-- Logs begin at Tue 2021-11-09 03:38:48 UTC, end at Tue 2021-11-09 05:31:46 UTC. -- Nov 09 04:19:53.124668 dv-neutron-816802-2-hyperv systemd[1]: Started Devstack devstack@q-svc.service. Nov 09 04:19:55.853750 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.common.config [-] Logging enabled! Nov 09 04:19:55.854390 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev151 Nov 09 04:19:55.854623 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=102048) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Nov 09 04:19:55.858595 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.common.config [-] Logging enabled! Nov 09 04:19:55.858846 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev151 Nov 09 04:19:55.859153 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=102048) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Nov 09 04:19:55.860094 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 09 04:19:55.860324 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 09 04:19:55.860685 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 09 04:19:55.860928 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 09 04:19:55.861148 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 09 04:19:55.861459 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] allow_bulk = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.861875 dv-neutron-816802-2-hyperv neutron-server[102048]: WARNING oslo_config.cfg [-] Deprecated: Option "allow_overlapping_ips" from group "DEFAULT" is deprecated for removal. Its value may be silently ignored in the future. Nov 09 04:19:55.862181 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] allow_overlapping_ips = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.862495 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] api_extensions_path = {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.862792 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] api_paste_config = api-paste.ini {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.863083 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] api_workers = 2 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.863368 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] auth_strategy = keystone {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.863648 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] backlog = 4096 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.863933 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] base_mac = fa:16:3e:00:00:00 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.864228 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] bind_host = 0.0.0.0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.864511 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] bind_port = 9696 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.864786 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] client_socket_timeout = 900 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.865066 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] config_dir = [] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.865352 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.865632 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] config_source = [] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.865915 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] control_exchange = neutron {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.866197 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] core_plugin = ml2 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.866503 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] debug = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.866785 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] default_availability_zones = [] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.867215 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.867611 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] dhcp_agent_notification = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.867890 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] dhcp_lease_duration = 86400 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.868175 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] dns_domain = openstacklocal {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.868449 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] enable_traditional_dhcp = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.868717 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] external_dns_driver = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.868988 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] filter_validation = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.869269 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] global_physnet_mtu = 1500 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.869593 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] host = dv-neutron-816802-2-hyperv {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.869868 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] http_retries = 3 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.870237 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] instance_format = [instance: %(uuid)s] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.870573 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.870858 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] ipam_driver = internal {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.871132 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] ipv6_pd_enabled = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.871404 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] log_config_append = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.871685 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.871955 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] log_dir = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.872223 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] log_file = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.872496 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] log_rotate_interval = 1 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.872783 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] log_rotate_interval_type = days {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.873065 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] log_rotation_type = none {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.873360 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.873580 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.873797 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.874081 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.874388 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.874665 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] max_dns_nameservers = 5 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.874937 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] max_header_line = 16384 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.875209 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] max_logfile_count = 30 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.875479 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] max_logfile_size_mb = 200 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.875749 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] max_subnet_host_routes = 20 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.876014 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] network_link_prefix = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.876294 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.876575 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.876856 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] pagination_max_limit = -1 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.877128 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] periodic_fuzzy_delay = 5 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.877397 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] periodic_interval = 40 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.877664 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] publish_errors = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.877933 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] rate_limit_burst = 0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.878215 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] rate_limit_except_level = CRITICAL {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.878509 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] rate_limit_interval = 0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.878781 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] retry_until_window = 30 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.879051 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] rpc_response_max_timeout = 600 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.879333 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] rpc_state_report_workers = 0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.879598 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] rpc_workers = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.879914 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] send_events_interval = 2 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.880160 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.880444 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] setproctitle = on {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.880723 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] state_path = /opt/stack/data/neutron {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.881004 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] syslog_log_facility = LOG_USER {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.881274 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] tcp_keepidle = 600 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.881550 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] transport_url = **** {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.881820 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] use_eventlog = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.882087 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] use_journal = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.882379 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] use_json = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.882643 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] use_ssl = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.882914 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] use_stderr = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.883210 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] use_syslog = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.883444 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] vlan_transparent = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.883709 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] watch_log_file = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.883977 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] wsgi_default_pool_size = 100 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.884243 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] wsgi_keep_alive = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.884521 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:55.884812 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.885102 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.885397 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] profiler.connection_string = messaging:// {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.885674 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] profiler.enabled = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.886003 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] profiler.es_doc_type = notification {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.886280 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] profiler.es_scroll_size = 10000 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.886587 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] profiler.es_scroll_time = 2m {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.886862 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] profiler.filter_error_trace = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.887146 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] profiler.hmac_keys = SECRET_KEY {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.887428 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.887710 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] profiler.socket_timeout = 0.1 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.887984 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.888269 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.888543 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.888835 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.889139 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.889431 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.889721 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.890019 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.890265 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.890561 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.890840 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.891128 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.891404 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.891689 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.891977 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.892256 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.892541 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] nova.auth_section = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.892836 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] nova.auth_type = password {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.893122 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.893391 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] nova.certfile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.893666 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] nova.collect_timing = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.893952 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] nova.endpoint_type = public {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.894268 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] nova.insecure = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.894517 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] nova.keyfile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.894792 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] nova.live_migration_events = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.895076 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] nova.region_name = RegionOne {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.895349 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] nova.split_loggers = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.895619 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] nova.timeout = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.895893 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] placement.auth_section = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.896169 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] placement.auth_type = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.896438 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] placement.cafile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.896706 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] placement.certfile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.896979 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] placement.collect_timing = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.897265 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] placement.endpoint_type = public {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.897535 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] placement.insecure = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.897800 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] placement.keyfile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.898067 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] placement.region_name = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.898340 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] placement.split_loggers = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.898628 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] placement.timeout = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.898907 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] ironic.auth_section = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.899181 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] ironic.auth_type = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.899448 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] ironic.cafile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.899714 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] ironic.certfile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.899986 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] ironic.collect_timing = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.900255 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] ironic.connect_retries = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.900522 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] ironic.connect_retry_delay = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.900794 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] ironic.enable_notifications = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.901062 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] ironic.endpoint_override = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.901334 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] ironic.insecure = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.902117 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] ironic.interface = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.902412 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] ironic.keyfile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.902689 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] ironic.max_version = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.902957 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] ironic.min_version = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.903226 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] ironic.region_name = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.903496 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] ironic.service_name = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.903764 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] ironic.service_type = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.904035 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] ironic.split_loggers = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.904303 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] ironic.status_code_retries = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.904572 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.904839 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] ironic.timeout = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.905108 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] ironic.valid_interfaces = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.905377 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] ironic.version = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.905658 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.905952 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.906226 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.906528 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.906804 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.907080 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.907352 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.907628 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.907903 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.908177 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.908447 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.908734 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.909014 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.909299 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.909579 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.909853 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.910191 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.910466 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.910747 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.911021 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.911297 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.911574 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.911855 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.912142 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.912432 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.912727 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.913015 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version = {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.913304 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.913583 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.913890 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.914164 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:55.914393 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 09 04:19:55.914636 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=102048) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}} Nov 09 04:19:56.342314 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=102048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:19:56.342623 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" "released" by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=102048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:19:56.342922 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=102048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:19:56.343255 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.manager [-] Loading core plugin: ml2 Nov 09 04:19:56.661593 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:56.661806 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:56.662083 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:56.663296 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:56.663576 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:56.663838 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:56.698907 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:56.699187 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:56.699457 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:56.715208 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:56.715484 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:56.715753 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:56.745349 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:56.745631 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:56.745903 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:56.782483 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:56.782813 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:56.783104 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:57.017603 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_create 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:57.018192 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_update 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:57.018192 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment precommit_create 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:57.018422 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: network precommit_delete 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:57.019126 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment before_delete 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:57.145970 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_delete 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:57.146291 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent before_delete 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:57.146595 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_create 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:57.146866 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_create 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:57.147133 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_update 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:57.147450 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_create 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:57.147711 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_delete 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:57.147967 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_create 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:57.148221 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_delete 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:57.148500 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network after_delete 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:57.148759 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network precommit_delete 0 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:57.149023 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_create 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:57.149279 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_update 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:57.149530 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_delete 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:57.149785 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port provisioning_complete 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:57.150046 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:57.150300 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy after_delete 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:57.150596 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > agent after_update 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:57.150871 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_delete 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:57.151129 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet precommit_delete 0 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:57.151449 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:57.151703 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:57.151986 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:57.152363 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:57.152612 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:57.152857 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:57.153257 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=102048) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 09 04:19:57.153494 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=102048) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 09 04:19:57.153729 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=102048) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 09 04:19:57.153963 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=102048) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 09 04:19:57.154195 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=102048) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 09 04:19:57.154460 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=102048) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 09 04:19:57.154823 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] Nov 09 04:19:57.158003 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1'] Nov 09 04:19:57.161994 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete Nov 09 04:19:57.165816 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(300, 349)])]) Nov 09 04:19:57.167487 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'] Nov 09 04:19:57.167950 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']) Nov 09 04:19:57.168280 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan'] Nov 09 04:19:57.168658 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security'] Nov 09 04:19:57.171492 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security'] Nov 09 04:19:57.171744 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security'] Nov 09 04:19:57.172087 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv'] Nov 09 04:19:57.177369 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.plugins.ml2.drivers.mech_agent [-] HyperV agent's supported_vnic_types: ['normal', 'direct'] Nov 09 04:19:57.200505 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.plugins.ml2.drivers.mech_agent [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa'] Nov 09 04:19:57.200955 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > qos_plugin after_init 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:57.201252 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=102048) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:82}} Nov 09 04:19:57.201610 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > logging-plugin after_init 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:57.203016 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=102048) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}} Nov 09 04:19:57.203298 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv'] Nov 09 04:19:57.203546 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv'] Nov 09 04:19:57.206755 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip before_response 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:57.207038 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_response 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:57.270593 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat' Nov 09 04:19:57.270777 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete Nov 09 04:19:57.271016 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve' Nov 09 04:19:57.271380 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)] Nov 09 04:19:57.291515 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_db.sqlalchemy.engines [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102048) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 09 04:19:58.325099 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.plugins.ml2.managers [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Initializing driver for type 'gre' Nov 09 04:19:58.325733 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] gre ID ranges: [(1, 1000)] Nov 09 04:19:58.564186 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.plugins.ml2.managers [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Initializing driver for type 'local' Nov 09 04:19:58.564506 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.plugins.ml2.managers [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Initializing driver for type 'vlan' Nov 09 04:19:58.652816 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] VlanTypeDriver initialization complete Nov 09 04:19:58.653087 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.plugins.ml2.managers [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Initializing driver for type 'vxlan' Nov 09 04:19:58.653581 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] vxlan ID ranges: [(1, 1000)] Nov 09 04:19:58.893047 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.plugins.ml2.managers [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Initializing extension driver 'port_security' Nov 09 04:19:58.893385 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.plugins.ml2.extensions.port_security [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] PortSecurityExtensionDriver initialization complete Nov 09 04:19:58.893710 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.plugins.ml2.managers [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Initializing mechanism driver 'openvswitch' Nov 09 04:19:58.894034 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.plugins.ml2.managers [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Initializing mechanism driver 'hyperv' Nov 09 04:19:58.900733 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.plugins.ml2.plugin [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=102048) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:19:58.901696 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > port after_create 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.902064 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > port after_update 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.903617 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > port after_delete 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.903617 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[port] started {{(pid=102048) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 09 04:19:58.903617 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > subnet after_create 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.903876 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > subnet after_update 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.904104 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > subnet after_delete 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.904494 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[subnet] started {{(pid=102048) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 09 04:19:58.904894 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > network after_create 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.905233 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > network after_update 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.905569 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > network after_delete 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.905954 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[network] started {{(pid=102048) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 09 04:19:58.906352 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > security_group after_create 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.906721 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > security_group after_update 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.907055 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > security_group after_delete 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.907443 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group] started {{(pid=102048) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 09 04:19:58.907840 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > security_group_rule after_create 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.908178 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > security_group_rule after_update 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.908509 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > security_group_rule after_delete 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.908896 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group_rule] started {{(pid=102048) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 09 04:19:58.909649 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > address_group after_create 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.909991 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > address_group after_update 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.910326 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > address_group after_delete 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.910738 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[address_group] started {{(pid=102048) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 09 04:19:58.911116 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] ML2 OVO RPC backend initialized. {{(pid=102048) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:154}} Nov 09 04:19:58.911887 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > router_interface after_create 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.912241 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > router_interface after_delete 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.912695 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > network before_response 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.913040 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > networks before_response 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.913383 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > port before_response 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.913724 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > ports before_response 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.914060 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > subnet before_response 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.914420 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > subnets before_response 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.914763 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > network after_create 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.915138 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > network after_update 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.915586 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > network after_delete 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.915913 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > port after_create 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.916245 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > port after_update 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.916572 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > port after_delete 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.917411 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > subnet after_create 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.917740 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > subnet after_update 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.918066 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > subnet after_delete 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.918669 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.plugins.ml2.plugin [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Modular L2 Plugin initialization complete Nov 09 04:19:58.918999 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading services supported by the core plugin {{(pid=102048) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}} Nov 09 04:19:58.919318 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.plugins.ml2.managers [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Got port-security extension from driver 'port_security' Nov 09 04:19:58.919775 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.extensions.vlantransparent [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Disabled vlantransparent extension. Nov 09 04:19:58.920421 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=102048) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}} Nov 09 04:19:58.920737 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading Plugin: router Nov 09 04:19:58.962585 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > router_interface before_create 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.962973 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > router after_create 55549900 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.963338 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > router before_create 55549900 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.963696 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > router_interface before_delete 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.964083 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > router_interface after_delete 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.964433 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > router after_delete 55549900 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.964792 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > floatingip after_create 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.965253 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > floatingip after_update 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.965674 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > router after_create 55549900 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.966114 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > router after_update 55549900 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.966484 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > router after_update 55549900 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.966838 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > router_gateway after_delete 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.967190 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > router after_update 55549900 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.967596 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > router precommit_update 55549900 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.967961 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: port after_update 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.968290 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: port after_delete 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.968659 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: subnet after_update 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.968989 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: subnetpool_address_scope after_update 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.969330 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > port precommit_delete 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.969671 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > router precommit_create 55549900 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.970010 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: port before_delete 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.970348 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > router precommit_create 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.970727 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > router after_update 55549900 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.971063 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > router precommit_delete 55549900 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.971408 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > router precommit_create 55549900 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.971762 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > router_interface after_create 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.972100 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > router precommit_update 55549900 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.972457 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > agent after_create 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.972799 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > agent after_delete 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.973137 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > network after_delete 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.974032 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.quota.resource_registry [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Tracking information for resource: router configured {{(pid=102048) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 09 04:19:58.974384 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.quota.resource_registry [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Tracking information for resource: floatingip configured {{(pid=102048) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 09 04:19:58.983093 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.db.l3_agentschedulers_db [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Skipping period L3 agent status check because automatic router rescheduling is disabled. Nov 09 04:19:58.983670 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: port after_update 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.984029 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: port after_create 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.984379 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: port after_delete 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.984727 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: port after_update 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.985499 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > router before_create 55550100 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.985859 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > router precommit_delete 55550100 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.986215 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > router precommit_create 55550100 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.986592 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > router precommit_update 55550100 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:58.991466 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.services.provider_configuration [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Service providers = [] {{(pid=102048) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}} Nov 09 04:19:58.991829 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.db.servicetype_db [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=102048) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}} Nov 09 04:19:58.994770 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.services.service_base [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=102048) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 09 04:19:58.995757 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.services.service_base [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=102048) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 09 04:19:58.996093 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.services.service_base [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=102048) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 09 04:19:58.996982 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.services.service_base [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=102048) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 09 04:19:58.997349 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.services.service_base [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Default provider is not specified for service type L3_ROUTER_NAT Nov 09 04:19:58.997706 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=102048) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 09 04:19:58.998017 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin Nov 09 04:19:59.010087 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Successfully loaded METERING plugin. Description: METERING {{(pid=102048) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 09 04:19:59.010458 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading Plugin: auto_allocate Nov 09 04:19:59.016299 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: network precommit_update 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:59.016660 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: network precommit_create 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:59.017166 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=102048) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 09 04:19:59.017485 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading Plugin: tag Nov 09 04:19:59.024279 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=102048) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 09 04:19:59.024609 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading Plugin: timestamp Nov 09 04:19:59.028480 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=102048) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 09 04:19:59.028803 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading Plugin: network_ip_availability Nov 09 04:19:59.034431 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:59.034794 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:59.035146 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:59.035845 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=102048) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 09 04:19:59.036159 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading Plugin: flavors Nov 09 04:19:59.041117 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=102048) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 09 04:19:59.041447 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading Plugin: revisions Nov 09 04:19:59.046317 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=102048) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 09 04:19:59.046717 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_concurrency.lockutils [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Lock "manager" "released" by "neutron.manager.NeutronManager._create_instance" :: held 2.704s {{(pid=102048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:19:59.047459 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=102048) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:640}} Nov 09 04:19:59.047789 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Initializing extension manager. Nov 09 04:19:59.048295 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: __init__.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.048665 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: __pycache__ {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.049012 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.049340 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: address_group.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.050177 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.050750 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: address-group Nov 09 04:19:59.051067 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: address_scope.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.051770 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.052260 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: address-scope Nov 09 04:19:59.052616 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: admin_state_down_before_update.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.065338 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.065833 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: router-admin-state-down-before-update Nov 09 04:19:59.066152 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: agent.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.066866 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.067360 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: agent Nov 09 04:19:59.067673 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: agent_resources_synced.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.068580 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.069075 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: agent-resources-synced Nov 09 04:19:59.069389 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: allowedaddresspairs.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.071195 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.071706 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: allowed-address-pairs Nov 09 04:19:59.072103 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: auto_allocated_topology.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.073194 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.073696 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: auto-allocated-topology Nov 09 04:19:59.074018 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: availability_zone.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.074733 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.075229 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: availability_zone Nov 09 04:19:59.075550 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: availability_zone_filter.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.076492 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.077096 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: availability_zone_filter Nov 09 04:19:59.077418 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: data_plane_status.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.078312 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.078830 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extension data-plane-status not supported by any of loaded plugins Nov 09 04:19:59.079148 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: default_subnetpools.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.080050 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.080547 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: default-subnetpools Nov 09 04:19:59.080865 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: dhcpagentscheduler.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.081660 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.082153 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: dhcp_agent_scheduler Nov 09 04:19:59.082499 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: dns.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.083471 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.083955 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extension dns-integration not supported by any of loaded plugins Nov 09 04:19:59.084273 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: dns_domain_ports.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.085180 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.085737 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extension dns-domain-ports not supported by any of loaded plugins Nov 09 04:19:59.086057 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: dns_integration_domain_keywords.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.086994 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="DNS domain names with keywords allowed" alias="dns-integration-domain-keywords" description="Allows to use keywords like , , and as DNS domain name" updated="2020-06-15T18:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.087489 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extension dns-integration-domain-keywords not supported by any of loaded plugins Nov 09 04:19:59.087803 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: dvr.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.088509 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.089019 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: dvr Nov 09 04:19:59.089330 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: ecmp_routes.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.094318 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Equal Cost Multipath Routing" alias="ecmp_routes" description="Allows traffic to reach thesame destination via multiple different links " updated="2020-11-26T18:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.094833 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extension ecmp_routes not supported by any of loaded plugins Nov 09 04:19:59.095148 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: empty_string_filtering.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.096063 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.096553 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: empty-string-filtering Nov 09 04:19:59.096869 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.097777 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.098261 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins Nov 09 04:19:59.098603 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.099503 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.099989 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins Nov 09 04:19:59.100381 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: external_net.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.101283 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.101778 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: external-net Nov 09 04:19:59.102094 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: extra_dhcp_opt.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.103017 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.103509 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: extra_dhcp_opt Nov 09 04:19:59.103826 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: extraroute.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.105308 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.105895 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: extraroute Nov 09 04:19:59.106211 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: extraroute_atomic.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.107273 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.108024 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: extraroute-atomic Nov 09 04:19:59.108344 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: filter_validation.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.109169 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.109666 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: filter-validation Nov 09 04:19:59.109987 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: fip_pf_description.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.110913 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.111403 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins Nov 09 04:19:59.111720 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: fip_port_details.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.112701 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.113199 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: fip-port-details Nov 09 04:19:59.113515 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: flavors.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.114785 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.115290 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: flavors Nov 09 04:19:59.115610 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.117284 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.117790 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins Nov 09 04:19:59.118114 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: floatingip_pools.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.118824 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.119322 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: floatingip-pools Nov 09 04:19:59.119639 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: ip_allocation.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.121111 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.121601 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extension ip_allocation not supported by any of loaded plugins Nov 09 04:19:59.121919 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: ip_substring_port_filtering.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.122876 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.123379 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: ip-substring-filtering Nov 09 04:19:59.123701 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: l2_adjacency.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.124627 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.125119 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extension l2_adjacency not supported by any of loaded plugins Nov 09 04:19:59.125435 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: l3.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.126400 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.126906 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: router Nov 09 04:19:59.127222 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: l3_conntrack_helper.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.129435 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.129950 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extension l3-conntrack-helper not supported by any of loaded plugins Nov 09 04:19:59.130275 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: l3_ext_gw_mode.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.131225 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.131728 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: ext-gw-mode Nov 09 04:19:59.132047 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: l3_ext_ha_mode.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.132983 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.133475 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: l3-ha Nov 09 04:19:59.133788 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: l3_flavors.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.134785 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.135282 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: l3-flavors Nov 09 04:19:59.135620 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.136522 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.137018 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: l3-port-ip-change-not-allowed Nov 09 04:19:59.137332 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: l3agentscheduler.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.138377 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.138879 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: l3_agent_scheduler Nov 09 04:19:59.139200 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: logging.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.140701 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.141209 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extension logging not supported by any of loaded plugins Nov 09 04:19:59.141534 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: metering.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.142267 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.142871 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: metering Nov 09 04:19:59.143196 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.144403 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.144912 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: metering_source_and_destination_fields Nov 09 04:19:59.145239 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: multiprovidernet.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.146161 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.146689 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: multi-provider Nov 09 04:19:59.147014 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: netmtu.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.147919 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.148417 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: net-mtu Nov 09 04:19:59.148737 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: netmtu_writable.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.149646 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.150140 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: net-mtu-writable Nov 09 04:19:59.150492 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: network_availability_zone.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.151377 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.151871 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: network_availability_zone Nov 09 04:19:59.152188 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: network_ip_availability.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.153297 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.153841 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: network-ip-availability Nov 09 04:19:59.154117 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: network_segment_range.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.154894 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.155395 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extension network-segment-range not supported by any of loaded plugins Nov 09 04:19:59.155716 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: pagination.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.157047 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.157382 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: pagination Nov 09 04:19:59.157699 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: port_device_profile.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.159270 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.159799 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: port-device-profile Nov 09 04:19:59.160119 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: port_mac_address_regenerate.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.161042 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.161539 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: port-mac-address-regenerate Nov 09 04:19:59.161857 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: port_numa_affinity_policy.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.162794 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.163290 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: port-numa-affinity-policy Nov 09 04:19:59.163612 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: port_resource_request.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.164512 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.165000 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extension port-resource-request not supported by any of loaded plugins Nov 09 04:19:59.165315 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: port_resource_request_groups.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.166282 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Port Resource Request Groups" alias="port-resource-request-groups" description="Support requesting multiple groups of resources and traits from the same RP subtree in resource_request" updated="2021-08-02T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.167309 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extension port-resource-request-groups not supported by any of loaded plugins Nov 09 04:19:59.167629 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: portbindings.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.168553 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.169047 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: binding Nov 09 04:19:59.169362 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: portbindings_extended.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.170661 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.171158 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: binding-extended Nov 09 04:19:59.171477 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: portsecurity.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.172378 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.172873 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: port-security Nov 09 04:19:59.173189 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: project_id.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.174159 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.174521 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: project-id Nov 09 04:19:59.174844 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: providernet.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.175756 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.176255 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: provider Nov 09 04:19:59.176571 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: qos.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.180203 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.180713 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extension qos not supported by any of loaded plugins Nov 09 04:19:59.181040 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: qos_bw_limit_direction.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.182290 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.183359 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extension qos-bw-limit-direction not supported by any of loaded plugins Nov 09 04:19:59.183680 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.184606 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.185102 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins Nov 09 04:19:59.185422 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: qos_default.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.186328 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.186866 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extension qos-default not supported by any of loaded plugins Nov 09 04:19:59.187185 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: qos_fip.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.187832 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.188326 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extension qos-fip not supported by any of loaded plugins Nov 09 04:19:59.188643 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: qos_gateway_ip.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.189558 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.190054 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extension qos-gateway-ip not supported by any of loaded plugins Nov 09 04:19:59.190387 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: qos_port_network_policy.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.191297 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.191790 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extension qos-port-network-policy not supported by any of loaded plugins Nov 09 04:19:59.192105 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: qos_pps_minimum_rule.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.193145 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="QoS minimum packet rate rule" alias="qos-pps-minimum" description="Allow to configure QoS minimum packet rate rule." updated="2021-07-14T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.193645 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extension qos-pps-minimum not supported by any of loaded plugins Nov 09 04:19:59.193968 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: qos_pps_rule.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.195171 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="QoS Rule Type Packet per Second Extension" alias="qos-pps" description="Add QoS Rule Type Packet per Second" updated="2021-05-12T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.195849 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extension qos-pps not supported by any of loaded plugins Nov 09 04:19:59.196176 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: qos_rule_type_details.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.197088 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.197584 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extension qos-rule-type-details not supported by any of loaded plugins Nov 09 04:19:59.197904 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: qos_rules_alias.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.199010 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.199508 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extension qos-rules-alias not supported by any of loaded plugins Nov 09 04:19:59.199824 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: quota_check_limit.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.200733 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Quota engine limit check" alias="quota-check-limit" description="Support for checking the resource usage before applying a new quota limit" updated="2021-09-08T16:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.201232 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: quota-check-limit Nov 09 04:19:59.201550 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: quotasv2.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.202510 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per project" updated="2012-07-29T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.202840 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: quotas Nov 09 04:19:59.203154 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: quotasv2_detail.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.206275 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.206642 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: quota_details Nov 09 04:19:59.206972 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: rbac.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.208023 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.208536 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: rbac-policies Nov 09 04:19:59.208860 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: rbac_address_group.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.209790 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.210294 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: rbac-address-group Nov 09 04:19:59.210640 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: rbac_address_scope.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.211560 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.212067 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: rbac-address-scope Nov 09 04:19:59.212391 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: rbac_security_groups.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.213312 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.213859 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: rbac-security-groups Nov 09 04:19:59.214179 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: rbac_subnetpool.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.215111 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.215615 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: rbac-subnetpool Nov 09 04:19:59.215934 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: revisionifmatch.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.216848 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.217348 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: revision-if-match Nov 09 04:19:59.217666 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: revisions.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.218794 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.219300 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: standard-attr-revisions Nov 09 04:19:59.219621 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: router_availability_zone.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.220282 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.220779 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: router_availability_zone Nov 09 04:19:59.221097 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: routerservicetype.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.222003 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.222536 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extension router-service-type not supported by any of loaded plugins Nov 09 04:19:59.222853 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.223769 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.224264 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: security-groups-normalized-cidr Nov 09 04:19:59.224581 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: security_groups_port_filtering.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.225572 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.226070 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: port-security-groups-filtering Nov 09 04:19:59.226418 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: security_groups_remote_address_group.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.227338 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.227900 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: security-groups-remote-address-group Nov 09 04:19:59.228218 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: security_groups_shared_filtering.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.229144 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Security group filtering on the shared field" alias="security-groups-shared-filtering" description="Support filtering security groups on the shared field" updated="2021-10-05T09:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.230176 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: security-groups-shared-filtering Nov 09 04:19:59.230565 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: security_groups_shared_filtering_lib.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.231156 dv-neutron-816802-2-hyperv neutron-server[102048]: WARNING neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Did not find expected name "Security_groups_shared_filtering_lib" in /opt/stack/neutron/neutron/extensions/security_groups_shared_filtering_lib.py Nov 09 04:19:59.231470 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: securitygroup.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.241526 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.242046 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: security-group Nov 09 04:19:59.242403 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: segment.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.243189 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.243683 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extension segment not supported by any of loaded plugins Nov 09 04:19:59.244009 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.244985 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.245989 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins Nov 09 04:19:59.246311 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: servicetype.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.247451 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.247959 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: service-type Nov 09 04:19:59.248280 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: sorting.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.249261 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.249588 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: sorting Nov 09 04:19:59.249905 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: standard_attr_segment.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.250833 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.251324 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extension standard-attr-segment not supported by any of loaded plugins Nov 09 04:19:59.251641 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: standardattrdescription.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.252376 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.252872 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: standard-attr-description Nov 09 04:19:59.253189 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: stateful_security_group.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.254110 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.254639 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: stateful-security-group Nov 09 04:19:59.254961 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: stdattrs_common.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.255525 dv-neutron-816802-2-hyperv neutron-server[102048]: WARNING neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py Nov 09 04:19:59.255844 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.256766 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.257270 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins Nov 09 04:19:59.257588 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: subnet_onboard.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.258673 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.259181 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: subnet_onboard Nov 09 04:19:59.259503 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: subnet_segmentid_writable.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.260424 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.260946 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extension subnet-segmentid-writable not supported by any of loaded plugins Nov 09 04:19:59.261265 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: subnet_service_types.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.262181 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.262703 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: subnet-service-types Nov 09 04:19:59.263024 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: subnetallocation.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.264089 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.264588 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: subnet_allocation Nov 09 04:19:59.264910 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.265573 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.266066 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: subnetpool-prefix-ops Nov 09 04:19:59.266403 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.267326 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.267819 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins Nov 09 04:19:59.268137 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: tagging.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.269188 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.269695 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: standard-attr-tag Nov 09 04:19:59.270017 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: timestamp.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.271229 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.271734 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loaded extension: standard-attr-timestamp Nov 09 04:19:59.272057 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: trunk.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.273080 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.273580 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extension trunk not supported by any of loaded plugins Nov 09 04:19:59.273907 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: trunk_details.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.274850 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.275347 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extension trunk-details not supported by any of loaded plugins Nov 09 04:19:59.275666 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: uplink_status_propagation.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.276616 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.277110 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extension uplink-status-propagation not supported by any of loaded plugins Nov 09 04:19:59.277427 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Loading extension file: vlantransparent.py {{(pid=102048) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 09 04:19:59.278085 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=102048) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 09 04:19:59.278607 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extension vlan-transparent not supported by any of loaded plugins Nov 09 04:19:59.281058 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.quota.resource_registry [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Creating instance of TrackedResource for resource:network Nov 09 04:19:59.281587 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.quota.resource_registry [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Creating instance of TrackedResource for resource:subnet Nov 09 04:19:59.281984 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.quota.resource_registry [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Creating instance of TrackedResource for resource:subnetpool Nov 09 04:19:59.282407 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.quota.resource_registry [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Creating instance of TrackedResource for resource:port Nov 09 04:19:59.283620 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.v2.resource_helper [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102048) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 09 04:19:59.284061 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.v2.resource_helper [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Service FLAVORS assigned prefix: {{(pid=102048) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 09 04:19:59.284662 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.v2.resource_helper [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102048) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 09 04:19:59.285101 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.v2.resource_helper [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102048) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 09 04:19:59.285427 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.quota.resource_registry [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Creating instance of TrackedResource for resource:router Nov 09 04:19:59.285852 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.quota.resource_registry [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Creating instance of TrackedResource for resource:floatingip Nov 09 04:19:59.286342 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.v2.resource_helper [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Service METERING assigned prefix: /metering {{(pid=102048) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 09 04:19:59.287813 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:59.288175 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:59.288520 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102048) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:19:59.289526 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.quota.resource_registry [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Creating instance of CountableResource for resource:rbac_policy Nov 09 04:19:59.289960 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.quota.resource_registry [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Creating instance of TrackedResource for resource:security_group Nov 09 04:19:59.290626 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.quota.resource_registry [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Creating instance of TrackedResource for resource:security_group_rule Nov 09 04:19:59.291232 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.v2.resource_helper [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Service CORE assigned prefix: {{(pid=102048) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 09 04:19:59.291561 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.quota.resource_registry [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Creating instance of TrackedResource for resource:subnetpool Nov 09 04:19:59.292421 dv-neutron-816802-2-hyperv neutron-server[102048]: WARNING neutron.quota.resource_registry [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] subnetpool is already registered Nov 09 04:19:59.292846 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.v2.resource_helper [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Service CORE assigned prefix: {{(pid=102048) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 09 04:19:59.293166 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.quota.resource_registry [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Creating instance of TrackedResource for resource:subnetpool Nov 09 04:19:59.293493 dv-neutron-816802-2-hyperv neutron-server[102048]: WARNING neutron.quota.resource_registry [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] subnetpool is already registered Nov 09 04:19:59.295892 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.v2.resource_helper [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102048) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 09 04:19:59.296329 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.v2.resource_helper [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Service FLAVORS assigned prefix: {{(pid=102048) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 09 04:19:59.296943 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.v2.resource_helper [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102048) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 09 04:19:59.297377 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.v2.resource_helper [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102048) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 09 04:19:59.297708 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.quota.resource_registry [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Creating instance of TrackedResource for resource:router Nov 09 04:19:59.298043 dv-neutron-816802-2-hyperv neutron-server[102048]: WARNING neutron.quota.resource_registry [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] router is already registered Nov 09 04:19:59.298490 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.quota.resource_registry [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Creating instance of TrackedResource for resource:floatingip Nov 09 04:19:59.298824 dv-neutron-816802-2-hyperv neutron-server[102048]: WARNING neutron.quota.resource_registry [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] floatingip is already registered Nov 09 04:19:59.299290 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.v2.resource_helper [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Service METERING assigned prefix: /metering {{(pid=102048) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 09 04:19:59.299989 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.quota.resource_registry [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Creating instance of CountableResource for resource:rbac_policy Nov 09 04:19:59.300310 dv-neutron-816802-2-hyperv neutron-server[102048]: WARNING neutron.quota.resource_registry [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] rbac_policy is already registered Nov 09 04:19:59.300731 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.quota.resource_registry [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Creating instance of TrackedResource for resource:security_group Nov 09 04:19:59.301060 dv-neutron-816802-2-hyperv neutron-server[102048]: WARNING neutron.quota.resource_registry [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] security_group is already registered Nov 09 04:19:59.301470 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.quota.resource_registry [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Creating instance of TrackedResource for resource:security_group_rule Nov 09 04:19:59.301797 dv-neutron-816802-2-hyperv neutron-server[102048]: WARNING neutron.quota.resource_registry [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] security_group_rule is already registered Nov 09 04:19:59.302284 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.v2.resource_helper [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Service CORE assigned prefix: {{(pid=102048) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 09 04:19:59.302638 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.quota.resource_registry [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Creating instance of TrackedResource for resource:subnetpool Nov 09 04:19:59.302970 dv-neutron-816802-2-hyperv neutron-server[102048]: WARNING neutron.quota.resource_registry [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] subnetpool is already registered Nov 09 04:19:59.303382 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.v2.resource_helper [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Service CORE assigned prefix: {{(pid=102048) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 09 04:19:59.303699 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.quota.resource_registry [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Creating instance of TrackedResource for resource:subnetpool Nov 09 04:19:59.304023 dv-neutron-816802-2-hyperv neutron-server[102048]: WARNING neutron.quota.resource_registry [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] subnetpool is already registered Nov 09 04:19:59.305712 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extended resource: extensions {{(pid=102048) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 09 04:19:59.307205 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extended resource: address-groups {{(pid=102048) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 09 04:19:59.309267 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extended resource: address-scopes {{(pid=102048) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 09 04:19:59.310478 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extended resource: agents {{(pid=102048) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 09 04:19:59.311722 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extended resource: auto-allocated-topology {{(pid=102048) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 09 04:19:59.312953 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extended resource: availability_zones {{(pid=102048) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 09 04:19:59.314147 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extended resource: dhcp-networks {{(pid=102048) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 09 04:19:59.315572 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extended resource: dhcp-agents {{(pid=102048) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 09 04:19:59.317075 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extended resource: routers {{(pid=102048) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 09 04:19:59.319183 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extended resource: flavors {{(pid=102048) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 09 04:19:59.320441 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extended resource: service_profiles {{(pid=102048) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 09 04:19:59.321650 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extended resource: next_providers {{(pid=102048) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 09 04:19:59.323160 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extended resource: service_profiles {{(pid=102048) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 09 04:19:59.324658 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extended resource: floatingip-pools {{(pid=102048) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 09 04:19:59.325958 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extended resource: routers {{(pid=102048) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 09 04:19:59.328068 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extended resource: floatingips {{(pid=102048) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 09 04:19:59.329439 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extended resource: l3-routers {{(pid=102048) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 09 04:19:59.331016 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extended resource: l3-agents {{(pid=102048) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 09 04:19:59.332418 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extended resource: metering-labels {{(pid=102048) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 09 04:19:59.333648 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extended resource: metering-label-rules {{(pid=102048) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 09 04:19:59.335055 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extended resource: network-ip-availabilities {{(pid=102048) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 09 04:19:59.336302 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extended resource: bindings {{(pid=102048) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 09 04:19:59.337846 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extended resource: quotas {{(pid=102048) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 09 04:19:59.340049 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extended resource: quotas {{(pid=102048) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 09 04:19:59.341562 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extended resource: rbac-policies {{(pid=102048) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 09 04:19:59.342778 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extended resource: security-groups {{(pid=102048) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 09 04:19:59.344080 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extended resource: security-group-rules {{(pid=102048) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 09 04:19:59.345309 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extended resource: service-providers {{(pid=102048) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 09 04:19:59.346538 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extended resource: subnetpools {{(pid=102048) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 09 04:19:59.347925 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extended resource: subnetpools {{(pid=102048) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 09 04:19:59.349390 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extended resource: tags {{(pid=102048) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 09 04:19:59.351075 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extended resource: tags {{(pid=102048) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 09 04:19:59.352869 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extended resource: tags {{(pid=102048) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 09 04:19:59.355297 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extended resource: tags {{(pid=102048) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 09 04:19:59.356981 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extended resource: tags {{(pid=102048) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 09 04:19:59.359192 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extended resource: tags {{(pid=102048) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 09 04:19:59.360855 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extended resource: tags {{(pid=102048) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 09 04:19:59.363604 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extended resource: tags {{(pid=102048) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 09 04:19:59.365371 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extended resource: tags {{(pid=102048) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 09 04:19:59.367101 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron.api.extensions [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Extended resource: tags {{(pid=102048) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 09 04:19:59.373272 dv-neutron-816802-2-hyperv neutron-server[102048]: WARNING keystonemiddleware.auth_token [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 09 04:19:59.377750 dv-neutron-816802-2-hyperv neutron-server[102048]: WARNING keystonemiddleware.auth_token [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 09 04:19:59.386765 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_concurrency.lockutils [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Acquired lock "singleton_lock" {{(pid=102048) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 09 04:19:59.387234 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_concurrency.lockutils [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Releasing lock "singleton_lock" {{(pid=102048) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 09 04:19:59.387885 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO oslo_service.service [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Starting 2 workers Nov 09 04:19:59.392673 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Started child 102161 {{(pid=102048) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 09 04:19:59.397078 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Started child 102162 {{(pid=102048) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 09 04:19:59.398064 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:19:59.398714 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO neutron.service [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Neutron service started, listening on 0.0.0.0:9696 Nov 09 04:19:59.399271 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Publish callbacks [] for process, before_spawn {{(pid=102048) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:19:59.399557 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [-] (102161) wsgi starting up on http://0.0.0.0:9696 Nov 09 04:19:59.402332 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO oslo_service.service [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Starting 1 workers Nov 09 04:19:59.402507 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:19:59.403926 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [-] (102162) wsgi starting up on http://0.0.0.0:9696 Nov 09 04:19:59.407578 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Started child 102163 {{(pid=102048) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 09 04:19:59.408118 dv-neutron-816802-2-hyperv neutron-server[102048]: INFO oslo_service.service [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Starting 1 workers Nov 09 04:19:59.411304 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.service [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] calling RpcWorker wait() {{(pid=102163) _wait /opt/stack/neutron/neutron/service.py:128}} Nov 09 04:19:59.411837 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.service [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] returning from RpcWorker wait() {{(pid=102163) _wait /opt/stack/neutron/neutron/service.py:135}} Nov 09 04:19:59.412539 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Started child 102164 {{(pid=102048) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 09 04:19:59.413312 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG neutron_lib.callbacks.manager [None req-26b8955c-c6e1-4da7-85e6-e3ba921a3d19 None None] Publish callbacks [] for process, after_spawn {{(pid=102048) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:19:59.413425 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:19:59.413851 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:19:59.415276 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=102048) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Nov 09 04:19:59.415504 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 09 04:19:59.415686 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 09 04:19:59.415897 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 09 04:19:59.416227 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 09 04:19:59.416386 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 09 04:19:59.416922 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.417727 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.417981 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.418231 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.418546 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.418750 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:19:59.419199 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.419318 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.419547 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.419826 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.420070 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.420233 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.420322 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:19:59.420406 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.420617 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.420857 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.421143 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.421395 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.421633 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.421898 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.422063 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.422297 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] config_source = [] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.422595 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.422840 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.423099 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] debug = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.423336 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.423810 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.424033 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.424280 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.424494 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.424768 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.425020 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.425300 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.425557 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.425785 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.426028 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.426267 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.426527 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.426729 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.426975 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.427187 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.427443 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.427655 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.428136 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] host = dv-neutron-816802-2-hyperv {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.428372 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.428599 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.428827 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.429088 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.429330 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.429559 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.429805 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.430066 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.430306 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.430562 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.430808 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.431046 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.431255 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] log_dir = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.431488 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] log_file = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.431643 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] log_options = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.431853 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.432115 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.432376 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.432619 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.432782 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.432952 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.433204 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.433390 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.433610 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.433838 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.434048 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.434254 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.434497 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.434711 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.434970 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.435208 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.435455 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.435666 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.435907 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.436128 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.436350 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.436623 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.436801 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.437044 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.437287 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.437513 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.437769 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.437979 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.438213 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.438492 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.438724 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.438976 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.439206 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.439431 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.439708 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.439951 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.440171 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.440396 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.440679 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.440899 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.441144 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.441388 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.441598 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.441845 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.442053 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.442260 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] use_journal = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.442526 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] use_json = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.442733 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.442976 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.443199 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.443406 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.443670 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.443814 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.444022 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.444245 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.444685 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.444965 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.445273 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.445529 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.445759 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.445993 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.446235 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.446470 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.446729 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.446933 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.447227 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.447442 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.447739 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.447950 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.448261 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.448554 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.448819 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.449086 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.449327 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.449555 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.449795 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.450029 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.450295 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.450551 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.450795 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.451021 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.452736 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.453425 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.453565 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.453851 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.24/identity {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.454147 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.454407 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.454656 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.454911 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.455158 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.455415 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.455639 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.455915 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.456175 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.456398 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.456623 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.456857 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.457076 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.457325 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.457570 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.457828 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.458067 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.458292 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.458530 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.458754 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.458989 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.459224 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.459471 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.459707 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.459943 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.460191 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.460415 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.460630 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.460877 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.461098 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.461349 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.461613 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.461827 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.462039 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.462277 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.462509 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.462788 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.463004 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.463233 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.463441 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.464232 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.464469 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.464697 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.464934 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.465143 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.465356 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.465564 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.465773 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.466021 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.466248 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.466496 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.466729 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.466956 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.467168 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.467397 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.467663 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.468334 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.468693 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.468939 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.469208 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.469516 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.469888 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.470012 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.470266 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.470529 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.475696 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.475696 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.475696 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.475696 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.475696 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.475696 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.475696 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.475696 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.476320 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.476320 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.476320 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.476320 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.476320 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.476320 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.476320 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.476320 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.480861 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.481139 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.481401 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.481684 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.481956 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.482233 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.482525 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.483061 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.483311 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.483591 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.483920 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.484213 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.484489 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.484728 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.484978 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.485264 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.485525 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.485810 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.486048 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.486294 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.490844 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.490976 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.491170 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.491515 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.491984 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.491984 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.492267 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.492516 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.492743 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.492966 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.493335 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.493605 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.493860 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.494141 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.494481 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.494765 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.495063 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.495302 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.24/identity {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.495518 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.495750 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.495998 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.496232 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.496450 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.496664 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.496883 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.497099 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.497395 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.497631 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.497848 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.498066 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.498311 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.498557 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.498779 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.499030 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.499251 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.499475 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.499712 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.499928 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.500144 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.500367 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.500597 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.500844 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.501064 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.501340 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.501593 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.501808 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.502032 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.502255 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.502532 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.502747 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.502991 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.503236 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.503523 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.503739 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.503956 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.504168 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.504400 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.504623 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.504840 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.505095 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.505345 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.505683 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.505940 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.506225 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.506491 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.506727 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.506974 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.507198 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.507434 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.507667 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.507881 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.508391 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.508391 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.508589 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.508803 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.509029 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.509241 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.509452 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.509679 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.509909 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.510194 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.510472 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.510743 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.510981 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.511235 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.511441 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.511687 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.511894 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.512141 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.512359 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.512579 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.512785 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.513011 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.513216 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.513421 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.513639 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.513851 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.514057 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.514327 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.514580 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.514817 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.515030 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.515243 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.515474 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.515718 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.515927 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.516134 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.516350 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.516562 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.516790 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.517032 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.517247 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.517453 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.517690 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.517904 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.518137 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.518481 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.518729 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.518965 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.519245 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.519470 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.519711 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.519932 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.520236 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.520452 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.520686 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.520902 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.521117 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.521334 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.521583 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.521901 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.522175 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.522461 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.522714 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.522999 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.523267 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:300:349'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.523531 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.523760 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.524046 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.524391 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.524654 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.524931 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.525173 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.525406 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.525647 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.525860 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.526093 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.526866 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.527080 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.527351 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.527580 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.527805 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.528040 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.528263 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.528496 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.528716 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.528944 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.529162 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.529431 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.529590 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 09 04:19:59.530193 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=102048) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Nov 09 04:19:59.530391 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 09 04:19:59.530528 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 09 04:19:59.530698 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 09 04:19:59.530865 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 09 04:19:59.531013 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 09 04:19:59.531388 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.531547 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.531704 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.531865 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.532022 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.532204 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.532349 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.532499 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.532651 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.532800 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.532960 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.533115 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.533279 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.533427 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.533589 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.533743 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.533886 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.534026 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.534192 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.534345 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] config_source = [] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.534525 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.534672 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.534830 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] debug = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.534986 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.535202 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.535364 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.535523 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.535680 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.535835 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.535990 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.536141 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.536441 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.536737 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.536896 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.537055 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.537211 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.537372 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.537529 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.537672 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.537815 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.537965 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.538159 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] host = dv-neutron-816802-2-hyperv {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.538260 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.538429 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.538585 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.538737 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.538893 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.539047 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.539201 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.539356 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.539503 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.539651 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.539800 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.539948 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.540097 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] log_dir = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.540254 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] log_file = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.540406 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] log_options = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.540560 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.540714 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.540868 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.541048 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.541208 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.541368 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.541525 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.541684 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.541882 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.542549 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.542704 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.542858 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.543013 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.543187 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.543340 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.543494 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.543649 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.543803 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.543958 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.544114 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.544268 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.544423 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.544576 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.544729 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.544883 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.545037 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.545191 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.545345 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.545498 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.545652 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.545806 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.545951 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.546083 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.546237 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.546408 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.546564 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.546718 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.546871 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.547028 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.547182 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.547336 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.547490 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.547648 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.547802 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.547955 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.548109 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] use_journal = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.548264 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] use_json = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.548416 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.548570 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.548723 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.548877 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.549029 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.549191 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.549337 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.549493 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:19:59.549667 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.549827 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.549994 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.550152 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.550317 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.550491 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.550650 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.550807 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.550964 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.551120 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.551283 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.551441 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.551610 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.551767 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.551924 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.552070 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.552227 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.552384 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.552541 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.552699 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.552855 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.553011 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.553179 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.553338 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.553497 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.553654 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.553813 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.553986 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.554145 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.554307 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.24/identity {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.554496 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.554720 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.554818 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.554960 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.555118 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.555276 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.555434 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.555591 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.555749 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.555907 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.556063 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.556220 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.556379 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.556535 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.556694 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.556851 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.557007 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.557162 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.557320 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.557500 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.557665 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.557823 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.557981 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.558139 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.558296 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.558488 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.558646 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.558803 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.558960 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.559117 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.559273 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.559429 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.559585 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.559742 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.559900 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.560056 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.560225 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.560383 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.560541 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.560699 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.560856 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.561013 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.561171 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.561328 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.561485 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.561643 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.561801 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.561958 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.562116 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.562274 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.562454 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.562612 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.562769 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.562925 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.563081 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.563238 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.563399 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.563542 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.563700 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.563865 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.564037 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.564194 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.564351 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.564506 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.564662 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.564818 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.564975 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.565197 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.565568 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.565568 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.565742 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.565821 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.565944 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.566101 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.566257 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.566438 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.566597 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.566751 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.566908 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.567065 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.567223 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.567377 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.567688 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.567994 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.568284 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.568581 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.568887 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.569176 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.569476 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.569641 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.569810 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.569979 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.570138 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.570295 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.570476 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.570634 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.570987 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.570987 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.571131 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.571236 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.571394 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.571553 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.571719 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.571888 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.572048 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.572208 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.572371 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.572552 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.572708 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.572865 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.573049 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.573200 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.573357 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.573518 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.573664 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.573818 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.573975 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.574133 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.574292 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.24/identity {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.574485 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.574612 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.574773 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.574930 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.575089 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.575246 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.575416 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.575553 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.575706 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.575862 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.576018 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.576174 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.576316 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.576536 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.576679 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.576767 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.576919 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.577075 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.577231 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.577387 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.577548 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.577704 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.577861 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.578016 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.578172 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.578331 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.578509 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.578667 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.578826 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.578983 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.579141 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.579298 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.579457 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.579615 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.579773 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.579931 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.580089 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.580246 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.580403 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.580558 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.580715 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.580871 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.581028 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.581200 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.581358 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.581517 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.581674 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.581832 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.581990 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.582148 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.582305 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.582488 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.582645 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.582801 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.582960 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.583120 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.583279 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.583436 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.583593 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.583749 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.583905 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.584063 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.584231 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.584392 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.584549 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.584708 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.584865 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.585024 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.585190 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.585348 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.585504 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.585662 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.585817 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.585975 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.586140 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.586298 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.586476 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.586639 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.586795 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.586943 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.587104 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.587263 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.587419 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.587582 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.587737 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.587895 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.588059 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.588217 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.588374 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.588529 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.589189 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.589358 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.589525 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.589684 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.589841 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.590000 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.590155 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.590312 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.590501 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.590658 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.590750 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:19:59.590836 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.590968 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.591127 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.591287 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.591447 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.591617 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.591775 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.591936 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.592092 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.592250 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.592409 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.592568 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.592729 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.592903 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.593063 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.593222 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.593388 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.593553 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:300:349'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.593718 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.593874 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.594038 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.594250 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.594343 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.594526 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.594684 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.594842 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.594999 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.595158 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.595314 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.595472 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.595628 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.595784 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.595939 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.596097 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.596254 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.596411 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.596567 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.596726 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.596884 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.597039 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.597195 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:19:59.597346 dv-neutron-816802-2-hyperv neutron-server[102048]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 09 04:19:59.801679 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 50700) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:19:59.810814 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [-] 10.222.0.24 "GET / HTTP/1.1" status: 200 len: 253 time: 0.0069788 Nov 09 04:20:11.284754 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-710bf9a3-f68d-4871-8d85-f46adf2002f1 None None] get_active_networks_info from dv-neutron-816802-2-hyperv {{(pid=102163) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}} Nov 09 04:20:11.365197 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-710bf9a3-f68d-4871-8d85-f46adf2002f1 None None] No non-hosted networks {{(pid=102163) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}} Nov 09 04:20:11.373197 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.agentschedulers_db [None req-710bf9a3-f68d-4871-8d85-f46adf2002f1 None None] DHCP Agent not found on host dv-neutron-816802-2-hyperv {{(pid=102163) list_active_networks_on_active_dhcp_agent /opt/stack/neutron/neutron/db/agentschedulers_db.py:455}} Nov 09 04:20:11.498156 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-57615f19-aaa1-4d91-9a2d-3f16734584a5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-465384'] for agent, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:13.701494 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c826f80f-e1e7-4bd7-a621-ff7d585e8702 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-465384'] for agent, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:13.740662 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.db.api [None req-cccbe5e3-3c89-4621-8fa1-533364e1458b None None] Retry wrapper got retriable exception: Failed to create a duplicate Agent: for attribute(s) ['agent_type', 'host'] with value(s) L3 agent-dv-neutron-816802-2-hyperv {{(pid=102163) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:20:13.741538 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG oslo_db.api [None req-cccbe5e3-3c89-4621-8fa1-533364e1458b None None] Performing DB retry for function neutron.db.agents_db.AgentDbMixin.create_or_update_agent {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:20:14.312904 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-cccbe5e3-3c89-4621-8fa1-533364e1458b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:15.035364 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-465384'] for agent, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:16.384173 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-465384'] for agent, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:17.011806 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-465384'] for agent, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:17.012998 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:20:17.013338 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:20:17.013660 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:20:17.013982 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:20:17.014297 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:20:17.014655 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:20:17.014982 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:20:17.015314 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:20:17.015631 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:20:17.015959 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:20:17.016289 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:20:17.016607 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:20:17.017017 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (, 'Open vSwitch agent', 'dv-neutron-816802-2-hyperv', {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:20:17.023646 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'dv-neutron-816802-2-hyperv', 'version_map': {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:20:17.783050 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 50792) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:20:18.289177 dv-neutron-816802-2-hyperv neutron-server[102162]: WARNING oslo_policy.policy [None req-370ee166-e2b5-483f-a17f-7bff8c8a958f admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 09 04:20:18.289753 dv-neutron-816802-2-hyperv neutron-server[102162]: WARNING oslo_policy.policy [None req-370ee166-e2b5-483f-a17f-7bff8c8a958f admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 09 04:20:18.513590 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [None req-370ee166-e2b5-483f-a17f-7bff8c8a958f admin admin] http://10.222.0.24:9696/v2.0/extensions returned with HTTP 200 {{(pid=102162) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:20:18.515836 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-370ee166-e2b5-483f-a17f-7bff8c8a958f admin admin] 10.222.0.24 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.7310727 Nov 09 04:20:21.015929 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 50808) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:20:21.121715 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.db.l3_hamode_db [None req-97b9c580-156e-486a-9013-96d7fd00cabf None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1 Nov 09 04:20:21.197010 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-97b9c580-156e-486a-9013-96d7fd00cabf None None] Routers set() bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:20:21.197400 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-97b9c580-156e-486a-9013-96d7fd00cabf None None] Router IDs set() for agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:462}} Nov 09 04:20:21.327288 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-d066e181-9a3c-4a84-9318-94edd563d613 admin admin] Request body: {'subnetpool': {'is_default': True, 'name': 'shared-default-subnetpool-v4', 'default_prefixlen': 26, 'shared': True, 'prefixes': ['172.20.0.0/16']}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:20:21.422106 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.policy [None req-d066e181-9a3c-4a84-9318-94edd563d613 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=102162) register_rules /opt/stack/neutron/neutron/policy.py:73}} Nov 09 04:20:21.467993 dv-neutron-816802-2-hyperv neutron-server[102162]: WARNING oslo_policy.policy [None req-d066e181-9a3c-4a84-9318-94edd563d613 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 09 04:20:21.468357 dv-neutron-816802-2-hyperv neutron-server[102162]: WARNING oslo_policy.policy [None req-d066e181-9a3c-4a84-9318-94edd563d613 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 09 04:20:21.476794 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.quota [None req-d066e181-9a3c-4a84-9318-94edd563d613 admin admin] Loaded quota_driver: . Nov 09 04:20:21.674002 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d066e181-9a3c-4a84-9318-94edd563d613 admin admin] Publish callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8756749555575', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8756749554978', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8756749641653', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8756749639153', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8756750245414', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8756749652335', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-1497589', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-1330384', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-344990', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-674709'] for rbac-policy, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:21.874054 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d066e181-9a3c-4a84-9318-94edd563d613 admin admin] Publish callbacks [] for subnetpool, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:21.875272 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-d066e181-9a3c-4a84-9318-94edd563d613 admin admin] 10.222.0.24 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 739 time: 0.8583126 Nov 09 04:20:25.055288 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 50820) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:20:25.537371 dv-neutron-816802-2-hyperv neutron-server[102161]: WARNING oslo_policy.policy [None req-e0ac1cb2-07c2-4573-9cd8-84fafa997d57 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 09 04:20:25.537974 dv-neutron-816802-2-hyperv neutron-server[102161]: WARNING oslo_policy.policy [None req-e0ac1cb2-07c2-4573-9cd8-84fafa997d57 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 09 04:20:25.759787 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-e0ac1cb2-07c2-4573-9cd8-84fafa997d57 admin admin] Request body: {'network': {'project_id': 'd3329127c71f406ea2af68ae8f335b96', 'admin_state_up': True, 'tenant_id': 'd3329127c71f406ea2af68ae8f335b96', 'name': 'private'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:20:25.761344 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.quota [None req-e0ac1cb2-07c2-4573-9cd8-84fafa997d57 admin admin] Loaded quota_driver: . Nov 09 04:20:25.875111 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e0ac1cb2-07c2-4573-9cd8-84fafa997d57 admin admin] Made reservation on behalf of d3329127c71f406ea2af68ae8f335b96 for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:20:25.970640 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.policy [None req-e0ac1cb2-07c2-4573-9cd8-84fafa997d57 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=102161) register_rules /opt/stack/neutron/neutron/policy.py:73}} Nov 09 04:20:26.017226 dv-neutron-816802-2-hyperv neutron-server[102161]: WARNING oslo_policy.policy [None req-e0ac1cb2-07c2-4573-9cd8-84fafa997d57 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 09 04:20:26.017576 dv-neutron-816802-2-hyperv neutron-server[102161]: WARNING oslo_policy.policy [None req-e0ac1cb2-07c2-4573-9cd8-84fafa997d57 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 09 04:20:26.028668 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e0ac1cb2-07c2-4573-9cd8-84fafa997d57 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:26.049172 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e0ac1cb2-07c2-4573-9cd8-84fafa997d57 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:26.156684 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e0ac1cb2-07c2-4573-9cd8-84fafa997d57 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:26.223381 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e0ac1cb2-07c2-4573-9cd8-84fafa997d57 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:26.243101 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e0ac1cb2-07c2-4573-9cd8-84fafa997d57 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 322} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:20:26.271978 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e0ac1cb2-07c2-4573-9cd8-84fafa997d57 admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8756747342888', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:26.272478 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e0ac1cb2-07c2-4573-9cd8-84fafa997d57 admin admin] Unsubscribe: segment precommit_create {{(pid=102161) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Nov 09 04:20:26.273000 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-e0ac1cb2-07c2-4573-9cd8-84fafa997d57 admin admin] Added segment 2bf0c19c-e72c-47a7-afb9-2d333299c92e of type vlan for network 121bb256-b908-4ce1-9802-a8de3aeeb775 Nov 09 04:20:26.292964 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0ac1cb2-07c2-4573-9cd8-84fafa997d57 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8563c4bb-594f-4d47-b8d7-b9e8b97e359b,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:20:26.310952 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0ac1cb2-07c2-4573-9cd8-84fafa997d57 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:20:26.311310 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0ac1cb2-07c2-4573-9cd8-84fafa997d57 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:20:26.311645 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0ac1cb2-07c2-4573-9cd8-84fafa997d57 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:20:26.311970 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0ac1cb2-07c2-4573-9cd8-84fafa997d57 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:20:26.312289 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0ac1cb2-07c2-4573-9cd8-84fafa997d57 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:20:26.312629 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0ac1cb2-07c2-4573-9cd8-84fafa997d57 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:20:26.312950 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0ac1cb2-07c2-4573-9cd8-84fafa997d57 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:20:26.313278 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0ac1cb2-07c2-4573-9cd8-84fafa997d57 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:20:26.313596 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0ac1cb2-07c2-4573-9cd8-84fafa997d57 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:20:26.313910 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0ac1cb2-07c2-4573-9cd8-84fafa997d57 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:20:26.314220 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0ac1cb2-07c2-4573-9cd8-84fafa997d57 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:20:26.314551 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0ac1cb2-07c2-4573-9cd8-84fafa997d57 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:20:26.315852 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0ac1cb2-07c2-4573-9cd8-84fafa997d57 admin admin] Tracked resource versions report: Nov 09 04:20:26.315852 dv-neutron-816802-2-hyperv neutron-server[102161]: pushed versions: Nov 09 04:20:26.315852 dv-neutron-816802-2-hyperv neutron-server[102161]: { 'AddressGroup': {'1.2'}, Nov 09 04:20:26.315852 dv-neutron-816802-2-hyperv neutron-server[102161]: 'ConntrackHelper': {'1.0'}, Nov 09 04:20:26.315852 dv-neutron-816802-2-hyperv neutron-server[102161]: 'Log': {'1.0'}, Nov 09 04:20:26.315852 dv-neutron-816802-2-hyperv neutron-server[102161]: 'Network': {'1.1'}, Nov 09 04:20:26.315852 dv-neutron-816802-2-hyperv neutron-server[102161]: 'Port': {'1.7'}, Nov 09 04:20:26.315852 dv-neutron-816802-2-hyperv neutron-server[102161]: 'PortForwarding': {'1.2'}, Nov 09 04:20:26.315852 dv-neutron-816802-2-hyperv neutron-server[102161]: 'QosPolicy': {'1.10'}, Nov 09 04:20:26.315852 dv-neutron-816802-2-hyperv neutron-server[102161]: 'SecurityGroup': {'1.5'}, Nov 09 04:20:26.315852 dv-neutron-816802-2-hyperv neutron-server[102161]: 'SecurityGroupRule': {'1.2'}, Nov 09 04:20:26.315852 dv-neutron-816802-2-hyperv neutron-server[102161]: 'SubPort': {'1.0'}, Nov 09 04:20:26.315852 dv-neutron-816802-2-hyperv neutron-server[102161]: 'Subnet': {'1.1'}, Nov 09 04:20:26.315852 dv-neutron-816802-2-hyperv neutron-server[102161]: 'Trunk': {'1.1'}} Nov 09 04:20:26.315852 dv-neutron-816802-2-hyperv neutron-server[102161]: consumer versions: Nov 09 04:20:26.315852 dv-neutron-816802-2-hyperv neutron-server[102161]: { DHCP agent@dv-neutron-816802-2-hyperv: {}, Nov 09 04:20:26.315852 dv-neutron-816802-2-hyperv neutron-server[102161]: L3 agent@dv-neutron-816802-2-hyperv: {}, Nov 09 04:20:26.315852 dv-neutron-816802-2-hyperv neutron-server[102161]: Metadata agent@dv-neutron-816802-2-hyperv: {}, Nov 09 04:20:26.315852 dv-neutron-816802-2-hyperv neutron-server[102161]: Metering agent@dv-neutron-816802-2-hyperv: {}, Nov 09 04:20:26.315852 dv-neutron-816802-2-hyperv neutron-server[102161]: Open vSwitch agent@dv-neutron-816802-2-hyperv: { 'AddressGroup': '1.2', Nov 09 04:20:26.315852 dv-neutron-816802-2-hyperv neutron-server[102161]: 'ConntrackHelper': '1.0', Nov 09 04:20:26.315852 dv-neutron-816802-2-hyperv neutron-server[102161]: 'Log': '1.0', Nov 09 04:20:26.315852 dv-neutron-816802-2-hyperv neutron-server[102161]: 'Network': '1.1', Nov 09 04:20:26.315852 dv-neutron-816802-2-hyperv neutron-server[102161]: 'Port': '1.7', Nov 09 04:20:26.315852 dv-neutron-816802-2-hyperv neutron-server[102161]: 'PortForwarding': '1.2', Nov 09 04:20:26.315852 dv-neutron-816802-2-hyperv neutron-server[102161]: 'QosPolicy': '1.10', Nov 09 04:20:26.315852 dv-neutron-816802-2-hyperv neutron-server[102161]: 'SecurityGroup': '1.5', Nov 09 04:20:26.315852 dv-neutron-816802-2-hyperv neutron-server[102161]: 'SecurityGroupRule': '1.2', Nov 09 04:20:26.315852 dv-neutron-816802-2-hyperv neutron-server[102161]: 'SubPort': '1.0', Nov 09 04:20:26.315852 dv-neutron-816802-2-hyperv neutron-server[102161]: 'Subnet': '1.1', Nov 09 04:20:26.315852 dv-neutron-816802-2-hyperv neutron-server[102161]: 'Trunk': '1.1'}} Nov 09 04:20:26.315852 dv-neutron-816802-2-hyperv neutron-server[102161]: {{(pid=102161) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 09 04:20:26.401891 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e0ac1cb2-07c2-4573-9cd8-84fafa997d57 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:26.495047 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e0ac1cb2-07c2-4573-9cd8-84fafa997d57 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:26.496869 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e0ac1cb2-07c2-4573-9cd8-84fafa997d57 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:20:26.498846 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e0ac1cb2-07c2-4573-9cd8-84fafa997d57 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:26.599236 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0ac1cb2-07c2-4573-9cd8-84fafa997d57 admin admin] Pushing event updated for resources: {'Network': ['ID=121bb256-b908-4ce1-9802-a8de3aeeb775,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:20:26.610379 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 121bb256-b908-4ce1-9802-a8de3aeeb775 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:20:26.638497 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-e0ac1cb2-07c2-4573-9cd8-84fafa997d57 admin admin] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 849 time: 1.5808868 Nov 09 04:20:29.413836 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 50842) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:20:29.788704 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8729705a-2705-4490-88f3-d58898688777 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:20:29.790063 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-8729705a-2705-4490-88f3-d58898688777 admin admin] 10.222.0.24 "GET /v2.0/networks/121bb256-b908-4ce1-9802-a8de3aeeb775 HTTP/1.1" status: 200 len: 825 time: 0.3752611 Nov 09 04:20:29.829617 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-687f6573-b2a2-47dd-ab2c-8a0dfdf93069 admin admin] 10.222.0.24 "GET /v2.0/subnetpools/6a6005dc-0303-432d-b81f-8302b2205f0a HTTP/1.1" status: 200 len: 734 time: 0.0328016 Nov 09 04:20:29.838760 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-b32393ac-64b2-48d1-989c-a2102650a03c admin admin] Request body: {'subnet': {'subnetpool_id': '6a6005dc-0303-432d-b81f-8302b2205f0a', 'gateway_ip': '172.20.0.1', 'name': 'private-subnet', 'tenant_id': 'd3329127c71f406ea2af68ae8f335b96', 'network_id': '121bb256-b908-4ce1-9802-a8de3aeeb775', 'ip_version': 4}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:20:29.947002 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b32393ac-64b2-48d1-989c-a2102650a03c admin admin] Made reservation on behalf of d3329127c71f406ea2af68ae8f335b96 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:20:29.949861 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b32393ac-64b2-48d1-989c-a2102650a03c admin admin] Publish callbacks [] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:30.295369 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b32393ac-64b2-48d1-989c-a2102650a03c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:30.362665 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b32393ac-64b2-48d1-989c-a2102650a03c admin admin] Pushing event updated for resources: {'Subnet': ['ID=5e7620d7-182d-4c74-94b7-72b9b0a25a5c,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:20:30.364823 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b32393ac-64b2-48d1-989c-a2102650a03c admin admin] Checking segment: {'id': '2bf0c19c-e72c-47a7-afb9-2d333299c92e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 322, 'network_id': '121bb256-b908-4ce1-9802-a8de3aeeb775'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:20:30.365199 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b32393ac-64b2-48d1-989c-a2102650a03c admin admin] Network hostable DHCP agents. Network: 121bb256-b908-4ce1-9802-a8de3aeeb775, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:20:30.446084 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b32393ac-64b2-48d1-989c-a2102650a03c admin admin] Network 121bb256-b908-4ce1-9802-a8de3aeeb775 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:20:30.537477 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-b32393ac-64b2-48d1-989c-a2102650a03c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 121bb256-b908-4ce1-9802-a8de3aeeb775) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:20:30.542170 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b32393ac-64b2-48d1-989c-a2102650a03c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:20:30.542786 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b32393ac-64b2-48d1-989c-a2102650a03c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:30.547338 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f7150f79-8329-47c9-87ee-daf081d028c6 None None] Network 121bb256-b908-4ce1-9802-a8de3aeeb775 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:20:30.626101 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-b32393ac-64b2-48d1-989c-a2102650a03c admin admin] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 854 time: 0.7904708 Nov 09 04:20:30.864445 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a468ceae-0f5c-4170-bc1f-d24df3a86ced None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-121bb256-b908-4ce1-9802-a8de3aeeb775', 'network_id': '121bb256-b908-4ce1-9802-a8de3aeeb775', 'tenant_id': 'd3329127c71f406ea2af68ae8f335b96', 'fixed_ips': [{'subnet_id': '5e7620d7-182d-4c74-94b7-72b9b0a25a5c'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:20:30.865688 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a468ceae-0f5c-4170-bc1f-d24df3a86ced None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:31.222940 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-a468ceae-0f5c-4170-bc1f-d24df3a86ced None None] Allocated IP 172.20.0.2 (121bb256-b908-4ce1-9802-a8de3aeeb775/5e7620d7-182d-4c74-94b7-72b9b0a25a5c/4dd3ccf6-5e3f-494b-b5cd-5608ce84f9ae) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:20:31.429974 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a468ceae-0f5c-4170-bc1f-d24df3a86ced None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:31.495722 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a468ceae-0f5c-4170-bc1f-d24df3a86ced None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:31.576692 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a468ceae-0f5c-4170-bc1f-d24df3a86ced None None] Network 121bb256-b908-4ce1-9802-a8de3aeeb775 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:20:31.580844 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-a468ceae-0f5c-4170-bc1f-d24df3a86ced None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:20:31.582740 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a468ceae-0f5c-4170-bc1f-d24df3a86ced None None] Pushing event updated for resources: {'Port': ['ID=4dd3ccf6-5e3f-494b-b5cd-5608ce84f9ae,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:20:31.587340 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a468ceae-0f5c-4170-bc1f-d24df3a86ced None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:20:31.595517 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a468ceae-0f5c-4170-bc1f-d24df3a86ced None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:20:31.595886 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a468ceae-0f5c-4170-bc1f-d24df3a86ced None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:20:31.596226 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a468ceae-0f5c-4170-bc1f-d24df3a86ced None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:20:31.599557 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a468ceae-0f5c-4170-bc1f-d24df3a86ced None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:20:31.599557 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a468ceae-0f5c-4170-bc1f-d24df3a86ced None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:20:31.599557 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a468ceae-0f5c-4170-bc1f-d24df3a86ced None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:20:31.599557 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a468ceae-0f5c-4170-bc1f-d24df3a86ced None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:20:31.599557 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a468ceae-0f5c-4170-bc1f-d24df3a86ced None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:20:31.599893 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a468ceae-0f5c-4170-bc1f-d24df3a86ced None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:20:31.599893 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a468ceae-0f5c-4170-bc1f-d24df3a86ced None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:20:31.599893 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a468ceae-0f5c-4170-bc1f-d24df3a86ced None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:20:31.599893 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a468ceae-0f5c-4170-bc1f-d24df3a86ced None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:20:31.600495 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a468ceae-0f5c-4170-bc1f-d24df3a86ced None None] Tracked resource versions report: Nov 09 04:20:31.600495 dv-neutron-816802-2-hyperv neutron-server[102163]: pushed versions: Nov 09 04:20:31.600495 dv-neutron-816802-2-hyperv neutron-server[102163]: { 'AddressGroup': {'1.2'}, Nov 09 04:20:31.600495 dv-neutron-816802-2-hyperv neutron-server[102163]: 'ConntrackHelper': {'1.0'}, Nov 09 04:20:31.600495 dv-neutron-816802-2-hyperv neutron-server[102163]: 'Log': {'1.0'}, Nov 09 04:20:31.600495 dv-neutron-816802-2-hyperv neutron-server[102163]: 'Network': {'1.1'}, Nov 09 04:20:31.600495 dv-neutron-816802-2-hyperv neutron-server[102163]: 'Port': {'1.7'}, Nov 09 04:20:31.600495 dv-neutron-816802-2-hyperv neutron-server[102163]: 'PortForwarding': {'1.2'}, Nov 09 04:20:31.600495 dv-neutron-816802-2-hyperv neutron-server[102163]: 'QosPolicy': {'1.10'}, Nov 09 04:20:31.600495 dv-neutron-816802-2-hyperv neutron-server[102163]: 'SecurityGroup': {'1.5'}, Nov 09 04:20:31.600495 dv-neutron-816802-2-hyperv neutron-server[102163]: 'SecurityGroupRule': {'1.2'}, Nov 09 04:20:31.600495 dv-neutron-816802-2-hyperv neutron-server[102163]: 'SubPort': {'1.0'}, Nov 09 04:20:31.600495 dv-neutron-816802-2-hyperv neutron-server[102163]: 'Subnet': {'1.1'}, Nov 09 04:20:31.600495 dv-neutron-816802-2-hyperv neutron-server[102163]: 'Trunk': {'1.1'}} Nov 09 04:20:31.600495 dv-neutron-816802-2-hyperv neutron-server[102163]: consumer versions: Nov 09 04:20:31.600495 dv-neutron-816802-2-hyperv neutron-server[102163]: { DHCP agent@dv-neutron-816802-2-hyperv: {}, Nov 09 04:20:31.600495 dv-neutron-816802-2-hyperv neutron-server[102163]: L3 agent@dv-neutron-816802-2-hyperv: {}, Nov 09 04:20:31.600495 dv-neutron-816802-2-hyperv neutron-server[102163]: Metadata agent@dv-neutron-816802-2-hyperv: {}, Nov 09 04:20:31.600495 dv-neutron-816802-2-hyperv neutron-server[102163]: Metering agent@dv-neutron-816802-2-hyperv: {}, Nov 09 04:20:31.600495 dv-neutron-816802-2-hyperv neutron-server[102163]: Open vSwitch agent@dv-neutron-816802-2-hyperv: { 'AddressGroup': '1.2', Nov 09 04:20:31.600495 dv-neutron-816802-2-hyperv neutron-server[102163]: 'ConntrackHelper': '1.0', Nov 09 04:20:31.600495 dv-neutron-816802-2-hyperv neutron-server[102163]: 'Log': '1.0', Nov 09 04:20:31.600495 dv-neutron-816802-2-hyperv neutron-server[102163]: 'Network': '1.1', Nov 09 04:20:31.600495 dv-neutron-816802-2-hyperv neutron-server[102163]: 'Port': '1.7', Nov 09 04:20:31.600495 dv-neutron-816802-2-hyperv neutron-server[102163]: 'PortForwarding': '1.2', Nov 09 04:20:31.600495 dv-neutron-816802-2-hyperv neutron-server[102163]: 'QosPolicy': '1.10', Nov 09 04:20:31.600495 dv-neutron-816802-2-hyperv neutron-server[102163]: 'SecurityGroup': '1.5', Nov 09 04:20:31.600495 dv-neutron-816802-2-hyperv neutron-server[102163]: 'SecurityGroupRule': '1.2', Nov 09 04:20:31.600495 dv-neutron-816802-2-hyperv neutron-server[102163]: 'SubPort': '1.0', Nov 09 04:20:31.600495 dv-neutron-816802-2-hyperv neutron-server[102163]: 'Subnet': '1.1', Nov 09 04:20:31.600495 dv-neutron-816802-2-hyperv neutron-server[102163]: 'Trunk': '1.1'}} Nov 09 04:20:31.600495 dv-neutron-816802-2-hyperv neutron-server[102163]: {{(pid=102163) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 09 04:20:31.678063 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-a468ceae-0f5c-4170-bc1f-d24df3a86ced None None] Attempting to bind port 4dd3ccf6-5e3f-494b-b5cd-5608ce84f9ae on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:20:31.678495 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-a468ceae-0f5c-4170-bc1f-d24df3a86ced None None] Attempting to bind port 4dd3ccf6-5e3f-494b-b5cd-5608ce84f9ae by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '2bf0c19c-e72c-47a7-afb9-2d333299c92e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 322, 'network_id': '121bb256-b908-4ce1-9802-a8de3aeeb775'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:20:31.678911 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a468ceae-0f5c-4170-bc1f-d24df3a86ced None None] Attempting to bind port 4dd3ccf6-5e3f-494b-b5cd-5608ce84f9ae on network 121bb256-b908-4ce1-9802-a8de3aeeb775 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:20:31.683805 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a468ceae-0f5c-4170-bc1f-d24df3a86ced None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 20, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:20:31.684207 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a468ceae-0f5c-4170-bc1f-d24df3a86ced None None] Checking segment: {'id': '2bf0c19c-e72c-47a7-afb9-2d333299c92e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 322, 'network_id': '121bb256-b908-4ce1-9802-a8de3aeeb775'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:20:31.684679 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a468ceae-0f5c-4170-bc1f-d24df3a86ced None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:31.685065 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a468ceae-0f5c-4170-bc1f-d24df3a86ced None None] Bound using segment: {'id': '2bf0c19c-e72c-47a7-afb9-2d333299c92e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 322, 'network_id': '121bb256-b908-4ce1-9802-a8de3aeeb775'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:20:31.685567 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-a468ceae-0f5c-4170-bc1f-d24df3a86ced None None] Bound port: 4dd3ccf6-5e3f-494b-b5cd-5608ce84f9ae, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2bf0c19c-e72c-47a7-afb9-2d333299c92e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 322, 'network_id': '121bb256-b908-4ce1-9802-a8de3aeeb775'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:20:31.685985 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a468ceae-0f5c-4170-bc1f-d24df3a86ced None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:31.747176 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-a468ceae-0f5c-4170-bc1f-d24df3a86ced None None] For port 4dd3ccf6-5e3f-494b-b5cd-5608ce84f9ae, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:20:31.751323 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-a468ceae-0f5c-4170-bc1f-d24df3a86ced None None] For port 4dd3ccf6-5e3f-494b-b5cd-5608ce84f9ae, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=4dd3ccf6-5e3f-494b-b5cd-5608ce84f9ae,segment=NetworkSegment(2bf0c19c-e72c-47a7-afb9-2d333299c92e),segment_id=2bf0c19c-e72c-47a7-afb9-2d333299c92e)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:20:31.850135 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a468ceae-0f5c-4170-bc1f-d24df3a86ced None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:31.920876 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a468ceae-0f5c-4170-bc1f-d24df3a86ced None None] Pushing event updated for resources: {'Port': ['ID=4dd3ccf6-5e3f-494b-b5cd-5608ce84f9ae,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:20:33.156084 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 50850) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:20:33.463904 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [None req-de3d1c10-5cea-46c0-8233-caf4cfed4fad admin admin] http://10.222.0.24:9696/v2.0/extensions returned with HTTP 200 {{(pid=102161) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:20:33.465591 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-de3d1c10-5cea-46c0-8233-caf4cfed4fad admin admin] 10.222.0.24 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3084457 Nov 09 04:20:35.961880 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 50858) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:20:36.271039 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [None req-30940a95-ebba-4047-994a-2312f44866ef admin admin] http://10.222.0.24:9696/v2.0/extensions returned with HTTP 200 {{(pid=102162) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:20:36.286392 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-30940a95-ebba-4047-994a-2312f44866ef admin admin] 10.222.0.24 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3090842 Nov 09 04:20:39.015831 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 50868) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:20:39.305494 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-4f589bf8-58b3-4ebd-9fb2-5a61756dbe58 admin admin] Request body: {'router': {'tenant_id': 'd3329127c71f406ea2af68ae8f335b96', 'admin_state_up': True, 'name': 'router1'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:20:39.446652 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4f589bf8-58b3-4ebd-9fb2-5a61756dbe58 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:39.448383 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4f589bf8-58b3-4ebd-9fb2-5a61756dbe58 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:39.592067 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4f589bf8-58b3-4ebd-9fb2-5a61756dbe58 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:39.655848 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4f589bf8-58b3-4ebd-9fb2-5a61756dbe58 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:39.754408 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4f589bf8-58b3-4ebd-9fb2-5a61756dbe58 admin admin] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:39.755621 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-4f589bf8-58b3-4ebd-9fb2-5a61756dbe58 admin admin] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 0.7388442 Nov 09 04:20:40.587844 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 4dd3ccf6-5e3f-494b-b5cd-5608ce84f9ae up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:20:40.676745 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 4dd3ccf6-5e3f-494b-b5cd-5608ce84f9ae triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:20:40.677135 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:40.782665 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:40.815568 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 4dd3ccf6-5e3f-494b-b5cd-5608ce84f9ae, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=4dd3ccf6-5e3f-494b-b5cd-5608ce84f9ae,segment=NetworkSegment(2bf0c19c-e72c-47a7-afb9-2d333299c92e),segment_id=2bf0c19c-e72c-47a7-afb9-2d333299c92e)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:20:40.926337 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:40.977182 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=4dd3ccf6-5e3f-494b-b5cd-5608ce84f9ae,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:20:41.004461 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7bdf221e-2a95-48c4-a309-8675737ad84e None None] Network 121bb256-b908-4ce1-9802-a8de3aeeb775 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:20:41.071792 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-9b2853d3-05ef-4989-af07-3f961871dbcc None None] Provisioning complete for port 4dd3ccf6-5e3f-494b-b5cd-5608ce84f9ae triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:20:41.072082 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9b2853d3-05ef-4989-af07-3f961871dbcc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:41.332383 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4a2ae193-0f66-44fe-a497-b3869c8d1cb2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:41.440410 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-2ed5bcc8-865a-4eac-9f06-53aaec68b37c None None] Provisioning complete for port 4dd3ccf6-5e3f-494b-b5cd-5608ce84f9ae triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:20:41.440774 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-2ed5bcc8-865a-4eac-9f06-53aaec68b37c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:42.260784 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 50882) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:20:42.544181 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 4dd3ccf6-5e3f-494b-b5cd-5608ce84f9ae up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:20:42.567692 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [None req-b3d9420c-47a9-4656-9698-a1fb635a49fb admin admin] http://10.222.0.24:9696/v2.0/extensions returned with HTTP 200 {{(pid=102162) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:20:42.568778 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-b3d9420c-47a9-4656-9698-a1fb635a49fb admin admin] 10.222.0.24 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3070755 Nov 09 04:20:42.592115 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 4dd3ccf6-5e3f-494b-b5cd-5608ce84f9ae triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:20:42.592479 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:43.629071 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-405c7680-4f56-4698-b34d-8bd0a6b48e0c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:45.055669 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 50900) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:20:45.066117 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:45.183504 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-c0abe355-62d6-4807-a76e-94d72f20c683 admin admin] Request body: {'network': {'provider:physical_network': 'physnet1', 'name': 'public', 'is_default': True, 'router:external': True, 'provider:network_type': 'flat', 'admin_state_up': True}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:20:45.266099 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c0abe355-62d6-4807-a76e-94d72f20c683 admin admin] Made reservation on behalf of cc437a887bd64fcc9e103fe09d48e3bd for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:20:45.268288 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c0abe355-62d6-4807-a76e-94d72f20c683 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:45.278709 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c0abe355-62d6-4807-a76e-94d72f20c683 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:45.346370 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c0abe355-62d6-4807-a76e-94d72f20c683 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:45.420188 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c0abe355-62d6-4807-a76e-94d72f20c683 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:45.434807 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-c0abe355-62d6-4807-a76e-94d72f20c683 admin admin] Reserving flat network on physical network physnet1 {{(pid=102161) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}} Nov 09 04:20:45.451986 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0abe355-62d6-4807-a76e-94d72f20c683 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=870024f8-2443-415d-b3e4-c242a9c32444,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:20:45.457286 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c0abe355-62d6-4807-a76e-94d72f20c683 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:45.457618 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-c0abe355-62d6-4807-a76e-94d72f20c683 admin admin] Added segment b32354f7-483b-42dd-a7b6-93b8f64d6739 of type flat for network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 Nov 09 04:20:45.502867 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c0abe355-62d6-4807-a76e-94d72f20c683 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:45.594718 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c0abe355-62d6-4807-a76e-94d72f20c683 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:45.595633 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c0abe355-62d6-4807-a76e-94d72f20c683 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:20:45.596209 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c0abe355-62d6-4807-a76e-94d72f20c683 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:45.653862 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0abe355-62d6-4807-a76e-94d72f20c683 admin admin] Pushing event updated for resources: {'Network': ['ID=2b6725f5-ebfe-485a-8f42-ccb5a241ddb5,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:20:45.663399 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:20:45.691725 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-c0abe355-62d6-4807-a76e-94d72f20c683 admin admin] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.6349618 Nov 09 04:20:46.309366 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:46.932112 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:48.011882 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 50918) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:20:48.101735 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-05f9868b-460b-47a7-96e2-cfc8df9b717c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:20:48.103074 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-05f9868b-460b-47a7-96e2-cfc8df9b717c admin admin] 10.222.0.24 "GET /v2.0/subnets/5e7620d7-182d-4c74-94b7-72b9b0a25a5c HTTP/1.1" status: 200 len: 849 time: 0.0902305 Nov 09 04:20:48.257829 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-84928a9d-950e-4eb8-b48d-1d466704b42e admin admin] 10.222.0.24 "GET /v2.0/routers/4547ac34-5f86-4e15-aad5-536d8a3d2497 HTTP/1.1" status: 200 len: 704 time: 0.1482449 Nov 09 04:20:48.518348 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0311bc26-c8c7-4962-840e-e145f51b947e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:48.800670 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-0311bc26-c8c7-4962-840e-e145f51b947e admin admin] Allocated IP 172.20.0.1 (121bb256-b908-4ce1-9802-a8de3aeeb775/5e7620d7-182d-4c74-94b7-72b9b0a25a5c/37fc99f9-4112-4667-b35a-83a260238027) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:20:48.948526 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0311bc26-c8c7-4962-840e-e145f51b947e admin admin] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:49.175368 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0311bc26-c8c7-4962-840e-e145f51b947e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:49.241259 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0311bc26-c8c7-4962-840e-e145f51b947e admin admin] Network 121bb256-b908-4ce1-9802-a8de3aeeb775 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:20:49.246847 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-0311bc26-c8c7-4962-840e-e145f51b947e admin admin] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:20:49.254675 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0311bc26-c8c7-4962-840e-e145f51b947e admin admin] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:20:49.255200 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0311bc26-c8c7-4962-840e-e145f51b947e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:49.315012 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0311bc26-c8c7-4962-840e-e145f51b947e admin admin] Pushing event updated for resources: {'Port': ['ID=37fc99f9-4112-4667-b35a-83a260238027,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:20:49.478869 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-4229a1f0-164d-4c26-b9f8-80fd78b29ee9 None None] Provisioning complete for port 37fc99f9-4112-4667-b35a-83a260238027 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:20:49.479440 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4229a1f0-164d-4c26-b9f8-80fd78b29ee9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:49.510133 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0311bc26-c8c7-4962-840e-e145f51b947e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:49.512427 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-4229a1f0-164d-4c26-b9f8-80fd78b29ee9 None None] Port 37fc99f9-4112-4667-b35a-83a260238027 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:20:49.713441 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0311bc26-c8c7-4962-840e-e145f51b947e admin admin] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:49.768620 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0311bc26-c8c7-4962-840e-e145f51b947e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:49.769593 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0311bc26-c8c7-4962-840e-e145f51b947e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:49.848365 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0311bc26-c8c7-4962-840e-e145f51b947e admin admin] Pushing event updated for resources: {'Port': ['ID=37fc99f9-4112-4667-b35a-83a260238027,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:20:49.893913 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0311bc26-c8c7-4962-840e-e145f51b947e admin admin] Network 121bb256-b908-4ce1-9802-a8de3aeeb775 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:20:49.895233 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-0311bc26-c8c7-4962-840e-e145f51b947e admin admin] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:20:50.120801 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0311bc26-c8c7-4962-840e-e145f51b947e admin admin] Router 4547ac34-5f86-4e15-aad5-536d8a3d2497 is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102161) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:20:50.134073 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-31b0989b-bbd8-4c7b-9a32-4d328bba3532 None None] Provisioning complete for port 37fc99f9-4112-4667-b35a-83a260238027 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:20:50.134472 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-31b0989b-bbd8-4c7b-9a32-4d328bba3532 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:50.166258 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-31b0989b-bbd8-4c7b-9a32-4d328bba3532 None None] Port 37fc99f9-4112-4667-b35a-83a260238027 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:20:50.210636 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0311bc26-c8c7-4962-840e-e145f51b947e admin admin] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:20:50.216109 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-0311bc26-c8c7-4962-840e-e145f51b947e admin admin] 10.222.0.24 "PUT /v2.0/routers/4547ac34-5f86-4e15-aad5-536d8a3d2497/add_router_interface HTTP/1.1" status: 200 len: 508 time: 1.9519489 Nov 09 04:20:50.220943 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-282a7767-fde9-42a1-8a88-acfe1ff93abf None None] Sync routers for ids ['4547ac34-5f86-4e15-aad5-536d8a3d2497'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:20:50.233546 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-282a7767-fde9-42a1-8a88-acfe1ff93abf None None] Routers {'4547ac34-5f86-4e15-aad5-536d8a3d2497'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:20:50.234347 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-282a7767-fde9-42a1-8a88-acfe1ff93abf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:20:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['4547ac34-5f86-4e15-aad5-536d8a3d2497'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:20:50.420597 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-282a7767-fde9-42a1-8a88-acfe1ff93abf None None] Set router 4547ac34-5f86-4e15-aad5-536d8a3d2497 gateway port host: None {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:20:50.844573 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-282a7767-fde9-42a1-8a88-acfe1ff93abf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4547ac34-5f86-4e15-aad5-536d8a3d2497', 'name': 'router1', 'tenant_id': 'd3329127c71f406ea2af68ae8f335b96', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:20:39Z', 'updated_at': '2021-11-09T04:20:49Z', 'revision_number': 2, 'project_id': 'd3329127c71f406ea2af68ae8f335b96', 'gw_port_host': None, '_interfaces': [{'id': '37fc99f9-4112-4667-b35a-83a260238027', 'name': '', 'network_id': '121bb256-b908-4ce1-9802-a8de3aeeb775', 'tenant_id': 'd3329127c71f406ea2af68ae8f335b96', 'mac_address': 'fa:16:3e:e6:e1:4b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4547ac34-5f86-4e15-aad5-536d8a3d2497', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '5e7620d7-182d-4c74-94b7-72b9b0a25a5c', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:20:48Z', 'updated_at': '2021-11-09T04:20:49Z', 'revision_number': 2, 'project_id': 'd3329127c71f406ea2af68ae8f335b96', 'subnets': [{'id': '5e7620d7-182d-4c74-94b7-72b9b0a25a5c', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '6a6005dc-0303-432d-b81f-8302b2205f0a'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:20:50.895249 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-282a7767-fde9-42a1-8a88-acfe1ff93abf None None] Checking router: 4547ac34-5f86-4e15-aad5-536d8a3d2497 for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:20:50.895627 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-282a7767-fde9-42a1-8a88-acfe1ff93abf None None] Updating router 4547ac34-5f86-4e15-aad5-536d8a3d2497 port 37fc99f9-4112-4667-b35a-83a260238027 binding host dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 04:20:50.942623 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-282a7767-fde9-42a1-8a88-acfe1ff93abf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:51.448934 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-282a7767-fde9-42a1-8a88-acfe1ff93abf None None] Publish callbacks [] for port, precommit_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:51.537391 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-282a7767-fde9-42a1-8a88-acfe1ff93abf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:51.693687 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e6b967f-00c7-4db9-96aa-604518a20bd2 None None] Pushing event updated for resources: {'Port': ['ID=37fc99f9-4112-4667-b35a-83a260238027,revision_number=3']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:20:51.709741 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e6b967f-00c7-4db9-96aa-604518a20bd2 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:20:51.710108 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e6b967f-00c7-4db9-96aa-604518a20bd2 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:20:51.710478 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e6b967f-00c7-4db9-96aa-604518a20bd2 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:20:51.710813 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e6b967f-00c7-4db9-96aa-604518a20bd2 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:20:51.711143 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e6b967f-00c7-4db9-96aa-604518a20bd2 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:20:51.711485 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e6b967f-00c7-4db9-96aa-604518a20bd2 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:20:51.711815 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e6b967f-00c7-4db9-96aa-604518a20bd2 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:20:51.712153 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e6b967f-00c7-4db9-96aa-604518a20bd2 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:20:51.712495 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e6b967f-00c7-4db9-96aa-604518a20bd2 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:20:51.712819 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e6b967f-00c7-4db9-96aa-604518a20bd2 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:20:51.713138 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e6b967f-00c7-4db9-96aa-604518a20bd2 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:20:51.713490 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e6b967f-00c7-4db9-96aa-604518a20bd2 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:20:51.714835 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e6b967f-00c7-4db9-96aa-604518a20bd2 None None] Tracked resource versions report: Nov 09 04:20:51.714835 dv-neutron-816802-2-hyperv neutron-server[102164]: pushed versions: Nov 09 04:20:51.714835 dv-neutron-816802-2-hyperv neutron-server[102164]: { 'AddressGroup': {'1.2'}, Nov 09 04:20:51.714835 dv-neutron-816802-2-hyperv neutron-server[102164]: 'ConntrackHelper': {'1.0'}, Nov 09 04:20:51.714835 dv-neutron-816802-2-hyperv neutron-server[102164]: 'Log': {'1.0'}, Nov 09 04:20:51.714835 dv-neutron-816802-2-hyperv neutron-server[102164]: 'Network': {'1.1'}, Nov 09 04:20:51.714835 dv-neutron-816802-2-hyperv neutron-server[102164]: 'Port': {'1.7'}, Nov 09 04:20:51.714835 dv-neutron-816802-2-hyperv neutron-server[102164]: 'PortForwarding': {'1.2'}, Nov 09 04:20:51.714835 dv-neutron-816802-2-hyperv neutron-server[102164]: 'QosPolicy': {'1.10'}, Nov 09 04:20:51.714835 dv-neutron-816802-2-hyperv neutron-server[102164]: 'SecurityGroup': {'1.5'}, Nov 09 04:20:51.714835 dv-neutron-816802-2-hyperv neutron-server[102164]: 'SecurityGroupRule': {'1.2'}, Nov 09 04:20:51.714835 dv-neutron-816802-2-hyperv neutron-server[102164]: 'SubPort': {'1.0'}, Nov 09 04:20:51.714835 dv-neutron-816802-2-hyperv neutron-server[102164]: 'Subnet': {'1.1'}, Nov 09 04:20:51.714835 dv-neutron-816802-2-hyperv neutron-server[102164]: 'Trunk': {'1.1'}} Nov 09 04:20:51.714835 dv-neutron-816802-2-hyperv neutron-server[102164]: consumer versions: Nov 09 04:20:51.714835 dv-neutron-816802-2-hyperv neutron-server[102164]: { DHCP agent@dv-neutron-816802-2-hyperv: {}, Nov 09 04:20:51.714835 dv-neutron-816802-2-hyperv neutron-server[102164]: L3 agent@dv-neutron-816802-2-hyperv: {}, Nov 09 04:20:51.714835 dv-neutron-816802-2-hyperv neutron-server[102164]: Metadata agent@dv-neutron-816802-2-hyperv: {}, Nov 09 04:20:51.714835 dv-neutron-816802-2-hyperv neutron-server[102164]: Metering agent@dv-neutron-816802-2-hyperv: {}, Nov 09 04:20:51.714835 dv-neutron-816802-2-hyperv neutron-server[102164]: Open vSwitch agent@dv-neutron-816802-2-hyperv: { 'AddressGroup': '1.2', Nov 09 04:20:51.714835 dv-neutron-816802-2-hyperv neutron-server[102164]: 'ConntrackHelper': '1.0', Nov 09 04:20:51.714835 dv-neutron-816802-2-hyperv neutron-server[102164]: 'Log': '1.0', Nov 09 04:20:51.714835 dv-neutron-816802-2-hyperv neutron-server[102164]: 'Network': '1.1', Nov 09 04:20:51.714835 dv-neutron-816802-2-hyperv neutron-server[102164]: 'Port': '1.7', Nov 09 04:20:51.714835 dv-neutron-816802-2-hyperv neutron-server[102164]: 'PortForwarding': '1.2', Nov 09 04:20:51.714835 dv-neutron-816802-2-hyperv neutron-server[102164]: 'QosPolicy': '1.10', Nov 09 04:20:51.714835 dv-neutron-816802-2-hyperv neutron-server[102164]: 'SecurityGroup': '1.5', Nov 09 04:20:51.714835 dv-neutron-816802-2-hyperv neutron-server[102164]: 'SecurityGroupRule': '1.2', Nov 09 04:20:51.714835 dv-neutron-816802-2-hyperv neutron-server[102164]: 'SubPort': '1.0', Nov 09 04:20:51.714835 dv-neutron-816802-2-hyperv neutron-server[102164]: 'Subnet': '1.1', Nov 09 04:20:51.714835 dv-neutron-816802-2-hyperv neutron-server[102164]: 'Trunk': '1.1'}} Nov 09 04:20:51.714835 dv-neutron-816802-2-hyperv neutron-server[102164]: {{(pid=102164) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 09 04:20:51.717242 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-282a7767-fde9-42a1-8a88-acfe1ff93abf None None] Attempting to bind port 37fc99f9-4112-4667-b35a-83a260238027 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:20:51.717560 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-282a7767-fde9-42a1-8a88-acfe1ff93abf None None] Attempting to bind port 37fc99f9-4112-4667-b35a-83a260238027 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '2bf0c19c-e72c-47a7-afb9-2d333299c92e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 322, 'network_id': '121bb256-b908-4ce1-9802-a8de3aeeb775'}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:20:51.717993 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-282a7767-fde9-42a1-8a88-acfe1ff93abf None None] Attempting to bind port 37fc99f9-4112-4667-b35a-83a260238027 on network 121bb256-b908-4ce1-9802-a8de3aeeb775 {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:20:51.724108 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-282a7767-fde9-42a1-8a88-acfe1ff93abf None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 20, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:20:51.724472 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-282a7767-fde9-42a1-8a88-acfe1ff93abf None None] Checking segment: {'id': '2bf0c19c-e72c-47a7-afb9-2d333299c92e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 322, 'network_id': '121bb256-b908-4ce1-9802-a8de3aeeb775'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102164) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:20:51.724948 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-282a7767-fde9-42a1-8a88-acfe1ff93abf None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:51.725328 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-282a7767-fde9-42a1-8a88-acfe1ff93abf None None] Bound using segment: {'id': '2bf0c19c-e72c-47a7-afb9-2d333299c92e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 322, 'network_id': '121bb256-b908-4ce1-9802-a8de3aeeb775'} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:20:51.725828 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-282a7767-fde9-42a1-8a88-acfe1ff93abf None None] Bound port: 37fc99f9-4112-4667-b35a-83a260238027, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2bf0c19c-e72c-47a7-afb9-2d333299c92e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 322, 'network_id': '121bb256-b908-4ce1-9802-a8de3aeeb775'}}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:20:51.726219 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-282a7767-fde9-42a1-8a88-acfe1ff93abf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:51.793928 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-282a7767-fde9-42a1-8a88-acfe1ff93abf None None] For port 37fc99f9-4112-4667-b35a-83a260238027, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102164) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:20:51.803080 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-a179e344-bc38-4300-a9d0-620a8c247802 None None] Provisioning complete for port 37fc99f9-4112-4667-b35a-83a260238027 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:20:51.803080 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a179e344-bc38-4300-a9d0-620a8c247802 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:51.812900 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-282a7767-fde9-42a1-8a88-acfe1ff93abf None None] For port 37fc99f9-4112-4667-b35a-83a260238027, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=37fc99f9-4112-4667-b35a-83a260238027,segment=NetworkSegment(2bf0c19c-e72c-47a7-afb9-2d333299c92e),segment_id=2bf0c19c-e72c-47a7-afb9-2d333299c92e)] {{(pid=102164) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:20:51.833626 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-a179e344-bc38-4300-a9d0-620a8c247802 None None] Port 37fc99f9-4112-4667-b35a-83a260238027 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:20:51.877962 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-282a7767-fde9-42a1-8a88-acfe1ff93abf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:51.927416 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-282a7767-fde9-42a1-8a88-acfe1ff93abf None None] Routers {'4547ac34-5f86-4e15-aad5-536d8a3d2497'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:20:51.928044 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-282a7767-fde9-42a1-8a88-acfe1ff93abf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:20:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['4547ac34-5f86-4e15-aad5-536d8a3d2497'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:20:52.004353 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e6b967f-00c7-4db9-96aa-604518a20bd2 None None] Pushing event updated for resources: {'Port': ['ID=37fc99f9-4112-4667-b35a-83a260238027,revision_number=4']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:20:52.029312 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-282a7767-fde9-42a1-8a88-acfe1ff93abf None None] Set router 4547ac34-5f86-4e15-aad5-536d8a3d2497 gateway port host: None {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:20:52.154637 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-5c3fa48c-0257-4039-8ff5-9261f7579e7e None None] Provisioning complete for port 37fc99f9-4112-4667-b35a-83a260238027 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:20:52.155164 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5c3fa48c-0257-4039-8ff5-9261f7579e7e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:52.238412 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-282a7767-fde9-42a1-8a88-acfe1ff93abf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4547ac34-5f86-4e15-aad5-536d8a3d2497', 'name': 'router1', 'tenant_id': 'd3329127c71f406ea2af68ae8f335b96', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:20:39Z', 'updated_at': '2021-11-09T04:20:49Z', 'revision_number': 2, 'project_id': 'd3329127c71f406ea2af68ae8f335b96', 'gw_port_host': None, '_interfaces': [{'id': '37fc99f9-4112-4667-b35a-83a260238027', 'name': '', 'network_id': '121bb256-b908-4ce1-9802-a8de3aeeb775', 'tenant_id': 'd3329127c71f406ea2af68ae8f335b96', 'mac_address': 'fa:16:3e:e6:e1:4b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4547ac34-5f86-4e15-aad5-536d8a3d2497', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '5e7620d7-182d-4c74-94b7-72b9b0a25a5c', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:20:48Z', 'updated_at': '2021-11-09T04:20:51Z', 'revision_number': 4, 'project_id': 'd3329127c71f406ea2af68ae8f335b96', 'subnets': [{'id': '5e7620d7-182d-4c74-94b7-72b9b0a25a5c', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '6a6005dc-0303-432d-b81f-8302b2205f0a'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:20:52.239784 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5c3fa48c-0257-4039-8ff5-9261f7579e7e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:52.263994 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-282a7767-fde9-42a1-8a88-acfe1ff93abf None None] The sync data for ids ['4547ac34-5f86-4e15-aad5-536d8a3d2497'] in dv-neutron-816802-2-hyperv is: [{'id': '4547ac34-5f86-4e15-aad5-536d8a3d2497', 'name': 'router1', 'tenant_id': 'd3329127c71f406ea2af68ae8f335b96', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:20:39Z', 'updated_at': '2021-11-09T04:20:49Z', 'revision_number': 2, 'project_id': 'd3329127c71f406ea2af68ae8f335b96', 'gw_port_host': None, '_interfaces': [{'id': '37fc99f9-4112-4667-b35a-83a260238027', 'name': '', 'network_id': '121bb256-b908-4ce1-9802-a8de3aeeb775', 'tenant_id': 'd3329127c71f406ea2af68ae8f335b96', 'mac_address': 'fa:16:3e:e6:e1:4b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4547ac34-5f86-4e15-aad5-536d8a3d2497', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '5e7620d7-182d-4c74-94b7-72b9b0a25a5c', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:20:48Z', 'updated_at': '2021-11-09T04:20:51Z', 'revision_number': 4, 'project_id': 'd3329127c71f406ea2af68ae8f335b96', 'subnets': [{'id': '5e7620d7-182d-4c74-94b7-72b9b0a25a5c', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '6a6005dc-0303-432d-b81f-8302b2205f0a'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:20:52.280284 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-5c3fa48c-0257-4039-8ff5-9261f7579e7e None None] For port 37fc99f9-4112-4667-b35a-83a260238027, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=37fc99f9-4112-4667-b35a-83a260238027,segment=NetworkSegment(2bf0c19c-e72c-47a7-afb9-2d333299c92e),segment_id=2bf0c19c-e72c-47a7-afb9-2d333299c92e)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:20:52.369214 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5c3fa48c-0257-4039-8ff5-9261f7579e7e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:52.420359 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c3fa48c-0257-4039-8ff5-9261f7579e7e None None] Pushing event updated for resources: {'Port': ['ID=37fc99f9-4112-4667-b35a-83a260238027,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:20:52.582086 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 50928) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:20:52.688158 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b89dd8c6-c15e-4a3d-b02c-b31f99c426dc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:20:52.689536 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-b89dd8c6-c15e-4a3d-b02c-b31f99c426dc admin admin] 10.222.0.24 "GET /v2.0/networks/2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 HTTP/1.1" status: 200 len: 842 time: 0.1064708 Nov 09 04:20:52.700055 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-7f89d791-9171-46d9-9553-26767bdfcd94 admin admin] Request body: {'subnet': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'ip_version': 4, 'enable_dhcp': False, 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'name': 'public-subnet'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:20:52.794414 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7f89d791-9171-46d9-9553-26767bdfcd94 admin admin] Made reservation on behalf of cc437a887bd64fcc9e103fe09d48e3bd for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:20:52.796719 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7f89d791-9171-46d9-9553-26767bdfcd94 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:53.130960 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.objects.ports [None req-7f89d791-9171-46d9-9553-26767bdfcd94 admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=102161) get_objects /opt/stack/neutron/neutron/objects/ports.py:444}} Nov 09 04:20:53.131288 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7f89d791-9171-46d9-9553-26767bdfcd94 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:53.185305 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f89d791-9171-46d9-9553-26767bdfcd94 admin admin] Pushing event updated for resources: {'Subnet': ['ID=e932d5b0-df1b-4711-8b71-813e648a5e78,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:20:53.192802 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7f89d791-9171-46d9-9553-26767bdfcd94 admin admin] Checking segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:20:53.193151 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7f89d791-9171-46d9-9553-26767bdfcd94 admin admin] Network hostable DHCP agents. Network: 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:20:53.305810 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7f89d791-9171-46d9-9553-26767bdfcd94 admin admin] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:20:53.389396 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-7f89d791-9171-46d9-9553-26767bdfcd94 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:20:53.393547 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7f89d791-9171-46d9-9553-26767bdfcd94 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:20:53.394437 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7f89d791-9171-46d9-9553-26767bdfcd94 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:53.402442 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8995a528-0703-4179-903b-8039d96b0ffe None None] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:20:53.476421 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 5 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:20:53.495251 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-7f89d791-9171-46d9-9553-26767bdfcd94 admin admin] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.7989779 Nov 09 04:20:53.532144 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-576df4e4-7c4c-4944-82ac-b2f52ccb0d52 None None] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:20:55.897800 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 50936) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:20:56.109739 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-44b19928-7546-4bb5-a67c-9df90ea966d6 admin admin] 10.222.0.24 "GET /v2.0/routers/4547ac34-5f86-4e15-aad5-536d8a3d2497 HTTP/1.1" status: 200 len: 710 time: 0.2106187 Nov 09 04:20:56.197318 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-008fa202-d45a-401a-9bec-48196c516d92 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:20:56.204945 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-008fa202-d45a-401a-9bec-48196c516d92 admin admin] 10.222.0.24 "GET /v2.0/networks/2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 HTTP/1.1" status: 200 len: 886 time: 0.0831814 Nov 09 04:20:56.208742 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-ac266903-631d-4b19-bd4f-e087ff5dc281 admin admin] Request body: {'router': {'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:20:56.452275 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ac266903-631d-4b19-bd4f-e087ff5dc281 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:56.803336 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ac266903-631d-4b19-bd4f-e087ff5dc281 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:56.881700 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ac266903-631d-4b19-bd4f-e087ff5dc281 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:56.986172 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-ac266903-631d-4b19-bd4f-e087ff5dc281 admin admin] Allocated IP 172.26.0.74 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/1e5a2a49-9edf-47ca-b3d2-f50e06efae49) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:20:57.087813 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ac266903-631d-4b19-bd4f-e087ff5dc281 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:57.178139 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ac266903-631d-4b19-bd4f-e087ff5dc281 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:57.214277 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ac266903-631d-4b19-bd4f-e087ff5dc281 admin admin] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:20:57.219280 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-ac266903-631d-4b19-bd4f-e087ff5dc281 admin admin] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:20:57.226340 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ac266903-631d-4b19-bd4f-e087ff5dc281 admin admin] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:20:57.228244 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac266903-631d-4b19-bd4f-e087ff5dc281 admin admin] Pushing event updated for resources: {'Port': ['ID=1e5a2a49-9edf-47ca-b3d2-f50e06efae49,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:20:57.543307 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ac266903-631d-4b19-bd4f-e087ff5dc281 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:57.831826 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ac266903-631d-4b19-bd4f-e087ff5dc281 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-466202', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-464271', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-936'] for router, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:57.835323 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ac266903-631d-4b19-bd4f-e087ff5dc281 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-466195', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-466408', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-464260'] for router, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:57.944307 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ac266903-631d-4b19-bd4f-e087ff5dc281 admin admin] Router 4547ac34-5f86-4e15-aad5-536d8a3d2497 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:20:58.055757 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ac266903-631d-4b19-bd4f-e087ff5dc281 admin admin] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:20:58.060014 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ac266903-631d-4b19-bd4f-e087ff5dc281 admin admin] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:58.061203 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-ac266903-631d-4b19-bd4f-e087ff5dc281 admin admin] 10.222.0.24 "PUT /v2.0/routers/4547ac34-5f86-4e15-aad5-536d8a3d2497 HTTP/1.1" status: 200 len: 889 time: 1.8557017 Nov 09 04:20:58.575949 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 37fc99f9-4112-4667-b35a-83a260238027 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:20:58.626170 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 37fc99f9-4112-4667-b35a-83a260238027 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:20:58.626591 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:20:59.217258 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-03c15072-f41e-4b35-9d65-d1b83125010f None None] Sync routers for ids ['4547ac34-5f86-4e15-aad5-536d8a3d2497'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:20:59.227966 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-03c15072-f41e-4b35-9d65-d1b83125010f None None] Routers {'4547ac34-5f86-4e15-aad5-536d8a3d2497'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:20:59.229195 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-03c15072-f41e-4b35-9d65-d1b83125010f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:20:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['4547ac34-5f86-4e15-aad5-536d8a3d2497'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:20:59.443086 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-03c15072-f41e-4b35-9d65-d1b83125010f None None] Set router 4547ac34-5f86-4e15-aad5-536d8a3d2497 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:20:59.938288 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-03c15072-f41e-4b35-9d65-d1b83125010f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4547ac34-5f86-4e15-aad5-536d8a3d2497', 'name': 'router1', 'tenant_id': 'd3329127c71f406ea2af68ae8f335b96', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.74'}], 'enable_snat': True}, 'gw_port_id': '1e5a2a49-9edf-47ca-b3d2-f50e06efae49', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:20:39Z', 'updated_at': '2021-11-09T04:20:57Z', 'revision_number': 4, 'project_id': 'd3329127c71f406ea2af68ae8f335b96', 'gw_port': {'id': '1e5a2a49-9edf-47ca-b3d2-f50e06efae49', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:a0:82', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4547ac34-5f86-4e15-aad5-536d8a3d2497', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:20:56Z', 'updated_at': '2021-11-09T04:20:56Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '37fc99f9-4112-4667-b35a-83a260238027', 'name': '', 'network_id': '121bb256-b908-4ce1-9802-a8de3aeeb775', 'tenant_id': 'd3329127c71f406ea2af68ae8f335b96', 'mac_address': 'fa:16:3e:e6:e1:4b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4547ac34-5f86-4e15-aad5-536d8a3d2497', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '5e7620d7-182d-4c74-94b7-72b9b0a25a5c', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:20:48Z', 'updated_at': '2021-11-09T04:20:52Z', 'revision_number': 5, 'project_id': 'd3329127c71f406ea2af68ae8f335b96', 'subnets': [{'id': '5e7620d7-182d-4c74-94b7-72b9b0a25a5c', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '6a6005dc-0303-432d-b81f-8302b2205f0a'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:21:00.004448 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-03c15072-f41e-4b35-9d65-d1b83125010f None None] Checking router: 4547ac34-5f86-4e15-aad5-536d8a3d2497 for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:21:00.004904 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-03c15072-f41e-4b35-9d65-d1b83125010f None None] Updating router 4547ac34-5f86-4e15-aad5-536d8a3d2497 port 1e5a2a49-9edf-47ca-b3d2-f50e06efae49 binding host dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 04:21:00.055871 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-03c15072-f41e-4b35-9d65-d1b83125010f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:21:00.366313 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-03c15072-f41e-4b35-9d65-d1b83125010f None None] Publish callbacks [] for port, precommit_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:21:00.495101 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-03c15072-f41e-4b35-9d65-d1b83125010f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:21:00.548837 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-453fa551-18a4-4088-b4d7-307e5e1a8213 None None] Pushing event updated for resources: {'Port': ['ID=1e5a2a49-9edf-47ca-b3d2-f50e06efae49,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:21:00.551417 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-03c15072-f41e-4b35-9d65-d1b83125010f None None] Attempting to bind port 1e5a2a49-9edf-47ca-b3d2-f50e06efae49 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:21:00.551784 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-03c15072-f41e-4b35-9d65-d1b83125010f None None] Attempting to bind port 1e5a2a49-9edf-47ca-b3d2-f50e06efae49 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:21:00.552529 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-03c15072-f41e-4b35-9d65-d1b83125010f None None] Attempting to bind port 1e5a2a49-9edf-47ca-b3d2-f50e06efae49 on network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:21:00.558523 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-03c15072-f41e-4b35-9d65-d1b83125010f None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 20, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:21:00.558895 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-03c15072-f41e-4b35-9d65-d1b83125010f None None] Checking segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:21:00.559285 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-03c15072-f41e-4b35-9d65-d1b83125010f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:21:00.559663 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-03c15072-f41e-4b35-9d65-d1b83125010f None None] Bound using segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:21:00.560126 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-03c15072-f41e-4b35-9d65-d1b83125010f None None] Bound port: 1e5a2a49-9edf-47ca-b3d2-f50e06efae49, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:21:00.560515 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-03c15072-f41e-4b35-9d65-d1b83125010f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:21:00.609303 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-03c15072-f41e-4b35-9d65-d1b83125010f None None] For port 1e5a2a49-9edf-47ca-b3d2-f50e06efae49, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:21:00.612274 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-03c15072-f41e-4b35-9d65-d1b83125010f None None] For port 1e5a2a49-9edf-47ca-b3d2-f50e06efae49, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=1e5a2a49-9edf-47ca-b3d2-f50e06efae49,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:21:00.641773 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 50948) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:21:00.711905 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-03c15072-f41e-4b35-9d65-d1b83125010f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:21:00.753755 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-eec62baf-3739-45ac-8ac3-3e4f8742708b admin admin] 10.222.0.24 "GET /v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200 len: 410 time: 0.1100671 Nov 09 04:21:00.768939 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-03c15072-f41e-4b35-9d65-d1b83125010f None None] Routers {'4547ac34-5f86-4e15-aad5-536d8a3d2497'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:21:00.769599 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-03c15072-f41e-4b35-9d65-d1b83125010f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:20:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['4547ac34-5f86-4e15-aad5-536d8a3d2497'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:21:00.774967 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-453fa551-18a4-4088-b4d7-307e5e1a8213 None None] Pushing event updated for resources: {'Port': ['ID=1e5a2a49-9edf-47ca-b3d2-f50e06efae49,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:21:00.884657 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-03c15072-f41e-4b35-9d65-d1b83125010f None None] Set router 4547ac34-5f86-4e15-aad5-536d8a3d2497 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:21:01.099898 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-03c15072-f41e-4b35-9d65-d1b83125010f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4547ac34-5f86-4e15-aad5-536d8a3d2497', 'name': 'router1', 'tenant_id': 'd3329127c71f406ea2af68ae8f335b96', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.74'}], 'enable_snat': True}, 'gw_port_id': '1e5a2a49-9edf-47ca-b3d2-f50e06efae49', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:20:39Z', 'updated_at': '2021-11-09T04:20:57Z', 'revision_number': 4, 'project_id': 'd3329127c71f406ea2af68ae8f335b96', 'gw_port': {'id': '1e5a2a49-9edf-47ca-b3d2-f50e06efae49', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:a0:82', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4547ac34-5f86-4e15-aad5-536d8a3d2497', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:20:56Z', 'updated_at': '2021-11-09T04:21:00Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '37fc99f9-4112-4667-b35a-83a260238027', 'name': '', 'network_id': '121bb256-b908-4ce1-9802-a8de3aeeb775', 'tenant_id': 'd3329127c71f406ea2af68ae8f335b96', 'mac_address': 'fa:16:3e:e6:e1:4b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4547ac34-5f86-4e15-aad5-536d8a3d2497', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '5e7620d7-182d-4c74-94b7-72b9b0a25a5c', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:20:48Z', 'updated_at': '2021-11-09T04:20:52Z', 'revision_number': 5, 'project_id': 'd3329127c71f406ea2af68ae8f335b96', 'subnets': [{'id': '5e7620d7-182d-4c74-94b7-72b9b0a25a5c', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '6a6005dc-0303-432d-b81f-8302b2205f0a'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:21:01.126165 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-03c15072-f41e-4b35-9d65-d1b83125010f None None] The sync data for ids ['4547ac34-5f86-4e15-aad5-536d8a3d2497'] in dv-neutron-816802-2-hyperv is: [{'id': '4547ac34-5f86-4e15-aad5-536d8a3d2497', 'name': 'router1', 'tenant_id': 'd3329127c71f406ea2af68ae8f335b96', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.74'}], 'enable_snat': True}, 'gw_port_id': '1e5a2a49-9edf-47ca-b3d2-f50e06efae49', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:20:39Z', 'updated_at': '2021-11-09T04:20:57Z', 'revision_number': 4, 'project_id': 'd3329127c71f406ea2af68ae8f335b96', 'gw_port': {'id': '1e5a2a49-9edf-47ca-b3d2-f50e06efae49', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:a0:82', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4547ac34-5f86-4e15-aad5-536d8a3d2497', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:20:56Z', 'updated_at': '2021-11-09T04:21:00Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '37fc99f9-4112-4667-b35a-83a260238027', 'name': '', 'network_id': '121bb256-b908-4ce1-9802-a8de3aeeb775', 'tenant_id': 'd3329127c71f406ea2af68ae8f335b96', 'mac_address': 'fa:16:3e:e6:e1:4b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4547ac34-5f86-4e15-aad5-536d8a3d2497', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '5e7620d7-182d-4c74-94b7-72b9b0a25a5c', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:20:48Z', 'updated_at': '2021-11-09T04:20:52Z', 'revision_number': 5, 'project_id': 'd3329127c71f406ea2af68ae8f335b96', 'subnets': [{'id': '5e7620d7-182d-4c74-94b7-72b9b0a25a5c', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '6a6005dc-0303-432d-b81f-8302b2205f0a'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:21:02.593210 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 1e5a2a49-9edf-47ca-b3d2-f50e06efae49 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:21:02.644154 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 1e5a2a49-9edf-47ca-b3d2-f50e06efae49 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:21:02.644825 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:21:02.736143 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:21:02.756839 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 1e5a2a49-9edf-47ca-b3d2-f50e06efae49, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=1e5a2a49-9edf-47ca-b3d2-f50e06efae49,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:21:02.839393 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:21:02.890860 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=1e5a2a49-9edf-47ca-b3d2-f50e06efae49,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:21:04.604484 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 1e5a2a49-9edf-47ca-b3d2-f50e06efae49 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:21:04.669503 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 1e5a2a49-9edf-47ca-b3d2-f50e06efae49 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:21:04.670220 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:21:11.293999 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-44cc1f62-09a8-471e-bdaf-85731515dcdd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:21:13.642788 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4cffda2b-f6a9-46eb-b914-1a26f561501c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:21:14.988830 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:21:16.334180 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:21:16.936919 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:21:30.475744 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 5 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:21:41.396301 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8a2d5f0c-3e95-4d38-97f0-899c4a3d8d5a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:21:43.647595 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b03fc633-0912-4607-8a12-dc164c2b8612 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:21:44.976001 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:21:47.325933 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:21:47.333303 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:22:07.474092 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 5 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:22:11.309122 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-909c957f-362d-4caf-be95-56bdf62a9088 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:22:13.663626 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4bee4d1b-3c43-46bd-bb57-ed627adc2084 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:22:15.017714 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:22:16.323782 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:22:16.929751 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:22:41.311632 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0a493dbd-e3a2-4609-9d56-ce6a7470c14f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:22:43.640416 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-89c18c4a-5764-4bf6-9a9c-045a067ec3e2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:22:44.472078 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 5 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:22:44.725970 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 51542) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:22:44.789666 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-bfc4a50d-ac5c-40b3-bc82-fdd3d26c29d0 admin admin] GET failed (client error): The resource could not be found. Nov 09 04:22:44.791047 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-bfc4a50d-ac5c-40b3-bc82-fdd3d26c29d0 admin admin] 10.222.0.24 "GET /v2.0/networks/private HTTP/1.1" status: 404 len: 315 time: 0.0641668 Nov 09 04:22:44.947750 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7a81be7b-41a6-4f59-b332-3477e63dfb3b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:22:44.949227 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-7a81be7b-41a6-4f59-b332-3477e63dfb3b admin admin] 10.222.0.24 "GET /v2.0/networks?name=private HTTP/1.1" status: 200 len: 872 time: 0.1535950 Nov 09 04:22:45.021209 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:22:46.334432 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:22:46.936692 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:22:47.244302 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 51552) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:22:47.335238 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-07148739-1c7d-4d08-9703-11eda6760ed0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:22:47.336636 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-07148739-1c7d-4d08-9703-11eda6760ed0 admin admin] 10.222.0.24 "GET /v2.0/subnets/5e7620d7-182d-4c74-94b7-72b9b0a25a5c HTTP/1.1" status: 200 len: 849 time: 0.0913475 Nov 09 04:22:47.346535 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-957de2af-08ee-4d30-a5bb-e3569df3e36d admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:22:47.430500 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-957de2af-08ee-4d30-a5bb-e3569df3e36d admin admin] Publish callbacks [] for subnet, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:22:47.639462 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-957de2af-08ee-4d30-a5bb-e3569df3e36d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8756747267211'] for subnet, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:22:47.669293 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-957de2af-08ee-4d30-a5bb-e3569df3e36d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:22:47.669879 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-957de2af-08ee-4d30-a5bb-e3569df3e36d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:22:47.671469 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-957de2af-08ee-4d30-a5bb-e3569df3e36d admin admin] 10.222.0.24 "PUT /v2.0/subnets/5e7620d7-182d-4c74-94b7-72b9b0a25a5c HTTP/1.1" status: 200 len: 868 time: 0.3283305 Nov 09 04:22:47.673664 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a22a7158-717e-4575-8b43-d9c942ff8e8d None None] Network 121bb256-b908-4ce1-9802-a8de3aeeb775 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:22:47.693029 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-957de2af-08ee-4d30-a5bb-e3569df3e36d admin admin] Pushing event updated for resources: {'Subnet': ['ID=5e7620d7-182d-4c74-94b7-72b9b0a25a5c,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:22:47.701766 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-957de2af-08ee-4d30-a5bb-e3569df3e36d admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:22:47.702292 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-957de2af-08ee-4d30-a5bb-e3569df3e36d admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:22:47.702662 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-957de2af-08ee-4d30-a5bb-e3569df3e36d admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:22:47.703003 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-957de2af-08ee-4d30-a5bb-e3569df3e36d admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:22:47.703332 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-957de2af-08ee-4d30-a5bb-e3569df3e36d admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:22:47.703661 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-957de2af-08ee-4d30-a5bb-e3569df3e36d admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:22:47.703984 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-957de2af-08ee-4d30-a5bb-e3569df3e36d admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:22:47.704323 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-957de2af-08ee-4d30-a5bb-e3569df3e36d admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:22:47.704648 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-957de2af-08ee-4d30-a5bb-e3569df3e36d admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:22:47.704966 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-957de2af-08ee-4d30-a5bb-e3569df3e36d admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:22:47.705290 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-957de2af-08ee-4d30-a5bb-e3569df3e36d admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:22:47.705607 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-957de2af-08ee-4d30-a5bb-e3569df3e36d admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:22:48.083161 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-02119124-ca9f-4777-b9a9-d44c997eacee None None] Provisioning complete for port 37fc99f9-4112-4667-b35a-83a260238027 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:22:48.083527 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-02119124-ca9f-4777-b9a9-d44c997eacee None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:22:48.167283 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-02119124-ca9f-4777-b9a9-d44c997eacee None None] Provisioning complete for port 4dd3ccf6-5e3f-494b-b5cd-5608ce84f9ae triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:22:48.167566 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-02119124-ca9f-4777-b9a9-d44c997eacee None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:22:49.940791 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 51560) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:22:50.143747 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bdf9f251-ad12-4865-8a4b-9bffc825c04d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:22:50.144132 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bdf9f251-ad12-4865-8a4b-9bffc825c04d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:22:50.146151 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-bdf9f251-ad12-4865-8a4b-9bffc825c04d admin admin] 10.222.0.24 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.2044013 Nov 09 04:22:52.391438 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 51568) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:22:52.520342 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5dbe3a7c-403c-438e-bd54-0f661efa957d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:22:52.520812 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5dbe3a7c-403c-438e-bd54-0f661efa957d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:22:52.522308 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-5dbe3a7c-403c-438e-bd54-0f661efa957d admin admin] 10.222.0.24 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.1299314 Nov 09 04:22:54.769052 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 51576) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:22:54.898263 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d14054e1-12cc-433f-ad9c-00f1f63f0492 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:22:54.899685 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-d14054e1-12cc-433f-ad9c-00f1f63f0492 admin admin] 10.222.0.24 "GET /v2.0/networks/121bb256-b908-4ce1-9802-a8de3aeeb775 HTTP/1.1" status: 200 len: 869 time: 0.1295943 Nov 09 04:22:57.179055 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 51584) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:22:57.302184 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bf560cee-4cdc-46dc-b5df-09a9a6901d4a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:22:57.303562 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-bf560cee-4cdc-46dc-b5df-09a9a6901d4a admin admin] 10.222.0.24 "GET /v2.0/networks/2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 HTTP/1.1" status: 200 len: 886 time: 0.1234767 Nov 09 04:22:59.616853 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 51592) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:22:59.830428 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6de93a05-106c-4734-9bee-a5957d0a8da0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:22:59.830796 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6de93a05-106c-4734-9bee-a5957d0a8da0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:22:59.832834 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-6de93a05-106c-4734-9bee-a5957d0a8da0 admin admin] 10.222.0.24 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.2150459 Nov 09 04:23:02.158528 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 51600) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:23:02.246879 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5f47840c-c029-4a72-97f0-e5380b74d1c4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:23:02.247328 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5f47840c-c029-4a72-97f0-e5380b74d1c4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:23:02.248850 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-5f47840c-c029-4a72-97f0-e5380b74d1c4 admin admin] 10.222.0.24 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.0894160 Nov 09 04:23:04.498282 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 51608) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:23:04.588875 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-197e8446-8d8d-47a8-bb22-be17605966ef admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:23:04.590205 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-197e8446-8d8d-47a8-bb22-be17605966ef admin admin] 10.222.0.24 "GET /v2.0/subnets/5e7620d7-182d-4c74-94b7-72b9b0a25a5c HTTP/1.1" status: 200 len: 868 time: 0.0909710 Nov 09 04:23:06.844161 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 51616) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:23:06.932500 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e63d3346-1f44-4cbd-9b35-fea71f2bd1b1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:23:06.933829 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-e63d3346-1f44-4cbd-9b35-fea71f2bd1b1 admin admin] 10.222.0.24 "GET /v2.0/subnets/e932d5b0-df1b-4711-8b71-813e648a5e78 HTTP/1.1" status: 200 len: 816 time: 0.0887918 Nov 09 04:23:11.304639 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-eedfae2d-c592-4734-80c8-93a2fb8ca539 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:23:13.626906 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1d7eddc8-4116-4eae-8a94-4b620edf3b51 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:23:14.975768 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:23:16.327592 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:23:16.924586 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:23:21.470029 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 5 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:23:31.708998 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 51670) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:23:31.756168 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [None req-a8e919cf-167c-493e-a2e2-8b19a79ef4cb admin admin] http://10.222.0.24:9696/v2.0/extensions returned with HTTP 200 {{(pid=102161) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:23:31.757169 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a8e919cf-167c-493e-a2e2-8b19a79ef4cb admin admin] 10.222.0.24 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0472379 Nov 09 04:23:34.127349 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 51678) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:23:34.191079 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-da105203-73a2-48b0-a277-890403f14dcb admin admin] GET failed (client error): The resource could not be found. Nov 09 04:23:34.192404 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-da105203-73a2-48b0-a277-890403f14dcb admin admin] 10.222.0.24 "GET /v2.0/networks/public HTTP/1.1" status: 404 len: 314 time: 0.0639336 Nov 09 04:23:34.275957 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-31e55263-e2ca-42a2-8701-7f1e48296ea8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:23:34.277393 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-31e55263-e2ca-42a2-8701-7f1e48296ea8 admin admin] 10.222.0.24 "GET /v2.0/networks?name=public HTTP/1.1" status: 200 len: 889 time: 0.0804207 Nov 09 04:23:36.567942 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 51686) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:23:36.614795 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-0e941425-618b-4a5d-bad2-556b77e78eca admin admin] Request body: {'network': {'name': 'shared', 'admin_state_up': True, 'shared': True}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:23:36.738341 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0e941425-618b-4a5d-bad2-556b77e78eca admin admin] Made reservation on behalf of cc437a887bd64fcc9e103fe09d48e3bd for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:23:36.740618 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0e941425-618b-4a5d-bad2-556b77e78eca admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:23:36.770700 dv-neutron-816802-2-hyperv neutron-server[102161]: WARNING neutron.services.revisions.revision_plugin [None req-0e941425-618b-4a5d-bad2-556b77e78eca admin admin] Could not find related network for resource to bump revision. Nov 09 04:23:36.781283 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0e941425-618b-4a5d-bad2-556b77e78eca admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 347} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:23:36.790190 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0e941425-618b-4a5d-bad2-556b77e78eca admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:23:36.790556 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-0e941425-618b-4a5d-bad2-556b77e78eca admin admin] Added segment 0c5d83af-b6a6-4c01-9649-7c99fc2fff40 of type vlan for network 4ebec4f8-ab1a-452b-a4e5-d8a3ef247cf7 Nov 09 04:23:36.828424 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0e941425-618b-4a5d-bad2-556b77e78eca admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:23:36.927263 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0e941425-618b-4a5d-bad2-556b77e78eca admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:23:36.928219 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0e941425-618b-4a5d-bad2-556b77e78eca admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:23:36.928819 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0e941425-618b-4a5d-bad2-556b77e78eca admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:23:36.985262 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e941425-618b-4a5d-bad2-556b77e78eca admin admin] Pushing event updated for resources: {'Network': ['ID=4ebec4f8-ab1a-452b-a4e5-d8a3ef247cf7,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:23:36.994832 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 4ebec4f8-ab1a-452b-a4e5-d8a3ef247cf7 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:23:37.027630 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-0e941425-618b-4a5d-bad2-556b77e78eca admin admin] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.4585366 Nov 09 04:23:39.308436 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 51694) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:23:39.367760 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-3287bc34-1b2b-4551-9b35-fe152566b489 admin admin] GET failed (client error): The resource could not be found. Nov 09 04:23:39.369080 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-3287bc34-1b2b-4551-9b35-fe152566b489 admin admin] 10.222.0.24 "GET /v2.0/networks/shared HTTP/1.1" status: 404 len: 314 time: 0.0596511 Nov 09 04:23:39.438881 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-517cf098-380e-4624-bf62-678366419506 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:23:39.440326 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-517cf098-380e-4624-bf62-678366419506 admin admin] 10.222.0.24 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200 len: 826 time: 0.0666821 Nov 09 04:23:39.450229 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-e7cac834-5e5a-4f1f-b37e-37cbb6a2e2bc admin admin] Request body: {'subnet': {'network_id': '4ebec4f8-ab1a-452b-a4e5-d8a3ef247cf7', 'description': 'shared-subnet', 'name': 'shared-subnet', 'cidr': '192.168.233.0/24', 'ip_version': 4}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:23:39.563068 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e7cac834-5e5a-4f1f-b37e-37cbb6a2e2bc admin admin] Made reservation on behalf of cc437a887bd64fcc9e103fe09d48e3bd for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:23:39.565771 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e7cac834-5e5a-4f1f-b37e-37cbb6a2e2bc admin admin] Publish callbacks [] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:23:39.778323 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e7cac834-5e5a-4f1f-b37e-37cbb6a2e2bc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:23:39.831818 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7cac834-5e5a-4f1f-b37e-37cbb6a2e2bc admin admin] Pushing event updated for resources: {'Subnet': ['ID=d8e36c73-ed38-4b28-87ea-6ec74f207dd1,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:23:39.839010 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7cac834-5e5a-4f1f-b37e-37cbb6a2e2bc admin admin] Checking segment: {'id': '0c5d83af-b6a6-4c01-9649-7c99fc2fff40', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 347, 'network_id': '4ebec4f8-ab1a-452b-a4e5-d8a3ef247cf7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:23:39.839354 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e7cac834-5e5a-4f1f-b37e-37cbb6a2e2bc admin admin] Network hostable DHCP agents. Network: 4ebec4f8-ab1a-452b-a4e5-d8a3ef247cf7, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:23:39.906139 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e7cac834-5e5a-4f1f-b37e-37cbb6a2e2bc admin admin] Network 4ebec4f8-ab1a-452b-a4e5-d8a3ef247cf7 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:23:39.974699 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-e7cac834-5e5a-4f1f-b37e-37cbb6a2e2bc admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 4ebec4f8-ab1a-452b-a4e5-d8a3ef247cf7) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:23:39.978647 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e7cac834-5e5a-4f1f-b37e-37cbb6a2e2bc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:23:39.979228 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e7cac834-5e5a-4f1f-b37e-37cbb6a2e2bc admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:23:39.984093 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ead85618-ff17-427c-9d35-137af9bc611e None None] Network 4ebec4f8-ab1a-452b-a4e5-d8a3ef247cf7 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:23:40.083839 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-e7cac834-5e5a-4f1f-b37e-37cbb6a2e2bc admin admin] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.6366980 Nov 09 04:23:40.212876 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-df26d9ee-4abb-4a5b-acde-d122fba9ca64 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-4ebec4f8-ab1a-452b-a4e5-d8a3ef247cf7', 'network_id': '4ebec4f8-ab1a-452b-a4e5-d8a3ef247cf7', 'tenant_id': 'cc437a887bd64fcc9e103fe09d48e3bd', 'fixed_ips': [{'subnet_id': 'd8e36c73-ed38-4b28-87ea-6ec74f207dd1'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:23:40.213958 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-df26d9ee-4abb-4a5b-acde-d122fba9ca64 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:23:40.354191 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-df26d9ee-4abb-4a5b-acde-d122fba9ca64 None None] Allocated IP 192.168.233.2 (4ebec4f8-ab1a-452b-a4e5-d8a3ef247cf7/d8e36c73-ed38-4b28-87ea-6ec74f207dd1/1f4981b1-0748-4c25-93f6-3607ac00ca24) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:23:40.496707 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-df26d9ee-4abb-4a5b-acde-d122fba9ca64 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:23:40.585261 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-df26d9ee-4abb-4a5b-acde-d122fba9ca64 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:23:40.629518 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-df26d9ee-4abb-4a5b-acde-d122fba9ca64 None None] Network 4ebec4f8-ab1a-452b-a4e5-d8a3ef247cf7 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:23:40.633193 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-df26d9ee-4abb-4a5b-acde-d122fba9ca64 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:23:40.635223 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df26d9ee-4abb-4a5b-acde-d122fba9ca64 None None] Pushing event updated for resources: {'Port': ['ID=1f4981b1-0748-4c25-93f6-3607ac00ca24,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:23:40.637326 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-df26d9ee-4abb-4a5b-acde-d122fba9ca64 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:23:40.648090 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df26d9ee-4abb-4a5b-acde-d122fba9ca64 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:23:40.648452 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df26d9ee-4abb-4a5b-acde-d122fba9ca64 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:23:40.648793 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df26d9ee-4abb-4a5b-acde-d122fba9ca64 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:23:40.649130 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df26d9ee-4abb-4a5b-acde-d122fba9ca64 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:23:40.649456 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df26d9ee-4abb-4a5b-acde-d122fba9ca64 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:23:40.649789 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df26d9ee-4abb-4a5b-acde-d122fba9ca64 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:23:40.650109 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df26d9ee-4abb-4a5b-acde-d122fba9ca64 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:23:40.650473 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df26d9ee-4abb-4a5b-acde-d122fba9ca64 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:23:40.650816 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df26d9ee-4abb-4a5b-acde-d122fba9ca64 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:23:40.651141 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df26d9ee-4abb-4a5b-acde-d122fba9ca64 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:23:40.651457 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df26d9ee-4abb-4a5b-acde-d122fba9ca64 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:23:40.651771 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df26d9ee-4abb-4a5b-acde-d122fba9ca64 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:23:40.700648 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-df26d9ee-4abb-4a5b-acde-d122fba9ca64 None None] Attempting to bind port 1f4981b1-0748-4c25-93f6-3607ac00ca24 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:23:40.701013 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-df26d9ee-4abb-4a5b-acde-d122fba9ca64 None None] Attempting to bind port 1f4981b1-0748-4c25-93f6-3607ac00ca24 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '0c5d83af-b6a6-4c01-9649-7c99fc2fff40', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 347, 'network_id': '4ebec4f8-ab1a-452b-a4e5-d8a3ef247cf7'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:23:40.701378 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-df26d9ee-4abb-4a5b-acde-d122fba9ca64 None None] Attempting to bind port 1f4981b1-0748-4c25-93f6-3607ac00ca24 on network 4ebec4f8-ab1a-452b-a4e5-d8a3ef247cf7 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:23:40.706929 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-df26d9ee-4abb-4a5b-acde-d122fba9ca64 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 23, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:23:40.708712 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-df26d9ee-4abb-4a5b-acde-d122fba9ca64 None None] Checking segment: {'id': '0c5d83af-b6a6-4c01-9649-7c99fc2fff40', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 347, 'network_id': '4ebec4f8-ab1a-452b-a4e5-d8a3ef247cf7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:23:40.708712 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-df26d9ee-4abb-4a5b-acde-d122fba9ca64 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:23:40.708712 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-df26d9ee-4abb-4a5b-acde-d122fba9ca64 None None] Bound using segment: {'id': '0c5d83af-b6a6-4c01-9649-7c99fc2fff40', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 347, 'network_id': '4ebec4f8-ab1a-452b-a4e5-d8a3ef247cf7'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:23:40.708712 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-df26d9ee-4abb-4a5b-acde-d122fba9ca64 None None] Bound port: 1f4981b1-0748-4c25-93f6-3607ac00ca24, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0c5d83af-b6a6-4c01-9649-7c99fc2fff40', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 347, 'network_id': '4ebec4f8-ab1a-452b-a4e5-d8a3ef247cf7'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:23:40.709215 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-df26d9ee-4abb-4a5b-acde-d122fba9ca64 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:23:40.772759 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-df26d9ee-4abb-4a5b-acde-d122fba9ca64 None None] For port 1f4981b1-0748-4c25-93f6-3607ac00ca24, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:23:40.775840 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-df26d9ee-4abb-4a5b-acde-d122fba9ca64 None None] For port 1f4981b1-0748-4c25-93f6-3607ac00ca24, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=1f4981b1-0748-4c25-93f6-3607ac00ca24,segment=NetworkSegment(0c5d83af-b6a6-4c01-9649-7c99fc2fff40),segment_id=0c5d83af-b6a6-4c01-9649-7c99fc2fff40)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:23:40.929339 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-df26d9ee-4abb-4a5b-acde-d122fba9ca64 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:23:40.989385 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df26d9ee-4abb-4a5b-acde-d122fba9ca64 None None] Pushing event updated for resources: {'Port': ['ID=1f4981b1-0748-4c25-93f6-3607ac00ca24,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:23:41.310154 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c17e9e5b-23be-4d2f-b1c7-cf088e982a67 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:23:41.797948 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4baa86fe-8546-4e73-94e2-7588486e5d67 None None] Network 4ebec4f8-ab1a-452b-a4e5-d8a3ef247cf7 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:23:41.880619 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-b09239dc-61c9-413a-afe9-5602c8939e07 None None] Provisioning complete for port 1f4981b1-0748-4c25-93f6-3607ac00ca24 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:23:41.880983 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b09239dc-61c9-413a-afe9-5602c8939e07 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:23:42.018267 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b09239dc-61c9-413a-afe9-5602c8939e07 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:23:42.056633 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-b09239dc-61c9-413a-afe9-5602c8939e07 None None] For port 1f4981b1-0748-4c25-93f6-3607ac00ca24, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=1f4981b1-0748-4c25-93f6-3607ac00ca24,segment=NetworkSegment(0c5d83af-b6a6-4c01-9649-7c99fc2fff40),segment_id=0c5d83af-b6a6-4c01-9649-7c99fc2fff40)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:23:42.146332 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b09239dc-61c9-413a-afe9-5602c8939e07 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:23:42.209417 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b09239dc-61c9-413a-afe9-5602c8939e07 None None] Pushing event updated for resources: {'Port': ['ID=1f4981b1-0748-4c25-93f6-3607ac00ca24,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:23:42.267741 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-3895fbae-1882-4cd8-a1e6-794980057387 None None] Provisioning complete for port 1f4981b1-0748-4c25-93f6-3607ac00ca24 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:23:42.268109 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3895fbae-1882-4cd8-a1e6-794980057387 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:23:42.689455 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 1f4981b1-0748-4c25-93f6-3607ac00ca24 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:23:42.740038 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 1f4981b1-0748-4c25-93f6-3607ac00ca24 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:23:42.740392 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:23:43.694464 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d9b32c5c-527d-47d2-8df3-c81ce1c404b2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:23:44.991636 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:23:46.357564 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:23:46.932566 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:23:58.468086 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 5 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:24:11.332040 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a6e44acd-26af-415b-a657-4f30f01ad77c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:24:13.640000 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-de79783f-3e9e-4df1-b5bb-10fbd7587d2a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:24:14.990435 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:24:16.356798 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:24:16.910554 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:24:35.466957 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 5 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:24:41.344437 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-666365c0-f21d-47b7-9ff1-9b97a8618d36 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:24:43.635221 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-602b8b7c-958f-4c4c-aac3-c5291aae0823 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:24:45.063485 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:24:46.366749 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:24:46.932248 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:25:11.307048 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-eaf74670-a1aa-4bc8-bf76-fdd85c0231f6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:25:12.465356 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 5 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:25:13.633859 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-daec1686-a0f3-4f3e-91eb-39c52ee964f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:25:15.015258 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:25:16.347991 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:25:17.051717 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:25:23.164279 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 51738) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:25:23.170113 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [None req-9bc2adb3-613c-4e67-bae0-f5e9ffb14dbf tempest-verify_tempest_config-2054521799 tempest-verify_tempest_config-2054521799-project] http://10.222.0.24:9696/v2.0/extensions returned with HTTP 200 {{(pid=102161) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:25:23.171127 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-9bc2adb3-613c-4e67-bae0-f5e9ffb14dbf tempest-verify_tempest_config-2054521799 tempest-verify_tempest_config-2054521799-project] 10.222.0.24 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14077 time: 0.0058951 Nov 09 04:25:23.665634 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 51756) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:25:23.765485 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-43726386-728e-4ba5-a69d-1db8f0ebd0a9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:25:23.833179 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-43726386-728e-4ba5-a69d-1db8f0ebd0a9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:25:23.902056 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-43726386-728e-4ba5-a69d-1db8f0ebd0a9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:25:23.949667 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-43726386-728e-4ba5-a69d-1db8f0ebd0a9 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=88b8b14db82843a595c493d17c6f9259&name=default HTTP/1.1" status: 200 len: 2992 time: 0.2829938 Nov 09 04:25:23.950755 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43726386-728e-4ba5-a69d-1db8f0ebd0a9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dfabb663-06be-4d30-85b5-9719416607d3,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:25:23.952377 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 51760) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:25:23.957274 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43726386-728e-4ba5-a69d-1db8f0ebd0a9 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:25:23.957635 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43726386-728e-4ba5-a69d-1db8f0ebd0a9 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:25:23.957972 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43726386-728e-4ba5-a69d-1db8f0ebd0a9 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:25:23.958300 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43726386-728e-4ba5-a69d-1db8f0ebd0a9 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:25:23.958643 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43726386-728e-4ba5-a69d-1db8f0ebd0a9 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:25:23.958991 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43726386-728e-4ba5-a69d-1db8f0ebd0a9 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:25:23.959313 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43726386-728e-4ba5-a69d-1db8f0ebd0a9 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:25:23.959643 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43726386-728e-4ba5-a69d-1db8f0ebd0a9 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:25:23.959962 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43726386-728e-4ba5-a69d-1db8f0ebd0a9 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:25:23.960275 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43726386-728e-4ba5-a69d-1db8f0ebd0a9 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:25:23.960585 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43726386-728e-4ba5-a69d-1db8f0ebd0a9 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:25:23.960891 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43726386-728e-4ba5-a69d-1db8f0ebd0a9 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:25:24.034514 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-75ea39bb-02b0-4ae7-a3a0-3933e3eebfc2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:25:24.054663 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-75ea39bb-02b0-4ae7-a3a0-3933e3eebfc2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:25:24.182565 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-75ea39bb-02b0-4ae7-a3a0-3933e3eebfc2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:25:24.185086 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-75ea39bb-02b0-4ae7-a3a0-3933e3eebfc2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:25:24.186239 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-75ea39bb-02b0-4ae7-a3a0-3933e3eebfc2 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/dfabb663-06be-4d30-85b5-9719416607d3 HTTP/1.1" status: 204 len: 168 time: 0.2328939 Nov 09 04:25:24.193710 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75ea39bb-02b0-4ae7-a3a0-3933e3eebfc2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dfabb663-06be-4d30-85b5-9719416607d3,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:25:24.205935 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75ea39bb-02b0-4ae7-a3a0-3933e3eebfc2 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:25:24.206292 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75ea39bb-02b0-4ae7-a3a0-3933e3eebfc2 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:25:24.206655 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75ea39bb-02b0-4ae7-a3a0-3933e3eebfc2 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:25:24.206980 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75ea39bb-02b0-4ae7-a3a0-3933e3eebfc2 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:25:24.207300 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75ea39bb-02b0-4ae7-a3a0-3933e3eebfc2 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:25:24.207631 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75ea39bb-02b0-4ae7-a3a0-3933e3eebfc2 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:25:24.207950 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75ea39bb-02b0-4ae7-a3a0-3933e3eebfc2 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:25:24.208276 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75ea39bb-02b0-4ae7-a3a0-3933e3eebfc2 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:25:24.208591 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75ea39bb-02b0-4ae7-a3a0-3933e3eebfc2 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:25:24.208980 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75ea39bb-02b0-4ae7-a3a0-3933e3eebfc2 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:25:24.209192 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75ea39bb-02b0-4ae7-a3a0-3933e3eebfc2 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:25:24.209496 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75ea39bb-02b0-4ae7-a3a0-3933e3eebfc2 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:25:24.210813 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75ea39bb-02b0-4ae7-a3a0-3933e3eebfc2 admin admin] Tracked resource versions report: Nov 09 04:25:24.210813 dv-neutron-816802-2-hyperv neutron-server[102162]: pushed versions: Nov 09 04:25:24.210813 dv-neutron-816802-2-hyperv neutron-server[102162]: { 'AddressGroup': {'1.2'}, Nov 09 04:25:24.210813 dv-neutron-816802-2-hyperv neutron-server[102162]: 'ConntrackHelper': {'1.0'}, Nov 09 04:25:24.210813 dv-neutron-816802-2-hyperv neutron-server[102162]: 'Log': {'1.0'}, Nov 09 04:25:24.210813 dv-neutron-816802-2-hyperv neutron-server[102162]: 'Network': {'1.1'}, Nov 09 04:25:24.210813 dv-neutron-816802-2-hyperv neutron-server[102162]: 'Port': {'1.7'}, Nov 09 04:25:24.210813 dv-neutron-816802-2-hyperv neutron-server[102162]: 'PortForwarding': {'1.2'}, Nov 09 04:25:24.210813 dv-neutron-816802-2-hyperv neutron-server[102162]: 'QosPolicy': {'1.10'}, Nov 09 04:25:24.210813 dv-neutron-816802-2-hyperv neutron-server[102162]: 'SecurityGroup': {'1.5'}, Nov 09 04:25:24.210813 dv-neutron-816802-2-hyperv neutron-server[102162]: 'SecurityGroupRule': {'1.2'}, Nov 09 04:25:24.210813 dv-neutron-816802-2-hyperv neutron-server[102162]: 'SubPort': {'1.0'}, Nov 09 04:25:24.210813 dv-neutron-816802-2-hyperv neutron-server[102162]: 'Subnet': {'1.1'}, Nov 09 04:25:24.210813 dv-neutron-816802-2-hyperv neutron-server[102162]: 'Trunk': {'1.1'}} Nov 09 04:25:24.210813 dv-neutron-816802-2-hyperv neutron-server[102162]: consumer versions: Nov 09 04:25:24.210813 dv-neutron-816802-2-hyperv neutron-server[102162]: { DHCP agent@dv-neutron-816802-2-hyperv: {}, Nov 09 04:25:24.210813 dv-neutron-816802-2-hyperv neutron-server[102162]: L3 agent@dv-neutron-816802-2-hyperv: {}, Nov 09 04:25:24.210813 dv-neutron-816802-2-hyperv neutron-server[102162]: Metadata agent@dv-neutron-816802-2-hyperv: {}, Nov 09 04:25:24.210813 dv-neutron-816802-2-hyperv neutron-server[102162]: Metering agent@dv-neutron-816802-2-hyperv: {}, Nov 09 04:25:24.210813 dv-neutron-816802-2-hyperv neutron-server[102162]: Open vSwitch agent@dv-neutron-816802-2-hyperv: { 'AddressGroup': '1.2', Nov 09 04:25:24.210813 dv-neutron-816802-2-hyperv neutron-server[102162]: 'ConntrackHelper': '1.0', Nov 09 04:25:24.210813 dv-neutron-816802-2-hyperv neutron-server[102162]: 'Log': '1.0', Nov 09 04:25:24.210813 dv-neutron-816802-2-hyperv neutron-server[102162]: 'Network': '1.1', Nov 09 04:25:24.210813 dv-neutron-816802-2-hyperv neutron-server[102162]: 'Port': '1.7', Nov 09 04:25:24.210813 dv-neutron-816802-2-hyperv neutron-server[102162]: 'PortForwarding': '1.2', Nov 09 04:25:24.210813 dv-neutron-816802-2-hyperv neutron-server[102162]: 'QosPolicy': '1.10', Nov 09 04:25:24.210813 dv-neutron-816802-2-hyperv neutron-server[102162]: 'SecurityGroup': '1.5', Nov 09 04:25:24.210813 dv-neutron-816802-2-hyperv neutron-server[102162]: 'SecurityGroupRule': '1.2', Nov 09 04:25:24.210813 dv-neutron-816802-2-hyperv neutron-server[102162]: 'SubPort': '1.0', Nov 09 04:25:24.210813 dv-neutron-816802-2-hyperv neutron-server[102162]: 'Subnet': '1.1', Nov 09 04:25:24.210813 dv-neutron-816802-2-hyperv neutron-server[102162]: 'Trunk': '1.1'}} Nov 09 04:25:24.210813 dv-neutron-816802-2-hyperv neutron-server[102162]: {{(pid=102162) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 09 04:25:41.317392 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-bdee9162-f0ca-4ce6-a47e-df820bc89c07 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:25:43.735789 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-44268a09-9e56-4773-97d4-968d56bf7a91 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:25:45.025855 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:25:46.353207 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:25:46.918501 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:25:49.462785 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 5 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:26:11.334752 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5a46cbf5-e114-4906-b238-507a735250ab None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:26:13.643093 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8c2c86aa-8b5f-4e29-bc65-6dbbc1e48c0f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:26:15.019967 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:26:16.357490 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:26:16.933039 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:26:26.462231 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 5 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:26:41.293212 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-23ccfb9c-b03c-4ce2-b803-34272fc3c68f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:26:42.046812 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-465384'] for agent, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:26:43.682256 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-aa557df1-86ff-40fe-92d5-4d399ced9022 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:26:45.024948 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:26:46.349785 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:26:46.927806 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:26:56.594010 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 51836) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:26:56.696374 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-ce8b3125-073a-4701-b846-fba4f0bf7a7e admin admin] 10.222.0.24 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4565 time: 0.1012690 Nov 09 04:26:59.023567 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 51846) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:26:59.083717 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-438e3afe-06e9-452e-87c0-1fef20623f7e admin admin] 10.222.0.24 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4565 time: 0.0590816 Nov 09 04:27:03.460216 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:27:11.303572 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5073c87e-192b-4325-be8e-8de1e5576821 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:27:11.977366 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:27:13.674667 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-fd791192-35c4-417b-ba1d-1a6909e2c44a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:27:15.022783 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:27:16.349280 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:27:16.897653 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:27:40.459992 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:27:41.319082 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-bb4fa875-1ed5-4c76-a259-90866e99105a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:27:41.994344 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:27:43.656512 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-98580335-7731-44ee-9d01-42a51f30014f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:27:44.999405 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:27:46.376604 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:27:46.925395 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:11.318574 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-283b8052-b182-4a86-89c2-83844a7fa81b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:11.998849 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:13.643527 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ac5a9779-1614-4131-b9c5-7a520a4a2f1a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:14.917915 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52036) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:14.954496 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52042) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:15.027793 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:15.396733 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-85d7645a-cc04-4bc8-86eb-9b63fec84893 admin admin] Request body: {'network': {'name': 'tempest-ServersTestJSON-828046534-network', 'tenant_id': 'a229c806094b42c7a0f7ed52f78dfd68'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:15.406167 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-7c3d85b3-d45d-4e0e-82e7-9b53e8cefa4b admin admin] Request body: {'network': {'name': 'tempest-ServersTestManualDisk-509590275-network', 'tenant_id': '5f3cd2a3586e46c09f847681f744075c'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:15.426014 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.db.api [None req-7c3d85b3-d45d-4e0e-82e7-9b53e8cefa4b admin admin] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Nov 09 04:28:15.426014 dv-neutron-816802-2-hyperv neutron-server[102161]: [SQL: INSERT INTO reservations (project_id, id, expiration) VALUES (%(project_id)s, %(id)s, %(expiration)s)] Nov 09 04:28:15.426014 dv-neutron-816802-2-hyperv neutron-server[102161]: [parameters: {'project_id': '5f3cd2a3586e46c09f847681f744075c', 'id': '4baa6b78-650c-440b-8cc7-8319d4cf7dec', 'expiration': datetime.datetime(2021, 11, 9, 4, 30, 15, 421677)}] Nov 09 04:28:15.426014 dv-neutron-816802-2-hyperv neutron-server[102161]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=102161) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:28:15.426414 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG oslo_db.api [None req-7c3d85b3-d45d-4e0e-82e7-9b53e8cefa4b admin admin] Performing DB retry for function neutron.db.quota.driver_nolock.DbQuotaNoLockDriver.make_reservation {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:28:15.512730 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-85d7645a-cc04-4bc8-86eb-9b63fec84893 admin admin] Made reservation on behalf of a229c806094b42c7a0f7ed52f78dfd68 for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:28:15.515498 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-85d7645a-cc04-4bc8-86eb-9b63fec84893 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:15.526380 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-85d7645a-cc04-4bc8-86eb-9b63fec84893 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:15.600694 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-85d7645a-cc04-4bc8-86eb-9b63fec84893 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:15.701049 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-85d7645a-cc04-4bc8-86eb-9b63fec84893 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:15.726478 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-85d7645a-cc04-4bc8-86eb-9b63fec84893 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 348} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:28:15.735948 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85d7645a-cc04-4bc8-86eb-9b63fec84893 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bec819c5-7328-445e-9491-61fd52474b1a,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:15.740701 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-85d7645a-cc04-4bc8-86eb-9b63fec84893 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:15.741040 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-85d7645a-cc04-4bc8-86eb-9b63fec84893 admin admin] Added segment 9b34c07b-e9e3-4439-982a-e160009938cf of type vlan for network d4ba3288-221c-40f3-a829-662c462cc93f Nov 09 04:28:15.752217 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85d7645a-cc04-4bc8-86eb-9b63fec84893 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:28:15.752560 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85d7645a-cc04-4bc8-86eb-9b63fec84893 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:28:15.752888 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85d7645a-cc04-4bc8-86eb-9b63fec84893 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:28:15.753211 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85d7645a-cc04-4bc8-86eb-9b63fec84893 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:28:15.753531 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85d7645a-cc04-4bc8-86eb-9b63fec84893 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:28:15.753872 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85d7645a-cc04-4bc8-86eb-9b63fec84893 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:28:15.754192 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85d7645a-cc04-4bc8-86eb-9b63fec84893 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:28:15.754546 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85d7645a-cc04-4bc8-86eb-9b63fec84893 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:28:15.756555 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85d7645a-cc04-4bc8-86eb-9b63fec84893 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:28:15.756555 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85d7645a-cc04-4bc8-86eb-9b63fec84893 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:28:15.756555 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85d7645a-cc04-4bc8-86eb-9b63fec84893 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:28:15.756555 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85d7645a-cc04-4bc8-86eb-9b63fec84893 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:28:15.757017 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85d7645a-cc04-4bc8-86eb-9b63fec84893 admin admin] Tracked resource versions report: Nov 09 04:28:15.757017 dv-neutron-816802-2-hyperv neutron-server[102161]: pushed versions: Nov 09 04:28:15.757017 dv-neutron-816802-2-hyperv neutron-server[102161]: { 'AddressGroup': {'1.2'}, Nov 09 04:28:15.757017 dv-neutron-816802-2-hyperv neutron-server[102161]: 'ConntrackHelper': {'1.0'}, Nov 09 04:28:15.757017 dv-neutron-816802-2-hyperv neutron-server[102161]: 'Log': {'1.0'}, Nov 09 04:28:15.757017 dv-neutron-816802-2-hyperv neutron-server[102161]: 'Network': {'1.1'}, Nov 09 04:28:15.757017 dv-neutron-816802-2-hyperv neutron-server[102161]: 'Port': {'1.7'}, Nov 09 04:28:15.757017 dv-neutron-816802-2-hyperv neutron-server[102161]: 'PortForwarding': {'1.2'}, Nov 09 04:28:15.757017 dv-neutron-816802-2-hyperv neutron-server[102161]: 'QosPolicy': {'1.10'}, Nov 09 04:28:15.757017 dv-neutron-816802-2-hyperv neutron-server[102161]: 'SecurityGroup': {'1.5'}, Nov 09 04:28:15.757017 dv-neutron-816802-2-hyperv neutron-server[102161]: 'SecurityGroupRule': {'1.2'}, Nov 09 04:28:15.757017 dv-neutron-816802-2-hyperv neutron-server[102161]: 'SubPort': {'1.0'}, Nov 09 04:28:15.757017 dv-neutron-816802-2-hyperv neutron-server[102161]: 'Subnet': {'1.1'}, Nov 09 04:28:15.757017 dv-neutron-816802-2-hyperv neutron-server[102161]: 'Trunk': {'1.1'}} Nov 09 04:28:15.757017 dv-neutron-816802-2-hyperv neutron-server[102161]: consumer versions: Nov 09 04:28:15.757017 dv-neutron-816802-2-hyperv neutron-server[102161]: { DHCP agent@dv-neutron-816802-2-hyperv: {}, Nov 09 04:28:15.757017 dv-neutron-816802-2-hyperv neutron-server[102161]: HyperV agent@hv-neutron-8168: {}, Nov 09 04:28:15.757017 dv-neutron-816802-2-hyperv neutron-server[102161]: L3 agent@dv-neutron-816802-2-hyperv: {}, Nov 09 04:28:15.757017 dv-neutron-816802-2-hyperv neutron-server[102161]: Metadata agent@dv-neutron-816802-2-hyperv: {}, Nov 09 04:28:15.757017 dv-neutron-816802-2-hyperv neutron-server[102161]: Metering agent@dv-neutron-816802-2-hyperv: {}, Nov 09 04:28:15.757017 dv-neutron-816802-2-hyperv neutron-server[102161]: Open vSwitch agent@dv-neutron-816802-2-hyperv: { 'AddressGroup': '1.2', Nov 09 04:28:15.757017 dv-neutron-816802-2-hyperv neutron-server[102161]: 'ConntrackHelper': '1.0', Nov 09 04:28:15.757017 dv-neutron-816802-2-hyperv neutron-server[102161]: 'Log': '1.0', Nov 09 04:28:15.757017 dv-neutron-816802-2-hyperv neutron-server[102161]: 'Network': '1.1', Nov 09 04:28:15.757017 dv-neutron-816802-2-hyperv neutron-server[102161]: 'Port': '1.7', Nov 09 04:28:15.757017 dv-neutron-816802-2-hyperv neutron-server[102161]: 'PortForwarding': '1.2', Nov 09 04:28:15.757017 dv-neutron-816802-2-hyperv neutron-server[102161]: 'QosPolicy': '1.10', Nov 09 04:28:15.757017 dv-neutron-816802-2-hyperv neutron-server[102161]: 'SecurityGroup': '1.5', Nov 09 04:28:15.757017 dv-neutron-816802-2-hyperv neutron-server[102161]: 'SecurityGroupRule': '1.2', Nov 09 04:28:15.757017 dv-neutron-816802-2-hyperv neutron-server[102161]: 'SubPort': '1.0', Nov 09 04:28:15.757017 dv-neutron-816802-2-hyperv neutron-server[102161]: 'Subnet': '1.1', Nov 09 04:28:15.757017 dv-neutron-816802-2-hyperv neutron-server[102161]: 'Trunk': '1.1'}} Nov 09 04:28:15.757017 dv-neutron-816802-2-hyperv neutron-server[102161]: {{(pid=102161) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 09 04:28:15.794940 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-85d7645a-cc04-4bc8-86eb-9b63fec84893 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:15.872869 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-85d7645a-cc04-4bc8-86eb-9b63fec84893 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:15.877127 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-85d7645a-cc04-4bc8-86eb-9b63fec84893 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:15.877127 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-85d7645a-cc04-4bc8-86eb-9b63fec84893 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:15.933062 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85d7645a-cc04-4bc8-86eb-9b63fec84893 admin admin] Pushing event updated for resources: {'Network': ['ID=d4ba3288-221c-40f3-a829-662c462cc93f,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:15.943358 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network d4ba3288-221c-40f3-a829-662c462cc93f details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:28:15.958828 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-85d7645a-cc04-4bc8-86eb-9b63fec84893 admin admin] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 878 time: 1.0397930 Nov 09 04:28:15.963849 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52076) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:15.972033 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-7d203a5e-cea8-4f94-8c7e-1617b3fc2e04 admin admin] Request body: {'subnet': {'network_id': 'd4ba3288-221c-40f3-a829-662c462cc93f', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServersTestJSON-828046534-subnet', 'tenant_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:16.027657 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7c3d85b3-d45d-4e0e-82e7-9b53e8cefa4b admin admin] Made reservation on behalf of 5f3cd2a3586e46c09f847681f744075c for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:28:16.030222 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7c3d85b3-d45d-4e0e-82e7-9b53e8cefa4b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:16.043200 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7c3d85b3-d45d-4e0e-82e7-9b53e8cefa4b admin admin] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:16.102843 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7d203a5e-cea8-4f94-8c7e-1617b3fc2e04 admin admin] Made reservation on behalf of a229c806094b42c7a0f7ed52f78dfd68 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:28:16.106641 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7d203a5e-cea8-4f94-8c7e-1617b3fc2e04 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:16.122946 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7c3d85b3-d45d-4e0e-82e7-9b53e8cefa4b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:16.186938 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7c3d85b3-d45d-4e0e-82e7-9b53e8cefa4b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:16.207312 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7c3d85b3-d45d-4e0e-82e7-9b53e8cefa4b admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 329} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:28:16.220286 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c3d85b3-d45d-4e0e-82e7-9b53e8cefa4b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=57cc57cf-ad83-4355-be3b-c1f64d56d806,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:16.224891 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7c3d85b3-d45d-4e0e-82e7-9b53e8cefa4b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:16.225331 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-7c3d85b3-d45d-4e0e-82e7-9b53e8cefa4b admin admin] Added segment efe0485f-d48f-4307-b89a-0bcb86aaf1c2 of type vlan for network 468b2f91-119a-402c-b695-5d7963ec6348 Nov 09 04:28:16.281047 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7c3d85b3-d45d-4e0e-82e7-9b53e8cefa4b admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:16.363605 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7c3d85b3-d45d-4e0e-82e7-9b53e8cefa4b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:16.364405 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:16.364942 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7c3d85b3-d45d-4e0e-82e7-9b53e8cefa4b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:16.365576 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7c3d85b3-d45d-4e0e-82e7-9b53e8cefa4b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:16.420523 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c3d85b3-d45d-4e0e-82e7-9b53e8cefa4b admin admin] Pushing event updated for resources: {'Network': ['ID=468b2f91-119a-402c-b695-5d7963ec6348,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:16.434774 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 468b2f91-119a-402c-b695-5d7963ec6348 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:28:16.525001 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-7c3d85b3-d45d-4e0e-82e7-9b53e8cefa4b admin admin] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 1.5666306 Nov 09 04:28:16.525161 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52100) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:16.530081 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-7d6283e0-cf4f-4050-a443-0b58f8b79691 admin admin] Request body: {'subnet': {'network_id': '468b2f91-119a-402c-b695-5d7963ec6348', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServersTestManualDisk-509590275-subnet', 'tenant_id': '5f3cd2a3586e46c09f847681f744075c', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:16.530504 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7d203a5e-cea8-4f94-8c7e-1617b3fc2e04 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:16.617486 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d203a5e-cea8-4f94-8c7e-1617b3fc2e04 admin admin] Pushing event updated for resources: {'Subnet': ['ID=b11be6b4-75f0-4756-9312-de5295f24e1b,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:16.621064 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7d203a5e-cea8-4f94-8c7e-1617b3fc2e04 admin admin] Checking segment: {'id': '9b34c07b-e9e3-4439-982a-e160009938cf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 348, 'network_id': 'd4ba3288-221c-40f3-a829-662c462cc93f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:28:16.621437 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7d203a5e-cea8-4f94-8c7e-1617b3fc2e04 admin admin] Network hostable DHCP agents. Network: d4ba3288-221c-40f3-a829-662c462cc93f, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:28:16.627375 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7d6283e0-cf4f-4050-a443-0b58f8b79691 admin admin] Made reservation on behalf of 5f3cd2a3586e46c09f847681f744075c for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:28:16.629831 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7d6283e0-cf4f-4050-a443-0b58f8b79691 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:16.634239 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d203a5e-cea8-4f94-8c7e-1617b3fc2e04 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:28:16.634626 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d203a5e-cea8-4f94-8c7e-1617b3fc2e04 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:28:16.634991 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d203a5e-cea8-4f94-8c7e-1617b3fc2e04 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:28:16.635323 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d203a5e-cea8-4f94-8c7e-1617b3fc2e04 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:28:16.635664 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d203a5e-cea8-4f94-8c7e-1617b3fc2e04 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:28:16.635986 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d203a5e-cea8-4f94-8c7e-1617b3fc2e04 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:28:16.636309 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d203a5e-cea8-4f94-8c7e-1617b3fc2e04 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:28:16.636650 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d203a5e-cea8-4f94-8c7e-1617b3fc2e04 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:28:16.636973 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d203a5e-cea8-4f94-8c7e-1617b3fc2e04 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:28:16.637288 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d203a5e-cea8-4f94-8c7e-1617b3fc2e04 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:28:16.637599 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d203a5e-cea8-4f94-8c7e-1617b3fc2e04 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:28:16.637912 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d203a5e-cea8-4f94-8c7e-1617b3fc2e04 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:28:16.638992 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d203a5e-cea8-4f94-8c7e-1617b3fc2e04 admin admin] Tracked resource versions report: Nov 09 04:28:16.638992 dv-neutron-816802-2-hyperv neutron-server[102162]: pushed versions: Nov 09 04:28:16.638992 dv-neutron-816802-2-hyperv neutron-server[102162]: { 'AddressGroup': {'1.2'}, Nov 09 04:28:16.638992 dv-neutron-816802-2-hyperv neutron-server[102162]: 'ConntrackHelper': {'1.0'}, Nov 09 04:28:16.638992 dv-neutron-816802-2-hyperv neutron-server[102162]: 'Log': {'1.0'}, Nov 09 04:28:16.638992 dv-neutron-816802-2-hyperv neutron-server[102162]: 'Network': {'1.1'}, Nov 09 04:28:16.638992 dv-neutron-816802-2-hyperv neutron-server[102162]: 'Port': {'1.7'}, Nov 09 04:28:16.638992 dv-neutron-816802-2-hyperv neutron-server[102162]: 'PortForwarding': {'1.2'}, Nov 09 04:28:16.638992 dv-neutron-816802-2-hyperv neutron-server[102162]: 'QosPolicy': {'1.10'}, Nov 09 04:28:16.638992 dv-neutron-816802-2-hyperv neutron-server[102162]: 'SecurityGroup': {'1.5'}, Nov 09 04:28:16.638992 dv-neutron-816802-2-hyperv neutron-server[102162]: 'SecurityGroupRule': {'1.2'}, Nov 09 04:28:16.638992 dv-neutron-816802-2-hyperv neutron-server[102162]: 'SubPort': {'1.0'}, Nov 09 04:28:16.638992 dv-neutron-816802-2-hyperv neutron-server[102162]: 'Subnet': {'1.1'}, Nov 09 04:28:16.638992 dv-neutron-816802-2-hyperv neutron-server[102162]: 'Trunk': {'1.1'}} Nov 09 04:28:16.638992 dv-neutron-816802-2-hyperv neutron-server[102162]: consumer versions: Nov 09 04:28:16.638992 dv-neutron-816802-2-hyperv neutron-server[102162]: { DHCP agent@dv-neutron-816802-2-hyperv: {}, Nov 09 04:28:16.638992 dv-neutron-816802-2-hyperv neutron-server[102162]: HyperV agent@hv-neutron-8168: {}, Nov 09 04:28:16.638992 dv-neutron-816802-2-hyperv neutron-server[102162]: L3 agent@dv-neutron-816802-2-hyperv: {}, Nov 09 04:28:16.638992 dv-neutron-816802-2-hyperv neutron-server[102162]: Metadata agent@dv-neutron-816802-2-hyperv: {}, Nov 09 04:28:16.638992 dv-neutron-816802-2-hyperv neutron-server[102162]: Metering agent@dv-neutron-816802-2-hyperv: {}, Nov 09 04:28:16.638992 dv-neutron-816802-2-hyperv neutron-server[102162]: Open vSwitch agent@dv-neutron-816802-2-hyperv: { 'AddressGroup': '1.2', Nov 09 04:28:16.638992 dv-neutron-816802-2-hyperv neutron-server[102162]: 'ConntrackHelper': '1.0', Nov 09 04:28:16.638992 dv-neutron-816802-2-hyperv neutron-server[102162]: 'Log': '1.0', Nov 09 04:28:16.638992 dv-neutron-816802-2-hyperv neutron-server[102162]: 'Network': '1.1', Nov 09 04:28:16.638992 dv-neutron-816802-2-hyperv neutron-server[102162]: 'Port': '1.7', Nov 09 04:28:16.638992 dv-neutron-816802-2-hyperv neutron-server[102162]: 'PortForwarding': '1.2', Nov 09 04:28:16.638992 dv-neutron-816802-2-hyperv neutron-server[102162]: 'QosPolicy': '1.10', Nov 09 04:28:16.638992 dv-neutron-816802-2-hyperv neutron-server[102162]: 'SecurityGroup': '1.5', Nov 09 04:28:16.638992 dv-neutron-816802-2-hyperv neutron-server[102162]: 'SecurityGroupRule': '1.2', Nov 09 04:28:16.638992 dv-neutron-816802-2-hyperv neutron-server[102162]: 'SubPort': '1.0', Nov 09 04:28:16.638992 dv-neutron-816802-2-hyperv neutron-server[102162]: 'Subnet': '1.1', Nov 09 04:28:16.638992 dv-neutron-816802-2-hyperv neutron-server[102162]: 'Trunk': '1.1'}} Nov 09 04:28:16.638992 dv-neutron-816802-2-hyperv neutron-server[102162]: {{(pid=102162) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 09 04:28:16.747424 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7d203a5e-cea8-4f94-8c7e-1617b3fc2e04 admin admin] Network d4ba3288-221c-40f3-a829-662c462cc93f is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:28:16.836929 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52112) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:16.843721 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-7d203a5e-cea8-4f94-8c7e-1617b3fc2e04 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, d4ba3288-221c-40f3-a829-662c462cc93f) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:28:16.854955 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7d203a5e-cea8-4f94-8c7e-1617b3fc2e04 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:16.854955 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7d203a5e-cea8-4f94-8c7e-1617b3fc2e04 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:16.859832 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52116) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:16.867878 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1be3c7f9-23c4-45e5-b25a-fb093adbb75c None None] Network d4ba3288-221c-40f3-a829-662c462cc93f requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:28:16.917137 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7d6283e0-cf4f-4050-a443-0b58f8b79691 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:16.938001 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-7d203a5e-cea8-4f94-8c7e-1617b3fc2e04 admin admin] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 841 time: 0.9714692 Nov 09 04:28:16.940650 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52122) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:16.944790 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-a16e92f3-81c4-4d77-85e7-9481a09539e4 admin admin] Request body: {'router': {'name': 'tempest-ServersTestJSON-828046534-router', 'tenant_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:16.971168 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:16.980709 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7d6283e0-cf4f-4050-a443-0b58f8b79691 admin admin] Checking segment: {'id': 'efe0485f-d48f-4307-b89a-0bcb86aaf1c2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 329, 'network_id': '468b2f91-119a-402c-b695-5d7963ec6348'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:28:16.981225 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7d6283e0-cf4f-4050-a443-0b58f8b79691 admin admin] Network hostable DHCP agents. Network: 468b2f91-119a-402c-b695-5d7963ec6348, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:28:16.988801 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d6283e0-cf4f-4050-a443-0b58f8b79691 admin admin] Pushing event updated for resources: {'Subnet': ['ID=a3d93294-0484-46fa-b8a6-204ec86c9c5f,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:17.057887 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d39d1b27-18e8-415e-8a22-1905a346389f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-d4ba3288-221c-40f3-a829-662c462cc93f', 'network_id': 'd4ba3288-221c-40f3-a829-662c462cc93f', 'tenant_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'fixed_ips': [{'subnet_id': 'b11be6b4-75f0-4756-9312-de5295f24e1b'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:28:17.059172 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d39d1b27-18e8-415e-8a22-1905a346389f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:17.101642 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a16e92f3-81c4-4d77-85e7-9481a09539e4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:17.102755 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a16e92f3-81c4-4d77-85e7-9481a09539e4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:17.118761 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7d6283e0-cf4f-4050-a443-0b58f8b79691 admin admin] Network 468b2f91-119a-402c-b695-5d7963ec6348 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:28:17.162653 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a16e92f3-81c4-4d77-85e7-9481a09539e4 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:17.202905 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-1251d4ea-dfa6-4e2c-a8e3-fc0055f49cf4 tempest-MeteringTestJSON-493962237 tempest-MeteringTestJSON-493962237-project-admin] Request body: {'metering_label': {'description': 'metering label created by tempest', 'name': 'tempest-metering-label-1103742048'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:17.203621 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-7d6283e0-cf4f-4050-a443-0b58f8b79691 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 468b2f91-119a-402c-b695-5d7963ec6348) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:28:17.203948 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-1251d4ea-dfa6-4e2c-a8e3-fc0055f49cf4 tempest-MeteringTestJSON-493962237 tempest-MeteringTestJSON-493962237-project-admin] Unknown quota resources ['metering_label']. {{(pid=102162) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Nov 09 04:28:17.213118 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7d6283e0-cf4f-4050-a443-0b58f8b79691 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:17.214416 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7d6283e0-cf4f-4050-a443-0b58f8b79691 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:17.226477 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-152c0def-acd6-4a5a-9c1c-bb94844f9ccf None None] Network 468b2f91-119a-402c-b695-5d7963ec6348 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:28:17.258927 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-d39d1b27-18e8-415e-8a22-1905a346389f None None] Allocated IP 172.20.0.2 (d4ba3288-221c-40f3-a829-662c462cc93f/b11be6b4-75f0-4756-9312-de5295f24e1b/29a6d3fc-4c49-4c48-8a90-1e058b15af0d) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:28:17.321800 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-7d6283e0-cf4f-4050-a443-0b58f8b79691 admin admin] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.7955317 Nov 09 04:28:17.330044 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52132) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:17.334578 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-d585d776-aca9-4b65-a3ac-f28fd9433b7a admin admin] Request body: {'router': {'name': 'tempest-ServersTestManualDisk-509590275-router', 'tenant_id': '5f3cd2a3586e46c09f847681f744075c', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:17.359719 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-f0a0242a-3394-4ad9-b165-0827ee38daba tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Request body: {'network': {'name': 'tempest-DHCPAgentSchedulersTestJSON-test-network-1983421889'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:17.397310 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.db.api [None req-f0a0242a-3394-4ad9-b165-0827ee38daba tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Nov 09 04:28:17.397310 dv-neutron-816802-2-hyperv neutron-server[102161]: [SQL: DELETE FROM reservations WHERE reservations.project_id = %(project_id_1)s AND reservations.expiration < %(expiration_1)s] Nov 09 04:28:17.397310 dv-neutron-816802-2-hyperv neutron-server[102161]: [parameters: {'project_id_1': '20a65be85603415da5c8f9fb587db6d6', 'expiration_1': datetime.datetime(2021, 11, 9, 4, 27, 57, 374963)}] Nov 09 04:28:17.397310 dv-neutron-816802-2-hyperv neutron-server[102161]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=102161) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:28:17.398514 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG oslo_db.api [None req-f0a0242a-3394-4ad9-b165-0827ee38daba tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Performing DB retry for function neutron.db.quota.driver_nolock.DbQuotaNoLockDriver.make_reservation {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:28:17.466811 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:28:17.497306 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d585d776-aca9-4b65-a3ac-f28fd9433b7a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:17.501128 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d585d776-aca9-4b65-a3ac-f28fd9433b7a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:17.526896 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52136) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:17.605758 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1251d4ea-dfa6-4e2c-a8e3-fc0055f49cf4 tempest-MeteringTestJSON-493962237 tempest-MeteringTestJSON-493962237-project-admin] Publish callbacks [] for metering_label, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:17.610069 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-1251d4ea-dfa6-4e2c-a8e3-fc0055f49cf4 tempest-MeteringTestJSON-493962237 tempest-MeteringTestJSON-493962237-project-admin] 10.222.0.24 "POST /v2.0/metering/metering-labels HTTP/1.1" status: 201 len: 478 time: 0.7721021 Nov 09 04:28:17.610690 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52142) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:17.629537 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d39d1b27-18e8-415e-8a22-1905a346389f None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:17.649373 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-c1243893-4343-4b4e-872e-e03b4798556a tempest-MeteringTestJSON-493962237 tempest-MeteringTestJSON-493962237-project-admin] Request body: {'metering_label_rule': {'remote_ip_prefix': '10.0.0.0/24', 'direction': 'ingress', 'metering_label_id': 'aa33c565-b6f8-4048-9c28-871da5544c03'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:17.649882 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-c1243893-4343-4b4e-872e-e03b4798556a tempest-MeteringTestJSON-493962237 tempest-MeteringTestJSON-493962237-project-admin] Unknown quota resources ['metering_label_rule']. {{(pid=102162) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Nov 09 04:28:17.665180 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a16e92f3-81c4-4d77-85e7-9481a09539e4 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:17.673227 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52146) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:17.720021 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7aba0e50-b0dd-4dea-8a76-695fe8fcfbf2 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-468b2f91-119a-402c-b695-5d7963ec6348', 'network_id': '468b2f91-119a-402c-b695-5d7963ec6348', 'tenant_id': '5f3cd2a3586e46c09f847681f744075c', 'fixed_ips': [{'subnet_id': 'a3d93294-0484-46fa-b8a6-204ec86c9c5f'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:28:17.720021 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7aba0e50-b0dd-4dea-8a76-695fe8fcfbf2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:17.720244 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d585d776-aca9-4b65-a3ac-f28fd9433b7a admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:17.720912 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d39d1b27-18e8-415e-8a22-1905a346389f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:17.779105 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d39d1b27-18e8-415e-8a22-1905a346389f None None] Network d4ba3288-221c-40f3-a829-662c462cc93f is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:28:17.829130 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-d39d1b27-18e8-415e-8a22-1905a346389f None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:28:17.834844 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d39d1b27-18e8-415e-8a22-1905a346389f None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:28:17.844496 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d39d1b27-18e8-415e-8a22-1905a346389f None None] Pushing event updated for resources: {'Port': ['ID=29a6d3fc-4c49-4c48-8a90-1e058b15af0d,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:17.886544 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d39d1b27-18e8-415e-8a22-1905a346389f None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:28:17.886915 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d39d1b27-18e8-415e-8a22-1905a346389f None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:28:17.887262 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d39d1b27-18e8-415e-8a22-1905a346389f None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:28:17.887660 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d39d1b27-18e8-415e-8a22-1905a346389f None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:28:17.887922 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d39d1b27-18e8-415e-8a22-1905a346389f None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:28:17.888269 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d39d1b27-18e8-415e-8a22-1905a346389f None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:28:17.888604 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d39d1b27-18e8-415e-8a22-1905a346389f None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:28:17.888943 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d39d1b27-18e8-415e-8a22-1905a346389f None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:28:17.889283 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d39d1b27-18e8-415e-8a22-1905a346389f None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:28:17.889608 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d39d1b27-18e8-415e-8a22-1905a346389f None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:28:17.889927 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d39d1b27-18e8-415e-8a22-1905a346389f None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:28:17.890240 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d39d1b27-18e8-415e-8a22-1905a346389f None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:28:17.891351 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d39d1b27-18e8-415e-8a22-1905a346389f None None] Tracked resource versions report: Nov 09 04:28:17.891351 dv-neutron-816802-2-hyperv neutron-server[102163]: pushed versions: Nov 09 04:28:17.891351 dv-neutron-816802-2-hyperv neutron-server[102163]: { 'AddressGroup': {'1.2'}, Nov 09 04:28:17.891351 dv-neutron-816802-2-hyperv neutron-server[102163]: 'ConntrackHelper': {'1.0'}, Nov 09 04:28:17.891351 dv-neutron-816802-2-hyperv neutron-server[102163]: 'Log': {'1.0'}, Nov 09 04:28:17.891351 dv-neutron-816802-2-hyperv neutron-server[102163]: 'Network': {'1.1'}, Nov 09 04:28:17.891351 dv-neutron-816802-2-hyperv neutron-server[102163]: 'Port': {'1.7'}, Nov 09 04:28:17.891351 dv-neutron-816802-2-hyperv neutron-server[102163]: 'PortForwarding': {'1.2'}, Nov 09 04:28:17.891351 dv-neutron-816802-2-hyperv neutron-server[102163]: 'QosPolicy': {'1.10'}, Nov 09 04:28:17.891351 dv-neutron-816802-2-hyperv neutron-server[102163]: 'SecurityGroup': {'1.5'}, Nov 09 04:28:17.891351 dv-neutron-816802-2-hyperv neutron-server[102163]: 'SecurityGroupRule': {'1.2'}, Nov 09 04:28:17.891351 dv-neutron-816802-2-hyperv neutron-server[102163]: 'SubPort': {'1.0'}, Nov 09 04:28:17.891351 dv-neutron-816802-2-hyperv neutron-server[102163]: 'Subnet': {'1.1'}, Nov 09 04:28:17.891351 dv-neutron-816802-2-hyperv neutron-server[102163]: 'Trunk': {'1.1'}} Nov 09 04:28:17.891351 dv-neutron-816802-2-hyperv neutron-server[102163]: consumer versions: Nov 09 04:28:17.891351 dv-neutron-816802-2-hyperv neutron-server[102163]: { DHCP agent@dv-neutron-816802-2-hyperv: {}, Nov 09 04:28:17.891351 dv-neutron-816802-2-hyperv neutron-server[102163]: HyperV agent@hv-neutron-8168: {}, Nov 09 04:28:17.891351 dv-neutron-816802-2-hyperv neutron-server[102163]: L3 agent@dv-neutron-816802-2-hyperv: {}, Nov 09 04:28:17.891351 dv-neutron-816802-2-hyperv neutron-server[102163]: Metadata agent@dv-neutron-816802-2-hyperv: {}, Nov 09 04:28:17.891351 dv-neutron-816802-2-hyperv neutron-server[102163]: Metering agent@dv-neutron-816802-2-hyperv: {}, Nov 09 04:28:17.891351 dv-neutron-816802-2-hyperv neutron-server[102163]: Open vSwitch agent@dv-neutron-816802-2-hyperv: { 'AddressGroup': '1.2', Nov 09 04:28:17.891351 dv-neutron-816802-2-hyperv neutron-server[102163]: 'ConntrackHelper': '1.0', Nov 09 04:28:17.891351 dv-neutron-816802-2-hyperv neutron-server[102163]: 'Log': '1.0', Nov 09 04:28:17.891351 dv-neutron-816802-2-hyperv neutron-server[102163]: 'Network': '1.1', Nov 09 04:28:17.891351 dv-neutron-816802-2-hyperv neutron-server[102163]: 'Port': '1.7', Nov 09 04:28:17.891351 dv-neutron-816802-2-hyperv neutron-server[102163]: 'PortForwarding': '1.2', Nov 09 04:28:17.891351 dv-neutron-816802-2-hyperv neutron-server[102163]: 'QosPolicy': '1.10', Nov 09 04:28:17.891351 dv-neutron-816802-2-hyperv neutron-server[102163]: 'SecurityGroup': '1.5', Nov 09 04:28:17.891351 dv-neutron-816802-2-hyperv neutron-server[102163]: 'SecurityGroupRule': '1.2', Nov 09 04:28:17.891351 dv-neutron-816802-2-hyperv neutron-server[102163]: 'SubPort': '1.0', Nov 09 04:28:17.891351 dv-neutron-816802-2-hyperv neutron-server[102163]: 'Subnet': '1.1', Nov 09 04:28:17.891351 dv-neutron-816802-2-hyperv neutron-server[102163]: 'Trunk': '1.1'}} Nov 09 04:28:17.891351 dv-neutron-816802-2-hyperv neutron-server[102163]: {{(pid=102163) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 09 04:28:17.906189 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52152) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:17.922062 dv-neutron-816802-2-hyperv neutron-server[102162]: WARNING neutron.services.metering.metering_plugin [None req-c1243893-4343-4b4e-872e-e03b4798556a tempest-MeteringTestJSON-493962237 tempest-MeteringTestJSON-493962237-project-admin] The use of 'remote_ip_prefix' in metering label rules is deprecated and will be removed in future releases. One should use instead the 'source_ip_prefix' and/or 'destination_ip_prefix' parameters. For more details, you can check the spec: https://review.opendev.org/#/c/744702/. Nov 09 04:28:17.952419 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-d39d1b27-18e8-415e-8a22-1905a346389f None None] Attempting to bind port 29a6d3fc-4c49-4c48-8a90-1e058b15af0d on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:28:17.952705 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-d39d1b27-18e8-415e-8a22-1905a346389f None None] Attempting to bind port 29a6d3fc-4c49-4c48-8a90-1e058b15af0d by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '9b34c07b-e9e3-4439-982a-e160009938cf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 348, 'network_id': 'd4ba3288-221c-40f3-a829-662c462cc93f'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:28:17.953068 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d39d1b27-18e8-415e-8a22-1905a346389f None None] Attempting to bind port 29a6d3fc-4c49-4c48-8a90-1e058b15af0d on network d4ba3288-221c-40f3-a829-662c462cc93f {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:28:17.964457 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d39d1b27-18e8-415e-8a22-1905a346389f None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 28, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:28:17.964834 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d39d1b27-18e8-415e-8a22-1905a346389f None None] Checking segment: {'id': '9b34c07b-e9e3-4439-982a-e160009938cf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 348, 'network_id': 'd4ba3288-221c-40f3-a829-662c462cc93f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:28:17.965238 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d39d1b27-18e8-415e-8a22-1905a346389f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:17.965614 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d39d1b27-18e8-415e-8a22-1905a346389f None None] Bound using segment: {'id': '9b34c07b-e9e3-4439-982a-e160009938cf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 348, 'network_id': 'd4ba3288-221c-40f3-a829-662c462cc93f'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:28:17.966122 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-d39d1b27-18e8-415e-8a22-1905a346389f None None] Bound port: 29a6d3fc-4c49-4c48-8a90-1e058b15af0d, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9b34c07b-e9e3-4439-982a-e160009938cf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 348, 'network_id': 'd4ba3288-221c-40f3-a829-662c462cc93f'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:28:17.966489 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d39d1b27-18e8-415e-8a22-1905a346389f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:17.976727 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-d42a2f5b-8bfe-4ea5-a150-749b926a53f0 tempest-RoutersAdminNegativeIpV6Test-2011772494 tempest-RoutersAdminNegativeIpV6Test-2011772494-project-admin] Request body: {'port': {'name': 'tempest-RoutersAdminNegativeIpV6Test-138686833', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:17.982211 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-7aba0e50-b0dd-4dea-8a76-695fe8fcfbf2 None None] Allocated IP 172.20.0.2 (468b2f91-119a-402c-b695-5d7963ec6348/a3d93294-0484-46fa-b8a6-204ec86c9c5f/1bda1008-dade-41b5-919b-108e230eb2a9) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:28:18.102653 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-d39d1b27-18e8-415e-8a22-1905a346389f None None] For port 29a6d3fc-4c49-4c48-8a90-1e058b15af0d, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:28:18.121085 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-d39d1b27-18e8-415e-8a22-1905a346389f None None] For port 29a6d3fc-4c49-4c48-8a90-1e058b15af0d, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=29a6d3fc-4c49-4c48-8a90-1e058b15af0d,segment=NetworkSegment(9b34c07b-e9e3-4439-982a-e160009938cf),segment_id=9b34c07b-e9e3-4439-982a-e160009938cf)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:28:18.146665 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-adb201d1-b719-4c12-b06f-78be3380321b tempest-ExternalNetworksTestJSON-1286645568 tempest-ExternalNetworksTestJSON-1286645568-project] Request body: {'network': {'name': 'tempest-ExternalNetworksTestJSON-test-network-270937190'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:18.153949 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c1243893-4343-4b4e-872e-e03b4798556a tempest-MeteringTestJSON-493962237 tempest-MeteringTestJSON-493962237-project-admin] Publish callbacks [] for metering_label_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:18.155343 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-c1243893-4343-4b4e-872e-e03b4798556a tempest-MeteringTestJSON-493962237 tempest-MeteringTestJSON-493962237-project-admin] 10.222.0.24 "POST /v2.0/metering/metering-label-rules HTTP/1.1" status: 201 len: 466 time: 0.5421681 Nov 09 04:28:18.161685 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52162) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:18.166013 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d42a2f5b-8bfe-4ea5-a150-749b926a53f0 tempest-RoutersAdminNegativeIpV6Test-2011772494 tempest-RoutersAdminNegativeIpV6Test-2011772494-project-admin] Made reservation on behalf of 1ea0115115a7470e94c6ed83ff0f1ad7 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:28:18.169466 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d42a2f5b-8bfe-4ea5-a150-749b926a53f0 tempest-RoutersAdminNegativeIpV6Test-2011772494 tempest-RoutersAdminNegativeIpV6Test-2011772494-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:18.176585 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-1922a9c2-f058-4283-ac63-85cd7dacb94d tempest-MeteringTestJSON-493962237 tempest-MeteringTestJSON-493962237-project-admin] Request body: {'metering_label_rule': {'remote_ip_prefix': '10.0.1.0/24', 'direction': 'ingress', 'metering_label_id': 'aa33c565-b6f8-4048-9c28-871da5544c03'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:18.178457 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-1922a9c2-f058-4283-ac63-85cd7dacb94d tempest-MeteringTestJSON-493962237 tempest-MeteringTestJSON-493962237-project-admin] Unknown quota resources ['metering_label_rule']. {{(pid=102161) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Nov 09 04:28:18.188244 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7aba0e50-b0dd-4dea-8a76-695fe8fcfbf2 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:18.188884 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f0a0242a-3394-4ad9-b165-0827ee38daba tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Made reservation on behalf of 20a65be85603415da5c8f9fb587db6d6 for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:28:18.192689 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d42a2f5b-8bfe-4ea5-a150-749b926a53f0 tempest-RoutersAdminNegativeIpV6Test-2011772494 tempest-RoutersAdminNegativeIpV6Test-2011772494-project-admin] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:18.198383 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f0a0242a-3394-4ad9-b165-0827ee38daba tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:18.210107 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d39d1b27-18e8-415e-8a22-1905a346389f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:18.257004 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d585d776-aca9-4b65-a3ac-f28fd9433b7a admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:18.261365 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f0a0242a-3394-4ad9-b165-0827ee38daba tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:18.270461 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-adb201d1-b719-4c12-b06f-78be3380321b tempest-ExternalNetworksTestJSON-1286645568 tempest-ExternalNetworksTestJSON-1286645568-project] Made reservation on behalf of f668e6cab6e34b529ec87023cadebeb9 for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:28:18.274076 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-adb201d1-b719-4c12-b06f-78be3380321b tempest-ExternalNetworksTestJSON-1286645568 tempest-ExternalNetworksTestJSON-1286645568-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:18.294553 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-adb201d1-b719-4c12-b06f-78be3380321b tempest-ExternalNetworksTestJSON-1286645568 tempest-ExternalNetworksTestJSON-1286645568-project] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:18.301719 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7aba0e50-b0dd-4dea-8a76-695fe8fcfbf2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:18.302243 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-16afc6c0-16dc-4e83-b4f8-3803a460453d tempest-PortsAdminExtendedAttrsTestJSON-1597080349 tempest-PortsAdminExtendedAttrsTestJSON-1597080349-project] Request body: {'network': {'name': 'tempest-PortsAdminExtendedAttrsTestJSON-test-network-970468622'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:18.344223 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7aba0e50-b0dd-4dea-8a76-695fe8fcfbf2 None None] Network 468b2f91-119a-402c-b695-5d7963ec6348 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:28:18.347932 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d39d1b27-18e8-415e-8a22-1905a346389f None None] Pushing event updated for resources: {'Port': ['ID=29a6d3fc-4c49-4c48-8a90-1e058b15af0d,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:18.360865 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-7aba0e50-b0dd-4dea-8a76-695fe8fcfbf2 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:28:18.365525 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7aba0e50-b0dd-4dea-8a76-695fe8fcfbf2 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:28:18.473602 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7aba0e50-b0dd-4dea-8a76-695fe8fcfbf2 None None] Pushing event updated for resources: {'Port': ['ID=1bda1008-dade-41b5-919b-108e230eb2a9,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:18.493699 dv-neutron-816802-2-hyperv neutron-server[102161]: WARNING neutron.services.metering.metering_plugin [None req-1922a9c2-f058-4283-ac63-85cd7dacb94d tempest-MeteringTestJSON-493962237 tempest-MeteringTestJSON-493962237-project-admin] The use of 'remote_ip_prefix' in metering label rules is deprecated and will be removed in future releases. One should use instead the 'source_ip_prefix' and/or 'destination_ip_prefix' parameters. For more details, you can check the spec: https://review.opendev.org/#/c/744702/. Nov 09 04:28:18.497796 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-7aba0e50-b0dd-4dea-8a76-695fe8fcfbf2 None None] Attempting to bind port 1bda1008-dade-41b5-919b-108e230eb2a9 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:28:18.498185 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-7aba0e50-b0dd-4dea-8a76-695fe8fcfbf2 None None] Attempting to bind port 1bda1008-dade-41b5-919b-108e230eb2a9 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'efe0485f-d48f-4307-b89a-0bcb86aaf1c2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 329, 'network_id': '468b2f91-119a-402c-b695-5d7963ec6348'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:28:18.498710 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7aba0e50-b0dd-4dea-8a76-695fe8fcfbf2 None None] Attempting to bind port 1bda1008-dade-41b5-919b-108e230eb2a9 on network 468b2f91-119a-402c-b695-5d7963ec6348 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:28:18.499840 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52168) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:18.506942 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7aba0e50-b0dd-4dea-8a76-695fe8fcfbf2 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 28, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:28:18.507488 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7aba0e50-b0dd-4dea-8a76-695fe8fcfbf2 None None] Checking segment: {'id': 'efe0485f-d48f-4307-b89a-0bcb86aaf1c2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 329, 'network_id': '468b2f91-119a-402c-b695-5d7963ec6348'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:28:18.507929 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7aba0e50-b0dd-4dea-8a76-695fe8fcfbf2 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:18.508642 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7aba0e50-b0dd-4dea-8a76-695fe8fcfbf2 None None] Bound using segment: {'id': 'efe0485f-d48f-4307-b89a-0bcb86aaf1c2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 329, 'network_id': '468b2f91-119a-402c-b695-5d7963ec6348'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:28:18.509124 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-7aba0e50-b0dd-4dea-8a76-695fe8fcfbf2 None None] Bound port: 1bda1008-dade-41b5-919b-108e230eb2a9, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'efe0485f-d48f-4307-b89a-0bcb86aaf1c2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 329, 'network_id': '468b2f91-119a-402c-b695-5d7963ec6348'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:28:18.509533 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7aba0e50-b0dd-4dea-8a76-695fe8fcfbf2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:18.537406 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-16afc6c0-16dc-4e83-b4f8-3803a460453d tempest-PortsAdminExtendedAttrsTestJSON-1597080349 tempest-PortsAdminExtendedAttrsTestJSON-1597080349-project] Made reservation on behalf of c3e4bed72e4f4e48b6788e16f7ad8d0d for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:28:18.540844 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-16afc6c0-16dc-4e83-b4f8-3803a460453d tempest-PortsAdminExtendedAttrsTestJSON-1597080349 tempest-PortsAdminExtendedAttrsTestJSON-1597080349-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:18.603708 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a16e92f3-81c4-4d77-85e7-9481a09539e4 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:18.605673 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-16afc6c0-16dc-4e83-b4f8-3803a460453d tempest-PortsAdminExtendedAttrsTestJSON-1597080349 tempest-PortsAdminExtendedAttrsTestJSON-1597080349-project] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:18.654717 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-7aba0e50-b0dd-4dea-8a76-695fe8fcfbf2 None None] For port 1bda1008-dade-41b5-919b-108e230eb2a9, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:28:18.656441 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d42a2f5b-8bfe-4ea5-a150-749b926a53f0 tempest-RoutersAdminNegativeIpV6Test-2011772494 tempest-RoutersAdminNegativeIpV6Test-2011772494-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:18.656691 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-7aba0e50-b0dd-4dea-8a76-695fe8fcfbf2 None None] For port 1bda1008-dade-41b5-919b-108e230eb2a9, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=1bda1008-dade-41b5-919b-108e230eb2a9,segment=NetworkSegment(efe0485f-d48f-4307-b89a-0bcb86aaf1c2),segment_id=efe0485f-d48f-4307-b89a-0bcb86aaf1c2)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:28:18.669783 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a16e92f3-81c4-4d77-85e7-9481a09539e4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:18.700743 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1922a9c2-f058-4283-ac63-85cd7dacb94d tempest-MeteringTestJSON-493962237 tempest-MeteringTestJSON-493962237-project-admin] Publish callbacks [] for metering_label_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:18.701616 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1922a9c2-f058-4283-ac63-85cd7dacb94d tempest-MeteringTestJSON-493962237 tempest-MeteringTestJSON-493962237-project-admin] 10.222.0.24 "POST /v2.0/metering/metering-label-rules HTTP/1.1" status: 201 len: 466 time: 0.5365229 Nov 09 04:28:18.706813 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f0a0242a-3394-4ad9-b165-0827ee38daba tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:18.707023 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d42a2f5b-8bfe-4ea5-a150-749b926a53f0 tempest-RoutersAdminNegativeIpV6Test-2011772494 tempest-RoutersAdminNegativeIpV6Test-2011772494-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:18.707706 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52172) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:18.723009 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-3bf9d60f-bcea-4031-b820-21dc6abe2840 tempest-MeteringTestJSON-493962237 tempest-MeteringTestJSON-493962237-project-admin] 10.222.0.24 "GET /v2.0/metering/metering-label-rules?id=3222e99f-7007-4d9f-90ba-dde7cf282627 HTTP/1.1" status: 200 len: 464 time: 0.0133152 Nov 09 04:28:18.725843 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52174) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:18.759104 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7aba0e50-b0dd-4dea-8a76-695fe8fcfbf2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:18.796413 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-902f4212-a78d-4494-b86a-acedcabbcf06 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Request body: {'floatingip': {'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:18.802271 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f0a0242a-3394-4ad9-b165-0827ee38daba tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:18.846509 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7aba0e50-b0dd-4dea-8a76-695fe8fcfbf2 None None] Pushing event updated for resources: {'Port': ['ID=1bda1008-dade-41b5-919b-108e230eb2a9,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:18.884750 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-adb201d1-b719-4c12-b06f-78be3380321b tempest-ExternalNetworksTestJSON-1286645568 tempest-ExternalNetworksTestJSON-1286645568-project] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:18.892097 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [None req-d42a2f5b-8bfe-4ea5-a150-749b926a53f0 tempest-RoutersAdminNegativeIpV6Test-2011772494 tempest-RoutersAdminNegativeIpV6Test-2011772494-project-admin] device_id is not set on port 4400c4cb-f2fd-4046-9513-7e4bfc9210ec yet. {{(pid=102162) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:28:18.930345 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 29a6d3fc-4c49-4c48-8a90-1e058b15af0d up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:28:18.942834 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f0a0242a-3394-4ad9-b165-0827ee38daba tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 325} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:28:18.992048 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 29a6d3fc-4c49-4c48-8a90-1e058b15af0d triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:28:18.992545 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:19.011974 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-adb201d1-b719-4c12-b06f-78be3380321b tempest-ExternalNetworksTestJSON-1286645568 tempest-ExternalNetworksTestJSON-1286645568-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:19.049725 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f0a0242a-3394-4ad9-b165-0827ee38daba tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:19.050062 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-f0a0242a-3394-4ad9-b165-0827ee38daba tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Added segment 4298f996-bd9c-4831-928f-e41287186d45 of type vlan for network 79bc3055-9536-43a1-b62c-3eb406e9f982 Nov 09 04:28:19.053847 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-17704a7d-4f05-4827-8653-cbf5bd118b8a tempest-MeteringTestJSON-493962237 tempest-MeteringTestJSON-493962237-project-admin] Publish callbacks [] for metering_label_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:19.055213 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-17704a7d-4f05-4827-8653-cbf5bd118b8a tempest-MeteringTestJSON-493962237 tempest-MeteringTestJSON-493962237-project-admin] 10.222.0.24 "DELETE /v2.0/metering/metering-label-rules/3222e99f-7007-4d9f-90ba-dde7cf282627 HTTP/1.1" status: 204 len: 168 time: 0.3283701 Nov 09 04:28:19.056054 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-adb201d1-b719-4c12-b06f-78be3380321b tempest-ExternalNetworksTestJSON-1286645568 tempest-ExternalNetworksTestJSON-1286645568-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 339} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:28:19.065997 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52182) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:19.067201 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0a0242a-3394-4ad9-b165-0827ee38daba tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Pushing event updated for resources: {'SecurityGroup': ['ID=921096d7-3d9d-4f4d-8865-ee499c229d69,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:19.106605 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d585d776-aca9-4b65-a3ac-f28fd9433b7a admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:19.110958 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d42a2f5b-8bfe-4ea5-a150-749b926a53f0 tempest-RoutersAdminNegativeIpV6Test-2011772494 tempest-RoutersAdminNegativeIpV6Test-2011772494-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=aad0a929-bb0e-42e1-ac6f-a28d0b4d5fdf,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:19.113179 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-527bdd42-7844-4034-95db-dd94d9767a20 tempest-MeteringTestJSON-493962237 tempest-MeteringTestJSON-493962237-project-admin] 10.222.0.24 "GET /v2.0/metering/metering-label-rules?id=3222e99f-7007-4d9f-90ba-dde7cf282627 HTTP/1.1" status: 200 len: 221 time: 0.0422370 Nov 09 04:28:19.124520 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-adb201d1-b719-4c12-b06f-78be3380321b tempest-ExternalNetworksTestJSON-1286645568 tempest-ExternalNetworksTestJSON-1286645568-project] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8756747342888', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:19.125271 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-adb201d1-b719-4c12-b06f-78be3380321b tempest-ExternalNetworksTestJSON-1286645568 tempest-ExternalNetworksTestJSON-1286645568-project] Unsubscribe: segment precommit_create {{(pid=102162) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Nov 09 04:28:19.125911 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-adb201d1-b719-4c12-b06f-78be3380321b tempest-ExternalNetworksTestJSON-1286645568 tempest-ExternalNetworksTestJSON-1286645568-project] Added segment 58a9d3dd-be9c-431a-93b4-3c80adba3d95 of type vlan for network 9b2f002d-0bf2-4dc9-bb94-06811489d8ac Nov 09 04:28:19.129643 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52184) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:19.146337 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-5887f804-db29-4d07-a74e-997ccf7a32f7 tempest-MeteringTestJSON-493962237 tempest-MeteringTestJSON-493962237-project-admin] Request body: {'metering_label': {'name': 'tempest-metering-label--1210206679', 'description': 'label created by tempest'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:19.150947 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-5887f804-db29-4d07-a74e-997ccf7a32f7 tempest-MeteringTestJSON-493962237 tempest-MeteringTestJSON-493962237-project-admin] Unknown quota resources ['metering_label']. {{(pid=102162) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Nov 09 04:28:19.153250 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f0a0242a-3394-4ad9-b165-0827ee38daba tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:19.156162 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d585d776-aca9-4b65-a3ac-f28fd9433b7a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:19.158012 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-902f4212-a78d-4494-b86a-acedcabbcf06 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks [] for floatingip, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:19.169174 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:19.229670 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 29a6d3fc-4c49-4c48-8a90-1e058b15af0d, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=29a6d3fc-4c49-4c48-8a90-1e058b15af0d,segment=NetworkSegment(9b34c07b-e9e3-4439-982a-e160009938cf),segment_id=9b34c07b-e9e3-4439-982a-e160009938cf)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:28:19.321747 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-a16e92f3-81c4-4d77-85e7-9481a09539e4 admin admin] Allocated IP 172.26.0.163 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/0fc8f26d-1642-4025-b21c-de2a4f14043f) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:28:19.326974 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-adb201d1-b719-4c12-b06f-78be3380321b tempest-ExternalNetworksTestJSON-1286645568 tempest-ExternalNetworksTestJSON-1286645568-project] Pushing event updated for resources: {'SecurityGroup': ['ID=5d9574b3-1b93-4ff3-a4b9-8a346a4a2478,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:19.337015 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-adb201d1-b719-4c12-b06f-78be3380321b tempest-ExternalNetworksTestJSON-1286645568 tempest-ExternalNetworksTestJSON-1286645568-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:19.374466 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-16afc6c0-16dc-4e83-b4f8-3803a460453d tempest-PortsAdminExtendedAttrsTestJSON-1597080349 tempest-PortsAdminExtendedAttrsTestJSON-1597080349-project] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:19.393899 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:19.430793 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f0a0242a-3394-4ad9-b165-0827ee38daba tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:19.440762 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f0a0242a-3394-4ad9-b165-0827ee38daba tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:19.441571 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f0a0242a-3394-4ad9-b165-0827ee38daba tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:19.467813 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=29a6d3fc-4c49-4c48-8a90-1e058b15af0d,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:19.495623 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-16afc6c0-16dc-4e83-b4f8-3803a460453d tempest-PortsAdminExtendedAttrsTestJSON-1597080349 tempest-PortsAdminExtendedAttrsTestJSON-1597080349-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:19.546318 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-adb201d1-b719-4c12-b06f-78be3380321b tempest-ExternalNetworksTestJSON-1286645568 tempest-ExternalNetworksTestJSON-1286645568-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:19.551944 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-adb201d1-b719-4c12-b06f-78be3380321b tempest-ExternalNetworksTestJSON-1286645568 tempest-ExternalNetworksTestJSON-1286645568-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:19.552535 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-adb201d1-b719-4c12-b06f-78be3380321b tempest-ExternalNetworksTestJSON-1286645568 tempest-ExternalNetworksTestJSON-1286645568-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:19.590099 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-902f4212-a78d-4494-b86a-acedcabbcf06 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:19.593524 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0a0242a-3394-4ad9-b165-0827ee38daba tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Pushing event updated for resources: {'Network': ['ID=79bc3055-9536-43a1-b62c-3eb406e9f982,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:19.600950 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-f0a0242a-3394-4ad9-b165-0827ee38daba tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 795 time: 2.7373388 Nov 09 04:28:19.604393 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52190) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:19.610563 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-fdc6c198-9fe9-4f2b-915e-b33a45d84602 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Request body: {'subnet': {'network_id': '79bc3055-9536-43a1-b62c-3eb406e9f982', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:19.611158 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 79bc3055-9536-43a1-b62c-3eb406e9f982 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:28:19.632311 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-16afc6c0-16dc-4e83-b4f8-3803a460453d tempest-PortsAdminExtendedAttrsTestJSON-1597080349 tempest-PortsAdminExtendedAttrsTestJSON-1597080349-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 336} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:28:19.641047 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5887f804-db29-4d07-a74e-997ccf7a32f7 tempest-MeteringTestJSON-493962237 tempest-MeteringTestJSON-493962237-project-admin] Publish callbacks [] for metering_label, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:19.642215 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-5887f804-db29-4d07-a74e-997ccf7a32f7 tempest-MeteringTestJSON-493962237 tempest-MeteringTestJSON-493962237-project-admin] 10.222.0.24 "POST /v2.0/metering/metering-labels HTTP/1.1" status: 201 len: 470 time: 0.5032699 Nov 09 04:28:19.649622 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52192) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:19.764210 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16afc6c0-16dc-4e83-b4f8-3803a460453d tempest-PortsAdminExtendedAttrsTestJSON-1597080349 tempest-PortsAdminExtendedAttrsTestJSON-1597080349-project] Pushing event updated for resources: {'SecurityGroup': ['ID=5f540beb-ab47-400b-81f2-b762d2bc59ee,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:19.769180 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a16e92f3-81c4-4d77-85e7-9481a09539e4 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:19.779205 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-16afc6c0-16dc-4e83-b4f8-3803a460453d tempest-PortsAdminExtendedAttrsTestJSON-1597080349 tempest-PortsAdminExtendedAttrsTestJSON-1597080349-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:19.779552 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-16afc6c0-16dc-4e83-b4f8-3803a460453d tempest-PortsAdminExtendedAttrsTestJSON-1597080349 tempest-PortsAdminExtendedAttrsTestJSON-1597080349-project] Added segment f1d2aaca-546e-49c2-8ff8-bfb9007964b1 of type vlan for network 6005ba78-d658-44f4-bad3-93b8496ee6db Nov 09 04:28:19.800455 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-adb201d1-b719-4c12-b06f-78be3380321b tempest-ExternalNetworksTestJSON-1286645568 tempest-ExternalNetworksTestJSON-1286645568-project] Pushing event updated for resources: {'Network': ['ID=9b2f002d-0bf2-4dc9-bb94-06811489d8ac,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:19.846837 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-814aaf9e-3c77-4fa0-8bc9-70c0ebeaf8e0 None None] Network d4ba3288-221c-40f3-a829-662c462cc93f requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:28:19.889124 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-adb201d1-b719-4c12-b06f-78be3380321b tempest-ExternalNetworksTestJSON-1286645568 tempest-ExternalNetworksTestJSON-1286645568-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 791 time: 2.2088346 Nov 09 04:28:19.891091 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52194) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:19.894074 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e61e6585-9168-4b18-bad0-0378715d1c67 tempest-MeteringTestJSON-493962237 tempest-MeteringTestJSON-493962237-project-admin] 10.222.0.24 "GET /v2.0/metering/metering-labels?id=32800283-4a5b-46ad-8d4d-57d3f0591a03 HTTP/1.1" status: 200 len: 468 time: 0.1308680 Nov 09 04:28:19.901051 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52196) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:19.915857 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 9b2f002d-0bf2-4dc9-bb94-06811489d8ac details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:28:19.923393 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-16afc6c0-16dc-4e83-b4f8-3803a460453d tempest-PortsAdminExtendedAttrsTestJSON-1597080349 tempest-PortsAdminExtendedAttrsTestJSON-1597080349-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:19.923885 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fdc6c198-9fe9-4f2b-915e-b33a45d84602 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Made reservation on behalf of 20a65be85603415da5c8f9fb587db6d6 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:28:19.929285 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-fdc6c198-9fe9-4f2b-915e-b33a45d84602 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Publish callbacks [] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:19.995793 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-835f4fea-8499-4bde-b281-6509ca8763c5 None None] Provisioning complete for port 29a6d3fc-4c49-4c48-8a90-1e058b15af0d triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:28:19.996226 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-835f4fea-8499-4bde-b281-6509ca8763c5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:20.063799 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a16e92f3-81c4-4d77-85e7-9481a09539e4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:20.123308 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-16afc6c0-16dc-4e83-b4f8-3803a460453d tempest-PortsAdminExtendedAttrsTestJSON-1597080349 tempest-PortsAdminExtendedAttrsTestJSON-1597080349-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:20.130652 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-16afc6c0-16dc-4e83-b4f8-3803a460453d tempest-PortsAdminExtendedAttrsTestJSON-1597080349 tempest-PortsAdminExtendedAttrsTestJSON-1597080349-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:20.131326 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-16afc6c0-16dc-4e83-b4f8-3803a460453d tempest-PortsAdminExtendedAttrsTestJSON-1597080349 tempest-PortsAdminExtendedAttrsTestJSON-1597080349-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:20.170707 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0459da80-d9f9-4b5d-8f12-be11884fb189 None None] Network 468b2f91-119a-402c-b695-5d7963ec6348 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:28:20.215886 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-99804c0d-6f8d-42af-aa12-886b26c12556 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Request body: {'network': {'name': 'tempest-network--447903048', 'router:external': True}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:20.228988 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a16e92f3-81c4-4d77-85e7-9481a09539e4 admin admin] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:28:20.280317 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-a16e92f3-81c4-4d77-85e7-9481a09539e4 admin admin] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:28:20.282721 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-d42a2f5b-8bfe-4ea5-a150-749b926a53f0 tempest-RoutersAdminNegativeIpV6Test-2011772494 tempest-RoutersAdminNegativeIpV6Test-2011772494-project-admin] Allocated IP 172.26.0.166 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/4400c4cb-f2fd-4046-9513-7e4bfc9210ec) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:28:20.293589 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a16e92f3-81c4-4d77-85e7-9481a09539e4 admin admin] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:28:20.325744 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a16e92f3-81c4-4d77-85e7-9481a09539e4 admin admin] Pushing event updated for resources: {'Port': ['ID=0fc8f26d-1642-4025-b21c-de2a4f14043f,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:20.335276 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16afc6c0-16dc-4e83-b4f8-3803a460453d tempest-PortsAdminExtendedAttrsTestJSON-1597080349 tempest-PortsAdminExtendedAttrsTestJSON-1597080349-project] Pushing event updated for resources: {'Network': ['ID=6005ba78-d658-44f4-bad3-93b8496ee6db,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:20.349931 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-16afc6c0-16dc-4e83-b4f8-3803a460453d tempest-PortsAdminExtendedAttrsTestJSON-1597080349 tempest-PortsAdminExtendedAttrsTestJSON-1597080349-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 798 time: 2.4426823 Nov 09 04:28:20.447136 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-5fd993bd-06e3-45b0-aa8b-0fa5ee897c31 None None] Provisioning complete for port 1bda1008-dade-41b5-919b-108e230eb2a9 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:28:20.449286 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5fd993bd-06e3-45b0-aa8b-0fa5ee897c31 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:20.460568 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-99804c0d-6f8d-42af-aa12-886b26c12556 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Made reservation on behalf of 50f2f3df9a9441cd84e52ab52b9432fc for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:28:20.464228 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-99804c0d-6f8d-42af-aa12-886b26c12556 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:20.496792 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-99804c0d-6f8d-42af-aa12-886b26c12556 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:20.555495 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-414cba26-c5ca-4cb3-a539-a74d72f2a38a tempest-MeteringTestJSON-493962237 tempest-MeteringTestJSON-493962237-project-admin] Publish callbacks [] for metering_label, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:20.558845 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-414cba26-c5ca-4cb3-a539-a74d72f2a38a tempest-MeteringTestJSON-493962237 tempest-MeteringTestJSON-493962237-project-admin] 10.222.0.24 "DELETE /v2.0/metering/metering-labels/32800283-4a5b-46ad-8d4d-57d3f0591a03 HTTP/1.1" status: 204 len: 168 time: 0.6559207 Nov 09 04:28:20.568318 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52210) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:20.574111 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 6005ba78-d658-44f4-bad3-93b8496ee6db details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:28:20.723627 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-050a3736-5ea7-475d-82d3-fe9e5a556684 tempest-MeteringTestJSON-493962237 tempest-MeteringTestJSON-493962237-project-admin] 10.222.0.24 "GET /v2.0/metering/metering-labels?id=32800283-4a5b-46ad-8d4d-57d3f0591a03 HTTP/1.1" status: 200 len: 216 time: 0.1514597 Nov 09 04:28:20.727895 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52214) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:20.742944 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-f45623f5-ebb6-4e22-9586-70582533fbb8 tempest-MeteringTestJSON-493962237 tempest-MeteringTestJSON-493962237-project-admin] 10.222.0.24 "GET /v2.0/metering/metering-label-rules?id=33 HTTP/1.1" status: 200 len: 221 time: 0.0125003 Nov 09 04:28:20.747862 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-fdc6c198-9fe9-4f2b-915e-b33a45d84602 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:20.761372 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52216) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:20.824610 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-99804c0d-6f8d-42af-aa12-886b26c12556 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:20.878908 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d42a2f5b-8bfe-4ea5-a150-749b926a53f0 tempest-RoutersAdminNegativeIpV6Test-2011772494 tempest-RoutersAdminNegativeIpV6Test-2011772494-project-admin] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:20.898084 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-bc6ad681-6760-41ab-81ac-882844081da3 tempest-MeteringTestJSON-493962237 tempest-MeteringTestJSON-493962237-project-admin] 10.222.0.24 "GET /v2.0/metering/metering-labels?id=33 HTTP/1.1" status: 200 len: 216 time: 0.1306264 Nov 09 04:28:20.902146 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52220) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:20.905526 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdc6c198-9fe9-4f2b-915e-b33a45d84602 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Pushing event updated for resources: {'Subnet': ['ID=452f7977-7ae4-43ac-beb5-9ea9aa4844a3,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:20.929107 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-99804c0d-6f8d-42af-aa12-886b26c12556 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:20.946222 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5fd993bd-06e3-45b0-aa8b-0fa5ee897c31 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:20.958936 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fdc6c198-9fe9-4f2b-915e-b33a45d84602 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Checking segment: {'id': '4298f996-bd9c-4831-928f-e41287186d45', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 325, 'network_id': '79bc3055-9536-43a1-b62c-3eb406e9f982'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:28:20.959381 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fdc6c198-9fe9-4f2b-915e-b33a45d84602 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Network hostable DHCP agents. Network: 79bc3055-9536-43a1-b62c-3eb406e9f982, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:28:20.967298 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-99804c0d-6f8d-42af-aa12-886b26c12556 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 318} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:28:20.981765 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-5fd993bd-06e3-45b0-aa8b-0fa5ee897c31 None None] For port 1bda1008-dade-41b5-919b-108e230eb2a9, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=1bda1008-dade-41b5-919b-108e230eb2a9,segment=NetworkSegment(efe0485f-d48f-4307-b89a-0bcb86aaf1c2),segment_id=efe0485f-d48f-4307-b89a-0bcb86aaf1c2)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:28:21.001040 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-99804c0d-6f8d-42af-aa12-886b26c12556 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:21.001380 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-99804c0d-6f8d-42af-aa12-886b26c12556 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Added segment 4376940f-fec7-44ba-b516-2d9605aaed3c of type vlan for network 2dfb69ab-7e18-4759-a210-8fbd86ee6faa Nov 09 04:28:21.003425 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99804c0d-6f8d-42af-aa12-886b26c12556 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b8a0e346-8fc1-434a-b469-9494dc021d8b,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:21.043425 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5fd993bd-06e3-45b0-aa8b-0fa5ee897c31 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:21.088867 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 1bda1008-dade-41b5-919b-108e230eb2a9 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:28:21.102883 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d42a2f5b-8bfe-4ea5-a150-749b926a53f0 tempest-RoutersAdminNegativeIpV6Test-2011772494 tempest-RoutersAdminNegativeIpV6Test-2011772494-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:21.106394 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-5d2aff03-a730-416b-9ea4-59f3c54c08a4 tempest-MeteringTestJSON-493962237 tempest-MeteringTestJSON-493962237-project-admin] 10.222.0.24 "GET /v2.0/metering/metering-labels/aa33c565-b6f8-4048-9c28-871da5544c03 HTTP/1.1" status: 200 len: 473 time: 0.1958196 Nov 09 04:28:21.116168 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52222) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:21.122270 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fd993bd-06e3-45b0-aa8b-0fa5ee897c31 None None] Pushing event updated for resources: {'Port': ['ID=1bda1008-dade-41b5-919b-108e230eb2a9,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:21.137994 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-54111dc4-178d-41ac-9b5c-f3398710317e tempest-MeteringTestJSON-493962237 tempest-MeteringTestJSON-493962237-project-admin] 10.222.0.24 "GET /v2.0/metering/metering-label-rules/71a49dde-2619-4265-9136-5e96e6662108 HTTP/1.1" status: 200 len: 461 time: 0.0188179 Nov 09 04:28:21.148207 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52224) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:21.182026 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52226) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:21.182812 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-d705d51f-01c5-4700-bfef-f8a4fbf1fd2b None None] Provisioning complete for port 29a6d3fc-4c49-4c48-8a90-1e058b15af0d triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:28:21.183184 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d705d51f-01c5-4700-bfef-f8a4fbf1fd2b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:21.183630 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-d585d776-aca9-4b65-a3ac-f28fd9433b7a admin admin] Allocated IP 172.26.0.66 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/a31e46ce-e371-4177-a2d5-f9a3681f192b) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:28:21.188052 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-99804c0d-6f8d-42af-aa12-886b26c12556 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:21.191743 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fdc6c198-9fe9-4f2b-915e-b33a45d84602 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Network 79bc3055-9536-43a1-b62c-3eb406e9f982 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:28:21.196364 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Request body: {'port': {'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db', 'binding:host_id': 'hv-neutron-8168', 'name': 'tempest-PortsAdminExtendedAttrsTestJSON-328286581'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:21.216677 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 1bda1008-dade-41b5-919b-108e230eb2a9 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:28:21.217071 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:21.246520 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d42a2f5b-8bfe-4ea5-a150-749b926a53f0 tempest-RoutersAdminNegativeIpV6Test-2011772494 tempest-RoutersAdminNegativeIpV6Test-2011772494-project-admin] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:28:21.258647 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a16e92f3-81c4-4d77-85e7-9481a09539e4 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:21.262210 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-d42a2f5b-8bfe-4ea5-a150-749b926a53f0 tempest-RoutersAdminNegativeIpV6Test-2011772494 tempest-RoutersAdminNegativeIpV6Test-2011772494-project-admin] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:28:21.270932 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d42a2f5b-8bfe-4ea5-a150-749b926a53f0 tempest-RoutersAdminNegativeIpV6Test-2011772494 tempest-RoutersAdminNegativeIpV6Test-2011772494-project-admin] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:28:21.272593 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d42a2f5b-8bfe-4ea5-a150-749b926a53f0 tempest-RoutersAdminNegativeIpV6Test-2011772494 tempest-RoutersAdminNegativeIpV6Test-2011772494-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:21.273686 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d42a2f5b-8bfe-4ea5-a150-749b926a53f0 tempest-RoutersAdminNegativeIpV6Test-2011772494 tempest-RoutersAdminNegativeIpV6Test-2011772494-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:21.312520 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d42a2f5b-8bfe-4ea5-a150-749b926a53f0 tempest-RoutersAdminNegativeIpV6Test-2011772494 tempest-RoutersAdminNegativeIpV6Test-2011772494-project-admin] Pushing event updated for resources: {'Port': ['ID=4400c4cb-f2fd-4046-9513-7e4bfc9210ec,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:21.335490 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-fdc6c198-9fe9-4f2b-915e-b33a45d84602 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 79bc3055-9536-43a1-b62c-3eb406e9f982) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:28:21.344275 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fdc6c198-9fe9-4f2b-915e-b33a45d84602 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:21.344882 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-fdc6c198-9fe9-4f2b-915e-b33a45d84602 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:21.349540 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 29a6d3fc-4c49-4c48-8a90-1e058b15af0d up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:28:21.359759 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d585d776-aca9-4b65-a3ac-f28fd9433b7a admin admin] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:21.372197 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1dc39f0f-02f9-483d-ae4d-807904fba734 None None] Network 79bc3055-9536-43a1-b62c-3eb406e9f982 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:28:21.393864 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-99804c0d-6f8d-42af-aa12-886b26c12556 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:21.394845 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-99804c0d-6f8d-42af-aa12-886b26c12556 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:21.395412 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-99804c0d-6f8d-42af-aa12-886b26c12556 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:21.399750 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-d705d51f-01c5-4700-bfef-f8a4fbf1fd2b None None] Provisioning complete for port 1bda1008-dade-41b5-919b-108e230eb2a9 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:28:21.403660 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d705d51f-01c5-4700-bfef-f8a4fbf1fd2b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:21.467005 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99804c0d-6f8d-42af-aa12-886b26c12556 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Pushing event updated for resources: {'Network': ['ID=2dfb69ab-7e18-4759-a210-8fbd86ee6faa,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:21.477558 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Made reservation on behalf of 1f5d2eca16394ba1811d503557bb1504 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:28:21.480158 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:21.484000 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 2dfb69ab-7e18-4759-a210-8fbd86ee6faa details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:28:21.504442 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d585d776-aca9-4b65-a3ac-f28fd9433b7a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:21.516793 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 29a6d3fc-4c49-4c48-8a90-1e058b15af0d triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:28:21.517192 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:21.550973 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cfe6df92-4c54-4c5c-92a3-ae644dfd2d33 tempest-MeteringTestJSON-493962237 tempest-MeteringTestJSON-493962237-project-admin] Publish callbacks [] for metering_label_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:21.552104 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-cfe6df92-4c54-4c5c-92a3-ae644dfd2d33 tempest-MeteringTestJSON-493962237 tempest-MeteringTestJSON-493962237-project-admin] 10.222.0.24 "DELETE /v2.0/metering/metering-label-rules/71a49dde-2619-4265-9136-5e96e6662108 HTTP/1.1" status: 204 len: 168 time: 0.3756168 Nov 09 04:28:21.554416 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:21.558453 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52230) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:21.590931 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-902f4212-a78d-4494-b86a-acedcabbcf06 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Allocated IP 172.26.0.144 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/4151881c-46eb-4bc9-ab1d-9d251cecb700) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:28:21.652913 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-d42a2f5b-8bfe-4ea5-a150-749b926a53f0 tempest-RoutersAdminNegativeIpV6Test-2011772494 tempest-RoutersAdminNegativeIpV6Test-2011772494-project-admin] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1036 time: 4.0896051 Nov 09 04:28:21.660281 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52232) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:21.671092 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-fdc6c198-9fe9-4f2b-915e-b33a45d84602 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.0656292 Nov 09 04:28:21.674655 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-1a261b7e-f78f-4a70-b0d6-aab54d47d50a tempest-RoutersAdminNegativeIpV6Test-2011772494 tempest-RoutersAdminNegativeIpV6Test-2011772494-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.166'}]}}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:21.680288 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-99804c0d-6f8d-42af-aa12-886b26c12556 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 862 time: 1.7897315 Nov 09 04:28:21.682708 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52234) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:21.683360 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52236) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:21.683594 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a16e92f3-81c4-4d77-85e7-9481a09539e4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:21.696184 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-120b4240-85fe-43f7-912d-e1683643c75d tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Request body: {'port': {'network_id': '79bc3055-9536-43a1-b62c-3eb406e9f982', 'name': 'tempest-DHCPAgentSchedulersTestJSON-2087255941'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:21.732404 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d585d776-aca9-4b65-a3ac-f28fd9433b7a admin admin] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:28:21.758534 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-96086c2e-3d2d-4fcd-a1f0-9cbcb97af446 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-79bc3055-9536-43a1-b62c-3eb406e9f982', 'network_id': '79bc3055-9536-43a1-b62c-3eb406e9f982', 'tenant_id': '20a65be85603415da5c8f9fb587db6d6', 'fixed_ips': [{'subnet_id': '452f7977-7ae4-43ac-beb5-9ea9aa4844a3'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:28:21.759423 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-96086c2e-3d2d-4fcd-a1f0-9cbcb97af446 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:21.763723 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-d585d776-aca9-4b65-a3ac-f28fd9433b7a admin admin] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:28:21.770530 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d585d776-aca9-4b65-a3ac-f28fd9433b7a admin admin] Pushing event updated for resources: {'Port': ['ID=a31e46ce-e371-4177-a2d5-f9a3681f192b,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:21.810523 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d585d776-aca9-4b65-a3ac-f28fd9433b7a admin admin] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:28:21.916651 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1a261b7e-f78f-4a70-b0d6-aab54d47d50a tempest-RoutersAdminNegativeIpV6Test-2011772494 tempest-RoutersAdminNegativeIpV6Test-2011772494-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:21.918348 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1a261b7e-f78f-4a70-b0d6-aab54d47d50a tempest-RoutersAdminNegativeIpV6Test-2011772494 tempest-RoutersAdminNegativeIpV6Test-2011772494-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:21.948369 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-96086c2e-3d2d-4fcd-a1f0-9cbcb97af446 None None] Allocated IP 172.20.0.2 (79bc3055-9536-43a1-b62c-3eb406e9f982/452f7977-7ae4-43ac-beb5-9ea9aa4844a3/af24097e-ae0a-4d62-aacd-2c2738983c34) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:28:21.955853 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-229c5c7c-d15e-4eea-819b-36461b19d786 tempest-MeteringTestJSON-493962237 tempest-MeteringTestJSON-493962237-project-admin] Publish callbacks [] for metering_label, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:21.957026 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-229c5c7c-d15e-4eea-819b-36461b19d786 tempest-MeteringTestJSON-493962237 tempest-MeteringTestJSON-493962237-project-admin] 10.222.0.24 "DELETE /v2.0/metering/metering-labels/aa33c565-b6f8-4048-9c28-871da5544c03 HTTP/1.1" status: 204 len: 168 time: 0.3976634 Nov 09 04:28:21.979952 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:21.985256 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-902f4212-a78d-4494-b86a-acedcabbcf06 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:22.025091 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-87f5638f-b560-4286-ad6a-bdd088ffe898 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:22.029112 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1a261b7e-f78f-4a70-b0d6-aab54d47d50a tempest-RoutersAdminNegativeIpV6Test-2011772494 tempest-RoutersAdminNegativeIpV6Test-2011772494-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:22.050206 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:22.059171 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] device_id is not set on port ff43a858-53a5-4a92-99f8-24113c99db26 yet. {{(pid=102162) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:28:22.153051 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5614fd3a-6af3-4e62-9e7d-3f9a8830c93e,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:22.156905 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-96086c2e-3d2d-4fcd-a1f0-9cbcb97af446 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:22.171386 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-87f5638f-b560-4286-ad6a-bdd088ffe898 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:22.193310 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-87f5638f-b560-4286-ad6a-bdd088ffe898 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Subscribe: > segment before_delete 55550000 {{(pid=102161) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:28:22.193657 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-87f5638f-b560-4286-ad6a-bdd088ffe898 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=102161) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:28:22.194442 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-87f5638f-b560-4286-ad6a-bdd088ffe898 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=102161) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:28:22.194849 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-87f5638f-b560-4286-ad6a-bdd088ffe898 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Subscribe: > port after_create 55550000 {{(pid=102161) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:28:22.195363 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-87f5638f-b560-4286-ad6a-bdd088ffe898 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Subscribe: > port after_delete 55550000 {{(pid=102161) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:28:22.195544 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-87f5638f-b560-4286-ad6a-bdd088ffe898 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Subscribe: > port after_update 55550000 {{(pid=102161) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:28:22.195832 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-87f5638f-b560-4286-ad6a-bdd088ffe898 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Subscribe: > segment after_delete 55550000 {{(pid=102161) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:28:22.195952 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a16e92f3-81c4-4d77-85e7-9481a09539e4 admin admin] Router c9d2cce0-31ab-42c3-ac82-14e36499c28f is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102162) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:28:22.196169 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-87f5638f-b560-4286-ad6a-bdd088ffe898 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Subscribe: > subnet after_create 55550000 {{(pid=102161) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:28:22.196502 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-87f5638f-b560-4286-ad6a-bdd088ffe898 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Subscribe: > subnet after_delete 55550000 {{(pid=102161) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:28:22.196814 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-87f5638f-b560-4286-ad6a-bdd088ffe898 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Subscribe: > subnet after_update 55550000 {{(pid=102161) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:28:22.284421 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-96086c2e-3d2d-4fcd-a1f0-9cbcb97af446 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:22.325617 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-96086c2e-3d2d-4fcd-a1f0-9cbcb97af446 None None] Network 79bc3055-9536-43a1-b62c-3eb406e9f982 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:28:22.328911 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-96086c2e-3d2d-4fcd-a1f0-9cbcb97af446 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:28:22.331051 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-96086c2e-3d2d-4fcd-a1f0-9cbcb97af446 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:28:22.346991 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96086c2e-3d2d-4fcd-a1f0-9cbcb97af446 None None] Pushing event updated for resources: {'Port': ['ID=af24097e-ae0a-4d62-aacd-2c2738983c34,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:22.416899 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-96086c2e-3d2d-4fcd-a1f0-9cbcb97af446 None None] Attempting to bind port af24097e-ae0a-4d62-aacd-2c2738983c34 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:28:22.417256 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-96086c2e-3d2d-4fcd-a1f0-9cbcb97af446 None None] Attempting to bind port af24097e-ae0a-4d62-aacd-2c2738983c34 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '4298f996-bd9c-4831-928f-e41287186d45', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 325, 'network_id': '79bc3055-9536-43a1-b62c-3eb406e9f982'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:28:22.417606 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-96086c2e-3d2d-4fcd-a1f0-9cbcb97af446 None None] Attempting to bind port af24097e-ae0a-4d62-aacd-2c2738983c34 on network 79bc3055-9536-43a1-b62c-3eb406e9f982 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:28:22.422711 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-96086c2e-3d2d-4fcd-a1f0-9cbcb97af446 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 28, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:28:22.423080 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-96086c2e-3d2d-4fcd-a1f0-9cbcb97af446 None None] Checking segment: {'id': '4298f996-bd9c-4831-928f-e41287186d45', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 325, 'network_id': '79bc3055-9536-43a1-b62c-3eb406e9f982'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:28:22.423467 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-96086c2e-3d2d-4fcd-a1f0-9cbcb97af446 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:22.423859 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-96086c2e-3d2d-4fcd-a1f0-9cbcb97af446 None None] Bound using segment: {'id': '4298f996-bd9c-4831-928f-e41287186d45', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 325, 'network_id': '79bc3055-9536-43a1-b62c-3eb406e9f982'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:28:22.424298 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-96086c2e-3d2d-4fcd-a1f0-9cbcb97af446 None None] Bound port: af24097e-ae0a-4d62-aacd-2c2738983c34, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4298f996-bd9c-4831-928f-e41287186d45', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 325, 'network_id': '79bc3055-9536-43a1-b62c-3eb406e9f982'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:28:22.424681 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-96086c2e-3d2d-4fcd-a1f0-9cbcb97af446 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:22.440014 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1a261b7e-f78f-4a70-b0d6-aab54d47d50a tempest-RoutersAdminNegativeIpV6Test-2011772494 tempest-RoutersAdminNegativeIpV6Test-2011772494-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:22.464776 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-87f5638f-b560-4286-ad6a-bdd088ffe898 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Subscribe: > subnet after_create 55550000 {{(pid=102161) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:28:22.466547 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-87f5638f-b560-4286-ad6a-bdd088ffe898 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Subscribe: > subnet after_delete 55550000 {{(pid=102161) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:28:22.466547 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-87f5638f-b560-4286-ad6a-bdd088ffe898 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Subscribe: > subnet before_create 55550000 {{(pid=102161) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:28:22.466547 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-87f5638f-b560-4286-ad6a-bdd088ffe898 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Subscribe: > subnet before_update 55550000 {{(pid=102161) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:28:22.466547 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-87f5638f-b560-4286-ad6a-bdd088ffe898 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2dfb69ab-7e18-4759-a210-8fbd86ee6faa']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:28:22.487599 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-87f5638f-b560-4286-ad6a-bdd088ffe898 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4376940f-fec7-44ba-b516-2d9605aaed3c') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:28:22.488241 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-87f5638f-b560-4286-ad6a-bdd088ffe898 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4376940f-fec7-44ba-b516-2d9605aaed3c') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:28:22.498649 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-96086c2e-3d2d-4fcd-a1f0-9cbcb97af446 None None] For port af24097e-ae0a-4d62-aacd-2c2738983c34, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:28:22.500846 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-902f4212-a78d-4494-b86a-acedcabbcf06 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:22.503264 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-96086c2e-3d2d-4fcd-a1f0-9cbcb97af446 None None] For port af24097e-ae0a-4d62-aacd-2c2738983c34, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=af24097e-ae0a-4d62-aacd-2c2738983c34,segment=NetworkSegment(4298f996-bd9c-4831-928f-e41287186d45),segment_id=4298f996-bd9c-4831-928f-e41287186d45)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:28:22.599462 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-96086c2e-3d2d-4fcd-a1f0-9cbcb97af446 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:22.606203 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52248) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:22.606847 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a16e92f3-81c4-4d77-85e7-9481a09539e4 admin admin] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:28:22.621794 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dcc3083e-289e-4052-bc5e-6ff27e1b85f8 None None] Sync routers for ids ['c9d2cce0-31ab-42c3-ac82-14e36499c28f'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:28:22.640432 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dcc3083e-289e-4052-bc5e-6ff27e1b85f8 None None] Routers {'c9d2cce0-31ab-42c3-ac82-14e36499c28f'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:28:22.641959 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-dcc3083e-289e-4052-bc5e-6ff27e1b85f8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:28:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['c9d2cce0-31ab-42c3-ac82-14e36499c28f'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:28:22.664651 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] device_id is not set on port ff43a858-53a5-4a92-99f8-24113c99db26 yet. {{(pid=102162) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:28:22.682198 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-120b4240-85fe-43f7-912d-e1683643c75d tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Made reservation on behalf of 20a65be85603415da5c8f9fb587db6d6 for: {'port': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:28:22.686002 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-120b4240-85fe-43f7-912d-e1683643c75d tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:22.695943 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:22.700810 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-87f5638f-b560-4286-ad6a-bdd088ffe898 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:22.723209 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96086c2e-3d2d-4fcd-a1f0-9cbcb97af446 None None] Pushing event updated for resources: {'Port': ['ID=af24097e-ae0a-4d62-aacd-2c2738983c34,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:22.759494 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [None req-120b4240-85fe-43f7-912d-e1683643c75d tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] device_id is not set on port ff1446eb-11a3-44e6-b704-52f9abc24748 yet. {{(pid=102161) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:28:22.796301 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a16e92f3-81c4-4d77-85e7-9481a09539e4 admin admin] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:22.797570 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a16e92f3-81c4-4d77-85e7-9481a09539e4 admin admin] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 917 time: 5.8560131 Nov 09 04:28:22.814506 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52252) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:22.845200 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:22.872314 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-085a9f11-7e5b-4581-8db4-2ab7a56b1a29 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:22.913350 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 1bda1008-dade-41b5-919b-108e230eb2a9 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:28:22.930895 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-87f5638f-b560-4286-ad6a-bdd088ffe898 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:22.949230 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-dcc3083e-289e-4052-bc5e-6ff27e1b85f8 None None] Set router c9d2cce0-31ab-42c3-ac82-14e36499c28f gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:28:22.957397 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-902f4212-a78d-4494-b86a-acedcabbcf06 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:28:22.988506 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Pushing event updated for resources: {'Port': ['ID=ff43a858-53a5-4a92-99f8-24113c99db26,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:23.034946 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1a261b7e-f78f-4a70-b0d6-aab54d47d50a tempest-RoutersAdminNegativeIpV6Test-2011772494 tempest-RoutersAdminNegativeIpV6Test-2011772494-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:23.040568 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 1bda1008-dade-41b5-919b-108e230eb2a9 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:28:23.041714 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:23.061008 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-902f4212-a78d-4494-b86a-acedcabbcf06 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Pushing event updated for resources: {'Port': ['ID=4151881c-46eb-4bc9-ab1d-9d251cecb700,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:23.064546 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-87f5638f-b560-4286-ad6a-bdd088ffe898 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Releasing vlan 318 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:28:23.065192 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-87f5638f-b560-4286-ad6a-bdd088ffe898 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:23.077743 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1a261b7e-f78f-4a70-b0d6-aab54d47d50a tempest-RoutersAdminNegativeIpV6Test-2011772494 tempest-RoutersAdminNegativeIpV6Test-2011772494-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:23.093227 dv-neutron-816802-2-hyperv neutron-server[102161]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 09 04:28:23.093227 dv-neutron-816802-2-hyperv neutron-server[102161]: from cryptography.utils import int_from_bytes Nov 09 04:28:23.093227 dv-neutron-816802-2-hyperv neutron-server[102161]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 09 04:28:23.093227 dv-neutron-816802-2-hyperv neutron-server[102161]: from cryptography.utils import int_from_bytes Nov 09 04:28:23.093227 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:28:23.093227 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:28:23.093227 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:28:23.093227 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:28:23.093227 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:28:23.093227 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:28:23.093227 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:28:23.093227 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:28:23.093227 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:28:23.093227 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:28:23.093227 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:28:23.093227 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:28:23.093227 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:28:23.093227 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:28:23.093227 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:28:23.093227 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:28:23.093227 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:28:23.093227 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:28:23.093227 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:28:23.093227 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:28:23.093227 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:28:23.093227 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:28:23.093227 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:28:23.093227 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:28:23.093227 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:28:23.093227 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:28:23.093227 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:28:23.093227 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:28:23.093227 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:28:23.093227 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:28:23.093227 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:28:23.093227 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:28:23.097386 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-902f4212-a78d-4494-b86a-acedcabbcf06 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:28:23.098440 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Checking segment: {'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:28:23.098802 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Network hostable DHCP agents. Network: 6005ba78-d658-44f4-bad3-93b8496ee6db, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:28:23.151745 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-902f4212-a78d-4494-b86a-acedcabbcf06 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:28:23.231351 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-dcc3083e-289e-4052-bc5e-6ff27e1b85f8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c9d2cce0-31ab-42c3-ac82-14e36499c28f', 'name': 'tempest-ServersTestJSON-828046534-router', 'tenant_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.163'}], 'enable_snat': True}, 'gw_port_id': '0fc8f26d-1642-4025-b21c-de2a4f14043f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:28:17Z', 'updated_at': '2021-11-09T04:28:20Z', 'revision_number': 3, 'project_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'gw_port': {'id': '0fc8f26d-1642-4025-b21c-de2a4f14043f', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:c5:bb:ba', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c9d2cce0-31ab-42c3-ac82-14e36499c28f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.163', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:28:18Z', 'updated_at': '2021-11-09T04:28:19Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:28:23.267493 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dcc3083e-289e-4052-bc5e-6ff27e1b85f8 None None] Checking router: c9d2cce0-31ab-42c3-ac82-14e36499c28f for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:28:23.267840 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dcc3083e-289e-4052-bc5e-6ff27e1b85f8 None None] Updating router c9d2cce0-31ab-42c3-ac82-14e36499c28f port 0fc8f26d-1642-4025-b21c-de2a4f14043f binding host dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 04:28:23.295279 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-dcc3083e-289e-4052-bc5e-6ff27e1b85f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:23.308304 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-085a9f11-7e5b-4581-8db4-2ab7a56b1a29 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:23.340789 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d585d776-aca9-4b65-a3ac-f28fd9433b7a admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:23.360098 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Network 6005ba78-d658-44f4-bad3-93b8496ee6db is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:28:23.387869 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1a261b7e-f78f-4a70-b0d6-aab54d47d50a tempest-RoutersAdminNegativeIpV6Test-2011772494 tempest-RoutersAdminNegativeIpV6Test-2011772494-project-admin] Publish callbacks [] for router, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:23.423323 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-085a9f11-7e5b-4581-8db4-2ab7a56b1a29 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:23.468906 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 6005ba78-d658-44f4-bad3-93b8496ee6db) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:28:23.477194 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-890d7927-62e1-4bfd-b970-efcbbccd217d None None] Network 6005ba78-d658-44f4-bad3-93b8496ee6db requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:28:23.490809 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-87f5638f-b560-4286-ad6a-bdd088ffe898 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:23.501908 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-120b4240-85fe-43f7-912d-e1683643c75d tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Allocated IP 172.20.0.8 (79bc3055-9536-43a1-b62c-3eb406e9f982/452f7977-7ae4-43ac-beb5-9ea9aa4844a3/ff1446eb-11a3-44e6-b704-52f9abc24748) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:28:23.558923 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:28:23.570275 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-085a9f11-7e5b-4581-8db4-2ab7a56b1a29 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=04b9f65ccd9a468cba131be6ba674cbc&name=default HTTP/1.1" status: 200 len: 2995 time: 0.9614892 Nov 09 04:28:23.571365 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-87f5638f-b560-4286-ad6a-bdd088ffe898 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network 2dfb69ab-7e18-4759-a210-8fbd86ee6faa {{(pid=102161) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:120}} Nov 09 04:28:23.572053 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-085a9f11-7e5b-4581-8db4-2ab7a56b1a29 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=45147dd9-6406-4562-b417-4b5dc4291477,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:23.604774 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52254) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:23.659979 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-dcc3083e-289e-4052-bc5e-6ff27e1b85f8 None None] Publish callbacks [] for port, precommit_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:23.691050 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port ff43a858-53a5-4a92-99f8-24113c99db26 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:28:23.691503 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port ff43a858-53a5-4a92-99f8-24113c99db26 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:28:23.691923 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port ff43a858-53a5-4a92-99f8-24113c99db26 on network 6005ba78-d658-44f4-bad3-93b8496ee6db {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:28:23.695263 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-87f5638f-b560-4286-ad6a-bdd088ffe898 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:23.702651 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-87f5638f-b560-4286-ad6a-bdd088ffe898 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] 10.222.0.24 "DELETE /v2.0/networks/2dfb69ab-7e18-4759-a210-8fbd86ee6faa HTTP/1.1" status: 204 len: 168 time: 2.0118854 Nov 09 04:28:23.722724 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52256) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:23.733796 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-e7225558-87fd-4e92-a2ea-61ce4c9d8243 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Request body: {'network': {'router:external': True}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:23.734019 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87f5638f-b560-4286-ad6a-bdd088ffe898 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Pushing event deleted for resources: {'Network': ['ID=2dfb69ab-7e18-4759-a210-8fbd86ee6faa,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:23.747140 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1a261b7e-f78f-4a70-b0d6-aab54d47d50a tempest-RoutersAdminNegativeIpV6Test-2011772494 tempest-RoutersAdminNegativeIpV6Test-2011772494-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:23.751185 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Port ff43a858-53a5-4a92-99f8-24113c99db26 on network 6005ba78-d658-44f4-bad3-93b8496ee6db not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:28:23.751604 dv-neutron-816802-2-hyperv neutron-server[102162]: ERROR neutron.plugins.ml2.managers [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Failed to bind port ff43a858-53a5-4a92-99f8-24113c99db26 on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] Nov 09 04:28:23.754464 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1a261b7e-f78f-4a70-b0d6-aab54d47d50a tempest-RoutersAdminNegativeIpV6Test-2011772494 tempest-RoutersAdminNegativeIpV6Test-2011772494-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:23.756059 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.plugins.ml2.plugin [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempt 2 to bind port ff43a858-53a5-4a92-99f8-24113c99db26 Nov 09 04:28:23.764113 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-dcc3083e-289e-4052-bc5e-6ff27e1b85f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:23.774172 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port ff43a858-53a5-4a92-99f8-24113c99db26 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:28:23.774568 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port ff43a858-53a5-4a92-99f8-24113c99db26 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:28:23.774896 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port ff43a858-53a5-4a92-99f8-24113c99db26 on network 6005ba78-d658-44f4-bad3-93b8496ee6db {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:28:23.784192 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Port ff43a858-53a5-4a92-99f8-24113c99db26 on network 6005ba78-d658-44f4-bad3-93b8496ee6db not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:28:23.784534 dv-neutron-816802-2-hyperv neutron-server[102162]: ERROR neutron.plugins.ml2.managers [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Failed to bind port ff43a858-53a5-4a92-99f8-24113c99db26 on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] Nov 09 04:28:23.806180 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-902f4212-a78d-4494-b86a-acedcabbcf06 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:23.825197 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0dc8d473-62e6-46e4-b2cb-9d448736efb0 None None] Pushing event updated for resources: {'Port': ['ID=0fc8f26d-1642-4025-b21c-de2a4f14043f,revision_number=2']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:23.832491 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.plugins.ml2.plugin [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempt 3 to bind port ff43a858-53a5-4a92-99f8-24113c99db26 Nov 09 04:28:23.862721 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0dc8d473-62e6-46e4-b2cb-9d448736efb0 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:28:23.863095 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0dc8d473-62e6-46e4-b2cb-9d448736efb0 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:28:23.863344 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0dc8d473-62e6-46e4-b2cb-9d448736efb0 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:28:23.863681 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0dc8d473-62e6-46e4-b2cb-9d448736efb0 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:28:23.864463 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0dc8d473-62e6-46e4-b2cb-9d448736efb0 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:28:23.864463 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0dc8d473-62e6-46e4-b2cb-9d448736efb0 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:28:23.864686 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0dc8d473-62e6-46e4-b2cb-9d448736efb0 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:28:23.865005 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0dc8d473-62e6-46e4-b2cb-9d448736efb0 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:28:23.865354 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0dc8d473-62e6-46e4-b2cb-9d448736efb0 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:28:23.865681 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0dc8d473-62e6-46e4-b2cb-9d448736efb0 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:28:23.866002 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0dc8d473-62e6-46e4-b2cb-9d448736efb0 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:28:24.264203 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0dc8d473-62e6-46e4-b2cb-9d448736efb0 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:28:24.264203 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0dc8d473-62e6-46e4-b2cb-9d448736efb0 None None] Tracked resource versions report: Nov 09 04:28:24.264203 dv-neutron-816802-2-hyperv neutron-server[102164]: pushed versions: Nov 09 04:28:24.264203 dv-neutron-816802-2-hyperv neutron-server[102164]: { 'AddressGroup': {'1.2'}, Nov 09 04:28:24.264203 dv-neutron-816802-2-hyperv neutron-server[102164]: 'ConntrackHelper': {'1.0'}, Nov 09 04:28:24.264203 dv-neutron-816802-2-hyperv neutron-server[102164]: 'Log': {'1.0'}, Nov 09 04:28:24.264203 dv-neutron-816802-2-hyperv neutron-server[102164]: 'Network': {'1.1'}, Nov 09 04:28:24.264203 dv-neutron-816802-2-hyperv neutron-server[102164]: 'Port': {'1.7'}, Nov 09 04:28:24.264203 dv-neutron-816802-2-hyperv neutron-server[102164]: 'PortForwarding': {'1.2'}, Nov 09 04:28:24.264203 dv-neutron-816802-2-hyperv neutron-server[102164]: 'QosPolicy': {'1.10'}, Nov 09 04:28:24.264203 dv-neutron-816802-2-hyperv neutron-server[102164]: 'SecurityGroup': {'1.5'}, Nov 09 04:28:24.264203 dv-neutron-816802-2-hyperv neutron-server[102164]: 'SecurityGroupRule': {'1.2'}, Nov 09 04:28:24.264203 dv-neutron-816802-2-hyperv neutron-server[102164]: 'SubPort': {'1.0'}, Nov 09 04:28:24.264203 dv-neutron-816802-2-hyperv neutron-server[102164]: 'Subnet': {'1.1'}, Nov 09 04:28:24.264203 dv-neutron-816802-2-hyperv neutron-server[102164]: 'Trunk': {'1.1'}} Nov 09 04:28:24.264203 dv-neutron-816802-2-hyperv neutron-server[102164]: consumer versions: Nov 09 04:28:24.264203 dv-neutron-816802-2-hyperv neutron-server[102164]: { DHCP agent@dv-neutron-816802-2-hyperv: {}, Nov 09 04:28:24.264203 dv-neutron-816802-2-hyperv neutron-server[102164]: HyperV agent@hv-neutron-8168: {}, Nov 09 04:28:24.264203 dv-neutron-816802-2-hyperv neutron-server[102164]: L3 agent@dv-neutron-816802-2-hyperv: {}, Nov 09 04:28:24.264203 dv-neutron-816802-2-hyperv neutron-server[102164]: Metadata agent@dv-neutron-816802-2-hyperv: {}, Nov 09 04:28:24.264203 dv-neutron-816802-2-hyperv neutron-server[102164]: Metering agent@dv-neutron-816802-2-hyperv: {}, Nov 09 04:28:24.264203 dv-neutron-816802-2-hyperv neutron-server[102164]: Open vSwitch agent@dv-neutron-816802-2-hyperv: { 'AddressGroup': '1.2', Nov 09 04:28:24.264203 dv-neutron-816802-2-hyperv neutron-server[102164]: 'ConntrackHelper': '1.0', Nov 09 04:28:24.264203 dv-neutron-816802-2-hyperv neutron-server[102164]: 'Log': '1.0', Nov 09 04:28:24.264203 dv-neutron-816802-2-hyperv neutron-server[102164]: 'Network': '1.1', Nov 09 04:28:24.264203 dv-neutron-816802-2-hyperv neutron-server[102164]: 'Port': '1.7', Nov 09 04:28:24.264203 dv-neutron-816802-2-hyperv neutron-server[102164]: 'PortForwarding': '1.2', Nov 09 04:28:24.264203 dv-neutron-816802-2-hyperv neutron-server[102164]: 'QosPolicy': '1.10', Nov 09 04:28:24.264203 dv-neutron-816802-2-hyperv neutron-server[102164]: 'SecurityGroup': '1.5', Nov 09 04:28:24.264203 dv-neutron-816802-2-hyperv neutron-server[102164]: 'SecurityGroupRule': '1.2', Nov 09 04:28:24.264203 dv-neutron-816802-2-hyperv neutron-server[102164]: 'SubPort': '1.0', Nov 09 04:28:24.264203 dv-neutron-816802-2-hyperv neutron-server[102164]: 'Subnet': '1.1', Nov 09 04:28:24.264203 dv-neutron-816802-2-hyperv neutron-server[102164]: 'Trunk': '1.1'}} Nov 09 04:28:24.264203 dv-neutron-816802-2-hyperv neutron-server[102164]: {{(pid=102164) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 09 04:28:24.264203 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-dcc3083e-289e-4052-bc5e-6ff27e1b85f8 None None] Attempting to bind port 0fc8f26d-1642-4025-b21c-de2a4f14043f on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:28:24.264203 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-dcc3083e-289e-4052-bc5e-6ff27e1b85f8 None None] Attempting to bind port 0fc8f26d-1642-4025-b21c-de2a4f14043f by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:28:24.264203 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dcc3083e-289e-4052-bc5e-6ff27e1b85f8 None None] Attempting to bind port 0fc8f26d-1642-4025-b21c-de2a4f14043f on network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:28:24.264203 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dcc3083e-289e-4052-bc5e-6ff27e1b85f8 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 28, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:28:24.273777 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dcc3083e-289e-4052-bc5e-6ff27e1b85f8 None None] Checking segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102164) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:28:24.273777 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-dcc3083e-289e-4052-bc5e-6ff27e1b85f8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:24.273777 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dcc3083e-289e-4052-bc5e-6ff27e1b85f8 None None] Bound using segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:28:24.273777 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-dcc3083e-289e-4052-bc5e-6ff27e1b85f8 None None] Bound port: 0fc8f26d-1642-4025-b21c-de2a4f14043f, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:28:24.273777 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-dcc3083e-289e-4052-bc5e-6ff27e1b85f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:24.274971 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port ff43a858-53a5-4a92-99f8-24113c99db26 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:28:24.274971 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port ff43a858-53a5-4a92-99f8-24113c99db26 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:28:24.274971 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port ff43a858-53a5-4a92-99f8-24113c99db26 on network 6005ba78-d658-44f4-bad3-93b8496ee6db {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:28:24.274971 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Port ff43a858-53a5-4a92-99f8-24113c99db26 on network 6005ba78-d658-44f4-bad3-93b8496ee6db not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:28:24.274971 dv-neutron-816802-2-hyperv neutron-server[102162]: ERROR neutron.plugins.ml2.managers [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Failed to bind port ff43a858-53a5-4a92-99f8-24113c99db26 on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] Nov 09 04:28:24.274971 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.plugins.ml2.plugin [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempt 4 to bind port ff43a858-53a5-4a92-99f8-24113c99db26 Nov 09 04:28:24.274971 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port ff43a858-53a5-4a92-99f8-24113c99db26 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:28:24.274971 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port ff43a858-53a5-4a92-99f8-24113c99db26 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:28:24.274971 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port ff43a858-53a5-4a92-99f8-24113c99db26 on network 6005ba78-d658-44f4-bad3-93b8496ee6db {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:28:24.276813 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-dcc3083e-289e-4052-bc5e-6ff27e1b85f8 None None] For port 0fc8f26d-1642-4025-b21c-de2a4f14043f, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102164) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:28:24.277074 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Port ff43a858-53a5-4a92-99f8-24113c99db26 on network 6005ba78-d658-44f4-bad3-93b8496ee6db not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:28:24.277074 dv-neutron-816802-2-hyperv neutron-server[102162]: ERROR neutron.plugins.ml2.managers [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Failed to bind port ff43a858-53a5-4a92-99f8-24113c99db26 on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] Nov 09 04:28:24.277074 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.plugins.ml2.plugin [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempt 5 to bind port ff43a858-53a5-4a92-99f8-24113c99db26 Nov 09 04:28:24.278099 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-dcc3083e-289e-4052-bc5e-6ff27e1b85f8 None None] For port 0fc8f26d-1642-4025-b21c-de2a4f14043f, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=0fc8f26d-1642-4025-b21c-de2a4f14043f,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102164) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:28:24.278418 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port ff43a858-53a5-4a92-99f8-24113c99db26 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:28:24.278418 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port ff43a858-53a5-4a92-99f8-24113c99db26 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:28:24.278418 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port ff43a858-53a5-4a92-99f8-24113c99db26 on network 6005ba78-d658-44f4-bad3-93b8496ee6db {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:28:24.278418 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Port ff43a858-53a5-4a92-99f8-24113c99db26 on network 6005ba78-d658-44f4-bad3-93b8496ee6db not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:28:24.278418 dv-neutron-816802-2-hyperv neutron-server[102162]: ERROR neutron.plugins.ml2.managers [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Failed to bind port ff43a858-53a5-4a92-99f8-24113c99db26 on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] Nov 09 04:28:24.278418 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.plugins.ml2.plugin [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempt 6 to bind port ff43a858-53a5-4a92-99f8-24113c99db26 Nov 09 04:28:24.278418 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port ff43a858-53a5-4a92-99f8-24113c99db26 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:28:24.278418 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port ff43a858-53a5-4a92-99f8-24113c99db26 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:28:24.278418 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port ff43a858-53a5-4a92-99f8-24113c99db26 on network 6005ba78-d658-44f4-bad3-93b8496ee6db {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:28:24.278418 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Port ff43a858-53a5-4a92-99f8-24113c99db26 on network 6005ba78-d658-44f4-bad3-93b8496ee6db not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:28:24.278418 dv-neutron-816802-2-hyperv neutron-server[102162]: ERROR neutron.plugins.ml2.managers [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Failed to bind port ff43a858-53a5-4a92-99f8-24113c99db26 on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] Nov 09 04:28:24.278418 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.plugins.ml2.plugin [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempt 7 to bind port ff43a858-53a5-4a92-99f8-24113c99db26 Nov 09 04:28:24.281002 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port ff43a858-53a5-4a92-99f8-24113c99db26 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:28:24.281002 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port ff43a858-53a5-4a92-99f8-24113c99db26 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:28:24.281002 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port ff43a858-53a5-4a92-99f8-24113c99db26 on network 6005ba78-d658-44f4-bad3-93b8496ee6db {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:28:24.281002 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Port ff43a858-53a5-4a92-99f8-24113c99db26 on network 6005ba78-d658-44f4-bad3-93b8496ee6db not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:28:24.281002 dv-neutron-816802-2-hyperv neutron-server[102162]: ERROR neutron.plugins.ml2.managers [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Failed to bind port ff43a858-53a5-4a92-99f8-24113c99db26 on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] Nov 09 04:28:24.281002 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.plugins.ml2.plugin [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempt 8 to bind port ff43a858-53a5-4a92-99f8-24113c99db26 Nov 09 04:28:24.281002 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port ff43a858-53a5-4a92-99f8-24113c99db26 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:28:24.281002 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port ff43a858-53a5-4a92-99f8-24113c99db26 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:28:24.281002 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port ff43a858-53a5-4a92-99f8-24113c99db26 on network 6005ba78-d658-44f4-bad3-93b8496ee6db {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:28:24.281002 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Port ff43a858-53a5-4a92-99f8-24113c99db26 on network 6005ba78-d658-44f4-bad3-93b8496ee6db not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:28:24.281002 dv-neutron-816802-2-hyperv neutron-server[102162]: ERROR neutron.plugins.ml2.managers [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Failed to bind port ff43a858-53a5-4a92-99f8-24113c99db26 on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] Nov 09 04:28:24.281002 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.plugins.ml2.plugin [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempt 9 to bind port ff43a858-53a5-4a92-99f8-24113c99db26 Nov 09 04:28:24.290404 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port ff43a858-53a5-4a92-99f8-24113c99db26 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:28:24.290404 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port ff43a858-53a5-4a92-99f8-24113c99db26 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:28:24.290404 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port ff43a858-53a5-4a92-99f8-24113c99db26 on network 6005ba78-d658-44f4-bad3-93b8496ee6db {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:28:24.290404 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Port ff43a858-53a5-4a92-99f8-24113c99db26 on network 6005ba78-d658-44f4-bad3-93b8496ee6db not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:28:24.290404 dv-neutron-816802-2-hyperv neutron-server[102162]: ERROR neutron.plugins.ml2.managers [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Failed to bind port ff43a858-53a5-4a92-99f8-24113c99db26 on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] Nov 09 04:28:24.290404 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.plugins.ml2.plugin [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempt 10 to bind port ff43a858-53a5-4a92-99f8-24113c99db26 Nov 09 04:28:24.290404 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port ff43a858-53a5-4a92-99f8-24113c99db26 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:28:24.290404 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port ff43a858-53a5-4a92-99f8-24113c99db26 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:28:24.290404 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port ff43a858-53a5-4a92-99f8-24113c99db26 on network 6005ba78-d658-44f4-bad3-93b8496ee6db {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:28:24.290404 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Port ff43a858-53a5-4a92-99f8-24113c99db26 on network 6005ba78-d658-44f4-bad3-93b8496ee6db not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:28:24.290404 dv-neutron-816802-2-hyperv neutron-server[102162]: ERROR neutron.plugins.ml2.managers [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Failed to bind port ff43a858-53a5-4a92-99f8-24113c99db26 on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] Nov 09 04:28:24.292076 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:24.292268 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-50c1f40e-ce7d-4527-84b2-dbfe7453de37 None None] Network 79bc3055-9536-43a1-b62c-3eb406e9f982 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:28:24.292902 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-22c57419-e1b0-4c22-a224-b4a4a3e02807 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:24.293048 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e7225558-87fd-4e92-a2ea-61ce4c9d8243 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Made reservation on behalf of 50f2f3df9a9441cd84e52ab52b9432fc for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:28:24.293048 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e7225558-87fd-4e92-a2ea-61ce4c9d8243 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:24.293337 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-22c57419-e1b0-4c22-a224-b4a4a3e02807 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:24.293474 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] For port ff43a858-53a5-4a92-99f8-24113c99db26, host hv-neutron-8168, cleared binding levels {{(pid=102162) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:28:24.293474 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempted to set empty binding levels {{(pid=102162) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:65}} Nov 09 04:28:24.293744 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-dcc3083e-289e-4052-bc5e-6ff27e1b85f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:24.293892 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e7225558-87fd-4e92-a2ea-61ce4c9d8243 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 324} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:28:24.293892 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e7225558-87fd-4e92-a2ea-61ce4c9d8243 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:24.293892 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-e7225558-87fd-4e92-a2ea-61ce4c9d8243 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Added segment f907c809-6d47-40ca-9855-3086df265851 of type vlan for network 25474b0c-53b0-4c3a-8cb0-00a4d7799f33 Nov 09 04:28:24.293892 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1a261b7e-f78f-4a70-b0d6-aab54d47d50a tempest-RoutersAdminNegativeIpV6Test-2011772494 tempest-RoutersAdminNegativeIpV6Test-2011772494-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:24.293892 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1a261b7e-f78f-4a70-b0d6-aab54d47d50a tempest-RoutersAdminNegativeIpV6Test-2011772494 tempest-RoutersAdminNegativeIpV6Test-2011772494-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 159012f9-0e69-4ae7-8ba7-c0d1159646da {{(pid=102162) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:28:24.295126 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-42030e2f-dbfa-4028-8c1f-00aeb2e6fa34 None None] Provisioning complete for port af24097e-ae0a-4d62-aacd-2c2738983c34 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:28:24.295126 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-42030e2f-dbfa-4028-8c1f-00aeb2e6fa34 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:24.301187 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:24.320069 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e7225558-87fd-4e92-a2ea-61ce4c9d8243 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:24.328895 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0dc8d473-62e6-46e4-b2cb-9d448736efb0 None None] Pushing event updated for resources: {'Port': ['ID=0fc8f26d-1642-4025-b21c-de2a4f14043f,revision_number=3']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:24.335905 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dcc3083e-289e-4052-bc5e-6ff27e1b85f8 None None] Routers {'c9d2cce0-31ab-42c3-ac82-14e36499c28f'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:28:24.337012 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-dcc3083e-289e-4052-bc5e-6ff27e1b85f8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:28:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['c9d2cce0-31ab-42c3-ac82-14e36499c28f'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:28:24.373241 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:24.374026 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:24.410313 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-902f4212-a78d-4494-b86a-acedcabbcf06 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:24.411373 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Pushing event updated for resources: {'Port': ['ID=ff43a858-53a5-4a92-99f8-24113c99db26,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:24.417568 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d585d776-aca9-4b65-a3ac-f28fd9433b7a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:24.432940 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.api.v2.resource [None req-1a261b7e-f78f-4a70-b0d6-aab54d47d50a tempest-RoutersAdminNegativeIpV6Test-2011772494 tempest-RoutersAdminNegativeIpV6Test-2011772494-project-admin] create failed (client error): There was a conflict when trying to complete your request. Nov 09 04:28:24.437920 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-1a261b7e-f78f-4a70-b0d6-aab54d47d50a tempest-RoutersAdminNegativeIpV6Test-2011772494 tempest-RoutersAdminNegativeIpV6Test-2011772494-project-admin] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 409 len: 372 time: 2.7719965 Nov 09 04:28:24.438550 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52258) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:24.536033 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-22c57419-e1b0-4c22-a224-b4a4a3e02807 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:24.538746 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-22c57419-e1b0-4c22-a224-b4a4a3e02807 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:24.548738 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-dcc3083e-289e-4052-bc5e-6ff27e1b85f8 None None] Set router c9d2cce0-31ab-42c3-ac82-14e36499c28f gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:28:24.552951 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-22c57419-e1b0-4c22-a224-b4a4a3e02807 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/45147dd9-6406-4562-b417-4b5dc4291477 HTTP/1.1" status: 204 len: 168 time: 0.9369261 Nov 09 04:28:24.605454 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-42030e2f-dbfa-4028-8c1f-00aeb2e6fa34 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:24.622499 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-120b4240-85fe-43f7-912d-e1683643c75d tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:24.661699 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-42030e2f-dbfa-4028-8c1f-00aeb2e6fa34 None None] For port af24097e-ae0a-4d62-aacd-2c2738983c34, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=af24097e-ae0a-4d62-aacd-2c2738983c34,segment=NetworkSegment(4298f996-bd9c-4831-928f-e41287186d45),segment_id=4298f996-bd9c-4831-928f-e41287186d45)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:28:24.667621 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22c57419-e1b0-4c22-a224-b4a4a3e02807 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=45147dd9-6406-4562-b417-4b5dc4291477,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:24.678991 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e7225558-87fd-4e92-a2ea-61ce4c9d8243 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:24.678991 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e7225558-87fd-4e92-a2ea-61ce4c9d8243 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:24.678991 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e7225558-87fd-4e92-a2ea-61ce4c9d8243 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:24.682282 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-d3d3579e-6972-445a-b2b5-369deea5df44 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 981 time: 3.4900565 Nov 09 04:28:24.705428 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52262) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:24.747018 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-42030e2f-dbfa-4028-8c1f-00aeb2e6fa34 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:24.819934 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42030e2f-dbfa-4028-8c1f-00aeb2e6fa34 None None] Pushing event updated for resources: {'Port': ['ID=af24097e-ae0a-4d62-aacd-2c2738983c34,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:24.875612 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-771a5fa5-a0ee-4baa-a703-e5abb947bc31 None None] Provisioning complete for port af24097e-ae0a-4d62-aacd-2c2738983c34 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:28:24.876130 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-771a5fa5-a0ee-4baa-a703-e5abb947bc31 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:24.896496 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e7225558-87fd-4e92-a2ea-61ce4c9d8243 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 836 time: 1.1700475 Nov 09 04:28:24.899708 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52264) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:24.901590 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-dcc3083e-289e-4052-bc5e-6ff27e1b85f8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c9d2cce0-31ab-42c3-ac82-14e36499c28f', 'name': 'tempest-ServersTestJSON-828046534-router', 'tenant_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.163'}], 'enable_snat': True}, 'gw_port_id': '0fc8f26d-1642-4025-b21c-de2a4f14043f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:28:17Z', 'updated_at': '2021-11-09T04:28:20Z', 'revision_number': 3, 'project_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'gw_port': {'id': '0fc8f26d-1642-4025-b21c-de2a4f14043f', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:c5:bb:ba', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c9d2cce0-31ab-42c3-ac82-14e36499c28f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.163', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:28:18Z', 'updated_at': '2021-11-09T04:28:23Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:28:24.910646 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-ac64fff5-6ca5-4fff-9617-8c540d3a61b1 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Request body: {'subnet': {'network_id': '25474b0c-53b0-4c3a-8cb0-00a4d7799f33', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'enable_dhcp': False}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:24.915208 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7225558-87fd-4e92-a2ea-61ce4c9d8243 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Pushing event updated for resources: {'Network': ['ID=25474b0c-53b0-4c3a-8cb0-00a4d7799f33,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:24.933731 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dcc3083e-289e-4052-bc5e-6ff27e1b85f8 None None] The sync data for ids ['c9d2cce0-31ab-42c3-ac82-14e36499c28f'] in dv-neutron-816802-2-hyperv is: [{'id': 'c9d2cce0-31ab-42c3-ac82-14e36499c28f', 'name': 'tempest-ServersTestJSON-828046534-router', 'tenant_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.163'}], 'enable_snat': True}, 'gw_port_id': '0fc8f26d-1642-4025-b21c-de2a4f14043f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:28:17Z', 'updated_at': '2021-11-09T04:28:20Z', 'revision_number': 3, 'project_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'gw_port': {'id': '0fc8f26d-1642-4025-b21c-de2a4f14043f', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:c5:bb:ba', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c9d2cce0-31ab-42c3-ac82-14e36499c28f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.163', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:28:18Z', 'updated_at': '2021-11-09T04:28:23Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:28:24.976992 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-33317bd3-9080-45b6-8f99-e43bd76db5f1 tempest-RoutersAdminNegativeIpV6Test-2011772494 tempest-RoutersAdminNegativeIpV6Test-2011772494-project-admin] Deleting port 4400c4cb-f2fd-4046-9513-7e4bfc9210ec {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:28:24.977347 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-33317bd3-9080-45b6-8f99-e43bd76db5f1 tempest-RoutersAdminNegativeIpV6Test-2011772494 tempest-RoutersAdminNegativeIpV6Test-2011772494-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:24.977889 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 25474b0c-53b0-4c3a-8cb0-00a4d7799f33 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:28:25.030748 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-902f4212-a78d-4494-b86a-acedcabbcf06 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:25.046017 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ac64fff5-6ca5-4fff-9617-8c540d3a61b1 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Made reservation on behalf of 50f2f3df9a9441cd84e52ab52b9432fc for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:28:25.048463 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ac64fff5-6ca5-4fff-9617-8c540d3a61b1 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks [] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:25.068685 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device af24097e-ae0a-4d62-aacd-2c2738983c34 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:28:25.070040 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-dcb19ed8-7cad-4e2a-ae13-de58436bb83d tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Deleting port ff43a858-53a5-4a92-99f8-24113c99db26 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:28:25.070401 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-dcb19ed8-7cad-4e2a-ae13-de58436bb83d tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:25.101806 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b8726645-b237-410e-a92e-99f16d9611e3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:25.105840 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-120b4240-85fe-43f7-912d-e1683643c75d tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:25.175691 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port af24097e-ae0a-4d62-aacd-2c2738983c34 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:28:25.176253 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:25.189878 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-902f4212-a78d-4494-b86a-acedcabbcf06 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:25.198724 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-33317bd3-9080-45b6-8f99-e43bd76db5f1 tempest-RoutersAdminNegativeIpV6Test-2011772494 tempest-RoutersAdminNegativeIpV6Test-2011772494-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:25.216961 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-120b4240-85fe-43f7-912d-e1683643c75d tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Network 79bc3055-9536-43a1-b62c-3eb406e9f982 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:28:25.253984 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-120b4240-85fe-43f7-912d-e1683643c75d tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:28:25.273885 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-33317bd3-9080-45b6-8f99-e43bd76db5f1 tempest-RoutersAdminNegativeIpV6Test-2011772494 tempest-RoutersAdminNegativeIpV6Test-2011772494-project-admin] Calling delete_port for 4400c4cb-f2fd-4046-9513-7e4bfc9210ec owned by {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:28:25.282074 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-dcb19ed8-7cad-4e2a-ae13-de58436bb83d tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] For port ff43a858-53a5-4a92-99f8-24113c99db26, host hv-neutron-8168, got binding levels [] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:28:25.284558 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-dcb19ed8-7cad-4e2a-ae13-de58436bb83d tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:25.297413 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-120b4240-85fe-43f7-912d-e1683643c75d tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:28:25.312711 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-120b4240-85fe-43f7-912d-e1683643c75d tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Pushing event updated for resources: {'Port': ['ID=ff1446eb-11a3-44e6-b704-52f9abc24748,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:25.370034 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-dcb19ed8-7cad-4e2a-ae13-de58436bb83d tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Calling delete_port for ff43a858-53a5-4a92-99f8-24113c99db26 owned by {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:28:25.425595 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52268) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:25.546456 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-902f4212-a78d-4494-b86a-acedcabbcf06 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:25.563647 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2214945e-7392-4b86-a268-18122b358a90 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:25.564045 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-120b4240-85fe-43f7-912d-e1683643c75d tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:25.564045 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-120b4240-85fe-43f7-912d-e1683643c75d tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:25.564045 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-902f4212-a78d-4494-b86a-acedcabbcf06 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Pushing event updated for resources: {'Port': ['ID=4151881c-46eb-4bc9-ab1d-9d251cecb700,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:25.608961 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-b8726645-b237-410e-a92e-99f16d9611e3 admin admin] Allocated IP 172.20.0.1 (d4ba3288-221c-40f3-a829-662c462cc93f/b11be6b4-75f0-4756-9312-de5295f24e1b/76f630f8-c464-46b2-b3b3-6a4c815cc2cf) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:28:25.695626 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d585d776-aca9-4b65-a3ac-f28fd9433b7a admin admin] Router 23955a4a-3903-49e9-ab99-5e003c83c868 is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102161) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:28:25.703026 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-120b4240-85fe-43f7-912d-e1683643c75d tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 4.0166302 Nov 09 04:28:25.707426 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-902f4212-a78d-4494-b86a-acedcabbcf06 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:25.708605 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-902f4212-a78d-4494-b86a-acedcabbcf06 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] 10.222.0.24 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 7.2070000 Nov 09 04:28:25.711264 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52270) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:25.711615 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52272) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:25.732720 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-61133fa0-d422-4359-8c64-43744cde1355 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Request body: {'network': {'name': 'tempest-FloatingIPAdminTestJSON-test-network-2014746222'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:25.754118 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-bd99c06d-bd59-4c7a-9bb0-9fbbb7f17a0f None None] Provisioning complete for port ff1446eb-11a3-44e6-b704-52f9abc24748 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:28:25.755221 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-bd99c06d-bd59-4c7a-9bb0-9fbbb7f17a0f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:25.775832 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-33317bd3-9080-45b6-8f99-e43bd76db5f1 tempest-RoutersAdminNegativeIpV6Test-2011772494 tempest-RoutersAdminNegativeIpV6Test-2011772494-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:25.805185 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-bd99c06d-bd59-4c7a-9bb0-9fbbb7f17a0f None None] Port ff1446eb-11a3-44e6-b704-52f9abc24748 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:28:25.830549 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-dcb19ed8-7cad-4e2a-ae13-de58436bb83d tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:25.858809 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33317bd3-9080-45b6-8f99-e43bd76db5f1 tempest-RoutersAdminNegativeIpV6Test-2011772494 tempest-RoutersAdminNegativeIpV6Test-2011772494-project-admin] Pushing event deleted for resources: {'Port': ['ID=4400c4cb-f2fd-4046-9513-7e4bfc9210ec,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:25.916918 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-33317bd3-9080-45b6-8f99-e43bd76db5f1 tempest-RoutersAdminNegativeIpV6Test-2011772494 tempest-RoutersAdminNegativeIpV6Test-2011772494-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:25.923488 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-33317bd3-9080-45b6-8f99-e43bd76db5f1 tempest-RoutersAdminNegativeIpV6Test-2011772494 tempest-RoutersAdminNegativeIpV6Test-2011772494-project-admin] 10.222.0.24 "DELETE /v2.0/ports/4400c4cb-f2fd-4046-9513-7e4bfc9210ec HTTP/1.1" status: 204 len: 168 time: 1.4810805 Nov 09 04:28:25.936062 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcb19ed8-7cad-4e2a-ae13-de58436bb83d tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Pushing event deleted for resources: {'Port': ['ID=ff43a858-53a5-4a92-99f8-24113c99db26,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:25.949754 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-dcb19ed8-7cad-4e2a-ae13-de58436bb83d tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:25.952927 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-dcb19ed8-7cad-4e2a-ae13-de58436bb83d tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] 10.222.0.24 "DELETE /v2.0/ports/ff43a858-53a5-4a92-99f8-24113c99db26 HTTP/1.1" status: 204 len: 168 time: 1.2351954 Nov 09 04:28:25.956604 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52276) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:26.027289 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-731883a8-b47c-47f9-8e68-d1b05fa83e85 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] GET failed (client error): The resource could not be found. Nov 09 04:28:26.028897 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-731883a8-b47c-47f9-8e68-d1b05fa83e85 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] 10.222.0.24 "GET /v2.0/ports/ff43a858-53a5-4a92-99f8-24113c99db26 HTTP/1.1" status: 404 len: 333 time: 0.0713420 Nov 09 04:28:26.034318 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52278) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:26.043838 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-dbf69ec2-fc84-42bd-a848-e5387f8de598 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Request body: {'port': {'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db', 'name': 'tempest-PortsAdminExtendedAttrsTestJSON-50177971'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:26.055400 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2214945e-7392-4b86-a268-18122b358a90 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:26.107088 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b8726645-b237-410e-a92e-99f16d9611e3 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:26.129327 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d585d776-aca9-4b65-a3ac-f28fd9433b7a admin admin] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:28:26.132898 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.objects.ports [None req-ac64fff5-6ca5-4fff-9617-8c540d3a61b1 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=102162) get_objects /opt/stack/neutron/neutron/objects/ports.py:444}} Nov 09 04:28:26.133403 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ac64fff5-6ca5-4fff-9617-8c540d3a61b1 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:26.141431 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2214945e-7392-4b86-a268-18122b358a90 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:26.142451 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-96153279-374e-4871-9bd1-29e27a166522 None None] Sync routers for ids ['23955a4a-3903-49e9-ab99-5e003c83c868'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:28:26.153708 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-96153279-374e-4871-9bd1-29e27a166522 None None] Routers {'23955a4a-3903-49e9-ab99-5e003c83c868'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:28:26.154880 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-96153279-374e-4871-9bd1-29e27a166522 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:28:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['23955a4a-3903-49e9-ab99-5e003c83c868'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:28:26.169892 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-61133fa0-d422-4359-8c64-43744cde1355 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Made reservation on behalf of 00757dadf44e4dd1a48e6e44b03816b0 for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:28:26.173405 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-61133fa0-d422-4359-8c64-43744cde1355 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:26.196377 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-61133fa0-d422-4359-8c64-43744cde1355 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:26.203226 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-b2e08d31-4a50-4db9-9f1a-5bab77139c51 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Deleting port ff1446eb-11a3-44e6-b704-52f9abc24748 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:28:26.204171 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b2e08d31-4a50-4db9-9f1a-5bab77139c51 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:26.243163 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-2214945e-7392-4b86-a268-18122b358a90 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=9c4093be82084c2399952d22c1c11279&name=default HTTP/1.1" status: 200 len: 2996 time: 0.8163257 Nov 09 04:28:26.248470 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2214945e-7392-4b86-a268-18122b358a90 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3ceda73c-4761-49d7-a215-bbca2ba85d42,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:26.251236 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52280) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:26.259874 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac64fff5-6ca5-4fff-9617-8c540d3a61b1 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Pushing event updated for resources: {'Subnet': ['ID=4e4a617b-3903-4f63-b43d-7b6ec4c3091f,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:26.305591 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ac64fff5-6ca5-4fff-9617-8c540d3a61b1 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Checking segment: {'id': 'f907c809-6d47-40ca-9855-3086df265851', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 324, 'network_id': '25474b0c-53b0-4c3a-8cb0-00a4d7799f33'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:28:26.305950 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ac64fff5-6ca5-4fff-9617-8c540d3a61b1 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Network hostable DHCP agents. Network: 25474b0c-53b0-4c3a-8cb0-00a4d7799f33, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:28:26.308608 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-96153279-374e-4871-9bd1-29e27a166522 None None] Set router 23955a4a-3903-49e9-ab99-5e003c83c868 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:28:26.320839 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b8726645-b237-410e-a92e-99f16d9611e3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:26.340678 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dbf69ec2-fc84-42bd-a848-e5387f8de598 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Made reservation on behalf of 1f5d2eca16394ba1811d503557bb1504 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:28:26.343580 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-dbf69ec2-fc84-42bd-a848-e5387f8de598 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:26.357173 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6ae3bfa4-9bcd-4fb0-abeb-9d182585c777 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:26.374566 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [None req-dbf69ec2-fc84-42bd-a848-e5387f8de598 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] device_id is not set on port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 yet. {{(pid=102162) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:28:26.388625 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6ae3bfa4-9bcd-4fb0-abeb-9d182585c777 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:26.392749 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b8726645-b237-410e-a92e-99f16d9611e3 admin admin] Network d4ba3288-221c-40f3-a829-662c462cc93f is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:28:26.409820 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-b8726645-b237-410e-a92e-99f16d9611e3 admin admin] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:28:26.412188 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b8726645-b237-410e-a92e-99f16d9611e3 admin admin] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:28:26.416351 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b2e08d31-4a50-4db9-9f1a-5bab77139c51 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:26.463528 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ac64fff5-6ca5-4fff-9617-8c540d3a61b1 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Network 25474b0c-53b0-4c3a-8cb0-00a4d7799f33 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:28:26.476091 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d585d776-aca9-4b65-a3ac-f28fd9433b7a admin admin] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:26.477621 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-d585d776-aca9-4b65-a3ac-f28fd9433b7a admin admin] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 922 time: 9.1462696 Nov 09 04:28:26.482208 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52284) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:26.484740 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-b2e08d31-4a50-4db9-9f1a-5bab77139c51 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Calling delete_port for ff1446eb-11a3-44e6-b704-52f9abc24748 owned by {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:28:26.490166 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8726645-b237-410e-a92e-99f16d9611e3 admin admin] Pushing event updated for resources: {'Port': ['ID=76f630f8-c464-46b2-b3b3-6a4c815cc2cf,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:26.600973 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b8726645-b237-410e-a92e-99f16d9611e3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:26.607011 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-61133fa0-d422-4359-8c64-43744cde1355 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:26.609975 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-96153279-374e-4871-9bd1-29e27a166522 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '23955a4a-3903-49e9-ab99-5e003c83c868', 'name': 'tempest-ServersTestManualDisk-509590275-router', 'tenant_id': '5f3cd2a3586e46c09f847681f744075c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.66'}], 'enable_snat': True}, 'gw_port_id': 'a31e46ce-e371-4177-a2d5-f9a3681f192b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:28:17Z', 'updated_at': '2021-11-09T04:28:22Z', 'revision_number': 3, 'project_id': '5f3cd2a3586e46c09f847681f744075c', 'gw_port': {'id': 'a31e46ce-e371-4177-a2d5-f9a3681f192b', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:d3:1e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '23955a4a-3903-49e9-ab99-5e003c83c868', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:28:19Z', 'updated_at': '2021-11-09T04:28:21Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:28:26.611030 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52286) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:26.643658 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-ac64fff5-6ca5-4fff-9617-8c540d3a61b1 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 25474b0c-53b0-4c3a-8cb0-00a4d7799f33) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:28:26.647402 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-96153279-374e-4871-9bd1-29e27a166522 None None] Checking router: 23955a4a-3903-49e9-ab99-5e003c83c868 for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:28:26.647402 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-96153279-374e-4871-9bd1-29e27a166522 None None] Updating router 23955a4a-3903-49e9-ab99-5e003c83c868 port a31e46ce-e371-4177-a2d5-f9a3681f192b binding host dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 04:28:26.656482 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6ae3bfa4-9bcd-4fb0-abeb-9d182585c777 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:26.659662 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6ae3bfa4-9bcd-4fb0-abeb-9d182585c777 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:26.663592 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-6ae3bfa4-9bcd-4fb0-abeb-9d182585c777 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/3ceda73c-4761-49d7-a215-bbca2ba85d42 HTTP/1.1" status: 204 len: 168 time: 0.4113431 Nov 09 04:28:26.677873 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ac64fff5-6ca5-4fff-9617-8c540d3a61b1 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:26.678554 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ac64fff5-6ca5-4fff-9617-8c540d3a61b1 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:26.690191 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-96153279-374e-4871-9bd1-29e27a166522 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:26.694994 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a47a908d-b317-4720-9d1a-78af9a22461c None None] Network 25474b0c-53b0-4c3a-8cb0-00a4d7799f33 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:28:26.766373 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-61133fa0-d422-4359-8c64-43744cde1355 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:26.815792 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b2e08d31-4a50-4db9-9f1a-5bab77139c51 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:26.817872 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-61133fa0-d422-4359-8c64-43744cde1355 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 327} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:28:26.913787 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-4d641cf2-6888-429f-9c82-ec7026239530 None None] Provisioning complete for port 76f630f8-c464-46b2-b3b3-6a4c815cc2cf triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:28:26.914809 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4d641cf2-6888-429f-9c82-ec7026239530 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:26.959377 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-4d641cf2-6888-429f-9c82-ec7026239530 None None] Port 76f630f8-c464-46b2-b3b3-6a4c815cc2cf cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:28:26.998233 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ae3bfa4-9bcd-4fb0-abeb-9d182585c777 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3ceda73c-4761-49d7-a215-bbca2ba85d42,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:27.049998 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-dbf69ec2-fc84-42bd-a848-e5387f8de598 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:27.085568 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-76fe01d3-1250-45a7-8852-f90e48dae248 None None] Network 25474b0c-53b0-4c3a-8cb0-00a4d7799f33 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:28:27.118636 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-ac64fff5-6ca5-4fff-9617-8c540d3a61b1 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 802 time: 2.2095380 Nov 09 04:28:27.126832 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52292) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:27.143713 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-0b7788bc-9fa5-4dea-9e00-daaafc885629 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Request body: {'floatingip': {'floating_network_id': '25474b0c-53b0-4c3a-8cb0-00a4d7799f33'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:27.162073 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 0fc8f26d-1642-4025-b21c-de2a4f14043f up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:28:27.169611 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7c309b71-e41f-449b-96ea-5e95db025bbf admin admin] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:27.223979 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61133fa0-d422-4359-8c64-43744cde1355 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f055b924-862a-48c9-833f-a06c7e5617ac,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:27.229446 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-61133fa0-d422-4359-8c64-43744cde1355 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:27.230461 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-61133fa0-d422-4359-8c64-43744cde1355 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Added segment 9bba1879-429a-4e85-9da5-469e1c46a5ba of type vlan for network b103fb67-62b2-4eeb-9e21-70ef83ccb4b2 Nov 09 04:28:27.233497 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2e08d31-4a50-4db9-9f1a-5bab77139c51 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Pushing event deleted for resources: {'Port': ['ID=ff1446eb-11a3-44e6-b704-52f9abc24748,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:27.307915 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0b7788bc-9fa5-4dea-9e00-daaafc885629 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks [] for floatingip, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:27.347094 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-96153279-374e-4871-9bd1-29e27a166522 None None] Publish callbacks [] for port, precommit_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:27.387508 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 0fc8f26d-1642-4025-b21c-de2a4f14043f triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:28:27.387788 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:27.412983 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-dbf69ec2-fc84-42bd-a848-e5387f8de598 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:27.427959 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-61133fa0-d422-4359-8c64-43744cde1355 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:27.475860 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-96153279-374e-4871-9bd1-29e27a166522 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:27.488825 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b2e08d31-4a50-4db9-9f1a-5bab77139c51 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:27.492723 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-b2e08d31-4a50-4db9-9f1a-5bab77139c51 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] 10.222.0.24 "DELETE /v2.0/ports/ff1446eb-11a3-44e6-b704-52f9abc24748 HTTP/1.1" status: 204 len: 168 time: 1.7781057 Nov 09 04:28:27.496853 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52300) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:27.571990 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-61133fa0-d422-4359-8c64-43744cde1355 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:27.585360 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:27.587275 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-61133fa0-d422-4359-8c64-43744cde1355 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:27.591346 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-61133fa0-d422-4359-8c64-43744cde1355 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:27.600987 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-96153279-374e-4871-9bd1-29e27a166522 None None] Attempting to bind port a31e46ce-e371-4177-a2d5-f9a3681f192b on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:28:27.601280 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-96153279-374e-4871-9bd1-29e27a166522 None None] Attempting to bind port a31e46ce-e371-4177-a2d5-f9a3681f192b by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:28:27.601691 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-96153279-374e-4871-9bd1-29e27a166522 None None] Attempting to bind port a31e46ce-e371-4177-a2d5-f9a3681f192b on network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:28:27.614520 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e8b9513-50ea-47f2-be5d-455edfa9a623 None None] Pushing event updated for resources: {'Port': ['ID=a31e46ce-e371-4177-a2d5-f9a3681f192b,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:27.647019 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dbf69ec2-fc84-42bd-a848-e5387f8de598 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Network 6005ba78-d658-44f4-bad3-93b8496ee6db is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:28:27.660630 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-dbf69ec2-fc84-42bd-a848-e5387f8de598 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:28:27.679645 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dbf69ec2-fc84-42bd-a848-e5387f8de598 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:28:27.680594 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dbf69ec2-fc84-42bd-a848-e5387f8de598 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:27.681248 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-dbf69ec2-fc84-42bd-a848-e5387f8de598 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:27.685633 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b8726645-b237-410e-a92e-99f16d9611e3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:27.704067 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbf69ec2-fc84-42bd-a848-e5387f8de598 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Pushing event updated for resources: {'Port': ['ID=24682efc-26e9-4be8-80d7-b4fa99ec4b58,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:27.732094 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7c309b71-e41f-449b-96ea-5e95db025bbf admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:27.737479 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 0fc8f26d-1642-4025-b21c-de2a4f14043f, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=0fc8f26d-1642-4025-b21c-de2a4f14043f,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:28:27.739323 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-96153279-374e-4871-9bd1-29e27a166522 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 28, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:28:27.742905 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-96153279-374e-4871-9bd1-29e27a166522 None None] Checking segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:28:27.742905 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-96153279-374e-4871-9bd1-29e27a166522 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:27.742905 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-96153279-374e-4871-9bd1-29e27a166522 None None] Bound using segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:28:27.742905 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-96153279-374e-4871-9bd1-29e27a166522 None None] Bound port: a31e46ce-e371-4177-a2d5-f9a3681f192b, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:28:27.742905 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-96153279-374e-4871-9bd1-29e27a166522 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:27.753611 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-61133fa0-d422-4359-8c64-43744cde1355 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 791 time: 2.0377204 Nov 09 04:28:27.756843 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52308) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:27.764061 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-e7d631b1-6505-441f-94f5-10e666dfb0fa tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Request body: {'subnet': {'network_id': 'b103fb67-62b2-4eeb-9e21-70ef83ccb4b2', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:27.795864 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61133fa0-d422-4359-8c64-43744cde1355 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Pushing event updated for resources: {'Network': ['ID=b103fb67-62b2-4eeb-9e21-70ef83ccb4b2,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:27.840559 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-96153279-374e-4871-9bd1-29e27a166522 None None] For port a31e46ce-e371-4177-a2d5-f9a3681f192b, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:28:27.842673 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network b103fb67-62b2-4eeb-9e21-70ef83ccb4b2 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:28:27.872411 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7c309b71-e41f-449b-96ea-5e95db025bbf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:27.878908 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3e96f0d5-0f34-4db3-8112-efc521fd4904 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:27.883924 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-f430d31b-07f0-4822-b551-594d557b1367 tempest-DHCPAgentSchedulersTestJSON-198564031 tempest-DHCPAgentSchedulersTestJSON-198564031-project-admin] 10.222.0.24 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4560 time: 0.3856924 Nov 09 04:28:27.891181 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52312) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:27.898895 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-96153279-374e-4871-9bd1-29e27a166522 None None] For port a31e46ce-e371-4177-a2d5-f9a3681f192b, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=a31e46ce-e371-4177-a2d5-f9a3681f192b,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:28:27.902182 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:27.908269 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-b8560056-d10d-4681-b636-6c25db4748d3 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Request body: {'network': {'name': 'tempest-DHCPAgentSchedulersTestJSON-test-network-327244105'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:27.909719 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device af24097e-ae0a-4d62-aacd-2c2738983c34 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:28:27.915135 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-dbf69ec2-fc84-42bd-a848-e5387f8de598 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 958 time: 1.8797743 Nov 09 04:28:27.925577 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52314) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:27.929652 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Request body: {'port': {'binding:host_id': 'hv-neutron-8168'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:27.952980 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0b7788bc-9fa5-4dea-9e00-daaafc885629 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:27.968530 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-7c309b71-e41f-449b-96ea-5e95db025bbf admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=58b67f1a1dfc46d984d118c0c959892f&name=default HTTP/1.1" status: 200 len: 2996 time: 1.3453674 Nov 09 04:28:27.985808 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52316) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:27.994700 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c309b71-e41f-449b-96ea-5e95db025bbf admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=47a80ac4-f8ab-4106-adcc-ea798d904716,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:28.033423 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-96153279-374e-4871-9bd1-29e27a166522 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:28.050290 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port af24097e-ae0a-4d62-aacd-2c2738983c34 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:28:28.050667 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:28.084130 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:28.112933 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b8560056-d10d-4681-b636-6c25db4748d3 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Made reservation on behalf of 20a65be85603415da5c8f9fb587db6d6 for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:28:28.116807 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b8560056-d10d-4681-b636-6c25db4748d3 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:28.174020 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b8726645-b237-410e-a92e-99f16d9611e3 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:28.174020 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-88ea5811-8469-448f-a93b-4a24cd829208 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:28.184394 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-0b7788bc-9fa5-4dea-9e00-daaafc885629 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Allocated IP 172.20.0.10 (25474b0c-53b0-4c3a-8cb0-00a4d7799f33/4e4a617b-3903-4f63-b43d-7b6ec4c3091f/8a71b503-67a9-49f4-ab35-b0fbcc4fdc84) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:28:28.185311 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=0fc8f26d-1642-4025-b21c-de2a4f14043f,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:28.202813 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-3e96f0d5-0f34-4db3-8112-efc521fd4904 admin admin] Allocated IP 172.20.0.1 (468b2f91-119a-402c-b695-5d7963ec6348/a3d93294-0484-46fa-b8a6-204ec86c9c5f/6e983a96-52c7-4df1-885b-dc7cdba4b08e) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:28:28.230184 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-88ea5811-8469-448f-a93b-4a24cd829208 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:28.231832 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b8560056-d10d-4681-b636-6c25db4748d3 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 306} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:28:28.257733 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e7d631b1-6505-441f-94f5-10e666dfb0fa tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Made reservation on behalf of 00757dadf44e4dd1a48e6e44b03816b0 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:28:28.261295 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e7d631b1-6505-441f-94f5-10e666dfb0fa tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:28.264773 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-96153279-374e-4871-9bd1-29e27a166522 None None] Routers {'23955a4a-3903-49e9-ab99-5e003c83c868'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:28:28.265464 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-96153279-374e-4871-9bd1-29e27a166522 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:28:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['23955a4a-3903-49e9-ab99-5e003c83c868'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:28:28.288089 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b8560056-d10d-4681-b636-6c25db4748d3 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:28.288375 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-b8560056-d10d-4681-b636-6c25db4748d3 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Added segment f775d02c-c2ee-440b-9e2c-2d4ca912affd of type vlan for network b975b0e1-d535-44d9-9216-4bfeb83030d6 Nov 09 04:28:28.341524 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e8b9513-50ea-47f2-be5d-455edfa9a623 None None] Pushing event updated for resources: {'Port': ['ID=a31e46ce-e371-4177-a2d5-f9a3681f192b,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:28.364177 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b8726645-b237-410e-a92e-99f16d9611e3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:28.376719 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0b7788bc-9fa5-4dea-9e00-daaafc885629 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:28.398164 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3e96f0d5-0f34-4db3-8112-efc521fd4904 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:28.405093 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-96153279-374e-4871-9bd1-29e27a166522 None None] Set router 23955a4a-3903-49e9-ab99-5e003c83c868 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:28:28.467236 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b8560056-d10d-4681-b636-6c25db4748d3 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:28.506562 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52326) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:28.547993 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3e96f0d5-0f34-4db3-8112-efc521fd4904 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:28.563278 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b8726645-b237-410e-a92e-99f16d9611e3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:28.564971 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8726645-b237-410e-a92e-99f16d9611e3 admin admin] Pushing event updated for resources: {'Port': ['ID=76f630f8-c464-46b2-b3b3-6a4c815cc2cf,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:28.586092 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0b7788bc-9fa5-4dea-9e00-daaafc885629 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:28.606666 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3e96f0d5-0f34-4db3-8112-efc521fd4904 admin admin] Network 468b2f91-119a-402c-b695-5d7963ec6348 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:28:28.614639 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-3e96f0d5-0f34-4db3-8112-efc521fd4904 admin admin] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:28:28.620144 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e96f0d5-0f34-4db3-8112-efc521fd4904 admin admin] Pushing event updated for resources: {'Port': ['ID=6e983a96-52c7-4df1-885b-dc7cdba4b08e,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:28.622938 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3e96f0d5-0f34-4db3-8112-efc521fd4904 admin admin] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:28:28.623494 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3e96f0d5-0f34-4db3-8112-efc521fd4904 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:28.624297 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-88ea5811-8469-448f-a93b-4a24cd829208 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:28.626942 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-88ea5811-8469-448f-a93b-4a24cd829208 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:28.627591 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0b7788bc-9fa5-4dea-9e00-daaafc885629 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Network 25474b0c-53b0-4c3a-8cb0-00a4d7799f33 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:28:28.630933 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-88ea5811-8469-448f-a93b-4a24cd829208 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/47a80ac4-f8ab-4106-adcc-ea798d904716 HTTP/1.1" status: 204 len: 168 time: 0.6441181 Nov 09 04:28:28.688584 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-0b7788bc-9fa5-4dea-9e00-daaafc885629 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:28:28.689469 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-96153279-374e-4871-9bd1-29e27a166522 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '23955a4a-3903-49e9-ab99-5e003c83c868', 'name': 'tempest-ServersTestManualDisk-509590275-router', 'tenant_id': '5f3cd2a3586e46c09f847681f744075c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.66'}], 'enable_snat': True}, 'gw_port_id': 'a31e46ce-e371-4177-a2d5-f9a3681f192b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:28:17Z', 'updated_at': '2021-11-09T04:28:22Z', 'revision_number': 3, 'project_id': '5f3cd2a3586e46c09f847681f744075c', 'gw_port': {'id': 'a31e46ce-e371-4177-a2d5-f9a3681f192b', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:d3:1e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '23955a4a-3903-49e9-ab99-5e003c83c868', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:28:19Z', 'updated_at': '2021-11-09T04:28:27Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:28:28.700396 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b8560056-d10d-4681-b636-6c25db4748d3 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:28.713349 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b8560056-d10d-4681-b636-6c25db4748d3 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:28.714161 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b8560056-d10d-4681-b636-6c25db4748d3 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:28.719586 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-90f44a2b-15f1-4923-98b0-bbea4b42cec8 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Request body: {'network': {'name': 'tempest-AllowedAddressPairIpV6TestJSON-test-network-1005723141'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:28.731062 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0b7788bc-9fa5-4dea-9e00-daaafc885629 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:28:28.733097 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-96153279-374e-4871-9bd1-29e27a166522 None None] The sync data for ids ['23955a4a-3903-49e9-ab99-5e003c83c868'] in dv-neutron-816802-2-hyperv is: [{'id': '23955a4a-3903-49e9-ab99-5e003c83c868', 'name': 'tempest-ServersTestManualDisk-509590275-router', 'tenant_id': '5f3cd2a3586e46c09f847681f744075c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.66'}], 'enable_snat': True}, 'gw_port_id': 'a31e46ce-e371-4177-a2d5-f9a3681f192b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:28:17Z', 'updated_at': '2021-11-09T04:28:22Z', 'revision_number': 3, 'project_id': '5f3cd2a3586e46c09f847681f744075c', 'gw_port': {'id': 'a31e46ce-e371-4177-a2d5-f9a3681f192b', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:d3:1e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '23955a4a-3903-49e9-ab99-5e003c83c868', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:28:19Z', 'updated_at': '2021-11-09T04:28:27Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:28:28.741461 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88ea5811-8469-448f-a93b-4a24cd829208 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=47a80ac4-f8ab-4106-adcc-ea798d904716,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:28.762401 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] device_id is not set on port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 yet. {{(pid=102161) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:28:28.854731 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:28.864388 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b7788bc-9fa5-4dea-9e00-daaafc885629 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Pushing event updated for resources: {'Port': ['ID=8a71b503-67a9-49f4-ab35-b0fbcc4fdc84,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:28.940571 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 0fc8f26d-1642-4025-b21c-de2a4f14043f up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:28:28.986446 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-90f44a2b-15f1-4923-98b0-bbea4b42cec8 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Made reservation on behalf of 18f5ee1caa74420f9ab67cc92c1e02e6 for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:28:28.990466 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-90f44a2b-15f1-4923-98b0-bbea4b42cec8 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:29.004899 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:29.006826 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-90f44a2b-15f1-4923-98b0-bbea4b42cec8 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:29.012372 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-ede4ef4d-64e9-4664-964d-974bf059a617 None None] Provisioning complete for port 6e983a96-52c7-4df1-885b-dc7cdba4b08e triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:28:29.012782 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ede4ef4d-64e9-4664-964d-974bf059a617 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:29.014800 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 0fc8f26d-1642-4025-b21c-de2a4f14043f triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:28:29.015157 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:29.022775 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0b7788bc-9fa5-4dea-9e00-daaafc885629 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks [] for floatingip, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:29.061907 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8560056-d10d-4681-b636-6c25db4748d3 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Pushing event updated for resources: {'Network': ['ID=b975b0e1-d535-44d9-9216-4bfeb83030d6,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:29.090954 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network b975b0e1-d535-44d9-9216-4bfeb83030d6 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:28:29.099286 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-b8560056-d10d-4681-b636-6c25db4748d3 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 794 time: 1.2055788 Nov 09 04:28:29.108265 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52332) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:29.161544 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-ede4ef4d-64e9-4664-964d-974bf059a617 None None] Port 6e983a96-52c7-4df1-885b-dc7cdba4b08e cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:28:29.201684 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b8726645-b237-410e-a92e-99f16d9611e3 admin admin] Network d4ba3288-221c-40f3-a829-662c462cc93f is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:28:29.212846 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3e96f0d5-0f34-4db3-8112-efc521fd4904 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:29.222467 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Pushing event updated for resources: {'Port': ['ID=24682efc-26e9-4be8-80d7-b4fa99ec4b58,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:29.240945 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-b8726645-b237-410e-a92e-99f16d9611e3 admin admin] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:28:29.265787 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e7d631b1-6505-441f-94f5-10e666dfb0fa tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:29.538262 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0b7788bc-9fa5-4dea-9e00-daaafc885629 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:29.571765 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-f8e4ef81-e175-456e-a866-753de2078180 tempest-DHCPAgentSchedulersTestJSON-198564031 tempest-DHCPAgentSchedulersTestJSON-198564031-project-admin] 10.222.0.24 "GET /v2.0/agents/cb24b282-9b2c-4486-bad1-b98e0db75839/dhcp-networks HTTP/1.1" status: 200 len: 6422 time: 0.4527197 Nov 09 04:28:29.577161 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52336) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:29.588004 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-d8a2491b-d74e-4d77-9261-ab767e0cb85c None None] Provisioning complete for port 76f630f8-c464-46b2-b3b3-6a4c815cc2cf triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:28:29.588368 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d8a2491b-d74e-4d77-9261-ab767e0cb85c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:29.588556 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7d631b1-6505-441f-94f5-10e666dfb0fa tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Pushing event updated for resources: {'Subnet': ['ID=84708fd2-e56f-45d8-a028-d5c7839aba25,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:29.591145 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:28:29.591529 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] {{(pid=102161) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:28:29.595566 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 on network 6005ba78-d658-44f4-bad3-93b8496ee6db {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:28:29.597745 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-90f44a2b-15f1-4923-98b0-bbea4b42cec8 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:29.607992 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3e96f0d5-0f34-4db3-8112-efc521fd4904 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:29.648009 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 on network 6005ba78-d658-44f4-bad3-93b8496ee6db not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:28:29.648376 dv-neutron-816802-2-hyperv neutron-server[102161]: ERROR neutron.plugins.ml2.managers [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Failed to bind port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] Nov 09 04:28:29.653534 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.plugins.ml2.plugin [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempt 2 to bind port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 Nov 09 04:28:29.654818 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-d8a2491b-d74e-4d77-9261-ab767e0cb85c None None] Port 76f630f8-c464-46b2-b3b3-6a4c815cc2cf cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:28:29.690995 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-90f44a2b-15f1-4923-98b0-bbea4b42cec8 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:29.728576 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3e96f0d5-0f34-4db3-8112-efc521fd4904 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:29.728576 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3e96f0d5-0f34-4db3-8112-efc521fd4904 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:29.735449 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-90f44a2b-15f1-4923-98b0-bbea4b42cec8 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 335} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:28:29.791298 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90f44a2b-15f1-4923-98b0-bbea4b42cec8 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Pushing event updated for resources: {'SecurityGroup': ['ID=cc8884ac-0be5-4835-984c-0b550268bd22,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:29.810197 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-90f44a2b-15f1-4923-98b0-bbea4b42cec8 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:29.810197 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-90f44a2b-15f1-4923-98b0-bbea4b42cec8 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Added segment 612a778a-22e6-45ba-8f8f-f3d4d6a26a8a of type vlan for network daccf5f5-3ea8-4f1b-ab62-78949d47bb91 Nov 09 04:28:29.822548 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52338) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:29.881350 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7d631b1-6505-441f-94f5-10e666dfb0fa tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Checking segment: {'id': '9bba1879-429a-4e85-9da5-469e1c46a5ba', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 327, 'network_id': 'b103fb67-62b2-4eeb-9e21-70ef83ccb4b2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:28:29.881919 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e7d631b1-6505-441f-94f5-10e666dfb0fa tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Network hostable DHCP agents. Network: b103fb67-62b2-4eeb-9e21-70ef83ccb4b2, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:28:29.893922 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e96f0d5-0f34-4db3-8112-efc521fd4904 admin admin] Pushing event updated for resources: {'Port': ['ID=6e983a96-52c7-4df1-885b-dc7cdba4b08e,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:29.905524 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0b7788bc-9fa5-4dea-9e00-daaafc885629 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:29.909039 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:28:29.909369 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] {{(pid=102161) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:28:29.909980 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 on network 6005ba78-d658-44f4-bad3-93b8496ee6db {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:28:29.924044 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 on network 6005ba78-d658-44f4-bad3-93b8496ee6db not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:28:29.924378 dv-neutron-816802-2-hyperv neutron-server[102161]: ERROR neutron.plugins.ml2.managers [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Failed to bind port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] Nov 09 04:28:29.951088 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-90f44a2b-15f1-4923-98b0-bbea4b42cec8 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:29.951739 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.plugins.ml2.plugin [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempt 3 to bind port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 Nov 09 04:28:29.975947 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b8726645-b237-410e-a92e-99f16d9611e3 admin admin] Router c9d2cce0-31ab-42c3-ac82-14e36499c28f has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:28:29.978154 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:28:29.978820 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] {{(pid=102161) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:28:29.979139 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 on network 6005ba78-d658-44f4-bad3-93b8496ee6db {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:28:29.985682 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0b7788bc-9fa5-4dea-9e00-daaafc885629 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:29.997662 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 on network 6005ba78-d658-44f4-bad3-93b8496ee6db not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:28:29.998047 dv-neutron-816802-2-hyperv neutron-server[102161]: ERROR neutron.plugins.ml2.managers [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Failed to bind port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] Nov 09 04:28:30.000536 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.plugins.ml2.plugin [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempt 4 to bind port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 Nov 09 04:28:30.016668 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-52ac286f-19b9-4df2-8fe1-5834fe21bf01 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=1ea0115115a7470e94c6ed83ff0f1ad7&name=default HTTP/1.1" status: 200 len: 2992 time: 0.1845315 Nov 09 04:28:30.016849 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d12da5db-a14a-4e17-a9a1-6ca2e030fe27 tempest-DHCPAgentSchedulersTestJSON-198564031 tempest-DHCPAgentSchedulersTestJSON-198564031-project-admin] Network b975b0e1-d535-44d9-9216-4bfeb83030d6 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:28:30.019421 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52340) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:30.023167 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e7d631b1-6505-441f-94f5-10e666dfb0fa tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Network b103fb67-62b2-4eeb-9e21-70ef83ccb4b2 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:28:30.041556 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0b7788bc-9fa5-4dea-9e00-daaafc885629 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:30.070801 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3e96f0d5-0f34-4db3-8112-efc521fd4904 admin admin] Network 468b2f91-119a-402c-b695-5d7963ec6348 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:28:30.072545 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b7788bc-9fa5-4dea-9e00-daaafc885629 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Pushing event updated for resources: {'Port': ['ID=8a71b503-67a9-49f4-ab35-b0fbcc4fdc84,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:30.076179 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:28:30.076441 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] {{(pid=102161) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:28:30.076551 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-3e96f0d5-0f34-4db3-8112-efc521fd4904 admin admin] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:28:30.076776 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 on network 6005ba78-d658-44f4-bad3-93b8496ee6db {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:28:30.088488 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-e7d631b1-6505-441f-94f5-10e666dfb0fa tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, b103fb67-62b2-4eeb-9e21-70ef83ccb4b2) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:28:30.097681 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-d12da5db-a14a-4e17-a9a1-6ca2e030fe27 tempest-DHCPAgentSchedulersTestJSON-198564031 tempest-DHCPAgentSchedulersTestJSON-198564031-project-admin] 10.222.0.24 "POST /v2.0/agents/cb24b282-9b2c-4486-bad1-b98e0db75839/dhcp-networks HTTP/1.1" status: 201 len: 201 time: 0.5110066 Nov 09 04:28:30.107748 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4b56f9ac-a9b5-4515-94ba-2553b809c4ab None None] Network b975b0e1-d535-44d9-9216-4bfeb83030d6 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:28:30.108274 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52342) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:30.122482 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e7d631b1-6505-441f-94f5-10e666dfb0fa tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:30.123080 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e7d631b1-6505-441f-94f5-10e666dfb0fa tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:30.125374 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 on network 6005ba78-d658-44f4-bad3-93b8496ee6db not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:28:30.125678 dv-neutron-816802-2-hyperv neutron-server[102161]: ERROR neutron.plugins.ml2.managers [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Failed to bind port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] Nov 09 04:28:30.130073 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.plugins.ml2.plugin [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempt 5 to bind port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 Nov 09 04:28:30.131573 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f6319cef-ebcc-4ed7-a2f7-5a2958c0e704 None None] Network b103fb67-62b2-4eeb-9e21-70ef83ccb4b2 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:28:30.134788 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-90f44a2b-15f1-4923-98b0-bbea4b42cec8 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:30.141082 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-90f44a2b-15f1-4923-98b0-bbea4b42cec8 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:30.143726 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-90f44a2b-15f1-4923-98b0-bbea4b42cec8 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:30.162632 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0b7788bc-9fa5-4dea-9e00-daaafc885629 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:30.164016 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-0b7788bc-9fa5-4dea-9e00-daaafc885629 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] 10.222.0.24 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 3.0363224 Nov 09 04:28:30.172934 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52344) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:30.218481 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:28:30.218822 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] {{(pid=102161) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:28:30.219157 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 on network 6005ba78-d658-44f4-bad3-93b8496ee6db {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:28:30.243899 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 on network 6005ba78-d658-44f4-bad3-93b8496ee6db not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:28:30.244408 dv-neutron-816802-2-hyperv neutron-server[102161]: ERROR neutron.plugins.ml2.managers [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Failed to bind port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] Nov 09 04:28:30.279252 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.plugins.ml2.plugin [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempt 6 to bind port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 Nov 09 04:28:30.282615 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b8726645-b237-410e-a92e-99f16d9611e3 admin admin] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:28:30.297510 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6eb59a56-d3a3-4815-9096-ac993cb6912e None None] Sync routers for ids ['c9d2cce0-31ab-42c3-ac82-14e36499c28f'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:28:30.319325 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-b8726645-b237-410e-a92e-99f16d9611e3 admin admin] 10.222.0.24 "PUT /v2.0/routers/c9d2cce0-31ab-42c3-ac82-14e36499c28f/add_router_interface HTTP/1.1" status: 200 len: 503 time: 7.4621305 Nov 09 04:28:30.321018 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6eb59a56-d3a3-4815-9096-ac993cb6912e None None] Routers {'c9d2cce0-31ab-42c3-ac82-14e36499c28f'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:28:30.324732 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-6eb59a56-d3a3-4815-9096-ac993cb6912e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:28:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['c9d2cce0-31ab-42c3-ac82-14e36499c28f'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:28:30.338635 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-e7d631b1-6505-441f-94f5-10e666dfb0fa tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.5804439 Nov 09 04:28:30.339263 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52348) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:30.354439 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-3c62ba12-512b-4dde-bb52-b932b19eb762 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Request body: {'router': {'name': 'tempest-FloatingIPAdminTestJSON-router-56854497', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}, 'admin_state_up': False}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:30.360473 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dcda0a22-8358-41d7-84ae-3668c97e7e68 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:30.409693 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-90f44a2b-15f1-4923-98b0-bbea4b42cec8 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 798 time: 1.9016814 Nov 09 04:28:30.432590 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-3d05e0e2-ea96-44db-8341-ec0cbe668c27 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] 10.222.0.24 "GET /v2.0/floatingips?floating_network_id=25474b0c-53b0-4c3a-8cb0-00a4d7799f33 HTTP/1.1" status: 200 len: 690 time: 0.2134502 Nov 09 04:28:30.435149 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52350) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:30.435480 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52352) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:30.458218 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-f3fc38b5-3310-490c-86ef-d8bfa9a0c44a tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Request body: {'subnet': {'network_id': 'daccf5f5-3ea8-4f1b-ab62-78949d47bb91', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:30.465009 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eee5bd77-c743-44e6-9429-16c7a57f58a2 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-b103fb67-62b2-4eeb-9e21-70ef83ccb4b2', 'network_id': 'b103fb67-62b2-4eeb-9e21-70ef83ccb4b2', 'tenant_id': '00757dadf44e4dd1a48e6e44b03816b0', 'fixed_ips': [{'subnet_id': '84708fd2-e56f-45d8-a028-d5c7839aba25'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:28:30.466978 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-eee5bd77-c743-44e6-9429-16c7a57f58a2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:30.467087 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:28:30.467359 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] {{(pid=102161) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:28:30.467863 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 on network 6005ba78-d658-44f4-bad3-93b8496ee6db {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:28:30.496078 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dcda0a22-8358-41d7-84ae-3668c97e7e68 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:30.498819 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90f44a2b-15f1-4923-98b0-bbea4b42cec8 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Pushing event updated for resources: {'Network': ['ID=daccf5f5-3ea8-4f1b-ab62-78949d47bb91,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:30.506960 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-c7cd0b83-93c7-4311-a714-25c8967c44e3 tempest-DHCPAgentSchedulersTestJSON-198564031 tempest-DHCPAgentSchedulersTestJSON-198564031-project-admin] 10.222.0.24 "GET /v2.0/agents/cb24b282-9b2c-4486-bad1-b98e0db75839/dhcp-networks HTTP/1.1" status: 200 len: 7995 time: 0.3958707 Nov 09 04:28:30.507663 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 on network 6005ba78-d658-44f4-bad3-93b8496ee6db not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:28:30.508160 dv-neutron-816802-2-hyperv neutron-server[102161]: ERROR neutron.plugins.ml2.managers [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Failed to bind port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] Nov 09 04:28:30.512584 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.plugins.ml2.plugin [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempt 7 to bind port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 Nov 09 04:28:30.518470 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52356) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:30.525606 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network daccf5f5-3ea8-4f1b-ab62-78949d47bb91 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:28:30.547497 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-6eb59a56-d3a3-4815-9096-ac993cb6912e None None] Set router c9d2cce0-31ab-42c3-ac82-14e36499c28f gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:28:30.569425 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:28:30.569759 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] {{(pid=102161) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:28:30.570091 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 on network 6005ba78-d658-44f4-bad3-93b8496ee6db {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:28:30.580195 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 on network 6005ba78-d658-44f4-bad3-93b8496ee6db not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:28:30.580555 dv-neutron-816802-2-hyperv neutron-server[102161]: ERROR neutron.plugins.ml2.managers [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Failed to bind port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] Nov 09 04:28:30.601510 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.plugins.ml2.plugin [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempt 8 to bind port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 Nov 09 04:28:30.635014 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3c62ba12-512b-4dde-bb52-b932b19eb762 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:30.636574 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3c62ba12-512b-4dde-bb52-b932b19eb762 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:30.648902 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:28:30.649236 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] {{(pid=102161) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:28:30.649578 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 on network 6005ba78-d658-44f4-bad3-93b8496ee6db {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:28:30.658701 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 on network 6005ba78-d658-44f4-bad3-93b8496ee6db not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:28:30.659013 dv-neutron-816802-2-hyperv neutron-server[102161]: ERROR neutron.plugins.ml2.managers [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Failed to bind port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] Nov 09 04:28:30.659401 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.plugins.ml2.plugin [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempt 9 to bind port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 Nov 09 04:28:30.672524 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:28:30.672852 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] {{(pid=102161) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:28:30.673190 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 on network 6005ba78-d658-44f4-bad3-93b8496ee6db {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:28:30.677741 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 on network 6005ba78-d658-44f4-bad3-93b8496ee6db not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:28:30.678114 dv-neutron-816802-2-hyperv neutron-server[102161]: ERROR neutron.plugins.ml2.managers [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Failed to bind port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] Nov 09 04:28:30.678533 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.plugins.ml2.plugin [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempt 10 to bind port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 Nov 09 04:28:30.694275 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:28:30.694646 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] {{(pid=102161) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:28:30.695025 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 on network 6005ba78-d658-44f4-bad3-93b8496ee6db {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:28:30.701741 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 on network 6005ba78-d658-44f4-bad3-93b8496ee6db not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:28:30.702067 dv-neutron-816802-2-hyperv neutron-server[102161]: ERROR neutron.plugins.ml2.managers [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Failed to bind port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] Nov 09 04:28:30.702527 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:30.707690 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-eee5bd77-c743-44e6-9429-16c7a57f58a2 None None] Allocated IP 172.20.0.2 (b103fb67-62b2-4eeb-9e21-70ef83ccb4b2/84708fd2-e56f-45d8-a028-d5c7839aba25/b5d65479-c9b1-4f1e-b764-d1921b06d257) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:28:30.748668 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3e96f0d5-0f34-4db3-8112-efc521fd4904 admin admin] Router 23955a4a-3903-49e9-ab99-5e003c83c868 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:28:30.749995 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-119ae2da-39a7-413f-b164-6a129d93eb2a tempest-DHCPAgentSchedulersTestJSON-198564031 tempest-DHCPAgentSchedulersTestJSON-198564031-project-admin] 10.222.0.24 "DELETE /v2.0/agents/cb24b282-9b2c-4486-bad1-b98e0db75839/dhcp-networks/b975b0e1-d535-44d9-9216-4bfeb83030d6 HTTP/1.1" status: 204 len: 168 time: 0.2283161 Nov 09 04:28:30.756186 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52366) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:30.778583 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dcda0a22-8358-41d7-84ae-3668c97e7e68 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:30.781154 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dcda0a22-8358-41d7-84ae-3668c97e7e68 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:30.782929 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-dcda0a22-8358-41d7-84ae-3668c97e7e68 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/aad0a929-bb0e-42e1-ac6f-a28d0b4d5fdf HTTP/1.1" status: 204 len: 168 time: 0.7606900 Nov 09 04:28:30.835030 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcda0a22-8358-41d7-84ae-3668c97e7e68 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=aad0a929-bb0e-42e1-ac6f-a28d0b4d5fdf,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:30.859903 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] For port 24682efc-26e9-4be8-80d7-b4fa99ec4b58, host hv-neutron-8168, cleared binding levels {{(pid=102161) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:28:30.860646 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempted to set empty binding levels {{(pid=102161) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:65}} Nov 09 04:28:30.868410 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-9d4af337-f39b-450b-bca6-666c70045943 None None] Provisioning complete for port 6e983a96-52c7-4df1-885b-dc7cdba4b08e triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:28:30.870554 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9d4af337-f39b-450b-bca6-666c70045943 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:30.955199 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:30.981322 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3c62ba12-512b-4dde-bb52-b932b19eb762 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:31.008551 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device a31e46ce-e371-4177-a2d5-f9a3681f192b up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:28:31.009635 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] In _notify_port_updated(), no bound segment for port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 on network 6005ba78-d658-44f4-bad3-93b8496ee6db {{(pid=102161) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 09 04:28:31.010852 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:31.011614 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:31.013105 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] 10.222.0.24 "PUT /v2.0/ports/24682efc-26e9-4be8-80d7-b4fa99ec4b58 HTTP/1.1" status: 200 len: 975 time: 3.0874298 Nov 09 04:28:31.018349 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52372) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:31.030908 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-6eb59a56-d3a3-4815-9096-ac993cb6912e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c9d2cce0-31ab-42c3-ac82-14e36499c28f', 'name': 'tempest-ServersTestJSON-828046534-router', 'tenant_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.163'}], 'enable_snat': True}, 'gw_port_id': '0fc8f26d-1642-4025-b21c-de2a4f14043f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:28:17Z', 'updated_at': '2021-11-09T04:28:27Z', 'revision_number': 4, 'project_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'gw_port': {'id': '0fc8f26d-1642-4025-b21c-de2a4f14043f', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:c5:bb:ba', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c9d2cce0-31ab-42c3-ac82-14e36499c28f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.163', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:28:18Z', 'updated_at': '2021-11-09T04:28:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '76f630f8-c464-46b2-b3b3-6a4c815cc2cf', 'name': '', 'network_id': 'd4ba3288-221c-40f3-a829-662c462cc93f', 'tenant_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'mac_address': 'fa:16:3e:71:0f:73', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c9d2cce0-31ab-42c3-ac82-14e36499c28f', 'device_owner': 'network:router_interface', 'standard_attr_id': 107, 'fixed_ips': [{'subnet_id': 'b11be6b4-75f0-4756-9312-de5295f24e1b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:28:25Z', 'updated_at': '2021-11-09T04:28:27Z', 'revision_number': 2, 'project_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'subnets': [{'id': 'b11be6b4-75f0-4756-9312-de5295f24e1b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:28:31.061081 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6eb59a56-d3a3-4815-9096-ac993cb6912e None None] Checking router: c9d2cce0-31ab-42c3-ac82-14e36499c28f for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:28:31.061442 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6eb59a56-d3a3-4815-9096-ac993cb6912e None None] Updating router c9d2cce0-31ab-42c3-ac82-14e36499c28f port 76f630f8-c464-46b2-b3b3-6a4c815cc2cf binding host dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 04:28:31.085884 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-9d4af337-f39b-450b-bca6-666c70045943 None None] Port 6e983a96-52c7-4df1-885b-dc7cdba4b08e cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:28:31.097701 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-6eb59a56-d3a3-4815-9096-ac993cb6912e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:31.245963 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79aceea2-669c-4eab-a4a3-05b3ce2144d2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Pushing event updated for resources: {'Port': ['ID=24682efc-26e9-4be8-80d7-b4fa99ec4b58,revision_number=3']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:31.259582 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3e96f0d5-0f34-4db3-8112-efc521fd4904 admin admin] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:28:31.275554 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-3e96f0d5-0f34-4db3-8112-efc521fd4904 admin admin] 10.222.0.24 "PUT /v2.0/routers/23955a4a-3903-49e9-ab99-5e003c83c868/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.7911534 Nov 09 04:28:31.291447 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a12032a9-67b4-46af-90a9-7caac35e4637 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:31.369867 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3c62ba12-512b-4dde-bb52-b932b19eb762 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:31.392972 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-09ba3244-8049-43c4-acd0-f60cb8ec4ff4 None None] Sync routers for ids ['23955a4a-3903-49e9-ab99-5e003c83c868'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:28:31.415079 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f9be7380-69fe-49e1-bad7-5e7f546bf5e2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:31.416244 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f9be7380-69fe-49e1-bad7-5e7f546bf5e2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:31.416719 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f9be7380-69fe-49e1-bad7-5e7f546bf5e2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:31.417596 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f9be7380-69fe-49e1-bad7-5e7f546bf5e2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:31.418066 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f9be7380-69fe-49e1-bad7-5e7f546bf5e2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:31.419197 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f9be7380-69fe-49e1-bad7-5e7f546bf5e2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:31.419938 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f9be7380-69fe-49e1-bad7-5e7f546bf5e2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:31.420409 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f9be7380-69fe-49e1-bad7-5e7f546bf5e2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:31.420924 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f9be7380-69fe-49e1-bad7-5e7f546bf5e2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:31.421381 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f9be7380-69fe-49e1-bad7-5e7f546bf5e2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:31.422188 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f9be7380-69fe-49e1-bad7-5e7f546bf5e2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:31.422679 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f9be7380-69fe-49e1-bad7-5e7f546bf5e2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:31.423343 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f9be7380-69fe-49e1-bad7-5e7f546bf5e2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:31.423917 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f9be7380-69fe-49e1-bad7-5e7f546bf5e2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:31.426592 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-f9be7380-69fe-49e1-bad7-5e7f546bf5e2 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] 10.222.0.24 "GET /v2.0/ports HTTP/1.1" status: 200 len: 12579 time: 0.4051893 Nov 09 04:28:31.439313 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-3662a34f-bd17-444c-b755-f4ad7d69ccfa tempest-DHCPAgentSchedulersTestJSON-198564031 tempest-DHCPAgentSchedulersTestJSON-198564031-project-admin] 10.222.0.24 "GET /v2.0/agents/cb24b282-9b2c-4486-bad1-b98e0db75839/dhcp-networks HTTP/1.1" status: 200 len: 7226 time: 0.6814468 Nov 09 04:28:31.439313 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52378) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:31.447327 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52380) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:31.450159 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f3fc38b5-3310-490c-86ef-d8bfa9a0c44a tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Made reservation on behalf of 18f5ee1caa74420f9ab67cc92c1e02e6 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:28:31.465053 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f3fc38b5-3310-490c-86ef-d8bfa9a0c44a tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks [] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:31.469220 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-09ba3244-8049-43c4-acd0-f60cb8ec4ff4 None None] Routers {'23955a4a-3903-49e9-ab99-5e003c83c868'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:28:31.475180 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-09ba3244-8049-43c4-acd0-f60cb8ec4ff4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:28:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['23955a4a-3903-49e9-ab99-5e003c83c868'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:28:31.540189 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-2cb866d5-d62a-4b42-95e1-c2ecc8d0f755 tempest-DHCPAgentSchedulersTestJSON-198564031 tempest-DHCPAgentSchedulersTestJSON-198564031-project-admin] 10.222.0.24 "GET /v2.0/networks/79bc3055-9536-43a1-b62c-3eb406e9f982/dhcp-agents HTTP/1.1" status: 200 len: 808 time: 0.0887210 Nov 09 04:28:31.546121 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52390) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:31.635367 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-610aad4b-6ec9-4a91-bbcf-95ffa821d3d9 tempest-DHCPAgentSchedulersTestJSON-198564031 tempest-DHCPAgentSchedulersTestJSON-198564031-project-admin] 10.222.0.24 "GET /v2.0/networks/79bc3055-9536-43a1-b62c-3eb406e9f982/dhcp-agents HTTP/1.1" status: 200 len: 808 time: 0.0841019 Nov 09 04:28:31.635981 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52394) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:31.772980 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-6eb59a56-d3a3-4815-9096-ac993cb6912e None None] Publish callbacks [] for port, precommit_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:31.799199 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-eee5bd77-c743-44e6-9429-16c7a57f58a2 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:31.808709 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port a31e46ce-e371-4177-a2d5-f9a3681f192b triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:28:31.809101 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:31.831013 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-9c95852c-d607-40f5-91f2-3967c3098ded tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Deleting port 24682efc-26e9-4be8-80d7-b4fa99ec4b58 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:28:31.831685 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9c95852c-d607-40f5-91f2-3967c3098ded tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:31.860461 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-6eb59a56-d3a3-4815-9096-ac993cb6912e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:31.922599 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-eee5bd77-c743-44e6-9429-16c7a57f58a2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:32.034808 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eee5bd77-c743-44e6-9429-16c7a57f58a2 None None] Pushing event updated for resources: {'Port': ['ID=b5d65479-c9b1-4f1e-b764-d1921b06d257,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:32.034941 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-6eb59a56-d3a3-4815-9096-ac993cb6912e None None] Attempting to bind port 76f630f8-c464-46b2-b3b3-6a4c815cc2cf on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:28:32.035305 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-6eb59a56-d3a3-4815-9096-ac993cb6912e None None] Attempting to bind port 76f630f8-c464-46b2-b3b3-6a4c815cc2cf by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '9b34c07b-e9e3-4439-982a-e160009938cf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 348, 'network_id': 'd4ba3288-221c-40f3-a829-662c462cc93f'}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:28:32.036000 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6eb59a56-d3a3-4815-9096-ac993cb6912e None None] Attempting to bind port 76f630f8-c464-46b2-b3b3-6a4c815cc2cf on network d4ba3288-221c-40f3-a829-662c462cc93f {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:28:32.053469 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6eb59a56-d3a3-4815-9096-ac993cb6912e None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 28, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:28:32.053859 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6eb59a56-d3a3-4815-9096-ac993cb6912e None None] Checking segment: {'id': '9b34c07b-e9e3-4439-982a-e160009938cf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 348, 'network_id': 'd4ba3288-221c-40f3-a829-662c462cc93f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102164) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:28:32.061530 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-6eb59a56-d3a3-4815-9096-ac993cb6912e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:32.062024 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6eb59a56-d3a3-4815-9096-ac993cb6912e None None] Bound using segment: {'id': '9b34c07b-e9e3-4439-982a-e160009938cf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 348, 'network_id': 'd4ba3288-221c-40f3-a829-662c462cc93f'} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:28:32.062565 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-6eb59a56-d3a3-4815-9096-ac993cb6912e None None] Bound port: 76f630f8-c464-46b2-b3b3-6a4c815cc2cf, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9b34c07b-e9e3-4439-982a-e160009938cf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 348, 'network_id': 'd4ba3288-221c-40f3-a829-662c462cc93f'}}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:28:32.062971 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-6eb59a56-d3a3-4815-9096-ac993cb6912e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:32.075140 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-09ba3244-8049-43c4-acd0-f60cb8ec4ff4 None None] Set router 23955a4a-3903-49e9-ab99-5e003c83c868 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:28:32.087311 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eee5bd77-c743-44e6-9429-16c7a57f58a2 None None] Network b103fb67-62b2-4eeb-9e21-70ef83ccb4b2 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:28:32.106973 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-77de0c45-3c76-451a-8d42-c8275c4b807f tempest-DHCPAgentSchedulersTestJSON-198564031 tempest-DHCPAgentSchedulersTestJSON-198564031-project-admin] 10.222.0.24 "GET /v2.0/agents/cb24b282-9b2c-4486-bad1-b98e0db75839/dhcp-networks HTTP/1.1" status: 200 len: 7226 time: 0.4676819 Nov 09 04:28:32.109629 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52406) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:32.116971 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-eee5bd77-c743-44e6-9429-16c7a57f58a2 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:28:32.122820 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-9c95852c-d607-40f5-91f2-3967c3098ded tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] For port 24682efc-26e9-4be8-80d7-b4fa99ec4b58, host hv-neutron-8168, got binding levels [] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:28:32.124777 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9c95852c-d607-40f5-91f2-3967c3098ded tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:32.126344 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eee5bd77-c743-44e6-9429-16c7a57f58a2 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:28:32.196270 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-a12032a9-67b4-46af-90a9-7caac35e4637 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Deleting port 8a71b503-67a9-49f4-ab35-b0fbcc4fdc84 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:28:32.196971 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a12032a9-67b4-46af-90a9-7caac35e4637 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:32.199356 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f3fc38b5-3310-490c-86ef-d8bfa9a0c44a tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:32.202568 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-6eb59a56-d3a3-4815-9096-ac993cb6912e None None] For port 76f630f8-c464-46b2-b3b3-6a4c815cc2cf, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102164) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:28:32.207916 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:32.210291 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-6eb59a56-d3a3-4815-9096-ac993cb6912e None None] For port 76f630f8-c464-46b2-b3b3-6a4c815cc2cf, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=76f630f8-c464-46b2-b3b3-6a4c815cc2cf,segment=NetworkSegment(9b34c07b-e9e3-4439-982a-e160009938cf),segment_id=9b34c07b-e9e3-4439-982a-e160009938cf)] {{(pid=102164) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:28:32.220885 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a1b5861-9182-4184-b20d-97a1846da3a0 None None] Pushing event updated for resources: {'Port': ['ID=76f630f8-c464-46b2-b3b3-6a4c815cc2cf,revision_number=3']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:32.255734 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-9c95852c-d607-40f5-91f2-3967c3098ded tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Calling delete_port for 24682efc-26e9-4be8-80d7-b4fa99ec4b58 owned by {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:28:32.311885 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port a31e46ce-e371-4177-a2d5-f9a3681f192b, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=a31e46ce-e371-4177-a2d5-f9a3681f192b,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:28:32.312472 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-6eb59a56-d3a3-4815-9096-ac993cb6912e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:32.358115 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-25a0fac8-8819-4c89-b0a1-7f96562fa5b4 None None] Provisioning complete for port 76f630f8-c464-46b2-b3b3-6a4c815cc2cf triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:28:32.358684 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-25a0fac8-8819-4c89-b0a1-7f96562fa5b4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:32.414345 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a1b5861-9182-4184-b20d-97a1846da3a0 None None] Pushing event updated for resources: {'Port': ['ID=76f630f8-c464-46b2-b3b3-6a4c815cc2cf,revision_number=4']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:32.418683 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:32.457745 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6eb59a56-d3a3-4815-9096-ac993cb6912e None None] Routers {'c9d2cce0-31ab-42c3-ac82-14e36499c28f'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:28:32.458398 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-6eb59a56-d3a3-4815-9096-ac993cb6912e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:28:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['c9d2cce0-31ab-42c3-ac82-14e36499c28f'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:28:32.541478 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=a31e46ce-e371-4177-a2d5-f9a3681f192b,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:32.544961 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-eee5bd77-c743-44e6-9429-16c7a57f58a2 None None] Attempting to bind port b5d65479-c9b1-4f1e-b764-d1921b06d257 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:28:32.545855 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-eee5bd77-c743-44e6-9429-16c7a57f58a2 None None] Attempting to bind port b5d65479-c9b1-4f1e-b764-d1921b06d257 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '9bba1879-429a-4e85-9da5-469e1c46a5ba', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 327, 'network_id': 'b103fb67-62b2-4eeb-9e21-70ef83ccb4b2'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:28:32.547127 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eee5bd77-c743-44e6-9429-16c7a57f58a2 None None] Attempting to bind port b5d65479-c9b1-4f1e-b764-d1921b06d257 on network b103fb67-62b2-4eeb-9e21-70ef83ccb4b2 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:28:32.565867 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eee5bd77-c743-44e6-9429-16c7a57f58a2 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 28, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:28:32.571049 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eee5bd77-c743-44e6-9429-16c7a57f58a2 None None] Checking segment: {'id': '9bba1879-429a-4e85-9da5-469e1c46a5ba', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 327, 'network_id': 'b103fb67-62b2-4eeb-9e21-70ef83ccb4b2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:28:32.571440 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-eee5bd77-c743-44e6-9429-16c7a57f58a2 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:32.571909 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eee5bd77-c743-44e6-9429-16c7a57f58a2 None None] Bound using segment: {'id': '9bba1879-429a-4e85-9da5-469e1c46a5ba', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 327, 'network_id': 'b103fb67-62b2-4eeb-9e21-70ef83ccb4b2'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:28:32.572518 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-eee5bd77-c743-44e6-9429-16c7a57f58a2 None None] Bound port: b5d65479-c9b1-4f1e-b764-d1921b06d257, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9bba1879-429a-4e85-9da5-469e1c46a5ba', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 327, 'network_id': 'b103fb67-62b2-4eeb-9e21-70ef83ccb4b2'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:28:32.574852 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-eee5bd77-c743-44e6-9429-16c7a57f58a2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:32.629709 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52412) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:32.684827 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f3fc38b5-3310-490c-86ef-d8bfa9a0c44a tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Checking segment: {'id': '612a778a-22e6-45ba-8f8f-f3d4d6a26a8a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 335, 'network_id': 'daccf5f5-3ea8-4f1b-ab62-78949d47bb91'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:28:32.685228 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f3fc38b5-3310-490c-86ef-d8bfa9a0c44a tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Network hostable DHCP agents. Network: daccf5f5-3ea8-4f1b-ab62-78949d47bb91, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:28:32.690722 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-25a0fac8-8819-4c89-b0a1-7f96562fa5b4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:32.710494 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-6eb59a56-d3a3-4815-9096-ac993cb6912e None None] Set router c9d2cce0-31ab-42c3-ac82-14e36499c28f gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:28:32.732729 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3fc38b5-3310-490c-86ef-d8bfa9a0c44a tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Pushing event updated for resources: {'Subnet': ['ID=88d0e868-7936-4409-8f96-0f4e98202b5e,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:32.747445 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52416) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:32.780452 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-e88c70d2-e87b-4bc2-b6c3-ab8e8e6d9eae tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Request body: {'security_group': {'name': 'tempest-securitygroup--2143389923', 'description': 'tempest-description--1790437045'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:32.803636 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-eee5bd77-c743-44e6-9429-16c7a57f58a2 None None] For port b5d65479-c9b1-4f1e-b764-d1921b06d257, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:28:32.808673 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-eee5bd77-c743-44e6-9429-16c7a57f58a2 None None] For port b5d65479-c9b1-4f1e-b764-d1921b06d257, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=b5d65479-c9b1-4f1e-b764-d1921b06d257,segment=NetworkSegment(9bba1879-429a-4e85-9da5-469e1c46a5ba),segment_id=9bba1879-429a-4e85-9da5-469e1c46a5ba)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:28:32.862392 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-25a0fac8-8819-4c89-b0a1-7f96562fa5b4 None None] For port 76f630f8-c464-46b2-b3b3-6a4c815cc2cf, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=76f630f8-c464-46b2-b3b3-6a4c815cc2cf,segment=NetworkSegment(9b34c07b-e9e3-4439-982a-e160009938cf),segment_id=9b34c07b-e9e3-4439-982a-e160009938cf)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:28:32.894930 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f3fc38b5-3310-490c-86ef-d8bfa9a0c44a tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Network daccf5f5-3ea8-4f1b-ab62-78949d47bb91 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:28:32.910591 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-ad0ceffe-b2c7-4a93-878a-2fbba8ee8125 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Request body: {'network': {'name': 'tempest-AllowedAddressPairTestJSON-test-network-1790153189'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:32.912389 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-66085f3e-a54d-4d39-abd6-4622fa58ae41 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:32.922673 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a12032a9-67b4-46af-90a9-7caac35e4637 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:32.929082 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a12032a9-67b4-46af-90a9-7caac35e4637 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks [] for floatingip, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:32.929212 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-eee5bd77-c743-44e6-9429-16c7a57f58a2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:32.940511 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-25a0fac8-8819-4c89-b0a1-7f96562fa5b4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:32.949455 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-a12032a9-67b4-46af-90a9-7caac35e4637 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Calling delete_port for 8a71b503-67a9-49f4-ab35-b0fbcc4fdc84 owned by network:floatingip {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:28:32.951376 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device a31e46ce-e371-4177-a2d5-f9a3681f192b up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:28:32.954888 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e88c70d2-e87b-4bc2-b6c3-ab8e8e6d9eae tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:32.999293 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3c62ba12-512b-4dde-bb52-b932b19eb762 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks [] for router_gateway, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:33.025452 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3c62ba12-512b-4dde-bb52-b932b19eb762 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:33.054049 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-f3fc38b5-3310-490c-86ef-d8bfa9a0c44a tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, daccf5f5-3ea8-4f1b-ab62-78949d47bb91) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:28:33.054514 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-6eb59a56-d3a3-4815-9096-ac993cb6912e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c9d2cce0-31ab-42c3-ac82-14e36499c28f', 'name': 'tempest-ServersTestJSON-828046534-router', 'tenant_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.163'}], 'enable_snat': True}, 'gw_port_id': '0fc8f26d-1642-4025-b21c-de2a4f14043f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:28:17Z', 'updated_at': '2021-11-09T04:28:27Z', 'revision_number': 4, 'project_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'gw_port': {'id': '0fc8f26d-1642-4025-b21c-de2a4f14043f', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:c5:bb:ba', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c9d2cce0-31ab-42c3-ac82-14e36499c28f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.163', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:28:18Z', 'updated_at': '2021-11-09T04:28:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '76f630f8-c464-46b2-b3b3-6a4c815cc2cf', 'name': '', 'network_id': 'd4ba3288-221c-40f3-a829-662c462cc93f', 'tenant_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'mac_address': 'fa:16:3e:71:0f:73', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c9d2cce0-31ab-42c3-ac82-14e36499c28f', 'device_owner': 'network:router_interface', 'standard_attr_id': 107, 'fixed_ips': [{'subnet_id': 'b11be6b4-75f0-4756-9312-de5295f24e1b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:28:25Z', 'updated_at': '2021-11-09T04:28:32Z', 'revision_number': 4, 'project_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'subnets': [{'id': 'b11be6b4-75f0-4756-9312-de5295f24e1b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:28:33.079164 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1e8be32d-1d23-4b79-96c7-e5497817be29 None None] Network daccf5f5-3ea8-4f1b-ab62-78949d47bb91 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:28:33.094017 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6eb59a56-d3a3-4815-9096-ac993cb6912e None None] The sync data for ids ['c9d2cce0-31ab-42c3-ac82-14e36499c28f'] in dv-neutron-816802-2-hyperv is: [{'id': 'c9d2cce0-31ab-42c3-ac82-14e36499c28f', 'name': 'tempest-ServersTestJSON-828046534-router', 'tenant_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.163'}], 'enable_snat': True}, 'gw_port_id': '0fc8f26d-1642-4025-b21c-de2a4f14043f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:28:17Z', 'updated_at': '2021-11-09T04:28:27Z', 'revision_number': 4, 'project_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'gw_port': {'id': '0fc8f26d-1642-4025-b21c-de2a4f14043f', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:c5:bb:ba', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c9d2cce0-31ab-42c3-ac82-14e36499c28f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.163', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:28:18Z', 'updated_at': '2021-11-09T04:28:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '76f630f8-c464-46b2-b3b3-6a4c815cc2cf', 'name': '', 'network_id': 'd4ba3288-221c-40f3-a829-662c462cc93f', 'tenant_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'mac_address': 'fa:16:3e:71:0f:73', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c9d2cce0-31ab-42c3-ac82-14e36499c28f', 'device_owner': 'network:router_interface', 'standard_attr_id': 107, 'fixed_ips': [{'subnet_id': 'b11be6b4-75f0-4756-9312-de5295f24e1b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:28:25Z', 'updated_at': '2021-11-09T04:28:32Z', 'revision_number': 4, 'project_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'subnets': [{'id': 'b11be6b4-75f0-4756-9312-de5295f24e1b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:28:33.096916 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f3fc38b5-3310-490c-86ef-d8bfa9a0c44a tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:33.098137 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f3fc38b5-3310-490c-86ef-d8bfa9a0c44a tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:33.101932 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52420) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:33.111656 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9c95852c-d607-40f5-91f2-3967c3098ded tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:33.124328 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-c4d06ad8-ae64-40f1-b99d-6e061711c7ac tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Request body: {'security_group': {'name': 'tempest-securitygroup--714870249', 'description': 'tempest-description--1366259531'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:33.140072 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ad0ceffe-b2c7-4a93-878a-2fbba8ee8125 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Made reservation on behalf of a369b57921894b01a70b43c4f969d224 for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:28:33.145945 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ad0ceffe-b2c7-4a93-878a-2fbba8ee8125 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:33.199882 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-4fba3d3f-db2e-4b2e-976f-8811c0237d03 None None] Provisioning complete for port 76f630f8-c464-46b2-b3b3-6a4c815cc2cf triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:28:33.200397 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4fba3d3f-db2e-4b2e-976f-8811c0237d03 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:33.202971 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port a31e46ce-e371-4177-a2d5-f9a3681f192b triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:28:33.207324 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:33.207467 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ad0ceffe-b2c7-4a93-878a-2fbba8ee8125 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:33.270520 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e88c70d2-e87b-4bc2-b6c3-ab8e8e6d9eae tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:33.308213 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eee5bd77-c743-44e6-9429-16c7a57f58a2 None None] Pushing event updated for resources: {'Port': ['ID=b5d65479-c9b1-4f1e-b764-d1921b06d257,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:33.310602 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c95852c-d607-40f5-91f2-3967c3098ded tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Pushing event deleted for resources: {'Port': ['ID=24682efc-26e9-4be8-80d7-b4fa99ec4b58,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:33.362122 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c4d06ad8-ae64-40f1-b99d-6e061711c7ac tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:33.376753 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e88c70d2-e87b-4bc2-b6c3-ab8e8e6d9eae tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:33.409453 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-09ba3244-8049-43c4-acd0-f60cb8ec4ff4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '23955a4a-3903-49e9-ab99-5e003c83c868', 'name': 'tempest-ServersTestManualDisk-509590275-router', 'tenant_id': '5f3cd2a3586e46c09f847681f744075c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.66'}], 'enable_snat': True}, 'gw_port_id': 'a31e46ce-e371-4177-a2d5-f9a3681f192b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:28:17Z', 'updated_at': '2021-11-09T04:28:28Z', 'revision_number': 4, 'project_id': '5f3cd2a3586e46c09f847681f744075c', 'gw_port': {'id': 'a31e46ce-e371-4177-a2d5-f9a3681f192b', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:d3:1e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '23955a4a-3903-49e9-ab99-5e003c83c868', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:28:19Z', 'updated_at': '2021-11-09T04:28:27Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '6e983a96-52c7-4df1-885b-dc7cdba4b08e', 'name': '', 'network_id': '468b2f91-119a-402c-b695-5d7963ec6348', 'tenant_id': '5f3cd2a3586e46c09f847681f744075c', 'mac_address': 'fa:16:3e:3c:66:6d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '23955a4a-3903-49e9-ab99-5e003c83c868', 'device_owner': 'network:router_interface', 'standard_attr_id': 127, 'fixed_ips': [{'subnet_id': 'a3d93294-0484-46fa-b8a6-204ec86c9c5f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:28:27Z', 'updated_at': '2021-11-09T04:28:29Z', 'revision_number': 2, 'project_id': '5f3cd2a3586e46c09f847681f744075c', 'subnets': [{'id': 'a3d93294-0484-46fa-b8a6-204ec86c9c5f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:28:33.425666 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9c95852c-d607-40f5-91f2-3967c3098ded tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:33.438150 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-9c95852c-d607-40f5-91f2-3967c3098ded tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] 10.222.0.24 "DELETE /v2.0/ports/24682efc-26e9-4be8-80d7-b4fa99ec4b58 HTTP/1.1" status: 204 len: 168 time: 1.9971929 Nov 09 04:28:33.439424 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-f3fc38b5-3310-490c-86ef-d8bfa9a0c44a tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 3.0026958 Nov 09 04:28:33.439894 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52422) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:33.443635 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-66085f3e-a54d-4d39-abd6-4622fa58ae41 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:33.446062 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52424) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:33.457816 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-88332025-86b4-4302-a5ec-afd0254bddd0 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Request body: {'port': {'network_id': 'daccf5f5-3ea8-4f1b-ab62-78949d47bb91', 'name': 'tempest-AllowedAddressPairIpV6TestJSON-343509295'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:33.489241 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-09ba3244-8049-43c4-acd0-f60cb8ec4ff4 None None] Checking router: 23955a4a-3903-49e9-ab99-5e003c83c868 for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:28:33.492465 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-09ba3244-8049-43c4-acd0-f60cb8ec4ff4 None None] Updating router 23955a4a-3903-49e9-ab99-5e003c83c868 port 6e983a96-52c7-4df1-885b-dc7cdba4b08e binding host dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 04:28:33.496272 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e88c70d2-e87b-4bc2-b6c3-ab8e8e6d9eae tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Pushing event updated for resources: {'SecurityGroup': ['ID=67cb2d36-e38c-4a29-adb5-c52b1d94ae99,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:33.502975 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-7a16a4ca-afbe-4442-9e5c-401cd3a50cf1 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] GET failed (client error): The resource could not be found. Nov 09 04:28:33.508009 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-7a16a4ca-afbe-4442-9e5c-401cd3a50cf1 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] 10.222.0.24 "GET /v2.0/ports/24682efc-26e9-4be8-80d7-b4fa99ec4b58 HTTP/1.1" status: 404 len: 333 time: 0.0557940 Nov 09 04:28:33.509564 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52426) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:33.518295 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-25ba3eed-2ca7-4273-9d5e-2ad6239c4ab6 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Request body: {'port': {'name': 'tempest-PortsAdminExtendedAttrsTestJSON-2026611164', 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:33.530263 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e88c70d2-e87b-4bc2-b6c3-ab8e8e6d9eae tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:33.537051 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e88c70d2-e87b-4bc2-b6c3-ab8e8e6d9eae tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1797 time: 0.7804306 Nov 09 04:28:33.537260 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52428) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:33.555362 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-17c9251d-ea4b-483d-aabe-44bf5e3558f5 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Request body: {'security_group_rule': {'security_group_id': '67cb2d36-e38c-4a29-adb5-c52b1d94ae99', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:33.559328 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25a0fac8-8819-4c89-b0a1-7f96562fa5b4 None None] Pushing event updated for resources: {'Port': ['ID=76f630f8-c464-46b2-b3b3-6a4c815cc2cf,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:33.578412 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-09ba3244-8049-43c4-acd0-f60cb8ec4ff4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:33.588515 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ad0ceffe-b2c7-4a93-878a-2fbba8ee8125 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:33.593635 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a12032a9-67b4-46af-90a9-7caac35e4637 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:33.667442 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a12032a9-67b4-46af-90a9-7caac35e4637 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Pushing event deleted for resources: {'Port': ['ID=8a71b503-67a9-49f4-ab35-b0fbcc4fdc84,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:33.681577 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c4d06ad8-ae64-40f1-b99d-6e061711c7ac tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:33.692707 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-66085f3e-a54d-4d39-abd6-4622fa58ae41 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b975b0e1-d535-44d9-9216-4bfeb83030d6']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:28:33.699103 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-19e7d3f6-fb44-4b75-92c9-da1bf703f3b0 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-daccf5f5-3ea8-4f1b-ab62-78949d47bb91', 'network_id': 'daccf5f5-3ea8-4f1b-ab62-78949d47bb91', 'tenant_id': '18f5ee1caa74420f9ab67cc92c1e02e6', 'fixed_ips': [{'subnet_id': '88d0e868-7936-4409-8f96-0f4e98202b5e'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:28:33.699942 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-19e7d3f6-fb44-4b75-92c9-da1bf703f3b0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:33.708710 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-3c62ba12-512b-4dde-bb52-b932b19eb762 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Allocated IP 172.26.0.232 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/a58316d9-1cb1-4878-8a21-f3577322ae07) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:28:33.726403 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ad0ceffe-b2c7-4a93-878a-2fbba8ee8125 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:33.740336 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a12032a9-67b4-46af-90a9-7caac35e4637 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks [] for floatingip, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:33.743563 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-25ba3eed-2ca7-4273-9d5e-2ad6239c4ab6 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Made reservation on behalf of 1f5d2eca16394ba1811d503557bb1504 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:28:33.745921 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-25ba3eed-2ca7-4273-9d5e-2ad6239c4ab6 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:33.748721 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-66085f3e-a54d-4d39-abd6-4622fa58ae41 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f775d02c-c2ee-440b-9e2c-2d4ca912affd') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:28:33.749294 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-66085f3e-a54d-4d39-abd6-4622fa58ae41 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f775d02c-c2ee-440b-9e2c-2d4ca912affd') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:28:33.775768 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c4d06ad8-ae64-40f1-b99d-6e061711c7ac tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:33.782236 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ad0ceffe-b2c7-4a93-878a-2fbba8ee8125 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 316} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:28:33.796308 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-66085f3e-a54d-4d39-abd6-4622fa58ae41 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:33.812286 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad0ceffe-b2c7-4a93-878a-2fbba8ee8125 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Pushing event updated for resources: {'SecurityGroup': ['ID=ea9e9faa-372b-4e4c-afa3-87735bf1d5a7,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:33.818978 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ad0ceffe-b2c7-4a93-878a-2fbba8ee8125 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:33.819385 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-ad0ceffe-b2c7-4a93-878a-2fbba8ee8125 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Added segment 3567d530-a0d1-4a5f-b2b6-e974cb02bf65 of type vlan for network e96f4292-19f0-4446-b093-408610b619f1 Nov 09 04:28:33.821876 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [None req-25ba3eed-2ca7-4273-9d5e-2ad6239c4ab6 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] device_id is not set on port 37ce592d-a83e-4683-8099-5ac92ede675d yet. {{(pid=102162) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:28:33.870600 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-66085f3e-a54d-4d39-abd6-4622fa58ae41 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:33.941750 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-66085f3e-a54d-4d39-abd6-4622fa58ae41 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Releasing vlan 306 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:28:33.942273 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-66085f3e-a54d-4d39-abd6-4622fa58ae41 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:33.948171 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-17c9251d-ea4b-483d-aabe-44bf5e3558f5 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:33.974748 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:28:33.974748 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:28:33.974748 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:28:33.974748 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:28:33.974748 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:28:33.974748 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:28:33.974748 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:28:33.974748 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:28:33.974748 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:28:33.974748 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:28:33.974748 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:28:33.974748 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:28:33.974748 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:28:33.974748 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:28:33.974748 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:28:33.974748 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:28:33.974748 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:28:33.974748 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:28:33.974748 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:28:33.974748 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:28:33.974748 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:28:33.974748 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:28:33.974748 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:28:33.974748 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:28:33.974748 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:28:33.974748 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:28:33.974748 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:28:33.974748 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:28:33.974748 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:28:33.974748 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:28:33.974748 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:28:33.974748 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:28:33.976938 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-19e7d3f6-fb44-4b75-92c9-da1bf703f3b0 None None] Allocated IP 2001:db8::2 (daccf5f5-3ea8-4f1b-ab62-78949d47bb91/88d0e868-7936-4409-8f96-0f4e98202b5e/617022e4-2ac0-4ae0-9a42-43aec6246b64) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:28:33.991362 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c4d06ad8-ae64-40f1-b99d-6e061711c7ac tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:33.997308 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-c4d06ad8-ae64-40f1-b99d-6e061711c7ac tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 0.8898501 Nov 09 04:28:33.999158 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4d06ad8-ae64-40f1-b99d-6e061711c7ac tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Pushing event updated for resources: {'SecurityGroup': ['ID=4b002f37-f4ce-4d8a-a894-560955e72139,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:34.006823 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52430) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:34.012033 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ad0ceffe-b2c7-4a93-878a-2fbba8ee8125 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:34.020685 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-62407bc2-a137-4811-b95d-1f2f1453d75a tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Request body: {'security_group_rule': {'security_group_id': '4b002f37-f4ce-4d8a-a894-560955e72139', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:34.047089 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a12032a9-67b4-46af-90a9-7caac35e4637 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:34.122886 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.db.resource_extend [None req-ad0ceffe-b2c7-4a93-878a-2fbba8ee8125 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] It took 0.11 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 09 04:28:34.155059 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-62407bc2-a137-4811-b95d-1f2f1453d75a tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:34.162455 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-17c9251d-ea4b-483d-aabe-44bf5e3558f5 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:34.190829 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3c62ba12-512b-4dde-bb52-b932b19eb762 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:34.220450 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-66085f3e-a54d-4d39-abd6-4622fa58ae41 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:34.234155 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-66085f3e-a54d-4d39-abd6-4622fa58ae41 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:34.238767 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-66085f3e-a54d-4d39-abd6-4622fa58ae41 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] 10.222.0.24 "DELETE /v2.0/networks/b975b0e1-d535-44d9-9216-4bfeb83030d6 HTTP/1.1" status: 204 len: 168 time: 2.1066689 Nov 09 04:28:34.240784 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52432) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:34.250527 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-62407bc2-a137-4811-b95d-1f2f1453d75a tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:34.280762 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-7d2e0e4f-6545-4e3e-8f43-6482f6213430 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] DELETE failed (client error): The resource could not be found. Nov 09 04:28:34.281508 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-7d2e0e4f-6545-4e3e-8f43-6482f6213430 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:28:34.284048 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ad0ceffe-b2c7-4a93-878a-2fbba8ee8125 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:34.285282 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-7d2e0e4f-6545-4e3e-8f43-6482f6213430 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] 10.222.0.24 "DELETE /v2.0/ports/ff1446eb-11a3-44e6-b704-52f9abc24748 HTTP/1.1" status: 404 len: 333 time: 0.0419116 Nov 09 04:28:34.287331 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-88332025-86b4-4302-a5ec-afd0254bddd0 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Made reservation on behalf of 18f5ee1caa74420f9ab67cc92c1e02e6 for: {'port': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:28:34.292425 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-88332025-86b4-4302-a5ec-afd0254bddd0 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:34.295161 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-17c9251d-ea4b-483d-aabe-44bf5e3558f5 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:34.301298 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52434) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:34.308371 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ad0ceffe-b2c7-4a93-878a-2fbba8ee8125 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:34.309238 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ad0ceffe-b2c7-4a93-878a-2fbba8ee8125 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:34.313501 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66085f3e-a54d-4d39-abd6-4622fa58ae41 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Pushing event deleted for resources: {'Network': ['ID=b975b0e1-d535-44d9-9216-4bfeb83030d6,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:34.315603 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a12032a9-67b4-46af-90a9-7caac35e4637 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:34.330311 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-62407bc2-a137-4811-b95d-1f2f1453d75a tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:34.428876 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a12032a9-67b4-46af-90a9-7caac35e4637 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Pushing event deleted for resources: {'Subnet': ['ID=4e4a617b-3903-4f63-b43d-7b6ec4c3091f,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:34.431884 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c9251d-ea4b-483d-aabe-44bf5e3558f5 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=cf2a06e0-41b6-46e2-bb58-be53b663f46f,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:34.438431 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-855a812d-c83a-4b31-9073-513f1331513a tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Deleting subnet 452f7977-7ae4-43ac-beb5-9ea9aa4844a3 {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:28:34.443718 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-19e7d3f6-fb44-4b75-92c9-da1bf703f3b0 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:34.451091 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-855a812d-c83a-4b31-9073-513f1331513a tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:34.456545 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-17c9251d-ea4b-483d-aabe-44bf5e3558f5 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:34.457759 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-17c9251d-ea4b-483d-aabe-44bf5e3558f5 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.9154739 Nov 09 04:28:34.459431 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3c62ba12-512b-4dde-bb52-b932b19eb762 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:34.483339 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-09ba3244-8049-43c4-acd0-f60cb8ec4ff4 None None] Publish callbacks [] for port, precommit_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:34.492270 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-62407bc2-a137-4811-b95d-1f2f1453d75a tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:34.493669 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-62407bc2-a137-4811-b95d-1f2f1453d75a tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.4786608 Nov 09 04:28:34.494665 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52436) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:34.501594 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52438) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:34.504719 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62407bc2-a137-4811-b95d-1f2f1453d75a tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1123ca39-5764-4645-943d-8cd7b13c2469,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:34.511640 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-5996d74c-7dd8-4731-963d-c6536843aa0e tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Request body: {'security_group_rule': {'security_group_id': '67cb2d36-e38c-4a29-adb5-c52b1d94ae99', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:34.527087 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-ad0ceffe-b2c7-4a93-878a-2fbba8ee8125 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 794 time: 1.8911850 Nov 09 04:28:34.529235 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-25ba3eed-2ca7-4273-9d5e-2ad6239c4ab6 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:34.530234 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-19e7d3f6-fb44-4b75-92c9-da1bf703f3b0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:34.551293 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52440) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:34.557239 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3c62ba12-512b-4dde-bb52-b932b19eb762 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:28:34.566731 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-a153aa41-82c5-418e-8872-cbb2f9b67d14 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Request body: {'subnet': {'network_id': 'e96f4292-19f0-4446-b093-408610b619f1', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:34.580283 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-19e7d3f6-fb44-4b75-92c9-da1bf703f3b0 None None] Network daccf5f5-3ea8-4f1b-ab62-78949d47bb91 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:28:34.587370 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-09ba3244-8049-43c4-acd0-f60cb8ec4ff4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:34.589453 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-19e7d3f6-fb44-4b75-92c9-da1bf703f3b0 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:28:34.592475 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-19e7d3f6-fb44-4b75-92c9-da1bf703f3b0 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:28:34.592792 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-ff464468-46c9-4c3c-a7e9-e700ce4b9fda tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Request body: {'security_group_rule': {'security_group_id': '4b002f37-f4ce-4d8a-a894-560955e72139', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:34.606601 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19e7d3f6-fb44-4b75-92c9-da1bf703f3b0 None None] Pushing event updated for resources: {'Port': ['ID=617022e4-2ac0-4ae0-9a42-43aec6246b64,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:34.615846 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c62ba12-512b-4dde-bb52-b932b19eb762 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Pushing event updated for resources: {'Port': ['ID=a58316d9-1cb1-4878-8a21-f3577322ae07,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:34.621033 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-3c62ba12-512b-4dde-bb52-b932b19eb762 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:28:34.623550 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3c62ba12-512b-4dde-bb52-b932b19eb762 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:28:34.677215 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad0ceffe-b2c7-4a93-878a-2fbba8ee8125 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Pushing event updated for resources: {'Network': ['ID=e96f4292-19f0-4446-b093-408610b619f1,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:34.711161 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network e96f4292-19f0-4446-b093-408610b619f1 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:28:34.718469 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-222ce791-157a-4bb3-a5de-2020651fdab7 None None] Pushing event updated for resources: {'Port': ['ID=6e983a96-52c7-4df1-885b-dc7cdba4b08e,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:34.728772 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-855a812d-c83a-4b31-9073-513f1331513a tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:34.734337 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [None req-88332025-86b4-4302-a5ec-afd0254bddd0 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] device_id is not set on port 220573b2-05bf-40da-85dd-c38e42a33c4b yet. {{(pid=102161) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:28:34.757688 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a12032a9-67b4-46af-90a9-7caac35e4637 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:34.827638 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a12032a9-67b4-46af-90a9-7caac35e4637 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Subscribe: > segment before_delete 55550000 {{(pid=102162) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:28:34.828011 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a12032a9-67b4-46af-90a9-7caac35e4637 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=102162) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:28:34.831093 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-19e7d3f6-fb44-4b75-92c9-da1bf703f3b0 None None] Attempting to bind port 617022e4-2ac0-4ae0-9a42-43aec6246b64 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:28:34.831358 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a12032a9-67b4-46af-90a9-7caac35e4637 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=102162) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:28:34.831358 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a12032a9-67b4-46af-90a9-7caac35e4637 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Subscribe: > port after_create 55550000 {{(pid=102162) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:28:34.831612 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-19e7d3f6-fb44-4b75-92c9-da1bf703f3b0 None None] Attempting to bind port 617022e4-2ac0-4ae0-9a42-43aec6246b64 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '612a778a-22e6-45ba-8f8f-f3d4d6a26a8a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 335, 'network_id': 'daccf5f5-3ea8-4f1b-ab62-78949d47bb91'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:28:34.831691 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a12032a9-67b4-46af-90a9-7caac35e4637 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Subscribe: > port after_delete 55550000 {{(pid=102162) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:28:34.831761 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-19e7d3f6-fb44-4b75-92c9-da1bf703f3b0 None None] Attempting to bind port 617022e4-2ac0-4ae0-9a42-43aec6246b64 on network daccf5f5-3ea8-4f1b-ab62-78949d47bb91 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:28:34.831824 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a12032a9-67b4-46af-90a9-7caac35e4637 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Subscribe: > port after_update 55550000 {{(pid=102162) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:28:34.831824 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a12032a9-67b4-46af-90a9-7caac35e4637 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Subscribe: > segment after_delete 55550000 {{(pid=102162) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:28:34.831824 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a12032a9-67b4-46af-90a9-7caac35e4637 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Subscribe: > subnet after_create 55550000 {{(pid=102162) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:28:34.831824 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a12032a9-67b4-46af-90a9-7caac35e4637 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Subscribe: > subnet after_delete 55550000 {{(pid=102162) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:28:34.831824 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a12032a9-67b4-46af-90a9-7caac35e4637 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Subscribe: > subnet after_update 55550000 {{(pid=102162) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:28:34.860412 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-19e7d3f6-fb44-4b75-92c9-da1bf703f3b0 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 28, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:28:34.860838 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-19e7d3f6-fb44-4b75-92c9-da1bf703f3b0 None None] Checking segment: {'id': '612a778a-22e6-45ba-8f8f-f3d4d6a26a8a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 335, 'network_id': 'daccf5f5-3ea8-4f1b-ab62-78949d47bb91'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:28:34.861269 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-19e7d3f6-fb44-4b75-92c9-da1bf703f3b0 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:34.861875 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-19e7d3f6-fb44-4b75-92c9-da1bf703f3b0 None None] Bound using segment: {'id': '612a778a-22e6-45ba-8f8f-f3d4d6a26a8a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 335, 'network_id': 'daccf5f5-3ea8-4f1b-ab62-78949d47bb91'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:28:34.862441 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-19e7d3f6-fb44-4b75-92c9-da1bf703f3b0 None None] Bound port: 617022e4-2ac0-4ae0-9a42-43aec6246b64, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '612a778a-22e6-45ba-8f8f-f3d4d6a26a8a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 335, 'network_id': 'daccf5f5-3ea8-4f1b-ab62-78949d47bb91'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:28:34.862845 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-19e7d3f6-fb44-4b75-92c9-da1bf703f3b0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:34.887501 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-09ba3244-8049-43c4-acd0-f60cb8ec4ff4 None None] Attempting to bind port 6e983a96-52c7-4df1-885b-dc7cdba4b08e on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:28:34.887897 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-09ba3244-8049-43c4-acd0-f60cb8ec4ff4 None None] Attempting to bind port 6e983a96-52c7-4df1-885b-dc7cdba4b08e by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'efe0485f-d48f-4307-b89a-0bcb86aaf1c2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 329, 'network_id': '468b2f91-119a-402c-b695-5d7963ec6348'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:28:34.888253 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-09ba3244-8049-43c4-acd0-f60cb8ec4ff4 None None] Attempting to bind port 6e983a96-52c7-4df1-885b-dc7cdba4b08e on network 468b2f91-119a-402c-b695-5d7963ec6348 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:28:34.910807 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-09ba3244-8049-43c4-acd0-f60cb8ec4ff4 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 28, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:28:34.911450 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-09ba3244-8049-43c4-acd0-f60cb8ec4ff4 None None] Checking segment: {'id': 'efe0485f-d48f-4307-b89a-0bcb86aaf1c2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 329, 'network_id': '468b2f91-119a-402c-b695-5d7963ec6348'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:28:34.911987 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-09ba3244-8049-43c4-acd0-f60cb8ec4ff4 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:34.912644 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-09ba3244-8049-43c4-acd0-f60cb8ec4ff4 None None] Bound using segment: {'id': 'efe0485f-d48f-4307-b89a-0bcb86aaf1c2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 329, 'network_id': '468b2f91-119a-402c-b695-5d7963ec6348'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:28:34.913379 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-09ba3244-8049-43c4-acd0-f60cb8ec4ff4 None None] Bound port: 6e983a96-52c7-4df1-885b-dc7cdba4b08e, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'efe0485f-d48f-4307-b89a-0bcb86aaf1c2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 329, 'network_id': '468b2f91-119a-402c-b695-5d7963ec6348'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:28:34.913944 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-09ba3244-8049-43c4-acd0-f60cb8ec4ff4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:35.006013 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-09ba3244-8049-43c4-acd0-f60cb8ec4ff4 None None] For port 6e983a96-52c7-4df1-885b-dc7cdba4b08e, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:28:35.014553 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-09ba3244-8049-43c4-acd0-f60cb8ec4ff4 None None] For port 6e983a96-52c7-4df1-885b-dc7cdba4b08e, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=6e983a96-52c7-4df1-885b-dc7cdba4b08e,segment=NetworkSegment(efe0485f-d48f-4307-b89a-0bcb86aaf1c2),segment_id=efe0485f-d48f-4307-b89a-0bcb86aaf1c2)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:28:35.025657 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2cacfd64-2a91-45ea-a563-b6c03b7b2c2a None None] Network b103fb67-62b2-4eeb-9e21-70ef83ccb4b2 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:28:35.054169 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a12032a9-67b4-46af-90a9-7caac35e4637 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Subscribe: > subnet after_create 55550000 {{(pid=102162) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:28:35.054564 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a12032a9-67b4-46af-90a9-7caac35e4637 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Subscribe: > subnet after_delete 55550000 {{(pid=102162) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:28:35.054898 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a12032a9-67b4-46af-90a9-7caac35e4637 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Subscribe: > subnet before_create 55550000 {{(pid=102162) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:28:35.055223 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a12032a9-67b4-46af-90a9-7caac35e4637 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Subscribe: > subnet before_update 55550000 {{(pid=102162) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 09 04:28:35.055599 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-a12032a9-67b4-46af-90a9-7caac35e4637 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['25474b0c-53b0-4c3a-8cb0-00a4d7799f33']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:28:35.085219 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5996d74c-7dd8-4731-963d-c6536843aa0e tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:35.096716 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-a12032a9-67b4-46af-90a9-7caac35e4637 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f907c809-6d47-40ca-9855-3086df265851') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:28:35.097039 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-a12032a9-67b4-46af-90a9-7caac35e4637 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f907c809-6d47-40ca-9855-3086df265851') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:28:35.120329 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a12032a9-67b4-46af-90a9-7caac35e4637 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:35.144666 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 76f630f8-c464-46b2-b3b3-6a4c815cc2cf up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:28:35.148514 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-09ba3244-8049-43c4-acd0-f60cb8ec4ff4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:35.154031 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a12032a9-67b4-46af-90a9-7caac35e4637 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:35.174998 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a12032a9-67b4-46af-90a9-7caac35e4637 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Releasing vlan 324 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:28:35.175402 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a12032a9-67b4-46af-90a9-7caac35e4637 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:35.179444 dv-neutron-816802-2-hyperv neutron-server[102162]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 09 04:28:35.179444 dv-neutron-816802-2-hyperv neutron-server[102162]: from cryptography.utils import int_from_bytes Nov 09 04:28:35.179444 dv-neutron-816802-2-hyperv neutron-server[102162]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 09 04:28:35.179444 dv-neutron-816802-2-hyperv neutron-server[102162]: from cryptography.utils import int_from_bytes Nov 09 04:28:35.179444 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:28:35.179444 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:28:35.179444 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:28:35.179444 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:28:35.179444 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:28:35.179444 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:28:35.179444 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:28:35.179444 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:28:35.179444 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:28:35.179444 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:28:35.179444 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:28:35.179444 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:28:35.179444 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:28:35.179444 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:28:35.179444 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:28:35.179444 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:28:35.179444 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:28:35.179444 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:28:35.179444 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:28:35.179444 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:28:35.179444 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:28:35.179444 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:28:35.179444 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:28:35.179444 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:28:35.179444 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:28:35.179444 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:28:35.179444 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:28:35.179444 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:28:35.179444 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:28:35.179444 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:28:35.179444 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:28:35.179444 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:28:35.200785 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ff464468-46c9-4c3c-a7e9-e700ce4b9fda tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:35.203958 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-25ba3eed-2ca7-4273-9d5e-2ad6239c4ab6 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:35.238283 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5996d74c-7dd8-4731-963d-c6536843aa0e tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:35.239173 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-855a812d-c83a-4b31-9073-513f1331513a tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:35.242857 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-416a0f20-1281-4c47-a1c0-be631a3f86e6 None None] Provisioning complete for port b5d65479-c9b1-4f1e-b764-d1921b06d257 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:28:35.244039 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-416a0f20-1281-4c47-a1c0-be631a3f86e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:35.277935 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a153aa41-82c5-418e-8872-cbb2f9b67d14 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Made reservation on behalf of a369b57921894b01a70b43c4f969d224 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:28:35.281561 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a153aa41-82c5-418e-8872-cbb2f9b67d14 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:35.301951 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-25ba3eed-2ca7-4273-9d5e-2ad6239c4ab6 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Network 6005ba78-d658-44f4-bad3-93b8496ee6db is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:28:35.314428 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-25ba3eed-2ca7-4273-9d5e-2ad6239c4ab6 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:28:35.319723 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-25ba3eed-2ca7-4273-9d5e-2ad6239c4ab6 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:28:35.320836 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-25ba3eed-2ca7-4273-9d5e-2ad6239c4ab6 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:35.321599 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-25ba3eed-2ca7-4273-9d5e-2ad6239c4ab6 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:35.357389 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-222ce791-157a-4bb3-a5de-2020651fdab7 None None] Pushing event updated for resources: {'Port': ['ID=6e983a96-52c7-4df1-885b-dc7cdba4b08e,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:35.358830 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5996d74c-7dd8-4731-963d-c6536843aa0e tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:35.392054 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25ba3eed-2ca7-4273-9d5e-2ad6239c4ab6 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Pushing event updated for resources: {'Port': ['ID=37ce592d-a83e-4683-8099-5ac92ede675d,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:35.399927 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a12032a9-67b4-46af-90a9-7caac35e4637 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:35.406969 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5996d74c-7dd8-4731-963d-c6536843aa0e tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8ef75136-b16b-4e8c-a346-3c32fba0a706,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:35.422864 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a12032a9-67b4-46af-90a9-7caac35e4637 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network 25474b0c-53b0-4c3a-8cb0-00a4d7799f33 {{(pid=102162) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:120}} Nov 09 04:28:35.425031 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-19e7d3f6-fb44-4b75-92c9-da1bf703f3b0 None None] For port 617022e4-2ac0-4ae0-9a42-43aec6246b64, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:28:35.426962 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a12032a9-67b4-46af-90a9-7caac35e4637 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:35.429197 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-09ba3244-8049-43c4-acd0-f60cb8ec4ff4 None None] Routers {'23955a4a-3903-49e9-ab99-5e003c83c868'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:28:35.430601 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a12032a9-67b4-46af-90a9-7caac35e4637 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] 10.222.0.24 "DELETE /v2.0/networks/25474b0c-53b0-4c3a-8cb0-00a4d7799f33 HTTP/1.1" status: 204 len: 168 time: 4.9930496 Nov 09 04:28:35.432443 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-09ba3244-8049-43c4-acd0-f60cb8ec4ff4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:28:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['23955a4a-3903-49e9-ab99-5e003c83c868'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:28:35.447835 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52446) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:35.448230 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-88332025-86b4-4302-a5ec-afd0254bddd0 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Allocated IP 2001:db8::23b (daccf5f5-3ea8-4f1b-ab62-78949d47bb91/88d0e868-7936-4409-8f96-0f4e98202b5e/220573b2-05bf-40da-85dd-c38e42a33c4b) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:28:35.456713 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a12032a9-67b4-46af-90a9-7caac35e4637 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Pushing event deleted for resources: {'Network': ['ID=25474b0c-53b0-4c3a-8cb0-00a4d7799f33,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:35.496504 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-19e7d3f6-fb44-4b75-92c9-da1bf703f3b0 None None] For port 617022e4-2ac0-4ae0-9a42-43aec6246b64, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=617022e4-2ac0-4ae0-9a42-43aec6246b64,segment=NetworkSegment(612a778a-22e6-45ba-8f8f-f3d4d6a26a8a),segment_id=612a778a-22e6-45ba-8f8f-f3d4d6a26a8a)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:28:35.548407 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5996d74c-7dd8-4731-963d-c6536843aa0e tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:35.548407 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-5996d74c-7dd8-4731-963d-c6536843aa0e tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 1.0294414 Nov 09 04:28:35.548407 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-25ba3eed-2ca7-4273-9d5e-2ad6239c4ab6 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 960 time: 2.0360670 Nov 09 04:28:35.548407 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52448) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:35.557509 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-e80bc416-f2c6-476d-8bb0-fab307800ffa tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Request body: {'floatingip': {'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:35.565756 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52450) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:35.634973 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a2b95062-514c-4656-a708-33ea8e368147 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] 10.222.0.24 "GET /v2.0/floatingips HTTP/1.1" status: 200 len: 691 time: 0.1857202 Nov 09 04:28:35.638381 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52452) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:35.647656 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-416a0f20-1281-4c47-a1c0-be631a3f86e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:35.667013 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-19e7d3f6-fb44-4b75-92c9-da1bf703f3b0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:35.669090 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9bc81b7f-070e-4e70-9dca-f5429b5332c7 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:35.670791 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-9bc81b7f-070e-4e70-9dca-f5429b5332c7 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] 10.222.0.24 "GET /v2.0/ports/37ce592d-a83e-4683-8099-5ac92ede675d HTTP/1.1" status: 200 len: 955 time: 0.1049752 Nov 09 04:28:35.701740 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52454) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:35.770405 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 76f630f8-c464-46b2-b3b3-6a4c815cc2cf triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:28:35.771063 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:35.827523 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19e7d3f6-fb44-4b75-92c9-da1bf703f3b0 None None] Pushing event updated for resources: {'Port': ['ID=617022e4-2ac0-4ae0-9a42-43aec6246b64,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:35.834324 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ff464468-46c9-4c3c-a7e9-e700ce4b9fda tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:35.850341 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3c62ba12-512b-4dde-bb52-b932b19eb762 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks [] for router_gateway, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:35.933549 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device b5d65479-c9b1-4f1e-b764-d1921b06d257 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:28:35.936863 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-416a0f20-1281-4c47-a1c0-be631a3f86e6 None None] For port b5d65479-c9b1-4f1e-b764-d1921b06d257, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=b5d65479-c9b1-4f1e-b764-d1921b06d257,segment=NetworkSegment(9bba1879-429a-4e85-9da5-469e1c46a5ba),segment_id=9bba1879-429a-4e85-9da5-469e1c46a5ba)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:28:35.950325 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ff464468-46c9-4c3c-a7e9-e700ce4b9fda tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:36.000288 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-09ba3244-8049-43c4-acd0-f60cb8ec4ff4 None None] Set router 23955a4a-3903-49e9-ab99-5e003c83c868 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:28:36.121159 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-416a0f20-1281-4c47-a1c0-be631a3f86e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:36.130321 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e80bc416-f2c6-476d-8bb0-fab307800ffa tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Publish callbacks [] for floatingip, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:36.222507 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-416a0f20-1281-4c47-a1c0-be631a3f86e6 None None] Pushing event updated for resources: {'Port': ['ID=b5d65479-c9b1-4f1e-b764-d1921b06d257,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:36.241420 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-416a0f20-1281-4c47-a1c0-be631a3f86e6 None None] Provisioning complete for port 6e983a96-52c7-4df1-885b-dc7cdba4b08e triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:28:36.243987 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-416a0f20-1281-4c47-a1c0-be631a3f86e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:36.293824 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a153aa41-82c5-418e-8872-cbb2f9b67d14 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:36.298612 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2dfb3108-0878-4b77-909d-e2ce428a60ae tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:36.299910 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2dfb3108-0878-4b77-909d-e2ce428a60ae tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:36.300766 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2dfb3108-0878-4b77-909d-e2ce428a60ae tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:36.301402 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2dfb3108-0878-4b77-909d-e2ce428a60ae tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:36.302010 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2dfb3108-0878-4b77-909d-e2ce428a60ae tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:36.302627 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2dfb3108-0878-4b77-909d-e2ce428a60ae tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:36.304403 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2dfb3108-0878-4b77-909d-e2ce428a60ae tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:36.305062 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2dfb3108-0878-4b77-909d-e2ce428a60ae tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:36.308016 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-2dfb3108-0878-4b77-909d-e2ce428a60ae tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] 10.222.0.24 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 5171 time: 0.6501253 Nov 09 04:28:36.313203 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port b5d65479-c9b1-4f1e-b764-d1921b06d257 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:28:36.313575 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:36.328704 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52456) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:36.335353 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-7ff27740-801c-47c4-9d92-c538821f153f tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Deleting port 37ce592d-a83e-4683-8099-5ac92ede675d {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:28:36.335497 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7ff27740-801c-47c4-9d92-c538821f153f tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:36.385068 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff464468-46c9-4c3c-a7e9-e700ce4b9fda tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=bcc4e10d-ea65-45ce-b1dd-7672c6191eb0,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:36.394077 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-855a812d-c83a-4b31-9073-513f1331513a tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:36.451268 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-855a812d-c83a-4b31-9073-513f1331513a tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:36.458399 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-855a812d-c83a-4b31-9073-513f1331513a tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] 10.222.0.24 "DELETE /v2.0/subnets/452f7977-7ae4-43ac-beb5-9ea9aa4844a3 HTTP/1.1" status: 204 len: 168 time: 2.1286061 Nov 09 04:28:36.458399 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-855a812d-c83a-4b31-9073-513f1331513a tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Pushing event deleted for resources: {'Subnet': ['ID=452f7977-7ae4-43ac-beb5-9ea9aa4844a3,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:36.458669 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.api.v2.resource [None req-9abe6a7a-5efb-45fe-98be-de39e0d0e6ca tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] delete failed (client error): The resource could not be found. Nov 09 04:28:36.458669 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-9abe6a7a-5efb-45fe-98be-de39e0d0e6ca tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] 10.222.0.24 "DELETE /v2.0/floatingips/f800cd3a-c105-40e2-b01d-f140e6dd9b7d HTTP/1.1" status: 404 len: 345 time: 0.1188552 Nov 09 04:28:36.465473 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52458) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:36.465800 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52460) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:36.504661 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-88332025-86b4-4302-a5ec-afd0254bddd0 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:36.534137 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a153aa41-82c5-418e-8872-cbb2f9b67d14 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Pushing event updated for resources: {'Subnet': ['ID=300c7541-d41f-47e3-ad5e-4d083e87c290,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:36.548794 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ff464468-46c9-4c3c-a7e9-e700ce4b9fda tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:36.550341 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-ff464468-46c9-4c3c-a7e9-e700ce4b9fda tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 1.9900384 Nov 09 04:28:36.555589 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52462) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:36.557181 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-10c8bd0f-df4c-4e95-bc44-7049d3ada298 None None] Network 79bc3055-9536-43a1-b62c-3eb406e9f982 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:28:36.562103 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-74ae45c6-399a-42ed-87e4-b12d49e54f26 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Request body: {'floatingip': {'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:36.567315 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-dadc7d65-07a7-4503-8e54-590c690c0d8a tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] DELETE failed (client error): The resource could not be found. Nov 09 04:28:36.568041 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-dadc7d65-07a7-4503-8e54-590c690c0d8a tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:28:36.574808 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-dadc7d65-07a7-4503-8e54-590c690c0d8a tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] 10.222.0.24 "DELETE /v2.0/networks/25474b0c-53b0-4c3a-8cb0-00a4d7799f33 HTTP/1.1" status: 404 len: 339 time: 0.1019826 Nov 09 04:28:36.578500 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52464) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:36.585339 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7ff27740-801c-47c4-9d92-c538821f153f tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:36.614334 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-c02e6ac9-0d57-4cca-86e8-93df4a4abbb5 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Request body: {'network': {'name': 'tempest-network--485882738', 'router:external': True}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:36.642381 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-7ff27740-801c-47c4-9d92-c538821f153f tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Calling delete_port for 37ce592d-a83e-4683-8099-5ac92ede675d owned by {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:28:36.658657 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-416a0f20-1281-4c47-a1c0-be631a3f86e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:36.666681 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3c62ba12-512b-4dde-bb52-b932b19eb762 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:36.688290 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a153aa41-82c5-418e-8872-cbb2f9b67d14 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Checking segment: {'id': '3567d530-a0d1-4a5f-b2b6-e974cb02bf65', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 316, 'network_id': 'e96f4292-19f0-4446-b093-408610b619f1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:28:36.688290 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a153aa41-82c5-418e-8872-cbb2f9b67d14 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Network hostable DHCP agents. Network: e96f4292-19f0-4446-b093-408610b619f1, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:28:36.692762 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-410f3d44-5015-42e7-91ed-2c28db7daab9 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:36.743019 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-416a0f20-1281-4c47-a1c0-be631a3f86e6 None None] For port 6e983a96-52c7-4df1-885b-dc7cdba4b08e, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=6e983a96-52c7-4df1-885b-dc7cdba4b08e,segment=NetworkSegment(efe0485f-d48f-4307-b89a-0bcb86aaf1c2),segment_id=efe0485f-d48f-4307-b89a-0bcb86aaf1c2)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:28:36.749666 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-09ba3244-8049-43c4-acd0-f60cb8ec4ff4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '23955a4a-3903-49e9-ab99-5e003c83c868', 'name': 'tempest-ServersTestManualDisk-509590275-router', 'tenant_id': '5f3cd2a3586e46c09f847681f744075c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.66'}], 'enable_snat': True}, 'gw_port_id': 'a31e46ce-e371-4177-a2d5-f9a3681f192b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:28:17Z', 'updated_at': '2021-11-09T04:28:28Z', 'revision_number': 4, 'project_id': '5f3cd2a3586e46c09f847681f744075c', 'gw_port': {'id': 'a31e46ce-e371-4177-a2d5-f9a3681f192b', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:d3:1e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '23955a4a-3903-49e9-ab99-5e003c83c868', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:28:19Z', 'updated_at': '2021-11-09T04:28:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '6e983a96-52c7-4df1-885b-dc7cdba4b08e', 'name': '', 'network_id': '468b2f91-119a-402c-b695-5d7963ec6348', 'tenant_id': '5f3cd2a3586e46c09f847681f744075c', 'mac_address': 'fa:16:3e:3c:66:6d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '23955a4a-3903-49e9-ab99-5e003c83c868', 'device_owner': 'network:router_interface', 'standard_attr_id': 127, 'fixed_ips': [{'subnet_id': 'a3d93294-0484-46fa-b8a6-204ec86c9c5f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:28:27Z', 'updated_at': '2021-11-09T04:28:35Z', 'revision_number': 4, 'project_id': '5f3cd2a3586e46c09f847681f744075c', 'subnets': [{'id': 'a3d93294-0484-46fa-b8a6-204ec86c9c5f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:28:36.764710 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-88332025-86b4-4302-a5ec-afd0254bddd0 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:36.770447 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e80bc416-f2c6-476d-8bb0-fab307800ffa tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:36.801922 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-09ba3244-8049-43c4-acd0-f60cb8ec4ff4 None None] The sync data for ids ['23955a4a-3903-49e9-ab99-5e003c83c868'] in dv-neutron-816802-2-hyperv is: [{'id': '23955a4a-3903-49e9-ab99-5e003c83c868', 'name': 'tempest-ServersTestManualDisk-509590275-router', 'tenant_id': '5f3cd2a3586e46c09f847681f744075c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.66'}], 'enable_snat': True}, 'gw_port_id': 'a31e46ce-e371-4177-a2d5-f9a3681f192b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:28:17Z', 'updated_at': '2021-11-09T04:28:28Z', 'revision_number': 4, 'project_id': '5f3cd2a3586e46c09f847681f744075c', 'gw_port': {'id': 'a31e46ce-e371-4177-a2d5-f9a3681f192b', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:d3:1e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '23955a4a-3903-49e9-ab99-5e003c83c868', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:28:19Z', 'updated_at': '2021-11-09T04:28:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '6e983a96-52c7-4df1-885b-dc7cdba4b08e', 'name': '', 'network_id': '468b2f91-119a-402c-b695-5d7963ec6348', 'tenant_id': '5f3cd2a3586e46c09f847681f744075c', 'mac_address': 'fa:16:3e:3c:66:6d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '23955a4a-3903-49e9-ab99-5e003c83c868', 'device_owner': 'network:router_interface', 'standard_attr_id': 127, 'fixed_ips': [{'subnet_id': 'a3d93294-0484-46fa-b8a6-204ec86c9c5f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:28:27Z', 'updated_at': '2021-11-09T04:28:35Z', 'revision_number': 4, 'project_id': '5f3cd2a3586e46c09f847681f744075c', 'subnets': [{'id': 'a3d93294-0484-46fa-b8a6-204ec86c9c5f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:28:36.803362 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-74ae45c6-399a-42ed-87e4-b12d49e54f26 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Publish callbacks [] for floatingip, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:36.833424 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-416a0f20-1281-4c47-a1c0-be631a3f86e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:36.950097 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c02e6ac9-0d57-4cca-86e8-93df4a4abbb5 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Made reservation on behalf of 50f2f3df9a9441cd84e52ab52b9432fc for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:28:36.952691 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c02e6ac9-0d57-4cca-86e8-93df4a4abbb5 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:36.957039 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-88332025-86b4-4302-a5ec-afd0254bddd0 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Network daccf5f5-3ea8-4f1b-ab62-78949d47bb91 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:28:36.968961 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a153aa41-82c5-418e-8872-cbb2f9b67d14 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Network e96f4292-19f0-4446-b093-408610b619f1 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:28:36.986876 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-88332025-86b4-4302-a5ec-afd0254bddd0 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:28:37.012854 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-416a0f20-1281-4c47-a1c0-be631a3f86e6 None None] Pushing event updated for resources: {'Port': ['ID=6e983a96-52c7-4df1-885b-dc7cdba4b08e,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:37.020778 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8b176394-a592-4918-bb85-d742bcb8bee9 None None] DHCP port deletion for 79bc3055-9536-43a1-b62c-3eb406e9f982 request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:28:37.056998 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-88332025-86b4-4302-a5ec-afd0254bddd0 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:28:37.063900 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-88332025-86b4-4302-a5ec-afd0254bddd0 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:37.067342 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-88332025-86b4-4302-a5ec-afd0254bddd0 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:37.079353 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88332025-86b4-4302-a5ec-afd0254bddd0 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Pushing event updated for resources: {'Port': ['ID=220573b2-05bf-40da-85dd-c38e42a33c4b,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:37.093983 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-adac8fd8-3361-4f97-a907-cc2587b33e80 None None] Provisioning complete for port b5d65479-c9b1-4f1e-b764-d1921b06d257 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:28:37.094723 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-adac8fd8-3361-4f97-a907-cc2587b33e80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:37.109223 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-a153aa41-82c5-418e-8872-cbb2f9b67d14 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, e96f4292-19f0-4446-b093-408610b619f1) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:28:37.124984 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a153aa41-82c5-418e-8872-cbb2f9b67d14 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:37.125869 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a153aa41-82c5-418e-8872-cbb2f9b67d14 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:37.148514 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-410f3d44-5015-42e7-91ed-2c28db7daab9 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Deleting port af24097e-ae0a-4d62-aacd-2c2738983c34 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:28:37.148778 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-410f3d44-5015-42e7-91ed-2c28db7daab9 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:37.205800 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c02e6ac9-0d57-4cca-86e8-93df4a4abbb5 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 344} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:28:37.215754 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-82d8a658-adde-4034-b1c8-11d384edc821 None None] Network e96f4292-19f0-4446-b093-408610b619f1 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:28:37.221309 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device b5d65479-c9b1-4f1e-b764-d1921b06d257 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:28:37.222598 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-e80bc416-f2c6-476d-8bb0-fab307800ffa tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Allocated IP 172.26.0.237 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/ee6a6aa8-5180-4983-aa6f-d63bd4571faf) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:28:37.224253 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c02e6ac9-0d57-4cca-86e8-93df4a4abbb5 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:37.224605 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-c02e6ac9-0d57-4cca-86e8-93df4a4abbb5 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Added segment bbd9a14d-68ff-45e4-9f74-c9e3bf806a37 of type vlan for network cf506371-efe2-405c-9c50-f023cabc44da Nov 09 04:28:37.244687 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-88332025-86b4-4302-a5ec-afd0254bddd0 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 943 time: 3.7942777 Nov 09 04:28:37.245497 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52466) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:37.252857 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-0d98455b-1d5f-4384-8b3e-6aef5ea50069 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Request body: {'port': {'network_id': 'daccf5f5-3ea8-4f1b-ab62-78949d47bb91', 'name': 'tempest-AllowedAddressPairIpV6TestJSON-1097641699', 'allowed_address_pairs': [{'ip_address': '2001:db8::23b', 'mac_address': 'fa:16:3e:87:f8:a2'}]}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:37.284720 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3c62ba12-512b-4dde-bb52-b932b19eb762 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Router cd21e659-1094-4653-b570-03e6ed4305e3 is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102161) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:28:37.301610 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-74ae45c6-399a-42ed-87e4-b12d49e54f26 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:37.317996 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-410f3d44-5015-42e7-91ed-2c28db7daab9 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] For port af24097e-ae0a-4d62-aacd-2c2738983c34, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=af24097e-ae0a-4d62-aacd-2c2738983c34,segment=NetworkSegment(4298f996-bd9c-4831-928f-e41287186d45),segment_id=4298f996-bd9c-4831-928f-e41287186d45)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:28:37.318391 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-410f3d44-5015-42e7-91ed-2c28db7daab9 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:37.336344 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c02e6ac9-0d57-4cca-86e8-93df4a4abbb5 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:37.338642 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-410f3d44-5015-42e7-91ed-2c28db7daab9 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Calling delete_port for af24097e-ae0a-4d62-aacd-2c2738983c34 owned by network:dhcp {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:28:37.384683 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-07ef572b-0989-46de-9700-6b3ab9c4cdab None None] Network daccf5f5-3ea8-4f1b-ab62-78949d47bb91 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:28:37.511292 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7ff27740-801c-47c4-9d92-c538821f153f tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:37.519532 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a153aa41-82c5-418e-8872-cbb2f9b67d14 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.9566839 Nov 09 04:28:37.528372 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52468) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:37.568620 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-8b176394-a592-4918-bb85-d742bcb8bee9 None None] Deleting port af24097e-ae0a-4d62-aacd-2c2738983c34 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:28:37.569010 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8b176394-a592-4918-bb85-d742bcb8bee9 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:37.569263 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-eea37f23-e24d-400a-96cf-f57b6674f5a0 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Request body: {'port': {'network_id': 'e96f4292-19f0-4446-b093-408610b619f1', 'name': 'tempest-AllowedAddressPairTestJSON-1093950458'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:37.600328 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-adac8fd8-3361-4f97-a907-cc2587b33e80 None None] Provisioning complete for port 6e983a96-52c7-4df1-885b-dc7cdba4b08e triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:28:37.600697 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-adac8fd8-3361-4f97-a907-cc2587b33e80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:37.616654 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c02e6ac9-0d57-4cca-86e8-93df4a4abbb5 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:37.617621 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c02e6ac9-0d57-4cca-86e8-93df4a4abbb5 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:37.618229 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c02e6ac9-0d57-4cca-86e8-93df4a4abbb5 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:37.622157 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ff27740-801c-47c4-9d92-c538821f153f tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Pushing event deleted for resources: {'Port': ['ID=37ce592d-a83e-4683-8099-5ac92ede675d,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:37.654516 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7ff27740-801c-47c4-9d92-c538821f153f tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:37.664693 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-7ff27740-801c-47c4-9d92-c538821f153f tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] 10.222.0.24 "DELETE /v2.0/ports/37ce592d-a83e-4683-8099-5ac92ede675d HTTP/1.1" status: 204 len: 168 time: 1.9609618 Nov 09 04:28:37.665433 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52470) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:37.694029 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0d98455b-1d5f-4384-8b3e-6aef5ea50069 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Made reservation on behalf of 18f5ee1caa74420f9ab67cc92c1e02e6 for: {'port': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:28:37.727925 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c02e6ac9-0d57-4cca-86e8-93df4a4abbb5 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Pushing event updated for resources: {'Network': ['ID=cf506371-efe2-405c-9c50-f023cabc44da,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:37.730464 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3c62ba12-512b-4dde-bb52-b932b19eb762 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:28:37.738097 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port b5d65479-c9b1-4f1e-b764-d1921b06d257 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:28:37.739322 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:37.757809 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-5d57ec67-5d3a-444f-b14a-41d085a8b4ab tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] GET failed (client error): The resource could not be found. Nov 09 04:28:37.759432 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-77bd9d4d-5ef6-495b-a655-2cb8a3d9fe45 None None] Sync routers for ids ['cd21e659-1094-4653-b570-03e6ed4305e3'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:28:37.764332 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-5d57ec67-5d3a-444f-b14a-41d085a8b4ab tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] 10.222.0.24 "GET /v2.0/ports/37ce592d-a83e-4683-8099-5ac92ede675d HTTP/1.1" status: 404 len: 333 time: 0.0514429 Nov 09 04:28:37.768522 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52472) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:37.780966 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-a6af4642-fcd5-4285-ab15-e32eece1ff81 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Request body: {'port': {'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db', 'name': 'tempest-PortsAdminExtendedAttrsTestJSON-628386188'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:37.781310 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-77bd9d4d-5ef6-495b-a655-2cb8a3d9fe45 None None] Routers {'cd21e659-1094-4653-b570-03e6ed4305e3'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:28:37.781951 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-77bd9d4d-5ef6-495b-a655-2cb8a3d9fe45 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:28:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['cd21e659-1094-4653-b570-03e6ed4305e3'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:28:37.786142 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e80bc416-f2c6-476d-8bb0-fab307800ffa tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:37.801511 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-c02e6ac9-0d57-4cca-86e8-93df4a4abbb5 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 862 time: 1.2217972 Nov 09 04:28:37.804023 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52474) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:37.830910 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-410f3d44-5015-42e7-91ed-2c28db7daab9 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:37.835038 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network cf506371-efe2-405c-9c50-f023cabc44da details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:28:37.853724 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-77bd9d4d-5ef6-495b-a655-2cb8a3d9fe45 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:28:37.887131 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-77bd9d4d-5ef6-495b-a655-2cb8a3d9fe45 None None] Routers {'cd21e659-1094-4653-b570-03e6ed4305e3'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:28:37.887955 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-77bd9d4d-5ef6-495b-a655-2cb8a3d9fe45 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:28:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['cd21e659-1094-4653-b570-03e6ed4305e3'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:28:37.903118 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-410f3d44-5015-42e7-91ed-2c28db7daab9 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Pushing event deleted for resources: {'Port': ['ID=af24097e-ae0a-4d62-aacd-2c2738983c34,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:37.916248 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-410f3d44-5015-42e7-91ed-2c28db7daab9 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] No DVR routers for this DVR port af24097e-ae0a-4d62-aacd-2c2738983c34 on host dv-neutron-816802-2-hyperv {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:28:37.936517 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-77bd9d4d-5ef6-495b-a655-2cb8a3d9fe45 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:28:37.942451 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-77bd9d4d-5ef6-495b-a655-2cb8a3d9fe45 None None] The sync data for ids ['cd21e659-1094-4653-b570-03e6ed4305e3'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:28:37.944468 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3c62ba12-512b-4dde-bb52-b932b19eb762 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:37.945642 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-3c62ba12-512b-4dde-bb52-b932b19eb762 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 890 time: 7.5998228 Nov 09 04:28:37.960612 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52476) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:37.987444 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0d98455b-1d5f-4384-8b3e-6aef5ea50069 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:37.995439 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e80bc416-f2c6-476d-8bb0-fab307800ffa tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:38.011547 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-8b176394-a592-4918-bb85-d742bcb8bee9 None None] For port af24097e-ae0a-4d62-aacd-2c2738983c34, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=af24097e-ae0a-4d62-aacd-2c2738983c34,segment=NetworkSegment(4298f996-bd9c-4831-928f-e41287186d45),segment_id=4298f996-bd9c-4831-928f-e41287186d45)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:28:38.012041 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8b176394-a592-4918-bb85-d742bcb8bee9 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:38.059795 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-8b176394-a592-4918-bb85-d742bcb8bee9 None None] Calling delete_port for af24097e-ae0a-4d62-aacd-2c2738983c34 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:28:38.088728 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e80bc416-f2c6-476d-8bb0-fab307800ffa tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:28:38.113930 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-e80bc416-f2c6-476d-8bb0-fab307800ffa tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:28:38.131220 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a6af4642-fcd5-4285-ab15-e32eece1ff81 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Made reservation on behalf of 1f5d2eca16394ba1811d503557bb1504 for: {'port': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:28:38.131675 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e80bc416-f2c6-476d-8bb0-fab307800ffa tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:28:38.133511 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a6af4642-fcd5-4285-ab15-e32eece1ff81 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:38.136427 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-410f3d44-5015-42e7-91ed-2c28db7daab9 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:38.204930 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [None req-0d98455b-1d5f-4384-8b3e-6aef5ea50069 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] device_id is not set on port 33b9eec2-3b88-4e68-9af3-06c54c5c2768 yet. {{(pid=102161) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:28:38.209858 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e80bc416-f2c6-476d-8bb0-fab307800ffa tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Pushing event updated for resources: {'Port': ['ID=ee6a6aa8-5180-4983-aa6f-d63bd4571faf,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:38.213243 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-410f3d44-5015-42e7-91ed-2c28db7daab9 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['79bc3055-9536-43a1-b62c-3eb406e9f982']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:28:38.231440 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-410f3d44-5015-42e7-91ed-2c28db7daab9 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4298f996-bd9c-4831-928f-e41287186d45') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:28:38.231734 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-410f3d44-5015-42e7-91ed-2c28db7daab9 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4298f996-bd9c-4831-928f-e41287186d45') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:28:38.234979 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5f95084f-ddd7-406e-a817-3581716cda36 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-e96f4292-19f0-4446-b093-408610b619f1', 'network_id': 'e96f4292-19f0-4446-b093-408610b619f1', 'tenant_id': 'a369b57921894b01a70b43c4f969d224', 'fixed_ips': [{'subnet_id': '300c7541-d41f-47e3-ad5e-4d083e87c290'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:28:38.235823 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5f95084f-ddd7-406e-a817-3581716cda36 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:38.254261 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-410f3d44-5015-42e7-91ed-2c28db7daab9 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:38.268880 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-74ae45c6-399a-42ed-87e4-b12d49e54f26 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Allocated IP 172.26.0.35 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/98ddb3ce-d420-4085-ac57-516c83b02a51) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:28:38.335389 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-410f3d44-5015-42e7-91ed-2c28db7daab9 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:38.344596 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-410f3d44-5015-42e7-91ed-2c28db7daab9 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Releasing vlan 325 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:28:38.344805 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-410f3d44-5015-42e7-91ed-2c28db7daab9 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:38.346220 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 617022e4-2ac0-4ae0-9a42-43aec6246b64 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:28:38.373484 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-50744be2-7d02-4996-b27e-12d67a847db7 None None] Provisioning complete for port 617022e4-2ac0-4ae0-9a42-43aec6246b64 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:28:38.373875 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-50744be2-7d02-4996-b27e-12d67a847db7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:38.376822 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-eea37f23-e24d-400a-96cf-f57b6674f5a0 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Made reservation on behalf of a369b57921894b01a70b43c4f969d224 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:28:38.380671 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-eea37f23-e24d-400a-96cf-f57b6674f5a0 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:38.382898 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:28:38.382898 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:28:38.382898 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:28:38.382898 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:28:38.382898 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:28:38.382898 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:28:38.382898 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:28:38.382898 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:28:38.382898 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:28:38.382898 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:28:38.382898 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:28:38.382898 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:28:38.382898 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:28:38.382898 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:28:38.382898 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:28:38.382898 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:28:38.382898 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:28:38.382898 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:28:38.382898 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:28:38.382898 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:28:38.382898 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:28:38.382898 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:28:38.382898 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:28:38.382898 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:28:38.382898 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:28:38.382898 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:28:38.382898 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:28:38.382898 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:28:38.382898 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:28:38.382898 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:28:38.382898 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:28:38.382898 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:28:38.456989 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [None req-eea37f23-e24d-400a-96cf-f57b6674f5a0 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] device_id is not set on port 27da12d2-a24d-479a-9a28-6ae975943c6b yet. {{(pid=102162) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:28:38.463956 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e80bc416-f2c6-476d-8bb0-fab307800ffa tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:38.466009 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ee5a33e3-8320-4cce-987d-0373359d955e tempest-ExternalNetworksTestJSON-1286645568 tempest-ExternalNetworksTestJSON-1286645568-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:38.473255 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ee5a33e3-8320-4cce-987d-0373359d955e tempest-ExternalNetworksTestJSON-1286645568 tempest-ExternalNetworksTestJSON-1286645568-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:38.480978 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ee5a33e3-8320-4cce-987d-0373359d955e tempest-ExternalNetworksTestJSON-1286645568 tempest-ExternalNetworksTestJSON-1286645568-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:38.488986 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ee5a33e3-8320-4cce-987d-0373359d955e tempest-ExternalNetworksTestJSON-1286645568 tempest-ExternalNetworksTestJSON-1286645568-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:38.493751 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-ee5a33e3-8320-4cce-987d-0373359d955e tempest-ExternalNetworksTestJSON-1286645568 tempest-ExternalNetworksTestJSON-1286645568-project] 10.222.0.24 "GET /v2.0/networks HTTP/1.1" status: 200 len: 2452 time: 0.6858783 Nov 09 04:28:38.495428 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-74ae45c6-399a-42ed-87e4-b12d49e54f26 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:38.498935 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [None req-a6af4642-fcd5-4285-ab15-e32eece1ff81 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] device_id is not set on port 01a330ac-5672-48a1-9331-e0160428ff9d yet. {{(pid=102161) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:28:38.525400 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8b176394-a592-4918-bb85-d742bcb8bee9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:38.528961 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52478) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:38.552062 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-410f3d44-5015-42e7-91ed-2c28db7daab9 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:38.578415 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b176394-a592-4918-bb85-d742bcb8bee9 None None] Pushing event deleted for resources: {'Port': ['ID=af24097e-ae0a-4d62-aacd-2c2738983c34,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:38.588593 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8b176394-a592-4918-bb85-d742bcb8bee9 None None] No DVR routers for this DVR port af24097e-ae0a-4d62-aacd-2c2738983c34 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:28:38.595062 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-410f3d44-5015-42e7-91ed-2c28db7daab9 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:38.606584 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-410f3d44-5015-42e7-91ed-2c28db7daab9 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] 10.222.0.24 "DELETE /v2.0/networks/79bc3055-9536-43a1-b62c-3eb406e9f982 HTTP/1.1" status: 204 len: 168 time: 2.1387148 Nov 09 04:28:38.619118 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-5f95084f-ddd7-406e-a817-3581716cda36 None None] Allocated IP 172.20.0.2 (e96f4292-19f0-4446-b093-408610b619f1/300c7541-d41f-47e3-ad5e-4d083e87c290/14d1d90a-743b-4e99-8c11-af1fc20317e1) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:28:38.652457 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-410f3d44-5015-42e7-91ed-2c28db7daab9 tempest-DHCPAgentSchedulersTestJSON-1908966837 tempest-DHCPAgentSchedulersTestJSON-1908966837-project] Pushing event deleted for resources: {'Network': ['ID=79bc3055-9536-43a1-b62c-3eb406e9f982,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:38.653205 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 617022e4-2ac0-4ae0-9a42-43aec6246b64 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:28:38.653836 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:38.682684 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-0d98455b-1d5f-4384-8b3e-6aef5ea50069 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Allocated IP 2001:db8::3e (daccf5f5-3ea8-4f1b-ab62-78949d47bb91/88d0e868-7936-4409-8f96-0f4e98202b5e/33b9eec2-3b88-4e68-9af3-06c54c5c2768) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:28:38.834314 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e80bc416-f2c6-476d-8bb0-fab307800ffa tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:38.881068 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-74ae45c6-399a-42ed-87e4-b12d49e54f26 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:38.931032 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-50744be2-7d02-4996-b27e-12d67a847db7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:39.006168 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-50744be2-7d02-4996-b27e-12d67a847db7 None None] For port 617022e4-2ac0-4ae0-9a42-43aec6246b64, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=617022e4-2ac0-4ae0-9a42-43aec6246b64,segment=NetworkSegment(612a778a-22e6-45ba-8f8f-f3d4d6a26a8a),segment_id=612a778a-22e6-45ba-8f8f-f3d4d6a26a8a)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:28:39.021346 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e80bc416-f2c6-476d-8bb0-fab307800ffa tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:39.075657 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:39.105856 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5f95084f-ddd7-406e-a817-3581716cda36 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:39.110252 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-50744be2-7d02-4996-b27e-12d67a847db7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:39.129427 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e80bc416-f2c6-476d-8bb0-fab307800ffa tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:39.164953 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52484) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:39.195741 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5f95084f-ddd7-406e-a817-3581716cda36 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:39.209628 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50744be2-7d02-4996-b27e-12d67a847db7 None None] Pushing event updated for resources: {'Port': ['ID=617022e4-2ac0-4ae0-9a42-43aec6246b64,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:39.213579 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.db.api [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=102163) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:28:39.213960 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG oslo_db.api [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:28:39.243742 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0d98455b-1d5f-4384-8b3e-6aef5ea50069 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:39.250348 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5f95084f-ddd7-406e-a817-3581716cda36 None None] Network e96f4292-19f0-4446-b093-408610b619f1 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:28:39.256940 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-5f95084f-ddd7-406e-a817-3581716cda36 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:28:39.265712 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5f95084f-ddd7-406e-a817-3581716cda36 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:28:39.281941 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f95084f-ddd7-406e-a817-3581716cda36 None None] Pushing event updated for resources: {'Port': ['ID=14d1d90a-743b-4e99-8c11-af1fc20317e1,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:39.285429 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-9f2655ed-7c49-4a7d-99e8-b0bb79207eba None None] Provisioning complete for port 220573b2-05bf-40da-85dd-c38e42a33c4b triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:28:39.286111 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-826db88f-202d-4b0a-8a6b-27ef162c2942 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:39.286226 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9f2655ed-7c49-4a7d-99e8-b0bb79207eba None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:39.312578 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e80bc416-f2c6-476d-8bb0-fab307800ffa tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Pushing event updated for resources: {'Port': ['ID=ee6a6aa8-5180-4983-aa6f-d63bd4571faf,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:39.369151 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e80bc416-f2c6-476d-8bb0-fab307800ffa tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:39.375244 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-eea37f23-e24d-400a-96cf-f57b6674f5a0 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Allocated IP 172.20.0.7 (e96f4292-19f0-4446-b093-408610b619f1/300c7541-d41f-47e3-ad5e-4d083e87c290/27da12d2-a24d-479a-9a28-6ae975943c6b) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:28:39.384771 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-9f2655ed-7c49-4a7d-99e8-b0bb79207eba None None] Port 220573b2-05bf-40da-85dd-c38e42a33c4b cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:28:39.386496 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-5f95084f-ddd7-406e-a817-3581716cda36 None None] Attempting to bind port 14d1d90a-743b-4e99-8c11-af1fc20317e1 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:28:39.386823 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-5f95084f-ddd7-406e-a817-3581716cda36 None None] Attempting to bind port 14d1d90a-743b-4e99-8c11-af1fc20317e1 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '3567d530-a0d1-4a5f-b2b6-e974cb02bf65', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 316, 'network_id': 'e96f4292-19f0-4446-b093-408610b619f1'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:28:39.387180 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5f95084f-ddd7-406e-a817-3581716cda36 None None] Attempting to bind port 14d1d90a-743b-4e99-8c11-af1fc20317e1 on network e96f4292-19f0-4446-b093-408610b619f1 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:28:39.403446 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5f95084f-ddd7-406e-a817-3581716cda36 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 28, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:28:39.403692 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5f95084f-ddd7-406e-a817-3581716cda36 None None] Checking segment: {'id': '3567d530-a0d1-4a5f-b2b6-e974cb02bf65', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 316, 'network_id': 'e96f4292-19f0-4446-b093-408610b619f1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:28:39.404090 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5f95084f-ddd7-406e-a817-3581716cda36 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:39.404473 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5f95084f-ddd7-406e-a817-3581716cda36 None None] Bound using segment: {'id': '3567d530-a0d1-4a5f-b2b6-e974cb02bf65', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 316, 'network_id': 'e96f4292-19f0-4446-b093-408610b619f1'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:28:39.404948 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-5f95084f-ddd7-406e-a817-3581716cda36 None None] Bound port: 14d1d90a-743b-4e99-8c11-af1fc20317e1, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3567d530-a0d1-4a5f-b2b6-e974cb02bf65', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 316, 'network_id': 'e96f4292-19f0-4446-b093-408610b619f1'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:28:39.405323 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5f95084f-ddd7-406e-a817-3581716cda36 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:39.415608 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-68efe02d-4270-4ded-b107-feebfbddb35e admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=20a65be85603415da5c8f9fb587db6d6&name=default HTTP/1.1" status: 200 len: 2992 time: 0.2464945 Nov 09 04:28:39.420905 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52488) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:39.421017 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-9f2655ed-7c49-4a7d-99e8-b0bb79207eba None None] Provisioning complete for port 617022e4-2ac0-4ae0-9a42-43aec6246b64 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:28:39.421017 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9f2655ed-7c49-4a7d-99e8-b0bb79207eba None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:39.441812 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0d98455b-1d5f-4384-8b3e-6aef5ea50069 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:39.455020 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74ae45c6-399a-42ed-87e4-b12d49e54f26 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Pushing event updated for resources: {'Port': ['ID=98ddb3ce-d420-4085-ac57-516c83b02a51,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:39.486475 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e80bc416-f2c6-476d-8bb0-fab307800ffa tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:39.498413 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e80bc416-f2c6-476d-8bb0-fab307800ffa tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 3.9339383 Nov 09 04:28:39.535711 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-5f95084f-ddd7-406e-a817-3581716cda36 None None] For port 14d1d90a-743b-4e99-8c11-af1fc20317e1, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:28:39.540815 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-5f95084f-ddd7-406e-a817-3581716cda36 None None] For port 14d1d90a-743b-4e99-8c11-af1fc20317e1, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=14d1d90a-743b-4e99-8c11-af1fc20317e1,segment=NetworkSegment(3567d530-a0d1-4a5f-b2b6-e974cb02bf65),segment_id=3567d530-a0d1-4a5f-b2b6-e974cb02bf65)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:28:39.548684 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-74ae45c6-399a-42ed-87e4-b12d49e54f26 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:28:39.561550 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-74ae45c6-399a-42ed-87e4-b12d49e54f26 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:28:39.564026 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-74ae45c6-399a-42ed-87e4-b12d49e54f26 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:28:39.595210 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-75916bb3-8b85-4334-981b-ea02d2c4b8e7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:39.595395 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5f95084f-ddd7-406e-a817-3581716cda36 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:39.620419 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0d98455b-1d5f-4384-8b3e-6aef5ea50069 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Network daccf5f5-3ea8-4f1b-ab62-78949d47bb91 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:28:39.660101 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-75916bb3-8b85-4334-981b-ea02d2c4b8e7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:39.685729 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f95084f-ddd7-406e-a817-3581716cda36 None None] Pushing event updated for resources: {'Port': ['ID=14d1d90a-743b-4e99-8c11-af1fc20317e1,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:39.692738 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-0d98455b-1d5f-4384-8b3e-6aef5ea50069 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:28:39.695965 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0d98455b-1d5f-4384-8b3e-6aef5ea50069 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:28:39.703102 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0d98455b-1d5f-4384-8b3e-6aef5ea50069 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:39.703732 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0d98455b-1d5f-4384-8b3e-6aef5ea50069 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:39.724411 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d98455b-1d5f-4384-8b3e-6aef5ea50069 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Pushing event updated for resources: {'Port': ['ID=33b9eec2-3b88-4e68-9af3-06c54c5c2768,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:39.739335 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-eea37f23-e24d-400a-96cf-f57b6674f5a0 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:39.877820 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-75916bb3-8b85-4334-981b-ea02d2c4b8e7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:39.880461 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-75916bb3-8b85-4334-981b-ea02d2c4b8e7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:39.884703 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-75916bb3-8b85-4334-981b-ea02d2c4b8e7 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/921096d7-3d9d-4f4d-8865-ee499c229d69 HTTP/1.1" status: 204 len: 168 time: 0.4648407 Nov 09 04:28:39.894863 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75916bb3-8b85-4334-981b-ea02d2c4b8e7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=921096d7-3d9d-4f4d-8865-ee499c229d69,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:39.903187 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52504) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:39.914991 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-0d98455b-1d5f-4384-8b3e-6aef5ea50069 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1007 time: 2.6660600 Nov 09 04:28:39.968187 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-eea37f23-e24d-400a-96cf-f57b6674f5a0 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:40.008422 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-826db88f-202d-4b0a-8a6b-27ef162c2942 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:40.115210 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a6af4642-fcd5-4285-ab15-e32eece1ff81 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:40.129112 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-826db88f-202d-4b0a-8a6b-27ef162c2942 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['cf506371-efe2-405c-9c50-f023cabc44da']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:28:40.161497 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-826db88f-202d-4b0a-8a6b-27ef162c2942 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'bbd9a14d-68ff-45e4-9f74-c9e3bf806a37') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:28:40.165493 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-826db88f-202d-4b0a-8a6b-27ef162c2942 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'bbd9a14d-68ff-45e4-9f74-c9e3bf806a37') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:28:40.168968 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 6e983a96-52c7-4df1-885b-dc7cdba4b08e up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:28:40.212106 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-826db88f-202d-4b0a-8a6b-27ef162c2942 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:40.214139 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-74ae45c6-399a-42ed-87e4-b12d49e54f26 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:40.243624 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-826db88f-202d-4b0a-8a6b-27ef162c2942 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:40.265658 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-826db88f-202d-4b0a-8a6b-27ef162c2942 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Releasing vlan 344 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:28:40.266061 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-826db88f-202d-4b0a-8a6b-27ef162c2942 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:40.269783 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:28:40.269783 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:28:40.269783 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:28:40.269783 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:28:40.269783 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:28:40.269783 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:28:40.269783 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:28:40.269783 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:28:40.269783 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:28:40.269783 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:28:40.269783 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:28:40.269783 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:28:40.269783 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:28:40.269783 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:28:40.269783 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:28:40.269783 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:28:40.269783 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:28:40.269783 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:28:40.269783 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:28:40.269783 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:28:40.269783 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:28:40.269783 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:28:40.269783 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:28:40.269783 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:28:40.269783 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:28:40.269783 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:28:40.269783 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:28:40.269783 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:28:40.269783 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:28:40.269783 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:28:40.269783 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:28:40.269783 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:28:40.295661 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 6e983a96-52c7-4df1-885b-dc7cdba4b08e triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:28:40.296051 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:40.300346 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eea37f23-e24d-400a-96cf-f57b6674f5a0 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Network e96f4292-19f0-4446-b093-408610b619f1 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:28:40.325354 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-eea37f23-e24d-400a-96cf-f57b6674f5a0 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:28:40.333271 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eea37f23-e24d-400a-96cf-f57b6674f5a0 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:28:40.338193 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eea37f23-e24d-400a-96cf-f57b6674f5a0 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Pushing event updated for resources: {'Port': ['ID=27da12d2-a24d-479a-9a28-6ae975943c6b,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:40.437966 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-732b10d0-587b-405f-afa5-1c8158a9b053 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:40.444143 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 617022e4-2ac0-4ae0-9a42-43aec6246b64 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:28:40.449924 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-732b10d0-587b-405f-afa5-1c8158a9b053 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:40.458611 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-732b10d0-587b-405f-afa5-1c8158a9b053 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:40.463737 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-74ae45c6-399a-42ed-87e4-b12d49e54f26 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:40.469011 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-732b10d0-587b-405f-afa5-1c8158a9b053 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] 10.222.0.24 "GET /v2.0/ports HTTP/1.1" status: 200 len: 2482 time: 0.5651910 Nov 09 04:28:40.470151 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52516) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:40.484339 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b7f8a270-f420-4c2f-9894-a6e81ce74683 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:40.506072 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eea37f23-e24d-400a-96cf-f57b6674f5a0 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:40.507423 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-eea37f23-e24d-400a-96cf-f57b6674f5a0 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:40.519017 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-ca5cd35b-c5d2-407b-b319-a1161552e421 None None] Provisioning complete for port 33b9eec2-3b88-4e68-9af3-06c54c5c2768 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:28:40.519387 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ca5cd35b-c5d2-407b-b319-a1161552e421 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:40.534073 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52524) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:40.538550 dv-neutron-816802-2-hyperv neutron-server[102162]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Nov 09 04:28:40.573660 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-ca5cd35b-c5d2-407b-b319-a1161552e421 None None] Port 33b9eec2-3b88-4e68-9af3-06c54c5c2768 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:28:40.579415 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 617022e4-2ac0-4ae0-9a42-43aec6246b64 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:28:40.579777 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:40.613077 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-eea37f23-e24d-400a-96cf-f57b6674f5a0 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 3.0727108 Nov 09 04:28:40.614928 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52526) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:40.619993 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-826db88f-202d-4b0a-8a6b-27ef162c2942 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:40.621977 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a6af4642-fcd5-4285-ab15-e32eece1ff81 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:40.623024 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4d21e6a7-b79e-45b1-b623-e6e8ad863c22 req-f21f9b86-d777-4bf1-a662-fd9a8d69fad2 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "GET /v2.0/security-groups?name=tempest-securitygroup--2143389923&fields=id&tenant_id=a229c806094b42c7a0f7ed52f78dfd68 HTTP/1.1" status: 200 len: 267 time: 0.0865388 Nov 09 04:28:40.635673 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-826db88f-202d-4b0a-8a6b-27ef162c2942 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network cf506371-efe2-405c-9c50-f023cabc44da {{(pid=102161) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:120}} Nov 09 04:28:40.639147 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-0189c035-46ce-45f6-b449-7cb16087402a tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Request body: {'port': {'network_id': 'e96f4292-19f0-4446-b093-408610b619f1', 'name': 'tempest-AllowedAddressPairTestJSON-1025698948', 'allowed_address_pairs': [{'ip_address': '172.20.0.7', 'mac_address': 'fa:16:3e:55:bc:e4'}]}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:40.663525 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-826db88f-202d-4b0a-8a6b-27ef162c2942 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:40.667985 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-826db88f-202d-4b0a-8a6b-27ef162c2942 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] 10.222.0.24 "DELETE /v2.0/networks/cf506371-efe2-405c-9c50-f023cabc44da HTTP/1.1" status: 204 len: 168 time: 2.0916839 Nov 09 04:28:40.676929 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-826db88f-202d-4b0a-8a6b-27ef162c2942 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Pushing event deleted for resources: {'Network': ['ID=cf506371-efe2-405c-9c50-f023cabc44da,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:40.684366 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52528) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:40.754862 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-07ee1409-daa1-488c-86e9-d0c13940d2cf tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Request body: {'network': {'name': 'tempest-network--502450387', 'router:external': True}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:40.769989 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device af24097e-ae0a-4d62-aacd-2c2738983c34 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:28:40.795543 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52530) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:40.797869 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a6af4642-fcd5-4285-ab15-e32eece1ff81 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Network 6005ba78-d658-44f4-bad3-93b8496ee6db is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:28:40.801730 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: af24097e-ae0a-4d62-aacd-2c2738983c34 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:28:40.802346 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device af24097e-ae0a-4d62-aacd-2c2738983c34 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:28:40.859665 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-a6af4642-fcd5-4285-ab15-e32eece1ff81 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:28:40.885010 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1358b60b-b4d3-4876-9c7e-82cb1299c00a admin admin] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:40.891117 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a6af4642-fcd5-4285-ab15-e32eece1ff81 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:28:40.891117 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a6af4642-fcd5-4285-ab15-e32eece1ff81 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:40.891117 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a6af4642-fcd5-4285-ab15-e32eece1ff81 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:40.914974 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6af4642-fcd5-4285-ab15-e32eece1ff81 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Pushing event updated for resources: {'Port': ['ID=01a330ac-5672-48a1-9331-e0160428ff9d,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:40.963368 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d21e6a7-b79e-45b1-b623-e6e8ad863c22 req-e7d738d4-2509-47ba-972d-7e8280833431 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:40.964931 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4d21e6a7-b79e-45b1-b623-e6e8ad863c22 req-e7d738d4-2509-47ba-972d-7e8280833431 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "GET /v2.0/networks?id=d4ba3288-221c-40f3-a829-662c462cc93f HTTP/1.1" status: 200 len: 805 time: 0.2909660 Nov 09 04:28:40.980519 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4d21e6a7-b79e-45b1-b623-e6e8ad863c22 req-7a45c270-50bc-40e9-9146-973a34563ffe tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "GET /v2.0/quotas/a229c806094b42c7a0f7ed52f78dfd68 HTTP/1.1" status: 200 len: 375 time: 0.0096252 Nov 09 04:28:41.064787 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-07ee1409-daa1-488c-86e9-d0c13940d2cf tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Made reservation on behalf of 50f2f3df9a9441cd84e52ab52b9432fc for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:28:41.067232 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-07ee1409-daa1-488c-86e9-d0c13940d2cf tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:41.090222 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4d21e6a7-b79e-45b1-b623-e6e8ad863c22 req-e44c955a-0f7f-4cc7-8207-df4164c1e85b tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "GET /v2.0/ports?tenant_id=a229c806094b42c7a0f7ed52f78dfd68&fields=id HTTP/1.1" status: 200 len: 348 time: 0.1039424 Nov 09 04:28:41.115657 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-7e65cad5-4c8b-4149-b74a-d8963d888717 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Deleting port 33b9eec2-3b88-4e68-9af3-06c54c5c2768 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:28:41.116006 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7e65cad5-4c8b-4149-b74a-d8963d888717 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:41.180585 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0189c035-46ce-45f6-b449-7cb16087402a tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Made reservation on behalf of a369b57921894b01a70b43c4f969d224 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:28:41.199529 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a6af4642-fcd5-4285-ab15-e32eece1ff81 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 959 time: 3.4275706 Nov 09 04:28:41.203249 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52538) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:41.210200 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Request body: {'port': {'binding:host_id': 'hv-neutron-8168'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:41.301747 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-42edb637-50ed-4ed7-8a67-b4a2b65766e3 None None] Network e96f4292-19f0-4446-b093-408610b619f1 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:28:41.308515 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:41.312430 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-07ee1409-daa1-488c-86e9-d0c13940d2cf tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 319} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:28:41.330071 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-74ae45c6-399a-42ed-87e4-b12d49e54f26 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:41.332842 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1358b60b-b4d3-4876-9c7e-82cb1299c00a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:41.338695 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-833f8188-82d5-4c5b-b574-cc2bf04f6bf7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:41.356682 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7e65cad5-4c8b-4149-b74a-d8963d888717 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:41.359514 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-07ee1409-daa1-488c-86e9-d0c13940d2cf tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:41.359847 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-07ee1409-daa1-488c-86e9-d0c13940d2cf tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Added segment 45292acf-208c-4029-9e36-9b61dc1708b7 of type vlan for network 75870ad8-ef8a-45f1-844d-3431d361c402 Nov 09 04:28:41.377451 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0189c035-46ce-45f6-b449-7cb16087402a tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:41.381386 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-7e65cad5-4c8b-4149-b74a-d8963d888717 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Calling delete_port for 33b9eec2-3b88-4e68-9af3-06c54c5c2768 owned by {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:28:41.410071 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [req-4d21e6a7-b79e-45b1-b623-e6e8ad863c22 req-0b81d137-31ff-432d-bf7e-d09f5ac9181d service neutron] http://10.222.0.24:9696/v2.0/extensions returned with HTTP 200 {{(pid=102162) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:28:41.415929 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4d21e6a7-b79e-45b1-b623-e6e8ad863c22 req-0b81d137-31ff-432d-bf7e-d09f5ac9181d service neutron] 10.222.0.24 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.1168635 Nov 09 04:28:41.416189 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-74ae45c6-399a-42ed-87e4-b12d49e54f26 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:41.418643 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [None req-0189c035-46ce-45f6-b449-7cb16087402a tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] device_id is not set on port 234ca806-27f1-4135-a54d-05e012b59029 yet. {{(pid=102162) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:28:41.427299 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-da8d4430-5b82-4e19-b342-f16bafe0636f None None] Provisioning complete for port 14d1d90a-743b-4e99-8c11-af1fc20317e1 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:28:41.427673 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-da8d4430-5b82-4e19-b342-f16bafe0636f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:41.449982 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1358b60b-b4d3-4876-9c7e-82cb1299c00a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:41.565010 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-da8d4430-5b82-4e19-b342-f16bafe0636f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:41.612335 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-da8d4430-5b82-4e19-b342-f16bafe0636f None None] For port 14d1d90a-743b-4e99-8c11-af1fc20317e1, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=14d1d90a-743b-4e99-8c11-af1fc20317e1,segment=NetworkSegment(3567d530-a0d1-4a5f-b2b6-e974cb02bf65),segment_id=3567d530-a0d1-4a5f-b2b6-e974cb02bf65)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:28:41.672759 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-da8d4430-5b82-4e19-b342-f16bafe0636f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:41.735831 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da8d4430-5b82-4e19-b342-f16bafe0636f None None] Pushing event updated for resources: {'Port': ['ID=14d1d90a-743b-4e99-8c11-af1fc20317e1,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:41.792334 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-07ee1409-daa1-488c-86e9-d0c13940d2cf tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:41.847365 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4d21e6a7-b79e-45b1-b623-e6e8ad863c22 req-2a54a9c3-3b6c-47a5-90a0-a2ef8f61b908 service neutron] 10.222.0.24 "GET /v2.0/networks/d4ba3288-221c-40f3-a829-662c462cc93f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4145184 Nov 09 04:28:41.855431 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-b7f8a270-f420-4c2f-9894-a6e81ce74683 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Allocated IP 172.20.0.1 (b103fb67-62b2-4eeb-9e21-70ef83ccb4b2/84708fd2-e56f-45d8-a028-d5c7839aba25/15c6d8e0-f7f0-4d07-8e83-c2d1157476d4) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:28:41.872693 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1358b60b-b4d3-4876-9c7e-82cb1299c00a admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=7ecd2b38dd8c42b69cd90af43cb08239&name=default HTTP/1.1" status: 200 len: 2996 time: 1.0695443 Nov 09 04:28:41.878090 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52542) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:41.884402 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1358b60b-b4d3-4876-9c7e-82cb1299c00a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8d65178c-baa1-4966-b6b5-bfd8459ce8d6,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:41.903675 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74ae45c6-399a-42ed-87e4-b12d49e54f26 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Pushing event updated for resources: {'Port': ['ID=98ddb3ce-d420-4085-ac57-516c83b02a51,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:41.913169 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-3ec1be7f-2044-4103-9643-0600c035c507 None None] Provisioning complete for port 27da12d2-a24d-479a-9a28-6ae975943c6b triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:28:41.913630 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3ec1be7f-2044-4103-9643-0600c035c507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:41.967404 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-3ec1be7f-2044-4103-9643-0600c035c507 None None] Port 27da12d2-a24d-479a-9a28-6ae975943c6b cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:28:41.974850 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4d21e6a7-b79e-45b1-b623-e6e8ad863c22 req-44e525ba-7e9e-448d-b29c-6f386c112a8f service neutron] 10.222.0.24 "GET /v2.0/networks/d4ba3288-221c-40f3-a829-662c462cc93f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0984340 Nov 09 04:28:41.996204 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-74ae45c6-399a-42ed-87e4-b12d49e54f26 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:42.000173 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-0189c035-46ce-45f6-b449-7cb16087402a tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Allocated IP 172.20.0.11 (e96f4292-19f0-4446-b093-408610b619f1/300c7541-d41f-47e3-ad5e-4d083e87c290/234ca806-27f1-4135-a54d-05e012b59029) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:28:42.032366 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-3ec1be7f-2044-4103-9643-0600c035c507 None None] Provisioning complete for port 14d1d90a-743b-4e99-8c11-af1fc20317e1 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:28:42.033590 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3ec1be7f-2044-4103-9643-0600c035c507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:42.065179 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-07ee1409-daa1-488c-86e9-d0c13940d2cf tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:42.066202 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-07ee1409-daa1-488c-86e9-d0c13940d2cf tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:42.066728 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-07ee1409-daa1-488c-86e9-d0c13940d2cf tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:42.073897 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] device_id is not set on port 01a330ac-5672-48a1-9331-e0160428ff9d yet. {{(pid=102162) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:28:42.097554 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:42.110215 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 14d1d90a-743b-4e99-8c11-af1fc20317e1 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:28:42.120922 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:42.142406 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-74ae45c6-399a-42ed-87e4-b12d49e54f26 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:42.143858 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-74ae45c6-399a-42ed-87e4-b12d49e54f26 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.24 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 5.5867646 Nov 09 04:28:42.196110 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:42.222109 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-07ee1409-daa1-488c-86e9-d0c13940d2cf tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 862 time: 1.5200915 Nov 09 04:28:42.229496 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b7f8a270-f420-4c2f-9894-a6e81ce74683 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:42.232314 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52546) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:42.233107 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07ee1409-daa1-488c-86e9-d0c13940d2cf tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Pushing event updated for resources: {'Network': ['ID=75870ad8-ef8a-45f1-844d-3431d361c402,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:42.251354 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Pushing event updated for resources: {'Port': ['ID=01a330ac-5672-48a1-9331-e0160428ff9d,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:42.255470 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c2099ab1-6c4e-43bb-8575-43ec85d46b71 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:42.273859 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 75870ad8-ef8a-45f1-844d-3431d361c402 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:28:42.279815 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c2099ab1-6c4e-43bb-8575-43ec85d46b71 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:42.310432 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 14d1d90a-743b-4e99-8c11-af1fc20317e1 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:28:42.311464 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:42.387103 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-43f8584b-16c3-4ff8-931a-8b08fe3b0514 tempest-ExternalNetworksTestJSON-1286645568 tempest-ExternalNetworksTestJSON-1286645568-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:42.391417 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-43f8584b-16c3-4ff8-931a-8b08fe3b0514 tempest-ExternalNetworksTestJSON-1286645568 tempest-ExternalNetworksTestJSON-1286645568-project] 10.222.0.24 "GET /v2.0/networks/75870ad8-ef8a-45f1-844d-3431d361c402 HTTP/1.1" status: 200 len: 756 time: 0.1533501 Nov 09 04:28:42.391417 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7e65cad5-4c8b-4149-b74a-d8963d888717 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:42.392117 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52554) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:42.427306 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 01a330ac-5672-48a1-9331-e0160428ff9d on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:28:42.427644 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 01a330ac-5672-48a1-9331-e0160428ff9d by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:28:42.428139 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 01a330ac-5672-48a1-9331-e0160428ff9d on network 6005ba78-d658-44f4-bad3-93b8496ee6db {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:28:42.435125 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c2099ab1-6c4e-43bb-8575-43ec85d46b71 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:42.437850 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c2099ab1-6c4e-43bb-8575-43ec85d46b71 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:42.446617 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-c2099ab1-6c4e-43bb-8575-43ec85d46b71 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/8d65178c-baa1-4966-b6b5-bfd8459ce8d6 HTTP/1.1" status: 204 len: 168 time: 0.4693751 Nov 09 04:28:42.514549 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-87961569-2817-4775-ba18-38b37304b1b5 tempest-ExternalNetworksTestJSON-1286645568 tempest-ExternalNetworksTestJSON-1286645568-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:42.516532 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-87961569-2817-4775-ba18-38b37304b1b5 tempest-ExternalNetworksTestJSON-1286645568 tempest-ExternalNetworksTestJSON-1286645568-project] 10.222.0.24 "GET /v2.0/networks/9b2f002d-0bf2-4dc9-bb94-06811489d8ac HTTP/1.1" status: 200 len: 767 time: 0.1233552 Nov 09 04:28:42.524812 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-d9b6d98e-bda8-4c4a-ac8c-9ce8db316ebb None None] Provisioning complete for port 27da12d2-a24d-479a-9a28-6ae975943c6b triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:28:42.525176 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d9b6d98e-bda8-4c4a-ac8c-9ce8db316ebb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:42.530702 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52570) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:42.533373 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0189c035-46ce-45f6-b449-7cb16087402a tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:42.536585 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b7f8a270-f420-4c2f-9894-a6e81ce74683 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:42.573892 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Port 01a330ac-5672-48a1-9331-e0160428ff9d on network 6005ba78-d658-44f4-bad3-93b8496ee6db not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:28:42.574257 dv-neutron-816802-2-hyperv neutron-server[102162]: ERROR neutron.plugins.ml2.managers [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Failed to bind port 01a330ac-5672-48a1-9331-e0160428ff9d on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] Nov 09 04:28:42.579791 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2099ab1-6c4e-43bb-8575-43ec85d46b71 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8d65178c-baa1-4966-b6b5-bfd8459ce8d6,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:42.581996 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.plugins.ml2.plugin [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempt 2 to bind port 01a330ac-5672-48a1-9331-e0160428ff9d Nov 09 04:28:42.600584 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-d9b6d98e-bda8-4c4a-ac8c-9ce8db316ebb None None] Port 27da12d2-a24d-479a-9a28-6ae975943c6b cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:28:42.663280 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-0f0b2892-1fc2-4a7f-aceb-99da112677ad req-ca4bee2e-73ce-46c1-a093-e8e6dab0494d tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "GET /v2.0/ports?device_id=fd8e39fc-699b-4777-aae4-ca592a898437 HTTP/1.1" status: 200 len: 210 time: 0.0872350 Nov 09 04:28:42.703012 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 01a330ac-5672-48a1-9331-e0160428ff9d on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:28:42.703348 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 01a330ac-5672-48a1-9331-e0160428ff9d by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:28:42.703683 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 01a330ac-5672-48a1-9331-e0160428ff9d on network 6005ba78-d658-44f4-bad3-93b8496ee6db {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:28:42.713810 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Port 01a330ac-5672-48a1-9331-e0160428ff9d on network 6005ba78-d658-44f4-bad3-93b8496ee6db not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:28:42.714430 dv-neutron-816802-2-hyperv neutron-server[102162]: ERROR neutron.plugins.ml2.managers [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Failed to bind port 01a330ac-5672-48a1-9331-e0160428ff9d on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] Nov 09 04:28:42.715056 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.plugins.ml2.plugin [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempt 3 to bind port 01a330ac-5672-48a1-9331-e0160428ff9d Nov 09 04:28:42.716412 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e65cad5-4c8b-4149-b74a-d8963d888717 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Pushing event deleted for resources: {'Port': ['ID=33b9eec2-3b88-4e68-9af3-06c54c5c2768,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:42.738010 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 01a330ac-5672-48a1-9331-e0160428ff9d on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:28:42.738667 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 01a330ac-5672-48a1-9331-e0160428ff9d by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:28:42.739232 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 01a330ac-5672-48a1-9331-e0160428ff9d on network 6005ba78-d658-44f4-bad3-93b8496ee6db {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:28:42.745040 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Port 01a330ac-5672-48a1-9331-e0160428ff9d on network 6005ba78-d658-44f4-bad3-93b8496ee6db not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:28:42.745637 dv-neutron-816802-2-hyperv neutron-server[102162]: ERROR neutron.plugins.ml2.managers [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Failed to bind port 01a330ac-5672-48a1-9331-e0160428ff9d on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] Nov 09 04:28:42.746197 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.plugins.ml2.plugin [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempt 4 to bind port 01a330ac-5672-48a1-9331-e0160428ff9d Nov 09 04:28:42.763797 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 01a330ac-5672-48a1-9331-e0160428ff9d on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:28:42.764726 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 01a330ac-5672-48a1-9331-e0160428ff9d by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:28:42.765384 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 01a330ac-5672-48a1-9331-e0160428ff9d on network 6005ba78-d658-44f4-bad3-93b8496ee6db {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:28:42.768290 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0189c035-46ce-45f6-b449-7cb16087402a tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:42.824141 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b7f8a270-f420-4c2f-9894-a6e81ce74683 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Network b103fb67-62b2-4eeb-9e21-70ef83ccb4b2 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:28:42.841419 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Port 01a330ac-5672-48a1-9331-e0160428ff9d on network 6005ba78-d658-44f4-bad3-93b8496ee6db not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:28:42.843720 dv-neutron-816802-2-hyperv neutron-server[102162]: ERROR neutron.plugins.ml2.managers [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Failed to bind port 01a330ac-5672-48a1-9331-e0160428ff9d on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] Nov 09 04:28:42.847499 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.plugins.ml2.plugin [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempt 5 to bind port 01a330ac-5672-48a1-9331-e0160428ff9d Nov 09 04:28:42.853403 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0189c035-46ce-45f6-b449-7cb16087402a tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Network e96f4292-19f0-4446-b093-408610b619f1 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:28:42.867195 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-0189c035-46ce-45f6-b449-7cb16087402a tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:28:42.873912 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0189c035-46ce-45f6-b449-7cb16087402a tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:28:42.883173 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 01a330ac-5672-48a1-9331-e0160428ff9d on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:28:42.884511 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 01a330ac-5672-48a1-9331-e0160428ff9d by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:28:42.884511 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 01a330ac-5672-48a1-9331-e0160428ff9d on network 6005ba78-d658-44f4-bad3-93b8496ee6db {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:28:42.901294 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-b7f8a270-f420-4c2f-9894-a6e81ce74683 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:28:42.907775 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0189c035-46ce-45f6-b449-7cb16087402a tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Pushing event updated for resources: {'Port': ['ID=234ca806-27f1-4135-a54d-05e012b59029,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:42.916328 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Port 01a330ac-5672-48a1-9331-e0160428ff9d on network 6005ba78-d658-44f4-bad3-93b8496ee6db not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:28:42.916741 dv-neutron-816802-2-hyperv neutron-server[102162]: ERROR neutron.plugins.ml2.managers [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Failed to bind port 01a330ac-5672-48a1-9331-e0160428ff9d on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] Nov 09 04:28:42.919234 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.plugins.ml2.plugin [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempt 6 to bind port 01a330ac-5672-48a1-9331-e0160428ff9d Nov 09 04:28:42.922837 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b7f8a270-f420-4c2f-9894-a6e81ce74683 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:28:42.943938 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 01a330ac-5672-48a1-9331-e0160428ff9d on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:28:42.944269 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 01a330ac-5672-48a1-9331-e0160428ff9d by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:28:42.944596 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 01a330ac-5672-48a1-9331-e0160428ff9d on network 6005ba78-d658-44f4-bad3-93b8496ee6db {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:28:42.953906 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0189c035-46ce-45f6-b449-7cb16087402a tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:42.954546 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0189c035-46ce-45f6-b449-7cb16087402a tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:42.959479 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Port 01a330ac-5672-48a1-9331-e0160428ff9d on network 6005ba78-d658-44f4-bad3-93b8496ee6db not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:28:42.959729 dv-neutron-816802-2-hyperv neutron-server[102162]: ERROR neutron.plugins.ml2.managers [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Failed to bind port 01a330ac-5672-48a1-9331-e0160428ff9d on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] Nov 09 04:28:42.973115 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.plugins.ml2.plugin [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempt 7 to bind port 01a330ac-5672-48a1-9331-e0160428ff9d Nov 09 04:28:42.993761 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 01a330ac-5672-48a1-9331-e0160428ff9d on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:28:42.993761 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 01a330ac-5672-48a1-9331-e0160428ff9d by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:28:42.993761 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 01a330ac-5672-48a1-9331-e0160428ff9d on network 6005ba78-d658-44f4-bad3-93b8496ee6db {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:28:42.998382 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Port 01a330ac-5672-48a1-9331-e0160428ff9d on network 6005ba78-d658-44f4-bad3-93b8496ee6db not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:28:42.998724 dv-neutron-816802-2-hyperv neutron-server[102162]: ERROR neutron.plugins.ml2.managers [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Failed to bind port 01a330ac-5672-48a1-9331-e0160428ff9d on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] Nov 09 04:28:42.999631 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.plugins.ml2.plugin [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempt 8 to bind port 01a330ac-5672-48a1-9331-e0160428ff9d Nov 09 04:28:43.018298 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 01a330ac-5672-48a1-9331-e0160428ff9d on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:28:43.018650 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 01a330ac-5672-48a1-9331-e0160428ff9d by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:28:43.019201 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 01a330ac-5672-48a1-9331-e0160428ff9d on network 6005ba78-d658-44f4-bad3-93b8496ee6db {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:28:43.027663 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Port 01a330ac-5672-48a1-9331-e0160428ff9d on network 6005ba78-d658-44f4-bad3-93b8496ee6db not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:28:43.027991 dv-neutron-816802-2-hyperv neutron-server[102162]: ERROR neutron.plugins.ml2.managers [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Failed to bind port 01a330ac-5672-48a1-9331-e0160428ff9d on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] Nov 09 04:28:43.028500 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.plugins.ml2.plugin [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempt 9 to bind port 01a330ac-5672-48a1-9331-e0160428ff9d Nov 09 04:28:43.048627 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 01a330ac-5672-48a1-9331-e0160428ff9d on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:28:43.048959 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 01a330ac-5672-48a1-9331-e0160428ff9d by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:28:43.049283 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 01a330ac-5672-48a1-9331-e0160428ff9d on network 6005ba78-d658-44f4-bad3-93b8496ee6db {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:28:43.053992 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Port 01a330ac-5672-48a1-9331-e0160428ff9d on network 6005ba78-d658-44f4-bad3-93b8496ee6db not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:28:43.054312 dv-neutron-816802-2-hyperv neutron-server[102162]: ERROR neutron.plugins.ml2.managers [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Failed to bind port 01a330ac-5672-48a1-9331-e0160428ff9d on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] Nov 09 04:28:43.054736 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.plugins.ml2.plugin [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempt 10 to bind port 01a330ac-5672-48a1-9331-e0160428ff9d Nov 09 04:28:43.072448 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-0189c035-46ce-45f6-b449-7cb16087402a tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 999 time: 2.4478300 Nov 09 04:28:43.094495 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52588) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:43.110794 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b7f8a270-f420-4c2f-9894-a6e81ce74683 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:43.123300 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 01a330ac-5672-48a1-9331-e0160428ff9d on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:28:43.126821 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 01a330ac-5672-48a1-9331-e0160428ff9d by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:28:43.127384 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempting to bind port 01a330ac-5672-48a1-9331-e0160428ff9d on network 6005ba78-d658-44f4-bad3-93b8496ee6db {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:28:43.145502 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bbd350e3-2bf0-4b40-8241-fca2d396cbae tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:43.147783 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7f8a270-f420-4c2f-9894-a6e81ce74683 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Pushing event updated for resources: {'Port': ['ID=15c6d8e0-f7f0-4d07-8e83-c2d1157476d4,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:43.152818 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7e65cad5-4c8b-4149-b74a-d8963d888717 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:43.156324 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-7e65cad5-4c8b-4149-b74a-d8963d888717 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] 10.222.0.24 "DELETE /v2.0/ports/33b9eec2-3b88-4e68-9af3-06c54c5c2768 HTTP/1.1" status: 204 len: 168 time: 2.6839988 Nov 09 04:28:43.165830 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52590) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:43.209605 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Port 01a330ac-5672-48a1-9331-e0160428ff9d on network 6005ba78-d658-44f4-bad3-93b8496ee6db not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:28:43.210084 dv-neutron-816802-2-hyperv neutron-server[102162]: ERROR neutron.plugins.ml2.managers [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Failed to bind port 01a330ac-5672-48a1-9331-e0160428ff9d on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '6005ba78-d658-44f4-bad3-93b8496ee6db'}] Nov 09 04:28:43.210605 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:43.263284 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-750f46f7-f91f-455e-a53a-bc0ad22395ee tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] GET failed (client error): The resource could not be found. Nov 09 04:28:43.265199 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-750f46f7-f91f-455e-a53a-bc0ad22395ee tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] 10.222.0.24 "GET /v2.0/ports/33b9eec2-3b88-4e68-9af3-06c54c5c2768 HTTP/1.1" status: 404 len: 333 time: 0.0965517 Nov 09 04:28:43.269841 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52594) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:43.275906 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-4c794131-5142-436e-9323-737975129d90 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Request body: {'port': {'network_id': 'daccf5f5-3ea8-4f1b-ab62-78949d47bb91', 'name': 'tempest-AllowedAddressPairIpV6TestJSON-1652178869'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:43.347442 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4d1ab8fe-a120-4d7f-a0be-8be536b67b55 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:43.358314 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4d1ab8fe-a120-4d7f-a0be-8be536b67b55 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:43.365639 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-d9854922-b32e-4c57-afc2-91f971f6f8c1 None None] Provisioning complete for port 234ca806-27f1-4135-a54d-05e012b59029 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:28:43.366640 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d9854922-b32e-4c57-afc2-91f971f6f8c1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:43.373466 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4d1ab8fe-a120-4d7f-a0be-8be536b67b55 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:43.375191 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-4d1ab8fe-a120-4d7f-a0be-8be536b67b55 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] 10.222.0.24 "GET /v2.0/ports HTTP/1.1" status: 200 len: 2467 time: 0.2794085 Nov 09 04:28:43.392029 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52604) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:43.439629 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bbd350e3-2bf0-4b40-8241-fca2d396cbae tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:43.458460 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-d9854922-b32e-4c57-afc2-91f971f6f8c1 None None] Port 234ca806-27f1-4135-a54d-05e012b59029 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:28:43.469884 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-d9854922-b32e-4c57-afc2-91f971f6f8c1 None None] Provisioning complete for port 15c6d8e0-f7f0-4d07-8e83-c2d1157476d4 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:28:43.490291 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d9854922-b32e-4c57-afc2-91f971f6f8c1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:43.496720 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-bbd350e3-2bf0-4b40-8241-fca2d396cbae tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['75870ad8-ef8a-45f1-844d-3431d361c402']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:28:43.499041 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52620) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:43.504844 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] For port 01a330ac-5672-48a1-9331-e0160428ff9d, host hv-neutron-8168, cleared binding levels {{(pid=102162) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:28:43.505214 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attempted to set empty binding levels {{(pid=102162) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:65}} Nov 09 04:28:43.508050 dv-neutron-816802-2-hyperv neutron-server[102161]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Nov 09 04:28:43.538437 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-d9854922-b32e-4c57-afc2-91f971f6f8c1 None None] Port 15c6d8e0-f7f0-4d07-8e83-c2d1157476d4 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:28:43.561954 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-bbd350e3-2bf0-4b40-8241-fca2d396cbae tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '45292acf-208c-4029-9e36-9b61dc1708b7') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:28:43.562266 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-bbd350e3-2bf0-4b40-8241-fca2d396cbae tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '45292acf-208c-4029-9e36-9b61dc1708b7') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:28:43.593154 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bbd350e3-2bf0-4b40-8241-fca2d396cbae tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:43.618194 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-efbe6138-7f35-4a78-b226-c4382f39ee20 req-9a2b1113-867f-4553-9f14-7d7ed770a711 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.24 "GET /v2.0/security-groups?name=tempest-securitygroup--714870249&fields=id&tenant_id=5f3cd2a3586e46c09f847681f744075c HTTP/1.1" status: 200 len: 267 time: 0.1128364 Nov 09 04:28:43.622903 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:43.625154 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bbd350e3-2bf0-4b40-8241-fca2d396cbae tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:43.648667 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-bbd350e3-2bf0-4b40-8241-fca2d396cbae tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Releasing vlan 319 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:28:43.649100 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bbd350e3-2bf0-4b40-8241-fca2d396cbae tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:43.650839 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:28:43.650839 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:28:43.650839 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:28:43.650839 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:28:43.650839 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:28:43.650839 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:28:43.650839 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:28:43.650839 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:28:43.650839 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:28:43.650839 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:28:43.650839 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:28:43.650839 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:28:43.650839 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:28:43.650839 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:28:43.650839 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:28:43.650839 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:28:43.650839 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:28:43.650839 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:28:43.650839 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:28:43.650839 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:28:43.650839 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:28:43.650839 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:28:43.650839 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:28:43.650839 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:28:43.650839 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:28:43.650839 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:28:43.650839 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:28:43.650839 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:28:43.650839 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:28:43.650839 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:28:43.650839 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:28:43.650839 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:28:43.674770 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-cbd14511-90df-4a46-b36e-13992ab96c27 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:43.682051 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] In _notify_port_updated(), no bound segment for port 01a330ac-5672-48a1-9331-e0160428ff9d on network 6005ba78-d658-44f4-bad3-93b8496ee6db {{(pid=102162) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 09 04:28:43.683110 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:43.683701 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:43.687852 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] 10.222.0.24 "PUT /v2.0/ports/01a330ac-5672-48a1-9331-e0160428ff9d HTTP/1.1" status: 200 len: 976 time: 2.4834845 Nov 09 04:28:43.688998 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52622) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:43.723228 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0133a2e-def0-4e5d-abc8-ef342e834a3e tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Pushing event updated for resources: {'Port': ['ID=01a330ac-5672-48a1-9331-e0160428ff9d,revision_number=3']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:43.801739 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8b944b67-bb34-430b-be93-455a08dc6a82 req-8a3402ba-0f8f-4c08-8338-87f5e95b9c10 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "GET /v2.0/ports?device_id=fd8e39fc-699b-4777-aae4-ca592a898437 HTTP/1.1" status: 200 len: 210 time: 0.0372536 Nov 09 04:28:43.803983 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-3c06c207-9f31-45e8-b4fc-e6b18ff38a67 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Deleting port 234ca806-27f1-4135-a54d-05e012b59029 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:28:43.808560 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3c06c207-9f31-45e8-b4fc-e6b18ff38a67 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:43.885487 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4c794131-5142-436e-9323-737975129d90 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Made reservation on behalf of 18f5ee1caa74420f9ab67cc92c1e02e6 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:28:43.891562 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4c794131-5142-436e-9323-737975129d90 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:43.891712 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bbd350e3-2bf0-4b40-8241-fca2d396cbae tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:43.912347 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bbd350e3-2bf0-4b40-8241-fca2d396cbae tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network 75870ad8-ef8a-45f1-844d-3431d361c402 {{(pid=102161) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:120}} Nov 09 04:28:43.917133 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [None req-4c794131-5142-436e-9323-737975129d90 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] device_id is not set on port f51fc55b-875a-40f1-9ac8-2fa2854463de yet. {{(pid=102162) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:28:43.954331 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bbd350e3-2bf0-4b40-8241-fca2d396cbae tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:43.960872 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-bbd350e3-2bf0-4b40-8241-fca2d396cbae tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] 10.222.0.24 "DELETE /v2.0/networks/75870ad8-ef8a-45f1-844d-3431d361c402 HTTP/1.1" status: 204 len: 168 time: 1.4160855 Nov 09 04:28:43.965532 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52634) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:43.976639 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-e23b1ce5-d6a0-40b0-9eb2-dfb4c99f27b7 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Request body: {'network': {'name': 'tempest-network--1082526774'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:44.006677 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b7f8a270-f420-4c2f-9894-a6e81ce74683 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:44.014828 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3c06c207-9f31-45e8-b4fc-e6b18ff38a67 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:44.016690 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbd350e3-2bf0-4b40-8241-fca2d396cbae tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Pushing event deleted for resources: {'Network': ['ID=75870ad8-ef8a-45f1-844d-3431d361c402,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:44.064192 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efbe6138-7f35-4a78-b226-c4382f39ee20 req-5551b892-7bd3-4e59-92cc-3df5fee45408 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:44.071278 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-efbe6138-7f35-4a78-b226-c4382f39ee20 req-5551b892-7bd3-4e59-92cc-3df5fee45408 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.24 "GET /v2.0/networks?id=468b2f91-119a-402c-b695-5d7963ec6348 HTTP/1.1" status: 200 len: 811 time: 0.4437230 Nov 09 04:28:44.104814 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-3c06c207-9f31-45e8-b4fc-e6b18ff38a67 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Calling delete_port for 234ca806-27f1-4135-a54d-05e012b59029 owned by {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:28:44.115442 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-efbe6138-7f35-4a78-b226-c4382f39ee20 req-57b909aa-e1ca-4ba8-9e4e-2bc28ebe5471 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.24 "GET /v2.0/quotas/5f3cd2a3586e46c09f847681f744075c HTTP/1.1" status: 200 len: 375 time: 0.0432801 Nov 09 04:28:44.126736 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-6a216a4f-0290-4523-be63-1a8cef2c6cb0 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Deleting port 01a330ac-5672-48a1-9331-e0160428ff9d {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:28:44.127070 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6a216a4f-0290-4523-be63-1a8cef2c6cb0 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:44.283463 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e23b1ce5-d6a0-40b0-9eb2-dfb4c99f27b7 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Made reservation on behalf of 50f2f3df9a9441cd84e52ab52b9432fc for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:28:44.285749 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e23b1ce5-d6a0-40b0-9eb2-dfb4c99f27b7 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:44.324582 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-4c794131-5142-436e-9323-737975129d90 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Allocated IP 2001:db8::c5 (daccf5f5-3ea8-4f1b-ab62-78949d47bb91/88d0e868-7936-4409-8f96-0f4e98202b5e/f51fc55b-875a-40f1-9ac8-2fa2854463de) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:28:44.357503 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e23b1ce5-d6a0-40b0-9eb2-dfb4c99f27b7 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 320} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:28:44.385584 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e23b1ce5-d6a0-40b0-9eb2-dfb4c99f27b7 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:44.385941 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-e23b1ce5-d6a0-40b0-9eb2-dfb4c99f27b7 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Added segment 15e3935e-63fa-4d04-beaf-7b1170019797 of type vlan for network 6dc7ab4d-2a23-4467-af70-eaf52e458c7b Nov 09 04:28:44.472636 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-6a216a4f-0290-4523-be63-1a8cef2c6cb0 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] For port 01a330ac-5672-48a1-9331-e0160428ff9d, host hv-neutron-8168, got binding levels [] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:28:44.473837 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6a216a4f-0290-4523-be63-1a8cef2c6cb0 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:44.512355 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-efbe6138-7f35-4a78-b226-c4382f39ee20 req-e1c68a57-ac9f-4539-a65e-bab149e9eea7 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.24 "GET /v2.0/ports?tenant_id=5f3cd2a3586e46c09f847681f744075c&fields=id HTTP/1.1" status: 200 len: 348 time: 0.3873210 Nov 09 04:28:44.519677 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e23b1ce5-d6a0-40b0-9eb2-dfb4c99f27b7 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:44.522663 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-6a216a4f-0290-4523-be63-1a8cef2c6cb0 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Calling delete_port for 01a330ac-5672-48a1-9331-e0160428ff9d owned by {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:28:44.640038 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b7f8a270-f420-4c2f-9894-a6e81ce74683 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:44.674146 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4c794131-5142-436e-9323-737975129d90 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:44.680001 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3c06c207-9f31-45e8-b4fc-e6b18ff38a67 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:44.694340 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b7f8a270-f420-4c2f-9894-a6e81ce74683 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:44.713789 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e23b1ce5-d6a0-40b0-9eb2-dfb4c99f27b7 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:44.714733 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e23b1ce5-d6a0-40b0-9eb2-dfb4c99f27b7 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:44.715296 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e23b1ce5-d6a0-40b0-9eb2-dfb4c99f27b7 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:44.720282 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c06c207-9f31-45e8-b4fc-e6b18ff38a67 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Pushing event deleted for resources: {'Port': ['ID=234ca806-27f1-4135-a54d-05e012b59029,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:44.747096 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6a216a4f-0290-4523-be63-1a8cef2c6cb0 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:44.774791 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6a216a4f-0290-4523-be63-1a8cef2c6cb0 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:44.780844 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-6a216a4f-0290-4523-be63-1a8cef2c6cb0 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] 10.222.0.24 "DELETE /v2.0/ports/01a330ac-5672-48a1-9331-e0160428ff9d HTTP/1.1" status: 204 len: 168 time: 1.0806217 Nov 09 04:28:44.787177 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52660) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:44.803745 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b7f8a270-f420-4c2f-9894-a6e81ce74683 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:44.805997 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7f8a270-f420-4c2f-9894-a6e81ce74683 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Pushing event updated for resources: {'Port': ['ID=15c6d8e0-f7f0-4d07-8e83-c2d1157476d4,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:44.848439 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-163ed713-3f34-46b5-8e9b-e2d739330e0f tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] GET failed (client error): The resource could not be found. Nov 09 04:28:44.849919 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-163ed713-3f34-46b5-8e9b-e2d739330e0f tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] 10.222.0.24 "GET /v2.0/ports/01a330ac-5672-48a1-9331-e0160428ff9d HTTP/1.1" status: 404 len: 333 time: 0.0618289 Nov 09 04:28:44.869096 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52664) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:44.925204 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a216a4f-0290-4523-be63-1a8cef2c6cb0 tempest-PortsAdminExtendedAttrsTestJSON-514482619 tempest-PortsAdminExtendedAttrsTestJSON-514482619-project-admin] Pushing event deleted for resources: {'Port': ['ID=01a330ac-5672-48a1-9331-e0160428ff9d,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:44.963271 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [req-efbe6138-7f35-4a78-b226-c4382f39ee20 req-22df1df1-678a-433e-96ca-4c1dd4c56e8e service neutron] http://10.222.0.24:9696/v2.0/extensions returned with HTTP 200 {{(pid=102161) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:28:44.971411 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-efbe6138-7f35-4a78-b226-c4382f39ee20 req-22df1df1-678a-433e-96ca-4c1dd4c56e8e service neutron] 10.222.0.24 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.2725143 Nov 09 04:28:44.997115 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-03dc905c-6456-4e40-8905-3af9f272d5ed tempest-PortsAdminExtendedAttrsTestJSON-1597080349 tempest-PortsAdminExtendedAttrsTestJSON-1597080349-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:45.010832 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e23b1ce5-d6a0-40b0-9eb2-dfb4c99f27b7 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 864 time: 1.0349822 Nov 09 04:28:45.010832 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e23b1ce5-d6a0-40b0-9eb2-dfb4c99f27b7 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Pushing event updated for resources: {'Network': ['ID=6dc7ab4d-2a23-4467-af70-eaf52e458c7b,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:45.011445 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52668) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:45.016508 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-1e696e93-3361-449d-892d-ed0ad1ee2822 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Request body: {'network': {'router:external': True}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:45.066957 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 6dc7ab4d-2a23-4467-af70-eaf52e458c7b details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:28:45.071246 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:45.313854 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4c794131-5142-436e-9323-737975129d90 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:45.354169 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2f63f2e5-227c-47ca-b1fd-6ed4a62ce35b req-6aee9c6e-0578-44d8-85e6-a51af7e71df1 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "GET /v2.0/ports?device_id=fd8e39fc-699b-4777-aae4-ca592a898437 HTTP/1.1" status: 200 len: 210 time: 0.3516147 Nov 09 04:28:45.378463 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b7f8a270-f420-4c2f-9894-a6e81ce74683 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Network b103fb67-62b2-4eeb-9e21-70ef83ccb4b2 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:28:45.381600 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-b7f8a270-f420-4c2f-9894-a6e81ce74683 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:28:45.385681 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-efbe6138-7f35-4a78-b226-c4382f39ee20 req-9216272c-0c28-4dfb-8876-c6dd04d8f4b2 service neutron] 10.222.0.24 "GET /v2.0/networks/468b2f91-119a-402c-b695-5d7963ec6348?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4133925 Nov 09 04:28:45.483982 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4c794131-5142-436e-9323-737975129d90 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Network daccf5f5-3ea8-4f1b-ab62-78949d47bb91 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:28:45.491004 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c794131-5142-436e-9323-737975129d90 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Pushing event updated for resources: {'Port': ['ID=f51fc55b-875a-40f1-9ac8-2fa2854463de,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:45.494087 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-4c794131-5142-436e-9323-737975129d90 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:28:45.501666 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4c794131-5142-436e-9323-737975129d90 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:28:45.507352 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4c794131-5142-436e-9323-737975129d90 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:45.508092 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4c794131-5142-436e-9323-737975129d90 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:45.567082 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52680) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:45.657744 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3c06c207-9f31-45e8-b4fc-e6b18ff38a67 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:45.666766 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-3c06c207-9f31-45e8-b4fc-e6b18ff38a67 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] 10.222.0.24 "DELETE /v2.0/ports/234ca806-27f1-4135-a54d-05e012b59029 HTTP/1.1" status: 204 len: 168 time: 2.2700338 Nov 09 04:28:45.667553 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-efbe6138-7f35-4a78-b226-c4382f39ee20 req-cf741328-2e3d-43f7-bbf6-a5c19c513f0c service neutron] 10.222.0.24 "GET /v2.0/networks/468b2f91-119a-402c-b695-5d7963ec6348?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2728655 Nov 09 04:28:45.670579 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52684) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:45.685696 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-03dc905c-6456-4e40-8905-3af9f272d5ed tempest-PortsAdminExtendedAttrsTestJSON-1597080349 tempest-PortsAdminExtendedAttrsTestJSON-1597080349-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:45.708760 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-22715781-b29e-4a4a-9eb5-07e4c0dcd276 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] GET failed (client error): The resource could not be found. Nov 09 04:28:45.710644 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-22715781-b29e-4a4a-9eb5-07e4c0dcd276 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] 10.222.0.24 "GET /v2.0/ports/234ca806-27f1-4135-a54d-05e012b59029 HTTP/1.1" status: 404 len: 333 time: 0.0391247 Nov 09 04:28:45.718400 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52686) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:45.725168 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-067813ad-e86a-4ba2-999f-19a6647662fe tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Request body: {'port': {'network_id': 'e96f4292-19f0-4446-b093-408610b619f1', 'name': 'tempest-AllowedAddressPairTestJSON-1504638074'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:45.731209 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-03dc905c-6456-4e40-8905-3af9f272d5ed tempest-PortsAdminExtendedAttrsTestJSON-1597080349 tempest-PortsAdminExtendedAttrsTestJSON-1597080349-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6005ba78-d658-44f4-bad3-93b8496ee6db']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:28:45.735244 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1e696e93-3361-449d-892d-ed0ad1ee2822 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:45.762211 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-5c825800-38be-49e1-af93-f694ccf48ae8 tempest-QuotasTest-273245475 tempest-QuotasTest-273245475-project-admin] Request body: {'quota': {'network': 0, 'port': 0}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:45.764280 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b7f8a270-f420-4c2f-9894-a6e81ce74683 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Router cd21e659-1094-4653-b570-03e6ed4305e3 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:28:45.788441 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-4c794131-5142-436e-9323-737975129d90 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 943 time: 2.5171506 Nov 09 04:28:45.797455 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-03dc905c-6456-4e40-8905-3af9f272d5ed tempest-PortsAdminExtendedAttrsTestJSON-1597080349 tempest-PortsAdminExtendedAttrsTestJSON-1597080349-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:28:45.797455 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-03dc905c-6456-4e40-8905-3af9f272d5ed tempest-PortsAdminExtendedAttrsTestJSON-1597080349 tempest-PortsAdminExtendedAttrsTestJSON-1597080349-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f1d2aaca-546e-49c2-8ff8-bfb9007964b1') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:28:45.797455 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52688) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:45.814302 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-83336f48-a734-4409-b623-6773307ab45e tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Request body: {'port': {'allowed_address_pairs': [{'ip_address': '2001:db8::23b', 'mac_address': 'fa:16:3e:87:f8:a2'}]}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:45.824880 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-03dc905c-6456-4e40-8905-3af9f272d5ed tempest-PortsAdminExtendedAttrsTestJSON-1597080349 tempest-PortsAdminExtendedAttrsTestJSON-1597080349-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:45.864452 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-03dc905c-6456-4e40-8905-3af9f272d5ed tempest-PortsAdminExtendedAttrsTestJSON-1597080349 tempest-PortsAdminExtendedAttrsTestJSON-1597080349-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:45.875631 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1e696e93-3361-449d-892d-ed0ad1ee2822 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:45.887223 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e0b1a5b8-770e-445e-b442-d13d0993f4a7 None None] Provisioning complete for port f51fc55b-875a-40f1-9ac8-2fa2854463de triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:28:45.887596 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e0b1a5b8-770e-445e-b442-d13d0993f4a7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:45.909447 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-03dc905c-6456-4e40-8905-3af9f272d5ed tempest-PortsAdminExtendedAttrsTestJSON-1597080349 tempest-PortsAdminExtendedAttrsTestJSON-1597080349-project] Releasing vlan 336 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:28:45.910050 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-03dc905c-6456-4e40-8905-3af9f272d5ed tempest-PortsAdminExtendedAttrsTestJSON-1597080349 tempest-PortsAdminExtendedAttrsTestJSON-1597080349-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:45.916467 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:28:45.916467 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:28:45.916467 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:28:45.916467 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:28:45.916467 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:28:45.916467 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:28:45.916467 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:28:45.916467 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:28:45.916467 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:28:45.916467 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:28:45.916467 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:28:45.916467 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:28:45.916467 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:28:45.916467 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:28:45.916467 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:28:45.916467 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:28:45.916467 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:28:45.916467 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:28:45.916467 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:28:45.916467 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:28:45.916467 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:28:45.916467 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:28:45.916467 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:28:45.916467 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:28:45.916467 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:28:45.916467 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:28:45.916467 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:28:45.916467 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:28:45.916467 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:28:45.916467 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:28:45.916467 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:28:45.916467 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:28:45.939504 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-1e696e93-3361-449d-892d-ed0ad1ee2822 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Network 6dc7ab4d-2a23-4467-af70-eaf52e458c7b is not hosted by any dhcp agent {{(pid=102162) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Nov 09 04:28:45.940448 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1e696e93-3361-449d-892d-ed0ad1ee2822 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:45.941085 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1e696e93-3361-449d-892d-ed0ad1ee2822 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:45.942602 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e0b1a5b8-770e-445e-b442-d13d0993f4a7 None None] Port f51fc55b-875a-40f1-9ac8-2fa2854463de cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:28:45.945401 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-1e696e93-3361-449d-892d-ed0ad1ee2822 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] 10.222.0.24 "PUT /v2.0/networks/6dc7ab4d-2a23-4467-af70-eaf52e458c7b HTTP/1.1" status: 200 len: 858 time: 0.9332087 Nov 09 04:28:45.954447 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52690) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:45.971143 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e0b1a5b8-770e-445e-b442-d13d0993f4a7 None None] Provisioning complete for port 15c6d8e0-f7f0-4d07-8e83-c2d1157476d4 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:28:45.971651 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e0b1a5b8-770e-445e-b442-d13d0993f4a7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:46.013417 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b7f8a270-f420-4c2f-9894-a6e81ce74683 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:28:46.024991 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d3ee147a-41a1-4ae7-9204-9bd92529ce32 None None] Sync routers for ids ['cd21e659-1094-4653-b570-03e6ed4305e3'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:28:46.027481 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-b7f8a270-f420-4c2f-9894-a6e81ce74683 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] 10.222.0.24 "PUT /v2.0/routers/cd21e659-1094-4653-b570-03e6ed4305e3/add_router_interface HTTP/1.1" status: 200 len: 503 time: 8.0640035 Nov 09 04:28:46.028108 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52692) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:46.038863 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e0b1a5b8-770e-445e-b442-d13d0993f4a7 None None] Port 15c6d8e0-f7f0-4d07-8e83-c2d1157476d4 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:28:46.042214 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-f9a9105d-59d6-4945-a785-18e5d7afe664 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Request body: {'port': {'network_id': 'b103fb67-62b2-4eeb-9e21-70ef83ccb4b2', 'name': 'tempest-FloatingIPAdminTestJSON-20164413'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:46.044252 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d3ee147a-41a1-4ae7-9204-9bd92529ce32 None None] Routers {'cd21e659-1094-4653-b570-03e6ed4305e3'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:28:46.044941 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-d3ee147a-41a1-4ae7-9204-9bd92529ce32 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:28:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['cd21e659-1094-4653-b570-03e6ed4305e3'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:28:46.082224 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-d3ee147a-41a1-4ae7-9204-9bd92529ce32 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:28:46.091669 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d3ee147a-41a1-4ae7-9204-9bd92529ce32 None None] Routers {'cd21e659-1094-4653-b570-03e6ed4305e3'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:28:46.091873 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-d3ee147a-41a1-4ae7-9204-9bd92529ce32 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:28:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['cd21e659-1094-4653-b570-03e6ed4305e3'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:28:46.133896 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-d3ee147a-41a1-4ae7-9204-9bd92529ce32 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:28:46.134666 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d3ee147a-41a1-4ae7-9204-9bd92529ce32 None None] The sync data for ids ['cd21e659-1094-4653-b570-03e6ed4305e3'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:28:46.157900 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e696e93-3361-449d-892d-ed0ad1ee2822 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Pushing event updated for resources: {'Network': ['ID=6dc7ab4d-2a23-4467-af70-eaf52e458c7b,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:46.183691 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9445a7ff-9c7b-4031-81f1-83ecb34c6d92 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:46.243421 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-03dc905c-6456-4e40-8905-3af9f272d5ed tempest-PortsAdminExtendedAttrsTestJSON-1597080349 tempest-PortsAdminExtendedAttrsTestJSON-1597080349-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:46.250710 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-067813ad-e86a-4ba2-999f-19a6647662fe tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Made reservation on behalf of a369b57921894b01a70b43c4f969d224 for: {'port': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:28:46.250845 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d4e08498-092f-41c1-8d5a-978db0632fad req-0dac14ac-6f49-40ce-b606-124113af9f82 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.24 "GET /v2.0/ports?device_id=1aa3bc74-67df-4706-979b-cbf709855232 HTTP/1.1" status: 200 len: 210 time: 0.0642180 Nov 09 04:28:46.252704 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-067813ad-e86a-4ba2-999f-19a6647662fe tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:46.263434 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-03dc905c-6456-4e40-8905-3af9f272d5ed tempest-PortsAdminExtendedAttrsTestJSON-1597080349 tempest-PortsAdminExtendedAttrsTestJSON-1597080349-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:46.266681 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-03dc905c-6456-4e40-8905-3af9f272d5ed tempest-PortsAdminExtendedAttrsTestJSON-1597080349 tempest-PortsAdminExtendedAttrsTestJSON-1597080349-project] 10.222.0.24 "DELETE /v2.0/networks/6005ba78-d658-44f4-bad3-93b8496ee6db HTTP/1.1" status: 204 len: 168 time: 1.3962138 Nov 09 04:28:46.294006 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-5c825800-38be-49e1-af93-f694ccf48ae8 tempest-QuotasTest-273245475 tempest-QuotasTest-273245475-project-admin] 10.222.0.24 "PUT /v2.0/quotas/9204a293cf0545a3ac82e89fc1f34f3d HTTP/1.1" status: 200 len: 366 time: 0.7158699 Nov 09 04:28:46.294496 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [None req-067813ad-e86a-4ba2-999f-19a6647662fe tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] device_id is not set on port 2c2624f2-2286-427f-bd68-0289b5dab6e7 yet. {{(pid=102161) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:28:46.294613 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-83336f48-a734-4409-b623-6773307ab45e tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:46.294613 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03dc905c-6456-4e40-8905-3af9f272d5ed tempest-PortsAdminExtendedAttrsTestJSON-1597080349 tempest-PortsAdminExtendedAttrsTestJSON-1597080349-project] Pushing event deleted for resources: {'Network': ['ID=6005ba78-d658-44f4-bad3-93b8496ee6db,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:46.296342 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52708) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:46.336806 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-19b68217-bf60-4522-ae69-116d153a9c1e tempest-QuotasTest-273245475 tempest-QuotasTest-273245475-project-admin] 10.222.0.24 "GET /v2.0/quotas HTTP/1.1" status: 200 len: 468 time: 0.0388672 Nov 09 04:28:46.339746 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52710) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:46.359668 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-e4ef09fb-bca2-4b7b-82e1-e15c476abcfd tempest-QuotasTest-273245475 tempest-QuotasTest-273245475-project-admin] 10.222.0.24 "GET /v2.0/quotas/9204a293cf0545a3ac82e89fc1f34f3d HTTP/1.1" status: 200 len: 366 time: 0.0181758 Nov 09 04:28:46.361922 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52712) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:46.384845 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f9a9105d-59d6-4945-a785-18e5d7afe664 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Made reservation on behalf of 00757dadf44e4dd1a48e6e44b03816b0 for: {'port': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:28:46.389050 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f9a9105d-59d6-4945-a785-18e5d7afe664 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:46.410137 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:46.419764 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9445a7ff-9c7b-4031-81f1-83ecb34c6d92 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:46.431179 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [None req-f9a9105d-59d6-4945-a785-18e5d7afe664 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] device_id is not set on port ceb33408-7f98-40bc-9e0d-9341e2ff0309 yet. {{(pid=102161) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:28:46.453878 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-9445a7ff-9c7b-4031-81f1-83ecb34c6d92 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6dc7ab4d-2a23-4467-af70-eaf52e458c7b']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:28:46.483185 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-9445a7ff-9c7b-4031-81f1-83ecb34c6d92 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '15e3935e-63fa-4d04-beaf-7b1170019797') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:28:46.484686 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-9445a7ff-9c7b-4031-81f1-83ecb34c6d92 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '15e3935e-63fa-4d04-beaf-7b1170019797') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:28:46.496985 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-b028131d-9127-4aa3-844d-22344e56bb86 tempest-QuotasTest-273245475 tempest-QuotasTest-273245475-project-admin] 10.222.0.24 "DELETE /v2.0/quotas/9204a293cf0545a3ac82e89fc1f34f3d HTTP/1.1" status: 204 len: 168 time: 0.1315010 Nov 09 04:28:46.497879 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52720) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:46.511932 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-067813ad-e86a-4ba2-999f-19a6647662fe tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Allocated IP 172.20.0.14 (e96f4292-19f0-4446-b093-408610b619f1/300c7541-d41f-47e3-ad5e-4d083e87c290/2c2624f2-2286-427f-bd68-0289b5dab6e7) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:28:46.571086 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9445a7ff-9c7b-4031-81f1-83ecb34c6d92 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:46.582162 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-60941ea3-6d25-4351-8ff8-ca3281e94266 tempest-QuotasTest-273245475 tempest-QuotasTest-273245475-project-admin] 10.222.0.24 "GET /v2.0/quotas HTTP/1.1" status: 200 len: 207 time: 0.0816760 Nov 09 04:28:46.587445 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52724) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:46.595741 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9445a7ff-9c7b-4031-81f1-83ecb34c6d92 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:46.596893 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-f9a9105d-59d6-4945-a785-18e5d7afe664 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Allocated IP 172.20.0.14 (b103fb67-62b2-4eeb-9e21-70ef83ccb4b2/84708fd2-e56f-45d8-a028-d5c7839aba25/ceb33408-7f98-40bc-9e0d-9341e2ff0309) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:28:46.616039 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9445a7ff-9c7b-4031-81f1-83ecb34c6d92 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Releasing vlan 320 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:28:46.616478 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9445a7ff-9c7b-4031-81f1-83ecb34c6d92 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:46.619719 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-85f16d25-14a3-48b5-9049-7e7f8b6dba74 tempest-QuotasTest-273245475 tempest-QuotasTest-273245475-project-admin] 10.222.0.24 "GET /v2.0/quotas/9204a293cf0545a3ac82e89fc1f34f3d HTTP/1.1" status: 200 len: 370 time: 0.0314009 Nov 09 04:28:46.620572 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:28:46.620572 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:28:46.620572 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:28:46.620572 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:28:46.620572 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:28:46.620572 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:28:46.620572 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:28:46.620572 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:28:46.620572 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:28:46.620572 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:28:46.620572 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:28:46.620572 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:28:46.620572 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:28:46.620572 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:28:46.620572 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:28:46.620572 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:28:46.620572 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:28:46.620572 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:28:46.620572 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:28:46.620572 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:28:46.620572 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:28:46.620572 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:28:46.620572 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:28:46.620572 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:28:46.620572 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:28:46.620572 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:28:46.620572 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:28:46.620572 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:28:46.620572 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:28:46.620572 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:28:46.620572 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:28:46.620572 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:28:46.633449 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52730) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:46.639623 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-c52bfffa-fe49-4cb4-acad-372eb0db7a9d tempest-QuotasTest-273245475 tempest-QuotasTest-273245475-project-admin] 10.222.0.24 "GET /v2.0/quotas/9204a293cf0545a3ac82e89fc1f34f3d/default HTTP/1.1" status: 200 len: 370 time: 0.0038331 Nov 09 04:28:46.650206 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52734) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:46.715468 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-83336f48-a734-4409-b623-6773307ab45e tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:46.734183 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c8610260-ba2f-40a8-9e53-64f8f074e8a8 req-66f0ede9-4b73-4741-8186-e893947e6d07 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "GET /v2.0/ports?device_id=fd8e39fc-699b-4777-aae4-ca592a898437 HTTP/1.1" status: 200 len: 210 time: 0.0900149 Nov 09 04:28:46.743128 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-e1d52936-4432-41df-889f-8e15b1abad9e tempest-QuotasTest-273245475 tempest-QuotasTest-273245475-project-admin] delete failed (client error): The resource could not be found. Nov 09 04:28:46.744740 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-e1d52936-4432-41df-889f-8e15b1abad9e tempest-QuotasTest-273245475 tempest-QuotasTest-273245475-project-admin] 10.222.0.24 "DELETE /v2.0/quotas/9204a293cf0545a3ac82e89fc1f34f3d HTTP/1.1" status: 404 len: 348 time: 0.0930245 Nov 09 04:28:46.846847 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9445a7ff-9c7b-4031-81f1-83ecb34c6d92 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:46.849739 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9445a7ff-9c7b-4031-81f1-83ecb34c6d92 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network 6dc7ab4d-2a23-4467-af70-eaf52e458c7b {{(pid=102162) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:120}} Nov 09 04:28:46.861290 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9445a7ff-9c7b-4031-81f1-83ecb34c6d92 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:46.865410 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-9445a7ff-9c7b-4031-81f1-83ecb34c6d92 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] 10.222.0.24 "DELETE /v2.0/networks/6dc7ab4d-2a23-4467-af70-eaf52e458c7b HTTP/1.1" status: 204 len: 168 time: 0.9004486 Nov 09 04:28:46.866789 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9445a7ff-9c7b-4031-81f1-83ecb34c6d92 tempest-ExternalNetworksTestJSON-426971159 tempest-ExternalNetworksTestJSON-426971159-project-admin] Pushing event deleted for resources: {'Network': ['ID=6dc7ab4d-2a23-4467-af70-eaf52e458c7b,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:46.868606 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52738) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:46.900831 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f9a9105d-59d6-4945-a785-18e5d7afe664 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:46.916882 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-83336f48-a734-4409-b623-6773307ab45e tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:46.922661 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-db091349-3aa6-4e24-9272-b3e9a42293ed tempest-ExternalNetworksTestJSON-1286645568 tempest-ExternalNetworksTestJSON-1286645568-project] DELETE failed (client error): The resource could not be found. Nov 09 04:28:46.923168 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-db091349-3aa6-4e24-9272-b3e9a42293ed tempest-ExternalNetworksTestJSON-1286645568 tempest-ExternalNetworksTestJSON-1286645568-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:28:46.926388 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-db091349-3aa6-4e24-9272-b3e9a42293ed tempest-ExternalNetworksTestJSON-1286645568 tempest-ExternalNetworksTestJSON-1286645568-project] 10.222.0.24 "DELETE /v2.0/subnets/4e4a617b-3903-4f63-b43d-7b6ec4c3091f HTTP/1.1" status: 404 len: 337 time: 0.0568221 Nov 09 04:28:46.935039 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-067813ad-e86a-4ba2-999f-19a6647662fe tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:46.951491 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52740) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:46.980702 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:46.983879 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-83336f48-a734-4409-b623-6773307ab45e tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] In _notify_port_updated(), no bound segment for port f51fc55b-875a-40f1-9ac8-2fa2854463de on network daccf5f5-3ea8-4f1b-ab62-78949d47bb91 {{(pid=102162) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 09 04:28:46.989748 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-83336f48-a734-4409-b623-6773307ab45e tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:46.990417 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-83336f48-a734-4409-b623-6773307ab45e tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:47.000548 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-83336f48-a734-4409-b623-6773307ab45e tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] 10.222.0.24 "PUT /v2.0/ports/f51fc55b-875a-40f1-9ac8-2fa2854463de HTTP/1.1" status: 200 len: 1002 time: 1.1877346 Nov 09 04:28:47.000548 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52744) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:47.037633 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.26', 56229) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:47.094617 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f9a9105d-59d6-4945-a785-18e5d7afe664 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:47.132425 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83336f48-a734-4409-b623-6773307ab45e tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Pushing event updated for resources: {'Port': ['ID=f51fc55b-875a-40f1-9ac8-2fa2854463de,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:47.132425 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52746) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:47.151605 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-085192f8-b4bf-4de8-a241-39030d912bcd tempest-ExternalNetworksTestJSON-1286645568 tempest-ExternalNetworksTestJSON-1286645568-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:47.169419 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52748) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:47.239736 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-ee84595c-8d57-48ad-ac3b-f90d59764e69 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Deleting port f51fc55b-875a-40f1-9ac8-2fa2854463de {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:28:47.245351 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ee84595c-8d57-48ad-ac3b-f90d59764e69 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:47.269610 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f9a9105d-59d6-4945-a785-18e5d7afe664 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Network b103fb67-62b2-4eeb-9e21-70ef83ccb4b2 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:28:47.276361 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-f9a9105d-59d6-4945-a785-18e5d7afe664 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:28:47.286913 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.quota.resource [None req-3572f915-bfaf-4fc6-bb59-87d116ffdf19 tempest-QuotasTest-273245475 tempest-QuotasTest-273245475-project-admin] Usage tracker for resource:network and project:94b0e713f9ce4e7bb03e7bb2e009ca42 is out of sync, need to count used quota {{(pid=102162) count_used /opt/stack/neutron/neutron/quota/resource.py:291}} Nov 09 04:28:47.288045 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f9a9105d-59d6-4945-a785-18e5d7afe664 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:28:47.354641 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9a9105d-59d6-4945-a785-18e5d7afe664 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Pushing event updated for resources: {'Port': ['ID=ceb33408-7f98-40bc-9e0d-9341e2ff0309,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:47.358506 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-067813ad-e86a-4ba2-999f-19a6647662fe tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:47.371230 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.quota.resource [None req-3572f915-bfaf-4fc6-bb59-87d116ffdf19 tempest-QuotasTest-273245475 tempest-QuotasTest-273245475-project-admin] Quota usage for network was recalculated. Used quota:0. {{(pid=102162) count_used /opt/stack/neutron/neutron/quota/resource.py:312}} Nov 09 04:28:47.466835 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.quota.resource [None req-3572f915-bfaf-4fc6-bb59-87d116ffdf19 tempest-QuotasTest-273245475 tempest-QuotasTest-273245475-project-admin] Usage tracker for resource:subnet and project:94b0e713f9ce4e7bb03e7bb2e009ca42 is out of sync, need to count used quota {{(pid=102162) count_used /opt/stack/neutron/neutron/quota/resource.py:291}} Nov 09 04:28:47.505996 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-067813ad-e86a-4ba2-999f-19a6647662fe tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Network e96f4292-19f0-4446-b093-408610b619f1 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:28:47.521832 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-067813ad-e86a-4ba2-999f-19a6647662fe tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:28:47.533519 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f9a9105d-59d6-4945-a785-18e5d7afe664 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:47.534340 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f9a9105d-59d6-4945-a785-18e5d7afe664 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:47.536908 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-067813ad-e86a-4ba2-999f-19a6647662fe tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Pushing event updated for resources: {'Port': ['ID=2c2624f2-2286-427f-bd68-0289b5dab6e7,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:47.537733 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-085192f8-b4bf-4de8-a241-39030d912bcd tempest-ExternalNetworksTestJSON-1286645568 tempest-ExternalNetworksTestJSON-1286645568-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:47.540429 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-067813ad-e86a-4ba2-999f-19a6647662fe tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:28:47.576651 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d21e6a7-b79e-45b1-b623-e6e8ad863c22 req-b47e7f2f-d2d6-428a-b8ce-5026078c4d47 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:47.578203 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-4d21e6a7-b79e-45b1-b623-e6e8ad863c22 req-b47e7f2f-d2d6-428a-b8ce-5026078c4d47 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.26 "GET /v2.0/networks?id=d4ba3288-221c-40f3-a829-662c462cc93f HTTP/1.1" status: 200 len: 805 time: 0.5395992 Nov 09 04:28:47.626799 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-4801807b-384c-413c-ae4c-3f7e080f55e9 None None] Provisioning complete for port f51fc55b-875a-40f1-9ac8-2fa2854463de triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:28:47.632289 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4801807b-384c-413c-ae4c-3f7e080f55e9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:47.645090 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-067813ad-e86a-4ba2-999f-19a6647662fe tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:47.653702 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-067813ad-e86a-4ba2-999f-19a6647662fe tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:47.701625 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-f9a9105d-59d6-4945-a785-18e5d7afe664 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.6603463 Nov 09 04:28:47.706397 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52770) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:47.712099 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-4801807b-384c-413c-ae4c-3f7e080f55e9 None None] Port f51fc55b-875a-40f1-9ac8-2fa2854463de cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:28:47.786140 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-067813ad-e86a-4ba2-999f-19a6647662fe tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 2.0664103 Nov 09 04:28:47.789786 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52780) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:47.803403 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-271ce807-50a1-4a97-b1ec-78a7e128aa2f tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Request body: {'port': {'allowed_address_pairs': [{'ip_address': '172.20.0.7', 'mac_address': 'fa:16:3e:55:bc:e4'}]}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:47.846373 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-c0d0ed5a-5795-43e2-b675-18b076d9c36f None None] Provisioning complete for port ceb33408-7f98-40bc-9e0d-9341e2ff0309 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:28:47.850469 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c0d0ed5a-5795-43e2-b675-18b076d9c36f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:47.927934 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-c0d0ed5a-5795-43e2-b675-18b076d9c36f None None] Port ceb33408-7f98-40bc-9e0d-9341e2ff0309 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:28:47.962223 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c9fbe75b-9aec-45c1-946c-e4764048cd20 req-7c86b93f-fa7a-42f4-8f71-963a7c645092 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "GET /v2.0/ports?device_id=fd8e39fc-699b-4777-aae4-ca592a898437 HTTP/1.1" status: 200 len: 210 time: 0.0643890 Nov 09 04:28:47.984887 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ee8d1cbc-3eb1-49ff-84f2-d9c2eac4de7b req-c70fda2a-9ce7-4f53-a3a6-690ff3591c89 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.24 "GET /v2.0/ports?device_id=1aa3bc74-67df-4706-979b-cbf709855232 HTTP/1.1" status: 200 len: 210 time: 0.5095294 Nov 09 04:28:47.985417 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-4d21e6a7-b79e-45b1-b623-e6e8ad863c22 req-e9f85ca9-571e-4180-b00c-3cd503ff6d5f tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.26 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=a229c806094b42c7a0f7ed52f78dfd68 HTTP/1.1" status: 200 len: 380 time: 0.3271525 Nov 09 04:28:47.985537 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.quota.resource [None req-3572f915-bfaf-4fc6-bb59-87d116ffdf19 tempest-QuotasTest-273245475 tempest-QuotasTest-273245475-project-admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=102162) count_used /opt/stack/neutron/neutron/quota/resource.py:312}} Nov 09 04:28:48.025810 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-085192f8-b4bf-4de8-a241-39030d912bcd tempest-ExternalNetworksTestJSON-1286645568 tempest-ExternalNetworksTestJSON-1286645568-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9b2f002d-0bf2-4dc9-bb94-06811489d8ac']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:28:48.046683 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-3b28cca1-3dc8-4a4f-9e35-904ed10e34f2 tempest-FloatingIPAdminTestJSON-625682852 tempest-FloatingIPAdminTestJSON-625682852-project-admin] Request body: {'floatingip': {'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'project_id': '00757dadf44e4dd1a48e6e44b03816b0', 'port_id': 'ceb33408-7f98-40bc-9e0d-9341e2ff0309'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:48.051837 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-b4d53a09-ea86-4295-9053-34cc786020a9 None None] Provisioning complete for port 2c2624f2-2286-427f-bd68-0289b5dab6e7 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:28:48.052487 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b4d53a09-ea86-4295-9053-34cc786020a9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:48.052981 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-5b8affea-b30a-4fab-a880-127686ef180b admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=c3e4bed72e4f4e48b6788e16f7ad8d0d&name=default HTTP/1.1" status: 200 len: 2992 time: 0.8744521 Nov 09 04:28:48.055779 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [req-4d21e6a7-b79e-45b1-b623-e6e8ad863c22 req-163a311a-7365-4b06-9793-09c4e01095e7 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Request body: {'port': {'device_id': 'fd8e39fc-699b-4777-aae4-ca592a898437', 'network_id': 'd4ba3288-221c-40f3-a829-662c462cc93f', 'admin_state_up': True, 'tenant_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'security_groups': ['67cb2d36-e38c-4a29-adb5-c52b1d94ae99']}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:48.056937 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-085192f8-b4bf-4de8-a241-39030d912bcd tempest-ExternalNetworksTestJSON-1286645568 tempest-ExternalNetworksTestJSON-1286645568-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '58a9d3dd-be9c-431a-93b4-3c80adba3d95') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:28:48.057233 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-085192f8-b4bf-4de8-a241-39030d912bcd tempest-ExternalNetworksTestJSON-1286645568 tempest-ExternalNetworksTestJSON-1286645568-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '58a9d3dd-be9c-431a-93b4-3c80adba3d95') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:28:48.059065 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.quota.resource [None req-3572f915-bfaf-4fc6-bb59-87d116ffdf19 tempest-QuotasTest-273245475 tempest-QuotasTest-273245475-project-admin] Usage tracker for resource:subnetpool and project:94b0e713f9ce4e7bb03e7bb2e009ca42 is out of sync, need to count used quota {{(pid=102162) count_used /opt/stack/neutron/neutron/quota/resource.py:291}} Nov 09 04:28:48.061335 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52788) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:48.068644 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ee84595c-8d57-48ad-ac3b-f90d59764e69 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:48.078544 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.quota.resource [None req-3572f915-bfaf-4fc6-bb59-87d116ffdf19 tempest-QuotasTest-273245475 tempest-QuotasTest-273245475-project-admin] Quota usage for subnetpool was recalculated. Used quota:0. {{(pid=102162) count_used /opt/stack/neutron/neutron/quota/resource.py:312}} Nov 09 04:28:48.083644 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-085192f8-b4bf-4de8-a241-39030d912bcd tempest-ExternalNetworksTestJSON-1286645568 tempest-ExternalNetworksTestJSON-1286645568-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:48.091423 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-b4d53a09-ea86-4295-9053-34cc786020a9 None None] Port 2c2624f2-2286-427f-bd68-0289b5dab6e7 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:28:48.093036 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-ee84595c-8d57-48ad-ac3b-f90d59764e69 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Calling delete_port for f51fc55b-875a-40f1-9ac8-2fa2854463de owned by {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:28:48.108279 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.quota.resource [None req-3572f915-bfaf-4fc6-bb59-87d116ffdf19 tempest-QuotasTest-273245475 tempest-QuotasTest-273245475-project-admin] Usage tracker for resource:port and project:94b0e713f9ce4e7bb03e7bb2e009ca42 is out of sync, need to count used quota {{(pid=102162) count_used /opt/stack/neutron/neutron/quota/resource.py:291}} Nov 09 04:28:48.111403 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-085192f8-b4bf-4de8-a241-39030d912bcd tempest-ExternalNetworksTestJSON-1286645568 tempest-ExternalNetworksTestJSON-1286645568-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:48.146032 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-085192f8-b4bf-4de8-a241-39030d912bcd tempest-ExternalNetworksTestJSON-1286645568 tempest-ExternalNetworksTestJSON-1286645568-project] Releasing vlan 339 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:28:48.146384 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-085192f8-b4bf-4de8-a241-39030d912bcd tempest-ExternalNetworksTestJSON-1286645568 tempest-ExternalNetworksTestJSON-1286645568-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:48.149821 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.quota.resource [None req-3572f915-bfaf-4fc6-bb59-87d116ffdf19 tempest-QuotasTest-273245475 tempest-QuotasTest-273245475-project-admin] Quota usage for port was recalculated. Used quota:0. {{(pid=102162) count_used /opt/stack/neutron/neutron/quota/resource.py:312}} Nov 09 04:28:48.151568 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:28:48.151568 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:28:48.151568 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:28:48.151568 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:28:48.151568 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:28:48.151568 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:28:48.151568 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:28:48.151568 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:28:48.151568 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:28:48.151568 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:28:48.151568 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:28:48.151568 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:28:48.151568 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:28:48.151568 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:28:48.151568 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:28:48.151568 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:28:48.151568 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:28:48.151568 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:28:48.151568 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:28:48.151568 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:28:48.151568 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:28:48.151568 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:28:48.151568 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:28:48.151568 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:28:48.151568 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:28:48.151568 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:28:48.151568 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:28:48.151568 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:28:48.151568 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:28:48.151568 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:28:48.151568 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:28:48.151568 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:28:48.208509 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.quota.resource [None req-3572f915-bfaf-4fc6-bb59-87d116ffdf19 tempest-QuotasTest-273245475 tempest-QuotasTest-273245475-project-admin] Usage tracker for resource:router and project:94b0e713f9ce4e7bb03e7bb2e009ca42 is out of sync, need to count used quota {{(pid=102162) count_used /opt/stack/neutron/neutron/quota/resource.py:291}} Nov 09 04:28:48.222435 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.quota.resource [None req-3572f915-bfaf-4fc6-bb59-87d116ffdf19 tempest-QuotasTest-273245475 tempest-QuotasTest-273245475-project-admin] Quota usage for router was recalculated. Used quota:0. {{(pid=102162) count_used /opt/stack/neutron/neutron/quota/resource.py:312}} Nov 09 04:28:48.236681 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3b28cca1-3dc8-4a4f-9e35-904ed10e34f2 tempest-FloatingIPAdminTestJSON-625682852 tempest-FloatingIPAdminTestJSON-625682852-project-admin] Publish callbacks [] for floatingip, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:48.239456 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.quota.resource [None req-3572f915-bfaf-4fc6-bb59-87d116ffdf19 tempest-QuotasTest-273245475 tempest-QuotasTest-273245475-project-admin] Usage tracker for resource:floatingip and project:94b0e713f9ce4e7bb03e7bb2e009ca42 is out of sync, need to count used quota {{(pid=102162) count_used /opt/stack/neutron/neutron/quota/resource.py:291}} Nov 09 04:28:48.251096 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.quota.resource [None req-3572f915-bfaf-4fc6-bb59-87d116ffdf19 tempest-QuotasTest-273245475 tempest-QuotasTest-273245475-project-admin] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=102162) count_used /opt/stack/neutron/neutron/quota/resource.py:312}} Nov 09 04:28:48.274181 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d3a7abbb-2b51-4bcc-acf9-b121aa328e22 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:48.275969 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-271ce807-50a1-4a97-b1ec-78a7e128aa2f tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:48.312126 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-085192f8-b4bf-4de8-a241-39030d912bcd tempest-ExternalNetworksTestJSON-1286645568 tempest-ExternalNetworksTestJSON-1286645568-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:48.324894 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-085192f8-b4bf-4de8-a241-39030d912bcd tempest-ExternalNetworksTestJSON-1286645568 tempest-ExternalNetworksTestJSON-1286645568-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:48.328071 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-085192f8-b4bf-4de8-a241-39030d912bcd tempest-ExternalNetworksTestJSON-1286645568 tempest-ExternalNetworksTestJSON-1286645568-project] 10.222.0.24 "DELETE /v2.0/networks/9b2f002d-0bf2-4dc9-bb94-06811489d8ac HTTP/1.1" status: 204 len: 168 time: 1.3756406 Nov 09 04:28:48.348724 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-085192f8-b4bf-4de8-a241-39030d912bcd tempest-ExternalNetworksTestJSON-1286645568 tempest-ExternalNetworksTestJSON-1286645568-project] Pushing event deleted for resources: {'Network': ['ID=9b2f002d-0bf2-4dc9-bb94-06811489d8ac,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:48.352777 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d3a7abbb-2b51-4bcc-acf9-b121aa328e22 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:48.362372 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.quota.resource [None req-3572f915-bfaf-4fc6-bb59-87d116ffdf19 tempest-QuotasTest-273245475 tempest-QuotasTest-273245475-project-admin] Usage tracker for resource:security_group and project:94b0e713f9ce4e7bb03e7bb2e009ca42 is out of sync, need to count used quota {{(pid=102162) count_used /opt/stack/neutron/neutron/quota/resource.py:291}} Nov 09 04:28:48.365977 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.quota.resource [None req-3572f915-bfaf-4fc6-bb59-87d116ffdf19 tempest-QuotasTest-273245475 tempest-QuotasTest-273245475-project-admin] Quota usage for security_group was recalculated. Used quota:0. {{(pid=102162) count_used /opt/stack/neutron/neutron/quota/resource.py:312}} Nov 09 04:28:48.373544 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.quota.resource [None req-3572f915-bfaf-4fc6-bb59-87d116ffdf19 tempest-QuotasTest-273245475 tempest-QuotasTest-273245475-project-admin] Usage tracker for resource:security_group_rule and project:94b0e713f9ce4e7bb03e7bb2e009ca42 is out of sync, need to count used quota {{(pid=102162) count_used /opt/stack/neutron/neutron/quota/resource.py:291}} Nov 09 04:28:48.379672 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.quota.resource [None req-3572f915-bfaf-4fc6-bb59-87d116ffdf19 tempest-QuotasTest-273245475 tempest-QuotasTest-273245475-project-admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=102162) count_used /opt/stack/neutron/neutron/quota/resource.py:312}} Nov 09 04:28:48.386442 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-3572f915-bfaf-4fc6-bb59-87d116ffdf19 tempest-QuotasTest-273245475 tempest-QuotasTest-273245475-project-admin] 10.222.0.24 "GET /v2.0/quotas/94b0e713f9ce4e7bb03e7bb2e009ca42/details.json HTTP/1.1" status: 200 len: 703 time: 1.2502501 Nov 09 04:28:48.442219 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ee84595c-8d57-48ad-ac3b-f90d59764e69 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:48.473329 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4d21e6a7-b79e-45b1-b623-e6e8ad863c22 req-163a311a-7365-4b06-9793-09c4e01095e7 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Made reservation on behalf of a229c806094b42c7a0f7ed52f78dfd68 for: {'port': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:28:48.477443 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [req-4d21e6a7-b79e-45b1-b623-e6e8ad863c22 req-163a311a-7365-4b06-9793-09c4e01095e7 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:48.477779 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee84595c-8d57-48ad-ac3b-f90d59764e69 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Pushing event deleted for resources: {'Port': ['ID=f51fc55b-875a-40f1-9ac8-2fa2854463de,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:48.563060 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d3a7abbb-2b51-4bcc-acf9-b121aa328e22 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:48.570282 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ee84595c-8d57-48ad-ac3b-f90d59764e69 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:48.570799 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d3a7abbb-2b51-4bcc-acf9-b121aa328e22 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:48.577277 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-d3a7abbb-2b51-4bcc-acf9-b121aa328e22 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/5f540beb-ab47-400b-81f2-b762d2bc59ee HTTP/1.1" status: 204 len: 168 time: 0.5090685 Nov 09 04:28:48.577481 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-ee84595c-8d57-48ad-ac3b-f90d59764e69 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] 10.222.0.24 "DELETE /v2.0/ports/f51fc55b-875a-40f1-9ac8-2fa2854463de HTTP/1.1" status: 204 len: 168 time: 1.5762677 Nov 09 04:28:48.577481 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52804) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:48.603692 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-7c50d021-82cf-4fca-b8ae-d8ce1bd4746c tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] GET failed (client error): The resource could not be found. Nov 09 04:28:48.608810 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-7c50d021-82cf-4fca-b8ae-d8ce1bd4746c tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] 10.222.0.24 "GET /v2.0/ports/f51fc55b-875a-40f1-9ac8-2fa2854463de HTTP/1.1" status: 404 len: 333 time: 0.0278201 Nov 09 04:28:48.608955 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52808) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:48.614058 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-b1b02fdd-4b33-44e5-b6c0-e74ac8b96cc0 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Request body: {'port': {'network_id': 'daccf5f5-3ea8-4f1b-ab62-78949d47bb91', 'name': 'tempest-AllowedAddressPairIpV6TestJSON-1473404008'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:48.623529 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3b28cca1-3dc8-4a4f-9e35-904ed10e34f2 tempest-FloatingIPAdminTestJSON-625682852 tempest-FloatingIPAdminTestJSON-625682852-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:48.671430 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3a7abbb-2b51-4bcc-acf9-b121aa328e22 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5f540beb-ab47-400b-81f2-b762d2bc59ee,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:48.785060 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-271ce807-50a1-4a97-b1ec-78a7e128aa2f tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:48.874799 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [req-4d21e6a7-b79e-45b1-b623-e6e8ad863c22 req-163a311a-7365-4b06-9793-09c4e01095e7 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Allocated IP 172.20.0.6 (d4ba3288-221c-40f3-a829-662c462cc93f/b11be6b4-75f0-4756-9312-de5295f24e1b/9ce4bb36-a0c7-4517-abaf-8db99ca3bb12) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:28:48.902851 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-3b28cca1-3dc8-4a4f-9e35-904ed10e34f2 tempest-FloatingIPAdminTestJSON-625682852 tempest-FloatingIPAdminTestJSON-625682852-project-admin] Allocated IP 172.26.0.148 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/e44bbd89-4625-4e16-91ef-9daeff9b4ff3) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:28:48.906678 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b1b02fdd-4b33-44e5-b6c0-e74ac8b96cc0 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Made reservation on behalf of 18f5ee1caa74420f9ab67cc92c1e02e6 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:28:48.908354 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-271ce807-50a1-4a97-b1ec-78a7e128aa2f tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:48.920106 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b1b02fdd-4b33-44e5-b6c0-e74ac8b96cc0 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:48.954494 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [None req-b1b02fdd-4b33-44e5-b6c0-e74ac8b96cc0 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] device_id is not set on port 6ac21351-9127-4d2c-a5b8-b9cc6060f4d9 yet. {{(pid=102162) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:28:49.047115 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52820) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:49.163348 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52824) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:49.280168 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-b1b02fdd-4b33-44e5-b6c0-e74ac8b96cc0 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Allocated IP 2001:db8::3d (daccf5f5-3ea8-4f1b-ab62-78949d47bb91/88d0e868-7936-4409-8f96-0f4e98202b5e/6ac21351-9127-4d2c-a5b8-b9cc6060f4d9) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:28:49.371018 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4b834690-f567-46e9-9ef0-6648121a9531 req-c24e1856-48c5-4d26-99b1-92c57dd1cc2c tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.24 "GET /v2.0/ports?device_id=1aa3bc74-67df-4706-979b-cbf709855232 HTTP/1.1" status: 200 len: 210 time: 0.0349090 Nov 09 04:28:49.391402 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-8547adc1-fddd-4ec1-a67c-4688b199b5be req-d29e076e-85d6-4c0d-8c46-eb3446fe0385 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "GET /v2.0/ports?device_id=fd8e39fc-699b-4777-aae4-ca592a898437 HTTP/1.1" status: 200 len: 210 time: 0.2183094 Nov 09 04:28:49.504470 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-271ce807-50a1-4a97-b1ec-78a7e128aa2f tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Pushing event updated for resources: {'Port': ['ID=2c2624f2-2286-427f-bd68-0289b5dab6e7,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:49.629913 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b1b02fdd-4b33-44e5-b6c0-e74ac8b96cc0 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:49.633490 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-271ce807-50a1-4a97-b1ec-78a7e128aa2f tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] In _notify_port_updated(), no bound segment for port 2c2624f2-2286-427f-bd68-0289b5dab6e7 on network e96f4292-19f0-4446-b093-408610b619f1 {{(pid=102161) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 09 04:28:49.646771 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-271ce807-50a1-4a97-b1ec-78a7e128aa2f tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:49.647452 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-271ce807-50a1-4a97-b1ec-78a7e128aa2f tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:49.652093 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-271ce807-50a1-4a97-b1ec-78a7e128aa2f tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] 10.222.0.24 "PUT /v2.0/ports/2c2624f2-2286-427f-bd68-0289b5dab6e7 HTTP/1.1" status: 200 len: 994 time: 1.8499796 Nov 09 04:28:49.678556 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52832) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:49.745114 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a7036ace-cb69-496a-9be6-491e6100df2f admin admin] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:49.749227 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-79edbc26-b5fe-4a73-95c0-8a3a492e5358 None None] Provisioning complete for port 2c2624f2-2286-427f-bd68-0289b5dab6e7 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:28:49.750446 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-79edbc26-b5fe-4a73-95c0-8a3a492e5358 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:49.845416 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-7fdddbc7-6e5a-4862-9c18-0d115966697e admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=f668e6cab6e34b529ec87023cadebeb9&name=default HTTP/1.1" status: 200 len: 2992 time: 0.7971478 Nov 09 04:28:49.860192 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-79edbc26-b5fe-4a73-95c0-8a3a492e5358 None None] Port 2c2624f2-2286-427f-bd68-0289b5dab6e7 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:28:49.960469 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a7036ace-cb69-496a-9be6-491e6100df2f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:49.963953 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52834) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:50.080538 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-65db8c26-f2ec-4fbd-bbab-d01ffe4ef7ab admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:50.080538 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.26', 56235) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:50.119189 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3b28cca1-3dc8-4a4f-9e35-904ed10e34f2 tempest-FloatingIPAdminTestJSON-625682852 tempest-FloatingIPAdminTestJSON-625682852-project-admin] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:50.296095 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-65db8c26-f2ec-4fbd-bbab-d01ffe4ef7ab admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:50.296648 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [req-4d21e6a7-b79e-45b1-b623-e6e8ad863c22 req-163a311a-7365-4b06-9793-09c4e01095e7 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:50.296748 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efbe6138-7f35-4a78-b226-c4382f39ee20 req-eb96a2ae-af53-4def-bfef-7836f35aa80e tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:50.296748 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-efbe6138-7f35-4a78-b226-c4382f39ee20 req-eb96a2ae-af53-4def-bfef-7836f35aa80e tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.26 "GET /v2.0/networks?id=468b2f91-119a-402c-b695-5d7963ec6348 HTTP/1.1" status: 200 len: 811 time: 0.1434934 Nov 09 04:28:50.296748 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-efbe6138-7f35-4a78-b226-c4382f39ee20 req-d81efc39-549f-4711-8f9d-841c1806ba54 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.26 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=5f3cd2a3586e46c09f847681f744075c HTTP/1.1" status: 200 len: 379 time: 0.0585253 Nov 09 04:28:50.296748 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-efbe6138-7f35-4a78-b226-c4382f39ee20 req-d583f874-0efe-498d-b347-dd2265a7e4e7 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Request body: {'port': {'device_id': '1aa3bc74-67df-4706-979b-cbf709855232', 'network_id': '468b2f91-119a-402c-b695-5d7963ec6348', 'admin_state_up': True, 'tenant_id': '5f3cd2a3586e46c09f847681f744075c', 'security_groups': ['4b002f37-f4ce-4d8a-a894-560955e72139']}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:50.357363 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a7036ace-cb69-496a-9be6-491e6100df2f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:50.361704 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-0410e3e4-85ce-49ef-ae9c-93c432a2c498 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Deleting port 2c2624f2-2286-427f-bd68-0289b5dab6e7 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:28:50.362621 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0410e3e4-85ce-49ef-ae9c-93c432a2c498 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:50.415290 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a7036ace-cb69-496a-9be6-491e6100df2f admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=9316d555cfa340fd8e07dab48e6dd4e4&name=default HTTP/1.1" status: 200 len: 2996 time: 1.2506707 Nov 09 04:28:50.419250 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7036ace-cb69-496a-9be6-491e6100df2f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=02da311f-29ee-42de-a7ed-88a58a01f5f3,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:50.425453 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52836) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:50.486378 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0410e3e4-85ce-49ef-ae9c-93c432a2c498 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:50.506026 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-0410e3e4-85ce-49ef-ae9c-93c432a2c498 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Calling delete_port for 2c2624f2-2286-427f-bd68-0289b5dab6e7 owned by {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:28:50.552339 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-210ab0a3-c099-48b6-ba0a-8285ebb7076e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:50.577239 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b1b02fdd-4b33-44e5-b6c0-e74ac8b96cc0 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:50.614280 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-210ab0a3-c099-48b6-ba0a-8285ebb7076e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:50.615871 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52842) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:50.634329 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-0a923ac1-8a0a-4f7e-965d-acb7a55df654 req-03a4ce88-90dd-4d60-9014-3fdf54a9ae2b tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "GET /v2.0/ports?device_id=fd8e39fc-699b-4777-aae4-ca592a898437 HTTP/1.1" status: 200 len: 210 time: 0.0604408 Nov 09 04:28:50.675938 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b1b02fdd-4b33-44e5-b6c0-e74ac8b96cc0 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Network daccf5f5-3ea8-4f1b-ab62-78949d47bb91 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:28:50.705265 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [req-4d21e6a7-b79e-45b1-b623-e6e8ad863c22 req-163a311a-7365-4b06-9793-09c4e01095e7 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:50.707128 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3b28cca1-3dc8-4a4f-9e35-904ed10e34f2 tempest-FloatingIPAdminTestJSON-625682852 tempest-FloatingIPAdminTestJSON-625682852-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:50.711246 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-25f8eb9b-342d-40d8-998f-c283648eb764 req-cdbd68b4-01cf-44f5-9591-cfb3919a89a8 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.24 "GET /v2.0/ports?device_id=1aa3bc74-67df-4706-979b-cbf709855232 HTTP/1.1" status: 200 len: 210 time: 0.1022952 Nov 09 04:28:50.712276 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-b1b02fdd-4b33-44e5-b6c0-e74ac8b96cc0 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:28:50.718515 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-65db8c26-f2ec-4fbd-bbab-d01ffe4ef7ab admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:50.722154 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-65db8c26-f2ec-4fbd-bbab-d01ffe4ef7ab admin admin] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:50.722261 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-65db8c26-f2ec-4fbd-bbab-d01ffe4ef7ab admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/5d9574b3-1b93-4ff3-a4b9-8a346a4a2478 HTTP/1.1" status: 204 len: 168 time: 0.7572715 Nov 09 04:28:50.723367 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b1b02fdd-4b33-44e5-b6c0-e74ac8b96cc0 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:28:50.729265 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b1b02fdd-4b33-44e5-b6c0-e74ac8b96cc0 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:50.729883 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b1b02fdd-4b33-44e5-b6c0-e74ac8b96cc0 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:50.750961 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-efbe6138-7f35-4a78-b226-c4382f39ee20 req-d583f874-0efe-498d-b347-dd2265a7e4e7 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Made reservation on behalf of 5f3cd2a3586e46c09f847681f744075c for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:28:50.753091 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-efbe6138-7f35-4a78-b226-c4382f39ee20 req-d583f874-0efe-498d-b347-dd2265a7e4e7 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:50.785649 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b28cca1-3dc8-4a4f-9e35-904ed10e34f2 tempest-FloatingIPAdminTestJSON-625682852 tempest-FloatingIPAdminTestJSON-625682852-project-admin] Pushing event updated for resources: {'Port': ['ID=e44bbd89-4625-4e16-91ef-9daeff9b4ff3,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:50.819913 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65db8c26-f2ec-4fbd-bbab-d01ffe4ef7ab admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5d9574b3-1b93-4ff3-a4b9-8a346a4a2478,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:50.835621 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1b02fdd-4b33-44e5-b6c0-e74ac8b96cc0 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Pushing event updated for resources: {'Port': ['ID=6ac21351-9127-4d2c-a5b8-b9cc6060f4d9,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:50.855735 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-bb200e7b-fcec-4453-8661-35df9fc5b506 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=1f5d2eca16394ba1811d503557bb1504&name=default HTTP/1.1" status: 200 len: 2992 time: 0.2366283 Nov 09 04:28:50.860341 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3b28cca1-3dc8-4a4f-9e35-904ed10e34f2 tempest-FloatingIPAdminTestJSON-625682852 tempest-FloatingIPAdminTestJSON-625682852-project-admin] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:28:50.860341 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4d21e6a7-b79e-45b1-b623-e6e8ad863c22 req-163a311a-7365-4b06-9793-09c4e01095e7 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Network d4ba3288-221c-40f3-a829-662c462cc93f is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:28:50.860563 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52846) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:50.863591 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-3b28cca1-3dc8-4a4f-9e35-904ed10e34f2 tempest-FloatingIPAdminTestJSON-625682852 tempest-FloatingIPAdminTestJSON-625682852-project-admin] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:28:50.869390 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3b28cca1-3dc8-4a4f-9e35-904ed10e34f2 tempest-FloatingIPAdminTestJSON-625682852 tempest-FloatingIPAdminTestJSON-625682852-project-admin] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:28:50.875694 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [req-4d21e6a7-b79e-45b1-b623-e6e8ad863c22 req-163a311a-7365-4b06-9793-09c4e01095e7 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:28:50.915767 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [req-4d21e6a7-b79e-45b1-b623-e6e8ad863c22 req-163a311a-7365-4b06-9793-09c4e01095e7 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:28:50.962528 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-b1b02fdd-4b33-44e5-b6c0-e74ac8b96cc0 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 943 time: 2.3504400 Nov 09 04:28:50.974969 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52848) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:51.009697 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-5d4c2b9f-d0df-4533-a534-0276ab30ad2e tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Request body: {'port': {'allowed_address_pairs': [{'ip_address': '2001:db8::/48', 'mac_address': 'fa:16:3e:87:f8:a2'}]}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:51.047073 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-210ab0a3-c099-48b6-ba0a-8285ebb7076e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:51.049780 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-210ab0a3-c099-48b6-ba0a-8285ebb7076e admin admin] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:51.059122 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-210ab0a3-c099-48b6-ba0a-8285ebb7076e admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/02da311f-29ee-42de-a7ed-88a58a01f5f3 HTTP/1.1" status: 204 len: 168 time: 0.6326234 Nov 09 04:28:51.067088 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-55b3f6e4-5344-4935-94d7-7fcf035cd299 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:51.096354 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-163a311a-7365-4b06-9793-09c4e01095e7 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Pushing event updated for resources: {'Port': ['ID=9ce4bb36-a0c7-4517-abaf-8db99ca3bb12,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:51.098254 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-210ab0a3-c099-48b6-ba0a-8285ebb7076e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=02da311f-29ee-42de-a7ed-88a58a01f5f3,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:51.152679 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-55b3f6e4-5344-4935-94d7-7fcf035cd299 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:51.162196 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0410e3e4-85ce-49ef-ae9c-93c432a2c498 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:51.210488 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-488f03ad-c5fc-4923-a380-dd46a76bbcfc None None] Provisioning complete for port 6ac21351-9127-4d2c-a5b8-b9cc6060f4d9 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:28:51.212189 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-488f03ad-c5fc-4923-a380-dd46a76bbcfc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:51.255262 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-488f03ad-c5fc-4923-a380-dd46a76bbcfc None None] Port 6ac21351-9127-4d2c-a5b8-b9cc6060f4d9 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:28:51.285624 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [req-efbe6138-7f35-4a78-b226-c4382f39ee20 req-d583f874-0efe-498d-b347-dd2265a7e4e7 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Allocated IP 172.20.0.6 (468b2f91-119a-402c-b695-5d7963ec6348/a3d93294-0484-46fa-b8a6-204ec86c9c5f/49694ee4-edfa-4a08-be0b-8bfa9b06128b) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:28:51.339623 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0410e3e4-85ce-49ef-ae9c-93c432a2c498 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Pushing event deleted for resources: {'Port': ['ID=2c2624f2-2286-427f-bd68-0289b5dab6e7,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:51.397245 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-14c90e34-0f6f-41a3-909d-c44038b98a70 None None] Provisioning complete for port 9ce4bb36-a0c7-4517-abaf-8db99ca3bb12 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:28:51.401135 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-14c90e34-0f6f-41a3-909d-c44038b98a70 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:51.444323 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d21e6a7-b79e-45b1-b623-e6e8ad863c22 req-163a311a-7365-4b06-9793-09c4e01095e7 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:51.444943 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [req-4d21e6a7-b79e-45b1-b623-e6e8ad863c22 req-163a311a-7365-4b06-9793-09c4e01095e7 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:51.465003 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-14c90e34-0f6f-41a3-909d-c44038b98a70 None None] Port 9ce4bb36-a0c7-4517-abaf-8db99ca3bb12 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:28:51.581804 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-55b3f6e4-5344-4935-94d7-7fcf035cd299 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:51.584490 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-55b3f6e4-5344-4935-94d7-7fcf035cd299 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:51.592854 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-55b3f6e4-5344-4935-94d7-7fcf035cd299 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/5614fd3a-6af3-4e62-9e7d-3f9a8830c93e HTTP/1.1" status: 204 len: 168 time: 0.7247033 Nov 09 04:28:51.612291 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-efbe6138-7f35-4a78-b226-c4382f39ee20 req-d583f874-0efe-498d-b347-dd2265a7e4e7 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:51.648406 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55b3f6e4-5344-4935-94d7-7fcf035cd299 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5614fd3a-6af3-4e62-9e7d-3f9a8830c93e,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:51.792560 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-4d21e6a7-b79e-45b1-b623-e6e8ad863c22 req-163a311a-7365-4b06-9793-09c4e01095e7 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.26 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 3.7424207 Nov 09 04:28:51.810279 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-efbe6138-7f35-4a78-b226-c4382f39ee20 req-d583f874-0efe-498d-b347-dd2265a7e4e7 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:51.849054 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [req-4d21e6a7-b79e-45b1-b623-e6e8ad863c22 req-0fc04cfc-a330-468e-bffd-642551584b1c tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] http://10.222.0.24:9696/v2.0/extensions returned with HTTP 200 {{(pid=102161) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:28:51.850285 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-4d21e6a7-b79e-45b1-b623-e6e8ad863c22 req-0fc04cfc-a330-468e-bffd-642551584b1c tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.26 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0121410 Nov 09 04:28:51.901141 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5d4c2b9f-d0df-4533-a534-0276ab30ad2e tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:51.909349 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-efbe6138-7f35-4a78-b226-c4382f39ee20 req-d583f874-0efe-498d-b347-dd2265a7e4e7 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Network 468b2f91-119a-402c-b695-5d7963ec6348 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:28:51.939167 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [req-efbe6138-7f35-4a78-b226-c4382f39ee20 req-d583f874-0efe-498d-b347-dd2265a7e4e7 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:28:51.959322 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-efbe6138-7f35-4a78-b226-c4382f39ee20 req-d583f874-0efe-498d-b347-dd2265a7e4e7 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:28:51.976121 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d583f874-0efe-498d-b347-dd2265a7e4e7 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Pushing event updated for resources: {'Port': ['ID=49694ee4-edfa-4a08-be0b-8bfa9b06128b,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:51.995026 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0410e3e4-85ce-49ef-ae9c-93c432a2c498 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:52.001066 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-0410e3e4-85ce-49ef-ae9c-93c432a2c498 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] 10.222.0.24 "DELETE /v2.0/ports/2c2624f2-2286-427f-bd68-0289b5dab6e7 HTTP/1.1" status: 204 len: 168 time: 1.9886010 Nov 09 04:28:52.047288 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52866) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:52.102716 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-04c94887-837f-4aa6-ba98-eac55e89d4bb tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] GET failed (client error): The resource could not be found. Nov 09 04:28:52.104933 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-04c94887-837f-4aa6-ba98-eac55e89d4bb tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] 10.222.0.24 "GET /v2.0/ports/2c2624f2-2286-427f-bd68-0289b5dab6e7 HTTP/1.1" status: 404 len: 333 time: 0.0545156 Nov 09 04:28:52.133096 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efbe6138-7f35-4a78-b226-c4382f39ee20 req-d583f874-0efe-498d-b347-dd2265a7e4e7 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:52.134603 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-efbe6138-7f35-4a78-b226-c4382f39ee20 req-d583f874-0efe-498d-b347-dd2265a7e4e7 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:52.168355 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9730f0af-638e-4f70-9a56-005dce4679c0 req-182981b6-a23f-47cd-a6ad-a43368807080 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:52.170013 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6966303c-89b4-498e-a696-764bb1124a38 req-d2a11cb6-d5fc-4d9e-ae50-ee8aeec85cce tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:52.171630 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-6966303c-89b4-498e-a696-764bb1124a38 req-d2a11cb6-d5fc-4d9e-ae50-ee8aeec85cce tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "GET /v2.0/ports?device_id=fd8e39fc-699b-4777-aae4-ca592a898437 HTTP/1.1" status: 200 len: 931 time: 0.3283367 Nov 09 04:28:52.186332 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9730f0af-638e-4f70-9a56-005dce4679c0 req-182981b6-a23f-47cd-a6ad-a43368807080 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.24 "GET /v2.0/ports?device_id=1aa3bc74-67df-4706-979b-cbf709855232 HTTP/1.1" status: 200 len: 931 time: 0.3125770 Nov 09 04:28:52.218833 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52868) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:52.219173 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52870) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:52.225668 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-1c764345-64d4-4a8b-9c7e-2404645d04ca tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Request body: {'port': {'network_id': 'e96f4292-19f0-4446-b093-408610b619f1', 'name': 'tempest-AllowedAddressPairTestJSON-89890551'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:52.328245 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52872) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:52.366744 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-559547f4-9016-475a-bd47-c38c1f56566d None None] Provisioning complete for port 49694ee4-edfa-4a08-be0b-8bfa9b06128b triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:28:52.367724 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-559547f4-9016-475a-bd47-c38c1f56566d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:52.393912 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7c862b39-7172-4ded-a64f-558de0b2c5e0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:52.431072 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-efbe6138-7f35-4a78-b226-c4382f39ee20 req-d583f874-0efe-498d-b347-dd2265a7e4e7 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.26 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.1656964 Nov 09 04:28:52.496819 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9730f0af-638e-4f70-9a56-005dce4679c0 req-519fd0f8-aee5-41fc-a3ef-b50c5748a996 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.24 "GET /v2.0/security-groups?id=4b002f37-f4ce-4d8a-a894-560955e72139&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3071995 Nov 09 04:28:52.518769 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-559547f4-9016-475a-bd47-c38c1f56566d None None] Port 49694ee4-edfa-4a08-be0b-8bfa9b06128b cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:28:52.526563 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-8553f849-b149-4d96-b5c5-1d8d7f519ec0 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=50f2f3df9a9441cd84e52ab52b9432fc&name=default HTTP/1.1" status: 200 len: 2992 time: 0.1868753 Nov 09 04:28:52.533188 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52874) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:52.542859 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3b28cca1-3dc8-4a4f-9e35-904ed10e34f2 tempest-FloatingIPAdminTestJSON-625682852 tempest-FloatingIPAdminTestJSON-625682852-project-admin] Publish callbacks [] for floatingip, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:52.661822 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7bcb8088-07b2-4a4c-977f-029b48c7732b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:52.704274 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7bcb8088-07b2-4a4c-977f-029b48c7732b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:52.712775 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-6966303c-89b4-498e-a696-764bb1124a38 req-c03e317c-1e00-4f98-ad8a-40b9f3f3f768 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "GET /v2.0/security-groups?id=67cb2d36-e38c-4a29-adb5-c52b1d94ae99&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0930338 Nov 09 04:28:52.740433 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7c862b39-7172-4ded-a64f-558de0b2c5e0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:52.775113 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-4d21e6a7-b79e-45b1-b623-e6e8ad863c22 req-1dc58b6c-71da-4af1-9a34-992fdb897d4b service neutron] Request body: {'port': {'device_id': 'fd8e39fc-699b-4777-aae4-ca592a898437', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:52.831093 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1c764345-64d4-4a8b-9c7e-2404645d04ca tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Made reservation on behalf of a369b57921894b01a70b43c4f969d224 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:28:52.836787 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1c764345-64d4-4a8b-9c7e-2404645d04ca tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:52.858773 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7c862b39-7172-4ded-a64f-558de0b2c5e0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:52.865812 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3b28cca1-3dc8-4a4f-9e35-904ed10e34f2 tempest-FloatingIPAdminTestJSON-625682852 tempest-FloatingIPAdminTestJSON-625682852-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:52.896303 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c862b39-7172-4ded-a64f-558de0b2c5e0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4bb07f65-88da-43d2-8f62-422e69f85e62,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:52.922862 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [None req-1c764345-64d4-4a8b-9c7e-2404645d04ca tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] device_id is not set on port 07d9b155-0486-43e1-a756-50fbe8d7b2d0 yet. {{(pid=102162) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:28:52.966449 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [req-efbe6138-7f35-4a78-b226-c4382f39ee20 req-93e48c7f-62bc-44eb-ba4e-c89687a3d4cb service neutron] Request body: {'port': {'device_id': '1aa3bc74-67df-4706-979b-cbf709855232', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:52.969904 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-4d21e6a7-b79e-45b1-b623-e6e8ad863c22 req-1dc58b6c-71da-4af1-9a34-992fdb897d4b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:52.975115 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5d4c2b9f-d0df-4533-a534-0276ab30ad2e tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:53.007042 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-7c862b39-7172-4ded-a64f-558de0b2c5e0 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=94b0e713f9ce4e7bb03e7bb2e009ca42&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7750926 Nov 09 04:28:53.013798 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52882) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:53.101838 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7bcb8088-07b2-4a4c-977f-029b48c7732b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:53.107415 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7bcb8088-07b2-4a4c-977f-029b48c7732b admin admin] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:53.110560 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-7bcb8088-07b2-4a4c-977f-029b48c7732b admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/b8a0e346-8fc1-434a-b469-9494dc021d8b HTTP/1.1" status: 204 len: 168 time: 0.5732918 Nov 09 04:28:53.194273 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bcb8088-07b2-4a4c-977f-029b48c7732b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b8a0e346-8fc1-434a-b469-9494dc021d8b,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:53.260835 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-1c764345-64d4-4a8b-9c7e-2404645d04ca tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Allocated IP 172.20.0.14 (e96f4292-19f0-4446-b093-408610b619f1/300c7541-d41f-47e3-ad5e-4d083e87c290/07d9b155-0486-43e1-a756-50fbe8d7b2d0) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:28:53.394518 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5d4c2b9f-d0df-4533-a534-0276ab30ad2e tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:53.477533 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-5d4c2b9f-d0df-4533-a534-0276ab30ad2e tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] In _notify_port_updated(), no bound segment for port 6ac21351-9127-4d2c-a5b8-b9cc6060f4d9 on network daccf5f5-3ea8-4f1b-ab62-78949d47bb91 {{(pid=102161) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 09 04:28:53.477533 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5d4c2b9f-d0df-4533-a534-0276ab30ad2e tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:53.477533 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5d4c2b9f-d0df-4533-a534-0276ab30ad2e tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:53.477533 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-5d4c2b9f-d0df-4533-a534-0276ab30ad2e tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] 10.222.0.24 "PUT /v2.0/ports/6ac21351-9127-4d2c-a5b8-b9cc6060f4d9 HTTP/1.1" status: 200 len: 1002 time: 2.4874654 Nov 09 04:28:53.478378 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [req-efbe6138-7f35-4a78-b226-c4382f39ee20 req-93e48c7f-62bc-44eb-ba4e-c89687a3d4cb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:53.486382 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52894) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:53.656405 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4c2b9f-d0df-4533-a534-0276ab30ad2e tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Pushing event updated for resources: {'Port': ['ID=6ac21351-9127-4d2c-a5b8-b9cc6060f4d9,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:53.696746 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-51969c90-de46-4f81-9490-d54282dbf972 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:53.728144 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1c764345-64d4-4a8b-9c7e-2404645d04ca tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:53.815537 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-51969c90-de46-4f81-9490-d54282dbf972 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:53.898101 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3b28cca1-3dc8-4a4f-9e35-904ed10e34f2 tempest-FloatingIPAdminTestJSON-625682852 tempest-FloatingIPAdminTestJSON-625682852-project-admin] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:53.967984 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-7a961aae-dae0-449e-91b0-83699992de9d None None] Provisioning complete for port 6ac21351-9127-4d2c-a5b8-b9cc6060f4d9 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:28:53.968939 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7a961aae-dae0-449e-91b0-83699992de9d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:54.020528 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-7a961aae-dae0-449e-91b0-83699992de9d None None] Port 6ac21351-9127-4d2c-a5b8-b9cc6060f4d9 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:28:54.082845 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3b28cca1-3dc8-4a4f-9e35-904ed10e34f2 tempest-FloatingIPAdminTestJSON-625682852 tempest-FloatingIPAdminTestJSON-625682852-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:54.147180 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [req-4d21e6a7-b79e-45b1-b623-e6e8ad863c22 req-1dc58b6c-71da-4af1-9a34-992fdb897d4b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 9ce4bb36-a0c7-4517-abaf-8db99ca3bb12 {{(pid=102162) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:28:54.159375 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-4d21e6a7-b79e-45b1-b623-e6e8ad863c22 req-1dc58b6c-71da-4af1-9a34-992fdb897d4b service neutron] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:54.178646 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c85204a6-0fc4-41fd-8120-2e12c0b2e210 req-ae3a9fb7-7e3a-4827-9284-71df81541c81 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:54.186650 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c85204a6-0fc4-41fd-8120-2e12c0b2e210 req-ae3a9fb7-7e3a-4827-9284-71df81541c81 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.24 "GET /v2.0/ports?device_id=1aa3bc74-67df-4706-979b-cbf709855232 HTTP/1.1" status: 200 len: 931 time: 0.4868336 Nov 09 04:28:54.242637 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.provisioning_blocks [req-4d21e6a7-b79e-45b1-b623-e6e8ad863c22 req-1dc58b6c-71da-4af1-9a34-992fdb897d4b service neutron] Transition to ACTIVE for port object 9ce4bb36-a0c7-4517-abaf-8db99ca3bb12 will not be triggered until provisioned by entity L2. {{(pid=102162) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 09 04:28:54.291454 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1c764345-64d4-4a8b-9c7e-2404645d04ca tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:54.311805 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c85204a6-0fc4-41fd-8120-2e12c0b2e210 req-37435520-4dd1-4b73-ae0d-065bc2da9ade tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.24 "GET /v2.0/security-groups?id=4b002f37-f4ce-4d8a-a894-560955e72139&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1242197 Nov 09 04:28:54.324008 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-4d21e6a7-b79e-45b1-b623-e6e8ad863c22 req-1dc58b6c-71da-4af1-9a34-992fdb897d4b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:54.428546 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1c764345-64d4-4a8b-9c7e-2404645d04ca tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Network e96f4292-19f0-4446-b093-408610b619f1 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:28:54.441518 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-1c764345-64d4-4a8b-9c7e-2404645d04ca tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:28:54.448362 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1c764345-64d4-4a8b-9c7e-2404645d04ca tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:28:54.483055 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:28:54.501263 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c764345-64d4-4a8b-9c7e-2404645d04ca tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Pushing event updated for resources: {'Port': ['ID=07d9b155-0486-43e1-a756-50fbe8d7b2d0,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:54.566019 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-51969c90-de46-4f81-9490-d54282dbf972 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:54.568672 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-51969c90-de46-4f81-9490-d54282dbf972 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:54.581739 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-51969c90-de46-4f81-9490-d54282dbf972 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/4bb07f65-88da-43d2-8f62-422e69f85e62 HTTP/1.1" status: 204 len: 168 time: 1.5648978 Nov 09 04:28:54.582599 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b28cca1-3dc8-4a4f-9e35-904ed10e34f2 tempest-FloatingIPAdminTestJSON-625682852 tempest-FloatingIPAdminTestJSON-625682852-project-admin] Pushing event updated for resources: {'Port': ['ID=e44bbd89-4625-4e16-91ef-9daeff9b4ff3,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:54.672715 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1c764345-64d4-4a8b-9c7e-2404645d04ca tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:54.673290 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1c764345-64d4-4a8b-9c7e-2404645d04ca tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:54.700397 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1dc58b6c-71da-4af1-9a34-992fdb897d4b service neutron] Pushing event updated for resources: {'Port': ['ID=9ce4bb36-a0c7-4517-abaf-8db99ca3bb12,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:54.765341 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51969c90-de46-4f81-9490-d54282dbf972 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4bb07f65-88da-43d2-8f62-422e69f85e62,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:54.771735 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-4d21e6a7-b79e-45b1-b623-e6e8ad863c22 req-1dc58b6c-71da-4af1-9a34-992fdb897d4b service neutron] Attempting to bind port 9ce4bb36-a0c7-4517-abaf-8db99ca3bb12 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:28:54.772295 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-4d21e6a7-b79e-45b1-b623-e6e8ad863c22 req-1dc58b6c-71da-4af1-9a34-992fdb897d4b service neutron] Attempting to bind port 9ce4bb36-a0c7-4517-abaf-8db99ca3bb12 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '9b34c07b-e9e3-4439-982a-e160009938cf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 348, 'network_id': 'd4ba3288-221c-40f3-a829-662c462cc93f'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:28:54.772389 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4d21e6a7-b79e-45b1-b623-e6e8ad863c22 req-1dc58b6c-71da-4af1-9a34-992fdb897d4b service neutron] Attempting to bind port 9ce4bb36-a0c7-4517-abaf-8db99ca3bb12 on network d4ba3288-221c-40f3-a829-662c462cc93f {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:28:54.781749 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4d21e6a7-b79e-45b1-b623-e6e8ad863c22 req-1dc58b6c-71da-4af1-9a34-992fdb897d4b service neutron] Port 9ce4bb36-a0c7-4517-abaf-8db99ca3bb12 on network d4ba3288-221c-40f3-a829-662c462cc93f not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:28:54.782868 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4d21e6a7-b79e-45b1-b623-e6e8ad863c22 req-1dc58b6c-71da-4af1-9a34-992fdb897d4b service neutron] Attempting to bind port 9ce4bb36-a0c7-4517-abaf-8db99ca3bb12 on network d4ba3288-221c-40f3-a829-662c462cc93f {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:28:54.794097 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4d21e6a7-b79e-45b1-b623-e6e8ad863c22 req-1dc58b6c-71da-4af1-9a34-992fdb897d4b service neutron] Checking agent: {'id': '7d36b884-4ad2-4878-9464-bf647030b544', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'started_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 28, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:28:54.795125 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4d21e6a7-b79e-45b1-b623-e6e8ad863c22 req-1dc58b6c-71da-4af1-9a34-992fdb897d4b service neutron] Checking segment: {'id': '9b34c07b-e9e3-4439-982a-e160009938cf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 348, 'network_id': 'd4ba3288-221c-40f3-a829-662c462cc93f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:28:54.795905 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4d21e6a7-b79e-45b1-b623-e6e8ad863c22 req-1dc58b6c-71da-4af1-9a34-992fdb897d4b service neutron] Bound using segment: {'id': '9b34c07b-e9e3-4439-982a-e160009938cf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 348, 'network_id': 'd4ba3288-221c-40f3-a829-662c462cc93f'} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:28:54.796744 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-4d21e6a7-b79e-45b1-b623-e6e8ad863c22 req-1dc58b6c-71da-4af1-9a34-992fdb897d4b service neutron] Bound port: 9ce4bb36-a0c7-4517-abaf-8db99ca3bb12, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '9b34c07b-e9e3-4439-982a-e160009938cf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 348, 'network_id': 'd4ba3288-221c-40f3-a829-662c462cc93f'}}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:28:54.797251 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-4d21e6a7-b79e-45b1-b623-e6e8ad863c22 req-1dc58b6c-71da-4af1-9a34-992fdb897d4b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:54.830112 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-96d3e8ed-0c9d-4238-b46d-a5687a3d3f6e tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Deleting port 6ac21351-9127-4d2c-a5b8-b9cc6060f4d9 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:28:54.831200 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-96d3e8ed-0c9d-4238-b46d-a5687a3d3f6e tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:54.838740 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [req-efbe6138-7f35-4a78-b226-c4382f39ee20 req-93e48c7f-62bc-44eb-ba4e-c89687a3d4cb service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 49694ee4-edfa-4a08-be0b-8bfa9b06128b {{(pid=102161) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:28:54.865953 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [req-efbe6138-7f35-4a78-b226-c4382f39ee20 req-93e48c7f-62bc-44eb-ba4e-c89687a3d4cb service neutron] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:54.877745 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-1c764345-64d4-4a8b-9c7e-2404645d04ca tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 936 time: 2.6528008 Nov 09 04:28:54.877745 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52930) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:54.893615 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-68706144-a68c-42ae-9ca6-b1c1eb6b4227 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Request body: {'port': {'allowed_address_pairs': [{'ip_address': '172.20.0.0/16', 'mac_address': 'fa:16:3e:55:bc:e4'}]}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:54.911181 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b03361f0-0740-450c-a98d-0be3d5339ed5 req-2fa98a28-1eda-4336-b9c0-a7617d7a4165 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:54.912842 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b03361f0-0740-450c-a98d-0be3d5339ed5 req-2fa98a28-1eda-4336-b9c0-a7617d7a4165 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "GET /v2.0/ports?device_id=fd8e39fc-699b-4777-aae4-ca592a898437 HTTP/1.1" status: 200 len: 931 time: 0.8556826 Nov 09 04:28:54.923736 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3b28cca1-3dc8-4a4f-9e35-904ed10e34f2 tempest-FloatingIPAdminTestJSON-625682852 tempest-FloatingIPAdminTestJSON-625682852-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:54.993377 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-db420c8a-53c9-42bd-b2d5-f73b1cb52a32 None None] Provisioning complete for port 07d9b155-0486-43e1-a756-50fbe8d7b2d0 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:28:54.994510 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-db420c8a-53c9-42bd-b2d5-f73b1cb52a32 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:55.048640 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-db420c8a-53c9-42bd-b2d5-f73b1cb52a32 None None] Port 07d9b155-0486-43e1-a756-50fbe8d7b2d0 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:28:55.062665 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.provisioning_blocks [req-efbe6138-7f35-4a78-b226-c4382f39ee20 req-93e48c7f-62bc-44eb-ba4e-c89687a3d4cb service neutron] Transition to ACTIVE for port object 49694ee4-edfa-4a08-be0b-8bfa9b06128b will not be triggered until provisioned by entity L2. {{(pid=102161) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 09 04:28:55.135947 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-4d21e6a7-b79e-45b1-b623-e6e8ad863c22 req-1dc58b6c-71da-4af1-9a34-992fdb897d4b service neutron] For port 9ce4bb36-a0c7-4517-abaf-8db99ca3bb12, host hv-neutron-8168, cleared binding levels {{(pid=102162) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:28:55.153370 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [req-efbe6138-7f35-4a78-b226-c4382f39ee20 req-93e48c7f-62bc-44eb-ba4e-c89687a3d4cb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:55.186323 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-4d21e6a7-b79e-45b1-b623-e6e8ad863c22 req-1dc58b6c-71da-4af1-9a34-992fdb897d4b service neutron] For port 9ce4bb36-a0c7-4517-abaf-8db99ca3bb12, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=9ce4bb36-a0c7-4517-abaf-8db99ca3bb12,segment=NetworkSegment(9b34c07b-e9e3-4439-982a-e160009938cf),segment_id=9b34c07b-e9e3-4439-982a-e160009938cf)] {{(pid=102162) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:28:55.211739 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b03361f0-0740-450c-a98d-0be3d5339ed5 req-f6687c3b-a96a-46d5-94e3-209a438fbc83 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "GET /v2.0/security-groups?id=67cb2d36-e38c-4a29-adb5-c52b1d94ae99&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2806284 Nov 09 04:28:55.238919 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93e48c7f-62bc-44eb-ba4e-c89687a3d4cb service neutron] Pushing event updated for resources: {'Port': ['ID=49694ee4-edfa-4a08-be0b-8bfa9b06128b,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:55.249622 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-96d3e8ed-0c9d-4238-b46d-a5687a3d3f6e tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:55.259852 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.l3_db [None req-3b28cca1-3dc8-4a4f-9e35-904ed10e34f2 tempest-FloatingIPAdminTestJSON-625682852 tempest-FloatingIPAdminTestJSON-625682852-project-admin] Floating IP 757d9653-a9b4-4deb-a1a6-847129aa5fa2 associated. External IP: 172.26.0.148, port: ceb33408-7f98-40bc-9e0d-9341e2ff0309. Nov 09 04:28:55.318858 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-68706144-a68c-42ae-9ca6-b1c1eb6b4227 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:55.321882 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-4d21e6a7-b79e-45b1-b623-e6e8ad863c22 req-1dc58b6c-71da-4af1-9a34-992fdb897d4b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:55.347866 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-96d3e8ed-0c9d-4238-b46d-a5687a3d3f6e tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Calling delete_port for 6ac21351-9127-4d2c-a5b8-b9cc6060f4d9 owned by {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:28:55.522387 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d21e6a7-b79e-45b1-b623-e6e8ad863c22 req-1dc58b6c-71da-4af1-9a34-992fdb897d4b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:55.523017 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-4d21e6a7-b79e-45b1-b623-e6e8ad863c22 req-1dc58b6c-71da-4af1-9a34-992fdb897d4b service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:55.524698 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4d21e6a7-b79e-45b1-b623-e6e8ad863c22 req-1dc58b6c-71da-4af1-9a34-992fdb897d4b service neutron] 10.222.0.26 "PUT /v2.0/ports/9ce4bb36-a0c7-4517-abaf-8db99ca3bb12 HTTP/1.1" status: 200 len: 1093 time: 2.9484510 Nov 09 04:28:55.809199 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fd8e39fc-699b-4777-aae4-ca592a898437', 'tag': '9ce4bb36-a0c7-4517-abaf-8db99ca3bb12'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:28:55.883542 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1dc58b6c-71da-4af1-9a34-992fdb897d4b service neutron] Pushing event updated for resources: {'Port': ['ID=9ce4bb36-a0c7-4517-abaf-8db99ca3bb12,revision_number=3']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:55.930568 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09a20ddc-a489-437c-ac44-0a34a08f18e2 req-cf074674-5450-422f-b976-6ec526919ed4 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:55.937933 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-09a20ddc-a489-437c-ac44-0a34a08f18e2 req-cf074674-5450-422f-b976-6ec526919ed4 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.24 "GET /v2.0/ports?device_id=1aa3bc74-67df-4706-979b-cbf709855232 HTTP/1.1" status: 200 len: 943 time: 0.4471204 Nov 09 04:28:55.989369 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-68706144-a68c-42ae-9ca6-b1c1eb6b4227 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:56.008518 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [req-efbe6138-7f35-4a78-b226-c4382f39ee20 req-93e48c7f-62bc-44eb-ba4e-c89687a3d4cb service neutron] Attempting to bind port 49694ee4-edfa-4a08-be0b-8bfa9b06128b on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:28:56.009184 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [req-efbe6138-7f35-4a78-b226-c4382f39ee20 req-93e48c7f-62bc-44eb-ba4e-c89687a3d4cb service neutron] Attempting to bind port 49694ee4-edfa-4a08-be0b-8bfa9b06128b by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'efe0485f-d48f-4307-b89a-0bcb86aaf1c2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 329, 'network_id': '468b2f91-119a-402c-b695-5d7963ec6348'}] {{(pid=102161) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:28:56.009184 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-efbe6138-7f35-4a78-b226-c4382f39ee20 req-93e48c7f-62bc-44eb-ba4e-c89687a3d4cb service neutron] Attempting to bind port 49694ee4-edfa-4a08-be0b-8bfa9b06128b on network 468b2f91-119a-402c-b695-5d7963ec6348 {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:28:56.021085 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-09a20ddc-a489-437c-ac44-0a34a08f18e2 req-55d72258-0ba4-45e1-b34f-c146693f863c tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.24 "GET /v2.0/security-groups?id=4b002f37-f4ce-4d8a-a894-560955e72139&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0820680 Nov 09 04:28:56.033077 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-efbe6138-7f35-4a78-b226-c4382f39ee20 req-93e48c7f-62bc-44eb-ba4e-c89687a3d4cb service neutron] Port 49694ee4-edfa-4a08-be0b-8bfa9b06128b on network 468b2f91-119a-402c-b695-5d7963ec6348 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:28:56.033077 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-efbe6138-7f35-4a78-b226-c4382f39ee20 req-93e48c7f-62bc-44eb-ba4e-c89687a3d4cb service neutron] Attempting to bind port 49694ee4-edfa-4a08-be0b-8bfa9b06128b on network 468b2f91-119a-402c-b695-5d7963ec6348 {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:28:56.033077 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-efbe6138-7f35-4a78-b226-c4382f39ee20 req-93e48c7f-62bc-44eb-ba4e-c89687a3d4cb service neutron] Checking agent: {'id': '7d36b884-4ad2-4878-9464-bf647030b544', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'started_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 28, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:28:56.033077 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-efbe6138-7f35-4a78-b226-c4382f39ee20 req-93e48c7f-62bc-44eb-ba4e-c89687a3d4cb service neutron] Checking segment: {'id': 'efe0485f-d48f-4307-b89a-0bcb86aaf1c2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 329, 'network_id': '468b2f91-119a-402c-b695-5d7963ec6348'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:28:56.033077 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-efbe6138-7f35-4a78-b226-c4382f39ee20 req-93e48c7f-62bc-44eb-ba4e-c89687a3d4cb service neutron] Bound using segment: {'id': 'efe0485f-d48f-4307-b89a-0bcb86aaf1c2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 329, 'network_id': '468b2f91-119a-402c-b695-5d7963ec6348'} {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:28:56.033077 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [req-efbe6138-7f35-4a78-b226-c4382f39ee20 req-93e48c7f-62bc-44eb-ba4e-c89687a3d4cb service neutron] Bound port: 49694ee4-edfa-4a08-be0b-8bfa9b06128b, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'efe0485f-d48f-4307-b89a-0bcb86aaf1c2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 329, 'network_id': '468b2f91-119a-402c-b695-5d7963ec6348'}}] {{(pid=102161) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:28:56.033693 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [req-efbe6138-7f35-4a78-b226-c4382f39ee20 req-93e48c7f-62bc-44eb-ba4e-c89687a3d4cb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:56.181005 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3b28cca1-3dc8-4a4f-9e35-904ed10e34f2 tempest-FloatingIPAdminTestJSON-625682852 tempest-FloatingIPAdminTestJSON-625682852-project-admin] Router cd21e659-1094-4653-b570-03e6ed4305e3 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:28:56.212062 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-96d3e8ed-0c9d-4238-b46d-a5687a3d3f6e tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:56.214575 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-68706144-a68c-42ae-9ca6-b1c1eb6b4227 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:56.299957 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [req-efbe6138-7f35-4a78-b226-c4382f39ee20 req-93e48c7f-62bc-44eb-ba4e-c89687a3d4cb service neutron] For port 49694ee4-edfa-4a08-be0b-8bfa9b06128b, host hv-neutron-8168, cleared binding levels {{(pid=102161) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:28:56.309184 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96d3e8ed-0c9d-4238-b46d-a5687a3d3f6e tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Pushing event deleted for resources: {'Port': ['ID=6ac21351-9127-4d2c-a5b8-b9cc6060f4d9,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:56.397814 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d21e6a7-b79e-45b1-b623-e6e8ad863c22 req-a522d1ce-1c1f-4d9b-a84e-6ceabdbb289f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:56.400843 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4d21e6a7-b79e-45b1-b623-e6e8ad863c22 req-a522d1ce-1c1f-4d9b-a84e-6ceabdbb289f service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=a229c806094b42c7a0f7ed52f78dfd68&device_id=fd8e39fc-699b-4777-aae4-ca592a898437 HTTP/1.1" status: 200 len: 1096 time: 0.2627547 Nov 09 04:28:56.405884 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [req-efbe6138-7f35-4a78-b226-c4382f39ee20 req-93e48c7f-62bc-44eb-ba4e-c89687a3d4cb service neutron] For port 49694ee4-edfa-4a08-be0b-8bfa9b06128b, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=49694ee4-edfa-4a08-be0b-8bfa9b06128b,segment=NetworkSegment(efe0485f-d48f-4307-b89a-0bcb86aaf1c2),segment_id=efe0485f-d48f-4307-b89a-0bcb86aaf1c2)] {{(pid=102161) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:28:56.410091 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-68706144-a68c-42ae-9ca6-b1c1eb6b4227 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] In _notify_port_updated(), no bound segment for port 07d9b155-0486-43e1-a756-50fbe8d7b2d0 on network e96f4292-19f0-4446-b093-408610b619f1 {{(pid=102162) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 09 04:28:56.410270 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-96d3e8ed-0c9d-4238-b46d-a5687a3d3f6e tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:56.419248 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-96d3e8ed-0c9d-4238-b46d-a5687a3d3f6e tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] 10.222.0.24 "DELETE /v2.0/ports/6ac21351-9127-4d2c-a5b8-b9cc6060f4d9 HTTP/1.1" status: 204 len: 168 time: 2.9289179 Nov 09 04:28:56.426016 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-68706144-a68c-42ae-9ca6-b1c1eb6b4227 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:56.428082 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52964) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:56.432666 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-68706144-a68c-42ae-9ca6-b1c1eb6b4227 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:56.437851 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-68706144-a68c-42ae-9ca6-b1c1eb6b4227 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] 10.222.0.24 "PUT /v2.0/ports/07d9b155-0486-43e1-a756-50fbe8d7b2d0 HTTP/1.1" status: 200 len: 995 time: 1.5594878 Nov 09 04:28:56.451759 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52966) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:56.482029 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68706144-a68c-42ae-9ca6-b1c1eb6b4227 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Pushing event updated for resources: {'Port': ['ID=07d9b155-0486-43e1-a756-50fbe8d7b2d0,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:56.556555 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-52c52fc0-0c81-4a45-9b55-e560c8802cbd tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] GET failed (client error): The resource could not be found. Nov 09 04:28:56.560308 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4d21e6a7-b79e-45b1-b623-e6e8ad863c22 req-c0e9eb3a-f17b-4809-aae3-687b11aa9e1d service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=9ce4bb36-a0c7-4517-abaf-8db99ca3bb12 HTTP/1.1" status: 200 len: 217 time: 0.1196017 Nov 09 04:28:56.568453 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 52968) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:56.570163 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-52c52fc0-0c81-4a45-9b55-e560c8802cbd tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] 10.222.0.24 "GET /v2.0/ports/6ac21351-9127-4d2c-a5b8-b9cc6060f4d9 HTTP/1.1" status: 404 len: 333 time: 0.1381421 Nov 09 04:28:56.573722 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-8cc20b16-9409-4f3f-b940-9be7733bc38e tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Request body: {'port': {'network_id': 'daccf5f5-3ea8-4f1b-ab62-78949d47bb91', 'name': 'tempest-AllowedAddressPairIpV6TestJSON-505753575'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:56.610826 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-461a8775-6662-4547-9d80-692ecd67f839" -d '{"events": [{"name": "network-changed", "server_uuid": "fd8e39fc-699b-4777-aae4-ca592a898437", "tag": "9ce4bb36-a0c7-4517-abaf-8db99ca3bb12"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:28:56.633053 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [req-efbe6138-7f35-4a78-b226-c4382f39ee20 req-93e48c7f-62bc-44eb-ba4e-c89687a3d4cb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:56.723644 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93e48c7f-62bc-44eb-ba4e-c89687a3d4cb service neutron] Pushing event updated for resources: {'Port': ['ID=49694ee4-edfa-4a08-be0b-8bfa9b06128b,revision_number=3']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:56.757761 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-0dba5ebb-5379-4bba-8755-5566be0131ba None None] Provisioning complete for port 07d9b155-0486-43e1-a756-50fbe8d7b2d0 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:28:56.763092 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0dba5ebb-5379-4bba-8755-5566be0131ba None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:56.805268 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efbe6138-7f35-4a78-b226-c4382f39ee20 req-93e48c7f-62bc-44eb-ba4e-c89687a3d4cb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:56.806964 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [req-efbe6138-7f35-4a78-b226-c4382f39ee20 req-93e48c7f-62bc-44eb-ba4e-c89687a3d4cb service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:56.808513 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-efbe6138-7f35-4a78-b226-c4382f39ee20 req-93e48c7f-62bc-44eb-ba4e-c89687a3d4cb service neutron] 10.222.0.26 "PUT /v2.0/ports/49694ee4-edfa-4a08-be0b-8bfa9b06128b HTTP/1.1" status: 200 len: 1093 time: 4.1874545 Nov 09 04:28:56.826215 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1aa3bc74-67df-4706-979b-cbf709855232', 'tag': '49694ee4-edfa-4a08-be0b-8bfa9b06128b'}] {{(pid=102161) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:28:56.877267 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d21e6a7-b79e-45b1-b623-e6e8ad863c22 req-5324f8a8-8a1f-4fc1-838c-948f9313f2aa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:56.884628 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4d21e6a7-b79e-45b1-b623-e6e8ad863c22 req-5324f8a8-8a1f-4fc1-838c-948f9313f2aa service neutron] 10.222.0.26 "GET /v2.0/subnets?id=b11be6b4-75f0-4756-9312-de5295f24e1b HTTP/1.1" status: 200 len: 844 time: 0.2505803 Nov 09 04:28:56.895054 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-0dba5ebb-5379-4bba-8755-5566be0131ba None None] Port 07d9b155-0486-43e1-a756-50fbe8d7b2d0 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:28:56.909781 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3b28cca1-3dc8-4a4f-9e35-904ed10e34f2 tempest-FloatingIPAdminTestJSON-625682852 tempest-FloatingIPAdminTestJSON-625682852-project-admin] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:28:56.914389 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52980) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:56.929696 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-790e1b2c-e0ed-43dc-b98e-aeabe94136a9 None None] Sync routers for ids ['cd21e659-1094-4653-b570-03e6ed4305e3'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:28:56.949263 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cbb586b-c34d-4b5f-a1f8-e45c1b976171 req-5cb40afd-fc47-40e1-bce0-539684c8f8e3 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:56.953299 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-790e1b2c-e0ed-43dc-b98e-aeabe94136a9 None None] Routers {'cd21e659-1094-4653-b570-03e6ed4305e3'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:28:56.953939 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-790e1b2c-e0ed-43dc-b98e-aeabe94136a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:28:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['cd21e659-1094-4653-b570-03e6ed4305e3'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:28:56.979124 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-3cbb586b-c34d-4b5f-a1f8-e45c1b976171 req-5cb40afd-fc47-40e1-bce0-539684c8f8e3 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "GET /v2.0/ports?device_id=fd8e39fc-699b-4777-aae4-ca592a898437 HTTP/1.1" status: 200 len: 943 time: 0.4980166 Nov 09 04:28:57.080170 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-790e1b2c-e0ed-43dc-b98e-aeabe94136a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:28:57.086375 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:28:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-86d34839-744d-4a83-8ff4-fc6337375e49 x-openstack-request-id: req-86d34839-744d-4a83-8ff4-fc6337375e49 {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:28:57.086646 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "fd8e39fc-699b-4777-aae4-ca592a898437", "tag": "9ce4bb36-a0c7-4517-abaf-8db99ca3bb12", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:28:57.086867 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-86d34839-744d-4a83-8ff4-fc6337375e49 {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:28:57.090762 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fd8e39fc-699b-4777-aae4-ca592a898437', 'tag': '9ce4bb36-a0c7-4517-abaf-8db99ca3bb12', 'status': 'completed', 'code': 200} Nov 09 04:28:57.105511 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-790e1b2c-e0ed-43dc-b98e-aeabe94136a9 None None] Routers {'cd21e659-1094-4653-b570-03e6ed4305e3'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:28:57.106180 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-790e1b2c-e0ed-43dc-b98e-aeabe94136a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:28:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['cd21e659-1094-4653-b570-03e6ed4305e3'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:28:57.149266 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d21e6a7-b79e-45b1-b623-e6e8ad863c22 req-95f71a54-6252-4d53-b477-a0b8d51e1b5b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:57.149266 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4d21e6a7-b79e-45b1-b623-e6e8ad863c22 req-95f71a54-6252-4d53-b477-a0b8d51e1b5b service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=d4ba3288-221c-40f3-a829-662c462cc93f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.2351818 Nov 09 04:28:57.193058 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-790e1b2c-e0ed-43dc-b98e-aeabe94136a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:28:57.194063 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-790e1b2c-e0ed-43dc-b98e-aeabe94136a9 None None] The sync data for ids ['cd21e659-1094-4653-b570-03e6ed4305e3'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:28:57.229424 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3b28cca1-3dc8-4a4f-9e35-904ed10e34f2 tempest-FloatingIPAdminTestJSON-625682852 tempest-FloatingIPAdminTestJSON-625682852-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:57.329523 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-3b28cca1-3dc8-4a4f-9e35-904ed10e34f2 tempest-FloatingIPAdminTestJSON-625682852 tempest-FloatingIPAdminTestJSON-625682852-project-admin] 10.222.0.24 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 987 time: 9.6158733 Nov 09 04:28:57.340943 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 52994) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:57.354597 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-5ec2a83f-4f88-4392-a224-9345b9cca970 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Deleting port 07d9b155-0486-43e1-a756-50fbe8d7b2d0 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:28:57.355141 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5ec2a83f-4f88-4392-a224-9345b9cca970 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:57.602005 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33b65b08-8fba-46d4-9285-50a140a6418d req-ff46559b-0be2-4865-b962-af443f9df818 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:57.603966 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-33b65b08-8fba-46d4-9285-50a140a6418d req-ff46559b-0be2-4865-b962-af443f9df818 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.24 "GET /v2.0/ports?device_id=1aa3bc74-67df-4706-979b-cbf709855232 HTTP/1.1" status: 200 len: 943 time: 0.3879778 Nov 09 04:28:57.721799 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4d21e6a7-b79e-45b1-b623-e6e8ad863c22 req-664806aa-967f-4262-a642-3558e1030f96 service neutron] 10.222.0.26 "GET /v2.0/networks/d4ba3288-221c-40f3-a829-662c462cc93f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5499029 Nov 09 04:28:57.761647 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8cc20b16-9409-4f3f-b940-9be7733bc38e tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Made reservation on behalf of 18f5ee1caa74420f9ab67cc92c1e02e6 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:28:57.765597 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8cc20b16-9409-4f3f-b940-9be7733bc38e tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:57.847779 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [None req-8cc20b16-9409-4f3f-b940-9be7733bc38e tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] device_id is not set on port 108ed2fc-5c3f-4fd4-8c8a-37bd462b1797 yet. {{(pid=102162) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:28:57.862999 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-33b65b08-8fba-46d4-9285-50a140a6418d req-786d4340-505f-4a41-b385-b12a1a8b0dce tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.24 "GET /v2.0/security-groups?id=4b002f37-f4ce-4d8a-a894-560955e72139&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2402983 Nov 09 04:28:57.948956 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4d21e6a7-b79e-45b1-b623-e6e8ad863c22 req-1fc4ff1d-fada-4813-9235-9431263945a2 service neutron] 10.222.0.26 "GET /v2.0/networks/d4ba3288-221c-40f3-a829-662c462cc93f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2129266 Nov 09 04:28:58.047564 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53006) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:58.076409 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}99dfdda0def497b4372884ef2eb87f06b1e425c8eba5ceda5f64bbab037a07d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d1a70bd5-6f7b-4b90-8149-5cb8929b0729" -d '{"events": [{"name": "network-changed", "server_uuid": "1aa3bc74-67df-4706-979b-cbf709855232", "tag": "49694ee4-edfa-4a08-be0b-8bfa9b06128b"}]}' {{(pid=102161) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:28:58.180202 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-8cc20b16-9409-4f3f-b940-9be7733bc38e tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Allocated IP 2001:db8::122 (daccf5f5-3ea8-4f1b-ab62-78949d47bb91/88d0e868-7936-4409-8f96-0f4e98202b5e/108ed2fc-5c3f-4fd4-8c8a-37bd462b1797) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:28:58.256955 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efbe6138-7f35-4a78-b226-c4382f39ee20 req-e8a85823-b9bc-46bc-aa5b-92936d03cfb6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:58.258555 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-efbe6138-7f35-4a78-b226-c4382f39ee20 req-e8a85823-b9bc-46bc-aa5b-92936d03cfb6 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=5f3cd2a3586e46c09f847681f744075c&device_id=1aa3bc74-67df-4706-979b-cbf709855232 HTTP/1.1" status: 200 len: 1096 time: 1.2591369 Nov 09 04:28:58.260581 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-eaf47ca7-8c41-4594-82f6-9faee2bafe94 tempest-FloatingIPAdminTestJSON-625682852 tempest-FloatingIPAdminTestJSON-625682852-project-admin] 10.222.0.24 "GET /v2.0/floatingips/757d9653-a9b4-4deb-a1a6-847129aa5fa2 HTTP/1.1" status: 200 len: 982 time: 0.9179490 Nov 09 04:28:58.264600 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-3cbb586b-c34d-4b5f-a1f8-e45c1b976171 req-8fdafcc6-102c-40ff-9b16-7f316b07c159 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "GET /v2.0/security-groups?id=67cb2d36-e38c-4a29-adb5-c52b1d94ae99&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 1.2846410 Nov 09 04:28:58.265446 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53014) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:58.272428 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-4c1759a6-7725-4979-8c0e-f7ec23d7e66b tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Request body: {'network': {'name': 'tempest-RoutersIpV6AdminTest-1551694962', 'router:external': True}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:58.398344 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8cc20b16-9409-4f3f-b940-9be7733bc38e tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:58.425842 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-efbe6138-7f35-4a78-b226-c4382f39ee20 req-9b9de8ad-775b-4b29-84e3-c75291875cfd service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=49694ee4-edfa-4a08-be0b-8bfa9b06128b HTTP/1.1" status: 200 len: 217 time: 0.0688345 Nov 09 04:28:58.460147 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-288bd353-7adb-4646-8749-3bc4671da97f tempest-ExternalNetworksAdminNegativeTestJSON-1412169277 tempest-ExternalNetworksAdminNegativeTestJSON-1412169277-project-admin] Request body: {'floatingip': {'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:58.496259 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-461a8775-6662-4547-9d80-692ecd67f839 req-225a3bb4-e13e-4da4-a6cd-4f11ef250ac1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:58.497796 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-461a8775-6662-4547-9d80-692ecd67f839 req-225a3bb4-e13e-4da4-a6cd-4f11ef250ac1 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=a229c806094b42c7a0f7ed52f78dfd68&device_id=fd8e39fc-699b-4777-aae4-ca592a898437 HTTP/1.1" status: 200 len: 1096 time: 0.3746200 Nov 09 04:28:58.501048 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53018) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:58.513392 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8cc20b16-9409-4f3f-b940-9be7733bc38e tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:58.562179 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-ef242e56-88be-48a1-8937-b6b367722715 tempest-FloatingIPAdminTestJSON-625682852 tempest-FloatingIPAdminTestJSON-625682852-project-admin] 10.222.0.24 "GET /v2.0/floatingips HTTP/1.1" status: 200 len: 2425 time: 0.2852499 Nov 09 04:28:58.564561 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5ec2a83f-4f88-4392-a224-9345b9cca970 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:58.576978 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53022) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:58.597823 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efbe6138-7f35-4a78-b226-c4382f39ee20 req-3c050ada-f2c3-44bd-a124-cc5645435232 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:58.604309 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-efbe6138-7f35-4a78-b226-c4382f39ee20 req-3c050ada-f2c3-44bd-a124-cc5645435232 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=a3d93294-0484-46fa-b8a6-204ec86c9c5f HTTP/1.1" status: 200 len: 850 time: 0.1521766 Nov 09 04:28:58.605311 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-5ec2a83f-4f88-4392-a224-9345b9cca970 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Calling delete_port for 07d9b155-0486-43e1-a756-50fbe8d7b2d0 owned by {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:28:58.613820 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4c1759a6-7725-4979-8c0e-f7ec23d7e66b tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Made reservation on behalf of 0f0b9fa79c884bda978424cf72c631d5 for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:28:58.620750 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4c1759a6-7725-4979-8c0e-f7ec23d7e66b tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:58.691190 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4c1759a6-7725-4979-8c0e-f7ec23d7e66b tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:58.793297 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efbe6138-7f35-4a78-b226-c4382f39ee20 req-cab03050-a2d1-4e33-b3c2-40b212cb827d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:58.794899 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-efbe6138-7f35-4a78-b226-c4382f39ee20 req-cab03050-a2d1-4e33-b3c2-40b212cb827d service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=468b2f91-119a-402c-b695-5d7963ec6348&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1648774 Nov 09 04:28:58.901350 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:28:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8959e461-bf12-4206-8a86-d5b0dc1afd12 x-openstack-request-id: req-8959e461-bf12-4206-8a86-d5b0dc1afd12 {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:28:58.901786 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1aa3bc74-67df-4706-979b-cbf709855232", "tag": "49694ee4-edfa-4a08-be0b-8bfa9b06128b", "status": "completed", "code": 200}]} {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:28:58.902044 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-8959e461-bf12-4206-8a86-d5b0dc1afd12 {{(pid=102161) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:28:58.902520 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1aa3bc74-67df-4706-979b-cbf709855232', 'tag': '49694ee4-edfa-4a08-be0b-8bfa9b06128b', 'status': 'completed', 'code': 200} Nov 09 04:28:58.991515 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4c1759a6-7725-4979-8c0e-f7ec23d7e66b tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:59.004382 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-efbe6138-7f35-4a78-b226-c4382f39ee20 req-28bed4b9-c428-4ef0-8797-9c34947c9a93 service neutron] 10.222.0.26 "GET /v2.0/networks/468b2f91-119a-402c-b695-5d7963ec6348?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1884234 Nov 09 04:28:59.048197 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4c1759a6-7725-4979-8c0e-f7ec23d7e66b tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:59.070514 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5ec2a83f-4f88-4392-a224-9345b9cca970 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:59.133938 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4c1759a6-7725-4979-8c0e-f7ec23d7e66b tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 317} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:28:59.145333 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c1759a6-7725-4979-8c0e-f7ec23d7e66b tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a306d7e6-050a-4562-8abd-43c9603f60b6,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:59.166159 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ec2a83f-4f88-4392-a224-9345b9cca970 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Pushing event deleted for resources: {'Port': ['ID=07d9b155-0486-43e1-a756-50fbe8d7b2d0,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:59.231731 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c09f9a5d-1341-4ed3-9f90-9134787b1b20 req-720e334f-f764-4187-bb49-eb00801275fa tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:59.233236 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c09f9a5d-1341-4ed3-9f90-9134787b1b20 req-720e334f-f764-4187-bb49-eb00801275fa tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.24 "GET /v2.0/ports?device_id=1aa3bc74-67df-4706-979b-cbf709855232 HTTP/1.1" status: 200 len: 943 time: 0.2230291 Nov 09 04:28:59.236071 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4c1759a6-7725-4979-8c0e-f7ec23d7e66b tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:59.236485 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-4c1759a6-7725-4979-8c0e-f7ec23d7e66b tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Added segment ece9e464-d526-4279-a858-9059edff602d of type vlan for network 17167882-1589-4583-8b9c-87263d360cca Nov 09 04:28:59.265687 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [None req-62ba7d10-10fa-462f-998b-68a06db78789 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions returned with HTTP 200 {{(pid=102162) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:28:59.277968 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-62ba7d10-10fa-462f-998b-68a06db78789 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14077 time: 0.7707696 Nov 09 04:28:59.281640 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53026) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:59.307073 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8cc20b16-9409-4f3f-b940-9be7733bc38e tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Network daccf5f5-3ea8-4f1b-ab62-78949d47bb91 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:28:59.312371 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [None req-e742181e-032b-4bc7-b5ed-0caac0221534 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/address-group returned with HTTP 200 {{(pid=102161) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:28:59.315137 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-e742181e-032b-4bc7-b5ed-0caac0221534 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/address-group HTTP/1.1" status: 200 len: 353 time: 0.0241749 Nov 09 04:28:59.325883 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53030) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:59.344729 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-288bd353-7adb-4646-8749-3bc4671da97f tempest-ExternalNetworksAdminNegativeTestJSON-1412169277 tempest-ExternalNetworksAdminNegativeTestJSON-1412169277-project-admin] Publish callbacks [] for floatingip, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:59.361581 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-8cc20b16-9409-4f3f-b940-9be7733bc38e tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:28:59.363881 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8cc20b16-9409-4f3f-b940-9be7733bc38e tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:28:59.377219 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8cc20b16-9409-4f3f-b940-9be7733bc38e tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:59.377219 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8cc20b16-9409-4f3f-b940-9be7733bc38e tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:59.379809 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [None req-8f69397d-3bfb-4832-bce5-ef345f713e8b tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/address-scope returned with HTTP 200 {{(pid=102161) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:28:59.386748 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-8f69397d-3bfb-4832-bce5-ef345f713e8b tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/address-scope HTTP/1.1" status: 200 len: 357 time: 0.0554748 Nov 09 04:28:59.410692 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53032) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:59.438074 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [None req-f7b38caa-33d9-4b71-907f-6ced0b177bc0 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/router-admin-state-down-before-update returned with HTTP 200 {{(pid=102162) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:28:59.441050 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5ec2a83f-4f88-4392-a224-9345b9cca970 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:59.443285 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-f7b38caa-33d9-4b71-907f-6ced0b177bc0 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/router-admin-state-down-before-update HTTP/1.1" status: 200 len: 506 time: 0.0135241 Nov 09 04:28:59.447440 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-5ec2a83f-4f88-4392-a224-9345b9cca970 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] 10.222.0.24 "DELETE /v2.0/ports/07d9b155-0486-43e1-a756-50fbe8d7b2d0 HTTP/1.1" status: 204 len: 168 time: 2.9869153 Nov 09 04:28:59.481998 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cc20b16-9409-4f3f-b940-9be7733bc38e tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Pushing event updated for resources: {'Port': ['ID=108ed2fc-5c3f-4fd4-8c8a-37bd462b1797,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:28:59.482532 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53034) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:59.482873 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53036) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:59.497377 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-efbe6138-7f35-4a78-b226-c4382f39ee20 req-4e751d8f-7ba6-4d2f-b06b-9429431b88bf service neutron] 10.222.0.26 "GET /v2.0/networks/468b2f91-119a-402c-b695-5d7963ec6348?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4232976 Nov 09 04:28:59.517726 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [None req-45feb785-854a-4895-b55a-03a75894f781 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/agent returned with HTTP 200 {{(pid=102161) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:28:59.524824 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-45feb785-854a-4895-b55a-03a75894f781 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/agent HTTP/1.1" status: 200 len: 347 time: 0.0215173 Nov 09 04:28:59.531703 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-8cc20b16-9409-4f3f-b940-9be7733bc38e tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 943 time: 2.9620492 Nov 09 04:28:59.534200 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53038) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:59.552329 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53040) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:59.581637 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [None req-26673b22-713f-43e6-bf28-45ca33a9dc3d tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/agent-resources-synced returned with HTTP 200 {{(pid=102162) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:28:59.582814 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-26673b22-713f-43e6-bf28-45ca33a9dc3d tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/agent-resources-synced HTTP/1.1" status: 200 len: 417 time: 0.0302882 Nov 09 04:28:59.593182 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-6ab1b955-cd2e-486e-9a12-c83a64d626b4 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Request body: {'port': {'network_id': 'daccf5f5-3ea8-4f1b-ab62-78949d47bb91', 'name': 'tempest-AllowedAddressPairIpV6TestJSON-757192762'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:59.600078 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4c1759a6-7725-4979-8c0e-f7ec23d7e66b tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:59.602437 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53042) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:59.639048 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [None req-3eeb201d-0188-4c23-acb1-3c383ec27a2e tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/allowed-address-pairs returned with HTTP 200 {{(pid=102161) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:28:59.640094 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-3eeb201d-0188-4c23-acb1-3c383ec27a2e tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/allowed-address-pairs HTTP/1.1" status: 200 len: 378 time: 0.0365016 Nov 09 04:28:59.641279 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-ef88f1ef-1f32-48cb-ab77-d8be0400bb36 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] GET failed (client error): The resource could not be found. Nov 09 04:28:59.646239 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-ef88f1ef-1f32-48cb-ab77-d8be0400bb36 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] 10.222.0.24 "GET /v2.0/ports/07d9b155-0486-43e1-a756-50fbe8d7b2d0 HTTP/1.1" status: 404 len: 333 time: 0.1329434 Nov 09 04:28:59.656395 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53044) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:59.656884 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53046) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:59.668627 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-285f4283-f004-4922-8abd-43c1cc46b37e tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Request body: {'port': {'network_id': 'e96f4292-19f0-4446-b093-408610b619f1', 'name': 'tempest-AllowedAddressPairTestJSON-662159011'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:28:59.749801 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [None req-2f28e033-eda6-444d-bffd-9aadcdad1b63 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/auto-allocated-topology returned with HTTP 200 {{(pid=102161) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:28:59.750752 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-2f28e033-eda6-444d-bffd-9aadcdad1b63 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/auto-allocated-topology HTTP/1.1" status: 200 len: 394 time: 0.0904381 Nov 09 04:28:59.762307 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53048) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:59.777032 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [None req-ec61286c-b20f-4a2d-8fc0-ec03985887a0 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/availability_zone returned with HTTP 200 {{(pid=102162) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:28:59.778167 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-ec61286c-b20f-4a2d-8fc0-ec03985887a0 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/availability_zone HTTP/1.1" status: 200 len: 372 time: 0.0049915 Nov 09 04:28:59.779409 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-461a8775-6662-4547-9d80-692ecd67f839 req-b8e91f1c-9c07-4fb6-a66c-f2e54fdcfc19 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:59.780978 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-461a8775-6662-4547-9d80-692ecd67f839 req-b8e91f1c-9c07-4fb6-a66c-f2e54fdcfc19 service neutron] 10.222.0.26 "GET /v2.0/networks?id=d4ba3288-221c-40f3-a829-662c462cc93f HTTP/1.1" status: 200 len: 906 time: 1.2588999 Nov 09 04:28:59.782893 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53050) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:59.793932 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [None req-6e296fbe-c61c-4b3f-a506-0cb3ec9e3b04 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/availability_zone_filter returned with HTTP 200 {{(pid=102162) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:28:59.795290 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-6e296fbe-c61c-4b3f-a506-0cb3ec9e3b04 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/availability_zone_filter HTTP/1.1" status: 200 len: 414 time: 0.0047650 Nov 09 04:28:59.821983 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db1a5604-fbcb-4487-95d8-053d1f52d5d8 req-68956f16-a233-4421-9a7d-cfb30904847e tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:28:59.829811 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-ee36d55b-47d9-4cdb-9a57-d209bc0c6f2f None None] Provisioning complete for port 108ed2fc-5c3f-4fd4-8c8a-37bd462b1797 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:28:59.830565 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-db1a5604-fbcb-4487-95d8-053d1f52d5d8 req-68956f16-a233-4421-9a7d-cfb30904847e tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "GET /v2.0/ports?device_id=fd8e39fc-699b-4777-aae4-ca592a898437 HTTP/1.1" status: 200 len: 943 time: 0.3348987 Nov 09 04:28:59.831647 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee36d55b-47d9-4cdb-9a57-d209bc0c6f2f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:59.837610 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53052) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:59.858493 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [None req-5d94113f-ea94-46f6-9205-add1f98434f9 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/default-subnetpools returned with HTTP 200 {{(pid=102162) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:28:59.865068 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-5d94113f-ea94-46f6-9205-add1f98434f9 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/default-subnetpools HTTP/1.1" status: 200 len: 405 time: 0.0177629 Nov 09 04:28:59.876250 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53054) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:59.878617 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-62a14109-ce0d-41be-b922-4ae08fb556bf tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Deleting port e44bbd89-4625-4e16-91ef-9daeff9b4ff3 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:28:59.879365 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-62a14109-ce0d-41be-b922-4ae08fb556bf tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:28:59.894387 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [None req-edde9e80-23b4-4270-b420-6b31315e4b2d tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/dhcp_agent_scheduler returned with HTTP 200 {{(pid=102162) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:28:59.894387 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-edde9e80-23b4-4270-b420-6b31315e4b2d tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/dhcp_agent_scheduler HTTP/1.1" status: 200 len: 381 time: 0.0087566 Nov 09 04:28:59.904053 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53056) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:59.909495 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.db.resource_extend [None req-4c1759a6-7725-4979-8c0e-f7ec23d7e66b tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] It took 0.25 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 09 04:28:59.917761 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [None req-52ad8e1a-d443-40b6-aabf-c3daff9a118b tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/dvr returned with HTTP 200 {{(pid=102162) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:28:59.918777 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-52ad8e1a-d443-40b6-aabf-c3daff9a118b tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/dvr HTTP/1.1" status: 200 len: 387 time: 0.0082722 Nov 09 04:28:59.933954 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53058) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:59.949729 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [None req-f11ce0f6-f9e1-40c8-8e68-4c01a43efeec tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/empty-string-filtering returned with HTTP 200 {{(pid=102161) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:28:59.950972 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-f11ce0f6-f9e1-40c8-8e68-4c01a43efeec tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/empty-string-filtering HTTP/1.1" status: 200 len: 413 time: 0.0143168 Nov 09 04:28:59.961123 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53060) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:59.961719 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-ee36d55b-47d9-4cdb-9a57-d209bc0c6f2f None None] Port 108ed2fc-5c3f-4fd4-8c8a-37bd462b1797 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:28:59.971945 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [None req-86161fb2-f92a-4f0c-b282-d5f8769884e6 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/external-net returned with HTTP 200 {{(pid=102162) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:28:59.975251 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-86161fb2-f92a-4f0c-b282-d5f8769884e6 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/external-net HTTP/1.1" status: 200 len: 394 time: 0.0058041 Nov 09 04:28:59.982745 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53062) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:28:59.986942 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c09f9a5d-1341-4ed3-9f90-9134787b1b20 req-c8bc432d-a412-44ab-b96f-e7f50bdd510a tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.24 "GET /v2.0/security-groups?id=4b002f37-f4ce-4d8a-a894-560955e72139&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.7325122 Nov 09 04:29:00.005044 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [None req-c1d5fd7a-0921-4859-b71c-fb0e0cb1a9af tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/extra_dhcp_opt returned with HTTP 200 {{(pid=102162) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:29:00.008066 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-c1d5fd7a-0921-4859-b71c-fb0e0cb1a9af tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/extra_dhcp_opt HTTP/1.1" status: 200 len: 498 time: 0.0229826 Nov 09 04:29:00.019092 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53064) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:00.024296 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [None req-e8de520a-ac27-437d-9345-f82cb03d0c2c tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/extraroute returned with HTTP 200 {{(pid=102161) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:29:00.025245 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-e8de520a-ac27-437d-9345-f82cb03d0c2c tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/extraroute HTTP/1.1" status: 200 len: 375 time: 0.0052247 Nov 09 04:29:00.028672 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53066) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:00.035217 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-db1a5604-fbcb-4487-95d8-053d1f52d5d8 req-1cd10355-0514-4f2b-9425-0b6de160f877 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "GET /v2.0/security-groups?id=67cb2d36-e38c-4a29-adb5-c52b1d94ae99&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2043712 Nov 09 04:29:00.040029 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [None req-a434d62a-33d2-44f2-9518-2d2c167d6cf7 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/extraroute-atomic returned with HTTP 200 {{(pid=102162) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:29:00.040962 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a434d62a-33d2-44f2-9518-2d2c167d6cf7 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/extraroute-atomic HTTP/1.1" status: 200 len: 444 time: 0.0048566 Nov 09 04:29:00.044085 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53068) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:00.048541 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [None req-90a918ed-5723-4a65-9227-ad97bb404757 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/filter-validation returned with HTTP 200 {{(pid=102161) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:29:00.051836 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-90a918ed-5723-4a65-9227-ad97bb404757 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/filter-validation HTTP/1.1" status: 200 len: 392 time: 0.0044529 Nov 09 04:29:00.052992 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53070) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:00.057933 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [None req-201b89c8-ace2-4f4a-bc96-757244291cf4 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/fip-port-details returned with HTTP 200 {{(pid=102162) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:29:00.058909 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-201b89c8-ace2-4f4a-bc96-757244291cf4 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/fip-port-details HTTP/1.1" status: 200 len: 406 time: 0.0050242 Nov 09 04:29:00.068618 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53072) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:00.073006 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-62a14109-ce0d-41be-b922-4ae08fb556bf tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:00.073355 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-62a14109-ce0d-41be-b922-4ae08fb556bf tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:00.073855 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [None req-5c2f28ee-ed1d-4630-b73f-e4df32ae1e27 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/flavors returned with HTTP 200 {{(pid=102161) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:29:00.077612 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-5c2f28ee-ed1d-4630-b73f-e4df32ae1e27 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/flavors HTTP/1.1" status: 200 len: 387 time: 0.0073140 Nov 09 04:29:00.078204 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53074) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:00.084944 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-288bd353-7adb-4646-8749-3bc4671da97f tempest-ExternalNetworksAdminNegativeTestJSON-1412169277 tempest-ExternalNetworksAdminNegativeTestJSON-1412169277-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:00.086856 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [None req-149b0e79-afdc-4b23-b50a-4b2400981cc4 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/floatingip-pools returned with HTTP 200 {{(pid=102161) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:29:00.095494 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-149b0e79-afdc-4b23-b50a-4b2400981cc4 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/floatingip-pools HTTP/1.1" status: 200 len: 382 time: 0.0077486 Nov 09 04:29:00.095494 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-285f4283-f004-4922-8abd-43c1cc46b37e tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Made reservation on behalf of a369b57921894b01a70b43c4f969d224 for: {'port': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:29:00.095494 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-285f4283-f004-4922-8abd-43c1cc46b37e tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:00.097806 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-62a14109-ce0d-41be-b922-4ae08fb556bf tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Calling delete_port for e44bbd89-4625-4e16-91ef-9daeff9b4ff3 owned by network:floatingip {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:29:00.099390 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53076) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:00.113456 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4c1759a6-7725-4979-8c0e-f7ec23d7e66b tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:00.114445 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4c1759a6-7725-4979-8c0e-f7ec23d7e66b tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:00.115039 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4c1759a6-7725-4979-8c0e-f7ec23d7e66b tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:00.136020 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [None req-e4a5d1c2-e0dc-47ca-bc02-4b945159e5fe tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/ip-substring-filtering returned with HTTP 200 {{(pid=102162) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:29:00.136999 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e4a5d1c2-e0dc-47ca-bc02-4b945159e5fe tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/ip-substring-filtering HTTP/1.1" status: 200 len: 416 time: 0.0331469 Nov 09 04:29:00.141212 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53078) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:00.142846 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [None req-285f4283-f004-4922-8abd-43c1cc46b37e tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] device_id is not set on port 935f4bfd-1fe9-45c5-8908-25562cbf71c9 yet. {{(pid=102161) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:29:00.159225 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [None req-1b949205-d39a-401b-8930-faa650e2629d tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/router returned with HTTP 200 {{(pid=102161) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:29:00.160952 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1b949205-d39a-401b-8930-faa650e2629d tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/router HTTP/1.1" status: 200 len: 450 time: 0.0125031 Nov 09 04:29:00.167349 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53080) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:00.216802 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [None req-2a43a0cf-1808-46c7-8825-995356297eed tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/ext-gw-mode returned with HTTP 200 {{(pid=102161) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:29:00.217832 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-2a43a0cf-1808-46c7-8825-995356297eed tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/ext-gw-mode HTTP/1.1" status: 200 len: 462 time: 0.0060966 Nov 09 04:29:00.244617 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53082) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:00.252679 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [None req-6222060b-f151-4104-a45f-fffe3530519f tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/l3-ha returned with HTTP 200 {{(pid=102162) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:29:00.253517 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-6222060b-f151-4104-a45f-fffe3530519f tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/l3-ha HTTP/1.1" status: 200 len: 360 time: 0.0075054 Nov 09 04:29:00.263843 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53084) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:00.271950 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [None req-12ad4b79-a754-4b89-a66d-72a8433d5a55 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/l3-flavors returned with HTTP 200 {{(pid=102162) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:29:00.273930 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-12ad4b79-a754-4b89-a66d-72a8433d5a55 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/l3-flavors HTTP/1.1" status: 200 len: 366 time: 0.0065606 Nov 09 04:29:00.292192 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53086) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:00.314726 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [None req-9057c87d-b2bf-47b6-aa90-29addc80484a tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/l3-port-ip-change-not-allowed returned with HTTP 200 {{(pid=102162) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:29:00.321452 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-9057c87d-b2bf-47b6-aa90-29addc80484a tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/l3-port-ip-change-not-allowed HTTP/1.1" status: 200 len: 439 time: 0.0282211 Nov 09 04:29:00.330959 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53088) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:00.335171 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [None req-653f979d-e266-4b1a-8ea2-cb3bfa930345 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/l3_agent_scheduler returned with HTTP 200 {{(pid=102162) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:29:00.336829 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-653f979d-e266-4b1a-8ea2-cb3bfa930345 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/l3_agent_scheduler HTTP/1.1" status: 200 len: 374 time: 0.0049477 Nov 09 04:29:00.337240 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-285f4283-f004-4922-8abd-43c1cc46b37e tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Allocated IP 172.20.0.11 (e96f4292-19f0-4446-b093-408610b619f1/300c7541-d41f-47e3-ad5e-4d083e87c290/935f4bfd-1fe9-45c5-8908-25562cbf71c9) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:29:00.345250 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53090) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:00.349521 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [None req-2048ce8d-9bcd-45fa-a1d5-f87d2aac44b6 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/metering returned with HTTP 200 {{(pid=102162) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:29:00.354046 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-2048ce8d-9bcd-45fa-a1d5-f87d2aac44b6 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/metering HTTP/1.1" status: 200 len: 357 time: 0.0042915 Nov 09 04:29:00.359786 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-288bd353-7adb-4646-8749-3bc4671da97f tempest-ExternalNetworksAdminNegativeTestJSON-1412169277 tempest-ExternalNetworksAdminNegativeTestJSON-1412169277-project-admin] Allocated IP 172.26.0.126 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/1875e08e-82ed-422c-a89b-0db337f49c03) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:29:00.361528 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53092) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:00.368964 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [None req-783a10dc-743f-4d9f-a4ca-f7af23e9a4b6 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/metering_source_and_destination_fields returned with HTTP 200 {{(pid=102162) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:29:00.370798 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-783a10dc-743f-4d9f-a4ca-f7af23e9a4b6 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/metering_source_and_destination_fields HTTP/1.1" status: 200 len: 515 time: 0.0074754 Nov 09 04:29:00.374516 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53094) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:00.374720 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6ab1b955-cd2e-486e-9a12-c83a64d626b4 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Made reservation on behalf of 18f5ee1caa74420f9ab67cc92c1e02e6 for: {'port': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:29:00.378340 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6ab1b955-cd2e-486e-9a12-c83a64d626b4 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:00.383568 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [None req-88a5ddf8-2bd6-4756-aa5d-f3e6c05380e7 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/multi-provider returned with HTTP 200 {{(pid=102162) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:29:00.386966 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-88a5ddf8-2bd6-4756-aa5d-f3e6c05380e7 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/multi-provider HTTP/1.1" status: 200 len: 406 time: 0.0098164 Nov 09 04:29:00.388748 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53096) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:00.392359 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [None req-6f3d62e1-0c54-474b-ad59-9efad645a72d tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/net-mtu returned with HTTP 200 {{(pid=102162) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:29:00.393324 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-6f3d62e1-0c54-474b-ad59-9efad645a72d tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/net-mtu HTTP/1.1" status: 200 len: 370 time: 0.0046170 Nov 09 04:29:00.399306 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c1759a6-7725-4979-8c0e-f7ec23d7e66b tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Pushing event updated for resources: {'Network': ['ID=17167882-1589-4583-8b9c-87263d360cca,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:00.400435 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53098) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:00.407990 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [None req-2cd39c19-08c1-432c-a89d-b87c15697d66 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/net-mtu-writable returned with HTTP 200 {{(pid=102162) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:29:00.408955 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-2cd39c19-08c1-432c-a89d-b87c15697d66 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/net-mtu-writable HTTP/1.1" status: 200 len: 401 time: 0.0076113 Nov 09 04:29:00.412883 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 17167882-1589-4583-8b9c-87263d360cca details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:29:00.414607 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53100) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:00.431402 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [None req-e3b56019-0bfc-4bf7-a511-bdc2aa5bfce2 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/network_availability_zone returned with HTTP 200 {{(pid=102162) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:29:00.433253 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e3b56019-0bfc-4bf7-a511-bdc2aa5bfce2 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/network_availability_zone HTTP/1.1" status: 200 len: 394 time: 0.0149312 Nov 09 04:29:00.437498 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [None req-6ab1b955-cd2e-486e-9a12-c83a64d626b4 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] device_id is not set on port 4246a39f-609e-4468-8e98-df1b9d5d58c9 yet. {{(pid=102161) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:29:00.441322 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53102) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:00.447160 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [None req-19a731d7-e176-4fda-a29f-40b2c4949d7d tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/network-ip-availability returned with HTTP 200 {{(pid=102162) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:29:00.450450 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-19a731d7-e176-4fda-a29f-40b2c4949d7d tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/network-ip-availability HTTP/1.1" status: 200 len: 410 time: 0.0058808 Nov 09 04:29:00.474854 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53104) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:00.482738 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [None req-d6e33e18-f325-4edc-a00e-b54631655abb tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/pagination returned with HTTP 200 {{(pid=102162) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:29:00.485718 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-d6e33e18-f325-4edc-a00e-b54631655abb tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/pagination HTTP/1.1" status: 200 len: 386 time: 0.0075929 Nov 09 04:29:00.497996 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53106) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:00.504299 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [None req-66ca9cda-250f-4c2a-853c-d6d44ca16dd2 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/port-device-profile returned with HTTP 200 {{(pid=102162) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:29:00.507523 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-66ca9cda-250f-4c2a-853c-d6d44ca16dd2 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/port-device-profile HTTP/1.1" status: 200 len: 383 time: 0.0047321 Nov 09 04:29:00.508134 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53108) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:00.513272 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [None req-396a1b0f-0852-45a6-9bd7-37ed5e06e7f0 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/port-mac-address-regenerate returned with HTTP 200 {{(pid=102162) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:29:00.515145 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-396a1b0f-0852-45a6-9bd7-37ed5e06e7f0 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/port-mac-address-regenerate HTTP/1.1" status: 200 len: 403 time: 0.0045528 Nov 09 04:29:00.519836 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53110) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:00.526729 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [None req-6c89f4bf-9d88-4a3a-bb28-8663dd20f214 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/port-numa-affinity-policy returned with HTTP 200 {{(pid=102162) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:29:00.530213 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-6c89f4bf-9d88-4a3a-bb28-8663dd20f214 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/port-numa-affinity-policy HTTP/1.1" status: 200 len: 392 time: 0.0062795 Nov 09 04:29:00.530527 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53112) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:00.534602 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [None req-57efa444-f7a8-4dc7-a9ed-88da8a716aab tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/binding returned with HTTP 200 {{(pid=102162) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:29:00.537775 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-57efa444-f7a8-4dc7-a9ed-88da8a716aab tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/binding HTTP/1.1" status: 200 len: 387 time: 0.0041411 Nov 09 04:29:00.541289 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53114) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:00.548878 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [None req-4ee95f67-9b4e-4a64-b32d-592298951784 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/binding-extended returned with HTTP 200 {{(pid=102161) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:29:00.552297 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-4ee95f67-9b4e-4a64-b32d-592298951784 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/binding-extended HTTP/1.1" status: 200 len: 406 time: 0.0048139 Nov 09 04:29:00.568931 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-4c1759a6-7725-4979-8c0e-f7ec23d7e66b tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 875 time: 3.6488903 Nov 09 04:29:00.569481 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53116) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:00.571705 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [None req-274615cf-9040-462a-855e-9800b24fd2f2 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/port-security returned with HTTP 200 {{(pid=102162) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:29:00.582185 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-274615cf-9040-462a-855e-9800b24fd2f2 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/port-security HTTP/1.1" status: 200 len: 354 time: 0.0050330 Nov 09 04:29:00.582450 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53118) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:00.582450 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-9bde925f-5c53-4c57-9a33-63ddbd291181 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Request body: {'subnet': {'network_id': '17167882-1589-4583-8b9c-87263d360cca', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'enable_dhcp': False}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:00.582712 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53120) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:00.590171 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [None req-b06e3390-cbbb-4428-bc6c-ccae0034c9f4 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/project-id returned with HTTP 200 {{(pid=102162) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:29:00.596366 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-b06e3390-cbbb-4428-bc6c-ccae0034c9f4 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/project-id HTTP/1.1" status: 200 len: 398 time: 0.0081084 Nov 09 04:29:00.607097 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53122) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:00.611655 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [None req-0d4f9914-d6e9-4ae8-9f7d-4621230188d3 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/provider returned with HTTP 200 {{(pid=102162) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:29:00.615197 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-0d4f9914-d6e9-4ae8-9f7d-4621230188d3 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/provider HTTP/1.1" status: 200 len: 385 time: 0.0045276 Nov 09 04:29:00.619691 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53124) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:00.628745 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [None req-784ff537-ec86-46d8-9565-b6dc967e09ca tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/quota-check-limit returned with HTTP 200 {{(pid=102162) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:29:00.632227 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-784ff537-ec86-46d8-9565-b6dc967e09ca tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/quota-check-limit HTTP/1.1" status: 200 len: 420 time: 0.0091178 Nov 09 04:29:00.633785 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53126) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:00.638632 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [None req-58169a49-2280-4a9f-9822-4a19729e18d9 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/quotas returned with HTTP 200 {{(pid=102161) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:29:00.641925 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-58169a49-2280-4a9f-9822-4a19729e18d9 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/quotas HTTP/1.1" status: 200 len: 386 time: 0.0054924 Nov 09 04:29:00.646114 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53128) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:00.657760 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-288bd353-7adb-4646-8749-3bc4671da97f tempest-ExternalNetworksAdminNegativeTestJSON-1412169277 tempest-ExternalNetworksAdminNegativeTestJSON-1412169277-project-admin] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:00.660059 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [None req-c4b11cf7-04f5-45d6-9ba7-1e4a1aff0434 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/quota_details returned with HTTP 200 {{(pid=102161) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:29:00.661294 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-c4b11cf7-04f5-45d6-9ba7-1e4a1aff0434 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/quota_details HTTP/1.1" status: 200 len: 407 time: 0.0102689 Nov 09 04:29:00.673490 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53130) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:00.679990 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-6ab1b955-cd2e-486e-9a12-c83a64d626b4 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Allocated IP 2001:db8::1eb (daccf5f5-3ea8-4f1b-ab62-78949d47bb91/88d0e868-7936-4409-8f96-0f4e98202b5e/4246a39f-609e-4468-8e98-df1b9d5d58c9) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:29:00.680326 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [None req-e512ad65-eb61-4379-b4ac-78ca71bab8ae tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/rbac-policies returned with HTTP 200 {{(pid=102162) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:29:00.682584 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e512ad65-eb61-4379-b4ac-78ca71bab8ae tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/rbac-policies HTTP/1.1" status: 200 len: 417 time: 0.0068693 Nov 09 04:29:00.693659 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53132) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:00.701510 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [None req-5c7aefe1-0e8d-416b-998a-579de9d7f6e1 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/rbac-address-group returned with HTTP 200 {{(pid=102161) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:29:00.702457 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-5c7aefe1-0e8d-416b-998a-579de9d7f6e1 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/rbac-address-group HTTP/1.1" status: 200 len: 392 time: 0.0049112 Nov 09 04:29:00.705131 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53134) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:00.711091 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [None req-d12cd8cf-9cdd-45ee-bacc-fd177e6a99db tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/rbac-address-scope returned with HTTP 200 {{(pid=102162) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:29:00.712853 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-d12cd8cf-9cdd-45ee-bacc-fd177e6a99db tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/rbac-address-scope HTTP/1.1" status: 200 len: 384 time: 0.0060496 Nov 09 04:29:00.715811 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53136) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:00.722333 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [None req-a133435b-7ac3-45b6-a241-fe9f071d7af5 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/rbac-security-groups returned with HTTP 200 {{(pid=102162) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:29:00.724068 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a133435b-7ac3-45b6-a241-fe9f071d7af5 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/rbac-security-groups HTTP/1.1" status: 200 len: 404 time: 0.0072842 Nov 09 04:29:00.732236 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53138) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:00.741656 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [None req-a7be6304-0bbb-4a90-9427-e274ccf0a7eb tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/rbac-subnetpool returned with HTTP 200 {{(pid=102162) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:29:00.743147 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a7be6304-0bbb-4a90-9427-e274ccf0a7eb tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/rbac-subnetpool HTTP/1.1" status: 200 len: 375 time: 0.0092235 Nov 09 04:29:00.745738 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53140) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:00.759186 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [None req-62b472b7-8a58-48ac-abff-889a2b1472cb tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/revision-if-match returned with HTTP 200 {{(pid=102162) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:29:00.760262 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-62b472b7-8a58-48ac-abff-889a2b1472cb tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/revision-if-match HTTP/1.1" status: 200 len: 441 time: 0.0058191 Nov 09 04:29:00.760583 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-285f4283-f004-4922-8abd-43c1cc46b37e tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:00.761659 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-62a14109-ce0d-41be-b922-4ae08fb556bf tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:00.763546 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53142) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:00.770132 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [None req-d266c18c-c76b-43c7-a7df-d9e745913b32 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/standard-attr-revisions returned with HTTP 200 {{(pid=102162) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:29:00.771171 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-d266c18c-c76b-43c7-a7df-d9e745913b32 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/standard-attr-revisions HTTP/1.1" status: 200 len: 423 time: 0.0042777 Nov 09 04:29:00.776822 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53144) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:00.780521 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9bde925f-5c53-4c57-9a33-63ddbd291181 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Made reservation on behalf of 0f0b9fa79c884bda978424cf72c631d5 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:29:00.782808 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9bde925f-5c53-4c57-9a33-63ddbd291181 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:00.806687 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [None req-0b6128e0-bfa7-4da1-9015-12c13decd4f9 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/router_availability_zone returned with HTTP 200 {{(pid=102162) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:29:00.812224 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53146) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:00.814672 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-0b6128e0-bfa7-4da1-9015-12c13decd4f9 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/router_availability_zone HTTP/1.1" status: 200 len: 391 time: 0.0348246 Nov 09 04:29:00.816249 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [None req-718bc570-93f6-4b9d-9dc7-69db7a838c5d tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/security-groups-normalized-cidr returned with HTTP 200 {{(pid=102161) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:29:00.817138 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-718bc570-93f6-4b9d-9dc7-69db7a838c5d tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/security-groups-normalized-cidr HTTP/1.1" status: 200 len: 445 time: 0.0042477 Nov 09 04:29:00.821328 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53148) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:00.829678 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62a14109-ce0d-41be-b922-4ae08fb556bf tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Pushing event deleted for resources: {'Port': ['ID=e44bbd89-4625-4e16-91ef-9daeff9b4ff3,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:00.854390 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [None req-6a601c9c-043d-4f33-94fb-9ae8968202d1 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/port-security-groups-filtering returned with HTTP 200 {{(pid=102161) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:29:00.855444 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-6a601c9c-043d-4f33-94fb-9ae8968202d1 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/port-security-groups-filtering HTTP/1.1" status: 200 len: 422 time: 0.0050037 Nov 09 04:29:00.860073 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-288bd353-7adb-4646-8749-3bc4671da97f tempest-ExternalNetworksAdminNegativeTestJSON-1412169277 tempest-ExternalNetworksAdminNegativeTestJSON-1412169277-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:00.868624 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53150) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:00.895897 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [None req-f45279b0-b2b8-44d4-b96e-2f5b243ba7ec tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/security-groups-remote-address-group returned with HTTP 200 {{(pid=102161) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:29:00.896853 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-f45279b0-b2b8-44d4-b96e-2f5b243ba7ec tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/security-groups-remote-address-group HTTP/1.1" status: 200 len: 448 time: 0.0226049 Nov 09 04:29:00.914347 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-288bd353-7adb-4646-8749-3bc4671da97f tempest-ExternalNetworksAdminNegativeTestJSON-1412169277 tempest-ExternalNetworksAdminNegativeTestJSON-1412169277-project-admin] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:29:00.933902 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53152) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:00.942725 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [None req-f00257cd-6bec-462e-8464-2926c049f3eb tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/security-groups-shared-filtering returned with HTTP 200 {{(pid=102162) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:29:00.943718 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-f00257cd-6bec-462e-8464-2926c049f3eb tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/security-groups-shared-filtering HTTP/1.1" status: 200 len: 435 time: 0.0091887 Nov 09 04:29:00.948853 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-288bd353-7adb-4646-8749-3bc4671da97f tempest-ExternalNetworksAdminNegativeTestJSON-1412169277 tempest-ExternalNetworksAdminNegativeTestJSON-1412169277-project-admin] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:29:00.949119 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53154) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:00.951334 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-288bd353-7adb-4646-8749-3bc4671da97f tempest-ExternalNetworksAdminNegativeTestJSON-1412169277 tempest-ExternalNetworksAdminNegativeTestJSON-1412169277-project-admin] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:29:00.959045 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [None req-cd29bfc6-2968-483b-8a27-b85e0b55e894 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/security-group returned with HTTP 200 {{(pid=102161) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:29:00.963089 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-cd29bfc6-2968-483b-8a27-b85e0b55e894 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/security-group HTTP/1.1" status: 200 len: 364 time: 0.0051491 Nov 09 04:29:00.964537 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53156) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:00.975376 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [None req-223fce38-e7f8-409a-a906-36692e579d19 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/service-type returned with HTTP 200 {{(pid=102161) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:29:00.979618 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-223fce38-e7f8-409a-a906-36692e579d19 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/service-type HTTP/1.1" status: 200 len: 415 time: 0.0098770 Nov 09 04:29:00.980586 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53158) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:00.988028 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [None req-1439cf47-b858-47af-a53c-25070b1aa379 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/sorting returned with HTTP 200 {{(pid=102161) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:29:00.992026 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1439cf47-b858-47af-a53c-25070b1aa379 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/sorting HTTP/1.1" status: 200 len: 377 time: 0.0066142 Nov 09 04:29:00.996155 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53160) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:01.018007 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [None req-79b92b00-734e-46e2-aaeb-310ea537b9bd tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/standard-attr-description returned with HTTP 200 {{(pid=102161) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:29:01.018007 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-79b92b00-734e-46e2-aaeb-310ea537b9bd tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/standard-attr-description HTTP/1.1" status: 200 len: 408 time: 0.0102339 Nov 09 04:29:01.021868 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53164) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:01.038274 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [None req-dfc5b90c-92ce-41c1-9ebe-e10725a7df96 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/stateful-security-group returned with HTTP 200 {{(pid=102161) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:29:01.042344 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-dfc5b90c-92ce-41c1-9ebe-e10725a7df96 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/stateful-security-group HTTP/1.1" status: 200 len: 402 time: 0.0094261 Nov 09 04:29:01.048142 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-62a14109-ce0d-41be-b922-4ae08fb556bf tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks [] for floatingip, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:01.048142 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.l3_db [None req-62a14109-ce0d-41be-b922-4ae08fb556bf tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Floating IP 757d9653-a9b4-4deb-a1a6-847129aa5fa2 disassociated (deleted). External IP: 172.26.0.148, port: ceb33408-7f98-40bc-9e0d-9341e2ff0309. Nov 09 04:29:01.048371 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53166) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:01.089759 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [None req-c05d464f-ec1f-4129-a988-2ef752d995c7 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/subnet_onboard returned with HTTP 200 {{(pid=102161) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:29:01.089759 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-c05d464f-ec1f-4129-a988-2ef752d995c7 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/subnet_onboard HTTP/1.1" status: 200 len: 391 time: 0.0428975 Nov 09 04:29:01.094423 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-285f4283-f004-4922-8abd-43c1cc46b37e tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:01.096106 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53170) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:01.102041 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [None req-aeff9456-89f7-4027-b852-7d52af8b3efe tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/subnet-service-types returned with HTTP 200 {{(pid=102161) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:29:01.103405 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-aeff9456-89f7-4027-b852-7d52af8b3efe tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/subnet-service-types HTTP/1.1" status: 200 len: 400 time: 0.0062969 Nov 09 04:29:01.111363 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6ab1b955-cd2e-486e-9a12-c83a64d626b4 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:01.122750 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53172) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:01.137392 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [None req-ebe4c903-8429-4455-8039-9efc80e64841 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/subnet_allocation returned with HTTP 200 {{(pid=102161) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:29:01.142811 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-ebe4c903-8429-4455-8039-9efc80e64841 tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/subnet_allocation HTTP/1.1" status: 200 len: 388 time: 0.0187421 Nov 09 04:29:01.149052 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53174) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:01.185336 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-288bd353-7adb-4646-8749-3bc4671da97f tempest-ExternalNetworksAdminNegativeTestJSON-1412169277 tempest-ExternalNetworksAdminNegativeTestJSON-1412169277-project-admin] Pushing event updated for resources: {'Port': ['ID=1875e08e-82ed-422c-a89b-0db337f49c03,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:01.199122 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [None req-b69fa8b2-dec6-49a9-987a-646774ea24db tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/subnetpool-prefix-ops returned with HTTP 200 {{(pid=102161) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:29:01.202665 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-b69fa8b2-dec6-49a9-987a-646774ea24db tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/subnetpool-prefix-ops HTTP/1.1" status: 200 len: 418 time: 0.0336194 Nov 09 04:29:01.209393 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53176) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:01.228361 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [None req-928a252d-7f7f-420d-9010-e5001d76b88f tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/standard-attr-tag returned with HTTP 200 {{(pid=102161) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:29:01.232051 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-928a252d-7f7f-420d-9010-e5001d76b88f tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/standard-attr-tag HTTP/1.1" status: 200 len: 537 time: 0.0161207 Nov 09 04:29:01.240803 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53178) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:01.251129 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [None req-1ce2e8fe-9978-47f6-8b3e-d172ea118b2d tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] http://10.222.0.24:9696/v2.0/extensions/standard-attr-timestamp returned with HTTP 200 {{(pid=102162) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:29:01.255188 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-1ce2e8fe-9978-47f6-8b3e-d172ea118b2d tempest-ExtensionsTestJSON-1397752607 tempest-ExtensionsTestJSON-1397752607-project] 10.222.0.24 "GET /v2.0/extensions/standard-attr-timestamp HTTP/1.1" status: 200 len: 449 time: 0.0080717 Nov 09 04:29:01.289684 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-285f4283-f004-4922-8abd-43c1cc46b37e tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Network e96f4292-19f0-4446-b093-408610b619f1 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:29:01.317367 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-288bd353-7adb-4646-8749-3bc4671da97f tempest-ExternalNetworksAdminNegativeTestJSON-1412169277 tempest-ExternalNetworksAdminNegativeTestJSON-1412169277-project-admin] Publish callbacks [] for floatingip, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:01.331001 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-285f4283-f004-4922-8abd-43c1cc46b37e tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:29:01.331614 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47486c7b-df7d-4263-bcd2-eb23f581636f req-56c4d832-166f-4cec-83f3-8f4d9f83ec9b tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:01.333167 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-47486c7b-df7d-4263-bcd2-eb23f581636f req-56c4d832-166f-4cec-83f3-8f4d9f83ec9b tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "GET /v2.0/ports?device_id=fd8e39fc-699b-4777-aae4-ca592a898437 HTTP/1.1" status: 200 len: 943 time: 0.1556504 Nov 09 04:29:01.333456 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-285f4283-f004-4922-8abd-43c1cc46b37e tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:29:01.374949 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-285f4283-f004-4922-8abd-43c1cc46b37e tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Pushing event updated for resources: {'Port': ['ID=935f4bfd-1fe9-45c5-8908-25562cbf71c9,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:01.426290 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7633a2f3-3530-4a6e-bc55-c40985c0514f req-51ccd03e-c7fe-4d1d-9451-e27457f8b472 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:01.433106 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-7633a2f3-3530-4a6e-bc55-c40985c0514f req-51ccd03e-c7fe-4d1d-9451-e27457f8b472 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.24 "GET /v2.0/ports?device_id=1aa3bc74-67df-4706-979b-cbf709855232 HTTP/1.1" status: 200 len: 943 time: 0.3438666 Nov 09 04:29:01.452260 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-285f4283-f004-4922-8abd-43c1cc46b37e tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:01.452878 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-285f4283-f004-4922-8abd-43c1cc46b37e tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:01.475559 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-47486c7b-df7d-4263-bcd2-eb23f581636f req-9c671456-7908-4dbf-90fe-bb42db4c9894 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "GET /v2.0/security-groups?id=67cb2d36-e38c-4a29-adb5-c52b1d94ae99&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1340945 Nov 09 04:29:01.479201 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-288bd353-7adb-4646-8749-3bc4671da97f tempest-ExternalNetworksAdminNegativeTestJSON-1412169277 tempest-ExternalNetworksAdminNegativeTestJSON-1412169277-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:01.513577 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6ab1b955-cd2e-486e-9a12-c83a64d626b4 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:01.526028 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-7633a2f3-3530-4a6e-bc55-c40985c0514f req-e04d9160-d8dd-409d-9e77-cb6b44e1c87a tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.24 "GET /v2.0/security-groups?id=4b002f37-f4ce-4d8a-a894-560955e72139&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0884020 Nov 09 04:29:01.529869 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-62a14109-ce0d-41be-b922-4ae08fb556bf tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Router cd21e659-1094-4653-b570-03e6ed4305e3 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:29:01.574076 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-285f4283-f004-4922-8abd-43c1cc46b37e tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 1.9102020 Nov 09 04:29:01.575631 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53182) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:01.587055 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-8012b821-b3b7-4e67-9f3f-7ba724bc7020 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Request body: {'port': {'network_id': 'e96f4292-19f0-4446-b093-408610b619f1', 'name': 'tempest-AllowedAddressPairTestJSON-653578749'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:01.643496 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6ab1b955-cd2e-486e-9a12-c83a64d626b4 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Network daccf5f5-3ea8-4f1b-ab62-78949d47bb91 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:29:01.706872 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ab1b955-cd2e-486e-9a12-c83a64d626b4 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Pushing event updated for resources: {'Port': ['ID=4246a39f-609e-4468-8e98-df1b9d5d58c9,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:01.711208 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-6ab1b955-cd2e-486e-9a12-c83a64d626b4 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:29:01.712212 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-ed236820-f93c-4f01-99db-8418261dad81 None None] Provisioning complete for port 935f4bfd-1fe9-45c5-8908-25562cbf71c9 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:29:01.713206 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ed236820-f93c-4f01-99db-8418261dad81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:01.719204 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ab1b955-cd2e-486e-9a12-c83a64d626b4 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:29:01.729646 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6ab1b955-cd2e-486e-9a12-c83a64d626b4 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:01.729646 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6ab1b955-cd2e-486e-9a12-c83a64d626b4 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:01.775160 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-ed236820-f93c-4f01-99db-8418261dad81 None None] Port 935f4bfd-1fe9-45c5-8908-25562cbf71c9 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:29:01.841478 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-6ab1b955-cd2e-486e-9a12-c83a64d626b4 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 943 time: 2.2796469 Nov 09 04:29:01.872828 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.objects.ports [None req-9bde925f-5c53-4c57-9a33-63ddbd291181 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=102161) get_objects /opt/stack/neutron/neutron/objects/ports.py:444}} Nov 09 04:29:01.873425 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9bde925f-5c53-4c57-9a33-63ddbd291181 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:01.909613 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53188) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:01.910042 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53190) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:01.927014 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-80093698-7a9b-4e39-ad0a-0c89147e5909 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Request body: {'port': {'allowed_address_pairs': [{'ip_address': '2001:db8::23b', 'mac_address': 'fa:16:3e:87:f8:a2'}, {'ip_address': '2001:db8::122', 'mac_address': 'fa:16:3e:1a:82:fe'}]}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:01.930482 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8012b821-b3b7-4e67-9f3f-7ba724bc7020 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Made reservation on behalf of a369b57921894b01a70b43c4f969d224 for: {'port': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:29:01.934085 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8012b821-b3b7-4e67-9f3f-7ba724bc7020 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:02.000952 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [None req-8012b821-b3b7-4e67-9f3f-7ba724bc7020 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] device_id is not set on port 169727b8-13f8-4d12-a56d-06813e708126 yet. {{(pid=102161) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:29:02.028551 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bde925f-5c53-4c57-9a33-63ddbd291181 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Pushing event updated for resources: {'Subnet': ['ID=aa65f5f6-77d4-4b7b-b90f-b2ffac782dc1,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:02.061570 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-288bd353-7adb-4646-8749-3bc4671da97f tempest-ExternalNetworksAdminNegativeTestJSON-1412169277 tempest-ExternalNetworksAdminNegativeTestJSON-1412169277-project-admin] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:02.071779 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-62a14109-ce0d-41be-b922-4ae08fb556bf tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:29:02.078102 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-62a14109-ce0d-41be-b922-4ae08fb556bf tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:02.082511 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-93ef68b1-ac06-48c1-b50e-61fcbc133d7f None None] Sync routers for ids ['cd21e659-1094-4653-b570-03e6ed4305e3'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:29:02.105351 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-93ef68b1-ac06-48c1-b50e-61fcbc133d7f None None] Routers {'cd21e659-1094-4653-b570-03e6ed4305e3'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:29:02.106133 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-93ef68b1-ac06-48c1-b50e-61fcbc133d7f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:28:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['cd21e659-1094-4653-b570-03e6ed4305e3'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:02.108216 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-288bd353-7adb-4646-8749-3bc4671da97f tempest-ExternalNetworksAdminNegativeTestJSON-1412169277 tempest-ExternalNetworksAdminNegativeTestJSON-1412169277-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:02.138448 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-62a14109-ce0d-41be-b922-4ae08fb556bf tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] 10.222.0.24 "DELETE /v2.0/floatingips/757d9653-a9b4-4deb-a1a6-847129aa5fa2 HTTP/1.1" status: 204 len: 168 time: 3.5480523 Nov 09 04:29:02.142807 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53194) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:02.150098 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-fbd7228b-6b13-401f-a92c-63ba96df1312 tempest-FloatingIPAdminTestJSON-625682852 tempest-FloatingIPAdminTestJSON-625682852-project-admin] Request body: {'floatingip': {'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:02.152452 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-59545b38-e79d-457c-a4a0-5232d7479c5a None None] Provisioning complete for port 4246a39f-609e-4468-8e98-df1b9d5d58c9 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:29:02.152940 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-59545b38-e79d-457c-a4a0-5232d7479c5a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:02.176879 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-93ef68b1-ac06-48c1-b50e-61fcbc133d7f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:02.197805 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-93ef68b1-ac06-48c1-b50e-61fcbc133d7f None None] Routers {'cd21e659-1094-4653-b570-03e6ed4305e3'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:29:02.198615 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-93ef68b1-ac06-48c1-b50e-61fcbc133d7f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:28:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['cd21e659-1094-4653-b570-03e6ed4305e3'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:02.230339 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-461a8775-6662-4547-9d80-692ecd67f839 req-3c421674-e12c-4953-9974-27d7bac4e4e1 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=9ce4bb36-a0c7-4517-abaf-8db99ca3bb12 HTTP/1.1" status: 200 len: 217 time: 0.0746706 Nov 09 04:29:02.238897 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-59545b38-e79d-457c-a4a0-5232d7479c5a None None] Port 4246a39f-609e-4468-8e98-df1b9d5d58c9 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:29:02.241402 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-93ef68b1-ac06-48c1-b50e-61fcbc133d7f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:02.242448 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-93ef68b1-ac06-48c1-b50e-61fcbc133d7f None None] The sync data for ids ['cd21e659-1094-4653-b570-03e6ed4305e3'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:29:02.252015 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-288bd353-7adb-4646-8749-3bc4671da97f tempest-ExternalNetworksAdminNegativeTestJSON-1412169277 tempest-ExternalNetworksAdminNegativeTestJSON-1412169277-project-admin] Pushing event updated for resources: {'Port': ['ID=1875e08e-82ed-422c-a89b-0db337f49c03,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:02.287806 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-288bd353-7adb-4646-8749-3bc4671da97f tempest-ExternalNetworksAdminNegativeTestJSON-1412169277 tempest-ExternalNetworksAdminNegativeTestJSON-1412169277-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:02.305076 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-461a8775-6662-4547-9d80-692ecd67f839 req-267136d7-2a2b-40f4-881e-f22c9336489a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:02.306561 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-461a8775-6662-4547-9d80-692ecd67f839 req-267136d7-2a2b-40f4-881e-f22c9336489a service neutron] 10.222.0.26 "GET /v2.0/subnets?id=b11be6b4-75f0-4756-9312-de5295f24e1b HTTP/1.1" status: 200 len: 844 time: 0.0649543 Nov 09 04:29:02.317920 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fbd7228b-6b13-401f-a92c-63ba96df1312 tempest-FloatingIPAdminTestJSON-625682852 tempest-FloatingIPAdminTestJSON-625682852-project-admin] Publish callbacks [] for floatingip, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:02.396117 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-288bd353-7adb-4646-8749-3bc4671da97f tempest-ExternalNetworksAdminNegativeTestJSON-1412169277 tempest-ExternalNetworksAdminNegativeTestJSON-1412169277-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:02.397328 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-288bd353-7adb-4646-8749-3bc4671da97f tempest-ExternalNetworksAdminNegativeTestJSON-1412169277 tempest-ExternalNetworksAdminNegativeTestJSON-1412169277-project-admin] 10.222.0.24 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 4.3490324 Nov 09 04:29:02.402571 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53196) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:02.409549 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-0fdcd9a0-b191-4fa5-b88e-4203265289b5 tempest-ExternalNetworksAdminNegativeTestJSON-1412169277 tempest-ExternalNetworksAdminNegativeTestJSON-1412169277-project-admin] Request body: {'port': {'name': 'tempest-ExternalNetworksAdminNegativeTestJSON-54836463', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'fixed_ips': [{'ip_address': '172.26.0.126'}]}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:02.414159 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-461a8775-6662-4547-9d80-692ecd67f839 req-af7e8aa8-7baa-4857-afb2-b2f91f2a71c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:02.415607 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-461a8775-6662-4547-9d80-692ecd67f839 req-af7e8aa8-7baa-4857-afb2-b2f91f2a71c1 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=d4ba3288-221c-40f3-a829-662c462cc93f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0947483 Nov 09 04:29:02.423435 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bcd1e717-38ff-41c7-b27c-6103a5cca747 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:02.456957 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9bde925f-5c53-4c57-9a33-63ddbd291181 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Checking segment: {'id': 'ece9e464-d526-4279-a858-9059edff602d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 317, 'network_id': '17167882-1589-4583-8b9c-87263d360cca'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:29:02.457323 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9bde925f-5c53-4c57-9a33-63ddbd291181 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Network hostable DHCP agents. Network: 17167882-1589-4583-8b9c-87263d360cca, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:29:02.530847 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0fdcd9a0-b191-4fa5-b88e-4203265289b5 tempest-ExternalNetworksAdminNegativeTestJSON-1412169277 tempest-ExternalNetworksAdminNegativeTestJSON-1412169277-project-admin] Made reservation on behalf of 121c73bcf3f444b6a12d8529493cd79e for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:29:02.533206 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0fdcd9a0-b191-4fa5-b88e-4203265289b5 tempest-ExternalNetworksAdminNegativeTestJSON-1412169277 tempest-ExternalNetworksAdminNegativeTestJSON-1412169277-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:02.552865 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-461a8775-6662-4547-9d80-692ecd67f839 req-d7c2d7a1-d8ac-4ff4-a35d-57d9695f6310 service neutron] 10.222.0.26 "GET /v2.0/networks/d4ba3288-221c-40f3-a829-662c462cc93f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1205795 Nov 09 04:29:02.552865 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0fdcd9a0-b191-4fa5-b88e-4203265289b5 tempest-ExternalNetworksAdminNegativeTestJSON-1412169277 tempest-ExternalNetworksAdminNegativeTestJSON-1412169277-project-admin] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:02.552865 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fbd7228b-6b13-401f-a92c-63ba96df1312 tempest-FloatingIPAdminTestJSON-625682852 tempest-FloatingIPAdminTestJSON-625682852-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:02.570419 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1a70bd5-6f7b-4b90-8149-5cb8929b0729 req-9187fb07-dd1d-4ab9-b082-570cfe9dd269 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:02.576680 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d1a70bd5-6f7b-4b90-8149-5cb8929b0729 req-9187fb07-dd1d-4ab9-b082-570cfe9dd269 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=5f3cd2a3586e46c09f847681f744075c&device_id=1aa3bc74-67df-4706-979b-cbf709855232 HTTP/1.1" status: 200 len: 1096 time: 0.1626549 Nov 09 04:29:02.600799 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-8012b821-b3b7-4e67-9f3f-7ba724bc7020 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Allocated IP 172.20.0.14 (e96f4292-19f0-4446-b093-408610b619f1/300c7541-d41f-47e3-ad5e-4d083e87c290/169727b8-13f8-4d12-a56d-06813e708126) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:29:02.612873 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9bde925f-5c53-4c57-9a33-63ddbd291181 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Network 17167882-1589-4583-8b9c-87263d360cca is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:29:02.664823 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-80093698-7a9b-4e39-ad0a-0c89147e5909 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:02.743867 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-9bde925f-5c53-4c57-9a33-63ddbd291181 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 17167882-1589-4583-8b9c-87263d360cca) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:29:02.751993 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8e25e100-b758-4f9d-acd5-8e15fb081ce0 None None] Network 17167882-1589-4583-8b9c-87263d360cca requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:29:02.768076 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9bde925f-5c53-4c57-9a33-63ddbd291181 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:02.768932 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9bde925f-5c53-4c57-9a33-63ddbd291181 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:02.815675 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1e91771-7c36-4ab8-8488-bf2fdf95a548 req-abb32f8f-bb03-4d08-a8d4-2706914cbb34 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:02.817178 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a1e91771-7c36-4ab8-8488-bf2fdf95a548 req-abb32f8f-bb03-4d08-a8d4-2706914cbb34 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "GET /v2.0/ports?device_id=fd8e39fc-699b-4777-aae4-ca592a898437 HTTP/1.1" status: 200 len: 943 time: 0.1962752 Nov 09 04:29:02.831589 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-fbd7228b-6b13-401f-a92c-63ba96df1312 tempest-FloatingIPAdminTestJSON-625682852 tempest-FloatingIPAdminTestJSON-625682852-project-admin] Allocated IP 172.26.0.90 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/5fd878ed-8fba-4f72-95ce-0b62ad2726f5) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:29:02.846769 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-461a8775-6662-4547-9d80-692ecd67f839 req-ce77457a-433f-4056-b374-6ded860dc535 service neutron] 10.222.0.26 "GET /v2.0/networks/d4ba3288-221c-40f3-a829-662c462cc93f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2826052 Nov 09 04:29:02.874755 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0fdcd9a0-b191-4fa5-b88e-4203265289b5 tempest-ExternalNetworksAdminNegativeTestJSON-1412169277 tempest-ExternalNetworksAdminNegativeTestJSON-1412169277-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:02.892615 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-55cafdef-d175-417d-b9fd-abf3b5370543 None None] Network 17167882-1589-4583-8b9c-87263d360cca requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:29:02.901209 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bcd1e717-38ff-41c7-b27c-6103a5cca747 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:02.910823 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2dada074-1bf0-4f84-817d-6d6fd9e23d63 req-11889c39-facf-4d12-8d6d-e535b5d3d29f tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:02.912329 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-2dada074-1bf0-4f84-817d-6d6fd9e23d63 req-11889c39-facf-4d12-8d6d-e535b5d3d29f tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.24 "GET /v2.0/ports?device_id=1aa3bc74-67df-4706-979b-cbf709855232 HTTP/1.1" status: 200 len: 943 time: 0.2940481 Nov 09 04:29:02.928042 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0fdcd9a0-b191-4fa5-b88e-4203265289b5 tempest-ExternalNetworksAdminNegativeTestJSON-1412169277 tempest-ExternalNetworksAdminNegativeTestJSON-1412169277-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:02.955854 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-9bde925f-5c53-4c57-9a33-63ddbd291181 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 822 time: 2.3775532 Nov 09 04:29:02.959021 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1a70bd5-6f7b-4b90-8149-5cb8929b0729 req-3eee4e4b-98df-4037-bf4a-94bbb27de011 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:02.960614 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d1a70bd5-6f7b-4b90-8149-5cb8929b0729 req-3eee4e4b-98df-4037-bf4a-94bbb27de011 service neutron] 10.222.0.26 "GET /v2.0/networks?id=468b2f91-119a-402c-b695-5d7963ec6348 HTTP/1.1" status: 200 len: 912 time: 0.3634114 Nov 09 04:29:02.961166 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53202) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:02.966404 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [None req-0fdcd9a0-b191-4fa5-b88e-4203265289b5 tempest-ExternalNetworksAdminNegativeTestJSON-1412169277 tempest-ExternalNetworksAdminNegativeTestJSON-1412169277-project-admin] device_id is not set on port c617770d-0508-42dd-919a-1680ad36b59d yet. {{(pid=102162) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:29:02.978795 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-a1c484b6-d520-4eb7-9055-073cd26067a7 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Request body: {'port': {'name': 'tempest-RoutersIpV6AdminTest-561643120', 'network_id': '17167882-1589-4583-8b9c-87263d360cca'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:03.008155 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bcd1e717-38ff-41c7-b27c-6103a5cca747 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:03.034418 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a1e91771-7c36-4ab8-8488-bf2fdf95a548 req-3e5a35cc-9f95-4519-a5da-c1f5f3262bce tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "GET /v2.0/security-groups?id=67cb2d36-e38c-4a29-adb5-c52b1d94ae99&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1934888 Nov 09 04:29:03.059512 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fdcd9a0-b191-4fa5-b88e-4203265289b5 tempest-ExternalNetworksAdminNegativeTestJSON-1412169277 tempest-ExternalNetworksAdminNegativeTestJSON-1412169277-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=df12496d-3213-4a62-9948-660c937650c4,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:03.069304 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d1a70bd5-6f7b-4b90-8149-5cb8929b0729 req-05e7cc09-3031-42ec-ae57-9059a12cb95e service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=49694ee4-edfa-4a08-be0b-8bfa9b06128b HTTP/1.1" status: 200 len: 217 time: 0.0949900 Nov 09 04:29:03.153832 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fbd7228b-6b13-401f-a92c-63ba96df1312 tempest-FloatingIPAdminTestJSON-625682852 tempest-FloatingIPAdminTestJSON-625682852-project-admin] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:03.205927 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-bcd1e717-38ff-41c7-b27c-6103a5cca747 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=1b42893b66344818b491d6dfcce24ca4&name=default HTTP/1.1" status: 200 len: 2996 time: 1.2924445 Nov 09 04:29:03.208734 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53204) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:03.215028 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bcd1e717-38ff-41c7-b27c-6103a5cca747 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6086b1e1-c7c1-49e7-afb6-17da19b9606e,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:03.232866 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8012b821-b3b7-4e67-9f3f-7ba724bc7020 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:03.238827 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-2dada074-1bf0-4f84-817d-6d6fd9e23d63 req-38a0ad84-f111-4a61-b981-d75353d327a0 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.24 "GET /v2.0/security-groups?id=4b002f37-f4ce-4d8a-a894-560955e72139&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2893071 Nov 09 04:29:03.251732 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a1c484b6-d520-4eb7-9055-073cd26067a7 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Made reservation on behalf of 0f0b9fa79c884bda978424cf72c631d5 for: {'port': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:29:03.254066 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a1c484b6-d520-4eb7-9055-073cd26067a7 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:03.262824 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5553e0e6-6caf-4d51-9ec7-6d3394375037 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:03.269426 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fbd7228b-6b13-401f-a92c-63ba96df1312 tempest-FloatingIPAdminTestJSON-625682852 tempest-FloatingIPAdminTestJSON-625682852-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:03.285018 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1a70bd5-6f7b-4b90-8149-5cb8929b0729 req-28e94e03-9d22-4de4-bc33-1b74aa63f7a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:03.286577 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d1a70bd5-6f7b-4b90-8149-5cb8929b0729 req-28e94e03-9d22-4de4-bc33-1b74aa63f7a7 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=a3d93294-0484-46fa-b8a6-204ec86c9c5f HTTP/1.1" status: 200 len: 850 time: 0.1823735 Nov 09 04:29:03.296200 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [None req-a1c484b6-d520-4eb7-9055-073cd26067a7 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] device_id is not set on port 5a559d98-4180-4b03-a40c-a198e82f0704 yet. {{(pid=102161) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:29:03.346465 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5553e0e6-6caf-4d51-9ec7-6d3394375037 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:03.374160 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fbd7228b-6b13-401f-a92c-63ba96df1312 tempest-FloatingIPAdminTestJSON-625682852 tempest-FloatingIPAdminTestJSON-625682852-project-admin] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:29:03.385979 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbd7228b-6b13-401f-a92c-63ba96df1312 tempest-FloatingIPAdminTestJSON-625682852 tempest-FloatingIPAdminTestJSON-625682852-project-admin] Pushing event updated for resources: {'Port': ['ID=5fd878ed-8fba-4f72-95ce-0b62ad2726f5,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:03.389344 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-fbd7228b-6b13-401f-a92c-63ba96df1312 tempest-FloatingIPAdminTestJSON-625682852 tempest-FloatingIPAdminTestJSON-625682852-project-admin] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:29:03.391574 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fbd7228b-6b13-401f-a92c-63ba96df1312 tempest-FloatingIPAdminTestJSON-625682852 tempest-FloatingIPAdminTestJSON-625682852-project-admin] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:29:03.423504 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-0fdcd9a0-b191-4fa5-b88e-4203265289b5 tempest-ExternalNetworksAdminNegativeTestJSON-1412169277 tempest-ExternalNetworksAdminNegativeTestJSON-1412169277-project-admin] POST failed (client error): There was a conflict when trying to complete your request. Nov 09 04:29:03.424005 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-0fdcd9a0-b191-4fa5-b88e-4203265289b5 tempest-ExternalNetworksAdminNegativeTestJSON-1412169277 tempest-ExternalNetworksAdminNegativeTestJSON-1412169277-project-admin] No notification will be sent due to unsuccessful status code: 409 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:29:03.432605 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-80093698-7a9b-4e39-ad0a-0c89147e5909 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:03.454995 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1a70bd5-6f7b-4b90-8149-5cb8929b0729 req-52d7004d-16f0-46b3-8b16-b5314e6fb167 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:03.456486 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d1a70bd5-6f7b-4b90-8149-5cb8929b0729 req-52d7004d-16f0-46b3-8b16-b5314e6fb167 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=468b2f91-119a-402c-b695-5d7963ec6348&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1488774 Nov 09 04:29:03.479620 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8012b821-b3b7-4e67-9f3f-7ba724bc7020 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:03.536240 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-80093698-7a9b-4e39-ad0a-0c89147e5909 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:03.538466 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-a1c484b6-d520-4eb7-9055-073cd26067a7 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Allocated IP 2001:db8::21 (17167882-1589-4583-8b9c-87263d360cca/aa65f5f6-77d4-4b7b-b90f-b2ffac782dc1/5a559d98-4180-4b03-a40c-a198e82f0704) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:29:03.555801 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-0fdcd9a0-b191-4fa5-b88e-4203265289b5 tempest-ExternalNetworksAdminNegativeTestJSON-1412169277 tempest-ExternalNetworksAdminNegativeTestJSON-1412169277-project-admin] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 409 len: 372 time: 1.1522160 Nov 09 04:29:03.574010 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53206) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:03.574183 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5553e0e6-6caf-4d51-9ec7-6d3394375037 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:03.576567 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5553e0e6-6caf-4d51-9ec7-6d3394375037 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:03.577684 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-5553e0e6-6caf-4d51-9ec7-6d3394375037 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/6086b1e1-c7c1-49e7-afb6-17da19b9606e HTTP/1.1" status: 204 len: 168 time: 0.3679211 Nov 09 04:29:03.590527 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5553e0e6-6caf-4d51-9ec7-6d3394375037 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6086b1e1-c7c1-49e7-afb6-17da19b9606e,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:03.608222 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fbd7228b-6b13-401f-a92c-63ba96df1312 tempest-FloatingIPAdminTestJSON-625682852 tempest-FloatingIPAdminTestJSON-625682852-project-admin] Publish callbacks [] for floatingip, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:03.647051 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-80093698-7a9b-4e39-ad0a-0c89147e5909 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] In _notify_port_updated(), no bound segment for port 4246a39f-609e-4468-8e98-df1b9d5d58c9 on network daccf5f5-3ea8-4f1b-ab62-78949d47bb91 {{(pid=102161) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 09 04:29:03.652847 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-80093698-7a9b-4e39-ad0a-0c89147e5909 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:03.653482 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-80093698-7a9b-4e39-ad0a-0c89147e5909 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:03.654819 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-80093698-7a9b-4e39-ad0a-0c89147e5909 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] 10.222.0.24 "PUT /v2.0/ports/4246a39f-609e-4468-8e98-df1b9d5d58c9 HTTP/1.1" status: 200 len: 1067 time: 1.7426047 Nov 09 04:29:03.657948 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53210) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:03.668373 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8012b821-b3b7-4e67-9f3f-7ba724bc7020 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Network e96f4292-19f0-4446-b093-408610b619f1 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:29:03.690059 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-8012b821-b3b7-4e67-9f3f-7ba724bc7020 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:29:03.691948 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8012b821-b3b7-4e67-9f3f-7ba724bc7020 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Pushing event updated for resources: {'Port': ['ID=169727b8-13f8-4d12-a56d-06813e708126,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:03.697270 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8012b821-b3b7-4e67-9f3f-7ba724bc7020 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:29:03.752972 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fbd7228b-6b13-401f-a92c-63ba96df1312 tempest-FloatingIPAdminTestJSON-625682852 tempest-FloatingIPAdminTestJSON-625682852-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:03.839941 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-85eb3e41-36af-4471-94fa-60baee55b487 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Deleting port 4246a39f-609e-4468-8e98-df1b9d5d58c9 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:29:03.840272 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-85eb3e41-36af-4471-94fa-60baee55b487 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:03.865144 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8012b821-b3b7-4e67-9f3f-7ba724bc7020 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:03.865853 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8012b821-b3b7-4e67-9f3f-7ba724bc7020 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:03.874874 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d1a70bd5-6f7b-4b90-8149-5cb8929b0729 req-357974a6-c782-4aa2-a8c0-4ff3456d50bc service neutron] 10.222.0.26 "GET /v2.0/networks/468b2f91-119a-402c-b695-5d7963ec6348?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4074721 Nov 09 04:29:03.958138 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80093698-7a9b-4e39-ad0a-0c89147e5909 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Pushing event updated for resources: {'Port': ['ID=4246a39f-609e-4468-8e98-df1b9d5d58c9,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:04.002693 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-7e1ceed7-e9c2-47a8-ab74-36dc945cbe7c None None] Provisioning complete for port 4246a39f-609e-4468-8e98-df1b9d5d58c9 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:29:04.003962 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7e1ceed7-e9c2-47a8-ab74-36dc945cbe7c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:04.006181 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-85eb3e41-36af-4471-94fa-60baee55b487 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:04.030941 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-85eb3e41-36af-4471-94fa-60baee55b487 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Calling delete_port for 4246a39f-609e-4468-8e98-df1b9d5d58c9 owned by {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:29:04.049628 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fbd7228b-6b13-401f-a92c-63ba96df1312 tempest-FloatingIPAdminTestJSON-625682852 tempest-FloatingIPAdminTestJSON-625682852-project-admin] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:04.058047 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-7e1ceed7-e9c2-47a8-ab74-36dc945cbe7c None None] Port 4246a39f-609e-4468-8e98-df1b9d5d58c9 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:29:04.121257 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fbd7228b-6b13-401f-a92c-63ba96df1312 tempest-FloatingIPAdminTestJSON-625682852 tempest-FloatingIPAdminTestJSON-625682852-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:04.150099 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-8012b821-b3b7-4e67-9f3f-7ba724bc7020 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 2.5705948 Nov 09 04:29:04.158704 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53222) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:04.167372 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-a996be44-c66e-4eea-ac65-61eabb03b845 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Request body: {'port': {'allowed_address_pairs': [{'ip_address': '172.20.0.7', 'mac_address': 'fa:16:3e:55:bc:e4'}, {'ip_address': '172.20.0.11', 'mac_address': 'fa:16:3e:7c:c2:93'}]}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:04.189088 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-cfaddfda-ec57-4d38-9d51-a540226d9ba7 None None] Provisioning complete for port 169727b8-13f8-4d12-a56d-06813e708126 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:29:04.189827 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-cfaddfda-ec57-4d38-9d51-a540226d9ba7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:04.197524 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d1a70bd5-6f7b-4b90-8149-5cb8929b0729 req-c34ebbbe-d873-4c56-93d5-e4d4bf64f6ab service neutron] 10.222.0.26 "GET /v2.0/networks/468b2f91-119a-402c-b695-5d7963ec6348?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2866037 Nov 09 04:29:04.225553 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbd7228b-6b13-401f-a92c-63ba96df1312 tempest-FloatingIPAdminTestJSON-625682852 tempest-FloatingIPAdminTestJSON-625682852-project-admin] Pushing event updated for resources: {'Port': ['ID=5fd878ed-8fba-4f72-95ce-0b62ad2726f5,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:04.256927 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-cfaddfda-ec57-4d38-9d51-a540226d9ba7 None None] Port 169727b8-13f8-4d12-a56d-06813e708126 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:29:04.274784 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-73587d82-5bcb-4c23-80c8-9b10c75cedba tempest-ExternalNetworksAdminNegativeTestJSON-1412169277 tempest-ExternalNetworksAdminNegativeTestJSON-1412169277-project-admin] Deleting port 1875e08e-82ed-422c-a89b-0db337f49c03 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:29:04.275115 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-73587d82-5bcb-4c23-80c8-9b10c75cedba tempest-ExternalNetworksAdminNegativeTestJSON-1412169277 tempest-ExternalNetworksAdminNegativeTestJSON-1412169277-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:04.278867 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a1c484b6-d520-4eb7-9055-073cd26067a7 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:04.316695 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c03946f1-edea-4498-a023-91a4c25e6966 req-655e6a7f-d0a7-496b-9e80-f036529307dd tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:04.318490 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c03946f1-edea-4498-a023-91a4c25e6966 req-655e6a7f-d0a7-496b-9e80-f036529307dd tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "GET /v2.0/ports?device_id=fd8e39fc-699b-4777-aae4-ca592a898437 HTTP/1.1" status: 200 len: 943 time: 0.1996038 Nov 09 04:29:04.324861 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fbd7228b-6b13-401f-a92c-63ba96df1312 tempest-FloatingIPAdminTestJSON-625682852 tempest-FloatingIPAdminTestJSON-625682852-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:04.388228 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c03946f1-edea-4498-a023-91a4c25e6966 req-0107e978-d156-407c-9a24-38869453cf9f tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "GET /v2.0/security-groups?id=67cb2d36-e38c-4a29-adb5-c52b1d94ae99&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0511415 Nov 09 04:29:04.421771 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fbd7228b-6b13-401f-a92c-63ba96df1312 tempest-FloatingIPAdminTestJSON-625682852 tempest-FloatingIPAdminTestJSON-625682852-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:04.422988 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-fbd7228b-6b13-401f-a92c-63ba96df1312 tempest-FloatingIPAdminTestJSON-625682852 tempest-FloatingIPAdminTestJSON-625682852-project-admin] 10.222.0.24 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 2.2792408 Nov 09 04:29:04.424321 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-85eb3e41-36af-4471-94fa-60baee55b487 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:04.428669 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53228) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:04.459556 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85eb3e41-36af-4471-94fa-60baee55b487 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Pushing event deleted for resources: {'Port': ['ID=4246a39f-609e-4468-8e98-df1b9d5d58c9,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:04.490135 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-73587d82-5bcb-4c23-80c8-9b10c75cedba tempest-ExternalNetworksAdminNegativeTestJSON-1412169277 tempest-ExternalNetworksAdminNegativeTestJSON-1412169277-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:04.490738 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-73587d82-5bcb-4c23-80c8-9b10c75cedba tempest-ExternalNetworksAdminNegativeTestJSON-1412169277 tempest-ExternalNetworksAdminNegativeTestJSON-1412169277-project-admin] Publish callbacks [] for floatingip, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:04.510895 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46accae3-37a7-4743-8e6b-316d52db534b req-023b14cd-dd08-4c97-919e-aeb15c45892a tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:04.512432 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-46accae3-37a7-4743-8e6b-316d52db534b req-023b14cd-dd08-4c97-919e-aeb15c45892a tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.24 "GET /v2.0/ports?device_id=1aa3bc74-67df-4706-979b-cbf709855232 HTTP/1.1" status: 200 len: 943 time: 0.1499448 Nov 09 04:29:04.515124 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a996be44-c66e-4eea-ac65-61eabb03b845 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:04.527747 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-73587d82-5bcb-4c23-80c8-9b10c75cedba tempest-ExternalNetworksAdminNegativeTestJSON-1412169277 tempest-ExternalNetworksAdminNegativeTestJSON-1412169277-project-admin] Calling delete_port for 1875e08e-82ed-422c-a89b-0db337f49c03 owned by network:floatingip {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:29:04.637425 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a1c484b6-d520-4eb7-9055-073cd26067a7 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:04.680671 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-85eb3e41-36af-4471-94fa-60baee55b487 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:04.684655 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-85eb3e41-36af-4471-94fa-60baee55b487 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] 10.222.0.24 "DELETE /v2.0/ports/4246a39f-609e-4468-8e98-df1b9d5d58c9 HTTP/1.1" status: 204 len: 168 time: 1.0256653 Nov 09 04:29:04.689954 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53238) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:04.724520 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-a12ac7ce-b6f5-4ff3-a9bf-c44564008ae0 tempest-FloatingIPAdminTestJSON-1680464394 tempest-FloatingIPAdminTestJSON-1680464394-project] Request body: {'floatingip': {'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:04.728591 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-46accae3-37a7-4743-8e6b-316d52db534b req-13a84606-86c4-4886-b1bd-832e8e056a5d tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.24 "GET /v2.0/security-groups?id=4b002f37-f4ce-4d8a-a894-560955e72139&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2073019 Nov 09 04:29:04.730326 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-777d5ec8-92ce-43cf-89f8-434749072ba3 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] GET failed (client error): The resource could not be found. Nov 09 04:29:04.732652 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-777d5ec8-92ce-43cf-89f8-434749072ba3 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] 10.222.0.24 "GET /v2.0/ports/4246a39f-609e-4468-8e98-df1b9d5d58c9 HTTP/1.1" status: 404 len: 333 time: 0.0416112 Nov 09 04:29:04.737454 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53240) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:04.769733 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a1c484b6-d520-4eb7-9055-073cd26067a7 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Network 17167882-1589-4583-8b9c-87263d360cca is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:29:04.813432 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-a1c484b6-d520-4eb7-9055-073cd26067a7 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:29:04.820285 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1c484b6-d520-4eb7-9055-073cd26067a7 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Pushing event updated for resources: {'Port': ['ID=5a559d98-4180-4b03-a40c-a198e82f0704,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:04.824622 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a1c484b6-d520-4eb7-9055-073cd26067a7 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:29:04.825589 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a1c484b6-d520-4eb7-9055-073cd26067a7 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:04.826187 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a1c484b6-d520-4eb7-9055-073cd26067a7 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:04.848288 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a12ac7ce-b6f5-4ff3-a9bf-c44564008ae0 tempest-FloatingIPAdminTestJSON-1680464394 tempest-FloatingIPAdminTestJSON-1680464394-project] Publish callbacks [] for floatingip, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:04.870038 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53244) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:04.958458 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a12ac7ce-b6f5-4ff3-a9bf-c44564008ae0 tempest-FloatingIPAdminTestJSON-1680464394 tempest-FloatingIPAdminTestJSON-1680464394-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:04.978801 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a1c484b6-d520-4eb7-9055-073cd26067a7 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1028 time: 2.0074525 Nov 09 04:29:04.984357 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53248) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:05.008862 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-0aaecea4-2dd8-4e01-9804-1b1163ac1114 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-50357582'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:05.067665 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-a12ac7ce-b6f5-4ff3-a9bf-c44564008ae0 tempest-FloatingIPAdminTestJSON-1680464394 tempest-FloatingIPAdminTestJSON-1680464394-project] Allocated IP 172.26.0.26 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/7aac9e85-a36c-4f42-93a1-7bdbde18fb1e) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:29:05.071848 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-d5cd9226-77f1-46bb-a48e-8fabfbf3b497 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Deleting port 108ed2fc-5c3f-4fd4-8c8a-37bd462b1797 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:29:05.072187 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d5cd9226-77f1-46bb-a48e-8fabfbf3b497 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:05.095224 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-73587d82-5bcb-4c23-80c8-9b10c75cedba tempest-ExternalNetworksAdminNegativeTestJSON-1412169277 tempest-ExternalNetworksAdminNegativeTestJSON-1412169277-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:05.118213 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a996be44-c66e-4eea-ac65-61eabb03b845 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:05.148773 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0aaecea4-2dd8-4e01-9804-1b1163ac1114 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Made reservation on behalf of 83cbb798c0f44b268f8acd2a70eb745a for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:29:05.152107 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0aaecea4-2dd8-4e01-9804-1b1163ac1114 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:05.158859 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73587d82-5bcb-4c23-80c8-9b10c75cedba tempest-ExternalNetworksAdminNegativeTestJSON-1412169277 tempest-ExternalNetworksAdminNegativeTestJSON-1412169277-project-admin] Pushing event deleted for resources: {'Port': ['ID=1875e08e-82ed-422c-a89b-0db337f49c03,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:05.172354 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a12ac7ce-b6f5-4ff3-a9bf-c44564008ae0 tempest-FloatingIPAdminTestJSON-1680464394 tempest-FloatingIPAdminTestJSON-1680464394-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:05.202108 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a996be44-c66e-4eea-ac65-61eabb03b845 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:05.203978 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0aaecea4-2dd8-4e01-9804-1b1163ac1114 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:05.382483 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d5cd9226-77f1-46bb-a48e-8fabfbf3b497 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:05.406387 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a996be44-c66e-4eea-ac65-61eabb03b845 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Pushing event updated for resources: {'Port': ['ID=169727b8-13f8-4d12-a56d-06813e708126,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:05.417589 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-c79ae359-825f-4b48-9945-2cf8f7e9cb21 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Deleting port 5a559d98-4180-4b03-a40c-a198e82f0704 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:29:05.417919 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c79ae359-825f-4b48-9945-2cf8f7e9cb21 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:05.420812 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-d5cd9226-77f1-46bb-a48e-8fabfbf3b497 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Calling delete_port for 108ed2fc-5c3f-4fd4-8c8a-37bd462b1797 owned by {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:29:05.511828 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2adcda34-57b3-4e22-8df1-b009d14a5cec req-bb3dba10-c895-49fe-85d3-cadc5cc94f00 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:05.513529 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2adcda34-57b3-4e22-8df1-b009d14a5cec req-bb3dba10-c895-49fe-85d3-cadc5cc94f00 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "GET /v2.0/ports?device_id=fd8e39fc-699b-4777-aae4-ca592a898437 HTTP/1.1" status: 200 len: 943 time: 0.0513151 Nov 09 04:29:05.516736 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a12ac7ce-b6f5-4ff3-a9bf-c44564008ae0 tempest-FloatingIPAdminTestJSON-1680464394 tempest-FloatingIPAdminTestJSON-1680464394-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:05.567619 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a12ac7ce-b6f5-4ff3-a9bf-c44564008ae0 tempest-FloatingIPAdminTestJSON-1680464394 tempest-FloatingIPAdminTestJSON-1680464394-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:29:05.572366 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-a12ac7ce-b6f5-4ff3-a9bf-c44564008ae0 tempest-FloatingIPAdminTestJSON-1680464394 tempest-FloatingIPAdminTestJSON-1680464394-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:29:05.578114 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a12ac7ce-b6f5-4ff3-a9bf-c44564008ae0 tempest-FloatingIPAdminTestJSON-1680464394 tempest-FloatingIPAdminTestJSON-1680464394-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:29:05.594087 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-726f6d94-86c7-4d8c-b782-2a911bf5baee None None] Provisioning complete for port 169727b8-13f8-4d12-a56d-06813e708126 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:29:05.594720 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-726f6d94-86c7-4d8c-b782-2a911bf5baee None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:05.626850 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a12ac7ce-b6f5-4ff3-a9bf-c44564008ae0 tempest-FloatingIPAdminTestJSON-1680464394 tempest-FloatingIPAdminTestJSON-1680464394-project] Pushing event updated for resources: {'Port': ['ID=7aac9e85-a36c-4f42-93a1-7bdbde18fb1e,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:05.635548 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-726f6d94-86c7-4d8c-b782-2a911bf5baee None None] Port 169727b8-13f8-4d12-a56d-06813e708126 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:29:05.643586 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2adcda34-57b3-4e22-8df1-b009d14a5cec req-0ddb33dc-29cb-47fc-8969-9c4b1204ab49 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "GET /v2.0/security-groups?id=67cb2d36-e38c-4a29-adb5-c52b1d94ae99&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1233928 Nov 09 04:29:05.703496 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a12ac7ce-b6f5-4ff3-a9bf-c44564008ae0 tempest-FloatingIPAdminTestJSON-1680464394 tempest-FloatingIPAdminTestJSON-1680464394-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:05.744720 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-73587d82-5bcb-4c23-80c8-9b10c75cedba tempest-ExternalNetworksAdminNegativeTestJSON-1412169277 tempest-ExternalNetworksAdminNegativeTestJSON-1412169277-project-admin] Publish callbacks [] for floatingip, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:05.747311 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-73587d82-5bcb-4c23-80c8-9b10c75cedba tempest-ExternalNetworksAdminNegativeTestJSON-1412169277 tempest-ExternalNetworksAdminNegativeTestJSON-1412169277-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:05.748453 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-73587d82-5bcb-4c23-80c8-9b10c75cedba tempest-ExternalNetworksAdminNegativeTestJSON-1412169277 tempest-ExternalNetworksAdminNegativeTestJSON-1412169277-project-admin] 10.222.0.24 "DELETE /v2.0/floatingips/e5302bad-27a2-41cf-a10b-ba5f2009e997 HTTP/1.1" status: 204 len: 168 time: 2.1710000 Nov 09 04:29:05.755018 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-a996be44-c66e-4eea-ac65-61eabb03b845 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] In _notify_port_updated(), no bound segment for port 169727b8-13f8-4d12-a56d-06813e708126 on network e96f4292-19f0-4446-b093-408610b619f1 {{(pid=102161) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 09 04:29:05.760620 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a996be44-c66e-4eea-ac65-61eabb03b845 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:05.761271 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a996be44-c66e-4eea-ac65-61eabb03b845 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:05.765197 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a996be44-c66e-4eea-ac65-61eabb03b845 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] 10.222.0.24 "PUT /v2.0/ports/169727b8-13f8-4d12-a56d-06813e708126 HTTP/1.1" status: 200 len: 1056 time: 1.6001580 Nov 09 04:29:05.769968 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53256) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:05.779696 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a12ac7ce-b6f5-4ff3-a9bf-c44564008ae0 tempest-FloatingIPAdminTestJSON-1680464394 tempest-FloatingIPAdminTestJSON-1680464394-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:05.942598 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a12ac7ce-b6f5-4ff3-a9bf-c44564008ae0 tempest-FloatingIPAdminTestJSON-1680464394 tempest-FloatingIPAdminTestJSON-1680464394-project] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:05.986242 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c79ae359-825f-4b48-9945-2cf8f7e9cb21 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:06.022339 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-c79ae359-825f-4b48-9945-2cf8f7e9cb21 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Calling delete_port for 5a559d98-4180-4b03-a40c-a198e82f0704 owned by {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:29:06.050084 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0aaecea4-2dd8-4e01-9804-1b1163ac1114 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:06.058973 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a12ac7ce-b6f5-4ff3-a9bf-c44564008ae0 tempest-FloatingIPAdminTestJSON-1680464394 tempest-FloatingIPAdminTestJSON-1680464394-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:06.062999 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1787f4e-79f1-4e4f-a970-2aad97bf77dc req-4be1aa0a-c079-424e-9528-eb34265466e9 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:06.064517 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b1787f4e-79f1-4e4f-a970-2aad97bf77dc req-4be1aa0a-c079-424e-9528-eb34265466e9 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.24 "GET /v2.0/ports?device_id=1aa3bc74-67df-4706-979b-cbf709855232 HTTP/1.1" status: 200 len: 943 time: 0.1935368 Nov 09 04:29:06.131007 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a12ac7ce-b6f5-4ff3-a9bf-c44564008ae0 tempest-FloatingIPAdminTestJSON-1680464394 tempest-FloatingIPAdminTestJSON-1680464394-project] Pushing event updated for resources: {'Port': ['ID=7aac9e85-a36c-4f42-93a1-7bdbde18fb1e,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:06.144814 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a12ac7ce-b6f5-4ff3-a9bf-c44564008ae0 tempest-FloatingIPAdminTestJSON-1680464394 tempest-FloatingIPAdminTestJSON-1680464394-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:06.150331 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0aaecea4-2dd8-4e01-9804-1b1163ac1114 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:06.209320 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-8e7d3f30-ac88-42b8-86a0-329aa8416598 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Deleting port 169727b8-13f8-4d12-a56d-06813e708126 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:29:06.209658 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8e7d3f30-ac88-42b8-86a0-329aa8416598 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:06.220182 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0aaecea4-2dd8-4e01-9804-1b1163ac1114 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 313} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:29:06.260498 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53260) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:06.279437 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0aaecea4-2dd8-4e01-9804-1b1163ac1114 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Pushing event updated for resources: {'SecurityGroup': ['ID=1cd00c25-cc79-48f6-918b-ebdf4918201a,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:06.283465 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0aaecea4-2dd8-4e01-9804-1b1163ac1114 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:06.283812 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-0aaecea4-2dd8-4e01-9804-1b1163ac1114 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Added segment 649c5ab9-1338-4cdb-aae3-0ee34f456666 of type vlan for network 6f70786d-53ba-429d-b311-5a26e2e908bd Nov 09 04:29:06.322671 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b1787f4e-79f1-4e4f-a970-2aad97bf77dc req-8b4e68d5-5d08-43dc-b674-1811966356b4 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.24 "GET /v2.0/security-groups?id=4b002f37-f4ce-4d8a-a894-560955e72139&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2255919 Nov 09 04:29:06.376634 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6a9f7d16-8ea1-4401-a6eb-5992b4cfa7d8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:06.389531 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0aaecea4-2dd8-4e01-9804-1b1163ac1114 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:06.439370 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8e7d3f30-ac88-42b8-86a0-329aa8416598 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:06.452630 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-8e7d3f30-ac88-42b8-86a0-329aa8416598 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Calling delete_port for 169727b8-13f8-4d12-a56d-06813e708126 owned by {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:29:06.454106 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6a9f7d16-8ea1-4401-a6eb-5992b4cfa7d8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:06.528671 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 49694ee4-edfa-4a08-be0b-8bfa9b06128b details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=102163) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 09 04:29:06.631557 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 49694ee4-edfa-4a08-be0b-8bfa9b06128b, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=49694ee4-edfa-4a08-be0b-8bfa9b06128b,segment=NetworkSegment(efe0485f-d48f-4307-b89a-0bcb86aaf1c2),segment_id=efe0485f-d48f-4307-b89a-0bcb86aaf1c2)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:29:06.643915 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Returning: {'device': '49694ee4-edfa-4a08-be0b-8bfa9b06128b', 'network_id': '468b2f91-119a-402c-b695-5d7963ec6348', 'port_id': '49694ee4-edfa-4a08-be0b-8bfa9b06128b', 'mac_address': 'fa:16:3e:2d:8b:fa', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 329, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a3d93294-0484-46fa-b8a6-204ec86c9c5f', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102163) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 09 04:29:06.726910 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:06.726910 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 49694ee4-edfa-4a08-be0b-8bfa9b06128b {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:29:06.726910 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 49694ee4-edfa-4a08-be0b-8bfa9b06128b, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=49694ee4-edfa-4a08-be0b-8bfa9b06128b,segment=NetworkSegment(efe0485f-d48f-4307-b89a-0bcb86aaf1c2),segment_id=efe0485f-d48f-4307-b89a-0bcb86aaf1c2)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:29:06.793348 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72aab262-726c-4795-8306-941c381f3166 req-15e788e3-f516-4559-bb55-58357b238568 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:06.794885 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-72aab262-726c-4795-8306-941c381f3166 req-15e788e3-f516-4559-bb55-58357b238568 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "GET /v2.0/ports?device_id=fd8e39fc-699b-4777-aae4-ca592a898437 HTTP/1.1" status: 200 len: 943 time: 0.0521305 Nov 09 04:29:06.840157 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-72aab262-726c-4795-8306-941c381f3166 req-af3e16d7-0c5e-469d-933b-0f919e9173e8 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "GET /v2.0/security-groups?id=67cb2d36-e38c-4a29-adb5-c52b1d94ae99&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0394168 Nov 09 04:29:06.930227 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a12ac7ce-b6f5-4ff3-a9bf-c44564008ae0 tempest-FloatingIPAdminTestJSON-1680464394 tempest-FloatingIPAdminTestJSON-1680464394-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:06.934240 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a12ac7ce-b6f5-4ff3-a9bf-c44564008ae0 tempest-FloatingIPAdminTestJSON-1680464394 tempest-FloatingIPAdminTestJSON-1680464394-project] 10.222.0.24 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 2.4980965 Nov 09 04:29:06.936017 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53266) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:06.985014 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-c5ce7f04-3a92-4d24-88e6-04d566a2498b tempest-FloatingIPAdminTestJSON-625682852 tempest-FloatingIPAdminTestJSON-625682852-project-admin] 10.222.0.24 "GET /v2.0/floatingips HTTP/1.1" status: 200 len: 2609 time: 0.0478458 Nov 09 04:29:06.987527 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53268) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:07.053100 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-fd483aad-8b0e-48a6-a5bb-89028d3a7094 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] 10.222.0.24 "GET /v2.0/floatingips HTTP/1.1" status: 200 len: 691 time: 0.0645373 Nov 09 04:29:07.056285 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53270) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:07.172375 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-2403a9b7-034e-4a16-ab82-aad5b39b1c49 tempest-FloatingIPAdminTestJSON-1680464394 tempest-FloatingIPAdminTestJSON-1680464394-project] Deleting port 7aac9e85-a36c-4f42-93a1-7bdbde18fb1e {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:29:07.172701 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2403a9b7-034e-4a16-ab82-aad5b39b1c49 tempest-FloatingIPAdminTestJSON-1680464394 tempest-FloatingIPAdminTestJSON-1680464394-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:07.180243 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0aaecea4-2dd8-4e01-9804-1b1163ac1114 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:07.188356 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0aaecea4-2dd8-4e01-9804-1b1163ac1114 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:07.188356 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0aaecea4-2dd8-4e01-9804-1b1163ac1114 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:07.188573 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6a9f7d16-8ea1-4401-a6eb-5992b4cfa7d8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:07.196959 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d5cd9226-77f1-46bb-a48e-8fabfbf3b497 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:07.198498 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c79ae359-825f-4b48-9945-2cf8f7e9cb21 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:07.199787 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8e7d3f30-ac88-42b8-86a0-329aa8416598 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:07.249716 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:07.250780 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 9ce4bb36-a0c7-4517-abaf-8db99ca3bb12 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=102163) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 09 04:29:07.259186 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a9f7d16-8ea1-4401-a6eb-5992b4cfa7d8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=af2dc559-bd52-4a55-a9a7-978da4a04c27,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:07.270619 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-6a9f7d16-8ea1-4401-a6eb-5992b4cfa7d8 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=2f33f6e15c3f4944aed281632a1564fe&name=default HTTP/1.1" status: 200 len: 2996 time: 1.0050263 Nov 09 04:29:07.274431 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c79ae359-825f-4b48-9945-2cf8f7e9cb21 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Pushing event deleted for resources: {'Port': ['ID=5a559d98-4180-4b03-a40c-a198e82f0704,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:07.274598 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53272) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:07.309201 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2403a9b7-034e-4a16-ab82-aad5b39b1c49 tempest-FloatingIPAdminTestJSON-1680464394 tempest-FloatingIPAdminTestJSON-1680464394-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:07.309606 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2403a9b7-034e-4a16-ab82-aad5b39b1c49 tempest-FloatingIPAdminTestJSON-1680464394 tempest-FloatingIPAdminTestJSON-1680464394-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:07.333067 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-2403a9b7-034e-4a16-ab82-aad5b39b1c49 tempest-FloatingIPAdminTestJSON-1680464394 tempest-FloatingIPAdminTestJSON-1680464394-project] Calling delete_port for 7aac9e85-a36c-4f42-93a1-7bdbde18fb1e owned by network:floatingip {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:29:07.391231 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3bf9b27b-df9e-441c-b5fc-945f6610d83c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:07.407761 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0aaecea4-2dd8-4e01-9804-1b1163ac1114 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Pushing event updated for resources: {'Network': ['ID=6f70786d-53ba-429d-b311-5a26e2e908bd,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:07.415831 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d5cd9226-77f1-46bb-a48e-8fabfbf3b497 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:07.419339 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-d5cd9226-77f1-46bb-a48e-8fabfbf3b497 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] 10.222.0.24 "DELETE /v2.0/ports/108ed2fc-5c3f-4fd4-8c8a-37bd462b1797 HTTP/1.1" status: 204 len: 168 time: 2.6709630 Nov 09 04:29:07.426517 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53278) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:07.433977 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-0aaecea4-2dd8-4e01-9804-1b1163ac1114 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 782 time: 2.5561411 Nov 09 04:29:07.447325 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 6f70786d-53ba-429d-b311-5a26e2e908bd details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:29:07.461392 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3bf9b27b-df9e-441c-b5fc-945f6610d83c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:07.513986 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c79ae359-825f-4b48-9945-2cf8f7e9cb21 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:07.524773 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-c79ae359-825f-4b48-9945-2cf8f7e9cb21 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] 10.222.0.24 "DELETE /v2.0/ports/5a559d98-4180-4b03-a40c-a198e82f0704 HTTP/1.1" status: 204 len: 168 time: 2.5369155 Nov 09 04:29:07.527953 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53280) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:07.535210 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-8ebdc5a8-5c0b-4f8b-bf74-ee143aff778a tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '17167882-1589-4583-8b9c-87263d360cca', 'external_fixed_ips': [{'subnet_id': 'aa65f5f6-77d4-4b7b-b90f-b2ffac782dc1', 'ip_address': '2001:db8::21'}]}}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:07.656078 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5cd9226-77f1-46bb-a48e-8fabfbf3b497 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Pushing event deleted for resources: {'Port': ['ID=108ed2fc-5c3f-4fd4-8c8a-37bd462b1797,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:07.684511 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-2ee63f14-d824-4136-b64f-4ffc3c2ab26a tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] GET failed (client error): The resource could not be found. Nov 09 04:29:07.690492 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8ebdc5a8-5c0b-4f8b-bf74-ee143aff778a tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:07.692728 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-2ee63f14-d824-4136-b64f-4ffc3c2ab26a tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] 10.222.0.24 "GET /v2.0/ports/108ed2fc-5c3f-4fd4-8c8a-37bd462b1797 HTTP/1.1" status: 404 len: 333 time: 0.2575181 Nov 09 04:29:07.692891 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8ebdc5a8-5c0b-4f8b-bf74-ee143aff778a tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:07.701421 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53282) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:07.751116 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2403a9b7-034e-4a16-ab82-aad5b39b1c49 tempest-FloatingIPAdminTestJSON-1680464394 tempest-FloatingIPAdminTestJSON-1680464394-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:07.759875 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=49694ee4-edfa-4a08-be0b-8bfa9b06128b,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:07.765938 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e7d3f30-ac88-42b8-86a0-329aa8416598 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Pushing event deleted for resources: {'Port': ['ID=169727b8-13f8-4d12-a56d-06813e708126,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:07.825872 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 9ce4bb36-a0c7-4517-abaf-8db99ca3bb12, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=9ce4bb36-a0c7-4517-abaf-8db99ca3bb12,segment=NetworkSegment(9b34c07b-e9e3-4439-982a-e160009938cf),segment_id=9b34c07b-e9e3-4439-982a-e160009938cf)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:29:07.844101 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Returning: {'device': '9ce4bb36-a0c7-4517-abaf-8db99ca3bb12', 'network_id': 'd4ba3288-221c-40f3-a829-662c462cc93f', 'port_id': '9ce4bb36-a0c7-4517-abaf-8db99ca3bb12', 'mac_address': 'fa:16:3e:6d:b9:2c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 348, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b11be6b4-75f0-4756-9312-de5295f24e1b', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102163) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 09 04:29:07.864227 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8ebdc5a8-5c0b-4f8b-bf74-ee143aff778a tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:07.865333 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89b48f25-9d2b-425a-b951-e5d8c3882f77 req-48e2af4e-3a96-4101-be91-60dcf7107f63 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:07.867938 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-89b48f25-9d2b-425a-b951-e5d8c3882f77 req-48e2af4e-3a96-4101-be91-60dcf7107f63 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.24 "GET /v2.0/ports?device_id=1aa3bc74-67df-4706-979b-cbf709855232 HTTP/1.1" status: 200 len: 944 time: 0.3337131 Nov 09 04:29:07.868054 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3bf9b27b-df9e-441c-b5fc-945f6610d83c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:07.870772 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3bf9b27b-df9e-441c-b5fc-945f6610d83c admin admin] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:07.872224 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-3bf9b27b-df9e-441c-b5fc-945f6610d83c admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/af2dc559-bd52-4a55-a9a7-978da4a04c27 HTTP/1.1" status: 204 len: 168 time: 0.6005147 Nov 09 04:29:07.942594 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2403a9b7-034e-4a16-ab82-aad5b39b1c49 tempest-FloatingIPAdminTestJSON-1680464394 tempest-FloatingIPAdminTestJSON-1680464394-project] Pushing event deleted for resources: {'Port': ['ID=7aac9e85-a36c-4f42-93a1-7bdbde18fb1e,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:07.965744 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bf9b27b-df9e-441c-b5fc-945f6610d83c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=af2dc559-bd52-4a55-a9a7-978da4a04c27,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:08.040609 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:08.060349 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9ce4bb36-a0c7-4517-abaf-8db99ca3bb12 {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:29:08.071017 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-89b48f25-9d2b-425a-b951-e5d8c3882f77 req-ff4834d6-3eac-4291-b115-835f418cd50c tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.24 "GET /v2.0/security-groups?id=4b002f37-f4ce-4d8a-a894-560955e72139&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1534193 Nov 09 04:29:08.105873 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 9ce4bb36-a0c7-4517-abaf-8db99ca3bb12, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=9ce4bb36-a0c7-4517-abaf-8db99ca3bb12,segment=NetworkSegment(9b34c07b-e9e3-4439-982a-e160009938cf),segment_id=9b34c07b-e9e3-4439-982a-e160009938cf)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:29:08.121446 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8e7d3f30-ac88-42b8-86a0-329aa8416598 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:08.126417 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-8e7d3f30-ac88-42b8-86a0-329aa8416598 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] 10.222.0.24 "DELETE /v2.0/ports/169727b8-13f8-4d12-a56d-06813e708126 HTTP/1.1" status: 204 len: 168 time: 2.3290961 Nov 09 04:29:08.129350 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53288) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:08.162946 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-8c76b57f-6c9a-4b9e-a3d1-ab8d2ee2d1e3 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] GET failed (client error): The resource could not be found. Nov 09 04:29:08.167532 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-8c76b57f-6c9a-4b9e-a3d1-ab8d2ee2d1e3 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] 10.222.0.24 "GET /v2.0/ports/169727b8-13f8-4d12-a56d-06813e708126 HTTP/1.1" status: 404 len: 333 time: 0.0347524 Nov 09 04:29:08.167895 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53290) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:08.270768 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:08.284336 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-561f2be2-92ce-416e-a2de-3f2c247b0b91 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Deleting port 935f4bfd-1fe9-45c5-8908-25562cbf71c9 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:29:08.284895 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-561f2be2-92ce-416e-a2de-3f2c247b0b91 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:08.321519 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8ebdc5a8-5c0b-4f8b-bf74-ee143aff778a tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:08.330310 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2403a9b7-034e-4a16-ab82-aad5b39b1c49 tempest-FloatingIPAdminTestJSON-1680464394 tempest-FloatingIPAdminTestJSON-1680464394-project] Publish callbacks [] for floatingip, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:08.334760 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=9ce4bb36-a0c7-4517-abaf-8db99ca3bb12,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:08.337334 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2403a9b7-034e-4a16-ab82-aad5b39b1c49 tempest-FloatingIPAdminTestJSON-1680464394 tempest-FloatingIPAdminTestJSON-1680464394-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:08.338817 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-2403a9b7-034e-4a16-ab82-aad5b39b1c49 tempest-FloatingIPAdminTestJSON-1680464394 tempest-FloatingIPAdminTestJSON-1680464394-project] 10.222.0.24 "DELETE /v2.0/floatingips/a2fd2c6e-7b80-4291-b0b5-8fe20722481a HTTP/1.1" status: 204 len: 168 time: 1.2816615 Nov 09 04:29:08.351506 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e229ee3-b778-417a-a81f-5fc3fb6a5a33 req-140e5a87-3926-459b-93bd-3e718a2bf866 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:08.360436 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6e229ee3-b778-417a-a81f-5fc3fb6a5a33 req-140e5a87-3926-459b-93bd-3e718a2bf866 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "GET /v2.0/ports?device_id=fd8e39fc-699b-4777-aae4-ca592a898437 HTTP/1.1" status: 200 len: 943 time: 0.2970531 Nov 09 04:29:08.361824 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53294) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:08.404580 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-945573bf-61c2-430d-9a63-1bcc64101c33 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Deleting port 220573b2-05bf-40da-85dd-c38e42a33c4b {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:29:08.405076 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-945573bf-61c2-430d-9a63-1bcc64101c33 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:08.510263 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-561f2be2-92ce-416e-a2de-3f2c247b0b91 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:08.519019 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6e229ee3-b778-417a-a81f-5fc3fb6a5a33 req-2b37f3b1-bf77-4b90-8c81-bcbcec44aff7 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "GET /v2.0/security-groups?id=67cb2d36-e38c-4a29-adb5-c52b1d94ae99&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1573331 Nov 09 04:29:08.528412 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-561f2be2-92ce-416e-a2de-3f2c247b0b91 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Calling delete_port for 935f4bfd-1fe9-45c5-8908-25562cbf71c9 owned by {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:29:08.588646 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-ec30ecee-7511-45c4-bc64-991176b00b14 tempest-FloatingIPAdminTestJSON-625682852 tempest-FloatingIPAdminTestJSON-625682852-project-admin] Deleting port 5fd878ed-8fba-4f72-95ce-0b62ad2726f5 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:29:08.589137 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ec30ecee-7511-45c4-bc64-991176b00b14 tempest-FloatingIPAdminTestJSON-625682852 tempest-FloatingIPAdminTestJSON-625682852-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:08.591480 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['9ce4bb36-a0c7-4517-abaf-8db99ca3bb12'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 04:29:08.608765 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-945573bf-61c2-430d-9a63-1bcc64101c33 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:08.643475 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-945573bf-61c2-430d-9a63-1bcc64101c33 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Calling delete_port for 220573b2-05bf-40da-85dd-c38e42a33c4b owned by {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:29:08.665926 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ec30ecee-7511-45c4-bc64-991176b00b14 tempest-FloatingIPAdminTestJSON-625682852 tempest-FloatingIPAdminTestJSON-625682852-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:08.666411 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ec30ecee-7511-45c4-bc64-991176b00b14 tempest-FloatingIPAdminTestJSON-625682852 tempest-FloatingIPAdminTestJSON-625682852-project-admin] Publish callbacks [] for floatingip, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:08.673583 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['49694ee4-edfa-4a08-be0b-8bfa9b06128b'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 04:29:08.679526 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-ec30ecee-7511-45c4-bc64-991176b00b14 tempest-FloatingIPAdminTestJSON-625682852 tempest-FloatingIPAdminTestJSON-625682852-project-admin] Calling delete_port for 5fd878ed-8fba-4f72-95ce-0b62ad2726f5 owned by network:floatingip {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:29:08.772183 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53296) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:08.853033 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-52d02d6e-e302-4b0d-849b-7d492937fed5 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=121c73bcf3f444b6a12d8529493cd79e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0767469 Nov 09 04:29:08.855236 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53298) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:08.884232 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ec30ecee-7511-45c4-bc64-991176b00b14 tempest-FloatingIPAdminTestJSON-625682852 tempest-FloatingIPAdminTestJSON-625682852-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:08.945698 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8ebdc5a8-5c0b-4f8b-bf74-ee143aff778a tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:08.967343 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8ebdc5a8-5c0b-4f8b-bf74-ee143aff778a tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:09.056703 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec30ecee-7511-45c4-bc64-991176b00b14 tempest-FloatingIPAdminTestJSON-625682852 tempest-FloatingIPAdminTestJSON-625682852-project-admin] Pushing event deleted for resources: {'Port': ['ID=5fd878ed-8fba-4f72-95ce-0b62ad2726f5,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:09.064229 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ec30ecee-7511-45c4-bc64-991176b00b14 tempest-FloatingIPAdminTestJSON-625682852 tempest-FloatingIPAdminTestJSON-625682852-project-admin] Publish callbacks [] for floatingip, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:09.068687 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ec30ecee-7511-45c4-bc64-991176b00b14 tempest-FloatingIPAdminTestJSON-625682852 tempest-FloatingIPAdminTestJSON-625682852-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:09.070940 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-ec30ecee-7511-45c4-bc64-991176b00b14 tempest-FloatingIPAdminTestJSON-625682852 tempest-FloatingIPAdminTestJSON-625682852-project-admin] 10.222.0.24 "DELETE /v2.0/floatingips/bcc9b7c5-b41e-409b-97ac-4c04638a1eec HTTP/1.1" status: 204 len: 168 time: 0.7073710 Nov 09 04:29:09.071812 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-561f2be2-92ce-416e-a2de-3f2c247b0b91 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:09.091685 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53300) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:09.124454 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-8ebdc5a8-5c0b-4f8b-bf74-ee143aff778a tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Allocated IP 2001:db8::21 (17167882-1589-4583-8b9c-87263d360cca/aa65f5f6-77d4-4b7b-b90f-b2ffac782dc1/80f26abe-dc24-4cad-824e-cf929e3c29c8) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:29:09.230394 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-561f2be2-92ce-416e-a2de-3f2c247b0b91 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Pushing event deleted for resources: {'Port': ['ID=935f4bfd-1fe9-45c5-8908-25562cbf71c9,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:09.261270 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8ebdc5a8-5c0b-4f8b-bf74-ee143aff778a tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:09.338148 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-96fcebfb-909e-49a8-b774-2e065047fe38 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:09.353515 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44e4650d-ecce-4f1d-bc81-c51ae94f0595 req-1dde25dd-e766-42b5-8c16-51ef1970a0a2 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:09.359008 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8ebdc5a8-5c0b-4f8b-bf74-ee143aff778a tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:09.361585 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-44e4650d-ecce-4f1d-bc81-c51ae94f0595 req-1dde25dd-e766-42b5-8c16-51ef1970a0a2 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.24 "GET /v2.0/ports?device_id=1aa3bc74-67df-4706-979b-cbf709855232 HTTP/1.1" status: 200 len: 944 time: 0.1564162 Nov 09 04:29:09.377493 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-561f2be2-92ce-416e-a2de-3f2c247b0b91 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:09.383483 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-561f2be2-92ce-416e-a2de-3f2c247b0b91 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] 10.222.0.24 "DELETE /v2.0/ports/935f4bfd-1fe9-45c5-8908-25562cbf71c9 HTTP/1.1" status: 204 len: 168 time: 1.2120242 Nov 09 04:29:09.387445 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53304) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:09.404576 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-96fcebfb-909e-49a8-b774-2e065047fe38 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:09.424282 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-3292323e-ee09-4ce7-aabd-6f2ed134b28b tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Deleting port ceb33408-7f98-40bc-9e0d-9341e2ff0309 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:29:09.424587 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3292323e-ee09-4ce7-aabd-6f2ed134b28b tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:09.436031 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8ebdc5a8-5c0b-4f8b-bf74-ee143aff778a tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Network 17167882-1589-4583-8b9c-87263d360cca is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:29:09.438478 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ebdc5a8-5c0b-4f8b-bf74-ee143aff778a tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Pushing event updated for resources: {'Port': ['ID=80f26abe-dc24-4cad-824e-cf929e3c29c8,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:09.441457 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-7fda0516-bde5-47a3-ab09-20eeae5d7d60 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] GET failed (client error): The resource could not be found. Nov 09 04:29:09.447075 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-7fda0516-bde5-47a3-ab09-20eeae5d7d60 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] 10.222.0.24 "GET /v2.0/ports/935f4bfd-1fe9-45c5-8908-25562cbf71c9 HTTP/1.1" status: 404 len: 333 time: 0.0535152 Nov 09 04:29:09.448896 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53306) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:09.449782 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-8ebdc5a8-5c0b-4f8b-bf74-ee143aff778a tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:29:09.462077 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8ebdc5a8-5c0b-4f8b-bf74-ee143aff778a tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:29:09.501213 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-945573bf-61c2-430d-9a63-1bcc64101c33 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:09.507586 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-44e4650d-ecce-4f1d-bc81-c51ae94f0595 req-09b1b97b-601c-4e4d-acd4-80cc241e3441 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.24 "GET /v2.0/security-groups?id=4b002f37-f4ce-4d8a-a894-560955e72139&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1444237 Nov 09 04:29:09.549708 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3292323e-ee09-4ce7-aabd-6f2ed134b28b tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:09.566270 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-3292323e-ee09-4ce7-aabd-6f2ed134b28b tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Calling delete_port for ceb33408-7f98-40bc-9e0d-9341e2ff0309 owned by {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:29:09.591960 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-945573bf-61c2-430d-9a63-1bcc64101c33 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Pushing event deleted for resources: {'Port': ['ID=220573b2-05bf-40da-85dd-c38e42a33c4b,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:09.673729 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-945573bf-61c2-430d-9a63-1bcc64101c33 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:09.677083 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-945573bf-61c2-430d-9a63-1bcc64101c33 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] 10.222.0.24 "DELETE /v2.0/ports/220573b2-05bf-40da-85dd-c38e42a33c4b HTTP/1.1" status: 204 len: 168 time: 1.9716837 Nov 09 04:29:09.679990 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53310) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:09.775304 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-993c9dca-8b74-4200-9581-cdf8cc9793bb tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Deleting subnet 88d0e868-7936-4409-8f96-0f4e98202b5e {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:29:09.779382 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-993c9dca-8b74-4200-9581-cdf8cc9793bb tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:09.842787 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-993c9dca-8b74-4200-9581-cdf8cc9793bb tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:09.948454 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-993c9dca-8b74-4200-9581-cdf8cc9793bb tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:09.952176 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3292323e-ee09-4ce7-aabd-6f2ed134b28b tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:09.984966 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd0bb0f5-ee7c-4e8e-bd62-761960929caa req-6341def7-05da-47b5-9fa0-430e9d27c2ea tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:09.986676 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-bd0bb0f5-ee7c-4e8e-bd62-761960929caa req-6341def7-05da-47b5-9fa0-430e9d27c2ea tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "GET /v2.0/ports?device_id=fd8e39fc-699b-4777-aae4-ca592a898437 HTTP/1.1" status: 200 len: 944 time: 0.3300133 Nov 09 04:29:09.993984 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-8761ac46-3447-47d2-9556-2027f85c50a8 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Deleting port 27da12d2-a24d-479a-9a28-6ae975943c6b {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:29:09.994320 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8761ac46-3447-47d2-9556-2027f85c50a8 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:10.004942 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3292323e-ee09-4ce7-aabd-6f2ed134b28b tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Pushing event deleted for resources: {'Port': ['ID=ceb33408-7f98-40bc-9e0d-9341e2ff0309,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:10.026012 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-96fcebfb-909e-49a8-b774-2e065047fe38 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:10.029754 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-96fcebfb-909e-49a8-b774-2e065047fe38 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:10.034633 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-96fcebfb-909e-49a8-b774-2e065047fe38 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/df12496d-3213-4a62-9948-660c937650c4 HTTP/1.1" status: 204 len: 168 time: 1.1740501 Nov 09 04:29:10.092624 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96fcebfb-909e-49a8-b774-2e065047fe38 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=df12496d-3213-4a62-9948-660c937650c4,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:10.111889 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3292323e-ee09-4ce7-aabd-6f2ed134b28b tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:10.115472 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-3292323e-ee09-4ce7-aabd-6f2ed134b28b tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] 10.222.0.24 "DELETE /v2.0/ports/ceb33408-7f98-40bc-9e0d-9341e2ff0309 HTTP/1.1" status: 204 len: 168 time: 1.0071998 Nov 09 04:29:10.124965 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53314) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:10.201241 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-993c9dca-8b74-4200-9581-cdf8cc9793bb tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:10.248864 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a99aa64b-0b6f-4939-83bc-1906bb0f83e8 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:10.251236 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a99aa64b-0b6f-4939-83bc-1906bb0f83e8 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] 10.222.0.24 "GET /v2.0/ports?device_id=cd21e659-1094-4653-b570-03e6ed4305e3 HTTP/1.1" status: 200 len: 913 time: 0.1252038 Nov 09 04:29:10.253820 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-993c9dca-8b74-4200-9581-cdf8cc9793bb tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Pushing event deleted for resources: {'Subnet': ['ID=88d0e868-7936-4409-8f96-0f4e98202b5e,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:10.261259 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53316) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:10.274299 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0ad954ea-ebf7-4dc2-9e3e-8b843344d129 None None] Network daccf5f5-3ea8-4f1b-ab62-78949d47bb91 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:29:10.275182 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-993c9dca-8b74-4200-9581-cdf8cc9793bb tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:10.280007 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-993c9dca-8b74-4200-9581-cdf8cc9793bb tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] 10.222.0.24 "DELETE /v2.0/subnets/88d0e868-7936-4409-8f96-0f4e98202b5e HTTP/1.1" status: 204 len: 168 time: 0.5765886 Nov 09 04:29:10.283498 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53318) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:10.435146 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5f3c2830-8b73-49d5-92cf-d8a9a09b2622 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:10.506095 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-bd0bb0f5-ee7c-4e8e-bd62-761960929caa req-324c322b-6699-4e60-95dd-0e7f62b507c6 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "GET /v2.0/security-groups?id=67cb2d36-e38c-4a29-adb5-c52b1d94ae99&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.5030096 Nov 09 04:29:10.524341 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-5f3c2830-8b73-49d5-92cf-d8a9a09b2622 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Deleting port 617022e4-2ac0-4ae0-9a42-43aec6246b64 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:29:10.524697 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5f3c2830-8b73-49d5-92cf-d8a9a09b2622 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:10.530176 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 49694ee4-edfa-4a08-be0b-8bfa9b06128b up at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:29:10.565049 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b4da3761-8570-4f9b-8ebc-11d1bbd98e17 None None] DHCP port deletion for daccf5f5-3ea8-4f1b-ab62-78949d47bb91 request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:29:10.665358 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-b4da3761-8570-4f9b-8ebc-11d1bbd98e17 None None] Deleting port 617022e4-2ac0-4ae0-9a42-43aec6246b64 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:29:10.665513 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b4da3761-8570-4f9b-8ebc-11d1bbd98e17 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:10.744818 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-b4da3761-8570-4f9b-8ebc-11d1bbd98e17 None None] For port 617022e4-2ac0-4ae0-9a42-43aec6246b64, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=617022e4-2ac0-4ae0-9a42-43aec6246b64,segment=NetworkSegment(612a778a-22e6-45ba-8f8f-f3d4d6a26a8a),segment_id=612a778a-22e6-45ba-8f8f-f3d4d6a26a8a)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:29:10.745171 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b4da3761-8570-4f9b-8ebc-11d1bbd98e17 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:10.753764 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-5f3c2830-8b73-49d5-92cf-d8a9a09b2622 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] For port 617022e4-2ac0-4ae0-9a42-43aec6246b64, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=617022e4-2ac0-4ae0-9a42-43aec6246b64,segment=NetworkSegment(612a778a-22e6-45ba-8f8f-f3d4d6a26a8a),segment_id=612a778a-22e6-45ba-8f8f-f3d4d6a26a8a)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:29:10.758745 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5f3c2830-8b73-49d5-92cf-d8a9a09b2622 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:10.762152 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-b4da3761-8570-4f9b-8ebc-11d1bbd98e17 None None] Calling delete_port for 617022e4-2ac0-4ae0-9a42-43aec6246b64 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:29:10.781969 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-5f3c2830-8b73-49d5-92cf-d8a9a09b2622 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Calling delete_port for 617022e4-2ac0-4ae0-9a42-43aec6246b64 owned by network:dhcp {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:29:10.795292 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8761ac46-3447-47d2-9556-2027f85c50a8 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:10.810835 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0af1e71-b9e2-4632-9782-e76407f6c23c req-10dc89cb-afb1-41cd-acf5-19a99d40be39 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:10.814153 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-e0af1e71-b9e2-4632-9782-e76407f6c23c req-10dc89cb-afb1-41cd-acf5-19a99d40be39 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.24 "GET /v2.0/ports?device_id=1aa3bc74-67df-4706-979b-cbf709855232 HTTP/1.1" status: 200 len: 944 time: 0.1780939 Nov 09 04:29:10.814682 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53330) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:10.822063 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8ebdc5a8-5c0b-4f8b-bf74-ee143aff778a tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:10.823938 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-45d66695-4d52-488c-9a81-7cf3f32d5ee5 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Request body: {'subnet': {'network_id': '6f70786d-53ba-429d-b311-5a26e2e908bd', 'cidr': '2001:db8:0:ffff::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:ffff::1'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:10.826692 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning for port 49694ee4-edfa-4a08-be0b-8bfa9b06128b completed by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 09 04:29:10.826830 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-8761ac46-3447-47d2-9556-2027f85c50a8 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Calling delete_port for 27da12d2-a24d-479a-9a28-6ae975943c6b owned by {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:29:10.840792 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning complete for port 49694ee4-edfa-4a08-be0b-8bfa9b06128b triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:29:10.847408 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:10.961222 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:10.985689 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b4da3761-8570-4f9b-8ebc-11d1bbd98e17 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:11.027934 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 49694ee4-edfa-4a08-be0b-8bfa9b06128b, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=49694ee4-edfa-4a08-be0b-8bfa9b06128b,segment=NetworkSegment(efe0485f-d48f-4307-b89a-0bcb86aaf1c2),segment_id=efe0485f-d48f-4307-b89a-0bcb86aaf1c2)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:29:11.029642 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1aa3bc74-67df-4706-979b-cbf709855232', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '49694ee4-edfa-4a08-be0b-8bfa9b06128b'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:29:11.034714 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-e0af1e71-b9e2-4632-9782-e76407f6c23c req-5db1473a-244e-4546-89de-5865ab63bbe1 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.24 "GET /v2.0/security-groups?id=4b002f37-f4ce-4d8a-a894-560955e72139&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1206255 Nov 09 04:29:11.049130 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5f3c2830-8b73-49d5-92cf-d8a9a09b2622 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:11.112697 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f3c2830-8b73-49d5-92cf-d8a9a09b2622 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Pushing event deleted for resources: {'Port': ['ID=617022e4-2ac0-4ae0-9a42-43aec6246b64,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:11.117229 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5f3c2830-8b73-49d5-92cf-d8a9a09b2622 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] No DVR routers for this DVR port 617022e4-2ac0-4ae0-9a42-43aec6246b64 on host dv-neutron-816802-2-hyperv {{(pid=102161) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:29:11.119915 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b4da3761-8570-4f9b-8ebc-11d1bbd98e17 None None] No DVR routers for this DVR port 617022e4-2ac0-4ae0-9a42-43aec6246b64 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:29:11.122560 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:11.123425 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 9ce4bb36-a0c7-4517-abaf-8db99ca3bb12 up at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:29:11.132127 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4da3761-8570-4f9b-8ebc-11d1bbd98e17 None None] Pushing event deleted for resources: {'Port': ['ID=617022e4-2ac0-4ae0-9a42-43aec6246b64,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:11.180163 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-45d66695-4d52-488c-9a81-7cf3f32d5ee5 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Made reservation on behalf of 83cbb798c0f44b268f8acd2a70eb745a for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:29:11.184268 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-45d66695-4d52-488c-9a81-7cf3f32d5ee5 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:11.225743 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=49694ee4-edfa-4a08-be0b-8bfa9b06128b,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:11.301179 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8ebdc5a8-5c0b-4f8b-bf74-ee143aff778a tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:11.313115 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5f3c2830-8b73-49d5-92cf-d8a9a09b2622 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:11.334027 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-173330a7-08fe-484e-ab35-d72e9c3639e3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:11.357363 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning for port 9ce4bb36-a0c7-4517-abaf-8db99ca3bb12 completed by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 09 04:29:11.362095 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8761ac46-3447-47d2-9556-2027f85c50a8 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:11.363282 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning complete for port 9ce4bb36-a0c7-4517-abaf-8db99ca3bb12 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:29:11.364105 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:11.446252 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-aa9cdaab-d639-4770-9e29-e310c1e65769" -d '{"events": [{"server_uuid": "1aa3bc74-67df-4706-979b-cbf709855232", "name": "network-vif-plugged", "status": "completed", "tag": "49694ee4-edfa-4a08-be0b-8bfa9b06128b"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:29:11.494450 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8761ac46-3447-47d2-9556-2027f85c50a8 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Pushing event deleted for resources: {'Port': ['ID=27da12d2-a24d-479a-9a28-6ae975943c6b,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:11.553438 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:11.576631 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8761ac46-3447-47d2-9556-2027f85c50a8 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:11.580142 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-8761ac46-3447-47d2-9556-2027f85c50a8 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] 10.222.0.24 "DELETE /v2.0/ports/27da12d2-a24d-479a-9a28-6ae975943c6b HTTP/1.1" status: 204 len: 168 time: 2.1282518 Nov 09 04:29:11.584574 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53354) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:11.620847 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 9ce4bb36-a0c7-4517-abaf-8db99ca3bb12, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=9ce4bb36-a0c7-4517-abaf-8db99ca3bb12,segment=NetworkSegment(9b34c07b-e9e3-4439-982a-e160009938cf),segment_id=9b34c07b-e9e3-4439-982a-e160009938cf)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:29:11.677067 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-23855e17-7915-4eda-a1f2-5e3fe18c31e4 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Deleting subnet 300c7541-d41f-47e3-ad5e-4d083e87c290 {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:29:11.685826 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-23855e17-7915-4eda-a1f2-5e3fe18c31e4 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:11.693732 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:11.770616 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:29:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-131a8016-df82-4d0a-b7c0-c0426199474d x-openstack-request-id: req-131a8016-df82-4d0a-b7c0-c0426199474d {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:29:11.771362 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1aa3bc74-67df-4706-979b-cbf709855232", "name": "network-vif-plugged", "status": "completed", "tag": "49694ee4-edfa-4a08-be0b-8bfa9b06128b", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:29:11.771780 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-131a8016-df82-4d0a-b7c0-c0426199474d {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:29:11.776663 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1aa3bc74-67df-4706-979b-cbf709855232', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '49694ee4-edfa-4a08-be0b-8bfa9b06128b', 'code': 200} Nov 09 04:29:11.776663 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=9ce4bb36-a0c7-4517-abaf-8db99ca3bb12,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:11.820512 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-5f3c2830-8b73-49d5-92cf-d8a9a09b2622 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['daccf5f5-3ea8-4f1b-ab62-78949d47bb91']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:11.851037 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-5f3c2830-8b73-49d5-92cf-d8a9a09b2622 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '612a778a-22e6-45ba-8f8f-f3d4d6a26a8a') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:11.851341 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-5f3c2830-8b73-49d5-92cf-d8a9a09b2622 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '612a778a-22e6-45ba-8f8f-f3d4d6a26a8a') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:11.868228 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5f3c2830-8b73-49d5-92cf-d8a9a09b2622 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:11.926175 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5f3c2830-8b73-49d5-92cf-d8a9a09b2622 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:11.935466 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4ff53c7-5d0f-4862-bcb7-428cf89a66bb req-fd079d91-2086-4ab9-8740-7138c3e70782 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:11.937519 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-e4ff53c7-5d0f-4862-bcb7-428cf89a66bb req-fd079d91-2086-4ab9-8740-7138c3e70782 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "GET /v2.0/ports?device_id=fd8e39fc-699b-4777-aae4-ca592a898437 HTTP/1.1" status: 200 len: 945 time: 0.1391900 Nov 09 04:29:11.946375 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5f3c2830-8b73-49d5-92cf-d8a9a09b2622 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Releasing vlan 335 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:29:11.946789 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5f3c2830-8b73-49d5-92cf-d8a9a09b2622 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:11.951273 dv-neutron-816802-2-hyperv neutron-server[102161]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:29:11.951273 dv-neutron-816802-2-hyperv neutron-server[102161]: self.session.flush() Nov 09 04:29:11.951273 dv-neutron-816802-2-hyperv neutron-server[102161]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:29:11.951273 dv-neutron-816802-2-hyperv neutron-server[102161]: self.session.flush() Nov 09 04:29:11.951273 dv-neutron-816802-2-hyperv neutron-server[102161]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:29:11.951273 dv-neutron-816802-2-hyperv neutron-server[102161]: self.session.flush() Nov 09 04:29:11.951273 dv-neutron-816802-2-hyperv neutron-server[102161]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:29:11.951273 dv-neutron-816802-2-hyperv neutron-server[102161]: self.session.flush() Nov 09 04:29:11.951273 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:29:11.951273 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:29:11.951273 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:29:11.951273 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:29:11.951273 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:29:11.951273 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:29:11.951273 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:29:11.951273 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:29:11.951273 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:29:11.951273 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:29:11.951273 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:29:11.951273 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:29:11.951273 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:29:11.951273 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:29:11.951273 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:29:11.951273 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:29:11.951273 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:29:11.951273 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:29:11.951273 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:29:11.951273 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:29:11.951273 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:29:11.951273 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:29:11.951273 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:29:11.951273 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:29:11.951273 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:29:11.951273 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:29:11.951273 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:29:11.951273 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:29:11.951273 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:29:11.951273 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:29:11.951273 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:29:11.951273 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:29:12.002651 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 617022e4-2ac0-4ae0-9a42-43aec6246b64 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:29:12.008221 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e123890b-3568-4116-98a6-ca4809438daf tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:12.032809 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 617022e4-2ac0-4ae0-9a42-43aec6246b64 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:29:12.033331 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 617022e4-2ac0-4ae0-9a42-43aec6246b64 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:29:12.049595 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:12.054696 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-23855e17-7915-4eda-a1f2-5e3fe18c31e4 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:12.115159 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-e4ff53c7-5d0f-4862-bcb7-428cf89a66bb req-3f4bcea0-331b-4ad0-b26d-2c1baced834d tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "GET /v2.0/security-groups?id=67cb2d36-e38c-4a29-adb5-c52b1d94ae99&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1649842 Nov 09 04:29:12.156393 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5f3c2830-8b73-49d5-92cf-d8a9a09b2622 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:12.166446 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5f3c2830-8b73-49d5-92cf-d8a9a09b2622 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:12.169614 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-5f3c2830-8b73-49d5-92cf-d8a9a09b2622 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] 10.222.0.24 "DELETE /v2.0/networks/daccf5f5-3ea8-4f1b-ab62-78949d47bb91 HTTP/1.1" status: 204 len: 168 time: 1.8851757 Nov 09 04:29:12.202667 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8ebdc5a8-5c0b-4f8b-bf74-ee143aff778a tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Router 833370e1-94fd-4719-92b8-93ab892e117d is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102162) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:29:12.214046 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-45d66695-4d52-488c-9a81-7cf3f32d5ee5 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:12.238247 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f3c2830-8b73-49d5-92cf-d8a9a09b2622 tempest-AllowedAddressPairIpV6TestJSON-1471419708 tempest-AllowedAddressPairIpV6TestJSON-1471419708-project] Pushing event deleted for resources: {'Network': ['ID=daccf5f5-3ea8-4f1b-ab62-78949d47bb91,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:12.318613 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45d66695-4d52-488c-9a81-7cf3f32d5ee5 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Pushing event updated for resources: {'Subnet': ['ID=55f532c1-0964-46c0-bb3d-4cdfb666bdde,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:12.325716 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-151fa94d-7b70-4782-8e22-c8d195233517 req-dd5f6501-f63f-49ad-b734-65eae33a3952 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:12.327266 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-151fa94d-7b70-4782-8e22-c8d195233517 req-dd5f6501-f63f-49ad-b734-65eae33a3952 service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=1aa3bc74-67df-4706-979b-cbf709855232 HTTP/1.1" status: 200 len: 1098 time: 0.1564686 Nov 09 04:29:12.333419 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-45d66695-4d52-488c-9a81-7cf3f32d5ee5 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Checking segment: {'id': '649c5ab9-1338-4cdb-aae3-0ee34f456666', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 313, 'network_id': '6f70786d-53ba-429d-b311-5a26e2e908bd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:29:12.333862 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-45d66695-4d52-488c-9a81-7cf3f32d5ee5 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Network hostable DHCP agents. Network: 6f70786d-53ba-429d-b311-5a26e2e908bd, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:29:12.353195 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [req-151fa94d-7b70-4782-8e22-c8d195233517 req-0a257805-2c10-4d58-a5ac-eb57fb288e29 service neutron] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:12.412691 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-23855e17-7915-4eda-a1f2-5e3fe18c31e4 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:12.423293 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3da25a83-d62b-42a1-aa81-f5b4c448d15c req-b0285ff4-7c21-41c8-9012-60cf95e6fbca tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:12.424861 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3da25a83-d62b-42a1-aa81-f5b4c448d15c req-b0285ff4-7c21-41c8-9012-60cf95e6fbca tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.24 "GET /v2.0/ports?device_id=1aa3bc74-67df-4706-979b-cbf709855232 HTTP/1.1" status: 200 len: 945 time: 0.2720823 Nov 09 04:29:12.431702 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-45d66695-4d52-488c-9a81-7cf3f32d5ee5 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Network 6f70786d-53ba-429d-b311-5a26e2e908bd is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:29:12.450967 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [req-151fa94d-7b70-4782-8e22-c8d195233517 req-0a257805-2c10-4d58-a5ac-eb57fb288e29 service neutron] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:12.510660 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-45d66695-4d52-488c-9a81-7cf3f32d5ee5 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 6f70786d-53ba-429d-b311-5a26e2e908bd) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:29:12.512823 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [req-151fa94d-7b70-4782-8e22-c8d195233517 req-0a257805-2c10-4d58-a5ac-eb57fb288e29 service neutron] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:12.521321 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5e3209df-f04c-4ecc-afd7-228951d367b5 None None] Network 6f70786d-53ba-429d-b311-5a26e2e908bd requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:29:12.523928 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-45d66695-4d52-488c-9a81-7cf3f32d5ee5 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:12.524858 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-45d66695-4d52-488c-9a81-7cf3f32d5ee5 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:12.534322 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53374) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:12.588759 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-151fa94d-7b70-4782-8e22-c8d195233517 req-0a257805-2c10-4d58-a5ac-eb57fb288e29 service neutron] 10.222.0.26 "GET /v2.0/security-groups?id=4b002f37-f4ce-4d8a-a894-560955e72139&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2518911 Nov 09 04:29:12.590059 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a257805-2c10-4d58-a5ac-eb57fb288e29 service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=9686fa77-7003-459f-82d7-f7d43f5006e7,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:12.607547 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3da25a83-d62b-42a1-aa81-f5b4c448d15c req-47714677-9a26-4235-aa66-47b0309e7965 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.24 "GET /v2.0/security-groups?id=4b002f37-f4ce-4d8a-a894-560955e72139&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1526639 Nov 09 04:29:12.626864 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8ebdc5a8-5c0b-4f8b-bf74-ee143aff778a tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:29:12.627700 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53378) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:12.638753 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d9ecaf0-85b2-46d1-a659-ffb12968b852 None None] Sync routers for ids ['833370e1-94fd-4719-92b8-93ab892e117d'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:29:12.654770 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d9ecaf0-85b2-46d1-a659-ffb12968b852 None None] Routers {'833370e1-94fd-4719-92b8-93ab892e117d'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:29:12.658422 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-6d9ecaf0-85b2-46d1-a659-ffb12968b852 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:28:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['833370e1-94fd-4719-92b8-93ab892e117d'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:12.662069 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-45d66695-4d52-488c-9a81-7cf3f32d5ee5 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 1.8442621 Nov 09 04:29:12.663247 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53382) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:12.673790 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-8df849f7-84a6-4463-affe-c2c92e1748cb tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-72168426'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:12.685039 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-23855e17-7915-4eda-a1f2-5e3fe18c31e4 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:12.743497 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8ebdc5a8-5c0b-4f8b-bf74-ee143aff778a tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:12.744741 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-8ebdc5a8-5c0b-4f8b-bf74-ee143aff778a tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 877 time: 5.2151668 Nov 09 04:29:12.745951 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23855e17-7915-4eda-a1f2-5e3fe18c31e4 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Pushing event deleted for resources: {'Subnet': ['ID=300c7541-d41f-47e3-ad5e-4d083e87c290,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:12.748143 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53384) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:12.754632 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-23855e17-7915-4eda-a1f2-5e3fe18c31e4 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:12.763073 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-23855e17-7915-4eda-a1f2-5e3fe18c31e4 tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] 10.222.0.24 "DELETE /v2.0/subnets/300c7541-d41f-47e3-ad5e-4d083e87c290 HTTP/1.1" status: 204 len: 168 time: 1.1769593 Nov 09 04:29:12.765767 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53386) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:12.772057 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-42cb0660-8d4b-47bb-813e-c50999d4736f None None] Network e96f4292-19f0-4446-b093-408610b619f1 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:29:12.808050 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-e123890b-3568-4116-98a6-ca4809438daf tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Deleting port 15c6d8e0-f7f0-4d07-8e83-c2d1157476d4 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:29:12.808391 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e123890b-3568-4116-98a6-ca4809438daf tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:12.865640 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-32f02756-a9ae-451a-bf2a-7e25bfbb2b12 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-6f70786d-53ba-429d-b311-5a26e2e908bd', 'network_id': '6f70786d-53ba-429d-b311-5a26e2e908bd', 'tenant_id': '83cbb798c0f44b268f8acd2a70eb745a', 'fixed_ips': [{'subnet_id': '55f532c1-0964-46c0-bb3d-4cdfb666bdde'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:29:12.866785 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-32f02756-a9ae-451a-bf2a-7e25bfbb2b12 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:12.877479 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8df849f7-84a6-4463-affe-c2c92e1748cb tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Made reservation on behalf of 83cbb798c0f44b268f8acd2a70eb745a for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:29:12.885802 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8df849f7-84a6-4463-affe-c2c92e1748cb tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:12.916482 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-6d9ecaf0-85b2-46d1-a659-ffb12968b852 None None] Set router 833370e1-94fd-4719-92b8-93ab892e117d gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:29:12.927923 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-e443ec11-4344-4460-805a-902c8856181c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649-project] Request body: {'network': {'name': 'tempest-PortsAdminExtendedAttrsIpV6TestJSON-test-network-1562935886'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:12.935616 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e123890b-3568-4116-98a6-ca4809438daf tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:12.951115 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-e123890b-3568-4116-98a6-ca4809438daf tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Calling delete_port for 15c6d8e0-f7f0-4d07-8e83-c2d1157476d4 owned by network:router_interface {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:29:12.966550 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8df849f7-84a6-4463-affe-c2c92e1748cb tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 331} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:29:12.976670 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8df849f7-84a6-4463-affe-c2c92e1748cb tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:12.977370 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-8df849f7-84a6-4463-affe-c2c92e1748cb tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Added segment dfcc87e7-1051-40c7-88f0-44b13bd9b2d4 of type vlan for network 3ba7cbec-5c67-4017-89a4-d38ecdcd019a Nov 09 04:29:13.019545 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8df849f7-84a6-4463-affe-c2c92e1748cb tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:13.100613 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-32f02756-a9ae-451a-bf2a-7e25bfbb2b12 None None] Allocated IP 2001:db8:0:ffff::2 (6f70786d-53ba-429d-b311-5a26e2e908bd/55f532c1-0964-46c0-bb3d-4cdfb666bdde/ed6c5b80-b384-44d8-ba31-14b833a9cdf8) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:29:13.136479 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-0453abf5-f516-41fa-bb73-8bc976db26aa admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=18f5ee1caa74420f9ab67cc92c1e02e6&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5067499 Nov 09 04:29:13.140587 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53388) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:13.148997 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-6d9ecaf0-85b2-46d1-a659-ffb12968b852 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '833370e1-94fd-4719-92b8-93ab892e117d', 'name': '', 'tenant_id': '0f0b9fa79c884bda978424cf72c631d5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '17167882-1589-4583-8b9c-87263d360cca', 'external_fixed_ips': [{'subnet_id': 'aa65f5f6-77d4-4b7b-b90f-b2ffac782dc1', 'ip_address': '2001:db8::21'}], 'enable_snat': True}, 'gw_port_id': '80f26abe-dc24-4cad-824e-cf929e3c29c8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:29:07Z', 'updated_at': '2021-11-09T04:29:09Z', 'revision_number': 3, 'project_id': '0f0b9fa79c884bda978424cf72c631d5', 'gw_port': {'id': '80f26abe-dc24-4cad-824e-cf929e3c29c8', 'name': '', 'network_id': '17167882-1589-4583-8b9c-87263d360cca', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:a1:f9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '833370e1-94fd-4719-92b8-93ab892e117d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 248, 'fixed_ips': [{'subnet_id': 'aa65f5f6-77d4-4b7b-b90f-b2ffac782dc1', 'ip_address': '2001:db8::21', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:29:08Z', 'updated_at': '2021-11-09T04:29:09Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'aa65f5f6-77d4-4b7b-b90f-b2ffac782dc1', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:13.157795 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c442eb88-9376-445b-8ed7-9dc5398aa7ea None None] DHCP port deletion for e96f4292-19f0-4446-b093-408610b619f1 request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:29:13.161438 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8df849f7-84a6-4463-affe-c2c92e1748cb tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:13.182090 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8df849f7-84a6-4463-affe-c2c92e1748cb tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:13.182763 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8df849f7-84a6-4463-affe-c2c92e1748cb tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:13.186854 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d9ecaf0-85b2-46d1-a659-ffb12968b852 None None] Checking router: 833370e1-94fd-4719-92b8-93ab892e117d for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:29:13.195184 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d9ecaf0-85b2-46d1-a659-ffb12968b852 None None] Updating router 833370e1-94fd-4719-92b8-93ab892e117d port 80f26abe-dc24-4cad-824e-cf929e3c29c8 binding host dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 04:29:13.220998 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3275151c-c24f-408a-9925-39ec59a6b92a tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:13.223080 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-6d9ecaf0-85b2-46d1-a659-ffb12968b852 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:13.224678 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5797a3ff-caf7-412c-8a67-e82e2c626b99 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:13.278556 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e443ec11-4344-4460-805a-902c8856181c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649-project] Made reservation on behalf of 759e6d46f65c418d8a20baf3ece2e5bc for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:29:13.281984 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e443ec11-4344-4460-805a-902c8856181c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:13.286651 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5797a3ff-caf7-412c-8a67-e82e2c626b99 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:13.326073 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-c442eb88-9376-445b-8ed7-9dc5398aa7ea None None] Deleting port 14d1d90a-743b-4e99-8c11-af1fc20317e1 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:29:13.326924 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c442eb88-9376-445b-8ed7-9dc5398aa7ea None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:13.348667 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e443ec11-4344-4460-805a-902c8856181c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649-project] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:13.353236 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d07fbe3a-ca5a-43f3-b96d-b88fc99a5ec9 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks [] for router, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:13.362783 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-8df849f7-84a6-4463-affe-c2c92e1748cb tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 782 time: 0.6971123 Nov 09 04:29:13.366257 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53392) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:13.373068 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-1fb6b348-765e-4a63-8fda-9d63c5d0fe27 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Request body: {'subnet': {'network_id': '3ba7cbec-5c67-4017-89a4-d38ecdcd019a', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': None, 'enable_dhcp': True}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:13.413872 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8df849f7-84a6-4463-affe-c2c92e1748cb tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Pushing event updated for resources: {'Network': ['ID=3ba7cbec-5c67-4017-89a4-d38ecdcd019a,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:13.414859 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-c442eb88-9376-445b-8ed7-9dc5398aa7ea None None] For port 14d1d90a-743b-4e99-8c11-af1fc20317e1, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=14d1d90a-743b-4e99-8c11-af1fc20317e1,segment=NetworkSegment(3567d530-a0d1-4a5f-b2b6-e974cb02bf65),segment_id=3567d530-a0d1-4a5f-b2b6-e974cb02bf65)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:29:13.415517 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c442eb88-9376-445b-8ed7-9dc5398aa7ea None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:13.418765 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-32f02756-a9ae-451a-bf2a-7e25bfbb2b12 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:13.429767 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 3ba7cbec-5c67-4017-89a4-d38ecdcd019a details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:29:13.445960 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-c442eb88-9376-445b-8ed7-9dc5398aa7ea None None] Calling delete_port for 14d1d90a-743b-4e99-8c11-af1fc20317e1 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:29:13.461471 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5797a3ff-caf7-412c-8a67-e82e2c626b99 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:13.466921 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5797a3ff-caf7-412c-8a67-e82e2c626b99 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:13.470853 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-5797a3ff-caf7-412c-8a67-e82e2c626b99 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/cc8884ac-0be5-4835-984c-0b550268bd22 HTTP/1.1" status: 204 len: 168 time: 0.3193676 Nov 09 04:29:13.488467 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e123890b-3568-4116-98a6-ca4809438daf tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:13.513584 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfb8a8d5-d5a2-4b22-9dc8-3e07ee3d57bb req-84e01b84-b858-44af-b500-6d831d01014c tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:13.521757 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-dfb8a8d5-d5a2-4b22-9dc8-3e07ee3d57bb req-84e01b84-b858-44af-b500-6d831d01014c tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "GET /v2.0/ports?device_id=fd8e39fc-699b-4777-aae4-ca592a898437 HTTP/1.1" status: 200 len: 945 time: 0.2885590 Nov 09 04:29:13.550478 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-32f02756-a9ae-451a-bf2a-7e25bfbb2b12 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:13.617136 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-32f02756-a9ae-451a-bf2a-7e25bfbb2b12 None None] Network 6f70786d-53ba-429d-b311-5a26e2e908bd is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:29:13.645027 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-32f02756-a9ae-451a-bf2a-7e25bfbb2b12 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:29:13.650014 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5797a3ff-caf7-412c-8a67-e82e2c626b99 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cc8884ac-0be5-4835-984c-0b550268bd22,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:13.661335 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d07fbe3a-ca5a-43f3-b96d-b88fc99a5ec9 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:13.664586 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e123890b-3568-4116-98a6-ca4809438daf tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Pushing event deleted for resources: {'Port': ['ID=15c6d8e0-f7f0-4d07-8e83-c2d1157476d4,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:13.682988 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-32f02756-a9ae-451a-bf2a-7e25bfbb2b12 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:29:13.692609 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-dfb8a8d5-d5a2-4b22-9dc8-3e07ee3d57bb req-59ae1768-3034-4b0e-b73c-bad0afd43212 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "GET /v2.0/security-groups?id=67cb2d36-e38c-4a29-adb5-c52b1d94ae99&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1693158 Nov 09 04:29:13.705245 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-3275151c-c24f-408a-9925-39ec59a6b92a tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Deleting port 14d1d90a-743b-4e99-8c11-af1fc20317e1 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:29:13.705754 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3275151c-c24f-408a-9925-39ec59a6b92a tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:13.774557 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fd8e39fc-699b-4777-aae4-ca592a898437', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9ce4bb36-a0c7-4517-abaf-8db99ca3bb12'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:29:13.776275 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e443ec11-4344-4460-805a-902c8856181c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649-project] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:13.777438 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0bab089c-ab17-4d2c-a95b-905da2808c0f" -d '{"events": [{"server_uuid": "fd8e39fc-699b-4777-aae4-ca592a898437", "name": "network-vif-plugged", "status": "completed", "tag": "9ce4bb36-a0c7-4517-abaf-8db99ca3bb12"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:29:13.808669 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32f02756-a9ae-451a-bf2a-7e25bfbb2b12 None None] Pushing event updated for resources: {'Port': ['ID=ed6c5b80-b384-44d8-ba31-14b833a9cdf8,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:13.808669 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-083308c1-1bdb-4fdd-83c5-f210925a56f3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:13.818998 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-6d9ecaf0-85b2-46d1-a659-ffb12968b852 None None] Publish callbacks [] for port, precommit_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:13.872356 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-32f02756-a9ae-451a-bf2a-7e25bfbb2b12 None None] Attempting to bind port ed6c5b80-b384-44d8-ba31-14b833a9cdf8 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:29:13.872356 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-32f02756-a9ae-451a-bf2a-7e25bfbb2b12 None None] Attempting to bind port ed6c5b80-b384-44d8-ba31-14b833a9cdf8 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '649c5ab9-1338-4cdb-aae3-0ee34f456666', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 313, 'network_id': '6f70786d-53ba-429d-b311-5a26e2e908bd'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:29:13.872356 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-32f02756-a9ae-451a-bf2a-7e25bfbb2b12 None None] Attempting to bind port ed6c5b80-b384-44d8-ba31-14b833a9cdf8 on network 6f70786d-53ba-429d-b311-5a26e2e908bd {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:29:13.873258 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c442eb88-9376-445b-8ed7-9dc5398aa7ea None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:13.885383 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-32f02756-a9ae-451a-bf2a-7e25bfbb2b12 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 28, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:29:13.885748 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-32f02756-a9ae-451a-bf2a-7e25bfbb2b12 None None] Checking segment: {'id': '649c5ab9-1338-4cdb-aae3-0ee34f456666', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 313, 'network_id': '6f70786d-53ba-429d-b311-5a26e2e908bd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:29:13.886139 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-32f02756-a9ae-451a-bf2a-7e25bfbb2b12 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:13.886619 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-32f02756-a9ae-451a-bf2a-7e25bfbb2b12 None None] Bound using segment: {'id': '649c5ab9-1338-4cdb-aae3-0ee34f456666', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 313, 'network_id': '6f70786d-53ba-429d-b311-5a26e2e908bd'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:29:13.887108 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-32f02756-a9ae-451a-bf2a-7e25bfbb2b12 None None] Bound port: ed6c5b80-b384-44d8-ba31-14b833a9cdf8, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '649c5ab9-1338-4cdb-aae3-0ee34f456666', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 313, 'network_id': '6f70786d-53ba-429d-b311-5a26e2e908bd'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:29:13.887467 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-32f02756-a9ae-451a-bf2a-7e25bfbb2b12 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:13.901488 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-3275151c-c24f-408a-9925-39ec59a6b92a tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] For port 14d1d90a-743b-4e99-8c11-af1fc20317e1, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=14d1d90a-743b-4e99-8c11-af1fc20317e1,segment=NetworkSegment(3567d530-a0d1-4a5f-b2b6-e974cb02bf65),segment_id=3567d530-a0d1-4a5f-b2b6-e974cb02bf65)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:29:13.901965 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3275151c-c24f-408a-9925-39ec59a6b92a tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:13.904430 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e443ec11-4344-4460-805a-902c8856181c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:13.920377 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1fb6b348-765e-4a63-8fda-9d63c5d0fe27 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Made reservation on behalf of 83cbb798c0f44b268f8acd2a70eb745a for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:29:13.925228 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1fb6b348-765e-4a63-8fda-9d63c5d0fe27 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:13.954175 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:29:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-09ab8ef9-ef20-4cb7-ab87-722975d443d1 x-openstack-request-id: req-09ab8ef9-ef20-4cb7-ab87-722975d443d1 {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:29:13.954781 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fd8e39fc-699b-4777-aae4-ca592a898437", "name": "network-vif-plugged", "status": "completed", "tag": "9ce4bb36-a0c7-4517-abaf-8db99ca3bb12", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:29:13.956124 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-09ab8ef9-ef20-4cb7-ab87-722975d443d1 {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:29:13.957357 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fd8e39fc-699b-4777-aae4-ca592a898437', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9ce4bb36-a0c7-4517-abaf-8db99ca3bb12', 'code': 200} Nov 09 04:29:13.958322 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c442eb88-9376-445b-8ed7-9dc5398aa7ea None None] No DVR routers for this DVR port 14d1d90a-743b-4e99-8c11-af1fc20317e1 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:29:13.961959 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c442eb88-9376-445b-8ed7-9dc5398aa7ea None None] Pushing event deleted for resources: {'Port': ['ID=14d1d90a-743b-4e99-8c11-af1fc20317e1,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:13.974448 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e443ec11-4344-4460-805a-902c8856181c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649-project] Pushing event updated for resources: {'SecurityGroup': ['ID=63bf1220-a75b-489b-be17-63025a3530f9,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:13.990263 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-6d9ecaf0-85b2-46d1-a659-ffb12968b852 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:14.010122 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-3275151c-c24f-408a-9925-39ec59a6b92a tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Calling delete_port for 14d1d90a-743b-4e99-8c11-af1fc20317e1 owned by network:dhcp {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:29:14.041785 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e443ec11-4344-4460-805a-902c8856181c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 340} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:29:14.046204 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 14d1d90a-743b-4e99-8c11-af1fc20317e1 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:29:14.051081 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-6d9ecaf0-85b2-46d1-a659-ffb12968b852 None None] Attempting to bind port 80f26abe-dc24-4cad-824e-cf929e3c29c8 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:29:14.051493 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-6d9ecaf0-85b2-46d1-a659-ffb12968b852 None None] Attempting to bind port 80f26abe-dc24-4cad-824e-cf929e3c29c8 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'ece9e464-d526-4279-a858-9059edff602d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 317, 'network_id': '17167882-1589-4583-8b9c-87263d360cca'}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:29:14.051825 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d9ecaf0-85b2-46d1-a659-ffb12968b852 None None] Attempting to bind port 80f26abe-dc24-4cad-824e-cf929e3c29c8 on network 17167882-1589-4583-8b9c-87263d360cca {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:29:14.097444 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d9ecaf0-85b2-46d1-a659-ffb12968b852 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 28, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:29:14.097444 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d9ecaf0-85b2-46d1-a659-ffb12968b852 None None] Checking segment: {'id': 'ece9e464-d526-4279-a858-9059edff602d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 317, 'network_id': '17167882-1589-4583-8b9c-87263d360cca'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102164) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:29:14.097444 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-6d9ecaf0-85b2-46d1-a659-ffb12968b852 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:14.097444 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d9ecaf0-85b2-46d1-a659-ffb12968b852 None None] Bound using segment: {'id': 'ece9e464-d526-4279-a858-9059edff602d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 317, 'network_id': '17167882-1589-4583-8b9c-87263d360cca'} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:29:14.097444 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-6d9ecaf0-85b2-46d1-a659-ffb12968b852 None None] Bound port: 80f26abe-dc24-4cad-824e-cf929e3c29c8, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ece9e464-d526-4279-a858-9059edff602d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 317, 'network_id': '17167882-1589-4583-8b9c-87263d360cca'}}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:29:14.097444 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-6d9ecaf0-85b2-46d1-a659-ffb12968b852 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:14.105945 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b55e723-2236-4780-ac43-5767a7cc7368 req-10de9b1f-93a7-4068-befc-552f1641e5d3 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:14.107608 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2b55e723-2236-4780-ac43-5767a7cc7368 req-10de9b1f-93a7-4068-befc-552f1641e5d3 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.24 "GET /v2.0/ports?device_id=1aa3bc74-67df-4706-979b-cbf709855232 HTTP/1.1" status: 200 len: 945 time: 0.2625945 Nov 09 04:29:14.144557 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e123890b-3568-4116-98a6-ca4809438daf tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:14.152621 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e443ec11-4344-4460-805a-902c8856181c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:14.153035 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-e443ec11-4344-4460-805a-902c8856181c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649-project] Added segment 045dd48a-2a31-466f-8e9a-f939dcaa97e8 of type vlan for network c53bac62-4539-4143-874d-1fffa9d5216a Nov 09 04:29:14.187275 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-716c2a9e-869f-4c07-8151-ad815d5edc2e None None] Pushing event updated for resources: {'Port': ['ID=80f26abe-dc24-4cad-824e-cf929e3c29c8,revision_number=2']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:14.251690 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 14d1d90a-743b-4e99-8c11-af1fc20317e1 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:29:14.253441 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 14d1d90a-743b-4e99-8c11-af1fc20317e1 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:29:14.254337 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-6d9ecaf0-85b2-46d1-a659-ffb12968b852 None None] For port 80f26abe-dc24-4cad-824e-cf929e3c29c8, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102164) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:29:14.258711 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-6d9ecaf0-85b2-46d1-a659-ffb12968b852 None None] For port 80f26abe-dc24-4cad-824e-cf929e3c29c8, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=80f26abe-dc24-4cad-824e-cf929e3c29c8,segment=NetworkSegment(ece9e464-d526-4279-a858-9059edff602d),segment_id=ece9e464-d526-4279-a858-9059edff602d)] {{(pid=102164) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:29:14.279442 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e443ec11-4344-4460-805a-902c8856181c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:14.285539 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-d07fbe3a-ca5a-43f3-b96d-b88fc99a5ec9 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Deleting port 80f26abe-dc24-4cad-824e-cf929e3c29c8 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:29:14.285876 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d07fbe3a-ca5a-43f3-b96d-b88fc99a5ec9 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:14.315414 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-32f02756-a9ae-451a-bf2a-7e25bfbb2b12 None None] For port ed6c5b80-b384-44d8-ba31-14b833a9cdf8, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:29:14.320777 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-32f02756-a9ae-451a-bf2a-7e25bfbb2b12 None None] For port ed6c5b80-b384-44d8-ba31-14b833a9cdf8, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=ed6c5b80-b384-44d8-ba31-14b833a9cdf8,segment=NetworkSegment(649c5ab9-1338-4cdb-aae3-0ee34f456666),segment_id=649c5ab9-1338-4cdb-aae3-0ee34f456666)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:29:14.322338 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-6d9ecaf0-85b2-46d1-a659-ffb12968b852 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:14.340401 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2b55e723-2236-4780-ac43-5767a7cc7368 req-067f7ffe-dd18-4701-8f4a-006baf0458db tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.24 "GET /v2.0/security-groups?id=4b002f37-f4ce-4d8a-a894-560955e72139&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2217267 Nov 09 04:29:14.402649 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-32f02756-a9ae-451a-bf2a-7e25bfbb2b12 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:14.418143 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d9ecaf0-85b2-46d1-a659-ffb12968b852 None None] Routers {'833370e1-94fd-4719-92b8-93ab892e117d'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:29:14.418821 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-6d9ecaf0-85b2-46d1-a659-ffb12968b852 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:29:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['833370e1-94fd-4719-92b8-93ab892e117d'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:14.421305 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-716c2a9e-869f-4c07-8151-ad815d5edc2e None None] Pushing event updated for resources: {'Port': ['ID=80f26abe-dc24-4cad-824e-cf929e3c29c8,revision_number=3']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:14.452566 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3275151c-c24f-408a-9925-39ec59a6b92a tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:14.473527 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3275151c-c24f-408a-9925-39ec59a6b92a tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] No DVR routers for this DVR port 14d1d90a-743b-4e99-8c11-af1fc20317e1 on host dv-neutron-816802-2-hyperv {{(pid=102161) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:29:14.533898 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32f02756-a9ae-451a-bf2a-7e25bfbb2b12 None None] Pushing event updated for resources: {'Port': ['ID=ed6c5b80-b384-44d8-ba31-14b833a9cdf8,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:14.542273 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89e41bfb-8858-4d11-af31-678e2075debd req-772c5dcc-61c9-4b2a-bc60-f4cca67927df service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:14.543433 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-89e41bfb-8858-4d11-af31-678e2075debd req-772c5dcc-61c9-4b2a-bc60-f4cca67927df service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=fd8e39fc-699b-4777-aae4-ca592a898437 HTTP/1.1" status: 200 len: 1098 time: 0.1665010 Nov 09 04:29:14.544013 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e443ec11-4344-4460-805a-902c8856181c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:14.549523 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e443ec11-4344-4460-805a-902c8856181c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:14.550300 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e443ec11-4344-4460-805a-902c8856181c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:14.566451 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d07fbe3a-ca5a-43f3-b96d-b88fc99a5ec9 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:14.574220 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3275151c-c24f-408a-9925-39ec59a6b92a tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Pushing event deleted for resources: {'Port': ['ID=14d1d90a-743b-4e99-8c11-af1fc20317e1,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:14.611803 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-d07fbe3a-ca5a-43f3-b96d-b88fc99a5ec9 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Calling delete_port for 80f26abe-dc24-4cad-824e-cf929e3c29c8 owned by network:router_gateway {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:29:14.651225 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-e443ec11-4344-4460-805a-902c8856181c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 803 time: 2.1138461 Nov 09 04:29:14.657070 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-6d9ecaf0-85b2-46d1-a659-ffb12968b852 None None] Set router 833370e1-94fd-4719-92b8-93ab892e117d gateway port host: None {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:29:14.738803 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e443ec11-4344-4460-805a-902c8856181c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649-project] Pushing event updated for resources: {'Network': ['ID=c53bac62-4539-4143-874d-1fffa9d5216a,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:14.743688 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3275151c-c24f-408a-9925-39ec59a6b92a tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:14.771059 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network c53bac62-4539-4143-874d-1fffa9d5216a details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:29:14.835747 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-6d9ecaf0-85b2-46d1-a659-ffb12968b852 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '833370e1-94fd-4719-92b8-93ab892e117d', 'name': '', 'tenant_id': '0f0b9fa79c884bda978424cf72c631d5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:29:07Z', 'updated_at': '2021-11-09T04:29:13Z', 'revision_number': 4, 'project_id': '0f0b9fa79c884bda978424cf72c631d5', 'gw_port_host': None}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:14.852078 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-3275151c-c24f-408a-9925-39ec59a6b92a tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e96f4292-19f0-4446-b093-408610b619f1']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:14.882197 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d9ecaf0-85b2-46d1-a659-ffb12968b852 None None] The sync data for ids ['833370e1-94fd-4719-92b8-93ab892e117d'] in dv-neutron-816802-2-hyperv is: [{'id': '833370e1-94fd-4719-92b8-93ab892e117d', 'name': '', 'tenant_id': '0f0b9fa79c884bda978424cf72c631d5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:29:07Z', 'updated_at': '2021-11-09T04:29:13Z', 'revision_number': 4, 'project_id': '0f0b9fa79c884bda978424cf72c631d5', 'gw_port_host': None}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:29:14.887315 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-89e41bfb-8858-4d11-af31-678e2075debd req-31f477a8-9407-46c8-be45-a6e4a05a634b service neutron] 10.222.0.26 "GET /v2.0/security-groups?id=67cb2d36-e38c-4a29-adb5-c52b1d94ae99&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3171380 Nov 09 04:29:14.896658 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-3275151c-c24f-408a-9925-39ec59a6b92a tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3567d530-a0d1-4a5f-b2b6-e974cb02bf65') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:14.897314 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-3275151c-c24f-408a-9925-39ec59a6b92a tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3567d530-a0d1-4a5f-b2b6-e974cb02bf65') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:14.918318 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3275151c-c24f-408a-9925-39ec59a6b92a tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:14.934627 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3275151c-c24f-408a-9925-39ec59a6b92a tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:14.996533 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3275151c-c24f-408a-9925-39ec59a6b92a tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Releasing vlan 316 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:29:14.996985 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3275151c-c24f-408a-9925-39ec59a6b92a tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:15.000368 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:29:15.000368 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:29:15.000368 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:29:15.000368 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:29:15.000368 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:29:15.000368 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:29:15.000368 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:29:15.000368 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:29:15.000368 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:29:15.000368 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:29:15.000368 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:29:15.000368 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:29:15.000368 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:29:15.000368 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:29:15.000368 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:29:15.000368 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:29:15.000368 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:29:15.000368 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:29:15.000368 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:29:15.000368 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:29:15.000368 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:29:15.000368 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:29:15.000368 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:29:15.000368 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:29:15.000368 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:29:15.000368 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:29:15.000368 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:29:15.000368 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:29:15.000368 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:29:15.000368 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:29:15.000368 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:29:15.000368 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:29:15.115178 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1fb6b348-765e-4a63-8fda-9d63c5d0fe27 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:15.161851 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:15.166288 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53424) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:15.172491 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Request body: {'port': {'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a', 'binding:host_id': 'hv-neutron-8168', 'name': 'tempest-PortsAdminExtendedAttrsIpV6TestJSON-1259617159'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:15.186169 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-979da568-3729-4420-910d-942786270537 req-b9ab9773-60ae-44c2-a94c-e4e6bf55f764 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:15.188061 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-979da568-3729-4420-910d-942786270537 req-b9ab9773-60ae-44c2-a94c-e4e6bf55f764 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "GET /v2.0/ports?device_id=fd8e39fc-699b-4777-aae4-ca592a898437 HTTP/1.1" status: 200 len: 945 time: 0.1942685 Nov 09 04:29:15.203443 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e123890b-3568-4116-98a6-ca4809438daf tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Router cd21e659-1094-4653-b570-03e6ed4305e3 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:29:15.207653 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3275151c-c24f-408a-9925-39ec59a6b92a tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:15.221848 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3275151c-c24f-408a-9925-39ec59a6b92a tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:15.226057 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-3275151c-c24f-408a-9925-39ec59a6b92a tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] 10.222.0.24 "DELETE /v2.0/networks/e96f4292-19f0-4446-b093-408610b619f1 HTTP/1.1" status: 204 len: 168 time: 2.4584396 Nov 09 04:29:15.238793 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3275151c-c24f-408a-9925-39ec59a6b92a tempest-AllowedAddressPairTestJSON-1664545093 tempest-AllowedAddressPairTestJSON-1664545093-project] Pushing event deleted for resources: {'Network': ['ID=e96f4292-19f0-4446-b093-408610b619f1,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:15.240034 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fb6b348-765e-4a63-8fda-9d63c5d0fe27 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Pushing event updated for resources: {'Subnet': ['ID=21b1242e-cb25-403c-b89d-2f49e36afaa9,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:15.245179 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Made reservation on behalf of 657652107bc34ca7983289060f1bd8df for: {'port': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:29:15.247901 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:15.260555 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d07fbe3a-ca5a-43f3-b96d-b88fc99a5ec9 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:15.309716 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:15.314201 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d07fbe3a-ca5a-43f3-b96d-b88fc99a5ec9 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Pushing event deleted for resources: {'Port': ['ID=80f26abe-dc24-4cad-824e-cf929e3c29c8,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:15.346734 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53430) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:15.358154 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1fb6b348-765e-4a63-8fda-9d63c5d0fe27 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Checking segment: {'id': 'dfcc87e7-1051-40c7-88f0-44b13bd9b2d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 331, 'network_id': '3ba7cbec-5c67-4017-89a4-d38ecdcd019a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:29:15.358692 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1fb6b348-765e-4a63-8fda-9d63c5d0fe27 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Network hostable DHCP agents. Network: 3ba7cbec-5c67-4017-89a4-d38ecdcd019a, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:29:15.366500 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-979da568-3729-4420-910d-942786270537 req-3d864e50-e48d-4d36-8f9d-f655de93aec0 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "GET /v2.0/security-groups?id=67cb2d36-e38c-4a29-adb5-c52b1d94ae99&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1575623 Nov 09 04:29:15.378347 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d07fbe3a-ca5a-43f3-b96d-b88fc99a5ec9 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-466373'] for router_gateway, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:15.440208 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e123890b-3568-4116-98a6-ca4809438daf tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:29:15.448230 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e123890b-3568-4116-98a6-ca4809438daf tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] 10.222.0.24 "PUT /v2.0/routers/cd21e659-1094-4653-b570-03e6ed4305e3/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 5.1811318 Nov 09 04:29:15.448607 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53436) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:15.456396 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e2000439-8fd7-4e95-b7a2-7792159ccc42 None None] Sync routers for ids ['cd21e659-1094-4653-b570-03e6ed4305e3'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:29:15.467333 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e2000439-8fd7-4e95-b7a2-7792159ccc42 None None] Routers {'cd21e659-1094-4653-b570-03e6ed4305e3'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:29:15.468421 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-e2000439-8fd7-4e95-b7a2-7792159ccc42 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:29:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['cd21e659-1094-4653-b570-03e6ed4305e3'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:15.516770 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-33a1c3c8-fc38-40ec-a377-2930e42b7ad8 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Request body: {'network': {'name': 'tempest-FloatingIPNegativeTestJSON-test-network-1484885036'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:15.517048 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-e2000439-8fd7-4e95-b7a2-7792159ccc42 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:15.531275 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e2000439-8fd7-4e95-b7a2-7792159ccc42 None None] Routers {'cd21e659-1094-4653-b570-03e6ed4305e3'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:29:15.532136 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-e2000439-8fd7-4e95-b7a2-7792159ccc42 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:29:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['cd21e659-1094-4653-b570-03e6ed4305e3'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:15.536788 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1fb6b348-765e-4a63-8fda-9d63c5d0fe27 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Network 3ba7cbec-5c67-4017-89a4-d38ecdcd019a is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:29:15.553671 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d07fbe3a-ca5a-43f3-b96d-b88fc99a5ec9 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:15.556019 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d07fbe3a-ca5a-43f3-b96d-b88fc99a5ec9 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:15.580147 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-e2000439-8fd7-4e95-b7a2-7792159ccc42 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:15.580978 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e2000439-8fd7-4e95-b7a2-7792159ccc42 None None] The sync data for ids ['cd21e659-1094-4653-b570-03e6ed4305e3'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:29:15.629623 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-27a60b2d-324e-437f-b7fe-43d2be324b4e tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks [] for router, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:15.671366 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-1fb6b348-765e-4a63-8fda-9d63c5d0fe27 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 3ba7cbec-5c67-4017-89a4-d38ecdcd019a) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:29:15.677518 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1fb6b348-765e-4a63-8fda-9d63c5d0fe27 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:15.678108 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1fb6b348-765e-4a63-8fda-9d63c5d0fe27 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:15.688566 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-420e9ad1-77d0-4c23-9464-bef393e8f32a None None] Network 3ba7cbec-5c67-4017-89a4-d38ecdcd019a requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:29:15.691289 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82293a71-b3af-4354-8207-3c1b27419cf7 req-06e9e8ee-9a59-46f9-8d3c-400a5ebc46d3 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:15.692420 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-82293a71-b3af-4354-8207-3c1b27419cf7 req-06e9e8ee-9a59-46f9-8d3c-400a5ebc46d3 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.24 "GET /v2.0/ports?device_id=1aa3bc74-67df-4706-979b-cbf709855232 HTTP/1.1" status: 200 len: 945 time: 0.0767729 Nov 09 04:29:15.701283 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-33a1c3c8-fc38-40ec-a377-2930e42b7ad8 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Made reservation on behalf of 0bad988bbff146edaf9af1fa56d6a513 for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:29:15.704994 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-33a1c3c8-fc38-40ec-a377-2930e42b7ad8 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:15.745484 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-33a1c3c8-fc38-40ec-a377-2930e42b7ad8 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:15.778276 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-82293a71-b3af-4354-8207-3c1b27419cf7 req-e51e93c7-9f40-4219-b1ca-bd718ecb0c5b tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.24 "GET /v2.0/security-groups?id=4b002f37-f4ce-4d8a-a894-560955e72139&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0696490 Nov 09 04:29:15.782262 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d07fbe3a-ca5a-43f3-b96d-b88fc99a5ec9 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:15.782262 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d07fbe3a-ca5a-43f3-b96d-b88fc99a5ec9 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 833370e1-94fd-4719-92b8-93ab892e117d {{(pid=102161) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:29:15.782889 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-1fb6b348-765e-4a63-8fda-9d63c5d0fe27 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 812 time: 2.4149733 Nov 09 04:29:15.785513 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53438) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:15.788330 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d07fbe3a-ca5a-43f3-b96d-b88fc99a5ec9 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:15.790462 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-d07fbe3a-ca5a-43f3-b96d-b88fc99a5ec9 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] 10.222.0.24 "DELETE /v2.0/routers/833370e1-94fd-4719-92b8-93ab892e117d HTTP/1.1" status: 204 len: 168 time: 3.0384977 Nov 09 04:29:15.793915 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53440) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:15.849798 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-0a7a619d-497c-4771-b578-817a76774733 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Deleting subnet aa65f5f6-77d4-4b7b-b90f-b2ffac782dc1 {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:29:15.856337 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0a7a619d-497c-4771-b578-817a76774733 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:15.859630 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:15.904039 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0a7a619d-497c-4771-b578-817a76774733 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:15.974325 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:15.985810 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] device_id is not set on port 57fb12aa-7af6-48ad-992b-890147f21448 yet. {{(pid=102161) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:29:16.092596 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53446) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:16.093723 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device ed6c5b80-b384-44d8-ba31-14b833a9cdf8 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:29:16.127722 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-30c212ed-e626-4834-b38d-0d9d1a39e1be None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-3ba7cbec-5c67-4017-89a4-d38ecdcd019a', 'network_id': '3ba7cbec-5c67-4017-89a4-d38ecdcd019a', 'tenant_id': '83cbb798c0f44b268f8acd2a70eb745a', 'fixed_ips': [{'subnet_id': '21b1242e-cb25-403c-b89d-2f49e36afaa9'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:29:16.128950 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-30c212ed-e626-4834-b38d-0d9d1a39e1be None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:16.144649 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-27a60b2d-324e-437f-b7fe-43d2be324b4e tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks [] for router_gateway, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:16.171308 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3baf0370-1c9e-41f6-8df9-fcfba37fcc55 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:16.185203 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ef619023-9bd2-41cf-9860-2168e5382504,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:16.195508 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0a7a619d-497c-4771-b578-817a76774733 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:16.253171 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8df3211f-068a-45af-b706-1e142e8f2c47 None None] Network 6f70786d-53ba-429d-b311-5a26e2e908bd requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:29:16.339396 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-33a1c3c8-fc38-40ec-a377-2930e42b7ad8 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:16.348555 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3baf0370-1c9e-41f6-8df9-fcfba37fcc55 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:16.358846 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6551db2-f165-427f-84b5-6a56da9e1348 req-36b1d92b-9a73-4f8e-a1be-3d455b3fa0f0 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:16.360347 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port ed6c5b80-b384-44d8-ba31-14b833a9cdf8 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:29:16.360465 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a6551db2-f165-427f-84b5-6a56da9e1348 req-36b1d92b-9a73-4f8e-a1be-3d455b3fa0f0 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.24 "GET /v2.0/ports?device_id=1aa3bc74-67df-4706-979b-cbf709855232 HTTP/1.1" status: 200 len: 945 time: 0.2643900 Nov 09 04:29:16.360708 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:16.381965 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:29:16.382548 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:29:16.383846 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:29:16.384209 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:29:16.384535 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:29:16.385002 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:29:16.385348 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:29:16.385679 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:29:16.386012 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:29:16.386340 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:29:16.386689 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:29:16.387534 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:29:16.408410 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53450) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:16.427226 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-538b2598-bdb7-4b67-9d0e-ee02e5efa365 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Request body: {'floatingip': {'port_id': '49694ee4-edfa-4a08-be0b-8bfa9b06128b'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:16.433145 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-33a1c3c8-fc38-40ec-a377-2930e42b7ad8 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:16.441377 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] device_id is not set on port 57fb12aa-7af6-48ad-992b-890147f21448 yet. {{(pid=102161) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:29:16.447023 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-768482cf-3fb1-4ae6-ae96-f4003787e073 None None] Provisioning complete for port ed6c5b80-b384-44d8-ba31-14b833a9cdf8 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:29:16.447378 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-768482cf-3fb1-4ae6-ae96-f4003787e073 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:16.461701 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:16.529233 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:16.533351 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-33a1c3c8-fc38-40ec-a377-2930e42b7ad8 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 324} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:29:16.540655 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-538b2598-bdb7-4b67-9d0e-ee02e5efa365 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Publish callbacks [] for floatingip, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:16.543055 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33a1c3c8-fc38-40ec-a377-2930e42b7ad8 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Pushing event updated for resources: {'SecurityGroup': ['ID=ee162beb-ea68-4317-aaa3-523a7541a299,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:16.544223 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:16.581607 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-30c212ed-e626-4834-b38d-0d9d1a39e1be None None] Allocated IP 2001:db8::1 (3ba7cbec-5c67-4017-89a4-d38ecdcd019a/21b1242e-cb25-403c-b89d-2f49e36afaa9/74cf499c-8de4-4677-9745-3af1ae2cabba) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:29:16.599123 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45728616-7496-424b-a5cf-66f7e59a1658 req-6dfcf685-b00d-4a6a-9764-88eed5c2d98a tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:16.606228 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-33a1c3c8-fc38-40ec-a377-2930e42b7ad8 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:16.606592 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-33a1c3c8-fc38-40ec-a377-2930e42b7ad8 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Added segment a79a3f61-7b94-4db2-b42c-1e9442738b0a of type vlan for network 95c56523-9e9a-4f6f-aa13-0372772dbac5 Nov 09 04:29:16.607345 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-45728616-7496-424b-a5cf-66f7e59a1658 req-6dfcf685-b00d-4a6a-9764-88eed5c2d98a tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "GET /v2.0/ports?device_id=fd8e39fc-699b-4777-aae4-ca592a898437 HTTP/1.1" status: 200 len: 945 time: 0.1175139 Nov 09 04:29:16.609561 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0a7a619d-497c-4771-b578-817a76774733 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:16.625683 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a18f64ed-baf2-4782-a575-8212c753b4a2 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=a369b57921894b01a70b43c4f969d224&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5172327 Nov 09 04:29:16.633251 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:16.638644 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53454) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:16.655952 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-27a60b2d-324e-437f-b7fe-43d2be324b4e tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Deleting port a58316d9-1cb1-4878-8a21-f3577322ae07 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:29:16.656316 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-27a60b2d-324e-437f-b7fe-43d2be324b4e tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:16.742820 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port ed6c5b80-b384-44d8-ba31-14b833a9cdf8, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=ed6c5b80-b384-44d8-ba31-14b833a9cdf8,segment=NetworkSegment(649c5ab9-1338-4cdb-aae3-0ee34f456666),segment_id=649c5ab9-1338-4cdb-aae3-0ee34f456666)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:29:16.801116 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-33a1c3c8-fc38-40ec-a377-2930e42b7ad8 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:16.827392 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:16.939212 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-27a60b2d-324e-437f-b7fe-43d2be324b4e tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:16.955815 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a7a619d-497c-4771-b578-817a76774733 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Pushing event deleted for resources: {'Subnet': ['ID=aa65f5f6-77d4-4b7b-b90f-b2ffac782dc1,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:16.964685 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0a7a619d-497c-4771-b578-817a76774733 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:16.967860 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-0a7a619d-497c-4771-b578-817a76774733 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] 10.222.0.24 "DELETE /v2.0/subnets/aa65f5f6-77d4-4b7b-b90f-b2ffac782dc1 HTTP/1.1" status: 204 len: 168 time: 1.1728742 Nov 09 04:29:16.972733 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53456) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:16.979550 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Pushing event updated for resources: {'Port': ['ID=57fb12aa-7af6-48ad-992b-890147f21448,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:16.991863 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-29fcf8f9-6b97-4aa6-b386-28fbb2d395f6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:16.993665 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-27a60b2d-324e-437f-b7fe-43d2be324b4e tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Calling delete_port for a58316d9-1cb1-4878-8a21-f3577322ae07 owned by network:router_gateway {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:29:17.016492 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-768482cf-3fb1-4ae6-ae96-f4003787e073 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:17.021464 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-33a1c3c8-fc38-40ec-a377-2930e42b7ad8 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:17.027300 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-33a1c3c8-fc38-40ec-a377-2930e42b7ad8 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:17.027913 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-33a1c3c8-fc38-40ec-a377-2930e42b7ad8 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:17.056724 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-30c212ed-e626-4834-b38d-0d9d1a39e1be None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:17.072381 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Checking segment: {'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:29:17.072601 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=ed6c5b80-b384-44d8-ba31-14b833a9cdf8,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:17.072689 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Network hostable DHCP agents. Network: c53bac62-4539-4143-874d-1fffa9d5216a, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:29:17.076091 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:17.107574 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-45728616-7496-424b-a5cf-66f7e59a1658 req-6b9155cc-24a1-4d0b-99d6-64b268a31b41 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "GET /v2.0/security-groups?id=67cb2d36-e38c-4a29-adb5-c52b1d94ae99&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4992213 Nov 09 04:29:17.109109 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-29fcf8f9-6b97-4aa6-b386-28fbb2d395f6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:17.130649 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-30c212ed-e626-4834-b38d-0d9d1a39e1be None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:17.133314 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bebe1dd3-bf1b-491d-b4fe-feaa42b4c341 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:17.176100 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.db.api [None req-768482cf-3fb1-4ae6-ae96-f4003787e073 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=102163) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:29:17.176459 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG oslo_db.api [None req-768482cf-3fb1-4ae6-ae96-f4003787e073 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:29:17.179008 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30c212ed-e626-4834-b38d-0d9d1a39e1be None None] Pushing event updated for resources: {'Port': ['ID=74cf499c-8de4-4677-9745-3af1ae2cabba,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:17.193539 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-30c212ed-e626-4834-b38d-0d9d1a39e1be None None] Network 3ba7cbec-5c67-4017-89a4-d38ecdcd019a is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:29:17.195734 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-30c212ed-e626-4834-b38d-0d9d1a39e1be None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:29:17.198129 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-30c212ed-e626-4834-b38d-0d9d1a39e1be None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:29:17.204686 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Network c53bac62-4539-4143-874d-1fffa9d5216a is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:29:17.244273 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bebe1dd3-bf1b-491d-b4fe-feaa42b4c341 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:17.253299 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-30c212ed-e626-4834-b38d-0d9d1a39e1be None None] Attempting to bind port 74cf499c-8de4-4677-9745-3af1ae2cabba on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:29:17.253459 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-30c212ed-e626-4834-b38d-0d9d1a39e1be None None] Attempting to bind port 74cf499c-8de4-4677-9745-3af1ae2cabba by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'dfcc87e7-1051-40c7-88f0-44b13bd9b2d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 331, 'network_id': '3ba7cbec-5c67-4017-89a4-d38ecdcd019a'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:29:17.253705 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-30c212ed-e626-4834-b38d-0d9d1a39e1be None None] Attempting to bind port 74cf499c-8de4-4677-9745-3af1ae2cabba on network 3ba7cbec-5c67-4017-89a4-d38ecdcd019a {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:29:17.259468 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-30c212ed-e626-4834-b38d-0d9d1a39e1be None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 29, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:29:17.259835 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-30c212ed-e626-4834-b38d-0d9d1a39e1be None None] Checking segment: {'id': 'dfcc87e7-1051-40c7-88f0-44b13bd9b2d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 331, 'network_id': '3ba7cbec-5c67-4017-89a4-d38ecdcd019a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:29:17.260230 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-30c212ed-e626-4834-b38d-0d9d1a39e1be None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:17.260654 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-30c212ed-e626-4834-b38d-0d9d1a39e1be None None] Bound using segment: {'id': 'dfcc87e7-1051-40c7-88f0-44b13bd9b2d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 331, 'network_id': '3ba7cbec-5c67-4017-89a4-d38ecdcd019a'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:29:17.261136 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-30c212ed-e626-4834-b38d-0d9d1a39e1be None None] Bound port: 74cf499c-8de4-4677-9745-3af1ae2cabba, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'dfcc87e7-1051-40c7-88f0-44b13bd9b2d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 331, 'network_id': '3ba7cbec-5c67-4017-89a4-d38ecdcd019a'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:29:17.261892 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-30c212ed-e626-4834-b38d-0d9d1a39e1be None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:17.265887 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-bebe1dd3-bf1b-491d-b4fe-feaa42b4c341 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['17167882-1589-4583-8b9c-87263d360cca']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:17.281218 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-bebe1dd3-bf1b-491d-b4fe-feaa42b4c341 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ece9e464-d526-4279-a858-9059edff602d') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:17.281218 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-bebe1dd3-bf1b-491d-b4fe-feaa42b4c341 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ece9e464-d526-4279-a858-9059edff602d') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:17.288690 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bebe1dd3-bf1b-491d-b4fe-feaa42b4c341 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:17.293445 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-33a1c3c8-fc38-40ec-a377-2930e42b7ad8 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 794 time: 1.9429872 Nov 09 04:29:17.294973 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53460) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:17.302385 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-98ca8006-31ec-4b92-9e33-f27435752118 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Request body: {'subnet': {'network_id': '95c56523-9e9a-4f6f-aa13-0372772dbac5', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:17.311003 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, c53bac62-4539-4143-874d-1fffa9d5216a) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:29:17.325470 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fcf516ad-3a8d-43bb-9495-88a70ecd1767 None None] Network c53bac62-4539-4143-874d-1fffa9d5216a requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:29:17.329942 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bebe1dd3-bf1b-491d-b4fe-feaa42b4c341 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:17.336523 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:29:17.337621 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33a1c3c8-fc38-40ec-a377-2930e42b7ad8 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Pushing event updated for resources: {'Network': ['ID=95c56523-9e9a-4f6f-aa13-0372772dbac5,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:17.354649 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 57fb12aa-7af6-48ad-992b-890147f21448 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:29:17.354985 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 57fb12aa-7af6-48ad-992b-890147f21448 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] {{(pid=102161) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:29:17.355325 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 57fb12aa-7af6-48ad-992b-890147f21448 on network c53bac62-4539-4143-874d-1fffa9d5216a {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:29:17.359968 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-30c212ed-e626-4834-b38d-0d9d1a39e1be None None] For port 74cf499c-8de4-4677-9745-3af1ae2cabba, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:29:17.360598 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-bebe1dd3-bf1b-491d-b4fe-feaa42b4c341 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Releasing vlan 317 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:29:17.361018 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bebe1dd3-bf1b-491d-b4fe-feaa42b4c341 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:17.363209 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:29:17.363209 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:29:17.363209 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:29:17.363209 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:29:17.363209 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:29:17.363209 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:29:17.363209 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:29:17.363209 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:29:17.363209 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:29:17.363209 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:29:17.363209 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:29:17.363209 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:29:17.363209 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:29:17.363209 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:29:17.363209 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:29:17.363209 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:29:17.363209 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:29:17.363209 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:29:17.363209 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:29:17.363209 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:29:17.363209 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:29:17.363209 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:29:17.363209 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:29:17.363209 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:29:17.363209 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:29:17.363209 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:29:17.363209 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:29:17.363209 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:29:17.363209 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:29:17.363209 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:29:17.363209 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:29:17.363209 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:29:17.403861 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a1c3c8-fc38-40ec-a377-2930e42b7ad8 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:29:17.404235 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a1c3c8-fc38-40ec-a377-2930e42b7ad8 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:29:17.404575 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a1c3c8-fc38-40ec-a377-2930e42b7ad8 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:29:17.404908 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a1c3c8-fc38-40ec-a377-2930e42b7ad8 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:29:17.405241 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a1c3c8-fc38-40ec-a377-2930e42b7ad8 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:29:17.405568 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a1c3c8-fc38-40ec-a377-2930e42b7ad8 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:29:17.405890 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a1c3c8-fc38-40ec-a377-2930e42b7ad8 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:29:17.406268 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a1c3c8-fc38-40ec-a377-2930e42b7ad8 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:29:17.406617 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a1c3c8-fc38-40ec-a377-2930e42b7ad8 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:29:17.406754 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Port 57fb12aa-7af6-48ad-992b-890147f21448 on network c53bac62-4539-4143-874d-1fffa9d5216a not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:29:17.406929 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a1c3c8-fc38-40ec-a377-2930e42b7ad8 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:29:17.407027 dv-neutron-816802-2-hyperv neutron-server[102161]: ERROR neutron.plugins.ml2.managers [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Failed to bind port 57fb12aa-7af6-48ad-992b-890147f21448 on host hv-neutron-8168 for vnic_type normal using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] Nov 09 04:29:17.407254 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a1c3c8-fc38-40ec-a377-2930e42b7ad8 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:29:17.407407 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.plugins.ml2.plugin [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempt 2 to bind port 57fb12aa-7af6-48ad-992b-890147f21448 Nov 09 04:29:17.407588 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a1c3c8-fc38-40ec-a377-2930e42b7ad8 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:29:17.427453 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 95c56523-9e9a-4f6f-aa13-0372772dbac5 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:29:17.469195 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 57fb12aa-7af6-48ad-992b-890147f21448 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:29:17.469523 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 57fb12aa-7af6-48ad-992b-890147f21448 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] {{(pid=102161) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:29:17.469865 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 57fb12aa-7af6-48ad-992b-890147f21448 on network c53bac62-4539-4143-874d-1fffa9d5216a {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:29:17.476463 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Port 57fb12aa-7af6-48ad-992b-890147f21448 on network c53bac62-4539-4143-874d-1fffa9d5216a not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:29:17.476788 dv-neutron-816802-2-hyperv neutron-server[102161]: ERROR neutron.plugins.ml2.managers [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Failed to bind port 57fb12aa-7af6-48ad-992b-890147f21448 on host hv-neutron-8168 for vnic_type normal using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] Nov 09 04:29:17.478917 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.plugins.ml2.plugin [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempt 3 to bind port 57fb12aa-7af6-48ad-992b-890147f21448 Nov 09 04:29:17.499766 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 57fb12aa-7af6-48ad-992b-890147f21448 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:29:17.500136 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 57fb12aa-7af6-48ad-992b-890147f21448 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] {{(pid=102161) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:29:17.500467 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 57fb12aa-7af6-48ad-992b-890147f21448 on network c53bac62-4539-4143-874d-1fffa9d5216a {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:29:17.504947 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Port 57fb12aa-7af6-48ad-992b-890147f21448 on network c53bac62-4539-4143-874d-1fffa9d5216a not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:29:17.505279 dv-neutron-816802-2-hyperv neutron-server[102161]: ERROR neutron.plugins.ml2.managers [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Failed to bind port 57fb12aa-7af6-48ad-992b-890147f21448 on host hv-neutron-8168 for vnic_type normal using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] Nov 09 04:29:17.505668 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.plugins.ml2.plugin [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempt 4 to bind port 57fb12aa-7af6-48ad-992b-890147f21448 Nov 09 04:29:17.512334 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3baf0370-1c9e-41f6-8df9-fcfba37fcc55 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:17.523813 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 57fb12aa-7af6-48ad-992b-890147f21448 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:29:17.524162 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 57fb12aa-7af6-48ad-992b-890147f21448 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] {{(pid=102161) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:29:17.524575 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 57fb12aa-7af6-48ad-992b-890147f21448 on network c53bac62-4539-4143-874d-1fffa9d5216a {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:29:17.530694 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Port 57fb12aa-7af6-48ad-992b-890147f21448 on network c53bac62-4539-4143-874d-1fffa9d5216a not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:29:17.531046 dv-neutron-816802-2-hyperv neutron-server[102161]: ERROR neutron.plugins.ml2.managers [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Failed to bind port 57fb12aa-7af6-48ad-992b-890147f21448 on host hv-neutron-8168 for vnic_type normal using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] Nov 09 04:29:17.531518 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.plugins.ml2.plugin [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempt 5 to bind port 57fb12aa-7af6-48ad-992b-890147f21448 Nov 09 04:29:17.545959 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 57fb12aa-7af6-48ad-992b-890147f21448 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:29:17.546379 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 57fb12aa-7af6-48ad-992b-890147f21448 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] {{(pid=102161) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:29:17.546803 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 57fb12aa-7af6-48ad-992b-890147f21448 on network c53bac62-4539-4143-874d-1fffa9d5216a {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:29:17.551408 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Port 57fb12aa-7af6-48ad-992b-890147f21448 on network c53bac62-4539-4143-874d-1fffa9d5216a not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:29:17.551731 dv-neutron-816802-2-hyperv neutron-server[102161]: ERROR neutron.plugins.ml2.managers [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Failed to bind port 57fb12aa-7af6-48ad-992b-890147f21448 on host hv-neutron-8168 for vnic_type normal using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] Nov 09 04:29:17.552120 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.plugins.ml2.plugin [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempt 6 to bind port 57fb12aa-7af6-48ad-992b-890147f21448 Nov 09 04:29:17.565372 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 57fb12aa-7af6-48ad-992b-890147f21448 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:29:17.565640 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 57fb12aa-7af6-48ad-992b-890147f21448 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] {{(pid=102161) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:29:17.565976 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 57fb12aa-7af6-48ad-992b-890147f21448 on network c53bac62-4539-4143-874d-1fffa9d5216a {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:29:17.570919 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Port 57fb12aa-7af6-48ad-992b-890147f21448 on network c53bac62-4539-4143-874d-1fffa9d5216a not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:29:17.571246 dv-neutron-816802-2-hyperv neutron-server[102161]: ERROR neutron.plugins.ml2.managers [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Failed to bind port 57fb12aa-7af6-48ad-992b-890147f21448 on host hv-neutron-8168 for vnic_type normal using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] Nov 09 04:29:17.571790 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.plugins.ml2.plugin [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempt 7 to bind port 57fb12aa-7af6-48ad-992b-890147f21448 Nov 09 04:29:17.575680 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bebe1dd3-bf1b-491d-b4fe-feaa42b4c341 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:17.579834 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3baf0370-1c9e-41f6-8df9-fcfba37fcc55 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Pushing event deleted for resources: {'Subnet': ['ID=21b1242e-cb25-403c-b89d-2f49e36afaa9,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:17.580734 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bebe1dd3-bf1b-491d-b4fe-feaa42b4c341 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network 17167882-1589-4583-8b9c-87263d360cca {{(pid=102161) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:120}} Nov 09 04:29:17.583511 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-30c212ed-e626-4834-b38d-0d9d1a39e1be None None] For port 74cf499c-8de4-4677-9745-3af1ae2cabba, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=74cf499c-8de4-4677-9745-3af1ae2cabba,segment=NetworkSegment(dfcc87e7-1051-40c7-88f0-44b13bd9b2d4),segment_id=dfcc87e7-1051-40c7-88f0-44b13bd9b2d4)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:29:17.583888 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bebe1dd3-bf1b-491d-b4fe-feaa42b4c341 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:17.593492 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-bebe1dd3-bf1b-491d-b4fe-feaa42b4c341 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] 10.222.0.24 "DELETE /v2.0/networks/17167882-1589-4583-8b9c-87263d360cca HTTP/1.1" status: 204 len: 168 time: 0.6088066 Nov 09 04:29:17.608128 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bebe1dd3-bf1b-491d-b4fe-feaa42b4c341 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Pushing event deleted for resources: {'Network': ['ID=17167882-1589-4583-8b9c-87263d360cca,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:17.612902 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-98ca8006-31ec-4b92-9e33-f27435752118 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Made reservation on behalf of 0bad988bbff146edaf9af1fa56d6a513 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:29:17.616779 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7a554ac-2c76-4608-97dd-60f7da16e308 req-45d55d5a-3f1e-4bf5-a5d3-56dce51da4df tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:17.617096 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-98ca8006-31ec-4b92-9e33-f27435752118 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:17.618429 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d7a554ac-2c76-4608-97dd-60f7da16e308 req-45d55d5a-3f1e-4bf5-a5d3-56dce51da4df tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "GET /v2.0/ports?device_id=fd8e39fc-699b-4777-aae4-ca592a898437 HTTP/1.1" status: 200 len: 945 time: 0.3510036 Nov 09 04:29:17.621809 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 57fb12aa-7af6-48ad-992b-890147f21448 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:29:17.622143 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 57fb12aa-7af6-48ad-992b-890147f21448 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] {{(pid=102161) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:29:17.622536 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 57fb12aa-7af6-48ad-992b-890147f21448 on network c53bac62-4539-4143-874d-1fffa9d5216a {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:29:17.636219 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53464) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:17.642209 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-f93c9f02-2f72-4b32-bb67-9377ff7564cd tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Request body: {'floatingip': {'port_id': '9ce4bb36-a0c7-4517-abaf-8db99ca3bb12'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:17.673741 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-29fcf8f9-6b97-4aa6-b386-28fbb2d395f6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:17.673954 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Port 57fb12aa-7af6-48ad-992b-890147f21448 on network c53bac62-4539-4143-874d-1fffa9d5216a not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:29:17.674288 dv-neutron-816802-2-hyperv neutron-server[102161]: ERROR neutron.plugins.ml2.managers [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Failed to bind port 57fb12aa-7af6-48ad-992b-890147f21448 on host hv-neutron-8168 for vnic_type normal using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] Nov 09 04:29:17.676394 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-29fcf8f9-6b97-4aa6-b386-28fbb2d395f6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:17.688125 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-29fcf8f9-6b97-4aa6-b386-28fbb2d395f6 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/ea9e9faa-372b-4e4c-afa3-87735bf1d5a7 HTTP/1.1" status: 204 len: 168 time: 1.0391119 Nov 09 04:29:17.712700 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.plugins.ml2.plugin [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempt 8 to bind port 57fb12aa-7af6-48ad-992b-890147f21448 Nov 09 04:29:17.766769 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-30c212ed-e626-4834-b38d-0d9d1a39e1be None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:17.766933 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f93c9f02-2f72-4b32-bb67-9377ff7564cd tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Publish callbacks [] for floatingip, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:17.783935 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3baf0370-1c9e-41f6-8df9-fcfba37fcc55 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:17.792503 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29fcf8f9-6b97-4aa6-b386-28fbb2d395f6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ea9e9faa-372b-4e4c-afa3-87735bf1d5a7,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:17.826506 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-3baf0370-1c9e-41f6-8df9-fcfba37fcc55 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3ba7cbec-5c67-4017-89a4-d38ecdcd019a']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:17.838681 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-3baf0370-1c9e-41f6-8df9-fcfba37fcc55 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'dfcc87e7-1051-40c7-88f0-44b13bd9b2d4') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:17.839415 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-3baf0370-1c9e-41f6-8df9-fcfba37fcc55 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'dfcc87e7-1051-40c7-88f0-44b13bd9b2d4') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:17.851107 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3baf0370-1c9e-41f6-8df9-fcfba37fcc55 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:17.867273 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3baf0370-1c9e-41f6-8df9-fcfba37fcc55 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:17.965431 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-27a60b2d-324e-437f-b7fe-43d2be324b4e tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:17.973251 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3baf0370-1c9e-41f6-8df9-fcfba37fcc55 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Releasing vlan 331 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:29:17.975460 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3baf0370-1c9e-41f6-8df9-fcfba37fcc55 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:18.016072 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:29:18.016072 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:29:18.016072 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:29:18.016072 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:29:18.016072 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:29:18.016072 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:29:18.016072 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:29:18.016072 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:29:18.016072 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:29:18.016072 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:29:18.016072 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:29:18.016072 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:29:18.016072 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:29:18.016072 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:29:18.016072 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:29:18.016072 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:29:18.016072 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:29:18.016072 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:29:18.016072 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:29:18.016072 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:29:18.016072 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:29:18.016072 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:29:18.016072 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:29:18.016072 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:29:18.016072 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:29:18.016072 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:29:18.016072 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:29:18.016072 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:29:18.016072 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:29:18.016072 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:29:18.016072 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:29:18.016072 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:29:18.122530 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27a60b2d-324e-437f-b7fe-43d2be324b4e tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Pushing event deleted for resources: {'Port': ['ID=a58316d9-1cb1-4878-8a21-f3577322ae07,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:18.144978 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30c212ed-e626-4834-b38d-0d9d1a39e1be None None] Pushing event updated for resources: {'Port': ['ID=74cf499c-8de4-4677-9745-3af1ae2cabba,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:18.148200 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.db.resource_extend [None req-538b2598-bdb7-4b67-9d0e-ee02e5efa365 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] It took 0.24 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 09 04:29:18.159691 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device ed6c5b80-b384-44d8-ba31-14b833a9cdf8 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:29:18.238266 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30c212ed-e626-4834-b38d-0d9d1a39e1be None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:29:18.238666 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30c212ed-e626-4834-b38d-0d9d1a39e1be None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:29:18.239007 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30c212ed-e626-4834-b38d-0d9d1a39e1be None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:29:18.239335 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30c212ed-e626-4834-b38d-0d9d1a39e1be None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:29:18.239657 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30c212ed-e626-4834-b38d-0d9d1a39e1be None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:29:18.239992 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30c212ed-e626-4834-b38d-0d9d1a39e1be None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:29:18.240319 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30c212ed-e626-4834-b38d-0d9d1a39e1be None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:29:18.240677 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30c212ed-e626-4834-b38d-0d9d1a39e1be None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:29:18.241000 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30c212ed-e626-4834-b38d-0d9d1a39e1be None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:29:18.241314 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30c212ed-e626-4834-b38d-0d9d1a39e1be None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:29:18.241627 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30c212ed-e626-4834-b38d-0d9d1a39e1be None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:29:18.241936 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30c212ed-e626-4834-b38d-0d9d1a39e1be None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:29:18.249315 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-5526b21e-3e2c-4500-919d-2e1f8fe2782d None None] Provisioning complete for port ed6c5b80-b384-44d8-ba31-14b833a9cdf8 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:29:18.249685 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5526b21e-3e2c-4500-919d-2e1f8fe2782d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:18.307450 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53474) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:18.315209 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-1d01ffe0-e034-4cd5-9853-d8e0622c1b95 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Request body: {'router': {'name': 'tempest-router--577934901', 'project_id': '65694181c262450cb678bd27de096369'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:18.334968 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 57fb12aa-7af6-48ad-992b-890147f21448 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:29:18.335286 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 57fb12aa-7af6-48ad-992b-890147f21448 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] {{(pid=102161) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:29:18.335628 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 57fb12aa-7af6-48ad-992b-890147f21448 on network c53bac62-4539-4143-874d-1fffa9d5216a {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:29:18.342146 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port ed6c5b80-b384-44d8-ba31-14b833a9cdf8 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:29:18.342557 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:18.378461 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Port 57fb12aa-7af6-48ad-992b-890147f21448 on network c53bac62-4539-4143-874d-1fffa9d5216a not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:29:18.378799 dv-neutron-816802-2-hyperv neutron-server[102161]: ERROR neutron.plugins.ml2.managers [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Failed to bind port 57fb12aa-7af6-48ad-992b-890147f21448 on host hv-neutron-8168 for vnic_type normal using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] Nov 09 04:29:18.390256 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.db.resource_extend [None req-f93c9f02-2f72-4b32-bb67-9377ff7564cd tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] It took 0.11 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 09 04:29:18.393104 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.plugins.ml2.plugin [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempt 9 to bind port 57fb12aa-7af6-48ad-992b-890147f21448 Nov 09 04:29:18.482520 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 57fb12aa-7af6-48ad-992b-890147f21448 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:29:18.482856 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 57fb12aa-7af6-48ad-992b-890147f21448 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] {{(pid=102161) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:29:18.483188 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 57fb12aa-7af6-48ad-992b-890147f21448 on network c53bac62-4539-4143-874d-1fffa9d5216a {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:29:18.515853 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f93c9f02-2f72-4b32-bb67-9377ff7564cd tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:18.519983 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Port 57fb12aa-7af6-48ad-992b-890147f21448 on network c53bac62-4539-4143-874d-1fffa9d5216a not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:29:18.520479 dv-neutron-816802-2-hyperv neutron-server[102161]: ERROR neutron.plugins.ml2.managers [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Failed to bind port 57fb12aa-7af6-48ad-992b-890147f21448 on host hv-neutron-8168 for vnic_type normal using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] Nov 09 04:29:18.522266 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.plugins.ml2.plugin [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempt 10 to bind port 57fb12aa-7af6-48ad-992b-890147f21448 Nov 09 04:29:18.551330 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 57fb12aa-7af6-48ad-992b-890147f21448 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:29:18.551588 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 57fb12aa-7af6-48ad-992b-890147f21448 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] {{(pid=102161) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:29:18.552047 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 57fb12aa-7af6-48ad-992b-890147f21448 on network c53bac62-4539-4143-874d-1fffa9d5216a {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:29:18.562011 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1d01ffe0-e034-4cd5-9853-d8e0622c1b95 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:18.564666 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1d01ffe0-e034-4cd5-9853-d8e0622c1b95 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:18.572641 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.db.api [None req-3baf0370-1c9e-41f6-8df9-fcfba37fcc55 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Nov 09 04:29:18.572641 dv-neutron-816802-2-hyperv neutron-server[102162]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Nov 09 04:29:18.572641 dv-neutron-816802-2-hyperv neutron-server[102162]: [parameters: {'id': '3ba7cbec-5c67-4017-89a4-d38ecdcd019a'}] Nov 09 04:29:18.572641 dv-neutron-816802-2-hyperv neutron-server[102162]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=102162) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:29:18.573877 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG oslo_db.api [None req-3baf0370-1c9e-41f6-8df9-fcfba37fcc55 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:29:18.576330 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-538b2598-bdb7-4b67-9d0e-ee02e5efa365 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:18.584551 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-27a60b2d-324e-437f-b7fe-43d2be324b4e tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-466373'] for router_gateway, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:18.602236 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Port 57fb12aa-7af6-48ad-992b-890147f21448 on network c53bac62-4539-4143-874d-1fffa9d5216a not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:29:18.602834 dv-neutron-816802-2-hyperv neutron-server[102161]: ERROR neutron.plugins.ml2.managers [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Failed to bind port 57fb12aa-7af6-48ad-992b-890147f21448 on host hv-neutron-8168 for vnic_type normal using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] Nov 09 04:29:18.603208 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:18.608118 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f93c9f02-2f72-4b32-bb67-9377ff7564cd tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:18.680030 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-538b2598-bdb7-4b67-9d0e-ee02e5efa365 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:18.746973 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-27a60b2d-324e-437f-b7fe-43d2be324b4e tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:18.750540 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-27a60b2d-324e-437f-b7fe-43d2be324b4e tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:18.804823 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1d01ffe0-e034-4cd5-9853-d8e0622c1b95 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:18.857932 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.l3_db [None req-f93c9f02-2f72-4b32-bb67-9377ff7564cd tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Floating IP b6e50ee2-5399-49fe-a1c4-7571e8730316 associated. External IP: 172.26.0.237, port: 9ce4bb36-a0c7-4517-abaf-8db99ca3bb12. Nov 09 04:29:18.862004 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] For port 57fb12aa-7af6-48ad-992b-890147f21448, host hv-neutron-8168, cleared binding levels {{(pid=102161) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:29:18.862395 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.l3_db [None req-538b2598-bdb7-4b67-9d0e-ee02e5efa365 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Floating IP 00824cf7-be58-475c-a1dc-142d27e3cda6 associated. External IP: 172.26.0.35, port: 49694ee4-edfa-4a08-be0b-8bfa9b06128b. Nov 09 04:29:18.862531 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempted to set empty binding levels {{(pid=102161) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:65}} Nov 09 04:29:18.870079 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1d01ffe0-e034-4cd5-9853-d8e0622c1b95 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:18.908001 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-27a60b2d-324e-437f-b7fe-43d2be324b4e tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:18.908657 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-27a60b2d-324e-437f-b7fe-43d2be324b4e tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Fanout notify agent at l3_agent the message router_deleted on router cd21e659-1094-4653-b570-03e6ed4305e3 {{(pid=102162) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:29:18.916323 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-27a60b2d-324e-437f-b7fe-43d2be324b4e tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:18.917407 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-27a60b2d-324e-437f-b7fe-43d2be324b4e tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] 10.222.0.24 "DELETE /v2.0/routers/cd21e659-1094-4653-b570-03e6ed4305e3 HTTP/1.1" status: 204 len: 168 time: 3.4680972 Nov 09 04:29:18.919943 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53490) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:18.950392 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-98ca8006-31ec-4b92-9e33-f27435752118 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:18.990381 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1d01ffe0-e034-4cd5-9853-d8e0622c1b95 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:18.990381 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1d01ffe0-e034-4cd5-9853-d8e0622c1b95 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 722 time: 0.6774609 Nov 09 04:29:18.990381 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:18.997495 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53494) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:19.043067 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:19.043067 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:19.081768 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-d2dc3d77-f8a4-49da-9b8a-c47853941275 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Deleting subnet 84708fd2-e56f-45d8-a028-d5c7839aba25 {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:29:19.088135 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3baf0370-1c9e-41f6-8df9-fcfba37fcc55 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:19.093962 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d2dc3d77-f8a4-49da-9b8a-c47853941275 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:19.095720 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98ca8006-31ec-4b92-9e33-f27435752118 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Pushing event updated for resources: {'Subnet': ['ID=ee35063e-795f-4ddd-b990-2a7e9018abb7,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:19.102267 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Pushing event updated for resources: {'Port': ['ID=57fb12aa-7af6-48ad-992b-890147f21448,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:19.128147 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53496) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:19.133302 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1c3c8c6f-6dcb-44db-a98f-08c9dea831d8 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks [] for router, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:19.151451 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-23f15ee1-b447-4710-b812-f75ad5d00f74 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 986 time: 3.9843576 Nov 09 04:29:19.154324 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-98ca8006-31ec-4b92-9e33-f27435752118 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Checking segment: {'id': 'a79a3f61-7b94-4db2-b42c-1e9442738b0a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 324, 'network_id': '95c56523-9e9a-4f6f-aa13-0372772dbac5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:29:19.154718 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-98ca8006-31ec-4b92-9e33-f27435752118 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Network hostable DHCP agents. Network: 95c56523-9e9a-4f6f-aa13-0372772dbac5, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:29:19.158049 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53500) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:19.293589 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f93c9f02-2f72-4b32-bb67-9377ff7564cd tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Router c9d2cce0-31ab-42c3-ac82-14e36499c28f has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:29:19.316077 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-a3934ef2-32bc-4e6f-9f28-97296f61e9f7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Deleting port 57fb12aa-7af6-48ad-992b-890147f21448 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:29:19.316703 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a3934ef2-32bc-4e6f-9f28-97296f61e9f7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:19.325704 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-03489682-c49a-47e8-b10c-3726803e9abb tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Request body: {'networks': [{'name': 'tempest-network--124046516'}, {'name': 'tempest-network--1467723604'}]} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:19.326011 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-03489682-c49a-47e8-b10c-3726803e9abb tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Request body: {'network': {'name': 'tempest-network--124046516'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:19.326491 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-03489682-c49a-47e8-b10c-3726803e9abb tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Request body: {'network': {'name': 'tempest-network--1467723604'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:19.358856 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-98ca8006-31ec-4b92-9e33-f27435752118 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Network 95c56523-9e9a-4f6f-aa13-0372772dbac5 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:29:19.361443 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d2dc3d77-f8a4-49da-9b8a-c47853941275 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:19.404885 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8d79650f-e0ef-4eb1-8a45-26082a8e31b8 None None] Network 3ba7cbec-5c67-4017-89a4-d38ecdcd019a requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:29:19.413004 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1c3c8c6f-6dcb-44db-a98f-08c9dea831d8 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:19.417051 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1c3c8c6f-6dcb-44db-a98f-08c9dea831d8 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:19.460747 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-a3934ef2-32bc-4e6f-9f28-97296f61e9f7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] For port 57fb12aa-7af6-48ad-992b-890147f21448, host hv-neutron-8168, got binding levels [] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:29:19.461102 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a3934ef2-32bc-4e6f-9f28-97296f61e9f7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:19.472619 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-98ca8006-31ec-4b92-9e33-f27435752118 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 95c56523-9e9a-4f6f-aa13-0372772dbac5) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:29:19.477028 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-98ca8006-31ec-4b92-9e33-f27435752118 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:19.477879 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-98ca8006-31ec-4b92-9e33-f27435752118 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:19.483591 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-bda84a46-da25-457f-8824-01f6be037238 None None] Provisioning complete for port 74cf499c-8de4-4677-9745-3af1ae2cabba triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:29:19.484195 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-bda84a46-da25-457f-8824-01f6be037238 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:19.494142 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-a3934ef2-32bc-4e6f-9f28-97296f61e9f7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Calling delete_port for 57fb12aa-7af6-48ad-992b-890147f21448 owned by {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:29:19.503924 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2e1a83ab-6ebb-4543-ab76-bb5edba30289 None None] Network 95c56523-9e9a-4f6f-aa13-0372772dbac5 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:29:19.511157 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f93c9f02-2f72-4b32-bb67-9377ff7564cd tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:29:19.515915 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f93c9f02-2f72-4b32-bb67-9377ff7564cd tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:19.530670 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-097d737d-1119-475e-b4d0-2e04467fb2fb None None] Sync routers for ids ['c9d2cce0-31ab-42c3-ac82-14e36499c28f'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:29:19.551006 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-097d737d-1119-475e-b4d0-2e04467fb2fb None None] Routers {'c9d2cce0-31ab-42c3-ac82-14e36499c28f'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:29:19.551952 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-097d737d-1119-475e-b4d0-2e04467fb2fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:29:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['c9d2cce0-31ab-42c3-ac82-14e36499c28f'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:19.593786 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-f93c9f02-2f72-4b32-bb67-9377ff7564cd tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "PUT /v2.0/floatingips/b6e50ee2-5399-49fe-a1c4-7571e8730316 HTTP/1.1" status: 200 len: 991 time: 1.9547560 Nov 09 04:29:19.595390 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fd8e39fc-699b-4777-aae4-ca592a898437', 'tag': '9ce4bb36-a0c7-4517-abaf-8db99ca3bb12'}] {{(pid=102161) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:29:19.597768 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}99dfdda0def497b4372884ef2eb87f06b1e425c8eba5ceda5f64bbab037a07d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-10e56429-b3aa-4af6-8f6a-b04feb282ad6" -d '{"events": [{"name": "network-changed", "server_uuid": "fd8e39fc-699b-4777-aae4-ca592a898437", "tag": "9ce4bb36-a0c7-4517-abaf-8db99ca3bb12"}]}' {{(pid=102161) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:29:19.661982 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-98ca8006-31ec-4b92-9e33-f27435752118 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.3659322 Nov 09 04:29:19.664516 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53506) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:19.668378 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-03489682-c49a-47e8-b10c-3726803e9abb tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Made reservation on behalf of 34508a55938a43c2b57acd8dc368e922 for: {'network': 2} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:29:19.670093 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-c709eed4-173d-4863-a4e2-2307b2cfe813 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Request body: {'router': {'name': 'tempest-FloatingIPNegativeTestJSON-router-986947689', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:19.679875 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-03489682-c49a-47e8-b10c-3726803e9abb tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:19.682511 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1c3c8c6f-6dcb-44db-a98f-08c9dea831d8 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:19.683202 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1c3c8c6f-6dcb-44db-a98f-08c9dea831d8 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Fanout notify agent at l3_agent the message router_deleted on router e2ff07ab-ce3d-4a60-a9d6-c5a1f39e791e {{(pid=102162) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:29:19.706034 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1c3c8c6f-6dcb-44db-a98f-08c9dea831d8 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:19.707280 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-1c3c8c6f-6dcb-44db-a98f-08c9dea831d8 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] 10.222.0.24 "DELETE /v2.0/routers/e2ff07ab-ce3d-4a60-a9d6-c5a1f39e791e HTTP/1.1" status: 204 len: 168 time: 0.7088711 Nov 09 04:29:19.729855 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-3baf0370-1c9e-41f6-8df9-fcfba37fcc55 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Deleting port 74cf499c-8de4-4677-9745-3af1ae2cabba {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:29:19.730304 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3baf0370-1c9e-41f6-8df9-fcfba37fcc55 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:19.734510 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-60d64ec9-028c-452a-bf0e-30098ff4bd85 None None] DHCP port deletion for 3ba7cbec-5c67-4017-89a4-d38ecdcd019a request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:29:19.736230 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-538b2598-bdb7-4b67-9d0e-ee02e5efa365 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Router 23955a4a-3903-49e9-ab99-5e003c83c868 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:29:19.736519 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-bda84a46-da25-457f-8824-01f6be037238 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:19.737255 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-03489682-c49a-47e8-b10c-3726803e9abb tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:19.751304 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:29:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b2f49068-3708-4f76-b4f4-f635036076f4 x-openstack-request-id: req-b2f49068-3708-4f76-b4f4-f635036076f4 {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:29:19.754110 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "fd8e39fc-699b-4777-aae4-ca592a898437", "tag": "9ce4bb36-a0c7-4517-abaf-8db99ca3bb12", "status": "completed", "code": 200}]} {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:29:19.754110 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-b2f49068-3708-4f76-b4f4-f635036076f4 {{(pid=102161) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:29:19.754110 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fd8e39fc-699b-4777-aae4-ca592a898437', 'tag': '9ce4bb36-a0c7-4517-abaf-8db99ca3bb12', 'status': 'completed', 'code': 200} Nov 09 04:29:19.764447 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a3934ef2-32bc-4e6f-9f28-97296f61e9f7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:19.780816 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d2dc3d77-f8a4-49da-9b8a-c47853941275 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:19.811224 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fcd5ecbe-ee68-49ea-9543-678a38ac469f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-95c56523-9e9a-4f6f-aa13-0372772dbac5', 'network_id': '95c56523-9e9a-4f6f-aa13-0372772dbac5', 'tenant_id': '0bad988bbff146edaf9af1fa56d6a513', 'fixed_ips': [{'subnet_id': 'ee35063e-795f-4ddd-b990-2a7e9018abb7'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:29:19.812363 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-fcd5ecbe-ee68-49ea-9543-678a38ac469f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:19.839376 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-bda84a46-da25-457f-8824-01f6be037238 None None] For port 74cf499c-8de4-4677-9745-3af1ae2cabba, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=74cf499c-8de4-4677-9745-3af1ae2cabba,segment=NetworkSegment(dfcc87e7-1051-40c7-88f0-44b13bd9b2d4),segment_id=dfcc87e7-1051-40c7-88f0-44b13bd9b2d4)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:29:19.890107 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c709eed4-173d-4863-a4e2-2307b2cfe813 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:19.900448 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c709eed4-173d-4863-a4e2-2307b2cfe813 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:19.920048 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-097d737d-1119-475e-b4d0-2e04467fb2fb None None] Set router c9d2cce0-31ab-42c3-ac82-14e36499c28f gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:29:19.964101 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c709eed4-173d-4863-a4e2-2307b2cfe813 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:19.968156 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-3baf0370-1c9e-41f6-8df9-fcfba37fcc55 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] For port 74cf499c-8de4-4677-9745-3af1ae2cabba, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=74cf499c-8de4-4677-9745-3af1ae2cabba,segment=NetworkSegment(dfcc87e7-1051-40c7-88f0-44b13bd9b2d4),segment_id=dfcc87e7-1051-40c7-88f0-44b13bd9b2d4)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:29:19.968358 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3934ef2-32bc-4e6f-9f28-97296f61e9f7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Pushing event deleted for resources: {'Port': ['ID=57fb12aa-7af6-48ad-992b-890147f21448,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:19.968535 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3baf0370-1c9e-41f6-8df9-fcfba37fcc55 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:19.979968 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a3934ef2-32bc-4e6f-9f28-97296f61e9f7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:19.985997 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a3934ef2-32bc-4e6f-9f28-97296f61e9f7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] 10.222.0.24 "DELETE /v2.0/ports/57fb12aa-7af6-48ad-992b-890147f21448 HTTP/1.1" status: 204 len: 168 time: 0.8237216 Nov 09 04:29:19.986222 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53512) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:20.004928 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-3baf0370-1c9e-41f6-8df9-fcfba37fcc55 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Calling delete_port for 74cf499c-8de4-4677-9745-3af1ae2cabba owned by network:dhcp {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:29:20.014586 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-724f2f9d-c1b4-4ceb-8f81-7d2a62501a5c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] GET failed (client error): The resource could not be found. Nov 09 04:29:20.015609 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-bda84a46-da25-457f-8824-01f6be037238 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:20.019433 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-724f2f9d-c1b4-4ceb-8f81-7d2a62501a5c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] 10.222.0.24 "GET /v2.0/ports/57fb12aa-7af6-48ad-992b-890147f21448 HTTP/1.1" status: 404 len: 333 time: 0.0289485 Nov 09 04:29:20.019559 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53514) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:20.023412 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-60d64ec9-028c-452a-bf0e-30098ff4bd85 None None] Deleting port 74cf499c-8de4-4677-9745-3af1ae2cabba {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:29:20.027043 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-60d64ec9-028c-452a-bf0e-30098ff4bd85 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:20.027248 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-2f39f7c1-676e-41d5-9f32-2118740bc008 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Request body: {'port': {'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a', 'name': 'tempest-PortsAdminExtendedAttrsIpV6TestJSON-92206435'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:20.035348 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10e56429-b3aa-4af6-8f6a-b04feb282ad6 req-7a0b6f45-1b85-4fd1-b50b-e7684be50a05 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:20.037015 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-10e56429-b3aa-4af6-8f6a-b04feb282ad6 req-7a0b6f45-1b85-4fd1-b50b-e7684be50a05 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=a229c806094b42c7a0f7ed52f78dfd68&device_id=fd8e39fc-699b-4777-aae4-ca592a898437 HTTP/1.1" status: 200 len: 1098 time: 0.2766144 Nov 09 04:29:20.077949 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c709eed4-173d-4863-a4e2-2307b2cfe813 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:20.168206 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2f39f7c1-676e-41d5-9f32-2118740bc008 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Made reservation on behalf of 657652107bc34ca7983289060f1bd8df for: {'port': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:29:20.171022 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2f39f7c1-676e-41d5-9f32-2118740bc008 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:20.188589 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-03489682-c49a-47e8-b10c-3726803e9abb tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:20.191052 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d2dc3d77-f8a4-49da-9b8a-c47853941275 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:20.195038 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10e56429-b3aa-4af6-8f6a-b04feb282ad6 req-d379f5d4-60e6-43f3-a433-9b1b167f15ba service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:20.196948 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-10e56429-b3aa-4af6-8f6a-b04feb282ad6 req-d379f5d4-60e6-43f3-a433-9b1b167f15ba service neutron] 10.222.0.26 "GET /v2.0/networks?id=d4ba3288-221c-40f3-a829-662c462cc93f HTTP/1.1" status: 200 len: 906 time: 0.1512861 Nov 09 04:29:20.199701 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-538b2598-bdb7-4b67-9d0e-ee02e5efa365 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:29:20.201116 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-60d64ec9-028c-452a-bf0e-30098ff4bd85 None None] For port 74cf499c-8de4-4677-9745-3af1ae2cabba, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=74cf499c-8de4-4677-9745-3af1ae2cabba,segment=NetworkSegment(dfcc87e7-1051-40c7-88f0-44b13bd9b2d4),segment_id=dfcc87e7-1051-40c7-88f0-44b13bd9b2d4)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:29:20.201513 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-60d64ec9-028c-452a-bf0e-30098ff4bd85 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:20.211978 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [None req-2f39f7c1-676e-41d5-9f32-2118740bc008 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] device_id is not set on port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 yet. {{(pid=102161) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:29:20.212781 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bda84a46-da25-457f-8824-01f6be037238 None None] Pushing event updated for resources: {'Port': ['ID=74cf499c-8de4-4677-9745-3af1ae2cabba,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:20.226558 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-05578991-3e06-4ade-a441-2215cf3fdd73 None None] Sync routers for ids ['23955a4a-3903-49e9-ab99-5e003c83c868'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:29:20.229114 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-538b2598-bdb7-4b67-9d0e-ee02e5efa365 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:20.242735 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-60d64ec9-028c-452a-bf0e-30098ff4bd85 None None] Calling delete_port for 74cf499c-8de4-4677-9745-3af1ae2cabba owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:29:20.251576 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2dc3d77-f8a4-49da-9b8a-c47853941275 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Pushing event deleted for resources: {'Subnet': ['ID=84708fd2-e56f-45d8-a028-d5c7839aba25,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:20.252538 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-fcd5ecbe-ee68-49ea-9543-678a38ac469f None None] Allocated IP 172.20.0.2 (95c56523-9e9a-4f6f-aa13-0372772dbac5/ee35063e-795f-4ddd-b990-2a7e9018abb7/dd9f29fa-78b7-4375-a0ea-44e827f0c20c) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:29:20.265794 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d2dc3d77-f8a4-49da-9b8a-c47853941275 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:20.271586 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-d2dc3d77-f8a4-49da-9b8a-c47853941275 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] 10.222.0.24 "DELETE /v2.0/subnets/84708fd2-e56f-45d8-a028-d5c7839aba25 HTTP/1.1" status: 204 len: 168 time: 1.3484914 Nov 09 04:29:20.273963 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53516) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:20.278800 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-09fe922c-b808-42ac-ac7e-b20a1461ba60 None None] Network b103fb67-62b2-4eeb-9e21-70ef83ccb4b2 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:29:20.291791 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-538b2598-bdb7-4b67-9d0e-ee02e5efa365 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.24 "PUT /v2.0/floatingips/00824cf7-be58-475c-a1dc-142d27e3cda6 HTTP/1.1" status: 200 len: 990 time: 3.8751605 Nov 09 04:29:20.303404 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-05578991-3e06-4ade-a441-2215cf3fdd73 None None] Routers {'23955a4a-3903-49e9-ab99-5e003c83c868'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:29:20.303527 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1aa3bc74-67df-4706-979b-cbf709855232', 'tag': '49694ee4-edfa-4a08-be0b-8bfa9b06128b'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:29:20.304346 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-05578991-3e06-4ade-a441-2215cf3fdd73 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:29:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['23955a4a-3903-49e9-ab99-5e003c83c868'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:20.306402 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-14ff7058-d2f4-41b3-95b0-17fba10cb8ac" -d '{"events": [{"name": "network-changed", "server_uuid": "1aa3bc74-67df-4706-979b-cbf709855232", "tag": "49694ee4-edfa-4a08-be0b-8bfa9b06128b"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:29:20.356460 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-03489682-c49a-47e8-b10c-3726803e9abb tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:20.356460 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-03489682-c49a-47e8-b10c-3726803e9abb tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:20.363900 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53522) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:20.423660 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:29:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bafe4140-0480-4490-b9e2-a64c4b4b5db7 x-openstack-request-id: req-bafe4140-0480-4490-b9e2-a64c4b4b5db7 {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:29:20.424123 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1aa3bc74-67df-4706-979b-cbf709855232", "tag": "49694ee4-edfa-4a08-be0b-8bfa9b06128b", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:29:20.424373 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-bafe4140-0480-4490-b9e2-a64c4b4b5db7 {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:29:20.424761 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1aa3bc74-67df-4706-979b-cbf709855232', 'tag': '49694ee4-edfa-4a08-be0b-8bfa9b06128b', 'status': 'completed', 'code': 200} Nov 09 04:29:20.446831 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b0af58dd-2e2b-4152-b1d6-2131c628029b tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:20.450541 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03489682-c49a-47e8-b10c-3726803e9abb tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Pushing event updated for resources: {'SecurityGroup': ['ID=2f91204c-9f94-41c3-9c9a-1f236cc8d351,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:20.456247 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3baf0370-1c9e-41f6-8df9-fcfba37fcc55 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:20.470054 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-03489682-c49a-47e8-b10c-3726803e9abb tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 346} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:29:20.483662 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-03489682-c49a-47e8-b10c-3726803e9abb tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:20.484075 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-03489682-c49a-47e8-b10c-3726803e9abb tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Added segment b6a20f70-0b6d-4a27-8530-06e3b12466a3 of type vlan for network 91385f0c-02a9-4e40-9f4a-b83ef001c99d Nov 09 04:29:20.559946 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-03489682-c49a-47e8-b10c-3726803e9abb tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:20.563748 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-097d737d-1119-475e-b4d0-2e04467fb2fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c9d2cce0-31ab-42c3-ac82-14e36499c28f', 'name': 'tempest-ServersTestJSON-828046534-router', 'tenant_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.163'}], 'enable_snat': True}, 'gw_port_id': '0fc8f26d-1642-4025-b21c-de2a4f14043f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:28:17Z', 'updated_at': '2021-11-09T04:28:27Z', 'revision_number': 4, 'project_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'gw_port': {'id': '0fc8f26d-1642-4025-b21c-de2a4f14043f', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:c5:bb:ba', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c9d2cce0-31ab-42c3-ac82-14e36499c28f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.163', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:28:18Z', 'updated_at': '2021-11-09T04:28:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': 'b6e50ee2-5399-49fe-a1c4-7571e8730316', 'tenant_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'floating_ip_address': '172.26.0.237', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': 'c9d2cce0-31ab-42c3-ac82-14e36499c28f', 'port_id': '9ce4bb36-a0c7-4517-abaf-8db99ca3bb12', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 170, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd4ba3288-221c-40f3-a829-662c462cc93f', 'mac_address': 'fa:16:3e:6d:b9:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fd8e39fc-699b-4777-aae4-ca592a898437', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:28:38Z', 'updated_at': '2021-11-09T04:29:18Z', 'revision_number': 1, 'project_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '76f630f8-c464-46b2-b3b3-6a4c815cc2cf', 'name': '', 'network_id': 'd4ba3288-221c-40f3-a829-662c462cc93f', 'tenant_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'mac_address': 'fa:16:3e:71:0f:73', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c9d2cce0-31ab-42c3-ac82-14e36499c28f', 'device_owner': 'network:router_interface', 'standard_attr_id': 107, 'fixed_ips': [{'subnet_id': 'b11be6b4-75f0-4756-9312-de5295f24e1b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:28:25Z', 'updated_at': '2021-11-09T04:28:32Z', 'revision_number': 5, 'project_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'subnets': [{'id': 'b11be6b4-75f0-4756-9312-de5295f24e1b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:20.597420 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-03489682-c49a-47e8-b10c-3726803e9abb tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 342} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:29:20.601915 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-097d737d-1119-475e-b4d0-2e04467fb2fb None None] Checking router: c9d2cce0-31ab-42c3-ac82-14e36499c28f for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:29:20.608323 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-03489682-c49a-47e8-b10c-3726803e9abb tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:20.608695 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-03489682-c49a-47e8-b10c-3726803e9abb tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Added segment 3c48fec3-f764-48af-86df-e09e998040fc of type vlan for network 2da9771b-6fd0-4872-8475-20a7aa84ba6d Nov 09 04:29:20.614612 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-097d737d-1119-475e-b4d0-2e04467fb2fb None None] Routers {'c9d2cce0-31ab-42c3-ac82-14e36499c28f'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:29:20.616135 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-097d737d-1119-475e-b4d0-2e04467fb2fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:29:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['c9d2cce0-31ab-42c3-ac82-14e36499c28f'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:20.619847 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c709eed4-173d-4863-a4e2-2307b2cfe813 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:20.623539 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-c709eed4-173d-4863-a4e2-2307b2cfe813 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 714 time: 0.9555671 Nov 09 04:29:20.652009 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53528) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:20.655919 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-03489682-c49a-47e8-b10c-3726803e9abb tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:20.751745 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-097d737d-1119-475e-b4d0-2e04467fb2fb None None] Set router c9d2cce0-31ab-42c3-ac82-14e36499c28f gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:29:20.788119 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3baf0370-1c9e-41f6-8df9-fcfba37fcc55 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Pushing event deleted for resources: {'Port': ['ID=74cf499c-8de4-4677-9745-3af1ae2cabba,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:20.798719 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-10e56429-b3aa-4af6-8f6a-b04feb282ad6 req-d83222ed-b9f2-41cf-b2a6-3846ae08abd7 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=9ce4bb36-a0c7-4517-abaf-8db99ca3bb12 HTTP/1.1" status: 200 len: 999 time: 0.5793495 Nov 09 04:29:20.799603 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-7ae8e09d-8c06-4fe0-a9b6-b35d79e836ef tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Request body: {'router': {'name': 'tempest-RoutersIpV6AdminTest-router-1417933860', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}, 'admin_state_up': False}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:20.844611 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14ff7058-d2f4-41b3-95b0-17fba10cb8ac req-d9c3d153-e917-4c7e-8824-217582637dbd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:20.848169 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-14ff7058-d2f4-41b3-95b0-17fba10cb8ac req-d9c3d153-e917-4c7e-8824-217582637dbd service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=5f3cd2a3586e46c09f847681f744075c&device_id=1aa3bc74-67df-4706-979b-cbf709855232 HTTP/1.1" status: 200 len: 1098 time: 0.1554358 Nov 09 04:29:20.848941 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-03489682-c49a-47e8-b10c-3726803e9abb tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:20.850137 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-03489682-c49a-47e8-b10c-3726803e9abb tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:20.856774 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-03489682-c49a-47e8-b10c-3726803e9abb tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:20.868736 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-03489682-c49a-47e8-b10c-3726803e9abb tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:20.869705 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-03489682-c49a-47e8-b10c-3726803e9abb tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:20.900889 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-05578991-3e06-4ade-a441-2215cf3fdd73 None None] Set router 23955a4a-3903-49e9-ab99-5e003c83c868 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:29:20.955141 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3baf0370-1c9e-41f6-8df9-fcfba37fcc55 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] No DVR routers for this DVR port 74cf499c-8de4-4677-9745-3af1ae2cabba on host dv-neutron-816802-2-hyperv {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:29:20.961644 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-60d64ec9-028c-452a-bf0e-30098ff4bd85 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:20.977216 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-fcd5ecbe-ee68-49ea-9543-678a38ac469f None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:21.007396 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10e56429-b3aa-4af6-8f6a-b04feb282ad6 req-ffbeba36-34ae-4155-bd64-dcdf9f3e48d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:21.008846 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-10e56429-b3aa-4af6-8f6a-b04feb282ad6 req-ffbeba36-34ae-4155-bd64-dcdf9f3e48d1 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=b11be6b4-75f0-4756-9312-de5295f24e1b HTTP/1.1" status: 200 len: 844 time: 0.1753762 Nov 09 04:29:21.065026 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-fcd5ecbe-ee68-49ea-9543-678a38ac469f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:21.067448 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60d64ec9-028c-452a-bf0e-30098ff4bd85 None None] Pushing event deleted for resources: {'Port': ['ID=74cf499c-8de4-4677-9745-3af1ae2cabba,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:21.107837 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2f39f7c1-676e-41d5-9f32-2118740bc008 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:21.111059 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-60d64ec9-028c-452a-bf0e-30098ff4bd85 None None] No DVR routers for this DVR port 74cf499c-8de4-4677-9745-3af1ae2cabba on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:29:21.120741 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-097d737d-1119-475e-b4d0-2e04467fb2fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c9d2cce0-31ab-42c3-ac82-14e36499c28f', 'name': 'tempest-ServersTestJSON-828046534-router', 'tenant_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.163'}], 'enable_snat': True}, 'gw_port_id': '0fc8f26d-1642-4025-b21c-de2a4f14043f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:28:17Z', 'updated_at': '2021-11-09T04:28:27Z', 'revision_number': 4, 'project_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'gw_port': {'id': '0fc8f26d-1642-4025-b21c-de2a4f14043f', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:c5:bb:ba', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c9d2cce0-31ab-42c3-ac82-14e36499c28f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.163', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:28:18Z', 'updated_at': '2021-11-09T04:28:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': 'b6e50ee2-5399-49fe-a1c4-7571e8730316', 'tenant_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'floating_ip_address': '172.26.0.237', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': 'c9d2cce0-31ab-42c3-ac82-14e36499c28f', 'port_id': '9ce4bb36-a0c7-4517-abaf-8db99ca3bb12', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 170, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd4ba3288-221c-40f3-a829-662c462cc93f', 'mac_address': 'fa:16:3e:6d:b9:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fd8e39fc-699b-4777-aae4-ca592a898437', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:28:38Z', 'updated_at': '2021-11-09T04:29:18Z', 'revision_number': 1, 'project_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '76f630f8-c464-46b2-b3b3-6a4c815cc2cf', 'name': '', 'network_id': 'd4ba3288-221c-40f3-a829-662c462cc93f', 'tenant_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'mac_address': 'fa:16:3e:71:0f:73', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c9d2cce0-31ab-42c3-ac82-14e36499c28f', 'device_owner': 'network:router_interface', 'standard_attr_id': 107, 'fixed_ips': [{'subnet_id': 'b11be6b4-75f0-4756-9312-de5295f24e1b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:28:25Z', 'updated_at': '2021-11-09T04:28:32Z', 'revision_number': 5, 'project_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'subnets': [{'id': 'b11be6b4-75f0-4756-9312-de5295f24e1b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:21.125276 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fcd5ecbe-ee68-49ea-9543-678a38ac469f None None] Pushing event updated for resources: {'Port': ['ID=dd9f29fa-78b7-4375-a0ea-44e827f0c20c,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:21.128922 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cfac8677-60e8-4863-a185-ac4aecde67db None None] DHCP port deletion for b103fb67-62b2-4eeb-9e21-70ef83ccb4b2 request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:29:21.158257 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-097d737d-1119-475e-b4d0-2e04467fb2fb None None] The sync data for ids ['c9d2cce0-31ab-42c3-ac82-14e36499c28f'] in dv-neutron-816802-2-hyperv is: [{'id': 'c9d2cce0-31ab-42c3-ac82-14e36499c28f', 'name': 'tempest-ServersTestJSON-828046534-router', 'tenant_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.163'}], 'enable_snat': True}, 'gw_port_id': '0fc8f26d-1642-4025-b21c-de2a4f14043f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:28:17Z', 'updated_at': '2021-11-09T04:28:27Z', 'revision_number': 4, 'project_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'gw_port': {'id': '0fc8f26d-1642-4025-b21c-de2a4f14043f', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:c5:bb:ba', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c9d2cce0-31ab-42c3-ac82-14e36499c28f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.163', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:28:18Z', 'updated_at': '2021-11-09T04:28:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': 'b6e50ee2-5399-49fe-a1c4-7571e8730316', 'tenant_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'floating_ip_address': '172.26.0.237', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': 'c9d2cce0-31ab-42c3-ac82-14e36499c28f', 'port_id': '9ce4bb36-a0c7-4517-abaf-8db99ca3bb12', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 170, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd4ba3288-221c-40f3-a829-662c462cc93f', 'mac_address': 'fa:16:3e:6d:b9:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fd8e39fc-699b-4777-aae4-ca592a898437', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:28:38Z', 'updated_at': '2021-11-09T04:29:18Z', 'revision_number': 1, 'project_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '76f630f8-c464-46b2-b3b3-6a4c815cc2cf', 'name': '', 'network_id': 'd4ba3288-221c-40f3-a829-662c462cc93f', 'tenant_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'mac_address': 'fa:16:3e:71:0f:73', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c9d2cce0-31ab-42c3-ac82-14e36499c28f', 'device_owner': 'network:router_interface', 'standard_attr_id': 107, 'fixed_ips': [{'subnet_id': 'b11be6b4-75f0-4756-9312-de5295f24e1b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:28:25Z', 'updated_at': '2021-11-09T04:28:32Z', 'revision_number': 5, 'project_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'subnets': [{'id': 'b11be6b4-75f0-4756-9312-de5295f24e1b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:29:21.177735 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10e56429-b3aa-4af6-8f6a-b04feb282ad6 req-15d46305-d0d9-4d50-b279-3491ae9818d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:21.179843 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-10e56429-b3aa-4af6-8f6a-b04feb282ad6 req-15d46305-d0d9-4d50-b279-3491ae9818d5 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=d4ba3288-221c-40f3-a829-662c462cc93f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1254737 Nov 09 04:29:21.191482 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3baf0370-1c9e-41f6-8df9-fcfba37fcc55 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:21.218812 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-3baf0370-1c9e-41f6-8df9-fcfba37fcc55 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3ba7cbec-5c67-4017-89a4-d38ecdcd019a']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:21.231031 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-3baf0370-1c9e-41f6-8df9-fcfba37fcc55 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'dfcc87e7-1051-40c7-88f0-44b13bd9b2d4') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:21.231320 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-3baf0370-1c9e-41f6-8df9-fcfba37fcc55 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'dfcc87e7-1051-40c7-88f0-44b13bd9b2d4') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:21.232982 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bf5284a8-e16e-43c6-a5c0-3d7405462cab tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:21.243258 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3baf0370-1c9e-41f6-8df9-fcfba37fcc55 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:21.260411 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3baf0370-1c9e-41f6-8df9-fcfba37fcc55 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:21.267992 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3baf0370-1c9e-41f6-8df9-fcfba37fcc55 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Releasing vlan 331 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:29:21.268526 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3baf0370-1c9e-41f6-8df9-fcfba37fcc55 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:21.274976 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7ae8e09d-8c06-4fe0-a9b6-b35d79e836ef tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:21.276351 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7ae8e09d-8c06-4fe0-a9b6-b35d79e836ef tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:21.305666 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:29:21.305666 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:29:21.305666 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:29:21.305666 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:29:21.305666 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:29:21.305666 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:29:21.305666 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:29:21.305666 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:29:21.305666 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:29:21.305666 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:29:21.305666 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:29:21.305666 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:29:21.305666 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:29:21.305666 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:29:21.305666 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:29:21.305666 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:29:21.305666 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:29:21.305666 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:29:21.305666 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:29:21.305666 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:29:21.305666 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:29:21.305666 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:29:21.305666 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:29:21.305666 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:29:21.305666 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:29:21.305666 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:29:21.305666 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:29:21.305666 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:29:21.305666 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:29:21.305666 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:29:21.305666 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:29:21.305666 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:29:21.319735 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2f39f7c1-676e-41d5-9f32-2118740bc008 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:21.366292 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fcd5ecbe-ee68-49ea-9543-678a38ac469f None None] Network 95c56523-9e9a-4f6f-aa13-0372772dbac5 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:29:21.420433 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2f39f7c1-676e-41d5-9f32-2118740bc008 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Network c53bac62-4539-4143-874d-1fffa9d5216a is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:29:21.422378 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-2f39f7c1-676e-41d5-9f32-2118740bc008 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:29:21.463042 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-fcd5ecbe-ee68-49ea-9543-678a38ac469f None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:29:21.465466 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fcd5ecbe-ee68-49ea-9543-678a38ac469f None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:29:21.505740 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a09b6b92-330c-4ea7-921a-880ebe35f86b None None] New status for floating IP b6e50ee2-5399-49fe-a1c4-7571e8730316: ACTIVE {{(pid=102164) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 04:29:21.577933 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f39f7c1-676e-41d5-9f32-2118740bc008 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Pushing event updated for resources: {'Port': ['ID=63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:21.582868 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-10e56429-b3aa-4af6-8f6a-b04feb282ad6 req-016b176e-ba6f-499c-b8f4-3104641a671b service neutron] 10.222.0.26 "GET /v2.0/networks/d4ba3288-221c-40f3-a829-662c462cc93f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3930812 Nov 09 04:29:21.583613 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2f39f7c1-676e-41d5-9f32-2118740bc008 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:29:21.584497 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2f39f7c1-676e-41d5-9f32-2118740bc008 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:21.585075 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2f39f7c1-676e-41d5-9f32-2118740bc008 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:21.593958 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-fcd5ecbe-ee68-49ea-9543-678a38ac469f None None] Attempting to bind port dd9f29fa-78b7-4375-a0ea-44e827f0c20c on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:29:21.594441 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-fcd5ecbe-ee68-49ea-9543-678a38ac469f None None] Attempting to bind port dd9f29fa-78b7-4375-a0ea-44e827f0c20c by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'a79a3f61-7b94-4db2-b42c-1e9442738b0a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 324, 'network_id': '95c56523-9e9a-4f6f-aa13-0372772dbac5'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:29:21.594826 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fcd5ecbe-ee68-49ea-9543-678a38ac469f None None] Attempting to bind port dd9f29fa-78b7-4375-a0ea-44e827f0c20c on network 95c56523-9e9a-4f6f-aa13-0372772dbac5 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:29:21.618006 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fcd5ecbe-ee68-49ea-9543-678a38ac469f None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 29, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:29:21.619644 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fcd5ecbe-ee68-49ea-9543-678a38ac469f None None] Checking segment: {'id': 'a79a3f61-7b94-4db2-b42c-1e9442738b0a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 324, 'network_id': '95c56523-9e9a-4f6f-aa13-0372772dbac5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:29:21.620560 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-fcd5ecbe-ee68-49ea-9543-678a38ac469f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:21.621800 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fcd5ecbe-ee68-49ea-9543-678a38ac469f None None] Bound using segment: {'id': 'a79a3f61-7b94-4db2-b42c-1e9442738b0a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 324, 'network_id': '95c56523-9e9a-4f6f-aa13-0372772dbac5'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:29:21.624781 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-fcd5ecbe-ee68-49ea-9543-678a38ac469f None None] Bound port: dd9f29fa-78b7-4375-a0ea-44e827f0c20c, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a79a3f61-7b94-4db2-b42c-1e9442738b0a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 324, 'network_id': '95c56523-9e9a-4f6f-aa13-0372772dbac5'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:29:21.625511 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-fcd5ecbe-ee68-49ea-9543-678a38ac469f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:21.660596 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-cfac8677-60e8-4863-a185-ac4aecde67db None None] Deleting port b5d65479-c9b1-4f1e-b764-d1921b06d257 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:29:21.660968 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-cfac8677-60e8-4863-a185-ac4aecde67db None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:21.727070 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-fcd5ecbe-ee68-49ea-9543-678a38ac469f None None] For port dd9f29fa-78b7-4375-a0ea-44e827f0c20c, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:29:21.728608 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-2f39f7c1-676e-41d5-9f32-2118740bc008 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 962 time: 1.7079198 Nov 09 04:29:21.734190 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53534) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:21.734574 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-fcd5ecbe-ee68-49ea-9543-678a38ac469f None None] For port dd9f29fa-78b7-4375-a0ea-44e827f0c20c, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=dd9f29fa-78b7-4375-a0ea-44e827f0c20c,segment=NetworkSegment(a79a3f61-7b94-4db2-b42c-1e9442738b0a),segment_id=a79a3f61-7b94-4db2-b42c-1e9442738b0a)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:29:21.748462 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Request body: {'port': {'binding:host_id': 'hv-neutron-8168'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:21.763529 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-05578991-3e06-4ade-a441-2215cf3fdd73 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '23955a4a-3903-49e9-ab99-5e003c83c868', 'name': 'tempest-ServersTestManualDisk-509590275-router', 'tenant_id': '5f3cd2a3586e46c09f847681f744075c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.66'}], 'enable_snat': True}, 'gw_port_id': 'a31e46ce-e371-4177-a2d5-f9a3681f192b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:28:17Z', 'updated_at': '2021-11-09T04:28:28Z', 'revision_number': 4, 'project_id': '5f3cd2a3586e46c09f847681f744075c', 'gw_port': {'id': 'a31e46ce-e371-4177-a2d5-f9a3681f192b', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:d3:1e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '23955a4a-3903-49e9-ab99-5e003c83c868', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:28:19Z', 'updated_at': '2021-11-09T04:28:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '00824cf7-be58-475c-a1dc-142d27e3cda6', 'tenant_id': '5f3cd2a3586e46c09f847681f744075c', 'floating_ip_address': '172.26.0.35', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '23955a4a-3903-49e9-ab99-5e003c83c868', 'port_id': '49694ee4-edfa-4a08-be0b-8bfa9b06128b', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 174, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '468b2f91-119a-402c-b695-5d7963ec6348', 'mac_address': 'fa:16:3e:2d:8b:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1aa3bc74-67df-4706-979b-cbf709855232', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:28:39Z', 'updated_at': '2021-11-09T04:29:17Z', 'revision_number': 1, 'project_id': '5f3cd2a3586e46c09f847681f744075c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6e983a96-52c7-4df1-885b-dc7cdba4b08e', 'name': '', 'network_id': '468b2f91-119a-402c-b695-5d7963ec6348', 'tenant_id': '5f3cd2a3586e46c09f847681f744075c', 'mac_address': 'fa:16:3e:3c:66:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '23955a4a-3903-49e9-ab99-5e003c83c868', 'device_owner': 'network:router_interface', 'standard_attr_id': 127, 'fixed_ips': [{'subnet_id': 'a3d93294-0484-46fa-b8a6-204ec86c9c5f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:28:27Z', 'updated_at': '2021-11-09T04:28:36Z', 'revision_number': 5, 'project_id': '5f3cd2a3586e46c09f847681f744075c', 'subnets': [{'id': 'a3d93294-0484-46fa-b8a6-204ec86c9c5f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:21.795184 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-05578991-3e06-4ade-a441-2215cf3fdd73 None None] Checking router: 23955a4a-3903-49e9-ab99-5e003c83c868 for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:29:21.805829 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-bf5284a8-e16e-43c6-a5c0-3d7405462cab tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Allocated IP 172.20.0.1 (95c56523-9e9a-4f6f-aa13-0372772dbac5/ee35063e-795f-4ddd-b990-2a7e9018abb7/36e7de16-92d8-46d7-9c75-4b0f8046b5ff) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:29:21.827847 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:21.832578 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03489682-c49a-47e8-b10c-3726803e9abb tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Pushing event updated for resources: {'Network': ['ID=91385f0c-02a9-4e40-9f4a-b83ef001c99d,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:21.841566 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-05578991-3e06-4ade-a441-2215cf3fdd73 None None] Routers {'23955a4a-3903-49e9-ab99-5e003c83c868'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:29:21.842128 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-05578991-3e06-4ade-a441-2215cf3fdd73 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:29:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['23955a4a-3903-49e9-ab99-5e003c83c868'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:21.842948 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7ae8e09d-8c06-4fe0-a9b6-b35d79e836ef tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:21.856360 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-cfac8677-60e8-4863-a185-ac4aecde67db None None] For port b5d65479-c9b1-4f1e-b764-d1921b06d257, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=b5d65479-c9b1-4f1e-b764-d1921b06d257,segment=NetworkSegment(9bba1879-429a-4e85-9da5-469e1c46a5ba),segment_id=9bba1879-429a-4e85-9da5-469e1c46a5ba)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:29:21.856360 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-cfac8677-60e8-4863-a185-ac4aecde67db None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:21.856652 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-03489682-c49a-47e8-b10c-3726803e9abb tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 1319 time: 2.7168920 Nov 09 04:29:21.856747 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-fcd5ecbe-ee68-49ea-9543-678a38ac469f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:21.856843 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53536) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:21.928706 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3baf0370-1c9e-41f6-8df9-fcfba37fcc55 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:21.947577 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fcd5ecbe-ee68-49ea-9543-678a38ac469f None None] Pushing event updated for resources: {'Port': ['ID=dd9f29fa-78b7-4375-a0ea-44e827f0c20c,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:21.949962 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 91385f0c-02a9-4e40-9f4a-b83ef001c99d details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:29:21.961130 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3baf0370-1c9e-41f6-8df9-fcfba37fcc55 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:21.966929 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-3baf0370-1c9e-41f6-8df9-fcfba37fcc55 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "DELETE /v2.0/networks/3ba7cbec-5c67-4017-89a4-d38ecdcd019a HTTP/1.1" status: 204 len: 168 time: 6.1789742 Nov 09 04:29:21.973063 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03489682-c49a-47e8-b10c-3726803e9abb tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Pushing event updated for resources: {'Network': ['ID=2da9771b-6fd0-4872-8475-20a7aa84ba6d,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:21.979836 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-abffe00c-31fd-469e-a415-0e832ace91ce tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:21.980144 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-cfac8677-60e8-4863-a185-ac4aecde67db None None] Calling delete_port for b5d65479-c9b1-4f1e-b764-d1921b06d257 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:29:21.983862 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53538) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:21.986149 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-abffe00c-31fd-469e-a415-0e832ace91ce tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:21.993357 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-abffe00c-31fd-469e-a415-0e832ace91ce tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:22.001108 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-abffe00c-31fd-469e-a415-0e832ace91ce tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:22.003183 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-abffe00c-31fd-469e-a415-0e832ace91ce tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] 10.222.0.24 "GET /v2.0/networks HTTP/1.1" status: 200 len: 2406 time: 0.1458318 Nov 09 04:29:22.004431 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 2da9771b-6fd0-4872-8475-20a7aa84ba6d details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:29:22.005378 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-f8fb8ebb-cb6b-4717-966c-b1b435d61b66 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-23126322'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:22.009115 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-10e56429-b3aa-4af6-8f6a-b04feb282ad6 req-140c8419-d767-42c8-8417-7a2f9960cf00 service neutron] 10.222.0.26 "GET /v2.0/networks/d4ba3288-221c-40f3-a829-662c462cc93f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4032948 Nov 09 04:29:22.009719 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53540) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:22.123038 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device b5d65479-c9b1-4f1e-b764-d1921b06d257 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:29:22.141340 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-747557fc-64f1-4ed0-952e-f26659ca9f0a tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:22.153116 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3baf0370-1c9e-41f6-8df9-fcfba37fcc55 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Pushing event deleted for resources: {'Network': ['ID=3ba7cbec-5c67-4017-89a4-d38ecdcd019a,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:22.167211 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-b0af58dd-2e2b-4152-b1d6-2131c628029b tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Deleting port b5d65479-c9b1-4f1e-b764-d1921b06d257 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:29:22.168017 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b0af58dd-2e2b-4152-b1d6-2131c628029b tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:22.187999 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14ff7058-d2f4-41b3-95b0-17fba10cb8ac req-ccc8cc91-80e0-464c-b993-4591530b99e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:22.189743 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-14ff7058-d2f4-41b3-95b0-17fba10cb8ac req-ccc8cc91-80e0-464c-b993-4591530b99e4 service neutron] 10.222.0.26 "GET /v2.0/networks?id=468b2f91-119a-402c-b695-5d7963ec6348 HTTP/1.1" status: 200 len: 912 time: 1.3122792 Nov 09 04:29:22.336816 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:22.354580 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-05578991-3e06-4ade-a441-2215cf3fdd73 None None] Set router 23955a4a-3903-49e9-ab99-5e003c83c868 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:29:22.364819 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-747557fc-64f1-4ed0-952e-f26659ca9f0a tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:22.429073 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-b0af58dd-2e2b-4152-b1d6-2131c628029b tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] For port b5d65479-c9b1-4f1e-b764-d1921b06d257, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=b5d65479-c9b1-4f1e-b764-d1921b06d257,segment=NetworkSegment(9bba1879-429a-4e85-9da5-469e1c46a5ba),segment_id=9bba1879-429a-4e85-9da5-469e1c46a5ba)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:29:22.429927 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b0af58dd-2e2b-4152-b1d6-2131c628029b tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:22.433617 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bf5284a8-e16e-43c6-a5c0-3d7405462cab tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:22.436134 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-747557fc-64f1-4ed0-952e-f26659ca9f0a tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['91385f0c-02a9-4e40-9f4a-b83ef001c99d']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:22.455968 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-b0af58dd-2e2b-4152-b1d6-2131c628029b tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Calling delete_port for b5d65479-c9b1-4f1e-b764-d1921b06d257 owned by network:dhcp {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:29:22.462348 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-747557fc-64f1-4ed0-952e-f26659ca9f0a tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b6a20f70-0b6d-4a27-8530-06e3b12466a3') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:22.462792 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-747557fc-64f1-4ed0-952e-f26659ca9f0a tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b6a20f70-0b6d-4a27-8530-06e3b12466a3') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:22.467644 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-14ff7058-d2f4-41b3-95b0-17fba10cb8ac req-438d6bd2-3d73-4059-a110-3cc9fb2066e6 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=49694ee4-edfa-4a08-be0b-8bfa9b06128b HTTP/1.1" status: 200 len: 998 time: 0.2598913 Nov 09 04:29:22.484367 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-747557fc-64f1-4ed0-952e-f26659ca9f0a tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:22.508580 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-cfac8677-60e8-4863-a185-ac4aecde67db None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:22.524136 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-747557fc-64f1-4ed0-952e-f26659ca9f0a tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:22.524374 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cfac8677-60e8-4863-a185-ac4aecde67db None None] No DVR routers for this DVR port b5d65479-c9b1-4f1e-b764-d1921b06d257 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:29:22.549645 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-747557fc-64f1-4ed0-952e-f26659ca9f0a tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Releasing vlan 346 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:29:22.550050 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-747557fc-64f1-4ed0-952e-f26659ca9f0a tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:22.553773 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:29:22.553773 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:29:22.553773 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:29:22.553773 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:29:22.553773 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:29:22.553773 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:29:22.553773 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:29:22.553773 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:29:22.553773 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:29:22.553773 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:29:22.553773 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:29:22.553773 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:29:22.553773 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:29:22.553773 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:29:22.553773 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:29:22.553773 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:29:22.553773 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:29:22.553773 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:29:22.553773 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:29:22.553773 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:29:22.553773 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:29:22.553773 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:29:22.553773 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:29:22.553773 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:29:22.553773 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:29:22.553773 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:29:22.553773 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:29:22.553773 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:29:22.553773 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:29:22.553773 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:29:22.553773 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:29:22.553773 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:29:22.561697 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cfac8677-60e8-4863-a185-ac4aecde67db None None] Pushing event deleted for resources: {'Port': ['ID=b5d65479-c9b1-4f1e-b764-d1921b06d257,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:22.609021 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f8fb8ebb-cb6b-4717-966c-b1b435d61b66 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Made reservation on behalf of 83cbb798c0f44b268f8acd2a70eb745a for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:29:22.612578 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f8fb8ebb-cb6b-4717-966c-b1b435d61b66 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:22.632580 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7ae8e09d-8c06-4fe0-a9b6-b35d79e836ef tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:22.635235 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bf5284a8-e16e-43c6-a5c0-3d7405462cab tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:22.638398 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] device_id is not set on port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 yet. {{(pid=102161) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:29:22.653578 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:22.688449 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bf5284a8-e16e-43c6-a5c0-3d7405462cab tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Network 95c56523-9e9a-4f6f-aa13-0372772dbac5 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:29:22.691600 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-bf5284a8-e16e-43c6-a5c0-3d7405462cab tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:29:22.694133 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bf5284a8-e16e-43c6-a5c0-3d7405462cab tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:29:22.708402 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f8fb8ebb-cb6b-4717-966c-b1b435d61b66 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 300} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:29:22.711467 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14ff7058-d2f4-41b3-95b0-17fba10cb8ac req-2d51448c-c3cf-4ba4-9b9d-46df060c65ce service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:22.713623 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-14ff7058-d2f4-41b3-95b0-17fba10cb8ac req-2d51448c-c3cf-4ba4-9b9d-46df060c65ce service neutron] 10.222.0.26 "GET /v2.0/subnets?id=a3d93294-0484-46fa-b8a6-204ec86c9c5f HTTP/1.1" status: 200 len: 850 time: 0.2070673 Nov 09 04:29:22.732432 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf5284a8-e16e-43c6-a5c0-3d7405462cab tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Pushing event updated for resources: {'Port': ['ID=36e7de16-92d8-46d7-9c75-4b0f8046b5ff,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:22.742211 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-747557fc-64f1-4ed0-952e-f26659ca9f0a tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:22.743009 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-747557fc-64f1-4ed0-952e-f26659ca9f0a tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:22.748851 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-747557fc-64f1-4ed0-952e-f26659ca9f0a tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] 10.222.0.24 "DELETE /v2.0/networks/91385f0c-02a9-4e40-9f4a-b83ef001c99d HTTP/1.1" status: 204 len: 168 time: 0.7109692 Nov 09 04:29:22.754401 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53546) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:22.771208 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-05578991-3e06-4ade-a441-2215cf3fdd73 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '23955a4a-3903-49e9-ab99-5e003c83c868', 'name': 'tempest-ServersTestManualDisk-509590275-router', 'tenant_id': '5f3cd2a3586e46c09f847681f744075c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.66'}], 'enable_snat': True}, 'gw_port_id': 'a31e46ce-e371-4177-a2d5-f9a3681f192b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:28:17Z', 'updated_at': '2021-11-09T04:28:28Z', 'revision_number': 4, 'project_id': '5f3cd2a3586e46c09f847681f744075c', 'gw_port': {'id': 'a31e46ce-e371-4177-a2d5-f9a3681f192b', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:d3:1e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '23955a4a-3903-49e9-ab99-5e003c83c868', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:28:19Z', 'updated_at': '2021-11-09T04:28:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '00824cf7-be58-475c-a1dc-142d27e3cda6', 'tenant_id': '5f3cd2a3586e46c09f847681f744075c', 'floating_ip_address': '172.26.0.35', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '23955a4a-3903-49e9-ab99-5e003c83c868', 'port_id': '49694ee4-edfa-4a08-be0b-8bfa9b06128b', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 174, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '468b2f91-119a-402c-b695-5d7963ec6348', 'mac_address': 'fa:16:3e:2d:8b:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1aa3bc74-67df-4706-979b-cbf709855232', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:28:39Z', 'updated_at': '2021-11-09T04:29:17Z', 'revision_number': 1, 'project_id': '5f3cd2a3586e46c09f847681f744075c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6e983a96-52c7-4df1-885b-dc7cdba4b08e', 'name': '', 'network_id': '468b2f91-119a-402c-b695-5d7963ec6348', 'tenant_id': '5f3cd2a3586e46c09f847681f744075c', 'mac_address': 'fa:16:3e:3c:66:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '23955a4a-3903-49e9-ab99-5e003c83c868', 'device_owner': 'network:router_interface', 'standard_attr_id': 127, 'fixed_ips': [{'subnet_id': 'a3d93294-0484-46fa-b8a6-204ec86c9c5f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:28:27Z', 'updated_at': '2021-11-09T04:28:36Z', 'revision_number': 5, 'project_id': '5f3cd2a3586e46c09f847681f744075c', 'subnets': [{'id': 'a3d93294-0484-46fa-b8a6-204ec86c9c5f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:22.779901 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f8fb8ebb-cb6b-4717-966c-b1b435d61b66 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:22.780246 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-f8fb8ebb-cb6b-4717-966c-b1b435d61b66 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Added segment 390f9f13-b28d-47b2-8cd2-9f274969fa64 of type vlan for network 807848a2-a4f3-4a57-9607-825f2f20d042 Nov 09 04:29:22.782188 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:22.807083 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-05578991-3e06-4ade-a441-2215cf3fdd73 None None] The sync data for ids ['23955a4a-3903-49e9-ab99-5e003c83c868'] in dv-neutron-816802-2-hyperv is: [{'id': '23955a4a-3903-49e9-ab99-5e003c83c868', 'name': 'tempest-ServersTestManualDisk-509590275-router', 'tenant_id': '5f3cd2a3586e46c09f847681f744075c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.66'}], 'enable_snat': True}, 'gw_port_id': 'a31e46ce-e371-4177-a2d5-f9a3681f192b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:28:17Z', 'updated_at': '2021-11-09T04:28:28Z', 'revision_number': 4, 'project_id': '5f3cd2a3586e46c09f847681f744075c', 'gw_port': {'id': 'a31e46ce-e371-4177-a2d5-f9a3681f192b', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:d3:1e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '23955a4a-3903-49e9-ab99-5e003c83c868', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:28:19Z', 'updated_at': '2021-11-09T04:28:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '00824cf7-be58-475c-a1dc-142d27e3cda6', 'tenant_id': '5f3cd2a3586e46c09f847681f744075c', 'floating_ip_address': '172.26.0.35', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '23955a4a-3903-49e9-ab99-5e003c83c868', 'port_id': '49694ee4-edfa-4a08-be0b-8bfa9b06128b', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 174, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '468b2f91-119a-402c-b695-5d7963ec6348', 'mac_address': 'fa:16:3e:2d:8b:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1aa3bc74-67df-4706-979b-cbf709855232', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:28:39Z', 'updated_at': '2021-11-09T04:29:17Z', 'revision_number': 1, 'project_id': '5f3cd2a3586e46c09f847681f744075c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6e983a96-52c7-4df1-885b-dc7cdba4b08e', 'name': '', 'network_id': '468b2f91-119a-402c-b695-5d7963ec6348', 'tenant_id': '5f3cd2a3586e46c09f847681f744075c', 'mac_address': 'fa:16:3e:3c:66:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '23955a4a-3903-49e9-ab99-5e003c83c868', 'device_owner': 'network:router_interface', 'standard_attr_id': 127, 'fixed_ips': [{'subnet_id': 'a3d93294-0484-46fa-b8a6-204ec86c9c5f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:28:27Z', 'updated_at': '2021-11-09T04:28:36Z', 'revision_number': 5, 'project_id': '5f3cd2a3586e46c09f847681f744075c', 'subnets': [{'id': 'a3d93294-0484-46fa-b8a6-204ec86c9c5f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:29:22.814232 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-747557fc-64f1-4ed0-952e-f26659ca9f0a tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Pushing event deleted for resources: {'Network': ['ID=91385f0c-02a9-4e40-9f4a-b83ef001c99d,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:22.821657 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bf5284a8-e16e-43c6-a5c0-3d7405462cab tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:22.870810 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b0af58dd-2e2b-4152-b1d6-2131c628029b tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:22.878563 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f8fb8ebb-cb6b-4717-966c-b1b435d61b66 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:22.897463 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-29d72bea-266d-444b-a569-cda1c2c6f3fc tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:22.915012 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0af58dd-2e2b-4152-b1d6-2131c628029b tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Pushing event deleted for resources: {'Port': ['ID=b5d65479-c9b1-4f1e-b764-d1921b06d257,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:22.919190 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14ff7058-d2f4-41b3-95b0-17fba10cb8ac req-33b73110-51e7-4505-847f-cf581e2e8529 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:22.920795 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-14ff7058-d2f4-41b3-95b0-17fba10cb8ac req-33b73110-51e7-4505-847f-cf581e2e8529 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=468b2f91-119a-402c-b695-5d7963ec6348&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1997571 Nov 09 04:29:22.921656 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b0af58dd-2e2b-4152-b1d6-2131c628029b tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] No DVR routers for this DVR port b5d65479-c9b1-4f1e-b764-d1921b06d257 on host dv-neutron-816802-2-hyperv {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:29:22.992482 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Pushing event updated for resources: {'Port': ['ID=63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:23.044150 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:29:23.044636 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] {{(pid=102161) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:29:23.045123 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 on network c53bac62-4539-4143-874d-1fffa9d5216a {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:29:23.056601 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 on network c53bac62-4539-4143-874d-1fffa9d5216a not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:29:23.056989 dv-neutron-816802-2-hyperv neutron-server[102161]: ERROR neutron.plugins.ml2.managers [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Failed to bind port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 on host hv-neutron-8168 for vnic_type normal using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] Nov 09 04:29:23.066914 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f8fb8ebb-cb6b-4717-966c-b1b435d61b66 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:23.067162 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.plugins.ml2.plugin [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempt 2 to bind port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 Nov 09 04:29:23.072530 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f8fb8ebb-cb6b-4717-966c-b1b435d61b66 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:23.073147 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f8fb8ebb-cb6b-4717-966c-b1b435d61b66 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:23.119810 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:29:23.120144 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] {{(pid=102161) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:29:23.120482 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 on network c53bac62-4539-4143-874d-1fffa9d5216a {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:29:23.126229 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-29d72bea-266d-444b-a569-cda1c2c6f3fc tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:23.134446 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b0af58dd-2e2b-4152-b1d6-2131c628029b tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:23.134785 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 on network c53bac62-4539-4143-874d-1fffa9d5216a not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:29:23.135117 dv-neutron-816802-2-hyperv neutron-server[102161]: ERROR neutron.plugins.ml2.managers [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Failed to bind port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 on host hv-neutron-8168 for vnic_type normal using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] Nov 09 04:29:23.137120 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.plugins.ml2.plugin [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempt 3 to bind port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 Nov 09 04:29:23.179154 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-29d72bea-266d-444b-a569-cda1c2c6f3fc tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2da9771b-6fd0-4872-8475-20a7aa84ba6d']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:23.181575 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:29:23.181906 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] {{(pid=102161) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:29:23.182238 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 on network c53bac62-4539-4143-874d-1fffa9d5216a {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:29:23.195723 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 on network c53bac62-4539-4143-874d-1fffa9d5216a not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:29:23.196051 dv-neutron-816802-2-hyperv neutron-server[102161]: ERROR neutron.plugins.ml2.managers [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Failed to bind port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 on host hv-neutron-8168 for vnic_type normal using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] Nov 09 04:29:23.197660 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-29d72bea-266d-444b-a569-cda1c2c6f3fc tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3c48fec3-f764-48af-86df-e09e998040fc') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:23.197958 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-29d72bea-266d-444b-a569-cda1c2c6f3fc tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3c48fec3-f764-48af-86df-e09e998040fc') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:23.201836 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.plugins.ml2.plugin [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempt 4 to bind port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 Nov 09 04:29:23.206705 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-b0af58dd-2e2b-4152-b1d6-2131c628029b tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b103fb67-62b2-4eeb-9e21-70ef83ccb4b2']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:23.218345 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-f8fb8ebb-cb6b-4717-966c-b1b435d61b66 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 782 time: 1.2176144 Nov 09 04:29:23.221284 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:29:23.221616 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] {{(pid=102161) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:29:23.221952 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 on network c53bac62-4539-4143-874d-1fffa9d5216a {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:29:23.228390 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53548) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:23.233288 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-532e14e4-c232-457b-b926-6d06f7505d70 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Request body: {'subnet': {'network_id': '807848a2-a4f3-4a57-9607-825f2f20d042', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::2'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:23.237952 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-29d72bea-266d-444b-a569-cda1c2c6f3fc tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:23.247493 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bf5284a8-e16e-43c6-a5c0-3d7405462cab tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:23.269123 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-b0af58dd-2e2b-4152-b1d6-2131c628029b tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9bba1879-429a-4e85-9da5-469e1c46a5ba') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:23.269421 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-b0af58dd-2e2b-4152-b1d6-2131c628029b tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9bba1879-429a-4e85-9da5-469e1c46a5ba') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:23.271289 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8fb8ebb-cb6b-4717-966c-b1b435d61b66 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Pushing event updated for resources: {'Network': ['ID=807848a2-a4f3-4a57-9607-825f2f20d042,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:23.278927 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 on network c53bac62-4539-4143-874d-1fffa9d5216a not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:29:23.279261 dv-neutron-816802-2-hyperv neutron-server[102161]: ERROR neutron.plugins.ml2.managers [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Failed to bind port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 on host hv-neutron-8168 for vnic_type normal using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] Nov 09 04:29:23.285598 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.plugins.ml2.plugin [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempt 5 to bind port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 Nov 09 04:29:23.288795 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 807848a2-a4f3-4a57-9607-825f2f20d042 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:29:23.313865 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b0af58dd-2e2b-4152-b1d6-2131c628029b tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:23.327427 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-14ff7058-d2f4-41b3-95b0-17fba10cb8ac req-8f3f80e1-93cb-497c-a64f-d0e16766e076 service neutron] 10.222.0.26 "GET /v2.0/networks/468b2f91-119a-402c-b695-5d7963ec6348?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3681180 Nov 09 04:29:23.331245 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-29d72bea-266d-444b-a569-cda1c2c6f3fc tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:23.337532 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b0af58dd-2e2b-4152-b1d6-2131c628029b tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:23.381947 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3178288f-a26b-4fb7-9e08-7c27f0b34755 None None] Network 95c56523-9e9a-4f6f-aa13-0372772dbac5 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:29:23.385061 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b0af58dd-2e2b-4152-b1d6-2131c628029b tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Releasing vlan 327 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:29:23.385477 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b0af58dd-2e2b-4152-b1d6-2131c628029b tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:23.394583 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bb389f82-0d8f-400b-b4db-79d20c6c7ccb None None] New status for floating IP 00824cf7-be58-475c-a1dc-142d27e3cda6: ACTIVE {{(pid=102163) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 04:29:23.394970 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-29d72bea-266d-444b-a569-cda1c2c6f3fc tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Releasing vlan 342 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:29:23.395622 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-29d72bea-266d-444b-a569-cda1c2c6f3fc tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:23.399359 dv-neutron-816802-2-hyperv neutron-server[102162]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:29:23.399359 dv-neutron-816802-2-hyperv neutron-server[102162]: self.session.flush() Nov 09 04:29:23.399359 dv-neutron-816802-2-hyperv neutron-server[102162]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:29:23.399359 dv-neutron-816802-2-hyperv neutron-server[102162]: self.session.flush() Nov 09 04:29:23.399359 dv-neutron-816802-2-hyperv neutron-server[102162]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:29:23.399359 dv-neutron-816802-2-hyperv neutron-server[102162]: self.session.flush() Nov 09 04:29:23.399359 dv-neutron-816802-2-hyperv neutron-server[102162]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:29:23.399359 dv-neutron-816802-2-hyperv neutron-server[102162]: self.session.flush() Nov 09 04:29:23.399359 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:29:23.399359 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:29:23.399359 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:29:23.399359 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:29:23.399359 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:29:23.399359 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:29:23.399359 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:29:23.399359 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:29:23.399359 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:29:23.399359 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:29:23.399359 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:29:23.399359 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:29:23.399359 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:29:23.399359 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:29:23.399359 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:29:23.399359 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:29:23.399359 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:29:23.399359 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:29:23.399359 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:29:23.399359 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:29:23.399359 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:29:23.399359 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:29:23.399359 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:29:23.399359 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:29:23.399359 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:29:23.399359 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:29:23.399359 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:29:23.399359 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:29:23.399359 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:29:23.399359 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:29:23.399359 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:29:23.399359 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:29:23.401591 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:29:23.401591 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:29:23.401591 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:29:23.401591 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:29:23.401591 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:29:23.401591 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:29:23.401591 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:29:23.401591 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:29:23.401591 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:29:23.401591 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:29:23.401591 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:29:23.401591 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:29:23.401591 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:29:23.401591 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:29:23.401591 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:29:23.401591 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:29:23.401591 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:29:23.401591 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:29:23.401591 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:29:23.401591 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:29:23.401591 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:29:23.401591 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:29:23.401591 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:29:23.401591 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:29:23.401591 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:29:23.401591 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:29:23.401591 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:29:23.401591 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:29:23.401591 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:29:23.401591 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:29:23.401591 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:29:23.401591 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:29:23.405667 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:29:23.405667 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] {{(pid=102161) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:29:23.405667 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 on network c53bac62-4539-4143-874d-1fffa9d5216a {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:29:23.439114 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 on network c53bac62-4539-4143-874d-1fffa9d5216a not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:29:23.439463 dv-neutron-816802-2-hyperv neutron-server[102161]: ERROR neutron.plugins.ml2.managers [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Failed to bind port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 on host hv-neutron-8168 for vnic_type normal using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] Nov 09 04:29:23.472130 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.plugins.ml2.plugin [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempt 6 to bind port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 Nov 09 04:29:23.591683 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7ae8e09d-8c06-4fe0-a9b6-b35d79e836ef tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks [] for router_gateway, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:23.614886 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-14ff7058-d2f4-41b3-95b0-17fba10cb8ac req-d140b647-44e6-49d1-824f-4b81486a2a79 service neutron] 10.222.0.26 "GET /v2.0/networks/468b2f91-119a-402c-b695-5d7963ec6348?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2748926 Nov 09 04:29:23.616939 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7ae8e09d-8c06-4fe0-a9b6-b35d79e836ef tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:23.620387 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b0af58dd-2e2b-4152-b1d6-2131c628029b tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:23.634716 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b0af58dd-2e2b-4152-b1d6-2131c628029b tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:23.641034 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-b0af58dd-2e2b-4152-b1d6-2131c628029b tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] 10.222.0.24 "DELETE /v2.0/networks/b103fb67-62b2-4eeb-9e21-70ef83ccb4b2 HTTP/1.1" status: 204 len: 168 time: 3.3658116 Nov 09 04:29:23.641686 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53552) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:23.687425 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0af58dd-2e2b-4152-b1d6-2131c628029b tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Pushing event deleted for resources: {'Network': ['ID=b103fb67-62b2-4eeb-9e21-70ef83ccb4b2,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:23.743149 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-ea989695-5ec5-414f-b8d5-564d3b5d6317 None None] Provisioning complete for port dd9f29fa-78b7-4375-a0ea-44e827f0c20c triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:29:23.743504 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ea989695-5ec5-414f-b8d5-564d3b5d6317 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:23.854869 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-7ae8e09d-8c06-4fe0-a9b6-b35d79e836ef tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Allocated IP 172.26.0.18 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/5f1b04f2-2d14-4367-835c-2c41b3bf4c8b) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:29:23.890718 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:29:23.891165 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] {{(pid=102161) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:29:23.891165 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 on network c53bac62-4539-4143-874d-1fffa9d5216a {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:29:23.902621 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 on network c53bac62-4539-4143-874d-1fffa9d5216a not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:29:23.902940 dv-neutron-816802-2-hyperv neutron-server[102161]: ERROR neutron.plugins.ml2.managers [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Failed to bind port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 on host hv-neutron-8168 for vnic_type normal using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] Nov 09 04:29:23.904980 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.plugins.ml2.plugin [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempt 7 to bind port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 Nov 09 04:29:23.913690 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-63c22075-3e6b-45e4-af2b-18647f05cb87 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Deleting port 4151881c-46eb-4bc9-ab1d-9d251cecb700 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:29:23.914224 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-63c22075-3e6b-45e4-af2b-18647f05cb87 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:23.929575 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:29:23.930068 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] {{(pid=102161) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:29:23.930470 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 on network c53bac62-4539-4143-874d-1fffa9d5216a {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:29:23.941850 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 on network c53bac62-4539-4143-874d-1fffa9d5216a not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:29:23.942255 dv-neutron-816802-2-hyperv neutron-server[102161]: ERROR neutron.plugins.ml2.managers [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Failed to bind port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 on host hv-neutron-8168 for vnic_type normal using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] Nov 09 04:29:23.957503 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.plugins.ml2.plugin [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempt 8 to bind port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 Nov 09 04:29:23.993375 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ea989695-5ec5-414f-b8d5-564d3b5d6317 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:24.009426 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:29:24.009629 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] {{(pid=102161) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:29:24.010664 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 on network c53bac62-4539-4143-874d-1fffa9d5216a {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:29:24.018024 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 on network c53bac62-4539-4143-874d-1fffa9d5216a not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:29:24.018458 dv-neutron-816802-2-hyperv neutron-server[102161]: ERROR neutron.plugins.ml2.managers [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Failed to bind port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 on host hv-neutron-8168 for vnic_type normal using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] Nov 09 04:29:24.021224 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.plugins.ml2.plugin [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempt 9 to bind port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 Nov 09 04:29:24.040397 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-ea989695-5ec5-414f-b8d5-564d3b5d6317 None None] For port dd9f29fa-78b7-4375-a0ea-44e827f0c20c, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=dd9f29fa-78b7-4375-a0ea-44e827f0c20c,segment=NetworkSegment(a79a3f61-7b94-4db2-b42c-1e9442738b0a),segment_id=a79a3f61-7b94-4db2-b42c-1e9442738b0a)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:29:24.046825 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:29:24.047452 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] {{(pid=102161) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:29:24.048274 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 on network c53bac62-4539-4143-874d-1fffa9d5216a {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:29:24.056656 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-532e14e4-c232-457b-b926-6d06f7505d70 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Made reservation on behalf of 83cbb798c0f44b268f8acd2a70eb745a for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:29:24.062899 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-532e14e4-c232-457b-b926-6d06f7505d70 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:24.068256 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-63c22075-3e6b-45e4-af2b-18647f05cb87 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:24.074973 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-29d72bea-266d-444b-a569-cda1c2c6f3fc tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:24.075439 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-63c22075-3e6b-45e4-af2b-18647f05cb87 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:24.092256 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7ae8e09d-8c06-4fe0-a9b6-b35d79e836ef tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:24.100508 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-63c22075-3e6b-45e4-af2b-18647f05cb87 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Calling delete_port for 4151881c-46eb-4bc9-ab1d-9d251cecb700 owned by network:floatingip {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:29:24.105749 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ea989695-5ec5-414f-b8d5-564d3b5d6317 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:24.112819 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-29d72bea-266d-444b-a569-cda1c2c6f3fc tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:24.117891 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-29d72bea-266d-444b-a569-cda1c2c6f3fc tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] 10.222.0.24 "DELETE /v2.0/networks/2da9771b-6fd0-4872-8475-20a7aa84ba6d HTTP/1.1" status: 204 len: 168 time: 1.3619273 Nov 09 04:29:24.124863 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 on network c53bac62-4539-4143-874d-1fffa9d5216a not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:29:24.125320 dv-neutron-816802-2-hyperv neutron-server[102161]: ERROR neutron.plugins.ml2.managers [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Failed to bind port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 on host hv-neutron-8168 for vnic_type normal using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] Nov 09 04:29:24.126470 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53556) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:24.142236 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.plugins.ml2.plugin [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempt 10 to bind port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 Nov 09 04:29:24.157705 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device dd9f29fa-78b7-4375-a0ea-44e827f0c20c up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:29:24.181294 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29d72bea-266d-444b-a569-cda1c2c6f3fc tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Pushing event deleted for resources: {'Network': ['ID=2da9771b-6fd0-4872-8475-20a7aa84ba6d,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:24.201557 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:29:24.202056 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] {{(pid=102161) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:29:24.202504 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 on network c53bac62-4539-4143-874d-1fffa9d5216a {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:29:24.224654 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 on network c53bac62-4539-4143-874d-1fffa9d5216a not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:29:24.225150 dv-neutron-816802-2-hyperv neutron-server[102161]: ERROR neutron.plugins.ml2.managers [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Failed to bind port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 on host hv-neutron-8168 for vnic_type normal using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] Nov 09 04:29:24.225607 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:24.226768 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea989695-5ec5-414f-b8d5-564d3b5d6317 None None] Pushing event updated for resources: {'Port': ['ID=dd9f29fa-78b7-4375-a0ea-44e827f0c20c,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:24.242860 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port dd9f29fa-78b7-4375-a0ea-44e827f0c20c triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:29:24.243690 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:24.287966 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bf5284a8-e16e-43c6-a5c0-3d7405462cab tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:24.358167 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bf5284a8-e16e-43c6-a5c0-3d7405462cab tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:24.452336 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-f3ca89d2-b36f-4a42-84d7-379c913bd8cc None None] Provisioning complete for port 36e7de16-92d8-46d7-9c75-4b0f8046b5ff triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:29:24.452913 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f3ca89d2-b36f-4a42-84d7-379c913bd8cc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:24.477348 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] For port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0, host hv-neutron-8168, cleared binding levels {{(pid=102161) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:29:24.478182 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempted to set empty binding levels {{(pid=102161) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:65}} Nov 09 04:29:24.504672 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf5284a8-e16e-43c6-a5c0-3d7405462cab tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Pushing event updated for resources: {'Port': ['ID=36e7de16-92d8-46d7-9c75-4b0f8046b5ff,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:24.506805 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-f3ca89d2-b36f-4a42-84d7-379c913bd8cc None None] Port 36e7de16-92d8-46d7-9c75-4b0f8046b5ff cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:29:24.515100 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bf5284a8-e16e-43c6-a5c0-3d7405462cab tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:24.519739 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-f3ca89d2-b36f-4a42-84d7-379c913bd8cc None None] Provisioning complete for port dd9f29fa-78b7-4375-a0ea-44e827f0c20c triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:29:24.520370 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f3ca89d2-b36f-4a42-84d7-379c913bd8cc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:24.562273 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:24.611782 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] In _notify_port_updated(), no bound segment for port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 on network c53bac62-4539-4143-874d-1fffa9d5216a {{(pid=102161) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 09 04:29:24.612631 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:24.613225 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:24.616973 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] 10.222.0.24 "PUT /v2.0/ports/63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 HTTP/1.1" status: 200 len: 979 time: 2.8773537 Nov 09 04:29:24.621598 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53560) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:24.685455 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7470aeba-ba42-42f8-b7c4-4938d1ca72dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Pushing event updated for resources: {'Port': ['ID=63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0,revision_number=3']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:24.686730 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1c22642a-d263-406d-b2ae-b9d323692ce8 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:24.687828 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-532e14e4-c232-457b-b926-6d06f7505d70 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:24.692816 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1c22642a-d263-406d-b2ae-b9d323692ce8 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:24.696671 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-1c22642a-d263-406d-b2ae-b9d323692ce8 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] 10.222.0.24 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1339 time: 0.5664103 Nov 09 04:29:24.701135 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53562) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:24.711511 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7ae8e09d-8c06-4fe0-a9b6-b35d79e836ef tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:24.733528 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-16bc97bb-888e-40c2-912a-9e08ef7c7fd8 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsIpV6Test-test-network-1760029430'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:24.741750 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-838894a0-069c-4bd8-8807-f35ac56fcf1a None None] Provisioning complete for port 36e7de16-92d8-46d7-9c75-4b0f8046b5ff triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:29:24.741958 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-838894a0-069c-4bd8-8807-f35ac56fcf1a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:24.777604 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7ae8e09d-8c06-4fe0-a9b6-b35d79e836ef tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:29:24.784283 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-7ae8e09d-8c06-4fe0-a9b6-b35d79e836ef tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:29:24.787740 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-838894a0-069c-4bd8-8807-f35ac56fcf1a None None] Port 36e7de16-92d8-46d7-9c75-4b0f8046b5ff cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:29:24.790463 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7ae8e09d-8c06-4fe0-a9b6-b35d79e836ef tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:29:24.797896 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ae8e09d-8c06-4fe0-a9b6-b35d79e836ef tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Pushing event updated for resources: {'Port': ['ID=5f1b04f2-2d14-4367-835c-2c41b3bf4c8b,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:24.799386 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0884add9-9c94-40b3-a468-56eca83adb5f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:24.799854 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0884add9-9c94-40b3-a468-56eca83adb5f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:24.801539 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0884add9-9c94-40b3-a468-56eca83adb5f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:24.801539 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0884add9-9c94-40b3-a468-56eca83adb5f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:24.801539 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0884add9-9c94-40b3-a468-56eca83adb5f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:24.801784 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0884add9-9c94-40b3-a468-56eca83adb5f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:24.802047 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0884add9-9c94-40b3-a468-56eca83adb5f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:24.802505 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0884add9-9c94-40b3-a468-56eca83adb5f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:24.803020 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0884add9-9c94-40b3-a468-56eca83adb5f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:24.803489 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0884add9-9c94-40b3-a468-56eca83adb5f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:24.803937 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0884add9-9c94-40b3-a468-56eca83adb5f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:24.804377 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0884add9-9c94-40b3-a468-56eca83adb5f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:24.804816 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0884add9-9c94-40b3-a468-56eca83adb5f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:24.805253 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0884add9-9c94-40b3-a468-56eca83adb5f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:24.805696 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0884add9-9c94-40b3-a468-56eca83adb5f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:24.806139 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0884add9-9c94-40b3-a468-56eca83adb5f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:24.806572 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0884add9-9c94-40b3-a468-56eca83adb5f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:24.807017 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0884add9-9c94-40b3-a468-56eca83adb5f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:24.807453 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0884add9-9c94-40b3-a468-56eca83adb5f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:24.810054 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-0884add9-9c94-40b3-a468-56eca83adb5f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] 10.222.0.24 "GET /v2.0/ports HTTP/1.1" status: 200 len: 17207 time: 0.1859064 Nov 09 04:29:24.816274 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53564) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:24.830172 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-532e14e4-c232-457b-b926-6d06f7505d70 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Pushing event updated for resources: {'Subnet': ['ID=70a58ff6-4289-498f-b089-ac67e5c7c82f,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:24.864869 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bf5284a8-e16e-43c6-a5c0-3d7405462cab tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Network 95c56523-9e9a-4f6f-aa13-0372772dbac5 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:29:24.871813 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-bf5284a8-e16e-43c6-a5c0-3d7405462cab tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:29:24.882435 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-532e14e4-c232-457b-b926-6d06f7505d70 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Checking segment: {'id': '390f9f13-b28d-47b2-8cd2-9f274969fa64', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 300, 'network_id': '807848a2-a4f3-4a57-9607-825f2f20d042'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:29:24.882795 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-532e14e4-c232-457b-b926-6d06f7505d70 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Network hostable DHCP agents. Network: 807848a2-a4f3-4a57-9607-825f2f20d042, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:29:24.917737 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-63c22075-3e6b-45e4-af2b-18647f05cb87 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:24.960621 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-16bc97bb-888e-40c2-912a-9e08ef7c7fd8 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Made reservation on behalf of 34508a55938a43c2b57acd8dc368e922 for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:29:24.964055 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-16bc97bb-888e-40c2-912a-9e08ef7c7fd8 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:24.974872 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63c22075-3e6b-45e4-af2b-18647f05cb87 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Pushing event deleted for resources: {'Port': ['ID=4151881c-46eb-4bc9-ab1d-9d251cecb700,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:25.044748 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-16bc97bb-888e-40c2-912a-9e08ef7c7fd8 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 349} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:29:25.053467 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-63c22075-3e6b-45e4-af2b-18647f05cb87 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks [] for floatingip, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:25.056157 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-63c22075-3e6b-45e4-af2b-18647f05cb87 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:25.058928 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-63c22075-3e6b-45e4-af2b-18647f05cb87 tempest-FloatingIPAdminTestJSON-1391443551 tempest-FloatingIPAdminTestJSON-1391443551-project] 10.222.0.24 "DELETE /v2.0/floatingips/6b2cf3de-b72f-466c-922f-a5e7cfeae409 HTTP/1.1" status: 204 len: 168 time: 1.4059601 Nov 09 04:29:25.059375 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-3e24683d-2c8a-4ab5-97e5-823d81e544ca tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Deleting port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:29:25.059711 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3e24683d-2c8a-4ab5-97e5-823d81e544ca tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:25.066666 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-16bc97bb-888e-40c2-912a-9e08ef7c7fd8 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:25.067022 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-16bc97bb-888e-40c2-912a-9e08ef7c7fd8 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Added segment c48caa46-c5f6-4117-8aca-48a50d5cd811 of type vlan for network a7c7b95d-55e7-4c90-a62a-939c3c718b77 Nov 09 04:29:25.077632 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-532e14e4-c232-457b-b926-6d06f7505d70 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Network 807848a2-a4f3-4a57-9607-825f2f20d042 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:29:25.177469 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-532e14e4-c232-457b-b926-6d06f7505d70 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 807848a2-a4f3-4a57-9607-825f2f20d042) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:29:25.187038 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dd68f1be-ee15-44a9-9e0a-3c416808e668 None None] Network 807848a2-a4f3-4a57-9607-825f2f20d042 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:29:25.188460 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-532e14e4-c232-457b-b926-6d06f7505d70 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:25.189048 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-532e14e4-c232-457b-b926-6d06f7505d70 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:25.191661 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-3e24683d-2c8a-4ab5-97e5-823d81e544ca tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] For port 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0, host hv-neutron-8168, got binding levels [] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:29:25.192002 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3e24683d-2c8a-4ab5-97e5-823d81e544ca tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:25.201313 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-16bc97bb-888e-40c2-912a-9e08ef7c7fd8 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:25.216598 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-3e24683d-2c8a-4ab5-97e5-823d81e544ca tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Calling delete_port for 63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 owned by {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:29:25.227998 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7ae8e09d-8c06-4fe0-a9b6-b35d79e836ef tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks [] for router_gateway, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:25.257596 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-994a0fac-4d04-4ba5-85e5-98148f52f20f None None] Provisioning complete for port 36e7de16-92d8-46d7-9c75-4b0f8046b5ff triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:29:25.258442 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-994a0fac-4d04-4ba5-85e5-98148f52f20f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:25.283516 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bf5284a8-e16e-43c6-a5c0-3d7405462cab tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Router 1601b691-a672-4120-96cd-d64828e2535d is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102161) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:29:25.313174 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-994a0fac-4d04-4ba5-85e5-98148f52f20f None None] Port 36e7de16-92d8-46d7-9c75-4b0f8046b5ff cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:29:25.351775 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-532e14e4-c232-457b-b926-6d06f7505d70 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 865 time: 2.1184044 Nov 09 04:29:25.364785 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53570) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:25.373594 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-345459a5-5ebc-4069-a2b6-89f2beb3962b tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-763816145'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:25.380047 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-16bc97bb-888e-40c2-912a-9e08ef7c7fd8 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:25.385695 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-16bc97bb-888e-40c2-912a-9e08ef7c7fd8 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:25.386265 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-16bc97bb-888e-40c2-912a-9e08ef7c7fd8 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:25.395838 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a1548289-d708-4857-8bea-b427d5650b55 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-807848a2-a4f3-4a57-9607-825f2f20d042', 'network_id': '807848a2-a4f3-4a57-9607-825f2f20d042', 'tenant_id': '83cbb798c0f44b268f8acd2a70eb745a', 'fixed_ips': [{'subnet_id': '70a58ff6-4289-498f-b089-ac67e5c7c82f'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:29:25.395838 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a1548289-d708-4857-8bea-b427d5650b55 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:25.466963 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bf5284a8-e16e-43c6-a5c0-3d7405462cab tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:29:25.468551 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3e24683d-2c8a-4ab5-97e5-823d81e544ca tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:25.475918 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-bf5284a8-e16e-43c6-a5c0-3d7405462cab tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] 10.222.0.24 "PUT /v2.0/routers/1601b691-a672-4120-96cd-d64828e2535d/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.8229790 Nov 09 04:29:25.477302 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-345459a5-5ebc-4069-a2b6-89f2beb3962b tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Made reservation on behalf of 83cbb798c0f44b268f8acd2a70eb745a for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:29:25.480098 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0cd2071e-ea33-4b0b-8cc4-612c1d27fb7d None None] Sync routers for ids ['1601b691-a672-4120-96cd-d64828e2535d'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:29:25.481566 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-345459a5-5ebc-4069-a2b6-89f2beb3962b tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:25.482775 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53572) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:25.491906 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-91255669-63ce-488b-aaf0-15ac1e7f1457 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Request body: {'port': {'network_id': '95c56523-9e9a-4f6f-aa13-0372772dbac5', 'name': 'tempest-FloatingIPNegativeTestJSON-1957026610'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:25.495969 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16bc97bb-888e-40c2-912a-9e08ef7c7fd8 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Pushing event updated for resources: {'Network': ['ID=a7c7b95d-55e7-4c90-a62a-939c3c718b77,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:25.516853 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network a7c7b95d-55e7-4c90-a62a-939c3c718b77 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:29:25.527890 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-345459a5-5ebc-4069-a2b6-89f2beb3962b tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 335} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:29:25.529434 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0cd2071e-ea33-4b0b-8cc4-612c1d27fb7d None None] Routers {'1601b691-a672-4120-96cd-d64828e2535d'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:29:25.530921 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-0cd2071e-ea33-4b0b-8cc4-612c1d27fb7d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:29:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['1601b691-a672-4120-96cd-d64828e2535d'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:25.533172 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e24683d-2c8a-4ab5-97e5-823d81e544ca tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Pushing event deleted for resources: {'Port': ['ID=63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:25.544165 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-16bc97bb-888e-40c2-912a-9e08ef7c7fd8 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 790 time: 0.8216891 Nov 09 04:29:25.547715 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-345459a5-5ebc-4069-a2b6-89f2beb3962b tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:25.548057 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-345459a5-5ebc-4069-a2b6-89f2beb3962b tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Added segment 5d84e43f-201d-4d76-b475-bfebe55b4aea of type vlan for network e366a2cb-d84c-4a09-bffb-dff826896c89 Nov 09 04:29:25.586794 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53578) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:25.590917 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3e24683d-2c8a-4ab5-97e5-823d81e544ca tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:25.596639 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-3e24683d-2c8a-4ab5-97e5-823d81e544ca tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] 10.222.0.24 "DELETE /v2.0/ports/63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 HTTP/1.1" status: 204 len: 168 time: 0.7734389 Nov 09 04:29:25.597715 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-a306802b-f509-488e-b658-3710c5c292f1 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsIpV6Test-test-network-1973778815'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:25.601343 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53580) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:25.638254 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-345459a5-5ebc-4069-a2b6-89f2beb3962b tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:25.651833 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-9d017fe8-93ab-43a9-ac94-0b81272a2a99 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] GET failed (client error): The resource could not be found. Nov 09 04:29:25.659093 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-9d017fe8-93ab-43a9-ac94-0b81272a2a99 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] 10.222.0.24 "GET /v2.0/ports/63a9b642-a2d6-49b6-a4bf-996e6aaeb8c0 HTTP/1.1" status: 404 len: 333 time: 0.0481195 Nov 09 04:29:25.666451 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53582) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:25.668714 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-0cd2071e-ea33-4b0b-8cc4-612c1d27fb7d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:25.670722 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-1f0b98fb-6de4-4252-8bbb-7a10a4d3d5a7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Request body: {'port': {'name': 'tempest-PortsAdminExtendedAttrsIpV6TestJSON-431388999', 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:25.678424 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-a1548289-d708-4857-8bea-b427d5650b55 None None] Allocated IP 2001:db8::1 (807848a2-a4f3-4a57-9607-825f2f20d042/70a58ff6-4289-498f-b089-ac67e5c7c82f/53326cfb-82fd-4c01-b6be-8320fdc356a6) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:29:25.685112 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0cd2071e-ea33-4b0b-8cc4-612c1d27fb7d None None] Routers {'1601b691-a672-4120-96cd-d64828e2535d'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:29:25.685348 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53584) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:25.686210 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-0cd2071e-ea33-4b0b-8cc4-612c1d27fb7d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:29:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['1601b691-a672-4120-96cd-d64828e2535d'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:25.696604 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7ae8e09d-8c06-4fe0-a9b6-b35d79e836ef tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:25.728663 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-0cd2071e-ea33-4b0b-8cc4-612c1d27fb7d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:25.729638 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0cd2071e-ea33-4b0b-8cc4-612c1d27fb7d None None] The sync data for ids ['1601b691-a672-4120-96cd-d64828e2535d'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:29:25.774104 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a306802b-f509-488e-b658-3710c5c292f1 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Made reservation on behalf of 34508a55938a43c2b57acd8dc368e922 for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:29:25.781991 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a306802b-f509-488e-b658-3710c5c292f1 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:25.802062 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.db.api [None req-91255669-63ce-488b-aaf0-15ac1e7f1457 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Nov 09 04:29:25.802062 dv-neutron-816802-2-hyperv neutron-server[102161]: [SQL: DELETE FROM reservations WHERE reservations.project_id = %(project_id_1)s AND reservations.expiration < %(expiration_1)s] Nov 09 04:29:25.802062 dv-neutron-816802-2-hyperv neutron-server[102161]: [parameters: {'project_id_1': '0bad988bbff146edaf9af1fa56d6a513', 'expiration_1': datetime.datetime(2021, 11, 9, 4, 29, 5, 699875)}] Nov 09 04:29:25.802062 dv-neutron-816802-2-hyperv neutron-server[102161]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=102161) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:29:25.806081 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG oslo_db.api [None req-91255669-63ce-488b-aaf0-15ac1e7f1457 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Performing DB retry for function neutron.db.quota.driver_nolock.DbQuotaNoLockDriver.make_reservation {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:29:25.821733 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a306802b-f509-488e-b658-3710c5c292f1 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 342} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:29:25.828611 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-345459a5-5ebc-4069-a2b6-89f2beb3962b tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:25.833716 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a306802b-f509-488e-b658-3710c5c292f1 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:25.834089 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-a306802b-f509-488e-b658-3710c5c292f1 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Added segment 8e6196ef-a897-4937-9f50-82bca1ac84f0 of type vlan for network 5ec7e43d-8b0b-4507-8c9d-637ec0696714 Nov 09 04:29:25.835135 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-345459a5-5ebc-4069-a2b6-89f2beb3962b tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:25.835352 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-345459a5-5ebc-4069-a2b6-89f2beb3962b tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:25.874167 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a1548289-d708-4857-8bea-b427d5650b55 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:25.875370 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a306802b-f509-488e-b658-3710c5c292f1 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:25.930333 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1f0b98fb-6de4-4252-8bbb-7a10a4d3d5a7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Made reservation on behalf of 657652107bc34ca7983289060f1bd8df for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:29:25.932814 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1f0b98fb-6de4-4252-8bbb-7a10a4d3d5a7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:25.965310 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-345459a5-5ebc-4069-a2b6-89f2beb3962b tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Pushing event updated for resources: {'Network': ['ID=e366a2cb-d84c-4a09-bffb-dff826896c89,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:25.973624 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a1548289-d708-4857-8bea-b427d5650b55 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:25.979000 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network e366a2cb-d84c-4a09-bffb-dff826896c89 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:29:25.984917 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-5abc95e7-efe0-4b49-98bb-46307ff12ca9 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=00757dadf44e4dd1a48e6e44b03816b0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2961822 Nov 09 04:29:25.984917 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [None req-1f0b98fb-6de4-4252-8bbb-7a10a4d3d5a7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] device_id is not set on port 9f0ff776-fcb0-4f7a-b1ba-73d3250ac80f yet. {{(pid=102162) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:29:25.986401 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53588) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:25.988311 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device dd9f29fa-78b7-4375-a0ea-44e827f0c20c up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:29:26.034493 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a306802b-f509-488e-b658-3710c5c292f1 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:26.039958 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-345459a5-5ebc-4069-a2b6-89f2beb3962b tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 783 time: 0.6691096 Nov 09 04:29:26.041140 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53592) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:26.042060 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a306802b-f509-488e-b658-3710c5c292f1 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:26.043064 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a306802b-f509-488e-b658-3710c5c292f1 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:26.046400 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-6baf7939-ceb0-42af-b7a4-ce1c7a1de222 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Request body: {'subnet': {'network_id': 'e366a2cb-d84c-4a09-bffb-dff826896c89', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'allocation_pools': [{'start': '2001:db8::3', 'end': '2001:db8::7'}]}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:26.080792 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7ae8e09d-8c06-4fe0-a9b6-b35d79e836ef tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Router a43fa85f-7459-401e-af22-bf37c55be422 is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102162) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:29:26.130025 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a1548289-d708-4857-8bea-b427d5650b55 None None] Network 807848a2-a4f3-4a57-9607-825f2f20d042 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:29:26.136188 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a306802b-f509-488e-b658-3710c5c292f1 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Pushing event updated for resources: {'Network': ['ID=5ec7e43d-8b0b-4507-8c9d-637ec0696714,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:26.138669 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-840f3be6-45e9-4876-a594-6a79f125d434 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:26.153490 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-a1548289-d708-4857-8bea-b427d5650b55 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:29:26.159573 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1548289-d708-4857-8bea-b427d5650b55 None None] Pushing event updated for resources: {'Port': ['ID=53326cfb-82fd-4c01-b6be-8320fdc356a6,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:26.164741 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a306802b-f509-488e-b658-3710c5c292f1 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 790 time: 0.5770862 Nov 09 04:29:26.168341 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53594) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:26.173382 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-1d37d614-4be5-4236-b88b-d42124538010 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Request body: {'ports': [{'network_id': 'a7c7b95d-55e7-4c90-a62a-939c3c718b77', 'name': 'tempest-port--1907269849', 'admin_state_up': True}, {'network_id': '5ec7e43d-8b0b-4507-8c9d-637ec0696714', 'admin_state_up': False}]} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:26.173879 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-1d37d614-4be5-4236-b88b-d42124538010 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Request body: {'port': {'network_id': 'a7c7b95d-55e7-4c90-a62a-939c3c718b77', 'name': 'tempest-port--1907269849', 'admin_state_up': True}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:26.174427 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-1d37d614-4be5-4236-b88b-d42124538010 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Request body: {'port': {'network_id': '5ec7e43d-8b0b-4507-8c9d-637ec0696714', 'admin_state_up': False}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:26.183656 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a1548289-d708-4857-8bea-b427d5650b55 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:29:26.187459 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 5ec7e43d-8b0b-4507-8c9d-637ec0696714 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:29:26.201321 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-840f3be6-45e9-4876-a594-6a79f125d434 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:26.332540 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port dd9f29fa-78b7-4375-a0ea-44e827f0c20c triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:29:26.333306 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:26.336611 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6baf7939-ceb0-42af-b7a4-ce1c7a1de222 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Made reservation on behalf of 83cbb798c0f44b268f8acd2a70eb745a for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:29:26.340078 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6baf7939-ceb0-42af-b7a4-ce1c7a1de222 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:26.409714 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-a1548289-d708-4857-8bea-b427d5650b55 None None] Attempting to bind port 53326cfb-82fd-4c01-b6be-8320fdc356a6 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:29:26.409975 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-a1548289-d708-4857-8bea-b427d5650b55 None None] Attempting to bind port 53326cfb-82fd-4c01-b6be-8320fdc356a6 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '390f9f13-b28d-47b2-8cd2-9f274969fa64', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 300, 'network_id': '807848a2-a4f3-4a57-9607-825f2f20d042'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:29:26.410330 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a1548289-d708-4857-8bea-b427d5650b55 None None] Attempting to bind port 53326cfb-82fd-4c01-b6be-8320fdc356a6 on network 807848a2-a4f3-4a57-9607-825f2f20d042 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:29:26.420241 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a1548289-d708-4857-8bea-b427d5650b55 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 29, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:29:26.420649 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a1548289-d708-4857-8bea-b427d5650b55 None None] Checking segment: {'id': '390f9f13-b28d-47b2-8cd2-9f274969fa64', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 300, 'network_id': '807848a2-a4f3-4a57-9607-825f2f20d042'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:29:26.420998 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a1548289-d708-4857-8bea-b427d5650b55 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:26.421385 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a1548289-d708-4857-8bea-b427d5650b55 None None] Bound using segment: {'id': '390f9f13-b28d-47b2-8cd2-9f274969fa64', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 300, 'network_id': '807848a2-a4f3-4a57-9607-825f2f20d042'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:29:26.421883 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-a1548289-d708-4857-8bea-b427d5650b55 None None] Bound port: 53326cfb-82fd-4c01-b6be-8320fdc356a6, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '390f9f13-b28d-47b2-8cd2-9f274969fa64', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 300, 'network_id': '807848a2-a4f3-4a57-9607-825f2f20d042'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:29:26.422135 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.ipam_backend_mixin [None req-6baf7939-ceb0-42af-b7a4-ce1c7a1de222 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Performing IP validity checks on allocation pools {{(pid=102162) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:325}} Nov 09 04:29:26.422633 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a1548289-d708-4857-8bea-b427d5650b55 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:26.422745 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.ipam_backend_mixin [None req-6baf7939-ceb0-42af-b7a4-ce1c7a1de222 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Checking for overlaps among allocation pools and gateway ip {{(pid=102162) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:346}} Nov 09 04:29:26.436939 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1f0b98fb-6de4-4252-8bbb-7a10a4d3d5a7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:26.449416 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7ae8e09d-8c06-4fe0-a9b6-b35d79e836ef tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:29:26.453227 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-840f3be6-45e9-4876-a594-6a79f125d434 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:26.465512 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-840f3be6-45e9-4876-a594-6a79f125d434 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:26.469821 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-840f3be6-45e9-4876-a594-6a79f125d434 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/f055b924-862a-48c9-833f-a06c7e5617ac HTTP/1.1" status: 204 len: 168 time: 0.4820378 Nov 09 04:29:26.485552 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-415e4045-4c4d-4a08-b762-13f534e48bb7 None None] Sync routers for ids ['a43fa85f-7459-401e-af22-bf37c55be422'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:29:26.491462 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-840f3be6-45e9-4876-a594-6a79f125d434 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f055b924-862a-48c9-833f-a06c7e5617ac,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:26.508486 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-91255669-63ce-488b-aaf0-15ac1e7f1457 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Made reservation on behalf of 0bad988bbff146edaf9af1fa56d6a513 for: {'port': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:29:26.519890 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-91255669-63ce-488b-aaf0-15ac1e7f1457 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:26.532277 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-415e4045-4c4d-4a08-b762-13f534e48bb7 None None] Routers {'a43fa85f-7459-401e-af22-bf37c55be422'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:29:26.532906 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-415e4045-4c4d-4a08-b762-13f534e48bb7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:29:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['a43fa85f-7459-401e-af22-bf37c55be422'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:26.564173 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [None req-91255669-63ce-488b-aaf0-15ac1e7f1457 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] device_id is not set on port 66695da2-5d15-4717-8c15-6199530b694a yet. {{(pid=102161) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:29:26.610815 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-415e4045-4c4d-4a08-b762-13f534e48bb7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:26.615338 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-a1548289-d708-4857-8bea-b427d5650b55 None None] For port 53326cfb-82fd-4c01-b6be-8320fdc356a6, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:29:26.629631 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-a1548289-d708-4857-8bea-b427d5650b55 None None] For port 53326cfb-82fd-4c01-b6be-8320fdc356a6, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=53326cfb-82fd-4c01-b6be-8320fdc356a6,segment=NetworkSegment(390f9f13-b28d-47b2-8cd2-9f274969fa64),segment_id=390f9f13-b28d-47b2-8cd2-9f274969fa64)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:29:26.636230 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-415e4045-4c4d-4a08-b762-13f534e48bb7 None None] Routers {'a43fa85f-7459-401e-af22-bf37c55be422'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:29:26.637257 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-415e4045-4c4d-4a08-b762-13f534e48bb7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:29:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['a43fa85f-7459-401e-af22-bf37c55be422'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:26.676304 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-415e4045-4c4d-4a08-b762-13f534e48bb7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:26.676964 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-415e4045-4c4d-4a08-b762-13f534e48bb7 None None] The sync data for ids ['a43fa85f-7459-401e-af22-bf37c55be422'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:29:26.691382 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-91255669-63ce-488b-aaf0-15ac1e7f1457 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Allocated IP 172.20.0.13 (95c56523-9e9a-4f6f-aa13-0372772dbac5/ee35063e-795f-4ddd-b990-2a7e9018abb7/66695da2-5d15-4717-8c15-6199530b694a) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:29:26.695155 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7ae8e09d-8c06-4fe0-a9b6-b35d79e836ef tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:26.696644 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-7ae8e09d-8c06-4fe0-a9b6-b35d79e836ef tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 888 time: 6.3314285 Nov 09 04:29:26.701854 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53600) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:26.722013 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a1548289-d708-4857-8bea-b427d5650b55 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:26.722462 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1f0b98fb-6de4-4252-8bbb-7a10a4d3d5a7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:26.725660 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6baf7939-ceb0-42af-b7a4-ce1c7a1de222 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:26.805977 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1548289-d708-4857-8bea-b427d5650b55 None None] Pushing event updated for resources: {'Port': ['ID=53326cfb-82fd-4c01-b6be-8320fdc356a6,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:26.836899 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1f0b98fb-6de4-4252-8bbb-7a10a4d3d5a7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Network c53bac62-4539-4143-874d-1fffa9d5216a is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:29:26.846038 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-1f0b98fb-6de4-4252-8bbb-7a10a4d3d5a7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:29:26.857974 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1f0b98fb-6de4-4252-8bbb-7a10a4d3d5a7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:29:26.859345 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1f0b98fb-6de4-4252-8bbb-7a10a4d3d5a7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:26.859536 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1f0b98fb-6de4-4252-8bbb-7a10a4d3d5a7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:26.865895 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6baf7939-ceb0-42af-b7a4-ce1c7a1de222 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Pushing event updated for resources: {'Subnet': ['ID=c66031ce-ca12-4cb0-9734-9397ff18ab6c,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:26.870283 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1d37d614-4be5-4236-b88b-d42124538010 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Made reservation on behalf of 34508a55938a43c2b57acd8dc368e922 for: {'port': 2} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:29:26.874995 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1d37d614-4be5-4236-b88b-d42124538010 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:26.875325 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f0b98fb-6de4-4252-8bbb-7a10a4d3d5a7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Pushing event updated for resources: {'Port': ['ID=9f0ff776-fcb0-4f7a-b1ba-73d3250ac80f,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:26.908594 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6baf7939-ceb0-42af-b7a4-ce1c7a1de222 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Checking segment: {'id': '5d84e43f-201d-4d76-b475-bfebe55b4aea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 335, 'network_id': 'e366a2cb-d84c-4a09-bffb-dff826896c89'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:29:26.908992 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6baf7939-ceb0-42af-b7a4-ce1c7a1de222 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Network hostable DHCP agents. Network: e366a2cb-d84c-4a09-bffb-dff826896c89, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:29:26.921026 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-bfcc1fc3-45d5-4318-8e1a-d8b3176fa538 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] 10.222.0.24 "GET /v2.0/routers/a43fa85f-7459-401e-af22-bf37c55be422 HTTP/1.1" status: 200 len: 924 time: 0.2175496 Nov 09 04:29:26.925159 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1d37d614-4be5-4236-b88b-d42124538010 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:26.929116 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53604) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:26.973715 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-5ed89ed9-777a-4731-8480-8d92b1922bda tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] 10.222.0.24 "GET /v2.0/ports?device_id=a43fa85f-7459-401e-af22-bf37c55be422 HTTP/1.1" status: 200 len: 205 time: 0.0428913 Nov 09 04:29:26.976272 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53606) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:27.056795 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6baf7939-ceb0-42af-b7a4-ce1c7a1de222 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Network e366a2cb-d84c-4a09-bffb-dff826896c89 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:29:27.065702 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53608) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:27.066283 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-1f0b98fb-6de4-4252-8bbb-7a10a4d3d5a7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 963 time: 1.3986280 Nov 09 04:29:27.126162 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aa2318e-3f07-4c23-95c2-719b6ef760d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:27.127578 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-4aa2318e-3f07-4c23-95c2-719b6ef760d1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] 10.222.0.24 "GET /v2.0/ports/9f0ff776-fcb0-4f7a-b1ba-73d3250ac80f HTTP/1.1" status: 200 len: 958 time: 0.0570698 Nov 09 04:29:27.130428 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [None req-1d37d614-4be5-4236-b88b-d42124538010 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] device_id is not set on port 6132eda6-c625-4740-a689-1d38c72268d9 yet. {{(pid=102161) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:29:27.133745 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53612) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:27.147240 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6b0ba2c5-ede9-4ef3-b507-49b39f68deb7 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks [] for router, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:27.177637 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-6baf7939-ceb0-42af-b7a4-ce1c7a1de222 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, e366a2cb-d84c-4a09-bffb-dff826896c89) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:29:27.177905 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-91255669-63ce-488b-aaf0-15ac1e7f1457 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:27.180523 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6f2a3f85-5fff-4e06-a205-fa75ff31039c None None] Network e366a2cb-d84c-4a09-bffb-dff826896c89 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:29:27.226825 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6baf7939-ceb0-42af-b7a4-ce1c7a1de222 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:27.227680 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6baf7939-ceb0-42af-b7a4-ce1c7a1de222 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:27.273017 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53614) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:27.318895 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-53b47233-24ef-4615-87b4-98a214790241 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:27.337261 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1d37d614-4be5-4236-b88b-d42124538010 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:27.346415 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-6baf7939-ceb0-42af-b7a4-ce1c7a1de222 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 803 time: 1.3037865 Nov 09 04:29:27.349932 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53616) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:27.425227 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [None req-1d37d614-4be5-4236-b88b-d42124538010 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] device_id is not set on port edc3a299-b427-4e90-809c-4858876343c0 yet. {{(pid=102161) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:29:27.429919 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-91255669-63ce-488b-aaf0-15ac1e7f1457 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:27.448761 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6b0ba2c5-ede9-4ef3-b507-49b39f68deb7 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks [] for router_gateway, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:27.476748 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-2b9f0a15-fd36-46cb-b74a-7feef74442cc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Deleting port 9f0ff776-fcb0-4f7a-b1ba-73d3250ac80f {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:29:27.477066 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2b9f0a15-fd36-46cb-b74a-7feef74442cc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:27.495304 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-91255669-63ce-488b-aaf0-15ac1e7f1457 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Network 95c56523-9e9a-4f6f-aa13-0372772dbac5 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:29:27.500338 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-494bbf94-289d-4e7e-8538-18a6f1b4ab1f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-e366a2cb-d84c-4a09-bffb-dff826896c89', 'network_id': 'e366a2cb-d84c-4a09-bffb-dff826896c89', 'tenant_id': '83cbb798c0f44b268f8acd2a70eb745a', 'fixed_ips': [{'subnet_id': 'c66031ce-ca12-4cb0-9734-9397ff18ab6c'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:29:27.500819 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-91255669-63ce-488b-aaf0-15ac1e7f1457 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:29:27.501422 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-494bbf94-289d-4e7e-8538-18a6f1b4ab1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:27.506708 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-91255669-63ce-488b-aaf0-15ac1e7f1457 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:29:27.532564 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91255669-63ce-488b-aaf0-15ac1e7f1457 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Pushing event updated for resources: {'Port': ['ID=66695da2-5d15-4717-8c15-6199530b694a,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:27.629770 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-91255669-63ce-488b-aaf0-15ac1e7f1457 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:27.631433 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-91255669-63ce-488b-aaf0-15ac1e7f1457 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:27.634696 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9222bdb4-3b11-4e9e-bef1-0a497a9dc50d tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:27.645513 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2b9f0a15-fd36-46cb-b74a-7feef74442cc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:27.669678 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-494bbf94-289d-4e7e-8538-18a6f1b4ab1f None None] Allocated IP 2001:db8::3 (e366a2cb-d84c-4a09-bffb-dff826896c89/c66031ce-ca12-4cb0-9734-9397ff18ab6c/34e0c946-f3ae-4404-b84b-4fd3f4e26fa1) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:29:27.686214 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-53b47233-24ef-4615-87b4-98a214790241 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:27.697814 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-2b9f0a15-fd36-46cb-b74a-7feef74442cc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Calling delete_port for 9f0ff776-fcb0-4f7a-b1ba-73d3250ac80f owned by {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:29:27.716272 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-91255669-63ce-488b-aaf0-15ac1e7f1457 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 2.2321823 Nov 09 04:29:27.723192 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1d37d614-4be5-4236-b88b-d42124538010 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:27.727352 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53618) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:27.732891 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-b0add7e0-f1be-41e2-970c-782ff50687f5 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Request body: {'floatingip': {'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:27.827806 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-53b47233-24ef-4615-87b4-98a214790241 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:27.845260 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-494bbf94-289d-4e7e-8538-18a6f1b4ab1f None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:27.848019 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b0add7e0-f1be-41e2-970c-782ff50687f5 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks [] for floatingip, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:27.848360 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-6b0ba2c5-ede9-4ef3-b507-49b39f68deb7 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Deleting port 5f1b04f2-2d14-4367-835c-2c41b3bf4c8b {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:29:27.848750 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6b0ba2c5-ede9-4ef3-b507-49b39f68deb7 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:27.875008 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-d0e247a6-da5a-4a11-9820-3c36ca667141 None None] Provisioning complete for port 66695da2-5d15-4717-8c15-6199530b694a triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:29:27.875516 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d0e247a6-da5a-4a11-9820-3c36ca667141 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:27.883350 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1d37d614-4be5-4236-b88b-d42124538010 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:27.936797 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-494bbf94-289d-4e7e-8538-18a6f1b4ab1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:27.967849 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-53b47233-24ef-4615-87b4-98a214790241 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=288630db6ff641f581f1a3d78a9c0081&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6914141 Nov 09 04:29:27.969533 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53622) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:27.972966 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9222bdb4-3b11-4e9e-bef1-0a497a9dc50d tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:27.976448 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53b47233-24ef-4615-87b4-98a214790241 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cc04b2bd-9448-4453-8359-5f32652bc1fb,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:27.995610 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-d0e247a6-da5a-4a11-9820-3c36ca667141 None None] Port 66695da2-5d15-4717-8c15-6199530b694a cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:29:28.004175 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-494bbf94-289d-4e7e-8538-18a6f1b4ab1f None None] Network e366a2cb-d84c-4a09-bffb-dff826896c89 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:29:28.011824 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-494bbf94-289d-4e7e-8538-18a6f1b4ab1f None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:29:28.015443 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-494bbf94-289d-4e7e-8538-18a6f1b4ab1f None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:29:28.034232 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d37d614-4be5-4236-b88b-d42124538010 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Pushing event updated for resources: {'Port': ['ID=6132eda6-c625-4740-a689-1d38c72268d9,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:28.035687 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-494bbf94-289d-4e7e-8538-18a6f1b4ab1f None None] Pushing event updated for resources: {'Port': ['ID=34e0c946-f3ae-4404-b84b-4fd3f4e26fa1,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:28.057718 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d37d614-4be5-4236-b88b-d42124538010 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Checking segment: {'id': 'c48caa46-c5f6-4117-8aca-48a50d5cd811', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': 'a7c7b95d-55e7-4c90-a62a-939c3c718b77'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:29:28.058080 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1d37d614-4be5-4236-b88b-d42124538010 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Network hostable DHCP agents. Network: a7c7b95d-55e7-4c90-a62a-939c3c718b77, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:29:28.095995 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6b0ba2c5-ede9-4ef3-b507-49b39f68deb7 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:28.104441 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 53326cfb-82fd-4c01-b6be-8320fdc356a6 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:29:28.106107 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b0add7e0-f1be-41e2-970c-782ff50687f5 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:28.111729 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-6b0ba2c5-ede9-4ef3-b507-49b39f68deb7 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Calling delete_port for 5f1b04f2-2d14-4367-835c-2c41b3bf4c8b owned by network:router_gateway {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:29:28.139249 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-494bbf94-289d-4e7e-8538-18a6f1b4ab1f None None] Attempting to bind port 34e0c946-f3ae-4404-b84b-4fd3f4e26fa1 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:29:28.139610 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-494bbf94-289d-4e7e-8538-18a6f1b4ab1f None None] Attempting to bind port 34e0c946-f3ae-4404-b84b-4fd3f4e26fa1 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '5d84e43f-201d-4d76-b475-bfebe55b4aea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 335, 'network_id': 'e366a2cb-d84c-4a09-bffb-dff826896c89'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:29:28.140028 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-494bbf94-289d-4e7e-8538-18a6f1b4ab1f None None] Attempting to bind port 34e0c946-f3ae-4404-b84b-4fd3f4e26fa1 on network e366a2cb-d84c-4a09-bffb-dff826896c89 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:29:28.151916 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-494bbf94-289d-4e7e-8538-18a6f1b4ab1f None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 29, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:29:28.156491 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-494bbf94-289d-4e7e-8538-18a6f1b4ab1f None None] Checking segment: {'id': '5d84e43f-201d-4d76-b475-bfebe55b4aea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 335, 'network_id': 'e366a2cb-d84c-4a09-bffb-dff826896c89'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:29:28.156491 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-494bbf94-289d-4e7e-8538-18a6f1b4ab1f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:28.156491 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-494bbf94-289d-4e7e-8538-18a6f1b4ab1f None None] Bound using segment: {'id': '5d84e43f-201d-4d76-b475-bfebe55b4aea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 335, 'network_id': 'e366a2cb-d84c-4a09-bffb-dff826896c89'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:29:28.156491 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-494bbf94-289d-4e7e-8538-18a6f1b4ab1f None None] Bound port: 34e0c946-f3ae-4404-b84b-4fd3f4e26fa1, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5d84e43f-201d-4d76-b475-bfebe55b4aea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 335, 'network_id': 'e366a2cb-d84c-4a09-bffb-dff826896c89'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:29:28.156491 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-494bbf94-289d-4e7e-8538-18a6f1b4ab1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:28.173277 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2b04a3d0-8378-4a16-b43f-49fa9b7a9bc3 None None] Network 807848a2-a4f3-4a57-9607-825f2f20d042 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:29:28.223186 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-b0add7e0-f1be-41e2-970c-782ff50687f5 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Allocated IP 172.26.0.220 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/ff7bbf87-4d4b-4aab-aaee-803cff5a6516) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:29:28.289420 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 53326cfb-82fd-4c01-b6be-8320fdc356a6 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:29:28.289786 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:28.324301 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-494bbf94-289d-4e7e-8538-18a6f1b4ab1f None None] For port 34e0c946-f3ae-4404-b84b-4fd3f4e26fa1, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:29:28.329664 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-8d7a255f-5109-439b-94b1-e9cfb6021771 None None] Provisioning complete for port 53326cfb-82fd-4c01-b6be-8320fdc356a6 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:29:28.330022 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8d7a255f-5109-439b-94b1-e9cfb6021771 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:28.355246 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b0add7e0-f1be-41e2-970c-782ff50687f5 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:28.365689 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-494bbf94-289d-4e7e-8538-18a6f1b4ab1f None None] For port 34e0c946-f3ae-4404-b84b-4fd3f4e26fa1, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=34e0c946-f3ae-4404-b84b-4fd3f4e26fa1,segment=NetworkSegment(5d84e43f-201d-4d76-b475-bfebe55b4aea),segment_id=5d84e43f-201d-4d76-b475-bfebe55b4aea)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:29:28.390968 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1d37d614-4be5-4236-b88b-d42124538010 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Network a7c7b95d-55e7-4c90-a62a-939c3c718b77 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:29:28.446468 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-494bbf94-289d-4e7e-8538-18a6f1b4ab1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:28.470212 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-1d37d614-4be5-4236-b88b-d42124538010 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, a7c7b95d-55e7-4c90-a62a-939c3c718b77) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:29:28.472392 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b0add7e0-f1be-41e2-970c-782ff50687f5 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:28.484900 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1d37d614-4be5-4236-b88b-d42124538010 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:29:28.484900 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1d37d614-4be5-4236-b88b-d42124538010 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:28.507915 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2ca9b834-f090-4175-89a2-8b6dce38dc8f None None] Network a7c7b95d-55e7-4c90-a62a-939c3c718b77 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:29:28.548062 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b0add7e0-f1be-41e2-970c-782ff50687f5 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:29:28.552746 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-b0add7e0-f1be-41e2-970c-782ff50687f5 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:29:28.559045 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b0add7e0-f1be-41e2-970c-782ff50687f5 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:29:28.562813 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0add7e0-f1be-41e2-970c-782ff50687f5 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Pushing event updated for resources: {'Port': ['ID=ff7bbf87-4d4b-4aab-aaee-803cff5a6516,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:28.594655 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2b9f0a15-fd36-46cb-b74a-7feef74442cc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:28.599097 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bb821e5b-0873-4f70-879f-1a0cb05b8302 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:28.635589 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:28.647896 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2b9f0a15-fd36-46cb-b74a-7feef74442cc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:28.651957 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-2b9f0a15-fd36-46cb-b74a-7feef74442cc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] 10.222.0.24 "DELETE /v2.0/ports/9f0ff776-fcb0-4f7a-b1ba-73d3250ac80f HTTP/1.1" status: 204 len: 168 time: 1.5174212 Nov 09 04:29:28.658755 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-494bbf94-289d-4e7e-8538-18a6f1b4ab1f None None] Pushing event updated for resources: {'Port': ['ID=34e0c946-f3ae-4404-b84b-4fd3f4e26fa1,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:28.659645 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53626) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:28.661590 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b9f0a15-fd36-46cb-b74a-7feef74442cc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Pushing event deleted for resources: {'Port': ['ID=9f0ff776-fcb0-4f7a-b1ba-73d3250ac80f,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:28.665733 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9222bdb4-3b11-4e9e-bef1-0a497a9dc50d tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:28.671862 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d37d614-4be5-4236-b88b-d42124538010 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Pushing event updated for resources: {'Port': ['ID=edc3a299-b427-4e90-809c-4858876343c0,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:28.673966 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8d7a255f-5109-439b-94b1-e9cfb6021771 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:28.674558 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d37d614-4be5-4236-b88b-d42124538010 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Checking segment: {'id': '8e6196ef-a897-4937-9f50-82bca1ac84f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 342, 'network_id': '5ec7e43d-8b0b-4507-8c9d-637ec0696714'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:29:28.674558 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1d37d614-4be5-4236-b88b-d42124538010 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Network hostable DHCP agents. Network: 5ec7e43d-8b0b-4507-8c9d-637ec0696714, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:29:28.731102 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bb821e5b-0873-4f70-879f-1a0cb05b8302 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:28.739828 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 53326cfb-82fd-4c01-b6be-8320fdc356a6, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=53326cfb-82fd-4c01-b6be-8320fdc356a6,segment=NetworkSegment(390f9f13-b28d-47b2-8cd2-9f274969fa64),segment_id=390f9f13-b28d-47b2-8cd2-9f274969fa64)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:29:28.743044 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9222bdb4-3b11-4e9e-bef1-0a497a9dc50d tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Pushing event deleted for resources: {'Subnet': ['ID=c66031ce-ca12-4cb0-9734-9397ff18ab6c,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:28.750536 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-dfea70dd-f17b-4341-8121-59a1faf24e1f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] GET failed (client error): The resource could not be found. Nov 09 04:29:28.756565 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-dfea70dd-f17b-4341-8121-59a1faf24e1f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] 10.222.0.24 "GET /v2.0/ports/9f0ff776-fcb0-4f7a-b1ba-73d3250ac80f HTTP/1.1" status: 404 len: 333 time: 0.0842736 Nov 09 04:29:28.757630 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53628) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:28.765940 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-b6da8498-27fe-4aba-850e-bb5178a46025 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Request body: {'port': {'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a', 'name': 'tempest-PortsAdminExtendedAttrsIpV6TestJSON-471697628'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:28.835761 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1d37d614-4be5-4236-b88b-d42124538010 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Network 5ec7e43d-8b0b-4507-8c9d-637ec0696714 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:29:28.872139 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9222bdb4-3b11-4e9e-bef1-0a497a9dc50d tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:28.907076 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-9222bdb4-3b11-4e9e-bef1-0a497a9dc50d tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e366a2cb-d84c-4a09-bffb-dff826896c89']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:28.924276 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:28.926887 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-9222bdb4-3b11-4e9e-bef1-0a497a9dc50d tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5d84e43f-201d-4d76-b475-bfebe55b4aea') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:28.927182 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-9222bdb4-3b11-4e9e-bef1-0a497a9dc50d tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5d84e43f-201d-4d76-b475-bfebe55b4aea') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:28.947436 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9222bdb4-3b11-4e9e-bef1-0a497a9dc50d tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:28.967343 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b6da8498-27fe-4aba-850e-bb5178a46025 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Made reservation on behalf of 657652107bc34ca7983289060f1bd8df for: {'port': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:29:28.968569 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9222bdb4-3b11-4e9e-bef1-0a497a9dc50d tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:28.970158 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b6da8498-27fe-4aba-850e-bb5178a46025 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:28.972294 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-1d37d614-4be5-4236-b88b-d42124538010 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 5ec7e43d-8b0b-4507-8c9d-637ec0696714) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:29:28.977279 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9222bdb4-3b11-4e9e-bef1-0a497a9dc50d tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Releasing vlan 335 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:29:28.978028 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1d37d614-4be5-4236-b88b-d42124538010 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:29:28.978606 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9222bdb4-3b11-4e9e-bef1-0a497a9dc50d tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:28.982483 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:29:28.982483 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:29:28.982483 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:29:28.982483 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:29:28.982483 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:29:28.982483 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:29:28.982483 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:29:28.982483 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:29:28.982483 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:29:28.982483 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:29:28.982483 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:29:28.982483 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:29:28.982483 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:29:28.982483 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:29:28.982483 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:29:28.982483 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:29:28.982483 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:29:28.982483 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:29:28.982483 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:29:28.982483 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:29:28.982483 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:29:28.982483 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:29:28.982483 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:29:28.982483 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:29:28.982483 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:29:28.982483 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:29:28.982483 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:29:28.982483 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:29:28.982483 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:29:28.982483 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:29:28.982483 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:29:28.982483 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:29:28.998593 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1d37d614-4be5-4236-b88b-d42124538010 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:29.003411 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8347904d-8a7e-4202-a6b7-1698b528811e None None] Network 5ec7e43d-8b0b-4507-8c9d-637ec0696714 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:29:29.008064 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1d37d614-4be5-4236-b88b-d42124538010 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:29.008064 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1d37d614-4be5-4236-b88b-d42124538010 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:29.032256 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [None req-b6da8498-27fe-4aba-850e-bb5178a46025 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] device_id is not set on port e95a994c-5360-4e9c-bd69-9635e419fdca yet. {{(pid=102161) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:29:29.043345 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6b0ba2c5-ede9-4ef3-b507-49b39f68deb7 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:29.088274 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b0ba2c5-ede9-4ef3-b507-49b39f68deb7 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Pushing event deleted for resources: {'Port': ['ID=5f1b04f2-2d14-4367-835c-2c41b3bf4c8b,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:29.098850 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bb821e5b-0873-4f70-879f-1a0cb05b8302 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:29.102012 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bb821e5b-0873-4f70-879f-1a0cb05b8302 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:29.105773 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-bb821e5b-0873-4f70-879f-1a0cb05b8302 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/cc04b2bd-9448-4453-8359-5f32652bc1fb HTTP/1.1" status: 204 len: 168 time: 1.1316502 Nov 09 04:29:29.117869 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1d37d614-4be5-4236-b88b-d42124538010 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1450 time: 2.9466515 Nov 09 04:29:29.120816 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53634) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:29.126719 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb821e5b-0873-4f70-879f-1a0cb05b8302 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cc04b2bd-9448-4453-8359-5f32652bc1fb,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:29.146737 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.db.api [None req-8d7a255f-5109-439b-94b1-e9cfb6021771 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=102163) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:29:29.147144 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG oslo_db.api [None req-8d7a255f-5109-439b-94b1-e9cfb6021771 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:29:29.162641 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=53326cfb-82fd-4c01-b6be-8320fdc356a6,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:29.205204 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.db.api [None req-9222bdb4-3b11-4e9e-bef1-0a497a9dc50d tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Nov 09 04:29:29.205204 dv-neutron-816802-2-hyperv neutron-server[102162]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Nov 09 04:29:29.205204 dv-neutron-816802-2-hyperv neutron-server[102162]: [parameters: {'id': 'e366a2cb-d84c-4a09-bffb-dff826896c89'}] Nov 09 04:29:29.205204 dv-neutron-816802-2-hyperv neutron-server[102162]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=102162) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:29:29.205895 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG oslo_db.api [None req-9222bdb4-3b11-4e9e-bef1-0a497a9dc50d tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:29:29.206739 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6b0ba2c5-ede9-4ef3-b507-49b39f68deb7 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-466373'] for router_gateway, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:29.297819 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b0add7e0-f1be-41e2-970c-782ff50687f5 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:29.305609 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6b0ba2c5-ede9-4ef3-b507-49b39f68deb7 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:29.308015 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6b0ba2c5-ede9-4ef3-b507-49b39f68deb7 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:29.349351 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b312cdd9-8cd0-47e8-87fd-8a9154890fbb tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:29.355710 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b312cdd9-8cd0-47e8-87fd-8a9154890fbb tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:29.359925 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-b312cdd9-8cd0-47e8-87fd-8a9154890fbb tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] 10.222.0.24 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1445 time: 0.2354147 Nov 09 04:29:29.360169 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53636) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:29.408026 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6b0ba2c5-ede9-4ef3-b507-49b39f68deb7 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:29.408944 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6b0ba2c5-ede9-4ef3-b507-49b39f68deb7 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Fanout notify agent at l3_agent the message router_deleted on router a43fa85f-7459-401e-af22-bf37c55be422 {{(pid=102162) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:29:29.418750 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6b0ba2c5-ede9-4ef3-b507-49b39f68deb7 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:29.422953 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-6b0ba2c5-ede9-4ef3-b507-49b39f68deb7 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] 10.222.0.24 "DELETE /v2.0/routers/a43fa85f-7459-401e-af22-bf37c55be422 HTTP/1.1" status: 204 len: 168 time: 2.4455154 Nov 09 04:29:29.424381 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53640) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:29.428828 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-efbca8ae-d60f-4074-9ff0-6b9fc2474ebf tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Request body: {'router': {'name': 'tempest-snat-router-495122030', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'enable_snat': False}}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:29.444097 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b6da8498-27fe-4aba-850e-bb5178a46025 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:29.452357 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b0add7e0-f1be-41e2-970c-782ff50687f5 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:29.510044 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-efbca8ae-d60f-4074-9ff0-6b9fc2474ebf tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:29.511679 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-efbca8ae-d60f-4074-9ff0-6b9fc2474ebf tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:29.585089 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-efbca8ae-d60f-4074-9ff0-6b9fc2474ebf tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:29.734156 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9222bdb4-3b11-4e9e-bef1-0a497a9dc50d tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:29.832955 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-4002a940-bd7d-45f3-9b99-c92c379fbb48 None None] Provisioning complete for port 53326cfb-82fd-4c01-b6be-8320fdc356a6 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:29:29.834803 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4002a940-bd7d-45f3-9b99-c92c379fbb48 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:29.841075 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-efbca8ae-d60f-4074-9ff0-6b9fc2474ebf tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:29.868159 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c33f9162-de89-4e50-839b-0931a26eef60 None None] Network e366a2cb-d84c-4a09-bffb-dff826896c89 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:29:29.884760 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-9222bdb4-3b11-4e9e-bef1-0a497a9dc50d tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Deleting port 34e0c946-f3ae-4404-b84b-4fd3f4e26fa1 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:29:29.884760 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9222bdb4-3b11-4e9e-bef1-0a497a9dc50d tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:29.906271 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53644) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:29.929579 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b6da8498-27fe-4aba-850e-bb5178a46025 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:29.942014 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-5eca62aa-0b50-4005-b19a-c9a10f706cbe tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Deleting port 6132eda6-c625-4740-a689-1d38c72268d9 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:29:29.942615 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5eca62aa-0b50-4005-b19a-c9a10f706cbe tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:29.972927 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f5494fef-52c8-4e95-98a9-f8d9d200a3b3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:30.057162 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b6da8498-27fe-4aba-850e-bb5178a46025 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Network c53bac62-4539-4143-874d-1fffa9d5216a is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:29:30.071263 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-b6da8498-27fe-4aba-850e-bb5178a46025 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:29:30.086822 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b6da8498-27fe-4aba-850e-bb5178a46025 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:29:30.087726 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b6da8498-27fe-4aba-850e-bb5178a46025 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:30.088324 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b6da8498-27fe-4aba-850e-bb5178a46025 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:30.094069 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6da8498-27fe-4aba-850e-bb5178a46025 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Pushing event updated for resources: {'Port': ['ID=e95a994c-5360-4e9c-bd69-9635e419fdca,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:30.097410 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5eca62aa-0b50-4005-b19a-c9a10f706cbe tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:30.109372 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-9222bdb4-3b11-4e9e-bef1-0a497a9dc50d tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] For port 34e0c946-f3ae-4404-b84b-4fd3f4e26fa1, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=34e0c946-f3ae-4404-b84b-4fd3f4e26fa1,segment=NetworkSegment(5d84e43f-201d-4d76-b475-bfebe55b4aea),segment_id=5d84e43f-201d-4d76-b475-bfebe55b4aea)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:29:30.109871 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9222bdb4-3b11-4e9e-bef1-0a497a9dc50d tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:30.130652 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-5eca62aa-0b50-4005-b19a-c9a10f706cbe tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Calling delete_port for 6132eda6-c625-4740-a689-1d38c72268d9 owned by {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:29:30.137397 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-9222bdb4-3b11-4e9e-bef1-0a497a9dc50d tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Calling delete_port for 34e0c946-f3ae-4404-b84b-4fd3f4e26fa1 owned by network:dhcp {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:29:30.138758 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b0add7e0-f1be-41e2-970c-782ff50687f5 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:30.176885 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-628441c8-0fa6-4036-b071-3f50fd771888 None None] DHCP port deletion for e366a2cb-d84c-4a09-bffb-dff826896c89 request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:29:30.188769 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-b6da8498-27fe-4aba-850e-bb5178a46025 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 963 time: 1.4286780 Nov 09 04:29:30.191507 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53648) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:30.196877 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Request body: {'port': {'binding:host_id': 'hv-neutron-8168'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:30.201335 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f5494fef-52c8-4e95-98a9-f8d9d200a3b3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:30.222898 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 53326cfb-82fd-4c01-b6be-8320fdc356a6 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:29:30.229282 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-f64bf200-773f-4b20-9144-dd53a2ece255 None None] Provisioning complete for port 34e0c946-f3ae-4404-b84b-4fd3f4e26fa1 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:29:30.229673 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b0add7e0-f1be-41e2-970c-782ff50687f5 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:30.229864 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f64bf200-773f-4b20-9144-dd53a2ece255 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:30.327775 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-628441c8-0fa6-4036-b071-3f50fd771888 None None] Deleting port 34e0c946-f3ae-4404-b84b-4fd3f4e26fa1 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:29:30.328161 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-628441c8-0fa6-4036-b071-3f50fd771888 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:30.331758 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f5494fef-52c8-4e95-98a9-f8d9d200a3b3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:30.342430 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0add7e0-f1be-41e2-970c-782ff50687f5 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Pushing event updated for resources: {'Port': ['ID=ff7bbf87-4d4b-4aab-aaee-803cff5a6516,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:30.346498 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:30.397356 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9222bdb4-3b11-4e9e-bef1-0a497a9dc50d tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:30.407598 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b0add7e0-f1be-41e2-970c-782ff50687f5 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:30.418946 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5eca62aa-0b50-4005-b19a-c9a10f706cbe tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:30.454215 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-f5494fef-52c8-4e95-98a9-f8d9d200a3b3 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=de013c7fddc2441aa0a309889348b682&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5442297 Nov 09 04:29:30.454215 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5494fef-52c8-4e95-98a9-f8d9d200a3b3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=133ecbb1-77b5-42f7-b116-2cf5f7be48fa,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:30.454871 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53650) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:30.467142 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9222bdb4-3b11-4e9e-bef1-0a497a9dc50d tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Pushing event deleted for resources: {'Port': ['ID=34e0c946-f3ae-4404-b84b-4fd3f4e26fa1,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:30.473801 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9222bdb4-3b11-4e9e-bef1-0a497a9dc50d tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] No DVR routers for this DVR port 34e0c946-f3ae-4404-b84b-4fd3f4e26fa1 on host dv-neutron-816802-2-hyperv {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:29:30.497336 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5eca62aa-0b50-4005-b19a-c9a10f706cbe tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Pushing event deleted for resources: {'Port': ['ID=6132eda6-c625-4740-a689-1d38c72268d9,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:30.505880 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5eca62aa-0b50-4005-b19a-c9a10f706cbe tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:30.509180 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-5eca62aa-0b50-4005-b19a-c9a10f706cbe tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] 10.222.0.24 "DELETE /v2.0/ports/6132eda6-c625-4740-a689-1d38c72268d9 HTTP/1.1" status: 204 len: 168 time: 1.1480494 Nov 09 04:29:30.513338 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53654) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:30.522197 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-efbca8ae-d60f-4074-9ff0-6b9fc2474ebf tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:30.536093 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b0add7e0-f1be-41e2-970c-782ff50687f5 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:30.537878 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-b0add7e0-f1be-41e2-970c-782ff50687f5 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] 10.222.0.24 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 2.8092151 Nov 09 04:29:30.558978 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53656) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:30.563816 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-0d38a8fe-2e42-434e-b903-2a8c980e95bc tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Request body: {'floatingip': {'port_id': '66695da2-5d15-4717-8c15-6199530b694a', 'fixed_ip_address': '172.20.0.13'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:30.566629 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-efbca8ae-d60f-4074-9ff0-6b9fc2474ebf tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:30.572803 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 53326cfb-82fd-4c01-b6be-8320fdc356a6 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:29:30.574054 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:30.628196 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0d38a8fe-2e42-434e-b903-2a8c980e95bc tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks [] for floatingip, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:30.644900 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9222bdb4-3b11-4e9e-bef1-0a497a9dc50d tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:30.665232 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f64bf200-773f-4b20-9144-dd53a2ece255 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:30.675699 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6deb2459-1e0c-43af-a173-0b8e8904a2df admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:30.681685 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-628441c8-0fa6-4036-b071-3f50fd771888 None None] For port 34e0c946-f3ae-4404-b84b-4fd3f4e26fa1, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=34e0c946-f3ae-4404-b84b-4fd3f4e26fa1,segment=NetworkSegment(5d84e43f-201d-4d76-b475-bfebe55b4aea),segment_id=5d84e43f-201d-4d76-b475-bfebe55b4aea)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:29:30.682346 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-628441c8-0fa6-4036-b071-3f50fd771888 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:30.687986 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-9222bdb4-3b11-4e9e-bef1-0a497a9dc50d tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e366a2cb-d84c-4a09-bffb-dff826896c89']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:30.709939 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-9222bdb4-3b11-4e9e-bef1-0a497a9dc50d tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5d84e43f-201d-4d76-b475-bfebe55b4aea') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:30.710608 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-9222bdb4-3b11-4e9e-bef1-0a497a9dc50d tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5d84e43f-201d-4d76-b475-bfebe55b4aea') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:30.711499 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-628441c8-0fa6-4036-b071-3f50fd771888 None None] Calling delete_port for 34e0c946-f3ae-4404-b84b-4fd3f4e26fa1 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:29:30.752668 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9222bdb4-3b11-4e9e-bef1-0a497a9dc50d tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:30.757614 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6deb2459-1e0c-43af-a173-0b8e8904a2df admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:30.783574 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9222bdb4-3b11-4e9e-bef1-0a497a9dc50d tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:30.799201 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] device_id is not set on port e95a994c-5360-4e9c-bd69-9635e419fdca yet. {{(pid=102161) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:29:30.809817 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9222bdb4-3b11-4e9e-bef1-0a497a9dc50d tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Releasing vlan 335 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:29:30.810215 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9222bdb4-3b11-4e9e-bef1-0a497a9dc50d tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:30.816934 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:30.817139 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:29:30.817139 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:29:30.817139 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:29:30.817139 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:29:30.817139 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:29:30.817139 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:29:30.817139 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:29:30.817139 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:29:30.817139 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:29:30.817139 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:29:30.817139 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:29:30.817139 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:29:30.817139 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:29:30.817139 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:29:30.817139 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:29:30.817139 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:29:30.817139 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:29:30.817139 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:29:30.817139 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:29:30.817139 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:29:30.817139 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:29:30.817139 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:29:30.817139 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:29:30.817139 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:29:30.817139 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:29:30.817139 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:29:30.817139 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:29:30.817139 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:29:30.817139 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:29:30.817139 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:29:30.817139 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:29:30.817139 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:29:30.821152 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-efbca8ae-d60f-4074-9ff0-6b9fc2474ebf tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Allocated IP 172.26.0.178 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/0b0033a1-902f-4286-9df5-9ba2ca69d4f9) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:29:30.827136 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-0d38a8fe-2e42-434e-b903-2a8c980e95bc tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] update failed (client error): The resource could not be found. Nov 09 04:29:30.828223 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-0d38a8fe-2e42-434e-b903-2a8c980e95bc tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] 10.222.0.24 "PUT /v2.0/floatingips/89296203-cd00-42e9-a073-0b3128943398 HTTP/1.1" status: 404 len: 507 time: 0.2680316 Nov 09 04:29:30.832890 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-1c9d9cda-f331-4a65-8803-c59e41f6b81b tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Deleting port edc3a299-b427-4e90-809c-4858876343c0 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:29:30.833230 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1c9d9cda-f331-4a65-8803-c59e41f6b81b tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:30.834907 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53658) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:30.867859 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-628441c8-0fa6-4036-b071-3f50fd771888 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:30.897911 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-628441c8-0fa6-4036-b071-3f50fd771888 None None] Pushing event deleted for resources: {'Port': ['ID=34e0c946-f3ae-4404-b84b-4fd3f4e26fa1,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:30.899842 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-628441c8-0fa6-4036-b071-3f50fd771888 None None] No DVR routers for this DVR port 34e0c946-f3ae-4404-b84b-4fd3f4e26fa1 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:29:30.912371 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:30.965413 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1c9d9cda-f331-4a65-8803-c59e41f6b81b tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:30.986295 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-1c9d9cda-f331-4a65-8803-c59e41f6b81b tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Calling delete_port for edc3a299-b427-4e90-809c-4858876343c0 owned by {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:29:31.009155 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Pushing event updated for resources: {'Port': ['ID=e95a994c-5360-4e9c-bd69-9635e419fdca,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:31.036024 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9222bdb4-3b11-4e9e-bef1-0a497a9dc50d tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:31.045153 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port e95a994c-5360-4e9c-bd69-9635e419fdca on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:29:31.045480 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port e95a994c-5360-4e9c-bd69-9635e419fdca by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] {{(pid=102161) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:29:31.045956 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port e95a994c-5360-4e9c-bd69-9635e419fdca on network c53bac62-4539-4143-874d-1fffa9d5216a {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:29:31.048132 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9222bdb4-3b11-4e9e-bef1-0a497a9dc50d tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:31.055552 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-9222bdb4-3b11-4e9e-bef1-0a497a9dc50d tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "DELETE /v2.0/networks/e366a2cb-d84c-4a09-bffb-dff826896c89 HTTP/1.1" status: 204 len: 168 time: 3.6994607 Nov 09 04:29:31.056051 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Port e95a994c-5360-4e9c-bd69-9635e419fdca on network c53bac62-4539-4143-874d-1fffa9d5216a not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:29:31.056456 dv-neutron-816802-2-hyperv neutron-server[102161]: ERROR neutron.plugins.ml2.managers [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Failed to bind port e95a994c-5360-4e9c-bd69-9635e419fdca on host hv-neutron-8168 for vnic_type normal using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] Nov 09 04:29:31.056571 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53660) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:31.057852 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.plugins.ml2.plugin [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempt 2 to bind port e95a994c-5360-4e9c-bd69-9635e419fdca Nov 09 04:29:31.069685 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-7aace36d-6621-45e9-9066-5524f6b55e9f tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1446155219'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:31.079000 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port e95a994c-5360-4e9c-bd69-9635e419fdca on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:29:31.079331 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port e95a994c-5360-4e9c-bd69-9635e419fdca by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] {{(pid=102161) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:29:31.079485 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9222bdb4-3b11-4e9e-bef1-0a497a9dc50d tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Pushing event deleted for resources: {'Network': ['ID=e366a2cb-d84c-4a09-bffb-dff826896c89,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:31.079680 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port e95a994c-5360-4e9c-bd69-9635e419fdca on network c53bac62-4539-4143-874d-1fffa9d5216a {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:29:31.081154 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6deb2459-1e0c-43af-a173-0b8e8904a2df admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:31.084237 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6deb2459-1e0c-43af-a173-0b8e8904a2df admin admin] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:31.085308 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-6deb2459-1e0c-43af-a173-0b8e8904a2df admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/133ecbb1-77b5-42f7-b116-2cf5f7be48fa HTTP/1.1" status: 204 len: 168 time: 0.6274450 Nov 09 04:29:31.088034 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Port e95a994c-5360-4e9c-bd69-9635e419fdca on network c53bac62-4539-4143-874d-1fffa9d5216a not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:29:31.088371 dv-neutron-816802-2-hyperv neutron-server[102161]: ERROR neutron.plugins.ml2.managers [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Failed to bind port e95a994c-5360-4e9c-bd69-9635e419fdca on host hv-neutron-8168 for vnic_type normal using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] Nov 09 04:29:31.089967 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.plugins.ml2.plugin [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempt 3 to bind port e95a994c-5360-4e9c-bd69-9635e419fdca Nov 09 04:29:31.109314 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port e95a994c-5360-4e9c-bd69-9635e419fdca on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:29:31.109652 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port e95a994c-5360-4e9c-bd69-9635e419fdca by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] {{(pid=102161) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:29:31.109992 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port e95a994c-5360-4e9c-bd69-9635e419fdca on network c53bac62-4539-4143-874d-1fffa9d5216a {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:29:31.115173 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Port e95a994c-5360-4e9c-bd69-9635e419fdca on network c53bac62-4539-4143-874d-1fffa9d5216a not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:29:31.115488 dv-neutron-816802-2-hyperv neutron-server[102161]: ERROR neutron.plugins.ml2.managers [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Failed to bind port e95a994c-5360-4e9c-bd69-9635e419fdca on host hv-neutron-8168 for vnic_type normal using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] Nov 09 04:29:31.116828 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.plugins.ml2.plugin [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempt 4 to bind port e95a994c-5360-4e9c-bd69-9635e419fdca Nov 09 04:29:31.122576 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6deb2459-1e0c-43af-a173-0b8e8904a2df admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=133ecbb1-77b5-42f7-b116-2cf5f7be48fa,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:31.129574 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port e95a994c-5360-4e9c-bd69-9635e419fdca on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:29:31.129959 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port e95a994c-5360-4e9c-bd69-9635e419fdca by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] {{(pid=102161) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:29:31.130478 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port e95a994c-5360-4e9c-bd69-9635e419fdca on network c53bac62-4539-4143-874d-1fffa9d5216a {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:29:31.132048 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-efbca8ae-d60f-4074-9ff0-6b9fc2474ebf tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:31.135652 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Port e95a994c-5360-4e9c-bd69-9635e419fdca on network c53bac62-4539-4143-874d-1fffa9d5216a not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:29:31.136163 dv-neutron-816802-2-hyperv neutron-server[102161]: ERROR neutron.plugins.ml2.managers [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Failed to bind port e95a994c-5360-4e9c-bd69-9635e419fdca on host hv-neutron-8168 for vnic_type normal using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] Nov 09 04:29:31.136496 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.plugins.ml2.plugin [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempt 5 to bind port e95a994c-5360-4e9c-bd69-9635e419fdca Nov 09 04:29:31.151625 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port e95a994c-5360-4e9c-bd69-9635e419fdca on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:29:31.152042 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port e95a994c-5360-4e9c-bd69-9635e419fdca by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] {{(pid=102161) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:29:31.152590 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port e95a994c-5360-4e9c-bd69-9635e419fdca on network c53bac62-4539-4143-874d-1fffa9d5216a {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:29:31.153477 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-155a1dbd-e56b-4501-bc84-6dd89281a58b tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Deleting port ff7bbf87-4d4b-4aab-aaee-803cff5a6516 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:29:31.153801 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-155a1dbd-e56b-4501-bc84-6dd89281a58b tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:31.158269 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Port e95a994c-5360-4e9c-bd69-9635e419fdca on network c53bac62-4539-4143-874d-1fffa9d5216a not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:29:31.158779 dv-neutron-816802-2-hyperv neutron-server[102161]: ERROR neutron.plugins.ml2.managers [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Failed to bind port e95a994c-5360-4e9c-bd69-9635e419fdca on host hv-neutron-8168 for vnic_type normal using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] Nov 09 04:29:31.159238 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.plugins.ml2.plugin [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempt 6 to bind port e95a994c-5360-4e9c-bd69-9635e419fdca Nov 09 04:29:31.164657 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1c9d9cda-f331-4a65-8803-c59e41f6b81b tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:31.200222 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port e95a994c-5360-4e9c-bd69-9635e419fdca on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:29:31.200555 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port e95a994c-5360-4e9c-bd69-9635e419fdca by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] {{(pid=102161) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:29:31.200901 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port e95a994c-5360-4e9c-bd69-9635e419fdca on network c53bac62-4539-4143-874d-1fffa9d5216a {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:29:31.205322 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c9d9cda-f331-4a65-8803-c59e41f6b81b tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Pushing event deleted for resources: {'Port': ['ID=edc3a299-b427-4e90-809c-4858876343c0,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:31.211676 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1c9d9cda-f331-4a65-8803-c59e41f6b81b tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:31.211829 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7aace36d-6621-45e9-9066-5524f6b55e9f tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Made reservation on behalf of 83cbb798c0f44b268f8acd2a70eb745a for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:29:31.214249 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1c9d9cda-f331-4a65-8803-c59e41f6b81b tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] 10.222.0.24 "DELETE /v2.0/ports/edc3a299-b427-4e90-809c-4858876343c0 HTTP/1.1" status: 204 len: 168 time: 0.6999314 Nov 09 04:29:31.215299 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Port e95a994c-5360-4e9c-bd69-9635e419fdca on network c53bac62-4539-4143-874d-1fffa9d5216a not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:29:31.215628 dv-neutron-816802-2-hyperv neutron-server[102161]: ERROR neutron.plugins.ml2.managers [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Failed to bind port e95a994c-5360-4e9c-bd69-9635e419fdca on host hv-neutron-8168 for vnic_type normal using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] Nov 09 04:29:31.216019 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.plugins.ml2.plugin [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempt 7 to bind port e95a994c-5360-4e9c-bd69-9635e419fdca Nov 09 04:29:31.217852 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7aace36d-6621-45e9-9066-5524f6b55e9f tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:31.221757 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53664) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:31.256576 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-2e535aa2-f0ce-4c8a-89b1-c0e5c4406fa9 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] 10.222.0.24 "GET /v2.0/ports HTTP/1.1" status: 200 len: 205 time: 0.0335987 Nov 09 04:29:31.259308 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port e95a994c-5360-4e9c-bd69-9635e419fdca on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:29:31.259733 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port e95a994c-5360-4e9c-bd69-9635e419fdca by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] {{(pid=102161) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:29:31.260080 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port e95a994c-5360-4e9c-bd69-9635e419fdca on network c53bac62-4539-4143-874d-1fffa9d5216a {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:29:31.261345 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53668) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:31.265856 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Port e95a994c-5360-4e9c-bd69-9635e419fdca on network c53bac62-4539-4143-874d-1fffa9d5216a not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:29:31.270270 dv-neutron-816802-2-hyperv neutron-server[102161]: ERROR neutron.plugins.ml2.managers [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Failed to bind port e95a994c-5360-4e9c-bd69-9635e419fdca on host hv-neutron-8168 for vnic_type normal using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] Nov 09 04:29:31.270270 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.plugins.ml2.plugin [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempt 8 to bind port e95a994c-5360-4e9c-bd69-9635e419fdca Nov 09 04:29:31.270478 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-100efcf4-8d74-4ee5-bb27-123820a302fc tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsIpV6Test-test-network-644829990'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:31.277951 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7aace36d-6621-45e9-9066-5524f6b55e9f tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 314} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:29:31.279428 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port e95a994c-5360-4e9c-bd69-9635e419fdca on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:29:31.279752 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port e95a994c-5360-4e9c-bd69-9635e419fdca by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] {{(pid=102161) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:29:31.280089 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port e95a994c-5360-4e9c-bd69-9635e419fdca on network c53bac62-4539-4143-874d-1fffa9d5216a {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:29:31.284544 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Port e95a994c-5360-4e9c-bd69-9635e419fdca on network c53bac62-4539-4143-874d-1fffa9d5216a not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:29:31.284875 dv-neutron-816802-2-hyperv neutron-server[102161]: ERROR neutron.plugins.ml2.managers [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Failed to bind port e95a994c-5360-4e9c-bd69-9635e419fdca on host hv-neutron-8168 for vnic_type normal using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] Nov 09 04:29:31.285319 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.plugins.ml2.plugin [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempt 9 to bind port e95a994c-5360-4e9c-bd69-9635e419fdca Nov 09 04:29:31.297282 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-efbca8ae-d60f-4074-9ff0-6b9fc2474ebf tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:31.299570 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port e95a994c-5360-4e9c-bd69-9635e419fdca on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:29:31.299903 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port e95a994c-5360-4e9c-bd69-9635e419fdca by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] {{(pid=102161) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:29:31.300127 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-155a1dbd-e56b-4501-bc84-6dd89281a58b tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:31.300241 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port e95a994c-5360-4e9c-bd69-9635e419fdca on network c53bac62-4539-4143-874d-1fffa9d5216a {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:29:31.300441 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-155a1dbd-e56b-4501-bc84-6dd89281a58b tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:31.305085 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Port e95a994c-5360-4e9c-bd69-9635e419fdca on network c53bac62-4539-4143-874d-1fffa9d5216a not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:29:31.305411 dv-neutron-816802-2-hyperv neutron-server[102161]: ERROR neutron.plugins.ml2.managers [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Failed to bind port e95a994c-5360-4e9c-bd69-9635e419fdca on host hv-neutron-8168 for vnic_type normal using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] Nov 09 04:29:31.305800 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.plugins.ml2.plugin [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempt 10 to bind port e95a994c-5360-4e9c-bd69-9635e419fdca Nov 09 04:29:31.318118 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port e95a994c-5360-4e9c-bd69-9635e419fdca on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:29:31.318483 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port e95a994c-5360-4e9c-bd69-9635e419fdca by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] {{(pid=102161) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:29:31.318600 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7aace36d-6621-45e9-9066-5524f6b55e9f tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:31.318819 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempting to bind port e95a994c-5360-4e9c-bd69-9635e419fdca on network c53bac62-4539-4143-874d-1fffa9d5216a {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:29:31.318926 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-7aace36d-6621-45e9-9066-5524f6b55e9f tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Added segment 9739d82e-de07-4efb-a846-2223dbf69c3a of type vlan for network 180d6f69-3e84-4af4-8ec3-10d9d54fc8a4 Nov 09 04:29:31.323418 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Port e95a994c-5360-4e9c-bd69-9635e419fdca on network c53bac62-4539-4143-874d-1fffa9d5216a not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:29:31.323560 dv-neutron-816802-2-hyperv neutron-server[102161]: ERROR neutron.plugins.ml2.managers [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Failed to bind port e95a994c-5360-4e9c-bd69-9635e419fdca on host hv-neutron-8168 for vnic_type normal using segments [{'id': '045dd48a-2a31-466f-8e9a-f939dcaa97e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'c53bac62-4539-4143-874d-1fffa9d5216a'}] Nov 09 04:29:31.324223 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:31.352683 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-155a1dbd-e56b-4501-bc84-6dd89281a58b tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Calling delete_port for ff7bbf87-4d4b-4aab-aaee-803cff5a6516 owned by network:floatingip {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:29:31.392168 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-efbca8ae-d60f-4074-9ff0-6b9fc2474ebf tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:29:31.392687 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] For port e95a994c-5360-4e9c-bd69-9635e419fdca, host hv-neutron-8168, cleared binding levels {{(pid=102161) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:29:31.393070 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attempted to set empty binding levels {{(pid=102161) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:65}} Nov 09 04:29:31.404915 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-efbca8ae-d60f-4074-9ff0-6b9fc2474ebf tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:29:31.412770 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-efbca8ae-d60f-4074-9ff0-6b9fc2474ebf tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Pushing event updated for resources: {'Port': ['ID=0b0033a1-902f-4286-9df5-9ba2ca69d4f9,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:31.416471 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-efbca8ae-d60f-4074-9ff0-6b9fc2474ebf tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:29:31.448607 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7aace36d-6621-45e9-9066-5524f6b55e9f tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:31.454726 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-100efcf4-8d74-4ee5-bb27-123820a302fc tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Made reservation on behalf of 34508a55938a43c2b57acd8dc368e922 for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:29:31.458548 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-100efcf4-8d74-4ee5-bb27-123820a302fc tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:31.463483 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:29:31.470121 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:31.506770 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] In _notify_port_updated(), no bound segment for port e95a994c-5360-4e9c-bd69-9635e419fdca on network c53bac62-4539-4143-874d-1fffa9d5216a {{(pid=102161) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 09 04:29:31.507630 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:31.508211 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:31.510061 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] 10.222.0.24 "PUT /v2.0/ports/e95a994c-5360-4e9c-bd69-9635e419fdca HTTP/1.1" status: 200 len: 980 time: 1.3170643 Nov 09 04:29:31.513202 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53672) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:31.557430 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-100efcf4-8d74-4ee5-bb27-123820a302fc tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 317} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:29:31.559384 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46021d3a-0fd0-4213-b4ed-4cd36de41365 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Pushing event updated for resources: {'Port': ['ID=e95a994c-5360-4e9c-bd69-9635e419fdca,revision_number=3']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:31.610491 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7aace36d-6621-45e9-9066-5524f6b55e9f tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:31.613776 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-bc49fa2e-b718-4ef5-a50f-ac8e6d7fd7ef tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Deleting port e95a994c-5360-4e9c-bd69-9635e419fdca {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:29:31.614153 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bc49fa2e-b718-4ef5-a50f-ac8e6d7fd7ef tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:31.617155 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7aace36d-6621-45e9-9066-5524f6b55e9f tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:31.617336 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7aace36d-6621-45e9-9066-5524f6b55e9f tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:31.713516 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-bc49fa2e-b718-4ef5-a50f-ac8e6d7fd7ef tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] For port e95a994c-5360-4e9c-bd69-9635e419fdca, host hv-neutron-8168, got binding levels [] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:29:31.713948 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bc49fa2e-b718-4ef5-a50f-ac8e6d7fd7ef tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:31.724792 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-100efcf4-8d74-4ee5-bb27-123820a302fc tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:31.725143 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-100efcf4-8d74-4ee5-bb27-123820a302fc tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Added segment dd9e8fdb-1a91-4c9d-9808-cd8fbf4dbb3d of type vlan for network 7b21ba4a-ddd5-4fb9-9bfd-bc86bfc5cedf Nov 09 04:29:31.734199 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-bc49fa2e-b718-4ef5-a50f-ac8e6d7fd7ef tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Calling delete_port for e95a994c-5360-4e9c-bd69-9635e419fdca owned by {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:29:31.768501 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7aace36d-6621-45e9-9066-5524f6b55e9f tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Pushing event updated for resources: {'Network': ['ID=180d6f69-3e84-4af4-8ec3-10d9d54fc8a4,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:31.779965 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 180d6f69-3e84-4af4-8ec3-10d9d54fc8a4 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:29:31.855806 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-7aace36d-6621-45e9-9066-5524f6b55e9f tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 0.7985194 Nov 09 04:29:31.857565 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-100efcf4-8d74-4ee5-bb27-123820a302fc tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:31.858913 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53682) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:31.864365 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-9ab1f05e-25f4-45a0-a3c5-d973b864fc07 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Request body: {'subnet': {'network_id': '180d6f69-3e84-4af4-8ec3-10d9d54fc8a4', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': None, 'host_routes': [{'destination': '2001::/64', 'nexthop': '2003::1'}], 'dns_nameservers': ['2001:4860:4860::8844', '2001:4860:4860::8888']}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:31.931681 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bc49fa2e-b718-4ef5-a50f-ac8e6d7fd7ef tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:31.980358 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-155a1dbd-e56b-4501-bc84-6dd89281a58b tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:31.983611 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc49fa2e-b718-4ef5-a50f-ac8e6d7fd7ef tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Pushing event deleted for resources: {'Port': ['ID=e95a994c-5360-4e9c-bd69-9635e419fdca,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:31.985935 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 34e0c946-f3ae-4404-b84b-4fd3f4e26fa1 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:29:31.993467 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bc49fa2e-b718-4ef5-a50f-ac8e6d7fd7ef tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:31.996641 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-bc49fa2e-b718-4ef5-a50f-ac8e6d7fd7ef tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] 10.222.0.24 "DELETE /v2.0/ports/e95a994c-5360-4e9c-bd69-9635e419fdca HTTP/1.1" status: 204 len: 168 time: 0.4825034 Nov 09 04:29:31.999210 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53686) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:32.028252 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-78befc18-1f57-47f9-901f-d1013c987a1a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] GET failed (client error): The resource could not be found. Nov 09 04:29:32.029797 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-78befc18-1f57-47f9-901f-d1013c987a1a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1500849293-project-admin] 10.222.0.24 "GET /v2.0/ports/e95a994c-5360-4e9c-bd69-9635e419fdca HTTP/1.1" status: 404 len: 333 time: 0.0296834 Nov 09 04:29:32.034781 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53688) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:32.040736 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 34e0c946-f3ae-4404-b84b-4fd3f4e26fa1 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:29:32.041203 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 34e0c946-f3ae-4404-b84b-4fd3f4e26fa1 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:29:32.043191 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-100efcf4-8d74-4ee5-bb27-123820a302fc tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:32.050413 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-100efcf4-8d74-4ee5-bb27-123820a302fc tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:32.051050 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-100efcf4-8d74-4ee5-bb27-123820a302fc tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:32.094782 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-155a1dbd-e56b-4501-bc84-6dd89281a58b tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Pushing event deleted for resources: {'Port': ['ID=ff7bbf87-4d4b-4aab-aaee-803cff5a6516,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:32.116902 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-58afe494-f264-437c-bdb6-91c520039362 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:32.123753 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9ab1f05e-25f4-45a0-a3c5-d973b864fc07 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Made reservation on behalf of 83cbb798c0f44b268f8acd2a70eb745a for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:29:32.128347 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9ab1f05e-25f4-45a0-a3c5-d973b864fc07 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:32.297497 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-58afe494-f264-437c-bdb6-91c520039362 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:32.328510 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-58afe494-f264-437c-bdb6-91c520039362 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c53bac62-4539-4143-874d-1fffa9d5216a']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:32.343160 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-58afe494-f264-437c-bdb6-91c520039362 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '045dd48a-2a31-466f-8e9a-f939dcaa97e8') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:32.343584 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-58afe494-f264-437c-bdb6-91c520039362 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '045dd48a-2a31-466f-8e9a-f939dcaa97e8') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:32.359518 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-58afe494-f264-437c-bdb6-91c520039362 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:32.402026 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-58afe494-f264-437c-bdb6-91c520039362 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:32.419154 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-58afe494-f264-437c-bdb6-91c520039362 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649-project] Releasing vlan 340 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:29:32.419723 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-58afe494-f264-437c-bdb6-91c520039362 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:32.423692 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:29:32.423692 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:29:32.423692 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:29:32.423692 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:29:32.423692 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:29:32.423692 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:29:32.423692 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:29:32.423692 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:29:32.423692 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:29:32.423692 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:29:32.423692 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:29:32.423692 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:29:32.423692 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:29:32.423692 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:29:32.423692 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:29:32.423692 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:29:32.423692 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:29:32.423692 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:29:32.423692 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:29:32.423692 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:29:32.423692 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:29:32.423692 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:29:32.423692 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:29:32.423692 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:29:32.423692 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:29:32.423692 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:29:32.423692 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:29:32.423692 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:29:32.423692 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:29:32.423692 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:29:32.423692 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:29:32.423692 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:29:32.503305 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-100efcf4-8d74-4ee5-bb27-123820a302fc tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 789 time: 1.2342458 Nov 09 04:29:32.503851 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53702) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:32.513712 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-f30ed2dd-bca0-4883-961b-79278f36f52a tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsIpV6Test-test-network-544517737'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:32.529518 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-100efcf4-8d74-4ee5-bb27-123820a302fc tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Pushing event updated for resources: {'Network': ['ID=7b21ba4a-ddd5-4fb9-9bfd-bc86bfc5cedf,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:32.536979 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-155a1dbd-e56b-4501-bc84-6dd89281a58b tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks [] for floatingip, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:32.541185 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 7b21ba4a-ddd5-4fb9-9bfd-bc86bfc5cedf details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:29:32.541520 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-155a1dbd-e56b-4501-bc84-6dd89281a58b tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:32.543672 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-155a1dbd-e56b-4501-bc84-6dd89281a58b tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] 10.222.0.24 "DELETE /v2.0/floatingips/89296203-cd00-42e9-a073-0b3128943398 HTTP/1.1" status: 204 len: 168 time: 1.7068472 Nov 09 04:29:32.547753 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-efbca8ae-d60f-4074-9ff0-6b9fc2474ebf tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:32.571135 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53704) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:32.576781 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-64e37b7e-3d60-485b-a0d4-e8160ecd6713 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Request body: {'floatingip': {'floating_network_id': '95c56523-9e9a-4f6f-aa13-0372772dbac5', 'port_id': '66695da2-5d15-4717-8c15-6199530b694a', 'fixed_ip_address': '172.20.0.13'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:32.861794 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-efbca8ae-d60f-4074-9ff0-6b9fc2474ebf tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:32.903894 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-58afe494-f264-437c-bdb6-91c520039362 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:32.914634 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-58afe494-f264-437c-bdb6-91c520039362 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:32.914634 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-58afe494-f264-437c-bdb6-91c520039362 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649-project] 10.222.0.24 "DELETE /v2.0/networks/c53bac62-4539-4143-874d-1fffa9d5216a HTTP/1.1" status: 204 len: 168 time: 0.8768001 Nov 09 04:29:32.926636 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58afe494-f264-437c-bdb6-91c520039362 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013421649-project] Pushing event deleted for resources: {'Network': ['ID=c53bac62-4539-4143-874d-1fffa9d5216a,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:33.074223 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9ab1f05e-25f4-45a0-a3c5-d973b864fc07 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:33.075971 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f30ed2dd-bca0-4883-961b-79278f36f52a tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Made reservation on behalf of 34508a55938a43c2b57acd8dc368e922 for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:29:33.080477 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f30ed2dd-bca0-4883-961b-79278f36f52a tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:33.151519 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f30ed2dd-bca0-4883-961b-79278f36f52a tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 338} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:29:33.171174 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ab1f05e-25f4-45a0-a3c5-d973b864fc07 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Pushing event updated for resources: {'Subnet': ['ID=d1015856-53b0-4ad8-93eb-806eb31ac49a,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:33.177005 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f30ed2dd-bca0-4883-961b-79278f36f52a tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:33.177914 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-f30ed2dd-bca0-4883-961b-79278f36f52a tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Added segment b391b776-41a7-46e7-9bd7-6dc78d4db991 of type vlan for network 535db112-7a68-4365-80ba-d9b95c16b4de Nov 09 04:29:33.190854 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9ab1f05e-25f4-45a0-a3c5-d973b864fc07 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Checking segment: {'id': '9739d82e-de07-4efb-a846-2223dbf69c3a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 314, 'network_id': '180d6f69-3e84-4af4-8ec3-10d9d54fc8a4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:29:33.191211 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9ab1f05e-25f4-45a0-a3c5-d973b864fc07 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Network hostable DHCP agents. Network: 180d6f69-3e84-4af4-8ec3-10d9d54fc8a4, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:29:33.195480 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-efbca8ae-d60f-4074-9ff0-6b9fc2474ebf tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Router f5974beb-acaf-4749-8a37-c81354d21d76 is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102162) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:29:33.225916 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f30ed2dd-bca0-4883-961b-79278f36f52a tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:33.233994 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-64e37b7e-3d60-485b-a0d4-e8160ecd6713 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks [] for floatingip, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:33.306105 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-efbca8ae-d60f-4074-9ff0-6b9fc2474ebf tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:29:33.319112 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d16c5fa-a09b-499c-8dcb-f1e0121aa55e None None] Sync routers for ids ['f5974beb-acaf-4749-8a37-c81354d21d76'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:29:33.330993 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d16c5fa-a09b-499c-8dcb-f1e0121aa55e None None] Routers {'f5974beb-acaf-4749-8a37-c81354d21d76'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:29:33.331693 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-6d16c5fa-a09b-499c-8dcb-f1e0121aa55e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:29:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['f5974beb-acaf-4749-8a37-c81354d21d76'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:33.372783 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9ab1f05e-25f4-45a0-a3c5-d973b864fc07 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Network 180d6f69-3e84-4af4-8ec3-10d9d54fc8a4 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:29:33.375839 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f30ed2dd-bca0-4883-961b-79278f36f52a tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:33.382487 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f30ed2dd-bca0-4883-961b-79278f36f52a tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:33.382487 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f30ed2dd-bca0-4883-961b-79278f36f52a tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:33.403324 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-efbca8ae-d60f-4074-9ff0-6b9fc2474ebf tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:33.404816 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-efbca8ae-d60f-4074-9ff0-6b9fc2474ebf tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 907 time: 3.9794602 Nov 09 04:29:33.407977 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53716) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:33.447221 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-6d16c5fa-a09b-499c-8dcb-f1e0121aa55e None None] Set router f5974beb-acaf-4749-8a37-c81354d21d76 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:29:33.461204 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f30ed2dd-bca0-4883-961b-79278f36f52a tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Pushing event updated for resources: {'Network': ['ID=535db112-7a68-4365-80ba-d9b95c16b4de,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:33.470733 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-64e37b7e-3d60-485b-a0d4-e8160ecd6713 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:29:33.474719 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-64e37b7e-3d60-485b-a0d4-e8160ecd6713 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] 10.222.0.24 "POST /v2.0/floatingips HTTP/1.1" status: 400 len: 373 time: 0.8994784 Nov 09 04:29:33.474845 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 535db112-7a68-4365-80ba-d9b95c16b4de details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:29:33.477904 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53718) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:33.484318 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-cda466e0-4644-4f51-a860-1118771babac tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Request body: {'floatingip': {'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'port_id': '66695da2-5d15-4717-8c15-6199530b694a', 'fixed_ip_address': '172.20.0.13'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:33.499960 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-f30ed2dd-bca0-4883-961b-79278f36f52a tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 789 time: 0.9957650 Nov 09 04:29:33.502996 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-9ab1f05e-25f4-45a0-a3c5-d973b864fc07 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 180d6f69-3e84-4af4-8ec3-10d9d54fc8a4) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:29:33.510176 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9ab1f05e-25f4-45a0-a3c5-d973b864fc07 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:33.510919 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9ab1f05e-25f4-45a0-a3c5-d973b864fc07 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:33.555755 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53726) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:33.561204 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-06c1451b-bfbb-4612-90bc-cbcb774c2a0c tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Request body: {'router': {'name': 'tempest-snat-router-495122030', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'enable_snat': True}}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:33.566899 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-eb7a9e7a-1921-4571-ad0c-a993da6410f0 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] 10.222.0.24 "GET /v2.0/routers/f5974beb-acaf-4749-8a37-c81354d21d76 HTTP/1.1" status: 200 len: 908 time: 0.1568460 Nov 09 04:29:33.575652 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5ffb78c1-fd74-464b-805f-e6b9e3282c67 None None] Network 180d6f69-3e84-4af4-8ec3-10d9d54fc8a4 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:29:33.630297 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cda466e0-4644-4f51-a860-1118771babac tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks [] for floatingip, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:33.702150 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53728) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:33.704676 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-9ab1f05e-25f4-45a0-a3c5-d973b864fc07 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 904 time: 1.8444462 Nov 09 04:29:33.733279 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53730) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:33.826963 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-6d16c5fa-a09b-499c-8dcb-f1e0121aa55e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f5974beb-acaf-4749-8a37-c81354d21d76', 'name': 'tempest-snat-router-495122030', 'tenant_id': '0f0b9fa79c884bda978424cf72c631d5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.178'}], 'enable_snat': False}, 'gw_port_id': '0b0033a1-902f-4286-9df5-9ba2ca69d4f9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:29:29Z', 'updated_at': '2021-11-09T04:29:31Z', 'revision_number': 3, 'project_id': '0f0b9fa79c884bda978424cf72c631d5', 'gw_port': {'id': '0b0033a1-902f-4286-9df5-9ba2ca69d4f9', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:09:31:0a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f5974beb-acaf-4749-8a37-c81354d21d76', 'device_owner': 'network:router_gateway', 'standard_attr_id': 327, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.178', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:29:30Z', 'updated_at': '2021-11-09T04:29:30Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': False, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:33.870629 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-06c1451b-bfbb-4612-90bc-cbcb774c2a0c tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:33.871631 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-06c1451b-bfbb-4612-90bc-cbcb774c2a0c tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:33.908447 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d16c5fa-a09b-499c-8dcb-f1e0121aa55e None None] Checking router: f5974beb-acaf-4749-8a37-c81354d21d76 for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:29:33.923749 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d16c5fa-a09b-499c-8dcb-f1e0121aa55e None None] Updating router f5974beb-acaf-4749-8a37-c81354d21d76 port 0b0033a1-902f-4286-9df5-9ba2ca69d4f9 binding host dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 04:29:33.964855 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-59154da8-3e9f-4fd0-877d-a0f247d44c71 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:33.970106 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cda466e0-4644-4f51-a860-1118771babac tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:33.999484 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-6d16c5fa-a09b-499c-8dcb-f1e0121aa55e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:34.060601 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-daefcb0e-2747-444a-907c-63c8dd78f577 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-180d6f69-3e84-4af4-8ec3-10d9d54fc8a4', 'network_id': '180d6f69-3e84-4af4-8ec3-10d9d54fc8a4', 'tenant_id': '83cbb798c0f44b268f8acd2a70eb745a', 'fixed_ips': [{'subnet_id': 'd1015856-53b0-4ad8-93eb-806eb31ac49a'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:29:34.061614 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-daefcb0e-2747-444a-907c-63c8dd78f577 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:34.116334 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-06c1451b-bfbb-4612-90bc-cbcb774c2a0c tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:34.221504 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-32d3f748-a7b7-45e6-a390-b6d91bf0a656 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=759e6d46f65c418d8a20baf3ece2e5bc&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4849133 Nov 09 04:29:34.222901 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53740) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:34.236271 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-59154da8-3e9f-4fd0-877d-a0f247d44c71 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:34.242072 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53742) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:34.243156 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-cda466e0-4644-4f51-a860-1118771babac tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Allocated IP 172.26.0.188 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/2f74f268-d7a9-4196-9c0c-b79f38097b04) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:29:34.296514 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-daefcb0e-2747-444a-907c-63c8dd78f577 None None] Allocated IP 2001:db8::1 (180d6f69-3e84-4af4-8ec3-10d9d54fc8a4/d1015856-53b0-4ad8-93eb-806eb31ac49a/c604e9a9-07b9-4e4a-bdcd-6be11baa45cf) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:29:34.403276 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-099e681c-d8b5-4f95-8ff8-63d6545df12e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:34.429741 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-099e681c-d8b5-4f95-8ff8-63d6545df12e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:34.441959 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-b608b8a3-175b-4847-ab92-c4214349f16c tempest-MeteringIpV6TestJSON-906262167 tempest-MeteringIpV6TestJSON-906262167-project-admin] Request body: {'metering_label': {'description': 'metering label created by tempest', 'name': 'tempest-metering-label-1817280635'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:34.443222 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-b608b8a3-175b-4847-ab92-c4214349f16c tempest-MeteringIpV6TestJSON-906262167 tempest-MeteringIpV6TestJSON-906262167-project-admin] Unknown quota resources ['metering_label']. {{(pid=102161) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Nov 09 04:29:34.509459 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-daefcb0e-2747-444a-907c-63c8dd78f577 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:34.563981 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-06c1451b-bfbb-4612-90bc-cbcb774c2a0c tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:34.596553 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-daefcb0e-2747-444a-907c-63c8dd78f577 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:34.610218 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-099e681c-d8b5-4f95-8ff8-63d6545df12e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:34.613344 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-099e681c-d8b5-4f95-8ff8-63d6545df12e admin admin] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:34.617789 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-099e681c-d8b5-4f95-8ff8-63d6545df12e admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/63bf1220-a75b-489b-be17-63025a3530f9 HTTP/1.1" status: 204 len: 168 time: 0.3894081 Nov 09 04:29:34.646441 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-099e681c-d8b5-4f95-8ff8-63d6545df12e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=63bf1220-a75b-489b-be17-63025a3530f9,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:34.654379 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-daefcb0e-2747-444a-907c-63c8dd78f577 None None] Network 180d6f69-3e84-4af4-8ec3-10d9d54fc8a4 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:29:34.660765 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-daefcb0e-2747-444a-907c-63c8dd78f577 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:29:34.674134 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-daefcb0e-2747-444a-907c-63c8dd78f577 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:29:34.680815 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-daefcb0e-2747-444a-907c-63c8dd78f577 None None] Pushing event updated for resources: {'Port': ['ID=c604e9a9-07b9-4e4a-bdcd-6be11baa45cf,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:34.699499 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-59154da8-3e9f-4fd0-877d-a0f247d44c71 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:34.753860 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59154da8-3e9f-4fd0-877d-a0f247d44c71 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Pushing event deleted for resources: {'Subnet': ['ID=d1015856-53b0-4ad8-93eb-806eb31ac49a,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:34.761749 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cda466e0-4644-4f51-a860-1118771babac tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:34.765737 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-daefcb0e-2747-444a-907c-63c8dd78f577 None None] Attempting to bind port c604e9a9-07b9-4e4a-bdcd-6be11baa45cf on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:29:34.770349 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-daefcb0e-2747-444a-907c-63c8dd78f577 None None] Attempting to bind port c604e9a9-07b9-4e4a-bdcd-6be11baa45cf by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '9739d82e-de07-4efb-a846-2223dbf69c3a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 314, 'network_id': '180d6f69-3e84-4af4-8ec3-10d9d54fc8a4'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:29:34.770349 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-daefcb0e-2747-444a-907c-63c8dd78f577 None None] Attempting to bind port c604e9a9-07b9-4e4a-bdcd-6be11baa45cf on network 180d6f69-3e84-4af4-8ec3-10d9d54fc8a4 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:29:34.774442 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-daefcb0e-2747-444a-907c-63c8dd78f577 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 29, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:29:34.774817 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-daefcb0e-2747-444a-907c-63c8dd78f577 None None] Checking segment: {'id': '9739d82e-de07-4efb-a846-2223dbf69c3a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 314, 'network_id': '180d6f69-3e84-4af4-8ec3-10d9d54fc8a4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:29:34.775305 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-daefcb0e-2747-444a-907c-63c8dd78f577 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:34.775692 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-daefcb0e-2747-444a-907c-63c8dd78f577 None None] Bound using segment: {'id': '9739d82e-de07-4efb-a846-2223dbf69c3a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 314, 'network_id': '180d6f69-3e84-4af4-8ec3-10d9d54fc8a4'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:29:34.776197 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-daefcb0e-2747-444a-907c-63c8dd78f577 None None] Bound port: c604e9a9-07b9-4e4a-bdcd-6be11baa45cf, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9739d82e-de07-4efb-a846-2223dbf69c3a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 314, 'network_id': '180d6f69-3e84-4af4-8ec3-10d9d54fc8a4'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:29:34.776724 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-daefcb0e-2747-444a-907c-63c8dd78f577 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:34.843741 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b608b8a3-175b-4847-ab92-c4214349f16c tempest-MeteringIpV6TestJSON-906262167 tempest-MeteringIpV6TestJSON-906262167-project-admin] Publish callbacks [] for metering_label, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:34.845221 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-b608b8a3-175b-4847-ab92-c4214349f16c tempest-MeteringIpV6TestJSON-906262167 tempest-MeteringIpV6TestJSON-906262167-project-admin] 10.222.0.24 "POST /v2.0/metering/metering-labels HTTP/1.1" status: 201 len: 478 time: 0.5991054 Nov 09 04:29:34.852209 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53750) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:34.859618 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-6c8073c0-47dc-4dac-bcc3-c867a383a8e9 tempest-MeteringIpV6TestJSON-906262167 tempest-MeteringIpV6TestJSON-906262167-project-admin] Request body: {'metering_label_rule': {'remote_ip_prefix': 'fd02::/64', 'direction': 'ingress', 'metering_label_id': 'fd2c863a-d264-4c67-a82d-625869c9f5dc'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:34.860363 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-6c8073c0-47dc-4dac-bcc3-c867a383a8e9 tempest-MeteringIpV6TestJSON-906262167 tempest-MeteringIpV6TestJSON-906262167-project-admin] Unknown quota resources ['metering_label_rule']. {{(pid=102161) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Nov 09 04:29:34.865705 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-daefcb0e-2747-444a-907c-63c8dd78f577 None None] For port c604e9a9-07b9-4e4a-bdcd-6be11baa45cf, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:29:34.869649 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-daefcb0e-2747-444a-907c-63c8dd78f577 None None] For port c604e9a9-07b9-4e4a-bdcd-6be11baa45cf, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=c604e9a9-07b9-4e4a-bdcd-6be11baa45cf,segment=NetworkSegment(9739d82e-de07-4efb-a846-2223dbf69c3a),segment_id=9739d82e-de07-4efb-a846-2223dbf69c3a)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:29:34.875410 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-59154da8-3e9f-4fd0-877d-a0f247d44c71 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:34.905180 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-59154da8-3e9f-4fd0-877d-a0f247d44c71 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['180d6f69-3e84-4af4-8ec3-10d9d54fc8a4']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:34.914954 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-59154da8-3e9f-4fd0-877d-a0f247d44c71 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9739d82e-de07-4efb-a846-2223dbf69c3a') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:34.915342 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-59154da8-3e9f-4fd0-877d-a0f247d44c71 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9739d82e-de07-4efb-a846-2223dbf69c3a') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:34.925270 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-59154da8-3e9f-4fd0-877d-a0f247d44c71 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:34.957508 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-daefcb0e-2747-444a-907c-63c8dd78f577 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:34.959137 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-59154da8-3e9f-4fd0-877d-a0f247d44c71 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:34.967643 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-59154da8-3e9f-4fd0-877d-a0f247d44c71 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Releasing vlan 314 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:29:34.968770 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-59154da8-3e9f-4fd0-877d-a0f247d44c71 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:35.016885 dv-neutron-816802-2-hyperv neutron-server[102161]: WARNING neutron.services.metering.metering_plugin [None req-6c8073c0-47dc-4dac-bcc3-c867a383a8e9 tempest-MeteringIpV6TestJSON-906262167 tempest-MeteringIpV6TestJSON-906262167-project-admin] The use of 'remote_ip_prefix' in metering label rules is deprecated and will be removed in future releases. One should use instead the 'source_ip_prefix' and/or 'destination_ip_prefix' parameters. For more details, you can check the spec: https://review.opendev.org/#/c/744702/. Nov 09 04:29:35.061795 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:29:35.061795 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:29:35.061795 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:29:35.061795 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:29:35.061795 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:29:35.061795 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:29:35.061795 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:29:35.061795 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:29:35.061795 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:29:35.061795 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:29:35.061795 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:29:35.061795 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:29:35.061795 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:29:35.061795 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:29:35.061795 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:29:35.061795 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:29:35.061795 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:29:35.061795 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:29:35.061795 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:29:35.061795 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:29:35.061795 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:29:35.061795 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:29:35.061795 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:29:35.061795 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:29:35.061795 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:29:35.061795 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:29:35.061795 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:29:35.061795 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:29:35.061795 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:29:35.061795 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:29:35.061795 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:29:35.061795 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:29:35.099915 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-daefcb0e-2747-444a-907c-63c8dd78f577 None None] Pushing event updated for resources: {'Port': ['ID=c604e9a9-07b9-4e4a-bdcd-6be11baa45cf,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:35.102742 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cda466e0-4644-4f51-a860-1118771babac tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:35.106788 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6c8073c0-47dc-4dac-bcc3-c867a383a8e9 tempest-MeteringIpV6TestJSON-906262167 tempest-MeteringIpV6TestJSON-906262167-project-admin] Publish callbacks [] for metering_label_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:35.107946 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-6c8073c0-47dc-4dac-bcc3-c867a383a8e9 tempest-MeteringIpV6TestJSON-906262167 tempest-MeteringIpV6TestJSON-906262167-project-admin] 10.222.0.24 "POST /v2.0/metering/metering-label-rules HTTP/1.1" status: 201 len: 464 time: 0.2524195 Nov 09 04:29:35.111639 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53756) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:35.112883 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ec8be6d1-ca55-4908-9e64-bdc202bb6762 None None] Network 180d6f69-3e84-4af4-8ec3-10d9d54fc8a4 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:29:35.129198 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-8b142eda-b5d4-4dc2-b4f7-0bdcbd1edd0d tempest-MeteringIpV6TestJSON-906262167 tempest-MeteringIpV6TestJSON-906262167-project-admin] Request body: {'metering_label_rule': {'remote_ip_prefix': 'fd03::/64', 'direction': 'ingress', 'metering_label_id': 'fd2c863a-d264-4c67-a82d-625869c9f5dc'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:35.132364 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-8b142eda-b5d4-4dc2-b4f7-0bdcbd1edd0d tempest-MeteringIpV6TestJSON-906262167 tempest-MeteringIpV6TestJSON-906262167-project-admin] Unknown quota resources ['metering_label_rule']. {{(pid=102162) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Nov 09 04:29:35.166473 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.db.api [None req-59154da8-3e9f-4fd0-877d-a0f247d44c71 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Nov 09 04:29:35.166473 dv-neutron-816802-2-hyperv neutron-server[102162]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Nov 09 04:29:35.166473 dv-neutron-816802-2-hyperv neutron-server[102162]: [parameters: {'id': '180d6f69-3e84-4af4-8ec3-10d9d54fc8a4'}] Nov 09 04:29:35.166473 dv-neutron-816802-2-hyperv neutron-server[102162]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=102162) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:29:35.167515 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG oslo_db.api [None req-59154da8-3e9f-4fd0-877d-a0f247d44c71 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:29:35.179582 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cda466e0-4644-4f51-a860-1118771babac tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Pushing event updated for resources: {'Port': ['ID=2f74f268-d7a9-4196-9c0c-b79f38097b04,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:35.295135 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cda466e0-4644-4f51-a860-1118771babac tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:29:35.298027 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-cda466e0-4644-4f51-a860-1118771babac tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:29:35.301495 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cda466e0-4644-4f51-a860-1118771babac tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:29:35.358822 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-6d16c5fa-a09b-499c-8dcb-f1e0121aa55e None None] Publish callbacks [] for port, precommit_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:35.367167 dv-neutron-816802-2-hyperv neutron-server[102162]: WARNING neutron.services.metering.metering_plugin [None req-8b142eda-b5d4-4dc2-b4f7-0bdcbd1edd0d tempest-MeteringIpV6TestJSON-906262167 tempest-MeteringIpV6TestJSON-906262167-project-admin] The use of 'remote_ip_prefix' in metering label rules is deprecated and will be removed in future releases. One should use instead the 'source_ip_prefix' and/or 'destination_ip_prefix' parameters. For more details, you can check the spec: https://review.opendev.org/#/c/744702/. Nov 09 04:29:35.377951 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0434495a-81c6-49b8-8f4b-b14908c48736 None None] get_active_networks_info from dv-neutron-816802-2-hyperv {{(pid=102163) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}} Nov 09 04:29:35.403261 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-06c1451b-bfbb-4612-90bc-cbcb774c2a0c tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:35.423704 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-6d16c5fa-a09b-499c-8dcb-f1e0121aa55e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:35.426436 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-06c1451b-bfbb-4612-90bc-cbcb774c2a0c tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:35.505024 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bef91b7f-92d8-4e25-935e-c33c8ed5addc None None] Pushing event updated for resources: {'Port': ['ID=0b0033a1-902f-4286-9df5-9ba2ca69d4f9,revision_number=2']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:35.515629 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-6d16c5fa-a09b-499c-8dcb-f1e0121aa55e None None] Attempting to bind port 0b0033a1-902f-4286-9df5-9ba2ca69d4f9 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:29:35.516491 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-6d16c5fa-a09b-499c-8dcb-f1e0121aa55e None None] Attempting to bind port 0b0033a1-902f-4286-9df5-9ba2ca69d4f9 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:29:35.517059 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d16c5fa-a09b-499c-8dcb-f1e0121aa55e None None] Attempting to bind port 0b0033a1-902f-4286-9df5-9ba2ca69d4f9 on network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:29:35.522626 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bef91b7f-92d8-4e25-935e-c33c8ed5addc None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:29:35.523276 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bef91b7f-92d8-4e25-935e-c33c8ed5addc None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:29:35.525466 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bef91b7f-92d8-4e25-935e-c33c8ed5addc None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:29:35.525466 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bef91b7f-92d8-4e25-935e-c33c8ed5addc None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:29:35.525466 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bef91b7f-92d8-4e25-935e-c33c8ed5addc None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:29:35.525826 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8b142eda-b5d4-4dc2-b4f7-0bdcbd1edd0d tempest-MeteringIpV6TestJSON-906262167 tempest-MeteringIpV6TestJSON-906262167-project-admin] Publish callbacks [] for metering_label_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:35.526289 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bef91b7f-92d8-4e25-935e-c33c8ed5addc None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:29:35.527121 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bef91b7f-92d8-4e25-935e-c33c8ed5addc None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:29:35.528205 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bef91b7f-92d8-4e25-935e-c33c8ed5addc None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:29:35.528768 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bef91b7f-92d8-4e25-935e-c33c8ed5addc None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:29:35.529574 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bef91b7f-92d8-4e25-935e-c33c8ed5addc None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:29:35.529827 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-8b142eda-b5d4-4dc2-b4f7-0bdcbd1edd0d tempest-MeteringIpV6TestJSON-906262167 tempest-MeteringIpV6TestJSON-906262167-project-admin] 10.222.0.24 "POST /v2.0/metering/metering-label-rules HTTP/1.1" status: 201 len: 464 time: 0.4106250 Nov 09 04:29:35.530383 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bef91b7f-92d8-4e25-935e-c33c8ed5addc None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:29:35.531194 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bef91b7f-92d8-4e25-935e-c33c8ed5addc None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:29:35.533076 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53758) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:35.543491 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d16c5fa-a09b-499c-8dcb-f1e0121aa55e None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 29, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:29:35.544420 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d16c5fa-a09b-499c-8dcb-f1e0121aa55e None None] Checking segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102164) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:29:35.545035 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-6d16c5fa-a09b-499c-8dcb-f1e0121aa55e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:35.545702 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d16c5fa-a09b-499c-8dcb-f1e0121aa55e None None] Bound using segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:29:35.546416 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-6d16c5fa-a09b-499c-8dcb-f1e0121aa55e None None] Bound port: 0b0033a1-902f-4286-9df5-9ba2ca69d4f9, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:29:35.547621 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-6d16c5fa-a09b-499c-8dcb-f1e0121aa55e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:35.565062 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-04f33449-4453-4335-9861-180542021c17 tempest-MeteringIpV6TestJSON-906262167 tempest-MeteringIpV6TestJSON-906262167-project-admin] 10.222.0.24 "GET /v2.0/metering/metering-label-rules?id=9187de00-17d7-4dea-af8e-85726ee1d403 HTTP/1.1" status: 200 len: 462 time: 0.0308549 Nov 09 04:29:35.573623 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53760) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:35.614245 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-6d16c5fa-a09b-499c-8dcb-f1e0121aa55e None None] For port 0b0033a1-902f-4286-9df5-9ba2ca69d4f9, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102164) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:29:35.620420 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-6d16c5fa-a09b-499c-8dcb-f1e0121aa55e None None] For port 0b0033a1-902f-4286-9df5-9ba2ca69d4f9, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=0b0033a1-902f-4286-9df5-9ba2ca69d4f9,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102164) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:29:35.651489 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0434495a-81c6-49b8-8f4b-b14908c48736 None None] Resources bound (agent type, host, resource id): {{(pid=102163) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 09 04:29:35.669445 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-59154da8-3e9f-4fd0-877d-a0f247d44c71 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:35.715901 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-6d16c5fa-a09b-499c-8dcb-f1e0121aa55e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:35.718652 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53762) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:35.844003 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d16c5fa-a09b-499c-8dcb-f1e0121aa55e None None] Routers {'f5974beb-acaf-4749-8a37-c81354d21d76'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:29:35.844757 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-6d16c5fa-a09b-499c-8dcb-f1e0121aa55e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:29:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['f5974beb-acaf-4749-8a37-c81354d21d76'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:35.851365 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bef91b7f-92d8-4e25-935e-c33c8ed5addc None None] Pushing event updated for resources: {'Port': ['ID=0b0033a1-902f-4286-9df5-9ba2ca69d4f9,revision_number=3']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:35.955913 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-06c1451b-bfbb-4612-90bc-cbcb774c2a0c tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Allocated IP 172.26.0.21 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/78ff927b-910b-4c76-8fb4-15ef5db9823c) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:29:35.984138 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5986fa7f-4896-44fe-8a8f-451a7a66833e tempest-MeteringIpV6TestJSON-906262167 tempest-MeteringIpV6TestJSON-906262167-project-admin] Publish callbacks [] for metering_label_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:35.984383 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-6d16c5fa-a09b-499c-8dcb-f1e0121aa55e None None] Set router f5974beb-acaf-4749-8a37-c81354d21d76 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:29:35.994527 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-5986fa7f-4896-44fe-8a8f-451a7a66833e tempest-MeteringIpV6TestJSON-906262167 tempest-MeteringIpV6TestJSON-906262167-project-admin] 10.222.0.24 "DELETE /v2.0/metering/metering-label-rules/9187de00-17d7-4dea-af8e-85726ee1d403 HTTP/1.1" status: 204 len: 168 time: 0.4161968 Nov 09 04:29:36.005906 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53766) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:36.075653 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-06c1451b-bfbb-4612-90bc-cbcb774c2a0c tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:36.092767 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-5ec15d54-18b1-4122-b2e7-ed8ae1c5e0fd admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=657652107bc34ca7983289060f1bd8df&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2991767 Nov 09 04:29:36.094911 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-88274125-2799-422b-a037-fcccc4769dfc tempest-MeteringIpV6TestJSON-906262167 tempest-MeteringIpV6TestJSON-906262167-project-admin] 10.222.0.24 "GET /v2.0/metering/metering-label-rules?id=9187de00-17d7-4dea-af8e-85726ee1d403 HTTP/1.1" status: 200 len: 221 time: 0.0712326 Nov 09 04:29:36.097486 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53768) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:36.098096 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53770) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:36.109245 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-c6d74905-b664-49e1-85c1-89c7ab56771b tempest-MeteringIpV6TestJSON-906262167 tempest-MeteringIpV6TestJSON-906262167-project-admin] Request body: {'metering_label': {'name': 'tempest-metering-label--850656397', 'description': 'label created by tempest'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:36.110111 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-c6d74905-b664-49e1-85c1-89c7ab56771b tempest-MeteringIpV6TestJSON-906262167 tempest-MeteringIpV6TestJSON-906262167-project-admin] Unknown quota resources ['metering_label']. {{(pid=102162) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Nov 09 04:29:36.188308 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-cda466e0-4644-4f51-a860-1118771babac tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Deleting port 2f74f268-d7a9-4196-9c0c-b79f38097b04 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:29:36.188713 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cda466e0-4644-4f51-a860-1118771babac tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:36.200355 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-59154da8-3e9f-4fd0-877d-a0f247d44c71 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Deleting port c604e9a9-07b9-4e4a-bdcd-6be11baa45cf {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:29:36.201110 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-59154da8-3e9f-4fd0-877d-a0f247d44c71 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:36.234020 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-06c1451b-bfbb-4612-90bc-cbcb774c2a0c tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:36.249171 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-6d16c5fa-a09b-499c-8dcb-f1e0121aa55e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f5974beb-acaf-4749-8a37-c81354d21d76', 'name': 'tempest-snat-router-495122030', 'tenant_id': '0f0b9fa79c884bda978424cf72c631d5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.178'}], 'enable_snat': False}, 'gw_port_id': '0b0033a1-902f-4286-9df5-9ba2ca69d4f9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:29:29Z', 'updated_at': '2021-11-09T04:29:31Z', 'revision_number': 3, 'project_id': '0f0b9fa79c884bda978424cf72c631d5', 'gw_port': {'id': '0b0033a1-902f-4286-9df5-9ba2ca69d4f9', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:09:31:0a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f5974beb-acaf-4749-8a37-c81354d21d76', 'device_owner': 'network:router_gateway', 'standard_attr_id': 327, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.178', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:29:30Z', 'updated_at': '2021-11-09T04:29:35Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': False, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:36.299957 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d16c5fa-a09b-499c-8dcb-f1e0121aa55e None None] The sync data for ids ['f5974beb-acaf-4749-8a37-c81354d21d76'] in dv-neutron-816802-2-hyperv is: [{'id': 'f5974beb-acaf-4749-8a37-c81354d21d76', 'name': 'tempest-snat-router-495122030', 'tenant_id': '0f0b9fa79c884bda978424cf72c631d5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.178'}], 'enable_snat': False}, 'gw_port_id': '0b0033a1-902f-4286-9df5-9ba2ca69d4f9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:29:29Z', 'updated_at': '2021-11-09T04:29:31Z', 'revision_number': 3, 'project_id': '0f0b9fa79c884bda978424cf72c631d5', 'gw_port': {'id': '0b0033a1-902f-4286-9df5-9ba2ca69d4f9', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:09:31:0a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f5974beb-acaf-4749-8a37-c81354d21d76', 'device_owner': 'network:router_gateway', 'standard_attr_id': 327, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.178', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:29:30Z', 'updated_at': '2021-11-09T04:29:35Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': False, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:29:36.322539 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-06c1451b-bfbb-4612-90bc-cbcb774c2a0c tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:29:36.343270 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8de88186-2fa3-464d-a9fb-54e2664380b1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:36.393705 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8de88186-2fa3-464d-a9fb-54e2664380b1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:36.395375 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cda466e0-4644-4f51-a860-1118771babac tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:36.395741 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cda466e0-4644-4f51-a860-1118771babac tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:36.421508 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-cda466e0-4644-4f51-a860-1118771babac tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Calling delete_port for 2f74f268-d7a9-4196-9c0c-b79f38097b04 owned by network:floatingip {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:29:36.533841 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-59154da8-3e9f-4fd0-877d-a0f247d44c71 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] For port c604e9a9-07b9-4e4a-bdcd-6be11baa45cf, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=c604e9a9-07b9-4e4a-bdcd-6be11baa45cf,segment=NetworkSegment(9739d82e-de07-4efb-a846-2223dbf69c3a),segment_id=9739d82e-de07-4efb-a846-2223dbf69c3a)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:29:36.535968 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-59154da8-3e9f-4fd0-877d-a0f247d44c71 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:36.593027 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8de88186-2fa3-464d-a9fb-54e2664380b1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:36.593027 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8de88186-2fa3-464d-a9fb-54e2664380b1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:36.593027 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-8de88186-2fa3-464d-a9fb-54e2664380b1 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/ef619023-9bd2-41cf-9860-2168e5382504 HTTP/1.1" status: 204 len: 168 time: 0.4888849 Nov 09 04:29:36.601776 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-06c1451b-bfbb-4612-90bc-cbcb774c2a0c tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:29:36.603944 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06c1451b-bfbb-4612-90bc-cbcb774c2a0c tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Pushing event updated for resources: {'Port': ['ID=78ff927b-910b-4c76-8fb4-15ef5db9823c,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:36.608035 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-06c1451b-bfbb-4612-90bc-cbcb774c2a0c tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:29:36.644380 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-59154da8-3e9f-4fd0-877d-a0f247d44c71 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Calling delete_port for c604e9a9-07b9-4e4a-bdcd-6be11baa45cf owned by network:dhcp {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:29:36.660917 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8de88186-2fa3-464d-a9fb-54e2664380b1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ef619023-9bd2-41cf-9860-2168e5382504,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:36.675686 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c6d74905-b664-49e1-85c1-89c7ab56771b tempest-MeteringIpV6TestJSON-906262167 tempest-MeteringIpV6TestJSON-906262167-project-admin] Publish callbacks [] for metering_label, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:36.677748 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-c6d74905-b664-49e1-85c1-89c7ab56771b tempest-MeteringIpV6TestJSON-906262167 tempest-MeteringIpV6TestJSON-906262167-project-admin] 10.222.0.24 "POST /v2.0/metering/metering-labels HTTP/1.1" status: 201 len: 469 time: 0.5717461 Nov 09 04:29:36.697532 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53776) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:36.785151 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cda466e0-4644-4f51-a860-1118771babac tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:36.801965 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53778) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:36.812263 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-4b30703c-b956-4afc-94b5-410c4c3c1990 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Request body: {'subnets': [{'network_id': '7b21ba4a-ddd5-4fb9-9bfd-bc86bfc5cedf', 'cidr': '2001:db8::/64', 'name': 'tempest-subnet--1911403067', 'ip_version': 6}, {'network_id': '535db112-7a68-4365-80ba-d9b95c16b4de', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6}]} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:36.812584 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-4b30703c-b956-4afc-94b5-410c4c3c1990 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Request body: {'subnet': {'network_id': '7b21ba4a-ddd5-4fb9-9bfd-bc86bfc5cedf', 'cidr': '2001:db8::/64', 'name': 'tempest-subnet--1911403067', 'ip_version': 6}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:36.813253 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-4b30703c-b956-4afc-94b5-410c4c3c1990 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Request body: {'subnet': {'network_id': '535db112-7a68-4365-80ba-d9b95c16b4de', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:36.817392 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-d712ff6b-8c17-4c49-8c5b-585bec8f70b6 tempest-MeteringIpV6TestJSON-906262167 tempest-MeteringIpV6TestJSON-906262167-project-admin] 10.222.0.24 "GET /v2.0/metering/metering-labels?id=00a2c6b1-5f10-4a0a-bc16-3f327fdc9ad1 HTTP/1.1" status: 200 len: 467 time: 0.1140909 Nov 09 04:29:36.821872 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53780) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:36.878422 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cda466e0-4644-4f51-a860-1118771babac tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Pushing event deleted for resources: {'Port': ['ID=2f74f268-d7a9-4196-9c0c-b79f38097b04,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:37.170641 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-cda466e0-4644-4f51-a860-1118771babac tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] create failed (client error): The resource could not be found. Nov 09 04:29:37.172463 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-cda466e0-4644-4f51-a860-1118771babac tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] 10.222.0.24 "POST /v2.0/floatingips HTTP/1.1" status: 404 len: 507 time: 3.6928918 Nov 09 04:29:37.175257 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53786) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:37.191571 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ab79d31c-52e6-42ff-aed2-6e786e7035c4 tempest-MeteringIpV6TestJSON-906262167 tempest-MeteringIpV6TestJSON-906262167-project-admin] Publish callbacks [] for metering_label, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:37.196428 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53788) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:37.197302 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-ab79d31c-52e6-42ff-aed2-6e786e7035c4 tempest-MeteringIpV6TestJSON-906262167 tempest-MeteringIpV6TestJSON-906262167-project-admin] 10.222.0.24 "DELETE /v2.0/metering/metering-labels/00a2c6b1-5f10-4a0a-bc16-3f327fdc9ad1 HTTP/1.1" status: 204 len: 168 time: 0.3754430 Nov 09 04:29:37.198578 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-59154da8-3e9f-4fd0-877d-a0f247d44c71 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:37.204317 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-06c1451b-bfbb-4612-90bc-cbcb774c2a0c tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:37.258279 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59154da8-3e9f-4fd0-877d-a0f247d44c71 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Pushing event deleted for resources: {'Port': ['ID=c604e9a9-07b9-4e4a-bdcd-6be11baa45cf,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:37.260247 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-b98139cf-564e-4209-b169-2f795a1097bc tempest-MeteringIpV6TestJSON-906262167 tempest-MeteringIpV6TestJSON-906262167-project-admin] 10.222.0.24 "GET /v2.0/metering/metering-labels?id=00a2c6b1-5f10-4a0a-bc16-3f327fdc9ad1 HTTP/1.1" status: 200 len: 216 time: 0.0626981 Nov 09 04:29:37.264151 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53792) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:37.265054 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-59154da8-3e9f-4fd0-877d-a0f247d44c71 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] No DVR routers for this DVR port c604e9a9-07b9-4e4a-bdcd-6be11baa45cf on host dv-neutron-816802-2-hyperv {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:29:37.317825 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4b30703c-b956-4afc-94b5-410c4c3c1990 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Made reservation on behalf of 34508a55938a43c2b57acd8dc368e922 for: {'subnet': 2} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:29:37.321470 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4b30703c-b956-4afc-94b5-410c4c3c1990 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:37.321581 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4b30703c-b956-4afc-94b5-410c4c3c1990 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:37.333739 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-d2b5f298-f73e-49ea-985f-9a9259a67756 tempest-MeteringIpV6TestJSON-906262167 tempest-MeteringIpV6TestJSON-906262167-project-admin] 10.222.0.24 "GET /v2.0/metering/metering-label-rules?id=33 HTTP/1.1" status: 200 len: 221 time: 0.0617077 Nov 09 04:29:37.350489 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53798) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:37.409130 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-26eb68a4-97ad-4311-b04f-06e9504424ef tempest-MeteringIpV6TestJSON-906262167 tempest-MeteringIpV6TestJSON-906262167-project-admin] 10.222.0.24 "GET /v2.0/metering/metering-labels?id=33 HTTP/1.1" status: 200 len: 216 time: 0.0576699 Nov 09 04:29:37.409864 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53800) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:37.413102 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-59154da8-3e9f-4fd0-877d-a0f247d44c71 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:37.487978 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-59154da8-3e9f-4fd0-877d-a0f247d44c71 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['180d6f69-3e84-4af4-8ec3-10d9d54fc8a4']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:37.506910 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-31a074dd-debf-4439-970f-9313ed0f2744 tempest-MeteringIpV6TestJSON-906262167 tempest-MeteringIpV6TestJSON-906262167-project-admin] 10.222.0.24 "GET /v2.0/metering/metering-labels/fd2c863a-d264-4c67-a82d-625869c9f5dc HTTP/1.1" status: 200 len: 473 time: 0.0891216 Nov 09 04:29:37.506910 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53806) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:37.515275 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-59154da8-3e9f-4fd0-877d-a0f247d44c71 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9739d82e-de07-4efb-a846-2223dbf69c3a') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:37.515655 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-59154da8-3e9f-4fd0-877d-a0f247d44c71 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9739d82e-de07-4efb-a846-2223dbf69c3a') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:37.535068 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-59154da8-3e9f-4fd0-877d-a0f247d44c71 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:37.541838 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-88c970c8-7828-40ef-a6b0-97e1af1d572e tempest-MeteringIpV6TestJSON-906262167 tempest-MeteringIpV6TestJSON-906262167-project-admin] 10.222.0.24 "GET /v2.0/metering/metering-label-rules/f7feeab2-cfe5-458c-987d-7d53595fd402 HTTP/1.1" status: 200 len: 459 time: 0.0284996 Nov 09 04:29:37.548571 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53808) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:37.563670 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-910fe173-46ac-43b7-9695-549eb6054304 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Deleting port 66695da2-5d15-4717-8c15-6199530b694a {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:29:37.564082 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-910fe173-46ac-43b7-9695-549eb6054304 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:37.568742 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-59154da8-3e9f-4fd0-877d-a0f247d44c71 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:37.593806 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-59154da8-3e9f-4fd0-877d-a0f247d44c71 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Releasing vlan 314 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:29:37.594338 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-59154da8-3e9f-4fd0-877d-a0f247d44c71 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:37.600574 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:29:37.600574 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:29:37.600574 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:29:37.600574 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:29:37.600574 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:29:37.600574 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:29:37.600574 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:29:37.600574 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:29:37.600574 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:29:37.600574 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:29:37.600574 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:29:37.600574 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:29:37.600574 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:29:37.600574 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:29:37.600574 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:29:37.600574 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:29:37.600574 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:29:37.600574 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:29:37.600574 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:29:37.600574 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:29:37.600574 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:29:37.600574 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:29:37.600574 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:29:37.600574 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:29:37.600574 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:29:37.600574 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:29:37.600574 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:29:37.600574 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:29:37.600574 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:29:37.600574 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:29:37.600574 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:29:37.600574 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:29:37.639382 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-06c1451b-bfbb-4612-90bc-cbcb774c2a0c tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:37.729361 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-910fe173-46ac-43b7-9695-549eb6054304 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:37.743053 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-910fe173-46ac-43b7-9695-549eb6054304 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Calling delete_port for 66695da2-5d15-4717-8c15-6199530b694a owned by {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:29:37.798285 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-59154da8-3e9f-4fd0-877d-a0f247d44c71 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:37.846778 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-59154da8-3e9f-4fd0-877d-a0f247d44c71 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:37.851685 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-59154da8-3e9f-4fd0-877d-a0f247d44c71 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "DELETE /v2.0/networks/180d6f69-3e84-4af4-8ec3-10d9d54fc8a4 HTTP/1.1" status: 204 len: 168 time: 4.1469936 Nov 09 04:29:37.864482 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53816) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:37.870807 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-cb346bd2-8f69-403a-91df-24b70f3b72bb tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1852959266'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:37.897161 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59154da8-3e9f-4fd0-877d-a0f247d44c71 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Pushing event deleted for resources: {'Network': ['ID=180d6f69-3e84-4af4-8ec3-10d9d54fc8a4,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:37.906507 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-06c1451b-bfbb-4612-90bc-cbcb774c2a0c tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Router 33c8b404-8f77-4e6e-b931-e5106d314f63 is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102161) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:29:37.909185 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1f176cad-3118-40df-9c84-d420a6cb2178 tempest-MeteringIpV6TestJSON-906262167 tempest-MeteringIpV6TestJSON-906262167-project-admin] Publish callbacks [] for metering_label_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:37.913448 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-1f176cad-3118-40df-9c84-d420a6cb2178 tempest-MeteringIpV6TestJSON-906262167 tempest-MeteringIpV6TestJSON-906262167-project-admin] 10.222.0.24 "DELETE /v2.0/metering/metering-label-rules/f7feeab2-cfe5-458c-987d-7d53595fd402 HTTP/1.1" status: 204 len: 168 time: 0.3624303 Nov 09 04:29:37.914014 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53818) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:38.049925 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 0b0033a1-902f-4286-9df5-9ba2ca69d4f9 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:29:38.106945 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 0b0033a1-902f-4286-9df5-9ba2ca69d4f9 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:29:38.107318 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:38.122314 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cb346bd2-8f69-403a-91df-24b70f3b72bb tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Made reservation on behalf of 83cbb798c0f44b268f8acd2a70eb745a for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:29:38.126397 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cb346bd2-8f69-403a-91df-24b70f3b72bb tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:38.156977 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-06c1451b-bfbb-4612-90bc-cbcb774c2a0c tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:29:38.199077 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-cb346bd2-8f69-403a-91df-24b70f3b72bb tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 330} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:29:38.229728 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ad0d6eb-b393-45f2-8d6a-05acc95236e3 None None] Sync routers for ids ['33c8b404-8f77-4e6e-b931-e5106d314f63'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:29:38.236002 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cb346bd2-8f69-403a-91df-24b70f3b72bb tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:38.242559 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-cb346bd2-8f69-403a-91df-24b70f3b72bb tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Added segment 3a0b343d-7541-40bc-87c7-5e2ef89982eb of type vlan for network aa0d1e9f-fc22-4053-b61f-4d6102a5f7d0 Nov 09 04:29:38.248374 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:38.280503 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0ad0d6eb-b393-45f2-8d6a-05acc95236e3 None None] Routers {'33c8b404-8f77-4e6e-b931-e5106d314f63'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:29:38.282707 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-0ad0d6eb-b393-45f2-8d6a-05acc95236e3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:29:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['33c8b404-8f77-4e6e-b931-e5106d314f63'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:38.287138 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 0b0033a1-902f-4286-9df5-9ba2ca69d4f9, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=0b0033a1-902f-4286-9df5-9ba2ca69d4f9,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:29:38.291074 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-06c1451b-bfbb-4612-90bc-cbcb774c2a0c tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:38.292408 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-06c1451b-bfbb-4612-90bc-cbcb774c2a0c tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 905 time: 4.7350676 Nov 09 04:29:38.304889 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53826) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:38.388397 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:38.427276 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-62f8dccc-8f5b-4ffb-ad70-7b6dfbc9995c tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] 10.222.0.24 "GET /v2.0/routers/33c8b404-8f77-4e6e-b931-e5106d314f63 HTTP/1.1" status: 200 len: 906 time: 0.1216621 Nov 09 04:29:38.434574 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53828) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:38.436377 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cb346bd2-8f69-403a-91df-24b70f3b72bb tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:38.461548 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-0ad0d6eb-b393-45f2-8d6a-05acc95236e3 None None] Set router 33c8b404-8f77-4e6e-b931-e5106d314f63 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:29:38.626680 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a9d87aaf-57a3-4dcc-9179-c1f7a5d83e28 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks [] for router, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:38.654019 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=0b0033a1-902f-4286-9df5-9ba2ca69d4f9,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:38.658912 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-910fe173-46ac-43b7-9695-549eb6054304 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:38.716794 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-910fe173-46ac-43b7-9695-549eb6054304 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Pushing event deleted for resources: {'Port': ['ID=66695da2-5d15-4717-8c15-6199530b694a,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:38.736565 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4b30703c-b956-4afc-94b5-410c4c3c1990 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:38.743507 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cb346bd2-8f69-403a-91df-24b70f3b72bb tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:38.754216 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cb346bd2-8f69-403a-91df-24b70f3b72bb tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:38.754819 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cb346bd2-8f69-403a-91df-24b70f3b72bb tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:38.762270 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-0ad0d6eb-b393-45f2-8d6a-05acc95236e3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '33c8b404-8f77-4e6e-b931-e5106d314f63', 'name': 'tempest-snat-router-495122030', 'tenant_id': '0f0b9fa79c884bda978424cf72c631d5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.21'}], 'enable_snat': True}, 'gw_port_id': '78ff927b-910b-4c76-8fb4-15ef5db9823c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:29:33Z', 'updated_at': '2021-11-09T04:29:36Z', 'revision_number': 3, 'project_id': '0f0b9fa79c884bda978424cf72c631d5', 'gw_port': {'id': '78ff927b-910b-4c76-8fb4-15ef5db9823c', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:55:bb:5d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '33c8b404-8f77-4e6e-b931-e5106d314f63', 'device_owner': 'network:router_gateway', 'standard_attr_id': 338, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:29:35Z', 'updated_at': '2021-11-09T04:29:35Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:38.775983 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2d634eb5-a35e-4a4f-801b-ca453802d32b tempest-MeteringIpV6TestJSON-906262167 tempest-MeteringIpV6TestJSON-906262167-project-admin] Publish callbacks [] for metering_label, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:38.775983 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-2d634eb5-a35e-4a4f-801b-ca453802d32b tempest-MeteringIpV6TestJSON-906262167 tempest-MeteringIpV6TestJSON-906262167-project-admin] 10.222.0.24 "DELETE /v2.0/metering/metering-labels/fd2c863a-d264-4c67-a82d-625869c9f5dc HTTP/1.1" status: 204 len: 168 time: 0.8595009 Nov 09 04:29:38.824628 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-910fe173-46ac-43b7-9695-549eb6054304 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:38.829256 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ad0d6eb-b393-45f2-8d6a-05acc95236e3 None None] Checking router: 33c8b404-8f77-4e6e-b931-e5106d314f63 for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:29:38.830699 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-910fe173-46ac-43b7-9695-549eb6054304 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] 10.222.0.24 "DELETE /v2.0/ports/66695da2-5d15-4717-8c15-6199530b694a HTTP/1.1" status: 204 len: 168 time: 1.6542416 Nov 09 04:29:38.831137 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ad0d6eb-b393-45f2-8d6a-05acc95236e3 None None] Updating router 33c8b404-8f77-4e6e-b931-e5106d314f63 port 78ff927b-910b-4c76-8fb4-15ef5db9823c binding host dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 04:29:38.834229 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53840) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:38.883916 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0ad0d6eb-b393-45f2-8d6a-05acc95236e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:38.929527 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-af50d756-ca33-406d-b185-31a07dd0072a tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:38.949178 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-cb346bd2-8f69-403a-91df-24b70f3b72bb tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 1.0834963 Nov 09 04:29:38.950310 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b30703c-b956-4afc-94b5-410c4c3c1990 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Pushing event updated for resources: {'Subnet': ['ID=c56087fb-3bf4-49d6-b69c-7bfa6c09fd5e,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:38.958679 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-af50d756-ca33-406d-b185-31a07dd0072a tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] 10.222.0.24 "GET /v2.0/ports?device_id=1601b691-a672-4120-96cd-d64828e2535d HTTP/1.1" status: 200 len: 913 time: 0.1234984 Nov 09 04:29:38.958679 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53844) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:38.960503 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53846) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:38.961316 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-edd34bcb-962f-4898-bd46-3f309325231d tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Request body: {'subnet': {'network_id': 'aa0d1e9f-fc22-4053-b61f-4d6102a5f7d0', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': None}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:38.975972 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a9d87aaf-57a3-4dcc-9179-c1f7a5d83e28 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:39.028125 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb346bd2-8f69-403a-91df-24b70f3b72bb tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Pushing event updated for resources: {'Network': ['ID=aa0d1e9f-fc22-4053-b61f-4d6102a5f7d0,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:39.049391 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network aa0d1e9f-fc22-4053-b61f-4d6102a5f7d0 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:29:39.074019 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4b30703c-b956-4afc-94b5-410c4c3c1990 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Checking segment: {'id': 'dd9e8fdb-1a91-4c9d-9808-cd8fbf4dbb3d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 317, 'network_id': '7b21ba4a-ddd5-4fb9-9bfd-bc86bfc5cedf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:29:39.074688 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4b30703c-b956-4afc-94b5-410c4c3c1990 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Network hostable DHCP agents. Network: 7b21ba4a-ddd5-4fb9-9bfd-bc86bfc5cedf, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:29:39.160992 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-edd34bcb-962f-4898-bd46-3f309325231d tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Made reservation on behalf of 83cbb798c0f44b268f8acd2a70eb745a for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:29:39.168156 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-edd34bcb-962f-4898-bd46-3f309325231d tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:39.201573 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4b30703c-b956-4afc-94b5-410c4c3c1990 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Network 7b21ba4a-ddd5-4fb9-9bfd-bc86bfc5cedf is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:29:39.243811 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53854) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:39.306024 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-4b30703c-b956-4afc-94b5-410c4c3c1990 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 7b21ba4a-ddd5-4fb9-9bfd-bc86bfc5cedf) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:29:39.313352 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4b30703c-b956-4afc-94b5-410c4c3c1990 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:39.358846 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53858) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:39.362557 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-37ffbb9e-635b-4e6a-8e8d-dfbab98ba947 None None] Network 7b21ba4a-ddd5-4fb9-9bfd-bc86bfc5cedf requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:29:39.459770 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0ad0d6eb-b393-45f2-8d6a-05acc95236e3 None None] Publish callbacks [] for port, precommit_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:39.515392 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0ad0d6eb-b393-45f2-8d6a-05acc95236e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:39.538784 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-edd34bcb-962f-4898-bd46-3f309325231d tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:39.598425 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-0ad0d6eb-b393-45f2-8d6a-05acc95236e3 None None] Attempting to bind port 78ff927b-910b-4c76-8fb4-15ef5db9823c on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:29:39.598843 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-0ad0d6eb-b393-45f2-8d6a-05acc95236e3 None None] Attempting to bind port 78ff927b-910b-4c76-8fb4-15ef5db9823c by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:29:39.599353 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0ad0d6eb-b393-45f2-8d6a-05acc95236e3 None None] Attempting to bind port 78ff927b-910b-4c76-8fb4-15ef5db9823c on network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:29:39.619698 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-86b0bcb2-91e4-4b36-9596-35d736385fa3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:39.622264 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0ad0d6eb-b393-45f2-8d6a-05acc95236e3 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 29, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:29:39.622825 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0ad0d6eb-b393-45f2-8d6a-05acc95236e3 None None] Checking segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:29:39.623331 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0ad0d6eb-b393-45f2-8d6a-05acc95236e3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:39.623818 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0ad0d6eb-b393-45f2-8d6a-05acc95236e3 None None] Bound using segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:29:39.624398 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-0ad0d6eb-b393-45f2-8d6a-05acc95236e3 None None] Bound port: 78ff927b-910b-4c76-8fb4-15ef5db9823c, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:29:39.624882 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0ad0d6eb-b393-45f2-8d6a-05acc95236e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:39.654862 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edd34bcb-962f-4898-bd46-3f309325231d tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Pushing event updated for resources: {'Subnet': ['ID=91289be5-8cd2-48e1-99bf-bf50f08a11e9,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:39.675685 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-191f161a-dbf6-4bfc-bfd4-69045cddf16c None None] Pushing event updated for resources: {'Port': ['ID=78ff927b-910b-4c76-8fb4-15ef5db9823c,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:39.681609 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-a9d87aaf-57a3-4dcc-9179-c1f7a5d83e28 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Deleting port 78ff927b-910b-4c76-8fb4-15ef5db9823c {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:29:39.681949 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a9d87aaf-57a3-4dcc-9179-c1f7a5d83e28 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:39.691605 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-edd34bcb-962f-4898-bd46-3f309325231d tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Checking segment: {'id': '3a0b343d-7541-40bc-87c7-5e2ef89982eb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 330, 'network_id': 'aa0d1e9f-fc22-4053-b61f-4d6102a5f7d0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:29:39.691966 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-edd34bcb-962f-4898-bd46-3f309325231d tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Network hostable DHCP agents. Network: aa0d1e9f-fc22-4053-b61f-4d6102a5f7d0, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:29:39.707627 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-503599a2-f97b-4555-a9f8-9b5ef1679257 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Request body: {'network': {'name': 'tempest-RoutersAdminTest-978187898', 'router:external': True}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:39.744406 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b68b6a95-227d-4c7a-83ba-66606ed029e6 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-7b21ba4a-ddd5-4fb9-9bfd-bc86bfc5cedf', 'network_id': '7b21ba4a-ddd5-4fb9-9bfd-bc86bfc5cedf', 'tenant_id': '34508a55938a43c2b57acd8dc368e922', 'fixed_ips': [{'subnet_id': 'c56087fb-3bf4-49d6-b69c-7bfa6c09fd5e'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:29:39.746222 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b68b6a95-227d-4c7a-83ba-66606ed029e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:39.757001 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-86b0bcb2-91e4-4b36-9596-35d736385fa3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:39.763773 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-0ad0d6eb-b393-45f2-8d6a-05acc95236e3 None None] For port 78ff927b-910b-4c76-8fb4-15ef5db9823c, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:29:39.779066 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-0ad0d6eb-b393-45f2-8d6a-05acc95236e3 None None] For port 78ff927b-910b-4c76-8fb4-15ef5db9823c, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=78ff927b-910b-4c76-8fb4-15ef5db9823c,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:29:39.842213 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-edd34bcb-962f-4898-bd46-3f309325231d tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Network aa0d1e9f-fc22-4053-b61f-4d6102a5f7d0 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:29:39.859269 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b30703c-b956-4afc-94b5-410c4c3c1990 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Pushing event updated for resources: {'Subnet': ['ID=661e690a-ab49-4fc3-b1d1-0ec72f8cdcb4,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:39.870211 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-86b0bcb2-91e4-4b36-9596-35d736385fa3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:39.889277 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4b30703c-b956-4afc-94b5-410c4c3c1990 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Checking segment: {'id': 'b391b776-41a7-46e7-9bd7-6dc78d4db991', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 338, 'network_id': '535db112-7a68-4365-80ba-d9b95c16b4de'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:29:39.889277 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4b30703c-b956-4afc-94b5-410c4c3c1990 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Network hostable DHCP agents. Network: 535db112-7a68-4365-80ba-d9b95c16b4de, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:29:39.911478 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a9d87aaf-57a3-4dcc-9179-c1f7a5d83e28 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:39.926278 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-86b0bcb2-91e4-4b36-9596-35d736385fa3 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=1544fbce4f9544598085e68dc906a162&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5632401 Nov 09 04:29:39.927428 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86b0bcb2-91e4-4b36-9596-35d736385fa3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=93c0798b-bf37-4632-99fd-50d4f7f8efdd,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:39.930045 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53866) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:39.940626 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-a9d87aaf-57a3-4dcc-9179-c1f7a5d83e28 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Calling delete_port for 78ff927b-910b-4c76-8fb4-15ef5db9823c owned by network:router_gateway {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:29:39.962752 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-edd34bcb-962f-4898-bd46-3f309325231d tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, aa0d1e9f-fc22-4053-b61f-4d6102a5f7d0) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:29:39.972991 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-edd34bcb-962f-4898-bd46-3f309325231d tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:39.973741 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-edd34bcb-962f-4898-bd46-3f309325231d tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:40.000058 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bf42ccd2-5a67-4e2a-a6b6-a1fa7fb6ecc7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:40.003778 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-503599a2-f97b-4555-a9f8-9b5ef1679257 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Made reservation on behalf of cf43ca7e091f42ca80c78a3f7dbeba63 for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:29:40.006647 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-503599a2-f97b-4555-a9f8-9b5ef1679257 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:40.037318 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bf42ccd2-5a67-4e2a-a6b6-a1fa7fb6ecc7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:40.037575 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7329be79-4c29-48f3-b119-398d1c20645d None None] Network aa0d1e9f-fc22-4053-b61f-4d6102a5f7d0 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:29:40.041498 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0ad0d6eb-b393-45f2-8d6a-05acc95236e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:40.059716 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-503599a2-f97b-4555-a9f8-9b5ef1679257 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:40.081682 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-edd34bcb-962f-4898-bd46-3f309325231d tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 812 time: 1.1236560 Nov 09 04:29:40.084709 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53868) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:40.099952 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 0b0033a1-902f-4286-9df5-9ba2ca69d4f9 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:29:40.102684 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4b30703c-b956-4afc-94b5-410c4c3c1990 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Network 535db112-7a68-4365-80ba-d9b95c16b4de is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:29:40.122498 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-4b30703c-b956-4afc-94b5-410c4c3c1990 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 535db112-7a68-4365-80ba-d9b95c16b4de) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:29:40.136094 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4b30703c-b956-4afc-94b5-410c4c3c1990 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:40.136566 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4b30703c-b956-4afc-94b5-410c4c3c1990 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:40.137176 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4b30703c-b956-4afc-94b5-410c4c3c1990 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:40.164529 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8f8dcbaf-1e7c-4797-89e1-e7e915074ddd None None] Network 535db112-7a68-4365-80ba-d9b95c16b4de requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:29:40.211790 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-70e80379-c881-40d6-9d74-b6da5825b40b tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:40.216399 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6b09befe-fc2a-494d-9c9c-e20105deec2c tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:40.230079 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-b68b6a95-227d-4c7a-83ba-66606ed029e6 None None] Allocated IP 2001:db8::1 (7b21ba4a-ddd5-4fb9-9bfd-bc86bfc5cedf/c56087fb-3bf4-49d6-b69c-7bfa6c09fd5e/dce773ae-639a-492f-832a-8a867bd5b865) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:29:40.266268 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-191f161a-dbf6-4bfc-bfd4-69045cddf16c None None] Pushing event updated for resources: {'Port': ['ID=78ff927b-910b-4c76-8fb4-15ef5db9823c,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:40.279777 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-70e80379-c881-40d6-9d74-b6da5825b40b tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:40.284898 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0ad0d6eb-b393-45f2-8d6a-05acc95236e3 None None] Routers {'33c8b404-8f77-4e6e-b931-e5106d314f63'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:29:40.285718 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-0ad0d6eb-b393-45f2-8d6a-05acc95236e3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:29:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['33c8b404-8f77-4e6e-b931-e5106d314f63'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:40.323199 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-4b30703c-b956-4afc-94b5-410c4c3c1990 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 1476 time: 3.5138454 Nov 09 04:29:40.323748 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53870) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:40.389528 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bf42ccd2-5a67-4e2a-a6b6-a1fa7fb6ecc7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:40.392154 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bf42ccd2-5a67-4e2a-a6b6-a1fa7fb6ecc7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:40.393725 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-bf42ccd2-5a67-4e2a-a6b6-a1fa7fb6ecc7 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/93c0798b-bf37-4632-99fd-50d4f7f8efdd HTTP/1.1" status: 204 len: 168 time: 0.4625702 Nov 09 04:29:40.418808 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf42ccd2-5a67-4e2a-a6b6-a1fa7fb6ecc7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=93c0798b-bf37-4632-99fd-50d4f7f8efdd,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:40.458455 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-736c30d9-dbe9-4b1b-8aee-8444fe562f01 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:40.459985 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-736c30d9-dbe9-4b1b-8aee-8444fe562f01 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:40.461612 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-736c30d9-dbe9-4b1b-8aee-8444fe562f01 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:40.466416 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-736c30d9-dbe9-4b1b-8aee-8444fe562f01 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] 10.222.0.24 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2102 time: 0.1385884 Nov 09 04:29:40.472634 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53874) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:40.497623 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a9d87aaf-57a3-4dcc-9179-c1f7a5d83e28 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:40.502191 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-503599a2-f97b-4555-a9f8-9b5ef1679257 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:40.521701 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-0ad0d6eb-b393-45f2-8d6a-05acc95236e3 None None] Set router 33c8b404-8f77-4e6e-b931-e5106d314f63 gateway port host: None {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:29:40.539902 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9d87aaf-57a3-4dcc-9179-c1f7a5d83e28 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Pushing event deleted for resources: {'Port': ['ID=78ff927b-910b-4c76-8fb4-15ef5db9823c,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:40.556023 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-dac4a12d-8141-4931-9322-3f7b4a25d84f tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Deleting subnet c56087fb-3bf4-49d6-b69c-7bfa6c09fd5e {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:29:40.563861 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-70e80379-c881-40d6-9d74-b6da5825b40b tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:40.588386 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-503599a2-f97b-4555-a9f8-9b5ef1679257 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:40.597744 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70e80379-c881-40d6-9d74-b6da5825b40b tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Pushing event deleted for resources: {'Subnet': ['ID=91289be5-8cd2-48e1-99bf-bf50f08a11e9,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:40.623181 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-503599a2-f97b-4555-a9f8-9b5ef1679257 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 308} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:29:40.644415 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 0b0033a1-902f-4286-9df5-9ba2ca69d4f9 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:29:40.645038 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:40.666399 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-503599a2-f97b-4555-a9f8-9b5ef1679257 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:40.666621 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-503599a2-f97b-4555-a9f8-9b5ef1679257 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Added segment dee31afc-2fc7-40e2-9fe3-1ec6de6d8270 of type vlan for network 3919e9cb-8006-4613-b88e-7ef46e2b76eb Nov 09 04:29:40.675370 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-0ad0d6eb-b393-45f2-8d6a-05acc95236e3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '33c8b404-8f77-4e6e-b931-e5106d314f63', 'name': 'tempest-snat-router-495122030', 'tenant_id': '0f0b9fa79c884bda978424cf72c631d5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:29:33Z', 'updated_at': '2021-11-09T04:29:38Z', 'revision_number': 4, 'project_id': '0f0b9fa79c884bda978424cf72c631d5', 'gw_port_host': None}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:40.678503 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-503599a2-f97b-4555-a9f8-9b5ef1679257 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a6e228fc-6893-40b8-ade5-54bd7135830b,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:40.684855 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-70e80379-c881-40d6-9d74-b6da5825b40b tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:40.688237 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a9d87aaf-57a3-4dcc-9179-c1f7a5d83e28 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-466373'] for router_gateway, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:40.708709 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-70e80379-c881-40d6-9d74-b6da5825b40b tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['aa0d1e9f-fc22-4053-b61f-4d6102a5f7d0']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:40.718632 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-70e80379-c881-40d6-9d74-b6da5825b40b tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3a0b343d-7541-40bc-87c7-5e2ef89982eb') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:40.718955 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-70e80379-c881-40d6-9d74-b6da5825b40b tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3a0b343d-7541-40bc-87c7-5e2ef89982eb') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:40.729535 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-70e80379-c881-40d6-9d74-b6da5825b40b tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:40.744316 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-70e80379-c881-40d6-9d74-b6da5825b40b tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:40.748948 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ad0d6eb-b393-45f2-8d6a-05acc95236e3 None None] The sync data for ids ['33c8b404-8f77-4e6e-b931-e5106d314f63'] in dv-neutron-816802-2-hyperv is: [{'id': '33c8b404-8f77-4e6e-b931-e5106d314f63', 'name': 'tempest-snat-router-495122030', 'tenant_id': '0f0b9fa79c884bda978424cf72c631d5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:29:33Z', 'updated_at': '2021-11-09T04:29:38Z', 'revision_number': 4, 'project_id': '0f0b9fa79c884bda978424cf72c631d5', 'gw_port_host': None}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:29:40.759348 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-70e80379-c881-40d6-9d74-b6da5825b40b tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Releasing vlan 330 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:29:40.759767 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-70e80379-c881-40d6-9d74-b6da5825b40b tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:40.764261 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:29:40.764261 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:29:40.764261 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:29:40.764261 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:29:40.764261 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:29:40.764261 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:29:40.764261 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:29:40.764261 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:29:40.764261 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:29:40.764261 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:29:40.764261 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:29:40.764261 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:29:40.764261 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:29:40.764261 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:29:40.764261 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:29:40.764261 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:29:40.764261 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:29:40.764261 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:29:40.764261 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:29:40.764261 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:29:40.764261 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:29:40.764261 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:29:40.764261 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:29:40.764261 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:29:40.764261 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:29:40.764261 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:29:40.764261 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:29:40.764261 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:29:40.764261 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:29:40.764261 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:29:40.764261 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:29:40.764261 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:29:40.776671 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d46f0118-767c-45e3-83c7-387f0e13e8e8 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-aa0d1e9f-fc22-4053-b61f-4d6102a5f7d0', 'network_id': 'aa0d1e9f-fc22-4053-b61f-4d6102a5f7d0', 'tenant_id': '83cbb798c0f44b268f8acd2a70eb745a', 'fixed_ips': [{'subnet_id': '91289be5-8cd2-48e1-99bf-bf50f08a11e9'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:29:40.777400 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d46f0118-767c-45e3-83c7-387f0e13e8e8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:40.873329 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a9d87aaf-57a3-4dcc-9179-c1f7a5d83e28 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:40.876209 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-503599a2-f97b-4555-a9f8-9b5ef1679257 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:40.880982 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a9d87aaf-57a3-4dcc-9179-c1f7a5d83e28 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:40.913664 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4eab3bcf-2e7b-4106-aa83-cf2e2ef0e9ee None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-535db112-7a68-4365-80ba-d9b95c16b4de', 'network_id': '535db112-7a68-4365-80ba-d9b95c16b4de', 'tenant_id': '34508a55938a43c2b57acd8dc368e922', 'fixed_ips': [{'subnet_id': '661e690a-ab49-4fc3-b1d1-0ec72f8cdcb4'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:29:40.914546 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4eab3bcf-2e7b-4106-aa83-cf2e2ef0e9ee None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:40.972530 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-6b09befe-fc2a-494d-9c9c-e20105deec2c tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Deleting port 36e7de16-92d8-46d7-9c75-4b0f8046b5ff {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:29:40.972945 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6b09befe-fc2a-494d-9c9c-e20105deec2c tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:41.003207 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b68b6a95-227d-4c7a-83ba-66606ed029e6 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:41.024201 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-70e80379-c881-40d6-9d74-b6da5825b40b tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:41.031250 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-70e80379-c881-40d6-9d74-b6da5825b40b tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:41.034471 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-70e80379-c881-40d6-9d74-b6da5825b40b tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "DELETE /v2.0/networks/aa0d1e9f-fc22-4053-b61f-4d6102a5f7d0 HTTP/1.1" status: 204 len: 168 time: 0.9466410 Nov 09 04:29:41.040423 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53882) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:41.048963 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-4c72756f-a317-45af-a928-850b89c5777f tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-2146063256'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:41.050085 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70e80379-c881-40d6-9d74-b6da5825b40b tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Pushing event deleted for resources: {'Network': ['ID=aa0d1e9f-fc22-4053-b61f-4d6102a5f7d0,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:41.078518 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-503599a2-f97b-4555-a9f8-9b5ef1679257 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:41.080147 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-503599a2-f97b-4555-a9f8-9b5ef1679257 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:41.082676 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-503599a2-f97b-4555-a9f8-9b5ef1679257 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:41.083794 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a9d87aaf-57a3-4dcc-9179-c1f7a5d83e28 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:41.084278 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a9d87aaf-57a3-4dcc-9179-c1f7a5d83e28 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 33c8b404-8f77-4e6e-b931-e5106d314f63 {{(pid=102161) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:29:41.089202 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a9d87aaf-57a3-4dcc-9179-c1f7a5d83e28 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:41.090759 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a9d87aaf-57a3-4dcc-9179-c1f7a5d83e28 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] 10.222.0.24 "DELETE /v2.0/routers/33c8b404-8f77-4e6e-b931-e5106d314f63 HTTP/1.1" status: 204 len: 168 time: 2.6581161 Nov 09 04:29:41.093204 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53884) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:41.140273 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6b09befe-fc2a-494d-9c9c-e20105deec2c tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:41.156742 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9981c3c0-6e3d-4f64-a331-f770df931b43 None None] Network aa0d1e9f-fc22-4053-b61f-4d6102a5f7d0 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:29:41.163099 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-4eab3bcf-2e7b-4106-aa83-cf2e2ef0e9ee None None] Allocated IP 2001:db8:0:1::1 (535db112-7a68-4365-80ba-d9b95c16b4de/661e690a-ab49-4fc3-b1d1-0ec72f8cdcb4/8ba98194-9b04-4342-822e-437c28b4afdc) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:29:41.177943 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9981c3c0-6e3d-4f64-a331-f770df931b43 None None] Network aa0d1e9f-fc22-4053-b61f-4d6102a5f7d0 could not be found, it might have been deleted concurrently. {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:225}} Nov 09 04:29:41.184547 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-6b09befe-fc2a-494d-9c9c-e20105deec2c tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Calling delete_port for 36e7de16-92d8-46d7-9c75-4b0f8046b5ff owned by network:router_interface {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:29:41.189229 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-dac4a12d-8141-4931-9322-3f7b4a25d84f tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:41.190644 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-503599a2-f97b-4555-a9f8-9b5ef1679257 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Pushing event updated for resources: {'Network': ['ID=3919e9cb-8006-4613-b88e-7ef46e2b76eb,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:41.193507 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b68b6a95-227d-4c7a-83ba-66606ed029e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:41.201237 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4c72756f-a317-45af-a928-850b89c5777f tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Made reservation on behalf of 83cbb798c0f44b268f8acd2a70eb745a for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:29:41.205488 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4c72756f-a317-45af-a928-850b89c5777f tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:41.224772 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 3919e9cb-8006-4613-b88e-7ef46e2b76eb details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:29:41.236705 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e296d648-99c7-4165-9a0b-f2c3ba03c088 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks [] for router, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:41.274905 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-dac4a12d-8141-4931-9322-3f7b4a25d84f tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:41.342679 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b68b6a95-227d-4c7a-83ba-66606ed029e6 None None] Network 7b21ba4a-ddd5-4fb9-9bfd-bc86bfc5cedf is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:29:41.365274 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-503599a2-f97b-4555-a9f8-9b5ef1679257 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 870 time: 2.1171887 Nov 09 04:29:41.368523 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53886) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:41.373534 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-1a44acfe-67f8-4e03-b7f2-bbef08b98c6e tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Request body: {'subnet': {'network_id': '3919e9cb-8006-4613-b88e-7ef46e2b76eb', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'enable_dhcp': False}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:41.401839 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53888) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:41.409482 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-b68b6a95-227d-4c7a-83ba-66606ed029e6 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:29:41.419882 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b68b6a95-227d-4c7a-83ba-66606ed029e6 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:29:41.432206 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4c72756f-a317-45af-a928-850b89c5777f tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 346} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:29:41.433626 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b68b6a95-227d-4c7a-83ba-66606ed029e6 None None] Pushing event updated for resources: {'Port': ['ID=dce773ae-639a-492f-832a-8a867bd5b865,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:41.440835 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1fa501db-fe83-4df7-aaf8-abe5f137f13b admin admin] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:41.458398 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4c72756f-a317-45af-a928-850b89c5777f tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:41.459101 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-4c72756f-a317-45af-a928-850b89c5777f tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Added segment aa07db52-653c-41c6-ba4b-e0dd8f0b1051 of type vlan for network 041287e3-92a1-4b58-9250-6007d559460c Nov 09 04:29:41.493757 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-dac4a12d-8141-4931-9322-3f7b4a25d84f tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:41.500938 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e296d648-99c7-4165-9a0b-f2c3ba03c088 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:41.505716 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-72fb8a56-5d03-494f-a149-17ec6785bbba None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:41.506626 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1a44acfe-67f8-4e03-b7f2-bbef08b98c6e tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Made reservation on behalf of cf43ca7e091f42ca80c78a3f7dbeba63 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:29:41.510079 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1a44acfe-67f8-4e03-b7f2-bbef08b98c6e tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:41.528864 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-bf0698bb-e5f3-4e7e-8778-218599385960 req-cf6a6b3a-0ecc-4e80-9fe6-a690a1b64d0c service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=fd8e39fc-699b-4777-aae4-ca592a898437&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1681745 Nov 09 04:29:41.541635 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-b68b6a95-227d-4c7a-83ba-66606ed029e6 None None] Attempting to bind port dce773ae-639a-492f-832a-8a867bd5b865 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:29:41.542190 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-b68b6a95-227d-4c7a-83ba-66606ed029e6 None None] Attempting to bind port dce773ae-639a-492f-832a-8a867bd5b865 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'dd9e8fdb-1a91-4c9d-9808-cd8fbf4dbb3d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 317, 'network_id': '7b21ba4a-ddd5-4fb9-9bfd-bc86bfc5cedf'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:29:41.542433 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b68b6a95-227d-4c7a-83ba-66606ed029e6 None None] Attempting to bind port dce773ae-639a-492f-832a-8a867bd5b865 on network 7b21ba4a-ddd5-4fb9-9bfd-bc86bfc5cedf {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:29:41.550306 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b68b6a95-227d-4c7a-83ba-66606ed029e6 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 29, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:29:41.550836 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b68b6a95-227d-4c7a-83ba-66606ed029e6 None None] Checking segment: {'id': 'dd9e8fdb-1a91-4c9d-9808-cd8fbf4dbb3d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 317, 'network_id': '7b21ba4a-ddd5-4fb9-9bfd-bc86bfc5cedf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:29:41.551430 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b68b6a95-227d-4c7a-83ba-66606ed029e6 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:41.552048 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b68b6a95-227d-4c7a-83ba-66606ed029e6 None None] Bound using segment: {'id': 'dd9e8fdb-1a91-4c9d-9808-cd8fbf4dbb3d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 317, 'network_id': '7b21ba4a-ddd5-4fb9-9bfd-bc86bfc5cedf'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:29:41.552584 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-b68b6a95-227d-4c7a-83ba-66606ed029e6 None None] Bound port: dce773ae-639a-492f-832a-8a867bd5b865, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'dd9e8fdb-1a91-4c9d-9808-cd8fbf4dbb3d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 317, 'network_id': '7b21ba4a-ddd5-4fb9-9bfd-bc86bfc5cedf'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:29:41.553030 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b68b6a95-227d-4c7a-83ba-66606ed029e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:41.589504 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4eab3bcf-2e7b-4106-aa83-cf2e2ef0e9ee None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:41.629921 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4c72756f-a317-45af-a928-850b89c5777f tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:41.650644 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-b68b6a95-227d-4c7a-83ba-66606ed029e6 None None] For port dce773ae-639a-492f-832a-8a867bd5b865, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:29:41.654990 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-b68b6a95-227d-4c7a-83ba-66606ed029e6 None None] For port dce773ae-639a-492f-832a-8a867bd5b865, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=dce773ae-639a-492f-832a-8a867bd5b865,segment=NetworkSegment(dd9e8fdb-1a91-4c9d-9808-cd8fbf4dbb3d),segment_id=dd9e8fdb-1a91-4c9d-9808-cd8fbf4dbb3d)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:29:41.669509 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-dac4a12d-8141-4931-9322-3f7b4a25d84f tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:41.692898 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4eab3bcf-2e7b-4106-aa83-cf2e2ef0e9ee None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:41.699188 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6b09befe-fc2a-494d-9c9c-e20105deec2c tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:41.726326 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-dac4a12d-8141-4931-9322-3f7b4a25d84f tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:41.732626 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-dac4a12d-8141-4931-9322-3f7b4a25d84f tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] 10.222.0.24 "DELETE /v2.0/subnets/c56087fb-3bf4-49d6-b69c-7bfa6c09fd5e HTTP/1.1" status: 204 len: 168 time: 1.2547617 Nov 09 04:29:41.732827 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dac4a12d-8141-4931-9322-3f7b4a25d84f tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Pushing event deleted for resources: {'Subnet': ['ID=c56087fb-3bf4-49d6-b69c-7bfa6c09fd5e,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:41.737186 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53892) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:41.751504 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b68b6a95-227d-4c7a-83ba-66606ed029e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:41.782556 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4eab3bcf-2e7b-4106-aa83-cf2e2ef0e9ee None None] Network 535db112-7a68-4365-80ba-d9b95c16b4de is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:29:41.783945 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b09befe-fc2a-494d-9c9c-e20105deec2c tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Pushing event deleted for resources: {'Port': ['ID=36e7de16-92d8-46d7-9c75-4b0f8046b5ff,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:41.785043 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf0698bb-e5f3-4e7e-8778-218599385960 req-0c36d3e4-c108-46b0-b60c-0ffbf7743bf6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:41.786596 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-bf0698bb-e5f3-4e7e-8778-218599385960 req-0c36d3e4-c108-46b0-b60c-0ffbf7743bf6 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=a229c806094b42c7a0f7ed52f78dfd68&device_id=fd8e39fc-699b-4777-aae4-ca592a898437 HTTP/1.1" status: 200 len: 1098 time: 0.1859603 Nov 09 04:29:41.794586 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4c72756f-a317-45af-a928-850b89c5777f tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:41.802329 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-4eab3bcf-2e7b-4106-aa83-cf2e2ef0e9ee None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:29:41.806405 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4eab3bcf-2e7b-4106-aa83-cf2e2ef0e9ee None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:29:41.806687 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4c72756f-a317-45af-a928-850b89c5777f tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:41.807483 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4c72756f-a317-45af-a928-850b89c5777f tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:41.833686 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-c7085404-0360-4fda-9e85-db60b4ede480 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Deleting subnet 661e690a-ab49-4fc3-b1d1-0ec72f8cdcb4 {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:29:41.853999 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-e296d648-99c7-4165-9a0b-f2c3ba03c088 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Deleting port 0b0033a1-902f-4286-9df5-9ba2ca69d4f9 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:29:41.854335 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e296d648-99c7-4165-9a0b-f2c3ba03c088 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:41.866539 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4eab3bcf-2e7b-4106-aa83-cf2e2ef0e9ee None None] Pushing event updated for resources: {'Port': ['ID=8ba98194-9b04-4342-822e-437c28b4afdc,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:41.881072 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c7085404-0360-4fda-9e85-db60b4ede480 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:41.929825 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b68b6a95-227d-4c7a-83ba-66606ed029e6 None None] Pushing event updated for resources: {'Port': ['ID=dce773ae-639a-492f-832a-8a867bd5b865,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:42.160806 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c7085404-0360-4fda-9e85-db60b4ede480 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:42.218785 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-e296d648-99c7-4165-9a0b-f2c3ba03c088 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] For port 0b0033a1-902f-4286-9df5-9ba2ca69d4f9, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=0b0033a1-902f-4286-9df5-9ba2ca69d4f9,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:29:42.218785 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e296d648-99c7-4165-9a0b-f2c3ba03c088 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:42.248324 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-e296d648-99c7-4165-9a0b-f2c3ba03c088 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Calling delete_port for 0b0033a1-902f-4286-9df5-9ba2ca69d4f9 owned by network:router_gateway {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:29:42.260352 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-4c72756f-a317-45af-a928-850b89c5777f tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 1.2169437 Nov 09 04:29:42.265820 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53896) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:42.274443 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-33d14206-b335-48fb-9f75-abfa1837a4ac tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Request body: {'subnet': {'network_id': '041287e3-92a1-4b58-9250-6007d559460c', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:42.284722 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-4eab3bcf-2e7b-4106-aa83-cf2e2ef0e9ee None None] Attempting to bind port 8ba98194-9b04-4342-822e-437c28b4afdc on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:29:42.285440 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-4eab3bcf-2e7b-4106-aa83-cf2e2ef0e9ee None None] Attempting to bind port 8ba98194-9b04-4342-822e-437c28b4afdc by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'b391b776-41a7-46e7-9bd7-6dc78d4db991', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 338, 'network_id': '535db112-7a68-4365-80ba-d9b95c16b4de'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:29:42.286129 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4eab3bcf-2e7b-4106-aa83-cf2e2ef0e9ee None None] Attempting to bind port 8ba98194-9b04-4342-822e-437c28b4afdc on network 535db112-7a68-4365-80ba-d9b95c16b4de {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:29:42.291294 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf0698bb-e5f3-4e7e-8778-218599385960 req-2273f9ae-6808-43ef-a375-77fb1b2a94ba service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:42.292731 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4eab3bcf-2e7b-4106-aa83-cf2e2ef0e9ee None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 29, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:29:42.292881 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-bf0698bb-e5f3-4e7e-8778-218599385960 req-2273f9ae-6808-43ef-a375-77fb1b2a94ba service neutron] 10.222.0.26 "GET /v2.0/networks?id=d4ba3288-221c-40f3-a829-662c462cc93f HTTP/1.1" status: 200 len: 906 time: 0.4641385 Nov 09 04:29:42.293500 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4eab3bcf-2e7b-4106-aa83-cf2e2ef0e9ee None None] Checking segment: {'id': 'b391b776-41a7-46e7-9bd7-6dc78d4db991', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 338, 'network_id': '535db112-7a68-4365-80ba-d9b95c16b4de'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:29:42.294119 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4eab3bcf-2e7b-4106-aa83-cf2e2ef0e9ee None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:42.294815 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4eab3bcf-2e7b-4106-aa83-cf2e2ef0e9ee None None] Bound using segment: {'id': 'b391b776-41a7-46e7-9bd7-6dc78d4db991', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 338, 'network_id': '535db112-7a68-4365-80ba-d9b95c16b4de'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:29:42.295493 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-4eab3bcf-2e7b-4106-aa83-cf2e2ef0e9ee None None] Bound port: 8ba98194-9b04-4342-822e-437c28b4afdc, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b391b776-41a7-46e7-9bd7-6dc78d4db991', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 338, 'network_id': '535db112-7a68-4365-80ba-d9b95c16b4de'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:29:42.296085 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4eab3bcf-2e7b-4106-aa83-cf2e2ef0e9ee None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:42.319840 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1fa501db-fe83-4df7-aaf8-abe5f137f13b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:42.368346 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c72756f-a317-45af-a928-850b89c5777f tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Pushing event updated for resources: {'Network': ['ID=041287e3-92a1-4b58-9250-6007d559460c,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:42.369058 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:42.374746 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-4eab3bcf-2e7b-4106-aa83-cf2e2ef0e9ee None None] For port 8ba98194-9b04-4342-822e-437c28b4afdc, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:29:42.378309 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6b09befe-fc2a-494d-9c9c-e20105deec2c tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:42.379520 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-4eab3bcf-2e7b-4106-aa83-cf2e2ef0e9ee None None] For port 8ba98194-9b04-4342-822e-437c28b4afdc, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=8ba98194-9b04-4342-822e-437c28b4afdc,segment=NetworkSegment(b391b776-41a7-46e7-9bd7-6dc78d4db991),segment_id=b391b776-41a7-46e7-9bd7-6dc78d4db991)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:29:42.383593 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 041287e3-92a1-4b58-9250-6007d559460c details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:29:42.401132 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1fa501db-fe83-4df7-aaf8-abe5f137f13b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:42.455565 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4eab3bcf-2e7b-4106-aa83-cf2e2ef0e9ee None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:42.480557 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c7085404-0360-4fda-9e85-db60b4ede480 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:42.523851 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1fa501db-fe83-4df7-aaf8-abe5f137f13b admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=175e9b46e0f44c779cc266d62b959297&name=default HTTP/1.1" status: 200 len: 2996 time: 1.1191025 Nov 09 04:29:42.523851 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fa501db-fe83-4df7-aaf8-abe5f137f13b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b17499ff-9ad6-47a1-ad39-328d536b828c,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:42.530275 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4eab3bcf-2e7b-4106-aa83-cf2e2ef0e9ee None None] Pushing event updated for resources: {'Port': ['ID=8ba98194-9b04-4342-822e-437c28b4afdc,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:42.534813 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53898) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:42.535037 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-bf0698bb-e5f3-4e7e-8778-218599385960 req-939f1e2c-d2fd-4c43-85e1-3d84fdc9f5f1 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=9ce4bb36-a0c7-4517-abaf-8db99ca3bb12 HTTP/1.1" status: 200 len: 1001 time: 0.2279477 Nov 09 04:29:42.668232 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf0698bb-e5f3-4e7e-8778-218599385960 req-ce5be6de-9708-4f28-be25-6ffa50f57e14 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:42.669692 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-bf0698bb-e5f3-4e7e-8778-218599385960 req-ce5be6de-9708-4f28-be25-6ffa50f57e14 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=b11be6b4-75f0-4756-9312-de5295f24e1b HTTP/1.1" status: 200 len: 844 time: 0.0933912 Nov 09 04:29:42.696986 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6b09befe-fc2a-494d-9c9c-e20105deec2c tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Router 1601b691-a672-4120-96cd-d64828e2535d has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:29:42.734875 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-fb4b6585-452c-45d6-baf3-315e7b0ba916 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:42.867178 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-fb4b6585-452c-45d6-baf3-315e7b0ba916 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:42.892753 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6b09befe-fc2a-494d-9c9c-e20105deec2c tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:29:42.905139 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-6b09befe-fc2a-494d-9c9c-e20105deec2c tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] 10.222.0.24 "PUT /v2.0/routers/1601b691-a672-4120-96cd-d64828e2535d/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.9409995 Nov 09 04:29:42.909827 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53902) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:42.912215 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b1018630-be7f-4f22-96d7-fea5b838af28 None None] Sync routers for ids ['1601b691-a672-4120-96cd-d64828e2535d'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:29:42.928185 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b1018630-be7f-4f22-96d7-fea5b838af28 None None] Routers {'1601b691-a672-4120-96cd-d64828e2535d'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:29:42.928834 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-b1018630-be7f-4f22-96d7-fea5b838af28 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:29:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['1601b691-a672-4120-96cd-d64828e2535d'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:42.968542 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-b1018630-be7f-4f22-96d7-fea5b838af28 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:42.981823 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b1018630-be7f-4f22-96d7-fea5b838af28 None None] Routers {'1601b691-a672-4120-96cd-d64828e2535d'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:29:42.982826 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-b1018630-be7f-4f22-96d7-fea5b838af28 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:29:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['1601b691-a672-4120-96cd-d64828e2535d'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:43.021196 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-b1018630-be7f-4f22-96d7-fea5b838af28 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:43.022066 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b1018630-be7f-4f22-96d7-fea5b838af28 None None] The sync data for ids ['1601b691-a672-4120-96cd-d64828e2535d'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:29:43.086895 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-33d14206-b335-48fb-9f75-abfa1837a4ac tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Made reservation on behalf of 83cbb798c0f44b268f8acd2a70eb745a for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:29:43.090650 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-33d14206-b335-48fb-9f75-abfa1837a4ac tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:43.098087 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c7085404-0360-4fda-9e85-db60b4ede480 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:43.167698 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7085404-0360-4fda-9e85-db60b4ede480 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Pushing event deleted for resources: {'Subnet': ['ID=661e690a-ab49-4fc3-b1d1-0ec72f8cdcb4,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:43.215661 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c7085404-0360-4fda-9e85-db60b4ede480 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:43.221563 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-c7085404-0360-4fda-9e85-db60b4ede480 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] 10.222.0.24 "DELETE /v2.0/subnets/661e690a-ab49-4fc3-b1d1-0ec72f8cdcb4 HTTP/1.1" status: 204 len: 168 time: 1.4810524 Nov 09 04:29:43.224128 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53906) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:43.242691 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f2a160f8-0cc2-4e3e-9252-2af969ad3b73 None None] Network 7b21ba4a-ddd5-4fb9-9bfd-bc86bfc5cedf requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:29:43.243229 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e296d648-99c7-4165-9a0b-f2c3ba03c088 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:43.315898 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e296d648-99c7-4165-9a0b-f2c3ba03c088 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Pushing event deleted for resources: {'Port': ['ID=0b0033a1-902f-4286-9df5-9ba2ca69d4f9,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:43.326240 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-a68141be-134e-4741-aacf-6281913d534f None None] Provisioning complete for port dce773ae-639a-492f-832a-8a867bd5b865 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:29:43.326961 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a68141be-134e-4741-aacf-6281913d534f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:43.328023 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf0698bb-e5f3-4e7e-8778-218599385960 req-2e4a21c3-bd55-41bb-b2f6-dfa09f5d2ecb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:43.329594 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-bf0698bb-e5f3-4e7e-8778-218599385960 req-2e4a21c3-bd55-41bb-b2f6-dfa09f5d2ecb service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=d4ba3288-221c-40f3-a829-662c462cc93f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.6402574 Nov 09 04:29:43.361285 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.objects.ports [None req-1a44acfe-67f8-4e03-b7f2-bbef08b98c6e tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=102161) get_objects /opt/stack/neutron/neutron/objects/ports.py:444}} Nov 09 04:29:43.361757 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1a44acfe-67f8-4e03-b7f2-bbef08b98c6e tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:43.371658 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f4c487d1-eb66-4bf8-9a44-db25b59046c1 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks [] for router, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:43.423527 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-33b81c45-7d69-41c6-8425-fa370a62d8ac tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:43.429222 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-33b81c45-7d69-41c6-8425-fa370a62d8ac tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] 10.222.0.24 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.1981301 Nov 09 04:29:43.433769 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53908) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:43.498483 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a68141be-134e-4741-aacf-6281913d534f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:43.508575 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a44acfe-67f8-4e03-b7f2-bbef08b98c6e tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Pushing event updated for resources: {'Subnet': ['ID=2af48489-6c72-46b4-8eb9-1e92215d96e9,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:43.522819 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e296d648-99c7-4165-9a0b-f2c3ba03c088 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-466373'] for router_gateway, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:43.544745 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-da3fed34-0726-499c-a4c4-756e91e37480 None None] DHCP port deletion for 7b21ba4a-ddd5-4fb9-9bfd-bc86bfc5cedf request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:29:43.577153 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-a68141be-134e-4741-aacf-6281913d534f None None] For port dce773ae-639a-492f-832a-8a867bd5b865, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=dce773ae-639a-492f-832a-8a867bd5b865,segment=NetworkSegment(dd9e8fdb-1a91-4c9d-9808-cd8fbf4dbb3d),segment_id=dd9e8fdb-1a91-4c9d-9808-cd8fbf4dbb3d)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:29:43.597962 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-fb4b6585-452c-45d6-baf3-315e7b0ba916 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:43.601080 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-fb4b6585-452c-45d6-baf3-315e7b0ba916 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:43.604874 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-fb4b6585-452c-45d6-baf3-315e7b0ba916 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/b17499ff-9ad6-47a1-ad39-328d536b828c HTTP/1.1" status: 204 len: 168 time: 1.0664771 Nov 09 04:29:43.645043 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-da3fed34-0726-499c-a4c4-756e91e37480 None None] Deleting port dce773ae-639a-492f-832a-8a867bd5b865 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:29:43.645652 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-da3fed34-0726-499c-a4c4-756e91e37480 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:43.647999 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f4c487d1-eb66-4bf8-9a44-db25b59046c1 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:43.650211 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a44acfe-67f8-4e03-b7f2-bbef08b98c6e tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Checking segment: {'id': 'dee31afc-2fc7-40e2-9fe3-1ec6de6d8270', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 308, 'network_id': '3919e9cb-8006-4613-b88e-7ef46e2b76eb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:29:43.650663 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1a44acfe-67f8-4e03-b7f2-bbef08b98c6e tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Network hostable DHCP agents. Network: 3919e9cb-8006-4613-b88e-7ef46e2b76eb, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:29:43.654557 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f4c487d1-eb66-4bf8-9a44-db25b59046c1 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:43.656223 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb4b6585-452c-45d6-baf3-315e7b0ba916 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b17499ff-9ad6-47a1-ad39-328d536b828c,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:43.702744 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e296d648-99c7-4165-9a0b-f2c3ba03c088 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:43.705033 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e296d648-99c7-4165-9a0b-f2c3ba03c088 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:43.727929 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-2ccb2d82-c423-41aa-8bbf-dd6cd1df6a44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:43.731598 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a68141be-134e-4741-aacf-6281913d534f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:43.749988 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1a44acfe-67f8-4e03-b7f2-bbef08b98c6e tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Network 3919e9cb-8006-4613-b88e-7ef46e2b76eb is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:29:43.790269 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e3ad0afb-5211-4626-a4cb-fbf424be33f3 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:43.795126 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-da3fed34-0726-499c-a4c4-756e91e37480 None None] For port dce773ae-639a-492f-832a-8a867bd5b865, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=dce773ae-639a-492f-832a-8a867bd5b865,segment=NetworkSegment(dd9e8fdb-1a91-4c9d-9808-cd8fbf4dbb3d),segment_id=dd9e8fdb-1a91-4c9d-9808-cd8fbf4dbb3d)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:29:43.795523 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-da3fed34-0726-499c-a4c4-756e91e37480 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:43.816587 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-bf0698bb-e5f3-4e7e-8778-218599385960 req-8209913f-40c0-4ba0-92e1-9f383b4e48a8 service neutron] 10.222.0.26 "GET /v2.0/networks/d4ba3288-221c-40f3-a829-662c462cc93f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4630947 Nov 09 04:29:43.819475 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-da3fed34-0726-499c-a4c4-756e91e37480 None None] Calling delete_port for dce773ae-639a-492f-832a-8a867bd5b865 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:29:43.839339 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f4c487d1-eb66-4bf8-9a44-db25b59046c1 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:43.839339 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f4c487d1-eb66-4bf8-9a44-db25b59046c1 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Fanout notify agent at l3_agent the message router_deleted on router 1601b691-a672-4120-96cd-d64828e2535d {{(pid=102161) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:29:43.847663 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f4c487d1-eb66-4bf8-9a44-db25b59046c1 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:43.848796 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-f4c487d1-eb66-4bf8-9a44-db25b59046c1 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] 10.222.0.24 "DELETE /v2.0/routers/1601b691-a672-4120-96cd-d64828e2535d HTTP/1.1" status: 204 len: 168 time: 0.9384377 Nov 09 04:29:43.851284 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53912) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:43.866077 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-1a44acfe-67f8-4e03-b7f2-bbef08b98c6e tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 3919e9cb-8006-4613-b88e-7ef46e2b76eb) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:29:43.900813 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e296d648-99c7-4165-9a0b-f2c3ba03c088 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:43.901341 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e296d648-99c7-4165-9a0b-f2c3ba03c088 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Fanout notify agent at l3_agent the message router_deleted on router f5974beb-acaf-4749-8a37-c81354d21d76 {{(pid=102162) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:29:43.908410 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1a44acfe-67f8-4e03-b7f2-bbef08b98c6e tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:43.908988 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1a44acfe-67f8-4e03-b7f2-bbef08b98c6e tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:43.909111 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e296d648-99c7-4165-9a0b-f2c3ba03c088 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:43.913872 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e296d648-99c7-4165-9a0b-f2c3ba03c088 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] 10.222.0.24 "DELETE /v2.0/routers/f5974beb-acaf-4749-8a37-c81354d21d76 HTTP/1.1" status: 204 len: 168 time: 2.8194261 Nov 09 04:29:43.929648 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53916) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:43.941500 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bc9df707-aad9-4cd0-97bc-0759eb499262 None None] Network 3919e9cb-8006-4613-b88e-7ef46e2b76eb requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:29:43.958406 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-19468b4c-ff44-4151-9a2a-595d075e0faa tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Request body: {'router': {'name': 'tempest-RoutersIpV6AdminTest-router-921902861', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}, 'admin_state_up': False}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:43.972280 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a68141be-134e-4741-aacf-6281913d534f None None] Pushing event updated for resources: {'Port': ['ID=dce773ae-639a-492f-832a-8a867bd5b865,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:44.000719 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-33d14206-b335-48fb-9f75-abfa1837a4ac tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:44.027180 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-4cebf94d-1ae6-446d-be6b-7487308b037d tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Deleting subnet ee35063e-795f-4ddd-b990-2a7e9018abb7 {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:29:44.045239 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4cebf94d-1ae6-446d-be6b-7487308b037d tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:44.082109 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-19468b4c-ff44-4151-9a2a-595d075e0faa tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:44.083969 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-19468b4c-ff44-4151-9a2a-595d075e0faa tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:44.086882 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f8bc2caf-bbfe-4f84-a97c-e1a52354dd26 None None] Network 535db112-7a68-4365-80ba-d9b95c16b4de requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:29:44.138289 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-bf0698bb-e5f3-4e7e-8778-218599385960 req-054fe7e6-9891-4da3-a41e-bd812b5f43d7 service neutron] 10.222.0.26 "GET /v2.0/networks/d4ba3288-221c-40f3-a829-662c462cc93f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2954690 Nov 09 04:29:44.140958 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-e3ad0afb-5211-4626-a4cb-fbf424be33f3 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Deleting port 8ba98194-9b04-4342-822e-437c28b4afdc {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:29:44.141479 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e3ad0afb-5211-4626-a4cb-fbf424be33f3 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:44.141618 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4cebf94d-1ae6-446d-be6b-7487308b037d tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:44.147291 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33d14206-b335-48fb-9f75-abfa1837a4ac tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Pushing event updated for resources: {'Subnet': ['ID=56601af2-58d8-42dc-ba43-94f41f0243d4,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:44.226161 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-da3fed34-0726-499c-a4c4-756e91e37480 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:44.232379 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1a44acfe-67f8-4e03-b7f2-bbef08b98c6e tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 802 time: 2.8626878 Nov 09 04:29:44.236326 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53920) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:44.260766 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-a228254f-db84-448d-b5d8-9155fb36aa10 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Request body: {'port': {'name': 'tempest-RoutersAdminTest-1931873511', 'network_id': '3919e9cb-8006-4613-b88e-7ef46e2b76eb'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:44.274256 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-33d14206-b335-48fb-9f75-abfa1837a4ac tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Checking segment: {'id': 'aa07db52-653c-41c6-ba4b-e0dd8f0b1051', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 346, 'network_id': '041287e3-92a1-4b58-9250-6007d559460c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:29:44.276318 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-33d14206-b335-48fb-9f75-abfa1837a4ac tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Network hostable DHCP agents. Network: 041287e3-92a1-4b58-9250-6007d559460c, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:29:44.279889 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-e3ad0afb-5211-4626-a4cb-fbf424be33f3 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] For port 8ba98194-9b04-4342-822e-437c28b4afdc, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=8ba98194-9b04-4342-822e-437c28b4afdc,segment=NetworkSegment(b391b776-41a7-46e7-9bd7-6dc78d4db991),segment_id=b391b776-41a7-46e7-9bd7-6dc78d4db991)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:29:44.280156 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e3ad0afb-5211-4626-a4cb-fbf424be33f3 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:44.330145 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-19468b4c-ff44-4151-9a2a-595d075e0faa tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:44.342429 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-e3ad0afb-5211-4626-a4cb-fbf424be33f3 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Calling delete_port for 8ba98194-9b04-4342-822e-437c28b4afdc owned by network:dhcp {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:29:44.375063 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a228254f-db84-448d-b5d8-9155fb36aa10 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Made reservation on behalf of cf43ca7e091f42ca80c78a3f7dbeba63 for: {'port': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:29:44.380594 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a228254f-db84-448d-b5d8-9155fb36aa10 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:44.397253 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 8ba98194-9b04-4342-822e-437c28b4afdc up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:29:44.400511 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4cebf94d-1ae6-446d-be6b-7487308b037d tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:44.405808 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [None req-a228254f-db84-448d-b5d8-9155fb36aa10 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] device_id is not set on port f84bf407-b651-47f6-95a6-580d68ae8b6d yet. {{(pid=102161) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:29:44.447902 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-33d14206-b335-48fb-9f75-abfa1837a4ac tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Network 041287e3-92a1-4b58-9250-6007d559460c is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:29:44.458598 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e1cc86b4-d5a1-41fa-a13e-30bd24c03de0 None None] Provisioning complete for port 8ba98194-9b04-4342-822e-437c28b4afdc triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:29:44.458957 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e1cc86b4-d5a1-41fa-a13e-30bd24c03de0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:44.464502 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-64bd5011-3597-4299-b8e1-50ca1b726103 None None] Network 3919e9cb-8006-4613-b88e-7ef46e2b76eb requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:29:44.467222 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da3fed34-0726-499c-a4c4-756e91e37480 None None] Pushing event deleted for resources: {'Port': ['ID=dce773ae-639a-492f-832a-8a867bd5b865,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:44.507347 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-da3fed34-0726-499c-a4c4-756e91e37480 None None] No DVR routers for this DVR port dce773ae-639a-492f-832a-8a867bd5b865 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:29:44.549966 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-33d14206-b335-48fb-9f75-abfa1837a4ac tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 041287e3-92a1-4b58-9250-6007d559460c) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:29:44.555321 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-33d14206-b335-48fb-9f75-abfa1837a4ac tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:44.556077 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-33d14206-b335-48fb-9f75-abfa1837a4ac tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:44.572965 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-959ea3b1-6b0f-43c6-8ba3-b936f0d979db None None] Network 041287e3-92a1-4b58-9250-6007d559460c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:29:44.579511 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e3ad0afb-5211-4626-a4cb-fbf424be33f3 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:44.601718 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e3ad0afb-5211-4626-a4cb-fbf424be33f3 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] No DVR routers for this DVR port 8ba98194-9b04-4342-822e-437c28b4afdc on host dv-neutron-816802-2-hyperv {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:29:44.611886 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No active binding found for port 8ba98194-9b04-4342-822e-437c28b4afdc {{(pid=102163) get_port_binding_host /opt/stack/neutron/neutron/plugins/ml2/db.py:216}} Nov 09 04:29:44.612304 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 8ba98194-9b04-4342-822e-437c28b4afdc not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:304}} Nov 09 04:29:44.665017 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3ad0afb-5211-4626-a4cb-fbf424be33f3 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Pushing event deleted for resources: {'Port': ['ID=8ba98194-9b04-4342-822e-437c28b4afdc,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:44.668070 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e1cc86b4-d5a1-41fa-a13e-30bd24c03de0 None None] Could not find standard attr ID for object 8ba98194-9b04-4342-822e-437c28b4afdc. {{(pid=102163) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 09 04:29:44.672642 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Port 8ba98194-9b04-4342-822e-437c28b4afdc not found, will not notify nova. {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:314}} Nov 09 04:29:44.674381 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.plugins.ml2.db [None req-e1cc86b4-d5a1-41fa-a13e-30bd24c03de0 None None] No ports have port_id starting with 8ba98194-9b04-4342-822e-437c28b4afdc Nov 09 04:29:44.709947 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-33d14206-b335-48fb-9f75-abfa1837a4ac tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 2.4412930 Nov 09 04:29:44.718752 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53932) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:44.732593 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-19468b4c-ff44-4151-9a2a-595d075e0faa tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:44.733579 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-89cc2738-93c9-47bf-a736-83860348861c tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Request body: {'subnet': {'network_id': '041287e3-92a1-4b58-9250-6007d559460c', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': None}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:44.754129 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-031f399e-8e71-4171-97a2-f004c00051bb None None] DHCP port deletion for 535db112-7a68-4365-80ba-d9b95c16b4de request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:29:44.758090 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-a228254f-db84-448d-b5d8-9155fb36aa10 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Allocated IP 172.20.0.11 (3919e9cb-8006-4613-b88e-7ef46e2b76eb/2af48489-6c72-46b4-8eb9-1e92215d96e9/f84bf407-b651-47f6-95a6-580d68ae8b6d) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:29:44.826512 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e3ad0afb-5211-4626-a4cb-fbf424be33f3 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:44.850831 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b234f9a0-3c28-486a-b651-0421185d05d5 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-041287e3-92a1-4b58-9250-6007d559460c', 'network_id': '041287e3-92a1-4b58-9250-6007d559460c', 'tenant_id': '83cbb798c0f44b268f8acd2a70eb745a', 'fixed_ips': [{'subnet_id': '56601af2-58d8-42dc-ba43-94f41f0243d4'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:29:44.851693 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b234f9a0-3c28-486a-b651-0421185d05d5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:44.882030 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4cebf94d-1ae6-446d-be6b-7487308b037d tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:44.882654 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-e3ad0afb-5211-4626-a4cb-fbf424be33f3 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['535db112-7a68-4365-80ba-d9b95c16b4de']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:44.896259 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-e3ad0afb-5211-4626-a4cb-fbf424be33f3 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b391b776-41a7-46e7-9bd7-6dc78d4db991') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:44.896259 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-e3ad0afb-5211-4626-a4cb-fbf424be33f3 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b391b776-41a7-46e7-9bd7-6dc78d4db991') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:44.913069 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e3ad0afb-5211-4626-a4cb-fbf424be33f3 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:44.938597 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e3ad0afb-5211-4626-a4cb-fbf424be33f3 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:44.952078 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e3ad0afb-5211-4626-a4cb-fbf424be33f3 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Releasing vlan 338 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:29:44.952502 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e3ad0afb-5211-4626-a4cb-fbf424be33f3 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:44.955633 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:29:44.955633 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:29:44.955633 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:29:44.955633 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:29:44.955633 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:29:44.955633 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:29:44.955633 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:29:44.955633 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:29:44.955633 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:29:44.955633 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:29:44.955633 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:29:44.955633 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:29:44.955633 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:29:44.955633 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:29:44.955633 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:29:44.955633 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:29:44.955633 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:29:44.955633 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:29:44.955633 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:29:44.955633 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:29:44.955633 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:29:44.955633 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:29:44.955633 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:29:44.955633 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:29:44.955633 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:29:44.955633 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:29:44.955633 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:29:44.955633 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:29:44.955633 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:29:44.955633 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:29:44.955633 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:29:44.955633 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:29:44.979776 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cebf94d-1ae6-446d-be6b-7487308b037d tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Pushing event deleted for resources: {'Subnet': ['ID=ee35063e-795f-4ddd-b990-2a7e9018abb7,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:44.985243 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4cebf94d-1ae6-446d-be6b-7487308b037d tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:44.989750 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-4cebf94d-1ae6-446d-be6b-7487308b037d tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] 10.222.0.24 "DELETE /v2.0/subnets/ee35063e-795f-4ddd-b990-2a7e9018abb7 HTTP/1.1" status: 204 len: 168 time: 1.1374521 Nov 09 04:29:44.998909 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53936) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:45.006126 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9c3e1aa2-e6cd-416c-9fdd-c9ca28438a8c None None] Network 95c56523-9e9a-4f6f-aa13-0372772dbac5 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:29:45.126712 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e3ad0afb-5211-4626-a4cb-fbf424be33f3 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:45.129580 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-b234f9a0-3c28-486a-b651-0421185d05d5 None None] Allocated IP 2001:db8::2 (041287e3-92a1-4b58-9250-6007d559460c/56601af2-58d8-42dc-ba43-94f41f0243d4/7c7cc4d1-9c07-4b9b-a732-a565794fd426) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:29:45.131717 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:45.134790 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e3ad0afb-5211-4626-a4cb-fbf424be33f3 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:45.136395 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a228254f-db84-448d-b5d8-9155fb36aa10 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:45.138713 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e3ad0afb-5211-4626-a4cb-fbf424be33f3 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] 10.222.0.24 "DELETE /v2.0/networks/535db112-7a68-4365-80ba-d9b95c16b4de HTTP/1.1" status: 204 len: 168 time: 1.7024169 Nov 09 04:29:45.143262 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-89cc2738-93c9-47bf-a736-83860348861c tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Made reservation on behalf of 83cbb798c0f44b268f8acd2a70eb745a for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:29:45.146915 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53944) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:45.147758 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-89cc2738-93c9-47bf-a736-83860348861c tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:45.183588 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3ad0afb-5211-4626-a4cb-fbf424be33f3 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Pushing event deleted for resources: {'Network': ['ID=535db112-7a68-4365-80ba-d9b95c16b4de,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:45.191479 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a260842c-cfec-40b5-b148-3e1303c1e719 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:45.281656 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-fe449cc1-e8ff-4eba-ab7f-036dbc386831 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:45.384882 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53948) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:45.385473 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2887364c-ed7e-48e7-9dc3-121c7af50ae6 None None] DHCP port deletion for 95c56523-9e9a-4f6f-aa13-0372772dbac5 request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:29:45.409321 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a228254f-db84-448d-b5d8-9155fb36aa10 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:45.443455 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b234f9a0-3c28-486a-b651-0421185d05d5 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:45.500686 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-2887364c-ed7e-48e7-9dc3-121c7af50ae6 None None] Deleting port dd9f29fa-78b7-4375-a0ea-44e827f0c20c {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:29:45.501053 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-2887364c-ed7e-48e7-9dc3-121c7af50ae6 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:45.511853 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-19468b4c-ff44-4151-9a2a-595d075e0faa tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks [] for router_gateway, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:45.546812 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a228254f-db84-448d-b5d8-9155fb36aa10 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Network 3919e9cb-8006-4613-b88e-7ef46e2b76eb is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:29:45.553977 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b234f9a0-3c28-486a-b651-0421185d05d5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:45.556127 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-f4ea8d66-2522-48c1-bc1e-0cb99dfc4ac4 tempest-AgentManagementNegativeTest-13371218 tempest-AgentManagementNegativeTest-13371218-project] 10.222.0.24 "GET /v2.0/agents HTTP/1.1" status: 200 len: 207 time: 0.1698720 Nov 09 04:29:45.579739 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-19468b4c-ff44-4151-9a2a-595d075e0faa tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:45.585702 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-89cc2738-93c9-47bf-a736-83860348861c tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:45.585938 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-a228254f-db84-448d-b5d8-9155fb36aa10 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:29:45.596947 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a228254f-db84-448d-b5d8-9155fb36aa10 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:29:45.599971 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a228254f-db84-448d-b5d8-9155fb36aa10 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Pushing event updated for resources: {'Port': ['ID=f84bf407-b651-47f6-95a6-580d68ae8b6d,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:45.613524 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-fe449cc1-e8ff-4eba-ab7f-036dbc386831 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:45.628853 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-89cc2738-93c9-47bf-a736-83860348861c tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Network 041287e3-92a1-4b58-9250-6007d559460c is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:29:45.633544 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-89cc2738-93c9-47bf-a736-83860348861c tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:29:45.636991 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-a260842c-cfec-40b5-b148-3e1303c1e719 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Deleting port dd9f29fa-78b7-4375-a0ea-44e827f0c20c {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:29:45.637583 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a260842c-cfec-40b5-b148-3e1303c1e719 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:45.642470 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-89cc2738-93c9-47bf-a736-83860348861c tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:45.643524 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-89cc2738-93c9-47bf-a736-83860348861c tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:45.719026 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-fe449cc1-e8ff-4eba-ab7f-036dbc386831 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7b21ba4a-ddd5-4fb9-9bfd-bc86bfc5cedf']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:45.719789 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89cc2738-93c9-47bf-a736-83860348861c tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Pushing event updated for resources: {'Subnet': ['ID=67887e10-7c7f-49fd-bc98-a6e0f6ba455f,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:45.743323 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-89cc2738-93c9-47bf-a736-83860348861c tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 793 time: 1.0226598 Nov 09 04:29:45.744644 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53956) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:45.762318 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-2887364c-ed7e-48e7-9dc3-121c7af50ae6 None None] For port dd9f29fa-78b7-4375-a0ea-44e827f0c20c, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=dd9f29fa-78b7-4375-a0ea-44e827f0c20c,segment=NetworkSegment(a79a3f61-7b94-4db2-b42c-1e9442738b0a),segment_id=a79a3f61-7b94-4db2-b42c-1e9442738b0a)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:29:45.762730 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-2887364c-ed7e-48e7-9dc3-121c7af50ae6 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:45.766586 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-fe449cc1-e8ff-4eba-ab7f-036dbc386831 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'dd9e8fdb-1a91-4c9d-9808-cd8fbf4dbb3d') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:45.766878 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-fe449cc1-e8ff-4eba-ab7f-036dbc386831 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'dd9e8fdb-1a91-4c9d-9808-cd8fbf4dbb3d') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:45.780387 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b234f9a0-3c28-486a-b651-0421185d05d5 None None] Network 041287e3-92a1-4b58-9250-6007d559460c is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:29:45.786423 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a228254f-db84-448d-b5d8-9155fb36aa10 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:45.787734 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a228254f-db84-448d-b5d8-9155fb36aa10 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:45.788396 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-2887364c-ed7e-48e7-9dc3-121c7af50ae6 None None] Calling delete_port for dd9f29fa-78b7-4375-a0ea-44e827f0c20c owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:29:45.790244 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-b234f9a0-3c28-486a-b651-0421185d05d5 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:29:45.793982 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-fe449cc1-e8ff-4eba-ab7f-036dbc386831 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:45.794169 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b234f9a0-3c28-486a-b651-0421185d05d5 None None] Pushing event updated for resources: {'Port': ['ID=7c7cc4d1-9c07-4b9b-a732-a565794fd426,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:45.796366 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b234f9a0-3c28-486a-b651-0421185d05d5 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:29:45.819078 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c26b7507-c65f-416c-8650-b7075a0b3509 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:45.820671 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c26b7507-c65f-416c-8650-b7075a0b3509 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:45.822233 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c26b7507-c65f-416c-8650-b7075a0b3509 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:45.824831 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c26b7507-c65f-416c-8650-b7075a0b3509 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:45.826220 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c26b7507-c65f-416c-8650-b7075a0b3509 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:45.831796 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-c26b7507-c65f-416c-8650-b7075a0b3509 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 3330 time: 0.0811727 Nov 09 04:29:45.831944 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-a260842c-cfec-40b5-b148-3e1303c1e719 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] For port dd9f29fa-78b7-4375-a0ea-44e827f0c20c, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=dd9f29fa-78b7-4375-a0ea-44e827f0c20c,segment=NetworkSegment(a79a3f61-7b94-4db2-b42c-1e9442738b0a),segment_id=a79a3f61-7b94-4db2-b42c-1e9442738b0a)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:29:45.831944 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a260842c-cfec-40b5-b148-3e1303c1e719 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:45.833450 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53958) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:45.838632 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-797edf0d-9f1e-4f46-b4d0-fd98d2fefa0c tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1165516889'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:45.874808 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-fe449cc1-e8ff-4eba-ab7f-036dbc386831 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:45.876914 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-a260842c-cfec-40b5-b148-3e1303c1e719 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Calling delete_port for dd9f29fa-78b7-4375-a0ea-44e827f0c20c owned by network:dhcp {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:29:45.901054 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-fe449cc1-e8ff-4eba-ab7f-036dbc386831 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Releasing vlan 317 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:29:45.901458 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-fe449cc1-e8ff-4eba-ab7f-036dbc386831 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:45.903737 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-b234f9a0-3c28-486a-b651-0421185d05d5 None None] Attempting to bind port 7c7cc4d1-9c07-4b9b-a732-a565794fd426 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:29:45.904105 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-b234f9a0-3c28-486a-b651-0421185d05d5 None None] Attempting to bind port 7c7cc4d1-9c07-4b9b-a732-a565794fd426 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'aa07db52-653c-41c6-ba4b-e0dd8f0b1051', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 346, 'network_id': '041287e3-92a1-4b58-9250-6007d559460c'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:29:45.905493 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b234f9a0-3c28-486a-b651-0421185d05d5 None None] Attempting to bind port 7c7cc4d1-9c07-4b9b-a732-a565794fd426 on network 041287e3-92a1-4b58-9250-6007d559460c {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:29:45.908351 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:29:45.908351 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:29:45.908351 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:29:45.908351 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:29:45.908351 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:29:45.908351 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:29:45.908351 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:29:45.908351 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:29:45.908351 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:29:45.908351 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:29:45.908351 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:29:45.908351 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:29:45.908351 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:29:45.908351 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:29:45.908351 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:29:45.908351 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:29:45.908351 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:29:45.908351 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:29:45.908351 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:29:45.908351 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:29:45.908351 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:29:45.908351 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:29:45.908351 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:29:45.908351 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:29:45.908351 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:29:45.908351 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:29:45.908351 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:29:45.908351 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:29:45.908351 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:29:45.908351 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:29:45.908351 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:29:45.908351 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:29:45.914460 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b234f9a0-3c28-486a-b651-0421185d05d5 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 29, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:29:45.914460 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b234f9a0-3c28-486a-b651-0421185d05d5 None None] Checking segment: {'id': 'aa07db52-653c-41c6-ba4b-e0dd8f0b1051', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 346, 'network_id': '041287e3-92a1-4b58-9250-6007d559460c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:29:45.914695 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b234f9a0-3c28-486a-b651-0421185d05d5 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:45.915086 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b234f9a0-3c28-486a-b651-0421185d05d5 None None] Bound using segment: {'id': 'aa07db52-653c-41c6-ba4b-e0dd8f0b1051', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 346, 'network_id': '041287e3-92a1-4b58-9250-6007d559460c'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:29:45.915563 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-b234f9a0-3c28-486a-b651-0421185d05d5 None None] Bound port: 7c7cc4d1-9c07-4b9b-a732-a565794fd426, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'aa07db52-653c-41c6-ba4b-e0dd8f0b1051', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 346, 'network_id': '041287e3-92a1-4b58-9250-6007d559460c'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:29:45.915981 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b234f9a0-3c28-486a-b651-0421185d05d5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:45.997867 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-b234f9a0-3c28-486a-b651-0421185d05d5 None None] For port 7c7cc4d1-9c07-4b9b-a732-a565794fd426, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:29:46.001357 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-b234f9a0-3c28-486a-b651-0421185d05d5 None None] For port 7c7cc4d1-9c07-4b9b-a732-a565794fd426, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=7c7cc4d1-9c07-4b9b-a732-a565794fd426,segment=NetworkSegment(aa07db52-653c-41c6-ba4b-e0dd8f0b1051),segment_id=aa07db52-653c-41c6-ba4b-e0dd8f0b1051)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:29:46.007624 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a228254f-db84-448d-b5d8-9155fb36aa10 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1024 time: 1.7643645 Nov 09 04:29:46.010270 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53960) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:46.017807 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-19468b4c-ff44-4151-9a2a-595d075e0faa tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Allocated IP 172.26.0.7 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/647668fe-1394-4488-9ab0-3c5f0c98e2c9) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:29:46.024241 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-2887364c-ed7e-48e7-9dc3-121c7af50ae6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:46.039817 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-797edf0d-9f1e-4f46-b4d0-fd98d2fefa0c tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Made reservation on behalf of 83cbb798c0f44b268f8acd2a70eb745a for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:29:46.040140 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 8ba98194-9b04-4342-822e-437c28b4afdc no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:29:46.043549 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-797edf0d-9f1e-4f46-b4d0-fd98d2fefa0c tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:46.101905 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2887364c-ed7e-48e7-9dc3-121c7af50ae6 None None] Pushing event deleted for resources: {'Port': ['ID=dd9f29fa-78b7-4375-a0ea-44e827f0c20c,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:46.104287 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 8ba98194-9b04-4342-822e-437c28b4afdc {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:29:46.104683 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 8ba98194-9b04-4342-822e-437c28b4afdc not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:29:46.105104 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 0b0033a1-902f-4286-9df5-9ba2ca69d4f9 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:29:46.108283 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b234f9a0-3c28-486a-b651-0421185d05d5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:46.118930 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-797edf0d-9f1e-4f46-b4d0-fd98d2fefa0c tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 310} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:29:46.133378 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-797edf0d-9f1e-4f46-b4d0-fd98d2fefa0c tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:46.133718 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-797edf0d-9f1e-4f46-b4d0-fd98d2fefa0c tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Added segment f03f8640-ff2f-45e0-bdf4-f5099f288abf of type vlan for network 329cc1ac-ceba-413f-a143-1180da7319e5 Nov 09 04:29:46.141315 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-fe449cc1-e8ff-4eba-ab7f-036dbc386831 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:46.147627 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2887364c-ed7e-48e7-9dc3-121c7af50ae6 None None] No DVR routers for this DVR port dd9f29fa-78b7-4375-a0ea-44e827f0c20c on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:29:46.155113 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-fe449cc1-e8ff-4eba-ab7f-036dbc386831 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:46.159722 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-fe449cc1-e8ff-4eba-ab7f-036dbc386831 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] 10.222.0.24 "DELETE /v2.0/networks/7b21ba4a-ddd5-4fb9-9bfd-bc86bfc5cedf HTTP/1.1" status: 204 len: 168 time: 1.0103488 Nov 09 04:29:46.165272 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53964) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:46.165272 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53966) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:46.206674 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-797edf0d-9f1e-4f46-b4d0-fd98d2fefa0c tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:46.206763 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 0b0033a1-902f-4286-9df5-9ba2ca69d4f9 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:29:46.206763 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 0b0033a1-902f-4286-9df5-9ba2ca69d4f9 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:29:46.206763 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device dd9f29fa-78b7-4375-a0ea-44e827f0c20c no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:29:46.229940 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe449cc1-e8ff-4eba-ab7f-036dbc386831 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Pushing event deleted for resources: {'Network': ['ID=7b21ba4a-ddd5-4fb9-9bfd-bc86bfc5cedf,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:46.235111 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a260842c-cfec-40b5-b148-3e1303c1e719 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:46.238520 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-78701155-d51f-4f82-90ad-31da6b77f4d7 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Deleting port f84bf407-b651-47f6-95a6-580d68ae8b6d {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:29:46.241328 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-78701155-d51f-4f82-90ad-31da6b77f4d7 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:46.251313 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: dd9f29fa-78b7-4375-a0ea-44e827f0c20c {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:29:46.251667 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device dd9f29fa-78b7-4375-a0ea-44e827f0c20c not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:29:46.282397 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b234f9a0-3c28-486a-b651-0421185d05d5 None None] Pushing event updated for resources: {'Port': ['ID=7c7cc4d1-9c07-4b9b-a732-a565794fd426,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:46.344205 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-797edf0d-9f1e-4f46-b4d0-fd98d2fefa0c tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:46.350715 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-797edf0d-9f1e-4f46-b4d0-fd98d2fefa0c tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:46.351339 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-797edf0d-9f1e-4f46-b4d0-fd98d2fefa0c tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:46.365110 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a260842c-cfec-40b5-b148-3e1303c1e719 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Pushing event deleted for resources: {'Port': ['ID=dd9f29fa-78b7-4375-a0ea-44e827f0c20c,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:46.380122 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a260842c-cfec-40b5-b148-3e1303c1e719 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] No DVR routers for this DVR port dd9f29fa-78b7-4375-a0ea-44e827f0c20c on host dv-neutron-816802-2-hyperv {{(pid=102161) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:29:46.391297 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:46.400449 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-994c4ae1-ec0a-4909-85df-0b55d03383fe admin admin] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:46.427759 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2479ea84-fd17-40eb-89f0-e376f0afe766 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:46.439384 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-19468b4c-ff44-4151-9a2a-595d075e0faa tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:46.442879 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-797edf0d-9f1e-4f46-b4d0-fd98d2fefa0c tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Pushing event updated for resources: {'Network': ['ID=329cc1ac-ceba-413f-a143-1180da7319e5,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:46.446098 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-78701155-d51f-4f82-90ad-31da6b77f4d7 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:46.456069 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 329cc1ac-ceba-413f-a143-1180da7319e5 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:29:46.459730 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-78701155-d51f-4f82-90ad-31da6b77f4d7 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Calling delete_port for f84bf407-b651-47f6-95a6-580d68ae8b6d owned by {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:29:46.464249 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-797edf0d-9f1e-4f46-b4d0-fd98d2fefa0c tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 0.6302426 Nov 09 04:29:46.466879 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53972) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:46.474565 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-9311d5e9-054f-4732-a6ea-23a0d1cef178 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Request body: {'network': {'name': 'New_network'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:46.559365 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a260842c-cfec-40b5-b148-3e1303c1e719 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:46.655720 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-a260842c-cfec-40b5-b148-3e1303c1e719 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['95c56523-9e9a-4f6f-aa13-0372772dbac5']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:46.702252 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-a260842c-cfec-40b5-b148-3e1303c1e719 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a79a3f61-7b94-4db2-b42c-1e9442738b0a') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:46.702590 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-a260842c-cfec-40b5-b148-3e1303c1e719 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a79a3f61-7b94-4db2-b42c-1e9442738b0a') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:46.716529 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-19468b4c-ff44-4151-9a2a-595d075e0faa tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:46.719320 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2479ea84-fd17-40eb-89f0-e376f0afe766 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:46.722604 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a260842c-cfec-40b5-b148-3e1303c1e719 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:46.745318 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9311d5e9-054f-4732-a6ea-23a0d1cef178 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:46.792264 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-19468b4c-ff44-4151-9a2a-595d075e0faa tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:29:46.794210 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a260842c-cfec-40b5-b148-3e1303c1e719 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:46.802822 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-2479ea84-fd17-40eb-89f0-e376f0afe766 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5ec7e43d-8b0b-4507-8c9d-637ec0696714']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:46.813703 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-19468b4c-ff44-4151-9a2a-595d075e0faa tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:29:46.820079 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a260842c-cfec-40b5-b148-3e1303c1e719 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Releasing vlan 324 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:29:46.820466 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a260842c-cfec-40b5-b148-3e1303c1e719 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:46.827646 dv-neutron-816802-2-hyperv neutron-server[102161]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:29:46.827646 dv-neutron-816802-2-hyperv neutron-server[102161]: self.session.flush() Nov 09 04:29:46.827646 dv-neutron-816802-2-hyperv neutron-server[102161]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:29:46.827646 dv-neutron-816802-2-hyperv neutron-server[102161]: self.session.flush() Nov 09 04:29:46.827646 dv-neutron-816802-2-hyperv neutron-server[102161]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:29:46.827646 dv-neutron-816802-2-hyperv neutron-server[102161]: self.session.flush() Nov 09 04:29:46.827646 dv-neutron-816802-2-hyperv neutron-server[102161]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:29:46.827646 dv-neutron-816802-2-hyperv neutron-server[102161]: self.session.flush() Nov 09 04:29:46.827646 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:29:46.827646 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:29:46.827646 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:29:46.827646 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:29:46.827646 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:29:46.827646 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:29:46.827646 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:29:46.827646 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:29:46.827646 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:29:46.827646 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:29:46.827646 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:29:46.827646 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:29:46.827646 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:29:46.827646 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:29:46.827646 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:29:46.827646 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:29:46.827646 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:29:46.827646 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:29:46.827646 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:29:46.827646 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:29:46.827646 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:29:46.827646 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:29:46.827646 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:29:46.827646 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:29:46.827646 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:29:46.827646 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:29:46.827646 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:29:46.827646 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:29:46.827646 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:29:46.827646 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:29:46.827646 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:29:46.827646 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:29:46.830467 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-19468b4c-ff44-4151-9a2a-595d075e0faa tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:29:46.876206 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-2479ea84-fd17-40eb-89f0-e376f0afe766 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8e6196ef-a897-4937-9f50-82bca1ac84f0') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:46.876496 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-2479ea84-fd17-40eb-89f0-e376f0afe766 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8e6196ef-a897-4937-9f50-82bca1ac84f0') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:46.878088 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19468b4c-ff44-4151-9a2a-595d075e0faa tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Pushing event updated for resources: {'Port': ['ID=647668fe-1394-4488-9ab0-3c5f0c98e2c9,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:46.903240 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9311d5e9-054f-4732-a6ea-23a0d1cef178 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:46.916649 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-994c4ae1-ec0a-4909-85df-0b55d03383fe admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:46.922061 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-9311d5e9-054f-4732-a6ea-23a0d1cef178 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Network 329cc1ac-ceba-413f-a143-1180da7319e5 is not hosted by any dhcp agent {{(pid=102162) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Nov 09 04:29:46.924947 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2479ea84-fd17-40eb-89f0-e376f0afe766 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:46.928792 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9311d5e9-054f-4732-a6ea-23a0d1cef178 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:46.930298 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9311d5e9-054f-4732-a6ea-23a0d1cef178 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:46.933615 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-9311d5e9-054f-4732-a6ea-23a0d1cef178 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "PUT /v2.0/networks/329cc1ac-ceba-413f-a143-1180da7319e5 HTTP/1.1" status: 200 len: 723 time: 0.4629407 Nov 09 04:29:46.938449 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53976) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:46.943962 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-61a681e7-7741-4c8b-839c-3584b843076c tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Request body: {'subnet': {'network_id': '329cc1ac-ceba-413f-a143-1180da7319e5', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:46.954938 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:46.984432 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2479ea84-fd17-40eb-89f0-e376f0afe766 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:47.000128 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-78701155-d51f-4f82-90ad-31da6b77f4d7 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:47.080038 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78701155-d51f-4f82-90ad-31da6b77f4d7 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Pushing event deleted for resources: {'Port': ['ID=f84bf407-b651-47f6-95a6-580d68ae8b6d,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:47.089226 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9311d5e9-054f-4732-a6ea-23a0d1cef178 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Pushing event updated for resources: {'Network': ['ID=329cc1ac-ceba-413f-a143-1180da7319e5,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:47.105101 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 329cc1ac-ceba-413f-a143-1180da7319e5 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:29:47.174732 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-78701155-d51f-4f82-90ad-31da6b77f4d7 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:47.182316 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-78701155-d51f-4f82-90ad-31da6b77f4d7 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] 10.222.0.24 "DELETE /v2.0/ports/f84bf407-b651-47f6-95a6-580d68ae8b6d HTTP/1.1" status: 204 len: 168 time: 1.1704867 Nov 09 04:29:47.184702 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53978) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:47.188115 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-fea7b062-976b-4be5-8cb7-230d79c6db7f tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '3919e9cb-8006-4613-b88e-7ef46e2b76eb', 'external_fixed_ips': [{'subnet_id': '2af48489-6c72-46b4-8eb9-1e92215d96e9', 'ip_address': '172.20.0.11'}]}}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:47.234872 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-61a681e7-7741-4c8b-839c-3584b843076c tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Made reservation on behalf of 83cbb798c0f44b268f8acd2a70eb745a for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:29:47.239459 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-61a681e7-7741-4c8b-839c-3584b843076c tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:47.356606 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fea7b062-976b-4be5-8cb7-230d79c6db7f tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:47.357913 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fea7b062-976b-4be5-8cb7-230d79c6db7f tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:47.370300 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-994c4ae1-ec0a-4909-85df-0b55d03383fe admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:47.372864 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2479ea84-fd17-40eb-89f0-e376f0afe766 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Releasing vlan 342 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:29:47.373256 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2479ea84-fd17-40eb-89f0-e376f0afe766 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:47.380005 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:29:47.380005 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:29:47.380005 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:29:47.380005 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:29:47.380005 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:29:47.380005 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:29:47.380005 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:29:47.380005 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:29:47.380005 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:29:47.380005 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:29:47.380005 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:29:47.380005 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:29:47.380005 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:29:47.380005 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:29:47.380005 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:29:47.380005 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:29:47.380005 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:29:47.380005 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:29:47.380005 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:29:47.380005 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:29:47.380005 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:29:47.380005 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:29:47.380005 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:29:47.380005 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:29:47.380005 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:29:47.380005 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:29:47.380005 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:29:47.380005 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:29:47.380005 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:29:47.380005 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:29:47.380005 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:29:47.380005 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:29:47.381781 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a260842c-cfec-40b5-b148-3e1303c1e719 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:47.386449 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a260842c-cfec-40b5-b148-3e1303c1e719 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:47.394649 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a260842c-cfec-40b5-b148-3e1303c1e719 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] 10.222.0.24 "DELETE /v2.0/networks/95c56523-9e9a-4f6f-aa13-0372772dbac5 HTTP/1.1" status: 204 len: 168 time: 2.3579745 Nov 09 04:29:47.450059 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6ef3949c-f369-44b3-bf4e-d9637b33d821 None None] Network 041287e3-92a1-4b58-9250-6007d559460c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:29:47.459160 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fea7b062-976b-4be5-8cb7-230d79c6db7f tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:47.535052 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a260842c-cfec-40b5-b148-3e1303c1e719 tempest-FloatingIPNegativeTestJSON-1863378586 tempest-FloatingIPNegativeTestJSON-1863378586-project] Pushing event deleted for resources: {'Network': ['ID=95c56523-9e9a-4f6f-aa13-0372772dbac5,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:47.551698 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-994c4ae1-ec0a-4909-85df-0b55d03383fe admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5cdb27dc-28cc-40d7-9969-b23048aa8a7c,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:47.567756 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-994c4ae1-ec0a-4909-85df-0b55d03383fe admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=0148e97178484dad94f5fac21a13255f&name=default HTTP/1.1" status: 200 len: 2996 time: 1.3881543 Nov 09 04:29:47.569602 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53984) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:47.569952 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-45b33a27-a871-473d-8964-368b61ceaad8 None None] Provisioning complete for port 7c7cc4d1-9c07-4b9b-a732-a565794fd426 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:29:47.570442 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-45b33a27-a871-473d-8964-368b61ceaad8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:47.622987 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4bb73186-ebda-4036-82ef-df4f2bf6b181 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:47.633124 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2479ea84-fd17-40eb-89f0-e376f0afe766 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:47.636924 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-61a681e7-7741-4c8b-839c-3584b843076c tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:47.681978 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2479ea84-fd17-40eb-89f0-e376f0afe766 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:47.685347 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-2479ea84-fd17-40eb-89f0-e376f0afe766 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] 10.222.0.24 "DELETE /v2.0/networks/5ec7e43d-8b0b-4507-8c9d-637ec0696714 HTTP/1.1" status: 204 len: 168 time: 1.5071940 Nov 09 04:29:47.691746 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53986) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:47.695591 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fea7b062-976b-4be5-8cb7-230d79c6db7f tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:47.706709 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4bb73186-ebda-4036-82ef-df4f2bf6b181 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:47.725124 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2479ea84-fd17-40eb-89f0-e376f0afe766 tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Pushing event deleted for resources: {'Network': ['ID=5ec7e43d-8b0b-4507-8c9d-637ec0696714,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:47.736580 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61a681e7-7741-4c8b-839c-3584b843076c tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Pushing event updated for resources: {'Subnet': ['ID=7e9c0a67-7fb1-46d2-a997-840c08842925,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:47.744890 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61a681e7-7741-4c8b-839c-3584b843076c tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Checking segment: {'id': 'f03f8640-ff2f-45e0-bdf4-f5099f288abf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': '329cc1ac-ceba-413f-a143-1180da7319e5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:29:47.745244 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-61a681e7-7741-4c8b-839c-3584b843076c tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Network hostable DHCP agents. Network: 329cc1ac-ceba-413f-a143-1180da7319e5, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:29:47.802910 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-45b33a27-a871-473d-8964-368b61ceaad8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:47.851149 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-61a681e7-7741-4c8b-839c-3584b843076c tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Network 329cc1ac-ceba-413f-a143-1180da7319e5 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:29:47.881060 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-45b33a27-a871-473d-8964-368b61ceaad8 None None] For port 7c7cc4d1-9c07-4b9b-a732-a565794fd426, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=7c7cc4d1-9c07-4b9b-a732-a565794fd426,segment=NetworkSegment(aa07db52-653c-41c6-ba4b-e0dd8f0b1051),segment_id=aa07db52-653c-41c6-ba4b-e0dd8f0b1051)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:29:47.904065 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4d088b3b-8764-479f-81e3-6dc1ef0ddaaf tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:47.911471 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2535878e-4a5f-488a-9cb8-0da2f7850802 None None] Update dhcp port {'port': {'network_id': '041287e3-92a1-4b58-9250-6007d559460c', 'fixed_ips': [{'subnet_id': '56601af2-58d8-42dc-ba43-94f41f0243d4', 'ip_address': '2001:db8::2'}, {'subnet_id': '67887e10-7c7f-49fd-bc98-a6e0f6ba455f'}], 'binding:host_id': 'dv-neutron-816802-2-hyperv'}, 'id': '7c7cc4d1-9c07-4b9b-a732-a565794fd426'} from dv-neutron-816802-2-hyperv. {{(pid=102163) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:328}} Nov 09 04:29:47.918408 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-19468b4c-ff44-4151-9a2a-595d075e0faa tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks [] for router_gateway, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:47.951738 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 53992) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:47.962724 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-2535878e-4a5f-488a-9cb8-0da2f7850802 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:47.986742 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-61a681e7-7741-4c8b-839c-3584b843076c tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 329cc1ac-ceba-413f-a143-1180da7319e5) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:29:48.003310 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-61a681e7-7741-4c8b-839c-3584b843076c tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:48.003906 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-61a681e7-7741-4c8b-839c-3584b843076c tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:48.027082 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-46f52173-5139-4a8d-8560-0dfd7b92a4b9 None None] Network 329cc1ac-ceba-413f-a143-1180da7319e5 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:29:48.029136 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-45b33a27-a871-473d-8964-368b61ceaad8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:48.048351 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4bb73186-ebda-4036-82ef-df4f2bf6b181 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:48.050960 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4bb73186-ebda-4036-82ef-df4f2bf6b181 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:48.052142 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-4bb73186-ebda-4036-82ef-df4f2bf6b181 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/5cdb27dc-28cc-40d7-9969-b23048aa8a7c HTTP/1.1" status: 204 len: 168 time: 0.4792454 Nov 09 04:29:48.089401 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bb73186-ebda-4036-82ef-df4f2bf6b181 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5cdb27dc-28cc-40d7-9969-b23048aa8a7c,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:48.095981 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4d088b3b-8764-479f-81e3-6dc1ef0ddaaf tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:48.124421 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fea7b062-976b-4be5-8cb7-230d79c6db7f tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:48.133930 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-4d088b3b-8764-479f-81e3-6dc1ef0ddaaf tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a7c7b95d-55e7-4c90-a62a-939c3c718b77']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:48.156920 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-4d088b3b-8764-479f-81e3-6dc1ef0ddaaf tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c48caa46-c5f6-4117-8aca-48a50d5cd811') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:48.157213 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-4d088b3b-8764-479f-81e3-6dc1ef0ddaaf tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c48caa46-c5f6-4117-8aca-48a50d5cd811') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:48.166806 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fea7b062-976b-4be5-8cb7-230d79c6db7f tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:48.175005 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-61a681e7-7741-4c8b-839c-3584b843076c tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.2330225 Nov 09 04:29:48.177124 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 53998) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:48.182100 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-e139e0ec-fa44-40e0-a2f9-ad9106009bb3 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Request body: {'subnet': {'name': 'New_subnet'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:48.213393 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4d088b3b-8764-479f-81e3-6dc1ef0ddaaf tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:48.213684 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 7c7cc4d1-9c07-4b9b-a732-a565794fd426 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:29:48.264313 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4d088b3b-8764-479f-81e3-6dc1ef0ddaaf tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:48.268373 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-e990f1bf-fb6f-4c7c-932d-8981b1e324c9 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=0bad988bbff146edaf9af1fa56d6a513&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3155339 Nov 09 04:29:48.275959 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54000) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:48.298525 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45b33a27-a871-473d-8964-368b61ceaad8 None None] Pushing event updated for resources: {'Port': ['ID=7c7cc4d1-9c07-4b9b-a732-a565794fd426,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:48.306915 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4d088b3b-8764-479f-81e3-6dc1ef0ddaaf tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Releasing vlan 349 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:29:48.307329 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4d088b3b-8764-479f-81e3-6dc1ef0ddaaf tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:48.311289 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:29:48.311289 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:29:48.311289 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:29:48.311289 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:29:48.311289 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:29:48.311289 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:29:48.311289 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:29:48.311289 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:29:48.311289 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:29:48.311289 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:29:48.311289 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:29:48.311289 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:29:48.311289 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:29:48.311289 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:29:48.311289 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:29:48.311289 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:29:48.311289 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:29:48.311289 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:29:48.311289 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:29:48.311289 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:29:48.311289 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:29:48.311289 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:29:48.311289 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:29:48.311289 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:29:48.311289 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:29:48.311289 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:29:48.311289 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:29:48.311289 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:29:48.311289 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:29:48.311289 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:29:48.311289 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:29:48.311289 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:29:48.395829 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 7c7cc4d1-9c07-4b9b-a732-a565794fd426 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:29:48.396330 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:48.453502 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-2535878e-4a5f-488a-9cb8-0da2f7850802 None None] Allocated IP 172.20.0.1 (041287e3-92a1-4b58-9250-6007d559460c/67887e10-7c7f-49fd-bc98-a6e0f6ba455f/7c7cc4d1-9c07-4b9b-a732-a565794fd426) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:29:48.461588 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-65b8fef4-4e10-4210-8a3d-b14afd4a5590 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:48.511228 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e7e79233-240c-4c22-981b-81820ede7425 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-329cc1ac-ceba-413f-a143-1180da7319e5', 'network_id': '329cc1ac-ceba-413f-a143-1180da7319e5', 'tenant_id': '83cbb798c0f44b268f8acd2a70eb745a', 'fixed_ips': [{'subnet_id': '7e9c0a67-7fb1-46d2-a997-840c08842925'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:29:48.512349 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e7e79233-240c-4c22-981b-81820ede7425 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:48.513804 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-19468b4c-ff44-4151-9a2a-595d075e0faa tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:48.537534 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-65b8fef4-4e10-4210-8a3d-b14afd4a5590 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:48.609085 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e139e0ec-fa44-40e0-a2f9-ad9106009bb3 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_update-5794779'] for subnet, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:48.661276 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4d088b3b-8764-479f-81e3-6dc1ef0ddaaf tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:48.687303 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4d088b3b-8764-479f-81e3-6dc1ef0ddaaf tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:48.693175 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-4d088b3b-8764-479f-81e3-6dc1ef0ddaaf tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] 10.222.0.24 "DELETE /v2.0/networks/a7c7b95d-55e7-4c90-a62a-939c3c718b77 HTTP/1.1" status: 204 len: 168 time: 0.9809265 Nov 09 04:29:48.694137 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d088b3b-8764-479f-81e3-6dc1ef0ddaaf tempest-BulkNetworkOpsIpV6Test-750730740 tempest-BulkNetworkOpsIpV6Test-750730740-project] Pushing event deleted for resources: {'Network': ['ID=a7c7b95d-55e7-4c90-a62a-939c3c718b77,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:48.702667 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-e7e79233-240c-4c22-981b-81820ede7425 None None] Allocated IP 2001:db8::2 (329cc1ac-ceba-413f-a143-1180da7319e5/7e9c0a67-7fb1-46d2-a997-840c08842925/b0c5807e-b943-4bc3-a8fa-5ba587093f2e) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:29:48.747209 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-fea7b062-976b-4be5-8cb7-230d79c6db7f tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Allocated IP 172.20.0.11 (3919e9cb-8006-4613-b88e-7ef46e2b76eb/2af48489-6c72-46b4-8eb9-1e92215d96e9/3b112c77-9cfb-422f-940a-39d00bcb862b) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:29:48.786999 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-65b8fef4-4e10-4210-8a3d-b14afd4a5590 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:48.790820 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-65b8fef4-4e10-4210-8a3d-b14afd4a5590 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:48.791213 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-65b8fef4-4e10-4210-8a3d-b14afd4a5590 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/ee162beb-ea68-4317-aaa3-523a7541a299 HTTP/1.1" status: 204 len: 168 time: 0.5153205 Nov 09 04:29:48.806182 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65b8fef4-4e10-4210-8a3d-b14afd4a5590 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ee162beb-ea68-4317-aaa3-523a7541a299,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:48.860122 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fea7b062-976b-4be5-8cb7-230d79c6db7f tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:48.945142 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-2535878e-4a5f-488a-9cb8-0da2f7850802 None None] For port 7c7cc4d1-9c07-4b9b-a732-a565794fd426, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=7c7cc4d1-9c07-4b9b-a732-a565794fd426,segment=NetworkSegment(aa07db52-653c-41c6-ba4b-e0dd8f0b1051),segment_id=aa07db52-653c-41c6-ba4b-e0dd8f0b1051)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:29:48.960406 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-19468b4c-ff44-4151-9a2a-595d075e0faa tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Router c9161b00-e513-429d-9e36-6b99b1929705 is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102161) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:29:49.000879 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fea7b062-976b-4be5-8cb7-230d79c6db7f tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:49.007505 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-2535878e-4a5f-488a-9cb8-0da2f7850802 None None] Publish callbacks [] for port, precommit_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:49.014299 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e7e79233-240c-4c22-981b-81820ede7425 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:49.043390 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fea7b062-976b-4be5-8cb7-230d79c6db7f tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Network 3919e9cb-8006-4613-b88e-7ef46e2b76eb is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:29:49.050061 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-fea7b062-976b-4be5-8cb7-230d79c6db7f tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:29:49.055188 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fea7b062-976b-4be5-8cb7-230d79c6db7f tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:29:49.057695 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-2535878e-4a5f-488a-9cb8-0da2f7850802 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:49.058392 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fea7b062-976b-4be5-8cb7-230d79c6db7f tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Pushing event updated for resources: {'Port': ['ID=3b112c77-9cfb-422f-940a-39d00bcb862b,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:49.096914 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e7e79233-240c-4c22-981b-81820ede7425 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:49.102391 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-19468b4c-ff44-4151-9a2a-595d075e0faa tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:29:49.126109 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9222ed8f-a898-4cbe-9f39-b93f91d06947 None None] Sync routers for ids ['c9161b00-e513-429d-9e36-6b99b1929705'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:29:49.169874 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e7e79233-240c-4c22-981b-81820ede7425 None None] Network 329cc1ac-ceba-413f-a143-1180da7319e5 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:29:49.179011 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-e7e79233-240c-4c22-981b-81820ede7425 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:29:49.181650 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2535878e-4a5f-488a-9cb8-0da2f7850802 None None] Pushing event updated for resources: {'Port': ['ID=7c7cc4d1-9c07-4b9b-a732-a565794fd426,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:49.184380 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e7e79233-240c-4c22-981b-81820ede7425 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:29:49.189494 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9222ed8f-a898-4cbe-9f39-b93f91d06947 None None] Routers {'c9161b00-e513-429d-9e36-6b99b1929705'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:29:49.190124 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-9222ed8f-a898-4cbe-9f39-b93f91d06947 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:29:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['c9161b00-e513-429d-9e36-6b99b1929705'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:49.214514 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-19468b4c-ff44-4151-9a2a-595d075e0faa tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:49.218425 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-19468b4c-ff44-4151-9a2a-595d075e0faa tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 886 time: 5.2767258 Nov 09 04:29:49.218635 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54022) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:49.223646 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-60a7cc71-7913-434f-bad9-f5d5adeb5e08 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'enable_snat': False}}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:49.250544 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-9222ed8f-a898-4cbe-9f39-b93f91d06947 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:49.320006 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9222ed8f-a898-4cbe-9f39-b93f91d06947 None None] Routers {'c9161b00-e513-429d-9e36-6b99b1929705'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:29:49.320640 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-9222ed8f-a898-4cbe-9f39-b93f91d06947 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:29:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['c9161b00-e513-429d-9e36-6b99b1929705'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:49.324383 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7e79233-240c-4c22-981b-81820ede7425 None None] Pushing event updated for resources: {'Port': ['ID=b0c5807e-b943-4bc3-a8fa-5ba587093f2e,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:49.324950 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54026) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:49.374071 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-e7e79233-240c-4c22-981b-81820ede7425 None None] Attempting to bind port b0c5807e-b943-4bc3-a8fa-5ba587093f2e on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:29:49.374416 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-e7e79233-240c-4c22-981b-81820ede7425 None None] Attempting to bind port b0c5807e-b943-4bc3-a8fa-5ba587093f2e by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'f03f8640-ff2f-45e0-bdf4-f5099f288abf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': '329cc1ac-ceba-413f-a143-1180da7319e5'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:29:49.374786 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7e79233-240c-4c22-981b-81820ede7425 None None] Attempting to bind port b0c5807e-b943-4bc3-a8fa-5ba587093f2e on network 329cc1ac-ceba-413f-a143-1180da7319e5 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:29:49.383312 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-9222ed8f-a898-4cbe-9f39-b93f91d06947 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:49.383956 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9222ed8f-a898-4cbe-9f39-b93f91d06947 None None] The sync data for ids ['c9161b00-e513-429d-9e36-6b99b1929705'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:29:49.387991 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7e79233-240c-4c22-981b-81820ede7425 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 29, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:29:49.388358 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7e79233-240c-4c22-981b-81820ede7425 None None] Checking segment: {'id': 'f03f8640-ff2f-45e0-bdf4-f5099f288abf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': '329cc1ac-ceba-413f-a143-1180da7319e5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:29:49.389210 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e7e79233-240c-4c22-981b-81820ede7425 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:49.389743 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7e79233-240c-4c22-981b-81820ede7425 None None] Bound using segment: {'id': 'f03f8640-ff2f-45e0-bdf4-f5099f288abf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': '329cc1ac-ceba-413f-a143-1180da7319e5'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:29:49.390384 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-e7e79233-240c-4c22-981b-81820ede7425 None None] Bound port: b0c5807e-b943-4bc3-a8fa-5ba587093f2e, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f03f8640-ff2f-45e0-bdf4-f5099f288abf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': '329cc1ac-ceba-413f-a143-1180da7319e5'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:29:49.392979 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e7e79233-240c-4c22-981b-81820ede7425 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:49.479205 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e139e0ec-fa44-40e0-a2f9-ad9106009bb3 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8756747267211', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_updated-5729887'] for subnet, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:49.502859 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e7e79233-240c-4c22-981b-81820ede7425 None None] For port b0c5807e-b943-4bc3-a8fa-5ba587093f2e, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:29:49.508206 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e7e79233-240c-4c22-981b-81820ede7425 None None] For port b0c5807e-b943-4bc3-a8fa-5ba587093f2e, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=b0c5807e-b943-4bc3-a8fa-5ba587093f2e,segment=NetworkSegment(f03f8640-ff2f-45e0-bdf4-f5099f288abf),segment_id=f03f8640-ff2f-45e0-bdf4-f5099f288abf)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:29:49.529371 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e139e0ec-fa44-40e0-a2f9-ad9106009bb3 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:49.531422 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e139e0ec-fa44-40e0-a2f9-ad9106009bb3 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:49.537291 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e139e0ec-fa44-40e0-a2f9-ad9106009bb3 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "PUT /v2.0/subnets/7e9c0a67-7fb1-46d2-a997-840c08842925 HTTP/1.1" status: 200 len: 826 time: 1.3591833 Nov 09 04:29:49.546496 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54040) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:49.589632 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e7e79233-240c-4c22-981b-81820ede7425 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:49.750608 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e2e10403-40bc-4e84-937e-a9c2c366db58 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:49.773579 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e139e0ec-fa44-40e0-a2f9-ad9106009bb3 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Pushing event updated for resources: {'Subnet': ['ID=7e9c0a67-7fb1-46d2-a997-840c08842925,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:49.800485 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-60a7cc71-7913-434f-bad9-f5d5adeb5e08 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:49.801667 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fea7b062-976b-4be5-8cb7-230d79c6db7f tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:49.811750 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-38925b37-6e32-45e1-80eb-89451bb28c7c admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=34508a55938a43c2b57acd8dc368e922&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4841967 Nov 09 04:29:49.815112 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54048) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:49.892084 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5b4fa3df-e81e-492d-9e74-585ec4d8a9d3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:49.920741 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5b4fa3df-e81e-492d-9e74-585ec4d8a9d3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:49.995763 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7e79233-240c-4c22-981b-81820ede7425 None None] Pushing event updated for resources: {'Port': ['ID=b0c5807e-b943-4bc3-a8fa-5ba587093f2e,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:50.104712 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 7c7cc4d1-9c07-4b9b-a732-a565794fd426 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:29:50.142044 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54054) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:50.171180 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1f3dcae1-9c74-4806-b392-fae8e4b5fcf8 None None] Network 041287e3-92a1-4b58-9250-6007d559460c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:29:50.200409 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-e2e10403-40bc-4e84-937e-a9c2c366db58 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Deleting port b0c5807e-b943-4bc3-a8fa-5ba587093f2e {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:29:50.200765 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e2e10403-40bc-4e84-937e-a9c2c366db58 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:50.239504 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5b4fa3df-e81e-492d-9e74-585ec4d8a9d3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:50.242285 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5b4fa3df-e81e-492d-9e74-585ec4d8a9d3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:50.245738 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-5b4fa3df-e81e-492d-9e74-585ec4d8a9d3 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/2f91204c-9f94-41c3-9c9a-1f236cc8d351 HTTP/1.1" status: 204 len: 168 time: 0.4273553 Nov 09 04:29:50.259988 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b4fa3df-e81e-492d-9e74-585ec4d8a9d3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2f91204c-9f94-41c3-9c9a-1f236cc8d351,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:50.312373 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-c2238bba-a174-417c-baaf-fd01fddfbf9a None None] Provisioning complete for port 7c7cc4d1-9c07-4b9b-a732-a565794fd426 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:29:50.317039 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c2238bba-a174-417c-baaf-fd01fddfbf9a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:50.386952 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 7c7cc4d1-9c07-4b9b-a732-a565794fd426 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:29:50.387649 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:50.404911 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fea7b062-976b-4be5-8cb7-230d79c6db7f tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:50.470686 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-63006640-6280-49f9-be21-29c9e9249490 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Request body: {'network': {'name': 'tempest-ExtraDHCPOptionsTestJSON-test-network-1707447350'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:50.493121 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-e2e10403-40bc-4e84-937e-a9c2c366db58 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] For port b0c5807e-b943-4bc3-a8fa-5ba587093f2e, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=b0c5807e-b943-4bc3-a8fa-5ba587093f2e,segment=NetworkSegment(f03f8640-ff2f-45e0-bdf4-f5099f288abf),segment_id=f03f8640-ff2f-45e0-bdf4-f5099f288abf)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:29:50.493607 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e2e10403-40bc-4e84-937e-a9c2c366db58 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:50.522874 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-e2e10403-40bc-4e84-937e-a9c2c366db58 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Calling delete_port for b0c5807e-b943-4bc3-a8fa-5ba587093f2e owned by network:dhcp {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:29:50.675929 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-63006640-6280-49f9-be21-29c9e9249490 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Made reservation on behalf of 44afe8e54a5c466e95915d5c99458492 for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:29:50.679903 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-63006640-6280-49f9-be21-29c9e9249490 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:50.692692 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-63006640-6280-49f9-be21-29c9e9249490 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:50.719151 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-60a7cc71-7913-434f-bad9-f5d5adeb5e08 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-466202', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-464271', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-936'] for router, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:50.726257 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-60a7cc71-7913-434f-bad9-f5d5adeb5e08 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-466195', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-466408', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-464260'] for router, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:50.795650 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fea7b062-976b-4be5-8cb7-230d79c6db7f tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Router 35d7d5c5-f2ed-4907-9dac-0add6d9bb5f4 is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102162) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:29:50.867468 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e2e10403-40bc-4e84-937e-a9c2c366db58 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:50.870829 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54074) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:50.898939 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-60a7cc71-7913-434f-bad9-f5d5adeb5e08 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Router c9161b00-e513-429d-9e36-6b99b1929705 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:29:50.934093 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2e10403-40bc-4e84-937e-a9c2c366db58 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Pushing event deleted for resources: {'Port': ['ID=b0c5807e-b943-4bc3-a8fa-5ba587093f2e,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:51.043341 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e2e10403-40bc-4e84-937e-a9c2c366db58 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] No DVR routers for this DVR port b0c5807e-b943-4bc3-a8fa-5ba587093f2e on host dv-neutron-816802-2-hyperv {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:29:51.063702 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-6579e917-7fa0-4a57-9663-14db9544da6b None None] Provisioning complete for port 7c7cc4d1-9c07-4b9b-a732-a565794fd426 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:29:51.064281 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6579e917-7fa0-4a57-9663-14db9544da6b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:51.073739 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-63006640-6280-49f9-be21-29c9e9249490 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:51.108525 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-60a7cc71-7913-434f-bad9-f5d5adeb5e08 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:29:51.110430 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fea7b062-976b-4be5-8cb7-230d79c6db7f tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:29:51.123213 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-56f8a189-2e1e-47b1-8cf9-a3dc53f2edbb None None] Sync routers for ids ['c9161b00-e513-429d-9e36-6b99b1929705'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:29:51.133627 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e2e10403-40bc-4e84-937e-a9c2c366db58 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:51.149587 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-60a7cc71-7913-434f-bad9-f5d5adeb5e08 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:51.158615 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-60a7cc71-7913-434f-bad9-f5d5adeb5e08 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] 10.222.0.24 "PUT /v2.0/routers/c9161b00-e513-429d-9e36-6b99b1929705 HTTP/1.1" status: 200 len: 923 time: 1.9363556 Nov 09 04:29:51.161264 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54084) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:51.162227 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-56f8a189-2e1e-47b1-8cf9-a3dc53f2edbb None None] Routers {'c9161b00-e513-429d-9e36-6b99b1929705'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:29:51.162902 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-56f8a189-2e1e-47b1-8cf9-a3dc53f2edbb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:29:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['c9161b00-e513-429d-9e36-6b99b1929705'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:51.208831 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-956c6ee3-5fb4-42e8-971f-9c4848fc1a56 None None] Sync routers for ids ['35d7d5c5-f2ed-4907-9dac-0add6d9bb5f4'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:29:51.220597 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-88fa330b-d36a-4d4d-80a4-5dfd8f1f02ff tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-1595515857'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:51.236923 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-956c6ee3-5fb4-42e8-971f-9c4848fc1a56 None None] Routers {'35d7d5c5-f2ed-4907-9dac-0add6d9bb5f4'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:29:51.239903 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-956c6ee3-5fb4-42e8-971f-9c4848fc1a56 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:29:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['35d7d5c5-f2ed-4907-9dac-0add6d9bb5f4'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:51.256155 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-63006640-6280-49f9-be21-29c9e9249490 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:51.281791 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fea7b062-976b-4be5-8cb7-230d79c6db7f tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:51.285598 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-fea7b062-976b-4be5-8cb7-230d79c6db7f tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 876 time: 4.0989475 Nov 09 04:29:51.287242 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54088) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:51.297106 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-63006640-6280-49f9-be21-29c9e9249490 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 334} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:29:51.318666 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63006640-6280-49f9-be21-29c9e9249490 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Pushing event updated for resources: {'SecurityGroup': ['ID=16bc60ab-fbaf-486d-a736-20c8c8259b90,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:51.391613 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54090) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:51.392075 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-41067835-467a-4826-9807-fef4b216ffb5 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] 10.222.0.24 "GET /v2.0/routers/c9161b00-e513-429d-9e36-6b99b1929705 HTTP/1.1" status: 200 len: 923 time: 0.2257547 Nov 09 04:29:51.409129 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-56f8a189-2e1e-47b1-8cf9-a3dc53f2edbb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:51.418745 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-56f8a189-2e1e-47b1-8cf9-a3dc53f2edbb None None] Routers {'c9161b00-e513-429d-9e36-6b99b1929705'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:29:51.419417 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-56f8a189-2e1e-47b1-8cf9-a3dc53f2edbb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:29:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['c9161b00-e513-429d-9e36-6b99b1929705'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:51.435783 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-956c6ee3-5fb4-42e8-971f-9c4848fc1a56 None None] Set router 35d7d5c5-f2ed-4907-9dac-0add6d9bb5f4 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:29:51.480635 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-56f8a189-2e1e-47b1-8cf9-a3dc53f2edbb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:51.481357 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-56f8a189-2e1e-47b1-8cf9-a3dc53f2edbb None None] The sync data for ids ['c9161b00-e513-429d-9e36-6b99b1929705'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:29:51.497078 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-63006640-6280-49f9-be21-29c9e9249490 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:51.497429 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-63006640-6280-49f9-be21-29c9e9249490 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Added segment 29dd0c31-fa36-4903-bb81-1974d7ba9c81 of type vlan for network 6b78e150-9412-4145-a432-680e4456364c Nov 09 04:29:51.502604 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c5f75649-beae-4833-8a0e-8415286edc19 None None] Network 329cc1ac-ceba-413f-a143-1180da7319e5 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:29:51.513001 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e2e10403-40bc-4e84-937e-a9c2c366db58 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:51.522089 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-88fa330b-d36a-4d4d-80a4-5dfd8f1f02ff tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Made reservation on behalf of 6761c80dbfa84798bb6517a9b532f870 for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:29:51.525581 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-88fa330b-d36a-4d4d-80a4-5dfd8f1f02ff tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:51.558346 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-63006640-6280-49f9-be21-29c9e9249490 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:51.579510 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2e10403-40bc-4e84-937e-a9c2c366db58 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Pushing event deleted for resources: {'Subnet': ['ID=7e9c0a67-7fb1-46d2-a997-840c08842925,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:51.582049 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4aecf310-46be-46ad-a66b-936ac2f3e962 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks [] for router, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:51.592021 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-fdf5cb3c-978b-4f6b-a676-b0ff076a4d5d None None] Could not find standard attr ID for object b0c5807e-b943-4bc3-a8fa-5ba587093f2e. {{(pid=102163) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 09 04:29:51.597185 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-88fa330b-d36a-4d4d-80a4-5dfd8f1f02ff tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:51.640238 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-63006640-6280-49f9-be21-29c9e9249490 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:51.646871 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-63006640-6280-49f9-be21-29c9e9249490 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:51.647906 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-63006640-6280-49f9-be21-29c9e9249490 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:51.724945 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a7cd0af5-1783-42d3-b944-30babf0fe58f tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:51.727497 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a7cd0af5-1783-42d3-b944-30babf0fe58f tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] 10.222.0.24 "GET /v2.0/ports?network_id=2b6725f5-ebfe-485a-8f42-ccb5a241ddb5&device_id=c9161b00-e513-429d-9e36-6b99b1929705&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 943 time: 0.3335063 Nov 09 04:29:51.733786 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54100) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:51.736661 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e2e10403-40bc-4e84-937e-a9c2c366db58 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:51.755920 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63006640-6280-49f9-be21-29c9e9249490 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Pushing event updated for resources: {'Network': ['ID=6b78e150-9412-4145-a432-680e4456364c,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:51.788393 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 6b78e150-9412-4145-a432-680e4456364c details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:29:51.806174 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-e2e10403-40bc-4e84-937e-a9c2c366db58 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['329cc1ac-ceba-413f-a143-1180da7319e5']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:51.823060 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-59e15cd7-4a92-47fd-8987-586c2676d203 None None] DHCP port deletion for 329cc1ac-ceba-413f-a143-1180da7319e5 request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:29:51.827517 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-e2e10403-40bc-4e84-937e-a9c2c366db58 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f03f8640-ff2f-45e0-bdf4-f5099f288abf') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:51.827755 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-e2e10403-40bc-4e84-937e-a9c2c366db58 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f03f8640-ff2f-45e0-bdf4-f5099f288abf') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:51.831106 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-956c6ee3-5fb4-42e8-971f-9c4848fc1a56 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '35d7d5c5-f2ed-4907-9dac-0add6d9bb5f4', 'name': '', 'tenant_id': 'cf43ca7e091f42ca80c78a3f7dbeba63', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3919e9cb-8006-4613-b88e-7ef46e2b76eb', 'external_fixed_ips': [{'subnet_id': '2af48489-6c72-46b4-8eb9-1e92215d96e9', 'ip_address': '172.20.0.11'}], 'enable_snat': True}, 'gw_port_id': '3b112c77-9cfb-422f-940a-39d00bcb862b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:29:47Z', 'updated_at': '2021-11-09T04:29:49Z', 'revision_number': 3, 'project_id': 'cf43ca7e091f42ca80c78a3f7dbeba63', 'gw_port': {'id': '3b112c77-9cfb-422f-940a-39d00bcb862b', 'name': '', 'network_id': '3919e9cb-8006-4613-b88e-7ef46e2b76eb', 'tenant_id': '', 'mac_address': 'fa:16:3e:1f:ac:81', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '35d7d5c5-f2ed-4907-9dac-0add6d9bb5f4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 382, 'fixed_ips': [{'subnet_id': '2af48489-6c72-46b4-8eb9-1e92215d96e9', 'ip_address': '172.20.0.11', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:29:48Z', 'updated_at': '2021-11-09T04:29:48Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '2af48489-6c72-46b4-8eb9-1e92215d96e9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:51.861975 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e2e10403-40bc-4e84-937e-a9c2c366db58 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:51.913499 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9a949f21-b524-42cb-8a6a-a7b09b479fcc None None] Network 329cc1ac-ceba-413f-a143-1180da7319e5 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:29:51.925844 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e2e10403-40bc-4e84-937e-a9c2c366db58 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:51.933277 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54104) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:51.938726 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4aecf310-46be-46ad-a66b-936ac2f3e962 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:51.941292 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-956c6ee3-5fb4-42e8-971f-9c4848fc1a56 None None] Checking router: 35d7d5c5-f2ed-4907-9dac-0add6d9bb5f4 for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:29:51.942217 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-956c6ee3-5fb4-42e8-971f-9c4848fc1a56 None None] Updating router 35d7d5c5-f2ed-4907-9dac-0add6d9bb5f4 port 3b112c77-9cfb-422f-940a-39d00bcb862b binding host dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 04:29:51.951778 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e2e10403-40bc-4e84-937e-a9c2c366db58 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Releasing vlan 310 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:29:51.952184 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e2e10403-40bc-4e84-937e-a9c2c366db58 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:51.958408 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:29:51.958408 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:29:51.958408 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:29:51.958408 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:29:51.958408 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:29:51.958408 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:29:51.958408 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:29:51.958408 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:29:51.958408 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:29:51.958408 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:29:51.958408 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:29:51.958408 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:29:51.958408 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:29:51.958408 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:29:51.958408 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:29:51.958408 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:29:51.958408 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:29:51.958408 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:29:51.958408 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:29:51.958408 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:29:51.958408 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:29:51.958408 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:29:51.958408 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:29:51.958408 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:29:51.958408 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:29:51.958408 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:29:51.958408 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:29:51.958408 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:29:51.958408 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:29:51.958408 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:29:51.958408 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:29:51.958408 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:29:52.022188 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-88fa330b-d36a-4d4d-80a4-5dfd8f1f02ff tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:52.034201 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-956c6ee3-5fb4-42e8-971f-9c4848fc1a56 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:52.110666 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-4aecf310-46be-46ad-a66b-936ac2f3e962 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Deleting port 3b112c77-9cfb-422f-940a-39d00bcb862b {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:29:52.111610 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4aecf310-46be-46ad-a66b-936ac2f3e962 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:52.115405 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-88fa330b-d36a-4d4d-80a4-5dfd8f1f02ff tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:52.149494 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-c5c8fe5a-55d2-4172-b22d-47bd2bc7baf6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Request body: {'networks': [{'name': 'tempest-network--737111107'}, {'name': 'tempest-network--1615405558'}]} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:52.149864 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-c5c8fe5a-55d2-4172-b22d-47bd2bc7baf6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Request body: {'network': {'name': 'tempest-network--737111107'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:52.150331 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-c5c8fe5a-55d2-4172-b22d-47bd2bc7baf6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Request body: {'network': {'name': 'tempest-network--1615405558'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:52.166065 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e2e10403-40bc-4e84-937e-a9c2c366db58 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:52.187384 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-63006640-6280-49f9-be21-29c9e9249490 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 792 time: 2.0440459 Nov 09 04:29:52.188040 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54108) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:52.201869 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-88fa330b-d36a-4d4d-80a4-5dfd8f1f02ff tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 324} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:29:52.203009 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-6581afa8-fd12-4a3b-a99b-b07d98fce834 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Request body: {'subnet': {'network_id': '6b78e150-9412-4145-a432-680e4456364c', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:52.212084 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e2e10403-40bc-4e84-937e-a9c2c366db58 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:52.215346 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e2e10403-40bc-4e84-937e-a9c2c366db58 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "DELETE /v2.0/networks/329cc1ac-ceba-413f-a143-1180da7319e5 HTTP/1.1" status: 204 len: 168 time: 2.6683128 Nov 09 04:29:52.226231 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54110) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:52.274025 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2e10403-40bc-4e84-937e-a9c2c366db58 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Pushing event deleted for resources: {'Network': ['ID=329cc1ac-ceba-413f-a143-1180da7319e5,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:52.292047 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-88fa330b-d36a-4d4d-80a4-5dfd8f1f02ff tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:52.292635 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-88fa330b-d36a-4d4d-80a4-5dfd8f1f02ff tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Added segment b5cec454-4fbe-451b-b90e-7cf65688ef8c of type vlan for network 3669a9e4-d853-4e8c-90ad-c544516ed2c5 Nov 09 04:29:52.295853 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88fa330b-d36a-4d4d-80a4-5dfd8f1f02ff tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event updated for resources: {'SecurityGroup': ['ID=ed3e80c4-f9aa-4306-90b7-0259ab09dd84,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:52.311667 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-c2aad350-07fc-4aac-bd2e-b1b6afc89382 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] DELETE failed (client error): The resource could not be found. Nov 09 04:29:52.312536 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c2aad350-07fc-4aac-bd2e-b1b6afc89382 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:29:52.315470 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-c2aad350-07fc-4aac-bd2e-b1b6afc89382 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "DELETE /v2.0/networks/329cc1ac-ceba-413f-a143-1180da7319e5 HTTP/1.1" status: 404 len: 339 time: 0.0649529 Nov 09 04:29:52.321954 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54114) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:52.343040 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-47a2f2de-ff7a-4384-bb10-845f02285c0b tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:52.346444 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-47a2f2de-ff7a-4384-bb10-845f02285c0b tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] 10.222.0.24 "GET /v2.0/networks/2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 HTTP/1.1" status: 200 len: 881 time: 0.6102452 Nov 09 04:29:52.347271 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-f8c0d016-7ddc-4bf9-b114-af57f2753061 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-2135610531', 'description': 'd1'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:52.348567 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54116) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:52.377712 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c5c8fe5a-55d2-4172-b22d-47bd2bc7baf6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Made reservation on behalf of 2f077d8d6e0c4af98a4ce8fbe06ce9d4 for: {'network': 2} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:29:52.385936 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-34078f8d-5e5b-4a80-9f41-92d1134a611f tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] 10.222.0.24 "GET /v2.0/ports?device_id=c9161b00-e513-429d-9e36-6b99b1929705 HTTP/1.1" status: 200 len: 205 time: 0.0340221 Nov 09 04:29:52.386970 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c5c8fe5a-55d2-4172-b22d-47bd2bc7baf6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:52.390253 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54118) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:52.393401 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4aecf310-46be-46ad-a66b-936ac2f3e962 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:52.398169 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-88fa330b-d36a-4d4d-80a4-5dfd8f1f02ff tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:52.411792 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-956c6ee3-5fb4-42e8-971f-9c4848fc1a56 None None] Publish callbacks [] for port, precommit_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:52.413283 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.db.api [None req-f8c0d016-7ddc-4bf9-b114-af57f2753061 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Nov 09 04:29:52.413283 dv-neutron-816802-2-hyperv neutron-server[102162]: [SQL: DELETE FROM reservations WHERE reservations.project_id = %(project_id_1)s AND reservations.expiration < %(expiration_1)s] Nov 09 04:29:52.413283 dv-neutron-816802-2-hyperv neutron-server[102162]: [parameters: {'project_id_1': '83cbb798c0f44b268f8acd2a70eb745a', 'expiration_1': datetime.datetime(2021, 11, 9, 4, 29, 32, 356147)}] Nov 09 04:29:52.413283 dv-neutron-816802-2-hyperv neutron-server[102162]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=102162) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:29:52.413650 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG oslo_db.api [None req-f8c0d016-7ddc-4bf9-b114-af57f2753061 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Performing DB retry for function neutron.db.quota.driver_nolock.DbQuotaNoLockDriver.make_reservation {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:29:52.419297 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c5c8fe5a-55d2-4172-b22d-47bd2bc7baf6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:52.422803 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-4aecf310-46be-46ad-a66b-936ac2f3e962 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Calling delete_port for 3b112c77-9cfb-422f-940a-39d00bcb862b owned by network:router_gateway {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:29:52.434627 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6581afa8-fd12-4a3b-a99b-b07d98fce834 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Made reservation on behalf of 44afe8e54a5c466e95915d5c99458492 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:29:52.438083 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6581afa8-fd12-4a3b-a99b-b07d98fce834 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:52.481058 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-956c6ee3-5fb4-42e8-971f-9c4848fc1a56 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:52.520322 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-88fa330b-d36a-4d4d-80a4-5dfd8f1f02ff tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:52.525958 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-88fa330b-d36a-4d4d-80a4-5dfd8f1f02ff tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:52.526571 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-88fa330b-d36a-4d4d-80a4-5dfd8f1f02ff tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:52.539864 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-956c6ee3-5fb4-42e8-971f-9c4848fc1a56 None None] Attempting to bind port 3b112c77-9cfb-422f-940a-39d00bcb862b on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:29:52.540672 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-956c6ee3-5fb4-42e8-971f-9c4848fc1a56 None None] Attempting to bind port 3b112c77-9cfb-422f-940a-39d00bcb862b by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'dee31afc-2fc7-40e2-9fe3-1ec6de6d8270', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 308, 'network_id': '3919e9cb-8006-4613-b88e-7ef46e2b76eb'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:29:52.540672 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-956c6ee3-5fb4-42e8-971f-9c4848fc1a56 None None] Attempting to bind port 3b112c77-9cfb-422f-940a-39d00bcb862b on network 3919e9cb-8006-4613-b88e-7ef46e2b76eb {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:29:52.542866 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-587c3e43-d298-4019-872a-47e238ffefb5 None None] Pushing event updated for resources: {'Port': ['ID=3b112c77-9cfb-422f-940a-39d00bcb862b,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:52.549222 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-956c6ee3-5fb4-42e8-971f-9c4848fc1a56 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 29, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:29:52.549703 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-956c6ee3-5fb4-42e8-971f-9c4848fc1a56 None None] Checking segment: {'id': 'dee31afc-2fc7-40e2-9fe3-1ec6de6d8270', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 308, 'network_id': '3919e9cb-8006-4613-b88e-7ef46e2b76eb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:29:52.549974 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-956c6ee3-5fb4-42e8-971f-9c4848fc1a56 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:52.550386 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-956c6ee3-5fb4-42e8-971f-9c4848fc1a56 None None] Bound using segment: {'id': 'dee31afc-2fc7-40e2-9fe3-1ec6de6d8270', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 308, 'network_id': '3919e9cb-8006-4613-b88e-7ef46e2b76eb'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:29:52.551439 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-956c6ee3-5fb4-42e8-971f-9c4848fc1a56 None None] Bound port: 3b112c77-9cfb-422f-940a-39d00bcb862b, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'dee31afc-2fc7-40e2-9fe3-1ec6de6d8270', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 308, 'network_id': '3919e9cb-8006-4613-b88e-7ef46e2b76eb'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:29:52.551439 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-956c6ee3-5fb4-42e8-971f-9c4848fc1a56 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:52.576476 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4e9ac8e4-122e-406e-90bb-a8defdc9a19d tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks [] for router, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:52.609088 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-956c6ee3-5fb4-42e8-971f-9c4848fc1a56 None None] For port 3b112c77-9cfb-422f-940a-39d00bcb862b, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:29:52.612748 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-956c6ee3-5fb4-42e8-971f-9c4848fc1a56 None None] For port 3b112c77-9cfb-422f-940a-39d00bcb862b, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=3b112c77-9cfb-422f-940a-39d00bcb862b,segment=NetworkSegment(dee31afc-2fc7-40e2-9fe3-1ec6de6d8270),segment_id=dee31afc-2fc7-40e2-9fe3-1ec6de6d8270)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:29:52.687755 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-956c6ee3-5fb4-42e8-971f-9c4848fc1a56 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:52.757499 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4e9ac8e4-122e-406e-90bb-a8defdc9a19d tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks [] for router_gateway, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:52.760284 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-587c3e43-d298-4019-872a-47e238ffefb5 None None] Pushing event updated for resources: {'Port': ['ID=3b112c77-9cfb-422f-940a-39d00bcb862b,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:52.766660 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-956c6ee3-5fb4-42e8-971f-9c4848fc1a56 None None] Routers {'35d7d5c5-f2ed-4907-9dac-0add6d9bb5f4'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:29:52.767630 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-956c6ee3-5fb4-42e8-971f-9c4848fc1a56 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:29:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['35d7d5c5-f2ed-4907-9dac-0add6d9bb5f4'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:52.864112 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6581afa8-fd12-4a3b-a99b-b07d98fce834 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:52.953654 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6581afa8-fd12-4a3b-a99b-b07d98fce834 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Pushing event updated for resources: {'Subnet': ['ID=2aa88cd9-d91d-402f-9e1c-75a447bc596d,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:52.993418 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6581afa8-fd12-4a3b-a99b-b07d98fce834 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Checking segment: {'id': '29dd0c31-fa36-4903-bb81-1974d7ba9c81', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 334, 'network_id': '6b78e150-9412-4145-a432-680e4456364c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:29:52.998353 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88fa330b-d36a-4d4d-80a4-5dfd8f1f02ff tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event updated for resources: {'Network': ['ID=3669a9e4-d853-4e8c-90ad-c544516ed2c5,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:52.999132 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6581afa8-fd12-4a3b-a99b-b07d98fce834 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Network hostable DHCP agents. Network: 6b78e150-9412-4145-a432-680e4456364c, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:29:52.999751 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-4e9ac8e4-122e-406e-90bb-a8defdc9a19d tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Deleting port 647668fe-1394-4488-9ab0-3c5f0c98e2c9 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:29:53.000093 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4e9ac8e4-122e-406e-90bb-a8defdc9a19d tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:53.011505 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 3669a9e4-d853-4e8c-90ad-c544516ed2c5 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:29:53.043526 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-956c6ee3-5fb4-42e8-971f-9c4848fc1a56 None None] Set router 35d7d5c5-f2ed-4907-9dac-0add6d9bb5f4 gateway port host: None {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:29:53.080062 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-88fa330b-d36a-4d4d-80a4-5dfd8f1f02ff tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 780 time: 2.1974363 Nov 09 04:29:53.080062 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c5c8fe5a-55d2-4172-b22d-47bd2bc7baf6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:53.115785 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4e9ac8e4-122e-406e-90bb-a8defdc9a19d tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:53.123578 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-956c6ee3-5fb4-42e8-971f-9c4848fc1a56 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '35d7d5c5-f2ed-4907-9dac-0add6d9bb5f4', 'name': '', 'tenant_id': 'cf43ca7e091f42ca80c78a3f7dbeba63', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:29:47Z', 'updated_at': '2021-11-09T04:29:51Z', 'revision_number': 4, 'project_id': 'cf43ca7e091f42ca80c78a3f7dbeba63', 'gw_port_host': None}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:53.127325 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-4e9ac8e4-122e-406e-90bb-a8defdc9a19d tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Calling delete_port for 647668fe-1394-4488-9ab0-3c5f0c98e2c9 owned by network:router_gateway {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:29:53.139259 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6581afa8-fd12-4a3b-a99b-b07d98fce834 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Network 6b78e150-9412-4145-a432-680e4456364c is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:29:53.157508 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-956c6ee3-5fb4-42e8-971f-9c4848fc1a56 None None] The sync data for ids ['35d7d5c5-f2ed-4907-9dac-0add6d9bb5f4'] in dv-neutron-816802-2-hyperv is: [{'id': '35d7d5c5-f2ed-4907-9dac-0add6d9bb5f4', 'name': '', 'tenant_id': 'cf43ca7e091f42ca80c78a3f7dbeba63', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:29:47Z', 'updated_at': '2021-11-09T04:29:51Z', 'revision_number': 4, 'project_id': 'cf43ca7e091f42ca80c78a3f7dbeba63', 'gw_port_host': None}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:29:53.188953 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c5c8fe5a-55d2-4172-b22d-47bd2bc7baf6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:53.189724 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c5c8fe5a-55d2-4172-b22d-47bd2bc7baf6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:53.192607 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f8c0d016-7ddc-4bf9-b114-af57f2753061 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Made reservation on behalf of 83cbb798c0f44b268f8acd2a70eb745a for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:29:53.196361 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f8c0d016-7ddc-4bf9-b114-af57f2753061 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:53.207009 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54122) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:53.213469 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-d080fa0f-6dda-4e00-98fa-2bc0b2792c24 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Request body: {'subnet': {'network_id': '3669a9e4-d853-4e8c-90ad-c544516ed2c5', 'cidr': '172.20.255.240/28', 'ip_version': 4, 'gateway_ip': '172.20.255.241'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:53.227015 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4aecf310-46be-46ad-a66b-936ac2f3e962 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:53.279833 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-6581afa8-fd12-4a3b-a99b-b07d98fce834 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 6b78e150-9412-4145-a432-680e4456364c) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:29:53.283603 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4aecf310-46be-46ad-a66b-936ac2f3e962 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Pushing event deleted for resources: {'Port': ['ID=3b112c77-9cfb-422f-940a-39d00bcb862b,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:53.285110 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5c8fe5a-55d2-4172-b22d-47bd2bc7baf6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Pushing event updated for resources: {'SecurityGroup': ['ID=0865e505-1d47-4388-88f0-f1fecd26b820,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:53.291856 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dca6d1b6-ae3f-42f4-846a-aba4a09c4204 None None] Network 6b78e150-9412-4145-a432-680e4456364c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:29:53.320387 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f8c0d016-7ddc-4bf9-b114-af57f2753061 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 325} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:29:53.325621 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6581afa8-fd12-4a3b-a99b-b07d98fce834 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:53.326055 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6581afa8-fd12-4a3b-a99b-b07d98fce834 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:53.326168 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c5c8fe5a-55d2-4172-b22d-47bd2bc7baf6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 333} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:29:53.350894 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f8c0d016-7ddc-4bf9-b114-af57f2753061 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:53.351249 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-f8c0d016-7ddc-4bf9-b114-af57f2753061 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Added segment 664b72d3-eb88-4c57-a801-7061f5540d78 of type vlan for network 41b6a30b-1a07-4d4e-bb4c-2047225fca0a Nov 09 04:29:53.400264 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c5c8fe5a-55d2-4172-b22d-47bd2bc7baf6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:53.400551 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-c5c8fe5a-55d2-4172-b22d-47bd2bc7baf6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Added segment 0bae02b6-e9d9-4197-8915-3723da1dd49c of type vlan for network a3060171-2337-47cb-9de2-3eb494ae2d7f Nov 09 04:29:53.445111 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-6581afa8-fd12-4a3b-a99b-b07d98fce834 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.2459528 Nov 09 04:29:53.452110 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54126) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:53.457922 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f8c0d016-7ddc-4bf9-b114-af57f2753061 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:53.462193 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-e52d0096-cde2-43a2-b29b-702b347f9831 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Request body: {'port': {'network_id': '6b78e150-9412-4145-a432-680e4456364c', 'name': 'tempest-ExtraDHCPOptionsTestJSON-1425512742'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:53.465139 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4aecf310-46be-46ad-a66b-936ac2f3e962 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-466373'] for router_gateway, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:53.542782 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-478802bc-c199-4e5c-9140-153518d85ef0 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-6b78e150-9412-4145-a432-680e4456364c', 'network_id': '6b78e150-9412-4145-a432-680e4456364c', 'tenant_id': '44afe8e54a5c466e95915d5c99458492', 'fixed_ips': [{'subnet_id': '2aa88cd9-d91d-402f-9e1c-75a447bc596d'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:29:53.544358 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-478802bc-c199-4e5c-9140-153518d85ef0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:53.546072 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c5c8fe5a-55d2-4172-b22d-47bd2bc7baf6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:53.549818 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4e9ac8e4-122e-406e-90bb-a8defdc9a19d tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:53.584411 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d080fa0f-6dda-4e00-98fa-2bc0b2792c24 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Made reservation on behalf of 6761c80dbfa84798bb6517a9b532f870 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:29:53.587716 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d080fa0f-6dda-4e00-98fa-2bc0b2792c24 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:53.588744 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4aecf310-46be-46ad-a66b-936ac2f3e962 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:53.591940 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4aecf310-46be-46ad-a66b-936ac2f3e962 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:53.595777 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e9ac8e4-122e-406e-90bb-a8defdc9a19d tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Pushing event deleted for resources: {'Port': ['ID=647668fe-1394-4488-9ab0-3c5f0c98e2c9,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:53.648020 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c5c8fe5a-55d2-4172-b22d-47bd2bc7baf6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 302} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:29:53.657835 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c5c8fe5a-55d2-4172-b22d-47bd2bc7baf6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:53.658172 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-c5c8fe5a-55d2-4172-b22d-47bd2bc7baf6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Added segment dbe7d506-2476-4b08-a4d5-4fc5ba635670 of type vlan for network a07c952d-27cd-4045-967f-043cd5d7542f Nov 09 04:29:53.659386 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f8c0d016-7ddc-4bf9-b114-af57f2753061 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:53.664989 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f8c0d016-7ddc-4bf9-b114-af57f2753061 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:53.665568 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f8c0d016-7ddc-4bf9-b114-af57f2753061 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:53.709052 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-478802bc-c199-4e5c-9140-153518d85ef0 None None] Allocated IP 172.20.0.2 (6b78e150-9412-4145-a432-680e4456364c/2aa88cd9-d91d-402f-9e1c-75a447bc596d/0acfa6cc-c45a-41fc-920a-0ef63d0600d0) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:29:53.725494 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4aecf310-46be-46ad-a66b-936ac2f3e962 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:53.726181 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4aecf310-46be-46ad-a66b-936ac2f3e962 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 35d7d5c5-f2ed-4907-9dac-0add6d9bb5f4 {{(pid=102162) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:29:53.751576 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4e9ac8e4-122e-406e-90bb-a8defdc9a19d tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-466373'] for router_gateway, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:53.765806 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4aecf310-46be-46ad-a66b-936ac2f3e962 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:53.766977 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-4aecf310-46be-46ad-a66b-936ac2f3e962 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] 10.222.0.24 "DELETE /v2.0/routers/35d7d5c5-f2ed-4907-9dac-0add6d9bb5f4 HTTP/1.1" status: 204 len: 168 time: 2.4786541 Nov 09 04:29:53.772844 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c5c8fe5a-55d2-4172-b22d-47bd2bc7baf6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:53.774729 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54128) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:53.809414 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8c0d016-7ddc-4bf9-b114-af57f2753061 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Pushing event updated for resources: {'Network': ['ID=41b6a30b-1a07-4d4e-bb4c-2047225fca0a,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:53.819805 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-f8c0d016-7ddc-4bf9-b114-af57f2753061 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 786 time: 1.4967780 Nov 09 04:29:53.824887 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54130) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:53.835615 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 41b6a30b-1a07-4d4e-bb4c-2047225fca0a details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:29:53.882688 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-a840c6b4-e37f-4466-b9b3-37d196258649 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Deleting subnet 2af48489-6c72-46b4-8eb9-1e92215d96e9 {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:29:53.891889 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4e9ac8e4-122e-406e-90bb-a8defdc9a19d tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:53.912865 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4e9ac8e4-122e-406e-90bb-a8defdc9a19d tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:53.913065 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a840c6b4-e37f-4466-b9b3-37d196258649 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:53.946895 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-478802bc-c199-4e5c-9140-153518d85ef0 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:53.963518 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8e6dba1a-0225-4b6a-9dc1-49baaa444bf6 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:53.967635 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-8e6dba1a-0225-4b6a-9dc1-49baaa444bf6 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "GET /v2.0/networks?id=41b6a30b-1a07-4d4e-bb4c-2047225fca0a HTTP/1.1" status: 200 len: 765 time: 0.1359901 Nov 09 04:29:53.968610 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54132) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:53.974225 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-9f3c5793-972a-4c8f-b688-3a67d0087abb tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Request body: {'network': {'description': 'd2'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:53.975204 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e52d0096-cde2-43a2-b29b-702b347f9831 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Made reservation on behalf of 44afe8e54a5c466e95915d5c99458492 for: {'port': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:29:53.979205 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e52d0096-cde2-43a2-b29b-702b347f9831 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:53.993461 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a840c6b4-e37f-4466-b9b3-37d196258649 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:54.010176 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [None req-e52d0096-cde2-43a2-b29b-702b347f9831 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] device_id is not set on port 1422f05c-c9c5-470c-b800-a079cd4d4962 yet. {{(pid=102161) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:29:54.020628 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c5c8fe5a-55d2-4172-b22d-47bd2bc7baf6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:54.021161 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c5c8fe5a-55d2-4172-b22d-47bd2bc7baf6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:54.026608 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c5c8fe5a-55d2-4172-b22d-47bd2bc7baf6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:54.031355 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c5c8fe5a-55d2-4172-b22d-47bd2bc7baf6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:54.031992 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c5c8fe5a-55d2-4172-b22d-47bd2bc7baf6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:54.076378 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-478802bc-c199-4e5c-9140-153518d85ef0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:54.102978 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4e9ac8e4-122e-406e-90bb-a8defdc9a19d tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:54.103508 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4e9ac8e4-122e-406e-90bb-a8defdc9a19d tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Fanout notify agent at l3_agent the message router_deleted on router c9161b00-e513-429d-9e36-6b99b1929705 {{(pid=102161) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:29:54.112303 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4e9ac8e4-122e-406e-90bb-a8defdc9a19d tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:54.113452 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-4e9ac8e4-122e-406e-90bb-a8defdc9a19d tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] 10.222.0.24 "DELETE /v2.0/routers/c9161b00-e513-429d-9e36-6b99b1929705 HTTP/1.1" status: 204 len: 168 time: 1.7221484 Nov 09 04:29:54.118153 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54134) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:54.128011 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-18daeb0c-587c-4ec7-8d7e-a15ac458d2f3 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Request body: {'router': {'name': 'tempest-RoutersIpV6AdminTest-router-862957921', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:54.162999 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-478802bc-c199-4e5c-9140-153518d85ef0 None None] Network 6b78e150-9412-4145-a432-680e4456364c is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:29:54.166310 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-478802bc-c199-4e5c-9140-153518d85ef0 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:29:54.166784 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a840c6b4-e37f-4466-b9b3-37d196258649 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:54.172162 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-478802bc-c199-4e5c-9140-153518d85ef0 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:29:54.193501 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-478802bc-c199-4e5c-9140-153518d85ef0 None None] Pushing event updated for resources: {'Port': ['ID=0acfa6cc-c45a-41fc-920a-0ef63d0600d0,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:54.210120 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5c8fe5a-55d2-4172-b22d-47bd2bc7baf6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Pushing event updated for resources: {'Network': ['ID=a3060171-2337-47cb-9de2-3eb494ae2d7f,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:54.217906 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-c5c8fe5a-55d2-4172-b22d-47bd2bc7baf6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 1319 time: 2.2792540 Nov 09 04:29:54.223583 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54138) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:54.249832 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network a3060171-2337-47cb-9de2-3eb494ae2d7f details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:29:54.250174 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-e52d0096-cde2-43a2-b29b-702b347f9831 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Allocated IP 172.20.0.7 (6b78e150-9412-4145-a432-680e4456364c/2aa88cd9-d91d-402f-9e1c-75a447bc596d/1422f05c-c9c5-470c-b800-a079cd4d4962) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:29:54.259154 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d080fa0f-6dda-4e00-98fa-2bc0b2792c24 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:54.317215 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-478802bc-c199-4e5c-9140-153518d85ef0 None None] Attempting to bind port 0acfa6cc-c45a-41fc-920a-0ef63d0600d0 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:29:54.317601 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-478802bc-c199-4e5c-9140-153518d85ef0 None None] Attempting to bind port 0acfa6cc-c45a-41fc-920a-0ef63d0600d0 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '29dd0c31-fa36-4903-bb81-1974d7ba9c81', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 334, 'network_id': '6b78e150-9412-4145-a432-680e4456364c'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:29:54.318105 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-478802bc-c199-4e5c-9140-153518d85ef0 None None] Attempting to bind port 0acfa6cc-c45a-41fc-920a-0ef63d0600d0 on network 6b78e150-9412-4145-a432-680e4456364c {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:29:54.342302 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-478802bc-c199-4e5c-9140-153518d85ef0 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 29, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:29:54.346642 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-478802bc-c199-4e5c-9140-153518d85ef0 None None] Checking segment: {'id': '29dd0c31-fa36-4903-bb81-1974d7ba9c81', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 334, 'network_id': '6b78e150-9412-4145-a432-680e4456364c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:29:54.346642 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-478802bc-c199-4e5c-9140-153518d85ef0 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:54.346642 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-478802bc-c199-4e5c-9140-153518d85ef0 None None] Bound using segment: {'id': '29dd0c31-fa36-4903-bb81-1974d7ba9c81', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 334, 'network_id': '6b78e150-9412-4145-a432-680e4456364c'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:29:54.346642 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-478802bc-c199-4e5c-9140-153518d85ef0 None None] Bound port: 0acfa6cc-c45a-41fc-920a-0ef63d0600d0, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '29dd0c31-fa36-4903-bb81-1974d7ba9c81', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 334, 'network_id': '6b78e150-9412-4145-a432-680e4456364c'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:29:54.346642 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-478802bc-c199-4e5c-9140-153518d85ef0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:54.364813 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d080fa0f-6dda-4e00-98fa-2bc0b2792c24 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event updated for resources: {'Subnet': ['ID=366772a4-c45a-4129-af01-4f834e98308c,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:54.401713 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-18daeb0c-587c-4ec7-8d7e-a15ac458d2f3 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:54.402608 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-18daeb0c-587c-4ec7-8d7e-a15ac458d2f3 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:54.414235 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-478802bc-c199-4e5c-9140-153518d85ef0 None None] For port 0acfa6cc-c45a-41fc-920a-0ef63d0600d0, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:29:54.415925 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5c8fe5a-55d2-4172-b22d-47bd2bc7baf6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Pushing event updated for resources: {'Network': ['ID=a07c952d-27cd-4045-967f-043cd5d7542f,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:54.417918 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-478802bc-c199-4e5c-9140-153518d85ef0 None None] For port 0acfa6cc-c45a-41fc-920a-0ef63d0600d0, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=0acfa6cc-c45a-41fc-920a-0ef63d0600d0,segment=NetworkSegment(29dd0c31-fa36-4903-bb81-1974d7ba9c81),segment_id=29dd0c31-fa36-4903-bb81-1974d7ba9c81)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:29:54.423429 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9f3c5793-972a-4c8f-b688-3a67d0087abb tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:54.436914 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network a07c952d-27cd-4045-967f-043cd5d7542f details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:29:54.438459 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d080fa0f-6dda-4e00-98fa-2bc0b2792c24 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Checking segment: {'id': 'b5cec454-4fbe-451b-b90e-7cf65688ef8c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 324, 'network_id': '3669a9e4-d853-4e8c-90ad-c544516ed2c5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:29:54.438872 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d080fa0f-6dda-4e00-98fa-2bc0b2792c24 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Network hostable DHCP agents. Network: 3669a9e4-d853-4e8c-90ad-c544516ed2c5, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:29:54.480896 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9f76135e-a512-427f-83b3-409b28392d7d tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:54.487866 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9f76135e-a512-427f-83b3-409b28392d7d tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:54.496190 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9f76135e-a512-427f-83b3-409b28392d7d tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:54.504843 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9f76135e-a512-427f-83b3-409b28392d7d tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:54.513217 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9f76135e-a512-427f-83b3-409b28392d7d tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:54.515832 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-478802bc-c199-4e5c-9140-153518d85ef0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:54.516745 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-9f76135e-a512-427f-83b3-409b28392d7d tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] 10.222.0.24 "GET /v2.0/networks HTTP/1.1" status: 200 len: 3009 time: 0.2583969 Nov 09 04:29:54.521676 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54140) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:54.536321 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a840c6b4-e37f-4466-b9b3-37d196258649 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:54.540219 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9f3c5793-972a-4c8f-b688-3a67d0087abb tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:54.566180 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-18daeb0c-587c-4ec7-8d7e-a15ac458d2f3 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:54.600272 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-478802bc-c199-4e5c-9140-153518d85ef0 None None] Pushing event updated for resources: {'Port': ['ID=0acfa6cc-c45a-41fc-920a-0ef63d0600d0,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:54.636452 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-18daeb0c-587c-4ec7-8d7e-a15ac458d2f3 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:54.641172 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a840c6b4-e37f-4466-b9b3-37d196258649 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Pushing event deleted for resources: {'Subnet': ['ID=2af48489-6c72-46b4-8eb9-1e92215d96e9,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:54.664583 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e52d0096-cde2-43a2-b29b-702b347f9831 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:54.666888 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-9f3c5793-972a-4c8f-b688-3a67d0087abb tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Network 41b6a30b-1a07-4d4e-bb4c-2047225fca0a is not hosted by any dhcp agent {{(pid=102162) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Nov 09 04:29:54.672523 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9f3c5793-972a-4c8f-b688-3a67d0087abb tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:54.673142 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9f3c5793-972a-4c8f-b688-3a67d0087abb tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:54.677832 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-9f3c5793-972a-4c8f-b688-3a67d0087abb tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "PUT /v2.0/networks/41b6a30b-1a07-4d4e-bb4c-2047225fca0a HTTP/1.1" status: 200 len: 762 time: 0.7082527 Nov 09 04:29:54.678490 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54144) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:54.693647 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d080fa0f-6dda-4e00-98fa-2bc0b2792c24 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Network 3669a9e4-d853-4e8c-90ad-c544516ed2c5 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:29:54.708920 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a840c6b4-e37f-4466-b9b3-37d196258649 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:54.713239 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a840c6b4-e37f-4466-b9b3-37d196258649 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] 10.222.0.24 "DELETE /v2.0/subnets/2af48489-6c72-46b4-8eb9-1e92215d96e9 HTTP/1.1" status: 204 len: 168 time: 0.9374785 Nov 09 04:29:54.718460 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54146) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:54.779150 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-18daeb0c-587c-4ec7-8d7e-a15ac458d2f3 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:54.779150 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-18daeb0c-587c-4ec7-8d7e-a15ac458d2f3 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 708 time: 0.6567693 Nov 09 04:29:54.779150 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54148) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:54.803433 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-a174f5a5-8d6c-4616-97e8-cdda65280629 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Request body: {'router': {'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:54.807760 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6a68a2e3-2408-4ef9-bc68-552137fa0d46 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:54.811830 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f3c5793-972a-4c8f-b688-3a67d0087abb tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Pushing event updated for resources: {'Network': ['ID=41b6a30b-1a07-4d4e-bb4c-2047225fca0a,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:54.822675 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 41b6a30b-1a07-4d4e-bb4c-2047225fca0a details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:29:54.851318 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d664d227-8404-4385-a862-2b3d36b3040e tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:54.856718 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-d664d227-8404-4385-a862-2b3d36b3040e tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "GET /v2.0/networks?id=41b6a30b-1a07-4d4e-bb4c-2047225fca0a HTTP/1.1" status: 200 len: 765 time: 0.1737044 Nov 09 04:29:54.857744 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54150) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:54.934290 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-d080fa0f-6dda-4e00-98fa-2bc0b2792c24 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 3669a9e4-d853-4e8c-90ad-c544516ed2c5) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:29:54.948289 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ffbbf3c1-3a57-44ad-a94d-33cc29f09cf4 None None] Network 3669a9e4-d853-4e8c-90ad-c544516ed2c5 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:29:54.973260 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d080fa0f-6dda-4e00-98fa-2bc0b2792c24 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:54.973846 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d080fa0f-6dda-4e00-98fa-2bc0b2792c24 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:54.979087 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-133d7505-d05f-480a-b8e7-90f95c1b7f77 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:55.005390 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e52d0096-cde2-43a2-b29b-702b347f9831 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:55.085860 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e52d0096-cde2-43a2-b29b-702b347f9831 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Network 6b78e150-9412-4145-a432-680e4456364c is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:29:55.114258 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-e52d0096-cde2-43a2-b29b-702b347f9831 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:29:55.117985 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1a7c8412-b62a-47e8-91cf-5625f4b8289e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-3669a9e4-d853-4e8c-90ad-c544516ed2c5', 'network_id': '3669a9e4-d853-4e8c-90ad-c544516ed2c5', 'tenant_id': '6761c80dbfa84798bb6517a9b532f870', 'fixed_ips': [{'subnet_id': '366772a4-c45a-4129-af01-4f834e98308c'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:29:55.123288 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1a7c8412-b62a-47e8-91cf-5625f4b8289e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:55.123408 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e52d0096-cde2-43a2-b29b-702b347f9831 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:29:55.126653 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-d080fa0f-6dda-4e00-98fa-2bc0b2792c24 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 816 time: 1.9173069 Nov 09 04:29:55.131553 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a174f5a5-8d6c-4616-97e8-cdda65280629 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:55.134241 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54152) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:55.149601 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6a68a2e3-2408-4ef9-bc68-552137fa0d46 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:55.166461 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-a1d10e9a-c4d5-420f-a17f-e4cb5fb67b74 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-1600745921'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:55.183717 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e52d0096-cde2-43a2-b29b-702b347f9831 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Pushing event updated for resources: {'Port': ['ID=1422f05c-c9c5-470c-b800-a079cd4d4962,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:55.212985 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e52d0096-cde2-43a2-b29b-702b347f9831 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:55.213725 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e52d0096-cde2-43a2-b29b-702b347f9831 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:55.228215 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-edcbbe98-41f6-48d8-9948-c7e703802168 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:55.238766 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-edcbbe98-41f6-48d8-9948-c7e703802168 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:55.243622 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-edcbbe98-41f6-48d8-9948-c7e703802168 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 1348 time: 0.3798208 Nov 09 04:29:55.245071 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54154) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:55.276723 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-6a68a2e3-2408-4ef9-bc68-552137fa0d46 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a3060171-2337-47cb-9de2-3eb494ae2d7f']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:55.293884 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-133d7505-d05f-480a-b8e7-90f95c1b7f77 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:55.297394 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a1d10e9a-c4d5-420f-a17f-e4cb5fb67b74 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Made reservation on behalf of 6761c80dbfa84798bb6517a9b532f870 for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:29:55.300902 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-6a68a2e3-2408-4ef9-bc68-552137fa0d46 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '0bae02b6-e9d9-4197-8915-3723da1dd49c') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:55.300902 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-6a68a2e3-2408-4ef9-bc68-552137fa0d46 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '0bae02b6-e9d9-4197-8915-3723da1dd49c') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:55.301297 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-1a7c8412-b62a-47e8-91cf-5625f4b8289e None None] Allocated IP 172.20.255.242 (3669a9e4-d853-4e8c-90ad-c544516ed2c5/366772a4-c45a-4129-af01-4f834e98308c/a1b1ba13-9d9c-4bc5-8c09-5a9619df2802) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:29:55.301381 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a1d10e9a-c4d5-420f-a17f-e4cb5fb67b74 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:55.304523 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-e9c7a614-01c6-46ab-90a1-767f2f3dfa4c tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "GET /v2.0/subnets?network_id=2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 HTTP/1.1" status: 200 len: 207 time: 0.0573666 Nov 09 04:29:55.308276 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54158) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:55.327140 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6a68a2e3-2408-4ef9-bc68-552137fa0d46 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:55.363635 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a1d10e9a-c4d5-420f-a17f-e4cb5fb67b74 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 337} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:29:55.364920 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-133d7505-d05f-480a-b8e7-90f95c1b7f77 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3919e9cb-8006-4613-b88e-7ef46e2b76eb']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:55.367561 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6a68a2e3-2408-4ef9-bc68-552137fa0d46 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:55.376572 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a1d10e9a-c4d5-420f-a17f-e4cb5fb67b74 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:55.376913 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-a1d10e9a-c4d5-420f-a17f-e4cb5fb67b74 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Added segment 6228cfb2-4f9f-4492-a6e4-baed1761b32c of type vlan for network 4a546e0a-7b29-4243-aab6-ce90674959a5 Nov 09 04:29:55.384086 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-133d7505-d05f-480a-b8e7-90f95c1b7f77 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'dee31afc-2fc7-40e2-9fe3-1ec6de6d8270') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:55.384787 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-133d7505-d05f-480a-b8e7-90f95c1b7f77 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'dee31afc-2fc7-40e2-9fe3-1ec6de6d8270') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:55.397554 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-e52d0096-cde2-43a2-b29b-702b347f9831 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 935 time: 1.9409149 Nov 09 04:29:55.402684 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54160) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:55.412941 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-a967a94e-a647-4f68-a161-f8b0d0b2cbaf tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Request body: {'port': {'network_id': '6b78e150-9412-4145-a432-680e4456364c', 'name': 'tempest-ExtraDHCPOptionsTestJSON-1365475677', 'extra_dhcp_opts': [{'opt_value': 'pxelinux.0', 'opt_name': 'bootfile-name'}, {'opt_value': '123.123.123.123', 'opt_name': 'tftp-server'}, {'opt_value': '123.123.123.45', 'opt_name': 'server-ip-address'}]}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:55.413497 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.api.validators [None req-a967a94e-a647-4f68-a161-f8b0d0b2cbaf tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] bootfile-name is not in valid_values {{(pid=102161) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Nov 09 04:29:55.413839 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.api.validators [None req-a967a94e-a647-4f68-a161-f8b0d0b2cbaf tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] tftp-server is not in valid_values {{(pid=102161) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Nov 09 04:29:55.414173 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.api.validators [None req-a967a94e-a647-4f68-a161-f8b0d0b2cbaf tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] server-ip-address is not in valid_values {{(pid=102161) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Nov 09 04:29:55.416260 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6a68a2e3-2408-4ef9-bc68-552137fa0d46 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Releasing vlan 333 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:29:55.416661 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6a68a2e3-2408-4ef9-bc68-552137fa0d46 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:55.425221 dv-neutron-816802-2-hyperv neutron-server[102162]: /usr/local/lib/python3.8/dist-packages/neutron_lib/db/model_query.py:331: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:29:55.425221 dv-neutron-816802-2-hyperv neutron-server[102162]: items = [ Nov 09 04:29:55.425221 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:29:55.425221 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:29:55.425221 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:29:55.425221 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:29:55.425221 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:29:55.425221 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:29:55.425221 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:29:55.425221 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:29:55.425221 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:29:55.425221 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:29:55.425221 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:29:55.425221 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:29:55.425221 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:29:55.425221 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:29:55.425221 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:29:55.425221 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:29:55.425221 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:29:55.425221 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:29:55.425221 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:29:55.425221 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:29:55.425221 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:29:55.425221 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:29:55.425221 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:29:55.425221 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:29:55.425221 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:29:55.425221 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:29:55.425221 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:29:55.425221 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:29:55.425221 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:29:55.425221 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:29:55.425221 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:29:55.425221 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:29:55.438599 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-133d7505-d05f-480a-b8e7-90f95c1b7f77 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:55.489113 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-133d7505-d05f-480a-b8e7-90f95c1b7f77 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:55.500562 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1a7c8412-b62a-47e8-91cf-5625f4b8289e None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:55.504675 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a1d10e9a-c4d5-420f-a17f-e4cb5fb67b74 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:55.506610 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-133d7505-d05f-480a-b8e7-90f95c1b7f77 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Releasing vlan 308 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:29:55.507011 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-133d7505-d05f-480a-b8e7-90f95c1b7f77 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:55.509249 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:29:55.509249 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:29:55.509249 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:29:55.509249 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:29:55.509249 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:29:55.509249 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:29:55.509249 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:29:55.509249 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:29:55.509249 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:29:55.509249 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:29:55.509249 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:29:55.509249 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:29:55.509249 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:29:55.509249 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:29:55.509249 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:29:55.509249 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:29:55.509249 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:29:55.509249 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:29:55.509249 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:29:55.509249 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:29:55.509249 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:29:55.509249 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:29:55.509249 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:29:55.509249 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:29:55.509249 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:29:55.509249 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:29:55.509249 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:29:55.509249 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:29:55.509249 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:29:55.509249 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:29:55.509249 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:29:55.509249 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:29:55.589293 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1a7c8412-b62a-47e8-91cf-5625f4b8289e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:55.602778 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8ff98706-ce5a-4670-8a64-6689e84ca8bc tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:55.610463 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8ff98706-ce5a-4670-8a64-6689e84ca8bc tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:55.616548 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8ff98706-ce5a-4670-8a64-6689e84ca8bc tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:55.622400 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8ff98706-ce5a-4670-8a64-6689e84ca8bc tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:55.628484 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8ff98706-ce5a-4670-8a64-6689e84ca8bc tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:55.634963 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8ff98706-ce5a-4670-8a64-6689e84ca8bc tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:55.640760 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8ff98706-ce5a-4670-8a64-6689e84ca8bc tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:55.642599 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-8ff98706-ce5a-4670-8a64-6689e84ca8bc tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "GET /v2.0/networks HTTP/1.1" status: 200 len: 4293 time: 0.3278959 Nov 09 04:29:55.645339 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6a68a2e3-2408-4ef9-bc68-552137fa0d46 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:55.651142 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1a7c8412-b62a-47e8-91cf-5625f4b8289e None None] Network 3669a9e4-d853-4e8c-90ad-c544516ed2c5 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:29:55.652656 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54162) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:55.654762 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-1a7c8412-b62a-47e8-91cf-5625f4b8289e None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:29:55.659006 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1a7c8412-b62a-47e8-91cf-5625f4b8289e None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:29:55.662204 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a7c8412-b62a-47e8-91cf-5625f4b8289e None None] Pushing event updated for resources: {'Port': ['ID=a1b1ba13-9d9c-4bc5-8c09-5a9619df2802,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:55.680248 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6a68a2e3-2408-4ef9-bc68-552137fa0d46 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:55.684876 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-6a68a2e3-2408-4ef9-bc68-552137fa0d46 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] 10.222.0.24 "DELETE /v2.0/networks/a3060171-2337-47cb-9de2-3eb494ae2d7f HTTP/1.1" status: 204 len: 168 time: 1.1613405 Nov 09 04:29:55.688218 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54166) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:55.709887 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a68a2e3-2408-4ef9-bc68-552137fa0d46 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Pushing event deleted for resources: {'Network': ['ID=a3060171-2337-47cb-9de2-3eb494ae2d7f,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:55.738010 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-1a7c8412-b62a-47e8-91cf-5625f4b8289e None None] Attempting to bind port a1b1ba13-9d9c-4bc5-8c09-5a9619df2802 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:29:55.738973 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-1a7c8412-b62a-47e8-91cf-5625f4b8289e None None] Attempting to bind port a1b1ba13-9d9c-4bc5-8c09-5a9619df2802 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'b5cec454-4fbe-451b-b90e-7cf65688ef8c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 324, 'network_id': '3669a9e4-d853-4e8c-90ad-c544516ed2c5'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:29:55.739546 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a7c8412-b62a-47e8-91cf-5625f4b8289e None None] Attempting to bind port a1b1ba13-9d9c-4bc5-8c09-5a9619df2802 on network 3669a9e4-d853-4e8c-90ad-c544516ed2c5 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:29:55.746021 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a7c8412-b62a-47e8-91cf-5625f4b8289e None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 29, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:29:55.746760 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a7c8412-b62a-47e8-91cf-5625f4b8289e None None] Checking segment: {'id': 'b5cec454-4fbe-451b-b90e-7cf65688ef8c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 324, 'network_id': '3669a9e4-d853-4e8c-90ad-c544516ed2c5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:29:55.747410 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1a7c8412-b62a-47e8-91cf-5625f4b8289e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:55.747999 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a7c8412-b62a-47e8-91cf-5625f4b8289e None None] Bound using segment: {'id': 'b5cec454-4fbe-451b-b90e-7cf65688ef8c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 324, 'network_id': '3669a9e4-d853-4e8c-90ad-c544516ed2c5'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:29:55.748680 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-1a7c8412-b62a-47e8-91cf-5625f4b8289e None None] Bound port: a1b1ba13-9d9c-4bc5-8c09-5a9619df2802, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b5cec454-4fbe-451b-b90e-7cf65688ef8c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 324, 'network_id': '3669a9e4-d853-4e8c-90ad-c544516ed2c5'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:29:55.749462 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1a7c8412-b62a-47e8-91cf-5625f4b8289e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:55.765778 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a174f5a5-8d6c-4616-97e8-cdda65280629 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks [] for router_gateway, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:55.767453 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a1d10e9a-c4d5-420f-a17f-e4cb5fb67b74 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:55.773749 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a1d10e9a-c4d5-420f-a17f-e4cb5fb67b74 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:55.774421 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a1d10e9a-c4d5-420f-a17f-e4cb5fb67b74 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:55.789138 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-133d7505-d05f-480a-b8e7-90f95c1b7f77 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:55.828744 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-133d7505-d05f-480a-b8e7-90f95c1b7f77 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network 3919e9cb-8006-4613-b88e-7ef46e2b76eb {{(pid=102162) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:120}} Nov 09 04:29:55.830406 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-133d7505-d05f-480a-b8e7-90f95c1b7f77 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Pushing event deleted for resources: {'Network': ['ID=3919e9cb-8006-4613-b88e-7ef46e2b76eb,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:55.832387 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-133d7505-d05f-480a-b8e7-90f95c1b7f77 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:55.845320 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a174f5a5-8d6c-4616-97e8-cdda65280629 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:55.848038 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-133d7505-d05f-480a-b8e7-90f95c1b7f77 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] 10.222.0.24 "DELETE /v2.0/networks/3919e9cb-8006-4613-b88e-7ef46e2b76eb HTTP/1.1" status: 204 len: 168 time: 1.1281989 Nov 09 04:29:55.870593 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-1a7c8412-b62a-47e8-91cf-5625f4b8289e None None] For port a1b1ba13-9d9c-4bc5-8c09-5a9619df2802, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:29:55.876221 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-1a7c8412-b62a-47e8-91cf-5625f4b8289e None None] For port a1b1ba13-9d9c-4bc5-8c09-5a9619df2802, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=a1b1ba13-9d9c-4bc5-8c09-5a9619df2802,segment=NetworkSegment(b5cec454-4fbe-451b-b90e-7cf65688ef8c),segment_id=b5cec454-4fbe-451b-b90e-7cf65688ef8c)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:29:55.956907 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1a7c8412-b62a-47e8-91cf-5625f4b8289e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:55.968823 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a967a94e-a647-4f68-a161-f8b0d0b2cbaf tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Made reservation on behalf of 44afe8e54a5c466e95915d5c99458492 for: {'port': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:29:55.975434 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a967a94e-a647-4f68-a161-f8b0d0b2cbaf tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:55.990436 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-97da5362-85b6-4c29-925e-0407e699ad74 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "GET /v2.0/networks?fields=id&fields=name&fields=mtu HTTP/1.1" status: 200 len: 911 time: 0.3348472 Nov 09 04:29:56.000860 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54172) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:56.024219 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ab45f9a9-b9bf-4f09-8e6b-c00b9759be24 None None] Network 6b78e150-9412-4145-a432-680e4456364c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:29:56.134578 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2b1ab6b9-43c1-4a91-84b0-1eee1df55371 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:56.136516 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2b1ab6b9-43c1-4a91-84b0-1eee1df55371 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:56.138053 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2b1ab6b9-43c1-4a91-84b0-1eee1df55371 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:56.139618 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2b1ab6b9-43c1-4a91-84b0-1eee1df55371 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:56.146271 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-677123cf-7b7e-4559-afe5-18e0df8721f0 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:56.149961 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2b1ab6b9-43c1-4a91-84b0-1eee1df55371 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:56.151962 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 0acfa6cc-c45a-41fc-920a-0ef63d0600d0 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:29:56.152806 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-2b1ab6b9-43c1-4a91-84b0-1eee1df55371 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 3330 time: 0.1505742 Nov 09 04:29:56.158464 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54176) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:56.184741 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a7c8412-b62a-47e8-91cf-5625f4b8289e None None] Pushing event updated for resources: {'Port': ['ID=a1b1ba13-9d9c-4bc5-8c09-5a9619df2802,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:56.208154 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-9cd2d327-37cb-46c3-8543-77f5383e783e None None] Provisioning complete for port 0acfa6cc-c45a-41fc-920a-0ef63d0600d0 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:29:56.208528 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9cd2d327-37cb-46c3-8543-77f5383e783e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:56.278532 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-45a41c94-bb36-42ab-bd50-79f431020a67 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Attributes excluded by policy engine: ['shared'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:56.280431 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-45a41c94-bb36-42ab-bd50-79f431020a67 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Attributes excluded by policy engine: ['shared'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:56.283474 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-45a41c94-bb36-42ab-bd50-79f431020a67 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Attributes excluded by policy engine: ['shared'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:56.286228 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-45a41c94-bb36-42ab-bd50-79f431020a67 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Attributes excluded by policy engine: ['shared'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:56.288150 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-45a41c94-bb36-42ab-bd50-79f431020a67 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Attributes excluded by policy engine: ['shared'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:56.297117 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-45a41c94-bb36-42ab-bd50-79f431020a67 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "GET /v2.0/subnets?fields=id&fields=network_id HTTP/1.1" status: 200 len: 697 time: 0.1362846 Nov 09 04:29:56.297952 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54180) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:56.476233 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54184) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:56.493929 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-f04645dd-bbcd-4d2c-b71c-0be3fb5986ae tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Request body: {'router': {'name': 'tempest-router--169643124', 'project_id': 'e4cf2b60fca04c8ba3e4fcf0e40812ea'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:56.588675 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 0acfa6cc-c45a-41fc-920a-0ef63d0600d0 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:29:56.588878 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:56.626550 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9cd2d327-37cb-46c3-8543-77f5383e783e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:56.627937 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7dda3ac4-948a-4a18-8757-cc4d919bd588 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:56.630816 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-7dda3ac4-948a-4a18-8757-cc4d919bd588 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "GET /v2.0/networks/6f70786d-53ba-429d-b311-5a26e2e908bd HTTP/1.1" status: 200 len: 802 time: 0.3313441 Nov 09 04:29:56.635267 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54188) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:56.689086 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1d10e9a-c4d5-420f-a17f-e4cb5fb67b74 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event updated for resources: {'Network': ['ID=4a546e0a-7b29-4243-aab6-ce90674959a5,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:56.696820 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-9cd2d327-37cb-46c3-8543-77f5383e783e None None] For port 0acfa6cc-c45a-41fc-920a-0ef63d0600d0, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=0acfa6cc-c45a-41fc-920a-0ef63d0600d0,segment=NetworkSegment(29dd0c31-fa36-4903-bb81-1974d7ba9c81),segment_id=29dd0c31-fa36-4903-bb81-1974d7ba9c81)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:29:56.700714 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a1d10e9a-c4d5-420f-a17f-e4cb5fb67b74 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 780 time: 1.5437047 Nov 09 04:29:56.708053 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54190) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:56.715141 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 4a546e0a-7b29-4243-aab6-ce90674959a5 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:29:56.716781 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-17bd835a-7bd0-4222-b8cd-770c085ca121 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Request body: {'subnet': {'network_id': '4a546e0a-7b29-4243-aab6-ce90674959a5', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'enable_dhcp': True, 'host_routes': [{'destination': '10.20.0.0/32', 'nexthop': '10.100.1.1'}], 'dns_nameservers': ['8.8.4.4', '8.8.8.8']}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:56.766517 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-a174f5a5-8d6c-4616-97e8-cdda65280629 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Allocated IP 172.26.0.98 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/ebcc17fd-b39b-4e71-9ee0-779c9a37499e) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:29:56.782431 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [None req-a967a94e-a647-4f68-a161-f8b0d0b2cbaf tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] device_id is not set on port 2d3a49b2-8263-4114-bc47-99fe1cab5442 yet. {{(pid=102161) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:29:56.803656 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d59c78cb-88bd-4d51-978f-0da1f0d3f85a req-4f1122dc-d220-429c-97c8-e3b217f06be6 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:56.805550 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d59c78cb-88bd-4d51-978f-0da1f0d3f85a req-4f1122dc-d220-429c-97c8-e3b217f06be6 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.24 "GET /v2.0/ports?device_id=1aa3bc74-67df-4706-979b-cbf709855232 HTTP/1.1" status: 200 len: 945 time: 0.8552396 Nov 09 04:29:57.035642 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9cd2d327-37cb-46c3-8543-77f5383e783e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:57.047164 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:57.273226 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cd2d327-37cb-46c3-8543-77f5383e783e None None] Pushing event updated for resources: {'Port': ['ID=0acfa6cc-c45a-41fc-920a-0ef63d0600d0,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:57.273226 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.db.api [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=102163) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:29:57.273226 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG oslo_db.api [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:29:57.286712 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-f43dc91a-3135-4d88-83a6-5195139f7024 None None] Provisioning complete for port 0acfa6cc-c45a-41fc-920a-0ef63d0600d0 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:29:57.287604 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f43dc91a-3135-4d88-83a6-5195139f7024 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:57.316106 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-677123cf-7b7e-4559-afe5-18e0df8721f0 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:57.399948 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-a967a94e-a647-4f68-a161-f8b0d0b2cbaf tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Allocated IP 172.20.0.13 (6b78e150-9412-4145-a432-680e4456364c/2aa88cd9-d91d-402f-9e1c-75a447bc596d/2d3a49b2-8263-4114-bc47-99fe1cab5442) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:29:57.404015 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f04645dd-bbcd-4d2c-b71c-0be3fb5986ae tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:57.405138 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f04645dd-bbcd-4d2c-b71c-0be3fb5986ae tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:57.415230 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-342a83f2-d2ea-4520-ae6e-18758a33c59f tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "GET /v2.0/networks/6f70786d-53ba-429d-b311-5a26e2e908bd?fields=id&fields=name&fields=mtu HTTP/1.1" status: 200 len: 318 time: 0.7785196 Nov 09 04:29:57.429905 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54192) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:57.453184 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-f43dc91a-3135-4d88-83a6-5195139f7024 None None] Provisioning complete for port 1422f05c-c9c5-470c-b800-a079cd4d4962 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:29:57.453555 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f43dc91a-3135-4d88-83a6-5195139f7024 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:57.505109 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-f43dc91a-3135-4d88-83a6-5195139f7024 None None] Port 1422f05c-c9c5-470c-b800-a079cd4d4962 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:29:57.532779 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-678a628c-32f4-4c6e-926e-aaa6a7d4bae7 None None] Network 3669a9e4-d853-4e8c-90ad-c544516ed2c5 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:29:57.553970 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f04645dd-bbcd-4d2c-b71c-0be3fb5986ae tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:57.576654 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c21e26f7-10a6-4412-a91e-d07c27269a5e req-6a1bb49f-8269-4c6c-ade9-e5396fd36d2d tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:57.578158 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c21e26f7-10a6-4412-a91e-d07c27269a5e req-6a1bb49f-8269-4c6c-ade9-e5396fd36d2d tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "GET /v2.0/ports?device_id=fd8e39fc-699b-4777-aae4-ca592a898437 HTTP/1.1" status: 200 len: 945 time: 0.9952073 Nov 09 04:29:57.581523 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-80f81ce4-9313-4dc7-a198-ea15591e3d17 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:57.583539 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-80f81ce4-9313-4dc7-a198-ea15591e3d17 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "GET /v2.0/subnets/55f532c1-0964-46c0-bb3d-4cdfb666bdde HTTP/1.1" status: 200 len: 843 time: 0.1498454 Nov 09 04:29:57.587505 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54194) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:57.603029 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d59c78cb-88bd-4d51-978f-0da1f0d3f85a req-7a092f8c-fd27-4207-afc6-d7051feb2f46 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.24 "GET /v2.0/security-groups?id=4b002f37-f4ce-4d8a-a894-560955e72139&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.7491827 Nov 09 04:29:57.604880 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-677123cf-7b7e-4559-afe5-18e0df8721f0 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a07c952d-27cd-4045-967f-043cd5d7542f']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:57.622319 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f04645dd-bbcd-4d2c-b71c-0be3fb5986ae tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:57.625080 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-677123cf-7b7e-4559-afe5-18e0df8721f0 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'dbe7d506-2476-4b08-a4d5-4fc5ba635670') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:57.625627 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-677123cf-7b7e-4559-afe5-18e0df8721f0 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'dbe7d506-2476-4b08-a4d5-4fc5ba635670') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:29:57.655816 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-677123cf-7b7e-4559-afe5-18e0df8721f0 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:57.666604 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-73b3e84d-e86d-4282-9e36-15995b8dbd05 None None] Provisioning complete for port a1b1ba13-9d9c-4bc5-8c09-5a9619df2802 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:29:57.666983 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-73b3e84d-e86d-4282-9e36-15995b8dbd05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:57.670581 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-17bd835a-7bd0-4222-b8cd-770c085ca121 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Made reservation on behalf of 6761c80dbfa84798bb6517a9b532f870 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:29:57.675504 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-17bd835a-7bd0-4222-b8cd-770c085ca121 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:57.721129 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-677123cf-7b7e-4559-afe5-18e0df8721f0 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:57.728698 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c21e26f7-10a6-4412-a91e-d07c27269a5e req-e535a6d5-831b-478f-8c9c-b3a4c90c31b5 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "GET /v2.0/security-groups?id=67cb2d36-e38c-4a29-adb5-c52b1d94ae99&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1396441 Nov 09 04:29:57.732624 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cac91a30-c294-4f20-89aa-8dd5108f80e5 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Attributes excluded by policy engine: ['shared'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:57.739018 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-cac91a30-c294-4f20-89aa-8dd5108f80e5 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "GET /v2.0/subnets/55f532c1-0964-46c0-bb3d-4cdfb666bdde?fields=id&fields=network_id HTTP/1.1" status: 200 len: 302 time: 0.1412458 Nov 09 04:29:57.741191 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f04645dd-bbcd-4d2c-b71c-0be3fb5986ae tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:57.749293 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-f04645dd-bbcd-4d2c-b71c-0be3fb5986ae tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 722 time: 1.2661109 Nov 09 04:29:57.749293 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54200) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:57.753375 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-c932257d-88cf-4ad8-ae42-579f136900d3 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-2044889690'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:57.762404 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54202) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:57.818424 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-677123cf-7b7e-4559-afe5-18e0df8721f0 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Releasing vlan 302 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:29:57.818956 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-677123cf-7b7e-4559-afe5-18e0df8721f0 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:57.823852 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:29:57.823852 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:29:57.823852 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:29:57.823852 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:29:57.823852 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:29:57.823852 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:29:57.823852 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:29:57.823852 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:29:57.823852 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:29:57.823852 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:29:57.823852 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:29:57.823852 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:29:57.823852 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:29:57.823852 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:29:57.823852 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:29:57.823852 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:29:57.823852 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:29:57.823852 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:29:57.823852 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:29:57.823852 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:29:57.823852 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:29:57.823852 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:29:57.823852 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:29:57.823852 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:29:57.823852 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:29:57.823852 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:29:57.823852 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:29:57.823852 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:29:57.823852 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:29:57.823852 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:29:57.823852 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:29:57.823852 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:29:57.864251 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-17c223aa-5f53-474d-8db2-15bfb509a6ba tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks [] for router, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:57.917683 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-73b3e84d-e86d-4282-9e36-15995b8dbd05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:57.961177 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a174f5a5-8d6c-4616-97e8-cdda65280629 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:57.964703 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c932257d-88cf-4ad8-ae42-579f136900d3 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Made reservation on behalf of 83cbb798c0f44b268f8acd2a70eb745a for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:29:57.970901 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-73b3e84d-e86d-4282-9e36-15995b8dbd05 None None] For port a1b1ba13-9d9c-4bc5-8c09-5a9619df2802, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=a1b1ba13-9d9c-4bc5-8c09-5a9619df2802,segment=NetworkSegment(b5cec454-4fbe-451b-b90e-7cf65688ef8c),segment_id=b5cec454-4fbe-451b-b90e-7cf65688ef8c)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:29:57.989601 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c932257d-88cf-4ad8-ae42-579f136900d3 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:58.037132 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a967a94e-a647-4f68-a161-f8b0d0b2cbaf tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:58.064218 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-73b3e84d-e86d-4282-9e36-15995b8dbd05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:58.103781 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-677123cf-7b7e-4559-afe5-18e0df8721f0 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:58.108902 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-677123cf-7b7e-4559-afe5-18e0df8721f0 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:58.112145 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-677123cf-7b7e-4559-afe5-18e0df8721f0 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] 10.222.0.24 "DELETE /v2.0/networks/a07c952d-27cd-4045-967f-043cd5d7542f HTTP/1.1" status: 204 len: 168 time: 2.4188650 Nov 09 04:29:58.121114 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54208) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:58.133184 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-73b3e84d-e86d-4282-9e36-15995b8dbd05 None None] Provisioning complete for port 1422f05c-c9c5-470c-b800-a079cd4d4962 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:29:58.133541 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-73b3e84d-e86d-4282-9e36-15995b8dbd05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:58.248408 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 0acfa6cc-c45a-41fc-920a-0ef63d0600d0 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:29:58.296141 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3a42a4d3-c750-48ef-8a84-5eea73d51614 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:58.302060 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c932257d-88cf-4ad8-ae42-579f136900d3 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 343} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:29:58.302298 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3a42a4d3-c750-48ef-8a84-5eea73d51614 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:58.313663 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-3a42a4d3-c750-48ef-8a84-5eea73d51614 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] 10.222.0.24 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1339 time: 0.1682415 Nov 09 04:29:58.315844 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54214) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:58.319471 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c932257d-88cf-4ad8-ae42-579f136900d3 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:58.322669 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-677123cf-7b7e-4559-afe5-18e0df8721f0 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Pushing event deleted for resources: {'Network': ['ID=a07c952d-27cd-4045-967f-043cd5d7542f,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:58.322819 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-c932257d-88cf-4ad8-ae42-579f136900d3 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Added segment f7804780-6a6e-45e4-b9d1-0469fe5dec5d of type vlan for network 9680862a-d7ab-46b3-9eea-47dd24c9bfec Nov 09 04:29:58.323998 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-73b3e84d-e86d-4282-9e36-15995b8dbd05 None None] Port 1422f05c-c9c5-470c-b800-a079cd4d4962 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:29:58.337317 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73b3e84d-e86d-4282-9e36-15995b8dbd05 None None] Pushing event updated for resources: {'Port': ['ID=a1b1ba13-9d9c-4bc5-8c09-5a9619df2802,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:58.342490 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-8f2a5f2a-4d25-421f-a4e3-b12916dffb1e tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsTest-test-network-19313490'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:58.357232 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 0acfa6cc-c45a-41fc-920a-0ef63d0600d0 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:29:58.358957 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:58.368799 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a174f5a5-8d6c-4616-97e8-cdda65280629 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:58.418315 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c932257d-88cf-4ad8-ae42-579f136900d3 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:58.420829 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a174f5a5-8d6c-4616-97e8-cdda65280629 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Pushing event updated for resources: {'Port': ['ID=ebcc17fd-b39b-4e71-9ee0-779c9a37499e,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:58.449423 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-17c223aa-5f53-474d-8db2-15bfb509a6ba tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:58.452356 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-17c223aa-5f53-474d-8db2-15bfb509a6ba tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:58.455919 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device a1b1ba13-9d9c-4bc5-8c09-5a9619df2802 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:29:58.474653 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a967a94e-a647-4f68-a161-f8b0d0b2cbaf tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:58.491419 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a174f5a5-8d6c-4616-97e8-cdda65280629 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:29:58.513304 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-0a9d159a-87e5-42c9-a39f-b53a0520ecdf None None] Provisioning complete for port a1b1ba13-9d9c-4bc5-8c09-5a9619df2802 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:29:58.513668 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0a9d159a-87e5-42c9-a39f-b53a0520ecdf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:58.525110 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-a174f5a5-8d6c-4616-97e8-cdda65280629 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:29:58.531859 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a174f5a5-8d6c-4616-97e8-cdda65280629 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:29:58.551745 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port a1b1ba13-9d9c-4bc5-8c09-5a9619df2802 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:29:58.551977 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:58.573738 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a967a94e-a647-4f68-a161-f8b0d0b2cbaf tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Network 6b78e150-9412-4145-a432-680e4456364c is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:29:58.575014 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a967a94e-a647-4f68-a161-f8b0d0b2cbaf tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Pushing event updated for resources: {'Port': ['ID=2d3a49b2-8263-4114-bc47-99fe1cab5442,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:58.577355 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8f2a5f2a-4d25-421f-a4e3-b12916dffb1e tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Made reservation on behalf of 2f077d8d6e0c4af98a4ce8fbe06ce9d4 for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:29:58.580757 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8f2a5f2a-4d25-421f-a4e3-b12916dffb1e tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:58.588490 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-a967a94e-a647-4f68-a161-f8b0d0b2cbaf tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:29:58.594155 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c932257d-88cf-4ad8-ae42-579f136900d3 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:58.602608 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a967a94e-a647-4f68-a161-f8b0d0b2cbaf tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:29:58.609948 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-17bd835a-7bd0-4222-b8cd-770c085ca121 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:58.637137 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c932257d-88cf-4ad8-ae42-579f136900d3 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:58.657400 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c932257d-88cf-4ad8-ae42-579f136900d3 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:58.700944 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-17c223aa-5f53-474d-8db2-15bfb509a6ba tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:58.701490 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-17c223aa-5f53-474d-8db2-15bfb509a6ba tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 9f277d04-869f-48f6-92ab-3bd44f198ae4 {{(pid=102162) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:29:58.728839 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-17c223aa-5f53-474d-8db2-15bfb509a6ba tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:58.730532 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-17c223aa-5f53-474d-8db2-15bfb509a6ba tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] 10.222.0.24 "DELETE /v2.0/routers/9f277d04-869f-48f6-92ab-3bd44f198ae4 HTTP/1.1" status: 204 len: 168 time: 0.9642534 Nov 09 04:29:58.755285 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8f2a5f2a-4d25-421f-a4e3-b12916dffb1e tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 331} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:29:58.768223 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8f2a5f2a-4d25-421f-a4e3-b12916dffb1e tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:58.768223 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-8f2a5f2a-4d25-421f-a4e3-b12916dffb1e tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Added segment f24b880e-7cbf-4acc-8973-0cb4a4a0d612 of type vlan for network ca45084c-ecc9-45bb-847c-5b9e30970a24 Nov 09 04:29:58.797292 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c932257d-88cf-4ad8-ae42-579f136900d3 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Pushing event updated for resources: {'Network': ['ID=9680862a-d7ab-46b3-9eea-47dd24c9bfec,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:58.809229 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 9680862a-d7ab-46b3-9eea-47dd24c9bfec details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:29:58.815090 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a967a94e-a647-4f68-a161-f8b0d0b2cbaf tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:58.823986 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a967a94e-a647-4f68-a161-f8b0d0b2cbaf tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:58.857484 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-c932257d-88cf-4ad8-ae42-579f136900d3 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 1.1076519 Nov 09 04:29:58.858165 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54220) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:58.864676 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-f9df9eb0-f6b6-4084-b86c-899d22f82025 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Request body: {'subnet': {'network_id': '9680862a-d7ab-46b3-9eea-47dd24c9bfec', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'host_routes': [{'destination': '2001::/64', 'nexthop': '2003::1'}], 'dns_nameservers': ['2001:4860:4860::8844', '2001:4860:4860::8888'], 'allocation_pools': [{'start': '2001:db8::3', 'end': '2001:db8::7'}]}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:58.928493 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8f2a5f2a-4d25-421f-a4e3-b12916dffb1e tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:58.973779 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17bd835a-7bd0-4222-b8cd-770c085ca121 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event updated for resources: {'Subnet': ['ID=17925b38-b947-433f-a9f5-c6477a234b2f,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:58.998067 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-ec4d495c-eae6-443f-aadf-908ceb3d8d2c None None] Provisioning complete for port 2d3a49b2-8263-4114-bc47-99fe1cab5442 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:29:58.999271 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ec4d495c-eae6-443f-aadf-908ceb3d8d2c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:59.017023 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae885487-dfff-46d0-8d94-2fd460cd1bd3 req-c229d3d9-dd34-412c-a6c2-e5a8b022871b tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:59.027254 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ae885487-dfff-46d0-8d94-2fd460cd1bd3 req-c229d3d9-dd34-412c-a6c2-e5a8b022871b tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.24 "GET /v2.0/ports?device_id=1aa3bc74-67df-4706-979b-cbf709855232 HTTP/1.1" status: 200 len: 945 time: 0.1407759 Nov 09 04:29:59.031776 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a967a94e-a647-4f68-a161-f8b0d0b2cbaf tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1153 time: 3.6252189 Nov 09 04:29:59.034862 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54224) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:59.047504 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-ec4d495c-eae6-443f-aadf-908ceb3d8d2c None None] Port 2d3a49b2-8263-4114-bc47-99fe1cab5442 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:29:59.047733 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-17bd835a-7bd0-4222-b8cd-770c085ca121 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Checking segment: {'id': '6228cfb2-4f9f-4492-a6e4-baed1761b32c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 337, 'network_id': '4a546e0a-7b29-4243-aab6-ce90674959a5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:29:59.048052 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-17bd835a-7bd0-4222-b8cd-770c085ca121 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Network hostable DHCP agents. Network: 4a546e0a-7b29-4243-aab6-ce90674959a5, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:29:59.081023 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c309bd51-6418-4f97-862f-6c2fa834855a req-d8d37854-c022-486a-8121-5cfe74713a64 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:59.082597 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c309bd51-6418-4f97-862f-6c2fa834855a req-d8d37854-c022-486a-8121-5cfe74713a64 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "GET /v2.0/ports?device_id=fd8e39fc-699b-4777-aae4-ca592a898437 HTTP/1.1" status: 200 len: 945 time: 0.0773356 Nov 09 04:29:59.085439 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8f2a5f2a-4d25-421f-a4e3-b12916dffb1e tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:59.091161 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8f2a5f2a-4d25-421f-a4e3-b12916dffb1e tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:59.095969 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8f2a5f2a-4d25-421f-a4e3-b12916dffb1e tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:59.115980 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ae885487-dfff-46d0-8d94-2fd460cd1bd3 req-7c50c8a2-e05c-4231-99bf-d78a1a6339d3 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.24 "GET /v2.0/security-groups?id=4b002f37-f4ce-4d8a-a894-560955e72139&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0838568 Nov 09 04:29:59.127846 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3905a9a3-7755-4093-a7e5-95b1e69b03ae tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:59.135730 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54226) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:59.137899 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3905a9a3-7755-4093-a7e5-95b1e69b03ae tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:59.143853 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3905a9a3-7755-4093-a7e5-95b1e69b03ae tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:59.145577 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-3905a9a3-7755-4093-a7e5-95b1e69b03ae tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] 10.222.0.24 "GET /v2.0/ports HTTP/1.1" status: 200 len: 2619 time: 0.1096504 Nov 09 04:29:59.148388 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54228) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:59.178286 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f9df9eb0-f6b6-4084-b86c-899d22f82025 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Made reservation on behalf of 83cbb798c0f44b268f8acd2a70eb745a for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:29:59.181626 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f9df9eb0-f6b6-4084-b86c-899d22f82025 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:59.188493 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-17bd835a-7bd0-4222-b8cd-770c085ca121 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Network 4a546e0a-7b29-4243-aab6-ce90674959a5 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:29:59.235115 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f2a5f2a-4d25-421f-a4e3-b12916dffb1e tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Pushing event updated for resources: {'Network': ['ID=ca45084c-ecc9-45bb-847c-5b9e30970a24,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:59.249343 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network ca45084c-ecc9-45bb-847c-5b9e30970a24 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:29:59.257781 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-8f2a5f2a-4d25-421f-a4e3-b12916dffb1e tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 0.9351873 Nov 09 04:29:59.260334 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54232) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:59.265909 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c309bd51-6418-4f97-862f-6c2fa834855a req-44de86fc-b176-485e-b445-12a1f714c7dc tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "GET /v2.0/security-groups?id=67cb2d36-e38c-4a29-adb5-c52b1d94ae99&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1716018 Nov 09 04:29:59.273551 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-3460f33a-c6c5-462b-ace2-bedf13ea4210 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsTest-test-network-656483111'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:59.279800 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.ipam_backend_mixin [None req-f9df9eb0-f6b6-4084-b86c-899d22f82025 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Performing IP validity checks on allocation pools {{(pid=102162) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:325}} Nov 09 04:29:59.279800 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.ipam_backend_mixin [None req-f9df9eb0-f6b6-4084-b86c-899d22f82025 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Checking for overlaps among allocation pools and gateway ip {{(pid=102162) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:346}} Nov 09 04:29:59.342293 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-5c0513c7-0ada-40a3-ab20-8e37e840b508 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Deleting port 2d3a49b2-8263-4114-bc47-99fe1cab5442 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:29:59.342569 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5c0513c7-0ada-40a3-ab20-8e37e840b508 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:59.349122 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-17bd835a-7bd0-4222-b8cd-770c085ca121 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 4a546e0a-7b29-4243-aab6-ce90674959a5) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:29:59.357609 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-19a44abf-dc5f-403d-907e-f6e96c904be0 None None] Network 4a546e0a-7b29-4243-aab6-ce90674959a5 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:29:59.365141 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-17bd835a-7bd0-4222-b8cd-770c085ca121 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:59.367254 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-17bd835a-7bd0-4222-b8cd-770c085ca121 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:59.371003 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3460f33a-c6c5-462b-ace2-bedf13ea4210 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Made reservation on behalf of 2f077d8d6e0c4af98a4ce8fbe06ce9d4 for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:29:59.374427 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3460f33a-c6c5-462b-ace2-bedf13ea4210 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:59.411935 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a174f5a5-8d6c-4616-97e8-cdda65280629 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks [] for router_gateway, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:59.449342 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3460f33a-c6c5-462b-ace2-bedf13ea4210 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 345} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:29:59.463376 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-71218ef0-5c69-463b-a80d-19438daea2b1 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Request body: {'router': {'name': 'tempest-RoutersAdminTest-router-767796685', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}, 'admin_state_up': False}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:59.482156 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-17bd835a-7bd0-4222-b8cd-770c085ca121 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 873 time: 2.7718189 Nov 09 04:29:59.483352 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3460f33a-c6c5-462b-ace2-bedf13ea4210 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:59.483691 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-3460f33a-c6c5-462b-ace2-bedf13ea4210 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Added segment c9067766-9d6f-474f-9b30-24ac4ea9f6a2 of type vlan for network 72286273-ea40-4989-bf4a-d67b2d8815b0 Nov 09 04:29:59.488731 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54234) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:59.522619 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5c0513c7-0ada-40a3-ab20-8e37e840b508 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:59.558263 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-db3097ad-36d3-4407-b597-b413f95e234a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-4a546e0a-7b29-4243-aab6-ce90674959a5', 'network_id': '4a546e0a-7b29-4243-aab6-ce90674959a5', 'tenant_id': '6761c80dbfa84798bb6517a9b532f870', 'fixed_ips': [{'subnet_id': '17925b38-b947-433f-a9f5-c6477a234b2f'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:29:59.559764 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-db3097ad-36d3-4407-b597-b413f95e234a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:59.573522 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3460f33a-c6c5-462b-ace2-bedf13ea4210 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:59.579390 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-5c0513c7-0ada-40a3-ab20-8e37e840b508 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Calling delete_port for 2d3a49b2-8263-4114-bc47-99fe1cab5442 owned by {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:29:59.635200 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f9df9eb0-f6b6-4084-b86c-899d22f82025 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:59.642429 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-71218ef0-5c69-463b-a80d-19438daea2b1 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:59.643413 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-71218ef0-5c69-463b-a80d-19438daea2b1 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:59.694986 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3460f33a-c6c5-462b-ace2-bedf13ea4210 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:59.698930 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-747c82e8-93cb-42ed-8942-d6a711cbf3a4 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:59.703330 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3460f33a-c6c5-462b-ace2-bedf13ea4210 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:29:59.703330 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3460f33a-c6c5-462b-ace2-bedf13ea4210 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:59.711301 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-db3097ad-36d3-4407-b597-b413f95e234a None None] Allocated IP 172.20.0.2 (4a546e0a-7b29-4243-aab6-ce90674959a5/17925b38-b947-433f-a9f5-c6477a234b2f/c812bcf3-8bd2-40c6-86ef-15b438452dd2) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:29:59.748135 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9df9eb0-f6b6-4084-b86c-899d22f82025 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Pushing event updated for resources: {'Subnet': ['ID=bfcb2be9-f2aa-4f0a-9e35-4e96a2dd46a7,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:59.789217 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f9df9eb0-f6b6-4084-b86c-899d22f82025 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Checking segment: {'id': 'f7804780-6a6e-45e4-b9d1-0469fe5dec5d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 343, 'network_id': '9680862a-d7ab-46b3-9eea-47dd24c9bfec'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:29:59.789581 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f9df9eb0-f6b6-4084-b86c-899d22f82025 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Network hostable DHCP agents. Network: 9680862a-d7ab-46b3-9eea-47dd24c9bfec, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:29:59.802572 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-71218ef0-5c69-463b-a80d-19438daea2b1 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:59.815365 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a174f5a5-8d6c-4616-97e8-cdda65280629 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-466202', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-464271', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-936'] for router, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:59.819191 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3460f33a-c6c5-462b-ace2-bedf13ea4210 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Pushing event updated for resources: {'Network': ['ID=72286273-ea40-4989-bf4a-d67b2d8815b0,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:29:59.826590 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-3460f33a-c6c5-462b-ace2-bedf13ea4210 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 785 time: 0.5569239 Nov 09 04:29:59.829353 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54236) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:29:59.831490 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-3baa0a73-9893-49e4-955f-d300cc25f7cd tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Request body: {'ports': [{'network_id': 'ca45084c-ecc9-45bb-847c-5b9e30970a24', 'name': 'tempest-port--80071716', 'admin_state_up': True}, {'network_id': '72286273-ea40-4989-bf4a-d67b2d8815b0', 'admin_state_up': False}]} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:59.831832 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-3baa0a73-9893-49e4-955f-d300cc25f7cd tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Request body: {'port': {'network_id': 'ca45084c-ecc9-45bb-847c-5b9e30970a24', 'name': 'tempest-port--80071716', 'admin_state_up': True}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:59.832316 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-3baa0a73-9893-49e4-955f-d300cc25f7cd tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Request body: {'port': {'network_id': '72286273-ea40-4989-bf4a-d67b2d8815b0', 'admin_state_up': False}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:29:59.835883 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a174f5a5-8d6c-4616-97e8-cdda65280629 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-466195', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-466408', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-464260'] for router, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:59.846281 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-747c82e8-93cb-42ed-8942-d6a711cbf3a4 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:59.875369 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 72286273-ea40-4989-bf4a-d67b2d8815b0 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:29:59.911174 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f9df9eb0-f6b6-4084-b86c-899d22f82025 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Network 9680862a-d7ab-46b3-9eea-47dd24c9bfec is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:29:59.948536 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5c0513c7-0ada-40a3-ab20-8e37e840b508 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:59.964331 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-db3097ad-36d3-4407-b597-b413f95e234a None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:29:59.996456 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-f9df9eb0-f6b6-4084-b86c-899d22f82025 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 9680862a-d7ab-46b3-9eea-47dd24c9bfec) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:00.000712 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c0513c7-0ada-40a3-ab20-8e37e840b508 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Pushing event deleted for resources: {'Port': ['ID=2d3a49b2-8263-4114-bc47-99fe1cab5442,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:00.005916 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f9df9eb0-f6b6-4084-b86c-899d22f82025 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:00.006746 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f9df9eb0-f6b6-4084-b86c-899d22f82025 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:00.010731 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-51d4bac4-78db-4383-9607-08bc39c5312e None None] Network 9680862a-d7ab-46b3-9eea-47dd24c9bfec requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:30:00.044268 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-db3097ad-36d3-4407-b597-b413f95e234a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:00.117071 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device a1b1ba13-9d9c-4bc5-8c09-5a9619df2802 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:30:00.122903 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5c0513c7-0ada-40a3-ab20-8e37e840b508 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:00.129656 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-5c0513c7-0ada-40a3-ab20-8e37e840b508 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] 10.222.0.24 "DELETE /v2.0/ports/2d3a49b2-8263-4114-bc47-99fe1cab5442 HTTP/1.1" status: 204 len: 168 time: 0.9768431 Nov 09 04:30:00.130521 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54238) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:00.136515 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-862383a4-4dd3-459f-8ddc-4795932e33d6 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Request body: {'port': {'name': 'tempest-new-port-name-1631648953', 'extra_dhcp_opts': [{'opt_value': 'pxelinux.0', 'opt_name': 'bootfile-name'}, {'opt_value': '123.123.123.123', 'opt_name': 'tftp-server'}, {'opt_value': '123.123.123.45', 'opt_name': 'server-ip-address'}]}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:00.136978 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.api.validators [None req-862383a4-4dd3-459f-8ddc-4795932e33d6 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] bootfile-name is not in valid_values {{(pid=102162) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Nov 09 04:30:00.137668 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.api.validators [None req-862383a4-4dd3-459f-8ddc-4795932e33d6 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] tftp-server is not in valid_values {{(pid=102162) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Nov 09 04:30:00.137668 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.api.validators [None req-862383a4-4dd3-459f-8ddc-4795932e33d6 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] server-ip-address is not in valid_values {{(pid=102162) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Nov 09 04:30:00.149854 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-f9df9eb0-f6b6-4084-b86c-899d22f82025 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 895 time: 1.2883012 Nov 09 04:30:00.170035 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-db3097ad-36d3-4407-b597-b413f95e234a None None] Network 4a546e0a-7b29-4243-aab6-ce90674959a5 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:30:00.178098 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54242) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:00.190149 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-5f893d81-a742-4e7f-86f0-f9a58643cdee tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Request body: {'subnet': {'name': 'New_subnet', 'host_routes': [{'destination': '2001::/64', 'nexthop': '2005::1'}], 'dns_nameservers': ['2001:4860:4860::7744', '2001:4860:4860::7888'], 'gateway_ip': '2001:db8::2', 'enable_dhcp': True}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:00.214788 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-db3097ad-36d3-4407-b597-b413f95e234a None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:00.229491 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-db3097ad-36d3-4407-b597-b413f95e234a None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:30:00.234822 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db3097ad-36d3-4407-b597-b413f95e234a None None] Pushing event updated for resources: {'Port': ['ID=c812bcf3-8bd2-40c6-86ef-15b438452dd2,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:00.247576 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-747c82e8-93cb-42ed-8942-d6a711cbf3a4 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:00.282239 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4a8d013-a84a-42ac-881a-25500c24d1ac req-d8d01da0-9bd8-411b-9a2a-c3cf50195dfb tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:00.283858 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e4a8d013-a84a-42ac-881a-25500c24d1ac req-d8d01da0-9bd8-411b-9a2a-c3cf50195dfb tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.26 "GET /v2.0/ports?device_id=1aa3bc74-67df-4706-979b-cbf709855232 HTTP/1.1" status: 200 len: 945 time: 0.2000713 Nov 09 04:30:00.366593 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-747c82e8-93cb-42ed-8942-d6a711cbf3a4 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event deleted for resources: {'Subnet': ['ID=17925b38-b947-433f-a9f5-c6477a234b2f,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:00.383769 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-db3097ad-36d3-4407-b597-b413f95e234a None None] Attempting to bind port c812bcf3-8bd2-40c6-86ef-15b438452dd2 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:30:00.384248 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-db3097ad-36d3-4407-b597-b413f95e234a None None] Attempting to bind port c812bcf3-8bd2-40c6-86ef-15b438452dd2 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '6228cfb2-4f9f-4492-a6e4-baed1761b32c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 337, 'network_id': '4a546e0a-7b29-4243-aab6-ce90674959a5'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:30:00.384484 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-db3097ad-36d3-4407-b597-b413f95e234a None None] Attempting to bind port c812bcf3-8bd2-40c6-86ef-15b438452dd2 on network 4a546e0a-7b29-4243-aab6-ce90674959a5 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:30:00.406378 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port a1b1ba13-9d9c-4bc5-8c09-5a9619df2802 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:30:00.406677 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:00.409875 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-db3097ad-36d3-4407-b597-b413f95e234a None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 29, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:30:00.410255 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-db3097ad-36d3-4407-b597-b413f95e234a None None] Checking segment: {'id': '6228cfb2-4f9f-4492-a6e4-baed1761b32c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 337, 'network_id': '4a546e0a-7b29-4243-aab6-ce90674959a5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:30:00.410653 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-db3097ad-36d3-4407-b597-b413f95e234a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:00.411034 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-db3097ad-36d3-4407-b597-b413f95e234a None None] Bound using segment: {'id': '6228cfb2-4f9f-4492-a6e4-baed1761b32c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 337, 'network_id': '4a546e0a-7b29-4243-aab6-ce90674959a5'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:30:00.411516 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-db3097ad-36d3-4407-b597-b413f95e234a None None] Bound port: c812bcf3-8bd2-40c6-86ef-15b438452dd2, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6228cfb2-4f9f-4492-a6e4-baed1761b32c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 337, 'network_id': '4a546e0a-7b29-4243-aab6-ce90674959a5'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:30:00.411895 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-db3097ad-36d3-4407-b597-b413f95e234a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:00.429133 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-736d36de-79e4-4133-966a-d3a3e79e200b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-9680862a-d7ab-46b3-9eea-47dd24c9bfec', 'network_id': '9680862a-d7ab-46b3-9eea-47dd24c9bfec', 'tenant_id': '83cbb798c0f44b268f8acd2a70eb745a', 'fixed_ips': [{'subnet_id': 'bfcb2be9-f2aa-4f0a-9e35-4e96a2dd46a7'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:30:00.429962 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-736d36de-79e4-4133-966a-d3a3e79e200b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:00.481088 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-862383a4-4dd3-459f-8ddc-4795932e33d6 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:00.560996 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-747c82e8-93cb-42ed-8942-d6a711cbf3a4 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:00.587364 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30b74182-8d62-48c8-9439-5b8fbb5cfee4 req-6ca664e7-107b-4542-b9cf-16bab5af9b1a tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:00.588891 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-30b74182-8d62-48c8-9439-5b8fbb5cfee4 req-6ca664e7-107b-4542-b9cf-16bab5af9b1a tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.24 "GET /v2.0/ports?device_id=1aa3bc74-67df-4706-979b-cbf709855232 HTTP/1.1" status: 200 len: 945 time: 0.3334110 Nov 09 04:30:00.603095 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5f893d81-a742-4e7f-86f0-f9a58643cdee tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_update-5794779'] for subnet, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:00.618465 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-db3097ad-36d3-4407-b597-b413f95e234a None None] For port c812bcf3-8bd2-40c6-86ef-15b438452dd2, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:30:00.638403 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-747c82e8-93cb-42ed-8942-d6a711cbf3a4 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4a546e0a-7b29-4243-aab6-ce90674959a5']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:00.646276 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-db3097ad-36d3-4407-b597-b413f95e234a None None] For port c812bcf3-8bd2-40c6-86ef-15b438452dd2, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=c812bcf3-8bd2-40c6-86ef-15b438452dd2,segment=NetworkSegment(6228cfb2-4f9f-4492-a6e4-baed1761b32c),segment_id=6228cfb2-4f9f-4492-a6e4-baed1761b32c)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:30:00.654852 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-71218ef0-5c69-463b-a80d-19438daea2b1 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:00.674169 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-747c82e8-93cb-42ed-8942-d6a711cbf3a4 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6228cfb2-4f9f-4492-a6e4-baed1761b32c') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:00.674441 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-747c82e8-93cb-42ed-8942-d6a711cbf3a4 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6228cfb2-4f9f-4492-a6e4-baed1761b32c') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:00.714744 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1174f33b-4e06-40ab-927d-7396f80aa82d req-db472e46-0be8-461f-b577-73a7bc8ef596 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:00.716432 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-1174f33b-4e06-40ab-927d-7396f80aa82d req-db472e46-0be8-461f-b577-73a7bc8ef596 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.26 "GET /v2.0/ports?device_id=fd8e39fc-699b-4777-aae4-ca592a898437 HTTP/1.1" status: 200 len: 945 time: 0.2066638 Nov 09 04:30:00.718885 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-747c82e8-93cb-42ed-8942-d6a711cbf3a4 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:00.728533 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-216664b4-cdc2-4993-a4a0-dee02fad0856 req-bcf94ea8-712d-42f4-af62-ddfd23185c8d tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:00.735485 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-216664b4-cdc2-4993-a4a0-dee02fad0856 req-bcf94ea8-712d-42f4-af62-ddfd23185c8d tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "GET /v2.0/ports?device_id=fd8e39fc-699b-4777-aae4-ca592a898437 HTTP/1.1" status: 200 len: 945 time: 0.1939609 Nov 09 04:30:00.779177 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-e4a8d013-a84a-42ac-881a-25500c24d1ac req-c6ec32e4-9c78-4e79-b8d6-eea56b29243e tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Deleting port 49694ee4-edfa-4a08-be0b-8bfa9b06128b {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:30:00.779485 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-e4a8d013-a84a-42ac-881a-25500c24d1ac req-c6ec32e4-9c78-4e79-b8d6-eea56b29243e tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:00.785515 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-747c82e8-93cb-42ed-8942-d6a711cbf3a4 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:00.798589 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-30b74182-8d62-48c8-9439-5b8fbb5cfee4 req-818a5397-9093-4ff4-956c-7c87b8e65fbd tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.24 "GET /v2.0/security-groups?id=4b002f37-f4ce-4d8a-a894-560955e72139&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1970460 Nov 09 04:30:00.815760 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3baa0a73-9893-49e4-955f-d300cc25f7cd tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Made reservation on behalf of 2f077d8d6e0c4af98a4ce8fbe06ce9d4 for: {'port': 2} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:30:00.820456 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3baa0a73-9893-49e4-955f-d300cc25f7cd tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:00.829305 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-db3097ad-36d3-4407-b597-b413f95e234a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:00.863010 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-747c82e8-93cb-42ed-8942-d6a711cbf3a4 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Releasing vlan 337 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:30:00.863526 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-747c82e8-93cb-42ed-8942-d6a711cbf3a4 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:00.867034 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:30:00.867034 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:30:00.867034 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:30:00.867034 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:30:00.867034 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:30:00.867034 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:30:00.867034 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:30:00.867034 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:30:00.867034 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:30:00.867034 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:30:00.867034 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:30:00.867034 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:30:00.867034 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:30:00.867034 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:30:00.867034 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:30:00.867034 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:30:00.867034 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:30:00.867034 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:30:00.867034 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:30:00.867034 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:30:00.867034 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:30:00.867034 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:30:00.867034 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:30:00.867034 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:30:00.867034 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:30:00.867034 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:30:00.867034 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:30:00.867034 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:30:00.867034 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:30:00.867034 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:30:00.867034 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:30:00.867034 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:30:00.870072 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3baa0a73-9893-49e4-955f-d300cc25f7cd tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:00.882208 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-736d36de-79e4-4133-966a-d3a3e79e200b None None] Allocated IP 2001:db8::3 (9680862a-d7ab-46b3-9eea-47dd24c9bfec/bfcb2be9-f2aa-4f0a-9e35-4e96a2dd46a7/ea2582be-a56b-44b1-98b4-9a334c134a75) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:30:00.943349 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db3097ad-36d3-4407-b597-b413f95e234a None None] Pushing event updated for resources: {'Port': ['ID=c812bcf3-8bd2-40c6-86ef-15b438452dd2,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:00.964161 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-216664b4-cdc2-4993-a4a0-dee02fad0856 req-05faebec-a2bc-49da-80a7-e148861b0a58 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "GET /v2.0/security-groups?id=67cb2d36-e38c-4a29-adb5-c52b1d94ae99&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2245197 Nov 09 04:30:00.964780 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a174f5a5-8d6c-4616-97e8-cdda65280629 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Router bac0f9e1-4e8b-4938-b8b0-48cbafecf6cd is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102161) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:30:01.000802 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a755eb30-5756-45c3-ba96-75b61bc5fd33 None None] Network 4a546e0a-7b29-4243-aab6-ce90674959a5 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:30:01.051377 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.db.api [None req-747c82e8-93cb-42ed-8942-d6a711cbf3a4 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Nov 09 04:30:01.051377 dv-neutron-816802-2-hyperv neutron-server[102162]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Nov 09 04:30:01.051377 dv-neutron-816802-2-hyperv neutron-server[102162]: [parameters: {'id': '4a546e0a-7b29-4243-aab6-ce90674959a5'}] Nov 09 04:30:01.051377 dv-neutron-816802-2-hyperv neutron-server[102162]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=102162) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:30:01.052055 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG oslo_db.api [None req-747c82e8-93cb-42ed-8942-d6a711cbf3a4 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:30:01.056565 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-e4a8d013-a84a-42ac-881a-25500c24d1ac req-c6ec32e4-9c78-4e79-b8d6-eea56b29243e tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] For port 49694ee4-edfa-4a08-be0b-8bfa9b06128b, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=49694ee4-edfa-4a08-be0b-8bfa9b06128b,segment=NetworkSegment(efe0485f-d48f-4307-b89a-0bcb86aaf1c2),segment_id=efe0485f-d48f-4307-b89a-0bcb86aaf1c2)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:30:01.056800 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-e4a8d013-a84a-42ac-881a-25500c24d1ac req-c6ec32e4-9c78-4e79-b8d6-eea56b29243e tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:01.070008 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [None req-3baa0a73-9893-49e4-955f-d300cc25f7cd tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] device_id is not set on port 98905f03-f8ab-4421-b0d5-3cb1e3f4d7da yet. {{(pid=102161) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:30:01.143780 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-862383a4-4dd3-459f-8ddc-4795932e33d6 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:01.157326 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [req-1174f33b-4e06-40ab-927d-7396f80aa82d req-33653a60-aa49-4b8b-a6f6-b70461219314 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Deleting port 9ce4bb36-a0c7-4517-abaf-8db99ca3bb12 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:30:01.157673 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [req-1174f33b-4e06-40ab-927d-7396f80aa82d req-33653a60-aa49-4b8b-a6f6-b70461219314 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:01.185991 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-736d36de-79e4-4133-966a-d3a3e79e200b None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:01.228976 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-862383a4-4dd3-459f-8ddc-4795932e33d6 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:01.257243 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-736d36de-79e4-4133-966a-d3a3e79e200b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:01.312140 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-736d36de-79e4-4133-966a-d3a3e79e200b None None] Network 9680862a-d7ab-46b3-9eea-47dd24c9bfec is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:30:01.319130 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a174f5a5-8d6c-4616-97e8-cdda65280629 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:30:01.323183 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-736d36de-79e4-4133-966a-d3a3e79e200b None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:01.325857 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-736d36de-79e4-4133-966a-d3a3e79e200b None None] Pushing event updated for resources: {'Port': ['ID=ea2582be-a56b-44b1-98b4-9a334c134a75,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:01.328199 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a174f5a5-8d6c-4616-97e8-cdda65280629 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:01.332903 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a174f5a5-8d6c-4616-97e8-cdda65280629 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] 10.222.0.24 "PUT /v2.0/routers/bac0f9e1-4e8b-4938-b8b0-48cbafecf6cd HTTP/1.1" status: 200 len: 882 time: 6.5464597 Nov 09 04:30:01.334822 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-736d36de-79e4-4133-966a-d3a3e79e200b None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:30:01.336157 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54246) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:01.342398 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e9e03b25-168f-43d2-bbfe-b6025b1f7a3e None None] Sync routers for ids ['bac0f9e1-4e8b-4938-b8b0-48cbafecf6cd'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:30:01.360982 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e9e03b25-168f-43d2-bbfe-b6025b1f7a3e None None] Routers {'bac0f9e1-4e8b-4938-b8b0-48cbafecf6cd'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:30:01.363422 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-e9e03b25-168f-43d2-bbfe-b6025b1f7a3e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:29:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['bac0f9e1-4e8b-4938-b8b0-48cbafecf6cd'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:01.411714 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-e9e03b25-168f-43d2-bbfe-b6025b1f7a3e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:01.429713 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e9e03b25-168f-43d2-bbfe-b6025b1f7a3e None None] Routers {'bac0f9e1-4e8b-4938-b8b0-48cbafecf6cd'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:30:01.430639 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-e9e03b25-168f-43d2-bbfe-b6025b1f7a3e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:29:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['bac0f9e1-4e8b-4938-b8b0-48cbafecf6cd'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:01.463573 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-736d36de-79e4-4133-966a-d3a3e79e200b None None] Attempting to bind port ea2582be-a56b-44b1-98b4-9a334c134a75 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:30:01.464202 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-736d36de-79e4-4133-966a-d3a3e79e200b None None] Attempting to bind port ea2582be-a56b-44b1-98b4-9a334c134a75 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'f7804780-6a6e-45e4-b9d1-0469fe5dec5d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 343, 'network_id': '9680862a-d7ab-46b3-9eea-47dd24c9bfec'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:30:01.464746 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-736d36de-79e4-4133-966a-d3a3e79e200b None None] Attempting to bind port ea2582be-a56b-44b1-98b4-9a334c134a75 on network 9680862a-d7ab-46b3-9eea-47dd24c9bfec {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:30:01.473674 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-736d36de-79e4-4133-966a-d3a3e79e200b None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 29, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:30:01.474423 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-736d36de-79e4-4133-966a-d3a3e79e200b None None] Checking segment: {'id': 'f7804780-6a6e-45e4-b9d1-0469fe5dec5d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 343, 'network_id': '9680862a-d7ab-46b3-9eea-47dd24c9bfec'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:30:01.475527 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-736d36de-79e4-4133-966a-d3a3e79e200b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:01.476156 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-736d36de-79e4-4133-966a-d3a3e79e200b None None] Bound using segment: {'id': 'f7804780-6a6e-45e4-b9d1-0469fe5dec5d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 343, 'network_id': '9680862a-d7ab-46b3-9eea-47dd24c9bfec'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:30:01.476794 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-736d36de-79e4-4133-966a-d3a3e79e200b None None] Bound port: ea2582be-a56b-44b1-98b4-9a334c134a75, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f7804780-6a6e-45e4-b9d1-0469fe5dec5d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 343, 'network_id': '9680862a-d7ab-46b3-9eea-47dd24c9bfec'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:30:01.479367 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-736d36de-79e4-4133-966a-d3a3e79e200b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:01.484227 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-e9e03b25-168f-43d2-bbfe-b6025b1f7a3e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:01.484888 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e9e03b25-168f-43d2-bbfe-b6025b1f7a3e None None] The sync data for ids ['bac0f9e1-4e8b-4938-b8b0-48cbafecf6cd'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:30:01.569195 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-736d36de-79e4-4133-966a-d3a3e79e200b None None] For port ea2582be-a56b-44b1-98b4-9a334c134a75, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:30:01.573798 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-736d36de-79e4-4133-966a-d3a3e79e200b None None] For port ea2582be-a56b-44b1-98b4-9a334c134a75, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=ea2582be-a56b-44b1-98b4-9a334c134a75,segment=NetworkSegment(f7804780-6a6e-45e4-b9d1-0469fe5dec5d),segment_id=f7804780-6a6e-45e4-b9d1-0469fe5dec5d)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:30:01.622399 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-f6b33dd8-3fe3-4a23-b8a1-890477e13cca None None] Provisioning complete for port 1422f05c-c9c5-470c-b800-a079cd4d4962 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:30:01.622399 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f6b33dd8-3fe3-4a23-b8a1-890477e13cca None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:01.625281 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3baa0a73-9893-49e4-955f-d300cc25f7cd tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:01.641620 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-71218ef0-5c69-463b-a80d-19438daea2b1 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks [] for router_gateway, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:01.651248 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [req-1174f33b-4e06-40ab-927d-7396f80aa82d req-33653a60-aa49-4b8b-a6f6-b70461219314 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] For port 9ce4bb36-a0c7-4517-abaf-8db99ca3bb12, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=9ce4bb36-a0c7-4517-abaf-8db99ca3bb12,segment=NetworkSegment(9b34c07b-e9e3-4439-982a-e160009938cf),segment_id=9b34c07b-e9e3-4439-982a-e160009938cf)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:30:01.651510 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-747c82e8-93cb-42ed-8942-d6a711cbf3a4 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:01.651996 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [req-1174f33b-4e06-40ab-927d-7396f80aa82d req-33653a60-aa49-4b8b-a6f6-b70461219314 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:01.665944 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-f6b33dd8-3fe3-4a23-b8a1-890477e13cca None None] Port 1422f05c-c9c5-470c-b800-a079cd4d4962 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:30:01.668097 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-736d36de-79e4-4133-966a-d3a3e79e200b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:01.688217 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-71218ef0-5c69-463b-a80d-19438daea2b1 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:01.731046 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-862383a4-4dd3-459f-8ddc-4795932e33d6 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Pushing event updated for resources: {'Port': ['ID=1422f05c-c9c5-470c-b800-a079cd4d4962,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:01.744753 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-736d36de-79e4-4133-966a-d3a3e79e200b None None] Pushing event updated for resources: {'Port': ['ID=ea2582be-a56b-44b1-98b4-9a334c134a75,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:01.805858 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-862383a4-4dd3-459f-8ddc-4795932e33d6 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] In _notify_port_updated(), no bound segment for port 1422f05c-c9c5-470c-b800-a079cd4d4962 on network 6b78e150-9412-4145-a432-680e4456364c {{(pid=102162) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 09 04:30:01.812951 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-862383a4-4dd3-459f-8ddc-4795932e33d6 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:01.813582 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-862383a4-4dd3-459f-8ddc-4795932e33d6 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:01.818819 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-862383a4-4dd3-459f-8ddc-4795932e33d6 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] 10.222.0.24 "PUT /v2.0/ports/1422f05c-c9c5-470c-b800-a079cd4d4962 HTTP/1.1" status: 200 len: 1136 time: 1.6872780 Nov 09 04:30:01.821703 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54250) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:01.823928 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-e4a8d013-a84a-42ac-881a-25500c24d1ac req-c6ec32e4-9c78-4e79-b8d6-eea56b29243e tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:01.824291 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-e4a8d013-a84a-42ac-881a-25500c24d1ac req-c6ec32e4-9c78-4e79-b8d6-eea56b29243e tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:01.824612 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.l3_db [req-e4a8d013-a84a-42ac-881a-25500c24d1ac req-c6ec32e4-9c78-4e79-b8d6-eea56b29243e tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Floating IP 00824cf7-be58-475c-a1dc-142d27e3cda6 disassociated. External IP: 172.26.0.35, port: 49694ee4-edfa-4a08-be0b-8bfa9b06128b. Nov 09 04:30:01.825038 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-e4a8d013-a84a-42ac-881a-25500c24d1ac req-c6ec32e4-9c78-4e79-b8d6-eea56b29243e tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Calling delete_port for 49694ee4-edfa-4a08-be0b-8bfa9b06128b owned by compute:nova {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:30:01.839697 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-69dd172a-31f7-4210-bdae-5de51f9b9caf tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] 10.222.0.24 "GET /v2.0/routers/bac0f9e1-4e8b-4938-b8b0-48cbafecf6cd HTTP/1.1" status: 200 len: 923 time: 0.4978571 Nov 09 04:30:01.851084 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [None req-3baa0a73-9893-49e4-955f-d300cc25f7cd tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] device_id is not set on port 2823e6dd-4131-49b8-8603-11ac168db9e5 yet. {{(pid=102161) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:30:01.862848 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54252) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:02.042072 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-189b35d9-c5bf-4e4f-a30d-6e79dd2e0598 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:02.047815 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-189b35d9-c5bf-4e4f-a30d-6e79dd2e0598 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] 10.222.0.24 "GET /v2.0/ports/1422f05c-c9c5-470c-b800-a079cd4d4962 HTTP/1.1" status: 200 len: 1136 time: 0.2196672 Nov 09 04:30:02.053867 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54256) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:02.223584 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4c36c32-6e92-4ea2-adcc-245f43f264c9 req-ee68051b-3381-4034-b0e4-86cb01d1eebc tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:02.225243 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f4c36c32-6e92-4ea2-adcc-245f43f264c9 req-ee68051b-3381-4034-b0e4-86cb01d1eebc tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.24 "GET /v2.0/ports?device_id=1aa3bc74-67df-4706-979b-cbf709855232 HTTP/1.1" status: 200 len: 945 time: 0.3155022 Nov 09 04:30:02.259075 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-747c82e8-93cb-42ed-8942-d6a711cbf3a4 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Deleting port c812bcf3-8bd2-40c6-86ef-15b438452dd2 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:30:02.259488 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-747c82e8-93cb-42ed-8942-d6a711cbf3a4 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:02.266795 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7fe64450-4711-4ac8-8d0e-83390fa7e1cc tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:02.268522 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-7fe64450-4711-4ac8-8d0e-83390fa7e1cc tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] 10.222.0.24 "GET /v2.0/ports?network_id=2b6725f5-ebfe-485a-8f42-ccb5a241ddb5&device_id=bac0f9e1-4e8b-4938-b8b0-48cbafecf6cd&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 944 time: 0.3615623 Nov 09 04:30:02.283321 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54258) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:02.298380 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-71218ef0-5c69-463b-a80d-19438daea2b1 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Allocated IP 172.26.0.229 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/33f4adf6-1014-4635-a602-f043b882a9ea) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:30:02.372380 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5f893d81-a742-4e7f-86f0-f9a58643cdee tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8756747267211', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_updated-5729887'] for subnet, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:02.389819 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fc69e71-6e17-4312-94c0-8c7d7e59df43 req-8b5220c1-bd19-4825-b12d-4b5c54169c82 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:02.391434 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-8fc69e71-6e17-4312-94c0-8c7d7e59df43 req-8b5220c1-bd19-4825-b12d-4b5c54169c82 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "GET /v2.0/ports?device_id=fd8e39fc-699b-4777-aae4-ca592a898437 HTTP/1.1" status: 200 len: 945 time: 0.3201120 Nov 09 04:30:02.501173 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-747c82e8-93cb-42ed-8942-d6a711cbf3a4 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] For port c812bcf3-8bd2-40c6-86ef-15b438452dd2, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=c812bcf3-8bd2-40c6-86ef-15b438452dd2,segment=NetworkSegment(6228cfb2-4f9f-4492-a6e4-baed1761b32c),segment_id=6228cfb2-4f9f-4492-a6e4-baed1761b32c)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:30:02.501646 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-747c82e8-93cb-42ed-8942-d6a711cbf3a4 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:02.552179 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5f893d81-a742-4e7f-86f0-f9a58643cdee tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:02.552857 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5f893d81-a742-4e7f-86f0-f9a58643cdee tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:02.571680 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-5f893d81-a742-4e7f-86f0-f9a58643cdee tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "PUT /v2.0/subnets/bfcb2be9-f2aa-4f0a-9e35-4e96a2dd46a7 HTTP/1.1" status: 200 len: 900 time: 2.3741958 Nov 09 04:30:02.572015 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54260) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:02.572101 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-747c82e8-93cb-42ed-8942-d6a711cbf3a4 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Calling delete_port for c812bcf3-8bd2-40c6-86ef-15b438452dd2 owned by network:dhcp {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:30:02.572101 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f4c36c32-6e92-4ea2-adcc-245f43f264c9 req-e911333d-cd01-4c47-8b95-e03b00db8fc2 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.24 "GET /v2.0/security-groups?id=4b002f37-f4ce-4d8a-a894-560955e72139&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3111570 Nov 09 04:30:02.603581 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-8fc69e71-6e17-4312-94c0-8c7d7e59df43 req-61f966fa-d6ea-4d58-a7bc-1006af90ef36 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "GET /v2.0/security-groups?id=67cb2d36-e38c-4a29-adb5-c52b1d94ae99&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1913815 Nov 09 04:30:02.609541 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f893d81-a742-4e7f-86f0-f9a58643cdee tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Pushing event updated for resources: {'Subnet': ['ID=bfcb2be9-f2aa-4f0a-9e35-4e96a2dd46a7,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:02.651537 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-cc3c96f1-b45f-4072-8920-f59ad09afe8c tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Deleting port 1422f05c-c9c5-470c-b800-a079cd4d4962 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:30:02.651537 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cc3c96f1-b45f-4072-8920-f59ad09afe8c tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:02.654965 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [req-1174f33b-4e06-40ab-927d-7396f80aa82d req-33653a60-aa49-4b8b-a6f6-b70461219314 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:02.655338 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [req-1174f33b-4e06-40ab-927d-7396f80aa82d req-33653a60-aa49-4b8b-a6f6-b70461219314 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:02.655656 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.l3_db [req-1174f33b-4e06-40ab-927d-7396f80aa82d req-33653a60-aa49-4b8b-a6f6-b70461219314 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Floating IP b6e50ee2-5399-49fe-a1c4-7571e8730316 disassociated. External IP: 172.26.0.237, port: 9ce4bb36-a0c7-4517-abaf-8db99ca3bb12. Nov 09 04:30:02.656010 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [req-1174f33b-4e06-40ab-927d-7396f80aa82d req-33653a60-aa49-4b8b-a6f6-b70461219314 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Calling delete_port for 9ce4bb36-a0c7-4517-abaf-8db99ca3bb12 owned by compute:nova {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:30:02.677962 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-e4a8d013-a84a-42ac-881a-25500c24d1ac req-c6ec32e4-9c78-4e79-b8d6-eea56b29243e tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:02.695973 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3baa0a73-9893-49e4-955f-d300cc25f7cd tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:02.729041 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-71218ef0-5c69-463b-a80d-19438daea2b1 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:02.758920 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-028ca749-8589-4973-8a6e-8db2bc3a597b tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:02.760536 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-028ca749-8589-4973-8a6e-8db2bc3a597b tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] 10.222.0.24 "GET /v2.0/networks/2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 HTTP/1.1" status: 200 len: 881 time: 0.4664168 Nov 09 04:30:02.778690 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54262) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:02.805164 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6ec32e4-9c78-4e79-b8d6-eea56b29243e tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Pushing event deleted for resources: {'Port': ['ID=49694ee4-edfa-4a08-be0b-8bfa9b06128b,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:02.830279 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-424c6455-9dc8-437d-b5fb-a4888ddaff83 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] 10.222.0.24 "GET /v2.0/ports?device_id=bac0f9e1-4e8b-4938-b8b0-48cbafecf6cd HTTP/1.1" status: 200 len: 205 time: 0.0507574 Nov 09 04:30:02.833132 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54264) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:02.842050 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3367cd93-7c2c-4567-a9a0-4e6fc18d78f3 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:02.858988 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cc3c96f1-b45f-4072-8920-f59ad09afe8c tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:02.951947 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3baa0a73-9893-49e4-955f-d300cc25f7cd tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:03.003336 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-71218ef0-5c69-463b-a80d-19438daea2b1 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:03.018225 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b5ba0559-956a-4c14-9baa-6323701420ac None None] Network 9680862a-d7ab-46b3-9eea-47dd24c9bfec requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:30:03.036510 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [req-e4a8d013-a84a-42ac-881a-25500c24d1ac req-c6ec32e4-9c78-4e79-b8d6-eea56b29243e tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Router 23955a4a-3903-49e9-ab99-5e003c83c868 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:30:03.039027 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-cc3c96f1-b45f-4072-8920-f59ad09afe8c tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Calling delete_port for 1422f05c-c9c5-470c-b800-a079cd4d4962 owned by {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:30:03.103745 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-747c82e8-93cb-42ed-8942-d6a711cbf3a4 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:03.112564 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-3367cd93-7c2c-4567-a9a0-4e6fc18d78f3 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Deleting port ea2582be-a56b-44b1-98b4-9a334c134a75 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:30:03.112955 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3367cd93-7c2c-4567-a9a0-4e6fc18d78f3 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:03.148534 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-c53145db-289d-4854-9281-af5e774874c4 None None] Provisioning complete for port ea2582be-a56b-44b1-98b4-9a334c134a75 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:30:03.149114 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c53145db-289d-4854-9281-af5e774874c4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:03.154636 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-747c82e8-93cb-42ed-8942-d6a711cbf3a4 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] No DVR routers for this DVR port c812bcf3-8bd2-40c6-86ef-15b438452dd2 on host dv-neutron-816802-2-hyperv {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:30:03.217932 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3baa0a73-9893-49e4-955f-d300cc25f7cd tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Checking segment: {'id': 'f24b880e-7cbf-4acc-8973-0cb4a4a0d612', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 331, 'network_id': 'ca45084c-ecc9-45bb-847c-5b9e30970a24'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:30:03.218489 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3baa0a73-9893-49e4-955f-d300cc25f7cd tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Network hostable DHCP agents. Network: ca45084c-ecc9-45bb-847c-5b9e30970a24, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:30:03.229839 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3baa0a73-9893-49e4-955f-d300cc25f7cd tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Pushing event updated for resources: {'Port': ['ID=98905f03-f8ab-4421-b0d5-3cb1e3f4d7da,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:03.239228 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-71218ef0-5c69-463b-a80d-19438daea2b1 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:30:03.248736 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-747c82e8-93cb-42ed-8942-d6a711cbf3a4 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event deleted for resources: {'Port': ['ID=c812bcf3-8bd2-40c6-86ef-15b438452dd2,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:03.291803 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71218ef0-5c69-463b-a80d-19438daea2b1 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Pushing event updated for resources: {'Port': ['ID=33f4adf6-1014-4635-a602-f043b882a9ea,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:03.298166 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-71218ef0-5c69-463b-a80d-19438daea2b1 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:03.305011 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [req-1174f33b-4e06-40ab-927d-7396f80aa82d req-33653a60-aa49-4b8b-a6f6-b70461219314 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:03.310490 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-71218ef0-5c69-463b-a80d-19438daea2b1 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:30:03.322202 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c53145db-289d-4854-9281-af5e774874c4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:03.370760 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-747c82e8-93cb-42ed-8942-d6a711cbf3a4 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:03.371902 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33653a60-aa49-4b8b-a6f6-b70461219314 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Pushing event deleted for resources: {'Port': ['ID=9ce4bb36-a0c7-4517-abaf-8db99ca3bb12,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:03.383636 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3baa0a73-9893-49e4-955f-d300cc25f7cd tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Network ca45084c-ecc9-45bb-847c-5b9e30970a24 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:30:03.402948 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-747c82e8-93cb-42ed-8942-d6a711cbf3a4 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4a546e0a-7b29-4243-aab6-ce90674959a5']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:03.407395 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-c53145db-289d-4854-9281-af5e774874c4 None None] For port ea2582be-a56b-44b1-98b4-9a334c134a75, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=ea2582be-a56b-44b1-98b4-9a334c134a75,segment=NetworkSegment(f7804780-6a6e-45e4-b9d1-0469fe5dec5d),segment_id=f7804780-6a6e-45e4-b9d1-0469fe5dec5d)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:30:03.422863 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-747c82e8-93cb-42ed-8942-d6a711cbf3a4 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6228cfb2-4f9f-4492-a6e4-baed1761b32c') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:03.427889 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-747c82e8-93cb-42ed-8942-d6a711cbf3a4 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6228cfb2-4f9f-4492-a6e4-baed1761b32c') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:03.439754 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-747c82e8-93cb-42ed-8942-d6a711cbf3a4 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:03.450668 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-3367cd93-7c2c-4567-a9a0-4e6fc18d78f3 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] For port ea2582be-a56b-44b1-98b4-9a334c134a75, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=ea2582be-a56b-44b1-98b4-9a334c134a75,segment=NetworkSegment(f7804780-6a6e-45e4-b9d1-0469fe5dec5d),segment_id=f7804780-6a6e-45e4-b9d1-0469fe5dec5d)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:30:03.451149 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3367cd93-7c2c-4567-a9a0-4e6fc18d78f3 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:03.453635 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-3baa0a73-9893-49e4-955f-d300cc25f7cd tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, ca45084c-ecc9-45bb-847c-5b9e30970a24) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:03.467681 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f0e5655b-506d-40a5-8fde-2bcbb4e842d5 None None] Network ca45084c-ecc9-45bb-847c-5b9e30970a24 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:30:03.471000 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3baa0a73-9893-49e4-955f-d300cc25f7cd tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:30:03.472011 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3baa0a73-9893-49e4-955f-d300cc25f7cd tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:03.493572 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c53145db-289d-4854-9281-af5e774874c4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:03.496482 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-3367cd93-7c2c-4567-a9a0-4e6fc18d78f3 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Calling delete_port for ea2582be-a56b-44b1-98b4-9a334c134a75 owned by network:dhcp {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:30:03.502883 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1635985f-bf60-4a62-b16c-5db980ddf4a7 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks [] for router, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:03.565072 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-747c82e8-93cb-42ed-8942-d6a711cbf3a4 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:03.579388 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-747c82e8-93cb-42ed-8942-d6a711cbf3a4 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Releasing vlan 337 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:30:03.579775 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-747c82e8-93cb-42ed-8942-d6a711cbf3a4 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:03.587902 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:30:03.587902 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:30:03.587902 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:30:03.587902 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:30:03.587902 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:30:03.587902 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:30:03.587902 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:30:03.587902 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:30:03.587902 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:30:03.587902 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:30:03.587902 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:30:03.587902 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:30:03.587902 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:30:03.587902 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:30:03.587902 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:30:03.587902 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:30:03.587902 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:30:03.587902 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:30:03.587902 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:30:03.587902 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:30:03.587902 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:30:03.587902 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:30:03.587902 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:30:03.587902 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:30:03.587902 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:30:03.587902 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:30:03.587902 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:30:03.587902 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:30:03.587902 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:30:03.587902 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:30:03.587902 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:30:03.587902 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:30:03.593440 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-24fc983a-62e0-43db-91df-0dd1b19d14d8 None None] Network 9680862a-d7ab-46b3-9eea-47dd24c9bfec requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:30:03.705395 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-32ce7936-19e0-4fde-9cff-724030e0c2e0 None None] Provisioning complete for port ea2582be-a56b-44b1-98b4-9a334c134a75 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:30:03.705903 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-32ce7936-19e0-4fde-9cff-724030e0c2e0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:03.719697 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [req-1174f33b-4e06-40ab-927d-7396f80aa82d req-33653a60-aa49-4b8b-a6f6-b70461219314 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Router c9d2cce0-31ab-42c3-ac82-14e36499c28f has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:30:03.751037 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-39b1622f-b293-4514-8ac3-849272f3a31d req-d3bb0dff-ef39-4888-ac5a-638bf9220170 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.24 "GET /v2.0/ports?device_id=1aa3bc74-67df-4706-979b-cbf709855232 HTTP/1.1" status: 200 len: 210 time: 0.0389977 Nov 09 04:30:03.780365 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c53145db-289d-4854-9281-af5e774874c4 None None] Pushing event updated for resources: {'Port': ['ID=ea2582be-a56b-44b1-98b4-9a334c134a75,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:03.783185 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-e4a8d013-a84a-42ac-881a-25500c24d1ac req-c6ec32e4-9c78-4e79-b8d6-eea56b29243e tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:30:03.796480 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3baa0a73-9893-49e4-955f-d300cc25f7cd tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Pushing event updated for resources: {'Port': ['ID=2823e6dd-4131-49b8-8603-11ac168db9e5,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:03.833570 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b54af3cc-e737-43a7-bb98-2bdb8c59375b None None] Sync routers for ids ['23955a4a-3903-49e9-ab99-5e003c83c868'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:30:03.869718 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-e4a8d013-a84a-42ac-881a-25500c24d1ac req-c6ec32e4-9c78-4e79-b8d6-eea56b29243e tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] No DVR routers for this DVR port 49694ee4-edfa-4a08-be0b-8bfa9b06128b on host hv-neutron-8168 {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:30:03.876246 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-e4a8d013-a84a-42ac-881a-25500c24d1ac req-c6ec32e4-9c78-4e79-b8d6-eea56b29243e tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:03.881335 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e4a8d013-a84a-42ac-881a-25500c24d1ac req-c6ec32e4-9c78-4e79-b8d6-eea56b29243e tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.26 "DELETE /v2.0/ports/49694ee4-edfa-4a08-be0b-8bfa9b06128b HTTP/1.1" status: 204 len: 173 time: 3.5772545 Nov 09 04:30:03.883431 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1635985f-bf60-4a62-b16c-5db980ddf4a7 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks [] for router_gateway, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:03.893730 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1aa3bc74-67df-4706-979b-cbf709855232', 'name': 'network-vif-deleted', 'tag': '49694ee4-edfa-4a08-be0b-8bfa9b06128b'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:30:03.896166 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-50937dcf-a088-456a-bffa-bbfb377fe043" -d '{"events": [{"server_uuid": "1aa3bc74-67df-4706-979b-cbf709855232", "name": "network-vif-deleted", "tag": "49694ee4-edfa-4a08-be0b-8bfa9b06128b"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:30:03.902713 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b54af3cc-e737-43a7-bb98-2bdb8c59375b None None] Routers {'23955a4a-3903-49e9-ab99-5e003c83c868'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:30:03.903432 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-b54af3cc-e737-43a7-bb98-2bdb8c59375b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:29:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['23955a4a-3903-49e9-ab99-5e003c83c868'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:03.914208 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-747c82e8-93cb-42ed-8942-d6a711cbf3a4 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:03.933903 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-747c82e8-93cb-42ed-8942-d6a711cbf3a4 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:03.937097 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-747c82e8-93cb-42ed-8942-d6a711cbf3a4 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "DELETE /v2.0/networks/4a546e0a-7b29-4243-aab6-ce90674959a5 HTTP/1.1" status: 204 len: 168 time: 4.4438217 Nov 09 04:30:03.950262 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54272) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:03.959190 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-54b51558-e1a6-44c4-8eea-cdaca4bbf170 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-375935127'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:03.990270 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:30:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-251375c8-7583-4e2d-b213-5155801f8aad x-openstack-request-id: req-251375c8-7583-4e2d-b213-5155801f8aad {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:30:03.990582 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1aa3bc74-67df-4706-979b-cbf709855232", "name": "network-vif-deleted", "tag": "49694ee4-edfa-4a08-be0b-8bfa9b06128b", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:30:03.990834 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-251375c8-7583-4e2d-b213-5155801f8aad {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:30:03.991239 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1aa3bc74-67df-4706-979b-cbf709855232', 'name': 'network-vif-deleted', 'tag': '49694ee4-edfa-4a08-be0b-8bfa9b06128b', 'status': 'completed', 'code': 200} Nov 09 04:30:03.994797 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-747c82e8-93cb-42ed-8942-d6a711cbf3a4 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event deleted for resources: {'Network': ['ID=4a546e0a-7b29-4243-aab6-ce90674959a5,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:03.999344 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cc3c96f1-b45f-4072-8920-f59ad09afe8c tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:04.031039 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc3c96f1-b45f-4072-8920-f59ad09afe8c tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Pushing event deleted for resources: {'Port': ['ID=1422f05c-c9c5-470c-b800-a079cd4d4962,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:04.179633 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-54b51558-e1a6-44c4-8eea-cdaca4bbf170 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Made reservation on behalf of 6761c80dbfa84798bb6517a9b532f870 for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:30:04.183209 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-54b51558-e1a6-44c4-8eea-cdaca4bbf170 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:04.192030 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cc3c96f1-b45f-4072-8920-f59ad09afe8c tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:04.194873 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-b54af3cc-e737-43a7-bb98-2bdb8c59375b None None] Set router 23955a4a-3903-49e9-ab99-5e003c83c868 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:30:04.199209 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-cc3c96f1-b45f-4072-8920-f59ad09afe8c tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] 10.222.0.24 "DELETE /v2.0/ports/1422f05c-c9c5-470c-b800-a079cd4d4962 HTTP/1.1" status: 204 len: 168 time: 2.1430669 Nov 09 04:30:04.202666 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54274) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:04.256116 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device ea2582be-a56b-44b1-98b4-9a334c134a75 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:30:04.264862 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-54b51558-e1a6-44c4-8eea-cdaca4bbf170 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 305} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:30:04.274670 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-54b51558-e1a6-44c4-8eea-cdaca4bbf170 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:04.275249 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-54b51558-e1a6-44c4-8eea-cdaca4bbf170 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Added segment 475198c2-ff54-4d05-b1e3-952bc396c422 of type vlan for network 58a373ab-b4cf-47d5-bc63-c38afd9d795e Nov 09 04:30:04.336557 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-54b51558-e1a6-44c4-8eea-cdaca4bbf170 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:04.400878 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-89498dbc-21ef-4fdd-8393-8fdbabf86752 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Deleting subnet 2aa88cd9-d91d-402f-9e1c-75a447bc596d {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:30:04.406960 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-89498dbc-21ef-4fdd-8393-8fdbabf86752 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:04.440377 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-1635985f-bf60-4a62-b16c-5db980ddf4a7 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Deleting port ebcc17fd-b39b-4e71-9ee0-779c9a37499e {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:30:04.440641 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1635985f-bf60-4a62-b16c-5db980ddf4a7 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:04.448693 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-54b51558-e1a6-44c4-8eea-cdaca4bbf170 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:04.454635 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-54b51558-e1a6-44c4-8eea-cdaca4bbf170 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:04.457283 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-54b51558-e1a6-44c4-8eea-cdaca4bbf170 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:04.512982 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-0cb27111-5fc1-4f33-94cf-8cb6ff7b44b6 req-63ac341a-64ea-4094-9acb-e9afe01de59f tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "GET /v2.0/ports?device_id=fd8e39fc-699b-4777-aae4-ca592a898437 HTTP/1.1" status: 200 len: 210 time: 0.6912858 Nov 09 04:30:04.528753 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-89498dbc-21ef-4fdd-8393-8fdbabf86752 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:04.623975 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3baa0a73-9893-49e4-955f-d300cc25f7cd tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Checking segment: {'id': 'c9067766-9d6f-474f-9b30-24ac4ea9f6a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 345, 'network_id': '72286273-ea40-4989-bf4a-d67b2d8815b0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:30:04.624536 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3baa0a73-9893-49e4-955f-d300cc25f7cd tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Network hostable DHCP agents. Network: 72286273-ea40-4989-bf4a-d67b2d8815b0, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:30:04.750035 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port ea2582be-a56b-44b1-98b4-9a334c134a75 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:30:04.750428 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:04.776216 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 49694ee4-edfa-4a08-be0b-8bfa9b06128b no longer exists at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:30:04.776338 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-1174f33b-4e06-40ab-927d-7396f80aa82d req-33653a60-aa49-4b8b-a6f6-b70461219314 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:30:04.787017 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d683d5b1-f0b1-4c9d-9b3d-37d43eccf74f None None] Sync routers for ids ['c9d2cce0-31ab-42c3-ac82-14e36499c28f'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:30:04.802465 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d683d5b1-f0b1-4c9d-9b3d-37d43eccf74f None None] Routers {'c9d2cce0-31ab-42c3-ac82-14e36499c28f'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:30:04.803121 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-d683d5b1-f0b1-4c9d-9b3d-37d43eccf74f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:29:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['c9d2cce0-31ab-42c3-ac82-14e36499c28f'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:04.848458 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3baa0a73-9893-49e4-955f-d300cc25f7cd tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Network 72286273-ea40-4989-bf4a-d67b2d8815b0 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:30:04.890811 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [req-1174f33b-4e06-40ab-927d-7396f80aa82d req-33653a60-aa49-4b8b-a6f6-b70461219314 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] No DVR routers for this DVR port 9ce4bb36-a0c7-4517-abaf-8db99ca3bb12 on host hv-neutron-8168 {{(pid=102161) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:30:04.897252 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3367cd93-7c2c-4567-a9a0-4e6fc18d78f3 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:04.902096 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [req-1174f33b-4e06-40ab-927d-7396f80aa82d req-33653a60-aa49-4b8b-a6f6-b70461219314 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:04.906398 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-1174f33b-4e06-40ab-927d-7396f80aa82d req-33653a60-aa49-4b8b-a6f6-b70461219314 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.26 "DELETE /v2.0/ports/9ce4bb36-a0c7-4517-abaf-8db99ca3bb12 HTTP/1.1" status: 204 len: 173 time: 4.1684546 Nov 09 04:30:04.912957 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fd8e39fc-699b-4777-aae4-ca592a898437', 'name': 'network-vif-deleted', 'tag': '9ce4bb36-a0c7-4517-abaf-8db99ca3bb12'}] {{(pid=102161) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:30:04.912957 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}99dfdda0def497b4372884ef2eb87f06b1e425c8eba5ceda5f64bbab037a07d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-eda0bf12-d9cb-498c-85e9-bbee533eb162" -d '{"events": [{"server_uuid": "fd8e39fc-699b-4777-aae4-ca592a898437", "name": "network-vif-deleted", "tag": "9ce4bb36-a0c7-4517-abaf-8db99ca3bb12"}]}' {{(pid=102161) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:30:04.918117 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] No Port match for: 49694ee4-edfa-4a08-be0b-8bfa9b06128b {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:30:04.922607 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 49694ee4-edfa-4a08-be0b-8bfa9b06128b not bound to the agent host hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:30:04.922975 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 9ce4bb36-a0c7-4517-abaf-8db99ca3bb12 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:30:04.992712 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-3baa0a73-9893-49e4-955f-d300cc25f7cd tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 72286273-ea40-4989-bf4a-d67b2d8815b0) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:05.022239 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] No Port match for: 9ce4bb36-a0c7-4517-abaf-8db99ca3bb12 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:30:05.022239 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 9ce4bb36-a0c7-4517-abaf-8db99ca3bb12 not bound to the agent host hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:30:05.025834 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f260d2e9-cfc5-4e77-8030-61dc44df9f6d None None] Network 72286273-ea40-4989-bf4a-d67b2d8815b0 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:30:05.076345 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3baa0a73-9893-49e4-955f-d300cc25f7cd tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:30:05.079700 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-d683d5b1-f0b1-4c9d-9b3d-37d43eccf74f None None] Set router c9d2cce0-31ab-42c3-ac82-14e36499c28f gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:30:05.087369 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3baa0a73-9893-49e4-955f-d300cc25f7cd tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:05.107449 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3baa0a73-9893-49e4-955f-d300cc25f7cd tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:05.117681 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3baa0a73-9893-49e4-955f-d300cc25f7cd tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:05.121797 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:30:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f01e95ac-30b1-4a08-8ed0-a7d9ec53da26 x-openstack-request-id: req-f01e95ac-30b1-4a08-8ed0-a7d9ec53da26 {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:30:05.124781 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fd8e39fc-699b-4777-aae4-ca592a898437", "name": "network-vif-deleted", "tag": "9ce4bb36-a0c7-4517-abaf-8db99ca3bb12", "status": "completed", "code": 200}]} {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:30:05.125044 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-f01e95ac-30b1-4a08-8ed0-a7d9ec53da26 {{(pid=102161) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:30:05.125463 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fd8e39fc-699b-4777-aae4-ca592a898437', 'name': 'network-vif-deleted', 'tag': '9ce4bb36-a0c7-4517-abaf-8db99ca3bb12', 'status': 'completed', 'code': 200} Nov 09 04:30:05.144543 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3367cd93-7c2c-4567-a9a0-4e6fc18d78f3 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Pushing event deleted for resources: {'Port': ['ID=ea2582be-a56b-44b1-98b4-9a334c134a75,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:05.203572 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-54b51558-e1a6-44c4-8eea-cdaca4bbf170 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 779 time: 1.2506938 Nov 09 04:30:05.224046 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54282) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:05.232240 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8f2ef566-afff-4b78-ad2f-8fa983bf4461 req-7199923c-4e4e-45fd-8295-d70834295f16 tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.24 "GET /v2.0/ports?device_id=1aa3bc74-67df-4706-979b-cbf709855232 HTTP/1.1" status: 200 len: 210 time: 0.0768058 Nov 09 04:30:05.233403 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-1610a6f4-9648-4f5f-b773-a160ffd56689 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Request body: {'subnet': {'network_id': '58a373ab-b4cf-47d5-bc63-c38afd9d795e', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': None, 'allocation_pools': [{'start': '172.20.0.3', 'end': '172.20.0.7'}]}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:05.244153 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54b51558-e1a6-44c4-8eea-cdaca4bbf170 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event updated for resources: {'Network': ['ID=58a373ab-b4cf-47d5-bc63-c38afd9d795e,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:05.256334 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6eae5d59-7c7f-4354-bae7-6802e9a4cd4d None None] DHCP port deletion for 9680862a-d7ab-46b3-9eea-47dd24c9bfec request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:30:05.271086 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-5f8c011e-1d90-4f3c-80a0-369a70d72a1d None None] Could not find standard attr ID for object ea2582be-a56b-44b1-98b4-9a334c134a75. {{(pid=102163) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 09 04:30:05.279904 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 58a373ab-b4cf-47d5-bc63-c38afd9d795e details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:30:05.314500 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1635985f-bf60-4a62-b16c-5db980ddf4a7 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:05.336267 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-1635985f-bf60-4a62-b16c-5db980ddf4a7 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Calling delete_port for ebcc17fd-b39b-4e71-9ee0-779c9a37499e owned by network:router_gateway {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:30:05.345191 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-89498dbc-21ef-4fdd-8393-8fdbabf86752 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:05.428135 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Could not find standard attr ID for object ea2582be-a56b-44b1-98b4-9a334c134a75. {{(pid=102163) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 09 04:30:05.433538 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No ports have port_id starting with ea2582be-a56b-44b1-98b4-9a334c134a75 Nov 09 04:30:05.450019 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-71218ef0-5c69-463b-a80d-19438daea2b1 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks [] for router_gateway, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:05.477469 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-d683d5b1-f0b1-4c9d-9b3d-37d43eccf74f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c9d2cce0-31ab-42c3-ac82-14e36499c28f', 'name': 'tempest-ServersTestJSON-828046534-router', 'tenant_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.163'}], 'enable_snat': True}, 'gw_port_id': '0fc8f26d-1642-4025-b21c-de2a4f14043f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:28:17Z', 'updated_at': '2021-11-09T04:28:27Z', 'revision_number': 4, 'project_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'gw_port': {'id': '0fc8f26d-1642-4025-b21c-de2a4f14043f', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:c5:bb:ba', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c9d2cce0-31ab-42c3-ac82-14e36499c28f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.163', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:28:18Z', 'updated_at': '2021-11-09T04:28:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '76f630f8-c464-46b2-b3b3-6a4c815cc2cf', 'name': '', 'network_id': 'd4ba3288-221c-40f3-a829-662c462cc93f', 'tenant_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'mac_address': 'fa:16:3e:71:0f:73', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c9d2cce0-31ab-42c3-ac82-14e36499c28f', 'device_owner': 'network:router_interface', 'standard_attr_id': 107, 'fixed_ips': [{'subnet_id': 'b11be6b4-75f0-4756-9312-de5295f24e1b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:28:25Z', 'updated_at': '2021-11-09T04:28:32Z', 'revision_number': 5, 'project_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'subnets': [{'id': 'b11be6b4-75f0-4756-9312-de5295f24e1b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:05.508692 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d683d5b1-f0b1-4c9d-9b3d-37d43eccf74f None None] Checking router: c9d2cce0-31ab-42c3-ac82-14e36499c28f for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:30:05.510756 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-b54af3cc-e737-43a7-bb98-2bdb8c59375b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '23955a4a-3903-49e9-ab99-5e003c83c868', 'name': 'tempest-ServersTestManualDisk-509590275-router', 'tenant_id': '5f3cd2a3586e46c09f847681f744075c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.66'}], 'enable_snat': True}, 'gw_port_id': 'a31e46ce-e371-4177-a2d5-f9a3681f192b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:28:17Z', 'updated_at': '2021-11-09T04:28:28Z', 'revision_number': 4, 'project_id': '5f3cd2a3586e46c09f847681f744075c', 'gw_port': {'id': 'a31e46ce-e371-4177-a2d5-f9a3681f192b', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:d3:1e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '23955a4a-3903-49e9-ab99-5e003c83c868', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:28:19Z', 'updated_at': '2021-11-09T04:28:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '6e983a96-52c7-4df1-885b-dc7cdba4b08e', 'name': '', 'network_id': '468b2f91-119a-402c-b695-5d7963ec6348', 'tenant_id': '5f3cd2a3586e46c09f847681f744075c', 'mac_address': 'fa:16:3e:3c:66:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '23955a4a-3903-49e9-ab99-5e003c83c868', 'device_owner': 'network:router_interface', 'standard_attr_id': 127, 'fixed_ips': [{'subnet_id': 'a3d93294-0484-46fa-b8a6-204ec86c9c5f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:28:27Z', 'updated_at': '2021-11-09T04:28:36Z', 'revision_number': 5, 'project_id': '5f3cd2a3586e46c09f847681f744075c', 'subnets': [{'id': 'a3d93294-0484-46fa-b8a6-204ec86c9c5f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:05.512722 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d683d5b1-f0b1-4c9d-9b3d-37d43eccf74f None None] Routers {'c9d2cce0-31ab-42c3-ac82-14e36499c28f'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:30:05.513330 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-d683d5b1-f0b1-4c9d-9b3d-37d43eccf74f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:29:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['c9d2cce0-31ab-42c3-ac82-14e36499c28f'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:05.544299 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b54af3cc-e737-43a7-bb98-2bdb8c59375b None None] Checking router: 23955a4a-3903-49e9-ab99-5e003c83c868 for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:30:05.555429 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b54af3cc-e737-43a7-bb98-2bdb8c59375b None None] Routers {'23955a4a-3903-49e9-ab99-5e003c83c868'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:30:05.556051 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-b54af3cc-e737-43a7-bb98-2bdb8c59375b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:29:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['23955a4a-3903-49e9-ab99-5e003c83c868'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:05.570755 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-3baa0a73-9893-49e4-955f-d300cc25f7cd tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1448 time: 5.7429371 Nov 09 04:30:05.578062 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54286) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:05.594746 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-89498dbc-21ef-4fdd-8393-8fdbabf86752 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:05.636107 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-d683d5b1-f0b1-4c9d-9b3d-37d43eccf74f None None] Set router c9d2cce0-31ab-42c3-ac82-14e36499c28f gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:30:05.640012 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3367cd93-7c2c-4567-a9a0-4e6fc18d78f3 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] No DVR routers for this DVR port ea2582be-a56b-44b1-98b4-9a334c134a75 on host dv-neutron-816802-2-hyperv {{(pid=102161) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:30:05.645232 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89498dbc-21ef-4fdd-8393-8fdbabf86752 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Pushing event deleted for resources: {'Subnet': ['ID=2aa88cd9-d91d-402f-9e1c-75a447bc596d,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:05.651611 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-89498dbc-21ef-4fdd-8393-8fdbabf86752 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:05.656332 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-89498dbc-21ef-4fdd-8393-8fdbabf86752 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] 10.222.0.24 "DELETE /v2.0/subnets/2aa88cd9-d91d-402f-9e1c-75a447bc596d HTTP/1.1" status: 204 len: 168 time: 1.4463074 Nov 09 04:30:05.666999 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54288) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:05.767630 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-b54af3cc-e737-43a7-bb98-2bdb8c59375b None None] Set router 23955a4a-3903-49e9-ab99-5e003c83c868 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:30:05.788369 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3367cd93-7c2c-4567-a9a0-4e6fc18d78f3 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:05.842012 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8fccd552-698b-4d43-b998-fdfb10c78df0 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:05.852994 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8fccd552-698b-4d43-b998-fdfb10c78df0 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:05.854683 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-8fccd552-698b-4d43-b998-fdfb10c78df0 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] 10.222.0.24 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1443 time: 0.2750711 Nov 09 04:30:05.866192 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54290) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:05.893259 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-d683d5b1-f0b1-4c9d-9b3d-37d43eccf74f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c9d2cce0-31ab-42c3-ac82-14e36499c28f', 'name': 'tempest-ServersTestJSON-828046534-router', 'tenant_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.163'}], 'enable_snat': True}, 'gw_port_id': '0fc8f26d-1642-4025-b21c-de2a4f14043f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:28:17Z', 'updated_at': '2021-11-09T04:28:27Z', 'revision_number': 4, 'project_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'gw_port': {'id': '0fc8f26d-1642-4025-b21c-de2a4f14043f', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:c5:bb:ba', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c9d2cce0-31ab-42c3-ac82-14e36499c28f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.163', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:28:18Z', 'updated_at': '2021-11-09T04:28:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '76f630f8-c464-46b2-b3b3-6a4c815cc2cf', 'name': '', 'network_id': 'd4ba3288-221c-40f3-a829-662c462cc93f', 'tenant_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'mac_address': 'fa:16:3e:71:0f:73', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c9d2cce0-31ab-42c3-ac82-14e36499c28f', 'device_owner': 'network:router_interface', 'standard_attr_id': 107, 'fixed_ips': [{'subnet_id': 'b11be6b4-75f0-4756-9312-de5295f24e1b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:28:25Z', 'updated_at': '2021-11-09T04:28:32Z', 'revision_number': 5, 'project_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'subnets': [{'id': 'b11be6b4-75f0-4756-9312-de5295f24e1b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:05.939824 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4d64639c-acf6-4af5-9314-39370f6ba6c8 None None] Network 6b78e150-9412-4145-a432-680e4456364c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:30:05.950858 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d683d5b1-f0b1-4c9d-9b3d-37d43eccf74f None None] The sync data for ids ['c9d2cce0-31ab-42c3-ac82-14e36499c28f'] in dv-neutron-816802-2-hyperv is: [{'id': 'c9d2cce0-31ab-42c3-ac82-14e36499c28f', 'name': 'tempest-ServersTestJSON-828046534-router', 'tenant_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.163'}], 'enable_snat': True}, 'gw_port_id': '0fc8f26d-1642-4025-b21c-de2a4f14043f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:28:17Z', 'updated_at': '2021-11-09T04:28:27Z', 'revision_number': 4, 'project_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'gw_port': {'id': '0fc8f26d-1642-4025-b21c-de2a4f14043f', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:c5:bb:ba', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c9d2cce0-31ab-42c3-ac82-14e36499c28f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.163', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:28:18Z', 'updated_at': '2021-11-09T04:28:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '76f630f8-c464-46b2-b3b3-6a4c815cc2cf', 'name': '', 'network_id': 'd4ba3288-221c-40f3-a829-662c462cc93f', 'tenant_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'mac_address': 'fa:16:3e:71:0f:73', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c9d2cce0-31ab-42c3-ac82-14e36499c28f', 'device_owner': 'network:router_interface', 'standard_attr_id': 107, 'fixed_ips': [{'subnet_id': 'b11be6b4-75f0-4756-9312-de5295f24e1b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:28:25Z', 'updated_at': '2021-11-09T04:28:32Z', 'revision_number': 5, 'project_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'subnets': [{'id': 'b11be6b4-75f0-4756-9312-de5295f24e1b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:30:05.993429 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-75a549b1-2efc-4861-8523-cbbf0c83d2d2 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:06.087126 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-20a84726-f614-4e1f-8927-9b24161081c6 req-5d1b0671-91a2-441c-b6fe-d51695cfeedd tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "GET /v2.0/ports?device_id=fd8e39fc-699b-4777-aae4-ca592a898437 HTTP/1.1" status: 200 len: 210 time: 0.1325486 Nov 09 04:30:06.120994 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3367cd93-7c2c-4567-a9a0-4e6fc18d78f3 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:06.125835 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device ea2582be-a56b-44b1-98b4-9a334c134a75 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:30:06.140238 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1635985f-bf60-4a62-b16c-5db980ddf4a7 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:06.175189 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3367cd93-7c2c-4567-a9a0-4e6fc18d78f3 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Pushing event deleted for resources: {'Subnet': ['ID=bfcb2be9-f2aa-4f0a-9e35-4e96a2dd46a7,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:06.196425 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: ea2582be-a56b-44b1-98b4-9a334c134a75 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:30:06.196787 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device ea2582be-a56b-44b1-98b4-9a334c134a75 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:30:06.212766 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1635985f-bf60-4a62-b16c-5db980ddf4a7 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Pushing event deleted for resources: {'Port': ['ID=ebcc17fd-b39b-4e71-9ee0-779c9a37499e,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:06.214291 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d75bb167-3175-4789-bb3d-5a2b04c4f113 None None] Network 9680862a-d7ab-46b3-9eea-47dd24c9bfec requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:30:06.254913 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-f1a3e8b3-8f03-43bc-bee0-bfacb3d0263b tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Deleting port 98905f03-f8ab-4421-b0d5-3cb1e3f4d7da {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:30:06.255255 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f1a3e8b3-8f03-43bc-bee0-bfacb3d0263b tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:06.336154 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1610a6f4-9648-4f5f-b773-a160ffd56689 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Made reservation on behalf of 6761c80dbfa84798bb6517a9b532f870 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:30:06.339991 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1610a6f4-9648-4f5f-b773-a160ffd56689 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:06.349201 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3367cd93-7c2c-4567-a9a0-4e6fc18d78f3 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:06.404145 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-75a549b1-2efc-4861-8523-cbbf0c83d2d2 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Deleting port 0acfa6cc-c45a-41fc-920a-0ef63d0600d0 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:30:06.404706 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-75a549b1-2efc-4861-8523-cbbf0c83d2d2 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:06.458894 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54296) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:06.465055 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-3367cd93-7c2c-4567-a9a0-4e6fc18d78f3 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9680862a-d7ab-46b3-9eea-47dd24c9bfec']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:06.470165 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-84fdbb16-1d90-4a8e-afcf-baa53d31491d None None] New status for floating IP b6e50ee2-5399-49fe-a1c4-7571e8730316: DOWN {{(pid=102163) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 04:30:06.480710 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.ipam_backend_mixin [None req-1610a6f4-9648-4f5f-b773-a160ffd56689 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Performing IP validity checks on allocation pools {{(pid=102161) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:325}} Nov 09 04:30:06.481287 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.ipam_backend_mixin [None req-1610a6f4-9648-4f5f-b773-a160ffd56689 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Checking for overlaps among allocation pools and gateway ip {{(pid=102161) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:346}} Nov 09 04:30:06.497048 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-3367cd93-7c2c-4567-a9a0-4e6fc18d78f3 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f7804780-6a6e-45e4-b9d1-0469fe5dec5d') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:06.497226 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-3367cd93-7c2c-4567-a9a0-4e6fc18d78f3 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f7804780-6a6e-45e4-b9d1-0469fe5dec5d') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:06.507830 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f1a3e8b3-8f03-43bc-bee0-bfacb3d0263b tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:06.507830 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-75a549b1-2efc-4861-8523-cbbf0c83d2d2 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] For port 0acfa6cc-c45a-41fc-920a-0ef63d0600d0, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=0acfa6cc-c45a-41fc-920a-0ef63d0600d0,segment=NetworkSegment(29dd0c31-fa36-4903-bb81-1974d7ba9c81),segment_id=29dd0c31-fa36-4903-bb81-1974d7ba9c81)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:30:06.507830 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-75a549b1-2efc-4861-8523-cbbf0c83d2d2 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:06.523415 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-560d736e-c3ce-4ad2-9b94-85a162170302 None None] DHCP port deletion for 9680862a-d7ab-46b3-9eea-47dd24c9bfec request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:30:06.524643 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3367cd93-7c2c-4567-a9a0-4e6fc18d78f3 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:06.528636 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-71218ef0-5c69-463b-a80d-19438daea2b1 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:06.547549 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-75a549b1-2efc-4861-8523-cbbf0c83d2d2 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Calling delete_port for 0acfa6cc-c45a-41fc-920a-0ef63d0600d0 owned by network:dhcp {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:30:06.549438 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1635985f-bf60-4a62-b16c-5db980ddf4a7 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-466373'] for router_gateway, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:06.593788 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3367cd93-7c2c-4567-a9a0-4e6fc18d78f3 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:06.615856 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3367cd93-7c2c-4567-a9a0-4e6fc18d78f3 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Releasing vlan 343 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:30:06.617605 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3367cd93-7c2c-4567-a9a0-4e6fc18d78f3 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:06.619487 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:30:06.619487 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:30:06.619487 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:30:06.619487 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:30:06.619487 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:30:06.619487 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:30:06.619487 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:30:06.619487 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:30:06.619487 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:30:06.619487 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:30:06.619487 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:30:06.619487 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:30:06.619487 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:30:06.619487 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:30:06.619487 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:30:06.619487 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:30:06.619487 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:30:06.619487 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:30:06.619487 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:30:06.619487 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:30:06.619487 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:30:06.619487 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:30:06.619487 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:30:06.619487 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:30:06.619487 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:30:06.619487 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:30:06.619487 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:30:06.619487 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:30:06.619487 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:30:06.619487 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:30:06.619487 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:30:06.619487 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:30:06.626788 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0af690cc-f04b-4494-ba30-7095b3216631 None None] DHCP port deletion for 6b78e150-9412-4145-a432-680e4456364c request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:30:06.646920 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1635985f-bf60-4a62-b16c-5db980ddf4a7 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:06.649065 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1635985f-bf60-4a62-b16c-5db980ddf4a7 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:06.664290 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-b54af3cc-e737-43a7-bb98-2bdb8c59375b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '23955a4a-3903-49e9-ab99-5e003c83c868', 'name': 'tempest-ServersTestManualDisk-509590275-router', 'tenant_id': '5f3cd2a3586e46c09f847681f744075c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.66'}], 'enable_snat': True}, 'gw_port_id': 'a31e46ce-e371-4177-a2d5-f9a3681f192b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:28:17Z', 'updated_at': '2021-11-09T04:28:28Z', 'revision_number': 4, 'project_id': '5f3cd2a3586e46c09f847681f744075c', 'gw_port': {'id': 'a31e46ce-e371-4177-a2d5-f9a3681f192b', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:d3:1e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '23955a4a-3903-49e9-ab99-5e003c83c868', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:28:19Z', 'updated_at': '2021-11-09T04:28:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '6e983a96-52c7-4df1-885b-dc7cdba4b08e', 'name': '', 'network_id': '468b2f91-119a-402c-b695-5d7963ec6348', 'tenant_id': '5f3cd2a3586e46c09f847681f744075c', 'mac_address': 'fa:16:3e:3c:66:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '23955a4a-3903-49e9-ab99-5e003c83c868', 'device_owner': 'network:router_interface', 'standard_attr_id': 127, 'fixed_ips': [{'subnet_id': 'a3d93294-0484-46fa-b8a6-204ec86c9c5f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:28:27Z', 'updated_at': '2021-11-09T04:28:36Z', 'revision_number': 5, 'project_id': '5f3cd2a3586e46c09f847681f744075c', 'subnets': [{'id': 'a3d93294-0484-46fa-b8a6-204ec86c9c5f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:06.687349 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-f1a3e8b3-8f03-43bc-bee0-bfacb3d0263b tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Calling delete_port for 98905f03-f8ab-4421-b0d5-3cb1e3f4d7da owned by {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:30:06.697671 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b54af3cc-e737-43a7-bb98-2bdb8c59375b None None] The sync data for ids ['23955a4a-3903-49e9-ab99-5e003c83c868'] in dv-neutron-816802-2-hyperv is: [{'id': '23955a4a-3903-49e9-ab99-5e003c83c868', 'name': 'tempest-ServersTestManualDisk-509590275-router', 'tenant_id': '5f3cd2a3586e46c09f847681f744075c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.66'}], 'enable_snat': True}, 'gw_port_id': 'a31e46ce-e371-4177-a2d5-f9a3681f192b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:28:17Z', 'updated_at': '2021-11-09T04:28:28Z', 'revision_number': 4, 'project_id': '5f3cd2a3586e46c09f847681f744075c', 'gw_port': {'id': 'a31e46ce-e371-4177-a2d5-f9a3681f192b', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:d3:1e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '23955a4a-3903-49e9-ab99-5e003c83c868', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:28:19Z', 'updated_at': '2021-11-09T04:28:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '6e983a96-52c7-4df1-885b-dc7cdba4b08e', 'name': '', 'network_id': '468b2f91-119a-402c-b695-5d7963ec6348', 'tenant_id': '5f3cd2a3586e46c09f847681f744075c', 'mac_address': 'fa:16:3e:3c:66:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '23955a4a-3903-49e9-ab99-5e003c83c868', 'device_owner': 'network:router_interface', 'standard_attr_id': 127, 'fixed_ips': [{'subnet_id': 'a3d93294-0484-46fa-b8a6-204ec86c9c5f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:28:27Z', 'updated_at': '2021-11-09T04:28:36Z', 'revision_number': 5, 'project_id': '5f3cd2a3586e46c09f847681f744075c', 'subnets': [{'id': 'a3d93294-0484-46fa-b8a6-204ec86c9c5f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:30:06.728225 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-0af690cc-f04b-4494-ba30-7095b3216631 None None] Deleting port 0acfa6cc-c45a-41fc-920a-0ef63d0600d0 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:30:06.728598 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0af690cc-f04b-4494-ba30-7095b3216631 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:06.815436 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-0af690cc-f04b-4494-ba30-7095b3216631 None None] For port 0acfa6cc-c45a-41fc-920a-0ef63d0600d0, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=0acfa6cc-c45a-41fc-920a-0ef63d0600d0,segment=NetworkSegment(29dd0c31-fa36-4903-bb81-1974d7ba9c81),segment_id=29dd0c31-fa36-4903-bb81-1974d7ba9c81)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:30:06.815880 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0af690cc-f04b-4494-ba30-7095b3216631 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:06.817670 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1635985f-bf60-4a62-b16c-5db980ddf4a7 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:06.818201 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1635985f-bf60-4a62-b16c-5db980ddf4a7 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Fanout notify agent at l3_agent the message router_deleted on router bac0f9e1-4e8b-4938-b8b0-48cbafecf6cd {{(pid=102162) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:30:06.835938 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-0af690cc-f04b-4494-ba30-7095b3216631 None None] Calling delete_port for 0acfa6cc-c45a-41fc-920a-0ef63d0600d0 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:30:06.836619 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1635985f-bf60-4a62-b16c-5db980ddf4a7 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:06.841566 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-1635985f-bf60-4a62-b16c-5db980ddf4a7 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] 10.222.0.24 "DELETE /v2.0/routers/bac0f9e1-4e8b-4938-b8b0-48cbafecf6cd HTTP/1.1" status: 204 len: 168 time: 3.9812248 Nov 09 04:30:06.842854 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54298) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:06.847846 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-c3a1f3da-007c-4c73-be12-66cc29581ac9 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Request body: {'router': {'name': 'tempest-RoutersIpV6AdminTest-router-1355758', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:06.852829 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3c14d439-a1a2-423a-9277-3ffed3d1821d tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:06.891409 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3367cd93-7c2c-4567-a9a0-4e6fc18d78f3 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:06.900344 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3c14d439-a1a2-423a-9277-3ffed3d1821d tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:06.912974 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3367cd93-7c2c-4567-a9a0-4e6fc18d78f3 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:06.919665 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-3367cd93-7c2c-4567-a9a0-4e6fc18d78f3 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "DELETE /v2.0/networks/9680862a-d7ab-46b3-9eea-47dd24c9bfec HTTP/1.1" status: 204 len: 168 time: 4.3547127 Nov 09 04:30:06.919665 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3367cd93-7c2c-4567-a9a0-4e6fc18d78f3 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Pushing event deleted for resources: {'Network': ['ID=9680862a-d7ab-46b3-9eea-47dd24c9bfec,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:06.923596 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54300) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:06.933868 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1610a6f4-9648-4f5f-b773-a160ffd56689 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:06.992380 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-a736307c-ded9-4108-ada1-52e641ac8fb5 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] DELETE failed (client error): The resource could not be found. Nov 09 04:30:06.992929 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a736307c-ded9-4108-ada1-52e641ac8fb5 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:30:06.998658 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a736307c-ded9-4108-ada1-52e641ac8fb5 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "DELETE /v2.0/subnets/bfcb2be9-f2aa-4f0a-9e35-4e96a2dd46a7 HTTP/1.1" status: 404 len: 337 time: 0.0715621 Nov 09 04:30:07.000614 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54302) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:07.015843 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-71218ef0-5c69-463b-a80d-19438daea2b1 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Router 51b84bbe-6de2-4db7-8c1e-f355ca5a4450 is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102161) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:30:07.019407 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c3a1f3da-007c-4c73-be12-66cc29581ac9 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:07.020521 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c3a1f3da-007c-4c73-be12-66cc29581ac9 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:07.029962 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f1a3e8b3-8f03-43bc-bee0-bfacb3d0263b tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:07.034379 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-75a549b1-2efc-4861-8523-cbbf0c83d2d2 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:07.055627 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-9d4adcdb-ddad-427a-b863-097fbc6c311a tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] DELETE failed (client error): The resource could not be found. Nov 09 04:30:07.055877 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9d4adcdb-ddad-427a-b863-097fbc6c311a tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:30:07.058908 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-9d4adcdb-ddad-427a-b863-097fbc6c311a tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "DELETE /v2.0/networks/9680862a-d7ab-46b3-9eea-47dd24c9bfec HTTP/1.1" status: 404 len: 339 time: 0.0573094 Nov 09 04:30:07.064726 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54304) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:07.076335 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1610a6f4-9648-4f5f-b773-a160ffd56689 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event updated for resources: {'Subnet': ['ID=8e52d510-3a3d-4e0d-bb67-46938c0bbbc3,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:07.076716 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3c14d439-a1a2-423a-9277-3ffed3d1821d tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:07.086415 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3c14d439-a1a2-423a-9277-3ffed3d1821d tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:07.088463 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-3c14d439-a1a2-423a-9277-3ffed3d1821d tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.24 "DELETE /v2.0/security-groups/4b002f37-f4ce-4d8a-a894-560955e72139 HTTP/1.1" status: 204 len: 168 time: 0.6242750 Nov 09 04:30:07.103687 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0af690cc-f04b-4494-ba30-7095b3216631 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:07.116643 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54306) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:07.140342 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0af690cc-f04b-4494-ba30-7095b3216631 None None] Pushing event deleted for resources: {'Port': ['ID=0acfa6cc-c45a-41fc-920a-0ef63d0600d0,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:07.142266 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-75a549b1-2efc-4861-8523-cbbf0c83d2d2 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] No DVR routers for this DVR port 0acfa6cc-c45a-41fc-920a-0ef63d0600d0 on host dv-neutron-816802-2-hyperv {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:30:07.151311 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0af690cc-f04b-4494-ba30-7095b3216631 None None] No DVR routers for this DVR port 0acfa6cc-c45a-41fc-920a-0ef63d0600d0 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:30:07.166468 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f1a3e8b3-8f03-43bc-bee0-bfacb3d0263b tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:07.171449 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-1ac1f756-2c46-4638-a65d-86f279f73b5c tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] show failed (client error): The resource could not be found. Nov 09 04:30:07.173739 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-f1a3e8b3-8f03-43bc-bee0-bfacb3d0263b tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] 10.222.0.24 "DELETE /v2.0/ports/98905f03-f8ab-4421-b0d5-3cb1e3f4d7da HTTP/1.1" status: 204 len: 168 time: 1.3018992 Nov 09 04:30:07.183957 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1ac1f756-2c46-4638-a65d-86f279f73b5c tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.24 "GET /v2.0/security-groups/4b002f37-f4ce-4d8a-a894-560955e72139 HTTP/1.1" status: 404 len: 347 time: 0.0539563 Nov 09 04:30:07.184604 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54312) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:07.184936 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54314) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:07.185415 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-be6bf4c7-74a8-43a1-ad0c-e516e5bc52ed None None] get_active_networks_info from dv-neutron-816802-2-hyperv {{(pid=102163) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}} Nov 09 04:30:07.198166 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dd06ca2b-d094-4818-9be9-f896f6fdaf0a None None] New status for floating IP 00824cf7-be58-475c-a1dc-142d27e3cda6: DOWN {{(pid=102164) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 04:30:07.205778 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75a549b1-2efc-4861-8523-cbbf0c83d2d2 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Pushing event deleted for resources: {'Port': ['ID=0acfa6cc-c45a-41fc-920a-0ef63d0600d0,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:07.235283 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c3a1f3da-007c-4c73-be12-66cc29581ac9 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:07.265154 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1610a6f4-9648-4f5f-b773-a160ffd56689 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Checking segment: {'id': '475198c2-ff54-4d05-b1e3-952bc396c422', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 305, 'network_id': '58a373ab-b4cf-47d5-bc63-c38afd9d795e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:30:07.265521 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1610a6f4-9648-4f5f-b773-a160ffd56689 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Network hostable DHCP agents. Network: 58a373ab-b4cf-47d5-bc63-c38afd9d795e, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:30:07.293839 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-dc336c47-941f-4be5-917a-86d81a9e5cac tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:07.297910 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54316) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:07.317599 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c14d439-a1a2-423a-9277-3ffed3d1821d tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=4b002f37-f4ce-4d8a-a894-560955e72139,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:07.361952 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1a3e8b3-8f03-43bc-bee0-bfacb3d0263b tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Pushing event deleted for resources: {'Port': ['ID=98905f03-f8ab-4421-b0d5-3cb1e3f4d7da,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:07.475492 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-75a549b1-2efc-4861-8523-cbbf0c83d2d2 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:07.554287 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-be6bf4c7-74a8-43a1-ad0c-e516e5bc52ed None None] Network 58a373ab-b4cf-47d5-bc63-c38afd9d795e is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102163) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:30:07.560406 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6c0ad546-f524-4506-9740-2726b3b53c39 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:07.562496 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-75a549b1-2efc-4861-8523-cbbf0c83d2d2 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6b78e150-9412-4145-a432-680e4456364c']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:07.562649 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c3a1f3da-007c-4c73-be12-66cc29581ac9 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:07.584462 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-dc336c47-941f-4be5-917a-86d81a9e5cac tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:07.589873 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-75a549b1-2efc-4861-8523-cbbf0c83d2d2 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '29dd0c31-fa36-4903-bb81-1974d7ba9c81') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:07.589873 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-75a549b1-2efc-4861-8523-cbbf0c83d2d2 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '29dd0c31-fa36-4903-bb81-1974d7ba9c81') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:07.616512 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-75a549b1-2efc-4861-8523-cbbf0c83d2d2 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:07.633530 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6c0ad546-f524-4506-9740-2726b3b53c39 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:07.637077 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-dc336c47-941f-4be5-917a-86d81a9e5cac tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['41b6a30b-1a07-4d4e-bb4c-2047225fca0a']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:07.651138 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-be6bf4c7-74a8-43a1-ad0c-e516e5bc52ed None None] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 58a373ab-b4cf-47d5-bc63-c38afd9d795e) {{(pid=102163) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 09 04:30:07.656216 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1610a6f4-9648-4f5f-b773-a160ffd56689 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Unable to find a vacant binding_index for network 58a373ab-b4cf-47d5-bc63-c38afd9d795e and agent cb24b282-9b2c-4486-bad1-b98e0db75839 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:209}} Nov 09 04:30:07.659356 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-75a549b1-2efc-4861-8523-cbbf0c83d2d2 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:07.668090 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-dc336c47-941f-4be5-917a-86d81a9e5cac tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '664b72d3-eb88-4c57-a801-7061f5540d78') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:07.668402 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-dc336c47-941f-4be5-917a-86d81a9e5cac tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '664b72d3-eb88-4c57-a801-7061f5540d78') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:07.672402 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-71218ef0-5c69-463b-a80d-19438daea2b1 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:30:07.681395 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-1610a6f4-9648-4f5f-b773-a160ffd56689 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 58a373ab-b4cf-47d5-bc63-c38afd9d795e) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:07.686231 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-75a549b1-2efc-4861-8523-cbbf0c83d2d2 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Releasing vlan 334 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:30:07.687177 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-75a549b1-2efc-4861-8523-cbbf0c83d2d2 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:07.692988 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:30:07.692988 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:30:07.692988 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:30:07.692988 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:30:07.692988 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:30:07.692988 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:30:07.692988 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:30:07.692988 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:30:07.692988 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:30:07.692988 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:30:07.692988 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:30:07.692988 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:30:07.692988 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:30:07.692988 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:30:07.692988 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:30:07.692988 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:30:07.692988 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:30:07.692988 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:30:07.692988 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:30:07.692988 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:30:07.692988 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:30:07.692988 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:30:07.692988 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:30:07.692988 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:30:07.692988 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:30:07.692988 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:30:07.692988 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:30:07.692988 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:30:07.692988 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:30:07.692988 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:30:07.692988 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:30:07.692988 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:30:07.698257 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-33a0101c-fcf2-4bf2-b88d-e250ea43b2ad None None] Sync routers for ids ['51b84bbe-6de2-4db7-8c1e-f355ca5a4450'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:30:07.698670 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-dc336c47-941f-4be5-917a-86d81a9e5cac tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:07.713835 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1610a6f4-9648-4f5f-b773-a160ffd56689 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:07.714475 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1610a6f4-9648-4f5f-b773-a160ffd56689 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:07.744165 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c3a1f3da-007c-4c73-be12-66cc29581ac9 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:07.747004 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-c3a1f3da-007c-4c73-be12-66cc29581ac9 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 706 time: 0.9031348 Nov 09 04:30:07.748554 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54318) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:07.755125 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-ef4ab40f-b8b0-4a34-9a4c-e8c6d5e8ee12 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'enable_snat': True}}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:07.767974 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-dc336c47-941f-4be5-917a-86d81a9e5cac tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:07.780327 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-dc336c47-941f-4be5-917a-86d81a9e5cac tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Releasing vlan 325 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:30:07.780726 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-dc336c47-941f-4be5-917a-86d81a9e5cac tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:07.783898 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:30:07.783898 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:30:07.783898 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:30:07.783898 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:30:07.783898 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:30:07.783898 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:30:07.783898 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:30:07.783898 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:30:07.783898 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:30:07.783898 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:30:07.783898 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:30:07.783898 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:30:07.783898 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:30:07.783898 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:30:07.783898 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:30:07.783898 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:30:07.783898 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:30:07.783898 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:30:07.783898 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:30:07.783898 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:30:07.783898 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:30:07.783898 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:30:07.783898 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:30:07.783898 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:30:07.783898 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:30:07.783898 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:30:07.783898 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:30:07.783898 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:30:07.783898 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:30:07.783898 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:30:07.783898 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:30:07.783898 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:30:07.804946 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-33a0101c-fcf2-4bf2-b88d-e250ea43b2ad None None] Routers {'51b84bbe-6de2-4db7-8c1e-f355ca5a4450'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:30:07.805931 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-33a0101c-fcf2-4bf2-b88d-e250ea43b2ad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:29:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['51b84bbe-6de2-4db7-8c1e-f355ca5a4450'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:07.843106 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-71218ef0-5c69-463b-a80d-19438daea2b1 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:07.844299 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-71218ef0-5c69-463b-a80d-19438daea2b1 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 884 time: 8.7075746 Nov 09 04:30:07.848322 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54320) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:07.849217 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-5c60bd79-a2fb-4b3c-9733-e9d3b2d924ac tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Deleting port 2823e6dd-4131-49b8-8603-11ac168db9e5 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:30:07.849600 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5c60bd79-a2fb-4b3c-9733-e9d3b2d924ac tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:07.856520 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1610a6f4-9648-4f5f-b773-a160ffd56689 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 792 time: 2.6276534 Nov 09 04:30:07.860968 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54322) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:07.862993 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-75a549b1-2efc-4861-8523-cbbf0c83d2d2 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:07.865391 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-33a0101c-fcf2-4bf2-b88d-e250ea43b2ad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:07.867644 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-75a549b1-2efc-4861-8523-cbbf0c83d2d2 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:07.873814 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-75a549b1-2efc-4861-8523-cbbf0c83d2d2 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] 10.222.0.24 "DELETE /v2.0/networks/6b78e150-9412-4145-a432-680e4456364c HTTP/1.1" status: 204 len: 168 time: 2.2025812 Nov 09 04:30:07.888959 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-33a0101c-fcf2-4bf2-b88d-e250ea43b2ad None None] Routers {'51b84bbe-6de2-4db7-8c1e-f355ca5a4450'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:30:07.889585 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-33a0101c-fcf2-4bf2-b88d-e250ea43b2ad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:29:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['51b84bbe-6de2-4db7-8c1e-f355ca5a4450'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:07.943276 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-33a0101c-fcf2-4bf2-b88d-e250ea43b2ad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:07.943916 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-33a0101c-fcf2-4bf2-b88d-e250ea43b2ad None None] The sync data for ids ['51b84bbe-6de2-4db7-8c1e-f355ca5a4450'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:30:07.949771 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6c0ad546-f524-4506-9740-2726b3b53c39 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:07.956704 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6c0ad546-f524-4506-9740-2726b3b53c39 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:07.956704 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-6c0ad546-f524-4506-9740-2726b3b53c39 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "DELETE /v2.0/security-groups/67cb2d36-e38c-4a29-adb5-c52b1d94ae99 HTTP/1.1" status: 204 len: 168 time: 0.6330349 Nov 09 04:30:07.960514 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75a549b1-2efc-4861-8523-cbbf0c83d2d2 tempest-ExtraDHCPOptionsTestJSON-879591885 tempest-ExtraDHCPOptionsTestJSON-879591885-project] Pushing event deleted for resources: {'Network': ['ID=6b78e150-9412-4145-a432-680e4456364c,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:07.967059 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54326) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:08.009553 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c0ad546-f524-4506-9740-2726b3b53c39 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=67cb2d36-e38c-4a29-adb5-c52b1d94ae99,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:08.015364 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-dc336c47-941f-4be5-917a-86d81a9e5cac tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:08.016217 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-41ff4bb1-36c8-4f25-b272-e91fb537032a tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Deleting port 98ddb3ce-d420-4085-ac57-516c83b02a51 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:30:08.022019 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-41ff4bb1-36c8-4f25-b272-e91fb537032a tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:08.069549 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-dc336c47-941f-4be5-917a-86d81a9e5cac tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:08.074022 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-dc336c47-941f-4be5-917a-86d81a9e5cac tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "DELETE /v2.0/networks/41b6a30b-1a07-4d4e-bb4c-2047225fca0a HTTP/1.1" status: 204 len: 168 time: 1.0072062 Nov 09 04:30:08.087796 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54328) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:08.107687 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc336c47-941f-4be5-917a-86d81a9e5cac tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Pushing event deleted for resources: {'Network': ['ID=41b6a30b-1a07-4d4e-bb4c-2047225fca0a,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:08.114195 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.api.v2.resource [None req-592492b5-3e1c-48e9-95bf-90c3ce5f1ef7 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] show failed (client error): The resource could not be found. Nov 09 04:30:08.115655 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-592492b5-3e1c-48e9-95bf-90c3ce5f1ef7 tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "GET /v2.0/security-groups/67cb2d36-e38c-4a29-adb5-c52b1d94ae99 HTTP/1.1" status: 404 len: 347 time: 0.1472282 Nov 09 04:30:08.120091 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54330) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:08.139829 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5c60bd79-a2fb-4b3c-9733-e9d3b2d924ac tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:08.175879 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 0acfa6cc-c45a-41fc-920a-0ef63d0600d0 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:30:08.214936 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-12155311-5390-400c-a948-2909fe02d36a tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] DELETE failed (client error): The resource could not be found. Nov 09 04:30:08.215439 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-12155311-5390-400c-a948-2909fe02d36a tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:30:08.218683 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-12155311-5390-400c-a948-2909fe02d36a tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "DELETE /v2.0/subnets/7e9c0a67-7fb1-46d2-a997-840c08842925 HTTP/1.1" status: 404 len: 337 time: 0.1280408 Nov 09 04:30:08.233180 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 0acfa6cc-c45a-41fc-920a-0ef63d0600d0 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:30:08.233526 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 0acfa6cc-c45a-41fc-920a-0ef63d0600d0 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:30:08.237253 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54332) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:08.263607 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-5c60bd79-a2fb-4b3c-9733-e9d3b2d924ac tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Calling delete_port for 2823e6dd-4131-49b8-8603-11ac168db9e5 owned by {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:30:08.292110 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-c6d404b3-f0d6-46a6-8815-f56cb6af737f tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] DELETE failed (client error): The resource could not be found. Nov 09 04:30:08.292214 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c6d404b3-f0d6-46a6-8815-f56cb6af737f tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:30:08.295387 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-c6d404b3-f0d6-46a6-8815-f56cb6af737f tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "DELETE /v2.0/networks/329cc1ac-ceba-413f-a143-1180da7319e5 HTTP/1.1" status: 404 len: 339 time: 0.0520692 Nov 09 04:30:08.310150 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a25e7bf9-3179-4f2a-9dca-386735852ae7 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-58a373ab-b4cf-47d5-bc63-c38afd9d795e', 'network_id': '58a373ab-b4cf-47d5-bc63-c38afd9d795e', 'tenant_id': '6761c80dbfa84798bb6517a9b532f870', 'fixed_ips': [{'subnet_id': '8e52d510-3a3d-4e0d-bb67-46938c0bbbc3'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:30:08.312248 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54334) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:08.316084 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a25e7bf9-3179-4f2a-9dca-386735852ae7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:08.324195 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-22362d8a-34da-4d1f-b2e0-07ba5599be28 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] 10.222.0.24 "GET /v2.0/routers/51b84bbe-6de2-4db7-8c1e-f355ca5a4450 HTTP/1.1" status: 200 len: 920 time: 0.4713256 Nov 09 04:30:08.330754 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54336) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:08.368262 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ef4ab40f-b8b0-4a34-9a4c-e8c6d5e8ee12 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:08.374227 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-252c622f-6287-400f-9532-b225ef81b2c2 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] 10.222.0.24 "GET /v2.0/ports?device_id=51b84bbe-6de2-4db7-8c1e-f355ca5a4450 HTTP/1.1" status: 200 len: 205 time: 0.0382977 Nov 09 04:30:08.375082 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54338) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:08.461342 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-337afe7c-7b17-43c6-bdf7-f506330ea35a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:08.466757 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:30:08.485127 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-e05da7ff-5e2c-4f09-ab0e-911376ccd0fd tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Deleting port ee6a6aa8-5180-4983-aa6f-d63bd4571faf {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:30:08.485511 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e05da7ff-5e2c-4f09-ab0e-911376ccd0fd tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:08.505249 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-41ff4bb1-36c8-4f25-b272-e91fb537032a tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:08.505955 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-41ff4bb1-36c8-4f25-b272-e91fb537032a tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:08.537697 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-c58ce9e2-bf95-430a-99c9-36c2839fa9b9 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Deleting subnet 67887e10-7c7f-49fd-bc98-a6e0f6ba455f {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:30:08.539152 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-a25e7bf9-3179-4f2a-9dca-386735852ae7 None None] Allocated IP 172.20.0.3 (58a373ab-b4cf-47d5-bc63-c38afd9d795e/8e52d510-3a3d-4e0d-bb67-46938c0bbbc3/82792a05-aff7-40d4-96e6-1defa130dd07) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:30:08.551112 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c58ce9e2-bf95-430a-99c9-36c2839fa9b9 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:08.554122 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-41ff4bb1-36c8-4f25-b272-e91fb537032a tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Calling delete_port for 98ddb3ce-d420-4085-ac57-516c83b02a51 owned by network:floatingip {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:30:08.564625 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54342) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:08.591869 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-14b8a188-759d-4812-ac6e-6a52b66017cb tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks [] for router, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:08.644155 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e05da7ff-5e2c-4f09-ab0e-911376ccd0fd tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:08.644155 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e05da7ff-5e2c-4f09-ab0e-911376ccd0fd tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:08.665852 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-e05da7ff-5e2c-4f09-ab0e-911376ccd0fd tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Calling delete_port for ee6a6aa8-5180-4983-aa6f-d63bd4571faf owned by network:floatingip {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:30:08.737033 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c58ce9e2-bf95-430a-99c9-36c2839fa9b9 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:08.780172 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-337afe7c-7b17-43c6-bdf7-f506330ea35a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:08.791648 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a25e7bf9-3179-4f2a-9dca-386735852ae7 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:08.800649 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-14b8a188-759d-4812-ac6e-6a52b66017cb tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks [] for router_gateway, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:08.840468 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-0f61be75-e9d3-469e-838e-f9e2cb8004ee admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=44afe8e54a5c466e95915d5c99458492&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2723851 Nov 09 04:30:08.843199 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54346) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:08.847398 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5c60bd79-a2fb-4b3c-9733-e9d3b2d924ac tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:08.874942 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a25e7bf9-3179-4f2a-9dca-386735852ae7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:08.923195 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c60bd79-a2fb-4b3c-9733-e9d3b2d924ac tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Pushing event deleted for resources: {'Port': ['ID=2823e6dd-4131-49b8-8603-11ac168db9e5,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:08.942748 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a25e7bf9-3179-4f2a-9dca-386735852ae7 None None] Network 58a373ab-b4cf-47d5-bc63-c38afd9d795e is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:30:08.944179 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a25e7bf9-3179-4f2a-9dca-386735852ae7 None None] Pushing event updated for resources: {'Port': ['ID=82792a05-aff7-40d4-96e6-1defa130dd07,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:08.948091 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-a25e7bf9-3179-4f2a-9dca-386735852ae7 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:08.953883 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a25e7bf9-3179-4f2a-9dca-386735852ae7 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:30:08.970025 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5c60bd79-a2fb-4b3c-9733-e9d3b2d924ac tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:08.977719 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-5c60bd79-a2fb-4b3c-9733-e9d3b2d924ac tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] 10.222.0.24 "DELETE /v2.0/ports/2823e6dd-4131-49b8-8603-11ac168db9e5 HTTP/1.1" status: 204 len: 168 time: 1.7608092 Nov 09 04:30:08.984457 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54348) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:08.993716 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9a784bb2-24e1-4f9f-a628-4216248d8973 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:09.020315 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-a25e7bf9-3179-4f2a-9dca-386735852ae7 None None] Attempting to bind port 82792a05-aff7-40d4-96e6-1defa130dd07 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:30:09.020728 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-a25e7bf9-3179-4f2a-9dca-386735852ae7 None None] Attempting to bind port 82792a05-aff7-40d4-96e6-1defa130dd07 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '475198c2-ff54-4d05-b1e3-952bc396c422', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 305, 'network_id': '58a373ab-b4cf-47d5-bc63-c38afd9d795e'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:30:09.021089 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a25e7bf9-3179-4f2a-9dca-386735852ae7 None None] Attempting to bind port 82792a05-aff7-40d4-96e6-1defa130dd07 on network 58a373ab-b4cf-47d5-bc63-c38afd9d795e {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:30:09.025903 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9a784bb2-24e1-4f9f-a628-4216248d8973 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:09.027119 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a25e7bf9-3179-4f2a-9dca-386735852ae7 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 29, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:30:09.027500 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a25e7bf9-3179-4f2a-9dca-386735852ae7 None None] Checking segment: {'id': '475198c2-ff54-4d05-b1e3-952bc396c422', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 305, 'network_id': '58a373ab-b4cf-47d5-bc63-c38afd9d795e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:30:09.027899 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a25e7bf9-3179-4f2a-9dca-386735852ae7 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:09.028343 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a25e7bf9-3179-4f2a-9dca-386735852ae7 None None] Bound using segment: {'id': '475198c2-ff54-4d05-b1e3-952bc396c422', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 305, 'network_id': '58a373ab-b4cf-47d5-bc63-c38afd9d795e'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:30:09.028828 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-a25e7bf9-3179-4f2a-9dca-386735852ae7 None None] Bound port: 82792a05-aff7-40d4-96e6-1defa130dd07, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '475198c2-ff54-4d05-b1e3-952bc396c422', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 305, 'network_id': '58a373ab-b4cf-47d5-bc63-c38afd9d795e'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:30:09.029204 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a25e7bf9-3179-4f2a-9dca-386735852ae7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:09.035604 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-fa0df4ab-033c-4a6d-ad15-9beae46a18f2 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] 10.222.0.24 "GET /v2.0/ports HTTP/1.1" status: 200 len: 205 time: 0.0448489 Nov 09 04:30:09.039383 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54350) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:09.046684 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-14b1b0e5-6c63-4aef-831e-762b0ce1e9e6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsTest-test-network-1581423049'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:09.051583 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c58ce9e2-bf95-430a-99c9-36c2839fa9b9 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:09.075441 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e05da7ff-5e2c-4f09-ab0e-911376ccd0fd tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:09.105408 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-a25e7bf9-3179-4f2a-9dca-386735852ae7 None None] For port 82792a05-aff7-40d4-96e6-1defa130dd07, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:30:09.113395 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-337afe7c-7b17-43c6-bdf7-f506330ea35a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:09.138763 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e05da7ff-5e2c-4f09-ab0e-911376ccd0fd tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Pushing event deleted for resources: {'Port': ['ID=ee6a6aa8-5180-4983-aa6f-d63bd4571faf,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:09.182875 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-337afe7c-7b17-43c6-bdf7-f506330ea35a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event deleted for resources: {'Subnet': ['ID=8e52d510-3a3d-4e0d-bb67-46938c0bbbc3,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:09.195167 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e05da7ff-5e2c-4f09-ab0e-911376ccd0fd tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Publish callbacks [] for floatingip, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:09.197961 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e05da7ff-5e2c-4f09-ab0e-911376ccd0fd tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:09.202647 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e05da7ff-5e2c-4f09-ab0e-911376ccd0fd tempest-ServersTestJSON-786487519 tempest-ServersTestJSON-786487519-project] 10.222.0.24 "DELETE /v2.0/floatingips/b6e50ee2-5399-49fe-a1c4-7571e8730316 HTTP/1.1" status: 204 len: 168 time: 1.0783787 Nov 09 04:30:09.202647 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-14b8a188-759d-4812-ac6e-6a52b66017cb tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Deleting port 33f4adf6-1014-4635-a602-f043b882a9ea {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:30:09.202647 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-14b8a188-759d-4812-ac6e-6a52b66017cb tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:09.205319 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54352) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:09.234518 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9a784bb2-24e1-4f9f-a628-4216248d8973 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:09.236300 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-a25e7bf9-3179-4f2a-9dca-386735852ae7 None None] For port 82792a05-aff7-40d4-96e6-1defa130dd07, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=82792a05-aff7-40d4-96e6-1defa130dd07,segment=NetworkSegment(475198c2-ff54-4d05-b1e3-952bc396c422),segment_id=475198c2-ff54-4d05-b1e3-952bc396c422)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:30:09.237127 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9a784bb2-24e1-4f9f-a628-4216248d8973 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:09.241499 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-9a784bb2-24e1-4f9f-a628-4216248d8973 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/16bc60ab-fbaf-486d-a736-20c8c8259b90 HTTP/1.1" status: 204 len: 168 time: 0.3947363 Nov 09 04:30:09.295551 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-41ff4bb1-36c8-4f25-b272-e91fb537032a tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:09.297436 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-14b1b0e5-6c63-4aef-831e-762b0ce1e9e6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Made reservation on behalf of 2f077d8d6e0c4af98a4ce8fbe06ce9d4 for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:30:09.301494 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-14b1b0e5-6c63-4aef-831e-762b0ce1e9e6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:09.342799 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a25e7bf9-3179-4f2a-9dca-386735852ae7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:09.343503 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-337afe7c-7b17-43c6-bdf7-f506330ea35a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:09.455383 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a25e7bf9-3179-4f2a-9dca-386735852ae7 None None] Pushing event updated for resources: {'Port': ['ID=82792a05-aff7-40d4-96e6-1defa130dd07,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:09.652216 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c58ce9e2-bf95-430a-99c9-36c2839fa9b9 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:09.662335 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41ff4bb1-36c8-4f25-b272-e91fb537032a tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Pushing event deleted for resources: {'Port': ['ID=98ddb3ce-d420-4085-ac57-516c83b02a51,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:09.713814 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-337afe7c-7b17-43c6-bdf7-f506330ea35a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['58a373ab-b4cf-47d5-bc63-c38afd9d795e']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:09.728504 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a784bb2-24e1-4f9f-a628-4216248d8973 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=16bc60ab-fbaf-486d-a736-20c8c8259b90,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:09.748288 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c58ce9e2-bf95-430a-99c9-36c2839fa9b9 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Pushing event deleted for resources: {'Subnet': ['ID=67887e10-7c7f-49fd-bc98-a6e0f6ba455f,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:09.769570 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c58ce9e2-bf95-430a-99c9-36c2839fa9b9 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:09.772802 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-c58ce9e2-bf95-430a-99c9-36c2839fa9b9 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "DELETE /v2.0/subnets/67887e10-7c7f-49fd-bc98-a6e0f6ba455f HTTP/1.1" status: 204 len: 168 time: 1.4594989 Nov 09 04:30:09.774765 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-337afe7c-7b17-43c6-bdf7-f506330ea35a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '475198c2-ff54-4d05-b1e3-952bc396c422') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:09.775039 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-337afe7c-7b17-43c6-bdf7-f506330ea35a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '475198c2-ff54-4d05-b1e3-952bc396c422') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:09.778011 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54362) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:09.803504 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-14b1b0e5-6c63-4aef-831e-762b0ce1e9e6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 306} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:30:09.812581 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-337afe7c-7b17-43c6-bdf7-f506330ea35a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:09.846291 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-14b1b0e5-6c63-4aef-831e-762b0ce1e9e6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:09.846659 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-14b1b0e5-6c63-4aef-831e-762b0ce1e9e6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Added segment dc817592-f56a-425b-948a-1516f6b1beb7 of type vlan for network 2407b60d-e30f-478f-a68d-2bf482c2f5f4 Nov 09 04:30:09.861169 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ef4ab40f-b8b0-4a34-9a4c-e8c6d5e8ee12 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:09.863442 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-337afe7c-7b17-43c6-bdf7-f506330ea35a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:09.891674 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-337afe7c-7b17-43c6-bdf7-f506330ea35a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Releasing vlan 305 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:30:09.892078 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-337afe7c-7b17-43c6-bdf7-f506330ea35a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:09.908857 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-799ac3a2-51a1-4500-817a-2586ef310462 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Deleting subnet 56601af2-58d8-42dc-ba43-94f41f0243d4 {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:30:09.912114 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:30:09.912114 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:30:09.912114 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:30:09.912114 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:30:09.912114 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:30:09.912114 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:30:09.912114 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:30:09.912114 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:30:09.912114 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:30:09.912114 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:30:09.912114 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:30:09.912114 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:30:09.912114 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:30:09.912114 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:30:09.912114 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:30:09.912114 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:30:09.912114 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:30:09.912114 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:30:09.912114 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:30:09.912114 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:30:09.912114 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:30:09.912114 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:30:09.912114 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:30:09.912114 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:30:09.912114 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:30:09.912114 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:30:09.912114 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:30:09.912114 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:30:09.912114 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:30:09.912114 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:30:09.912114 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:30:09.912114 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:30:09.914257 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ef4ab40f-b8b0-4a34-9a4c-e8c6d5e8ee12 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:09.916763 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-14b8a188-759d-4812-ac6e-6a52b66017cb tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:09.917368 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-41ff4bb1-36c8-4f25-b272-e91fb537032a tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Publish callbacks [] for floatingip, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:09.919959 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-41ff4bb1-36c8-4f25-b272-e91fb537032a tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:09.928454 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-41ff4bb1-36c8-4f25-b272-e91fb537032a tempest-ServersTestManualDisk-1432939749 tempest-ServersTestManualDisk-1432939749-project] 10.222.0.24 "DELETE /v2.0/floatingips/00824cf7-be58-475c-a1dc-142d27e3cda6 HTTP/1.1" status: 204 len: 168 time: 2.7031913 Nov 09 04:30:09.928645 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-799ac3a2-51a1-4500-817a-2586ef310462 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:09.929228 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54366) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:10.020015 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-14b8a188-759d-4812-ac6e-6a52b66017cb tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Calling delete_port for 33f4adf6-1014-4635-a602-f043b882a9ea owned by network:router_gateway {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:30:10.070705 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-14b1b0e5-6c63-4aef-831e-762b0ce1e9e6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:10.089004 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-799ac3a2-51a1-4500-817a-2586ef310462 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:10.106761 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 82792a05-aff7-40d4-96e6-1defa130dd07 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:30:10.137148 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-ef4ab40f-b8b0-4a34-9a4c-e8c6d5e8ee12 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Allocated IP 172.26.0.153 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/aff23a33-a3ae-4f92-a35a-dc548a11d22e) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:30:10.139917 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.db.api [None req-337afe7c-7b17-43c6-bdf7-f506330ea35a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Nov 09 04:30:10.139917 dv-neutron-816802-2-hyperv neutron-server[102161]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Nov 09 04:30:10.139917 dv-neutron-816802-2-hyperv neutron-server[102161]: [parameters: {'id': '58a373ab-b4cf-47d5-bc63-c38afd9d795e'}] Nov 09 04:30:10.139917 dv-neutron-816802-2-hyperv neutron-server[102161]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=102161) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:30:10.140262 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG oslo_db.api [None req-337afe7c-7b17-43c6-bdf7-f506330ea35a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:30:10.178902 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 82792a05-aff7-40d4-96e6-1defa130dd07 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:30:10.179276 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:10.222478 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-14b1b0e5-6c63-4aef-831e-762b0ce1e9e6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:10.245504 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-14b1b0e5-6c63-4aef-831e-762b0ce1e9e6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:10.249324 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-14b1b0e5-6c63-4aef-831e-762b0ce1e9e6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:10.325760 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:10.379659 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 82792a05-aff7-40d4-96e6-1defa130dd07, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=82792a05-aff7-40d4-96e6-1defa130dd07,segment=NetworkSegment(475198c2-ff54-4d05-b1e3-952bc396c422),segment_id=475198c2-ff54-4d05-b1e3-952bc396c422)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:30:10.397962 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-14b1b0e5-6c63-4aef-831e-762b0ce1e9e6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 786 time: 1.3573601 Nov 09 04:30:10.402298 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54376) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:10.410992 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-4c8b585e-bc98-49fc-9d96-41d8f822232f tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsTest-test-network-881405318'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:10.417313 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14b1b0e5-6c63-4aef-831e-762b0ce1e9e6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Pushing event updated for resources: {'Network': ['ID=2407b60d-e30f-478f-a68d-2bf482c2f5f4,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:10.429019 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 2407b60d-e30f-478f-a68d-2bf482c2f5f4 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:30:10.447105 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-799ac3a2-51a1-4500-817a-2586ef310462 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:10.457265 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ef4ab40f-b8b0-4a34-9a4c-e8c6d5e8ee12 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:10.511031 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:10.542396 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4c8b585e-bc98-49fc-9d96-41d8f822232f tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Made reservation on behalf of 2f077d8d6e0c4af98a4ce8fbe06ce9d4 for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:30:10.547614 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4c8b585e-bc98-49fc-9d96-41d8f822232f tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:10.581550 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ef4ab40f-b8b0-4a34-9a4c-e8c6d5e8ee12 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:10.595209 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=82792a05-aff7-40d4-96e6-1defa130dd07,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:10.644304 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-337afe7c-7b17-43c6-bdf7-f506330ea35a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:10.649247 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4c8b585e-bc98-49fc-9d96-41d8f822232f tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 349} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:30:10.653960 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54380) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:10.687334 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e89f7dbf-dc73-4b06-b3f2-c6b8aabd1f88 None None] get_active_networks_info from dv-neutron-816802-2-hyperv {{(pid=102163) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}} Nov 09 04:30:10.706607 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4c8b585e-bc98-49fc-9d96-41d8f822232f tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:10.707001 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-4c8b585e-bc98-49fc-9d96-41d8f822232f tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Added segment 5eddcc50-ff24-4ae6-9020-82b9642df813 of type vlan for network 7399bb70-27fb-4f3b-a5c5-a5ac1c4dc8d3 Nov 09 04:30:10.709457 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ef4ab40f-b8b0-4a34-9a4c-e8c6d5e8ee12 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:30:10.724493 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-ef4ab40f-b8b0-4a34-9a4c-e8c6d5e8ee12 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:10.728982 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef4ab40f-b8b0-4a34-9a4c-e8c6d5e8ee12 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Pushing event updated for resources: {'Port': ['ID=aff23a33-a3ae-4f92-a35a-dc548a11d22e,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:10.749051 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ef4ab40f-b8b0-4a34-9a4c-e8c6d5e8ee12 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:30:10.755131 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-799ac3a2-51a1-4500-817a-2586ef310462 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:10.787252 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4c8b585e-bc98-49fc-9d96-41d8f822232f tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:10.815554 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-52268442-f797-4fb3-b75b-aa70b2ba2428 None None] Provisioning complete for port 82792a05-aff7-40d4-96e6-1defa130dd07 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:30:10.815929 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-52268442-f797-4fb3-b75b-aa70b2ba2428 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:10.820129 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-82f794ef-1d60-43ae-bf00-5c0da57e6ef3 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-test-network-1749077381'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:10.822504 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-799ac3a2-51a1-4500-817a-2586ef310462 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Pushing event deleted for resources: {'Subnet': ['ID=56601af2-58d8-42dc-ba43-94f41f0243d4,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:10.838790 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-799ac3a2-51a1-4500-817a-2586ef310462 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:10.844439 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-799ac3a2-51a1-4500-817a-2586ef310462 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "DELETE /v2.0/subnets/56601af2-58d8-42dc-ba43-94f41f0243d4 HTTP/1.1" status: 204 len: 168 time: 1.0614710 Nov 09 04:30:10.844439 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-14b8a188-759d-4812-ac6e-6a52b66017cb tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:10.846560 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54384) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:10.890755 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e89f7dbf-dc73-4b06-b3f2-c6b8aabd1f88 None None] Resources bound (agent type, host, resource id): {{(pid=102163) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 09 04:30:10.941726 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4c8b585e-bc98-49fc-9d96-41d8f822232f tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:10.946112 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14b8a188-759d-4812-ac6e-6a52b66017cb tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Pushing event deleted for resources: {'Port': ['ID=33f4adf6-1014-4635-a602-f043b882a9ea,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:10.947303 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4c8b585e-bc98-49fc-9d96-41d8f822232f tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:10.948220 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4c8b585e-bc98-49fc-9d96-41d8f822232f tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:11.028414 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-82f794ef-1d60-43ae-bf00-5c0da57e6ef3 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Made reservation on behalf of 88f9f8da29bf4a8793b45130d483a6e6 for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:30:11.033177 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-82f794ef-1d60-43ae-bf00-5c0da57e6ef3 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:11.068396 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-87dc0cf5-d207-4b52-a012-fcf44bf9bd03 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:11.092158 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-82f794ef-1d60-43ae-bf00-5c0da57e6ef3 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:11.113155 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-54d638f4-41be-41fd-abf4-ef878a215e13 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:11.113392 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-4c8b585e-bc98-49fc-9d96-41d8f822232f tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 785 time: 0.7053046 Nov 09 04:30:11.114770 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-337afe7c-7b17-43c6-bdf7-f506330ea35a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Deleting port 82792a05-aff7-40d4-96e6-1defa130dd07 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:30:11.115115 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-337afe7c-7b17-43c6-bdf7-f506330ea35a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:11.120832 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-14b8a188-759d-4812-ac6e-6a52b66017cb tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-466373'] for router_gateway, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:11.188096 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-337afe7c-7b17-43c6-bdf7-f506330ea35a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] For port 82792a05-aff7-40d4-96e6-1defa130dd07, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=82792a05-aff7-40d4-96e6-1defa130dd07,segment=NetworkSegment(475198c2-ff54-4d05-b1e3-952bc396c422),segment_id=475198c2-ff54-4d05-b1e3-952bc396c422)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:30:11.188472 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-337afe7c-7b17-43c6-bdf7-f506330ea35a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:11.204797 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c8b585e-bc98-49fc-9d96-41d8f822232f tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Pushing event updated for resources: {'Network': ['ID=7399bb70-27fb-4f3b-a5c5-a5ac1c4dc8d3,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:11.209786 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-337afe7c-7b17-43c6-bdf7-f506330ea35a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Calling delete_port for 82792a05-aff7-40d4-96e6-1defa130dd07 owned by network:dhcp {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:30:11.245189 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 7399bb70-27fb-4f3b-a5c5-a5ac1c4dc8d3 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:30:11.274805 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54386) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:11.274805 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-7db74699-7b33-41bb-a603-0fe81d8c5857 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Request body: {'subnets': [{'network_id': '2407b60d-e30f-478f-a68d-2bf482c2f5f4', 'cidr': '172.20.0.0/28', 'name': 'tempest-subnet--1233061326', 'ip_version': 4}, {'network_id': '7399bb70-27fb-4f3b-a5c5-a5ac1c4dc8d3', 'cidr': '172.20.0.16/28', 'ip_version': 4}]} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:11.274805 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-7db74699-7b33-41bb-a603-0fe81d8c5857 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Request body: {'subnet': {'network_id': '2407b60d-e30f-478f-a68d-2bf482c2f5f4', 'cidr': '172.20.0.0/28', 'name': 'tempest-subnet--1233061326', 'ip_version': 4}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:11.274805 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-7db74699-7b33-41bb-a603-0fe81d8c5857 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Request body: {'subnet': {'network_id': '7399bb70-27fb-4f3b-a5c5-a5ac1c4dc8d3', 'cidr': '172.20.0.16/28', 'ip_version': 4}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:11.284341 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6882c62e-2f3d-4a66-b596-04172fce1c41 None None] Network 58a373ab-b4cf-47d5-bc63-c38afd9d795e requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:30:11.293999 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-709bcd0d-031e-4819-8454-5e0af604a60c None None] Network 041287e3-92a1-4b58-9250-6007d559460c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:30:11.314598 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-14b8a188-759d-4812-ac6e-6a52b66017cb tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:11.321469 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-14b8a188-759d-4812-ac6e-6a52b66017cb tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:11.420221 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-15ebdcc1-8252-4115-9a89-9fbcf2ef7a2e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:11.455445 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-87dc0cf5-d207-4b52-a012-fcf44bf9bd03 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Deleting port 7c7cc4d1-9c07-4b9b-a732-a565794fd426 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:30:11.455698 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-87dc0cf5-d207-4b52-a012-fcf44bf9bd03 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:11.511268 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-14b8a188-759d-4812-ac6e-6a52b66017cb tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:11.511268 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-14b8a188-759d-4812-ac6e-6a52b66017cb tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Fanout notify agent at l3_agent the message router_deleted on router 51b84bbe-6de2-4db7-8c1e-f355ca5a4450 {{(pid=102162) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:30:11.519686 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-14b8a188-759d-4812-ac6e-6a52b66017cb tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:11.524872 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-14b8a188-759d-4812-ac6e-6a52b66017cb tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] 10.222.0.24 "DELETE /v2.0/routers/51b84bbe-6de2-4db7-8c1e-f355ca5a4450 HTTP/1.1" status: 204 len: 168 time: 3.1485507 Nov 09 04:30:11.532215 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54388) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:11.563709 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-82f794ef-1d60-43ae-bf00-5c0da57e6ef3 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:11.567761 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-0b2baa7e-6fbd-4263-a245-f5ef2ba6b1bf tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Request body: {'router': {'name': 'tempest-snat-router-55453648', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'enable_snat': False}}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:11.570652 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ef4ab40f-b8b0-4a34-9a4c-e8c6d5e8ee12 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:11.581811 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c2b6e3cb-9ede-4838-a61b-1987677949a5 None None] Network 58a373ab-b4cf-47d5-bc63-c38afd9d795e requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:30:11.603298 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-87dc0cf5-d207-4b52-a012-fcf44bf9bd03 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] For port 7c7cc4d1-9c07-4b9b-a732-a565794fd426, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=7c7cc4d1-9c07-4b9b-a732-a565794fd426,segment=NetworkSegment(aa07db52-653c-41c6-ba4b-e0dd8f0b1051),segment_id=aa07db52-653c-41c6-ba4b-e0dd8f0b1051)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:30:11.603671 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-87dc0cf5-d207-4b52-a012-fcf44bf9bd03 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:11.616733 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-44c2f08c-2075-4f41-8562-ab71c518e343 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:11.656125 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-87dc0cf5-d207-4b52-a012-fcf44bf9bd03 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Calling delete_port for 7c7cc4d1-9c07-4b9b-a732-a565794fd426 owned by network:dhcp {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:30:11.662381 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-82f794ef-1d60-43ae-bf00-5c0da57e6ef3 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:11.711032 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-29c4dcc7-df95-4017-8825-779a2140f082 None None] DHCP port deletion for 041287e3-92a1-4b58-9250-6007d559460c request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:30:11.727137 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-337afe7c-7b17-43c6-bdf7-f506330ea35a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:11.745267 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-82f794ef-1d60-43ae-bf00-5c0da57e6ef3 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 315} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:30:11.754581 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0b2baa7e-6fbd-4263-a245-f5ef2ba6b1bf tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:11.755609 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0b2baa7e-6fbd-4263-a245-f5ef2ba6b1bf tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:11.781930 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82f794ef-1d60-43ae-bf00-5c0da57e6ef3 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event updated for resources: {'SecurityGroup': ['ID=93a8d386-4318-4da6-951d-9b8ee3c4f24a,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:11.795401 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-337afe7c-7b17-43c6-bdf7-f506330ea35a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event deleted for resources: {'Port': ['ID=82792a05-aff7-40d4-96e6-1defa130dd07,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:11.805303 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-337afe7c-7b17-43c6-bdf7-f506330ea35a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] No DVR routers for this DVR port 82792a05-aff7-40d4-96e6-1defa130dd07 on host dv-neutron-816802-2-hyperv {{(pid=102161) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:30:11.810859 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-82f794ef-1d60-43ae-bf00-5c0da57e6ef3 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:11.811211 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-82f794ef-1d60-43ae-bf00-5c0da57e6ef3 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Added segment 5cb8d89b-c83c-4beb-ac61-4edae91bc9e8 of type vlan for network cc397c48-c4cc-4846-a1ef-380b64be450d Nov 09 04:30:11.820281 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-29c4dcc7-df95-4017-8825-779a2140f082 None None] Deleting port 7c7cc4d1-9c07-4b9b-a732-a565794fd426 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:30:11.820885 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-29c4dcc7-df95-4017-8825-779a2140f082 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:11.898087 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7db74699-7b33-41bb-a603-0fe81d8c5857 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Made reservation on behalf of 2f077d8d6e0c4af98a4ce8fbe06ce9d4 for: {'subnet': 2} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:30:11.900831 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-177721e7-006a-4c22-82f2-ad8560d85803 None None] DHCP port deletion for 58a373ab-b4cf-47d5-bc63-c38afd9d795e request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:30:11.902888 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7db74699-7b33-41bb-a603-0fe81d8c5857 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:11.903234 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7db74699-7b33-41bb-a603-0fe81d8c5857 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:11.922510 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-29c4dcc7-df95-4017-8825-779a2140f082 None None] For port 7c7cc4d1-9c07-4b9b-a732-a565794fd426, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=7c7cc4d1-9c07-4b9b-a732-a565794fd426,segment=NetworkSegment(aa07db52-653c-41c6-ba4b-e0dd8f0b1051),segment_id=aa07db52-653c-41c6-ba4b-e0dd8f0b1051)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:30:11.923643 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-29c4dcc7-df95-4017-8825-779a2140f082 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:11.943063 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-29c4dcc7-df95-4017-8825-779a2140f082 None None] Calling delete_port for 7c7cc4d1-9c07-4b9b-a732-a565794fd426 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:30:12.071636 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 7c7cc4d1-9c07-4b9b-a732-a565794fd426 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:30:12.095739 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0b2baa7e-6fbd-4263-a245-f5ef2ba6b1bf tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:12.096274 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:12.098118 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-82f794ef-1d60-43ae-bf00-5c0da57e6ef3 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:12.148805 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-337afe7c-7b17-43c6-bdf7-f506330ea35a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:12.151822 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:12.188912 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ef4ab40f-b8b0-4a34-9a4c-e8c6d5e8ee12 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-466202', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-464271', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-936'] for router, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:12.236466 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-337afe7c-7b17-43c6-bdf7-f506330ea35a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['58a373ab-b4cf-47d5-bc63-c38afd9d795e']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:12.257193 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ef4ab40f-b8b0-4a34-9a4c-e8c6d5e8ee12 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-466195', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-466408', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-464260'] for router, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:12.277134 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-54d638f4-41be-41fd-abf4-ef878a215e13 admin admin] Deleting port 76f630f8-c464-46b2-b3b3-6a4c815cc2cf {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:30:12.277676 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-54d638f4-41be-41fd-abf4-ef878a215e13 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:12.287792 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.db.api [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Nov 09 04:30:12.287792 dv-neutron-816802-2-hyperv neutron-server[102163]: [SQL: UPDATE ports SET `status`=%(status)s WHERE ports.id = %(ports_id)s] Nov 09 04:30:12.287792 dv-neutron-816802-2-hyperv neutron-server[102163]: [parameters: {'status': 'DOWN', 'ports_id': '7c7cc4d1-9c07-4b9b-a732-a565794fd426'}] Nov 09 04:30:12.287792 dv-neutron-816802-2-hyperv neutron-server[102163]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=102163) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:30:12.288563 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-337afe7c-7b17-43c6-bdf7-f506330ea35a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '475198c2-ff54-4d05-b1e3-952bc396c422') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:12.288687 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG oslo_db.api [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:30:12.288779 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-337afe7c-7b17-43c6-bdf7-f506330ea35a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '475198c2-ff54-4d05-b1e3-952bc396c422') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:12.307425 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-337afe7c-7b17-43c6-bdf7-f506330ea35a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:12.309700 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-29c4dcc7-df95-4017-8825-779a2140f082 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:12.318328 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-87dc0cf5-d207-4b52-a012-fcf44bf9bd03 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:12.344672 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-29c4dcc7-df95-4017-8825-779a2140f082 None None] No DVR routers for this DVR port 7c7cc4d1-9c07-4b9b-a732-a565794fd426 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:30:12.350352 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29c4dcc7-df95-4017-8825-779a2140f082 None None] Pushing event deleted for resources: {'Port': ['ID=7c7cc4d1-9c07-4b9b-a732-a565794fd426,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:12.388758 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-87dc0cf5-d207-4b52-a012-fcf44bf9bd03 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] No DVR routers for this DVR port 7c7cc4d1-9c07-4b9b-a732-a565794fd426 on host dv-neutron-816802-2-hyperv {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:30:12.390373 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87dc0cf5-d207-4b52-a012-fcf44bf9bd03 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Pushing event deleted for resources: {'Port': ['ID=7c7cc4d1-9c07-4b9b-a732-a565794fd426,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:12.521088 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-87dc0cf5-d207-4b52-a012-fcf44bf9bd03 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:12.524753 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-54d638f4-41be-41fd-abf4-ef878a215e13 admin admin] For port 76f630f8-c464-46b2-b3b3-6a4c815cc2cf, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=76f630f8-c464-46b2-b3b3-6a4c815cc2cf,segment=NetworkSegment(9b34c07b-e9e3-4439-982a-e160009938cf),segment_id=9b34c07b-e9e3-4439-982a-e160009938cf)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:30:12.525141 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-54d638f4-41be-41fd-abf4-ef878a215e13 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:12.551858 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-54d638f4-41be-41fd-abf4-ef878a215e13 admin admin] Calling delete_port for 76f630f8-c464-46b2-b3b3-6a4c815cc2cf owned by network:router_interface {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:30:12.571142 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-87dc0cf5-d207-4b52-a012-fcf44bf9bd03 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['041287e3-92a1-4b58-9250-6007d559460c']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:12.582136 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-44c2f08c-2075-4f41-8562-ab71c518e343 admin admin] Deleting port 6e983a96-52c7-4df1-885b-dc7cdba4b08e {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:30:12.582500 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-44c2f08c-2075-4f41-8562-ab71c518e343 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:12.625208 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-337afe7c-7b17-43c6-bdf7-f506330ea35a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:12.628371 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-87dc0cf5-d207-4b52-a012-fcf44bf9bd03 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'aa07db52-653c-41c6-ba4b-e0dd8f0b1051') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:12.628619 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-87dc0cf5-d207-4b52-a012-fcf44bf9bd03 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'aa07db52-653c-41c6-ba4b-e0dd8f0b1051') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:12.630448 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-82f794ef-1d60-43ae-bf00-5c0da57e6ef3 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:12.637364 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-82f794ef-1d60-43ae-bf00-5c0da57e6ef3 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:12.637984 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-82f794ef-1d60-43ae-bf00-5c0da57e6ef3 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:12.653501 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-87dc0cf5-d207-4b52-a012-fcf44bf9bd03 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:12.703888 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-87dc0cf5-d207-4b52-a012-fcf44bf9bd03 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:12.722694 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-87dc0cf5-d207-4b52-a012-fcf44bf9bd03 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Releasing vlan 346 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:30:12.723101 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-87dc0cf5-d207-4b52-a012-fcf44bf9bd03 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:12.725435 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-337afe7c-7b17-43c6-bdf7-f506330ea35a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Releasing vlan 305 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:30:12.725854 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-337afe7c-7b17-43c6-bdf7-f506330ea35a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:12.727473 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:30:12.727473 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:30:12.727473 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:30:12.727473 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:30:12.727473 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:30:12.727473 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:30:12.727473 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:30:12.727473 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:30:12.727473 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:30:12.727473 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:30:12.727473 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:30:12.727473 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:30:12.727473 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:30:12.727473 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:30:12.727473 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:30:12.727473 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:30:12.727473 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:30:12.727473 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:30:12.727473 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:30:12.727473 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:30:12.727473 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:30:12.727473 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:30:12.727473 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:30:12.727473 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:30:12.727473 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:30:12.727473 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:30:12.727473 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:30:12.727473 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:30:12.727473 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:30:12.727473 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:30:12.727473 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:30:12.727473 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:30:12.733836 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:30:12.733836 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:30:12.733836 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:30:12.733836 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:30:12.733836 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:30:12.733836 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:30:12.733836 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:30:12.733836 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:30:12.733836 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:30:12.733836 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:30:12.733836 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:30:12.733836 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:30:12.733836 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:30:12.733836 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:30:12.733836 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:30:12.733836 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:30:12.733836 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:30:12.733836 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:30:12.733836 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:30:12.733836 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:30:12.733836 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:30:12.733836 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:30:12.733836 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:30:12.733836 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:30:12.733836 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:30:12.733836 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:30:12.733836 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:30:12.733836 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:30:12.733836 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:30:12.733836 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:30:12.733836 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:30:12.733836 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:30:12.761339 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0b2baa7e-6fbd-4263-a245-f5ef2ba6b1bf tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:12.818065 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Port 7c7cc4d1-9c07-4b9b-a732-a565794fd426 update to DOWN by agent not found {{(pid=102163) update_port_statuses /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2167}} Nov 09 04:30:12.818629 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 82792a05-aff7-40d4-96e6-1defa130dd07 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:30:12.827605 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-44c2f08c-2075-4f41-8562-ab71c518e343 admin admin] For port 6e983a96-52c7-4df1-885b-dc7cdba4b08e, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=6e983a96-52c7-4df1-885b-dc7cdba4b08e,segment=NetworkSegment(efe0485f-d48f-4307-b89a-0bcb86aaf1c2),segment_id=efe0485f-d48f-4307-b89a-0bcb86aaf1c2)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:30:12.831798 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-44c2f08c-2075-4f41-8562-ab71c518e343 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:12.846208 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 82792a05-aff7-40d4-96e6-1defa130dd07 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:30:12.846790 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 82792a05-aff7-40d4-96e6-1defa130dd07 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:30:12.854510 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-44c2f08c-2075-4f41-8562-ab71c518e343 admin admin] Calling delete_port for 6e983a96-52c7-4df1-885b-dc7cdba4b08e owned by network:router_interface {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:30:12.911739 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82f794ef-1d60-43ae-bf00-5c0da57e6ef3 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event updated for resources: {'Network': ['ID=cc397c48-c4cc-4846-a1ef-380b64be450d,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:12.931005 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network cc397c48-c4cc-4846-a1ef-380b64be450d details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:30:12.971217 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-82f794ef-1d60-43ae-bf00-5c0da57e6ef3 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 781 time: 2.3144619 Nov 09 04:30:12.976351 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54390) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:12.984976 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-1298541c-85c0-4337-a7f4-db3aa935d1d4 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Request body: {'port': {'network_id': 'cc397c48-c4cc-4846-a1ef-380b64be450d', 'name': 'tempest-PortsTestJSON-1730999928'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:12.997717 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-87dc0cf5-d207-4b52-a012-fcf44bf9bd03 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:13.065088 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-87dc0cf5-d207-4b52-a012-fcf44bf9bd03 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:13.068991 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-87dc0cf5-d207-4b52-a012-fcf44bf9bd03 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "DELETE /v2.0/networks/041287e3-92a1-4b58-9250-6007d559460c HTTP/1.1" status: 204 len: 168 time: 2.2185659 Nov 09 04:30:13.075274 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54392) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:13.102700 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-337afe7c-7b17-43c6-bdf7-f506330ea35a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:13.121042 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-337afe7c-7b17-43c6-bdf7-f506330ea35a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:13.124290 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-337afe7c-7b17-43c6-bdf7-f506330ea35a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "DELETE /v2.0/networks/58a373ab-b4cf-47d5-bc63-c38afd9d795e HTTP/1.1" status: 204 len: 168 time: 5.2587669 Nov 09 04:30:13.134341 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54394) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:13.136433 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87dc0cf5-d207-4b52-a012-fcf44bf9bd03 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Pushing event deleted for resources: {'Network': ['ID=041287e3-92a1-4b58-9250-6007d559460c,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:13.144964 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-337afe7c-7b17-43c6-bdf7-f506330ea35a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event deleted for resources: {'Network': ['ID=58a373ab-b4cf-47d5-bc63-c38afd9d795e,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:13.163215 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-ec31af95-03e5-47cd-b235-9c7e75c4de75 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-767378972'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:13.174551 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-535f5c4b-39ef-4ad9-8807-8cc7222e7240 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] DELETE failed (client error): The resource could not be found. Nov 09 04:30:13.175540 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-535f5c4b-39ef-4ad9-8807-8cc7222e7240 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:30:13.180950 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-535f5c4b-39ef-4ad9-8807-8cc7222e7240 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "DELETE /v2.0/subnets/91289be5-8cd2-48e1-99bf-bf50f08a11e9 HTTP/1.1" status: 404 len: 337 time: 0.0978496 Nov 09 04:30:13.180950 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-54d638f4-41be-41fd-abf4-ef878a215e13 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:13.185345 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54396) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:13.231024 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ef4ab40f-b8b0-4a34-9a4c-e8c6d5e8ee12 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Router 456b7559-d36a-4838-be45-e4472d3b3437 is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102161) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:30:13.240760 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-e84064e2-ac8e-4d36-9123-de28a073a696 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] DELETE failed (client error): The resource could not be found. Nov 09 04:30:13.246852 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e84064e2-ac8e-4d36-9123-de28a073a696 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:30:13.247844 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54d638f4-41be-41fd-abf4-ef878a215e13 admin admin] Pushing event deleted for resources: {'Port': ['ID=76f630f8-c464-46b2-b3b3-6a4c815cc2cf,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:13.252429 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-e84064e2-ac8e-4d36-9123-de28a073a696 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "DELETE /v2.0/networks/aa0d1e9f-fc22-4053-b61f-4d6102a5f7d0 HTTP/1.1" status: 404 len: 339 time: 0.0635333 Nov 09 04:30:13.255866 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54398) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:13.344774 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ec31af95-03e5-47cd-b235-9c7e75c4de75 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Made reservation on behalf of 6761c80dbfa84798bb6517a9b532f870 for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:30:13.351135 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ec31af95-03e5-47cd-b235-9c7e75c4de75 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:13.385317 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-4ca1f0d8-483f-499d-bdb1-28736f6953ce tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] DELETE failed (client error): The resource could not be found. Nov 09 04:30:13.386052 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-4ca1f0d8-483f-499d-bdb1-28736f6953ce tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:30:13.395237 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1298541c-85c0-4337-a7f4-db3aa935d1d4 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Made reservation on behalf of 88f9f8da29bf4a8793b45130d483a6e6 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:30:13.396096 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-4ca1f0d8-483f-499d-bdb1-28736f6953ce tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "DELETE /v2.0/subnets/d1015856-53b0-4ad8-93eb-806eb31ac49a HTTP/1.1" status: 404 len: 337 time: 0.1320474 Nov 09 04:30:13.400381 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1298541c-85c0-4337-a7f4-db3aa935d1d4 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:13.407962 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54400) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:13.495424 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-e9f49cc0-03db-4b01-8aef-fb3567a64716 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] DELETE failed (client error): The resource could not be found. Nov 09 04:30:13.495995 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e9f49cc0-03db-4b01-8aef-fb3567a64716 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:30:13.499125 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e9f49cc0-03db-4b01-8aef-fb3567a64716 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "DELETE /v2.0/networks/180d6f69-3e84-4af4-8ec3-10d9d54fc8a4 HTTP/1.1" status: 404 len: 339 time: 0.0901024 Nov 09 04:30:13.499889 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ec31af95-03e5-47cd-b235-9c7e75c4de75 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 301} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:30:13.512158 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54402) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:13.517749 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7db74699-7b33-41bb-a603-0fe81d8c5857 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:13.523746 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [None req-1298541c-85c0-4337-a7f4-db3aa935d1d4 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] device_id is not set on port a4de75ae-2dab-4896-8d2a-cdfef3f44fab yet. {{(pid=102162) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:30:13.589261 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-618efbe3-15b6-422a-b862-8ce116ef35fe tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] DELETE failed (client error): The resource could not be found. Nov 09 04:30:13.589721 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-618efbe3-15b6-422a-b862-8ce116ef35fe tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:30:13.592916 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-618efbe3-15b6-422a-b862-8ce116ef35fe tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "DELETE /v2.0/subnets/c66031ce-ca12-4cb0-9734-9397ff18ab6c HTTP/1.1" status: 404 len: 337 time: 0.0805662 Nov 09 04:30:13.597873 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ec31af95-03e5-47cd-b235-9c7e75c4de75 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:13.598218 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-ec31af95-03e5-47cd-b235-9c7e75c4de75 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Added segment d1461667-0349-4ea8-bfaa-b12234c64fac of type vlan for network f16672d2-3d55-4ccc-844f-a1ab468ad9db Nov 09 04:30:13.608851 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54404) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:13.643023 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-44c2f08c-2075-4f41-8562-ab71c518e343 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:13.645069 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e03bc71a-57b8-49fc-a0fc-37cddd841bf2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:13.667704 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0b2baa7e-6fbd-4263-a245-f5ef2ba6b1bf tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:13.697510 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7db74699-7b33-41bb-a603-0fe81d8c5857 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Pushing event updated for resources: {'Subnet': ['ID=c7b34027-e2c5-4180-b369-06e9baa52a2f,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:13.702823 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0b2baa7e-6fbd-4263-a245-f5ef2ba6b1bf tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:13.705344 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ef4ab40f-b8b0-4a34-9a4c-e8c6d5e8ee12 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:30:13.715274 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ef4ab40f-b8b0-4a34-9a4c-e8c6d5e8ee12 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:13.715274 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-ef4ab40f-b8b0-4a34-9a4c-e8c6d5e8ee12 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] 10.222.0.24 "PUT /v2.0/routers/456b7559-d36a-4838-be45-e4472d3b3437 HTTP/1.1" status: 200 len: 916 time: 5.9598465 Nov 09 04:30:13.715274 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54406) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:13.716793 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-15ca7496-edbd-4bfc-bb70-0d6f3f21e5d9 None None] Sync routers for ids ['456b7559-d36a-4838-be45-e4472d3b3437'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:30:13.722473 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-e39b5bf7-5678-4f62-acc0-234296dd4a51 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] DELETE failed (client error): The resource could not be found. Nov 09 04:30:13.723044 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e39b5bf7-5678-4f62-acc0-234296dd4a51 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:30:13.727016 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e39b5bf7-5678-4f62-acc0-234296dd4a51 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "DELETE /v2.0/networks/e366a2cb-d84c-4a09-bffb-dff826896c89 HTTP/1.1" status: 404 len: 339 time: 0.1163588 Nov 09 04:30:13.731072 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54408) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:13.742609 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44c2f08c-2075-4f41-8562-ab71c518e343 admin admin] Pushing event deleted for resources: {'Port': ['ID=6e983a96-52c7-4df1-885b-dc7cdba4b08e,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:13.755984 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ec31af95-03e5-47cd-b235-9c7e75c4de75 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:13.761308 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-15ca7496-edbd-4bfc-bb70-0d6f3f21e5d9 None None] Routers {'456b7559-d36a-4838-be45-e4472d3b3437'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:30:13.766465 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-15ca7496-edbd-4bfc-bb70-0d6f3f21e5d9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:30:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['456b7559-d36a-4838-be45-e4472d3b3437'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:13.811099 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-54d638f4-41be-41fd-abf4-ef878a215e13 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:13.821282 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-15ca7496-edbd-4bfc-bb70-0d6f3f21e5d9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:13.829225 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7db74699-7b33-41bb-a603-0fe81d8c5857 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Checking segment: {'id': 'dc817592-f56a-425b-948a-1516f6b1beb7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 306, 'network_id': '2407b60d-e30f-478f-a68d-2bf482c2f5f4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:30:13.830319 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7db74699-7b33-41bb-a603-0fe81d8c5857 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Network hostable DHCP agents. Network: 2407b60d-e30f-478f-a68d-2bf482c2f5f4, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:30:13.835596 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-15ca7496-edbd-4bfc-bb70-0d6f3f21e5d9 None None] Routers {'456b7559-d36a-4838-be45-e4472d3b3437'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:30:13.836636 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-15ca7496-edbd-4bfc-bb70-0d6f3f21e5d9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:30:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['456b7559-d36a-4838-be45-e4472d3b3437'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:13.921855 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-15ca7496-edbd-4bfc-bb70-0d6f3f21e5d9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:13.922746 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-15ca7496-edbd-4bfc-bb70-0d6f3f21e5d9 None None] The sync data for ids ['456b7559-d36a-4838-be45-e4472d3b3437'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:30:14.004135 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ec31af95-03e5-47cd-b235-9c7e75c4de75 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:14.011928 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ec31af95-03e5-47cd-b235-9c7e75c4de75 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:14.012749 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ec31af95-03e5-47cd-b235-9c7e75c4de75 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:14.075847 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7db74699-7b33-41bb-a603-0fe81d8c5857 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Network 2407b60d-e30f-478f-a68d-2bf482c2f5f4 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:30:14.141780 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-b3c9800d-9f17-44fb-9eac-37cfce938504 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Deleting subnet 70a58ff6-4289-498f-b089-ac67e5c7c82f {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:30:14.165236 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b3c9800d-9f17-44fb-9eac-37cfce938504 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:14.173448 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-7db74699-7b33-41bb-a603-0fe81d8c5857 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 2407b60d-e30f-478f-a68d-2bf482c2f5f4) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:14.198004 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-15ffb5a6-03e3-4282-bc36-9e71dcc06a8e None None] Network 2407b60d-e30f-478f-a68d-2bf482c2f5f4 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:30:14.203036 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7db74699-7b33-41bb-a603-0fe81d8c5857 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:14.215322 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-0b2baa7e-6fbd-4263-a245-f5ef2ba6b1bf tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Allocated IP 172.26.0.113 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/9947f24d-f96c-49f9-8eb6-2be971ed9745) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:30:14.229422 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-d77f91b5-86a4-499a-aa2a-f0f0b8701f85 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] 10.222.0.24 "GET /v2.0/routers/456b7559-d36a-4838-be45-e4472d3b3437 HTTP/1.1" status: 200 len: 922 time: 0.5094323 Nov 09 04:30:14.250438 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54410) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:14.311084 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1298541c-85c0-4337-a7f4-db3aa935d1d4 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:14.316570 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b3c9800d-9f17-44fb-9eac-37cfce938504 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:14.318454 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-ec31af95-03e5-47cd-b235-9c7e75c4de75 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 779 time: 1.1790590 Nov 09 04:30:14.327237 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54412) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:14.332835 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-3ac35723-f20d-4f8f-878c-677dc557578d tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Request body: {'subnet': {'network_id': 'f16672d2-3d55-4ccc-844f-a1ab468ad9db', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': None, 'enable_dhcp': True}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:14.341008 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec31af95-03e5-47cd-b235-9c7e75c4de75 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event updated for resources: {'Network': ['ID=f16672d2-3d55-4ccc-844f-a1ab468ad9db,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:14.353778 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network f16672d2-3d55-4ccc-844f-a1ab468ad9db details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:30:14.366200 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-44c2f08c-2075-4f41-8562-ab71c518e343 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:14.412922 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7db74699-7b33-41bb-a603-0fe81d8c5857 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Pushing event updated for resources: {'Subnet': ['ID=c7b32e74-a0f0-4be8-9ac1-514d28bf9a8a,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:14.460707 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-df71e69f-2821-46cf-873a-f6ff11afe30f tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:14.464965 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-df71e69f-2821-46cf-873a-f6ff11afe30f tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] 10.222.0.24 "GET /v2.0/ports?network_id=2b6725f5-ebfe-485a-8f42-ccb5a241ddb5&device_id=456b7559-d36a-4838-be45-e4472d3b3437&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 945 time: 0.2111464 Nov 09 04:30:14.465564 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54414) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:14.534873 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7db74699-7b33-41bb-a603-0fe81d8c5857 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Checking segment: {'id': '5eddcc50-ff24-4ae6-9020-82b9642df813', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '7399bb70-27fb-4f3b-a5c5-a5ac1c4dc8d3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:30:14.535293 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7db74699-7b33-41bb-a603-0fe81d8c5857 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Network hostable DHCP agents. Network: 7399bb70-27fb-4f3b-a5c5-a5ac1c4dc8d3, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:30:14.602763 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0b2baa7e-6fbd-4263-a245-f5ef2ba6b1bf tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:14.611565 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b3c9800d-9f17-44fb-9eac-37cfce938504 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:14.650221 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1298541c-85c0-4337-a7f4-db3aa935d1d4 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:14.703175 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aab8f1cd-ff33-4285-ab55-81ddda8fd5d3 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-2407b60d-e30f-478f-a68d-2bf482c2f5f4', 'network_id': '2407b60d-e30f-478f-a68d-2bf482c2f5f4', 'tenant_id': '2f077d8d6e0c4af98a4ce8fbe06ce9d4', 'fixed_ips': [{'subnet_id': 'c7b34027-e2c5-4180-b369-06e9baa52a2f'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:30:14.705993 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-aab8f1cd-ff33-4285-ab55-81ddda8fd5d3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:14.742951 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-54d638f4-41be-41fd-abf4-ef878a215e13 admin admin] Router c9d2cce0-31ab-42c3-ac82-14e36499c28f has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:30:14.743724 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3ac35723-f20d-4f8f-878c-677dc557578d tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Made reservation on behalf of 6761c80dbfa84798bb6517a9b532f870 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:30:14.747257 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3ac35723-f20d-4f8f-878c-677dc557578d tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:14.768720 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1298541c-85c0-4337-a7f4-db3aa935d1d4 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event updated for resources: {'Port': ['ID=a4de75ae-2dab-4896-8d2a-cdfef3f44fab,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:14.868491 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-aab8f1cd-ff33-4285-ab55-81ddda8fd5d3 None None] Allocated IP 172.20.0.2 (2407b60d-e30f-478f-a68d-2bf482c2f5f4/c7b34027-e2c5-4180-b369-06e9baa52a2f/7101fd59-3be8-4029-b9cf-5a6533d9f71f) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:30:14.957325 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7db74699-7b33-41bb-a603-0fe81d8c5857 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Network 7399bb70-27fb-4f3b-a5c5-a5ac1c4dc8d3 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:30:14.968178 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2ad536ff-16d9-4fbd-a545-a28e7287ca44 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:14.973098 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-2ad536ff-16d9-4fbd-a545-a28e7287ca44 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] 10.222.0.24 "GET /v2.0/networks/2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 HTTP/1.1" status: 200 len: 881 time: 0.5033457 Nov 09 04:30:14.973770 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54416) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:15.016039 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-7802122d-6964-472c-902a-0f52e1f834e9 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] 10.222.0.24 "GET /v2.0/ports?device_id=456b7559-d36a-4838-be45-e4472d3b3437 HTTP/1.1" status: 200 len: 205 time: 0.0375471 Nov 09 04:30:15.021873 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54418) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:15.044739 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-aab8f1cd-ff33-4285-ab55-81ddda8fd5d3 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:15.064358 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-7db74699-7b33-41bb-a603-0fe81d8c5857 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 7399bb70-27fb-4f3b-a5c5-a5ac1c4dc8d3) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:15.069645 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7db74699-7b33-41bb-a603-0fe81d8c5857 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:15.070043 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7db74699-7b33-41bb-a603-0fe81d8c5857 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:15.071190 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7db74699-7b33-41bb-a603-0fe81d8c5857 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:15.074639 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-687373fd-8e88-409e-a87a-858b09e874b5 None None] Network 7399bb70-27fb-4f3b-a5c5-a5ac1c4dc8d3 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:30:15.103035 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0b2baa7e-6fbd-4263-a245-f5ef2ba6b1bf tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:15.130283 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:15.144487 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-aab8f1cd-ff33-4285-ab55-81ddda8fd5d3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:15.199848 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-7db74699-7b33-41bb-a603-0fe81d8c5857 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 1426 time: 3.9362864 Nov 09 04:30:15.201766 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b3c9800d-9f17-44fb-9eac-37cfce938504 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:15.206615 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aab8f1cd-ff33-4285-ab55-81ddda8fd5d3 None None] Network 2407b60d-e30f-478f-a68d-2bf482c2f5f4 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:30:15.208825 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54420) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:15.213655 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b2baa7e-6fbd-4263-a245-f5ef2ba6b1bf tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Pushing event updated for resources: {'Port': ['ID=9947f24d-f96c-49f9-8eb6-2be971ed9745,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:15.221336 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1298541c-85c0-4337-a7f4-db3aa935d1d4 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Checking segment: {'id': '5cb8d89b-c83c-4beb-ac61-4edae91bc9e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 315, 'network_id': 'cc397c48-c4cc-4846-a1ef-380b64be450d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:30:15.222969 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1298541c-85c0-4337-a7f4-db3aa935d1d4 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Network hostable DHCP agents. Network: cc397c48-c4cc-4846-a1ef-380b64be450d, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:30:15.229463 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-aab8f1cd-ff33-4285-ab55-81ddda8fd5d3 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:15.231310 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aab8f1cd-ff33-4285-ab55-81ddda8fd5d3 None None] Pushing event updated for resources: {'Port': ['ID=7101fd59-3be8-4029-b9cf-5a6533d9f71f,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:15.234912 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aab8f1cd-ff33-4285-ab55-81ddda8fd5d3 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:30:15.317961 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3c9800d-9f17-44fb-9eac-37cfce938504 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Pushing event deleted for resources: {'Subnet': ['ID=70a58ff6-4289-498f-b089-ac67e5c7c82f,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:15.323693 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-aab8f1cd-ff33-4285-ab55-81ddda8fd5d3 None None] Attempting to bind port 7101fd59-3be8-4029-b9cf-5a6533d9f71f on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:30:15.324093 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-aab8f1cd-ff33-4285-ab55-81ddda8fd5d3 None None] Attempting to bind port 7101fd59-3be8-4029-b9cf-5a6533d9f71f by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'dc817592-f56a-425b-948a-1516f6b1beb7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 306, 'network_id': '2407b60d-e30f-478f-a68d-2bf482c2f5f4'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:30:15.324705 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aab8f1cd-ff33-4285-ab55-81ddda8fd5d3 None None] Attempting to bind port 7101fd59-3be8-4029-b9cf-5a6533d9f71f on network 2407b60d-e30f-478f-a68d-2bf482c2f5f4 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:30:15.333296 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aab8f1cd-ff33-4285-ab55-81ddda8fd5d3 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 29, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:30:15.333296 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aab8f1cd-ff33-4285-ab55-81ddda8fd5d3 None None] Checking segment: {'id': 'dc817592-f56a-425b-948a-1516f6b1beb7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 306, 'network_id': '2407b60d-e30f-478f-a68d-2bf482c2f5f4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:30:15.334257 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-aab8f1cd-ff33-4285-ab55-81ddda8fd5d3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:15.334257 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aab8f1cd-ff33-4285-ab55-81ddda8fd5d3 None None] Bound using segment: {'id': 'dc817592-f56a-425b-948a-1516f6b1beb7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 306, 'network_id': '2407b60d-e30f-478f-a68d-2bf482c2f5f4'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:30:15.334586 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-aab8f1cd-ff33-4285-ab55-81ddda8fd5d3 None None] Bound port: 7101fd59-3be8-4029-b9cf-5a6533d9f71f, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'dc817592-f56a-425b-948a-1516f6b1beb7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 306, 'network_id': '2407b60d-e30f-478f-a68d-2bf482c2f5f4'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:30:15.342420 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-aab8f1cd-ff33-4285-ab55-81ddda8fd5d3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:15.342779 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0b2baa7e-6fbd-4263-a245-f5ef2ba6b1bf tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:30:15.347158 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6be66fbc-5561-4efa-baf3-5cd7590488d7 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-7399bb70-27fb-4f3b-a5c5-a5ac1c4dc8d3', 'network_id': '7399bb70-27fb-4f3b-a5c5-a5ac1c4dc8d3', 'tenant_id': '2f077d8d6e0c4af98a4ce8fbe06ce9d4', 'fixed_ips': [{'subnet_id': 'c7b32e74-a0f0-4be8-9ac1-514d28bf9a8a'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:30:15.348218 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6be66fbc-5561-4efa-baf3-5cd7590488d7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:15.354811 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b3c9800d-9f17-44fb-9eac-37cfce938504 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:15.357637 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-b3c9800d-9f17-44fb-9eac-37cfce938504 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "DELETE /v2.0/subnets/70a58ff6-4289-498f-b089-ac67e5c7c82f HTTP/1.1" status: 204 len: 168 time: 1.6234493 Nov 09 04:30:15.365763 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-0b2baa7e-6fbd-4263-a245-f5ef2ba6b1bf tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:15.366019 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f7354ce5-da69-45b1-bd1d-a53530793f15 None None] Network 807848a2-a4f3-4a57-9607-825f2f20d042 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:30:15.371401 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54422) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:15.381026 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0b2baa7e-6fbd-4263-a245-f5ef2ba6b1bf tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:30:15.384758 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-95692e1d-7c7b-4c6e-9b55-6ed3f28aa894 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks [] for router, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:15.392278 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0078d6d7-bb7c-431a-b920-ca13f6db1037 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:15.394531 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0078d6d7-bb7c-431a-b920-ca13f6db1037 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:15.396252 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0078d6d7-bb7c-431a-b920-ca13f6db1037 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:15.400985 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-0078d6d7-bb7c-431a-b920-ca13f6db1037 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] 10.222.0.24 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2052 time: 0.1852746 Nov 09 04:30:15.401173 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-54d638f4-41be-41fd-abf4-ef878a215e13 admin admin] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:30:15.402719 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1298541c-85c0-4337-a7f4-db3aa935d1d4 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Network cc397c48-c4cc-4846-a1ef-380b64be450d is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:30:15.405361 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54424) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:15.411002 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-44c2f08c-2075-4f41-8562-ab71c518e343 admin admin] Router 23955a4a-3903-49e9-ab99-5e003c83c868 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:30:15.414448 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-54d638f4-41be-41fd-abf4-ef878a215e13 admin admin] 10.222.0.24 "PUT /v2.0/routers/c9d2cce0-31ab-42c3-ac82-14e36499c28f/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 6.2051809 Nov 09 04:30:15.423405 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54426) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:15.425321 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6db27e1e-3482-4143-bb9a-66c7710b22de None None] Sync routers for ids ['c9d2cce0-31ab-42c3-ac82-14e36499c28f'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:30:15.457849 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-1298541c-85c0-4337-a7f4-db3aa935d1d4 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, cc397c48-c4cc-4846-a1ef-380b64be450d) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:15.504809 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b2cfbe1a-a54c-470c-a02c-e6907a970aa6 None None] Network cc397c48-c4cc-4846-a1ef-380b64be450d requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:30:15.528775 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1298541c-85c0-4337-a7f4-db3aa935d1d4 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:30:15.534923 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1298541c-85c0-4337-a7f4-db3aa935d1d4 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:15.535648 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1298541c-85c0-4337-a7f4-db3aa935d1d4 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:15.557473 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6db27e1e-3482-4143-bb9a-66c7710b22de None None] Routers {'c9d2cce0-31ab-42c3-ac82-14e36499c28f'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:30:15.558102 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-6db27e1e-3482-4143-bb9a-66c7710b22de None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:30:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['c9d2cce0-31ab-42c3-ac82-14e36499c28f'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:15.614618 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3ed54bb2-2fb1-4eb1-a389-2c4959d5cd54 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:15.617412 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-32034feb-db41-43c4-b63a-38135471dcf8 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Deleting subnet c7b34027-e2c5-4180-b369-06e9baa52a2f {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:30:15.651438 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-32034feb-db41-43c4-b63a-38135471dcf8 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:15.683691 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-95692e1d-7c7b-4c6e-9b55-6ed3f28aa894 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks [] for router_gateway, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:15.694231 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-1298541c-85c0-4337-a7f4-db3aa935d1d4 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 846 time: 2.7165277 Nov 09 04:30:15.694450 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54428) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:15.704199 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-21142dd7-5a1e-4838-b777-870ca1b3a789 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-1906955322'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:15.739362 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-aab8f1cd-ff33-4285-ab55-81ddda8fd5d3 None None] For port 7101fd59-3be8-4029-b9cf-5a6533d9f71f, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:30:15.739927 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3ac35723-f20d-4f8f-878c-677dc557578d tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:15.783038 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-3ed54bb2-2fb1-4eb1-a389-2c4959d5cd54 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Deleting port 53326cfb-82fd-4c01-b6be-8320fdc356a6 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:30:15.783394 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3ed54bb2-2fb1-4eb1-a389-2c4959d5cd54 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:15.783646 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-32034feb-db41-43c4-b63a-38135471dcf8 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:15.786814 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3bbf71c4-f85a-4f28-9d39-15cfb0a24877 admin admin] Publish callbacks [] for router, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:15.812803 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-aab8f1cd-ff33-4285-ab55-81ddda8fd5d3 None None] For port 7101fd59-3be8-4029-b9cf-5a6533d9f71f, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=7101fd59-3be8-4029-b9cf-5a6533d9f71f,segment=NetworkSegment(dc817592-f56a-425b-948a-1516f6b1beb7),segment_id=dc817592-f56a-425b-948a-1516f6b1beb7)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:30:15.863099 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-6be66fbc-5561-4efa-baf3-5cd7590488d7 None None] Allocated IP 172.20.0.18 (7399bb70-27fb-4f3b-a5c5-a5ac1c4dc8d3/c7b32e74-a0f0-4be8-9ac1-514d28bf9a8a/8c17389a-4a93-4c11-9672-8b0727e2814e) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:30:15.900042 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-6db27e1e-3482-4143-bb9a-66c7710b22de None None] Set router c9d2cce0-31ab-42c3-ac82-14e36499c28f gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:30:15.902187 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-44c2f08c-2075-4f41-8562-ab71c518e343 admin admin] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:30:15.921736 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d31374fb-e918-49b7-b982-70c03f060441 None None] Sync routers for ids ['23955a4a-3903-49e9-ab99-5e003c83c868'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:30:15.924675 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-44c2f08c-2075-4f41-8562-ab71c518e343 admin admin] 10.222.0.24 "PUT /v2.0/routers/23955a4a-3903-49e9-ab99-5e003c83c868/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 5.9750590 Nov 09 04:30:15.924896 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ac35723-f20d-4f8f-878c-677dc557578d tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event updated for resources: {'Subnet': ['ID=a23c1d35-7377-416a-afd7-f17bae47cfc9,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:15.927020 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54430) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:15.932007 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-21142dd7-5a1e-4838-b777-870ca1b3a789 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Made reservation on behalf of 88f9f8da29bf4a8793b45130d483a6e6 for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:30:15.936424 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-21142dd7-5a1e-4838-b777-870ca1b3a789 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:15.957403 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-3ed54bb2-2fb1-4eb1-a389-2c4959d5cd54 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] For port 53326cfb-82fd-4c01-b6be-8320fdc356a6, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=53326cfb-82fd-4c01-b6be-8320fdc356a6,segment=NetworkSegment(390f9f13-b28d-47b2-8cd2-9f274969fa64),segment_id=390f9f13-b28d-47b2-8cd2-9f274969fa64)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:30:15.958063 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3ed54bb2-2fb1-4eb1-a389-2c4959d5cd54 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:15.962863 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d31374fb-e918-49b7-b982-70c03f060441 None None] Routers {'23955a4a-3903-49e9-ab99-5e003c83c868'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:30:15.963483 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-d31374fb-e918-49b7-b982-70c03f060441 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:30:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['23955a4a-3903-49e9-ab99-5e003c83c868'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:16.014689 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3ac35723-f20d-4f8f-878c-677dc557578d tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Checking segment: {'id': 'd1461667-0349-4ea8-bfaa-b12234c64fac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 301, 'network_id': 'f16672d2-3d55-4ccc-844f-a1ab468ad9db'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:30:16.015090 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3ac35723-f20d-4f8f-878c-677dc557578d tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Network hostable DHCP agents. Network: f16672d2-3d55-4ccc-844f-a1ab468ad9db, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:30:16.038515 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-3ed54bb2-2fb1-4eb1-a389-2c4959d5cd54 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Calling delete_port for 53326cfb-82fd-4c01-b6be-8320fdc356a6 owned by network:dhcp {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:30:16.045623 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-32034feb-db41-43c4-b63a-38135471dcf8 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:16.085153 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3bbf71c4-f85a-4f28-9d39-15cfb0a24877 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:16.095470 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-d31374fb-e918-49b7-b982-70c03f060441 None None] Set router 23955a4a-3903-49e9-ab99-5e003c83c868 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:30:16.105709 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-aab8f1cd-ff33-4285-ab55-81ddda8fd5d3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:16.124781 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3ac35723-f20d-4f8f-878c-677dc557578d tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Network f16672d2-3d55-4ccc-844f-a1ab468ad9db is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:30:16.196202 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-32034feb-db41-43c4-b63a-38135471dcf8 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:16.199018 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-3ac35723-f20d-4f8f-878c-677dc557578d tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, f16672d2-3d55-4ccc-844f-a1ab468ad9db) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:16.234007 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3ac35723-f20d-4f8f-878c-677dc557578d tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:16.234991 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3ac35723-f20d-4f8f-878c-677dc557578d tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:16.289917 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-95692e1d-7c7b-4c6e-9b55-6ed3f28aa894 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Deleting port aff23a33-a3ae-4f92-a35a-dc548a11d22e {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:30:16.290283 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-95692e1d-7c7b-4c6e-9b55-6ed3f28aa894 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:16.300890 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-32034feb-db41-43c4-b63a-38135471dcf8 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:16.307692 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-32034feb-db41-43c4-b63a-38135471dcf8 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] 10.222.0.24 "DELETE /v2.0/subnets/c7b34027-e2c5-4180-b369-06e9baa52a2f HTTP/1.1" status: 204 len: 168 time: 0.8925447 Nov 09 04:30:16.307692 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32034feb-db41-43c4-b63a-38135471dcf8 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Pushing event deleted for resources: {'Subnet': ['ID=c7b34027-e2c5-4180-b369-06e9baa52a2f,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:16.309162 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54432) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:16.330126 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-3ac35723-f20d-4f8f-878c-677dc557578d tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 793 time: 1.9973195 Nov 09 04:30:16.335041 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54434) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:16.336657 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6d08aaf8-dea9-4440-8405-2e7a1c3f1eec None None] DHCP port deletion for 807848a2-a4f3-4a57-9607-825f2f20d042 request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:30:16.391161 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-21142dd7-5a1e-4838-b777-870ca1b3a789 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 316} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:30:16.414881 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-6652ff0e-12cd-44f6-883e-57e0c4c4c7e5 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Deleting subnet c7b32e74-a0f0-4be8-9ac1-514d28bf9a8a {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:30:16.423866 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aab8f1cd-ff33-4285-ab55-81ddda8fd5d3 None None] Pushing event updated for resources: {'Port': ['ID=7101fd59-3be8-4029-b9cf-5a6533d9f71f,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:16.425467 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-3bbf71c4-f85a-4f28-9d39-15cfb0a24877 admin admin] Deleting port 0fc8f26d-1642-4025-b21c-de2a4f14043f {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:30:16.425803 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3bbf71c4-f85a-4f28-9d39-15cfb0a24877 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:16.427709 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0b2baa7e-6fbd-4263-a245-f5ef2ba6b1bf tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:16.428923 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-080b2175-aaae-4cd9-a1d8-4478a4ec58c0 None None] Network f16672d2-3d55-4ccc-844f-a1ab468ad9db requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:30:16.487770 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-21142dd7-5a1e-4838-b777-870ca1b3a789 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:16.488399 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-21142dd7-5a1e-4838-b777-870ca1b3a789 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Added segment 29f62496-7e30-4776-b257-351cfaaf21cb of type vlan for network fbf37a20-2f64-4540-9a29-42b164c6fa30 Nov 09 04:30:16.508197 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-d31374fb-e918-49b7-b982-70c03f060441 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '23955a4a-3903-49e9-ab99-5e003c83c868', 'name': 'tempest-ServersTestManualDisk-509590275-router', 'tenant_id': '5f3cd2a3586e46c09f847681f744075c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.66'}], 'enable_snat': True}, 'gw_port_id': 'a31e46ce-e371-4177-a2d5-f9a3681f192b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:28:17Z', 'updated_at': '2021-11-09T04:30:13Z', 'revision_number': 5, 'project_id': '5f3cd2a3586e46c09f847681f744075c', 'gw_port': {'id': 'a31e46ce-e371-4177-a2d5-f9a3681f192b', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:d3:1e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '23955a4a-3903-49e9-ab99-5e003c83c868', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:28:19Z', 'updated_at': '2021-11-09T04:28:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:16.548939 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d31374fb-e918-49b7-b982-70c03f060441 None None] Checking router: 23955a4a-3903-49e9-ab99-5e003c83c868 for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:30:16.569232 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d31374fb-e918-49b7-b982-70c03f060441 None None] Routers {'23955a4a-3903-49e9-ab99-5e003c83c868'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:30:16.570953 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-d31374fb-e918-49b7-b982-70c03f060441 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:30:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['23955a4a-3903-49e9-ab99-5e003c83c868'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:16.577735 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d1ed3bdf-cfb1-48d8-953f-54981fe3977a admin admin] Publish callbacks [] for router, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:16.599553 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:16.608165 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6be66fbc-5561-4efa-baf3-5cd7590488d7 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:16.622984 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-3bbf71c4-f85a-4f28-9d39-15cfb0a24877 admin admin] For port 0fc8f26d-1642-4025-b21c-de2a4f14043f, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=0fc8f26d-1642-4025-b21c-de2a4f14043f,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:30:16.623639 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3bbf71c4-f85a-4f28-9d39-15cfb0a24877 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:16.650821 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-3bbf71c4-f85a-4f28-9d39-15cfb0a24877 admin admin] Calling delete_port for 0fc8f26d-1642-4025-b21c-de2a4f14043f owned by network:router_gateway {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:30:16.684294 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6be66fbc-5561-4efa-baf3-5cd7590488d7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:16.735897 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6be66fbc-5561-4efa-baf3-5cd7590488d7 None None] Pushing event updated for resources: {'Port': ['ID=8c17389a-4a93-4c11-9672-8b0727e2814e,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:16.739649 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-6d08aaf8-dea9-4440-8405-2e7a1c3f1eec None None] Deleting port 53326cfb-82fd-4c01-b6be-8320fdc356a6 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:30:16.740307 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6d08aaf8-dea9-4440-8405-2e7a1c3f1eec None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:16.748819 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-6db27e1e-3482-4143-bb9a-66c7710b22de None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c9d2cce0-31ab-42c3-ac82-14e36499c28f', 'name': 'tempest-ServersTestJSON-828046534-router', 'tenant_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.163'}], 'enable_snat': True}, 'gw_port_id': '0fc8f26d-1642-4025-b21c-de2a4f14043f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:28:17Z', 'updated_at': '2021-11-09T04:30:12Z', 'revision_number': 5, 'project_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'gw_port': {'id': '0fc8f26d-1642-4025-b21c-de2a4f14043f', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:c5:bb:ba', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c9d2cce0-31ab-42c3-ac82-14e36499c28f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.163', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:28:18Z', 'updated_at': '2021-11-09T04:28:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:16.771172 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-d31374fb-e918-49b7-b982-70c03f060441 None None] Set router 23955a4a-3903-49e9-ab99-5e003c83c868 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:30:16.788748 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6db27e1e-3482-4143-bb9a-66c7710b22de None None] Checking router: c9d2cce0-31ab-42c3-ac82-14e36499c28f for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:30:16.824396 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6652ff0e-12cd-44f6-883e-57e0c4c4c7e5 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:16.882072 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6652ff0e-12cd-44f6-883e-57e0c4c4c7e5 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:16.891437 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6db27e1e-3482-4143-bb9a-66c7710b22de None None] Routers {'c9d2cce0-31ab-42c3-ac82-14e36499c28f'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:30:16.892624 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-6db27e1e-3482-4143-bb9a-66c7710b22de None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:30:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['c9d2cce0-31ab-42c3-ac82-14e36499c28f'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:16.899983 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6be66fbc-5561-4efa-baf3-5cd7590488d7 None None] Network 7399bb70-27fb-4f3b-a5c5-a5ac1c4dc8d3 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:30:16.966854 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-6be66fbc-5561-4efa-baf3-5cd7590488d7 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:16.980581 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6be66fbc-5561-4efa-baf3-5cd7590488d7 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:30:17.030473 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-6d08aaf8-dea9-4440-8405-2e7a1c3f1eec None None] For port 53326cfb-82fd-4c01-b6be-8320fdc356a6, host dv-neutron-816802-2-hyperv, got binding levels [] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:30:17.033085 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6d08aaf8-dea9-4440-8405-2e7a1c3f1eec None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:17.062100 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-95692e1d-7c7b-4c6e-9b55-6ed3f28aa894 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:17.072389 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3ed54bb2-2fb1-4eb1-a389-2c4959d5cd54 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:17.077928 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-21142dd7-5a1e-4838-b777-870ca1b3a789 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:17.089492 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:17.108036 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-6d08aaf8-dea9-4440-8405-2e7a1c3f1eec None None] Calling delete_port for 53326cfb-82fd-4c01-b6be-8320fdc356a6 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:30:17.128833 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6652ff0e-12cd-44f6-883e-57e0c4c4c7e5 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:17.131171 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-d31374fb-e918-49b7-b982-70c03f060441 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '23955a4a-3903-49e9-ab99-5e003c83c868', 'name': 'tempest-ServersTestManualDisk-509590275-router', 'tenant_id': '5f3cd2a3586e46c09f847681f744075c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.66'}], 'enable_snat': True}, 'gw_port_id': 'a31e46ce-e371-4177-a2d5-f9a3681f192b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:28:17Z', 'updated_at': '2021-11-09T04:30:13Z', 'revision_number': 5, 'project_id': '5f3cd2a3586e46c09f847681f744075c', 'gw_port': {'id': 'a31e46ce-e371-4177-a2d5-f9a3681f192b', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:d3:1e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '23955a4a-3903-49e9-ab99-5e003c83c868', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:28:19Z', 'updated_at': '2021-11-09T04:28:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:17.137135 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.ipam_backend_mixin [None req-6d08aaf8-dea9-4440-8405-2e7a1c3f1eec None None] Port 53326cfb-82fd-4c01-b6be-8320fdc356a6 was not found and therefore no delete operation was performed {{(pid=102163) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Nov 09 04:30:17.140740 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1373216a-02d0-461e-80b9-86426194eff1 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-f16672d2-3d55-4ccc-844f-a1ab468ad9db', 'network_id': 'f16672d2-3d55-4ccc-844f-a1ab468ad9db', 'tenant_id': '6761c80dbfa84798bb6517a9b532f870', 'fixed_ips': [{'subnet_id': 'a23c1d35-7377-416a-afd7-f17bae47cfc9'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:30:17.141585 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1373216a-02d0-461e-80b9-86426194eff1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:17.145438 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-95692e1d-7c7b-4c6e-9b55-6ed3f28aa894 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Calling delete_port for aff23a33-a3ae-4f92-a35a-dc548a11d22e owned by network:router_gateway {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:30:17.173027 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3ed54bb2-2fb1-4eb1-a389-2c4959d5cd54 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] No DVR routers for this DVR port 53326cfb-82fd-4c01-b6be-8320fdc356a6 on host dv-neutron-816802-2-hyperv {{(pid=102161) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:30:17.175463 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ed54bb2-2fb1-4eb1-a389-2c4959d5cd54 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Pushing event deleted for resources: {'Port': ['ID=53326cfb-82fd-4c01-b6be-8320fdc356a6,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:17.177812 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d31374fb-e918-49b7-b982-70c03f060441 None None] The sync data for ids ['23955a4a-3903-49e9-ab99-5e003c83c868'] in dv-neutron-816802-2-hyperv is: [{'id': '23955a4a-3903-49e9-ab99-5e003c83c868', 'name': 'tempest-ServersTestManualDisk-509590275-router', 'tenant_id': '5f3cd2a3586e46c09f847681f744075c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.66'}], 'enable_snat': True}, 'gw_port_id': 'a31e46ce-e371-4177-a2d5-f9a3681f192b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:28:17Z', 'updated_at': '2021-11-09T04:30:13Z', 'revision_number': 5, 'project_id': '5f3cd2a3586e46c09f847681f744075c', 'gw_port': {'id': 'a31e46ce-e371-4177-a2d5-f9a3681f192b', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:d3:1e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '23955a4a-3903-49e9-ab99-5e003c83c868', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:28:19Z', 'updated_at': '2021-11-09T04:28:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:30:17.200807 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3bbf71c4-f85a-4f28-9d39-15cfb0a24877 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:17.236434 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6d08aaf8-dea9-4440-8405-2e7a1c3f1eec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:17.252296 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bbf71c4-f85a-4f28-9d39-15cfb0a24877 admin admin] Pushing event deleted for resources: {'Port': ['ID=0fc8f26d-1642-4025-b21c-de2a4f14043f,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:17.275319 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ed54bb2-2fb1-4eb1-a389-2c4959d5cd54 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:30:17.275655 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ed54bb2-2fb1-4eb1-a389-2c4959d5cd54 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:30:17.276002 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ed54bb2-2fb1-4eb1-a389-2c4959d5cd54 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:30:17.276332 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ed54bb2-2fb1-4eb1-a389-2c4959d5cd54 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:30:17.276664 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ed54bb2-2fb1-4eb1-a389-2c4959d5cd54 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:30:17.276991 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ed54bb2-2fb1-4eb1-a389-2c4959d5cd54 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:30:17.277312 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ed54bb2-2fb1-4eb1-a389-2c4959d5cd54 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:30:17.277630 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ed54bb2-2fb1-4eb1-a389-2c4959d5cd54 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:30:17.277951 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ed54bb2-2fb1-4eb1-a389-2c4959d5cd54 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:30:17.279156 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ed54bb2-2fb1-4eb1-a389-2c4959d5cd54 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:30:17.279156 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ed54bb2-2fb1-4eb1-a389-2c4959d5cd54 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:30:17.279156 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ed54bb2-2fb1-4eb1-a389-2c4959d5cd54 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:30:17.284859 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-11bd986a-02fe-4434-8ea7-39440e7b34cb tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:17.295504 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-6db27e1e-3482-4143-bb9a-66c7710b22de None None] Set router c9d2cce0-31ab-42c3-ac82-14e36499c28f gateway port host: None {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:30:17.301470 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d08aaf8-dea9-4440-8405-2e7a1c3f1eec None None] Pushing event deleted for resources: {'Port': ['ID=53326cfb-82fd-4c01-b6be-8320fdc356a6,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:17.345343 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3bbf71c4-f85a-4f28-9d39-15cfb0a24877 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-466373'] for router_gateway, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:17.372108 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-6be66fbc-5561-4efa-baf3-5cd7590488d7 None None] Attempting to bind port 8c17389a-4a93-4c11-9672-8b0727e2814e on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:30:17.372739 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-6be66fbc-5561-4efa-baf3-5cd7590488d7 None None] Attempting to bind port 8c17389a-4a93-4c11-9672-8b0727e2814e by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '5eddcc50-ff24-4ae6-9020-82b9642df813', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '7399bb70-27fb-4f3b-a5c5-a5ac1c4dc8d3'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:30:17.373101 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6be66fbc-5561-4efa-baf3-5cd7590488d7 None None] Attempting to bind port 8c17389a-4a93-4c11-9672-8b0727e2814e on network 7399bb70-27fb-4f3b-a5c5-a5ac1c4dc8d3 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:30:17.381491 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-21142dd7-5a1e-4838-b777-870ca1b3a789 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:17.385802 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-6db27e1e-3482-4143-bb9a-66c7710b22de None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c9d2cce0-31ab-42c3-ac82-14e36499c28f', 'name': 'tempest-ServersTestJSON-828046534-router', 'tenant_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:28:17Z', 'updated_at': '2021-11-09T04:30:16Z', 'revision_number': 6, 'project_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'gw_port_host': None}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:17.387231 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-21142dd7-5a1e-4838-b777-870ca1b3a789 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:17.387753 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-21142dd7-5a1e-4838-b777-870ca1b3a789 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:17.404903 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d08aaf8-dea9-4440-8405-2e7a1c3f1eec None None] No DVR routers for this DVR port 53326cfb-82fd-4c01-b6be-8320fdc356a6 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:30:17.409208 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6be66fbc-5561-4efa-baf3-5cd7590488d7 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 30, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:30:17.409584 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6be66fbc-5561-4efa-baf3-5cd7590488d7 None None] Checking segment: {'id': '5eddcc50-ff24-4ae6-9020-82b9642df813', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '7399bb70-27fb-4f3b-a5c5-a5ac1c4dc8d3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:30:17.409985 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6be66fbc-5561-4efa-baf3-5cd7590488d7 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:17.410390 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6be66fbc-5561-4efa-baf3-5cd7590488d7 None None] Bound using segment: {'id': '5eddcc50-ff24-4ae6-9020-82b9642df813', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '7399bb70-27fb-4f3b-a5c5-a5ac1c4dc8d3'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:30:17.410878 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-6be66fbc-5561-4efa-baf3-5cd7590488d7 None None] Bound port: 8c17389a-4a93-4c11-9672-8b0727e2814e, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5eddcc50-ff24-4ae6-9020-82b9642df813', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '7399bb70-27fb-4f3b-a5c5-a5ac1c4dc8d3'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:30:17.411257 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6be66fbc-5561-4efa-baf3-5cd7590488d7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:17.411651 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6652ff0e-12cd-44f6-883e-57e0c4c4c7e5 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:17.460281 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6db27e1e-3482-4143-bb9a-66c7710b22de None None] The sync data for ids ['c9d2cce0-31ab-42c3-ac82-14e36499c28f'] in dv-neutron-816802-2-hyperv is: [{'id': 'c9d2cce0-31ab-42c3-ac82-14e36499c28f', 'name': 'tempest-ServersTestJSON-828046534-router', 'tenant_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:28:17Z', 'updated_at': '2021-11-09T04:30:16Z', 'revision_number': 6, 'project_id': 'a229c806094b42c7a0f7ed52f78dfd68', 'gw_port_host': None}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:30:17.488451 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3bbf71c4-f85a-4f28-9d39-15cfb0a24877 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:17.490272 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6652ff0e-12cd-44f6-883e-57e0c4c4c7e5 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Pushing event deleted for resources: {'Subnet': ['ID=c7b32e74-a0f0-4be8-9ac1-514d28bf9a8a,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:17.510232 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3ed54bb2-2fb1-4eb1-a389-2c4959d5cd54 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:17.516979 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3bbf71c4-f85a-4f28-9d39-15cfb0a24877 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:17.520093 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6652ff0e-12cd-44f6-883e-57e0c4c4c7e5 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:17.525780 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-6652ff0e-12cd-44f6-883e-57e0c4c4c7e5 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] 10.222.0.24 "DELETE /v2.0/subnets/c7b32e74-a0f0-4be8-9ac1-514d28bf9a8a HTTP/1.1" status: 204 len: 168 time: 1.2108791 Nov 09 04:30:17.526537 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6652ff0e-12cd-44f6-883e-57e0c4c4c7e5 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:30:17.526954 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6652ff0e-12cd-44f6-883e-57e0c4c4c7e5 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:30:17.527298 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6652ff0e-12cd-44f6-883e-57e0c4c4c7e5 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:30:17.527632 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6652ff0e-12cd-44f6-883e-57e0c4c4c7e5 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:30:17.527965 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6652ff0e-12cd-44f6-883e-57e0c4c4c7e5 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:30:17.528289 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6652ff0e-12cd-44f6-883e-57e0c4c4c7e5 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:30:17.528614 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6652ff0e-12cd-44f6-883e-57e0c4c4c7e5 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:30:17.528888 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-6be66fbc-5561-4efa-baf3-5cd7590488d7 None None] For port 8c17389a-4a93-4c11-9672-8b0727e2814e, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:30:17.528996 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6652ff0e-12cd-44f6-883e-57e0c4c4c7e5 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:30:17.529267 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6652ff0e-12cd-44f6-883e-57e0c4c4c7e5 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:30:17.529609 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6652ff0e-12cd-44f6-883e-57e0c4c4c7e5 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:30:17.529934 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6652ff0e-12cd-44f6-883e-57e0c4c4c7e5 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:30:17.530253 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6652ff0e-12cd-44f6-883e-57e0c4c4c7e5 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:30:17.532002 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-6be66fbc-5561-4efa-baf3-5cd7590488d7 None None] For port 8c17389a-4a93-4c11-9672-8b0727e2814e, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=8c17389a-4a93-4c11-9672-8b0727e2814e,segment=NetworkSegment(5eddcc50-ff24-4ae6-9020-82b9642df813),segment_id=5eddcc50-ff24-4ae6-9020-82b9642df813)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:30:17.532837 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54436) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:17.549064 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-1373216a-02d0-461e-80b9-86426194eff1 None None] Allocated IP 172.20.0.1 (f16672d2-3d55-4ccc-844f-a1ab468ad9db/a23c1d35-7377-416a-afd7-f17bae47cfc9/35b8d915-9e94-428b-ade3-653f286b9d56) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:30:17.612644 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6be66fbc-5561-4efa-baf3-5cd7590488d7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:17.632033 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-21142dd7-5a1e-4838-b777-870ca1b3a789 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 1.9327855 Nov 09 04:30:17.641963 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54438) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:17.652838 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-d2a862d2-f822-4233-aedd-93000a0da0d9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Request body: {'ports': [{'network_id': 'cc397c48-c4cc-4846-a1ef-380b64be450d'}, {'network_id': 'fbf37a20-2f64-4540-9a29-42b164c6fa30'}]} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:17.653149 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-d2a862d2-f822-4233-aedd-93000a0da0d9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Request body: {'port': {'network_id': 'cc397c48-c4cc-4846-a1ef-380b64be450d'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:17.653628 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-d2a862d2-f822-4233-aedd-93000a0da0d9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Request body: {'port': {'network_id': 'fbf37a20-2f64-4540-9a29-42b164c6fa30'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:17.664464 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d1ed3bdf-cfb1-48d8-953f-54981fe3977a admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:17.698721 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-3ed54bb2-2fb1-4eb1-a389-2c4959d5cd54 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['807848a2-a4f3-4a57-9607-825f2f20d042']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:17.700045 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6be66fbc-5561-4efa-baf3-5cd7590488d7 None None] Pushing event updated for resources: {'Port': ['ID=8c17389a-4a93-4c11-9672-8b0727e2814e,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:17.715565 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-89628262-caf6-4255-87a2-ad93fd722c4b tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:17.729512 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-89628262-caf6-4255-87a2-ad93fd722c4b tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] 10.222.0.24 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.1869802 Nov 09 04:30:17.732752 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21142dd7-5a1e-4838-b777-870ca1b3a789 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event updated for resources: {'Network': ['ID=fbf37a20-2f64-4540-9a29-42b164c6fa30,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:17.734735 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54440) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:17.740490 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-3ed54bb2-2fb1-4eb1-a389-2c4959d5cd54 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '390f9f13-b28d-47b2-8cd2-9f274969fa64') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:17.740793 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-3ed54bb2-2fb1-4eb1-a389-2c4959d5cd54 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '390f9f13-b28d-47b2-8cd2-9f274969fa64') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:17.771442 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3bbf71c4-f85a-4f28-9d39-15cfb0a24877 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:17.771968 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3bbf71c4-f85a-4f28-9d39-15cfb0a24877 admin admin] Fanout notify agent at l3_agent the message router_deleted on router c9d2cce0-31ab-42c3-ac82-14e36499c28f {{(pid=102162) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:30:17.778291 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3bbf71c4-f85a-4f28-9d39-15cfb0a24877 admin admin] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:17.781964 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-3bbf71c4-f85a-4f28-9d39-15cfb0a24877 admin admin] 10.222.0.24 "DELETE /v2.0/routers/c9d2cce0-31ab-42c3-ac82-14e36499c28f HTTP/1.1" status: 204 len: 168 time: 2.3540361 Nov 09 04:30:17.783322 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54442) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:17.794140 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network fbf37a20-2f64-4540-9a29-42b164c6fa30 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:30:17.855810 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3ed54bb2-2fb1-4eb1-a389-2c4959d5cd54 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:17.869914 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-0b7f8236-3937-4a11-b3a9-31816ad027ba admin admin] Deleting subnet b11be6b4-75f0-4756-9312-de5295f24e1b {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:30:17.897890 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0b7f8236-3937-4a11-b3a9-31816ad027ba admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:17.947617 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0b2baa7e-6fbd-4263-a245-f5ef2ba6b1bf tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:17.948244 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0b7f8236-3937-4a11-b3a9-31816ad027ba admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:18.051707 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0b7f8236-3937-4a11-b3a9-31816ad027ba admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:18.054758 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-11bd986a-02fe-4434-8ea7-39440e7b34cb tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:18.061784 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3ed54bb2-2fb1-4eb1-a389-2c4959d5cd54 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:18.069225 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1373216a-02d0-461e-80b9-86426194eff1 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:18.098317 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1d573999-7525-4c92-b9bf-e66472b4829e None None] Network 2407b60d-e30f-478f-a68d-2bf482c2f5f4 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:30:18.117776 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3ed54bb2-2fb1-4eb1-a389-2c4959d5cd54 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Releasing vlan 300 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:30:18.118339 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3ed54bb2-2fb1-4eb1-a389-2c4959d5cd54 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:18.121165 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6a6fa85b-8748-4e0e-be5b-36cd2f0ab9fa None None] Network 7399bb70-27fb-4f3b-a5c5-a5ac1c4dc8d3 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:30:18.121302 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:30:18.121302 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:30:18.121302 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:30:18.121302 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:30:18.121302 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:30:18.121302 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:30:18.121302 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:30:18.121302 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:30:18.121302 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:30:18.121302 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:30:18.121302 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:30:18.121302 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:30:18.121302 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:30:18.121302 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:30:18.121302 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:30:18.121302 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:30:18.121302 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:30:18.121302 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:30:18.121302 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:30:18.121302 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:30:18.121302 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:30:18.121302 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:30:18.121302 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:30:18.121302 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:30:18.121302 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:30:18.121302 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:30:18.121302 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:30:18.121302 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:30:18.121302 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:30:18.121302 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:30:18.121302 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:30:18.121302 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:30:18.201474 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1373216a-02d0-461e-80b9-86426194eff1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:18.205422 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0b7f8236-3937-4a11-b3a9-31816ad027ba admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:18.216409 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-32ce6278-e5d4-4b7a-b9cd-6ae438f8ccc6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:18.238655 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b7f8236-3937-4a11-b3a9-31816ad027ba admin admin] Pushing event deleted for resources: {'Subnet': ['ID=b11be6b4-75f0-4756-9312-de5295f24e1b,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:18.241066 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d2a862d2-f822-4233-aedd-93000a0da0d9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Made reservation on behalf of 88f9f8da29bf4a8793b45130d483a6e6 for: {'port': 2} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:30:18.245496 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d2a862d2-f822-4233-aedd-93000a0da0d9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:18.250486 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0b7f8236-3937-4a11-b3a9-31816ad027ba admin admin] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:18.256449 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-0b7f8236-3937-4a11-b3a9-31816ad027ba admin admin] 10.222.0.24 "DELETE /v2.0/subnets/b11be6b4-75f0-4756-9312-de5295f24e1b HTTP/1.1" status: 204 len: 168 time: 0.4693694 Nov 09 04:30:18.260635 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54444) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:18.282152 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d6719077-3f74-427c-a241-bf5d83c6f8e2 None None] Network d4ba3288-221c-40f3-a829-662c462cc93f requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:30:18.285502 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d2a862d2-f822-4233-aedd-93000a0da0d9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:18.349142 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3ed54bb2-2fb1-4eb1-a389-2c4959d5cd54 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:18.401795 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-d1ed3bdf-cfb1-48d8-953f-54981fe3977a admin admin] Deleting port a31e46ce-e371-4177-a2d5-f9a3681f192b {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:30:18.402125 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d1ed3bdf-cfb1-48d8-953f-54981fe3977a admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:18.407966 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3ed54bb2-2fb1-4eb1-a389-2c4959d5cd54 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:18.414317 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-3ed54bb2-2fb1-4eb1-a389-2c4959d5cd54 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "DELETE /v2.0/networks/807848a2-a4f3-4a57-9607-825f2f20d042 HTTP/1.1" status: 204 len: 168 time: 3.0417619 Nov 09 04:30:18.417861 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54446) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:18.448327 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ed54bb2-2fb1-4eb1-a389-2c4959d5cd54 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Pushing event deleted for resources: {'Network': ['ID=807848a2-a4f3-4a57-9607-825f2f20d042,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:18.452806 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-11bd986a-02fe-4434-8ea7-39440e7b34cb tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:18.468717 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-95692e1d-7c7b-4c6e-9b55-6ed3f28aa894 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:18.483451 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f368be63-7585-45e6-9ce4-fe7909db4d96 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:18.489718 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-e4e57c18-df5d-4bf8-8e71-b7d41285ea1b tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] DELETE failed (client error): The resource could not be found. Nov 09 04:30:18.490411 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e4e57c18-df5d-4bf8-8e71-b7d41285ea1b tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:30:18.495890 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e4e57c18-df5d-4bf8-8e71-b7d41285ea1b tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "DELETE /v2.0/subnets/21b1242e-cb25-403c-b89d-2f49e36afaa9 HTTP/1.1" status: 404 len: 337 time: 0.0699716 Nov 09 04:30:18.496490 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [None req-d2a862d2-f822-4233-aedd-93000a0da0d9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] device_id is not set on port 86752625-c92f-47ca-8662-6d3e1bc49a32 yet. {{(pid=102162) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:30:18.502485 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54448) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:18.533366 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-58d9c507-de0c-4daf-aad1-beb76e56be45 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] DELETE failed (client error): The resource could not be found. Nov 09 04:30:18.533995 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-58d9c507-de0c-4daf-aad1-beb76e56be45 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:30:18.539506 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-58d9c507-de0c-4daf-aad1-beb76e56be45 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "DELETE /v2.0/networks/3ba7cbec-5c67-4017-89a4-d38ecdcd019a HTTP/1.1" status: 404 len: 339 time: 0.0331421 Nov 09 04:30:18.559997 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54450) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:18.583103 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1373216a-02d0-461e-80b9-86426194eff1 None None] Network f16672d2-3d55-4ccc-844f-a1ab468ad9db is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:30:18.605582 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 7101fd59-3be8-4029-b9cf-5a6533d9f71f up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:30:18.609155 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-09c89cbf-a2a3-48ba-a602-f6da2d6ccc3e None None] Provisioning complete for port 7101fd59-3be8-4029-b9cf-5a6533d9f71f triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:30:18.609155 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-09c89cbf-a2a3-48ba-a602-f6da2d6ccc3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:18.640030 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11bd986a-02fe-4434-8ea7-39440e7b34cb tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event deleted for resources: {'Subnet': ['ID=a23c1d35-7377-416a-afd7-f17bae47cfc9,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:18.644105 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-5faee4be-71fc-4775-bd4f-24843c4fe57c tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Deleting subnet 55f532c1-0964-46c0-bb3d-4cdfb666bdde {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:30:18.669985 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-1373216a-02d0-461e-80b9-86426194eff1 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:18.673939 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1373216a-02d0-461e-80b9-86426194eff1 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:30:18.677494 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95692e1d-7c7b-4c6e-9b55-6ed3f28aa894 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Pushing event deleted for resources: {'Port': ['ID=aff23a33-a3ae-4f92-a35a-dc548a11d22e,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:18.681512 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5faee4be-71fc-4775-bd4f-24843c4fe57c tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:18.706736 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1373216a-02d0-461e-80b9-86426194eff1 None None] Pushing event updated for resources: {'Port': ['ID=35b8d915-9e94-428b-ade3-653f286b9d56,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:18.718403 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-f368be63-7585-45e6-9ce4-fe7909db4d96 admin admin] Deleting port 29a6d3fc-4c49-4c48-8a90-1e058b15af0d {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:30:18.718710 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f368be63-7585-45e6-9ce4-fe7909db4d96 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:18.761348 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1373216a-02d0-461e-80b9-86426194eff1 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:30:18.761653 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1373216a-02d0-461e-80b9-86426194eff1 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:30:18.761998 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1373216a-02d0-461e-80b9-86426194eff1 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:30:18.762335 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1373216a-02d0-461e-80b9-86426194eff1 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:30:18.762695 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1373216a-02d0-461e-80b9-86426194eff1 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:30:18.763037 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1373216a-02d0-461e-80b9-86426194eff1 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:30:18.763372 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1373216a-02d0-461e-80b9-86426194eff1 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:30:18.763700 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1373216a-02d0-461e-80b9-86426194eff1 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:30:18.764046 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1373216a-02d0-461e-80b9-86426194eff1 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:30:18.764416 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1373216a-02d0-461e-80b9-86426194eff1 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:30:18.764759 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1373216a-02d0-461e-80b9-86426194eff1 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:30:18.765085 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1373216a-02d0-461e-80b9-86426194eff1 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:30:18.782565 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0b2baa7e-6fbd-4263-a245-f5ef2ba6b1bf tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Router 94e78643-8c7f-4500-ac2d-ed3cabe59101 is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102161) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:30:18.803005 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-11bd986a-02fe-4434-8ea7-39440e7b34cb tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:18.811402 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-32ce6278-e5d4-4b7a-b9cd-6ae438f8ccc6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Deleting port 8c17389a-4a93-4c11-9672-8b0727e2814e {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:30:18.811787 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-32ce6278-e5d4-4b7a-b9cd-6ae438f8ccc6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:18.816684 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5faee4be-71fc-4775-bd4f-24843c4fe57c tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:18.894071 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-95692e1d-7c7b-4c6e-9b55-6ed3f28aa894 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-466373'] for router_gateway, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:18.921051 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 7101fd59-3be8-4029-b9cf-5a6533d9f71f triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:30:18.921944 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:18.935620 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5faee4be-71fc-4775-bd4f-24843c4fe57c tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:19.009135 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-09c89cbf-a2a3-48ba-a602-f6da2d6ccc3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:19.011200 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-1373216a-02d0-461e-80b9-86426194eff1 None None] Attempting to bind port 35b8d915-9e94-428b-ade3-653f286b9d56 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:30:19.011781 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-1373216a-02d0-461e-80b9-86426194eff1 None None] Attempting to bind port 35b8d915-9e94-428b-ade3-653f286b9d56 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'd1461667-0349-4ea8-bfaa-b12234c64fac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 301, 'network_id': 'f16672d2-3d55-4ccc-844f-a1ab468ad9db'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:30:19.012301 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1373216a-02d0-461e-80b9-86426194eff1 None None] Attempting to bind port 35b8d915-9e94-428b-ade3-653f286b9d56 on network f16672d2-3d55-4ccc-844f-a1ab468ad9db {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:30:19.022509 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-f368be63-7585-45e6-9ce4-fe7909db4d96 admin admin] For port 29a6d3fc-4c49-4c48-8a90-1e058b15af0d, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=29a6d3fc-4c49-4c48-8a90-1e058b15af0d,segment=NetworkSegment(9b34c07b-e9e3-4439-982a-e160009938cf),segment_id=9b34c07b-e9e3-4439-982a-e160009938cf)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:30:19.023002 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f368be63-7585-45e6-9ce4-fe7909db4d96 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:19.029999 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1373216a-02d0-461e-80b9-86426194eff1 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 30, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:30:19.030734 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1373216a-02d0-461e-80b9-86426194eff1 None None] Checking segment: {'id': 'd1461667-0349-4ea8-bfaa-b12234c64fac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 301, 'network_id': 'f16672d2-3d55-4ccc-844f-a1ab468ad9db'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:30:19.031454 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1373216a-02d0-461e-80b9-86426194eff1 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:19.031998 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1373216a-02d0-461e-80b9-86426194eff1 None None] Bound using segment: {'id': 'd1461667-0349-4ea8-bfaa-b12234c64fac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 301, 'network_id': 'f16672d2-3d55-4ccc-844f-a1ab468ad9db'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:30:19.032836 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-1373216a-02d0-461e-80b9-86426194eff1 None None] Bound port: 35b8d915-9e94-428b-ade3-653f286b9d56, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd1461667-0349-4ea8-bfaa-b12234c64fac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 301, 'network_id': 'f16672d2-3d55-4ccc-844f-a1ab468ad9db'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:30:19.033544 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1373216a-02d0-461e-80b9-86426194eff1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:19.039255 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-f368be63-7585-45e6-9ce4-fe7909db4d96 admin admin] Calling delete_port for 29a6d3fc-4c49-4c48-8a90-1e058b15af0d owned by network:dhcp {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:30:19.040668 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-14a781b5-7db8-4d47-8cd2-31878c1c7052 None None] DHCP port deletion for 2407b60d-e30f-478f-a68d-2bf482c2f5f4 request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:30:19.122481 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5faee4be-71fc-4775-bd4f-24843c4fe57c tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:19.126660 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d2a862d2-f822-4233-aedd-93000a0da0d9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:19.131399 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-09c89cbf-a2a3-48ba-a602-f6da2d6ccc3e None None] For port 7101fd59-3be8-4029-b9cf-5a6533d9f71f, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=7101fd59-3be8-4029-b9cf-5a6533d9f71f,segment=NetworkSegment(dc817592-f56a-425b-948a-1516f6b1beb7),segment_id=dc817592-f56a-425b-948a-1516f6b1beb7)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:30:19.133856 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e79e0d2c-3ba7-4e1a-a5b9-a39cb1636091 None None] DHCP port deletion for d4ba3288-221c-40f3-a829-662c462cc93f request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:30:19.195290 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5faee4be-71fc-4775-bd4f-24843c4fe57c tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Pushing event deleted for resources: {'Subnet': ['ID=55f532c1-0964-46c0-bb3d-4cdfb666bdde,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:19.201249 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5faee4be-71fc-4775-bd4f-24843c4fe57c tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:19.201534 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-09c89cbf-a2a3-48ba-a602-f6da2d6ccc3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:19.209365 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-5faee4be-71fc-4775-bd4f-24843c4fe57c tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "DELETE /v2.0/subnets/55f532c1-0964-46c0-bb3d-4cdfb666bdde HTTP/1.1" status: 204 len: 168 time: 0.6470363 Nov 09 04:30:19.217541 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-74dd604e-874f-4b96-86a7-f598f9ace987 None None] Network 6f70786d-53ba-429d-b311-5a26e2e908bd requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:30:19.237772 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54452) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:19.257113 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-d1ed3bdf-cfb1-48d8-953f-54981fe3977a admin admin] For port a31e46ce-e371-4177-a2d5-f9a3681f192b, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=a31e46ce-e371-4177-a2d5-f9a3681f192b,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:30:19.257817 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d1ed3bdf-cfb1-48d8-953f-54981fe3977a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:19.271105 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:19.287636 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [None req-d2a862d2-f822-4233-aedd-93000a0da0d9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] device_id is not set on port 2ea9aea3-f5d8-4a4a-ba62-37e354a74128 yet. {{(pid=102162) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:30:19.316604 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f368be63-7585-45e6-9ce4-fe7909db4d96 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:19.317134 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-1373216a-02d0-461e-80b9-86426194eff1 None None] For port 35b8d915-9e94-428b-ade3-653f286b9d56, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:30:19.321291 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-d1ed3bdf-cfb1-48d8-953f-54981fe3977a admin admin] Calling delete_port for a31e46ce-e371-4177-a2d5-f9a3681f192b owned by network:router_gateway {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:30:19.361650 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f368be63-7585-45e6-9ce4-fe7909db4d96 admin admin] Pushing event deleted for resources: {'Port': ['ID=29a6d3fc-4c49-4c48-8a90-1e058b15af0d,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:19.362639 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-1373216a-02d0-461e-80b9-86426194eff1 None None] For port 35b8d915-9e94-428b-ade3-653f286b9d56, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=35b8d915-9e94-428b-ade3-653f286b9d56,segment=NetworkSegment(d1461667-0349-4ea8-bfaa-b12234c64fac),segment_id=d1461667-0349-4ea8-bfaa-b12234c64fac)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:30:19.369096 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f368be63-7585-45e6-9ce4-fe7909db4d96 admin admin] No DVR routers for this DVR port 29a6d3fc-4c49-4c48-8a90-1e058b15af0d on host dv-neutron-816802-2-hyperv {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:30:19.377479 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4f8bb5c1-fc88-4472-9f0d-4da105dafa41 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:19.384342 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-95692e1d-7c7b-4c6e-9b55-6ed3f28aa894 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:19.386864 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09c89cbf-a2a3-48ba-a602-f6da2d6ccc3e None None] Pushing event updated for resources: {'Port': ['ID=7101fd59-3be8-4029-b9cf-5a6533d9f71f,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:19.391257 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-95692e1d-7c7b-4c6e-9b55-6ed3f28aa894 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:19.391908 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-14a781b5-7db8-4d47-8cd2-31878c1c7052 None None] Deleting port 7101fd59-3be8-4029-b9cf-5a6533d9f71f {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:30:19.392123 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-14a781b5-7db8-4d47-8cd2-31878c1c7052 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:19.405557 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-11bd986a-02fe-4434-8ea7-39440e7b34cb tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f16672d2-3d55-4ccc-844f-a1ab468ad9db']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:19.437588 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-11bd986a-02fe-4434-8ea7-39440e7b34cb tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd1461667-0349-4ea8-bfaa-b12234c64fac') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:19.437958 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-11bd986a-02fe-4434-8ea7-39440e7b34cb tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd1461667-0349-4ea8-bfaa-b12234c64fac') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:19.442676 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-32ce6278-e5d4-4b7a-b9cd-6ae438f8ccc6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] For port 8c17389a-4a93-4c11-9672-8b0727e2814e, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=8c17389a-4a93-4c11-9672-8b0727e2814e,segment=NetworkSegment(5eddcc50-ff24-4ae6-9020-82b9642df813),segment_id=5eddcc50-ff24-4ae6-9020-82b9642df813)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:30:19.442982 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-32ce6278-e5d4-4b7a-b9cd-6ae438f8ccc6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:19.454537 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1373216a-02d0-461e-80b9-86426194eff1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:19.520740 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f368be63-7585-45e6-9ce4-fe7909db4d96 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:19.532326 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e79e0d2c-3ba7-4e1a-a5b9-a39cb1636091 None None] Deleting port 29a6d3fc-4c49-4c48-8a90-1e058b15af0d {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:30:19.532699 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e79e0d2c-3ba7-4e1a-a5b9-a39cb1636091 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:19.536061 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-11bd986a-02fe-4434-8ea7-39440e7b34cb tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:19.547077 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-32ce6278-e5d4-4b7a-b9cd-6ae438f8ccc6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Calling delete_port for 8c17389a-4a93-4c11-9672-8b0727e2814e owned by network:dhcp {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:30:19.562731 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-f368be63-7585-45e6-9ce4-fe7909db4d96 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d4ba3288-221c-40f3-a829-662c462cc93f']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:19.569628 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0b2baa7e-6fbd-4263-a245-f5ef2ba6b1bf tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:30:19.578127 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-11bd986a-02fe-4434-8ea7-39440e7b34cb tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:19.579151 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.db.api [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=102163) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:30:19.579506 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG oslo_db.api [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:30:19.588405 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-f368be63-7585-45e6-9ce4-fe7909db4d96 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9b34c07b-e9e3-4439-982a-e160009938cf') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:19.588405 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-f368be63-7585-45e6-9ce4-fe7909db4d96 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9b34c07b-e9e3-4439-982a-e160009938cf') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:19.613714 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f368be63-7585-45e6-9ce4-fe7909db4d96 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:19.617322 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d2a862d2-f822-4233-aedd-93000a0da0d9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:19.622668 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aa06ee4c-c699-4be4-a38b-e72d5301dfa5 None None] Sync routers for ids ['94e78643-8c7f-4500-ac2d-ed3cabe59101'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:30:19.629675 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-95692e1d-7c7b-4c6e-9b55-6ed3f28aa894 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:19.630330 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-14a781b5-7db8-4d47-8cd2-31878c1c7052 None None] For port 7101fd59-3be8-4029-b9cf-5a6533d9f71f, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=7101fd59-3be8-4029-b9cf-5a6533d9f71f,segment=NetworkSegment(dc817592-f56a-425b-948a-1516f6b1beb7),segment_id=dc817592-f56a-425b-948a-1516f6b1beb7)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:30:19.630626 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-95692e1d-7c7b-4c6e-9b55-6ed3f28aa894 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Fanout notify agent at l3_agent the message router_deleted on router 456b7559-d36a-4838-be45-e4472d3b3437 {{(pid=102161) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:30:19.630753 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-14a781b5-7db8-4d47-8cd2-31878c1c7052 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:19.648288 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-95692e1d-7c7b-4c6e-9b55-6ed3f28aa894 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:19.649559 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-95692e1d-7c7b-4c6e-9b55-6ed3f28aa894 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] 10.222.0.24 "DELETE /v2.0/routers/456b7559-d36a-4838-be45-e4472d3b3437 HTTP/1.1" status: 204 len: 168 time: 4.6266325 Nov 09 04:30:19.656183 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-11bd986a-02fe-4434-8ea7-39440e7b34cb tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Releasing vlan 301 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:30:19.656321 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-11bd986a-02fe-4434-8ea7-39440e7b34cb tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:19.660024 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:30:19.660024 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:30:19.660024 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:30:19.660024 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:30:19.660024 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:30:19.660024 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:30:19.660024 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:30:19.660024 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:30:19.660024 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:30:19.660024 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:30:19.660024 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:30:19.660024 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:30:19.660024 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:30:19.660024 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:30:19.660024 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:30:19.660024 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:30:19.660024 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:30:19.660024 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:30:19.660024 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:30:19.660024 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:30:19.660024 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:30:19.660024 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:30:19.660024 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:30:19.660024 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:30:19.660024 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:30:19.660024 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:30:19.660024 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:30:19.660024 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:30:19.660024 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:30:19.660024 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:30:19.660024 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:30:19.660024 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:30:19.673138 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54454) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:19.678057 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-2507d6a5-3fec-4d8c-974b-ef838a5514c6 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Request body: {'router': {'name': 'tempest-RoutersIpV6AdminTest-router-1451098090', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:19.692442 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-14a781b5-7db8-4d47-8cd2-31878c1c7052 None None] Calling delete_port for 7101fd59-3be8-4029-b9cf-5a6533d9f71f owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:30:19.699886 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1373216a-02d0-461e-80b9-86426194eff1 None None] Pushing event updated for resources: {'Port': ['ID=35b8d915-9e94-428b-ade3-653f286b9d56,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:19.716664 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e79e0d2c-3ba7-4e1a-a5b9-a39cb1636091 None None] For port 29a6d3fc-4c49-4c48-8a90-1e058b15af0d, host dv-neutron-816802-2-hyperv, got binding levels [] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:30:19.717066 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e79e0d2c-3ba7-4e1a-a5b9-a39cb1636091 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:19.741023 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aa06ee4c-c699-4be4-a38b-e72d5301dfa5 None None] Routers {'94e78643-8c7f-4500-ac2d-ed3cabe59101'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:30:19.742052 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-aa06ee4c-c699-4be4-a38b-e72d5301dfa5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:30:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['94e78643-8c7f-4500-ac2d-ed3cabe59101'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:19.751190 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0b2baa7e-6fbd-4263-a245-f5ef2ba6b1bf tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:19.753001 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-0b2baa7e-6fbd-4263-a245-f5ef2ba6b1bf tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 906 time: 8.2171903 Nov 09 04:30:19.765744 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54456) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:19.816209 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-16c4d714-190e-45cb-8ee3-53d954f15e2e None None] Network f16672d2-3d55-4ccc-844f-a1ab468ad9db requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:30:19.822501 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e79e0d2c-3ba7-4e1a-a5b9-a39cb1636091 None None] Calling delete_port for 29a6d3fc-4c49-4c48-8a90-1e058b15af0d owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:30:19.836607 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.ipam_backend_mixin [None req-e79e0d2c-3ba7-4e1a-a5b9-a39cb1636091 None None] Port 29a6d3fc-4c49-4c48-8a90-1e058b15af0d was not found and therefore no delete operation was performed {{(pid=102163) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Nov 09 04:30:19.854201 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6751c05d-5d90-40b4-ae3c-0cd72c5aff61 None None] DHCP port deletion for 6f70786d-53ba-429d-b311-5a26e2e908bd request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:30:19.865105 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e79e0d2c-3ba7-4e1a-a5b9-a39cb1636091 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:19.898001 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.db.api [None req-11bd986a-02fe-4434-8ea7-39440e7b34cb tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Nov 09 04:30:19.898001 dv-neutron-816802-2-hyperv neutron-server[102161]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Nov 09 04:30:19.898001 dv-neutron-816802-2-hyperv neutron-server[102161]: [parameters: {'id': 'f16672d2-3d55-4ccc-844f-a1ab468ad9db'}] Nov 09 04:30:19.898001 dv-neutron-816802-2-hyperv neutron-server[102161]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=102161) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:30:19.898819 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG oslo_db.api [None req-11bd986a-02fe-4434-8ea7-39440e7b34cb tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:30:19.977458 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f368be63-7585-45e6-9ce4-fe7909db4d96 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:19.984944 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-4f8bb5c1-fc88-4472-9f0d-4da105dafa41 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Deleting port ed6c5b80-b384-44d8-ba31-14b833a9cdf8 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:30:19.985285 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4f8bb5c1-fc88-4472-9f0d-4da105dafa41 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:19.987616 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2507d6a5-3fec-4d8c-974b-ef838a5514c6 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:19.988201 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e79e0d2c-3ba7-4e1a-a5b9-a39cb1636091 None None] Pushing event deleted for resources: {'Port': ['ID=29a6d3fc-4c49-4c48-8a90-1e058b15af0d,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:19.988863 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2507d6a5-3fec-4d8c-974b-ef838a5514c6 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:19.992027 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f368be63-7585-45e6-9ce4-fe7909db4d96 admin admin] Releasing vlan 348 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:30:19.992418 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f368be63-7585-45e6-9ce4-fe7909db4d96 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:19.994146 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:30:19.994146 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:30:19.994146 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:30:19.994146 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:30:19.994146 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:30:19.994146 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:30:19.994146 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:30:19.994146 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:30:19.994146 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:30:19.994146 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:30:19.994146 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:30:19.994146 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:30:19.994146 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:30:19.994146 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:30:19.994146 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:30:19.994146 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:30:19.994146 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:30:19.994146 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:30:19.994146 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:30:19.994146 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:30:19.994146 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:30:19.994146 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:30:19.994146 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:30:19.994146 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:30:19.994146 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:30:19.994146 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:30:19.994146 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:30:19.994146 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:30:19.994146 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:30:19.994146 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:30:19.994146 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:30:19.994146 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:30:20.007968 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e79e0d2c-3ba7-4e1a-a5b9-a39cb1636091 None None] No DVR routers for this DVR port 29a6d3fc-4c49-4c48-8a90-1e058b15af0d on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:30:20.019584 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-4ef2f038-c157-4949-b511-6d81e1958e9c tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] 10.222.0.24 "GET /v2.0/routers/94e78643-8c7f-4500-ac2d-ed3cabe59101 HTTP/1.1" status: 200 len: 907 time: 0.2489316 Nov 09 04:30:20.026657 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54458) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:20.034700 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-32ce6278-e5d4-4b7a-b9cd-6ae438f8ccc6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:20.041156 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-c3802379-89b6-4414-811a-9daa127429e6 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Request body: {'router': {'name': 'tempest-snat-router-55453648', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'enable_snat': True}}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:20.069775 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32ce6278-e5d4-4b7a-b9cd-6ae438f8ccc6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Pushing event deleted for resources: {'Port': ['ID=8c17389a-4a93-4c11-9672-8b0727e2814e,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:20.087311 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-aa06ee4c-c699-4be4-a38b-e72d5301dfa5 None None] Set router 94e78643-8c7f-4500-ac2d-ed3cabe59101 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:30:20.099435 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-32ce6278-e5d4-4b7a-b9cd-6ae438f8ccc6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] No DVR routers for this DVR port 8c17389a-4a93-4c11-9672-8b0727e2814e on host dv-neutron-816802-2-hyperv {{(pid=102161) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:30:20.102978 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2507d6a5-3fec-4d8c-974b-ef838a5514c6 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:20.133239 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d1ed3bdf-cfb1-48d8-953f-54981fe3977a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:20.141235 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-4f8bb5c1-fc88-4472-9f0d-4da105dafa41 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] For port ed6c5b80-b384-44d8-ba31-14b833a9cdf8, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=ed6c5b80-b384-44d8-ba31-14b833a9cdf8,segment=NetworkSegment(649c5ab9-1338-4cdb-aae3-0ee34f456666),segment_id=649c5ab9-1338-4cdb-aae3-0ee34f456666)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:30:20.141600 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4f8bb5c1-fc88-4472-9f0d-4da105dafa41 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:20.157142 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-4f8bb5c1-fc88-4472-9f0d-4da105dafa41 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Calling delete_port for ed6c5b80-b384-44d8-ba31-14b833a9cdf8 owned by network:dhcp {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:30:20.177595 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2507d6a5-3fec-4d8c-974b-ef838a5514c6 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:20.196895 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1ed3bdf-cfb1-48d8-953f-54981fe3977a admin admin] Pushing event deleted for resources: {'Port': ['ID=a31e46ce-e371-4177-a2d5-f9a3681f192b,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:20.201834 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d2a862d2-f822-4233-aedd-93000a0da0d9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:20.243129 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c3802379-89b6-4414-811a-9daa127429e6 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:20.244096 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c3802379-89b6-4414-811a-9daa127429e6 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:20.254716 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f368be63-7585-45e6-9ce4-fe7909db4d96 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:20.277508 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f368be63-7585-45e6-9ce4-fe7909db4d96 admin admin] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:20.280856 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-f368be63-7585-45e6-9ce4-fe7909db4d96 admin admin] 10.222.0.24 "DELETE /v2.0/networks/d4ba3288-221c-40f3-a829-662c462cc93f HTTP/1.1" status: 204 len: 168 time: 2.0192583 Nov 09 04:30:20.286318 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d2a862d2-f822-4233-aedd-93000a0da0d9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Network cc397c48-c4cc-4846-a1ef-380b64be450d is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:30:20.308919 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-d2a862d2-f822-4233-aedd-93000a0da0d9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:20.311282 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-32ce6278-e5d4-4b7a-b9cd-6ae438f8ccc6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:20.313494 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f368be63-7585-45e6-9ce4-fe7909db4d96 admin admin] Pushing event deleted for resources: {'Network': ['ID=d4ba3288-221c-40f3-a829-662c462cc93f,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:20.315172 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2a862d2-f822-4233-aedd-93000a0da0d9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event updated for resources: {'Port': ['ID=86752625-c92f-47ca-8662-6d3e1bc49a32,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:20.325343 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2507d6a5-3fec-4d8c-974b-ef838a5514c6 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:20.328670 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-2507d6a5-3fec-4d8c-974b-ef838a5514c6 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 0.6544981 Nov 09 04:30:20.334387 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d2a862d2-f822-4233-aedd-93000a0da0d9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:30:20.334583 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d2a862d2-f822-4233-aedd-93000a0da0d9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:20.336325 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54464) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:20.352173 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-87d9f8cf-f792-4c5e-88c0-3d46fab9243e tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'enable_snat': False}}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:20.352541 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d1ed3bdf-cfb1-48d8-953f-54981fe3977a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-466373'] for router_gateway, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:20.359668 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-14a781b5-7db8-4d47-8cd2-31878c1c7052 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:20.423351 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14a781b5-7db8-4d47-8cd2-31878c1c7052 None None] Pushing event deleted for resources: {'Port': ['ID=7101fd59-3be8-4029-b9cf-5a6533d9f71f,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:20.427395 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-14a781b5-7db8-4d47-8cd2-31878c1c7052 None None] No DVR routers for this DVR port 7101fd59-3be8-4029-b9cf-5a6533d9f71f on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:30:20.438224 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-11bd986a-02fe-4434-8ea7-39440e7b34cb tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:20.442418 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c3802379-89b6-4414-811a-9daa127429e6 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:20.445741 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-32ce6278-e5d4-4b7a-b9cd-6ae438f8ccc6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7399bb70-27fb-4f3b-a5c5-a5ac1c4dc8d3']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:20.491592 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-6751c05d-5d90-40b4-ae3c-0cd72c5aff61 None None] Deleting port ed6c5b80-b384-44d8-ba31-14b833a9cdf8 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:30:20.491971 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6751c05d-5d90-40b4-ae3c-0cd72c5aff61 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:20.511254 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-32ce6278-e5d4-4b7a-b9cd-6ae438f8ccc6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5eddcc50-ff24-4ae6-9020-82b9642df813') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:20.511551 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-32ce6278-e5d4-4b7a-b9cd-6ae438f8ccc6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5eddcc50-ff24-4ae6-9020-82b9642df813') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:20.527544 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d1ed3bdf-cfb1-48d8-953f-54981fe3977a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:20.529053 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d1ed3bdf-cfb1-48d8-953f-54981fe3977a admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:20.535479 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-32ce6278-e5d4-4b7a-b9cd-6ae438f8ccc6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:20.606468 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 6e983a96-52c7-4df1-885b-dc7cdba4b08e no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:30:20.609478 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-6751c05d-5d90-40b4-ae3c-0cd72c5aff61 None None] For port ed6c5b80-b384-44d8-ba31-14b833a9cdf8, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=ed6c5b80-b384-44d8-ba31-14b833a9cdf8,segment=NetworkSegment(649c5ab9-1338-4cdb-aae3-0ee34f456666),segment_id=649c5ab9-1338-4cdb-aae3-0ee34f456666)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:30:20.609836 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6751c05d-5d90-40b4-ae3c-0cd72c5aff61 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:20.616267 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-32ce6278-e5d4-4b7a-b9cd-6ae438f8ccc6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:20.626904 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-32ce6278-e5d4-4b7a-b9cd-6ae438f8ccc6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Releasing vlan 349 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:30:20.627358 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-32ce6278-e5d4-4b7a-b9cd-6ae438f8ccc6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:20.631227 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:30:20.631227 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:30:20.631227 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:30:20.631227 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:30:20.631227 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:30:20.631227 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:30:20.631227 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:30:20.631227 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:30:20.631227 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:30:20.631227 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:30:20.631227 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:30:20.631227 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:30:20.631227 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:30:20.631227 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:30:20.631227 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:30:20.631227 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:30:20.631227 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:30:20.631227 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:30:20.631227 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:30:20.631227 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:30:20.631227 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:30:20.631227 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:30:20.631227 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:30:20.631227 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:30:20.631227 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:30:20.631227 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:30:20.631227 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:30:20.631227 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:30:20.631227 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:30:20.631227 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:30:20.631227 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:30:20.631227 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:30:20.655876 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-6751c05d-5d90-40b4-ae3c-0cd72c5aff61 None None] Calling delete_port for ed6c5b80-b384-44d8-ba31-14b833a9cdf8 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:30:20.657514 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 6e983a96-52c7-4df1-885b-dc7cdba4b08e {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:30:20.657867 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 6e983a96-52c7-4df1-885b-dc7cdba4b08e not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:30:20.658247 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 53326cfb-82fd-4c01-b6be-8320fdc356a6 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:30:20.688010 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 53326cfb-82fd-4c01-b6be-8320fdc356a6 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:30:20.688349 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 53326cfb-82fd-4c01-b6be-8320fdc356a6 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:30:20.689148 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 76f630f8-c464-46b2-b3b3-6a4c815cc2cf no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:30:20.709534 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-11bd986a-02fe-4434-8ea7-39440e7b34cb tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Deleting port 35b8d915-9e94-428b-ade3-653f286b9d56 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:30:20.709534 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-11bd986a-02fe-4434-8ea7-39440e7b34cb tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:20.717953 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4f8bb5c1-fc88-4472-9f0d-4da105dafa41 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:20.737859 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d1ed3bdf-cfb1-48d8-953f-54981fe3977a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:20.738440 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d1ed3bdf-cfb1-48d8-953f-54981fe3977a admin admin] Fanout notify agent at l3_agent the message router_deleted on router 23955a4a-3903-49e9-ab99-5e003c83c868 {{(pid=102161) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:30:20.744475 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d1ed3bdf-cfb1-48d8-953f-54981fe3977a admin admin] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:20.744697 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2a862d2-f822-4233-aedd-93000a0da0d9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event updated for resources: {'Port': ['ID=2ea9aea3-f5d8-4a4a-ba62-37e354a74128,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:20.748106 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-d1ed3bdf-cfb1-48d8-953f-54981fe3977a admin admin] 10.222.0.24 "DELETE /v2.0/routers/23955a4a-3903-49e9-ab99-5e003c83c868 HTTP/1.1" status: 204 len: 168 time: 4.8148053 Nov 09 04:30:20.748236 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 76f630f8-c464-46b2-b3b3-6a4c815cc2cf {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:30:20.750451 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 76f630f8-c464-46b2-b3b3-6a4c815cc2cf not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:30:20.750599 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54466) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:20.755697 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4f8bb5c1-fc88-4472-9f0d-4da105dafa41 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] No DVR routers for this DVR port ed6c5b80-b384-44d8-ba31-14b833a9cdf8 on host dv-neutron-816802-2-hyperv {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:30:20.788099 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-aa06ee4c-c699-4be4-a38b-e72d5301dfa5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '94e78643-8c7f-4500-ac2d-ed3cabe59101', 'name': 'tempest-snat-router-55453648', 'tenant_id': 'cf43ca7e091f42ca80c78a3f7dbeba63', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.113'}], 'enable_snat': False}, 'gw_port_id': '9947f24d-f96c-49f9-8eb6-2be971ed9745', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:30:11Z', 'updated_at': '2021-11-09T04:30:15Z', 'revision_number': 3, 'project_id': 'cf43ca7e091f42ca80c78a3f7dbeba63', 'gw_port': {'id': '9947f24d-f96c-49f9-8eb6-2be971ed9745', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:a8:0d:41', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '94e78643-8c7f-4500-ac2d-ed3cabe59101', 'device_owner': 'network:router_gateway', 'standard_attr_id': 457, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:30:13Z', 'updated_at': '2021-11-09T04:30:14Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': False, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:20.789179 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d2a862d2-f822-4233-aedd-93000a0da0d9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Checking segment: {'id': '29f62496-7e30-4776-b257-351cfaaf21cb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 316, 'network_id': 'fbf37a20-2f64-4540-9a29-42b164c6fa30'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:30:20.789862 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d2a862d2-f822-4233-aedd-93000a0da0d9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Network hostable DHCP agents. Network: fbf37a20-2f64-4540-9a29-42b164c6fa30, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:30:20.829516 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-32ce6278-e5d4-4b7a-b9cd-6ae438f8ccc6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:20.830320 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aa06ee4c-c699-4be4-a38b-e72d5301dfa5 None None] Checking router: 94e78643-8c7f-4500-ac2d-ed3cabe59101 for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:30:20.831238 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aa06ee4c-c699-4be4-a38b-e72d5301dfa5 None None] Updating router 94e78643-8c7f-4500-ac2d-ed3cabe59101 port 9947f24d-f96c-49f9-8eb6-2be971ed9745 binding host dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 04:30:20.834674 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-32ce6278-e5d4-4b7a-b9cd-6ae438f8ccc6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:20.841160 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-32ce6278-e5d4-4b7a-b9cd-6ae438f8ccc6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] 10.222.0.24 "DELETE /v2.0/networks/7399bb70-27fb-4f3b-a5c5-a5ac1c4dc8d3 HTTP/1.1" status: 204 len: 168 time: 3.0924401 Nov 09 04:30:20.845426 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54468) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:20.859360 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6751c05d-5d90-40b4-ae3c-0cd72c5aff61 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:20.863606 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-aa06ee4c-c699-4be4-a38b-e72d5301dfa5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:20.913445 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6751c05d-5d90-40b4-ae3c-0cd72c5aff61 None None] Pushing event deleted for resources: {'Port': ['ID=ed6c5b80-b384-44d8-ba31-14b833a9cdf8,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:20.919858 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6751c05d-5d90-40b4-ae3c-0cd72c5aff61 None None] No DVR routers for this DVR port ed6c5b80-b384-44d8-ba31-14b833a9cdf8 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:30:20.926658 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54470) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:20.956235 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f8bb5c1-fc88-4472-9f0d-4da105dafa41 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Pushing event deleted for resources: {'Port': ['ID=ed6c5b80-b384-44d8-ba31-14b833a9cdf8,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:20.971879 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-11bd986a-02fe-4434-8ea7-39440e7b34cb tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] For port 35b8d915-9e94-428b-ade3-653f286b9d56, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=35b8d915-9e94-428b-ade3-653f286b9d56,segment=NetworkSegment(d1461667-0349-4ea8-bfaa-b12234c64fac),segment_id=d1461667-0349-4ea8-bfaa-b12234c64fac)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:30:20.972459 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-11bd986a-02fe-4434-8ea7-39440e7b34cb tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:20.979811 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32ce6278-e5d4-4b7a-b9cd-6ae438f8ccc6 tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Pushing event deleted for resources: {'Network': ['ID=7399bb70-27fb-4f3b-a5c5-a5ac1c4dc8d3,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:21.003762 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-87d9f8cf-f792-4c5e-88c0-3d46fab9243e tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:21.008543 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5f527eb0-2342-4217-8e13-239b1e40a93a None None] get_active_networks_info from dv-neutron-816802-2-hyperv {{(pid=102163) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}} Nov 09 04:30:21.045872 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-11bd986a-02fe-4434-8ea7-39440e7b34cb tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Calling delete_port for 35b8d915-9e94-428b-ade3-653f286b9d56 owned by network:dhcp {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:30:21.054043 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c3802379-89b6-4414-811a-9daa127429e6 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:21.078635 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-6be3439a-87c2-4999-8dc5-6cbce8423c71 admin admin] Deleting subnet a3d93294-0484-46fa-b8a6-204ec86c9c5f {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:30:21.096469 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4f8bb5c1-fc88-4472-9f0d-4da105dafa41 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:21.096769 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6be3439a-87c2-4999-8dc5-6cbce8423c71 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:21.136134 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-4f8bb5c1-fc88-4472-9f0d-4da105dafa41 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6f70786d-53ba-429d-b311-5a26e2e908bd']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:21.155028 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-4f8bb5c1-fc88-4472-9f0d-4da105dafa41 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '649c5ab9-1338-4cdb-aae3-0ee34f456666') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:21.155325 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-4f8bb5c1-fc88-4472-9f0d-4da105dafa41 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '649c5ab9-1338-4cdb-aae3-0ee34f456666') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:21.168713 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8cbe65af-fc62-460a-ad0f-4d5d71dfb33c tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:21.187215 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 7101fd59-3be8-4029-b9cf-5a6533d9f71f no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:30:21.212551 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-903e8558-9c65-4c3d-ae03-b02762dc793b admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=a229c806094b42c7a0f7ed52f78dfd68&name=default HTTP/1.1" status: 200 len: 2992 time: 0.2807710 Nov 09 04:30:21.213134 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5f527eb0-2342-4217-8e13-239b1e40a93a None None] Resources bound (agent type, host, resource id): {{(pid=102163) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 09 04:30:21.215699 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54472) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:21.215929 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4f8bb5c1-fc88-4472-9f0d-4da105dafa41 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:21.226227 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 7101fd59-3be8-4029-b9cf-5a6533d9f71f {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:30:21.226539 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6be3439a-87c2-4999-8dc5-6cbce8423c71 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:21.226951 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 7101fd59-3be8-4029-b9cf-5a6533d9f71f not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:30:21.227049 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d2a862d2-f822-4233-aedd-93000a0da0d9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Network fbf37a20-2f64-4540-9a29-42b164c6fa30 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:30:21.227135 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device ed6c5b80-b384-44d8-ba31-14b833a9cdf8 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:30:21.246136 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4f8bb5c1-fc88-4472-9f0d-4da105dafa41 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:21.258228 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4f8bb5c1-fc88-4472-9f0d-4da105dafa41 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Releasing vlan 313 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:30:21.264477 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4f8bb5c1-fc88-4472-9f0d-4da105dafa41 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:21.264477 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:30:21.264477 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:30:21.264477 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:30:21.264477 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:30:21.264477 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:30:21.264477 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:30:21.264477 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:30:21.264477 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:30:21.264477 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:30:21.264477 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:30:21.264477 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:30:21.264477 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:30:21.264477 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:30:21.264477 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:30:21.264477 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:30:21.264477 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:30:21.264477 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:30:21.264477 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:30:21.264477 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:30:21.264477 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:30:21.264477 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:30:21.264477 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:30:21.264477 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:30:21.264477 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:30:21.264477 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:30:21.264477 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:30:21.264477 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:30:21.264477 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:30:21.264477 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:30:21.264477 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:30:21.264477 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:30:21.264477 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:30:21.266342 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: ed6c5b80-b384-44d8-ba31-14b833a9cdf8 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:30:21.266342 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device ed6c5b80-b384-44d8-ba31-14b833a9cdf8 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:30:21.266810 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 0fc8f26d-1642-4025-b21c-de2a4f14043f no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:30:21.304732 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 0fc8f26d-1642-4025-b21c-de2a4f14043f {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:30:21.305105 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 0fc8f26d-1642-4025-b21c-de2a4f14043f not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:30:21.305483 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 29a6d3fc-4c49-4c48-8a90-1e058b15af0d no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:30:21.349100 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 29a6d3fc-4c49-4c48-8a90-1e058b15af0d {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:30:21.349444 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 29a6d3fc-4c49-4c48-8a90-1e058b15af0d not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:30:21.353209 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-d2a862d2-f822-4233-aedd-93000a0da0d9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, fbf37a20-2f64-4540-9a29-42b164c6fa30) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:21.366643 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d2a862d2-f822-4233-aedd-93000a0da0d9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:30:21.381132 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d2a862d2-f822-4233-aedd-93000a0da0d9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:21.386609 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d2a862d2-f822-4233-aedd-93000a0da0d9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:21.387544 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d2a862d2-f822-4233-aedd-93000a0da0d9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:21.462608 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8cbe65af-fc62-460a-ad0f-4d5d71dfb33c tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:21.469659 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-aa06ee4c-c699-4be4-a38b-e72d5301dfa5 None None] Publish callbacks [] for port, precommit_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:21.471965 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-11bd986a-02fe-4434-8ea7-39440e7b34cb tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:21.474077 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-086eed89-ef1f-489d-a68a-85a4980f8ac4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:21.514109 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-d2a862d2-f822-4233-aedd-93000a0da0d9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1425 time: 3.8685498 Nov 09 04:30:21.515036 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4f8bb5c1-fc88-4472-9f0d-4da105dafa41 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:21.519360 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54474) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:21.534381 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-8cbe65af-fc62-460a-ad0f-4d5d71dfb33c tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2407b60d-e30f-478f-a68d-2bf482c2f5f4']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:21.538521 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-11bd986a-02fe-4434-8ea7-39440e7b34cb tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] No DVR routers for this DVR port 35b8d915-9e94-428b-ade3-653f286b9d56 on host dv-neutron-816802-2-hyperv {{(pid=102161) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:30:21.552540 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11bd986a-02fe-4434-8ea7-39440e7b34cb tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event deleted for resources: {'Port': ['ID=35b8d915-9e94-428b-ade3-653f286b9d56,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:21.556812 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4f8bb5c1-fc88-4472-9f0d-4da105dafa41 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:21.560133 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-4f8bb5c1-fc88-4472-9f0d-4da105dafa41 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] 10.222.0.24 "DELETE /v2.0/networks/6f70786d-53ba-429d-b311-5a26e2e908bd HTTP/1.1" status: 204 len: 168 time: 2.3204730 Nov 09 04:30:21.578622 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6be3439a-87c2-4999-8dc5-6cbce8423c71 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:21.585978 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-8cbe65af-fc62-460a-ad0f-4d5d71dfb33c tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'dc817592-f56a-425b-948a-1516f6b1beb7') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:21.585978 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-8cbe65af-fc62-460a-ad0f-4d5d71dfb33c tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'dc817592-f56a-425b-948a-1516f6b1beb7') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:21.586197 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f8bb5c1-fc88-4472-9f0d-4da105dafa41 tempest-NetworksIpV6Test-910883035 tempest-NetworksIpV6Test-910883035-project] Pushing event deleted for resources: {'Network': ['ID=6f70786d-53ba-429d-b311-5a26e2e908bd,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:21.589094 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-086eed89-ef1f-489d-a68a-85a4980f8ac4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:21.631301 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-aa06ee4c-c699-4be4-a38b-e72d5301dfa5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:21.631756 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8cbe65af-fc62-460a-ad0f-4d5d71dfb33c tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:21.687911 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8cbe65af-fc62-460a-ad0f-4d5d71dfb33c tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:21.713735 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddd19e85-be2c-4fd6-96c8-6ae8e6a4cfc3 None None] Pushing event updated for resources: {'Port': ['ID=9947f24d-f96c-49f9-8eb6-2be971ed9745,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:21.723143 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ea49d25c-6936-48af-adb1-4dce6d0f7c25 None None] get_active_networks_info from dv-neutron-816802-2-hyperv {{(pid=102163) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}} Nov 09 04:30:21.731889 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-87d9f8cf-f792-4c5e-88c0-3d46fab9243e tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:21.744349 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8cbe65af-fc62-460a-ad0f-4d5d71dfb33c tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Releasing vlan 306 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:30:21.744770 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8cbe65af-fc62-460a-ad0f-4d5d71dfb33c tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:21.748159 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:30:21.748159 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:30:21.748159 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:30:21.748159 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:30:21.748159 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:30:21.748159 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:30:21.748159 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:30:21.748159 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:30:21.748159 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:30:21.748159 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:30:21.748159 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:30:21.748159 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:30:21.748159 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:30:21.748159 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:30:21.748159 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:30:21.748159 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:30:21.748159 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:30:21.748159 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:30:21.748159 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:30:21.748159 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:30:21.748159 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:30:21.748159 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:30:21.748159 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:30:21.748159 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:30:21.748159 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:30:21.748159 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:30:21.748159 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:30:21.748159 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:30:21.748159 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:30:21.748159 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:30:21.748159 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:30:21.748159 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:30:21.751922 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-11bd986a-02fe-4434-8ea7-39440e7b34cb tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:21.759787 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-87d9f8cf-f792-4c5e-88c0-3d46fab9243e tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:21.780506 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-aa06ee4c-c699-4be4-a38b-e72d5301dfa5 None None] Attempting to bind port 9947f24d-f96c-49f9-8eb6-2be971ed9745 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:30:21.781165 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-aa06ee4c-c699-4be4-a38b-e72d5301dfa5 None None] Attempting to bind port 9947f24d-f96c-49f9-8eb6-2be971ed9745 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:30:21.781410 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c3802379-89b6-4414-811a-9daa127429e6 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:21.784539 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aa06ee4c-c699-4be4-a38b-e72d5301dfa5 None None] Attempting to bind port 9947f24d-f96c-49f9-8eb6-2be971ed9745 on network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:30:21.793939 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aa06ee4c-c699-4be4-a38b-e72d5301dfa5 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 30, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:30:21.794474 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aa06ee4c-c699-4be4-a38b-e72d5301dfa5 None None] Checking segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:30:21.794877 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-aa06ee4c-c699-4be4-a38b-e72d5301dfa5 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:21.795264 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aa06ee4c-c699-4be4-a38b-e72d5301dfa5 None None] Bound using segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:30:21.795735 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-aa06ee4c-c699-4be4-a38b-e72d5301dfa5 None None] Bound port: 9947f24d-f96c-49f9-8eb6-2be971ed9745, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:30:21.796201 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-aa06ee4c-c699-4be4-a38b-e72d5301dfa5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:21.828603 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c3802379-89b6-4414-811a-9daa127429e6 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:21.834254 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-11bd986a-02fe-4434-8ea7-39440e7b34cb tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f16672d2-3d55-4ccc-844f-a1ab468ad9db']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:21.845057 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-11bd986a-02fe-4434-8ea7-39440e7b34cb tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd1461667-0349-4ea8-bfaa-b12234c64fac') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:21.845369 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-11bd986a-02fe-4434-8ea7-39440e7b34cb tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd1461667-0349-4ea8-bfaa-b12234c64fac') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:21.850634 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-0b64f178-1630-474a-9a1d-e12e04214162 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Deleting port 2ea9aea3-f5d8-4a4a-ba62-37e354a74128 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:30:21.853345 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0b64f178-1630-474a-9a1d-e12e04214162 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:21.858242 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-11bd986a-02fe-4434-8ea7-39440e7b34cb tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:21.871408 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-aa06ee4c-c699-4be4-a38b-e72d5301dfa5 None None] For port 9947f24d-f96c-49f9-8eb6-2be971ed9745, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:30:21.874780 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-11bd986a-02fe-4434-8ea7-39440e7b34cb tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:21.876344 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-aa06ee4c-c699-4be4-a38b-e72d5301dfa5 None None] For port 9947f24d-f96c-49f9-8eb6-2be971ed9745, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=9947f24d-f96c-49f9-8eb6-2be971ed9745,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:30:21.890191 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-11bd986a-02fe-4434-8ea7-39440e7b34cb tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Releasing vlan 301 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:30:21.890191 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-11bd986a-02fe-4434-8ea7-39440e7b34cb tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:21.916422 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:30:21.916422 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:30:21.916422 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:30:21.916422 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:30:21.916422 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:30:21.916422 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:30:21.916422 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:30:21.916422 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:30:21.916422 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:30:21.916422 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:30:21.916422 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:30:21.916422 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:30:21.916422 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:30:21.916422 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:30:21.916422 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:30:21.916422 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:30:21.916422 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:30:21.916422 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:30:21.916422 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:30:21.916422 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:30:21.916422 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:30:21.916422 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:30:21.916422 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:30:21.916422 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:30:21.916422 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:30:21.916422 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:30:21.916422 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:30:21.916422 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:30:21.916422 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:30:21.916422 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:30:21.916422 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:30:21.916422 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:30:21.932556 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ea49d25c-6936-48af-adb1-4dce6d0f7c25 None None] Resources bound (agent type, host, resource id): {{(pid=102163) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 09 04:30:21.948053 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6be3439a-87c2-4999-8dc5-6cbce8423c71 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:21.989494 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6be3439a-87c2-4999-8dc5-6cbce8423c71 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=a3d93294-0484-46fa-b8a6-204ec86c9c5f,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:21.995950 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-086eed89-ef1f-489d-a68a-85a4980f8ac4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:21.998753 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-086eed89-ef1f-489d-a68a-85a4980f8ac4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:22.000035 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-086eed89-ef1f-489d-a68a-85a4980f8ac4 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/bec819c5-7328-445e-9491-61fd52474b1a HTTP/1.1" status: 204 len: 168 time: 0.7837639 Nov 09 04:30:22.000897 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8cbe65af-fc62-460a-ad0f-4d5d71dfb33c tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:22.002488 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-aa06ee4c-c699-4be4-a38b-e72d5301dfa5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:22.003706 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6be3439a-87c2-4999-8dc5-6cbce8423c71 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:22.008731 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-6be3439a-87c2-4999-8dc5-6cbce8423c71 admin admin] 10.222.0.24 "DELETE /v2.0/subnets/a3d93294-0484-46fa-b8a6-204ec86c9c5f HTTP/1.1" status: 204 len: 168 time: 1.2587433 Nov 09 04:30:22.014058 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54480) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:22.067787 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8cbe65af-fc62-460a-ad0f-4d5d71dfb33c tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:22.070767 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddd19e85-be2c-4fd6-96c8-6ae8e6a4cfc3 None None] Pushing event updated for resources: {'Port': ['ID=9947f24d-f96c-49f9-8eb6-2be971ed9745,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:22.071331 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0b64f178-1630-474a-9a1d-e12e04214162 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:22.071623 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-8cbe65af-fc62-460a-ad0f-4d5d71dfb33c tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] 10.222.0.24 "DELETE /v2.0/networks/2407b60d-e30f-478f-a68d-2bf482c2f5f4 HTTP/1.1" status: 204 len: 168 time: 1.2189133 Nov 09 04:30:22.076445 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54482) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:22.078035 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cbe65af-fc62-460a-ad0f-4d5d71dfb33c tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Pushing event deleted for resources: {'Network': ['ID=2407b60d-e30f-478f-a68d-2bf482c2f5f4,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:22.082620 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-086eed89-ef1f-489d-a68a-85a4980f8ac4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bec819c5-7328-445e-9491-61fd52474b1a,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:22.100110 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aa06ee4c-c699-4be4-a38b-e72d5301dfa5 None None] Routers {'94e78643-8c7f-4500-ac2d-ed3cabe59101'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:30:22.100939 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-aa06ee4c-c699-4be4-a38b-e72d5301dfa5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:30:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['94e78643-8c7f-4500-ac2d-ed3cabe59101'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:22.109355 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-87d9f8cf-f792-4c5e-88c0-3d46fab9243e tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Allocated IP 172.26.0.64 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/44936ee5-95e8-4a26-8472-36c60d7ca2b5) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:30:22.127850 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-0b64f178-1630-474a-9a1d-e12e04214162 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Calling delete_port for 2ea9aea3-f5d8-4a4a-ba62-37e354a74128 owned by {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:30:22.296559 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d6d7c1c2-f3c4-4ed5-8463-75d8a04a2f1e tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:22.327492 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-aa06ee4c-c699-4be4-a38b-e72d5301dfa5 None None] Set router 94e78643-8c7f-4500-ac2d-ed3cabe59101 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:30:22.372007 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-11bd986a-02fe-4434-8ea7-39440e7b34cb tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:22.380350 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-11bd986a-02fe-4434-8ea7-39440e7b34cb tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:22.388028 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-11bd986a-02fe-4434-8ea7-39440e7b34cb tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "DELETE /v2.0/networks/f16672d2-3d55-4ccc-844f-a1ab468ad9db HTTP/1.1" status: 204 len: 168 time: 6.0474353 Nov 09 04:30:22.388028 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54488) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:22.407048 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54490) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:22.427227 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-a1f8ba74-af4c-47d7-a7c1-67f11245fd0c tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-1094702507'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:22.438766 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11bd986a-02fe-4434-8ea7-39440e7b34cb tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event deleted for resources: {'Network': ['ID=f16672d2-3d55-4ccc-844f-a1ab468ad9db,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:22.462140 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6947528d-2160-4689-ae2c-11cda9ace25e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:22.533120 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-6947528d-2160-4689-ae2c-11cda9ace25e admin admin] Deleting port 1bda1008-dade-41b5-919b-108e230eb2a9 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:30:22.540132 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6947528d-2160-4689-ae2c-11cda9ace25e admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:22.552907 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d6d7c1c2-f3c4-4ed5-8463-75d8a04a2f1e tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:22.573989 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-87d9f8cf-f792-4c5e-88c0-3d46fab9243e tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:22.575051 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e2f2ea34-56f0-4998-8670-7019b6535911 None None] Network fbf37a20-2f64-4540-9a29-42b164c6fa30 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:30:22.577604 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a0895c83-38f0-4108-bf09-969c98bbdb7c None None] Network 468b2f91-119a-402c-b695-5d7963ec6348 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:30:22.579284 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a1f8ba74-af4c-47d7-a7c1-67f11245fd0c tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Made reservation on behalf of 6761c80dbfa84798bb6517a9b532f870 for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:30:22.583800 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a1f8ba74-af4c-47d7-a7c1-67f11245fd0c tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:22.604223 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-d6d7c1c2-f3c4-4ed5-8463-75d8a04a2f1e tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['72286273-ea40-4989-bf4a-d67b2d8815b0']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:22.629150 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-d6d7c1c2-f3c4-4ed5-8463-75d8a04a2f1e tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c9067766-9d6f-474f-9b30-24ac4ea9f6a2') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:22.629473 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-d6d7c1c2-f3c4-4ed5-8463-75d8a04a2f1e tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c9067766-9d6f-474f-9b30-24ac4ea9f6a2') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:22.647658 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d6d7c1c2-f3c4-4ed5-8463-75d8a04a2f1e tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:22.652128 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-6947528d-2160-4689-ae2c-11cda9ace25e admin admin] For port 1bda1008-dade-41b5-919b-108e230eb2a9, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=1bda1008-dade-41b5-919b-108e230eb2a9,segment=NetworkSegment(efe0485f-d48f-4307-b89a-0bcb86aaf1c2),segment_id=efe0485f-d48f-4307-b89a-0bcb86aaf1c2)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:30:22.652491 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6947528d-2160-4689-ae2c-11cda9ace25e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:22.676122 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a1f8ba74-af4c-47d7-a7c1-67f11245fd0c tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 314} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:30:22.679169 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-6947528d-2160-4689-ae2c-11cda9ace25e admin admin] Calling delete_port for 1bda1008-dade-41b5-919b-108e230eb2a9 owned by network:dhcp {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:30:22.686378 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0b64f178-1630-474a-9a1d-e12e04214162 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:22.697119 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d6d7c1c2-f3c4-4ed5-8463-75d8a04a2f1e tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:22.698273 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a1f8ba74-af4c-47d7-a7c1-67f11245fd0c tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:22.698701 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-a1f8ba74-af4c-47d7-a7c1-67f11245fd0c tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Added segment 6801eee2-b555-4544-80b2-a79040b919ff of type vlan for network db90cb04-d853-4680-bcb2-8a3f67843e79 Nov 09 04:30:22.739545 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d6d7c1c2-f3c4-4ed5-8463-75d8a04a2f1e tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Releasing vlan 345 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:30:22.740127 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d6d7c1c2-f3c4-4ed5-8463-75d8a04a2f1e tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:22.743487 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:30:22.743487 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:30:22.743487 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:30:22.743487 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:30:22.743487 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:30:22.743487 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:30:22.743487 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:30:22.743487 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:30:22.743487 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:30:22.743487 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:30:22.743487 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:30:22.743487 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:30:22.743487 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:30:22.743487 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:30:22.743487 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:30:22.743487 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:30:22.743487 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:30:22.743487 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:30:22.743487 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:30:22.743487 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:30:22.743487 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:30:22.743487 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:30:22.743487 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:30:22.743487 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:30:22.743487 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:30:22.743487 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:30:22.743487 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:30:22.743487 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:30:22.743487 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:30:22.743487 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:30:22.743487 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:30:22.743487 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:30:22.748161 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b64f178-1630-474a-9a1d-e12e04214162 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event deleted for resources: {'Port': ['ID=2ea9aea3-f5d8-4a4a-ba62-37e354a74128,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:22.787945 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a1f8ba74-af4c-47d7-a7c1-67f11245fd0c tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:22.836013 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0b64f178-1630-474a-9a1d-e12e04214162 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:22.841983 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-0b64f178-1630-474a-9a1d-e12e04214162 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "DELETE /v2.0/ports/2ea9aea3-f5d8-4a4a-ba62-37e354a74128 HTTP/1.1" status: 204 len: 168 time: 1.3191457 Nov 09 04:30:22.842217 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54502) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:22.857443 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a214ddee-536f-4e06-b8c1-ae7148c63f81 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=83cbb798c0f44b268f8acd2a70eb745a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4469337 Nov 09 04:30:22.862832 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54504) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:22.868072 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device a31e46ce-e371-4177-a2d5-f9a3681f192b no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:30:22.915448 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-078e6dc5-f1fe-4fe9-ac39-dfddbfa9d8ee admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:22.922777 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-acb94489-9cac-4c94-8c2e-968bcc151ca6 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:22.934618 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-acb94489-9cac-4c94-8c2e-968bcc151ca6 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:22.937833 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-acb94489-9cac-4c94-8c2e-968bcc151ca6 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1452 time: 0.0943339 Nov 09 04:30:22.938035 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-078e6dc5-f1fe-4fe9-ac39-dfddbfa9d8ee admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:22.940792 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a1f8ba74-af4c-47d7-a7c1-67f11245fd0c tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:22.952038 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a1f8ba74-af4c-47d7-a7c1-67f11245fd0c tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:22.953183 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: a31e46ce-e371-4177-a2d5-f9a3681f192b {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:30:22.953529 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device a31e46ce-e371-4177-a2d5-f9a3681f192b not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:30:22.954333 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a1f8ba74-af4c-47d7-a7c1-67f11245fd0c tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:22.969936 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54506) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:22.976228 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d6d7c1c2-f3c4-4ed5-8463-75d8a04a2f1e tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:22.978544 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-87d9f8cf-f792-4c5e-88c0-3d46fab9243e tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:22.983751 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6947528d-2160-4689-ae2c-11cda9ace25e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:23.031088 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d6d7c1c2-f3c4-4ed5-8463-75d8a04a2f1e tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:23.035126 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-d6d7c1c2-f3c4-4ed5-8463-75d8a04a2f1e tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] 10.222.0.24 "DELETE /v2.0/networks/72286273-ea40-4989-bf4a-d67b2d8815b0 HTTP/1.1" status: 204 len: 168 time: 0.9524317 Nov 09 04:30:23.038156 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54508) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:23.055876 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-87d9f8cf-f792-4c5e-88c0-3d46fab9243e tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:30:23.067527 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-aa06ee4c-c699-4be4-a38b-e72d5301dfa5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '94e78643-8c7f-4500-ac2d-ed3cabe59101', 'name': 'tempest-snat-router-55453648', 'tenant_id': 'cf43ca7e091f42ca80c78a3f7dbeba63', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.113'}], 'enable_snat': False}, 'gw_port_id': '9947f24d-f96c-49f9-8eb6-2be971ed9745', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:30:11Z', 'updated_at': '2021-11-09T04:30:15Z', 'revision_number': 3, 'project_id': 'cf43ca7e091f42ca80c78a3f7dbeba63', 'gw_port': {'id': '9947f24d-f96c-49f9-8eb6-2be971ed9745', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:a8:0d:41', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '94e78643-8c7f-4500-ac2d-ed3cabe59101', 'device_owner': 'network:router_gateway', 'standard_attr_id': 457, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:30:13Z', 'updated_at': '2021-11-09T04:30:21Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': False, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:23.074010 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6d7c1c2-f3c4-4ed5-8463-75d8a04a2f1e tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Pushing event deleted for resources: {'Network': ['ID=72286273-ea40-4989-bf4a-d67b2d8815b0,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:23.084630 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-87d9f8cf-f792-4c5e-88c0-3d46fab9243e tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:23.091885 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-87d9f8cf-f792-4c5e-88c0-3d46fab9243e tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:30:23.125055 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aa06ee4c-c699-4be4-a38b-e72d5301dfa5 None None] The sync data for ids ['94e78643-8c7f-4500-ac2d-ed3cabe59101'] in dv-neutron-816802-2-hyperv is: [{'id': '94e78643-8c7f-4500-ac2d-ed3cabe59101', 'name': 'tempest-snat-router-55453648', 'tenant_id': 'cf43ca7e091f42ca80c78a3f7dbeba63', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.113'}], 'enable_snat': False}, 'gw_port_id': '9947f24d-f96c-49f9-8eb6-2be971ed9745', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:30:11Z', 'updated_at': '2021-11-09T04:30:15Z', 'revision_number': 3, 'project_id': 'cf43ca7e091f42ca80c78a3f7dbeba63', 'gw_port': {'id': '9947f24d-f96c-49f9-8eb6-2be971ed9745', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:a8:0d:41', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '94e78643-8c7f-4500-ac2d-ed3cabe59101', 'device_owner': 'network:router_gateway', 'standard_attr_id': 457, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:30:13Z', 'updated_at': '2021-11-09T04:30:21Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': False, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:30:23.150382 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1513b6a4-153b-45c3-96f0-8f778234d7c5 None None] DHCP port deletion for 468b2f91-119a-402c-b695-5d7963ec6348 request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:30:23.160332 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87d9f8cf-f792-4c5e-88c0-3d46fab9243e tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Pushing event updated for resources: {'Port': ['ID=44936ee5-95e8-4a26-8472-36c60d7ca2b5,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:23.192324 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-c3802379-89b6-4414-811a-9daa127429e6 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Allocated IP 172.26.0.197 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/9497cf32-a29c-439f-bf2c-8cfebde2405f) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:30:23.230136 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6947528d-2160-4689-ae2c-11cda9ace25e admin admin] Pushing event deleted for resources: {'Port': ['ID=1bda1008-dade-41b5-919b-108e230eb2a9,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:23.236165 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6947528d-2160-4689-ae2c-11cda9ace25e admin admin] No DVR routers for this DVR port 1bda1008-dade-41b5-919b-108e230eb2a9 on host dv-neutron-816802-2-hyperv {{(pid=102161) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:30:23.251287 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-078e6dc5-f1fe-4fe9-ac39-dfddbfa9d8ee admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:23.254461 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-078e6dc5-f1fe-4fe9-ac39-dfddbfa9d8ee admin admin] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:23.255645 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-078e6dc5-f1fe-4fe9-ac39-dfddbfa9d8ee admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/1cd00c25-cc79-48f6-918b-ebdf4918201a HTTP/1.1" status: 204 len: 168 time: 0.3917942 Nov 09 04:30:23.296339 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a1f8ba74-af4c-47d7-a7c1-67f11245fd0c tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 780 time: 0.9083323 Nov 09 04:30:23.297146 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1f8ba74-af4c-47d7-a7c1-67f11245fd0c tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event updated for resources: {'Network': ['ID=db90cb04-d853-4680-bcb2-8a3f67843e79,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:23.313955 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54518) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:23.325971 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network db90cb04-d853-4680-bcb2-8a3f67843e79 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:30:23.345919 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-53c07492-3dac-4575-be60-a3dc0feccebb tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Request body: {'subnet': {'network_id': 'db90cb04-d853-4680-bcb2-8a3f67843e79', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:23.355312 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-289ae9e0-d033-4a63-883e-7881bb33f48f tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:23.509747 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54522) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:23.529347 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6947528d-2160-4689-ae2c-11cda9ace25e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:23.626767 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-6947528d-2160-4689-ae2c-11cda9ace25e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['468b2f91-119a-402c-b695-5d7963ec6348']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:23.665158 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-078e6dc5-f1fe-4fe9-ac39-dfddbfa9d8ee admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1cd00c25-cc79-48f6-918b-ebdf4918201a,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:23.687427 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-6947528d-2160-4689-ae2c-11cda9ace25e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'efe0485f-d48f-4307-b89a-0bcb86aaf1c2') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:23.687752 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-6947528d-2160-4689-ae2c-11cda9ace25e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'efe0485f-d48f-4307-b89a-0bcb86aaf1c2') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:23.692287 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-53c07492-3dac-4575-be60-a3dc0feccebb tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Made reservation on behalf of 6761c80dbfa84798bb6517a9b532f870 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:30:23.698515 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-53c07492-3dac-4575-be60-a3dc0feccebb tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:23.813385 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c3802379-89b6-4414-811a-9daa127429e6 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:23.827311 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6947528d-2160-4689-ae2c-11cda9ace25e admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:23.841760 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-289ae9e0-d033-4a63-883e-7881bb33f48f tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:23.900510 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-bf77b3ac-fd3e-4f91-8bde-cbb361ee0ac8 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Deleting port 86752625-c92f-47ca-8662-6d3e1bc49a32 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:30:23.900859 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bf77b3ac-fd3e-4f91-8bde-cbb361ee0ac8 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:23.926125 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-289ae9e0-d033-4a63-883e-7881bb33f48f tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ca45084c-ecc9-45bb-847c-5b9e30970a24']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:23.935582 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c3802379-89b6-4414-811a-9daa127429e6 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:23.939893 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-289ae9e0-d033-4a63-883e-7881bb33f48f tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f24b880e-7cbf-4acc-8973-0cb4a4a0d612') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:23.940192 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-289ae9e0-d033-4a63-883e-7881bb33f48f tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f24b880e-7cbf-4acc-8973-0cb4a4a0d612') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:23.956227 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-289ae9e0-d033-4a63-883e-7881bb33f48f tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:23.960828 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-bdc1ec43-7c1a-44ac-8cf1-b56e44c8786c admin admin] Request body: {'network': {'name': 'tempest-ServerActionsTestJSON-1211051012-network', 'tenant_id': '6015befde7f546d881cb247ae5bc81ae'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:24.001678 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c3802379-89b6-4414-811a-9daa127429e6 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:30:24.004426 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6947528d-2160-4689-ae2c-11cda9ace25e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:24.029481 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-289ae9e0-d033-4a63-883e-7881bb33f48f tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:24.033290 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-c3802379-89b6-4414-811a-9daa127429e6 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:24.042781 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c3802379-89b6-4414-811a-9daa127429e6 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:30:24.058089 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3802379-89b6-4414-811a-9daa127429e6 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Pushing event updated for resources: {'Port': ['ID=9497cf32-a29c-439f-bf2c-8cfebde2405f,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:24.070512 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6947528d-2160-4689-ae2c-11cda9ace25e admin admin] Releasing vlan 329 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:30:24.070922 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6947528d-2160-4689-ae2c-11cda9ace25e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:24.073033 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:30:24.073033 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:30:24.073033 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:30:24.073033 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:30:24.073033 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:30:24.073033 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:30:24.073033 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:30:24.073033 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:30:24.073033 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:30:24.073033 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:30:24.073033 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:30:24.073033 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:30:24.073033 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:30:24.073033 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:30:24.073033 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:30:24.073033 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:30:24.073033 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:30:24.073033 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:30:24.073033 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:30:24.073033 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:30:24.073033 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:30:24.073033 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:30:24.073033 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:30:24.073033 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:30:24.073033 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:30:24.073033 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:30:24.073033 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:30:24.073033 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:30:24.073033 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:30:24.073033 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:30:24.073033 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:30:24.073033 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:30:24.083286 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-289ae9e0-d033-4a63-883e-7881bb33f48f tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Releasing vlan 331 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:30:24.083697 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-289ae9e0-d033-4a63-883e-7881bb33f48f tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:24.090772 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:30:24.090772 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:30:24.090772 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:30:24.090772 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:30:24.090772 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:30:24.090772 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:30:24.090772 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:30:24.090772 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:30:24.090772 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:30:24.090772 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:30:24.090772 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:30:24.090772 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:30:24.090772 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:30:24.090772 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:30:24.090772 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:30:24.090772 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:30:24.090772 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:30:24.090772 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:30:24.090772 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:30:24.090772 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:30:24.090772 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:30:24.090772 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:30:24.090772 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:30:24.090772 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:30:24.090772 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:30:24.090772 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:30:24.090772 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:30:24.090772 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:30:24.090772 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:30:24.090772 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:30:24.090772 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:30:24.090772 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:30:24.114609 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-87d9f8cf-f792-4c5e-88c0-3d46fab9243e tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:24.192550 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bdc1ec43-7c1a-44ac-8cf1-b56e44c8786c admin admin] Made reservation on behalf of 6015befde7f546d881cb247ae5bc81ae for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:30:24.195031 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bdc1ec43-7c1a-44ac-8cf1-b56e44c8786c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:24.197987 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bf77b3ac-fd3e-4f91-8bde-cbb361ee0ac8 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:24.225784 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bdc1ec43-7c1a-44ac-8cf1-b56e44c8786c admin admin] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:24.234899 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-bf77b3ac-fd3e-4f91-8bde-cbb361ee0ac8 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Calling delete_port for 86752625-c92f-47ca-8662-6d3e1bc49a32 owned by {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:30:24.319737 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6947528d-2160-4689-ae2c-11cda9ace25e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:24.331799 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6947528d-2160-4689-ae2c-11cda9ace25e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:24.336180 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-6947528d-2160-4689-ae2c-11cda9ace25e admin admin] 10.222.0.24 "DELETE /v2.0/networks/468b2f91-119a-402c-b695-5d7963ec6348 HTTP/1.1" status: 204 len: 168 time: 2.3151505 Nov 09 04:30:24.361612 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-289ae9e0-d033-4a63-883e-7881bb33f48f tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:24.374578 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6947528d-2160-4689-ae2c-11cda9ace25e admin admin] Pushing event deleted for resources: {'Network': ['ID=468b2f91-119a-402c-b695-5d7963ec6348,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:24.380183 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-289ae9e0-d033-4a63-883e-7881bb33f48f tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:24.387099 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-289ae9e0-d033-4a63-883e-7881bb33f48f tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] 10.222.0.24 "DELETE /v2.0/networks/ca45084c-ecc9-45bb-847c-5b9e30970a24 HTTP/1.1" status: 204 len: 168 time: 1.3417604 Nov 09 04:30:24.434009 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-289ae9e0-d033-4a63-883e-7881bb33f48f tempest-BulkNetworkOpsTest-138698031 tempest-BulkNetworkOpsTest-138698031-project] Pushing event deleted for resources: {'Network': ['ID=ca45084c-ecc9-45bb-847c-5b9e30970a24,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:24.489663 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bdc1ec43-7c1a-44ac-8cf1-b56e44c8786c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:24.518760 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-87d9f8cf-f792-4c5e-88c0-3d46fab9243e tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-466202', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-464271', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-936'] for router, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:24.548796 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-87d9f8cf-f792-4c5e-88c0-3d46fab9243e tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-466195', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-466408', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-464260'] for router, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:24.566347 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bf77b3ac-fd3e-4f91-8bde-cbb361ee0ac8 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:24.594945 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf77b3ac-fd3e-4f91-8bde-cbb361ee0ac8 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event deleted for resources: {'Port': ['ID=86752625-c92f-47ca-8662-6d3e1bc49a32,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:24.597154 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bdc1ec43-7c1a-44ac-8cf1-b56e44c8786c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:24.615729 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c3802379-89b6-4414-811a-9daa127429e6 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:24.615956 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bf77b3ac-fd3e-4f91-8bde-cbb361ee0ac8 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:24.619455 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-bf77b3ac-fd3e-4f91-8bde-cbb361ee0ac8 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "DELETE /v2.0/ports/86752625-c92f-47ca-8662-6d3e1bc49a32 HTTP/1.1" status: 204 len: 168 time: 1.6527178 Nov 09 04:30:24.624306 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54546) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:24.635613 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-bdc1ec43-7c1a-44ac-8cf1-b56e44c8786c admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 325} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:30:24.637822 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-53c07492-3dac-4575-be60-a3dc0feccebb tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:24.699368 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bdc1ec43-7c1a-44ac-8cf1-b56e44c8786c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:24.699729 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-bdc1ec43-7c1a-44ac-8cf1-b56e44c8786c admin admin] Added segment e211d893-ee7a-48e3-bc29-b8824167e15b of type vlan for network a270b61c-1f4f-4d97-be79-4a24c65fddc2 Nov 09 04:30:24.701080 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bdc1ec43-7c1a-44ac-8cf1-b56e44c8786c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=166c208c-5f61-4202-822a-ffd40396dd80,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:24.735406 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54548) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:24.802413 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53c07492-3dac-4575-be60-a3dc0feccebb tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event updated for resources: {'Subnet': ['ID=eb210d12-d586-4808-8538-959ecc2a7819,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:24.805771 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bdc1ec43-7c1a-44ac-8cf1-b56e44c8786c admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:24.835861 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-72702d55-6020-4569-85ff-dcefbd5d84f6 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:24.840941 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-72702d55-6020-4569-85ff-dcefbd5d84f6 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "GET /v2.0/ports HTTP/1.1" status: 200 len: 844 time: 0.2157605 Nov 09 04:30:24.841706 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54552) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:24.904699 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-53c07492-3dac-4575-be60-a3dc0feccebb tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Checking segment: {'id': '6801eee2-b555-4544-80b2-a79040b919ff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 314, 'network_id': 'db90cb04-d853-4680-bcb2-8a3f67843e79'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:30:24.905318 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-53c07492-3dac-4575-be60-a3dc0feccebb tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Network hostable DHCP agents. Network: db90cb04-d853-4680-bcb2-8a3f67843e79, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:30:24.912087 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-cdb12f6f-b7d0-4aec-a8c5-517128f3e1d9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] GET failed (client error): The resource could not be found. Nov 09 04:30:24.916379 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-87d9f8cf-f792-4c5e-88c0-3d46fab9243e tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Router 9e078f7a-7765-4972-8cd2-e5085db47ecf is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102162) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:30:24.916862 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-cdb12f6f-b7d0-4aec-a8c5-517128f3e1d9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "GET /v2.0/ports/2ea9aea3-f5d8-4a4a-ba62-37e354a74128 HTTP/1.1" status: 404 len: 333 time: 0.0700760 Nov 09 04:30:24.922103 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54554) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:24.932605 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-945fd21b-6c05-41c3-8682-95d4486ef842 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=5f3cd2a3586e46c09f847681f744075c&name=default HTTP/1.1" status: 200 len: 2992 time: 0.1703956 Nov 09 04:30:24.935949 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54556) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:24.969848 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54558) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:24.989652 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 9947f24d-f96c-49f9-8eb6-2be971ed9745 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:30:24.998528 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-96a0c5a8-ff8b-47a7-9587-dddbd370883b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] GET failed (client error): The resource could not be found. Nov 09 04:30:24.999977 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-96a0c5a8-ff8b-47a7-9587-dddbd370883b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "GET /v2.0/ports/86752625-c92f-47ca-8662-6d3e1bc49a32 HTTP/1.1" status: 404 len: 333 time: 0.0802481 Nov 09 04:30:25.002527 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c3802379-89b6-4414-811a-9daa127429e6 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:25.002927 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54562) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:25.011733 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cda8339a-0104-4a7f-a186-fc20122066da admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:25.016060 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bdc1ec43-7c1a-44ac-8cf1-b56e44c8786c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:25.017066 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bdc1ec43-7c1a-44ac-8cf1-b56e44c8786c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:25.018238 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bdc1ec43-7c1a-44ac-8cf1-b56e44c8786c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:25.107504 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 9947f24d-f96c-49f9-8eb6-2be971ed9745 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:30:25.107781 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:25.109215 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bdc1ec43-7c1a-44ac-8cf1-b56e44c8786c admin admin] Pushing event updated for resources: {'Network': ['ID=a270b61c-1f4f-4d97-be79-4a24c65fddc2,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:25.117122 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-53c07492-3dac-4575-be60-a3dc0feccebb tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Network db90cb04-d853-4680-bcb2-8a3f67843e79 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:30:25.151070 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network a270b61c-1f4f-4d97-be79-4a24c65fddc2 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:30:25.173439 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cda8339a-0104-4a7f-a186-fc20122066da admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:25.227247 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-bdc1ec43-7c1a-44ac-8cf1-b56e44c8786c admin admin] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 1.7092230 Nov 09 04:30:25.232205 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1f5f1fff-384b-4b42-b944-1aae45afb94b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:25.237134 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54566) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:25.242348 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-30d8a554-716d-4bc7-b5d1-ebf5e26a50b3 admin admin] Request body: {'subnet': {'network_id': 'a270b61c-1f4f-4d97-be79-4a24c65fddc2', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerActionsTestJSON-1211051012-subnet', 'tenant_id': '6015befde7f546d881cb247ae5bc81ae', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:25.247036 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-53c07492-3dac-4575-be60-a3dc0feccebb tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, db90cb04-d853-4680-bcb2-8a3f67843e79) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:25.289370 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-53c07492-3dac-4575-be60-a3dc0feccebb tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:25.289968 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-53c07492-3dac-4575-be60-a3dc0feccebb tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:25.295127 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e2c35b89-0979-4e54-a7af-a6b4e133a690 None None] Network db90cb04-d853-4680-bcb2-8a3f67843e79 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:30:25.318328 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-87d9f8cf-f792-4c5e-88c0-3d46fab9243e tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:30:25.324164 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-87d9f8cf-f792-4c5e-88c0-3d46fab9243e tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:25.327507 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-87d9f8cf-f792-4c5e-88c0-3d46fab9243e tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] 10.222.0.24 "PUT /v2.0/routers/9e078f7a-7765-4972-8cd2-e5085db47ecf HTTP/1.1" status: 200 len: 919 time: 4.9790416 Nov 09 04:30:25.334408 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c4d596a0-8c98-4c41-8c13-3a13e793530a None None] Sync routers for ids ['9e078f7a-7765-4972-8cd2-e5085db47ecf'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:30:25.335478 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54568) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:25.336040 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54570) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:25.351812 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c4d596a0-8c98-4c41-8c13-3a13e793530a None None] Routers {'9e078f7a-7765-4972-8cd2-e5085db47ecf'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:30:25.354997 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-c4d596a0-8c98-4c41-8c13-3a13e793530a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:30:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['9e078f7a-7765-4972-8cd2-e5085db47ecf'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:25.405730 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-c4d596a0-8c98-4c41-8c13-3a13e793530a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:25.416812 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c4d596a0-8c98-4c41-8c13-3a13e793530a None None] Routers {'9e078f7a-7765-4972-8cd2-e5085db47ecf'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:30:25.417701 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-c4d596a0-8c98-4c41-8c13-3a13e793530a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:30:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['9e078f7a-7765-4972-8cd2-e5085db47ecf'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:25.432214 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-30d8a554-716d-4bc7-b5d1-ebf5e26a50b3 admin admin] Made reservation on behalf of 6015befde7f546d881cb247ae5bc81ae for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:30:25.434496 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-30d8a554-716d-4bc7-b5d1-ebf5e26a50b3 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:25.461096 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-c4d596a0-8c98-4c41-8c13-3a13e793530a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:25.463455 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c4d596a0-8c98-4c41-8c13-3a13e793530a None None] The sync data for ids ['9e078f7a-7765-4972-8cd2-e5085db47ecf'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:30:25.475415 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:25.502503 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-100d11c7-59e0-4003-9111-78d532abf2a1 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Request body: {'network': {'name': 'tempest-RoutersTest-589114814'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:25.508234 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 9947f24d-f96c-49f9-8eb6-2be971ed9745, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=9947f24d-f96c-49f9-8eb6-2be971ed9745,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:30:25.513510 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-53c07492-3dac-4575-be60-a3dc0feccebb tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.1922104 Nov 09 04:30:25.513510 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cda8339a-0104-4a7f-a186-fc20122066da admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:25.514572 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cda8339a-0104-4a7f-a186-fc20122066da admin admin] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:25.521496 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54574) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:25.523045 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c3802379-89b6-4414-811a-9daa127429e6 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Router 5ec7af2c-6266-4564-aeae-0c55aba5200b is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102162) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:30:25.534654 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-cda8339a-0104-4a7f-a186-fc20122066da admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/57cc57cf-ad83-4355-be3b-c1f64d56d806 HTTP/1.1" status: 204 len: 168 time: 0.5816929 Nov 09 04:30:25.540794 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1f5f1fff-384b-4b42-b944-1aae45afb94b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:25.556915 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cda8339a-0104-4a7f-a186-fc20122066da admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=57cc57cf-ad83-4355-be3b-c1f64d56d806,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:25.570888 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-1f5f1fff-384b-4b42-b944-1aae45afb94b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['fbf37a20-2f64-4540-9a29-42b164c6fa30']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:25.590658 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-1f5f1fff-384b-4b42-b944-1aae45afb94b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '29f62496-7e30-4776-b257-351cfaaf21cb') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:25.590793 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:25.590909 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-1f5f1fff-384b-4b42-b944-1aae45afb94b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '29f62496-7e30-4776-b257-351cfaaf21cb') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:25.613372 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1f5f1fff-384b-4b42-b944-1aae45afb94b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:25.630502 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1f5f1fff-384b-4b42-b944-1aae45afb94b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:25.643418 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1f5f1fff-384b-4b42-b944-1aae45afb94b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Releasing vlan 316 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:30:25.645133 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1f5f1fff-384b-4b42-b944-1aae45afb94b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:25.649879 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:30:25.649879 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:30:25.649879 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:30:25.649879 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:30:25.649879 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:30:25.649879 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:30:25.649879 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:30:25.649879 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:30:25.649879 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:30:25.649879 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:30:25.649879 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:30:25.649879 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:30:25.649879 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:30:25.649879 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:30:25.649879 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:30:25.649879 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:30:25.649879 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:30:25.649879 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:30:25.649879 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:30:25.649879 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:30:25.649879 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:30:25.649879 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:30:25.649879 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:30:25.649879 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:30:25.649879 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:30:25.649879 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:30:25.649879 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:30:25.649879 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:30:25.649879 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:30:25.649879 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:30:25.649879 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:30:25.649879 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:30:25.652348 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a45c21e7-44cf-4177-9fef-471de7b31416 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-db90cb04-d853-4680-bcb2-8a3f67843e79', 'network_id': 'db90cb04-d853-4680-bcb2-8a3f67843e79', 'tenant_id': '6761c80dbfa84798bb6517a9b532f870', 'fixed_ips': [{'subnet_id': 'eb210d12-d586-4808-8538-959ecc2a7819'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:30:25.653199 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a45c21e7-44cf-4177-9fef-471de7b31416 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:25.685461 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 1bda1008-dade-41b5-919b-108e230eb2a9 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:30:25.725155 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 1bda1008-dade-41b5-919b-108e230eb2a9 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:30:25.725155 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 1bda1008-dade-41b5-919b-108e230eb2a9 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:30:25.735519 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=9947f24d-f96c-49f9-8eb6-2be971ed9745,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:25.756418 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-deccb984-870b-41e0-a6e0-01e66612ffcc admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=2f077d8d6e0c4af98a4ce8fbe06ce9d4&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7718980 Nov 09 04:30:25.756899 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54578) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:25.826337 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7f3ab85b-e84a-434a-b424-79b7c7f2ddde admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:25.840879 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1f5f1fff-384b-4b42-b944-1aae45afb94b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:25.853497 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1f5f1fff-384b-4b42-b944-1aae45afb94b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:25.856935 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1f5f1fff-384b-4b42-b944-1aae45afb94b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "DELETE /v2.0/networks/fbf37a20-2f64-4540-9a29-42b164c6fa30 HTTP/1.1" status: 204 len: 168 time: 0.8529086 Nov 09 04:30:25.866944 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54580) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:25.872493 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-dc3738a9-b05a-4ee5-854a-089188f637da tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-561680757'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:25.898281 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7f3ab85b-e84a-434a-b424-79b7c7f2ddde admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:25.913143 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f5f1fff-384b-4b42-b944-1aae45afb94b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event deleted for resources: {'Network': ['ID=fbf37a20-2f64-4540-9a29-42b164c6fa30,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:26.023364 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-a45c21e7-44cf-4177-9fef-471de7b31416 None None] Allocated IP 172.20.0.2 (db90cb04-d853-4680-bcb2-8a3f67843e79/eb210d12-d586-4808-8538-959ecc2a7819/f67f9614-451a-4e9c-bc78-07c8fe91744e) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:30:26.044703 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dc3738a9-b05a-4ee5-854a-089188f637da tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Made reservation on behalf of 88f9f8da29bf4a8793b45130d483a6e6 for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:30:26.048294 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dc3738a9-b05a-4ee5-854a-089188f637da tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:26.051399 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7f3ab85b-e84a-434a-b424-79b7c7f2ddde admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:26.054188 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7f3ab85b-e84a-434a-b424-79b7c7f2ddde admin admin] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:26.055299 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-7f3ab85b-e84a-434a-b424-79b7c7f2ddde admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/0865e505-1d47-4388-88f0-f1fecd26b820 HTTP/1.1" status: 204 len: 168 time: 0.2966604 Nov 09 04:30:26.076802 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f3ab85b-e84a-434a-b424-79b7c7f2ddde admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0865e505-1d47-4388-88f0-f1fecd26b820,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:26.088943 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-dc3738a9-b05a-4ee5-854a-089188f637da tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 336} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:30:26.103700 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dc3738a9-b05a-4ee5-854a-089188f637da tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:26.104000 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-dc3738a9-b05a-4ee5-854a-089188f637da tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Added segment c36a4d79-e250-4bb8-9048-928eee98e328 of type vlan for network f5798b15-f4fc-4342-b0d7-1c42a5da2fde Nov 09 04:30:26.166251 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dc3738a9-b05a-4ee5-854a-089188f637da tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:26.209058 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-100d11c7-59e0-4003-9111-78d532abf2a1 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Made reservation on behalf of 188f23ef0cb54006875c672b78f5249f for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:30:26.212619 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-100d11c7-59e0-4003-9111-78d532abf2a1 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:26.227123 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8a627adf-4607-4b2c-b28f-25b1432b258a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:26.238254 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a45c21e7-44cf-4177-9fef-471de7b31416 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:26.256143 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dc3738a9-b05a-4ee5-854a-089188f637da tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:26.261161 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-100d11c7-59e0-4003-9111-78d532abf2a1 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:26.266311 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dc3738a9-b05a-4ee5-854a-089188f637da tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:26.268647 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dc3738a9-b05a-4ee5-854a-089188f637da tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:26.282845 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-86ab1cb9-5062-4ae0-b11c-99bdef7936ec tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] 10.222.0.24 "GET /v2.0/routers/9e078f7a-7765-4972-8cd2-e5085db47ecf HTTP/1.1" status: 200 len: 925 time: 0.9406393 Nov 09 04:30:26.284489 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54594) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:26.309090 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a45c21e7-44cf-4177-9fef-471de7b31416 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:26.369029 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc3738a9-b05a-4ee5-854a-089188f637da tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event updated for resources: {'Network': ['ID=f5798b15-f4fc-4342-b0d7-1c42a5da2fde,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:26.379885 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-dc3738a9-b05a-4ee5-854a-089188f637da tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 767 time: 0.5133255 Nov 09 04:30:26.380603 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54598) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:26.386284 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-61ac309f-1c0e-484f-8048-33f58382a16f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Request body: {'subnet': {'network_id': 'f5798b15-f4fc-4342-b0d7-1c42a5da2fde', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'allocation_pools': [{'start': '172.20.0.2', 'end': '172.20.0.14'}]}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:26.387234 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a45c21e7-44cf-4177-9fef-471de7b31416 None None] Pushing event updated for resources: {'Port': ['ID=f67f9614-451a-4e9c-bc78-07c8fe91744e,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:26.399023 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network f5798b15-f4fc-4342-b0d7-1c42a5da2fde details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:30:26.418308 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ba97b125-17c6-483b-8856-7b2f59bd2835 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:26.419849 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-ba97b125-17c6-483b-8856-7b2f59bd2835 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] 10.222.0.24 "GET /v2.0/ports?network_id=2b6725f5-ebfe-485a-8f42-ccb5a241ddb5&device_id=9e078f7a-7765-4972-8cd2-e5085db47ecf&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 944 time: 0.1246860 Nov 09 04:30:26.422617 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54600) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:26.425250 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c3802379-89b6-4414-811a-9daa127429e6 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:30:26.498121 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5e3e4287-3156-44c5-885e-8f8c6bd155bd None None] Sync routers for ids ['5ec7af2c-6266-4564-aeae-0c55aba5200b'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:30:26.528099 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a45c21e7-44cf-4177-9fef-471de7b31416 None None] Network db90cb04-d853-4680-bcb2-8a3f67843e79 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:30:26.572719 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-8a627adf-4607-4b2c-b28f-25b1432b258a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Deleting port f67f9614-451a-4e9c-bc78-07c8fe91744e {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:30:26.572719 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8a627adf-4607-4b2c-b28f-25b1432b258a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:26.576227 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-a45c21e7-44cf-4177-9fef-471de7b31416 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:26.578786 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a45c21e7-44cf-4177-9fef-471de7b31416 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:30:26.585944 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5e3e4287-3156-44c5-885e-8f8c6bd155bd None None] Routers {'5ec7af2c-6266-4564-aeae-0c55aba5200b'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:30:26.586641 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-5e3e4287-3156-44c5-885e-8f8c6bd155bd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:30:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['5ec7af2c-6266-4564-aeae-0c55aba5200b'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:26.589665 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c3802379-89b6-4414-811a-9daa127429e6 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:26.590639 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-30fc66cf-22e1-4abd-9c11-ee391380fcc5 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:26.591118 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-c3802379-89b6-4414-811a-9daa127429e6 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 905 time: 6.5581820 Nov 09 04:30:26.594920 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-30fc66cf-22e1-4abd-9c11-ee391380fcc5 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] 10.222.0.24 "GET /v2.0/networks/2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 HTTP/1.1" status: 200 len: 881 time: 0.1715429 Nov 09 04:30:26.595775 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54608) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:26.602727 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-100d11c7-59e0-4003-9111-78d532abf2a1 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:26.605405 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54610) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:26.609932 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-30d8a554-716d-4bc7-b5d1-ebf5e26a50b3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:26.700007 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-100d11c7-59e0-4003-9111-78d532abf2a1 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:26.705499 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-e1be6bcf-442a-4eb8-85bf-989729ad17e0 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] 10.222.0.24 "GET /v2.0/ports?device_id=9e078f7a-7765-4972-8cd2-e5085db47ecf HTTP/1.1" status: 200 len: 205 time: 0.1006002 Nov 09 04:30:26.706173 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-61ac309f-1c0e-484f-8048-33f58382a16f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Made reservation on behalf of 88f9f8da29bf4a8793b45130d483a6e6 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:30:26.709639 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-61ac309f-1c0e-484f-8048-33f58382a16f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:26.714075 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54616) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:26.727971 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30d8a554-716d-4bc7-b5d1-ebf5e26a50b3 admin admin] Pushing event updated for resources: {'Subnet': ['ID=b2956e71-9b0f-4060-922c-e54ce6cff80a,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:26.743570 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-100d11c7-59e0-4003-9111-78d532abf2a1 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 334} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:30:26.799291 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-8a627adf-4607-4b2c-b28f-25b1432b258a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] For port f67f9614-451a-4e9c-bc78-07c8fe91744e, host dv-neutron-816802-2-hyperv, got binding levels [] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:30:26.806750 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8a627adf-4607-4b2c-b28f-25b1432b258a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:26.826461 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-100d11c7-59e0-4003-9111-78d532abf2a1 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:26.826988 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-100d11c7-59e0-4003-9111-78d532abf2a1 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Added segment de95ed3f-4273-400f-9757-f62070e21304 of type vlan for network db9e10ea-0b45-4893-ab26-2f1ea5e8271b Nov 09 04:30:26.958748 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-a45c21e7-44cf-4177-9fef-471de7b31416 None None] Attempting to bind port f67f9614-451a-4e9c-bc78-07c8fe91744e on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:30:26.959475 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-a45c21e7-44cf-4177-9fef-471de7b31416 None None] Attempting to bind port f67f9614-451a-4e9c-bc78-07c8fe91744e by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '6801eee2-b555-4544-80b2-a79040b919ff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 314, 'network_id': 'db90cb04-d853-4680-bcb2-8a3f67843e79'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:30:26.960196 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a45c21e7-44cf-4177-9fef-471de7b31416 None None] Attempting to bind port f67f9614-451a-4e9c-bc78-07c8fe91744e on network db90cb04-d853-4680-bcb2-8a3f67843e79 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:30:26.969906 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 9947f24d-f96c-49f9-8eb6-2be971ed9745 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:30:26.973636 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a45c21e7-44cf-4177-9fef-471de7b31416 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 30, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:30:26.974304 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a45c21e7-44cf-4177-9fef-471de7b31416 None None] Checking segment: {'id': '6801eee2-b555-4544-80b2-a79040b919ff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 314, 'network_id': 'db90cb04-d853-4680-bcb2-8a3f67843e79'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:30:26.974909 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a45c21e7-44cf-4177-9fef-471de7b31416 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:26.975406 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a45c21e7-44cf-4177-9fef-471de7b31416 None None] Bound using segment: {'id': '6801eee2-b555-4544-80b2-a79040b919ff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 314, 'network_id': 'db90cb04-d853-4680-bcb2-8a3f67843e79'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:30:26.976012 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-a45c21e7-44cf-4177-9fef-471de7b31416 None None] Bound port: f67f9614-451a-4e9c-bc78-07c8fe91744e, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6801eee2-b555-4544-80b2-a79040b919ff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 314, 'network_id': 'db90cb04-d853-4680-bcb2-8a3f67843e79'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:30:26.976528 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a45c21e7-44cf-4177-9fef-471de7b31416 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:27.056013 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-100d11c7-59e0-4003-9111-78d532abf2a1 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:27.091799 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-30d8a554-716d-4bc7-b5d1-ebf5e26a50b3 admin admin] Checking segment: {'id': 'e211d893-ee7a-48e3-bc29-b8824167e15b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 325, 'network_id': 'a270b61c-1f4f-4d97-be79-4a24c65fddc2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:30:27.093527 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-30d8a554-716d-4bc7-b5d1-ebf5e26a50b3 admin admin] Network hostable DHCP agents. Network: a270b61c-1f4f-4d97-be79-4a24c65fddc2, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:30:27.120371 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-8a627adf-4607-4b2c-b28f-25b1432b258a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Calling delete_port for f67f9614-451a-4e9c-bc78-07c8fe91744e owned by network:dhcp {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:30:27.157486 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-100d11c7-59e0-4003-9111-78d532abf2a1 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event updated for resources: {'SecurityGroup': ['ID=7280840c-7ed6-415f-a063-64e6385482d1,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:27.164930 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.ipam_backend_mixin [None req-61ac309f-1c0e-484f-8048-33f58382a16f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Performing IP validity checks on allocation pools {{(pid=102161) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:325}} Nov 09 04:30:27.167817 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.ipam_backend_mixin [None req-61ac309f-1c0e-484f-8048-33f58382a16f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Checking for overlaps among allocation pools and gateway ip {{(pid=102161) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:346}} Nov 09 04:30:27.214238 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-5e3e4287-3156-44c5-885e-8f8c6bd155bd None None] Set router 5ec7af2c-6266-4564-aeae-0c55aba5200b gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:30:27.282423 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-c15a2f34-ceae-4035-aacd-7a374b8cb5fb tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] 10.222.0.24 "GET /v2.0/routers/5ec7af2c-6266-4564-aeae-0c55aba5200b HTTP/1.1" status: 200 len: 906 time: 0.6855695 Nov 09 04:30:27.285268 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54628) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:27.387606 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-100d11c7-59e0-4003-9111-78d532abf2a1 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:27.388085 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-605acdfd-8668-4b39-b65a-5be6c2e1ffde tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks [] for router, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:27.393999 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-100d11c7-59e0-4003-9111-78d532abf2a1 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:27.395422 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-100d11c7-59e0-4003-9111-78d532abf2a1 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:27.465450 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-30d8a554-716d-4bc7-b5d1-ebf5e26a50b3 admin admin] Network a270b61c-1f4f-4d97-be79-4a24c65fddc2 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:30:27.519238 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.db.api [None req-a45c21e7-44cf-4177-9fef-471de7b31416 None None] Retry wrapper got retriable exception: UPDATE statement on table 'ml2_port_bindings' expected to update 1 row(s); 0 were matched. {{(pid=102163) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:30:27.519604 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG oslo_db.api [None req-a45c21e7-44cf-4177-9fef-471de7b31416 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin._bind_port_if_needed {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:30:27.520390 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 9947f24d-f96c-49f9-8eb6-2be971ed9745 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:30:27.520756 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:27.535911 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8a627adf-4607-4b2c-b28f-25b1432b258a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:27.541171 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-100d11c7-59e0-4003-9111-78d532abf2a1 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event updated for resources: {'Network': ['ID=db9e10ea-0b45-4893-ab26-2f1ea5e8271b,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:27.549301 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-100d11c7-59e0-4003-9111-78d532abf2a1 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 765 time: 2.2056930 Nov 09 04:30:27.561171 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54636) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:27.562626 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network db9e10ea-0b45-4893-ab26-2f1ea5e8271b details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:30:27.597997 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-be7abfcf-ea34-4312-963a-2e1a63146b16 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks [] for router, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:27.615000 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-ea8cf2aa-d640-4a9c-a44c-b4ee3de8949d tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Request body: {'network': {'name': 'tempest-RoutersTest-402758100'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:27.633023 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a627adf-4607-4b2c-b28f-25b1432b258a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event deleted for resources: {'Port': ['ID=f67f9614-451a-4e9c-bc78-07c8fe91744e,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:27.648046 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-605acdfd-8668-4b39-b65a-5be6c2e1ffde tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks [] for router_gateway, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:27.667958 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-61ac309f-1c0e-484f-8048-33f58382a16f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:27.696340 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-30d8a554-716d-4bc7-b5d1-ebf5e26a50b3 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, a270b61c-1f4f-4d97-be79-4a24c65fddc2) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:27.718522 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-5e3e4287-3156-44c5-885e-8f8c6bd155bd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5ec7af2c-6266-4564-aeae-0c55aba5200b', 'name': 'tempest-snat-router-55453648', 'tenant_id': 'cf43ca7e091f42ca80c78a3f7dbeba63', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.197'}], 'enable_snat': True}, 'gw_port_id': '9497cf32-a29c-439f-bf2c-8cfebde2405f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:30:20Z', 'updated_at': '2021-11-09T04:30:24Z', 'revision_number': 3, 'project_id': 'cf43ca7e091f42ca80c78a3f7dbeba63', 'gw_port': {'id': '9497cf32-a29c-439f-bf2c-8cfebde2405f', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:8b:cb:fa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5ec7af2c-6266-4564-aeae-0c55aba5200b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 469, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.197', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:30:21Z', 'updated_at': '2021-11-09T04:30:23Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:27.724939 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8a627adf-4607-4b2c-b28f-25b1432b258a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] No DVR routers for this DVR port f67f9614-451a-4e9c-bc78-07c8fe91744e on host dv-neutron-816802-2-hyperv {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:30:27.728060 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-30d8a554-716d-4bc7-b5d1-ebf5e26a50b3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:27.729354 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-30d8a554-716d-4bc7-b5d1-ebf5e26a50b3 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:27.747987 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-32d48793-8fc6-4262-bd5a-c927c4f3796a None None] Network a270b61c-1f4f-4d97-be79-4a24c65fddc2 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:30:27.809847 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8a627adf-4607-4b2c-b28f-25b1432b258a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:27.815736 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61ac309f-1c0e-484f-8048-33f58382a16f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event updated for resources: {'Subnet': ['ID=d07738e5-a445-49bf-89a9-f648661cbc55,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:27.819745 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-be7abfcf-ea34-4312-963a-2e1a63146b16 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:27.837833 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61ac309f-1c0e-484f-8048-33f58382a16f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Checking segment: {'id': 'c36a4d79-e250-4bb8-9048-928eee98e328', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': 'f5798b15-f4fc-4342-b0d7-1c42a5da2fde'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:30:27.838264 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-61ac309f-1c0e-484f-8048-33f58382a16f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Network hostable DHCP agents. Network: f5798b15-f4fc-4342-b0d7-1c42a5da2fde, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:30:27.848127 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ea8cf2aa-d640-4a9c-a44c-b4ee3de8949d tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Made reservation on behalf of 188f23ef0cb54006875c672b78f5249f for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:30:27.851326 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ea8cf2aa-d640-4a9c-a44c-b4ee3de8949d tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:27.867463 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5e3e4287-3156-44c5-885e-8f8c6bd155bd None None] Checking router: 5ec7af2c-6266-4564-aeae-0c55aba5200b for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:30:27.867786 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5e3e4287-3156-44c5-885e-8f8c6bd155bd None None] Updating router 5ec7af2c-6266-4564-aeae-0c55aba5200b port 9497cf32-a29c-439f-bf2c-8cfebde2405f binding host dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 04:30:27.869875 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-605acdfd-8668-4b39-b65a-5be6c2e1ffde tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Deleting port 44936ee5-95e8-4a26-8472-36c60d7ca2b5 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:30:27.870389 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-605acdfd-8668-4b39-b65a-5be6c2e1ffde tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:27.880712 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54644) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:27.916010 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ea8cf2aa-d640-4a9c-a44c-b4ee3de8949d tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 316} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:30:27.926540 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-30d8a554-716d-4bc7-b5d1-ebf5e26a50b3 admin admin] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 2.6881239 Nov 09 04:30:27.930579 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54650) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:27.937412 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ea8cf2aa-d640-4a9c-a44c-b4ee3de8949d tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:27.937992 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-ea8cf2aa-d640-4a9c-a44c-b4ee3de8949d tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Added segment 610156cc-bb06-4490-92ef-b436312a6831 of type vlan for network 0a61eb3b-f9c4-4bc0-94dd-9f48ad858a9d Nov 09 04:30:27.942827 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-aeff7b3c-c75a-43e9-952e-012df8a35907 admin admin] Request body: {'router': {'name': 'tempest-ServerActionsTestJSON-1211051012-router', 'tenant_id': '6015befde7f546d881cb247ae5bc81ae', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:27.956946 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-61ac309f-1c0e-484f-8048-33f58382a16f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Network f5798b15-f4fc-4342-b0d7-1c42a5da2fde is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:30:28.012108 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ea8cf2aa-d640-4a9c-a44c-b4ee3de8949d tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:28.051349 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8a627adf-4607-4b2c-b28f-25b1432b258a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:28.052981 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-605acdfd-8668-4b39-b65a-5be6c2e1ffde tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:28.057645 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-be7abfcf-ea34-4312-963a-2e1a63146b16 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Deleting port 9497cf32-a29c-439f-bf2c-8cfebde2405f {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:30:28.057994 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-be7abfcf-ea34-4312-963a-2e1a63146b16 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:28.094519 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a627adf-4607-4b2c-b28f-25b1432b258a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event deleted for resources: {'Subnet': ['ID=eb210d12-d586-4808-8538-959ecc2a7819,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:28.096625 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-aeff7b3c-c75a-43e9-952e-012df8a35907 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:28.097827 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-aeff7b3c-c75a-43e9-952e-012df8a35907 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:28.162548 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-aeff7b3c-c75a-43e9-952e-012df8a35907 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:28.163596 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-be7abfcf-ea34-4312-963a-2e1a63146b16 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:28.168991 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ea8cf2aa-d640-4a9c-a44c-b4ee3de8949d tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:28.176895 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ea8cf2aa-d640-4a9c-a44c-b4ee3de8949d tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:28.178003 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ea8cf2aa-d640-4a9c-a44c-b4ee3de8949d tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:28.195773 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-be7abfcf-ea34-4312-963a-2e1a63146b16 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Calling delete_port for 9497cf32-a29c-439f-bf2c-8cfebde2405f owned by network:router_gateway {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:30:28.232249 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e5111f73-63c5-4e81-87c2-59d12012c6e5 tempest-ServiceProvidersTest-562383018 tempest-ServiceProvidersTest-562383018-project] 10.222.0.24 "GET /v2.0/service-providers HTTP/1.1" status: 200 len: 498 time: 0.3440673 Nov 09 04:30:28.289226 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5e3e4287-3156-44c5-885e-8f8c6bd155bd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:28.310836 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-61ac309f-1c0e-484f-8048-33f58382a16f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, f5798b15-f4fc-4342-b0d7-1c42a5da2fde) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:28.337014 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-605acdfd-8668-4b39-b65a-5be6c2e1ffde tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Calling delete_port for 44936ee5-95e8-4a26-8472-36c60d7ca2b5 owned by network:router_gateway {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:30:28.346680 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-61ac309f-1c0e-484f-8048-33f58382a16f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:28.347963 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-61ac309f-1c0e-484f-8048-33f58382a16f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:28.349980 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3a42d09d-c681-4183-b60c-359db4562f7c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-a270b61c-1f4f-4d97-be79-4a24c65fddc2', 'network_id': 'a270b61c-1f4f-4d97-be79-4a24c65fddc2', 'tenant_id': '6015befde7f546d881cb247ae5bc81ae', 'fixed_ips': [{'subnet_id': 'b2956e71-9b0f-4060-922c-e54ce6cff80a'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:30:28.350994 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3a42d09d-c681-4183-b60c-359db4562f7c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:28.364384 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-77b201ed-5713-4aff-94c7-12373cc562c3 None None] Network f5798b15-f4fc-4342-b0d7-1c42a5da2fde requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:30:28.391314 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8a627adf-4607-4b2c-b28f-25b1432b258a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:28.402243 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-ea8cf2aa-d640-4a9c-a44c-b4ee3de8949d tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 765 time: 0.8402510 Nov 09 04:30:28.413464 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54660) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:28.418930 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-3a87b1b8-4ab6-4694-ab8d-2849aee933b4 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Request body: {'subnet': {'network_id': 'db9e10ea-0b45-4893-ab26-2f1ea5e8271b', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:28.421535 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-a45c21e7-44cf-4177-9fef-471de7b31416 None None] Attempting to bind port f67f9614-451a-4e9c-bc78-07c8fe91744e on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:30:28.422168 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-a45c21e7-44cf-4177-9fef-471de7b31416 None None] Attempting to bind port f67f9614-451a-4e9c-bc78-07c8fe91744e by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '6801eee2-b555-4544-80b2-a79040b919ff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 314, 'network_id': 'db90cb04-d853-4680-bcb2-8a3f67843e79'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:30:28.422606 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a45c21e7-44cf-4177-9fef-471de7b31416 None None] Attempting to bind port f67f9614-451a-4e9c-bc78-07c8fe91744e on network db90cb04-d853-4680-bcb2-8a3f67843e79 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:30:28.426559 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea8cf2aa-d640-4a9c-a44c-b4ee3de8949d tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event updated for resources: {'Network': ['ID=0a61eb3b-f9c4-4bc0-94dd-9f48ad858a9d,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:28.477617 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 0a61eb3b-f9c4-4bc0-94dd-9f48ad858a9d details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:30:28.487781 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-61ac309f-1c0e-484f-8048-33f58382a16f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.1051929 Nov 09 04:30:28.491846 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54664) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:28.496798 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-b379ce9c-f6c5-40d6-b803-7dc864d31d9e tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Request body: {'port': {'network_id': 'f5798b15-f4fc-4342-b0d7-1c42a5da2fde', 'name': 'tempest-PortsTestJSON-2070245935'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:28.504995 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a45c21e7-44cf-4177-9fef-471de7b31416 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 30, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:30:28.505360 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a45c21e7-44cf-4177-9fef-471de7b31416 None None] Checking segment: {'id': '6801eee2-b555-4544-80b2-a79040b919ff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 314, 'network_id': 'db90cb04-d853-4680-bcb2-8a3f67843e79'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:30:28.505799 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a45c21e7-44cf-4177-9fef-471de7b31416 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:28.506180 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a45c21e7-44cf-4177-9fef-471de7b31416 None None] Bound using segment: {'id': '6801eee2-b555-4544-80b2-a79040b919ff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 314, 'network_id': 'db90cb04-d853-4680-bcb2-8a3f67843e79'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:30:28.506704 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-a45c21e7-44cf-4177-9fef-471de7b31416 None None] Bound port: f67f9614-451a-4e9c-bc78-07c8fe91744e, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6801eee2-b555-4544-80b2-a79040b919ff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 314, 'network_id': 'db90cb04-d853-4680-bcb2-8a3f67843e79'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:30:28.507078 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a45c21e7-44cf-4177-9fef-471de7b31416 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:28.536257 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-8a627adf-4607-4b2c-b28f-25b1432b258a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['db90cb04-d853-4680-bcb2-8a3f67843e79']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:28.588277 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-aeff7b3c-c75a-43e9-952e-012df8a35907 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:28.592650 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-8a627adf-4607-4b2c-b28f-25b1432b258a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6801eee2-b555-4544-80b2-a79040b919ff') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:28.592843 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-8a627adf-4607-4b2c-b28f-25b1432b258a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6801eee2-b555-4544-80b2-a79040b919ff') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:28.614998 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8a627adf-4607-4b2c-b28f-25b1432b258a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:28.653410 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8a627adf-4607-4b2c-b28f-25b1432b258a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:28.658681 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-a45c21e7-44cf-4177-9fef-471de7b31416 None None] Port f67f9614-451a-4e9c-bc78-07c8fe91744e has been deleted concurrently {{(pid=102163) _commit_port_binding /opt/stack/neutron/neutron/plugins/ml2/plugin.py:665}} Nov 09 04:30:28.664463 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8a627adf-4607-4b2c-b28f-25b1432b258a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Releasing vlan 314 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:30:28.664906 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8a627adf-4607-4b2c-b28f-25b1432b258a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:28.668115 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:30:28.668115 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:30:28.668115 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:30:28.668115 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:30:28.668115 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:30:28.668115 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:30:28.668115 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:30:28.668115 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:30:28.668115 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:30:28.668115 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:30:28.668115 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:30:28.668115 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:30:28.668115 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:30:28.668115 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:30:28.668115 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:30:28.668115 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:30:28.668115 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:30:28.668115 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:30:28.668115 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:30:28.668115 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:30:28.668115 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:30:28.668115 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:30:28.668115 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:30:28.668115 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:30:28.668115 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:30:28.668115 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:30:28.668115 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:30:28.668115 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:30:28.668115 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:30:28.668115 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:30:28.668115 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:30:28.668115 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:30:28.775597 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3a87b1b8-4ab6-4694-ab8d-2849aee933b4 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Made reservation on behalf of 188f23ef0cb54006875c672b78f5249f for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:30:28.781539 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3a87b1b8-4ab6-4694-ab8d-2849aee933b4 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:28.842334 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8a627adf-4607-4b2c-b28f-25b1432b258a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:28.920389 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8a627adf-4607-4b2c-b28f-25b1432b258a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:28.927010 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-8a627adf-4607-4b2c-b28f-25b1432b258a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "DELETE /v2.0/networks/db90cb04-d853-4680-bcb2-8a3f67843e79 HTTP/1.1" status: 204 len: 168 time: 3.4009440 Nov 09 04:30:28.932221 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54670) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:28.943230 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-935d1dad-6e35-41a7-95fb-be423042f345 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-1587477092'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:28.950544 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-be7abfcf-ea34-4312-963a-2e1a63146b16 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:28.972351 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a627adf-4607-4b2c-b28f-25b1432b258a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event deleted for resources: {'Network': ['ID=db90cb04-d853-4680-bcb2-8a3f67843e79,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:29.044483 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-605acdfd-8668-4b39-b65a-5be6c2e1ffde tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:29.051245 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e84510d1-2de2-49f5-931e-9994fd62d102 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-f5798b15-f4fc-4342-b0d7-1c42a5da2fde', 'network_id': 'f5798b15-f4fc-4342-b0d7-1c42a5da2fde', 'tenant_id': '88f9f8da29bf4a8793b45130d483a6e6', 'fixed_ips': [{'subnet_id': 'd07738e5-a445-49bf-89a9-f648661cbc55'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:30:29.052368 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e84510d1-2de2-49f5-931e-9994fd62d102 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:29.054439 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54672) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:29.069108 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54676) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:29.156776 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b379ce9c-f6c5-40d6-b803-7dc864d31d9e tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Made reservation on behalf of 88f9f8da29bf4a8793b45130d483a6e6 for: {'port': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:30:29.175145 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b379ce9c-f6c5-40d6-b803-7dc864d31d9e tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:29.178299 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be7abfcf-ea34-4312-963a-2e1a63146b16 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Pushing event deleted for resources: {'Port': ['ID=9497cf32-a29c-439f-bf2c-8cfebde2405f,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:29.216766 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-3a42d09d-c681-4183-b60c-359db4562f7c None None] Allocated IP 172.20.0.2 (a270b61c-1f4f-4d97-be79-4a24c65fddc2/b2956e71-9b0f-4060-922c-e54ce6cff80a/5a469f60-d369-4f42-8796-f6357a453930) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:30:29.322641 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-605acdfd-8668-4b39-b65a-5be6c2e1ffde tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Pushing event deleted for resources: {'Port': ['ID=44936ee5-95e8-4a26-8472-36c60d7ca2b5,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:29.359680 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.db.api [None req-5e3e4287-3156-44c5-885e-8f8c6bd155bd None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=102163) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:30:29.360226 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG oslo_db.api [None req-5e3e4287-3156-44c5-885e-8f8c6bd155bd None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:30:29.382135 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-5a4c33f2-a9c7-47f6-8330-34ce04136aad tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] Request body: {'quota': {'network': 2}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:29.450171 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-935d1dad-6e35-41a7-95fb-be423042f345 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Made reservation on behalf of 6761c80dbfa84798bb6517a9b532f870 for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:30:29.453676 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-935d1dad-6e35-41a7-95fb-be423042f345 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:29.462257 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [None req-b379ce9c-f6c5-40d6-b803-7dc864d31d9e tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] device_id is not set on port 870a158e-55f5-4b89-9985-b2ef9e5d65c1 yet. {{(pid=102161) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:30:29.483195 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-aeff7b3c-c75a-43e9-952e-012df8a35907 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:29.506567 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-aeff7b3c-c75a-43e9-952e-012df8a35907 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:29.583935 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3a87b1b8-4ab6-4694-ab8d-2849aee933b4 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:29.595631 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-605acdfd-8668-4b39-b65a-5be6c2e1ffde tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-466373'] for router_gateway, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:29.614636 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-e84510d1-2de2-49f5-931e-9994fd62d102 None None] Allocated IP 172.20.0.2 (f5798b15-f4fc-4342-b0d7-1c42a5da2fde/d07738e5-a445-49bf-89a9-f648661cbc55/40db2e16-239b-4240-9e19-f35a26d3685b) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:30:29.650415 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-be7abfcf-ea34-4312-963a-2e1a63146b16 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-466373'] for router_gateway, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:29.685677 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-935d1dad-6e35-41a7-95fb-be423042f345 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 306} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:30:29.692132 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-5a4c33f2-a9c7-47f6-8330-34ce04136aad tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] 10.222.0.24 "PUT /v2.0/quotas/cb18dbc837274b8799c9aea5a3b4ad93 HTTP/1.1" status: 200 len: 368 time: 0.6158986 Nov 09 04:30:29.704041 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54680) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:29.725543 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-2574ddf9-b6a7-416a-9d48-4582e2817ae8 tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] Request body: {'network': {'project_id': 'cb18dbc837274b8799c9aea5a3b4ad93'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:29.778767 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4ac5444c-e4bd-49d2-9a0d-0bfea7c29a81 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:29.807960 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a87b1b8-4ab6-4694-ab8d-2849aee933b4 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event updated for resources: {'Subnet': ['ID=91be2814-c9e6-41c8-8b39-591a057bbda9,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:29.817033 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-605acdfd-8668-4b39-b65a-5be6c2e1ffde tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:29.818972 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-935d1dad-6e35-41a7-95fb-be423042f345 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:29.819310 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-935d1dad-6e35-41a7-95fb-be423042f345 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Added segment 2ddb3949-f824-4128-bd87-8019dfd3d905 of type vlan for network e6c58b7d-aeed-4bbf-9856-1d53b3644115 Nov 09 04:30:29.822293 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-605acdfd-8668-4b39-b65a-5be6c2e1ffde tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:29.833098 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3a42d09d-c681-4183-b60c-359db4562f7c None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:29.834096 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-be7abfcf-ea34-4312-963a-2e1a63146b16 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:29.842146 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-be7abfcf-ea34-4312-963a-2e1a63146b16 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:29.858347 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3a87b1b8-4ab6-4694-ab8d-2849aee933b4 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Checking segment: {'id': 'de95ed3f-4273-400f-9757-f62070e21304', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 334, 'network_id': 'db9e10ea-0b45-4893-ab26-2f1ea5e8271b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:30:29.858725 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3a87b1b8-4ab6-4694-ab8d-2849aee933b4 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Network hostable DHCP agents. Network: db9e10ea-0b45-4893-ab26-2f1ea5e8271b, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:30:29.879935 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-aeff7b3c-c75a-43e9-952e-012df8a35907 admin admin] Allocated IP 172.26.0.95 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/a4e20770-3342-4c9b-a9bf-d4dab52b7d8d) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:30:29.912262 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2574ddf9-b6a7-416a-9d48-4582e2817ae8 tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] Made reservation on behalf of cb18dbc837274b8799c9aea5a3b4ad93 for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:30:29.914665 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2574ddf9-b6a7-416a-9d48-4582e2817ae8 tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:29.957886 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5e3e4287-3156-44c5-885e-8f8c6bd155bd None None] Port 9497cf32-a29c-439f-bf2c-8cfebde2405f not found while updating agent binding for router 5ec7af2c-6266-4564-aeae-0c55aba5200b. {{(pid=102163) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:216}} Nov 09 04:30:29.959954 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2574ddf9-b6a7-416a-9d48-4582e2817ae8 tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:29.965640 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3a42d09d-c681-4183-b60c-359db4562f7c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:30.003208 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-935d1dad-6e35-41a7-95fb-be423042f345 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:30.042245 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3a42d09d-c681-4183-b60c-359db4562f7c None None] Network a270b61c-1f4f-4d97-be79-4a24c65fddc2 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:30:30.044695 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e84510d1-2de2-49f5-931e-9994fd62d102 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:30.050241 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-3a42d09d-c681-4183-b60c-359db4562f7c None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:30.075907 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3a42d09d-c681-4183-b60c-359db4562f7c None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:30:30.085783 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4ac5444c-e4bd-49d2-9a0d-0bfea7c29a81 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:30.087966 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3a87b1b8-4ab6-4694-ab8d-2849aee933b4 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Network db9e10ea-0b45-4893-ab26-2f1ea5e8271b is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:30:30.092261 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5e3e4287-3156-44c5-885e-8f8c6bd155bd None None] Routers {'5ec7af2c-6266-4564-aeae-0c55aba5200b'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:30:30.092881 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-5e3e4287-3156-44c5-885e-8f8c6bd155bd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:30:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['5ec7af2c-6266-4564-aeae-0c55aba5200b'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:30.105833 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-605acdfd-8668-4b39-b65a-5be6c2e1ffde tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:30.112052 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-605acdfd-8668-4b39-b65a-5be6c2e1ffde tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Fanout notify agent at l3_agent the message router_deleted on router 9e078f7a-7765-4972-8cd2-e5085db47ecf {{(pid=102161) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:30:30.136226 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-605acdfd-8668-4b39-b65a-5be6c2e1ffde tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:30.138024 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-605acdfd-8668-4b39-b65a-5be6c2e1ffde tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] 10.222.0.24 "DELETE /v2.0/routers/9e078f7a-7765-4972-8cd2-e5085db47ecf HTTP/1.1" status: 204 len: 168 time: 3.4231112 Nov 09 04:30:30.139403 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-935d1dad-6e35-41a7-95fb-be423042f345 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:30.144325 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-aeff7b3c-c75a-43e9-952e-012df8a35907 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:30.145729 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54682) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:30.148706 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-935d1dad-6e35-41a7-95fb-be423042f345 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:30.150865 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-935d1dad-6e35-41a7-95fb-be423042f345 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:30.153521 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-4b692a53-2fa6-4b13-8b05-0c98f8d2e25a tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Request body: {'router': {'name': 'tempest-RoutersIpV6AdminTest-router-409695295', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}, 'admin_state_up': False}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:30.193343 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4ac5444c-e4bd-49d2-9a0d-0bfea7c29a81 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:30.195653 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-3a87b1b8-4ab6-4694-ab8d-2849aee933b4 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, db9e10ea-0b45-4893-ab26-2f1ea5e8271b) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:30.225432 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9a21519f-632b-47f9-9552-d11f9223e365 None None] Network db9e10ea-0b45-4893-ab26-2f1ea5e8271b requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:30:30.234783 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3a87b1b8-4ab6-4694-ab8d-2849aee933b4 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:30.235391 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3a87b1b8-4ab6-4694-ab8d-2849aee933b4 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:30.254738 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2574ddf9-b6a7-416a-9d48-4582e2817ae8 tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:30.265971 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-b379ce9c-f6c5-40d6-b803-7dc864d31d9e tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Allocated IP 172.20.0.3 (f5798b15-f4fc-4342-b0d7-1c42a5da2fde/d07738e5-a445-49bf-89a9-f648661cbc55/870a158e-55f5-4b89-9985-b2ef9e5d65c1) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:30:30.294522 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-4ac5444c-e4bd-49d2-9a0d-0bfea7c29a81 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=fd3283d3a5e545bc8775f459cd5adb4b&name=default HTTP/1.1" status: 200 len: 2996 time: 1.2365835 Nov 09 04:30:30.299249 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54684) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:30.306036 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ac5444c-e4bd-49d2-9a0d-0bfea7c29a81 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c2a0b876-0fef-47e2-9de1-83cab0bebd39,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:30.319647 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2574ddf9-b6a7-416a-9d48-4582e2817ae8 tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:30.349847 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e84510d1-2de2-49f5-931e-9994fd62d102 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:30.371218 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2574ddf9-b6a7-416a-9d48-4582e2817ae8 tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 339} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:30:30.373688 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-5e3e4287-3156-44c5-885e-8f8c6bd155bd None None] Set router 5ec7af2c-6266-4564-aeae-0c55aba5200b gateway port host: None {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:30:30.392118 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4b692a53-2fa6-4b13-8b05-0c98f8d2e25a tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:30.393677 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4b692a53-2fa6-4b13-8b05-0c98f8d2e25a tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:30.406722 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2574ddf9-b6a7-416a-9d48-4582e2817ae8 tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:30.407069 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-2574ddf9-b6a7-416a-9d48-4582e2817ae8 tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] Added segment 7438a1af-d1c7-4767-8b60-d5d6212ad11b of type vlan for network f28ec1eb-1ed1-4d2e-942d-5f48ee8d838f Nov 09 04:30:30.407371 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a42d09d-c681-4183-b60c-359db4562f7c None None] Pushing event updated for resources: {'Port': ['ID=5a469f60-d369-4f42-8796-f6357a453930,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:30.408811 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2574ddf9-b6a7-416a-9d48-4582e2817ae8 tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=064df39c-4d01-464c-9daa-e0fc8ea833db,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:30.419240 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-aeff7b3c-c75a-43e9-952e-012df8a35907 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:30.483494 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-be7abfcf-ea34-4312-963a-2e1a63146b16 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:30.488026 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-be7abfcf-ea34-4312-963a-2e1a63146b16 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 5ec7af2c-6266-4564-aeae-0c55aba5200b {{(pid=102161) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:30:30.495764 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-be7abfcf-ea34-4312-963a-2e1a63146b16 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:30.505659 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-be7abfcf-ea34-4312-963a-2e1a63146b16 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] 10.222.0.24 "DELETE /v2.0/routers/5ec7af2c-6266-4564-aeae-0c55aba5200b HTTP/1.1" status: 204 len: 168 time: 3.2141490 Nov 09 04:30:30.513595 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54686) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:30.526931 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b379ce9c-f6c5-40d6-b803-7dc864d31d9e tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:30.538109 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-3a87b1b8-4ab6-4694-ab8d-2849aee933b4 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.1209593 Nov 09 04:30:30.540580 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-5e3e4287-3156-44c5-885e-8f8c6bd155bd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5ec7af2c-6266-4564-aeae-0c55aba5200b', 'name': 'tempest-snat-router-55453648', 'tenant_id': 'cf43ca7e091f42ca80c78a3f7dbeba63', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:30:20Z', 'updated_at': '2021-11-09T04:30:28Z', 'revision_number': 5, 'project_id': 'cf43ca7e091f42ca80c78a3f7dbeba63', 'gw_port_host': None}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:30.546630 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fe19a0af-9b24-4e25-a0da-3865a9b474d8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:30.548497 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54688) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:30.549264 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e84510d1-2de2-49f5-931e-9994fd62d102 None None] Network f5798b15-f4fc-4342-b0d7-1c42a5da2fde is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:30:30.559727 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-fbfa4c8e-0324-4141-8885-ad9269ec3cfb None None] Could not find standard attr ID for object f67f9614-451a-4e9c-bc78-07c8fe91744e. {{(pid=102163) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 09 04:30:30.588042 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2574ddf9-b6a7-416a-9d48-4582e2817ae8 tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:30.603145 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-d0b2f3b2-bbf8-4e16-ab17-4e1665aece6f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Request body: {'subnet': {'network_id': '0a61eb3b-f9c4-4bc0-94dd-9f48ad858a9d', 'cidr': '172.21.0.0/28', 'ip_version': 4, 'gateway_ip': '172.21.0.1'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:30.619042 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aeff7b3c-c75a-43e9-952e-012df8a35907 admin admin] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:30:30.635301 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-935d1dad-6e35-41a7-95fb-be423042f345 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event updated for resources: {'Network': ['ID=e6c58b7d-aeed-4bbf-9856-1d53b3644115,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:30.652636 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-aeff7b3c-c75a-43e9-952e-012df8a35907 admin admin] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:30.674265 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-935d1dad-6e35-41a7-95fb-be423042f345 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 780 time: 1.7331436 Nov 09 04:30:30.676811 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54690) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:30.682440 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-76102920-3a48-45e7-ad8d-a022690b476a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Request body: {'subnet': {'network_id': 'e6c58b7d-aeed-4bbf-9856-1d53b3644115', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'allocation_pools': [{'start': '172.20.0.3', 'end': '172.20.0.7'}]}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:30.700404 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aeff7b3c-c75a-43e9-952e-012df8a35907 admin admin] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:30:30.705048 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aeff7b3c-c75a-43e9-952e-012df8a35907 admin admin] Pushing event updated for resources: {'Port': ['ID=a4e20770-3342-4c9b-a9bf-d4dab52b7d8d,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:30.714514 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4b692a53-2fa6-4b13-8b05-0c98f8d2e25a tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:30.764563 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b379ce9c-f6c5-40d6-b803-7dc864d31d9e tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:30.784714 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fe19a0af-9b24-4e25-a0da-3865a9b474d8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:30.788441 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-e84510d1-2de2-49f5-931e-9994fd62d102 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:30.790327 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b653ec32-cf7f-4d0f-b82e-98f4f4f08e7e None None] DHCP port deletion for db90cb04-d853-4680-bcb2-8a3f67843e79 request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:30:30.794103 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network e6c58b7d-aeed-4bbf-9856-1d53b3644115 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:30:30.799882 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-3a42d09d-c681-4183-b60c-359db4562f7c None None] Attempting to bind port 5a469f60-d369-4f42-8796-f6357a453930 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:30:30.800410 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-3a42d09d-c681-4183-b60c-359db4562f7c None None] Attempting to bind port 5a469f60-d369-4f42-8796-f6357a453930 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'e211d893-ee7a-48e3-bc29-b8824167e15b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 325, 'network_id': 'a270b61c-1f4f-4d97-be79-4a24c65fddc2'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:30:30.800903 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3a42d09d-c681-4183-b60c-359db4562f7c None None] Attempting to bind port 5a469f60-d369-4f42-8796-f6357a453930 on network a270b61c-1f4f-4d97-be79-4a24c65fddc2 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:30:30.819045 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e84510d1-2de2-49f5-931e-9994fd62d102 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:30:30.836955 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3a42d09d-c681-4183-b60c-359db4562f7c None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 30, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:30:30.837431 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3a42d09d-c681-4183-b60c-359db4562f7c None None] Checking segment: {'id': 'e211d893-ee7a-48e3-bc29-b8824167e15b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 325, 'network_id': 'a270b61c-1f4f-4d97-be79-4a24c65fddc2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:30:30.837738 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3a42d09d-c681-4183-b60c-359db4562f7c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:30.841264 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3a42d09d-c681-4183-b60c-359db4562f7c None None] Bound using segment: {'id': 'e211d893-ee7a-48e3-bc29-b8824167e15b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 325, 'network_id': 'a270b61c-1f4f-4d97-be79-4a24c65fddc2'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:30:30.841264 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-3a42d09d-c681-4183-b60c-359db4562f7c None None] Bound port: 5a469f60-d369-4f42-8796-f6357a453930, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e211d893-ee7a-48e3-bc29-b8824167e15b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 325, 'network_id': 'a270b61c-1f4f-4d97-be79-4a24c65fddc2'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:30:30.841264 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3a42d09d-c681-4183-b60c-359db4562f7c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:30.847405 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b379ce9c-f6c5-40d6-b803-7dc864d31d9e tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Network f5798b15-f4fc-4342-b0d7-1c42a5da2fde is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:30:30.856786 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5e3e4287-3156-44c5-885e-8f8c6bd155bd None None] The sync data for ids ['5ec7af2c-6266-4564-aeae-0c55aba5200b'] in dv-neutron-816802-2-hyperv is: [{'id': '5ec7af2c-6266-4564-aeae-0c55aba5200b', 'name': 'tempest-snat-router-55453648', 'tenant_id': 'cf43ca7e091f42ca80c78a3f7dbeba63', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:30:20Z', 'updated_at': '2021-11-09T04:30:28Z', 'revision_number': 5, 'project_id': 'cf43ca7e091f42ca80c78a3f7dbeba63', 'gw_port_host': None}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:30:30.858255 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-b379ce9c-f6c5-40d6-b803-7dc864d31d9e tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:30.874783 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b379ce9c-f6c5-40d6-b803-7dc864d31d9e tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:30:30.881600 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b379ce9c-f6c5-40d6-b803-7dc864d31d9e tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event updated for resources: {'Port': ['ID=870a158e-55f5-4b89-9985-b2ef9e5d65c1,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:30.908592 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e84510d1-2de2-49f5-931e-9994fd62d102 None None] Pushing event updated for resources: {'Port': ['ID=40db2e16-239b-4240-9e19-f35a26d3685b,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:30.944442 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-76102920-3a48-45e7-ad8d-a022690b476a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Made reservation on behalf of 6761c80dbfa84798bb6517a9b532f870 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:30:30.953225 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-76102920-3a48-45e7-ad8d-a022690b476a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:30.995813 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2574ddf9-b6a7-416a-9d48-4582e2817ae8 tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:30.996954 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2574ddf9-b6a7-416a-9d48-4582e2817ae8 tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:30.997536 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2574ddf9-b6a7-416a-9d48-4582e2817ae8 tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:31.000355 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b379ce9c-f6c5-40d6-b803-7dc864d31d9e tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:31.001198 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b379ce9c-f6c5-40d6-b803-7dc864d31d9e tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:31.021298 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2937f749-334b-4227-93df-22e824d7615d None None] Network db90cb04-d853-4680-bcb2-8a3f67843e79 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:30:31.071743 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.ipam_backend_mixin [None req-76102920-3a48-45e7-ad8d-a022690b476a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Performing IP validity checks on allocation pools {{(pid=102161) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:325}} Nov 09 04:30:31.074101 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.ipam_backend_mixin [None req-76102920-3a48-45e7-ad8d-a022690b476a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Checking for overlaps among allocation pools and gateway ip {{(pid=102161) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:346}} Nov 09 04:30:31.086994 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2937f749-334b-4227-93df-22e824d7615d None None] Network db90cb04-d853-4680-bcb2-8a3f67843e79 could not be found, it might have been deleted concurrently. {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:225}} Nov 09 04:30:31.112611 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-091ff7c5-65ea-42b5-9829-a9431b654a58 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-db9e10ea-0b45-4893-ab26-2f1ea5e8271b', 'network_id': 'db9e10ea-0b45-4893-ab26-2f1ea5e8271b', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'fixed_ips': [{'subnet_id': '91be2814-c9e6-41c8-8b39-591a057bbda9'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:30:31.113658 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-091ff7c5-65ea-42b5-9829-a9431b654a58 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:31.174341 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-e84510d1-2de2-49f5-931e-9994fd62d102 None None] Attempting to bind port 40db2e16-239b-4240-9e19-f35a26d3685b on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:30:31.175131 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-e84510d1-2de2-49f5-931e-9994fd62d102 None None] Attempting to bind port 40db2e16-239b-4240-9e19-f35a26d3685b by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'c36a4d79-e250-4bb8-9048-928eee98e328', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': 'f5798b15-f4fc-4342-b0d7-1c42a5da2fde'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:30:31.175641 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e84510d1-2de2-49f5-931e-9994fd62d102 None None] Attempting to bind port 40db2e16-239b-4240-9e19-f35a26d3685b on network f5798b15-f4fc-4342-b0d7-1c42a5da2fde {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:30:31.251044 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-3a42d09d-c681-4183-b60c-359db4562f7c None None] For port 5a469f60-d369-4f42-8796-f6357a453930, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:30:31.285773 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e84510d1-2de2-49f5-931e-9994fd62d102 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 30, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:30:31.286488 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e84510d1-2de2-49f5-931e-9994fd62d102 None None] Checking segment: {'id': 'c36a4d79-e250-4bb8-9048-928eee98e328', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': 'f5798b15-f4fc-4342-b0d7-1c42a5da2fde'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:30:31.287049 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e84510d1-2de2-49f5-931e-9994fd62d102 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:31.287607 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e84510d1-2de2-49f5-931e-9994fd62d102 None None] Bound using segment: {'id': 'c36a4d79-e250-4bb8-9048-928eee98e328', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': 'f5798b15-f4fc-4342-b0d7-1c42a5da2fde'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:30:31.288103 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-e84510d1-2de2-49f5-931e-9994fd62d102 None None] Bound port: 40db2e16-239b-4240-9e19-f35a26d3685b, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c36a4d79-e250-4bb8-9048-928eee98e328', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': 'f5798b15-f4fc-4342-b0d7-1c42a5da2fde'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:30:31.288517 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e84510d1-2de2-49f5-931e-9994fd62d102 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:31.296875 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-3a42d09d-c681-4183-b60c-359db4562f7c None None] For port 5a469f60-d369-4f42-8796-f6357a453930, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=5a469f60-d369-4f42-8796-f6357a453930,segment=NetworkSegment(e211d893-ee7a-48e3-bc29-b8824167e15b),segment_id=e211d893-ee7a-48e3-bc29-b8824167e15b)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:30:31.407626 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3a42d09d-c681-4183-b60c-359db4562f7c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:31.461866 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e84510d1-2de2-49f5-931e-9994fd62d102 None None] For port 40db2e16-239b-4240-9e19-f35a26d3685b, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:30:31.489802 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-091ff7c5-65ea-42b5-9829-a9431b654a58 None None] Allocated IP 172.20.0.2 (db9e10ea-0b45-4893-ab26-2f1ea5e8271b/91be2814-c9e6-41c8-8b39-591a057bbda9/6bdef35f-00ac-46ea-a01f-2644260e91e1) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:30:31.518903 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e84510d1-2de2-49f5-931e-9994fd62d102 None None] For port 40db2e16-239b-4240-9e19-f35a26d3685b, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=40db2e16-239b-4240-9e19-f35a26d3685b,segment=NetworkSegment(c36a4d79-e250-4bb8-9048-928eee98e328),segment_id=c36a4d79-e250-4bb8-9048-928eee98e328)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:30:31.557966 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a42d09d-c681-4183-b60c-359db4562f7c None None] Pushing event updated for resources: {'Port': ['ID=5a469f60-d369-4f42-8796-f6357a453930,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:31.572683 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e84510d1-2de2-49f5-931e-9994fd62d102 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:31.588142 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-76102920-3a48-45e7-ad8d-a022690b476a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:31.660851 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-649accbe-01d1-4148-95cb-21cf9203d2a7 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks [] for router, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:31.676215 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4b692a53-2fa6-4b13-8b05-0c98f8d2e25a tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:31.699636 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-76102920-3a48-45e7-ad8d-a022690b476a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Checking segment: {'id': '2ddb3949-f824-4128-bd87-8019dfd3d905', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 306, 'network_id': 'e6c58b7d-aeed-4bbf-9856-1d53b3644115'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:30:31.699988 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-76102920-3a48-45e7-ad8d-a022690b476a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Network hostable DHCP agents. Network: e6c58b7d-aeed-4bbf-9856-1d53b3644115, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:30:31.726047 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2574ddf9-b6a7-416a-9d48-4582e2817ae8 tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] Pushing event updated for resources: {'Network': ['ID=f28ec1eb-1ed1-4d2e-942d-5f48ee8d838f,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:31.748587 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76102920-3a48-45e7-ad8d-a022690b476a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event updated for resources: {'Subnet': ['ID=93d26cc7-2350-4f28-b358-8bc13b541762,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:31.769382 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network f28ec1eb-1ed1-4d2e-942d-5f48ee8d838f details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:30:31.829827 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e84510d1-2de2-49f5-931e-9994fd62d102 None None] Pushing event updated for resources: {'Port': ['ID=40db2e16-239b-4240-9e19-f35a26d3685b,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:31.835510 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d0b2f3b2-bbf8-4e16-ab17-4e1665aece6f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Made reservation on behalf of 188f23ef0cb54006875c672b78f5249f for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:30:31.840773 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d0b2f3b2-bbf8-4e16-ab17-4e1665aece6f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:31.863676 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-76102920-3a48-45e7-ad8d-a022690b476a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Network e6c58b7d-aeed-4bbf-9856-1d53b3644115 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:30:31.955478 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-b379ce9c-f6c5-40d6-b803-7dc864d31d9e tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 924 time: 3.4601731 Nov 09 04:30:31.955806 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54692) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:31.988633 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-76102920-3a48-45e7-ad8d-a022690b476a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, e6c58b7d-aeed-4bbf-9856-1d53b3644115) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:32.010038 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-830afb21-705f-405e-92eb-b562c3e9d2b4 None None] Network e6c58b7d-aeed-4bbf-9856-1d53b3644115 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:30:32.027093 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-76102920-3a48-45e7-ad8d-a022690b476a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:32.028242 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-76102920-3a48-45e7-ad8d-a022690b476a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:32.028979 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-091ff7c5-65ea-42b5-9829-a9431b654a58 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:32.086887 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fe19a0af-9b24-4e25-a0da-3865a9b474d8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:32.092005 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fe19a0af-9b24-4e25-a0da-3865a9b474d8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:32.095427 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-fe19a0af-9b24-4e25-a0da-3865a9b474d8 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/c2a0b876-0fef-47e2-9de1-83cab0bebd39 HTTP/1.1" status: 204 len: 168 time: 1.7941682 Nov 09 04:30:32.110739 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54696) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:32.115555 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-2574ddf9-b6a7-416a-9d48-4582e2817ae8 tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 837 time: 2.3962111 Nov 09 04:30:32.123631 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-dc69310d-515c-4677-8ecb-e40f6bd41c7c tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] Request body: {'network': {'project_id': 'cb18dbc837274b8799c9aea5a3b4ad93'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:32.161725 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-091ff7c5-65ea-42b5-9829-a9431b654a58 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:32.203468 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54698) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:32.204437 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-76102920-3a48-45e7-ad8d-a022690b476a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 800 time: 1.5168257 Nov 09 04:30:32.228759 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-091ff7c5-65ea-42b5-9829-a9431b654a58 None None] Network db9e10ea-0b45-4893-ab26-2f1ea5e8271b is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:30:32.265327 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-091ff7c5-65ea-42b5-9829-a9431b654a58 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:32.268447 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-091ff7c5-65ea-42b5-9829-a9431b654a58 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:30:32.322537 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-1e2bcb1c-60cd-4c6c-b2a9-b596131df1e6 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Deleting port 870a158e-55f5-4b89-9985-b2ef9e5d65c1 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:30:32.322886 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1e2bcb1c-60cd-4c6c-b2a9-b596131df1e6 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:32.366016 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-091ff7c5-65ea-42b5-9829-a9431b654a58 None None] Pushing event updated for resources: {'Port': ['ID=6bdef35f-00ac-46ea-a01f-2644260e91e1,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:32.387762 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dc69310d-515c-4677-8ecb-e40f6bd41c7c tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] Made reservation on behalf of cb18dbc837274b8799c9aea5a3b4ad93 for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:30:32.388068 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe19a0af-9b24-4e25-a0da-3865a9b474d8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c2a0b876-0fef-47e2-9de1-83cab0bebd39,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:32.388729 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dc69310d-515c-4677-8ecb-e40f6bd41c7c tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:32.456204 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-dc69310d-515c-4677-8ecb-e40f6bd41c7c tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 331} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:30:32.473667 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1e2bcb1c-60cd-4c6c-b2a9-b596131df1e6 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:32.474339 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-091ff7c5-65ea-42b5-9829-a9431b654a58 None None] Attempting to bind port 6bdef35f-00ac-46ea-a01f-2644260e91e1 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:30:32.474829 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-091ff7c5-65ea-42b5-9829-a9431b654a58 None None] Attempting to bind port 6bdef35f-00ac-46ea-a01f-2644260e91e1 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'de95ed3f-4273-400f-9757-f62070e21304', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 334, 'network_id': 'db9e10ea-0b45-4893-ab26-2f1ea5e8271b'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:30:32.475278 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-091ff7c5-65ea-42b5-9829-a9431b654a58 None None] Attempting to bind port 6bdef35f-00ac-46ea-a01f-2644260e91e1 on network db9e10ea-0b45-4893-ab26-2f1ea5e8271b {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:30:32.493701 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dc69310d-515c-4677-8ecb-e40f6bd41c7c tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:32.493701 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-dc69310d-515c-4677-8ecb-e40f6bd41c7c tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] Added segment 6ee646af-aaaf-4773-bba4-15abf7c53850 of type vlan for network e60b28f2-9a15-45c5-914e-e164b880cfee Nov 09 04:30:32.495007 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-091ff7c5-65ea-42b5-9829-a9431b654a58 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 30, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:30:32.495514 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-091ff7c5-65ea-42b5-9829-a9431b654a58 None None] Checking segment: {'id': 'de95ed3f-4273-400f-9757-f62070e21304', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 334, 'network_id': 'db9e10ea-0b45-4893-ab26-2f1ea5e8271b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:30:32.496017 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-091ff7c5-65ea-42b5-9829-a9431b654a58 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:32.496507 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-091ff7c5-65ea-42b5-9829-a9431b654a58 None None] Bound using segment: {'id': 'de95ed3f-4273-400f-9757-f62070e21304', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 334, 'network_id': 'db9e10ea-0b45-4893-ab26-2f1ea5e8271b'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:30:32.497094 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-091ff7c5-65ea-42b5-9829-a9431b654a58 None None] Bound port: 6bdef35f-00ac-46ea-a01f-2644260e91e1, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'de95ed3f-4273-400f-9757-f62070e21304', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 334, 'network_id': 'db9e10ea-0b45-4893-ab26-2f1ea5e8271b'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:30:32.497580 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-091ff7c5-65ea-42b5-9829-a9431b654a58 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:32.505812 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-1e2bcb1c-60cd-4c6c-b2a9-b596131df1e6 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Calling delete_port for 870a158e-55f5-4b89-9985-b2ef9e5d65c1 owned by {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:30:32.581288 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dc69310d-515c-4677-8ecb-e40f6bd41c7c tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:32.605089 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8922c1d6-34ac-4f83-9692-425ea96f1a73 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-e6c58b7d-aeed-4bbf-9856-1d53b3644115', 'network_id': 'e6c58b7d-aeed-4bbf-9856-1d53b3644115', 'tenant_id': '6761c80dbfa84798bb6517a9b532f870', 'fixed_ips': [{'subnet_id': '93d26cc7-2350-4f28-b358-8bc13b541762'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:30:32.606066 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8922c1d6-34ac-4f83-9692-425ea96f1a73 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:32.648204 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-649accbe-01d1-4148-95cb-21cf9203d2a7 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:32.697109 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-72417fa1-15d7-4ea7-a6b9-2918a78f841b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:32.807846 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-091ff7c5-65ea-42b5-9829-a9431b654a58 None None] For port 6bdef35f-00ac-46ea-a01f-2644260e91e1, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:30:32.823339 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-aeff7b3c-c75a-43e9-952e-012df8a35907 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:32.828568 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dc69310d-515c-4677-8ecb-e40f6bd41c7c tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:32.830881 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dc69310d-515c-4677-8ecb-e40f6bd41c7c tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:32.831475 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dc69310d-515c-4677-8ecb-e40f6bd41c7c tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:32.929935 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1e2bcb1c-60cd-4c6c-b2a9-b596131df1e6 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:32.930727 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-091ff7c5-65ea-42b5-9829-a9431b654a58 None None] For port 6bdef35f-00ac-46ea-a01f-2644260e91e1, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=6bdef35f-00ac-46ea-a01f-2644260e91e1,segment=NetworkSegment(de95ed3f-4273-400f-9757-f62070e21304),segment_id=de95ed3f-4273-400f-9757-f62070e21304)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:30:32.985829 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-8922c1d6-34ac-4f83-9692-425ea96f1a73 None None] Allocated IP 172.20.0.3 (e6c58b7d-aeed-4bbf-9856-1d53b3644115/93d26cc7-2350-4f28-b358-8bc13b541762/aca0c961-8945-477f-911e-d3ac45c9d2bb) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:30:33.001424 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-091ff7c5-65ea-42b5-9829-a9431b654a58 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:33.012490 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e2bcb1c-60cd-4c6c-b2a9-b596131df1e6 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event deleted for resources: {'Port': ['ID=870a158e-55f5-4b89-9985-b2ef9e5d65c1,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:33.035996 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-dc69310d-515c-4677-8ecb-e40f6bd41c7c tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 837 time: 0.9217691 Nov 09 04:30:33.041977 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54710) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:33.041977 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc69310d-515c-4677-8ecb-e40f6bd41c7c tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] Pushing event updated for resources: {'Network': ['ID=e60b28f2-9a15-45c5-914e-e164b880cfee,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:33.055174 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-37ce1a94-fa8e-4fa4-bab6-0fa57717a73a tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] Request body: {'network': {'project_id': 'cb18dbc837274b8799c9aea5a3b4ad93'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:33.074084 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network e60b28f2-9a15-45c5-914e-e164b880cfee details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:30:33.160667 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 40db2e16-239b-4240-9e19-f35a26d3685b up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:30:33.200014 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-37ce1a94-fa8e-4fa4-bab6-0fa57717a73a tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] POST failed (client error): There was a conflict when trying to complete your request. Nov 09 04:30:33.201118 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-37ce1a94-fa8e-4fa4-bab6-0fa57717a73a tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] No notification will be sent due to unsuccessful status code: 409 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:30:33.206196 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-37ce1a94-fa8e-4fa4-bab6-0fa57717a73a tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 409 len: 310 time: 0.1550992 Nov 09 04:30:33.206902 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54712) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:33.313753 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-72417fa1-15d7-4ea7-a6b9-2918a78f841b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:33.337811 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-2d30a9f3-cdce-4778-ad6c-dc33541c1b92 tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=cb18dbc837274b8799c9aea5a3b4ad93&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1274614 Nov 09 04:30:33.341941 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54718) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:33.364716 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1e2bcb1c-60cd-4c6c-b2a9-b596131df1e6 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:33.374405 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1e2bcb1c-60cd-4c6c-b2a9-b596131df1e6 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "DELETE /v2.0/ports/870a158e-55f5-4b89-9985-b2ef9e5d65c1 HTTP/1.1" status: 204 len: 168 time: 1.4139581 Nov 09 04:30:33.376056 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54720) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:33.411815 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-86790d80-f9f6-4310-b223-1568cf73e79d tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] DELETE failed (client error): The resource could not be found. Nov 09 04:30:33.411815 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-86790d80-f9f6-4310-b223-1568cf73e79d tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:30:33.418907 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-86790d80-f9f6-4310-b223-1568cf73e79d tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "DELETE /v2.0/ports/870a158e-55f5-4b89-9985-b2ef9e5d65c1 HTTP/1.1" status: 404 len: 333 time: 0.0414617 Nov 09 04:30:33.422587 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54722) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:33.451511 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d0b2f3b2-bbf8-4e16-ab17-4e1665aece6f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:33.474262 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-78d291f0-778f-45e2-b28c-77c833e555b3 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] GET failed (client error): The resource could not be found. Nov 09 04:30:33.480627 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-78d291f0-778f-45e2-b28c-77c833e555b3 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "GET /v2.0/ports/870a158e-55f5-4b89-9985-b2ef9e5d65c1 HTTP/1.1" status: 404 len: 333 time: 0.0502257 Nov 09 04:30:33.483232 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54726) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:33.492569 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-091ff7c5-65ea-42b5-9829-a9431b654a58 None None] Pushing event updated for resources: {'Port': ['ID=6bdef35f-00ac-46ea-a01f-2644260e91e1,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:33.629775 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 40db2e16-239b-4240-9e19-f35a26d3685b triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:30:33.630145 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:33.639507 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-6c91015a-4df7-4049-887c-477aa2c0a4b6 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Deleting subnet d07738e5-a445-49bf-89a9-f648661cbc55 {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:30:33.646213 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6c91015a-4df7-4049-887c-477aa2c0a4b6 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:33.712303 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6c91015a-4df7-4049-887c-477aa2c0a4b6 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:33.843323 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0be7e094-0d95-41a7-9d4b-c01bf888f56a None None] Network f5798b15-f4fc-4342-b0d7-1c42a5da2fde requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:30:33.848511 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6c91015a-4df7-4049-887c-477aa2c0a4b6 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:33.849711 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-649accbe-01d1-4148-95cb-21cf9203d2a7 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Deleting port 9947f24d-f96c-49f9-8eb6-2be971ed9745 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:30:33.850230 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-649accbe-01d1-4148-95cb-21cf9203d2a7 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:33.964884 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0b2f3b2-bbf8-4e16-ab17-4e1665aece6f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event updated for resources: {'Subnet': ['ID=46e2a34a-c423-454a-a4ea-0bc78ae2ec41,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:33.967495 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3d839a31-b6c2-4049-be3b-b2c7404a73f8 tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:33.980521 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4b692a53-2fa6-4b13-8b05-0c98f8d2e25a tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks [] for router_gateway, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:34.013154 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3d839a31-b6c2-4049-be3b-b2c7404a73f8 tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:34.056883 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6c91015a-4df7-4049-887c-477aa2c0a4b6 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:34.099727 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c91015a-4df7-4049-887c-477aa2c0a4b6 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event deleted for resources: {'Subnet': ['ID=d07738e5-a445-49bf-89a9-f648661cbc55,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:34.103243 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6c91015a-4df7-4049-887c-477aa2c0a4b6 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:34.106867 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-6c91015a-4df7-4049-887c-477aa2c0a4b6 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "DELETE /v2.0/subnets/d07738e5-a445-49bf-89a9-f648661cbc55 HTTP/1.1" status: 204 len: 168 time: 0.6225066 Nov 09 04:30:34.109812 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54732) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:34.137144 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4b692a53-2fa6-4b13-8b05-0c98f8d2e25a tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:34.188564 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d0b2f3b2-bbf8-4e16-ab17-4e1665aece6f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Checking segment: {'id': '610156cc-bb06-4490-92ef-b436312a6831', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 316, 'network_id': '0a61eb3b-f9c4-4bc0-94dd-9f48ad858a9d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:30:34.188946 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d0b2f3b2-bbf8-4e16-ab17-4e1665aece6f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Network hostable DHCP agents. Network: 0a61eb3b-f9c4-4bc0-94dd-9f48ad858a9d, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:30:34.241025 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-685aaff9-5d4b-48d8-8112-28958798682f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:34.258834 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5217d3e2-b94d-4088-8b16-591c05b75d94 None None] Network a270b61c-1f4f-4d97-be79-4a24c65fddc2 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:30:34.279770 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-649accbe-01d1-4148-95cb-21cf9203d2a7 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] For port 9947f24d-f96c-49f9-8eb6-2be971ed9745, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=9947f24d-f96c-49f9-8eb6-2be971ed9745,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:30:34.279770 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-649accbe-01d1-4148-95cb-21cf9203d2a7 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:34.284568 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8922c1d6-34ac-4f83-9692-425ea96f1a73 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:34.289306 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-5860ba58-99b4-4392-adbf-9a13518ae76f None None] Provisioning complete for port 40db2e16-239b-4240-9e19-f35a26d3685b triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:30:34.289959 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5860ba58-99b4-4392-adbf-9a13518ae76f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:34.293126 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-aeff7b3c-c75a-43e9-952e-012df8a35907 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:34.304627 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3d839a31-b6c2-4049-be3b-b2c7404a73f8 tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:34.307457 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3d839a31-b6c2-4049-be3b-b2c7404a73f8 tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:34.312838 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54736) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:34.313793 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-3d839a31-b6c2-4049-be3b-b2c7404a73f8 tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] 10.222.0.24 "DELETE /v2.0/security-groups/064df39c-4d01-464c-9daa-e0fc8ea833db HTTP/1.1" status: 204 len: 168 time: 0.9694517 Nov 09 04:30:34.318182 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-649accbe-01d1-4148-95cb-21cf9203d2a7 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Calling delete_port for 9947f24d-f96c-49f9-8eb6-2be971ed9745 owned by network:router_gateway {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:30:34.324761 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:34.328813 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d839a31-b6c2-4049-be3b-b2c7404a73f8 tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=064df39c-4d01-464c-9daa-e0fc8ea833db,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:34.388048 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-685aaff9-5d4b-48d8-8112-28958798682f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Deleting port 40db2e16-239b-4240-9e19-f35a26d3685b {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:30:34.389883 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-685aaff9-5d4b-48d8-8112-28958798682f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:34.431392 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8922c1d6-34ac-4f83-9692-425ea96f1a73 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:34.498759 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-685aaff9-5d4b-48d8-8112-28958798682f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] For port 40db2e16-239b-4240-9e19-f35a26d3685b, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=40db2e16-239b-4240-9e19-f35a26d3685b,segment=NetworkSegment(c36a4d79-e250-4bb8-9048-928eee98e328),segment_id=c36a4d79-e250-4bb8-9048-928eee98e328)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:30:34.500818 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-685aaff9-5d4b-48d8-8112-28958798682f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:34.531316 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d0b2f3b2-bbf8-4e16-ab17-4e1665aece6f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Network 0a61eb3b-f9c4-4bc0-94dd-9f48ad858a9d is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:30:34.532528 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-685aaff9-5d4b-48d8-8112-28958798682f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Calling delete_port for 40db2e16-239b-4240-9e19-f35a26d3685b owned by network:dhcp {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:30:34.541952 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8922c1d6-34ac-4f83-9692-425ea96f1a73 None None] Pushing event updated for resources: {'Port': ['ID=aca0c961-8945-477f-911e-d3ac45c9d2bb,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:34.678463 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8922c1d6-34ac-4f83-9692-425ea96f1a73 None None] Network e6c58b7d-aeed-4bbf-9856-1d53b3644115 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:30:34.683050 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 40db2e16-239b-4240-9e19-f35a26d3685b, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=40db2e16-239b-4240-9e19-f35a26d3685b,segment=NetworkSegment(c36a4d79-e250-4bb8-9048-928eee98e328),segment_id=c36a4d79-e250-4bb8-9048-928eee98e328)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:30:34.700875 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-8922c1d6-34ac-4f83-9692-425ea96f1a73 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:34.732297 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8922c1d6-34ac-4f83-9692-425ea96f1a73 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:30:34.773981 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1d3ca89c-79d7-4b0c-bd82-76fa6e720d89 tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:34.830933 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-4b692a53-2fa6-4b13-8b05-0c98f8d2e25a tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Allocated IP 172.26.0.16 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/14fc2607-bdd8-4afb-b710-1fe823ed3ff1) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:30:34.839672 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-d0b2f3b2-bbf8-4e16-ab17-4e1665aece6f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 0a61eb3b-f9c4-4bc0-94dd-9f48ad858a9d) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:34.852893 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-72417fa1-15d7-4ea7-a6b9-2918a78f841b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:34.884102 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d0b2f3b2-bbf8-4e16-ab17-4e1665aece6f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:34.884691 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d0b2f3b2-bbf8-4e16-ab17-4e1665aece6f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:34.931708 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-685aaff9-5d4b-48d8-8112-28958798682f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:34.938851 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72417fa1-15d7-4ea7-a6b9-2918a78f841b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event deleted for resources: {'Subnet': ['ID=93d26cc7-2350-4f28-b358-8bc13b541762,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:34.998665 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-685aaff9-5d4b-48d8-8112-28958798682f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] No DVR routers for this DVR port 40db2e16-239b-4240-9e19-f35a26d3685b on host dv-neutron-816802-2-hyperv {{(pid=102161) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:30:35.079049 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-d0b2f3b2-bbf8-4e16-ab17-4e1665aece6f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 4.4884360 Nov 09 04:30:35.079733 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54748) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:35.110124 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9450d54e-b67d-496c-ad4b-a253eec16de5 None None] Network 0a61eb3b-f9c4-4bc0-94dd-9f48ad858a9d requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:30:35.112339 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-685aaff9-5d4b-48d8-8112-28958798682f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:35.112662 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-24a40ea7-7c1e-4393-a4ab-85089019a6d0 None None] Network db9e10ea-0b45-4893-ab26-2f1ea5e8271b requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:30:35.125118 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-ad31f73a-0341-4e86-a5b6-1f74ac009b13 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-1840174411', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:35.129092 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-685aaff9-5d4b-48d8-8112-28958798682f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event deleted for resources: {'Port': ['ID=40db2e16-239b-4240-9e19-f35a26d3685b,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:35.146289 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-685aaff9-5d4b-48d8-8112-28958798682f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f5798b15-f4fc-4342-b0d7-1c42a5da2fde']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:35.159422 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-685aaff9-5d4b-48d8-8112-28958798682f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c36a4d79-e250-4bb8-9048-928eee98e328') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:35.159714 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-685aaff9-5d4b-48d8-8112-28958798682f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c36a4d79-e250-4bb8-9048-928eee98e328') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:35.179932 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-685aaff9-5d4b-48d8-8112-28958798682f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:35.182429 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5860ba58-99b4-4392-adbf-9a13518ae76f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:35.198611 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-685aaff9-5d4b-48d8-8112-28958798682f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:35.201103 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:35.202040 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 5a469f60-d369-4f42-8796-f6357a453930 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:30:35.206299 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-685aaff9-5d4b-48d8-8112-28958798682f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Releasing vlan 336 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:30:35.206860 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-685aaff9-5d4b-48d8-8112-28958798682f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:35.210893 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:30:35.210893 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:30:35.210893 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:30:35.210893 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:30:35.210893 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:30:35.210893 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:30:35.210893 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:30:35.210893 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:30:35.210893 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:30:35.210893 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:30:35.210893 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:30:35.210893 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:30:35.210893 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:30:35.210893 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:30:35.210893 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:30:35.210893 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:30:35.210893 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:30:35.210893 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:30:35.210893 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:30:35.210893 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:30:35.210893 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:30:35.210893 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:30:35.210893 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:30:35.210893 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:30:35.210893 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:30:35.210893 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:30:35.210893 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:30:35.210893 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:30:35.210893 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:30:35.210893 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:30:35.210893 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:30:35.210893 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:30:35.245943 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-649accbe-01d1-4148-95cb-21cf9203d2a7 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:35.257180 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-72417fa1-15d7-4ea7-a6b9-2918a78f841b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:35.260553 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1d3ca89c-79d7-4b0c-bd82-76fa6e720d89 tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:35.348054 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-8922c1d6-34ac-4f83-9692-425ea96f1a73 None None] Attempting to bind port aca0c961-8945-477f-911e-d3ac45c9d2bb on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:30:35.348498 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-8922c1d6-34ac-4f83-9692-425ea96f1a73 None None] Attempting to bind port aca0c961-8945-477f-911e-d3ac45c9d2bb by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '2ddb3949-f824-4128-bd87-8019dfd3d905', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 306, 'network_id': 'e6c58b7d-aeed-4bbf-9856-1d53b3644115'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:30:35.348929 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8922c1d6-34ac-4f83-9692-425ea96f1a73 None None] Attempting to bind port aca0c961-8945-477f-911e-d3ac45c9d2bb on network e6c58b7d-aeed-4bbf-9856-1d53b3644115 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:30:35.361543 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-685aaff9-5d4b-48d8-8112-28958798682f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:35.389422 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-1d3ca89c-79d7-4b0c-bd82-76fa6e720d89 tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e60b28f2-9a15-45c5-914e-e164b880cfee']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:35.393393 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-649accbe-01d1-4148-95cb-21cf9203d2a7 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Pushing event deleted for resources: {'Port': ['ID=9947f24d-f96c-49f9-8eb6-2be971ed9745,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:35.395907 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-aeff7b3c-c75a-43e9-952e-012df8a35907 admin admin] Router 5023cfbb-afb2-4e33-bdc1-c1173218f6bf is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102162) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:30:35.399332 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-685aaff9-5d4b-48d8-8112-28958798682f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:35.408197 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-685aaff9-5d4b-48d8-8112-28958798682f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "DELETE /v2.0/networks/f5798b15-f4fc-4342-b0d7-1c42a5da2fde HTTP/1.1" status: 204 len: 168 time: 1.2928584 Nov 09 04:30:35.413781 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-685aaff9-5d4b-48d8-8112-28958798682f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event deleted for resources: {'Network': ['ID=f5798b15-f4fc-4342-b0d7-1c42a5da2fde,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:35.416866 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54754) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:35.427932 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-3dcd0138-7468-4cd0-8c6b-b67df15e665b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-964607782'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:35.434299 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-1d3ca89c-79d7-4b0c-bd82-76fa6e720d89 tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6ee646af-aaaf-4773-bba4-15abf7c53850') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:35.434299 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-1d3ca89c-79d7-4b0c-bd82-76fa6e720d89 tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6ee646af-aaaf-4773-bba4-15abf7c53850') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:35.436623 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-207edf58-be78-48c4-b8c6-54db4948318a None None] DHCP port deletion for f5798b15-f4fc-4342-b0d7-1c42a5da2fde request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:30:35.462163 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ad31f73a-0341-4e86-a5b6-1f74ac009b13 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:35.463316 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ad31f73a-0341-4e86-a5b6-1f74ac009b13 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:35.465574 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event deleted for resources: {'Port': ['ID=40db2e16-239b-4240-9e19-f35a26d3685b,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:35.468609 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-72417fa1-15d7-4ea7-a6b9-2918a78f841b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e6c58b7d-aeed-4bbf-9856-1d53b3644115']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:35.474206 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1d3ca89c-79d7-4b0c-bd82-76fa6e720d89 tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:35.507118 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3dcd0138-7468-4cd0-8c6b-b67df15e665b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Made reservation on behalf of 88f9f8da29bf4a8793b45130d483a6e6 for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:30:35.511061 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3dcd0138-7468-4cd0-8c6b-b67df15e665b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:35.511616 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-72417fa1-15d7-4ea7-a6b9-2918a78f841b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2ddb3949-f824-4128-bd87-8019dfd3d905') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:35.511922 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-72417fa1-15d7-4ea7-a6b9-2918a78f841b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2ddb3949-f824-4128-bd87-8019dfd3d905') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:35.546936 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-72417fa1-15d7-4ea7-a6b9-2918a78f841b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:35.547902 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8922c1d6-34ac-4f83-9692-425ea96f1a73 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 30, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:30:35.548959 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8922c1d6-34ac-4f83-9692-425ea96f1a73 None None] Checking segment: {'id': '2ddb3949-f824-4128-bd87-8019dfd3d905', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 306, 'network_id': 'e6c58b7d-aeed-4bbf-9856-1d53b3644115'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:30:35.549235 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1d3ca89c-79d7-4b0c-bd82-76fa6e720d89 tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:35.549506 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8922c1d6-34ac-4f83-9692-425ea96f1a73 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:35.550204 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8922c1d6-34ac-4f83-9692-425ea96f1a73 None None] Bound using segment: {'id': '2ddb3949-f824-4128-bd87-8019dfd3d905', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 306, 'network_id': 'e6c58b7d-aeed-4bbf-9856-1d53b3644115'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:30:35.551190 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-8922c1d6-34ac-4f83-9692-425ea96f1a73 None None] Bound port: aca0c961-8945-477f-911e-d3ac45c9d2bb, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2ddb3949-f824-4128-bd87-8019dfd3d905', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 306, 'network_id': 'e6c58b7d-aeed-4bbf-9856-1d53b3644115'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:30:35.551591 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8922c1d6-34ac-4f83-9692-425ea96f1a73 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:35.577391 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 5a469f60-d369-4f42-8796-f6357a453930 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:30:35.577782 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:35.809882 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-8922c1d6-34ac-4f83-9692-425ea96f1a73 None None] For port aca0c961-8945-477f-911e-d3ac45c9d2bb, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:30:35.872627 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-bb596a30-5e18-420d-ba1d-2d90f15e55ab None None] Provisioning complete for port 6bdef35f-00ac-46ea-a01f-2644260e91e1 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:30:35.872986 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-bb596a30-5e18-420d-ba1d-2d90f15e55ab None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:35.909126 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1c3af64c-8b2c-441c-8912-5981644fbd86 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-0a61eb3b-f9c4-4bc0-94dd-9f48ad858a9d', 'network_id': '0a61eb3b-f9c4-4bc0-94dd-9f48ad858a9d', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'fixed_ips': [{'subnet_id': '46e2a34a-c423-454a-a4ea-0bc78ae2ec41'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:30:35.909999 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1c3af64c-8b2c-441c-8912-5981644fbd86 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:35.984123 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-649accbe-01d1-4148-95cb-21cf9203d2a7 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-466373'] for router_gateway, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:35.995394 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1d3ca89c-79d7-4b0c-bd82-76fa6e720d89 tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] Releasing vlan 331 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:30:35.995802 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1d3ca89c-79d7-4b0c-bd82-76fa6e720d89 tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:36.003658 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:30:36.003658 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:30:36.003658 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:30:36.003658 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:30:36.003658 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:30:36.003658 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:30:36.003658 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:30:36.003658 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:30:36.003658 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:30:36.003658 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:30:36.003658 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:30:36.003658 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:30:36.003658 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:30:36.003658 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:30:36.003658 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:30:36.003658 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:30:36.003658 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:30:36.003658 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:30:36.003658 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:30:36.003658 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:30:36.003658 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:30:36.003658 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:30:36.003658 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:30:36.003658 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:30:36.003658 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:30:36.003658 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:30:36.003658 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:30:36.003658 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:30:36.003658 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:30:36.003658 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:30:36.003658 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:30:36.003658 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:30:36.071586 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:36.108545 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4b692a53-2fa6-4b13-8b05-0c98f8d2e25a tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:36.127562 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54758) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:36.133450 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-387a4125-19a9-4c3a-a26e-01a4f2cd3d5f tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-2098836817', 'description': 'tempest-secgroup-smoke-2098836817 description', 'project_id': 'fd7df27e425449dfb80d0838c8f7fb89'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:36.147431 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ad31f73a-0341-4e86-a5b6-1f74ac009b13 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:36.217020 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 5a469f60-d369-4f42-8796-f6357a453930, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=5a469f60-d369-4f42-8796-f6357a453930,segment=NetworkSegment(e211d893-ee7a-48e3-bc29-b8824167e15b),segment_id=e211d893-ee7a-48e3-bc29-b8824167e15b)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:30:36.224309 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ad31f73a-0341-4e86-a5b6-1f74ac009b13 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:36.226985 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-bb596a30-5e18-420d-ba1d-2d90f15e55ab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:36.233454 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-649accbe-01d1-4148-95cb-21cf9203d2a7 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:36.234731 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-1c3af64c-8b2c-441c-8912-5981644fbd86 None None] Allocated IP 172.21.0.2 (0a61eb3b-f9c4-4bc0-94dd-9f48ad858a9d/46e2a34a-c423-454a-a4ea-0bc78ae2ec41/9ba426d3-a467-48c0-af5a-2a69f373ca1a) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:30:36.240093 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-387a4125-19a9-4c3a-a26e-01a4f2cd3d5f tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:36.247081 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-649accbe-01d1-4148-95cb-21cf9203d2a7 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:36.259082 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-387a4125-19a9-4c3a-a26e-01a4f2cd3d5f tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:36.305649 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-bb596a30-5e18-420d-ba1d-2d90f15e55ab None None] For port 6bdef35f-00ac-46ea-a01f-2644260e91e1, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=6bdef35f-00ac-46ea-a01f-2644260e91e1,segment=NetworkSegment(de95ed3f-4273-400f-9757-f62070e21304),segment_id=de95ed3f-4273-400f-9757-f62070e21304)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:30:36.337108 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-aeff7b3c-c75a-43e9-952e-012df8a35907 admin admin] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:30:36.341443 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-73a6e13f-1b82-417c-b715-4b3378f7079d None None] Sync routers for ids ['5023cfbb-afb2-4e33-bdc1-c1173218f6bf'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:30:36.349367 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:36.356035 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-73a6e13f-1b82-417c-b715-4b3378f7079d None None] Routers {'5023cfbb-afb2-4e33-bdc1-c1173218f6bf'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:30:36.358376 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-73a6e13f-1b82-417c-b715-4b3378f7079d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:30:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['5023cfbb-afb2-4e33-bdc1-c1173218f6bf'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:36.383038 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1d3ca89c-79d7-4b0c-bd82-76fa6e720d89 tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:36.394854 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3dcd0138-7468-4cd0-8c6b-b67df15e665b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 309} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:30:36.395679 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1d3ca89c-79d7-4b0c-bd82-76fa6e720d89 tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:36.397999 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-1d3ca89c-79d7-4b0c-bd82-76fa6e720d89 tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] 10.222.0.24 "DELETE /v2.0/networks/e60b28f2-9a15-45c5-914e-e164b880cfee HTTP/1.1" status: 204 len: 168 time: 2.0754850 Nov 09 04:30:36.402314 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-8922c1d6-34ac-4f83-9692-425ea96f1a73 None None] For port aca0c961-8945-477f-911e-d3ac45c9d2bb, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=aca0c961-8945-477f-911e-d3ac45c9d2bb,segment=NetworkSegment(2ddb3949-f824-4128-bd87-8019dfd3d905),segment_id=2ddb3949-f824-4128-bd87-8019dfd3d905)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:30:36.403606 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54760) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:36.426516 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-bb596a30-5e18-420d-ba1d-2d90f15e55ab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:36.447032 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3dcd0138-7468-4cd0-8c6b-b67df15e665b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:36.450991 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-3dcd0138-7468-4cd0-8c6b-b67df15e665b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Added segment 30da2c7b-8ba0-4c22-9597-3763f0be3551 of type vlan for network dee7e689-a388-42bb-96eb-2960b07f7335 Nov 09 04:30:36.502645 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=5a469f60-d369-4f42-8796-f6357a453930,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:36.507159 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8922c1d6-34ac-4f83-9692-425ea96f1a73 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:36.547586 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3c2217a8-ea9e-4d65-8c23-88dc2841c721 tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:36.570294 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb596a30-5e18-420d-ba1d-2d90f15e55ab None None] Pushing event updated for resources: {'Port': ['ID=6bdef35f-00ac-46ea-a01f-2644260e91e1,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:36.586521 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-bb596a30-5e18-420d-ba1d-2d90f15e55ab None None] Provisioning complete for port 5a469f60-d369-4f42-8796-f6357a453930 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:30:36.587134 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-bb596a30-5e18-420d-ba1d-2d90f15e55ab None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:36.603296 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-73a6e13f-1b82-417c-b715-4b3378f7079d None None] Set router 5023cfbb-afb2-4e33-bdc1-c1173218f6bf gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:30:36.604477 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-72417fa1-15d7-4ea7-a6b9-2918a78f841b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:36.620871 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ad31f73a-0341-4e86-a5b6-1f74ac009b13 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:36.622269 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54762) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:36.623259 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-ad31f73a-0341-4e86-a5b6-1f74ac009b13 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 700 time: 1.5156531 Nov 09 04:30:36.630419 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4b692a53-2fa6-4b13-8b05-0c98f8d2e25a tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:36.643710 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3dcd0138-7468-4cd0-8c6b-b67df15e665b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:36.658528 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-aeff7b3c-c75a-43e9-952e-012df8a35907 admin admin] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:36.667507 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 6bdef35f-00ac-46ea-a01f-2644260e91e1 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:30:36.672567 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-aeff7b3c-c75a-43e9-952e-012df8a35907 admin admin] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 8.7394736 Nov 09 04:30:36.675207 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-649accbe-01d1-4148-95cb-21cf9203d2a7 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:36.678027 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-649accbe-01d1-4148-95cb-21cf9203d2a7 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 94e78643-8c7f-4500-ac2d-ed3cabe59101 {{(pid=102162) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:30:36.693538 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-649accbe-01d1-4148-95cb-21cf9203d2a7 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:36.701390 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-649accbe-01d1-4148-95cb-21cf9203d2a7 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] 10.222.0.24 "DELETE /v2.0/routers/94e78643-8c7f-4500-ac2d-ed3cabe59101 HTTP/1.1" status: 204 len: 168 time: 6.1831477 Nov 09 04:30:36.706230 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54764) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:36.706934 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54766) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:36.718682 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4b692a53-2fa6-4b13-8b05-0c98f8d2e25a tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:30:36.724535 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d3ca89c-79d7-4b0c-bd82-76fa6e720d89 tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] Pushing event deleted for resources: {'Network': ['ID=e60b28f2-9a15-45c5-914e-e164b880cfee,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:36.733787 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-55495f44-f0cf-4b53-bed5-4285c7900947 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Request body: {'router': {'name': 'tempest-RoutersAdminTest-router-421024650', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}, 'admin_state_up': False}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:36.767289 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-72417fa1-15d7-4ea7-a6b9-2918a78f841b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Releasing vlan 306 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:30:36.767858 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-72417fa1-15d7-4ea7-a6b9-2918a78f841b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:36.773031 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-4b692a53-2fa6-4b13-8b05-0c98f8d2e25a tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:36.775839 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:30:36.775839 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:30:36.775839 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:30:36.775839 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:30:36.775839 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:30:36.775839 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:30:36.775839 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:30:36.775839 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:30:36.775839 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:30:36.775839 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:30:36.775839 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:30:36.775839 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:30:36.775839 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:30:36.775839 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:30:36.775839 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:30:36.775839 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:30:36.775839 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:30:36.775839 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:30:36.775839 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:30:36.775839 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:30:36.775839 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:30:36.775839 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:30:36.775839 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:30:36.775839 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:30:36.775839 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:30:36.775839 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:30:36.775839 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:30:36.775839 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:30:36.775839 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:30:36.775839 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:30:36.775839 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:30:36.775839 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:30:36.778207 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4b692a53-2fa6-4b13-8b05-0c98f8d2e25a tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:30:36.789547 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1c3af64c-8b2c-441c-8912-5981644fbd86 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:36.819740 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8922c1d6-34ac-4f83-9692-425ea96f1a73 None None] Pushing event updated for resources: {'Port': ['ID=aca0c961-8945-477f-911e-d3ac45c9d2bb,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:36.825816 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.db.resource_extend [None req-3dcd0138-7468-4cd0-8c6b-b67df15e665b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] It took 0.17 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 09 04:30:36.860799 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d119d264-cdeb-4de2-8800-d379f252b28d None None] Network e6c58b7d-aeed-4bbf-9856-1d53b3644115 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:30:36.890529 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-387a4125-19a9-4c3a-a26e-01a4f2cd3d5f tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:36.896788 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1c3af64c-8b2c-441c-8912-5981644fbd86 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:36.996008 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-387a4125-19a9-4c3a-a26e-01a4f2cd3d5f tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:37.006206 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 6bdef35f-00ac-46ea-a01f-2644260e91e1 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:30:37.006206 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:37.024308 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-73a6e13f-1b82-417c-b715-4b3378f7079d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5023cfbb-afb2-4e33-bdc1-c1173218f6bf', 'name': 'tempest-ServerActionsTestJSON-1211051012-router', 'tenant_id': '6015befde7f546d881cb247ae5bc81ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.95'}], 'enable_snat': True}, 'gw_port_id': 'a4e20770-3342-4c9b-a9bf-d4dab52b7d8d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:30:28Z', 'updated_at': '2021-11-09T04:30:31Z', 'revision_number': 3, 'project_id': '6015befde7f546d881cb247ae5bc81ae', 'gw_port': {'id': 'a4e20770-3342-4c9b-a9bf-d4dab52b7d8d', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:03:2b:36', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5023cfbb-afb2-4e33-bdc1-c1173218f6bf', 'device_owner': 'network:router_gateway', 'standard_attr_id': 499, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:30:29Z', 'updated_at': '2021-11-09T04:30:29Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:37.038842 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3dcd0138-7468-4cd0-8c6b-b67df15e665b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:37.046552 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3dcd0138-7468-4cd0-8c6b-b67df15e665b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:37.047541 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3dcd0138-7468-4cd0-8c6b-b67df15e665b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:37.081356 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-73a6e13f-1b82-417c-b715-4b3378f7079d None None] Checking router: 5023cfbb-afb2-4e33-bdc1-c1173218f6bf for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:30:37.082008 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-73a6e13f-1b82-417c-b715-4b3378f7079d None None] Updating router 5023cfbb-afb2-4e33-bdc1-c1173218f6bf port a4e20770-3342-4c9b-a9bf-d4dab52b7d8d binding host dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 04:30:37.084443 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1c3af64c-8b2c-441c-8912-5981644fbd86 None None] Network 0a61eb3b-f9c4-4bc0-94dd-9f48ad858a9d is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:30:37.097525 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-387a4125-19a9-4c3a-a26e-01a4f2cd3d5f tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Pushing event updated for resources: {'SecurityGroup': ['ID=0c33fb12-86ce-4d95-80c8-24801f8f332f,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:37.108525 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-1c3af64c-8b2c-441c-8912-5981644fbd86 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:37.129067 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c3af64c-8b2c-441c-8912-5981644fbd86 None None] Pushing event updated for resources: {'Port': ['ID=9ba426d3-a467-48c0-af5a-2a69f373ca1a,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:37.132146 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1c3af64c-8b2c-441c-8912-5981644fbd86 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:30:37.162082 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b692a53-2fa6-4b13-8b05-0c98f8d2e25a tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Pushing event updated for resources: {'Port': ['ID=14fc2607-bdd8-4afb-b710-1fe823ed3ff1,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:37.187283 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-73a6e13f-1b82-417c-b715-4b3378f7079d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:37.244358 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3dcd0138-7468-4cd0-8c6b-b67df15e665b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event updated for resources: {'Network': ['ID=dee7e689-a388-42bb-96eb-2960b07f7335,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:37.276813 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network dee7e689-a388-42bb-96eb-2960b07f7335 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:30:37.285196 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3c2217a8-ea9e-4d65-8c23-88dc2841c721 tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:37.292135 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-55495f44-f0cf-4b53-bed5-4285c7900947 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:37.293186 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-55495f44-f0cf-4b53-bed5-4285c7900947 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:37.344683 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-3dcd0138-7468-4cd0-8c6b-b67df15e665b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 767 time: 1.9237089 Nov 09 04:30:37.349531 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54768) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:37.355391 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-e0933806-1327-45ef-a970-90c8a8e79cdc tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Request body: {'subnet': {'network_id': 'dee7e689-a388-42bb-96eb-2960b07f7335', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:37.383520 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-55495f44-f0cf-4b53-bed5-4285c7900947 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:37.383520 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.db.api [None req-72417fa1-15d7-4ea7-a6b9-2918a78f841b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Nov 09 04:30:37.383520 dv-neutron-816802-2-hyperv neutron-server[102162]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Nov 09 04:30:37.383520 dv-neutron-816802-2-hyperv neutron-server[102162]: [parameters: {'id': 'e6c58b7d-aeed-4bbf-9856-1d53b3644115'}] Nov 09 04:30:37.383520 dv-neutron-816802-2-hyperv neutron-server[102162]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=102162) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:30:37.383520 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG oslo_db.api [None req-72417fa1-15d7-4ea7-a6b9-2918a78f841b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:30:37.419158 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a3d534aa-ef9f-48d6-a311-23e6e81145ef tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:37.468091 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-3c2217a8-ea9e-4d65-8c23-88dc2841c721 tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f28ec1eb-1ed1-4d2e-942d-5f48ee8d838f']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:37.482470 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-3c2217a8-ea9e-4d65-8c23-88dc2841c721 tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '7438a1af-d1c7-4767-8b60-d5d6212ad11b') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:37.482827 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-3c2217a8-ea9e-4d65-8c23-88dc2841c721 tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '7438a1af-d1c7-4767-8b60-d5d6212ad11b') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:37.524115 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-387a4125-19a9-4c3a-a26e-01a4f2cd3d5f tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:37.549483 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3c2217a8-ea9e-4d65-8c23-88dc2841c721 tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:37.630228 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-387a4125-19a9-4c3a-a26e-01a4f2cd3d5f tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:37.639890 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-73a6e13f-1b82-417c-b715-4b3378f7079d None None] Publish callbacks [] for port, precommit_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:37.643649 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-1c3af64c-8b2c-441c-8912-5981644fbd86 None None] Attempting to bind port 9ba426d3-a467-48c0-af5a-2a69f373ca1a on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:30:37.644112 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-1c3af64c-8b2c-441c-8912-5981644fbd86 None None] Attempting to bind port 9ba426d3-a467-48c0-af5a-2a69f373ca1a by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '610156cc-bb06-4490-92ef-b436312a6831', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 316, 'network_id': '0a61eb3b-f9c4-4bc0-94dd-9f48ad858a9d'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:30:37.644754 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c3af64c-8b2c-441c-8912-5981644fbd86 None None] Attempting to bind port 9ba426d3-a467-48c0-af5a-2a69f373ca1a on network 0a61eb3b-f9c4-4bc0-94dd-9f48ad858a9d {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:30:37.665444 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e0933806-1327-45ef-a970-90c8a8e79cdc tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Made reservation on behalf of 88f9f8da29bf4a8793b45130d483a6e6 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:30:37.678697 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-04b30e9d-ce44-4733-af7b-52ed4419d234 None None] Provisioning complete for port 6bdef35f-00ac-46ea-a01f-2644260e91e1 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:30:37.679069 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-04b30e9d-ce44-4733-af7b-52ed4419d234 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:37.679178 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e0933806-1327-45ef-a970-90c8a8e79cdc tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:37.684767 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c3af64c-8b2c-441c-8912-5981644fbd86 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 30, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:30:37.684767 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c3af64c-8b2c-441c-8912-5981644fbd86 None None] Checking segment: {'id': '610156cc-bb06-4490-92ef-b436312a6831', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 316, 'network_id': '0a61eb3b-f9c4-4bc0-94dd-9f48ad858a9d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:30:37.684767 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1c3af64c-8b2c-441c-8912-5981644fbd86 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:37.687057 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c3af64c-8b2c-441c-8912-5981644fbd86 None None] Bound using segment: {'id': '610156cc-bb06-4490-92ef-b436312a6831', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 316, 'network_id': '0a61eb3b-f9c4-4bc0-94dd-9f48ad858a9d'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:30:37.687057 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-1c3af64c-8b2c-441c-8912-5981644fbd86 None None] Bound port: 9ba426d3-a467-48c0-af5a-2a69f373ca1a, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '610156cc-bb06-4490-92ef-b436312a6831', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 316, 'network_id': '0a61eb3b-f9c4-4bc0-94dd-9f48ad858a9d'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:30:37.687057 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1c3af64c-8b2c-441c-8912-5981644fbd86 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:37.747796 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-73a6e13f-1b82-417c-b715-4b3378f7079d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:37.755825 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3c2217a8-ea9e-4d65-8c23-88dc2841c721 tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:37.789939 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3c2217a8-ea9e-4d65-8c23-88dc2841c721 tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] Releasing vlan 339 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:30:37.790391 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3c2217a8-ea9e-4d65-8c23-88dc2841c721 tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:37.792956 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:30:37.792956 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:30:37.792956 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:30:37.792956 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:30:37.792956 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:30:37.792956 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:30:37.792956 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:30:37.792956 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:30:37.792956 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:30:37.792956 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:30:37.792956 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:30:37.792956 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:30:37.792956 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:30:37.792956 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:30:37.792956 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:30:37.792956 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:30:37.792956 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:30:37.792956 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:30:37.792956 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:30:37.792956 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:30:37.792956 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:30:37.792956 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:30:37.792956 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:30:37.792956 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:30:37.792956 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:30:37.792956 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:30:37.792956 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:30:37.792956 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:30:37.792956 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:30:37.792956 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:30:37.792956 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:30:37.792956 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:30:37.822054 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 40db2e16-239b-4240-9e19-f35a26d3685b no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:30:37.846500 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-73a6e13f-1b82-417c-b715-4b3378f7079d None None] Attempting to bind port a4e20770-3342-4c9b-a9bf-d4dab52b7d8d on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:30:37.846866 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-73a6e13f-1b82-417c-b715-4b3378f7079d None None] Attempting to bind port a4e20770-3342-4c9b-a9bf-d4dab52b7d8d by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:30:37.847221 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-73a6e13f-1b82-417c-b715-4b3378f7079d None None] Attempting to bind port a4e20770-3342-4c9b-a9bf-d4dab52b7d8d on network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:30:37.866049 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-73a6e13f-1b82-417c-b715-4b3378f7079d None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 30, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:30:37.866500 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-73a6e13f-1b82-417c-b715-4b3378f7079d None None] Checking segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102164) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:30:37.866856 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-73a6e13f-1b82-417c-b715-4b3378f7079d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:37.867242 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-73a6e13f-1b82-417c-b715-4b3378f7079d None None] Bound using segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:30:37.867700 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-73a6e13f-1b82-417c-b715-4b3378f7079d None None] Bound port: a4e20770-3342-4c9b-a9bf-d4dab52b7d8d, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:30:37.868069 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-73a6e13f-1b82-417c-b715-4b3378f7079d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:37.870352 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b37d7862-f4cb-4651-8589-27363402c62b None None] Pushing event updated for resources: {'Port': ['ID=a4e20770-3342-4c9b-a9bf-d4dab52b7d8d,revision_number=2']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:37.873561 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 40db2e16-239b-4240-9e19-f35a26d3685b {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:30:37.875753 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 40db2e16-239b-4240-9e19-f35a26d3685b not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:30:37.907220 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b37d7862-f4cb-4651-8589-27363402c62b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:30:37.907639 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b37d7862-f4cb-4651-8589-27363402c62b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:30:37.908479 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b37d7862-f4cb-4651-8589-27363402c62b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:30:37.908809 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b37d7862-f4cb-4651-8589-27363402c62b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:30:37.909132 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b37d7862-f4cb-4651-8589-27363402c62b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:30:37.909838 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b37d7862-f4cb-4651-8589-27363402c62b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:30:37.910178 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b37d7862-f4cb-4651-8589-27363402c62b None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:30:37.910679 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b37d7862-f4cb-4651-8589-27363402c62b None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:30:37.911055 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-55495f44-f0cf-4b53-bed5-4285c7900947 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:37.911250 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b37d7862-f4cb-4651-8589-27363402c62b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:30:37.911975 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b37d7862-f4cb-4651-8589-27363402c62b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:30:37.911975 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b37d7862-f4cb-4651-8589-27363402c62b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:30:37.912185 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b37d7862-f4cb-4651-8589-27363402c62b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:30:37.929772 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-1c3af64c-8b2c-441c-8912-5981644fbd86 None None] For port 9ba426d3-a467-48c0-af5a-2a69f373ca1a, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:30:37.945535 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-72417fa1-15d7-4ea7-a6b9-2918a78f841b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:37.956975 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-73a6e13f-1b82-417c-b715-4b3378f7079d None None] For port a4e20770-3342-4c9b-a9bf-d4dab52b7d8d, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102164) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:30:37.964171 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-73a6e13f-1b82-417c-b715-4b3378f7079d None None] For port a4e20770-3342-4c9b-a9bf-d4dab52b7d8d, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=a4e20770-3342-4c9b-a9bf-d4dab52b7d8d,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102164) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:30:37.982100 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-387a4125-19a9-4c3a-a26e-01a4f2cd3d5f tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:37.987349 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-387a4125-19a9-4c3a-a26e-01a4f2cd3d5f tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 1.8555963 Nov 09 04:30:37.991568 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54770) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:38.000235 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-04b30e9d-ce44-4733-af7b-52ed4419d234 None None] Provisioning complete for port 5a469f60-d369-4f42-8796-f6357a453930 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:30:38.000606 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-04b30e9d-ce44-4733-af7b-52ed4419d234 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:38.000926 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-72444197-6bf9-46a2-8149-f0dc0f43cc05 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Request body: {'security_group_rule': {'security_group_id': '4ff68177-77d2-4250-b11c-4d5b55fd3619', 'project_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:38.013021 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-387a4125-19a9-4c3a-a26e-01a4f2cd3d5f tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Pushing event updated for resources: {'SecurityGroup': ['ID=4ff68177-77d2-4250-b11c-4d5b55fd3619,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:38.023252 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-a3d534aa-ef9f-48d6-a311-23e6e81145ef tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Allocated IP 172.20.0.1 (db9e10ea-0b45-4893-ab26-2f1ea5e8271b/91be2814-c9e6-41c8-8b39-591a057bbda9/0e09fa29-fdeb-4ced-98cd-cb627627d82c) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:30:38.041052 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-73a6e13f-1b82-417c-b715-4b3378f7079d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:38.117437 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b37d7862-f4cb-4651-8589-27363402c62b None None] Pushing event updated for resources: {'Port': ['ID=a4e20770-3342-4c9b-a9bf-d4dab52b7d8d,revision_number=3']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:38.157457 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3c2217a8-ea9e-4d65-8c23-88dc2841c721 tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:38.169894 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-73a6e13f-1b82-417c-b715-4b3378f7079d None None] Routers {'5023cfbb-afb2-4e33-bdc1-c1173218f6bf'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:30:38.170563 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-73a6e13f-1b82-417c-b715-4b3378f7079d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:30:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['5023cfbb-afb2-4e33-bdc1-c1173218f6bf'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:38.185087 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-1c3af64c-8b2c-441c-8912-5981644fbd86 None None] For port 9ba426d3-a467-48c0-af5a-2a69f373ca1a, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=9ba426d3-a467-48c0-af5a-2a69f373ca1a,segment=NetworkSegment(610156cc-bb06-4490-92ef-b436312a6831),segment_id=610156cc-bb06-4490-92ef-b436312a6831)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:30:38.211780 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3c2217a8-ea9e-4d65-8c23-88dc2841c721 tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:38.219577 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-3c2217a8-ea9e-4d65-8c23-88dc2841c721 tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] 10.222.0.24 "DELETE /v2.0/networks/f28ec1eb-1ed1-4d2e-942d-5f48ee8d838f HTTP/1.1" status: 204 len: 168 time: 1.8099658 Nov 09 04:30:38.240363 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1c3af64c-8b2c-441c-8912-5981644fbd86 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:38.317746 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c2217a8-ea9e-4d65-8c23-88dc2841c721 tempest-QuotasNegativeTest-173560773 tempest-QuotasNegativeTest-173560773-project-admin] Pushing event deleted for resources: {'Network': ['ID=f28ec1eb-1ed1-4d2e-942d-5f48ee8d838f,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:38.321699 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4b692a53-2fa6-4b13-8b05-0c98f8d2e25a tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks [] for router_gateway, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:38.377945 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-72444197-6bf9-46a2-8149-f0dc0f43cc05 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:38.391813 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c3af64c-8b2c-441c-8912-5981644fbd86 None None] Pushing event updated for resources: {'Port': ['ID=9ba426d3-a467-48c0-af5a-2a69f373ca1a,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:38.402970 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-73a6e13f-1b82-417c-b715-4b3378f7079d None None] Set router 5023cfbb-afb2-4e33-bdc1-c1173218f6bf gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:30:38.527466 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 6bdef35f-00ac-46ea-a01f-2644260e91e1 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:30:38.612700 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-72444197-6bf9-46a2-8149-f0dc0f43cc05 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:38.638934 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a3d534aa-ef9f-48d6-a311-23e6e81145ef tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:38.647184 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-72417fa1-15d7-4ea7-a6b9-2918a78f841b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Deleting port aca0c961-8945-477f-911e-d3ac45c9d2bb {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:30:38.647415 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-72417fa1-15d7-4ea7-a6b9-2918a78f841b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:38.651412 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 6bdef35f-00ac-46ea-a01f-2644260e91e1 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:30:38.651913 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:38.712791 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-72444197-6bf9-46a2-8149-f0dc0f43cc05 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:38.740728 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e0933806-1327-45ef-a970-90c8a8e79cdc tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:38.759082 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72444197-6bf9-46a2-8149-f0dc0f43cc05 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3a00cb11-e126-45c2-b511-6c42673ed3d0,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:38.802251 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-73a6e13f-1b82-417c-b715-4b3378f7079d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5023cfbb-afb2-4e33-bdc1-c1173218f6bf', 'name': 'tempest-ServerActionsTestJSON-1211051012-router', 'tenant_id': '6015befde7f546d881cb247ae5bc81ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.95'}], 'enable_snat': True}, 'gw_port_id': 'a4e20770-3342-4c9b-a9bf-d4dab52b7d8d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:30:28Z', 'updated_at': '2021-11-09T04:30:31Z', 'revision_number': 3, 'project_id': '6015befde7f546d881cb247ae5bc81ae', 'gw_port': {'id': 'a4e20770-3342-4c9b-a9bf-d4dab52b7d8d', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:03:2b:36', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5023cfbb-afb2-4e33-bdc1-c1173218f6bf', 'device_owner': 'network:router_gateway', 'standard_attr_id': 499, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:30:29Z', 'updated_at': '2021-11-09T04:30:37Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:38.844036 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 5a469f60-d369-4f42-8796-f6357a453930 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:30:38.871552 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-72444197-6bf9-46a2-8149-f0dc0f43cc05 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:38.873635 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-73a6e13f-1b82-417c-b715-4b3378f7079d None None] The sync data for ids ['5023cfbb-afb2-4e33-bdc1-c1173218f6bf'] in dv-neutron-816802-2-hyperv is: [{'id': '5023cfbb-afb2-4e33-bdc1-c1173218f6bf', 'name': 'tempest-ServerActionsTestJSON-1211051012-router', 'tenant_id': '6015befde7f546d881cb247ae5bc81ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.95'}], 'enable_snat': True}, 'gw_port_id': 'a4e20770-3342-4c9b-a9bf-d4dab52b7d8d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:30:28Z', 'updated_at': '2021-11-09T04:30:31Z', 'revision_number': 3, 'project_id': '6015befde7f546d881cb247ae5bc81ae', 'gw_port': {'id': 'a4e20770-3342-4c9b-a9bf-d4dab52b7d8d', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:03:2b:36', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5023cfbb-afb2-4e33-bdc1-c1173218f6bf', 'device_owner': 'network:router_gateway', 'standard_attr_id': 499, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:30:29Z', 'updated_at': '2021-11-09T04:30:37Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:30:38.883837 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-72444197-6bf9-46a2-8149-f0dc0f43cc05 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.8881454 Nov 09 04:30:38.889084 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54778) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:38.898441 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a3d534aa-ef9f-48d6-a311-23e6e81145ef tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:38.908922 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-da31549f-024c-49ad-b48a-5cf97388eb9d tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Request body: {'security_group_rule': {'security_group_id': '4ff68177-77d2-4250-b11c-4d5b55fd3619', 'project_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:38.976101 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 5a469f60-d369-4f42-8796-f6357a453930 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:30:38.976285 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:39.009817 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3d534aa-ef9f-48d6-a311-23e6e81145ef tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event updated for resources: {'Port': ['ID=0e09fa29-fdeb-4ced-98cd-cb627627d82c,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:39.041077 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-72417fa1-15d7-4ea7-a6b9-2918a78f841b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] For port aca0c961-8945-477f-911e-d3ac45c9d2bb, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=aca0c961-8945-477f-911e-d3ac45c9d2bb,segment=NetworkSegment(2ddb3949-f824-4128-bd87-8019dfd3d905),segment_id=2ddb3949-f824-4128-bd87-8019dfd3d905)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:30:39.041450 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-72417fa1-15d7-4ea7-a6b9-2918a78f841b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:39.054802 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e0933806-1327-45ef-a970-90c8a8e79cdc tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Checking segment: {'id': '30da2c7b-8ba0-4c22-9597-3763f0be3551', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 309, 'network_id': 'dee7e689-a388-42bb-96eb-2960b07f7335'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:30:39.055170 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e0933806-1327-45ef-a970-90c8a8e79cdc tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Network hostable DHCP agents. Network: dee7e689-a388-42bb-96eb-2960b07f7335, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:30:39.065848 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0933806-1327-45ef-a970-90c8a8e79cdc tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event updated for resources: {'Subnet': ['ID=65e6912e-4232-4d7d-9de9-d0574b22fe1f,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:39.072203 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a3d534aa-ef9f-48d6-a311-23e6e81145ef tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Network db9e10ea-0b45-4893-ab26-2f1ea5e8271b is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:30:39.077180 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-a3d534aa-ef9f-48d6-a311-23e6e81145ef tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:39.081828 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a3d534aa-ef9f-48d6-a311-23e6e81145ef tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:30:39.153351 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-da31549f-024c-49ad-b48a-5cf97388eb9d tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:39.178549 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e0933806-1327-45ef-a970-90c8a8e79cdc tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Network dee7e689-a388-42bb-96eb-2960b07f7335 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:30:39.180726 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a3d534aa-ef9f-48d6-a311-23e6e81145ef tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:39.219337 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 9947f24d-f96c-49f9-8eb6-2be971ed9745 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:30:39.244097 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 9947f24d-f96c-49f9-8eb6-2be971ed9745 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:30:39.244548 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 9947f24d-f96c-49f9-8eb6-2be971ed9745 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:30:39.303893 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cea938d8-0fc9-4e3b-a73a-f4cd38fd29d2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:39.356917 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-72417fa1-15d7-4ea7-a6b9-2918a78f841b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Calling delete_port for aca0c961-8945-477f-911e-d3ac45c9d2bb owned by network:dhcp {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:30:39.517105 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-93b98e7c-2c74-4ac5-9cca-96715835c993 None None] Provisioning complete for port 0e09fa29-fdeb-4ced-98cd-cb627627d82c triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:30:39.517105 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-93b98e7c-2c74-4ac5-9cca-96715835c993 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:39.632855 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-93b98e7c-2c74-4ac5-9cca-96715835c993 None None] Port 0e09fa29-fdeb-4ced-98cd-cb627627d82c cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:30:39.760090 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-e0933806-1327-45ef-a970-90c8a8e79cdc tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, dee7e689-a388-42bb-96eb-2960b07f7335) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:39.769067 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e97d2802-c65f-4c84-8b25-0422f6e4752e None None] Network dee7e689-a388-42bb-96eb-2960b07f7335 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:30:39.774574 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54782) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:39.792229 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e0933806-1327-45ef-a970-90c8a8e79cdc tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:39.792820 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e0933806-1327-45ef-a970-90c8a8e79cdc tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:39.807675 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-da31549f-024c-49ad-b48a-5cf97388eb9d tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:39.878618 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-da31549f-024c-49ad-b48a-5cf97388eb9d tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:39.937269 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-e0933806-1327-45ef-a970-90c8a8e79cdc tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.5863793 Nov 09 04:30:39.947503 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54786) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:39.991844 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-504f36bb-43a7-4d6a-b07f-bf4bae28003f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Request body: {'port': {'network_id': 'dee7e689-a388-42bb-96eb-2960b07f7335', 'security_groups': [], 'name': 'tempest-PortsTestJSON-790858822'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:39.996537 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da31549f-024c-49ad-b48a-5cf97388eb9d tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1c13da8f-685f-4a34-96bd-675d2604e0bb,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:40.019470 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a3d534aa-ef9f-48d6-a311-23e6e81145ef tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:40.092368 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-da31549f-024c-49ad-b48a-5cf97388eb9d tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:40.096247 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-da31549f-024c-49ad-b48a-5cf97388eb9d tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 1.1969256 Nov 09 04:30:40.105316 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54788) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:40.120605 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-21e10267-3462-4893-8ea2-787f54015838 None None] Network 0a61eb3b-f9c4-4bc0-94dd-9f48ad858a9d requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:30:40.150215 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1dadd34e-b736-4012-add1-1168b728145f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-dee7e689-a388-42bb-96eb-2960b07f7335', 'network_id': 'dee7e689-a388-42bb-96eb-2960b07f7335', 'tenant_id': '88f9f8da29bf4a8793b45130d483a6e6', 'fixed_ips': [{'subnet_id': '65e6912e-4232-4d7d-9de9-d0574b22fe1f'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:30:40.151497 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1dadd34e-b736-4012-add1-1168b728145f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:40.180058 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-66f747b1-d4c3-472d-8d8a-7cdab7062ee7 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Request body: {'security_group_rule': {'security_group_id': '4ff68177-77d2-4250-b11c-4d5b55fd3619', 'project_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:40.213200 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-55495f44-f0cf-4b53-bed5-4285c7900947 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks [] for router_gateway, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:40.239381 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-ebc6e552-0c1c-439c-bfa2-3d768c77d1bb None None] Provisioning complete for port 9ba426d3-a467-48c0-af5a-2a69f373ca1a triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:30:40.240617 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ebc6e552-0c1c-439c-bfa2-3d768c77d1bb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:40.255720 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4b692a53-2fa6-4b13-8b05-0c98f8d2e25a tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:40.277377 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-55495f44-f0cf-4b53-bed5-4285c7900947 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:40.302047 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dc3dfe4a-ef69-4bf5-9fdd-69f8f8b931ed admin admin] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:40.357267 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-66f747b1-d4c3-472d-8d8a-7cdab7062ee7 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:40.585432 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ebc6e552-0c1c-439c-bfa2-3d768c77d1bb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:40.613589 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-66f747b1-d4c3-472d-8d8a-7cdab7062ee7 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:40.621892 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-504f36bb-43a7-4d6a-b07f-bf4bae28003f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Made reservation on behalf of 88f9f8da29bf4a8793b45130d483a6e6 for: {'port': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:30:40.626862 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-504f36bb-43a7-4d6a-b07f-bf4bae28003f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:40.627041 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 9ba426d3-a467-48c0-af5a-2a69f373ca1a up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:30:40.709126 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [None req-504f36bb-43a7-4d6a-b07f-bf4bae28003f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] device_id is not set on port 153089ec-acc0-413b-ae5f-f0f91ab5ceca yet. {{(pid=102161) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:30:40.716617 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dc3dfe4a-ef69-4bf5-9fdd-69f8f8b931ed admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:40.718766 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-1dadd34e-b736-4012-add1-1168b728145f None None] Allocated IP 172.20.0.2 (dee7e689-a388-42bb-96eb-2960b07f7335/65e6912e-4232-4d7d-9de9-d0574b22fe1f/f77ff47a-4d0e-4c2f-84e5-d451dd4abe75) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:30:40.727785 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-66f747b1-d4c3-472d-8d8a-7cdab7062ee7 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:40.728604 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-ebc6e552-0c1c-439c-bfa2-3d768c77d1bb None None] For port 9ba426d3-a467-48c0-af5a-2a69f373ca1a, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=9ba426d3-a467-48c0-af5a-2a69f373ca1a,segment=NetworkSegment(610156cc-bb06-4490-92ef-b436312a6831),segment_id=610156cc-bb06-4490-92ef-b436312a6831)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:30:40.766061 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 9ba426d3-a467-48c0-af5a-2a69f373ca1a triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:30:40.768102 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:40.779541 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-72417fa1-15d7-4ea7-a6b9-2918a78f841b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:40.814670 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ebc6e552-0c1c-439c-bfa2-3d768c77d1bb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:40.821421 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dc3dfe4a-ef69-4bf5-9fdd-69f8f8b931ed admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:40.833649 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-cea938d8-0fc9-4e3b-a73a-f4cd38fd29d2 admin admin] Allocated IP 172.20.0.1 (a270b61c-1f4f-4d97-be79-4a24c65fddc2/b2956e71-9b0f-4060-922c-e54ce6cff80a/e025929c-44cc-4832-b4a4-0216288df212) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:30:40.838189 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66f747b1-d4c3-472d-8d8a-7cdab7062ee7 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c227442d-14ff-4e12-bc5e-7e88b1d243c4,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:40.842991 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72417fa1-15d7-4ea7-a6b9-2918a78f841b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event deleted for resources: {'Port': ['ID=aca0c961-8945-477f-911e-d3ac45c9d2bb,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:40.848111 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-72417fa1-15d7-4ea7-a6b9-2918a78f841b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] No DVR routers for this DVR port aca0c961-8945-477f-911e-d3ac45c9d2bb on host dv-neutron-816802-2-hyperv {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:30:40.894064 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-55495f44-f0cf-4b53-bed5-4285c7900947 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Allocated IP 172.26.0.245 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/926c0f7a-a3c9-4cba-bc73-92c3e33904c6) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:30:40.936433 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a3d534aa-ef9f-48d6-a311-23e6e81145ef tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:40.970740 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-66f747b1-d4c3-472d-8d8a-7cdab7062ee7 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:40.977487 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-66f747b1-d4c3-472d-8d8a-7cdab7062ee7 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.8049240 Nov 09 04:30:40.979640 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54790) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:40.988588 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc3dfe4a-ef69-4bf5-9fdd-69f8f8b931ed admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=613fd167-57fe-4380-8d4a-cd6623a138c2,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:41.003575 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-6ccfb015-d107-4b1f-b31e-8b159c14587e tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Request body: {'security_group_rule': {'security_group_id': '4ff68177-77d2-4250-b11c-4d5b55fd3619', 'project_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:41.010962 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-72417fa1-15d7-4ea7-a6b9-2918a78f841b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:41.031530 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54792) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:41.031998 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-dc3dfe4a-ef69-4bf5-9fdd-69f8f8b931ed admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=bf4024c27f2443e29c122a08cd02afdc&name=default HTTP/1.1" status: 200 len: 2996 time: 1.2520645 Nov 09 04:30:41.035917 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a3d534aa-ef9f-48d6-a311-23e6e81145ef tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:41.070217 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebc6e552-0c1c-439c-bfa2-3d768c77d1bb None None] Pushing event updated for resources: {'Port': ['ID=9ba426d3-a467-48c0-af5a-2a69f373ca1a,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:41.154046 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-72417fa1-15d7-4ea7-a6b9-2918a78f841b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e6c58b7d-aeed-4bbf-9856-1d53b3644115']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:41.193732 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-72417fa1-15d7-4ea7-a6b9-2918a78f841b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2ddb3949-f824-4128-bd87-8019dfd3d905') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:41.194034 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-72417fa1-15d7-4ea7-a6b9-2918a78f841b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2ddb3949-f824-4128-bd87-8019dfd3d905') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:41.227263 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-72417fa1-15d7-4ea7-a6b9-2918a78f841b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:41.242655 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device a4e20770-3342-4c9b-a9bf-d4dab52b7d8d up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:30:41.269250 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-72417fa1-15d7-4ea7-a6b9-2918a78f841b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:41.279870 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4b692a53-2fa6-4b13-8b05-0c98f8d2e25a tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Router 261d799f-49ff-439f-8e9c-bb4bf5bd54f1 is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102162) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:30:41.281062 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3d534aa-ef9f-48d6-a311-23e6e81145ef tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event updated for resources: {'Port': ['ID=0e09fa29-fdeb-4ced-98cd-cb627627d82c,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:41.284531 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a3d534aa-ef9f-48d6-a311-23e6e81145ef tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:41.403238 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6ccfb015-d107-4b1f-b31e-8b159c14587e tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:41.403367 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-72417fa1-15d7-4ea7-a6b9-2918a78f841b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Releasing vlan 306 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:30:41.403367 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-72417fa1-15d7-4ea7-a6b9-2918a78f841b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:41.403367 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:30:41.403367 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:30:41.403367 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:30:41.403367 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:30:41.403367 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:30:41.403367 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:30:41.403367 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:30:41.403367 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:30:41.403367 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:30:41.403367 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:30:41.403367 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:30:41.403367 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:30:41.403367 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:30:41.403367 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:30:41.403367 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:30:41.403367 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:30:41.403367 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:30:41.403367 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:30:41.403367 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:30:41.403367 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:30:41.403367 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:30:41.403367 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:30:41.403367 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:30:41.403367 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:30:41.403367 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:30:41.403367 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:30:41.403367 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:30:41.403367 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:30:41.403367 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:30:41.403367 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:30:41.403367 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:30:41.403367 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:30:41.405289 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-8832c656-1dec-496c-86f8-175e2cc04a61 None None] Provisioning complete for port 9ba426d3-a467-48c0-af5a-2a69f373ca1a triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:30:41.405289 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8832c656-1dec-496c-86f8-175e2cc04a61 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:41.405532 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cea938d8-0fc9-4e3b-a73a-f4cd38fd29d2 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:41.405532 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-06c3f68a-bb9e-43dd-ad37-ab6ba194bbd0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:41.410493 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-55495f44-f0cf-4b53-bed5-4285c7900947 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:41.432613 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1dadd34e-b736-4012-add1-1168b728145f None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:41.463477 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4fc0e111-32d8-4214-b403-229ac94f7319 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:41.465396 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port a4e20770-3342-4c9b-a9bf-d4dab52b7d8d triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:30:41.465757 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:41.497276 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6ccfb015-d107-4b1f-b31e-8b159c14587e tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:41.510529 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-06c3f68a-bb9e-43dd-ad37-ab6ba194bbd0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:41.513855 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a3d534aa-ef9f-48d6-a311-23e6e81145ef tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Network db9e10ea-0b45-4893-ab26-2f1ea5e8271b is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:30:41.518021 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-a3d534aa-ef9f-48d6-a311-23e6e81145ef tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:41.535142 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1dadd34e-b736-4012-add1-1168b728145f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:41.597065 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6ccfb015-d107-4b1f-b31e-8b159c14587e tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:41.641137 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-72417fa1-15d7-4ea7-a6b9-2918a78f841b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:41.644700 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1dadd34e-b736-4012-add1-1168b728145f None None] Network dee7e689-a388-42bb-96eb-2960b07f7335 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:30:41.647718 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-72417fa1-15d7-4ea7-a6b9-2918a78f841b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:41.656561 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-1dadd34e-b736-4012-add1-1168b728145f None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:41.660079 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-72417fa1-15d7-4ea7-a6b9-2918a78f841b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "DELETE /v2.0/networks/e6c58b7d-aeed-4bbf-9856-1d53b3644115 HTTP/1.1" status: 204 len: 168 time: 9.3813152 Nov 09 04:30:41.660079 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54794) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:41.662438 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1dadd34e-b736-4012-add1-1168b728145f None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:30:41.674702 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-510773af-c109-4faf-b9b0-01d88bd855ca tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-1992239294'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:41.705440 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ccfb015-d107-4b1f-b31e-8b159c14587e tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=124eb439-665f-4453-8697-25466e721c3b,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:41.730823 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72417fa1-15d7-4ea7-a6b9-2918a78f841b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event deleted for resources: {'Network': ['ID=e6c58b7d-aeed-4bbf-9856-1d53b3644115,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:41.756934 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-55495f44-f0cf-4b53-bed5-4285c7900947 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:41.768262 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4b692a53-2fa6-4b13-8b05-0c98f8d2e25a tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:30:41.790460 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cea938d8-0fc9-4e3b-a73a-f4cd38fd29d2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:41.810509 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1dadd34e-b736-4012-add1-1168b728145f None None] Pushing event updated for resources: {'Port': ['ID=f77ff47a-4d0e-4c2f-84e5-d451dd4abe75,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:41.823093 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f78c1dcf-f9e1-4340-872e-52b2519e190d None None] Sync routers for ids ['261d799f-49ff-439f-8e9c-bb4bf5bd54f1'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:30:41.823093 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-1dadd34e-b736-4012-add1-1168b728145f None None] Attempting to bind port f77ff47a-4d0e-4c2f-84e5-d451dd4abe75 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:30:41.823093 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-1dadd34e-b736-4012-add1-1168b728145f None None] Attempting to bind port f77ff47a-4d0e-4c2f-84e5-d451dd4abe75 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '30da2c7b-8ba0-4c22-9597-3763f0be3551', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 309, 'network_id': 'dee7e689-a388-42bb-96eb-2960b07f7335'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:30:41.823093 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1dadd34e-b736-4012-add1-1168b728145f None None] Attempting to bind port f77ff47a-4d0e-4c2f-84e5-d451dd4abe75 on network dee7e689-a388-42bb-96eb-2960b07f7335 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:30:41.834274 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1dadd34e-b736-4012-add1-1168b728145f None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 30, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:30:41.834765 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1dadd34e-b736-4012-add1-1168b728145f None None] Checking segment: {'id': '30da2c7b-8ba0-4c22-9597-3763f0be3551', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 309, 'network_id': 'dee7e689-a388-42bb-96eb-2960b07f7335'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:30:41.835210 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1dadd34e-b736-4012-add1-1168b728145f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:41.835647 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1dadd34e-b736-4012-add1-1168b728145f None None] Bound using segment: {'id': '30da2c7b-8ba0-4c22-9597-3763f0be3551', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 309, 'network_id': 'dee7e689-a388-42bb-96eb-2960b07f7335'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:30:41.836709 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-1dadd34e-b736-4012-add1-1168b728145f None None] Bound port: f77ff47a-4d0e-4c2f-84e5-d451dd4abe75, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '30da2c7b-8ba0-4c22-9597-3763f0be3551', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 309, 'network_id': 'dee7e689-a388-42bb-96eb-2960b07f7335'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:30:41.836709 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1dadd34e-b736-4012-add1-1168b728145f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:41.848204 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-504f36bb-43a7-4d6a-b07f-bf4bae28003f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Allocated IP 172.20.0.4 (dee7e689-a388-42bb-96eb-2960b07f7335/65e6912e-4232-4d7d-9de9-d0574b22fe1f/153089ec-acc0-413b-ae5f-f0f91ab5ceca) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:30:41.853032 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-06c3f68a-bb9e-43dd-ad37-ab6ba194bbd0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:41.856021 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-06c3f68a-bb9e-43dd-ad37-ab6ba194bbd0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:41.861363 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-06c3f68a-bb9e-43dd-ad37-ab6ba194bbd0 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/613fd167-57fe-4380-8d4a-cd6623a138c2 HTTP/1.1" status: 204 len: 168 time: 0.7896514 Nov 09 04:30:41.910147 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55495f44-f0cf-4b53-bed5-4285c7900947 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Pushing event updated for resources: {'Port': ['ID=926c0f7a-a3c9-4cba-bc73-92c3e33904c6,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:41.932455 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-55495f44-f0cf-4b53-bed5-4285c7900947 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:30:41.937833 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06c3f68a-bb9e-43dd-ad37-ab6ba194bbd0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=613fd167-57fe-4380-8d4a-cd6623a138c2,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:41.960063 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6ccfb015-d107-4b1f-b31e-8b159c14587e tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:41.965166 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-6ccfb015-d107-4b1f-b31e-8b159c14587e tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.9787714 Nov 09 04:30:41.968381 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54798) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:41.979872 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f78c1dcf-f9e1-4340-872e-52b2519e190d None None] Routers {'261d799f-49ff-439f-8e9c-bb4bf5bd54f1'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:30:41.983409 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-f78c1dcf-f9e1-4340-872e-52b2519e190d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:30:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['261d799f-49ff-439f-8e9c-bb4bf5bd54f1'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:41.983557 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-a35804e2-39b6-4e0c-acd2-267c28315f9c tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Request body: {'security_group_rule': {'security_group_id': '4ff68177-77d2-4250-b11c-4d5b55fd3619', 'project_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:41.983676 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cea938d8-0fc9-4e3b-a73a-f4cd38fd29d2 admin admin] Network a270b61c-1f4f-4d97-be79-4a24c65fddc2 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:30:41.986675 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-510773af-c109-4faf-b9b0-01d88bd855ca tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Made reservation on behalf of 6761c80dbfa84798bb6517a9b532f870 for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:30:41.991861 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-510773af-c109-4faf-b9b0-01d88bd855ca tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:41.994897 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-55495f44-f0cf-4b53-bed5-4285c7900947 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:42.053139 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:42.065783 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-55495f44-f0cf-4b53-bed5-4285c7900947 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:30:42.073694 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cea938d8-0fc9-4e3b-a73a-f4cd38fd29d2 admin admin] Pushing event updated for resources: {'Port': ['ID=e025929c-44cc-4832-b4a4-0216288df212,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:42.079144 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-cea938d8-0fc9-4e3b-a73a-f4cd38fd29d2 admin admin] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:42.086442 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cea938d8-0fc9-4e3b-a73a-f4cd38fd29d2 admin admin] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:30:42.087028 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port a4e20770-3342-4c9b-a9bf-d4dab52b7d8d, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=a4e20770-3342-4c9b-a9bf-d4dab52b7d8d,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:30:42.111538 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-f78c1dcf-f9e1-4340-872e-52b2519e190d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:42.122688 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a3d534aa-ef9f-48d6-a311-23e6e81145ef tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Router 3a5287b2-31f6-4415-beea-0718ba71be47 is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102161) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:30:42.142921 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-504f36bb-43a7-4d6a-b07f-bf4bae28003f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:42.159831 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:42.171244 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.securitygroups_db [None req-a35804e2-39b6-4e0c-acd2-267c28315f9c tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Project fd7df27e425449dfb80d0838c8f7fb89 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 09 04:30:42.207247 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4b692a53-2fa6-4b13-8b05-0c98f8d2e25a tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:42.211720 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-4b692a53-2fa6-4b13-8b05-0c98f8d2e25a tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 887 time: 12.0638361 Nov 09 04:30:42.217833 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54800) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:42.227268 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f78c1dcf-f9e1-4340-872e-52b2519e190d None None] Routers {'261d799f-49ff-439f-8e9c-bb4bf5bd54f1'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:30:42.227898 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-f78c1dcf-f9e1-4340-872e-52b2519e190d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:30:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['261d799f-49ff-439f-8e9c-bb4bf5bd54f1'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:42.236636 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-0185ddcb-ea95-403b-981c-d21b92d59cab tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Request body: {'router': {'external_gateway_info': {}}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:42.251872 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-2e966e95-3a0d-4e0f-9df3-2f65ba54d19c None None] Provisioning complete for port 0e09fa29-fdeb-4ced-98cd-cb627627d82c triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:30:42.252242 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-2e966e95-3a0d-4e0f-9df3-2f65ba54d19c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:42.366569 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a35804e2-39b6-4e0c-acd2-267c28315f9c tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:42.380909 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-2e966e95-3a0d-4e0f-9df3-2f65ba54d19c None None] Port 0e09fa29-fdeb-4ced-98cd-cb627627d82c cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:30:42.389350 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:42.392714 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-1dadd34e-b736-4012-add1-1168b728145f None None] For port f77ff47a-4d0e-4c2f-84e5-d451dd4abe75, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:30:42.404407 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-f78c1dcf-f9e1-4340-872e-52b2519e190d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:42.414984 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f78c1dcf-f9e1-4340-872e-52b2519e190d None None] The sync data for ids ['261d799f-49ff-439f-8e9c-bb4bf5bd54f1'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:30:42.438559 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=a4e20770-3342-4c9b-a9bf-d4dab52b7d8d,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:42.456192 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-1dadd34e-b736-4012-add1-1168b728145f None None] For port f77ff47a-4d0e-4c2f-84e5-d451dd4abe75, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=f77ff47a-4d0e-4c2f-84e5-d451dd4abe75,segment=NetworkSegment(30da2c7b-8ba0-4c22-9597-3763f0be3551),segment_id=30da2c7b-8ba0-4c22-9597-3763f0be3551)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:30:42.492512 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cea938d8-0fc9-4e3b-a73a-f4cd38fd29d2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:42.503114 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a35804e2-39b6-4e0c-acd2-267c28315f9c tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:42.504364 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-510773af-c109-4faf-b9b0-01d88bd855ca tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 343} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:30:42.515667 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1dadd34e-b736-4012-add1-1168b728145f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:42.574926 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a35804e2-39b6-4e0c-acd2-267c28315f9c tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:42.594208 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a3d534aa-ef9f-48d6-a311-23e6e81145ef tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:30:42.603153 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1dadd34e-b736-4012-add1-1168b728145f None None] Pushing event updated for resources: {'Port': ['ID=f77ff47a-4d0e-4c2f-84e5-d451dd4abe75,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:42.605945 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 9ba426d3-a467-48c0-af5a-2a69f373ca1a up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:30:42.607081 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0f7d83ac-b916-4f59-bc9b-2ec22b45edee None None] Sync routers for ids ['3a5287b2-31f6-4415-beea-0718ba71be47'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:30:42.617921 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a3d534aa-ef9f-48d6-a311-23e6e81145ef tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "PUT /v2.0/routers/3a5287b2-31f6-4415-beea-0718ba71be47/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.9836321 Nov 09 04:30:42.629918 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0f7d83ac-b916-4f59-bc9b-2ec22b45edee None None] Routers {'3a5287b2-31f6-4415-beea-0718ba71be47'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:30:42.630577 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-0f7d83ac-b916-4f59-bc9b-2ec22b45edee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:30:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['3a5287b2-31f6-4415-beea-0718ba71be47'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:42.635147 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54804) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:42.713303 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-0f7d83ac-b916-4f59-bc9b-2ec22b45edee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:42.732755 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0f7d83ac-b916-4f59-bc9b-2ec22b45edee None None] Routers {'3a5287b2-31f6-4415-beea-0718ba71be47'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:30:42.734752 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a35804e2-39b6-4e0c-acd2-267c28315f9c tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5e8f9e4a-1b99-426d-8824-6563e9b4eca9,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:42.748911 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 9ba426d3-a467-48c0-af5a-2a69f373ca1a triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:30:42.749245 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:42.752466 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-0f7d83ac-b916-4f59-bc9b-2ec22b45edee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:30:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['3a5287b2-31f6-4415-beea-0718ba71be47'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:42.788251 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1c8f1355-b632-48c0-893d-33d69ed7adc9 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:42.801533 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1c8f1355-b632-48c0-893d-33d69ed7adc9 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "GET /v2.0/ports/0e09fa29-fdeb-4ced-98cd-cb627627d82c HTTP/1.1" status: 200 len: 910 time: 0.1652825 Nov 09 04:30:42.802443 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54806) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:42.806462 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-504f36bb-43a7-4d6a-b07f-bf4bae28003f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:42.832965 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a35804e2-39b6-4e0c-acd2-267c28315f9c tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:42.837350 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a35804e2-39b6-4e0c-acd2-267c28315f9c tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.8658280 Nov 09 04:30:42.838402 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54808) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:42.840724 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-646355ef-7f3a-4770-b949-565346424040 None None] Provisioning complete for port e025929c-44cc-4832-b4a4-0216288df212 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:30:42.841200 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-646355ef-7f3a-4770-b949-565346424040 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:42.863286 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-0f7d83ac-b916-4f59-bc9b-2ec22b45edee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:42.864614 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0f7d83ac-b916-4f59-bc9b-2ec22b45edee None None] The sync data for ids ['3a5287b2-31f6-4415-beea-0718ba71be47'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:30:42.887179 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-510773af-c109-4faf-b9b0-01d88bd855ca tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:42.887669 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-510773af-c109-4faf-b9b0-01d88bd855ca tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Added segment 65abba88-0391-46a9-860b-6e03a3ed017e of type vlan for network f1806145-f899-452a-9fed-c9a23870b515 Nov 09 04:30:42.907939 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-880cf338-3492-4c3f-a53c-187b52fbd8b8 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Request body: {'security_group_rule': {'security_group_id': '4ff68177-77d2-4250-b11c-4d5b55fd3619', 'project_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:42.953925 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-646355ef-7f3a-4770-b949-565346424040 None None] Port e025929c-44cc-4832-b4a4-0216288df212 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:30:42.956051 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-504f36bb-43a7-4d6a-b07f-bf4bae28003f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Network dee7e689-a388-42bb-96eb-2960b07f7335 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:30:43.046883 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-504f36bb-43a7-4d6a-b07f-bf4bae28003f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:43.050072 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-504f36bb-43a7-4d6a-b07f-bf4bae28003f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:30:43.054821 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54810) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:43.075368 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.securitygroups_db [None req-880cf338-3492-4c3f-a53c-187b52fbd8b8 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Project fd7df27e425449dfb80d0838c8f7fb89 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 09 04:30:43.112507 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-880cf338-3492-4c3f-a53c-187b52fbd8b8 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:43.153766 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8684e4ec-0d68-43cd-87e6-b137fedee15e admin admin] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:43.170752 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-504f36bb-43a7-4d6a-b07f-bf4bae28003f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event updated for resources: {'Port': ['ID=153089ec-acc0-413b-ae5f-f0f91ab5ceca,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:43.263902 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-510773af-c109-4faf-b9b0-01d88bd855ca tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:43.296746 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-504f36bb-43a7-4d6a-b07f-bf4bae28003f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:43.297343 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-504f36bb-43a7-4d6a-b07f-bf4bae28003f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:43.349030 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-880cf338-3492-4c3f-a53c-187b52fbd8b8 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:43.463256 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-510773af-c109-4faf-b9b0-01d88bd855ca tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:43.464205 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-504f36bb-43a7-4d6a-b07f-bf4bae28003f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 885 time: 3.4813638 Nov 09 04:30:43.464956 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-880cf338-3492-4c3f-a53c-187b52fbd8b8 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:43.468975 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54812) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:43.469320 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-510773af-c109-4faf-b9b0-01d88bd855ca tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:43.469930 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-510773af-c109-4faf-b9b0-01d88bd855ca tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:43.541444 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-880cf338-3492-4c3f-a53c-187b52fbd8b8 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ce19e064-8c9c-4323-8739-fc130e47e75a,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:43.561891 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8684e4ec-0d68-43cd-87e6-b137fedee15e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:43.618429 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-880cf338-3492-4c3f-a53c-187b52fbd8b8 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:43.619854 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-880cf338-3492-4c3f-a53c-187b52fbd8b8 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.7187283 Nov 09 04:30:43.623333 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54814) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:43.635396 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-f7b4b91f-479c-4fc6-8d7b-aff4661e9bb2 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Request body: {'network': {'name': 'tempest-network-smoke--1705860698', 'project_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'port_security_enabled': True}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:43.647183 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8684e4ec-0d68-43cd-87e6-b137fedee15e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:43.654189 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cea938d8-0fc9-4e3b-a73a-f4cd38fd29d2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:43.658512 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4926a2b7-b0dd-447f-8fe0-30725cfec0b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:43.665250 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-510773af-c109-4faf-b9b0-01d88bd855ca tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 780 time: 1.9955988 Nov 09 04:30:43.676246 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54816) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:43.682451 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-510773af-c109-4faf-b9b0-01d88bd855ca tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event updated for resources: {'Network': ['ID=f1806145-f899-452a-9fed-c9a23870b515,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:43.685956 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0185ddcb-ea95-403b-981c-d21b92d59cab tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:43.687608 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-689de5af-d206-44ef-abd5-a0a89593032b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Request body: {'subnet': {'network_id': 'f1806145-f899-452a-9fed-c9a23870b515', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': None, 'host_routes': [{'destination': '10.20.0.0/32', 'nexthop': '10.100.1.1'}], 'dns_nameservers': ['8.8.4.4', '8.8.8.8']}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:43.693776 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-55495f44-f0cf-4b53-bed5-4285c7900947 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks [] for router_gateway, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:43.722380 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network f1806145-f899-452a-9fed-c9a23870b515 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:30:43.829765 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0185ddcb-ea95-403b-981c-d21b92d59cab tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks [] for router_gateway, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:44.055490 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-8684e4ec-0d68-43cd-87e6-b137fedee15e admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=38d1e2166706416983c41df1a924347e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.9976494 Nov 09 04:30:44.103586 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54818) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:44.104259 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8684e4ec-0d68-43cd-87e6-b137fedee15e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c846fc51-ba74-49e3-85ab-8df8b8a5f7a2,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:44.135072 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f7b4b91f-479c-4fc6-8d7b-aff4661e9bb2 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Made reservation on behalf of fd7df27e425449dfb80d0838c8f7fb89 for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:30:44.138596 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f7b4b91f-479c-4fc6-8d7b-aff4661e9bb2 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:44.179847 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-4114b6fb-a584-424c-9a3b-71f90723fec3 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Deleting port 153089ec-acc0-413b-ae5f-f0f91ab5ceca {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:30:44.180218 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4114b6fb-a584-424c-9a3b-71f90723fec3 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:44.184103 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-aa9fd873-b664-4afe-a4f0-a79d9f32c083 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:44.318462 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-79c61838-be25-4dee-9298-f3f125ddc597 None None] Network dee7e689-a388-42bb-96eb-2960b07f7335 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:30:44.323033 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f7b4b91f-479c-4fc6-8d7b-aff4661e9bb2 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 313} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:30:44.387865 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5ce5da3c-3726-4e91-875f-6536df04f952 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:44.392350 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f7b4b91f-479c-4fc6-8d7b-aff4661e9bb2 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:44.392350 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-f7b4b91f-479c-4fc6-8d7b-aff4661e9bb2 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Added segment d5411e15-1506-4025-8472-ba7118358f68 of type vlan for network 9c94e7dc-d679-4a7e-b264-6d619dbc935e Nov 09 04:30:44.408077 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-0fc8aa90-f595-4717-a587-5a5e2c4408cf None None] Provisioning complete for port f77ff47a-4d0e-4c2f-84e5-d451dd4abe75 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:30:44.408708 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0fc8aa90-f595-4717-a587-5a5e2c4408cf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:44.409356 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-689de5af-d206-44ef-abd5-a0a89593032b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Made reservation on behalf of 6761c80dbfa84798bb6517a9b532f870 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:30:44.417605 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-689de5af-d206-44ef-abd5-a0a89593032b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:44.461851 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cea938d8-0fc9-4e3b-a73a-f4cd38fd29d2 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:44.465865 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-0185ddcb-ea95-403b-981c-d21b92d59cab tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Deleting port 14fc2607-bdd8-4afb-b710-1fe823ed3ff1 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:30:44.466195 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0185ddcb-ea95-403b-981c-d21b92d59cab tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:44.509991 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-55495f44-f0cf-4b53-bed5-4285c7900947 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:44.529792 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4114b6fb-a584-424c-9a3b-71f90723fec3 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:44.556768 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cea938d8-0fc9-4e3b-a73a-f4cd38fd29d2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:44.565207 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0fc8aa90-f595-4717-a587-5a5e2c4408cf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:44.572438 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5ce5da3c-3726-4e91-875f-6536df04f952 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:44.590438 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-4114b6fb-a584-424c-9a3b-71f90723fec3 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Calling delete_port for 153089ec-acc0-413b-ae5f-f0f91ab5ceca owned by {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:30:44.593191 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f7b4b91f-479c-4fc6-8d7b-aff4661e9bb2 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:44.645082 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-0fc8aa90-f595-4717-a587-5a5e2c4408cf None None] For port f77ff47a-4d0e-4c2f-84e5-d451dd4abe75, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=f77ff47a-4d0e-4c2f-84e5-d451dd4abe75,segment=NetworkSegment(30da2c7b-8ba0-4c22-9597-3763f0be3551),segment_id=30da2c7b-8ba0-4c22-9597-3763f0be3551)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:30:44.671664 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device f77ff47a-4d0e-4c2f-84e5-d451dd4abe75 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:30:44.718083 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0fc8aa90-f595-4717-a587-5a5e2c4408cf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:44.781933 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fc8aa90-f595-4717-a587-5a5e2c4408cf None None] Pushing event updated for resources: {'Port': ['ID=f77ff47a-4d0e-4c2f-84e5-d451dd4abe75,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:44.784675 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cea938d8-0fc9-4e3b-a73a-f4cd38fd29d2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:44.785934 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port f77ff47a-4d0e-4c2f-84e5-d451dd4abe75 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:30:44.786623 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:44.788381 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cea938d8-0fc9-4e3b-a73a-f4cd38fd29d2 admin admin] Pushing event updated for resources: {'Port': ['ID=e025929c-44cc-4832-b4a4-0216288df212,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:44.793357 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0185ddcb-ea95-403b-981c-d21b92d59cab tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:44.815943 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f7b4b91f-479c-4fc6-8d7b-aff4661e9bb2 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:44.821553 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f7b4b91f-479c-4fc6-8d7b-aff4661e9bb2 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:44.822159 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f7b4b91f-479c-4fc6-8d7b-aff4661e9bb2 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:44.883718 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-0185ddcb-ea95-403b-981c-d21b92d59cab tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Calling delete_port for 14fc2607-bdd8-4afb-b710-1fe823ed3ff1 owned by network:router_gateway {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:30:44.921823 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device a4e20770-3342-4c9b-a9bf-d4dab52b7d8d up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:30:44.985867 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cea938d8-0fc9-4e3b-a73a-f4cd38fd29d2 admin admin] Network a270b61c-1f4f-4d97-be79-4a24c65fddc2 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:30:44.992218 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-cea938d8-0fc9-4e3b-a73a-f4cd38fd29d2 admin admin] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:44.999165 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5ce5da3c-3726-4e91-875f-6536df04f952 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:45.002337 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5ce5da3c-3726-4e91-875f-6536df04f952 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:45.005830 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-5ce5da3c-3726-4e91-875f-6536df04f952 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/c846fc51-ba74-49e3-85ab-8df8b8a5f7a2 HTTP/1.1" status: 204 len: 168 time: 0.8964138 Nov 09 04:30:45.010760 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port a4e20770-3342-4c9b-a9bf-d4dab52b7d8d triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:30:45.011980 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:45.084532 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:45.103108 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-d366dbe4-0a5c-4384-9e0b-a8173fe941cf None None] Provisioning complete for port 153089ec-acc0-413b-ae5f-f0f91ab5ceca triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:30:45.103594 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d366dbe4-0a5c-4384-9e0b-a8173fe941cf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:45.144360 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-d366dbe4-0a5c-4384-9e0b-a8173fe941cf None None] Port 153089ec-acc0-413b-ae5f-f0f91ab5ceca cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:30:45.158837 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-f7b4b91f-479c-4fc6-8d7b-aff4661e9bb2 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 1.5326755 Nov 09 04:30:45.168414 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-d366dbe4-0a5c-4384-9e0b-a8173fe941cf None None] Provisioning complete for port f77ff47a-4d0e-4c2f-84e5-d451dd4abe75 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:30:45.168918 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d366dbe4-0a5c-4384-9e0b-a8173fe941cf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:45.170440 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54822) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:45.182083 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-e4c888bb-f6e0-42fc-9c97-cb0721bd9012 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Request body: {'router': {'name': 'tempest-TestNetworkAdvancedServerOps-router-1135837892', 'admin_state_up': True, 'project_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:45.260301 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ce5da3c-3726-4e91-875f-6536df04f952 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c846fc51-ba74-49e3-85ab-8df8b8a5f7a2,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:45.271565 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-55495f44-f0cf-4b53-bed5-4285c7900947 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Router 454f4384-6780-4402-98ea-5edbe666cd33 is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102162) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:30:45.288224 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-689de5af-d206-44ef-abd5-a0a89593032b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:45.289985 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7b4b91f-479c-4fc6-8d7b-aff4661e9bb2 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Pushing event updated for resources: {'Network': ['ID=9c94e7dc-d679-4a7e-b264-6d619dbc935e,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:45.326816 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 9c94e7dc-d679-4a7e-b264-6d619dbc935e details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:30:45.404319 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4114b6fb-a584-424c-9a3b-71f90723fec3 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:45.417885 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-aa9fd873-b664-4afe-a4f0-a79d9f32c083 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Allocated IP 172.21.0.1 (0a61eb3b-f9c4-4bc0-94dd-9f48ad858a9d/46e2a34a-c423-454a-a4ea-0bc78ae2ec41/15453fb5-186c-4eec-947f-e2f2717366a7) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:30:45.458697 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cea938d8-0fc9-4e3b-a73a-f4cd38fd29d2 admin admin] Router 5023cfbb-afb2-4e33-bdc1-c1173218f6bf has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:30:45.469724 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4114b6fb-a584-424c-9a3b-71f90723fec3 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event deleted for resources: {'Port': ['ID=153089ec-acc0-413b-ae5f-f0f91ab5ceca,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:45.483147 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c5f407e6-744c-4a47-8384-7a0709a264b0 None None] get_active_networks_info from dv-neutron-816802-2-hyperv {{(pid=102163) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}} Nov 09 04:30:45.516323 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-689de5af-d206-44ef-abd5-a0a89593032b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event updated for resources: {'Subnet': ['ID=c31edbab-096a-4d5c-80c7-21775d0297d8,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:45.520954 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0185ddcb-ea95-403b-981c-d21b92d59cab tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:45.522990 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-689de5af-d206-44ef-abd5-a0a89593032b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Checking segment: {'id': '65abba88-0391-46a9-860b-6e03a3ed017e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 343, 'network_id': 'f1806145-f899-452a-9fed-c9a23870b515'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:30:45.523356 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-689de5af-d206-44ef-abd5-a0a89593032b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Network hostable DHCP agents. Network: f1806145-f899-452a-9fed-c9a23870b515, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:30:45.524358 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:30:45.525644 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e4c888bb-f6e0-42fc-9c97-cb0721bd9012 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:45.526864 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e4c888bb-f6e0-42fc-9c97-cb0721bd9012 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:45.618913 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0185ddcb-ea95-403b-981c-d21b92d59cab tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Pushing event deleted for resources: {'Port': ['ID=14fc2607-bdd8-4afb-b710-1fe823ed3ff1,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:45.632224 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-55495f44-f0cf-4b53-bed5-4285c7900947 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:30:45.652404 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-469458cd-b017-4dba-b934-01309f73c54e None None] Sync routers for ids ['454f4384-6780-4402-98ea-5edbe666cd33'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:30:45.685784 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-469458cd-b017-4dba-b934-01309f73c54e None None] Routers {'454f4384-6780-4402-98ea-5edbe666cd33'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:30:45.686591 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-469458cd-b017-4dba-b934-01309f73c54e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:30:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['454f4384-6780-4402-98ea-5edbe666cd33'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:45.740174 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-469458cd-b017-4dba-b934-01309f73c54e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:45.780509 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0185ddcb-ea95-403b-981c-d21b92d59cab tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-466373'] for router_gateway, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:45.780762 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e4c888bb-f6e0-42fc-9c97-cb0721bd9012 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:45.789733 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-689de5af-d206-44ef-abd5-a0a89593032b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Network f1806145-f899-452a-9fed-c9a23870b515 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:30:45.796847 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4114b6fb-a584-424c-9a3b-71f90723fec3 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:45.800440 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-4114b6fb-a584-424c-9a3b-71f90723fec3 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "DELETE /v2.0/ports/153089ec-acc0-413b-ae5f-f0f91ab5ceca HTTP/1.1" status: 204 len: 168 time: 2.3230412 Nov 09 04:30:45.806864 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54826) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:45.820427 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-469458cd-b017-4dba-b934-01309f73c54e None None] Routers {'454f4384-6780-4402-98ea-5edbe666cd33'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:30:45.821197 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-469458cd-b017-4dba-b934-01309f73c54e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:30:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['454f4384-6780-4402-98ea-5edbe666cd33'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:45.825094 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cea938d8-0fc9-4e3b-a73a-f4cd38fd29d2 admin admin] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:30:45.864654 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-551e9831-6df5-4c09-999f-4f6ae7a0d09d None None] Sync routers for ids ['5023cfbb-afb2-4e33-bdc1-c1173218f6bf'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:30:45.875380 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-469458cd-b017-4dba-b934-01309f73c54e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:45.882305 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-469458cd-b017-4dba-b934-01309f73c54e None None] The sync data for ids ['454f4384-6780-4402-98ea-5edbe666cd33'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:30:45.891655 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-ee9a77f5-c4ae-4f19-8519-242d1aea7b67 None None] Provisioning complete for port e025929c-44cc-4832-b4a4-0216288df212 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:30:45.891956 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee9a77f5-c4ae-4f19-8519-242d1aea7b67 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:45.903312 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-551e9831-6df5-4c09-999f-4f6ae7a0d09d None None] Routers {'5023cfbb-afb2-4e33-bdc1-c1173218f6bf'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:30:45.904552 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-551e9831-6df5-4c09-999f-4f6ae7a0d09d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:30:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['5023cfbb-afb2-4e33-bdc1-c1173218f6bf'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:45.908739 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-55495f44-f0cf-4b53-bed5-4285c7900947 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:45.909980 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-55495f44-f0cf-4b53-bed5-4285c7900947 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 884 time: 9.1855884 Nov 09 04:30:45.914651 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-cea938d8-0fc9-4e3b-a73a-f4cd38fd29d2 admin admin] 10.222.0.24 "PUT /v2.0/routers/5023cfbb-afb2-4e33-bdc1-c1173218f6bf/add_router_interface HTTP/1.1" status: 200 len: 503 time: 9.1913521 Nov 09 04:30:45.917485 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54828) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:45.929383 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-689ab077-1a77-48e5-b2ad-49b2c290e45a tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] GET failed (client error): The resource could not be found. Nov 09 04:30:45.933149 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-689ab077-1a77-48e5-b2ad-49b2c290e45a tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "GET /v2.0/ports/153089ec-acc0-413b-ae5f-f0f91ab5ceca HTTP/1.1" status: 404 len: 333 time: 0.1244552 Nov 09 04:30:45.937848 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-689de5af-d206-44ef-abd5-a0a89593032b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, f1806145-f899-452a-9fed-c9a23870b515) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:45.963317 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-ee9a77f5-c4ae-4f19-8519-242d1aea7b67 None None] Port e025929c-44cc-4832-b4a4-0216288df212 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:30:45.983973 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-ee9a77f5-c4ae-4f19-8519-242d1aea7b67 None None] Could not find standard attr ID for object 153089ec-acc0-413b-ae5f-f0f91ab5ceca. {{(pid=102163) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 09 04:30:46.005587 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54830) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:46.006657 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-2caa0e0c-1e48-4b5b-a6a5-8de2d07bdf77 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'enable_snat': False}}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:46.043608 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c5f407e6-744c-4a47-8384-7a0709a264b0 None None] Unable to find a vacant binding_index for network f1806145-f899-452a-9fed-c9a23870b515 and agent cb24b282-9b2c-4486-bad1-b98e0db75839 {{(pid=102163) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:209}} Nov 09 04:30:46.051588 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c5f407e6-744c-4a47-8384-7a0709a264b0 None None] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, f1806145-f899-452a-9fed-c9a23870b515) {{(pid=102163) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 09 04:30:46.119509 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-551e9831-6df5-4c09-999f-4f6ae7a0d09d None None] Set router 5023cfbb-afb2-4e33-bdc1-c1173218f6bf gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:30:46.149937 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-689de5af-d206-44ef-abd5-a0a89593032b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:46.158649 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-689de5af-d206-44ef-abd5-a0a89593032b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:46.181685 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-1c752c7b-6ca7-4e83-a383-97d35e1129bf tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Deleting subnet 65e6912e-4232-4d7d-9de9-d0574b22fe1f {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:30:46.202559 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-aa9fd873-b664-4afe-a4f0-a79d9f32c083 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:46.248678 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1c752c7b-6ca7-4e83-a383-97d35e1129bf tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:46.317528 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e4c888bb-f6e0-42fc-9c97-cb0721bd9012 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:46.353860 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-689de5af-d206-44ef-abd5-a0a89593032b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 865 time: 2.6743457 Nov 09 04:30:46.369591 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54846) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:46.380378 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0185ddcb-ea95-403b-981c-d21b92d59cab tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-466202', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-464271', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-936'] for router, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:46.394147 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0185ddcb-ea95-403b-981c-d21b92d59cab tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-466195', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-466408', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-464260'] for router, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:46.409866 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1c752c7b-6ca7-4e83-a383-97d35e1129bf tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:46.432684 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-551e9831-6df5-4c09-999f-4f6ae7a0d09d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5023cfbb-afb2-4e33-bdc1-c1173218f6bf', 'name': 'tempest-ServerActionsTestJSON-1211051012-router', 'tenant_id': '6015befde7f546d881cb247ae5bc81ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.95'}], 'enable_snat': True}, 'gw_port_id': 'a4e20770-3342-4c9b-a9bf-d4dab52b7d8d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:30:28Z', 'updated_at': '2021-11-09T04:30:43Z', 'revision_number': 4, 'project_id': '6015befde7f546d881cb247ae5bc81ae', 'gw_port': {'id': 'a4e20770-3342-4c9b-a9bf-d4dab52b7d8d', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:03:2b:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5023cfbb-afb2-4e33-bdc1-c1173218f6bf', 'device_owner': 'network:router_gateway', 'standard_attr_id': 499, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:30:29Z', 'updated_at': '2021-11-09T04:30:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'e025929c-44cc-4832-b4a4-0216288df212', 'name': '', 'network_id': 'a270b61c-1f4f-4d97-be79-4a24c65fddc2', 'tenant_id': '6015befde7f546d881cb247ae5bc81ae', 'mac_address': 'fa:16:3e:7a:69:40', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5023cfbb-afb2-4e33-bdc1-c1173218f6bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 539, 'fixed_ips': [{'subnet_id': 'b2956e71-9b0f-4060-922c-e54ce6cff80a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:30:40Z', 'updated_at': '2021-11-09T04:30:43Z', 'revision_number': 2, 'project_id': '6015befde7f546d881cb247ae5bc81ae', 'subnets': [{'id': 'b2956e71-9b0f-4060-922c-e54ce6cff80a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:46.471933 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:46.498847 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e7cb8d30-85c8-4008-b973-4d6f78f92e93 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-f1806145-f899-452a-9fed-c9a23870b515', 'network_id': 'f1806145-f899-452a-9fed-c9a23870b515', 'tenant_id': '6761c80dbfa84798bb6517a9b532f870', 'fixed_ips': [{'subnet_id': 'c31edbab-096a-4d5c-80c7-21775d0297d8'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:30:46.499826 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e7cb8d30-85c8-4008-b973-4d6f78f92e93 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:46.525284 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-551e9831-6df5-4c09-999f-4f6ae7a0d09d None None] Checking router: 5023cfbb-afb2-4e33-bdc1-c1173218f6bf for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:30:46.530696 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-551e9831-6df5-4c09-999f-4f6ae7a0d09d None None] Updating router 5023cfbb-afb2-4e33-bdc1-c1173218f6bf port e025929c-44cc-4832-b4a4-0216288df212 binding host dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 04:30:46.537381 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device f77ff47a-4d0e-4c2f-84e5-d451dd4abe75 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:30:46.567481 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-551e9831-6df5-4c09-999f-4f6ae7a0d09d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:46.604271 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0185ddcb-ea95-403b-981c-d21b92d59cab tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Router 261d799f-49ff-439f-8e9c-bb4bf5bd54f1 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:30:46.776374 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-aa9fd873-b664-4afe-a4f0-a79d9f32c083 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:46.790869 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0185ddcb-ea95-403b-981c-d21b92d59cab tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:30:46.799526 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0185ddcb-ea95-403b-981c-d21b92d59cab tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:46.803879 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-0185ddcb-ea95-403b-981c-d21b92d59cab tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] 10.222.0.24 "PUT /v2.0/routers/261d799f-49ff-439f-8e9c-bb4bf5bd54f1 HTTP/1.1" status: 200 len: 709 time: 4.5788279 Nov 09 04:30:46.807739 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54854) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:46.852160 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7241efd9-6292-4618-bada-f1e8031d1a8a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:46.865224 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1c752c7b-6ca7-4e83-a383-97d35e1129bf tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:46.867665 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aa9fd873-b664-4afe-a4f0-a79d9f32c083 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Network 0a61eb3b-f9c4-4bc0-94dd-9f48ad858a9d is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:30:46.884618 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-e7cb8d30-85c8-4008-b973-4d6f78f92e93 None None] Allocated IP 172.20.0.1 (f1806145-f899-452a-9fed-c9a23870b515/c31edbab-096a-4d5c-80c7-21775d0297d8/87efc66a-74ea-46b3-be1c-7def2ac70303) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:30:46.913032 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-aa9fd873-b664-4afe-a4f0-a79d9f32c083 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:46.923277 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aa9fd873-b664-4afe-a4f0-a79d9f32c083 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:30:46.968797 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-aa9fd873-b664-4afe-a4f0-a79d9f32c083 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:46.975334 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa9fd873-b664-4afe-a4f0-a79d9f32c083 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event updated for resources: {'Port': ['ID=15453fb5-186c-4eec-947f-e2f2717366a7,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:47.117841 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d61679dc-7a86-42c8-9bb7-119cf8d53050 None None] Sync routers for ids ['261d799f-49ff-439f-8e9c-bb4bf5bd54f1'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:30:47.207661 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-551e9831-6df5-4c09-999f-4f6ae7a0d09d None None] Publish callbacks [] for port, precommit_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:47.227788 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port f77ff47a-4d0e-4c2f-84e5-d451dd4abe75 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:30:47.228227 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:47.233519 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d61679dc-7a86-42c8-9bb7-119cf8d53050 None None] Routers {'261d799f-49ff-439f-8e9c-bb4bf5bd54f1'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:30:47.233519 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-d61679dc-7a86-42c8-9bb7-119cf8d53050 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:30:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['261d799f-49ff-439f-8e9c-bb4bf5bd54f1'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:47.272339 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-551e9831-6df5-4c09-999f-4f6ae7a0d09d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:47.306681 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-d61679dc-7a86-42c8-9bb7-119cf8d53050 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:47.309048 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:47.319168 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e7cb8d30-85c8-4008-b973-4d6f78f92e93 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:47.319439 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54860) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:47.333538 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d61679dc-7a86-42c8-9bb7-119cf8d53050 None None] Routers {'261d799f-49ff-439f-8e9c-bb4bf5bd54f1'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:30:47.334135 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-d61679dc-7a86-42c8-9bb7-119cf8d53050 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:30:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['261d799f-49ff-439f-8e9c-bb4bf5bd54f1'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:47.373787 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-bb8fdd27-d371-402d-8590-181a214d4215 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1687056584', 'description': 'tempest-description--229767948'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:47.388866 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-d61679dc-7a86-42c8-9bb7-119cf8d53050 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:47.389753 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d61679dc-7a86-42c8-9bb7-119cf8d53050 None None] The sync data for ids ['261d799f-49ff-439f-8e9c-bb4bf5bd54f1'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:30:47.405055 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-551e9831-6df5-4c09-999f-4f6ae7a0d09d None None] Attempting to bind port e025929c-44cc-4832-b4a4-0216288df212 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:30:47.405576 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-551e9831-6df5-4c09-999f-4f6ae7a0d09d None None] Attempting to bind port e025929c-44cc-4832-b4a4-0216288df212 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'e211d893-ee7a-48e3-bc29-b8824167e15b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 325, 'network_id': 'a270b61c-1f4f-4d97-be79-4a24c65fddc2'}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:30:47.406068 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-551e9831-6df5-4c09-999f-4f6ae7a0d09d None None] Attempting to bind port e025929c-44cc-4832-b4a4-0216288df212 on network a270b61c-1f4f-4d97-be79-4a24c65fddc2 {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:30:47.413695 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-551e9831-6df5-4c09-999f-4f6ae7a0d09d None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 30, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:30:47.414230 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-551e9831-6df5-4c09-999f-4f6ae7a0d09d None None] Checking segment: {'id': 'e211d893-ee7a-48e3-bc29-b8824167e15b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 325, 'network_id': 'a270b61c-1f4f-4d97-be79-4a24c65fddc2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102164) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:30:47.414743 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-551e9831-6df5-4c09-999f-4f6ae7a0d09d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:47.415258 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-551e9831-6df5-4c09-999f-4f6ae7a0d09d None None] Bound using segment: {'id': 'e211d893-ee7a-48e3-bc29-b8824167e15b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 325, 'network_id': 'a270b61c-1f4f-4d97-be79-4a24c65fddc2'} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:30:47.415841 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-551e9831-6df5-4c09-999f-4f6ae7a0d09d None None] Bound port: e025929c-44cc-4832-b4a4-0216288df212, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e211d893-ee7a-48e3-bc29-b8824167e15b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 325, 'network_id': 'a270b61c-1f4f-4d97-be79-4a24c65fddc2'}}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:30:47.416326 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-551e9831-6df5-4c09-999f-4f6ae7a0d09d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:47.427618 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e7cb8d30-85c8-4008-b973-4d6f78f92e93 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:47.485685 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-ede2a53f-6b6d-4169-825c-8cbc70d23e8a tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] 10.222.0.24 "GET /v2.0/routers/261d799f-49ff-439f-8e9c-bb4bf5bd54f1 HTTP/1.1" status: 200 len: 744 time: 0.6776764 Nov 09 04:30:47.487332 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7241efd9-6292-4618-bada-f1e8031d1a8a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:47.488533 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54864) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:47.495894 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1c752c7b-6ca7-4e83-a383-97d35e1129bf tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:47.510750 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-551e9831-6df5-4c09-999f-4f6ae7a0d09d None None] For port e025929c-44cc-4832-b4a4-0216288df212, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102164) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:30:47.517887 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-551e9831-6df5-4c09-999f-4f6ae7a0d09d None None] For port e025929c-44cc-4832-b4a4-0216288df212, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=e025929c-44cc-4832-b4a4-0216288df212,segment=NetworkSegment(e211d893-ee7a-48e3-bc29-b8824167e15b),segment_id=e211d893-ee7a-48e3-bc29-b8824167e15b)] {{(pid=102164) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:30:47.538241 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00296503-95a2-4eb7-9353-557cb54189f7 None None] Pushing event updated for resources: {'Port': ['ID=e025929c-44cc-4832-b4a4-0216288df212,revision_number=3']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:47.545647 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1c752c7b-6ca7-4e83-a383-97d35e1129bf tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:47.552737 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-5584d4d0-60a0-4cfd-8318-37349acbe029 tempest-RoutersIpV6AdminTest-1441178297 tempest-RoutersIpV6AdminTest-1441178297-project-admin] 10.222.0.24 "GET /v2.0/ports?network_id=2b6725f5-ebfe-485a-8f42-ccb5a241ddb5&device_id=261d799f-49ff-439f-8e9c-bb4bf5bd54f1 HTTP/1.1" status: 200 len: 205 time: 0.0630300 Nov 09 04:30:47.553359 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54866) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:47.564012 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1c752c7b-6ca7-4e83-a383-97d35e1129bf tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "DELETE /v2.0/subnets/65e6912e-4232-4d7d-9de9-d0574b22fe1f HTTP/1.1" status: 204 len: 168 time: 1.5529716 Nov 09 04:30:47.567367 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54868) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:47.582063 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-551e9831-6df5-4c09-999f-4f6ae7a0d09d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:47.628514 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-ece4fe1d-865a-4826-9b43-f9e9c972bc2c tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] 10.222.0.24 "GET /v2.0/ports?device_id=261d799f-49ff-439f-8e9c-bb4bf5bd54f1 HTTP/1.1" status: 200 len: 205 time: 0.0714741 Nov 09 04:30:47.629001 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54870) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:47.661967 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e7cb8d30-85c8-4008-b973-4d6f78f92e93 None None] Network f1806145-f899-452a-9fed-c9a23870b515 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:30:47.670414 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-e7cb8d30-85c8-4008-b973-4d6f78f92e93 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:47.678529 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e7cb8d30-85c8-4008-b973-4d6f78f92e93 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:30:47.678529 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7cb8d30-85c8-4008-b973-4d6f78f92e93 None None] Pushing event updated for resources: {'Port': ['ID=87efc66a-74ea-46b3-be1c-7def2ac70303,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:47.690353 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00296503-95a2-4eb7-9353-557cb54189f7 None None] Pushing event updated for resources: {'Port': ['ID=e025929c-44cc-4832-b4a4-0216288df212,revision_number=4']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:47.703695 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-551e9831-6df5-4c09-999f-4f6ae7a0d09d None None] Routers {'5023cfbb-afb2-4e33-bdc1-c1173218f6bf'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:30:47.704973 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-551e9831-6df5-4c09-999f-4f6ae7a0d09d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:30:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['5023cfbb-afb2-4e33-bdc1-c1173218f6bf'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:47.733627 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bb8fdd27-d371-402d-8590-181a214d4215 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:47.751234 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-e7cb8d30-85c8-4008-b973-4d6f78f92e93 None None] Attempting to bind port 87efc66a-74ea-46b3-be1c-7def2ac70303 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:30:47.752296 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-e7cb8d30-85c8-4008-b973-4d6f78f92e93 None None] Attempting to bind port 87efc66a-74ea-46b3-be1c-7def2ac70303 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '65abba88-0391-46a9-860b-6e03a3ed017e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 343, 'network_id': 'f1806145-f899-452a-9fed-c9a23870b515'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:30:47.753301 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7cb8d30-85c8-4008-b973-4d6f78f92e93 None None] Attempting to bind port 87efc66a-74ea-46b3-be1c-7def2ac70303 on network f1806145-f899-452a-9fed-c9a23870b515 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:30:47.755210 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-aa9fd873-b664-4afe-a4f0-a79d9f32c083 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:47.768901 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7cb8d30-85c8-4008-b973-4d6f78f92e93 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 30, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:30:47.770851 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7cb8d30-85c8-4008-b973-4d6f78f92e93 None None] Checking segment: {'id': '65abba88-0391-46a9-860b-6e03a3ed017e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 343, 'network_id': 'f1806145-f899-452a-9fed-c9a23870b515'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:30:47.771417 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e7cb8d30-85c8-4008-b973-4d6f78f92e93 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:47.772683 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7cb8d30-85c8-4008-b973-4d6f78f92e93 None None] Bound using segment: {'id': '65abba88-0391-46a9-860b-6e03a3ed017e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 343, 'network_id': 'f1806145-f899-452a-9fed-c9a23870b515'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:30:47.773284 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-e7cb8d30-85c8-4008-b973-4d6f78f92e93 None None] Bound port: 87efc66a-74ea-46b3-be1c-7def2ac70303, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '65abba88-0391-46a9-860b-6e03a3ed017e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 343, 'network_id': 'f1806145-f899-452a-9fed-c9a23870b515'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:30:47.776030 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e7cb8d30-85c8-4008-b973-4d6f78f92e93 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:47.787941 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2caa0e0c-1e48-4b5b-a6a5-8de2d07bdf77 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:47.796571 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8025cb3e-2071-42d7-b4ce-71b3338a5976 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks [] for router, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:47.808678 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c752c7b-6ca7-4e83-a383-97d35e1129bf tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event deleted for resources: {'Subnet': ['ID=65e6912e-4232-4d7d-9de9-d0574b22fe1f,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:47.867002 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e7cb8d30-85c8-4008-b973-4d6f78f92e93 None None] For port 87efc66a-74ea-46b3-be1c-7def2ac70303, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:30:47.871257 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e7cb8d30-85c8-4008-b973-4d6f78f92e93 None None] For port 87efc66a-74ea-46b3-be1c-7def2ac70303, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=87efc66a-74ea-46b3-be1c-7def2ac70303,segment=NetworkSegment(65abba88-0391-46a9-860b-6e03a3ed017e),segment_id=65abba88-0391-46a9-860b-6e03a3ed017e)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:30:47.894957 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-551e9831-6df5-4c09-999f-4f6ae7a0d09d None None] Set router 5023cfbb-afb2-4e33-bdc1-c1173218f6bf gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:30:47.912158 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e4c888bb-f6e0-42fc-9c97-cb0721bd9012 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks [] for router_gateway, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:47.941471 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e7cb8d30-85c8-4008-b973-4d6f78f92e93 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:47.952390 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e4c888bb-f6e0-42fc-9c97-cb0721bd9012 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:48.022386 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7cb8d30-85c8-4008-b973-4d6f78f92e93 None None] Pushing event updated for resources: {'Port': ['ID=87efc66a-74ea-46b3-be1c-7def2ac70303,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:48.045166 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-be91cca2-d77b-4cbd-856f-dbf46eea1fbc tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:48.050820 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8025cb3e-2071-42d7-b4ce-71b3338a5976 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:48.065775 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8025cb3e-2071-42d7-b4ce-71b3338a5976 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:48.171310 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7241efd9-6292-4618-bada-f1e8031d1a8a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:48.214306 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8025cb3e-2071-42d7-b4ce-71b3338a5976 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:48.215299 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8025cb3e-2071-42d7-b4ce-71b3338a5976 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Fanout notify agent at l3_agent the message router_deleted on router 261d799f-49ff-439f-8e9c-bb4bf5bd54f1 {{(pid=102162) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:30:48.224482 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7241efd9-6292-4618-bada-f1e8031d1a8a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event deleted for resources: {'Subnet': ['ID=c31edbab-096a-4d5c-80c7-21775d0297d8,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:48.241687 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8025cb3e-2071-42d7-b4ce-71b3338a5976 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:48.243321 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-8025cb3e-2071-42d7-b4ce-71b3338a5976 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] 10.222.0.24 "DELETE /v2.0/routers/261d799f-49ff-439f-8e9c-bb4bf5bd54f1 HTTP/1.1" status: 204 len: 168 time: 0.6104083 Nov 09 04:30:48.253562 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54882) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:48.340916 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-be91cca2-d77b-4cbd-856f-dbf46eea1fbc tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Deleting port f77ff47a-4d0e-4c2f-84e5-d451dd4abe75 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:30:48.341339 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-be91cca2-d77b-4cbd-856f-dbf46eea1fbc tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:48.344398 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bb8fdd27-d371-402d-8590-181a214d4215 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:48.416660 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e2044cc4-3a57-49aa-94e8-569c27080bf1 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] 10.222.0.24 "GET /v2.0/ports?device_id=261d799f-49ff-439f-8e9c-bb4bf5bd54f1 HTTP/1.1" status: 200 len: 205 time: 0.1523881 Nov 09 04:30:48.417556 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54884) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:48.453315 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-551e9831-6df5-4c09-999f-4f6ae7a0d09d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5023cfbb-afb2-4e33-bdc1-c1173218f6bf', 'name': 'tempest-ServerActionsTestJSON-1211051012-router', 'tenant_id': '6015befde7f546d881cb247ae5bc81ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.95'}], 'enable_snat': True}, 'gw_port_id': 'a4e20770-3342-4c9b-a9bf-d4dab52b7d8d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:30:28Z', 'updated_at': '2021-11-09T04:30:43Z', 'revision_number': 4, 'project_id': '6015befde7f546d881cb247ae5bc81ae', 'gw_port': {'id': 'a4e20770-3342-4c9b-a9bf-d4dab52b7d8d', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:03:2b:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5023cfbb-afb2-4e33-bdc1-c1173218f6bf', 'device_owner': 'network:router_gateway', 'standard_attr_id': 499, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:30:29Z', 'updated_at': '2021-11-09T04:30:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'e025929c-44cc-4832-b4a4-0216288df212', 'name': '', 'network_id': 'a270b61c-1f4f-4d97-be79-4a24c65fddc2', 'tenant_id': '6015befde7f546d881cb247ae5bc81ae', 'mac_address': 'fa:16:3e:7a:69:40', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5023cfbb-afb2-4e33-bdc1-c1173218f6bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 539, 'fixed_ips': [{'subnet_id': 'b2956e71-9b0f-4060-922c-e54ce6cff80a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:30:40Z', 'updated_at': '2021-11-09T04:30:47Z', 'revision_number': 4, 'project_id': '6015befde7f546d881cb247ae5bc81ae', 'subnets': [{'id': 'b2956e71-9b0f-4060-922c-e54ce6cff80a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:48.457684 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7241efd9-6292-4618-bada-f1e8031d1a8a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:48.484163 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-551e9831-6df5-4c09-999f-4f6ae7a0d09d None None] The sync data for ids ['5023cfbb-afb2-4e33-bdc1-c1173218f6bf'] in dv-neutron-816802-2-hyperv is: [{'id': '5023cfbb-afb2-4e33-bdc1-c1173218f6bf', 'name': 'tempest-ServerActionsTestJSON-1211051012-router', 'tenant_id': '6015befde7f546d881cb247ae5bc81ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.95'}], 'enable_snat': True}, 'gw_port_id': 'a4e20770-3342-4c9b-a9bf-d4dab52b7d8d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:30:28Z', 'updated_at': '2021-11-09T04:30:43Z', 'revision_number': 4, 'project_id': '6015befde7f546d881cb247ae5bc81ae', 'gw_port': {'id': 'a4e20770-3342-4c9b-a9bf-d4dab52b7d8d', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:03:2b:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5023cfbb-afb2-4e33-bdc1-c1173218f6bf', 'device_owner': 'network:router_gateway', 'standard_attr_id': 499, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:30:29Z', 'updated_at': '2021-11-09T04:30:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'e025929c-44cc-4832-b4a4-0216288df212', 'name': '', 'network_id': 'a270b61c-1f4f-4d97-be79-4a24c65fddc2', 'tenant_id': '6015befde7f546d881cb247ae5bc81ae', 'mac_address': 'fa:16:3e:7a:69:40', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5023cfbb-afb2-4e33-bdc1-c1173218f6bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 539, 'fixed_ips': [{'subnet_id': 'b2956e71-9b0f-4060-922c-e54ce6cff80a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:30:40Z', 'updated_at': '2021-11-09T04:30:47Z', 'revision_number': 4, 'project_id': '6015befde7f546d881cb247ae5bc81ae', 'subnets': [{'id': 'b2956e71-9b0f-4060-922c-e54ce6cff80a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:30:48.488495 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-7241efd9-6292-4618-bada-f1e8031d1a8a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f1806145-f899-452a-9fed-c9a23870b515']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:48.497085 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54886) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:48.512389 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.api.v2.resource [None req-49e9e11c-c687-4686-8ca5-aaf8712ef467 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] delete failed (client error): The resource could not be found. Nov 09 04:30:48.515396 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-49e9e11c-c687-4686-8ca5-aaf8712ef467 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] 10.222.0.24 "DELETE /v2.0/routers/261d799f-49ff-439f-8e9c-bb4bf5bd54f1 HTTP/1.1" status: 404 len: 336 time: 0.0823016 Nov 09 04:30:48.520149 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54888) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:48.541672 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bb8fdd27-d371-402d-8590-181a214d4215 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:48.571682 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-e4c888bb-f6e0-42fc-9c97-cb0721bd9012 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Allocated IP 172.26.0.69 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/8508be40-2af9-45a5-96f0-06d142f33d8d) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:30:48.575154 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-bc400d37-589c-41e4-96af-8f5d00ae2bad tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] 10.222.0.24 "GET /v2.0/ports?device_id=9e078f7a-7765-4972-8cd2-e5085db47ecf HTTP/1.1" status: 200 len: 205 time: 0.0526769 Nov 09 04:30:48.583175 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54892) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:48.586302 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-7241efd9-6292-4618-bada-f1e8031d1a8a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '65abba88-0391-46a9-860b-6e03a3ed017e') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:48.587273 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 87efc66a-74ea-46b3-be1c-7def2ac70303 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:30:48.588024 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-7241efd9-6292-4618-bada-f1e8031d1a8a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '65abba88-0391-46a9-860b-6e03a3ed017e') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:48.618658 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7241efd9-6292-4618-bada-f1e8031d1a8a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:48.632385 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-be91cca2-d77b-4cbd-856f-dbf46eea1fbc tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] For port f77ff47a-4d0e-4c2f-84e5-d451dd4abe75, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=f77ff47a-4d0e-4c2f-84e5-d451dd4abe75,segment=NetworkSegment(30da2c7b-8ba0-4c22-9597-3763f0be3551),segment_id=30da2c7b-8ba0-4c22-9597-3763f0be3551)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:30:48.633944 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-be91cca2-d77b-4cbd-856f-dbf46eea1fbc tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:48.667321 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 87efc66a-74ea-46b3-be1c-7def2ac70303 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:30:48.667850 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:48.711786 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7241efd9-6292-4618-bada-f1e8031d1a8a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:48.732314 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.api.v2.resource [None req-091d19af-6ad3-48b2-a404-485e96ed365b tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] delete failed (client error): The resource could not be found. Nov 09 04:30:48.733374 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-091d19af-6ad3-48b2-a404-485e96ed365b tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] 10.222.0.24 "DELETE /v2.0/routers/9e078f7a-7765-4972-8cd2-e5085db47ecf HTTP/1.1" status: 404 len: 336 time: 0.1320500 Nov 09 04:30:48.736569 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-be91cca2-d77b-4cbd-856f-dbf46eea1fbc tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Calling delete_port for f77ff47a-4d0e-4c2f-84e5-d451dd4abe75 owned by network:dhcp {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:30:48.737160 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb8fdd27-d371-402d-8590-181a214d4215 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Pushing event updated for resources: {'SecurityGroup': ['ID=e441bd2c-e53d-45df-ab4c-85115d8b53a7,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:48.743164 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54894) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:48.779010 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bb8fdd27-d371-402d-8590-181a214d4215 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:48.780273 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-bb8fdd27-d371-402d-8590-181a214d4215 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 1.4111328 Nov 09 04:30:48.781597 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7241efd9-6292-4618-bada-f1e8031d1a8a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Releasing vlan 343 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:30:48.782577 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7241efd9-6292-4618-bada-f1e8031d1a8a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:48.791314 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:30:48.791314 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:30:48.791314 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:30:48.791314 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:30:48.791314 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:30:48.791314 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:30:48.791314 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:30:48.791314 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:30:48.791314 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:30:48.791314 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:30:48.791314 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:30:48.791314 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:30:48.791314 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:30:48.791314 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:30:48.791314 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:30:48.791314 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:30:48.791314 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:30:48.791314 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:30:48.791314 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:30:48.791314 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:30:48.791314 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:30:48.791314 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:30:48.791314 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:30:48.791314 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:30:48.791314 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:30:48.791314 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:30:48.791314 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:30:48.791314 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:30:48.791314 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:30:48.791314 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:30:48.791314 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:30:48.791314 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:30:48.809196 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:48.830081 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54896) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:48.854049 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 87efc66a-74ea-46b3-be1c-7def2ac70303, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=87efc66a-74ea-46b3-be1c-7def2ac70303,segment=NetworkSegment(65abba88-0391-46a9-860b-6e03a3ed017e),segment_id=65abba88-0391-46a9-860b-6e03a3ed017e)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:30:48.883057 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-84d7aa48-e9bf-4d3b-88c0-e08d591d55f4 tempest-RoutersAdminNegativeTest-1441694984 tempest-RoutersAdminNegativeTest-1441694984-project-admin] Request body: {'port': {'name': 'tempest-RoutersAdminNegativeTest-870468989', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:48.888862 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-073c1f28-e6f2-4e6d-a4ef-a55e46aadda5 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Request body: {'security_group_rule': {'security_group_id': 'e441bd2c-e53d-45df-ab4c-85115d8b53a7', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:48.930789 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-9e73b5d9-cbcf-4319-a3d2-4ba5c53015db tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] 10.222.0.24 "GET /v2.0/ports?device_id=456b7559-d36a-4838-be45-e4472d3b3437 HTTP/1.1" status: 200 len: 205 time: 0.1781676 Nov 09 04:30:48.940956 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:48.949221 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54898) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:48.959383 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-aa9fd873-b664-4afe-a4f0-a79d9f32c083 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:49.000484 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-be91cca2-d77b-4cbd-856f-dbf46eea1fbc tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:49.002732 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.api.v2.resource [None req-0d807486-14e1-4c2b-aad6-1b24bae1aa24 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] delete failed (client error): The resource could not be found. Nov 09 04:30:49.007190 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-0d807486-14e1-4c2b-aad6-1b24bae1aa24 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] 10.222.0.24 "DELETE /v2.0/routers/456b7559-d36a-4838-be45-e4472d3b3437 HTTP/1.1" status: 404 len: 336 time: 0.0569537 Nov 09 04:30:49.011518 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54900) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:49.017614 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.db.api [None req-7241efd9-6292-4618-bada-f1e8031d1a8a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Nov 09 04:30:49.017614 dv-neutron-816802-2-hyperv neutron-server[102161]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Nov 09 04:30:49.017614 dv-neutron-816802-2-hyperv neutron-server[102161]: [parameters: {'id': 'f1806145-f899-452a-9fed-c9a23870b515'}] Nov 09 04:30:49.017614 dv-neutron-816802-2-hyperv neutron-server[102161]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=102161) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:30:49.018291 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG oslo_db.api [None req-7241efd9-6292-4618-bada-f1e8031d1a8a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:30:49.027902 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=87efc66a-74ea-46b3-be1c-7def2ac70303,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:49.056288 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be91cca2-d77b-4cbd-856f-dbf46eea1fbc tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event deleted for resources: {'Port': ['ID=f77ff47a-4d0e-4c2f-84e5-d451dd4abe75,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:49.060942 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-adfd44aa-736b-453f-99ef-6cdd8d40a039 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] 10.222.0.24 "GET /v2.0/ports?device_id=bac0f9e1-4e8b-4938-b8b0-48cbafecf6cd HTTP/1.1" status: 200 len: 205 time: 0.0446889 Nov 09 04:30:49.061843 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-aa9fd873-b664-4afe-a4f0-a79d9f32c083 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:49.064092 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54902) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:49.078206 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-be91cca2-d77b-4cbd-856f-dbf46eea1fbc tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] No DVR routers for this DVR port f77ff47a-4d0e-4c2f-84e5-d451dd4abe75 on host dv-neutron-816802-2-hyperv {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:30:49.155955 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-84d7aa48-e9bf-4d3b-88c0-e08d591d55f4 tempest-RoutersAdminNegativeTest-1441694984 tempest-RoutersAdminNegativeTest-1441694984-project-admin] Made reservation on behalf of f1e5b31f33b04a78b3494cc9ea9d6500 for: {'port': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:30:49.159175 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-84d7aa48-e9bf-4d3b-88c0-e08d591d55f4 tempest-RoutersAdminNegativeTest-1441694984 tempest-RoutersAdminNegativeTest-1441694984-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:49.168402 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa9fd873-b664-4afe-a4f0-a79d9f32c083 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event updated for resources: {'Port': ['ID=15453fb5-186c-4eec-947f-e2f2717366a7,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:49.188713 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e4c888bb-f6e0-42fc-9c97-cb0721bd9012 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:49.202488 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-84d7aa48-e9bf-4d3b-88c0-e08d591d55f4 tempest-RoutersAdminNegativeTest-1441694984 tempest-RoutersAdminNegativeTest-1441694984-project-admin] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:49.241344 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-073c1f28-e6f2-4e6d-a4ef-a55e46aadda5 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:49.247331 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-aa9fd873-b664-4afe-a4f0-a79d9f32c083 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:49.371199 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.api.v2.resource [None req-bf17fa72-742c-47a5-a9f3-1fc87e99efb4 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] delete failed (client error): The resource could not be found. Nov 09 04:30:49.372561 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-bf17fa72-742c-47a5-a9f3-1fc87e99efb4 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] 10.222.0.24 "DELETE /v2.0/routers/bac0f9e1-4e8b-4938-b8b0-48cbafecf6cd HTTP/1.1" status: 404 len: 336 time: 0.3052814 Nov 09 04:30:49.377792 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54904) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:49.404819 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-510ec763-9c40-4126-aaad-e42b5ae25dad None None] Network f1806145-f899-452a-9fed-c9a23870b515 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:30:49.436637 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-073c1f28-e6f2-4e6d-a4ef-a55e46aadda5 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:49.441431 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e4c888bb-f6e0-42fc-9c97-cb0721bd9012 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:49.446339 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2caa0e0c-1e48-4b5b-a6a5-8de2d07bdf77 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-466202', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-464271', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-936'] for router, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:49.467736 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-8462240a-35b2-4897-bdcd-21897b492ab8 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] 10.222.0.24 "GET /v2.0/ports?device_id=c9161b00-e513-429d-9e36-6b99b1929705 HTTP/1.1" status: 200 len: 205 time: 0.0887086 Nov 09 04:30:49.478329 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54906) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:49.514066 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4c888bb-f6e0-42fc-9c97-cb0721bd9012 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Pushing event updated for resources: {'Port': ['ID=8508be40-2af9-45a5-96f0-06d142f33d8d,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:49.532088 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7241efd9-6292-4618-bada-f1e8031d1a8a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:49.533977 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-073c1f28-e6f2-4e6d-a4ef-a55e46aadda5 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:49.572408 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-073c1f28-e6f2-4e6d-a4ef-a55e46aadda5 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0a38deb7-ca7b-4269-a39d-1c0b60c9c0cc,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:49.585449 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e4c888bb-f6e0-42fc-9c97-cb0721bd9012 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:30:49.595502 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-e4c888bb-f6e0-42fc-9c97-cb0721bd9012 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:49.598348 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e4c888bb-f6e0-42fc-9c97-cb0721bd9012 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:30:49.619557 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-36c651d9-2de4-4614-9f88-e02930c3f9fd None None] Provisioning complete for port 87efc66a-74ea-46b3-be1c-7def2ac70303 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:30:49.619921 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-36c651d9-2de4-4614-9f88-e02930c3f9fd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:49.641070 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.api.v2.resource [None req-a8e1fe6b-f660-4a94-8034-59351aeef586 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] delete failed (client error): The resource could not be found. Nov 09 04:30:49.645138 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a8e1fe6b-f660-4a94-8034-59351aeef586 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] 10.222.0.24 "DELETE /v2.0/routers/c9161b00-e513-429d-9e36-6b99b1929705 HTTP/1.1" status: 404 len: 336 time: 0.1651416 Nov 09 04:30:49.646970 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2caa0e0c-1e48-4b5b-a6a5-8de2d07bdf77 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-466195', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-466408', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-464260'] for router, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:49.659369 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54908) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:49.688678 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-84d7aa48-e9bf-4d3b-88c0-e08d591d55f4 tempest-RoutersAdminNegativeTest-1441694984 tempest-RoutersAdminNegativeTest-1441694984-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:49.694005 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-be91cca2-d77b-4cbd-856f-dbf46eea1fbc tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:49.734763 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-71356d23-c1f8-46b9-b369-ddaf32c638d2 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] 10.222.0.24 "GET /v2.0/ports?device_id=a43fa85f-7459-401e-af22-bf37c55be422 HTTP/1.1" status: 200 len: 205 time: 0.0743742 Nov 09 04:30:49.738406 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54910) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:49.759285 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aa9fd873-b664-4afe-a4f0-a79d9f32c083 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Network 0a61eb3b-f9c4-4bc0-94dd-9f48ad858a9d is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:30:49.764934 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-84d7aa48-e9bf-4d3b-88c0-e08d591d55f4 tempest-RoutersAdminNegativeTest-1441694984 tempest-RoutersAdminNegativeTest-1441694984-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:49.773989 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-aa9fd873-b664-4afe-a4f0-a79d9f32c083 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:49.786178 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [None req-84d7aa48-e9bf-4d3b-88c0-e08d591d55f4 tempest-RoutersAdminNegativeTest-1441694984 tempest-RoutersAdminNegativeTest-1441694984-project-admin] device_id is not set on port 97be4e79-2b86-4f13-9740-332a5207ee11 yet. {{(pid=102161) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:30:49.864209 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e5b657de-c9a9-4292-81b5-9fcad3d458be None None] Network f1806145-f899-452a-9fed-c9a23870b515 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:30:49.866008 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-073c1f28-e6f2-4e6d-a4ef-a55e46aadda5 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:49.869541 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-073c1f28-e6f2-4e6d-a4ef-a55e46aadda5 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 1.0139976 Nov 09 04:30:49.890317 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7aa3cbc0-9112-4bca-ad46-9b0118ab49d3 None None] Network dee7e689-a388-42bb-96eb-2960b07f7335 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:30:49.895304 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-be91cca2-d77b-4cbd-856f-dbf46eea1fbc tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['dee7e689-a388-42bb-96eb-2960b07f7335']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:49.900071 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54912) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:49.906392 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-3015b1c5-3af6-4308-a11b-31076cbb0596 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Request body: {'security_group_rule': {'security_group_id': 'e441bd2c-e53d-45df-ab4c-85115d8b53a7', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:49.925191 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.api.v2.resource [None req-3d354380-582c-49e3-83de-e29dfc5ce408 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] delete failed (client error): The resource could not be found. Nov 09 04:30:49.926326 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-3d354380-582c-49e3-83de-e29dfc5ce408 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] 10.222.0.24 "DELETE /v2.0/routers/a43fa85f-7459-401e-af22-bf37c55be422 HTTP/1.1" status: 404 len: 336 time: 0.1180427 Nov 09 04:30:49.938286 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54914) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:49.950058 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-be91cca2-d77b-4cbd-856f-dbf46eea1fbc tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '30da2c7b-8ba0-4c22-9597-3763f0be3551') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:49.950310 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-be91cca2-d77b-4cbd-856f-dbf46eea1fbc tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '30da2c7b-8ba0-4c22-9597-3763f0be3551') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:49.992180 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-a01a734a-37c9-435f-a9ec-d7318a8bf175 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] DELETE failed (client error): The resource could not be found. Nov 09 04:30:49.992732 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a01a734a-37c9-435f-a9ec-d7318a8bf175 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:30:49.999919 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a01a734a-37c9-435f-a9ec-d7318a8bf175 tempest-RoutersIpV6AdminTest-366297031 tempest-RoutersIpV6AdminTest-366297031-project] 10.222.0.24 "DELETE /v2.0/subnets/aa65f5f6-77d4-4b7b-b90f-b2ffac782dc1 HTTP/1.1" status: 404 len: 337 time: 0.0546410 Nov 09 04:30:50.000113 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84d7aa48-e9bf-4d3b-88c0-e08d591d55f4 tempest-RoutersAdminNegativeTest-1441694984 tempest-RoutersAdminNegativeTest-1441694984-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=476e53da-24ae-4e3f-938f-448b2d448381,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:50.023409 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-be91cca2-d77b-4cbd-856f-dbf46eea1fbc tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:50.125515 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-be91cca2-d77b-4cbd-856f-dbf46eea1fbc tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:50.140908 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-c5389116-0caa-4033-a9a1-7fc8b710e5ec None None] Provisioning complete for port 15453fb5-186c-4eec-947f-e2f2717366a7 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:30:50.141847 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c5389116-0caa-4033-a9a1-7fc8b710e5ec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:50.163441 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-be91cca2-d77b-4cbd-856f-dbf46eea1fbc tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Releasing vlan 309 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:30:50.163848 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-be91cca2-d77b-4cbd-856f-dbf46eea1fbc tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:50.167352 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:30:50.167352 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:30:50.167352 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:30:50.167352 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:30:50.167352 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:30:50.167352 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:30:50.167352 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:30:50.167352 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:30:50.167352 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:30:50.167352 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:30:50.167352 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:30:50.167352 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:30:50.167352 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:30:50.167352 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:30:50.167352 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:30:50.167352 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:30:50.167352 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:30:50.167352 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:30:50.167352 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:30:50.167352 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:30:50.167352 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:30:50.167352 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:30:50.167352 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:30:50.167352 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:30:50.167352 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:30:50.167352 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:30:50.167352 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:30:50.167352 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:30:50.167352 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:30:50.167352 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:30:50.167352 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:30:50.167352 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:30:50.272276 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3015b1c5-3af6-4308-a11b-31076cbb0596 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:50.277356 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-c5389116-0caa-4033-a9a1-7fc8b710e5ec None None] Port 15453fb5-186c-4eec-947f-e2f2717366a7 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:30:50.303987 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-c5389116-0caa-4033-a9a1-7fc8b710e5ec None None] Provisioning complete for port e025929c-44cc-4832-b4a4-0216288df212 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:30:50.314881 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c5389116-0caa-4033-a9a1-7fc8b710e5ec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:50.330966 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2caa0e0c-1e48-4b5b-a6a5-8de2d07bdf77 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Router 454f4384-6780-4402-98ea-5edbe666cd33 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:30:50.385957 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-7241efd9-6292-4618-bada-f1e8031d1a8a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Deleting port 87efc66a-74ea-46b3-be1c-7def2ac70303 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:30:50.386763 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7241efd9-6292-4618-bada-f1e8031d1a8a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:50.394078 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e01faf71-6933-4e6e-88b2-aac09226c1c6 None None] DHCP port deletion for dee7e689-a388-42bb-96eb-2960b07f7335 request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:30:50.396472 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3015b1c5-3af6-4308-a11b-31076cbb0596 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:50.407771 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cd05dca5-2dfd-4f9d-9070-003eec89ec12 None None] DHCP port deletion for f1806145-f899-452a-9fed-c9a23870b515 request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:30:50.456086 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-7241efd9-6292-4618-bada-f1e8031d1a8a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] For port 87efc66a-74ea-46b3-be1c-7def2ac70303, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=87efc66a-74ea-46b3-be1c-7def2ac70303,segment=NetworkSegment(65abba88-0391-46a9-860b-6e03a3ed017e),segment_id=65abba88-0391-46a9-860b-6e03a3ed017e)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:30:50.456625 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7241efd9-6292-4618-bada-f1e8031d1a8a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:50.469600 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-7241efd9-6292-4618-bada-f1e8031d1a8a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Calling delete_port for 87efc66a-74ea-46b3-be1c-7def2ac70303 owned by network:dhcp {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:30:50.483892 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c5389116-0caa-4033-a9a1-7fc8b710e5ec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:50.502408 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-aa9fd873-b664-4afe-a4f0-a79d9f32c083 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Router 3a5287b2-31f6-4415-beea-0718ba71be47 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:30:50.505582 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-be91cca2-d77b-4cbd-856f-dbf46eea1fbc tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:50.509716 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3015b1c5-3af6-4308-a11b-31076cbb0596 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:50.542137 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-be91cca2-d77b-4cbd-856f-dbf46eea1fbc tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:50.545079 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-c5389116-0caa-4033-a9a1-7fc8b710e5ec None None] For port e025929c-44cc-4832-b4a4-0216288df212, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=e025929c-44cc-4832-b4a4-0216288df212,segment=NetworkSegment(e211d893-ee7a-48e3-bc29-b8824167e15b),segment_id=e211d893-ee7a-48e3-bc29-b8824167e15b)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:30:50.545942 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-be91cca2-d77b-4cbd-856f-dbf46eea1fbc tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "DELETE /v2.0/networks/dee7e689-a388-42bb-96eb-2960b07f7335 HTTP/1.1" status: 204 len: 168 time: 2.9773970 Nov 09 04:30:50.553887 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3015b1c5-3af6-4308-a11b-31076cbb0596 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=15228a0a-4990-4ad5-b770-c72b0d75eec0,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:50.554228 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54918) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:50.559484 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-12a2495e-779a-4756-8599-25a6f79bbd28 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Request body: {'port': {'network_id': 'cc397c48-c4cc-4846-a1ef-380b64be450d', 'name': 'tempest-PortsTestJSON-99915930'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:50.577529 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device e025929c-44cc-4832-b4a4-0216288df212 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:30:50.579699 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2caa0e0c-1e48-4b5b-a6a5-8de2d07bdf77 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:30:50.592783 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-cd05dca5-2dfd-4f9d-9070-003eec89ec12 None None] Deleting port 87efc66a-74ea-46b3-be1c-7def2ac70303 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:30:50.593433 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-cd05dca5-2dfd-4f9d-9070-003eec89ec12 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:50.594879 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2a12d597-17c0-460b-8183-8b7d257f093f None None] Sync routers for ids ['454f4384-6780-4402-98ea-5edbe666cd33'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:30:50.607861 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be91cca2-d77b-4cbd-856f-dbf46eea1fbc tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event deleted for resources: {'Network': ['ID=dee7e689-a388-42bb-96eb-2960b07f7335,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:50.618924 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2a12d597-17c0-460b-8183-8b7d257f093f None None] Routers {'454f4384-6780-4402-98ea-5edbe666cd33'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:30:50.619453 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-2a12d597-17c0-460b-8183-8b7d257f093f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:30:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['454f4384-6780-4402-98ea-5edbe666cd33'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:50.625152 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2caa0e0c-1e48-4b5b-a6a5-8de2d07bdf77 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:50.643931 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-2caa0e0c-1e48-4b5b-a6a5-8de2d07bdf77 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] 10.222.0.24 "PUT /v2.0/routers/454f4384-6780-4402-98ea-5edbe666cd33 HTTP/1.1" status: 200 len: 921 time: 4.7258716 Nov 09 04:30:50.645494 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54922) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:50.653690 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c5389116-0caa-4033-a9a1-7fc8b710e5ec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:50.695496 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-2a12d597-17c0-460b-8183-8b7d257f093f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:50.712594 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2a12d597-17c0-460b-8183-8b7d257f093f None None] Routers {'454f4384-6780-4402-98ea-5edbe666cd33'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:30:50.713371 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-2a12d597-17c0-460b-8183-8b7d257f093f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:30:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['454f4384-6780-4402-98ea-5edbe666cd33'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:50.720509 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54924) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:50.755848 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-2a12d597-17c0-460b-8183-8b7d257f093f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:50.756762 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2a12d597-17c0-460b-8183-8b7d257f093f None None] The sync data for ids ['454f4384-6780-4402-98ea-5edbe666cd33'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:30:50.769245 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3015b1c5-3af6-4308-a11b-31076cbb0596 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:50.770678 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-3015b1c5-3af6-4308-a11b-31076cbb0596 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.8691707 Nov 09 04:30:50.776284 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54928) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:50.782904 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-cd05dca5-2dfd-4f9d-9070-003eec89ec12 None None] For port 87efc66a-74ea-46b3-be1c-7def2ac70303, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=87efc66a-74ea-46b3-be1c-7def2ac70303,segment=NetworkSegment(65abba88-0391-46a9-860b-6e03a3ed017e),segment_id=65abba88-0391-46a9-860b-6e03a3ed017e)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:30:50.783305 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-cd05dca5-2dfd-4f9d-9070-003eec89ec12 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:50.785490 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-d6de32d8-12ae-4856-b20f-974d49d12364 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Request body: {'floatingip': {'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:50.829648 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-cd05dca5-2dfd-4f9d-9070-003eec89ec12 None None] Calling delete_port for 87efc66a-74ea-46b3-be1c-7def2ac70303 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:30:50.853552 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5389116-0caa-4033-a9a1-7fc8b710e5ec None None] Pushing event updated for resources: {'Port': ['ID=e025929c-44cc-4832-b4a4-0216288df212,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:50.865482 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port e025929c-44cc-4832-b4a4-0216288df212 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:30:50.866095 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:50.868097 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-20f5fb4d-cd0b-43cb-b1f6-e53484947c1e None None] Provisioning complete for port 15453fb5-186c-4eec-947f-e2f2717366a7 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:30:50.868465 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-20f5fb4d-cd0b-43cb-b1f6-e53484947c1e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:50.936624 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-84d7aa48-e9bf-4d3b-88c0-e08d591d55f4 tempest-RoutersAdminNegativeTest-1441694984 tempest-RoutersAdminNegativeTest-1441694984-project-admin] Allocated IP 172.26.0.109 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/97be4e79-2b86-4f13-9740-332a5207ee11) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:30:50.939672 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-20f5fb4d-cd0b-43cb-b1f6-e53484947c1e None None] Port 15453fb5-186c-4eec-947f-e2f2717366a7 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:30:51.012640 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-20f5fb4d-cd0b-43cb-b1f6-e53484947c1e None None] Provisioning complete for port e025929c-44cc-4832-b4a4-0216288df212 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:30:51.013014 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-20f5fb4d-cd0b-43cb-b1f6-e53484947c1e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:51.091441 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-cd05dca5-2dfd-4f9d-9070-003eec89ec12 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:51.128756 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7241efd9-6292-4618-bada-f1e8031d1a8a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:51.131917 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd05dca5-2dfd-4f9d-9070-003eec89ec12 None None] Pushing event deleted for resources: {'Port': ['ID=87efc66a-74ea-46b3-be1c-7def2ac70303,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:51.137356 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cd05dca5-2dfd-4f9d-9070-003eec89ec12 None None] No DVR routers for this DVR port 87efc66a-74ea-46b3-be1c-7def2ac70303 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:30:51.219215 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device f77ff47a-4d0e-4c2f-84e5-d451dd4abe75 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:30:51.241583 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d6de32d8-12ae-4856-b20f-974d49d12364 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Publish callbacks [] for floatingip, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:51.241817 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: f77ff47a-4d0e-4c2f-84e5-d451dd4abe75 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:30:51.242082 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device f77ff47a-4d0e-4c2f-84e5-d451dd4abe75 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:30:51.251562 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 87efc66a-74ea-46b3-be1c-7def2ac70303 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:30:51.269999 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 87efc66a-74ea-46b3-be1c-7def2ac70303 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:30:51.269999 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 87efc66a-74ea-46b3-be1c-7def2ac70303 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:30:51.275098 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7241efd9-6292-4618-bada-f1e8031d1a8a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event deleted for resources: {'Port': ['ID=87efc66a-74ea-46b3-be1c-7def2ac70303,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:51.276933 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2b553915-e089-464d-b07f-79411fa508d5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:51.279127 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7241efd9-6292-4618-bada-f1e8031d1a8a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] No DVR routers for this DVR port 87efc66a-74ea-46b3-be1c-7def2ac70303 on host dv-neutron-816802-2-hyperv {{(pid=102161) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:30:51.289111 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-3c3d0a80-cdd4-417b-a08e-c1759a8fb31f tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] 10.222.0.24 "GET /v2.0/routers/454f4384-6780-4402-98ea-5edbe666cd33 HTTP/1.1" status: 200 len: 921 time: 0.6396928 Nov 09 04:30:51.290488 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54930) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:51.303695 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-aa9fd873-b664-4afe-a4f0-a79d9f32c083 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:30:51.311794 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-aa9fd873-b664-4afe-a4f0-a79d9f32c083 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "PUT /v2.0/routers/3a5287b2-31f6-4415-beea-0718ba71be47/add_router_interface HTTP/1.1" status: 200 len: 503 time: 8.4992101 Nov 09 04:30:51.313661 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54932) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:51.315448 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e15ce619-aa45-42d9-aa08-5fa8a203308f None None] Sync routers for ids ['3a5287b2-31f6-4415-beea-0718ba71be47'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:30:51.327594 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e15ce619-aa45-42d9-aa08-5fa8a203308f None None] Routers {'3a5287b2-31f6-4415-beea-0718ba71be47'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:30:51.336558 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-e15ce619-aa45-42d9-aa08-5fa8a203308f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:30:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['3a5287b2-31f6-4415-beea-0718ba71be47'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:51.363483 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-e15ce619-aa45-42d9-aa08-5fa8a203308f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:51.366953 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-12a2495e-779a-4756-8599-25a6f79bbd28 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Made reservation on behalf of 88f9f8da29bf4a8793b45130d483a6e6 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:30:51.372538 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-12a2495e-779a-4756-8599-25a6f79bbd28 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:51.372971 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e15ce619-aa45-42d9-aa08-5fa8a203308f None None] Routers {'3a5287b2-31f6-4415-beea-0718ba71be47'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:30:51.373579 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-e15ce619-aa45-42d9-aa08-5fa8a203308f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:30:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['3a5287b2-31f6-4415-beea-0718ba71be47'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:51.390795 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e4c888bb-f6e0-42fc-9c97-cb0721bd9012 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks [] for router_gateway, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:51.411040 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-e15ce619-aa45-42d9-aa08-5fa8a203308f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:51.411612 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e15ce619-aa45-42d9-aa08-5fa8a203308f None None] The sync data for ids ['3a5287b2-31f6-4415-beea-0718ba71be47'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:30:51.424173 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [None req-12a2495e-779a-4756-8599-25a6f79bbd28 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] device_id is not set on port 090d1dc7-3b92-4012-8ddd-3bcf1ef59daf yet. {{(pid=102162) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:30:51.434904 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d25b6535-a3e4-46e4-b258-a657bd31af2e tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:51.436631 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-d25b6535-a3e4-46e4-b258-a657bd31af2e tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] 10.222.0.24 "GET /v2.0/ports?network_id=2b6725f5-ebfe-485a-8f42-ccb5a241ddb5&device_id=454f4384-6780-4402-98ea-5edbe666cd33&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 945 time: 0.1395869 Nov 09 04:30:51.440631 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54934) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:51.506734 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-60141b97-a0df-49b4-85fd-2fe57f95dc81 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:51.508130 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-60141b97-a0df-49b4-85fd-2fe57f95dc81 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "GET /v2.0/ports/15453fb5-186c-4eec-947f-e2f2717366a7 HTTP/1.1" status: 200 len: 910 time: 0.1620471 Nov 09 04:30:51.513479 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-84d7aa48-e9bf-4d3b-88c0-e08d591d55f4 tempest-RoutersAdminNegativeTest-1441694984 tempest-RoutersAdminNegativeTest-1441694984-project-admin] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:51.516213 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54936) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:51.517153 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7241efd9-6292-4618-bada-f1e8031d1a8a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:51.583914 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-7241efd9-6292-4618-bada-f1e8031d1a8a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f1806145-f899-452a-9fed-c9a23870b515']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:51.609392 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-7241efd9-6292-4618-bada-f1e8031d1a8a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '65abba88-0391-46a9-860b-6e03a3ed017e') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:51.609689 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-7241efd9-6292-4618-bada-f1e8031d1a8a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '65abba88-0391-46a9-860b-6e03a3ed017e') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:51.629044 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7241efd9-6292-4618-bada-f1e8031d1a8a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:51.647479 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7241efd9-6292-4618-bada-f1e8031d1a8a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:51.676229 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2b553915-e089-464d-b07f-79411fa508d5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:51.686658 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7241efd9-6292-4618-bada-f1e8031d1a8a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Releasing vlan 343 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:30:51.687065 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7241efd9-6292-4618-bada-f1e8031d1a8a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:51.690100 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:30:51.690100 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:30:51.690100 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:30:51.690100 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:30:51.690100 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:30:51.690100 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:30:51.690100 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:30:51.690100 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:30:51.690100 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:30:51.690100 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:30:51.690100 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:30:51.690100 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:30:51.690100 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:30:51.690100 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:30:51.690100 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:30:51.690100 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:30:51.690100 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:30:51.690100 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:30:51.690100 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:30:51.690100 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:30:51.690100 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:30:51.690100 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:30:51.690100 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:30:51.690100 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:30:51.690100 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:30:51.690100 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:30:51.690100 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:30:51.690100 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:30:51.690100 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:30:51.690100 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:30:51.690100 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:30:51.690100 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:30:51.703032 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-84d7aa48-e9bf-4d3b-88c0-e08d591d55f4 tempest-RoutersAdminNegativeTest-1441694984 tempest-RoutersAdminNegativeTest-1441694984-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:51.725255 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d6de32d8-12ae-4856-b20f-974d49d12364 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:51.748271 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2b553915-e089-464d-b07f-79411fa508d5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:51.756503 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7a3a8b3a-d4b7-41b8-8a4d-9d41642484cc tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:51.757895 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-7a3a8b3a-d4b7-41b8-8a4d-9d41642484cc tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] 10.222.0.24 "GET /v2.0/networks/2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 HTTP/1.1" status: 200 len: 881 time: 0.3145301 Nov 09 04:30:51.771070 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54938) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:51.850810 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-cf93c8ea-f6ac-43bd-8afc-91dcceaf9681 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] 10.222.0.24 "GET /v2.0/ports?device_id=454f4384-6780-4402-98ea-5edbe666cd33 HTTP/1.1" status: 200 len: 205 time: 0.0733461 Nov 09 04:30:51.857914 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54940) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:51.859629 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-84d7aa48-e9bf-4d3b-88c0-e08d591d55f4 tempest-RoutersAdminNegativeTest-1441694984 tempest-RoutersAdminNegativeTest-1441694984-project-admin] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:30:51.874099 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84d7aa48-e9bf-4d3b-88c0-e08d591d55f4 tempest-RoutersAdminNegativeTest-1441694984 tempest-RoutersAdminNegativeTest-1441694984-project-admin] Pushing event updated for resources: {'Port': ['ID=97be4e79-2b86-4f13-9740-332a5207ee11,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:51.876782 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-84d7aa48-e9bf-4d3b-88c0-e08d591d55f4 tempest-RoutersAdminNegativeTest-1441694984 tempest-RoutersAdminNegativeTest-1441694984-project-admin] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:51.909905 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-84d7aa48-e9bf-4d3b-88c0-e08d591d55f4 tempest-RoutersAdminNegativeTest-1441694984 tempest-RoutersAdminNegativeTest-1441694984-project-admin] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:30:51.916971 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7241efd9-6292-4618-bada-f1e8031d1a8a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:51.950409 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-2b553915-e089-464d-b07f-79411fa508d5 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=e7ad386b2af84574a3c9b87e95cb5d0a&name=default HTTP/1.1" status: 200 len: 2996 time: 1.1953218 Nov 09 04:30:51.952602 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7241efd9-6292-4618-bada-f1e8031d1a8a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:51.955933 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-7241efd9-6292-4618-bada-f1e8031d1a8a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "DELETE /v2.0/networks/f1806145-f899-452a-9fed-c9a23870b515 HTTP/1.1" status: 204 len: 168 time: 5.5829175 Nov 09 04:30:51.959349 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54942) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:51.964069 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54944) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:51.971568 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-12a2495e-779a-4756-8599-25a6f79bbd28 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:51.975848 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-e2a6c8f2-e3fa-46c8-9943-1fd383e8eb2a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-281836746'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:51.981347 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e4c888bb-f6e0-42fc-9c97-cb0721bd9012 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:51.983584 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b553915-e089-464d-b07f-79411fa508d5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ae354f52-aac6-4f04-bfed-d79705b97fd8,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:51.988397 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7241efd9-6292-4618-bada-f1e8031d1a8a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event deleted for resources: {'Network': ['ID=f1806145-f899-452a-9fed-c9a23870b515,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:52.088746 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-84d7aa48-e9bf-4d3b-88c0-e08d591d55f4 tempest-RoutersAdminNegativeTest-1441694984 tempest-RoutersAdminNegativeTest-1441694984-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:52.089346 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-84d7aa48-e9bf-4d3b-88c0-e08d591d55f4 tempest-RoutersAdminNegativeTest-1441694984 tempest-RoutersAdminNegativeTest-1441694984-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:52.112240 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-d6de32d8-12ae-4856-b20f-974d49d12364 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Allocated IP 172.26.0.108 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/45120212-510c-49f0-aaf0-a0b92dab5b54) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:30:52.144147 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e2a6c8f2-e3fa-46c8-9943-1fd383e8eb2a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Made reservation on behalf of 6761c80dbfa84798bb6517a9b532f870 for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:30:52.147598 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e2a6c8f2-e3fa-46c8-9943-1fd383e8eb2a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:52.164225 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-de8828dc-a823-4a06-accb-97171f49459f tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks [] for router, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:52.167950 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-12a2495e-779a-4756-8599-25a6f79bbd28 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:52.212935 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ea030459-fa6f-48ef-8353-15dcb4e8c659 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:52.242153 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-84d7aa48-e9bf-4d3b-88c0-e08d591d55f4 tempest-RoutersAdminNegativeTest-1441694984 tempest-RoutersAdminNegativeTest-1441694984-project-admin] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1032 time: 3.7430449 Nov 09 04:30:52.248008 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54946) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:52.257456 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-08ee2b78-1fd4-4a33-8e14-eb1826be91fa tempest-RoutersAdminNegativeTest-1441694984 tempest-RoutersAdminNegativeTest-1441694984-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.109'}]}}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:52.285628 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e2a6c8f2-e3fa-46c8-9943-1fd383e8eb2a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 339} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:30:52.294664 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ea030459-fa6f-48ef-8353-15dcb4e8c659 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:52.305698 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-12a2495e-779a-4756-8599-25a6f79bbd28 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Network cc397c48-c4cc-4846-a1ef-380b64be450d is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:30:52.319052 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-12a2495e-779a-4756-8599-25a6f79bbd28 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:52.322608 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e2a6c8f2-e3fa-46c8-9943-1fd383e8eb2a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:52.322954 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-e2a6c8f2-e3fa-46c8-9943-1fd383e8eb2a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Added segment b8d0e716-c34d-4023-9e0e-8badca1fb165 of type vlan for network ac222708-3380-42f2-a528-a2319594bae1 Nov 09 04:30:52.336286 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-12a2495e-779a-4756-8599-25a6f79bbd28 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:30:52.341761 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-12a2495e-779a-4756-8599-25a6f79bbd28 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:52.342332 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-12a2495e-779a-4756-8599-25a6f79bbd28 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:52.355878 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12a2495e-779a-4756-8599-25a6f79bbd28 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event updated for resources: {'Port': ['ID=090d1dc7-3b92-4012-8ddd-3bcf1ef59daf,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:52.371660 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-de8828dc-a823-4a06-accb-97171f49459f tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks [] for router_gateway, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:52.404851 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-08ee2b78-1fd4-4a33-8e14-eb1826be91fa tempest-RoutersAdminNegativeTest-1441694984 tempest-RoutersAdminNegativeTest-1441694984-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:52.406223 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-08ee2b78-1fd4-4a33-8e14-eb1826be91fa tempest-RoutersAdminNegativeTest-1441694984 tempest-RoutersAdminNegativeTest-1441694984-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:52.432287 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e2a6c8f2-e3fa-46c8-9943-1fd383e8eb2a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:52.453271 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device e025929c-44cc-4832-b4a4-0216288df212 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:30:52.464649 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d6de32d8-12ae-4856-b20f-974d49d12364 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:52.481210 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ea030459-fa6f-48ef-8353-15dcb4e8c659 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:52.483972 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ea030459-fa6f-48ef-8353-15dcb4e8c659 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:52.487663 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-ea030459-fa6f-48ef-8353-15dcb4e8c659 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/ae354f52-aac6-4f04-bfed-d79705b97fd8 HTTP/1.1" status: 204 len: 168 time: 0.5127728 Nov 09 04:30:52.487663 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e4c888bb-f6e0-42fc-9c97-cb0721bd9012 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Router 20fa17b9-5a43-469e-a0de-e9be80c05f6f is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102161) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:30:52.525779 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-12a2495e-779a-4756-8599-25a6f79bbd28 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 844 time: 1.9703133 Nov 09 04:30:52.529792 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54950) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:52.540393 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port e025929c-44cc-4832-b4a4-0216288df212 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:30:52.540393 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:52.543853 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b09cd840-2a7a-4f94-bb2d-1b92eedae039 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:52.564151 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e2a6c8f2-e3fa-46c8-9943-1fd383e8eb2a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:52.569879 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e2a6c8f2-e3fa-46c8-9943-1fd383e8eb2a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:52.570593 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e2a6c8f2-e3fa-46c8-9943-1fd383e8eb2a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:52.674452 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d6de32d8-12ae-4856-b20f-974d49d12364 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:52.760291 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea030459-fa6f-48ef-8353-15dcb4e8c659 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ae354f52-aac6-4f04-bfed-d79705b97fd8,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:52.796945 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-08ee2b78-1fd4-4a33-8e14-eb1826be91fa tempest-RoutersAdminNegativeTest-1441694984 tempest-RoutersAdminNegativeTest-1441694984-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:52.807936 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e2a6c8f2-e3fa-46c8-9943-1fd383e8eb2a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 779 time: 0.8427005 Nov 09 04:30:52.813856 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54954) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:52.822729 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d6de32d8-12ae-4856-b20f-974d49d12364 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:30:52.829332 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-8a9c5f64-a46c-4b18-9e9d-b8444a25121d tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Request body: {'subnet': {'network_id': 'ac222708-3380-42f2-a528-a2319594bae1', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': None}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:52.840595 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2a6c8f2-e3fa-46c8-9943-1fd383e8eb2a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event updated for resources: {'Network': ['ID=ac222708-3380-42f2-a528-a2319594bae1,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:52.863131 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network ac222708-3380-42f2-a528-a2319594bae1 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:30:52.867852 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-d6de32d8-12ae-4856-b20f-974d49d12364 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:52.882193 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d6de32d8-12ae-4856-b20f-974d49d12364 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:30:52.884016 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6de32d8-12ae-4856-b20f-974d49d12364 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Pushing event updated for resources: {'Port': ['ID=45120212-510c-49f0-aaf0-a0b92dab5b54,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:52.945968 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e4c888bb-f6e0-42fc-9c97-cb0721bd9012 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:30:52.959982 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ecdedfcd-1ea5-4003-aa3d-a2d5e484a760 None None] Sync routers for ids ['20fa17b9-5a43-469e-a0de-e9be80c05f6f'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:30:52.968646 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ecdedfcd-1ea5-4003-aa3d-a2d5e484a760 None None] Routers {'20fa17b9-5a43-469e-a0de-e9be80c05f6f'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:30:52.969336 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-ecdedfcd-1ea5-4003-aa3d-a2d5e484a760 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:30:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['20fa17b9-5a43-469e-a0de-e9be80c05f6f'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:53.030708 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-de8828dc-a823-4a06-accb-97171f49459f tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Deleting port 926c0f7a-a3c9-4cba-bc73-92c3e33904c6 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:30:53.031147 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-de8828dc-a823-4a06-accb-97171f49459f tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:53.052425 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-ed57d74b-513f-4d16-8687-f47531b4ac26 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Deleting port 090d1dc7-3b92-4012-8ddd-3bcf1ef59daf {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:30:53.057585 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ed57d74b-513f-4d16-8687-f47531b4ac26 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:53.108490 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-ecdedfcd-1ea5-4003-aa3d-a2d5e484a760 None None] Set router 20fa17b9-5a43-469e-a0de-e9be80c05f6f gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:30:53.144384 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e4c888bb-f6e0-42fc-9c97-cb0721bd9012 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:53.148956 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-e4c888bb-f6e0-42fc-9c97-cb0721bd9012 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 895 time: 7.9675975 Nov 09 04:30:53.149657 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54956) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:53.164941 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-08ee2b78-1fd4-4a33-8e14-eb1826be91fa tempest-RoutersAdminNegativeTest-1441694984 tempest-RoutersAdminNegativeTest-1441694984-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:53.181514 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ed57d74b-513f-4d16-8687-f47531b4ac26 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:53.186409 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54960) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:53.191091 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-de8828dc-a823-4a06-accb-97171f49459f tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:53.192203 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d6de32d8-12ae-4856-b20f-974d49d12364 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:53.204763 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-de8828dc-a823-4a06-accb-97171f49459f tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Calling delete_port for 926c0f7a-a3c9-4cba-bc73-92c3e33904c6 owned by network:router_gateway {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:30:53.248795 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-ed57d74b-513f-4d16-8687-f47531b4ac26 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Calling delete_port for 090d1dc7-3b92-4012-8ddd-3bcf1ef59daf owned by {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:30:53.253303 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8a9c5f64-a46c-4b18-9e9d-b8444a25121d tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Made reservation on behalf of 6761c80dbfa84798bb6517a9b532f870 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:30:53.257570 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8a9c5f64-a46c-4b18-9e9d-b8444a25121d tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:53.404481 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-ecdedfcd-1ea5-4003-aa3d-a2d5e484a760 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '20fa17b9-5a43-469e-a0de-e9be80c05f6f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1135837892', 'tenant_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.69'}], 'enable_snat': True}, 'gw_port_id': '8508be40-2af9-45a5-96f0-06d142f33d8d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:30:45Z', 'updated_at': '2021-11-09T04:30:50Z', 'revision_number': 3, 'project_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'gw_port': {'id': '8508be40-2af9-45a5-96f0-06d142f33d8d', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:95:95:e8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '20fa17b9-5a43-469e-a0de-e9be80c05f6f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 567, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:30:48Z', 'updated_at': '2021-11-09T04:30:48Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:53.429660 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-7d983289-a4f5-4bb6-8304-ba67a2c6187a admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=0f0b9fa79c884bda978424cf72c631d5&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2401798 Nov 09 04:30:53.436738 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54962) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:53.443761 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ecdedfcd-1ea5-4003-aa3d-a2d5e484a760 None None] Checking router: 20fa17b9-5a43-469e-a0de-e9be80c05f6f for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:30:53.444082 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ecdedfcd-1ea5-4003-aa3d-a2d5e484a760 None None] Updating router 20fa17b9-5a43-469e-a0de-e9be80c05f6f port 8508be40-2af9-45a5-96f0-06d142f33d8d binding host dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 04:30:53.473140 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-5f653a2e-6621-43d0-b717-f90d0d7d08ca tempest-TestNetworkAdvancedServerOps-649297627 tempest-TestNetworkAdvancedServerOps-649297627-project-admin] 10.222.0.24 "GET /v2.0/subnets?project_id=fd7df27e425449dfb80d0838c8f7fb89&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.3187349 Nov 09 04:30:53.474812 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-ecdedfcd-1ea5-4003-aa3d-a2d5e484a760 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:53.475517 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54964) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:53.485633 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d6de32d8-12ae-4856-b20f-974d49d12364 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:53.599644 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-b09cd840-2a7a-4f94-bb2d-1b92eedae039 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Deleting port 15453fb5-186c-4eec-947f-e2f2717366a7 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:30:53.599974 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b09cd840-2a7a-4f94-bb2d-1b92eedae039 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:53.635449 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-52936978-3846-4bb6-9a87-f2b2608504c8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:53.637082 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-de8828dc-a823-4a06-accb-97171f49459f tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:53.723288 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ed57d74b-513f-4d16-8687-f47531b4ac26 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:53.724114 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de8828dc-a823-4a06-accb-97171f49459f tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Pushing event deleted for resources: {'Port': ['ID=926c0f7a-a3c9-4cba-bc73-92c3e33904c6,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:53.741125 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-ecdedfcd-1ea5-4003-aa3d-a2d5e484a760 None None] Publish callbacks [] for port, precommit_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:53.784049 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-52936978-3846-4bb6-9a87-f2b2608504c8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:53.787574 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed57d74b-513f-4d16-8687-f47531b4ac26 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event deleted for resources: {'Port': ['ID=090d1dc7-3b92-4012-8ddd-3bcf1ef59daf,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:53.794971 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-ecdedfcd-1ea5-4003-aa3d-a2d5e484a760 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:53.797782 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb2c8b28-c08f-4983-abc2-587a57535d59 tempest-TestNetworkAdvancedServerOps-649297627 tempest-TestNetworkAdvancedServerOps-649297627-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:53.801311 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-eb2c8b28-c08f-4983-abc2-587a57535d59 tempest-TestNetworkAdvancedServerOps-649297627 tempest-TestNetworkAdvancedServerOps-649297627-project-admin] 10.222.0.24 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.3206847 Nov 09 04:30:53.804129 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 54966) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:53.831113 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-08ee2b78-1fd4-4a33-8e14-eb1826be91fa tempest-RoutersAdminNegativeTest-1441694984 tempest-RoutersAdminNegativeTest-1441694984-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:53.835272 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-de8828dc-a823-4a06-accb-97171f49459f tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-466373'] for router_gateway, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:53.841412 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ed57d74b-513f-4d16-8687-f47531b4ac26 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:53.848163 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-ed57d74b-513f-4d16-8687-f47531b4ac26 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "DELETE /v2.0/ports/090d1dc7-3b92-4012-8ddd-3bcf1ef59daf HTTP/1.1" status: 204 len: 168 time: 1.3141463 Nov 09 04:30:53.855494 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-ecdedfcd-1ea5-4003-aa3d-a2d5e484a760 None None] Attempting to bind port 8508be40-2af9-45a5-96f0-06d142f33d8d on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:30:53.855978 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-ecdedfcd-1ea5-4003-aa3d-a2d5e484a760 None None] Attempting to bind port 8508be40-2af9-45a5-96f0-06d142f33d8d by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:30:53.856434 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ecdedfcd-1ea5-4003-aa3d-a2d5e484a760 None None] Attempting to bind port 8508be40-2af9-45a5-96f0-06d142f33d8d on network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:30:53.867936 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ecdedfcd-1ea5-4003-aa3d-a2d5e484a760 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 30, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:30:53.868504 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ecdedfcd-1ea5-4003-aa3d-a2d5e484a760 None None] Checking segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102164) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:30:53.869289 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-ecdedfcd-1ea5-4003-aa3d-a2d5e484a760 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:53.869724 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ecdedfcd-1ea5-4003-aa3d-a2d5e484a760 None None] Bound using segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:30:53.870294 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-ecdedfcd-1ea5-4003-aa3d-a2d5e484a760 None None] Bound port: 8508be40-2af9-45a5-96f0-06d142f33d8d, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:30:53.870837 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-ecdedfcd-1ea5-4003-aa3d-a2d5e484a760 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:53.884129 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54968) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:53.898598 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6df5e50a-6754-4dc2-af3a-dbdb62c22c03 None None] Pushing event updated for resources: {'Port': ['ID=8508be40-2af9-45a5-96f0-06d142f33d8d,revision_number=2']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:53.917791 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b09cd840-2a7a-4f94-bb2d-1b92eedae039 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:53.926063 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-98ca6cce-9570-4778-a5db-bc74be95b196 tempest-TestNetworkAdvancedServerOps-649297627 tempest-TestNetworkAdvancedServerOps-649297627-project-admin] 10.222.0.24 "GET /v2.0/subnets?network_id=2b6725f5-ebfe-485a-8f42-ccb5a241ddb5&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.1134875 Nov 09 04:30:53.926347 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-c61ff50a-a7d6-482a-8d42-652cff43143f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Request body: {'port': {'network_id': 'cc397c48-c4cc-4846-a1ef-380b64be450d', 'mac_address': 'fa:16:3e:96:bf:af', 'name': 'tempest-PortsTestJSON-1266203209'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:53.931699 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-08ee2b78-1fd4-4a33-8e14-eb1826be91fa tempest-RoutersAdminNegativeTest-1441694984 tempest-RoutersAdminNegativeTest-1441694984-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:53.936173 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-ecdedfcd-1ea5-4003-aa3d-a2d5e484a760 None None] For port 8508be40-2af9-45a5-96f0-06d142f33d8d, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102164) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:30:53.940679 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-ecdedfcd-1ea5-4003-aa3d-a2d5e484a760 None None] For port 8508be40-2af9-45a5-96f0-06d142f33d8d, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=8508be40-2af9-45a5-96f0-06d142f33d8d,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102164) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:30:53.961072 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54970) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:53.985474 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-a8b59c54-b5b5-4ad9-9733-8fa262939246 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-529135057', 'network_id': '9c94e7dc-d679-4a7e-b264-6d619dbc935e', 'project_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:53.992894 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-ecdedfcd-1ea5-4003-aa3d-a2d5e484a760 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:54.015246 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-de8828dc-a823-4a06-accb-97171f49459f tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:54.020265 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-de8828dc-a823-4a06-accb-97171f49459f tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:54.049359 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ecdedfcd-1ea5-4003-aa3d-a2d5e484a760 None None] Routers {'20fa17b9-5a43-469e-a0de-e9be80c05f6f'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:30:54.050006 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-ecdedfcd-1ea5-4003-aa3d-a2d5e484a760 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:30:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['20fa17b9-5a43-469e-a0de-e9be80c05f6f'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:54.137196 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6df5e50a-6754-4dc2-af3a-dbdb62c22c03 None None] Pushing event updated for resources: {'Port': ['ID=8508be40-2af9-45a5-96f0-06d142f33d8d,revision_number=3']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:54.172153 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-ecdedfcd-1ea5-4003-aa3d-a2d5e484a760 None None] Set router 20fa17b9-5a43-469e-a0de-e9be80c05f6f gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:30:54.288051 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-b09cd840-2a7a-4f94-bb2d-1b92eedae039 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Calling delete_port for 15453fb5-186c-4eec-947f-e2f2717366a7 owned by network:router_interface {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:30:54.292690 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-de8828dc-a823-4a06-accb-97171f49459f tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:54.293250 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-de8828dc-a823-4a06-accb-97171f49459f tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Fanout notify agent at l3_agent the message router_deleted on router 454f4384-6780-4402-98ea-5edbe666cd33 {{(pid=102161) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:30:54.301008 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-de8828dc-a823-4a06-accb-97171f49459f tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:54.303129 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-de8828dc-a823-4a06-accb-97171f49459f tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] 10.222.0.24 "DELETE /v2.0/routers/454f4384-6780-4402-98ea-5edbe666cd33 HTTP/1.1" status: 204 len: 168 time: 2.4383783 Nov 09 04:30:54.311106 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54972) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:54.317722 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-e2efe7f4-1951-44ed-9c3e-dc19d6cd08ea tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Request body: {'router': {'name': 'tempest-RoutersAdminTest-router-1479567671', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:54.389989 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-ecdedfcd-1ea5-4003-aa3d-a2d5e484a760 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '20fa17b9-5a43-469e-a0de-e9be80c05f6f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1135837892', 'tenant_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.69'}], 'enable_snat': True}, 'gw_port_id': '8508be40-2af9-45a5-96f0-06d142f33d8d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:30:45Z', 'updated_at': '2021-11-09T04:30:50Z', 'revision_number': 3, 'project_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'gw_port': {'id': '8508be40-2af9-45a5-96f0-06d142f33d8d', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:95:95:e8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '20fa17b9-5a43-469e-a0de-e9be80c05f6f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 567, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:30:48Z', 'updated_at': '2021-11-09T04:30:53Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:54.396299 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d6de32d8-12ae-4856-b20f-974d49d12364 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:54.397035 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c61ff50a-a7d6-482a-8d42-652cff43143f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Made reservation on behalf of 88f9f8da29bf4a8793b45130d483a6e6 for: {'port': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:30:54.418510 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ecdedfcd-1ea5-4003-aa3d-a2d5e484a760 None None] The sync data for ids ['20fa17b9-5a43-469e-a0de-e9be80c05f6f'] in dv-neutron-816802-2-hyperv is: [{'id': '20fa17b9-5a43-469e-a0de-e9be80c05f6f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1135837892', 'tenant_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.69'}], 'enable_snat': True}, 'gw_port_id': '8508be40-2af9-45a5-96f0-06d142f33d8d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:30:45Z', 'updated_at': '2021-11-09T04:30:50Z', 'revision_number': 3, 'project_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'gw_port': {'id': '8508be40-2af9-45a5-96f0-06d142f33d8d', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:95:95:e8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '20fa17b9-5a43-469e-a0de-e9be80c05f6f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 567, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:30:48Z', 'updated_at': '2021-11-09T04:30:53Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:30:54.423528 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-08ee2b78-1fd4-4a33-8e14-eb1826be91fa tempest-RoutersAdminNegativeTest-1441694984 tempest-RoutersAdminNegativeTest-1441694984-project-admin] Publish callbacks [] for router, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:54.469632 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-52936978-3846-4bb6-9a87-f2b2608504c8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:54.472226 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-52936978-3846-4bb6-9a87-f2b2608504c8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:54.475694 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-52936978-3846-4bb6-9a87-f2b2608504c8 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/a306d7e6-050a-4562-8abd-43c9603f60b6 HTTP/1.1" status: 204 len: 168 time: 1.0306153 Nov 09 04:30:54.492714 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8a9c5f64-a46c-4b18-9e9d-b8444a25121d tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:54.503309 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52936978-3846-4bb6-9a87-f2b2608504c8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a306d7e6-050a-4562-8abd-43c9603f60b6,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:54.503309 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d6de32d8-12ae-4856-b20f-974d49d12364 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:54.528518 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a8b59c54-b5b5-4ad9-9733-8fa262939246 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Made reservation on behalf of fd7df27e425449dfb80d0838c8f7fb89 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:30:54.538104 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a8b59c54-b5b5-4ad9-9733-8fa262939246 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:54.651435 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6de32d8-12ae-4856-b20f-974d49d12364 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Pushing event updated for resources: {'Port': ['ID=45120212-510c-49f0-aaf0-a0b92dab5b54,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:54.654847 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a9c5f64-a46c-4b18-9e9d-b8444a25121d tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event updated for resources: {'Subnet': ['ID=553b0892-90f3-4894-b443-571a5b0ef1a0,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:54.699866 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d6de32d8-12ae-4856-b20f-974d49d12364 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:54.710874 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8a9c5f64-a46c-4b18-9e9d-b8444a25121d tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Checking segment: {'id': 'b8d0e716-c34d-4023-9e0e-8badca1fb165', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 339, 'network_id': 'ac222708-3380-42f2-a528-a2319594bae1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:30:54.711284 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8a9c5f64-a46c-4b18-9e9d-b8444a25121d tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Network hostable DHCP agents. Network: ac222708-3380-42f2-a528-a2319594bae1, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:30:54.827025 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b09cd840-2a7a-4f94-bb2d-1b92eedae039 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:54.877698 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8a9c5f64-a46c-4b18-9e9d-b8444a25121d tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Network ac222708-3380-42f2-a528-a2319594bae1 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:30:54.880261 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b09cd840-2a7a-4f94-bb2d-1b92eedae039 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event deleted for resources: {'Port': ['ID=15453fb5-186c-4eec-947f-e2f2717366a7,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:54.929057 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c61ff50a-a7d6-482a-8d42-652cff43143f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:55.042370 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-08ee2b78-1fd4-4a33-8e14-eb1826be91fa tempest-RoutersAdminNegativeTest-1441694984 tempest-RoutersAdminNegativeTest-1441694984-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:55.051588 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-08ee2b78-1fd4-4a33-8e14-eb1826be91fa tempest-RoutersAdminNegativeTest-1441694984 tempest-RoutersAdminNegativeTest-1441694984-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:55.056108 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [None req-c61ff50a-a7d6-482a-8d42-652cff43143f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] device_id is not set on port 244f946c-b21d-4e42-9aea-3b1ae3d2a792 yet. {{(pid=102161) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:30:55.063486 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e2efe7f4-1951-44ed-9c3e-dc19d6cd08ea tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:55.064367 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e2efe7f4-1951-44ed-9c3e-dc19d6cd08ea tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:55.105360 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b09cd840-2a7a-4f94-bb2d-1b92eedae039 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:55.217642 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d6de32d8-12ae-4856-b20f-974d49d12364 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:55.220431 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-d6de32d8-12ae-4856-b20f-974d49d12364 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 4.4388847 Nov 09 04:30:55.245084 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e2efe7f4-1951-44ed-9c3e-dc19d6cd08ea tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:55.249839 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-08ee2b78-1fd4-4a33-8e14-eb1826be91fa tempest-RoutersAdminNegativeTest-1441694984 tempest-RoutersAdminNegativeTest-1441694984-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:55.250578 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-08ee2b78-1fd4-4a33-8e14-eb1826be91fa tempest-RoutersAdminNegativeTest-1441694984 tempest-RoutersAdminNegativeTest-1441694984-project-admin] Fanout notify agent at l3_agent the message router_deleted on router b4ea6436-bda0-43ec-99ca-98bbffde3ce0 {{(pid=102161) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:30:55.274619 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-8a9c5f64-a46c-4b18-9e9d-b8444a25121d tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, ac222708-3380-42f2-a528-a2319594bae1) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:55.287572 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4892d8e0-a5d7-47fb-9079-aa0b45b883d7 None None] Network ac222708-3380-42f2-a528-a2319594bae1 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:30:55.331626 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e2efe7f4-1951-44ed-9c3e-dc19d6cd08ea tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:55.352889 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8a9c5f64-a46c-4b18-9e9d-b8444a25121d tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:55.354078 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8a9c5f64-a46c-4b18-9e9d-b8444a25121d tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:55.409172 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e2efe7f4-1951-44ed-9c3e-dc19d6cd08ea tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:55.413081 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-e2efe7f4-1951-44ed-9c3e-dc19d6cd08ea tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 705 time: 1.0983610 Nov 09 04:30:55.445946 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-08ee2b78-1fd4-4a33-8e14-eb1826be91fa tempest-RoutersAdminNegativeTest-1441694984 tempest-RoutersAdminNegativeTest-1441694984-project-admin] create failed (client error): There was a conflict when trying to complete your request. Nov 09 04:30:55.449943 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-08ee2b78-1fd4-4a33-8e14-eb1826be91fa tempest-RoutersAdminNegativeTest-1441694984 tempest-RoutersAdminNegativeTest-1441694984-project-admin] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 409 len: 372 time: 3.1957643 Nov 09 04:30:55.450673 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54988) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:55.450880 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 54992) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:55.464262 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-f5b6831f-680d-4c57-95ba-a3734d6a7935 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Request body: {'router': {'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:55.511372 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7b6e85d7-0465-4daa-8825-b69776763ea7 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-ac222708-3380-42f2-a528-a2319594bae1', 'network_id': 'ac222708-3380-42f2-a528-a2319594bae1', 'tenant_id': '6761c80dbfa84798bb6517a9b532f870', 'fixed_ips': [{'subnet_id': '553b0892-90f3-4894-b443-571a5b0ef1a0'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:30:55.512239 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7b6e85d7-0465-4daa-8825-b69776763ea7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:55.567995 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-8a9c5f64-a46c-4b18-9e9d-b8444a25121d tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 793 time: 2.7481990 Nov 09 04:30:55.575677 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55006) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:55.697723 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b09cd840-2a7a-4f94-bb2d-1b92eedae039 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Router 3a5287b2-31f6-4415-beea-0718ba71be47 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:30:55.701463 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-7b6e85d7-0465-4daa-8825-b69776763ea7 None None] Allocated IP 172.20.0.1 (ac222708-3380-42f2-a528-a2319594bae1/553b0892-90f3-4894-b443-571a5b0ef1a0/c72e445d-7e00-4e84-be0c-e959a4c59ad7) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:30:55.710014 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3869370c-fc52-47e3-a8d0-b06b10455e56 req-e3a82575-be47-4e58-8cae-d45b229c7a5d tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?name=tempest-securitygroup--1687056584&fields=id&tenant_id=6015befde7f546d881cb247ae5bc81ae HTTP/1.1" status: 200 len: 267 time: 0.1606307 Nov 09 04:30:55.763892 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-80bb2de3-fc42-4663-a43b-2a609db41ce6 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:55.813827 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a8b59c54-b5b5-4ad9-9733-8fa262939246 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:55.839285 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c61ff50a-a7d6-482a-8d42-652cff43143f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:55.912170 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8b59c54-b5b5-4ad9-9733-8fa262939246 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Pushing event updated for resources: {'Subnet': ['ID=003822ea-7d1a-41fa-a15f-16fc8c9f624c,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:55.934139 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7b6e85d7-0465-4daa-8825-b69776763ea7 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:55.941918 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f5b6831f-680d-4c57-95ba-a3734d6a7935 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:55.948788 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b09cd840-2a7a-4f94-bb2d-1b92eedae039 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:30:55.957833 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-b09cd840-2a7a-4f94-bb2d-1b92eedae039 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "PUT /v2.0/routers/3a5287b2-31f6-4415-beea-0718ba71be47/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 4.4404898 Nov 09 04:30:55.959843 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55016) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:55.965222 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cf392a91-1304-4dea-a28b-a988b5a53f8f None None] Sync routers for ids ['3a5287b2-31f6-4415-beea-0718ba71be47'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:30:55.968074 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3869370c-fc52-47e3-a8d0-b06b10455e56 req-b20984da-b52f-49e2-9f5a-0f2d4a4f34a2 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:55.969588 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3869370c-fc52-47e3-a8d0-b06b10455e56 req-b20984da-b52f-49e2-9f5a-0f2d4a4f34a2 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/networks?id=a270b61c-1f4f-4d97-be79-4a24c65fddc2 HTTP/1.1" status: 200 len: 812 time: 0.2522407 Nov 09 04:30:55.979160 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-80bb2de3-fc42-4663-a43b-2a609db41ce6 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:55.986303 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cf392a91-1304-4dea-a28b-a988b5a53f8f None None] Routers {'3a5287b2-31f6-4415-beea-0718ba71be47'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:30:55.987184 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-cf392a91-1304-4dea-a28b-a988b5a53f8f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:30:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['3a5287b2-31f6-4415-beea-0718ba71be47'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:56.012646 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3869370c-fc52-47e3-a8d0-b06b10455e56 req-f8b97a16-3a47-4405-b9e4-6db620d53621 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/quotas/6015befde7f546d881cb247ae5bc81ae HTTP/1.1" status: 200 len: 375 time: 0.0351014 Nov 09 04:30:56.098795 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a8b59c54-b5b5-4ad9-9733-8fa262939246 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Checking segment: {'id': 'd5411e15-1506-4025-8472-ba7118358f68', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 313, 'network_id': '9c94e7dc-d679-4a7e-b264-6d619dbc935e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:30:56.099120 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a8b59c54-b5b5-4ad9-9733-8fa262939246 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Network hostable DHCP agents. Network: 9c94e7dc-d679-4a7e-b264-6d619dbc935e, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:30:56.101916 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-80bb2de3-fc42-4663-a43b-2a609db41ce6 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:56.140649 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-d59b3de5-01b5-4462-ae96-8cc006128cf0 tempest-RoutersAdminNegativeTest-1441694984 tempest-RoutersAdminNegativeTest-1441694984-project-admin] Deleting port 97be4e79-2b86-4f13-9740-332a5207ee11 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:30:56.140649 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d59b3de5-01b5-4462-ae96-8cc006128cf0 tempest-RoutersAdminNegativeTest-1441694984 tempest-RoutersAdminNegativeTest-1441694984-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:56.144616 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55018) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:56.148693 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3869370c-fc52-47e3-a8d0-b06b10455e56 req-363cb0a8-8cb8-42e0-847a-4f2d78c4538a tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?tenant_id=6015befde7f546d881cb247ae5bc81ae&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0934517 Nov 09 04:30:56.151530 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80bb2de3-fc42-4663-a43b-2a609db41ce6 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event deleted for resources: {'Subnet': ['ID=553b0892-90f3-4894-b443-571a5b0ef1a0,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:56.245109 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-cf392a91-1304-4dea-a28b-a988b5a53f8f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:56.250447 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7b6e85d7-0465-4daa-8825-b69776763ea7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:56.268469 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c61ff50a-a7d6-482a-8d42-652cff43143f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:56.280692 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-80bb2de3-fc42-4663-a43b-2a609db41ce6 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:56.306968 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cf392a91-1304-4dea-a28b-a988b5a53f8f None None] Routers {'3a5287b2-31f6-4415-beea-0718ba71be47'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:30:56.307611 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-cf392a91-1304-4dea-a28b-a988b5a53f8f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:30:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['3a5287b2-31f6-4415-beea-0718ba71be47'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:56.313947 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7b6e85d7-0465-4daa-8825-b69776763ea7 None None] Network ac222708-3380-42f2-a528-a2319594bae1 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:30:56.323092 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a8b59c54-b5b5-4ad9-9733-8fa262939246 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Network 9c94e7dc-d679-4a7e-b264-6d619dbc935e is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:30:56.330098 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-243af254-e38a-4fdb-862a-ed69267634a6 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Request body: {'network': {'name': 'tempest-NetworksIpV6TestAttrs-test-network-1429702225'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:56.348324 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b6e85d7-0465-4daa-8825-b69776763ea7 None None] Pushing event updated for resources: {'Port': ['ID=c72e445d-7e00-4e84-be0c-e959a4c59ad7,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:56.350821 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-7b6e85d7-0465-4daa-8825-b69776763ea7 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:56.353562 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-cf392a91-1304-4dea-a28b-a988b5a53f8f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:56.354383 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cf392a91-1304-4dea-a28b-a988b5a53f8f None None] The sync data for ids ['3a5287b2-31f6-4415-beea-0718ba71be47'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:30:56.355917 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7b6e85d7-0465-4daa-8825-b69776763ea7 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:30:56.361630 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-80bb2de3-fc42-4663-a43b-2a609db41ce6 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ac222708-3380-42f2-a528-a2319594bae1']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:56.382723 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-80bb2de3-fc42-4663-a43b-2a609db41ce6 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b8d0e716-c34d-4023-9e0e-8badca1fb165') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:56.383329 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-80bb2de3-fc42-4663-a43b-2a609db41ce6 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b8d0e716-c34d-4023-9e0e-8badca1fb165') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:56.402006 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-80bb2de3-fc42-4663-a43b-2a609db41ce6 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:56.417178 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-7b6e85d7-0465-4daa-8825-b69776763ea7 None None] Attempting to bind port c72e445d-7e00-4e84-be0c-e959a4c59ad7 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:30:56.418487 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-7b6e85d7-0465-4daa-8825-b69776763ea7 None None] Attempting to bind port c72e445d-7e00-4e84-be0c-e959a4c59ad7 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'b8d0e716-c34d-4023-9e0e-8badca1fb165', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 339, 'network_id': 'ac222708-3380-42f2-a528-a2319594bae1'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:30:56.419076 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7b6e85d7-0465-4daa-8825-b69776763ea7 None None] Attempting to bind port c72e445d-7e00-4e84-be0c-e959a4c59ad7 on network ac222708-3380-42f2-a528-a2319594bae1 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:30:56.426970 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7b6e85d7-0465-4daa-8825-b69776763ea7 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 30, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:30:56.427673 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7b6e85d7-0465-4daa-8825-b69776763ea7 None None] Checking segment: {'id': 'b8d0e716-c34d-4023-9e0e-8badca1fb165', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 339, 'network_id': 'ac222708-3380-42f2-a528-a2319594bae1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:30:56.428249 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7b6e85d7-0465-4daa-8825-b69776763ea7 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:56.428792 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7b6e85d7-0465-4daa-8825-b69776763ea7 None None] Bound using segment: {'id': 'b8d0e716-c34d-4023-9e0e-8badca1fb165', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 339, 'network_id': 'ac222708-3380-42f2-a528-a2319594bae1'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:30:56.429429 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-7b6e85d7-0465-4daa-8825-b69776763ea7 None None] Bound port: c72e445d-7e00-4e84-be0c-e959a4c59ad7, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b8d0e716-c34d-4023-9e0e-8badca1fb165', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 339, 'network_id': 'ac222708-3380-42f2-a528-a2319594bae1'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:30:56.430131 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7b6e85d7-0465-4daa-8825-b69776763ea7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:56.449362 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c61ff50a-a7d6-482a-8d42-652cff43143f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Network cc397c48-c4cc-4846-a1ef-380b64be450d is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:30:56.458664 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3869370c-fc52-47e3-a8d0-b06b10455e56 req-10e87294-ffdb-454a-93b0-653358842b82 service neutron] 10.222.0.24 "GET /v2.0/networks/a270b61c-1f4f-4d97-be79-4a24c65fddc2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2259510 Nov 09 04:30:56.483075 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d59b3de5-01b5-4462-ae96-8cc006128cf0 tempest-RoutersAdminNegativeTest-1441694984 tempest-RoutersAdminNegativeTest-1441694984-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:56.487390 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-80bb2de3-fc42-4663-a43b-2a609db41ce6 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:56.501355 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-d59b3de5-01b5-4462-ae96-8cc006128cf0 tempest-RoutersAdminNegativeTest-1441694984 tempest-RoutersAdminNegativeTest-1441694984-project-admin] Calling delete_port for 97be4e79-2b86-4f13-9740-332a5207ee11 owned by {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:30:56.510101 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-7b6e85d7-0465-4daa-8825-b69776763ea7 None None] For port c72e445d-7e00-4e84-be0c-e959a4c59ad7, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:30:56.513510 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-a8b59c54-b5b5-4ad9-9733-8fa262939246 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 9c94e7dc-d679-4a7e-b264-6d619dbc935e) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:56.515548 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-c61ff50a-a7d6-482a-8d42-652cff43143f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:56.518215 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c61ff50a-a7d6-482a-8d42-652cff43143f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event updated for resources: {'Port': ['ID=244f946c-b21d-4e42-9aea-3b1ae3d2a792,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:56.524759 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-80bb2de3-fc42-4663-a43b-2a609db41ce6 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Releasing vlan 339 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:30:56.525334 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-80bb2de3-fc42-4663-a43b-2a609db41ce6 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:56.528694 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:30:56.528694 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:30:56.528694 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:30:56.528694 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:30:56.528694 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:30:56.528694 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:30:56.528694 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:30:56.528694 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:30:56.528694 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:30:56.528694 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:30:56.528694 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:30:56.528694 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:30:56.528694 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:30:56.528694 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:30:56.528694 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:30:56.528694 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:30:56.528694 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:30:56.528694 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:30:56.528694 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:30:56.528694 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:30:56.528694 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:30:56.528694 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:30:56.528694 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:30:56.528694 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:30:56.528694 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:30:56.528694 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:30:56.528694 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:30:56.528694 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:30:56.528694 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:30:56.528694 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:30:56.528694 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:30:56.528694 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:30:56.531130 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5227b91a-1bd0-4199-a330-9f63e4c1b8cb None None] Network 9c94e7dc-d679-4a7e-b264-6d619dbc935e requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:30:56.541707 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c61ff50a-a7d6-482a-8d42-652cff43143f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:30:56.549689 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c61ff50a-a7d6-482a-8d42-652cff43143f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:56.553754 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c61ff50a-a7d6-482a-8d42-652cff43143f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:56.555540 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 8508be40-2af9-45a5-96f0-06d142f33d8d up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:30:56.567537 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a8b59c54-b5b5-4ad9-9733-8fa262939246 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:56.568258 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a8b59c54-b5b5-4ad9-9733-8fa262939246 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:56.624222 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3869370c-fc52-47e3-a8d0-b06b10455e56 req-d5630129-f623-4086-91e6-d5c46efe1ea0 service neutron] 10.222.0.24 "GET /v2.0/networks/a270b61c-1f4f-4d97-be79-4a24c65fddc2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1645586 Nov 09 04:30:56.640651 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-7b6e85d7-0465-4daa-8825-b69776763ea7 None None] For port c72e445d-7e00-4e84-be0c-e959a4c59ad7, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=c72e445d-7e00-4e84-be0c-e959a4c59ad7,segment=NetworkSegment(b8d0e716-c34d-4023-9e0e-8badca1fb165),segment_id=b8d0e716-c34d-4023-9e0e-8badca1fb165)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:30:56.649882 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-243af254-e38a-4fdb-862a-ed69267634a6 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Made reservation on behalf of 6acf678d74da4512a431e262bbd32037 for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:30:56.652094 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.db.api [None req-80bb2de3-fc42-4663-a43b-2a609db41ce6 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Nov 09 04:30:56.652094 dv-neutron-816802-2-hyperv neutron-server[102162]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Nov 09 04:30:56.652094 dv-neutron-816802-2-hyperv neutron-server[102162]: [parameters: {'id': 'ac222708-3380-42f2-a528-a2319594bae1'}] Nov 09 04:30:56.652094 dv-neutron-816802-2-hyperv neutron-server[102162]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=102162) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:30:56.657775 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG oslo_db.api [None req-80bb2de3-fc42-4663-a43b-2a609db41ce6 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:30:56.657936 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-243af254-e38a-4fdb-862a-ed69267634a6 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:56.668305 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-243af254-e38a-4fdb-862a-ed69267634a6 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:56.686438 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 8508be40-2af9-45a5-96f0-06d142f33d8d triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:30:56.686867 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:56.713780 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7b6e85d7-0465-4daa-8825-b69776763ea7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:56.737397 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-c61ff50a-a7d6-482a-8d42-652cff43143f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 846 time: 2.8525190 Nov 09 04:30:56.740180 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55022) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:56.799636 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a8b59c54-b5b5-4ad9-9733-8fa262939246 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 831 time: 2.8361969 Nov 09 04:30:56.807143 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55024) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:56.829972 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-95adb0f2-666c-413a-86d5-49b6bde82c4e tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:56.832138 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-95adb0f2-666c-413a-86d5-49b6bde82c4e tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "GET /v2.0/ports/244f946c-b21d-4e42-9aea-3b1ae3d2a792 HTTP/1.1" status: 200 len: 841 time: 0.0904377 Nov 09 04:30:56.834482 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55026) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:56.938077 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b6e85d7-0465-4daa-8825-b69776763ea7 None None] Pushing event updated for resources: {'Port': ['ID=c72e445d-7e00-4e84-be0c-e959a4c59ad7,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:56.966517 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fa244691-11ee-4ce2-8e10-d85835c600e5 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-9c94e7dc-d679-4a7e-b264-6d619dbc935e', 'network_id': '9c94e7dc-d679-4a7e-b264-6d619dbc935e', 'tenant_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'fixed_ips': [{'subnet_id': '003822ea-7d1a-41fa-a15f-16fc8c9f624c'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:30:56.969867 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-fa244691-11ee-4ce2-8e10-d85835c600e5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:57.004625 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fdc7296a-12d0-4458-90ac-97ff47805c0d None None] Network ac222708-3380-42f2-a528-a2319594bae1 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:30:57.030092 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-2633e864-bd30-4666-ace5-678c8eb2527d tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Deleting port 244f946c-b21d-4e42-9aea-3b1ae3d2a792 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:30:57.030722 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2633e864-bd30-4666-ace5-678c8eb2527d tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:57.151771 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2633e864-bd30-4666-ace5-678c8eb2527d tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:57.161722 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-fa244691-11ee-4ce2-8e10-d85835c600e5 None None] Allocated IP 172.20.0.2 (9c94e7dc-d679-4a7e-b264-6d619dbc935e/003822ea-7d1a-41fa-a15f-16fc8c9f624c/8c90ef15-e112-469b-9b84-e60842294cb2) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:30:57.163174 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-80bb2de3-fc42-4663-a43b-2a609db41ce6 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:57.174780 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:57.208946 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-2633e864-bd30-4666-ace5-678c8eb2527d tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Calling delete_port for 244f946c-b21d-4e42-9aea-3b1ae3d2a792 owned by {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:30:57.258479 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 8508be40-2af9-45a5-96f0-06d142f33d8d, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=8508be40-2af9-45a5-96f0-06d142f33d8d,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:30:57.419562 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:57.424870 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-80bb2de3-fc42-4663-a43b-2a609db41ce6 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Deleting port c72e445d-7e00-4e84-be0c-e959a4c59ad7 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:30:57.425308 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-80bb2de3-fc42-4663-a43b-2a609db41ce6 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:57.524248 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-290f0c60-2a38-45dc-a94c-a6d7d1e13123 req-436c7eb1-7d3a-4088-8ec3-46a50b611437 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 210 time: 0.4309747 Nov 09 04:30:57.524938 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d59b3de5-01b5-4462-ae96-8cc006128cf0 tempest-RoutersAdminNegativeTest-1441694984 tempest-RoutersAdminNegativeTest-1441694984-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:57.533029 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=8508be40-2af9-45a5-96f0-06d142f33d8d,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:57.535298 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-80bb2de3-fc42-4663-a43b-2a609db41ce6 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] For port c72e445d-7e00-4e84-be0c-e959a4c59ad7, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=c72e445d-7e00-4e84-be0c-e959a4c59ad7,segment=NetworkSegment(b8d0e716-c34d-4023-9e0e-8badca1fb165),segment_id=b8d0e716-c34d-4023-9e0e-8badca1fb165)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:30:57.535744 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-80bb2de3-fc42-4663-a43b-2a609db41ce6 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:57.555012 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2633e864-bd30-4666-ace5-678c8eb2527d tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:57.565553 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f5b6831f-680d-4c57-95ba-a3734d6a7935 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks [] for router_gateway, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:57.568812 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-243af254-e38a-4fdb-862a-ed69267634a6 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:57.600886 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-80bb2de3-fc42-4663-a43b-2a609db41ce6 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Calling delete_port for c72e445d-7e00-4e84-be0c-e959a4c59ad7 owned by network:dhcp {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:30:57.603960 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2633e864-bd30-4666-ace5-678c8eb2527d tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event deleted for resources: {'Port': ['ID=244f946c-b21d-4e42-9aea-3b1ae3d2a792,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:57.618445 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-fa244691-11ee-4ce2-8e10-d85835c600e5 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:57.633554 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d59b3de5-01b5-4462-ae96-8cc006128cf0 tempest-RoutersAdminNegativeTest-1441694984 tempest-RoutersAdminNegativeTest-1441694984-project-admin] Pushing event deleted for resources: {'Port': ['ID=97be4e79-2b86-4f13-9740-332a5207ee11,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:57.638283 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f5b6831f-680d-4c57-95ba-a3734d6a7935 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:57.648412 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2633e864-bd30-4666-ace5-678c8eb2527d tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:57.653841 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-2633e864-bd30-4666-ace5-678c8eb2527d tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "DELETE /v2.0/ports/244f946c-b21d-4e42-9aea-3b1ae3d2a792 HTTP/1.1" status: 204 len: 168 time: 0.8177752 Nov 09 04:30:57.680498 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-fa244691-11ee-4ce2-8e10-d85835c600e5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:57.686256 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55036) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:57.714696 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-243af254-e38a-4fdb-862a-ed69267634a6 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:57.770579 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fa244691-11ee-4ce2-8e10-d85835c600e5 None None] Network 9c94e7dc-d679-4a7e-b264-6d619dbc935e is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:30:57.775131 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-fa244691-11ee-4ce2-8e10-d85835c600e5 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:57.777512 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa244691-11ee-4ce2-8e10-d85835c600e5 None None] Pushing event updated for resources: {'Port': ['ID=8c90ef15-e112-469b-9b84-e60842294cb2,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:57.780474 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fa244691-11ee-4ce2-8e10-d85835c600e5 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:30:57.848217 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-56e3e4a8-d225-4f02-9d1c-e6f465e4cc48 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] GET failed (client error): The resource could not be found. Nov 09 04:30:57.850226 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-fa244691-11ee-4ce2-8e10-d85835c600e5 None None] Attempting to bind port 8c90ef15-e112-469b-9b84-e60842294cb2 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:30:57.850349 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-56e3e4a8-d225-4f02-9d1c-e6f465e4cc48 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "GET /v2.0/ports/244f946c-b21d-4e42-9aea-3b1ae3d2a792 HTTP/1.1" status: 404 len: 333 time: 0.1525581 Nov 09 04:30:57.850862 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-fa244691-11ee-4ce2-8e10-d85835c600e5 None None] Attempting to bind port 8c90ef15-e112-469b-9b84-e60842294cb2 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'd5411e15-1506-4025-8472-ba7118358f68', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 313, 'network_id': '9c94e7dc-d679-4a7e-b264-6d619dbc935e'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:30:57.851679 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa244691-11ee-4ce2-8e10-d85835c600e5 None None] Attempting to bind port 8c90ef15-e112-469b-9b84-e60842294cb2 on network 9c94e7dc-d679-4a7e-b264-6d619dbc935e {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:30:57.854277 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55038) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:57.859180 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa244691-11ee-4ce2-8e10-d85835c600e5 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 30, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:30:57.860312 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-aa0a9520-4cb0-4959-8210-3aade09be1ff tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Request body: {'port': {'network_id': 'cc397c48-c4cc-4846-a1ef-380b64be450d', 'name': 'tempest-PortsTestJSON-1584777041'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:57.865676 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa244691-11ee-4ce2-8e10-d85835c600e5 None None] Checking segment: {'id': 'd5411e15-1506-4025-8472-ba7118358f68', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 313, 'network_id': '9c94e7dc-d679-4a7e-b264-6d619dbc935e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:30:57.865676 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-fa244691-11ee-4ce2-8e10-d85835c600e5 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:57.865676 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa244691-11ee-4ce2-8e10-d85835c600e5 None None] Bound using segment: {'id': 'd5411e15-1506-4025-8472-ba7118358f68', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 313, 'network_id': '9c94e7dc-d679-4a7e-b264-6d619dbc935e'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:30:57.865676 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-fa244691-11ee-4ce2-8e10-d85835c600e5 None None] Bound port: 8c90ef15-e112-469b-9b84-e60842294cb2, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd5411e15-1506-4025-8472-ba7118358f68', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 313, 'network_id': '9c94e7dc-d679-4a7e-b264-6d619dbc935e'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:30:57.865676 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-fa244691-11ee-4ce2-8e10-d85835c600e5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:57.889264 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-80bb2de3-fc42-4663-a43b-2a609db41ce6 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:57.955441 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-fa244691-11ee-4ce2-8e10-d85835c600e5 None None] For port 8c90ef15-e112-469b-9b84-e60842294cb2, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:30:57.965811 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-fa244691-11ee-4ce2-8e10-d85835c600e5 None None] For port 8c90ef15-e112-469b-9b84-e60842294cb2, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=8c90ef15-e112-469b-9b84-e60842294cb2,segment=NetworkSegment(d5411e15-1506-4025-8472-ba7118358f68),segment_id=d5411e15-1506-4025-8472-ba7118358f68)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:30:57.965977 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-80bb2de3-fc42-4663-a43b-2a609db41ce6 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] No DVR routers for this DVR port c72e445d-7e00-4e84-be0c-e959a4c59ad7 on host dv-neutron-816802-2-hyperv {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:30:57.970202 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80bb2de3-fc42-4663-a43b-2a609db41ce6 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event deleted for resources: {'Port': ['ID=c72e445d-7e00-4e84-be0c-e959a4c59ad7,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:57.994532 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d59b3de5-01b5-4462-ae96-8cc006128cf0 tempest-RoutersAdminNegativeTest-1441694984 tempest-RoutersAdminNegativeTest-1441694984-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:58.001652 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-d59b3de5-01b5-4462-ae96-8cc006128cf0 tempest-RoutersAdminNegativeTest-1441694984 tempest-RoutersAdminNegativeTest-1441694984-project-admin] 10.222.0.24 "DELETE /v2.0/ports/97be4e79-2b86-4f13-9740-332a5207ee11 HTTP/1.1" status: 204 len: 168 time: 2.4776289 Nov 09 04:30:58.001652 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-243af254-e38a-4fdb-862a-ed69267634a6 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 309} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:30:58.044570 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-fa244691-11ee-4ce2-8e10-d85835c600e5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:58.073668 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-80bb2de3-fc42-4663-a43b-2a609db41ce6 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:58.106487 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-80bb2de3-fc42-4663-a43b-2a609db41ce6 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ac222708-3380-42f2-a528-a2319594bae1']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:58.117115 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-80bb2de3-fc42-4663-a43b-2a609db41ce6 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b8d0e716-c34d-4023-9e0e-8badca1fb165') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:58.117772 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-80bb2de3-fc42-4663-a43b-2a609db41ce6 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b8d0e716-c34d-4023-9e0e-8badca1fb165') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:30:58.130881 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-80bb2de3-fc42-4663-a43b-2a609db41ce6 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:58.133113 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-243af254-e38a-4fdb-862a-ed69267634a6 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Pushing event updated for resources: {'SecurityGroup': ['ID=2daac299-4729-4f4d-a9da-781f03c02e4c,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:58.158172 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-aa0a9520-4cb0-4959-8210-3aade09be1ff tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Made reservation on behalf of 88f9f8da29bf4a8793b45130d483a6e6 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:30:58.158942 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-243af254-e38a-4fdb-862a-ed69267634a6 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:58.159384 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-243af254-e38a-4fdb-862a-ed69267634a6 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Added segment a5dc97b2-9efa-4398-bd82-7057a61e12f5 of type vlan for network 40dee9cb-19f2-4ff9-b4f7-f821196139d9 Nov 09 04:30:58.161485 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa244691-11ee-4ce2-8e10-d85835c600e5 None None] Pushing event updated for resources: {'Port': ['ID=8c90ef15-e112-469b-9b84-e60842294cb2,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:58.167511 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-aa0a9520-4cb0-4959-8210-3aade09be1ff tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:58.184009 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-eb9a28d9-2231-4339-87be-c54916092dff tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:58.202502 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-80bb2de3-fc42-4663-a43b-2a609db41ce6 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:58.215498 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-80bb2de3-fc42-4663-a43b-2a609db41ce6 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Releasing vlan 339 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:30:58.216602 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-80bb2de3-fc42-4663-a43b-2a609db41ce6 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:58.283232 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:30:58.283232 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:30:58.283232 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:30:58.283232 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:30:58.283232 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:30:58.283232 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:30:58.283232 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:30:58.283232 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:30:58.283232 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:30:58.283232 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:30:58.283232 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:30:58.283232 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:30:58.283232 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:30:58.283232 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:30:58.283232 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:30:58.283232 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:30:58.283232 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:30:58.283232 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:30:58.283232 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:30:58.283232 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:30:58.283232 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:30:58.283232 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:30:58.283232 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:30:58.283232 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:30:58.283232 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:30:58.283232 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:30:58.283232 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:30:58.283232 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:30:58.283232 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:30:58.283232 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:30:58.283232 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:30:58.283232 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:30:58.287737 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [None req-aa0a9520-4cb0-4959-8210-3aade09be1ff tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] device_id is not set on port 6da829c8-0673-4ad7-a3f3-c012a78028b9 yet. {{(pid=102162) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:30:58.294848 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-f5b6831f-680d-4c57-95ba-a3734d6a7935 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Allocated IP 172.26.0.101 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/342a1e88-61fd-4273-9b85-e0e7ad2eecb5) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:30:58.420023 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-243af254-e38a-4fdb-862a-ed69267634a6 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:58.541927 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-aa0a9520-4cb0-4959-8210-3aade09be1ff tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:58.543872 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 8508be40-2af9-45a5-96f0-06d142f33d8d up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:30:58.620062 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 8508be40-2af9-45a5-96f0-06d142f33d8d triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:30:58.620436 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:58.655148 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-387b1a3a-ba27-4e9a-a831-d68f667452f7 req-a8d0c4b4-8b8a-4d3f-81e6-283cdfaaff0d tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 210 time: 0.0352383 Nov 09 04:30:58.707183 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f5b6831f-680d-4c57-95ba-a3734d6a7935 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:58.718819 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-80bb2de3-fc42-4663-a43b-2a609db41ce6 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:58.723620 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-80bb2de3-fc42-4663-a43b-2a609db41ce6 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:58.730734 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-80bb2de3-fc42-4663-a43b-2a609db41ce6 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "DELETE /v2.0/networks/ac222708-3380-42f2-a528-a2319594bae1 HTTP/1.1" status: 204 len: 168 time: 3.1506763 Nov 09 04:30:58.730734 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-aa0a9520-4cb0-4959-8210-3aade09be1ff tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:58.732297 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55046) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:58.762973 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-0ea1e7b9-f832-46f9-9814-12250c3acc36 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-92869420'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:58.780459 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-243af254-e38a-4fdb-862a-ed69267634a6 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:58.788033 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-243af254-e38a-4fdb-862a-ed69267634a6 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:58.788801 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-243af254-e38a-4fdb-862a-ed69267634a6 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1588161'] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:58.802144 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80bb2de3-fc42-4663-a43b-2a609db41ce6 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event deleted for resources: {'Network': ['ID=ac222708-3380-42f2-a528-a2319594bae1,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:58.829118 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aa0a9520-4cb0-4959-8210-3aade09be1ff tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Network cc397c48-c4cc-4846-a1ef-380b64be450d is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:30:58.835484 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-aa0a9520-4cb0-4959-8210-3aade09be1ff tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:58.842107 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aa0a9520-4cb0-4959-8210-3aade09be1ff tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:30:58.855445 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aa0a9520-4cb0-4959-8210-3aade09be1ff tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:58.856658 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-aa0a9520-4cb0-4959-8210-3aade09be1ff tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:58.871971 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa0a9520-4cb0-4959-8210-3aade09be1ff tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event updated for resources: {'Port': ['ID=6da829c8-0673-4ad7-a3f3-c012a78028b9,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:58.896120 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0ea1e7b9-f832-46f9-9814-12250c3acc36 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Made reservation on behalf of 6761c80dbfa84798bb6517a9b532f870 for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:30:58.901111 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0ea1e7b9-f832-46f9-9814-12250c3acc36 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:58.935261 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0ea1e7b9-f832-46f9-9814-12250c3acc36 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 340} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:30:58.946888 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0ea1e7b9-f832-46f9-9814-12250c3acc36 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:58.948370 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-0ea1e7b9-f832-46f9-9814-12250c3acc36 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Added segment fc8937be-8581-4319-9242-98f26829c900 of type vlan for network 515a4841-6c09-4d97-9765-9efc12ff470f Nov 09 04:30:58.965699 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-aa0a9520-4cb0-4959-8210-3aade09be1ff tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 846 time: 1.1060371 Nov 09 04:30:58.965908 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55050) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:58.978999 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55052) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:58.983716 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-4164138c-7a86-4b90-9051-9f4bb88b1c45 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Request body: {'port': {'name': 'New_Port', 'admin_state_up': False}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:59.013878 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-243af254-e38a-4fdb-862a-ed69267634a6 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 789 time: 2.8474607 Nov 09 04:30:59.014808 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0ea1e7b9-f832-46f9-9814-12250c3acc36 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:59.014970 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f5b6831f-680d-4c57-95ba-a3734d6a7935 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:59.014970 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-243af254-e38a-4fdb-862a-ed69267634a6 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Pushing event updated for resources: {'Network': ['ID=40dee9cb-19f2-4ff9-b4f7-f821196139d9,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:59.029172 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 40dee9cb-19f2-4ff9-b4f7-f821196139d9 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:30:59.128953 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0ea1e7b9-f832-46f9-9814-12250c3acc36 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:59.137793 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0ea1e7b9-f832-46f9-9814-12250c3acc36 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:30:59.138488 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0ea1e7b9-f832-46f9-9814-12250c3acc36 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:59.201970 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f5b6831f-680d-4c57-95ba-a3734d6a7935 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:30:59.247644 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-f5b6831f-680d-4c57-95ba-a3734d6a7935 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:30:59.266243 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ea1e7b9-f832-46f9-9814-12250c3acc36 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event updated for resources: {'Network': ['ID=515a4841-6c09-4d97-9765-9efc12ff470f,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:59.280627 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-0ea1e7b9-f832-46f9-9814-12250c3acc36 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 778 time: 0.5224917 Nov 09 04:30:59.281067 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 515a4841-6c09-4d97-9765-9efc12ff470f details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:30:59.283098 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f5b6831f-680d-4c57-95ba-a3734d6a7935 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:30:59.288299 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55056) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:30:59.295116 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-3376e367-549d-4f66-bd30-95f870d024ba tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Request body: {'network': {'name': 'New_network'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:30:59.304516 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5b6831f-680d-4c57-95ba-a3734d6a7935 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Pushing event updated for resources: {'Port': ['ID=342a1e88-61fd-4273-9b85-e0e7ad2eecb5,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:30:59.307475 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bbf84130-8ef3-40dc-9ed2-690001f7b99c admin admin] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:59.401614 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4164138c-7a86-4b90-9051-9f4bb88b1c45 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:59.413137 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-699753d0-5efa-4b42-965a-6a49cd15d7e8 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:59.575329 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b982ecb7-a997-4684-9aae-73f82274e5ef None None] Network 9c94e7dc-d679-4a7e-b264-6d619dbc935e requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:30:59.695069 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-b86a527d-eb29-48f5-a8ff-7646475f0f27 None None] Provisioning complete for port 8c90ef15-e112-469b-9b84-e60842294cb2 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:30:59.697938 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b86a527d-eb29-48f5-a8ff-7646475f0f27 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:59.880588 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b86a527d-eb29-48f5-a8ff-7646475f0f27 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:30:59.931139 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-b86a527d-eb29-48f5-a8ff-7646475f0f27 None None] For port 8c90ef15-e112-469b-9b84-e60842294cb2, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=8c90ef15-e112-469b-9b84-e60842294cb2,segment=NetworkSegment(d5411e15-1506-4025-8472-ba7118358f68),segment_id=d5411e15-1506-4025-8472-ba7118358f68)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:31:00.026227 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b86a527d-eb29-48f5-a8ff-7646475f0f27 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:00.102619 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b86a527d-eb29-48f5-a8ff-7646475f0f27 None None] Pushing event updated for resources: {'Port': ['ID=8c90ef15-e112-469b-9b84-e60842294cb2,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:00.165580 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2e453285-5196-4fb8-9cda-a91122b42046 None None] get_active_networks_info from dv-neutron-816802-2-hyperv {{(pid=102163) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}} Nov 09 04:31:00.280436 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-6a9eec15-db22-4568-88d5-455fee85a297 None None] Provisioning complete for port 8c90ef15-e112-469b-9b84-e60842294cb2 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:00.280890 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6a9eec15-db22-4568-88d5-455fee85a297 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:00.282436 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2e453285-5196-4fb8-9cda-a91122b42046 None None] Resources bound (agent type, host, resource id): {{(pid=102163) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 09 04:31:00.307959 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-eb9a28d9-2231-4339-87be-c54916092dff tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Deleting port 0e09fa29-fdeb-4ced-98cd-cb627627d82c {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:31:00.308544 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-eb9a28d9-2231-4339-87be-c54916092dff tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:00.430511 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-7135c386-0f33-435d-9d7e-7e1f18bef7ac req-9c38475c-7864-4321-a703-1e1fb3783ff4 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 210 time: 0.3130085 Nov 09 04:31:00.588767 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3376e367-549d-4f66-bd30-95f870d024ba tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:00.623957 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 8c90ef15-e112-469b-9b84-e60842294cb2 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:31:00.731438 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 8c90ef15-e112-469b-9b84-e60842294cb2 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:00.732194 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:00.742020 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3376e367-549d-4f66-bd30-95f870d024ba tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:00.762496 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3869370c-fc52-47e3-a8d0-b06b10455e56 req-9c822b7e-1ea6-4d75-a70e-636678433bd4 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:00.763946 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-3869370c-fc52-47e3-a8d0-b06b10455e56 req-9c822b7e-1ea6-4d75-a70e-636678433bd4 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.26 "GET /v2.0/networks?id=a270b61c-1f4f-4d97-be79-4a24c65fddc2 HTTP/1.1" status: 200 len: 812 time: 0.6499033 Nov 09 04:31:00.839672 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-3376e367-549d-4f66-bd30-95f870d024ba tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Network 515a4841-6c09-4d97-9765-9efc12ff470f is not hosted by any dhcp agent {{(pid=102161) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Nov 09 04:31:00.847662 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3376e367-549d-4f66-bd30-95f870d024ba tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:00.847662 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3376e367-549d-4f66-bd30-95f870d024ba tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:00.848353 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-3376e367-549d-4f66-bd30-95f870d024ba tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "PUT /v2.0/networks/515a4841-6c09-4d97-9765-9efc12ff470f HTTP/1.1" status: 200 len: 723 time: 1.5590358 Nov 09 04:31:00.852536 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55066) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:00.855085 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bbf84130-8ef3-40dc-9ed2-690001f7b99c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:00.864764 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-917f8312-fd70-4f1e-934d-69f45ef240d1 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Request body: {'subnet': {'network_id': '515a4841-6c09-4d97-9765-9efc12ff470f', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:00.879658 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-eb9a28d9-2231-4339-87be-c54916092dff tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:00.917739 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4164138c-7a86-4b90-9051-9f4bb88b1c45 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:00.936651 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f5b6831f-680d-4c57-95ba-a3734d6a7935 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks [] for router_gateway, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:00.971451 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-eb9a28d9-2231-4339-87be-c54916092dff tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Calling delete_port for 0e09fa29-fdeb-4ced-98cd-cb627627d82c owned by network:router_interface {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:31:01.017714 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bbf84130-8ef3-40dc-9ed2-690001f7b99c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:01.019949 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3376e367-549d-4f66-bd30-95f870d024ba tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event updated for resources: {'Network': ['ID=515a4841-6c09-4d97-9765-9efc12ff470f,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:01.031094 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 515a4841-6c09-4d97-9765-9efc12ff470f details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:31:01.032158 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-917f8312-fd70-4f1e-934d-69f45ef240d1 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Made reservation on behalf of 6761c80dbfa84798bb6517a9b532f870 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:01.037827 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-917f8312-fd70-4f1e-934d-69f45ef240d1 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:01.081937 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbf84130-8ef3-40dc-9ed2-690001f7b99c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1ebe8d7e-561d-46f1-9025-fab08092df6a,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:01.085630 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4164138c-7a86-4b90-9051-9f4bb88b1c45 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:01.252929 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-4164138c-7a86-4b90-9051-9f4bb88b1c45 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] In _notify_port_updated(), no bound segment for port 6da829c8-0673-4ad7-a3f3-c012a78028b9 on network cc397c48-c4cc-4846-a1ef-380b64be450d {{(pid=102161) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 09 04:31:01.258614 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4164138c-7a86-4b90-9051-9f4bb88b1c45 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:01.259260 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4164138c-7a86-4b90-9051-9f4bb88b1c45 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:01.263227 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-4164138c-7a86-4b90-9051-9f4bb88b1c45 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "PUT /v2.0/ports/6da829c8-0673-4ad7-a3f3-c012a78028b9 HTTP/1.1" status: 200 len: 818 time: 2.2869644 Nov 09 04:31:01.263382 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-917f8312-fd70-4f1e-934d-69f45ef240d1 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:01.266819 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55068) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:01.271029 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-bbf84130-8ef3-40dc-9ed2-690001f7b99c admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=24283089e6f44e4ab1b67e53bae1326c&name=default HTTP/1.1" status: 200 len: 2996 time: 2.2835014 Nov 09 04:31:01.277239 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55070) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:01.323979 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-3869370c-fc52-47e3-a8d0-b06b10455e56 req-5a2f23d8-6d01-4740-ab92-f90a1f7ccf0c tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.26 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=6015befde7f546d881cb247ae5bc81ae HTTP/1.1" status: 200 len: 380 time: 0.5151386 Nov 09 04:31:01.341211 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4164138c-7a86-4b90-9051-9f4bb88b1c45 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event updated for resources: {'Port': ['ID=6da829c8-0673-4ad7-a3f3-c012a78028b9,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:01.346462 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [req-3869370c-fc52-47e3-a8d0-b06b10455e56 req-d0309a64-57d8-434d-9b64-7cf69a289b4d tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Request body: {'port': {'device_id': '433dca8f-3e84-4693-93ed-4f8fcd69553a', 'network_id': 'a270b61c-1f4f-4d97-be79-4a24c65fddc2', 'admin_state_up': True, 'tenant_id': '6015befde7f546d881cb247ae5bc81ae', 'security_groups': ['e441bd2c-e53d-45df-ab4c-85115d8b53a7']}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:01.393877 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-699753d0-5efa-4b42-965a-6a49cd15d7e8 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Allocated IP 172.20.0.1 (9c94e7dc-d679-4a7e-b264-6d619dbc935e/003822ea-7d1a-41fa-a15f-16fc8c9f624c/bab3b0b2-ec0e-464a-b15f-1f71dc13f0f3) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:31:01.413807 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-917f8312-fd70-4f1e-934d-69f45ef240d1 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event updated for resources: {'Subnet': ['ID=a3e2e2e8-fb66-4d71-950c-ea808ef30228,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:01.432454 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-917f8312-fd70-4f1e-934d-69f45ef240d1 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Checking segment: {'id': 'fc8937be-8581-4319-9242-98f26829c900', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': '515a4841-6c09-4d97-9765-9efc12ff470f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:31:01.432454 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-917f8312-fd70-4f1e-934d-69f45ef240d1 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Network hostable DHCP agents. Network: 515a4841-6c09-4d97-9765-9efc12ff470f, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:31:01.450403 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9e3d998d-966b-4972-91f4-1accbeb6b483 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:01.489422 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9e3d998d-966b-4972-91f4-1accbeb6b483 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:01.494404 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-f466dff6-8e84-43c2-888d-c0a3d1f541eb tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Deleting port 6da829c8-0673-4ad7-a3f3-c012a78028b9 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:31:01.494740 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f466dff6-8e84-43c2-888d-c0a3d1f541eb tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:01.575566 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-917f8312-fd70-4f1e-934d-69f45ef240d1 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Network 515a4841-6c09-4d97-9765-9efc12ff470f is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:31:01.619967 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a9754e07-6898-4585-8910-446cec2667c9 req-e126ca5d-c732-48ce-aee6-cc541ef99230 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 210 time: 0.0475302 Nov 09 04:31:01.621592 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f466dff6-8e84-43c2-888d-c0a3d1f541eb tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:01.639863 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-f466dff6-8e84-43c2-888d-c0a3d1f541eb tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Calling delete_port for 6da829c8-0673-4ad7-a3f3-c012a78028b9 owned by {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:31:01.651241 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-917f8312-fd70-4f1e-934d-69f45ef240d1 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 515a4841-6c09-4d97-9765-9efc12ff470f) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:01.667648 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1ed27a55-6bb3-4508-9e84-452c951282a1 None None] Network 515a4841-6c09-4d97-9765-9efc12ff470f requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:01.699661 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-917f8312-fd70-4f1e-934d-69f45ef240d1 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:01.700525 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-917f8312-fd70-4f1e-934d-69f45ef240d1 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:01.705795 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9e3d998d-966b-4972-91f4-1accbeb6b483 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:01.709503 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9e3d998d-966b-4972-91f4-1accbeb6b483 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:01.710603 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-9e3d998d-966b-4972-91f4-1accbeb6b483 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/1ebe8d7e-561d-46f1-9025-fab08092df6a HTTP/1.1" status: 204 len: 168 time: 0.4319222 Nov 09 04:31:01.752548 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f5b6831f-680d-4c57-95ba-a3734d6a7935 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-466202', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-464271', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-936'] for router, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:01.769454 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e3d998d-966b-4972-91f4-1accbeb6b483 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1ebe8d7e-561d-46f1-9025-fab08092df6a,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:01.770619 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f5b6831f-680d-4c57-95ba-a3734d6a7935 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-466195', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-466408', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-464260'] for router, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:01.897079 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-917f8312-fd70-4f1e-934d-69f45ef240d1 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.0418313 Nov 09 04:31:01.898675 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55076) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:01.909355 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-778c0ff6-051d-43f0-a8bd-ad974635c4e7 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Request body: {'subnet': {'name': 'New_subnet'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:01.981320 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2f257642-0dfd-46c3-b261-17cf04ef0cd8 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-515a4841-6c09-4d97-9765-9efc12ff470f', 'network_id': '515a4841-6c09-4d97-9765-9efc12ff470f', 'tenant_id': '6761c80dbfa84798bb6517a9b532f870', 'fixed_ips': [{'subnet_id': 'a3e2e2e8-fb66-4d71-950c-ea808ef30228'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:31:01.982318 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-2f257642-0dfd-46c3-b261-17cf04ef0cd8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:01.982863 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f466dff6-8e84-43c2-888d-c0a3d1f541eb tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:02.065933 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f466dff6-8e84-43c2-888d-c0a3d1f541eb tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event deleted for resources: {'Port': ['ID=6da829c8-0673-4ad7-a3f3-c012a78028b9,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:02.132775 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-2f257642-0dfd-46c3-b261-17cf04ef0cd8 None None] Allocated IP 172.20.0.2 (515a4841-6c09-4d97-9765-9efc12ff470f/a3e2e2e8-fb66-4d71-950c-ea808ef30228/33182f14-5e22-490d-b84e-3e6eae6a7425) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:31:02.135558 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f466dff6-8e84-43c2-888d-c0a3d1f541eb tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:02.141662 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-f466dff6-8e84-43c2-888d-c0a3d1f541eb tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "DELETE /v2.0/ports/6da829c8-0673-4ad7-a3f3-c012a78028b9 HTTP/1.1" status: 204 len: 168 time: 0.8711402 Nov 09 04:31:02.145619 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55080) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:02.223650 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-3869370c-fc52-47e3-a8d0-b06b10455e56 req-d0309a64-57d8-434d-9b64-7cf69a289b4d tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Made reservation on behalf of 6015befde7f546d881cb247ae5bc81ae for: {'port': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:02.231142 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [req-3869370c-fc52-47e3-a8d0-b06b10455e56 req-d0309a64-57d8-434d-9b64-7cf69a289b4d tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:02.233764 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-eb9a28d9-2231-4339-87be-c54916092dff tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:02.275782 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-778c0ff6-051d-43f0-a8bd-ad974635c4e7 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_update-5794779'] for subnet, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:02.286918 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-699753d0-5efa-4b42-965a-6a49cd15d7e8 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:02.307438 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d32f6eed-e4dd-4207-8960-b07d7102970e tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:02.308933 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-d32f6eed-e4dd-4207-8960-b07d7102970e tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "GET /v2.0/ports HTTP/1.1" status: 200 len: 844 time: 0.1624122 Nov 09 04:31:02.311819 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55082) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:02.323698 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55084) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:02.329863 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-968bccec-0abe-4f4f-aeb4-6232772dd8f7 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Request body: {'subnet': {'network_id': '40dee9cb-19f2-4ff9-b4f7-f821196139d9', 'cidr': '2001:db8:0:ffff::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:ffff::1'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:02.353102 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-ca42bcc9-c5f1-47bc-bd41-1e152dafc1a4 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] GET failed (client error): The resource could not be found. Nov 09 04:31:02.354682 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-ca42bcc9-c5f1-47bc-bd41-1e152dafc1a4 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "GET /v2.0/ports/6da829c8-0673-4ad7-a3f3-c012a78028b9 HTTP/1.1" status: 404 len: 333 time: 0.0413992 Nov 09 04:31:02.358020 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-2f257642-0dfd-46c3-b261-17cf04ef0cd8 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:02.366553 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55086) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:02.377935 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb9a28d9-2231-4339-87be-c54916092dff tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event deleted for resources: {'Port': ['ID=0e09fa29-fdeb-4ced-98cd-cb627627d82c,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:02.382246 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-bba72409-e338-49a8-bf90-7f163c179152 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-2028109919'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:02.392939 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-699753d0-5efa-4b42-965a-6a49cd15d7e8 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:02.414846 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-2f257642-0dfd-46c3-b261-17cf04ef0cd8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:02.442558 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-699753d0-5efa-4b42-965a-6a49cd15d7e8 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Network 9c94e7dc-d679-4a7e-b264-6d619dbc935e is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:31:02.467491 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2f257642-0dfd-46c3-b261-17cf04ef0cd8 None None] Network 515a4841-6c09-4d97-9765-9efc12ff470f is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:31:02.475150 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-2f257642-0dfd-46c3-b261-17cf04ef0cd8 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:02.478402 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2f257642-0dfd-46c3-b261-17cf04ef0cd8 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:31:02.487394 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f257642-0dfd-46c3-b261-17cf04ef0cd8 None None] Pushing event updated for resources: {'Port': ['ID=33182f14-5e22-490d-b84e-3e6eae6a7425,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:02.492646 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-699753d0-5efa-4b42-965a-6a49cd15d7e8 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:02.496808 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55088) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:02.511869 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-699753d0-5efa-4b42-965a-6a49cd15d7e8 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:31:02.561668 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-2f257642-0dfd-46c3-b261-17cf04ef0cd8 None None] Attempting to bind port 33182f14-5e22-490d-b84e-3e6eae6a7425 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:31:02.562156 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-2f257642-0dfd-46c3-b261-17cf04ef0cd8 None None] Attempting to bind port 33182f14-5e22-490d-b84e-3e6eae6a7425 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'fc8937be-8581-4319-9242-98f26829c900', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': '515a4841-6c09-4d97-9765-9efc12ff470f'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:31:02.562716 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f257642-0dfd-46c3-b261-17cf04ef0cd8 None None] Attempting to bind port 33182f14-5e22-490d-b84e-3e6eae6a7425 on network 515a4841-6c09-4d97-9765-9efc12ff470f {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:31:02.580112 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f257642-0dfd-46c3-b261-17cf04ef0cd8 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 30, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:31:02.580447 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f257642-0dfd-46c3-b261-17cf04ef0cd8 None None] Checking segment: {'id': 'fc8937be-8581-4319-9242-98f26829c900', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': '515a4841-6c09-4d97-9765-9efc12ff470f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:31:02.580941 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-2f257642-0dfd-46c3-b261-17cf04ef0cd8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:02.581439 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f257642-0dfd-46c3-b261-17cf04ef0cd8 None None] Bound using segment: {'id': 'fc8937be-8581-4319-9242-98f26829c900', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': '515a4841-6c09-4d97-9765-9efc12ff470f'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:31:02.582012 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-2f257642-0dfd-46c3-b261-17cf04ef0cd8 None None] Bound port: 33182f14-5e22-490d-b84e-3e6eae6a7425, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fc8937be-8581-4319-9242-98f26829c900', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': '515a4841-6c09-4d97-9765-9efc12ff470f'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:31:02.582513 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-2f257642-0dfd-46c3-b261-17cf04ef0cd8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:02.593069 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f5b6831f-680d-4c57-95ba-a3734d6a7935 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Router e9b01a01-61f1-462d-88a5-1936b443614d is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102161) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:31:02.628178 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-699753d0-5efa-4b42-965a-6a49cd15d7e8 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Pushing event updated for resources: {'Port': ['ID=bab3b0b2-ec0e-464a-b15f-1f71dc13f0f3,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:02.696794 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-2f257642-0dfd-46c3-b261-17cf04ef0cd8 None None] For port 33182f14-5e22-490d-b84e-3e6eae6a7425, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:31:02.701471 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-2f257642-0dfd-46c3-b261-17cf04ef0cd8 None None] For port 33182f14-5e22-490d-b84e-3e6eae6a7425, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=33182f14-5e22-490d-b84e-3e6eae6a7425,segment=NetworkSegment(fc8937be-8581-4319-9242-98f26829c900),segment_id=fc8937be-8581-4319-9242-98f26829c900)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:31:02.750864 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-699753d0-5efa-4b42-965a-6a49cd15d7e8 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:02.764140 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-2f257642-0dfd-46c3-b261-17cf04ef0cd8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:02.805048 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-dd52892a-1060-48ef-8cff-c0da56fc0c75 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=f1e5b31f33b04a78b3494cc9ea9d6500&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3012698 Nov 09 04:31:02.840344 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55092) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:02.864333 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f257642-0dfd-46c3-b261-17cf04ef0cd8 None None] Pushing event updated for resources: {'Port': ['ID=33182f14-5e22-490d-b84e-3e6eae6a7425,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:02.935420 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-5825334e-d4bd-40ec-975b-9100da2f3045 None None] Provisioning complete for port bab3b0b2-ec0e-464a-b15f-1f71dc13f0f3 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:02.935890 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5825334e-d4bd-40ec-975b-9100da2f3045 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:03.008906 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-5825334e-d4bd-40ec-975b-9100da2f3045 None None] Port bab3b0b2-ec0e-464a-b15f-1f71dc13f0f3 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:31:03.011731 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c2d12d40-7bd4-45ea-9614-1e01fe1bc475 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:03.030492 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-def8fd64-ca46-48b3-87e2-ee4a4dd35e76 req-a0fad04f-55c5-468f-8109-5e0b72b463b4 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 210 time: 0.2324557 Nov 09 04:31:03.034167 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bba72409-e338-49a8-bf90-7f163c179152 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Made reservation on behalf of 88f9f8da29bf4a8793b45130d483a6e6 for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:03.037659 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bba72409-e338-49a8-bf90-7f163c179152 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:03.039793 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [req-3869370c-fc52-47e3-a8d0-b06b10455e56 req-d0309a64-57d8-434d-9b64-7cf69a289b4d tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Allocated IP 172.20.0.4 (a270b61c-1f4f-4d97-be79-4a24c65fddc2/b2956e71-9b0f-4060-922c-e54ce6cff80a/99ad1d96-b35b-4120-b5a9-c95c47bd3ffc) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:31:03.088780 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c2d12d40-7bd4-45ea-9614-1e01fe1bc475 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:03.101001 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-eb9a28d9-2231-4339-87be-c54916092dff tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:03.104390 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-bba72409-e338-49a8-bf90-7f163c179152 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 327} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:31:03.129990 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bba72409-e338-49a8-bf90-7f163c179152 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:03.130329 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-bba72409-e338-49a8-bf90-7f163c179152 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Added segment f9c6a9a1-e5a3-4af2-8413-8cf5b0d1e3ae of type vlan for network 472e0931-6be9-4332-83a6-c65cb3b98b7d Nov 09 04:31:03.146600 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-778c0ff6-051d-43f0-a8bd-ad974635c4e7 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8756747267211', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_updated-5729887'] for subnet, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:03.227640 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bba72409-e338-49a8-bf90-7f163c179152 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:03.230211 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-968bccec-0abe-4f4f-aeb4-6232772dd8f7 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Made reservation on behalf of 6acf678d74da4512a431e262bbd32037 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:03.233649 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-968bccec-0abe-4f4f-aeb4-6232772dd8f7 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:03.240098 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-778c0ff6-051d-43f0-a8bd-ad974635c4e7 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:03.240691 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-778c0ff6-051d-43f0-a8bd-ad974635c4e7 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:03.244618 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-778c0ff6-051d-43f0-a8bd-ad974635c4e7 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "PUT /v2.0/subnets/a3e2e2e8-fb66-4d71-950c-ea808ef30228 HTTP/1.1" status: 200 len: 806 time: 1.3416634 Nov 09 04:31:03.256040 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55094) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:03.263242 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f5b6831f-680d-4c57-95ba-a3734d6a7935 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:31:03.271761 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f5b6831f-680d-4c57-95ba-a3734d6a7935 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:03.273883 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-f5b6831f-680d-4c57-95ba-a3734d6a7935 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] 10.222.0.24 "PUT /v2.0/routers/e9b01a01-61f1-462d-88a5-1936b443614d HTTP/1.1" status: 200 len: 880 time: 7.8149204 Nov 09 04:31:03.276238 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b479aa8b-5ba9-46fd-a0db-151d3e79547f None None] Sync routers for ids ['e9b01a01-61f1-462d-88a5-1936b443614d'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:31:03.282844 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55096) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:03.289825 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b479aa8b-5ba9-46fd-a0db-151d3e79547f None None] Routers {'e9b01a01-61f1-462d-88a5-1936b443614d'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:31:03.290644 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-b479aa8b-5ba9-46fd-a0db-151d3e79547f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:30:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['e9b01a01-61f1-462d-88a5-1936b443614d'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:03.333992 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-b479aa8b-5ba9-46fd-a0db-151d3e79547f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:03.344987 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b479aa8b-5ba9-46fd-a0db-151d3e79547f None None] Routers {'e9b01a01-61f1-462d-88a5-1936b443614d'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:31:03.345964 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-b479aa8b-5ba9-46fd-a0db-151d3e79547f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:30:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['e9b01a01-61f1-462d-88a5-1936b443614d'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:03.351555 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-778c0ff6-051d-43f0-a8bd-ad974635c4e7 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event updated for resources: {'Subnet': ['ID=a3e2e2e8-fb66-4d71-950c-ea808ef30228,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:03.358641 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.db.resource_extend [None req-bba72409-e338-49a8-bf90-7f163c179152 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] It took 0.11 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 09 04:31:03.361960 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c2d12d40-7bd4-45ea-9614-1e01fe1bc475 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:03.367399 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c2d12d40-7bd4-45ea-9614-1e01fe1bc475 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:03.367399 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-c2d12d40-7bd4-45ea-9614-1e01fe1bc475 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/476e53da-24ae-4e3f-938f-448b2d448381 HTTP/1.1" status: 204 len: 168 time: 0.5242059 Nov 09 04:31:03.395538 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-b479aa8b-5ba9-46fd-a0db-151d3e79547f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:03.396421 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b479aa8b-5ba9-46fd-a0db-151d3e79547f None None] The sync data for ids ['e9b01a01-61f1-462d-88a5-1936b443614d'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:31:03.421177 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2d12d40-7bd4-45ea-9614-1e01fe1bc475 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=476e53da-24ae-4e3f-938f-448b2d448381,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:03.488570 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-157d832c-9d32-4b60-9cde-16b6eea2bd34 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:03.524440 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bba72409-e338-49a8-bf90-7f163c179152 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:03.529961 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bba72409-e338-49a8-bf90-7f163c179152 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:03.530589 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bba72409-e338-49a8-bf90-7f163c179152 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:03.554113 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-eb9a28d9-2231-4339-87be-c54916092dff tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Router 3a5287b2-31f6-4415-beea-0718ba71be47 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:31:03.576611 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-699753d0-5efa-4b42-965a-6a49cd15d7e8 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:03.611755 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [req-3869370c-fc52-47e3-a8d0-b06b10455e56 req-d0309a64-57d8-434d-9b64-7cf69a289b4d tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:03.620636 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-0c5f909f-c3cb-439e-82ba-cee702aec1bf tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] 10.222.0.24 "GET /v2.0/routers/e9b01a01-61f1-462d-88a5-1936b443614d HTTP/1.1" status: 200 len: 921 time: 0.3350601 Nov 09 04:31:03.625904 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55100) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:03.677605 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-bba72409-e338-49a8-bf90-7f163c179152 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 1.3082061 Nov 09 04:31:03.688550 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55102) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:03.695284 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bba72409-e338-49a8-bf90-7f163c179152 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event updated for resources: {'Network': ['ID=472e0931-6be9-4332-83a6-c65cb3b98b7d,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:03.706976 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-4f5d7559-64be-43d5-b8d9-528c70a4b220 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Request body: {'subnet': {'network_id': '472e0931-6be9-4332-83a6-c65cb3b98b7d', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:03.710553 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 472e0931-6be9-4332-83a6-c65cb3b98b7d details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:31:03.792392 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-968bccec-0abe-4f4f-aeb4-6232772dd8f7 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:03.826931 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-eb9a28d9-2231-4339-87be-c54916092dff tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:31:03.836972 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-eb9a28d9-2231-4339-87be-c54916092dff tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "PUT /v2.0/routers/3a5287b2-31f6-4415-beea-0718ba71be47/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 7.8745413 Nov 09 04:31:03.839231 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eecf8a48-9c4e-478a-8dc4-358b3eff7087 None None] Sync routers for ids ['3a5287b2-31f6-4415-beea-0718ba71be47'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:31:03.840168 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55106) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:03.855478 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eecf8a48-9c4e-478a-8dc4-358b3eff7087 None None] Routers {'3a5287b2-31f6-4415-beea-0718ba71be47'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:31:03.860136 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-eecf8a48-9c4e-478a-8dc4-358b3eff7087 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:30:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['3a5287b2-31f6-4415-beea-0718ba71be47'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:03.900425 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-968bccec-0abe-4f4f-aeb4-6232772dd8f7 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Pushing event updated for resources: {'Subnet': ['ID=1bdc3844-b17a-4a9a-934e-eee20137f970,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:03.941577 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-157d832c-9d32-4b60-9cde-16b6eea2bd34 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Deleting port 33182f14-5e22-490d-b84e-3e6eae6a7425 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:31:03.941938 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-157d832c-9d32-4b60-9cde-16b6eea2bd34 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:03.969972 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-eecf8a48-9c4e-478a-8dc4-358b3eff7087 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:03.986338 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eecf8a48-9c4e-478a-8dc4-358b3eff7087 None None] Routers {'3a5287b2-31f6-4415-beea-0718ba71be47'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:31:03.987012 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-eecf8a48-9c4e-478a-8dc4-358b3eff7087 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:30:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['3a5287b2-31f6-4415-beea-0718ba71be47'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:03.993299 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-968bccec-0abe-4f4f-aeb4-6232772dd8f7 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Checking segment: {'id': 'a5dc97b2-9efa-4398-bd82-7057a61e12f5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 309, 'network_id': '40dee9cb-19f2-4ff9-b4f7-f821196139d9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:31:03.993808 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-968bccec-0abe-4f4f-aeb4-6232772dd8f7 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Network hostable DHCP agents. Network: 40dee9cb-19f2-4ff9-b4f7-f821196139d9, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:31:04.024298 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-eecf8a48-9c4e-478a-8dc4-358b3eff7087 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:04.025042 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eecf8a48-9c4e-478a-8dc4-358b3eff7087 None None] The sync data for ids ['3a5287b2-31f6-4415-beea-0718ba71be47'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:31:04.080769 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4f5d7559-64be-43d5-b8d9-528c70a4b220 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Made reservation on behalf of 88f9f8da29bf4a8793b45130d483a6e6 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:04.085678 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4f5d7559-64be-43d5-b8d9-528c70a4b220 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:04.098791 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-157d832c-9d32-4b60-9cde-16b6eea2bd34 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] For port 33182f14-5e22-490d-b84e-3e6eae6a7425, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=33182f14-5e22-490d-b84e-3e6eae6a7425,segment=NetworkSegment(fc8937be-8581-4319-9242-98f26829c900),segment_id=fc8937be-8581-4319-9242-98f26829c900)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:31:04.099266 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-157d832c-9d32-4b60-9cde-16b6eea2bd34 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:04.144327 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-968bccec-0abe-4f4f-aeb4-6232772dd8f7 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Network 40dee9cb-19f2-4ff9-b4f7-f821196139d9 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:31:04.168775 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-287b980c-e38a-4672-bc89-f81c7e426d32 None None] Network 515a4841-6c09-4d97-9765-9efc12ff470f requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:04.173179 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-157d832c-9d32-4b60-9cde-16b6eea2bd34 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Calling delete_port for 33182f14-5e22-490d-b84e-3e6eae6a7425 owned by network:dhcp {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:31:04.207234 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-b97ebe5f-146e-453c-8731-9ec07e55ab27 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "GET /v2.0/ports?device_id=3a5287b2-31f6-4415-beea-0718ba71be47 HTTP/1.1" status: 200 len: 205 time: 0.3616998 Nov 09 04:31:04.210694 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55116) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:04.219252 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d2903ae5-af62-4964-9070-a9f83d1d6939 req-f90ebf49-3bf5-4bbb-af01-af1b7e31737b tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 210 time: 0.0883114 Nov 09 04:31:04.223624 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-968bccec-0abe-4f4f-aeb4-6232772dd8f7 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 40dee9cb-19f2-4ff9-b4f7-f821196139d9) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:04.237497 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-968bccec-0abe-4f4f-aeb4-6232772dd8f7 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:04.238287 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-968bccec-0abe-4f4f-aeb4-6232772dd8f7 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:04.252963 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c1b7300f-d128-4a37-89e4-68e4df788492 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:04.257588 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-c1b7300f-d128-4a37-89e4-68e4df788492 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] 10.222.0.24 "GET /v2.0/ports?network_id=2b6725f5-ebfe-485a-8f42-ccb5a241ddb5&device_id=e9b01a01-61f1-462d-88a5-1936b443614d&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 945 time: 0.6274796 Nov 09 04:31:04.258214 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55120) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:04.268526 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-15518dce-87f4-4969-bcec-6f51d04358bf None None] Network 40dee9cb-19f2-4ff9-b4f7-f821196139d9 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:04.315941 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-b33ecc45-ba40-4fbe-aca2-1a1e780fff04 None None] Provisioning complete for port 33182f14-5e22-490d-b84e-3e6eae6a7425 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:04.316563 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b33ecc45-ba40-4fbe-aca2-1a1e780fff04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:04.323149 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [req-3869370c-fc52-47e3-a8d0-b06b10455e56 req-d0309a64-57d8-434d-9b64-7cf69a289b4d tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:04.362149 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-968bccec-0abe-4f4f-aeb4-6232772dd8f7 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 2.0372968 Nov 09 04:31:04.366787 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55122) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:04.375857 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-d3f0c294-c260-42da-b059-b764786b1640 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Request body: {'network': {'name': 'tempest-NetworksIpV6TestAttrs-test-network-141433215'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:04.427288 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-3869370c-fc52-47e3-a8d0-b06b10455e56 req-d0309a64-57d8-434d-9b64-7cf69a289b4d tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Network a270b61c-1f4f-4d97-be79-4a24c65fddc2 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:31:04.490473 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [req-3869370c-fc52-47e3-a8d0-b06b10455e56 req-d0309a64-57d8-434d-9b64-7cf69a289b4d tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:04.522020 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d3f0c294-c260-42da-b059-b764786b1640 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Made reservation on behalf of 6acf678d74da4512a431e262bbd32037 for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:04.524613 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-850e6c4f-c1d7-46a4-ae42-e7b54ecffe54 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:04.526162 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-850e6c4f-c1d7-46a4-ae42-e7b54ecffe54 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] 10.222.0.24 "GET /v2.0/networks/2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 HTTP/1.1" status: 200 len: 881 time: 0.2645576 Nov 09 04:31:04.528683 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-54da475f-ac18-462c-8a7b-d93d32830a6e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for router, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:04.530045 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d3f0c294-c260-42da-b059-b764786b1640 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:04.532856 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55126) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:04.576448 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b33ecc45-ba40-4fbe-aca2-1a1e780fff04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:04.604942 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 33182f14-5e22-490d-b84e-3e6eae6a7425 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:31:04.612991 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-2b2f747b-d121-4653-822f-e733bb86b3e8 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] 10.222.0.24 "GET /v2.0/ports?device_id=e9b01a01-61f1-462d-88a5-1936b443614d HTTP/1.1" status: 200 len: 205 time: 0.0746133 Nov 09 04:31:04.617095 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55132) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:04.624138 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-157d832c-9d32-4b60-9cde-16b6eea2bd34 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:04.678440 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [req-3869370c-fc52-47e3-a8d0-b06b10455e56 req-d0309a64-57d8-434d-9b64-7cf69a289b4d tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:31:04.681174 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 33182f14-5e22-490d-b84e-3e6eae6a7425 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:31:04.681659 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 33182f14-5e22-490d-b84e-3e6eae6a7425 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:304}} Nov 09 04:31:04.699386 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-157d832c-9d32-4b60-9cde-16b6eea2bd34 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event deleted for resources: {'Port': ['ID=33182f14-5e22-490d-b84e-3e6eae6a7425,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:04.708376 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0309a64-57d8-434d-9b64-7cf69a289b4d tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Pushing event updated for resources: {'Port': ['ID=99ad1d96-b35b-4120-b5a9-c95c47bd3ffc,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:04.733732 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d3f0c294-c260-42da-b059-b764786b1640 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 330} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:31:04.740852 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4f5d7559-64be-43d5-b8d9-528c70a4b220 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:04.748982 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Port 33182f14-5e22-490d-b84e-3e6eae6a7425 not found, will not notify nova. {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:314}} Nov 09 04:31:04.796340 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-157d832c-9d32-4b60-9cde-16b6eea2bd34 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] No DVR routers for this DVR port 33182f14-5e22-490d-b84e-3e6eae6a7425 on host dv-neutron-816802-2-hyperv {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:31:04.840856 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d3f0c294-c260-42da-b059-b764786b1640 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:04.841206 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-d3f0c294-c260-42da-b059-b764786b1640 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Added segment 303916b3-0435-4d77-9e83-60967f186bbf of type vlan for network b64bd442-d79d-4349-b9b3-5833909b2409 Nov 09 04:31:04.862890 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7a3f8cda-5499-4400-9c9e-54d5613fbfd8 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-40dee9cb-19f2-4ff9-b4f7-f821196139d9', 'network_id': '40dee9cb-19f2-4ff9-b4f7-f821196139d9', 'tenant_id': '6acf678d74da4512a431e262bbd32037', 'fixed_ips': [{'subnet_id': '1bdc3844-b17a-4a9a-934e-eee20137f970'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:31:04.865280 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7a3f8cda-5499-4400-9c9e-54d5613fbfd8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:04.987615 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55136) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:05.006184 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d3f0c294-c260-42da-b059-b764786b1640 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:05.028001 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f5d7559-64be-43d5-b8d9-528c70a4b220 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event updated for resources: {'Subnet': ['ID=a38fa5e5-0ac0-4d69-8fb6-dcbb9f935dc1,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:05.039630 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b6fdd8c6-e720-4e75-a31c-d182da64f249 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks [] for router, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:05.041844 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-157d832c-9d32-4b60-9cde-16b6eea2bd34 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:05.050725 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-0805892c-a93e-4f56-88c7-5a0e5d15f4ac None None] Provisioning complete for port 99ad1d96-b35b-4120-b5a9-c95c47bd3ffc triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:05.051229 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0805892c-a93e-4f56-88c7-5a0e5d15f4ac None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:05.095759 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-54da475f-ac18-462c-8a7b-d93d32830a6e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:05.102771 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-54da475f-ac18-462c-8a7b-d93d32830a6e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:05.115729 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4f5d7559-64be-43d5-b8d9-528c70a4b220 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Checking segment: {'id': 'f9c6a9a1-e5a3-4af2-8413-8cf5b0d1e3ae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 327, 'network_id': '472e0931-6be9-4332-83a6-c65cb3b98b7d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:31:05.115729 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4f5d7559-64be-43d5-b8d9-528c70a4b220 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Network hostable DHCP agents. Network: 472e0931-6be9-4332-83a6-c65cb3b98b7d, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:31:05.117053 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-0805892c-a93e-4f56-88c7-5a0e5d15f4ac None None] Port 99ad1d96-b35b-4120-b5a9-c95c47bd3ffc cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:31:05.125734 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3869370c-fc52-47e3-a8d0-b06b10455e56 req-d0309a64-57d8-434d-9b64-7cf69a289b4d tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:05.127958 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [req-3869370c-fc52-47e3-a8d0-b06b10455e56 req-d0309a64-57d8-434d-9b64-7cf69a289b4d tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:05.129265 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-7a3f8cda-5499-4400-9c9e-54d5613fbfd8 None None] Allocated IP 2001:db8:0:ffff::2 (40dee9cb-19f2-4ff9-b4f7-f821196139d9/1bdc3844-b17a-4a9a-934e-eee20137f970/627d2dd9-7b3b-4b20-a4e4-18764ff393f3) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:31:05.173762 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-418abc08-6c6c-4345-867b-0b3a92e15c70 None None] Network 515a4841-6c09-4d97-9765-9efc12ff470f requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:05.190085 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-699753d0-5efa-4b42-965a-6a49cd15d7e8 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:05.215789 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-5b597596-2c6d-4596-9e8f-49c57c8e0691 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'network': {'name': 'tempest-NetworksTestDHCPv6-test-network-1230850621'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:05.245660 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b6fdd8c6-e720-4e75-a31c-d182da64f249 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks [] for router_gateway, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:05.254467 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d3f0c294-c260-42da-b059-b764786b1640 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:05.260359 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d3f0c294-c260-42da-b059-b764786b1640 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:05.264064 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d3f0c294-c260-42da-b059-b764786b1640 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:05.309270 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-3869370c-fc52-47e3-a8d0-b06b10455e56 req-d0309a64-57d8-434d-9b64-7cf69a289b4d tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.26 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 3.9776320 Nov 09 04:31:05.310348 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-54da475f-ac18-462c-8a7b-d93d32830a6e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:05.311198 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-54da475f-ac18-462c-8a7b-d93d32830a6e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Fanout notify agent at l3_agent the message router_deleted on router 3a5287b2-31f6-4415-beea-0718ba71be47 {{(pid=102161) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:31:05.314492 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-699753d0-5efa-4b42-965a-6a49cd15d7e8 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:05.324473 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-54da475f-ac18-462c-8a7b-d93d32830a6e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:05.328583 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-54da475f-ac18-462c-8a7b-d93d32830a6e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "DELETE /v2.0/routers/3a5287b2-31f6-4415-beea-0718ba71be47 HTTP/1.1" status: 204 len: 168 time: 1.1139784 Nov 09 04:31:05.331396 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55142) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:05.355254 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4f5d7559-64be-43d5-b8d9-528c70a4b220 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Network 472e0931-6be9-4332-83a6-c65cb3b98b7d is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:31:05.356575 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [req-3869370c-fc52-47e3-a8d0-b06b10455e56 req-838682a9-cb55-49bf-92d1-3b068d007aaf service neutron] Request body: {'port': {'device_id': '433dca8f-3e84-4693-93ed-4f8fcd69553a', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:05.357807 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-157d832c-9d32-4b60-9cde-16b6eea2bd34 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:05.392912 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3f0c294-c260-42da-b059-b764786b1640 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Pushing event updated for resources: {'Network': ['ID=b64bd442-d79d-4349-b9b3-5833909b2409,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:05.404001 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network b64bd442-d79d-4349-b9b3-5833909b2409 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:31:05.409283 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-157d832c-9d32-4b60-9cde-16b6eea2bd34 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event deleted for resources: {'Subnet': ['ID=a3e2e2e8-fb66-4d71-950c-ea808ef30228,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:05.435342 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7a3f8cda-5499-4400-9c9e-54d5613fbfd8 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:05.485426 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6fd2b755-f2ac-46b2-b82f-4790f62d405c None None] DHCP port deletion for 515a4841-6c09-4d97-9765-9efc12ff470f request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:31:05.513460 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-4f5d7559-64be-43d5-b8d9-528c70a4b220 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 472e0931-6be9-4332-83a6-c65cb3b98b7d) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:05.513460 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4f5d7559-64be-43d5-b8d9-528c70a4b220 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:05.513460 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4f5d7559-64be-43d5-b8d9-528c70a4b220 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:05.517875 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-78387078-b56e-47c9-ba99-0265324acd0f None None] Network 472e0931-6be9-4332-83a6-c65cb3b98b7d requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:05.523168 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-157d832c-9d32-4b60-9cde-16b6eea2bd34 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:05.541408 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7a3f8cda-5499-4400-9c9e-54d5613fbfd8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:05.555221 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-157d832c-9d32-4b60-9cde-16b6eea2bd34 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['515a4841-6c09-4d97-9765-9efc12ff470f']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:05.558016 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5b597596-2c6d-4596-9e8f-49c57c8e0691 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:05.561499 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5b597596-2c6d-4596-9e8f-49c57c8e0691 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:05.561738 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-699753d0-5efa-4b42-965a-6a49cd15d7e8 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:05.563547 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-699753d0-5efa-4b42-965a-6a49cd15d7e8 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Pushing event updated for resources: {'Port': ['ID=bab3b0b2-ec0e-464a-b15f-1f71dc13f0f3,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:05.583003 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-157d832c-9d32-4b60-9cde-16b6eea2bd34 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'fc8937be-8581-4319-9242-98f26829c900') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:05.583341 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-157d832c-9d32-4b60-9cde-16b6eea2bd34 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'fc8937be-8581-4319-9242-98f26829c900') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:05.585139 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-d7e4bcdd-60db-4ca4-8d9a-0aea8211c2b2 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Deleting subnet 46e2a34a-c423-454a-a4ea-0bc78ae2ec41 {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:31:05.592205 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d7e4bcdd-60db-4ca4-8d9a-0aea8211c2b2 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:05.592385 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5b597596-2c6d-4596-9e8f-49c57c8e0691 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:05.595478 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [req-3869370c-fc52-47e3-a8d0-b06b10455e56 req-838682a9-cb55-49bf-92d1-3b068d007aaf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:05.600364 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-157d832c-9d32-4b60-9cde-16b6eea2bd34 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:05.625337 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-4f5d7559-64be-43d5-b8d9-528c70a4b220 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.9356902 Nov 09 04:31:05.628197 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-157d832c-9d32-4b60-9cde-16b6eea2bd34 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:05.631704 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55146) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:05.636632 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-b6fdd8c6-e720-4e75-a31c-d182da64f249 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Deleting port 342a1e88-61fd-4273-9b85-e0e7ad2eecb5 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:31:05.636951 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b6fdd8c6-e720-4e75-a31c-d182da64f249 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:05.645529 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-0ac9ee64-7314-474b-815a-0ad6bb9bc669 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Request body: {'subnet': {'network_id': '472e0931-6be9-4332-83a6-c65cb3b98b7d', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:05.652043 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-157d832c-9d32-4b60-9cde-16b6eea2bd34 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Releasing vlan 340 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:31:05.652043 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-157d832c-9d32-4b60-9cde-16b6eea2bd34 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:05.652329 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ab2c81c-11ad-4f00-a082-e2a9954f861a req-9513d905-086d-4c7b-a54e-20917586907b tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:05.652571 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-6ab2c81c-11ad-4f00-a082-e2a9954f861a req-9513d905-086d-4c7b-a54e-20917586907b tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 931 time: 0.3230073 Nov 09 04:31:05.676191 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:31:05.676191 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:31:05.676191 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:31:05.676191 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:31:05.676191 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:31:05.676191 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:31:05.676191 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:31:05.676191 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:31:05.676191 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:31:05.676191 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:31:05.676191 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:31:05.676191 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:31:05.676191 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:31:05.676191 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:31:05.676191 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:31:05.676191 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:31:05.676191 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:31:05.676191 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:31:05.676191 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:31:05.676191 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:31:05.676191 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:31:05.676191 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:31:05.676191 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:31:05.676191 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:31:05.676191 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:31:05.676191 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:31:05.676191 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:31:05.676191 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:31:05.676191 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:31:05.676191 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:31:05.676191 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:31:05.676191 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:31:05.682244 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-d3f0c294-c260-42da-b059-b764786b1640 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 788 time: 1.3144107 Nov 09 04:31:05.693396 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55148) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:05.745808 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d7e4bcdd-60db-4ca4-8d9a-0aea8211c2b2 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:05.773993 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-37f64c87-fe2a-4011-92e5-267763f2d9c8 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Request body: {'subnet': {'network_id': 'b64bd442-d79d-4349-b9b3-5833909b2409', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:05.775134 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7a3f8cda-5499-4400-9c9e-54d5613fbfd8 None None] Network 40dee9cb-19f2-4ff9-b4f7-f821196139d9 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:31:05.787296 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-7a3f8cda-5499-4400-9c9e-54d5613fbfd8 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:05.794831 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7a3f8cda-5499-4400-9c9e-54d5613fbfd8 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:31:05.800842 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a3f8cda-5499-4400-9c9e-54d5613fbfd8 None None] Pushing event updated for resources: {'Port': ['ID=627d2dd9-7b3b-4b20-a4e4-18764ff393f3,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:05.881020 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b6fdd8c6-e720-4e75-a31c-d182da64f249 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:05.896492 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-7a3f8cda-5499-4400-9c9e-54d5613fbfd8 None None] Attempting to bind port 627d2dd9-7b3b-4b20-a4e4-18764ff393f3 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:31:05.896703 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-7a3f8cda-5499-4400-9c9e-54d5613fbfd8 None None] Attempting to bind port 627d2dd9-7b3b-4b20-a4e4-18764ff393f3 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'a5dc97b2-9efa-4398-bd82-7057a61e12f5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 309, 'network_id': '40dee9cb-19f2-4ff9-b4f7-f821196139d9'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:31:05.896987 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7a3f8cda-5499-4400-9c9e-54d5613fbfd8 None None] Attempting to bind port 627d2dd9-7b3b-4b20-a4e4-18764ff393f3 on network 40dee9cb-19f2-4ff9-b4f7-f821196139d9 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:31:05.902316 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-b6fdd8c6-e720-4e75-a31c-d182da64f249 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Calling delete_port for 342a1e88-61fd-4273-9b85-e0e7ad2eecb5 owned by network:router_gateway {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:31:05.910112 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7a3f8cda-5499-4400-9c9e-54d5613fbfd8 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 30, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:31:05.911041 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7a3f8cda-5499-4400-9c9e-54d5613fbfd8 None None] Checking segment: {'id': 'a5dc97b2-9efa-4398-bd82-7057a61e12f5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 309, 'network_id': '40dee9cb-19f2-4ff9-b4f7-f821196139d9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:31:05.911041 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7a3f8cda-5499-4400-9c9e-54d5613fbfd8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:05.911352 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7a3f8cda-5499-4400-9c9e-54d5613fbfd8 None None] Bound using segment: {'id': 'a5dc97b2-9efa-4398-bd82-7057a61e12f5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 309, 'network_id': '40dee9cb-19f2-4ff9-b4f7-f821196139d9'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:31:05.912028 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-7a3f8cda-5499-4400-9c9e-54d5613fbfd8 None None] Bound port: 627d2dd9-7b3b-4b20-a4e4-18764ff393f3, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a5dc97b2-9efa-4398-bd82-7057a61e12f5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 309, 'network_id': '40dee9cb-19f2-4ff9-b4f7-f821196139d9'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:31:05.912481 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7a3f8cda-5499-4400-9c9e-54d5613fbfd8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:05.961050 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-157d832c-9d32-4b60-9cde-16b6eea2bd34 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:05.977449 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-157d832c-9d32-4b60-9cde-16b6eea2bd34 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:05.983398 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-157d832c-9d32-4b60-9cde-16b6eea2bd34 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "DELETE /v2.0/networks/515a4841-6c09-4d97-9765-9efc12ff470f HTTP/1.1" status: 204 len: 168 time: 2.7258940 Nov 09 04:31:05.991175 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55150) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:05.994724 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bcb68ba4-7657-4dd2-9ae7-54b1aaa7424c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-472e0931-6be9-4332-83a6-c65cb3b98b7d', 'network_id': '472e0931-6be9-4332-83a6-c65cb3b98b7d', 'tenant_id': '88f9f8da29bf4a8793b45130d483a6e6', 'fixed_ips': [{'subnet_id': 'a38fa5e5-0ac0-4d69-8fb6-dcbb9f935dc1'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:31:05.995585 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-bcb68ba4-7657-4dd2-9ae7-54b1aaa7424c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:06.020182 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-7a3f8cda-5499-4400-9c9e-54d5613fbfd8 None None] For port 627d2dd9-7b3b-4b20-a4e4-18764ff393f3, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:31:06.023553 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-7a3f8cda-5499-4400-9c9e-54d5613fbfd8 None None] For port 627d2dd9-7b3b-4b20-a4e4-18764ff393f3, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=627d2dd9-7b3b-4b20-a4e4-18764ff393f3,segment=NetworkSegment(a5dc97b2-9efa-4398-bd82-7057a61e12f5),segment_id=a5dc97b2-9efa-4398-bd82-7057a61e12f5)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:31:06.029405 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-157d832c-9d32-4b60-9cde-16b6eea2bd34 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event deleted for resources: {'Network': ['ID=515a4841-6c09-4d97-9765-9efc12ff470f,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:06.041365 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-80042b08-553f-4873-a0b6-8c8ff55fb251 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] DELETE failed (client error): The resource could not be found. Nov 09 04:31:06.048732 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-80042b08-553f-4873-a0b6-8c8ff55fb251 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:31:06.048872 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-80042b08-553f-4873-a0b6-8c8ff55fb251 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "DELETE /v2.0/networks/515a4841-6c09-4d97-9765-9efc12ff470f HTTP/1.1" status: 404 len: 339 time: 0.0482693 Nov 09 04:31:06.049456 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55152) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:06.059134 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-e2670e53-1909-4c65-ae08-7085dd48a0c6 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-460956914', 'description': 'd1'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:06.072988 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0ac9ee64-7314-474b-815a-0ad6bb9bc669 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Made reservation on behalf of 88f9f8da29bf4a8793b45130d483a6e6 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:06.078278 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0ac9ee64-7314-474b-815a-0ad6bb9bc669 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:06.080994 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-6ab2c81c-11ad-4f00-a082-e2a9954f861a req-72e54b91-5eb8-4e1a-b3f7-cfe634e0f040 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4153597 Nov 09 04:31:06.095641 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7a3f8cda-5499-4400-9c9e-54d5613fbfd8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:06.128931 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-699753d0-5efa-4b42-965a-6a49cd15d7e8 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Network 9c94e7dc-d679-4a7e-b264-6d619dbc935e is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:31:06.208550 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a3f8cda-5499-4400-9c9e-54d5613fbfd8 None None] Pushing event updated for resources: {'Port': ['ID=627d2dd9-7b3b-4b20-a4e4-18764ff393f3,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:06.209405 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-699753d0-5efa-4b42-965a-6a49cd15d7e8 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:06.215421 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5b597596-2c6d-4596-9e8f-49c57c8e0691 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:06.219186 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-bcb68ba4-7657-4dd2-9ae7-54b1aaa7424c None None] Allocated IP 172.20.0.2 (472e0931-6be9-4332-83a6-c65cb3b98b7d/a38fa5e5-0ac0-4d69-8fb6-dcbb9f935dc1/ab8e63ae-1230-482f-a48d-68b82b5ab45b) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:31:06.230941 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d7e4bcdd-60db-4ca4-8d9a-0aea8211c2b2 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:06.277866 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.ipam_backend_mixin [None req-0ac9ee64-7314-474b-815a-0ad6bb9bc669 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Validation for CIDR: 172.20.0.0/28 failed - overlaps with subnet a38fa5e5-0ac0-4d69-8fb6-dcbb9f935dc1 (CIDR: 172.20.0.0/28) Nov 09 04:31:06.329819 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-0ac9ee64-7314-474b-815a-0ad6bb9bc669 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:31:06.330662 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-0ac9ee64-7314-474b-815a-0ad6bb9bc669 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:31:06.332451 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e2670e53-1909-4c65-ae08-7085dd48a0c6 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Made reservation on behalf of 6761c80dbfa84798bb6517a9b532f870 for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:06.340573 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e2670e53-1909-4c65-ae08-7085dd48a0c6 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:06.363767 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5b597596-2c6d-4596-9e8f-49c57c8e0691 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:06.398829 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e2670e53-1909-4c65-ae08-7085dd48a0c6 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 320} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:31:06.404827 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5b597596-2c6d-4596-9e8f-49c57c8e0691 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 349} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:31:06.432043 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b597596-2c6d-4596-9e8f-49c57c8e0691 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'SecurityGroup': ['ID=e26e25e3-915d-43f3-9d9d-1901466269b2,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:06.435627 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e2670e53-1909-4c65-ae08-7085dd48a0c6 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:06.439469 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-e2670e53-1909-4c65-ae08-7085dd48a0c6 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Added segment 9a3aa6fe-359f-4370-b4c5-5e9759a7b161 of type vlan for network 58e0a9a1-6f0d-416b-a47b-26ea5282a8d9 Nov 09 04:31:06.443524 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5b597596-2c6d-4596-9e8f-49c57c8e0691 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:06.443524 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-5b597596-2c6d-4596-9e8f-49c57c8e0691 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Added segment af4cde93-bd96-45fc-bfc1-9d70f48450dd of type vlan for network 988d2354-693c-4d52-af17-25e0643eaa0c Nov 09 04:31:06.443524 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b6fdd8c6-e720-4e75-a31c-d182da64f249 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:06.484544 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-bcb68ba4-7657-4dd2-9ae7-54b1aaa7424c None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:06.501725 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [req-3869370c-fc52-47e3-a8d0-b06b10455e56 req-838682a9-cb55-49bf-92d1-3b068d007aaf service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 99ad1d96-b35b-4120-b5a9-c95c47bd3ffc {{(pid=102161) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:31:06.512228 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [req-3869370c-fc52-47e3-a8d0-b06b10455e56 req-838682a9-cb55-49bf-92d1-3b068d007aaf service neutron] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:06.530733 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 33182f14-5e22-490d-b84e-3e6eae6a7425 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:31:06.531867 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-699753d0-5efa-4b42-965a-6a49cd15d7e8 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Router 20fa17b9-5a43-469e-a0de-e9be80c05f6f has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:31:06.543486 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-37f64c87-fe2a-4011-92e5-267763f2d9c8 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Made reservation on behalf of 6acf678d74da4512a431e262bbd32037 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:06.559697 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-37f64c87-fe2a-4011-92e5-267763f2d9c8 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:06.572700 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 33182f14-5e22-490d-b84e-3e6eae6a7425 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:31:06.573057 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 33182f14-5e22-490d-b84e-3e6eae6a7425 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:31:06.575960 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-bcb68ba4-7657-4dd2-9ae7-54b1aaa7424c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:06.606849 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.provisioning_blocks [req-3869370c-fc52-47e3-a8d0-b06b10455e56 req-838682a9-cb55-49bf-92d1-3b068d007aaf service neutron] Transition to ACTIVE for port object 99ad1d96-b35b-4120-b5a9-c95c47bd3ffc will not be triggered until provisioned by entity L2. {{(pid=102161) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 09 04:31:06.612332 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d7e4bcdd-60db-4ca4-8d9a-0aea8211c2b2 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:06.624078 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6fdd8c6-e720-4e75-a31c-d182da64f249 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Pushing event deleted for resources: {'Port': ['ID=342a1e88-61fd-4273-9b85-e0e7ad2eecb5,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:06.633779 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bcb68ba4-7657-4dd2-9ae7-54b1aaa7424c None None] Network 472e0931-6be9-4332-83a6-c65cb3b98b7d is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:31:06.639017 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-bcb68ba4-7657-4dd2-9ae7-54b1aaa7424c None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:06.652941 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bcb68ba4-7657-4dd2-9ae7-54b1aaa7424c None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:31:06.689434 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5b597596-2c6d-4596-9e8f-49c57c8e0691 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:06.695252 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bcb68ba4-7657-4dd2-9ae7-54b1aaa7424c None None] Pushing event updated for resources: {'Port': ['ID=ab8e63ae-1230-482f-a48d-68b82b5ab45b,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:06.730525 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e2670e53-1909-4c65-ae08-7085dd48a0c6 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:06.741073 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-0ac9ee64-7314-474b-815a-0ad6bb9bc669 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 1.1061330 Nov 09 04:31:06.748516 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55154) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:06.753631 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-1a3b3d08-b641-4a63-94c8-658867f1dfb6 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Request body: {'subnet': {'network_id': '472e0931-6be9-4332-83a6-c65cb3b98b7d', 'cidr': '172.20.0.16/28', 'ip_version': 4, 'gateway_ip': '172.20.0.17'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:06.762832 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-bcb68ba4-7657-4dd2-9ae7-54b1aaa7424c None None] Attempting to bind port ab8e63ae-1230-482f-a48d-68b82b5ab45b on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:31:06.763194 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-bcb68ba4-7657-4dd2-9ae7-54b1aaa7424c None None] Attempting to bind port ab8e63ae-1230-482f-a48d-68b82b5ab45b by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'f9c6a9a1-e5a3-4af2-8413-8cf5b0d1e3ae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 327, 'network_id': '472e0931-6be9-4332-83a6-c65cb3b98b7d'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:31:06.763829 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bcb68ba4-7657-4dd2-9ae7-54b1aaa7424c None None] Attempting to bind port ab8e63ae-1230-482f-a48d-68b82b5ab45b on network 472e0931-6be9-4332-83a6-c65cb3b98b7d {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:31:06.767009 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b6fdd8c6-e720-4e75-a31c-d182da64f249 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-466373'] for router_gateway, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:06.779748 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-80accf7d-8236-43dc-a14f-ffe5dcca827a None None] Provisioning complete for port bab3b0b2-ec0e-464a-b15f-1f71dc13f0f3 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:06.781351 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-80accf7d-8236-43dc-a14f-ffe5dcca827a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:06.787285 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bcb68ba4-7657-4dd2-9ae7-54b1aaa7424c None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 30, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:31:06.787285 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bcb68ba4-7657-4dd2-9ae7-54b1aaa7424c None None] Checking segment: {'id': 'f9c6a9a1-e5a3-4af2-8413-8cf5b0d1e3ae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 327, 'network_id': '472e0931-6be9-4332-83a6-c65cb3b98b7d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:31:06.787285 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-bcb68ba4-7657-4dd2-9ae7-54b1aaa7424c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:06.787285 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bcb68ba4-7657-4dd2-9ae7-54b1aaa7424c None None] Bound using segment: {'id': 'f9c6a9a1-e5a3-4af2-8413-8cf5b0d1e3ae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 327, 'network_id': '472e0931-6be9-4332-83a6-c65cb3b98b7d'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:31:06.787285 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-bcb68ba4-7657-4dd2-9ae7-54b1aaa7424c None None] Bound port: ab8e63ae-1230-482f-a48d-68b82b5ab45b, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f9c6a9a1-e5a3-4af2-8413-8cf5b0d1e3ae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 327, 'network_id': '472e0931-6be9-4332-83a6-c65cb3b98b7d'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:31:06.787285 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-bcb68ba4-7657-4dd2-9ae7-54b1aaa7424c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:06.850694 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-80accf7d-8236-43dc-a14f-ffe5dcca827a None None] Port bab3b0b2-ec0e-464a-b15f-1f71dc13f0f3 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:31:06.895051 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-bcb68ba4-7657-4dd2-9ae7-54b1aaa7424c None None] For port ab8e63ae-1230-482f-a48d-68b82b5ab45b, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:31:06.898718 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-bcb68ba4-7657-4dd2-9ae7-54b1aaa7424c None None] For port ab8e63ae-1230-482f-a48d-68b82b5ab45b, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=ab8e63ae-1230-482f-a48d-68b82b5ab45b,segment=NetworkSegment(f9c6a9a1-e5a3-4af2-8413-8cf5b0d1e3ae),segment_id=f9c6a9a1-e5a3-4af2-8413-8cf5b0d1e3ae)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:31:06.938889 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b6fdd8c6-e720-4e75-a31c-d182da64f249 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:06.940441 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5b597596-2c6d-4596-9e8f-49c57c8e0691 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:06.945972 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5b597596-2c6d-4596-9e8f-49c57c8e0691 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:06.953076 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5b597596-2c6d-4596-9e8f-49c57c8e0691 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:06.953076 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b6fdd8c6-e720-4e75-a31c-d182da64f249 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:06.970397 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-bcb68ba4-7657-4dd2-9ae7-54b1aaa7424c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:06.971745 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [req-3869370c-fc52-47e3-a8d0-b06b10455e56 req-838682a9-cb55-49bf-92d1-3b068d007aaf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:07.007599 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-66ff9376-7bc6-49bb-8838-a79445166876 None None] Network 0a61eb3b-f9c4-4bc0-94dd-9f48ad858a9d requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:07.024335 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7e4bcdd-60db-4ca4-8d9a-0aea8211c2b2 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event deleted for resources: {'Subnet': ['ID=46e2a34a-c423-454a-a4ea-0bc78ae2ec41,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:07.026395 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e2670e53-1909-4c65-ae08-7085dd48a0c6 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:07.032575 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e2670e53-1909-4c65-ae08-7085dd48a0c6 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:07.033275 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e2670e53-1909-4c65-ae08-7085dd48a0c6 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:07.048153 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d7e4bcdd-60db-4ca4-8d9a-0aea8211c2b2 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:07.054108 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-d7e4bcdd-60db-4ca4-8d9a-0aea8211c2b2 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "DELETE /v2.0/subnets/46e2a34a-c423-454a-a4ea-0bc78ae2ec41 HTTP/1.1" status: 204 len: 168 time: 1.7003071 Nov 09 04:31:07.058123 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55156) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:07.101186 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b597596-2c6d-4596-9e8f-49c57c8e0691 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Network': ['ID=988d2354-693c-4d52-af17-25e0643eaa0c,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:07.132987 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-5b597596-2c6d-4596-9e8f-49c57c8e0691 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 786 time: 2.1420856 Nov 09 04:31:07.141839 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55160) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:07.151642 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-346be615-7ddd-4e37-a33d-833afe732015 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'subnet': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:07.194244 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-838682a9-cb55-49bf-92d1-3b068d007aaf service neutron] Pushing event updated for resources: {'Port': ['ID=99ad1d96-b35b-4120-b5a9-c95c47bd3ffc,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:07.226267 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:31:07.255408 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bcb68ba4-7657-4dd2-9ae7-54b1aaa7424c None None] Pushing event updated for resources: {'Port': ['ID=ab8e63ae-1230-482f-a48d-68b82b5ab45b,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:07.370656 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-cfec9fa4-7249-4b4e-9987-800160cfe9e1 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Deleting subnet 91be2814-c9e6-41c8-8b39-591a057bbda9 {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:31:07.451828 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cfec9fa4-7249-4b4e-9987-800160cfe9e1 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:07.463418 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-699753d0-5efa-4b42-965a-6a49cd15d7e8 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:31:07.475054 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-699753d0-5efa-4b42-965a-6a49cd15d7e8 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "PUT /v2.0/routers/20fa17b9-5a43-469e-a0de-e9be80c05f6f/add_router_interface HTTP/1.1" status: 200 len: 503 time: 10.6661654 Nov 09 04:31:07.550762 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a23f5c62-43d9-42fc-9228-cdd76bf5ff33 None None] Sync routers for ids ['20fa17b9-5a43-469e-a0de-e9be80c05f6f'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:31:07.565812 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a23f5c62-43d9-42fc-9228-cdd76bf5ff33 None None] Routers {'20fa17b9-5a43-469e-a0de-e9be80c05f6f'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:31:07.566729 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-a23f5c62-43d9-42fc-9228-cdd76bf5ff33 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:30:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['20fa17b9-5a43-469e-a0de-e9be80c05f6f'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:07.617901 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-160733ba-0c7a-4f31-9685-170aee1b195e None None] DHCP port deletion for 0a61eb3b-f9c4-4bc0-94dd-9f48ad858a9d request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:31:07.661688 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [req-3869370c-fc52-47e3-a8d0-b06b10455e56 req-838682a9-cb55-49bf-92d1-3b068d007aaf service neutron] Attempting to bind port 99ad1d96-b35b-4120-b5a9-c95c47bd3ffc on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:31:07.672213 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [req-3869370c-fc52-47e3-a8d0-b06b10455e56 req-838682a9-cb55-49bf-92d1-3b068d007aaf service neutron] Attempting to bind port 99ad1d96-b35b-4120-b5a9-c95c47bd3ffc by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'e211d893-ee7a-48e3-bc29-b8824167e15b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 325, 'network_id': 'a270b61c-1f4f-4d97-be79-4a24c65fddc2'}] {{(pid=102161) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:31:07.672993 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3869370c-fc52-47e3-a8d0-b06b10455e56 req-838682a9-cb55-49bf-92d1-3b068d007aaf service neutron] Attempting to bind port 99ad1d96-b35b-4120-b5a9-c95c47bd3ffc on network a270b61c-1f4f-4d97-be79-4a24c65fddc2 {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:31:07.677813 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cfec9fa4-7249-4b4e-9987-800160cfe9e1 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:07.731228 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e2670e53-1909-4c65-ae08-7085dd48a0c6 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 781 time: 1.6780505 Nov 09 04:31:07.732008 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b6fdd8c6-e720-4e75-a31c-d182da64f249 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:07.732495 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b6fdd8c6-e720-4e75-a31c-d182da64f249 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Fanout notify agent at l3_agent the message router_deleted on router e9b01a01-61f1-462d-88a5-1936b443614d {{(pid=102162) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:31:07.743967 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-160733ba-0c7a-4f31-9685-170aee1b195e None None] Deleting port 9ba426d3-a467-48c0-af5a-2a69f373ca1a {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:31:07.745758 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-160733ba-0c7a-4f31-9685-170aee1b195e None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:07.753854 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55164) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:07.783068 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b6fdd8c6-e720-4e75-a31c-d182da64f249 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:07.785375 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-b6fdd8c6-e720-4e75-a31c-d182da64f249 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] 10.222.0.24 "DELETE /v2.0/routers/e9b01a01-61f1-462d-88a5-1936b443614d HTTP/1.1" status: 204 len: 168 time: 3.1673226 Nov 09 04:31:07.826540 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cfec9fa4-7249-4b4e-9987-800160cfe9e1 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:07.829144 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55168) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:07.832217 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2670e53-1909-4c65-ae08-7085dd48a0c6 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event updated for resources: {'Network': ['ID=58e0a9a1-6f0d-416b-a47b-26ea5282a8d9,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:07.885449 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 58e0a9a1-6f0d-416b-a47b-26ea5282a8d9 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:31:07.892768 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-b0217cb7-0cf2-48c3-9f00-f313571b193b tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Request body: {'router': {'name': 'tempest-RoutersAdminTest-router-743000450', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:07.893367 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3869370c-fc52-47e3-a8d0-b06b10455e56 req-838682a9-cb55-49bf-92d1-3b068d007aaf service neutron] Port 99ad1d96-b35b-4120-b5a9-c95c47bd3ffc on network a270b61c-1f4f-4d97-be79-4a24c65fddc2 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:31:07.893793 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3869370c-fc52-47e3-a8d0-b06b10455e56 req-838682a9-cb55-49bf-92d1-3b068d007aaf service neutron] Attempting to bind port 99ad1d96-b35b-4120-b5a9-c95c47bd3ffc on network a270b61c-1f4f-4d97-be79-4a24c65fddc2 {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:31:07.900356 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-a23f5c62-43d9-42fc-9228-cdd76bf5ff33 None None] Set router 20fa17b9-5a43-469e-a0de-e9be80c05f6f gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:31:07.920477 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3869370c-fc52-47e3-a8d0-b06b10455e56 req-838682a9-cb55-49bf-92d1-3b068d007aaf service neutron] Checking agent: {'id': '7d36b884-4ad2-4878-9464-bf647030b544', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'started_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 30, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:31:07.921003 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3869370c-fc52-47e3-a8d0-b06b10455e56 req-838682a9-cb55-49bf-92d1-3b068d007aaf service neutron] Checking segment: {'id': 'e211d893-ee7a-48e3-bc29-b8824167e15b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 325, 'network_id': 'a270b61c-1f4f-4d97-be79-4a24c65fddc2'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:31:07.921874 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3869370c-fc52-47e3-a8d0-b06b10455e56 req-838682a9-cb55-49bf-92d1-3b068d007aaf service neutron] Bound using segment: {'id': 'e211d893-ee7a-48e3-bc29-b8824167e15b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 325, 'network_id': 'a270b61c-1f4f-4d97-be79-4a24c65fddc2'} {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:31:07.922510 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [req-3869370c-fc52-47e3-a8d0-b06b10455e56 req-838682a9-cb55-49bf-92d1-3b068d007aaf service neutron] Bound port: 99ad1d96-b35b-4120-b5a9-c95c47bd3ffc, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e211d893-ee7a-48e3-bc29-b8824167e15b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 325, 'network_id': 'a270b61c-1f4f-4d97-be79-4a24c65fddc2'}}] {{(pid=102161) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:31:07.923189 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [req-3869370c-fc52-47e3-a8d0-b06b10455e56 req-838682a9-cb55-49bf-92d1-3b068d007aaf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:07.991919 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a18dd6b1-83a4-4543-ab76-8ad9f48e30a4 req-6922ef68-5389-4ebe-9570-849c3e06c75a tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:07.993844 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a18dd6b1-83a4-4543-ab76-8ad9f48e30a4 req-6922ef68-5389-4ebe-9570-849c3e06c75a tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 943 time: 0.2963898 Nov 09 04:31:08.003190 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6ec06a5f-915d-40b1-9da0-c13482434a42 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:08.007842 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-6ec06a5f-915d-40b1-9da0-c13482434a42 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "GET /v2.0/networks?id=58e0a9a1-6f0d-416b-a47b-26ea5282a8d9 HTTP/1.1" status: 200 len: 760 time: 0.2529354 Nov 09 04:31:08.011188 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55178) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:08.014823 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1a3b3d08-b641-4a63-94c8-658867f1dfb6 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Made reservation on behalf of 88f9f8da29bf4a8793b45130d483a6e6 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:08.019138 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1a3b3d08-b641-4a63-94c8-658867f1dfb6 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:08.023169 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-160733ba-0c7a-4f31-9685-170aee1b195e None None] For port 9ba426d3-a467-48c0-af5a-2a69f373ca1a, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=9ba426d3-a467-48c0-af5a-2a69f373ca1a,segment=NetworkSegment(610156cc-bb06-4490-92ef-b436312a6831),segment_id=610156cc-bb06-4490-92ef-b436312a6831)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:31:08.023539 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-160733ba-0c7a-4f31-9685-170aee1b195e None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:08.030236 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-652e7db4-4288-4f9c-acc3-e610bb59580b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Request body: {'network': {'description': 'd2'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:08.032478 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f56f1e8d-4b6d-451a-a6f3-42120c90c40d req-ee181721-3491-4512-ab87-544e2a53b2ff tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-2098836817&fields=id&tenant_id=fd7df27e425449dfb80d0838c8f7fb89 HTTP/1.1" status: 200 len: 267 time: 0.1422224 Nov 09 04:31:08.055757 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-160733ba-0c7a-4f31-9685-170aee1b195e None None] Calling delete_port for 9ba426d3-a467-48c0-af5a-2a69f373ca1a owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:31:08.111575 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b4a232ce-4d56-4231-974d-d5d0d8779d3e None None] Network 40dee9cb-19f2-4ff9-b4f7-f821196139d9 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:08.191918 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-4d10f119-b742-480a-8aae-7d0d6d64736a None None] Provisioning complete for port 627d2dd9-7b3b-4b20-a4e4-18764ff393f3 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:08.192241 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4d10f119-b742-480a-8aae-7d0d6d64736a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:08.215100 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b0217cb7-0cf2-48c3-9f00-f313571b193b tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:08.216553 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b0217cb7-0cf2-48c3-9f00-f313571b193b tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:08.298047 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a18dd6b1-83a4-4543-ab76-8ad9f48e30a4 req-7a1562c4-8332-4930-9205-a766ff4ba313 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2856171 Nov 09 04:31:08.327320 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.objects.ports [None req-37f64c87-fe2a-4011-92e5-267763f2d9c8 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=102161) get_objects /opt/stack/neutron/neutron/objects/ports.py:444}} Nov 09 04:31:08.338694 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cfec9fa4-7249-4b4e-9987-800160cfe9e1 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:08.342418 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-346be615-7ddd-4e37-a33d-833afe732015 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:08.346192 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-346be615-7ddd-4e37-a33d-833afe732015 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:08.347575 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [req-3869370c-fc52-47e3-a8d0-b06b10455e56 req-838682a9-cb55-49bf-92d1-3b068d007aaf service neutron] For port 99ad1d96-b35b-4120-b5a9-c95c47bd3ffc, host hv-neutron-8168, cleared binding levels {{(pid=102161) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:31:08.352165 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-a23f5c62-43d9-42fc-9228-cdd76bf5ff33 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '20fa17b9-5a43-469e-a0de-e9be80c05f6f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1135837892', 'tenant_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.69'}], 'enable_snat': True}, 'gw_port_id': '8508be40-2af9-45a5-96f0-06d142f33d8d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:30:45Z', 'updated_at': '2021-11-09T04:31:03Z', 'revision_number': 4, 'project_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'gw_port': {'id': '8508be40-2af9-45a5-96f0-06d142f33d8d', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:95:95:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '20fa17b9-5a43-469e-a0de-e9be80c05f6f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 567, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:30:48Z', 'updated_at': '2021-11-09T04:30:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'bab3b0b2-ec0e-464a-b15f-1f71dc13f0f3', 'name': '', 'network_id': '9c94e7dc-d679-4a7e-b264-6d619dbc935e', 'tenant_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'mac_address': 'fa:16:3e:b2:bf:75', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '20fa17b9-5a43-469e-a0de-e9be80c05f6f', 'device_owner': 'network:router_interface', 'standard_attr_id': 610, 'fixed_ips': [{'subnet_id': '003822ea-7d1a-41fa-a15f-16fc8c9f624c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:31:00Z', 'updated_at': '2021-11-09T04:31:04Z', 'revision_number': 2, 'project_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'subnets': [{'id': '003822ea-7d1a-41fa-a15f-16fc8c9f624c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:08.362977 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-37f64c87-fe2a-4011-92e5-267763f2d9c8 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:08.374172 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cfec9fa4-7249-4b4e-9987-800160cfe9e1 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:08.382284 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-cfec9fa4-7249-4b4e-9987-800160cfe9e1 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "DELETE /v2.0/subnets/91be2814-c9e6-41c8-8b39-591a057bbda9 HTTP/1.1" status: 204 len: 168 time: 1.3181827 Nov 09 04:31:08.394954 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2f8d56df-43c2-401a-8597-1fa6f40b2650 None None] Network db9e10ea-0b45-4893-ab26-2f1ea5e8271b requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:08.399443 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55180) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:08.422843 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cfec9fa4-7249-4b4e-9987-800160cfe9e1 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event deleted for resources: {'Subnet': ['ID=91be2814-c9e6-41c8-8b39-591a057bbda9,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:08.426195 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [req-3869370c-fc52-47e3-a8d0-b06b10455e56 req-838682a9-cb55-49bf-92d1-3b068d007aaf service neutron] For port 99ad1d96-b35b-4120-b5a9-c95c47bd3ffc, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=99ad1d96-b35b-4120-b5a9-c95c47bd3ffc,segment=NetworkSegment(e211d893-ee7a-48e3-bc29-b8824167e15b),segment_id=e211d893-ee7a-48e3-bc29-b8824167e15b)] {{(pid=102161) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:31:08.435297 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f56f1e8d-4b6d-451a-a6f3-42120c90c40d req-2722756f-76c1-4ef6-ae64-e28d97782c50 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:08.439350 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f56f1e8d-4b6d-451a-a6f3-42120c90c40d req-2722756f-76c1-4ef6-ae64-e28d97782c50 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/networks?id=9c94e7dc-d679-4a7e-b264-6d619dbc935e HTTP/1.1" status: 200 len: 797 time: 0.3938384 Nov 09 04:31:08.450971 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a23f5c62-43d9-42fc-9228-cdd76bf5ff33 None None] Checking router: 20fa17b9-5a43-469e-a0de-e9be80c05f6f for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:31:08.453660 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a23f5c62-43d9-42fc-9228-cdd76bf5ff33 None None] Updating router 20fa17b9-5a43-469e-a0de-e9be80c05f6f port bab3b0b2-ec0e-464a-b15f-1f71dc13f0f3 binding host dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 04:31:08.492574 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-a23f5c62-43d9-42fc-9228-cdd76bf5ff33 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:08.518895 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4d10f119-b742-480a-8aae-7d0d6d64736a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:08.528981 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [req-3869370c-fc52-47e3-a8d0-b06b10455e56 req-838682a9-cb55-49bf-92d1-3b068d007aaf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:08.587695 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b0217cb7-0cf2-48c3-9f00-f313571b193b tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:08.590765 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-4d10f119-b742-480a-8aae-7d0d6d64736a None None] For port 627d2dd9-7b3b-4b20-a4e4-18764ff393f3, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=627d2dd9-7b3b-4b20-a4e4-18764ff393f3,segment=NetworkSegment(a5dc97b2-9efa-4398-bd82-7057a61e12f5),segment_id=a5dc97b2-9efa-4398-bd82-7057a61e12f5)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:31:08.599272 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-160733ba-0c7a-4f31-9685-170aee1b195e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:08.629423 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3869370c-fc52-47e3-a8d0-b06b10455e56 req-838682a9-cb55-49bf-92d1-3b068d007aaf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:08.630045 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [req-3869370c-fc52-47e3-a8d0-b06b10455e56 req-838682a9-cb55-49bf-92d1-3b068d007aaf service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:08.631904 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-3869370c-fc52-47e3-a8d0-b06b10455e56 req-838682a9-cb55-49bf-92d1-3b068d007aaf service neutron] 10.222.0.26 "PUT /v2.0/ports/99ad1d96-b35b-4120-b5a9-c95c47bd3ffc HTTP/1.1" status: 200 len: 1093 time: 3.3012335 Nov 09 04:31:08.641513 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f56f1e8d-4b6d-451a-a6f3-42120c90c40d req-42dcf612-2714-4fec-bcbb-f18c16a35ed8 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/quotas/fd7df27e425449dfb80d0838c8f7fb89 HTTP/1.1" status: 200 len: 375 time: 0.1459975 Nov 09 04:31:08.680881 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-652e7db4-4288-4f9c-acc3-e610bb59580b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:08.689820 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-160733ba-0c7a-4f31-9685-170aee1b195e None None] Pushing event deleted for resources: {'Port': ['ID=9ba426d3-a467-48c0-af5a-2a69f373ca1a,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:08.697455 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b0217cb7-0cf2-48c3-9f00-f313571b193b tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:08.712496 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '433dca8f-3e84-4693-93ed-4f8fcd69553a', 'tag': '99ad1d96-b35b-4120-b5a9-c95c47bd3ffc'}] {{(pid=102161) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:31:08.714510 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}99dfdda0def497b4372884ef2eb87f06b1e425c8eba5ceda5f64bbab037a07d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3e4cc1b5-5ddf-41ef-a12e-c2db42d461f2" -d '{"events": [{"name": "network-changed", "server_uuid": "433dca8f-3e84-4693-93ed-4f8fcd69553a", "tag": "99ad1d96-b35b-4120-b5a9-c95c47bd3ffc"}]}' {{(pid=102161) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:31:08.721726 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4d10f119-b742-480a-8aae-7d0d6d64736a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:08.759552 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-160733ba-0c7a-4f31-9685-170aee1b195e None None] No DVR routers for this DVR port 9ba426d3-a467-48c0-af5a-2a69f373ca1a on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:31:08.761968 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 627d2dd9-7b3b-4b20-a4e4-18764ff393f3 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:31:08.771978 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5fa58ade-d449-46d7-beed-a50ee148b453 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:08.831630 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-652e7db4-4288-4f9c-acc3-e610bb59580b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:08.843731 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:31:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1edfca38-882e-41ab-ae5d-a69c70a119f9 x-openstack-request-id: req-1edfca38-882e-41ab-ae5d-a69c70a119f9 {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:31:08.844313 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "433dca8f-3e84-4693-93ed-4f8fcd69553a", "tag": "99ad1d96-b35b-4120-b5a9-c95c47bd3ffc", "status": "completed", "code": 200}]} {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:31:08.844749 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-1edfca38-882e-41ab-ae5d-a69c70a119f9 {{(pid=102161) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:31:08.845476 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '433dca8f-3e84-4693-93ed-4f8fcd69553a', 'tag': '99ad1d96-b35b-4120-b5a9-c95c47bd3ffc', 'status': 'completed', 'code': 200} Nov 09 04:31:08.900747 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37f64c87-fe2a-4011-92e5-267763f2d9c8 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Pushing event updated for resources: {'Subnet': ['ID=0a62af1b-0b59-428b-9d98-66562f1625b1,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:08.929177 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-37f64c87-fe2a-4011-92e5-267763f2d9c8 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Checking segment: {'id': '303916b3-0435-4d77-9e83-60967f186bbf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 330, 'network_id': 'b64bd442-d79d-4349-b9b3-5833909b2409'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:31:08.929844 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-37f64c87-fe2a-4011-92e5-267763f2d9c8 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Network hostable DHCP agents. Network: b64bd442-d79d-4349-b9b3-5833909b2409, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:31:08.934474 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b0217cb7-0cf2-48c3-9f00-f313571b193b tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:08.935486 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-838682a9-cb55-49bf-92d1-3b068d007aaf service neutron] Pushing event updated for resources: {'Port': ['ID=99ad1d96-b35b-4120-b5a9-c95c47bd3ffc,revision_number=3']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:08.935826 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-b0217cb7-0cf2-48c3-9f00-f313571b193b tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 704 time: 1.1054530 Nov 09 04:31:08.942934 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-652e7db4-4288-4f9c-acc3-e610bb59580b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event updated for resources: {'Network': ['ID=58e0a9a1-6f0d-416b-a47b-26ea5282a8d9,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:08.948942 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55184) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:08.967383 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-f1ec9560-532e-47e7-9a4f-896f769f8c93 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'enable_snat': True}}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:08.977397 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 58e0a9a1-6f0d-416b-a47b-26ea5282a8d9 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:31:09.032139 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b7536816-e3a3-4efb-bcb2-c17b51e7693c None None] Network 472e0931-6be9-4332-83a6-c65cb3b98b7d requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:09.033715 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f56f1e8d-4b6d-451a-a6f3-42120c90c40d req-b2d385ae-86c4-47b1-8a12-940d206d7bc2 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/ports?tenant_id=fd7df27e425449dfb80d0838c8f7fb89&fields=id HTTP/1.1" status: 200 len: 302 time: 0.3912961 Nov 09 04:31:09.059175 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3869370c-fc52-47e3-a8d0-b06b10455e56 req-16ad9bce-6156-4e01-8b1c-8ec77d057d5b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:09.059175 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-3869370c-fc52-47e3-a8d0-b06b10455e56 req-16ad9bce-6156-4e01-8b1c-8ec77d057d5b service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=6015befde7f546d881cb247ae5bc81ae&device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 1096 time: 0.2530358 Nov 09 04:31:09.078683 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-a23f5c62-43d9-42fc-9228-cdd76bf5ff33 None None] Publish callbacks [] for port, precommit_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:09.104993 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-652e7db4-4288-4f9c-acc3-e610bb59580b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Network 58e0a9a1-6f0d-416b-a47b-26ea5282a8d9 is not hosted by any dhcp agent {{(pid=102162) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Nov 09 04:31:09.111282 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-652e7db4-4288-4f9c-acc3-e610bb59580b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:09.111872 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-652e7db4-4288-4f9c-acc3-e610bb59580b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:09.113117 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-652e7db4-4288-4f9c-acc3-e610bb59580b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "PUT /v2.0/networks/58e0a9a1-6f0d-416b-a47b-26ea5282a8d9 HTTP/1.1" status: 200 len: 757 time: 1.0994353 Nov 09 04:31:09.116830 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55186) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:09.118268 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-3869370c-fc52-47e3-a8d0-b06b10455e56 req-cbc167d9-c414-4d00-bc55-fb4c387378f7 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=99ad1d96-b35b-4120-b5a9-c95c47bd3ffc HTTP/1.1" status: 200 len: 217 time: 0.0514600 Nov 09 04:31:09.126870 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d10f119-b742-480a-8aae-7d0d6d64736a None None] Pushing event updated for resources: {'Port': ['ID=627d2dd9-7b3b-4b20-a4e4-18764ff393f3,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:09.162910 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-a23f5c62-43d9-42fc-9228-cdd76bf5ff33 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:09.180076 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-37f64c87-fe2a-4011-92e5-267763f2d9c8 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Network b64bd442-d79d-4349-b9b3-5833909b2409 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:31:09.232989 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50b4e9e2-da5c-46ed-920e-9ca9d17a0653 None None] Pushing event updated for resources: {'Port': ['ID=bab3b0b2-ec0e-464a-b15f-1f71dc13f0f3,revision_number=3']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:09.290341 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3869370c-fc52-47e3-a8d0-b06b10455e56 req-ee19978d-22e5-49fc-ad7f-0364eb9478fe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:09.291980 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-3869370c-fc52-47e3-a8d0-b06b10455e56 req-ee19978d-22e5-49fc-ad7f-0364eb9478fe service neutron] 10.222.0.26 "GET /v2.0/subnets?id=b2956e71-9b0f-4060-922c-e54ce6cff80a HTTP/1.1" status: 200 len: 851 time: 0.1621377 Nov 09 04:31:09.303166 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7242c5c0-e522-4671-8853-b6bba8448e6f tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:09.304768 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-7242c5c0-e522-4671-8853-b6bba8448e6f tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "GET /v2.0/networks?id=58e0a9a1-6f0d-416b-a47b-26ea5282a8d9 HTTP/1.1" status: 200 len: 760 time: 0.1855760 Nov 09 04:31:09.309102 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55188) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:09.324265 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-37f64c87-fe2a-4011-92e5-267763f2d9c8 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, b64bd442-d79d-4349-b9b3-5833909b2409) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:09.339268 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-d71a85ca-795e-40d6-a4a5-d1c2b0011254 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-1355256357'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:09.347807 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b2712ba3-7354-41ff-819a-e6e308f38f2b None None] Network b64bd442-d79d-4349-b9b3-5833909b2409 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:09.373907 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-37f64c87-fe2a-4011-92e5-267763f2d9c8 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:09.374560 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-37f64c87-fe2a-4011-92e5-267763f2d9c8 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:09.403072 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5fa58ade-d449-46d7-beed-a50ee148b453 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:09.413482 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-a23f5c62-43d9-42fc-9228-cdd76bf5ff33 None None] Attempting to bind port bab3b0b2-ec0e-464a-b15f-1f71dc13f0f3 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:31:09.414054 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-a23f5c62-43d9-42fc-9228-cdd76bf5ff33 None None] Attempting to bind port bab3b0b2-ec0e-464a-b15f-1f71dc13f0f3 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'd5411e15-1506-4025-8472-ba7118358f68', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 313, 'network_id': '9c94e7dc-d679-4a7e-b264-6d619dbc935e'}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:31:09.414934 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a23f5c62-43d9-42fc-9228-cdd76bf5ff33 None None] Attempting to bind port bab3b0b2-ec0e-464a-b15f-1f71dc13f0f3 on network 9c94e7dc-d679-4a7e-b264-6d619dbc935e {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:31:09.425255 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-56a2c121-7c11-4cf0-afce-05e77755ca51 None None] Provisioning complete for port ab8e63ae-1230-482f-a48d-68b82b5ab45b triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:09.425621 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a2c121-7c11-4cf0-afce-05e77755ca51 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:09.428580 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a23f5c62-43d9-42fc-9228-cdd76bf5ff33 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 30, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:31:09.429334 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a23f5c62-43d9-42fc-9228-cdd76bf5ff33 None None] Checking segment: {'id': 'd5411e15-1506-4025-8472-ba7118358f68', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 313, 'network_id': '9c94e7dc-d679-4a7e-b264-6d619dbc935e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102164) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:31:09.430013 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f56f1e8d-4b6d-451a-a6f3-42120c90c40d req-05f494ab-484e-4139-bb44-a58047cf4390 service neutron] 10.222.0.24 "GET /v2.0/networks/9c94e7dc-d679-4a7e-b264-6d619dbc935e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3752820 Nov 09 04:31:09.430148 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-a23f5c62-43d9-42fc-9228-cdd76bf5ff33 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:09.430790 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a23f5c62-43d9-42fc-9228-cdd76bf5ff33 None None] Bound using segment: {'id': 'd5411e15-1506-4025-8472-ba7118358f68', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 313, 'network_id': '9c94e7dc-d679-4a7e-b264-6d619dbc935e'} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:31:09.431430 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-a23f5c62-43d9-42fc-9228-cdd76bf5ff33 None None] Bound port: bab3b0b2-ec0e-464a-b15f-1f71dc13f0f3, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd5411e15-1506-4025-8472-ba7118358f68', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 313, 'network_id': '9c94e7dc-d679-4a7e-b264-6d619dbc935e'}}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:31:09.432749 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-a23f5c62-43d9-42fc-9228-cdd76bf5ff33 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:09.513633 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 627d2dd9-7b3b-4b20-a4e4-18764ff393f3 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:09.513981 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:09.534966 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d71a85ca-795e-40d6-a4a5-d1c2b0011254 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Made reservation on behalf of 6761c80dbfa84798bb6517a9b532f870 for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:09.542337 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d71a85ca-795e-40d6-a4a5-d1c2b0011254 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:09.549173 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3869370c-fc52-47e3-a8d0-b06b10455e56 req-1a17bdb9-16a0-49e5-93f0-57ecaf9482aa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:09.551082 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-3869370c-fc52-47e3-a8d0-b06b10455e56 req-1a17bdb9-16a0-49e5-93f0-57ecaf9482aa service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=a270b61c-1f4f-4d97-be79-4a24c65fddc2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.2431588 Nov 09 04:31:09.568235 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-37f64c87-fe2a-4011-92e5-267763f2d9c8 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 827 time: 3.8709431 Nov 09 04:31:09.587411 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d2b5827c-3c40-4666-8ff0-b2453b7eb6e8 None None] DHCP port deletion for db9e10ea-0b45-4893-ab26-2f1ea5e8271b request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:31:09.596710 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55192) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:09.610189 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-1f88dd1c-55c5-4b22-8e40-dc4f7ff42cca tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Request body: {'port': {'network_id': 'b64bd442-d79d-4349-b9b3-5833909b2409', 'name': 'tempest-NetworksIpV6TestAttrs-1386024912'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:09.620577 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f1ec9560-532e-47e7-9a4f-896f769f8c93 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:09.633375 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-a23f5c62-43d9-42fc-9228-cdd76bf5ff33 None None] For port bab3b0b2-ec0e-464a-b15f-1f71dc13f0f3, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102164) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:31:09.639515 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-a23f5c62-43d9-42fc-9228-cdd76bf5ff33 None None] For port bab3b0b2-ec0e-464a-b15f-1f71dc13f0f3, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=bab3b0b2-ec0e-464a-b15f-1f71dc13f0f3,segment=NetworkSegment(d5411e15-1506-4025-8472-ba7118358f68),segment_id=d5411e15-1506-4025-8472-ba7118358f68)] {{(pid=102164) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:31:09.645204 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-5fa58ade-d449-46d7-beed-a50ee148b453 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0a61eb3b-f9c4-4bc0-94dd-9f48ad858a9d']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:09.666632 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-5fa58ade-d449-46d7-beed-a50ee148b453 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '610156cc-bb06-4490-92ef-b436312a6831') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:09.666955 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-5fa58ade-d449-46d7-beed-a50ee148b453 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '610156cc-bb06-4490-92ef-b436312a6831') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:09.714513 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5fa58ade-d449-46d7-beed-a50ee148b453 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:09.719716 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-a23f5c62-43d9-42fc-9228-cdd76bf5ff33 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:09.764609 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14fe175c-e3e7-468c-9058-95f0321c3688 req-ef53769f-04f0-4f03-88f5-030f667fe9ce tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:09.766273 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-14fe175c-e3e7-468c-9058-95f0321c3688 req-ef53769f-04f0-4f03-88f5-030f667fe9ce tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 943 time: 0.3583279 Nov 09 04:31:09.776989 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5fa58ade-d449-46d7-beed-a50ee148b453 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:09.787716 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device ab8e63ae-1230-482f-a48d-68b82b5ab45b up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:31:09.788810 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d71a85ca-795e-40d6-a4a5-d1c2b0011254 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 326} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:31:09.825204 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f56f1e8d-4b6d-451a-a6f3-42120c90c40d req-21e52a56-5b6f-485b-b66d-dd5e9f710492 service neutron] 10.222.0.24 "GET /v2.0/networks/9c94e7dc-d679-4a7e-b264-6d619dbc935e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3846614 Nov 09 04:31:09.826873 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5fa58ade-d449-46d7-beed-a50ee148b453 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Releasing vlan 316 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:31:09.827687 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5fa58ade-d449-46d7-beed-a50ee148b453 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:09.832685 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:31:09.832685 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:31:09.832685 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:31:09.832685 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:31:09.832685 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:31:09.832685 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:31:09.832685 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:31:09.832685 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:31:09.832685 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:31:09.832685 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:31:09.832685 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:31:09.832685 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:31:09.832685 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:31:09.832685 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:31:09.832685 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:31:09.832685 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:31:09.832685 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:31:09.832685 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:31:09.832685 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:31:09.832685 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:31:09.832685 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:31:09.832685 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:31:09.832685 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:31:09.832685 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:31:09.832685 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:31:09.832685 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:31:09.832685 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:31:09.832685 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:31:09.832685 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:31:09.832685 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:31:09.832685 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:31:09.832685 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:31:09.835385 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1a3b3d08-b641-4a63-94c8-658867f1dfb6 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:09.843860 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d71a85ca-795e-40d6-a4a5-d1c2b0011254 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:09.847014 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-d71a85ca-795e-40d6-a4a5-d1c2b0011254 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Added segment 3defe9f8-d112-4c13-83df-42da5cffbca1 of type vlan for network 34540b11-0cc5-4059-9dc2-d2360b37c1c4 Nov 09 04:31:09.851178 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50b4e9e2-da5c-46ed-920e-9ca9d17a0653 None None] Pushing event updated for resources: {'Port': ['ID=bab3b0b2-ec0e-464a-b15f-1f71dc13f0f3,revision_number=4']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:09.887105 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-346be615-7ddd-4e37-a33d-833afe732015 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:09.905220 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a23f5c62-43d9-42fc-9228-cdd76bf5ff33 None None] Routers {'20fa17b9-5a43-469e-a0de-e9be80c05f6f'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:31:09.905890 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-a23f5c62-43d9-42fc-9228-cdd76bf5ff33 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:30:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['20fa17b9-5a43-469e-a0de-e9be80c05f6f'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:09.944809 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-3869370c-fc52-47e3-a8d0-b06b10455e56 req-c83f536f-07a2-461f-b25c-c50ed6bd9a69 service neutron] 10.222.0.26 "GET /v2.0/networks/a270b61c-1f4f-4d97-be79-4a24c65fddc2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3804197 Nov 09 04:31:09.950656 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d71a85ca-795e-40d6-a4a5-d1c2b0011254 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:10.005987 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a2c121-7c11-4cf0-afce-05e77755ca51 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:10.038081 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a3b3d08-b641-4a63-94c8-658867f1dfb6 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event updated for resources: {'Subnet': ['ID=853593ba-982b-48a1-b01d-006ead90d6dd,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:10.052529 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-d2b5827c-3c40-4666-8ff0-b2453b7eb6e8 None None] Deleting port 6bdef35f-00ac-46ea-a01f-2644260e91e1 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:31:10.052953 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d2b5827c-3c40-4666-8ff0-b2453b7eb6e8 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:10.165159 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-d2b5827c-3c40-4666-8ff0-b2453b7eb6e8 None None] For port 6bdef35f-00ac-46ea-a01f-2644260e91e1, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=6bdef35f-00ac-46ea-a01f-2644260e91e1,segment=NetworkSegment(de95ed3f-4273-400f-9757-f62070e21304),segment_id=de95ed3f-4273-400f-9757-f62070e21304)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:31:10.165559 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d2b5827c-3c40-4666-8ff0-b2453b7eb6e8 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:10.172062 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1a3b3d08-b641-4a63-94c8-658867f1dfb6 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Network 472e0931-6be9-4332-83a6-c65cb3b98b7d is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:31:10.214732 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-a23f5c62-43d9-42fc-9228-cdd76bf5ff33 None None] Set router 20fa17b9-5a43-469e-a0de-e9be80c05f6f gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:31:10.235897 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-1a3b3d08-b641-4a63-94c8-658867f1dfb6 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:10.247636 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1a3b3d08-b641-4a63-94c8-658867f1dfb6 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:10.248233 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1a3b3d08-b641-4a63-94c8-658867f1dfb6 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:10.254109 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5fa58ade-d449-46d7-beed-a50ee148b453 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:10.265939 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-14fe175c-e3e7-468c-9058-95f0321c3688 req-4c806b51-6e64-4537-a98c-fb0667796afa tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4861088 Nov 09 04:31:10.296640 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5fa58ade-d449-46d7-beed-a50ee148b453 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:10.307034 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-5fa58ade-d449-46d7-beed-a50ee148b453 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "DELETE /v2.0/networks/0a61eb3b-f9c4-4bc0-94dd-9f48ad858a9d HTTP/1.1" status: 204 len: 168 time: 1.8980422 Nov 09 04:31:10.307034 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-346be615-7ddd-4e37-a33d-833afe732015 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Subnet': ['ID=1bcc611a-d3c8-4019-aae7-12b401d69e2f,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:10.320487 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55198) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:10.346132 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fa58ade-d449-46d7-beed-a50ee148b453 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event deleted for resources: {'Network': ['ID=0a61eb3b-f9c4-4bc0-94dd-9f48ad858a9d,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:10.349357 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6a81ceb5-d8b5-46c3-a746-e6cb19ad9168 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-b64bd442-d79d-4349-b9b3-5833909b2409', 'network_id': 'b64bd442-d79d-4349-b9b3-5833909b2409', 'tenant_id': '6acf678d74da4512a431e262bbd32037', 'fixed_ips': [{'subnet_id': '0a62af1b-0b59-428b-9d98-66562f1625b1'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:31:10.350608 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6a81ceb5-d8b5-46c3-a746-e6cb19ad9168 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:10.372414 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-d2b5827c-3c40-4666-8ff0-b2453b7eb6e8 None None] Calling delete_port for 6bdef35f-00ac-46ea-a01f-2644260e91e1 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:31:10.423399 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-715ba15e-d5f9-416a-b66d-2571f67805ac None None] Network 472e0931-6be9-4332-83a6-c65cb3b98b7d requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:10.441978 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-346be615-7ddd-4e37-a33d-833afe732015 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Checking segment: {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:31:10.442350 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-346be615-7ddd-4e37-a33d-833afe732015 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Network hostable DHCP agents. Network: 988d2354-693c-4d52-af17-25e0643eaa0c, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:31:10.458514 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-56a2c121-7c11-4cf0-afce-05e77755ca51 None None] For port ab8e63ae-1230-482f-a48d-68b82b5ab45b, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=ab8e63ae-1230-482f-a48d-68b82b5ab45b,segment=NetworkSegment(f9c6a9a1-e5a3-4af2-8413-8cf5b0d1e3ae),segment_id=f9c6a9a1-e5a3-4af2-8413-8cf5b0d1e3ae)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:31:10.464004 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port ab8e63ae-1230-482f-a48d-68b82b5ab45b triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:10.464693 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c9cc0f36-a8b8-43a3-a25f-d163bc5c67e6 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:10.464838 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:10.522514 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a2c121-7c11-4cf0-afce-05e77755ca51 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:10.575029 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-242385a5-2a98-4964-bdd3-54c1d342f0c5 req-1371c81d-9ad6-4a73-a444-23184f070f34 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/ports?device_id=9c4e58e3-39e4-4212-b106-50b44d4c4e28 HTTP/1.1" status: 200 len: 210 time: 0.0363786 Nov 09 04:31:10.582430 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-346be615-7ddd-4e37-a33d-833afe732015 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Network 988d2354-693c-4d52-af17-25e0643eaa0c is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:31:10.619508 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1f88dd1c-55c5-4b22-8e40-dc4f7ff42cca tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Made reservation on behalf of 6acf678d74da4512a431e262bbd32037 for: {'port': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:10.623601 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1f88dd1c-55c5-4b22-8e40-dc4f7ff42cca tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:10.646420 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d71a85ca-795e-40d6-a4a5-d1c2b0011254 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:10.652085 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d71a85ca-795e-40d6-a4a5-d1c2b0011254 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:10.652955 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d71a85ca-795e-40d6-a4a5-d1c2b0011254 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:10.673036 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-3869370c-fc52-47e3-a8d0-b06b10455e56 req-0aec9ccf-9493-4646-9d4e-22dd99388e18 service neutron] 10.222.0.26 "GET /v2.0/networks/a270b61c-1f4f-4d97-be79-4a24c65fddc2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7121820 Nov 09 04:31:10.702121 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [None req-1f88dd1c-55c5-4b22-8e40-dc4f7ff42cca tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] device_id is not set on port 390ecda3-53a0-42c3-9d18-914395f6acad yet. {{(pid=102161) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:31:10.706586 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-c9cc0f36-a8b8-43a3-a25f-d163bc5c67e6 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Deleting port 6bdef35f-00ac-46ea-a01f-2644260e91e1 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:31:10.706925 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c9cc0f36-a8b8-43a3-a25f-d163bc5c67e6 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:10.715606 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f1ec9560-532e-47e7-9a4f-896f769f8c93 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:10.725567 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-a23f5c62-43d9-42fc-9228-cdd76bf5ff33 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '20fa17b9-5a43-469e-a0de-e9be80c05f6f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1135837892', 'tenant_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.69'}], 'enable_snat': True}, 'gw_port_id': '8508be40-2af9-45a5-96f0-06d142f33d8d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:30:45Z', 'updated_at': '2021-11-09T04:31:03Z', 'revision_number': 4, 'project_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'gw_port': {'id': '8508be40-2af9-45a5-96f0-06d142f33d8d', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:95:95:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '20fa17b9-5a43-469e-a0de-e9be80c05f6f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 567, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:30:48Z', 'updated_at': '2021-11-09T04:30:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'bab3b0b2-ec0e-464a-b15f-1f71dc13f0f3', 'name': '', 'network_id': '9c94e7dc-d679-4a7e-b264-6d619dbc935e', 'tenant_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'mac_address': 'fa:16:3e:b2:bf:75', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '20fa17b9-5a43-469e-a0de-e9be80c05f6f', 'device_owner': 'network:router_interface', 'standard_attr_id': 610, 'fixed_ips': [{'subnet_id': '003822ea-7d1a-41fa-a15f-16fc8c9f624c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:31:00Z', 'updated_at': '2021-11-09T04:31:09Z', 'revision_number': 4, 'project_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'subnets': [{'id': '003822ea-7d1a-41fa-a15f-16fc8c9f624c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:10.775480 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a23f5c62-43d9-42fc-9228-cdd76bf5ff33 None None] The sync data for ids ['20fa17b9-5a43-469e-a0de-e9be80c05f6f'] in dv-neutron-816802-2-hyperv is: [{'id': '20fa17b9-5a43-469e-a0de-e9be80c05f6f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1135837892', 'tenant_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.69'}], 'enable_snat': True}, 'gw_port_id': '8508be40-2af9-45a5-96f0-06d142f33d8d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:30:45Z', 'updated_at': '2021-11-09T04:31:03Z', 'revision_number': 4, 'project_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'gw_port': {'id': '8508be40-2af9-45a5-96f0-06d142f33d8d', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:95:95:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '20fa17b9-5a43-469e-a0de-e9be80c05f6f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 567, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:30:48Z', 'updated_at': '2021-11-09T04:30:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'bab3b0b2-ec0e-464a-b15f-1f71dc13f0f3', 'name': '', 'network_id': '9c94e7dc-d679-4a7e-b264-6d619dbc935e', 'tenant_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'mac_address': 'fa:16:3e:b2:bf:75', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '20fa17b9-5a43-469e-a0de-e9be80c05f6f', 'device_owner': 'network:router_interface', 'standard_attr_id': 610, 'fixed_ips': [{'subnet_id': '003822ea-7d1a-41fa-a15f-16fc8c9f624c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:31:00Z', 'updated_at': '2021-11-09T04:31:09Z', 'revision_number': 4, 'project_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'subnets': [{'id': '003822ea-7d1a-41fa-a15f-16fc8c9f624c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:31:10.796247 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-1a3b3d08-b641-4a63-94c8-658867f1dfb6 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 804 time: 4.0461931 Nov 09 04:31:10.798336 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f1ec9560-532e-47e7-9a4f-896f769f8c93 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:10.802631 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-346be615-7ddd-4e37-a33d-833afe732015 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 988d2354-693c-4d52-af17-25e0643eaa0c) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:10.806072 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-d71a85ca-795e-40d6-a4a5-d1c2b0011254 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 780 time: 1.4767511 Nov 09 04:31:10.806168 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55204) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:10.813468 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-f286fd37-6f65-42ca-aa86-a9711f807cbb tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Request body: {'port': {'network_id': '472e0931-6be9-4332-83a6-c65cb3b98b7d', 'fixed_ips': [{'subnet_id': 'a38fa5e5-0ac0-4d69-8fb6-dcbb9f935dc1'}, {'subnet_id': '853593ba-982b-48a1-b01d-006ead90d6dd'}], 'name': 'tempest-PortsTestJSON-1019269305'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:10.819409 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55206) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:10.828585 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-46cb05de-5aff-4c5a-8f17-f0d2a23c804b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Request body: {'subnet': {'network_id': '34540b11-0cc5-4059-9dc2-d2360b37c1c4', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:10.871627 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-33be0169-cc93-4140-addb-4141b427c2ff None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:10.880001 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-346be615-7ddd-4e37-a33d-833afe732015 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:10.880964 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-346be615-7ddd-4e37-a33d-833afe732015 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:10.964069 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56a2c121-7c11-4cf0-afce-05e77755ca51 None None] Pushing event updated for resources: {'Port': ['ID=ab8e63ae-1230-482f-a48d-68b82b5ab45b,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:11.004091 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 9ba426d3-a467-48c0-af5a-2a69f373ca1a no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:31:11.008072 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d71a85ca-795e-40d6-a4a5-d1c2b0011254 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event updated for resources: {'Network': ['ID=34540b11-0cc5-4059-9dc2-d2360b37c1c4,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:11.071475 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 9ba426d3-a467-48c0-af5a-2a69f373ca1a {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:31:11.072069 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 9ba426d3-a467-48c0-af5a-2a69f373ca1a not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:31:11.075583 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 34540b11-0cc5-4059-9dc2-d2360b37c1c4 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:31:11.112256 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e4cc1b5-5ddf-41ef-a12e-c2db42d461f2 req-d45230f9-f3e3-4316-95af-500cbf012b64 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:11.114406 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-3e4cc1b5-5ddf-41ef-a12e-c2db42d461f2 req-d45230f9-f3e3-4316-95af-500cbf012b64 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=6015befde7f546d881cb247ae5bc81ae&device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 1096 time: 0.1283534 Nov 09 04:31:11.161011 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-61245d59-e098-40ad-8fa6-70fa09f77309 None None] Provisioning complete for port bab3b0b2-ec0e-464a-b15f-1f71dc13f0f3 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:11.161367 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-61245d59-e098-40ad-8fa6-70fa09f77309 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:11.206015 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-46cb05de-5aff-4c5a-8f17-f0d2a23c804b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Made reservation on behalf of 6761c80dbfa84798bb6517a9b532f870 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:11.210141 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-46cb05de-5aff-4c5a-8f17-f0d2a23c804b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:11.298215 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-6a81ceb5-d8b5-46c3-a746-e6cb19ad9168 None None] Allocated IP 2001:db8::f816:3eff:fe00:74b0 (b64bd442-d79d-4349-b9b3-5833909b2409/0a62af1b-0b59-428b-9d98-66562f1625b1/7086c1a6-ddfa-4612-9396-d70dbb558c5c) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:31:11.507758 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e4cc1b5-5ddf-41ef-a12e-c2db42d461f2 req-f156b8a8-de07-4b6e-8604-e4b6d160d072 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:11.508178 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-c9cc0f36-a8b8-43a3-a25f-d163bc5c67e6 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] For port 6bdef35f-00ac-46ea-a01f-2644260e91e1, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=6bdef35f-00ac-46ea-a01f-2644260e91e1,segment=NetworkSegment(de95ed3f-4273-400f-9757-f62070e21304),segment_id=de95ed3f-4273-400f-9757-f62070e21304)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:31:11.508554 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c9cc0f36-a8b8-43a3-a25f-d163bc5c67e6 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:11.510636 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-3e4cc1b5-5ddf-41ef-a12e-c2db42d461f2 req-f156b8a8-de07-4b6e-8604-e4b6d160d072 service neutron] 10.222.0.26 "GET /v2.0/networks?id=a270b61c-1f4f-4d97-be79-4a24c65fddc2 HTTP/1.1" status: 200 len: 913 time: 0.3863406 Nov 09 04:31:11.531534 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-346be615-7ddd-4e37-a33d-833afe732015 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 4.3887711 Nov 09 04:31:11.550538 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55212) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:11.555698 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-9a4e0deb-81cb-40e0-b3da-9d27f2b95178 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'port': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'name': 'tempest-NetworksTestDHCPv6-1373475837'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:11.592122 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-c9cc0f36-a8b8-43a3-a25f-d163bc5c67e6 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Calling delete_port for 6bdef35f-00ac-46ea-a01f-2644260e91e1 owned by network:dhcp {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:31:11.602088 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6a81ceb5-d8b5-46c3-a746-e6cb19ad9168 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:11.608095 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device ab8e63ae-1230-482f-a48d-68b82b5ab45b up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:31:11.644354 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-3e4cc1b5-5ddf-41ef-a12e-c2db42d461f2 req-d3532851-595e-4392-80ca-8798d5c6c7d7 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=99ad1d96-b35b-4120-b5a9-c95c47bd3ffc HTTP/1.1" status: 200 len: 217 time: 0.1243796 Nov 09 04:31:11.779608 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-5fd1d9b5-a058-4b63-9609-76614b703800 req-599f27fc-f01a-42c3-b34c-18606b775a1d tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/ports?device_id=9c4e58e3-39e4-4212-b106-50b44d4c4e28 HTTP/1.1" status: 200 len: 210 time: 0.0637691 Nov 09 04:31:11.804826 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6336255-bb4b-48f8-b66b-2d31771280c5 req-4a4c74ae-dca2-40cb-9dbb-6c0efbb85c3d tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:11.806386 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d6336255-bb4b-48f8-b66b-2d31771280c5 req-4a4c74ae-dca2-40cb-9dbb-6c0efbb85c3d tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 943 time: 0.3577137 Nov 09 04:31:11.826265 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-f1ec9560-532e-47e7-9a4f-896f769f8c93 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Allocated IP 172.26.0.196 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/2ad7cfe1-e3b0-4322-8461-1f16258cb9f9) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:31:11.844251 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port ab8e63ae-1230-482f-a48d-68b82b5ab45b triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:11.846544 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:11.850710 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d2b5827c-3c40-4666-8ff0-b2453b7eb6e8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:11.901550 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6a81ceb5-d8b5-46c3-a746-e6cb19ad9168 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:11.910977 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c9c607f8-f8c0-4512-ade8-a579c058e595 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:11.911652 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e4cc1b5-5ddf-41ef-a12e-c2db42d461f2 req-622f4512-3794-490f-9dca-5b857ce06ba4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:11.913264 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-3e4cc1b5-5ddf-41ef-a12e-c2db42d461f2 req-622f4512-3794-490f-9dca-5b857ce06ba4 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=b2956e71-9b0f-4060-922c-e54ce6cff80a HTTP/1.1" status: 200 len: 851 time: 0.2587366 Nov 09 04:31:11.930956 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f286fd37-6f65-42ca-aa86-a9711f807cbb tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Made reservation on behalf of 88f9f8da29bf4a8793b45130d483a6e6 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:11.970660 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-46cb05de-5aff-4c5a-8f17-f0d2a23c804b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:11.977792 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-1f88dd1c-55c5-4b22-8e40-dc4f7ff42cca tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Allocated IP 2001:db8::f816:3eff:fe30:6280 (b64bd442-d79d-4349-b9b3-5833909b2409/0a62af1b-0b59-428b-9d98-66562f1625b1/390ecda3-53a0-42c3-9d18-914395f6acad) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:31:12.065511 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d6336255-bb4b-48f8-b66b-2d31771280c5 req-47205db2-5746-4ee8-aa82-ae6e8362bdb6 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2368309 Nov 09 04:31:12.074537 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c9cc0f36-a8b8-43a3-a25f-d163bc5c67e6 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:12.075177 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9a4e0deb-81cb-40e0-b3da-9d27f2b95178 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:12.078314 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9a4e0deb-81cb-40e0-b3da-9d27f2b95178 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:12.157883 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [None req-9a4e0deb-81cb-40e0-b3da-9d27f2b95178 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] device_id is not set on port ee6eccfd-1357-4b13-bf25-4d1cef0fd60e yet. {{(pid=102162) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:31:12.164813 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9cc0f36-a8b8-43a3-a25f-d163bc5c67e6 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event deleted for resources: {'Port': ['ID=6bdef35f-00ac-46ea-a01f-2644260e91e1,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:12.178394 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c9cc0f36-a8b8-43a3-a25f-d163bc5c67e6 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] No DVR routers for this DVR port 6bdef35f-00ac-46ea-a01f-2644260e91e1 on host dv-neutron-816802-2-hyperv {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:31:12.212123 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2b5827c-3c40-4666-8ff0-b2453b7eb6e8 None None] Pushing event deleted for resources: {'Port': ['ID=6bdef35f-00ac-46ea-a01f-2644260e91e1,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:12.218648 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d2b5827c-3c40-4666-8ff0-b2453b7eb6e8 None None] No DVR routers for this DVR port 6bdef35f-00ac-46ea-a01f-2644260e91e1 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:31:12.257841 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6a81ceb5-d8b5-46c3-a746-e6cb19ad9168 None None] Network b64bd442-d79d-4349-b9b3-5833909b2409 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:31:12.276371 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f286fd37-6f65-42ca-aa86-a9711f807cbb tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:12.285341 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e4cc1b5-5ddf-41ef-a12e-c2db42d461f2 req-5c2a69c0-3aa1-485b-8474-230d1388e1bd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:12.287603 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-3e4cc1b5-5ddf-41ef-a12e-c2db42d461f2 req-5c2a69c0-3aa1-485b-8474-230d1388e1bd service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=a270b61c-1f4f-4d97-be79-4a24c65fddc2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.3651984 Nov 09 04:31:12.313000 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [None req-f286fd37-6f65-42ca-aa86-a9711f807cbb tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] device_id is not set on port 9e44f1ae-891b-4a24-90bf-230a42b37820 yet. {{(pid=102162) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:31:12.324237 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f1ec9560-532e-47e7-9a4f-896f769f8c93 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:12.328612 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-6a81ceb5-d8b5-46c3-a746-e6cb19ad9168 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:12.341125 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6a81ceb5-d8b5-46c3-a746-e6cb19ad9168 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:31:12.345841 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-61245d59-e098-40ad-8fa6-70fa09f77309 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:12.413839 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:12.423404 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a81ceb5-d8b5-46c3-a746-e6cb19ad9168 None None] Pushing event updated for resources: {'Port': ['ID=7086c1a6-ddfa-4612-9396-d70dbb558c5c,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:12.444145 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46cb05de-5aff-4c5a-8f17-f0d2a23c804b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event updated for resources: {'Subnet': ['ID=d360fc46-82eb-4904-9996-d0675d95d2e3,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:12.474322 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4a53d710-439b-416b-ba57-cb3af8dd3901 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-988d2354-693c-4d52-af17-25e0643eaa0c', 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'tenant_id': '8b0758f781884982bf5b94e6609237f6', 'fixed_ips': [{'subnet_id': '1bcc611a-d3c8-4019-aae7-12b401d69e2f'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:31:12.475276 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4a53d710-439b-416b-ba57-cb3af8dd3901 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:12.480300 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-46cb05de-5aff-4c5a-8f17-f0d2a23c804b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Checking segment: {'id': '3defe9f8-d112-4c13-83df-42da5cffbca1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 326, 'network_id': '34540b11-0cc5-4059-9dc2-d2360b37c1c4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:31:12.480756 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-46cb05de-5aff-4c5a-8f17-f0d2a23c804b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Network hostable DHCP agents. Network: 34540b11-0cc5-4059-9dc2-d2360b37c1c4, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:31:12.536457 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1f88dd1c-55c5-4b22-8e40-dc4f7ff42cca tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:12.537265 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c9cc0f36-a8b8-43a3-a25f-d163bc5c67e6 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:12.540043 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-61245d59-e098-40ad-8fa6-70fa09f77309 None None] For port bab3b0b2-ec0e-464a-b15f-1f71dc13f0f3, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=bab3b0b2-ec0e-464a-b15f-1f71dc13f0f3,segment=NetworkSegment(d5411e15-1506-4025-8472-ba7118358f68),segment_id=d5411e15-1506-4025-8472-ba7118358f68)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:31:12.565812 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-3e4cc1b5-5ddf-41ef-a12e-c2db42d461f2 req-3a3ab0d0-f6d5-4c8d-a7f8-9f1af770c02b service neutron] 10.222.0.26 "GET /v2.0/networks/a270b61c-1f4f-4d97-be79-4a24c65fddc2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2534404 Nov 09 04:31:12.580375 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-6a81ceb5-d8b5-46c3-a746-e6cb19ad9168 None None] Attempting to bind port 7086c1a6-ddfa-4612-9396-d70dbb558c5c on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:31:12.580824 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-6a81ceb5-d8b5-46c3-a746-e6cb19ad9168 None None] Attempting to bind port 7086c1a6-ddfa-4612-9396-d70dbb558c5c by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '303916b3-0435-4d77-9e83-60967f186bbf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 330, 'network_id': 'b64bd442-d79d-4349-b9b3-5833909b2409'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:31:12.581254 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6a81ceb5-d8b5-46c3-a746-e6cb19ad9168 None None] Attempting to bind port 7086c1a6-ddfa-4612-9396-d70dbb558c5c on network b64bd442-d79d-4349-b9b3-5833909b2409 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:31:12.588961 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-61245d59-e098-40ad-8fa6-70fa09f77309 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:12.591817 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device bab3b0b2-ec0e-464a-b15f-1f71dc13f0f3 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:31:12.612396 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-46cb05de-5aff-4c5a-8f17-f0d2a23c804b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Network 34540b11-0cc5-4059-9dc2-d2360b37c1c4 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:31:12.637336 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cb5f0f34-178b-4877-a49b-781be787cfd8 None None] Update dhcp port {'port': {'network_id': '472e0931-6be9-4332-83a6-c65cb3b98b7d', 'fixed_ips': [{'subnet_id': 'a38fa5e5-0ac0-4d69-8fb6-dcbb9f935dc1', 'ip_address': '172.20.0.2'}, {'subnet_id': '853593ba-982b-48a1-b01d-006ead90d6dd'}], 'binding:host_id': 'dv-neutron-816802-2-hyperv'}, 'id': 'ab8e63ae-1230-482f-a48d-68b82b5ab45b'} from dv-neutron-816802-2-hyperv. {{(pid=102163) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:328}} Nov 09 04:31:12.667319 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-c9cc0f36-a8b8-43a3-a25f-d163bc5c67e6 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['db9e10ea-0b45-4893-ab26-2f1ea5e8271b']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:12.688381 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6a81ceb5-d8b5-46c3-a746-e6cb19ad9168 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 30, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:31:12.688857 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6a81ceb5-d8b5-46c3-a746-e6cb19ad9168 None None] Checking segment: {'id': '303916b3-0435-4d77-9e83-60967f186bbf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 330, 'network_id': 'b64bd442-d79d-4349-b9b3-5833909b2409'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:31:12.689143 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6a81ceb5-d8b5-46c3-a746-e6cb19ad9168 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:12.689534 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6a81ceb5-d8b5-46c3-a746-e6cb19ad9168 None None] Bound using segment: {'id': '303916b3-0435-4d77-9e83-60967f186bbf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 330, 'network_id': 'b64bd442-d79d-4349-b9b3-5833909b2409'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:31:12.690021 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-6a81ceb5-d8b5-46c3-a746-e6cb19ad9168 None None] Bound port: 7086c1a6-ddfa-4612-9396-d70dbb558c5c, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '303916b3-0435-4d77-9e83-60967f186bbf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 330, 'network_id': 'b64bd442-d79d-4349-b9b3-5833909b2409'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:31:12.690422 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6a81ceb5-d8b5-46c3-a746-e6cb19ad9168 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:12.699152 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-46cb05de-5aff-4c5a-8f17-f0d2a23c804b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 34540b11-0cc5-4059-9dc2-d2360b37c1c4) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:12.708294 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-c9cc0f36-a8b8-43a3-a25f-d163bc5c67e6 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'de95ed3f-4273-400f-9757-f62070e21304') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:12.708686 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-c9cc0f36-a8b8-43a3-a25f-d163bc5c67e6 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'de95ed3f-4273-400f-9757-f62070e21304') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:12.717610 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-46cb05de-5aff-4c5a-8f17-f0d2a23c804b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:12.718237 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-46cb05de-5aff-4c5a-8f17-f0d2a23c804b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:12.726176 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c9cc0f36-a8b8-43a3-a25f-d163bc5c67e6 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:12.735298 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bce9ea34-ef48-4eb2-999c-7814359702ef None None] Network 34540b11-0cc5-4059-9dc2-d2360b37c1c4 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:12.752438 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c9cc0f36-a8b8-43a3-a25f-d163bc5c67e6 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:12.755768 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-9a4e0deb-81cb-40e0-b3da-9d27f2b95178 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Allocated IP 2001:db8::17 (988d2354-693c-4d52-af17-25e0643eaa0c/1bcc611a-d3c8-4019-aae7-12b401d69e2f/ee6eccfd-1357-4b13-bf25-4d1cef0fd60e) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:31:12.784076 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c9cc0f36-a8b8-43a3-a25f-d163bc5c67e6 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Releasing vlan 334 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:31:12.784482 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c9cc0f36-a8b8-43a3-a25f-d163bc5c67e6 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:12.787600 dv-neutron-816802-2-hyperv neutron-server[102162]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:31:12.787600 dv-neutron-816802-2-hyperv neutron-server[102162]: self.session.flush() Nov 09 04:31:12.787600 dv-neutron-816802-2-hyperv neutron-server[102162]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:31:12.787600 dv-neutron-816802-2-hyperv neutron-server[102162]: self.session.flush() Nov 09 04:31:12.787600 dv-neutron-816802-2-hyperv neutron-server[102162]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:31:12.787600 dv-neutron-816802-2-hyperv neutron-server[102162]: self.session.flush() Nov 09 04:31:12.787600 dv-neutron-816802-2-hyperv neutron-server[102162]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:31:12.787600 dv-neutron-816802-2-hyperv neutron-server[102162]: self.session.flush() Nov 09 04:31:12.787600 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:31:12.787600 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:31:12.787600 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:31:12.787600 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:31:12.787600 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:31:12.787600 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:31:12.787600 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:31:12.787600 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:31:12.787600 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:31:12.787600 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:31:12.787600 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:31:12.787600 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:31:12.787600 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:31:12.787600 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:31:12.787600 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:31:12.787600 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:31:12.787600 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:31:12.787600 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:31:12.787600 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:31:12.787600 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:31:12.787600 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:31:12.787600 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:31:12.787600 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:31:12.787600 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:31:12.787600 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:31:12.787600 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:31:12.787600 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:31:12.787600 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:31:12.787600 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:31:12.787600 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:31:12.787600 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:31:12.787600 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:31:12.793437 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-3e4cc1b5-5ddf-41ef-a12e-c2db42d461f2 req-73c33063-222c-47fc-8754-ad0ea4e7b9ad service neutron] 10.222.0.26 "GET /v2.0/networks/a270b61c-1f4f-4d97-be79-4a24c65fddc2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2180507 Nov 09 04:31:12.829399 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-cb5f0f34-178b-4877-a49b-781be787cfd8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:12.833502 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f1ec9560-532e-47e7-9a4f-896f769f8c93 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:12.837978 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1f88dd1c-55c5-4b22-8e40-dc4f7ff42cca tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:12.845879 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-46cb05de-5aff-4c5a-8f17-f0d2a23c804b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.0228686 Nov 09 04:31:12.854322 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55218) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:12.892961 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-61245d59-e098-40ad-8fa6-70fa09f77309 None None] Provisioning complete for port ab8e63ae-1230-482f-a48d-68b82b5ab45b triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:12.892961 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-61245d59-e098-40ad-8fa6-70fa09f77309 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:12.906637 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1f88dd1c-55c5-4b22-8e40-dc4f7ff42cca tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Network b64bd442-d79d-4349-b9b3-5833909b2409 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:31:12.954067 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f1ec9560-532e-47e7-9a4f-896f769f8c93 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:31:12.967527 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-f1ec9560-532e-47e7-9a4f-896f769f8c93 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:12.970306 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-1f88dd1c-55c5-4b22-8e40-dc4f7ff42cca tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:12.972935 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1f88dd1c-55c5-4b22-8e40-dc4f7ff42cca tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:31:12.978348 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f1ec9560-532e-47e7-9a4f-896f769f8c93 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:31:12.979920 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1f88dd1c-55c5-4b22-8e40-dc4f7ff42cca tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:12.980607 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1f88dd1c-55c5-4b22-8e40-dc4f7ff42cca tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:12.984452 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-0a8f7a0e-e7ed-4f64-8b00-895039f4811c req-36676642-1864-4976-9da2-17ff2486d597 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/ports?device_id=9c4e58e3-39e4-4212-b106-50b44d4c4e28 HTTP/1.1" status: 200 len: 210 time: 0.0712595 Nov 09 04:31:13.002794 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1ec9560-532e-47e7-9a4f-896f769f8c93 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Pushing event updated for resources: {'Port': ['ID=2ad7cfe1-e3b0-4322-8461-1f16258cb9f9,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:13.047322 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 99ad1d96-b35b-4120-b5a9-c95c47bd3ffc details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=102163) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 09 04:31:13.058136 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c9cc0f36-a8b8-43a3-a25f-d163bc5c67e6 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:13.066925 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61245d59-e098-40ad-8fa6-70fa09f77309 None None] Pushing event updated for resources: {'Port': ['ID=bab3b0b2-ec0e-464a-b15f-1f71dc13f0f3,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:13.078049 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c9cc0f36-a8b8-43a3-a25f-d163bc5c67e6 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:13.087779 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-c9cc0f36-a8b8-43a3-a25f-d163bc5c67e6 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "DELETE /v2.0/networks/db9e10ea-0b45-4893-ab26-2f1ea5e8271b HTTP/1.1" status: 204 len: 168 time: 2.7651870 Nov 09 04:31:13.099910 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55220) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:13.107077 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-7fb1c635-76a6-4130-aee4-fb728a86df81 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Request body: {'network': {'name': 'tempest-RoutersTest-2039070428'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:13.140359 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9cc0f36-a8b8-43a3-a25f-d163bc5c67e6 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event deleted for resources: {'Network': ['ID=db9e10ea-0b45-4893-ab26-2f1ea5e8271b,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:13.158463 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port bab3b0b2-ec0e-464a-b15f-1f71dc13f0f3 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:13.158949 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:13.164440 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f88dd1c-55c5-4b22-8e40-dc4f7ff42cca tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Pushing event updated for resources: {'Port': ['ID=390ecda3-53a0-42c3-9d18-914395f6acad,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:13.167569 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-6a81ceb5-d8b5-46c3-a746-e6cb19ad9168 None None] For port 7086c1a6-ddfa-4612-9396-d70dbb558c5c, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:31:13.210397 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1f88dd1c-55c5-4b22-8e40-dc4f7ff42cca tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 951 time: 3.6053631 Nov 09 04:31:13.216654 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55224) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:13.283303 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7fb1c635-76a6-4130-aee4-fb728a86df81 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Made reservation on behalf of 188f23ef0cb54006875c672b78f5249f for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:13.289546 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7fb1c635-76a6-4130-aee4-fb728a86df81 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:13.298022 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-6a81ceb5-d8b5-46c3-a746-e6cb19ad9168 None None] For port 7086c1a6-ddfa-4612-9396-d70dbb558c5c, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=7086c1a6-ddfa-4612-9396-d70dbb558c5c,segment=NetworkSegment(303916b3-0435-4d77-9e83-60967f186bbf),segment_id=303916b3-0435-4d77-9e83-60967f186bbf)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:31:13.325972 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7fb1c635-76a6-4130-aee4-fb728a86df81 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 312} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:31:13.334642 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3bbaeb84-9404-4018-bbcf-79fc8e7adf04 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-34540b11-0cc5-4059-9dc2-d2360b37c1c4', 'network_id': '34540b11-0cc5-4059-9dc2-d2360b37c1c4', 'tenant_id': '6761c80dbfa84798bb6517a9b532f870', 'fixed_ips': [{'subnet_id': 'd360fc46-82eb-4904-9996-d0675d95d2e3'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:31:13.335920 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3bbaeb84-9404-4018-bbcf-79fc8e7adf04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:13.337433 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7fb1c635-76a6-4130-aee4-fb728a86df81 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:13.337697 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-7fb1c635-76a6-4130-aee4-fb728a86df81 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Added segment ab066ae5-0f1f-4c66-aa12-5d1f0c9bbe81 of type vlan for network 6e2848bc-b428-4045-8127-510baced6460 Nov 09 04:31:13.353397 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9a4e0deb-81cb-40e0-b3da-9d27f2b95178 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:13.385959 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7fb1c635-76a6-4130-aee4-fb728a86df81 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:13.389160 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-f286fd37-6f65-42ca-aa86-a9711f807cbb tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Allocated IP 172.20.0.14 (472e0931-6be9-4332-83a6-c65cb3b98b7d/a38fa5e5-0ac0-4d69-8fb6-dcbb9f935dc1/9e44f1ae-891b-4a24-90bf-230a42b37820) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:31:13.400962 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6a81ceb5-d8b5-46c3-a746-e6cb19ad9168 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:13.401633 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-f286fd37-6f65-42ca-aa86-a9711f807cbb tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Allocated IP 172.20.0.21 (472e0931-6be9-4332-83a6-c65cb3b98b7d/853593ba-982b-48a1-b01d-006ead90d6dd/9e44f1ae-891b-4a24-90bf-230a42b37820) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:31:13.433968 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f56f1e8d-4b6d-451a-a6f3-42120c90c40d req-7b1a5d26-2ffe-4a89-add3-eda6bc9cb7b1 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:13.435811 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f56f1e8d-4b6d-451a-a6f3-42120c90c40d req-7b1a5d26-2ffe-4a89-add3-eda6bc9cb7b1 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.26 "GET /v2.0/networks?id=9c94e7dc-d679-4a7e-b264-6d619dbc935e HTTP/1.1" status: 200 len: 797 time: 0.4434483 Nov 09 04:31:13.440072 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d5824bd0-5dc6-4109-9483-fdbac2eadc41 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:13.462621 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a13dd297-f31a-429d-8a35-ebdc788a8330 req-dc0d1c44-3334-4e7a-96a5-9e6fd0d6bd2f tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:13.470043 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a13dd297-f31a-429d-8a35-ebdc788a8330 req-dc0d1c44-3334-4e7a-96a5-9e6fd0d6bd2f tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 943 time: 0.1516252 Nov 09 04:31:13.521061 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f56f1e8d-4b6d-451a-a6f3-42120c90c40d req-74f88331-844a-40b8-8733-3cd5dc09f140 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.26 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=fd7df27e425449dfb80d0838c8f7fb89 HTTP/1.1" status: 200 len: 380 time: 0.0712852 Nov 09 04:31:13.521890 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7fb1c635-76a6-4130-aee4-fb728a86df81 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:13.527460 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7fb1c635-76a6-4130-aee4-fb728a86df81 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:13.528057 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7fb1c635-76a6-4130-aee4-fb728a86df81 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:13.545369 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-851ae2d7-96a9-4d19-ac8b-8531a1443ee7 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Deleting subnet 0a62af1b-0b59-428b-9d98-66562f1625b1 {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:31:13.556121 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [req-f56f1e8d-4b6d-451a-a6f3-42120c90c40d req-d03d6095-659a-4327-a394-79d84df9ead6 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Request body: {'port': {'device_id': '9c4e58e3-39e4-4212-b106-50b44d4c4e28', 'network_id': '9c94e7dc-d679-4a7e-b264-6d619dbc935e', 'admin_state_up': True, 'tenant_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'security_groups': ['4ff68177-77d2-4250-b11c-4d5b55fd3619']}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:13.597069 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 99ad1d96-b35b-4120-b5a9-c95c47bd3ffc, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=99ad1d96-b35b-4120-b5a9-c95c47bd3ffc,segment=NetworkSegment(e211d893-ee7a-48e3-bc29-b8824167e15b),segment_id=e211d893-ee7a-48e3-bc29-b8824167e15b)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:31:13.659239 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-851ae2d7-96a9-4d19-ac8b-8531a1443ee7 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:13.698749 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9a4e0deb-81cb-40e0-b3da-9d27f2b95178 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:13.710741 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-7fb1c635-76a6-4130-aee4-fb728a86df81 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 766 time: 0.6072316 Nov 09 04:31:13.719644 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55228) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:13.741199 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-476c006c-10df-4a56-b5e2-16e83c5cb0dc tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Request body: {'subnet': {'network_id': '6e2848bc-b428-4045-8127-510baced6460', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:13.744085 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a13dd297-f31a-429d-8a35-ebdc788a8330 req-6df3f9fb-1e1f-4d0f-9b3f-80ee00cc831e tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2730939 Nov 09 04:31:13.765611 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Returning: {'device': '99ad1d96-b35b-4120-b5a9-c95c47bd3ffc', 'network_id': 'a270b61c-1f4f-4d97-be79-4a24c65fddc2', 'port_id': '99ad1d96-b35b-4120-b5a9-c95c47bd3ffc', 'mac_address': 'fa:16:3e:b2:a6:91', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 325, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b2956e71-9b0f-4060-922c-e54ce6cff80a', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102163) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 09 04:31:13.783844 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a81ceb5-d8b5-46c3-a746-e6cb19ad9168 None None] Pushing event updated for resources: {'Port': ['ID=7086c1a6-ddfa-4612-9396-d70dbb558c5c,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:13.832643 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-61245d59-e098-40ad-8fa6-70fa09f77309 None None] Provisioning complete for port 627d2dd9-7b3b-4b20-a4e4-18764ff393f3 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:13.833234 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-61245d59-e098-40ad-8fa6-70fa09f77309 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:13.839343 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f1ec9560-532e-47e7-9a4f-896f769f8c93 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:13.846178 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9a4e0deb-81cb-40e0-b3da-9d27f2b95178 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:31:13.879621 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 627d2dd9-7b3b-4b20-a4e4-18764ff393f3 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:31:13.901839 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-4a53d710-439b-416b-ba57-cb3af8dd3901 None None] Allocated IP 2001:db8::2 (988d2354-693c-4d52-af17-25e0643eaa0c/1bcc611a-d3c8-4019-aae7-12b401d69e2f/cacdee0a-4fb3-484e-936f-fbc190a2cb37) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:31:13.904161 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0b70bdad-70af-4790-b626-1035acee3b5a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:13.909899 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fb1c635-76a6-4130-aee4-fb728a86df81 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event updated for resources: {'Network': ['ID=6e2848bc-b428-4045-8127-510baced6460,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:13.915943 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-851ae2d7-96a9-4d19-ac8b-8531a1443ee7 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:13.916510 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-9a4e0deb-81cb-40e0-b3da-9d27f2b95178 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:13.920475 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9a4e0deb-81cb-40e0-b3da-9d27f2b95178 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:31:13.928296 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9a4e0deb-81cb-40e0-b3da-9d27f2b95178 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:13.928976 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9a4e0deb-81cb-40e0-b3da-9d27f2b95178 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:13.962666 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a4e0deb-81cb-40e0-b3da-9d27f2b95178 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Port': ['ID=ee6eccfd-1357-4b13-bf25-4d1cef0fd60e,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:14.002351 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 6e2848bc-b428-4045-8127-510baced6460 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:31:14.007086 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d5824bd0-5dc6-4109-9483-fdbac2eadc41 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:14.035798 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f286fd37-6f65-42ca-aa86-a9711f807cbb tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:14.089278 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-3bbaeb84-9404-4018-bbcf-79fc8e7adf04 None None] Allocated IP 172.20.0.2 (34540b11-0cc5-4059-9dc2-d2360b37c1c4/d360fc46-82eb-4904-9996-d0675d95d2e3/5a94a8e9-5741-464a-a62d-787955cf0970) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:31:14.109807 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f56f1e8d-4b6d-451a-a6f3-42120c90c40d req-d03d6095-659a-4327-a394-79d84df9ead6 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Made reservation on behalf of fd7df27e425449dfb80d0838c8f7fb89 for: {'port': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:14.118509 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [req-f56f1e8d-4b6d-451a-a6f3-42120c90c40d req-d03d6095-659a-4327-a394-79d84df9ead6 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:14.177636 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b5bb94dc-d1ff-4687-8f8e-e61148d2588b req-216451fd-a390-45a4-8764-be5965f958a8 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/ports?device_id=9c4e58e3-39e4-4212-b106-50b44d4c4e28 HTTP/1.1" status: 200 len: 210 time: 0.0543797 Nov 09 04:31:14.182470 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:14.278123 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-851ae2d7-96a9-4d19-ac8b-8531a1443ee7 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:14.281954 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 99ad1d96-b35b-4120-b5a9-c95c47bd3ffc {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:31:14.374709 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-476c006c-10df-4a56-b5e2-16e83c5cb0dc tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Made reservation on behalf of 188f23ef0cb54006875c672b78f5249f for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:14.378633 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-476c006c-10df-4a56-b5e2-16e83c5cb0dc tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:14.423775 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [req-f56f1e8d-4b6d-451a-a6f3-42120c90c40d req-d03d6095-659a-4327-a394-79d84df9ead6 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Allocated IP 172.20.0.6 (9c94e7dc-d679-4a7e-b264-6d619dbc935e/003822ea-7d1a-41fa-a15f-16fc8c9f624c/9c023fad-c8fa-4120-b9cc-4ea22c1718e4) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:31:14.493126 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-9a4e0deb-81cb-40e0-b3da-9d27f2b95178 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 931 time: 2.9413099 Nov 09 04:31:14.497217 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55234) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:14.501372 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-851ae2d7-96a9-4d19-ac8b-8531a1443ee7 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:14.544940 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-851ae2d7-96a9-4d19-ac8b-8531a1443ee7 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Pushing event deleted for resources: {'Subnet': ['ID=0a62af1b-0b59-428b-9d98-66562f1625b1,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:14.570769 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-851ae2d7-96a9-4d19-ac8b-8531a1443ee7 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:14.578142 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 99ad1d96-b35b-4120-b5a9-c95c47bd3ffc, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=99ad1d96-b35b-4120-b5a9-c95c47bd3ffc,segment=NetworkSegment(e211d893-ee7a-48e3-bc29-b8824167e15b),segment_id=e211d893-ee7a-48e3-bc29-b8824167e15b)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:31:14.580727 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-851ae2d7-96a9-4d19-ac8b-8531a1443ee7 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] 10.222.0.24 "DELETE /v2.0/subnets/0a62af1b-0b59-428b-9d98-66562f1625b1 HTTP/1.1" status: 204 len: 168 time: 1.3630188 Nov 09 04:31:14.586471 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f1ec9560-532e-47e7-9a4f-896f769f8c93 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-466202', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-464271', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-936'] for router, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:14.586637 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55236) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:14.588858 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f1ec9560-532e-47e7-9a4f-896f769f8c93 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-466195', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-466408', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-464260'] for router, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:14.593724 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 627d2dd9-7b3b-4b20-a4e4-18764ff393f3 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:14.594183 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:14.600026 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1d141dea-a66a-4114-91f0-31896d018213 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:14.604601 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-1d141dea-a66a-4114-91f0-31896d018213 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/ports HTTP/1.1" status: 200 len: 929 time: 0.1063852 Nov 09 04:31:14.606601 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55238) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:14.668452 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f286fd37-6f65-42ca-aa86-a9711f807cbb tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:14.670570 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-57be2789-f105-4afb-b0ac-24dbb5901c70 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:14.672316 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-57be2789-f105-4afb-b0ac-24dbb5901c70 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:14.673969 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-57be2789-f105-4afb-b0ac-24dbb5901c70 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] 10.222.0.24 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1478 time: 0.0863271 Nov 09 04:31:14.681590 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55240) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:14.694267 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:14.792224 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f286fd37-6f65-42ca-aa86-a9711f807cbb tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Network 472e0931-6be9-4332-83a6-c65cb3b98b7d is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:31:14.804264 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-f286fd37-6f65-42ca-aa86-a9711f807cbb tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:14.807059 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f286fd37-6f65-42ca-aa86-a9711f807cbb tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:31:14.860009 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f286fd37-6f65-42ca-aa86-a9711f807cbb tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event updated for resources: {'Port': ['ID=9e44f1ae-891b-4a24-90bf-230a42b37820,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:14.861277 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-cb5f0f34-178b-4877-a49b-781be787cfd8 None None] Allocated IP 172.20.0.18 (472e0931-6be9-4332-83a6-c65cb3b98b7d/853593ba-982b-48a1-b01d-006ead90d6dd/ab8e63ae-1230-482f-a48d-68b82b5ab45b) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:31:14.872095 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4a53d710-439b-416b-ba57-cb3af8dd3901 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:14.880155 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3bbaeb84-9404-4018-bbcf-79fc8e7adf04 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:14.896659 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=99ad1d96-b35b-4120-b5a9-c95c47bd3ffc,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:14.944768 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['99ad1d96-b35b-4120-b5a9-c95c47bd3ffc'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 04:31:14.973846 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f286fd37-6f65-42ca-aa86-a9711f807cbb tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:14.974659 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f286fd37-6f65-42ca-aa86-a9711f807cbb tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:15.018901 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2e1c0f1-3aa0-440d-9d58-9ee1fa21f946 req-3f4ab480-6c44-4369-9737-56d8d6de014c tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:15.026835 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c2e1c0f1-3aa0-440d-9d58-9ee1fa21f946 req-3f4ab480-6c44-4369-9737-56d8d6de014c tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 944 time: 0.1613820 Nov 09 04:31:15.040754 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4a53d710-439b-416b-ba57-cb3af8dd3901 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:15.043146 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3bbaeb84-9404-4018-bbcf-79fc8e7adf04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:15.051074 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-41e00f3c-4def-45a0-8477-194917f998f6 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Deleting port ee6eccfd-1357-4b13-bf25-4d1cef0fd60e {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:31:15.051412 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-41e00f3c-4def-45a0-8477-194917f998f6 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:15.095920 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-f286fd37-6f65-42ca-aa86-a9711f807cbb tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1005 time: 4.2843862 Nov 09 04:31:15.102332 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55244) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:15.133423 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3bbaeb84-9404-4018-bbcf-79fc8e7adf04 None None] Network 34540b11-0cc5-4059-9dc2-d2360b37c1c4 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:31:15.137218 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4a53d710-439b-416b-ba57-cb3af8dd3901 None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:31:15.137385 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-df09bb45-8b72-4478-9378-d718a36e33e4 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:15.140439 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-2dcd9ead-046a-401f-9519-fb3ef49b21f4 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Request body: {'port': {'fixed_ips': [{'subnet_id': 'a38fa5e5-0ac0-4d69-8fb6-dcbb9f935dc1'}]}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:15.148494 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-3bbaeb84-9404-4018-bbcf-79fc8e7adf04 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:15.153769 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-4a53d710-439b-416b-ba57-cb3af8dd3901 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:15.158705 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a53d710-439b-416b-ba57-cb3af8dd3901 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:31:15.162431 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3bbaeb84-9404-4018-bbcf-79fc8e7adf04 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:31:15.208470 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-df09bb45-8b72-4478-9378-d718a36e33e4 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] DELETE failed (client error): There was a conflict when trying to complete your request. Nov 09 04:31:15.209100 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-df09bb45-8b72-4478-9378-d718a36e33e4 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] No notification will be sent due to unsuccessful status code: 409 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:31:15.209271 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:15.213979 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-df09bb45-8b72-4478-9378-d718a36e33e4 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] 10.222.0.24 "DELETE /v2.0/networks/b64bd442-d79d-4349-b9b3-5833909b2409 HTTP/1.1" status: 409 len: 405 time: 0.5286639 Nov 09 04:31:15.236986 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 6bdef35f-00ac-46ea-a01f-2644260e91e1 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:31:15.240913 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-cb5f0f34-178b-4877-a49b-781be787cfd8 None None] For port ab8e63ae-1230-482f-a48d-68b82b5ab45b, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=ab8e63ae-1230-482f-a48d-68b82b5ab45b,segment=NetworkSegment(f9c6a9a1-e5a3-4af2-8413-8cf5b0d1e3ae),segment_id=f9c6a9a1-e5a3-4af2-8413-8cf5b0d1e3ae)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:31:15.245707 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c2e1c0f1-3aa0-440d-9d58-9ee1fa21f946 req-1ded960b-0545-4f18-9cd1-206c5ea27b1c tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2156682 Nov 09 04:31:15.245707 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55248) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:15.253538 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-704e7966-8c0e-4b57-99c7-b690ae9bb7d0 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Request body: {'network': {'name': 'tempest-NetworksIpV6TestAttrs-test-network-1380863083'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:15.268967 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f1ec9560-532e-47e7-9a4f-896f769f8c93 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Router 59f4ff39-f644-4f83-8a3a-2a6f1674e434 is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102162) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:31:15.270314 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a53d710-439b-416b-ba57-cb3af8dd3901 None None] Pushing event updated for resources: {'Port': ['ID=cacdee0a-4fb3-484e-936f-fbc190a2cb37,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:15.306713 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-41e00f3c-4def-45a0-8477-194917f998f6 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:15.318987 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1136f12a-788f-40ef-9c50-8f236379b004 None None] Network b64bd442-d79d-4349-b9b3-5833909b2409 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:15.330985 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-e905bac3-53f2-41ff-bb3b-641e079be76c req-97bd44c1-ea14-498c-9f49-763a0ab3f1cb tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/ports?device_id=9c4e58e3-39e4-4212-b106-50b44d4c4e28 HTTP/1.1" status: 200 len: 210 time: 0.0392132 Nov 09 04:31:15.338585 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-41e00f3c-4def-45a0-8477-194917f998f6 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Calling delete_port for ee6eccfd-1357-4b13-bf25-4d1cef0fd60e owned by {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:31:15.341706 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2dcd9ead-046a-401f-9519-fb3ef49b21f4 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:15.377455 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 6bdef35f-00ac-46ea-a01f-2644260e91e1 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:31:15.377791 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 6bdef35f-00ac-46ea-a01f-2644260e91e1 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:31:15.385757 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d5824bd0-5dc6-4109-9483-fdbac2eadc41 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:15.436952 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5824bd0-5dc6-4109-9483-fdbac2eadc41 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event deleted for resources: {'Subnet': ['ID=d360fc46-82eb-4904-9996-d0675d95d2e3,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:15.488807 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [req-f56f1e8d-4b6d-451a-a6f3-42120c90c40d req-d03d6095-659a-4327-a394-79d84df9ead6 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:15.499631 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-4a53d710-439b-416b-ba57-cb3af8dd3901 None None] Attempting to bind port cacdee0a-4fb3-484e-936f-fbc190a2cb37 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:31:15.499631 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-4a53d710-439b-416b-ba57-cb3af8dd3901 None None] Attempting to bind port cacdee0a-4fb3-484e-936f-fbc190a2cb37 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:31:15.499892 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4a53d710-439b-416b-ba57-cb3af8dd3901 None None] Attempting to bind port cacdee0a-4fb3-484e-936f-fbc190a2cb37 on network 988d2354-693c-4d52-af17-25e0643eaa0c {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:31:15.511557 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-cb5f0f34-178b-4877-a49b-781be787cfd8 None None] Publish callbacks [] for port, precommit_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:15.516196 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-476c006c-10df-4a56-b5e2-16e83c5cb0dc tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:15.524617 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-704e7966-8c0e-4b57-99c7-b690ae9bb7d0 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Made reservation on behalf of 6acf678d74da4512a431e262bbd32037 for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:15.526779 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-3bbaeb84-9404-4018-bbcf-79fc8e7adf04 None None] Attempting to bind port 5a94a8e9-5741-464a-a62d-787955cf0970 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:31:15.527141 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-3bbaeb84-9404-4018-bbcf-79fc8e7adf04 None None] Attempting to bind port 5a94a8e9-5741-464a-a62d-787955cf0970 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '3defe9f8-d112-4c13-83df-42da5cffbca1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 326, 'network_id': '34540b11-0cc5-4059-9dc2-d2360b37c1c4'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:31:15.528483 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3bbaeb84-9404-4018-bbcf-79fc8e7adf04 None None] Attempting to bind port 5a94a8e9-5741-464a-a62d-787955cf0970 on network 34540b11-0cc5-4059-9dc2-d2360b37c1c4 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:31:15.529719 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-704e7966-8c0e-4b57-99c7-b690ae9bb7d0 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:15.530853 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bbaeb84-9404-4018-bbcf-79fc8e7adf04 None None] Pushing event updated for resources: {'Port': ['ID=5a94a8e9-5741-464a-a62d-787955cf0970,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:15.544014 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4a53d710-439b-416b-ba57-cb3af8dd3901 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 30, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:31:15.544545 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4a53d710-439b-416b-ba57-cb3af8dd3901 None None] Checking segment: {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:31:15.544893 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4a53d710-439b-416b-ba57-cb3af8dd3901 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:15.545277 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4a53d710-439b-416b-ba57-cb3af8dd3901 None None] Bound using segment: {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:31:15.546406 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-4a53d710-439b-416b-ba57-cb3af8dd3901 None None] Bound port: cacdee0a-4fb3-484e-936f-fbc190a2cb37, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:31:15.547052 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4a53d710-439b-416b-ba57-cb3af8dd3901 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:15.567210 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-9177f774-0aac-48d2-8851-8f028899add7 None None] Provisioning complete for port 7086c1a6-ddfa-4612-9396-d70dbb558c5c triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:15.567494 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9177f774-0aac-48d2-8851-8f028899add7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:15.572742 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3bbaeb84-9404-4018-bbcf-79fc8e7adf04 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 30, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:31:15.573315 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3bbaeb84-9404-4018-bbcf-79fc8e7adf04 None None] Checking segment: {'id': '3defe9f8-d112-4c13-83df-42da5cffbca1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 326, 'network_id': '34540b11-0cc5-4059-9dc2-d2360b37c1c4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:31:15.573539 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3bbaeb84-9404-4018-bbcf-79fc8e7adf04 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:15.573926 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3bbaeb84-9404-4018-bbcf-79fc8e7adf04 None None] Bound using segment: {'id': '3defe9f8-d112-4c13-83df-42da5cffbca1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 326, 'network_id': '34540b11-0cc5-4059-9dc2-d2360b37c1c4'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:31:15.574415 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-3bbaeb84-9404-4018-bbcf-79fc8e7adf04 None None] Bound port: 5a94a8e9-5741-464a-a62d-787955cf0970, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3defe9f8-d112-4c13-83df-42da5cffbca1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 326, 'network_id': '34540b11-0cc5-4059-9dc2-d2360b37c1c4'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:31:15.574794 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3bbaeb84-9404-4018-bbcf-79fc8e7adf04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:15.583544 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-cb5f0f34-178b-4877-a49b-781be787cfd8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:15.613968 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d5824bd0-5dc6-4109-9483-fdbac2eadc41 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:15.652150 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-704e7966-8c0e-4b57-99c7-b690ae9bb7d0 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 331} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:31:15.664251 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-d5824bd0-5dc6-4109-9483-fdbac2eadc41 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['34540b11-0cc5-4059-9dc2-d2360b37c1c4']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:15.673177 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-476c006c-10df-4a56-b5e2-16e83c5cb0dc tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event updated for resources: {'Subnet': ['ID=4b3485de-3625-4aed-aab6-5ac993d0f4c3,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:15.680655 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-d5824bd0-5dc6-4109-9483-fdbac2eadc41 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3defe9f8-d112-4c13-83df-42da5cffbca1') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:15.684171 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-d5824bd0-5dc6-4109-9483-fdbac2eadc41 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3defe9f8-d112-4c13-83df-42da5cffbca1') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:15.684171 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-476c006c-10df-4a56-b5e2-16e83c5cb0dc tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Checking segment: {'id': 'ab066ae5-0f1f-4c66-aa12-5d1f0c9bbe81', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 312, 'network_id': '6e2848bc-b428-4045-8127-510baced6460'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:31:15.684171 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-476c006c-10df-4a56-b5e2-16e83c5cb0dc tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Network hostable DHCP agents. Network: 6e2848bc-b428-4045-8127-510baced6460, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:31:15.695782 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device bab3b0b2-ec0e-464a-b15f-1f71dc13f0f3 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:31:15.699245 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [req-f56f1e8d-4b6d-451a-a6f3-42120c90c40d req-d03d6095-659a-4327-a394-79d84df9ead6 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:15.707464 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d5824bd0-5dc6-4109-9483-fdbac2eadc41 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:15.732710 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-704e7966-8c0e-4b57-99c7-b690ae9bb7d0 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:15.734542 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-704e7966-8c0e-4b57-99c7-b690ae9bb7d0 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Added segment b769ba14-e21e-411b-82e2-2dd33164c868 of type vlan for network 03811c18-3b1c-42b8-9413-4db7f837fa52 Nov 09 04:31:15.762646 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d5824bd0-5dc6-4109-9483-fdbac2eadc41 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:15.771124 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f56f1e8d-4b6d-451a-a6f3-42120c90c40d req-d03d6095-659a-4327-a394-79d84df9ead6 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Network 9c94e7dc-d679-4a7e-b264-6d619dbc935e is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:31:15.778267 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [req-f56f1e8d-4b6d-451a-a6f3-42120c90c40d req-d03d6095-659a-4327-a394-79d84df9ead6 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:15.781223 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d5824bd0-5dc6-4109-9483-fdbac2eadc41 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Releasing vlan 326 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:31:15.781617 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d5824bd0-5dc6-4109-9483-fdbac2eadc41 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:15.786077 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:31:15.786077 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:31:15.786077 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:31:15.786077 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:31:15.786077 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:31:15.786077 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:31:15.786077 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:31:15.786077 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:31:15.786077 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:31:15.786077 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:31:15.786077 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:31:15.786077 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:31:15.786077 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:31:15.786077 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:31:15.786077 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:31:15.786077 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:31:15.786077 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:31:15.786077 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:31:15.786077 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:31:15.786077 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:31:15.786077 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:31:15.786077 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:31:15.786077 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:31:15.786077 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:31:15.786077 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:31:15.786077 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:31:15.786077 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:31:15.786077 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:31:15.786077 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:31:15.786077 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:31:15.786077 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:31:15.786077 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:31:15.786077 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [req-f56f1e8d-4b6d-451a-a6f3-42120c90c40d req-d03d6095-659a-4327-a394-79d84df9ead6 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:31:15.788453 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d03d6095-659a-4327-a394-79d84df9ead6 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Pushing event updated for resources: {'Port': ['ID=9c023fad-c8fa-4120-b9cc-4ea22c1718e4,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:15.831438 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-476c006c-10df-4a56-b5e2-16e83c5cb0dc tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Network 6e2848bc-b428-4045-8127-510baced6460 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:31:15.856461 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-704e7966-8c0e-4b57-99c7-b690ae9bb7d0 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:15.859409 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f1ec9560-532e-47e7-9a4f-896f769f8c93 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:31:15.875003 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f1ec9560-532e-47e7-9a4f-896f769f8c93 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:15.876439 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-f1ec9560-532e-47e7-9a4f-896f769f8c93 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] 10.222.0.24 "PUT /v2.0/routers/59f4ff39-f644-4f83-8a3a-2a6f1674e434 HTTP/1.1" status: 200 len: 914 time: 6.9179103 Nov 09 04:31:15.884486 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55250) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:15.937211 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-43ddeedb-1653-4f8d-b7cc-0f205fa6739d None None] Sync routers for ids ['59f4ff39-f644-4f83-8a3a-2a6f1674e434'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:31:15.937719 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f56f1e8d-4b6d-451a-a6f3-42120c90c40d req-d03d6095-659a-4327-a394-79d84df9ead6 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:15.938403 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [req-f56f1e8d-4b6d-451a-a6f3-42120c90c40d req-d03d6095-659a-4327-a394-79d84df9ead6 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:15.955658 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-476c006c-10df-4a56-b5e2-16e83c5cb0dc tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 6e2848bc-b428-4045-8127-510baced6460) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:15.959690 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.db.api [None req-d5824bd0-5dc6-4109-9483-fdbac2eadc41 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Nov 09 04:31:15.959690 dv-neutron-816802-2-hyperv neutron-server[102161]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Nov 09 04:31:15.959690 dv-neutron-816802-2-hyperv neutron-server[102161]: [parameters: {'id': '34540b11-0cc5-4059-9dc2-d2360b37c1c4'}] Nov 09 04:31:15.959690 dv-neutron-816802-2-hyperv neutron-server[102161]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=102161) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:31:15.960147 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG oslo_db.api [None req-d5824bd0-5dc6-4109-9483-fdbac2eadc41 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:31:15.981065 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-43ddeedb-1653-4f8d-b7cc-0f205fa6739d None None] Routers {'59f4ff39-f644-4f83-8a3a-2a6f1674e434'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:31:15.981701 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-43ddeedb-1653-4f8d-b7cc-0f205fa6739d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:31:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['59f4ff39-f644-4f83-8a3a-2a6f1674e434'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:16.003937 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-476c006c-10df-4a56-b5e2-16e83c5cb0dc tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:16.004579 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-476c006c-10df-4a56-b5e2-16e83c5cb0dc tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:16.015435 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-41e00f3c-4def-45a0-8477-194917f998f6 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:16.019916 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-42a850ed-849a-466b-87f7-040bd6ce2829 None None] Network 6e2848bc-b428-4045-8127-510baced6460 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:16.041370 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-2fa98a27-c67d-4597-b51f-560ea4ac40d4 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] 10.222.0.24 "GET /v2.0/routers/59f4ff39-f644-4f83-8a3a-2a6f1674e434 HTTP/1.1" status: 200 len: 920 time: 0.1572411 Nov 09 04:31:16.044326 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55254) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:16.088661 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f56f1e8d-4b6d-451a-a6f3-42120c90c40d req-d03d6095-659a-4327-a394-79d84df9ead6 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.26 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.5378499 Nov 09 04:31:16.094705 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-476c006c-10df-4a56-b5e2-16e83c5cb0dc tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.3651948 Nov 09 04:31:16.105256 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [req-f56f1e8d-4b6d-451a-a6f3-42120c90c40d req-6241d26b-3b91-4857-a410-b4dde0a3df49 service neutron] Request body: {'port': {'device_id': '9c4e58e3-39e4-4212-b106-50b44d4c4e28', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:16.120788 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-43ddeedb-1653-4f8d-b7cc-0f205fa6739d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:16.136244 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55256) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:16.183456 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-41e00f3c-4def-45a0-8477-194917f998f6 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:16.184887 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb5f0f34-178b-4877-a49b-781be787cfd8 None None] Pushing event updated for resources: {'Port': ['ID=ab8e63ae-1230-482f-a48d-68b82b5ab45b,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:16.190173 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-41e00f3c-4def-45a0-8477-194917f998f6 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/ports/ee6eccfd-1357-4b13-bf25-4d1cef0fd60e HTTP/1.1" status: 204 len: 168 time: 1.5796604 Nov 09 04:31:16.190173 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41e00f3c-4def-45a0-8477-194917f998f6 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event deleted for resources: {'Port': ['ID=ee6eccfd-1357-4b13-bf25-4d1cef0fd60e,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:16.193108 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-43ddeedb-1653-4f8d-b7cc-0f205fa6739d None None] Routers {'59f4ff39-f644-4f83-8a3a-2a6f1674e434'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:31:16.193536 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-43ddeedb-1653-4f8d-b7cc-0f205fa6739d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:31:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['59f4ff39-f644-4f83-8a3a-2a6f1674e434'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:16.196008 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55258) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:16.199818 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f938b51d-619b-4daa-883e-25bbac508a53 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:16.204781 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-f938b51d-619b-4daa-883e-25bbac508a53 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] 10.222.0.24 "GET /v2.0/ports?network_id=2b6725f5-ebfe-485a-8f42-ccb5a241ddb5&device_id=59f4ff39-f644-4f83-8a3a-2a6f1674e434&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 945 time: 0.1594479 Nov 09 04:31:16.214647 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55260) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:16.217882 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-4a53d710-439b-416b-ba57-cb3af8dd3901 None None] For port cacdee0a-4fb3-484e-936f-fbc190a2cb37, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:31:16.221028 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-2dcd9ead-046a-401f-9519-fb3ef49b21f4 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Delete allocated IP 172.20.0.21 (472e0931-6be9-4332-83a6-c65cb3b98b7d/853593ba-982b-48a1-b01d-006ead90d6dd) {{(pid=102162) _delete_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:118}} Nov 09 04:31:16.255140 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-d23e3b95-e081-4696-b0ec-4f5a84b95279 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-625589827', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:16.262791 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-704e7966-8c0e-4b57-99c7-b690ae9bb7d0 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:16.267181 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [req-f56f1e8d-4b6d-451a-a6f3-42120c90c40d req-6241d26b-3b91-4857-a410-b4dde0a3df49 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:16.271594 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-704e7966-8c0e-4b57-99c7-b690ae9bb7d0 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:16.272430 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-704e7966-8c0e-4b57-99c7-b690ae9bb7d0 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:16.346372 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8dc9ba93-3b91-4023-a0ca-5fac9bb62732 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-6e2848bc-b428-4045-8127-510baced6460', 'network_id': '6e2848bc-b428-4045-8127-510baced6460', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'fixed_ips': [{'subnet_id': '4b3485de-3625-4aed-aab6-5ac993d0f4c3'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:31:16.347136 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8dc9ba93-3b91-4023-a0ca-5fac9bb62732 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:16.349420 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-43ddeedb-1653-4f8d-b7cc-0f205fa6739d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:16.350085 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-43ddeedb-1653-4f8d-b7cc-0f205fa6739d None None] The sync data for ids ['59f4ff39-f644-4f83-8a3a-2a6f1674e434'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:31:16.371435 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-3bbaeb84-9404-4018-bbcf-79fc8e7adf04 None None] For port 5a94a8e9-5741-464a-a62d-787955cf0970, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:31:16.386498 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-4a53d710-439b-416b-ba57-cb3af8dd3901 None None] For port cacdee0a-4fb3-484e-936f-fbc190a2cb37, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=cacdee0a-4fb3-484e-936f-fbc190a2cb37,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:31:16.449912 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-3bbaeb84-9404-4018-bbcf-79fc8e7adf04 None None] For port 5a94a8e9-5741-464a-a62d-787955cf0970, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=5a94a8e9-5741-464a-a62d-787955cf0970,segment=NetworkSegment(3defe9f8-d112-4c13-83df-42da5cffbca1),segment_id=3defe9f8-d112-4c13-83df-42da5cffbca1)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:31:16.452213 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-085a5666-aa77-4964-98fe-d86885c41345 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:16.454697 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-085a5666-aa77-4964-98fe-d86885c41345 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:16.457872 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-085a5666-aa77-4964-98fe-d86885c41345 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1477 time: 0.2514873 Nov 09 04:31:16.479988 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fccd78cc-e5de-4ff1-9fd4-ff18d5980547 None None] DHCP port deletion for b64bd442-d79d-4349-b9b3-5833909b2409 request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:31:16.484060 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d5824bd0-5dc6-4109-9483-fdbac2eadc41 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:16.484446 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55268) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:16.489673 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4a53d710-439b-416b-ba57-cb3af8dd3901 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:16.502145 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9177f774-0aac-48d2-8851-8f028899add7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:16.511060 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port bab3b0b2-ec0e-464a-b15f-1f71dc13f0f3 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:16.511432 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:16.581291 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-704e7966-8c0e-4b57-99c7-b690ae9bb7d0 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Pushing event updated for resources: {'Network': ['ID=03811c18-3b1c-42b8-9413-4db7f837fa52,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:16.598665 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-68e8b532-2854-4aa9-9abf-55f7832bb8d2 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:16.600441 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-68e8b532-2854-4aa9-9abf-55f7832bb8d2 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] 10.222.0.24 "GET /v2.0/networks/2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 HTTP/1.1" status: 200 len: 881 time: 0.3824363 Nov 09 04:31:16.608006 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55270) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:16.620673 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-6a9c89b5-66b2-4e67-9e4c-edaa71244618 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Deleting subnet 1bcc611a-d3c8-4019-aae7-12b401d69e2f {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:31:16.625924 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6a9c89b5-66b2-4e67-9e4c-edaa71244618 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:16.671128 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-b41049e5-d225-4406-a50b-ea0ddeebf588 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] 10.222.0.24 "GET /v2.0/ports?device_id=59f4ff39-f644-4f83-8a3a-2a6f1674e434 HTTP/1.1" status: 200 len: 205 time: 0.0539079 Nov 09 04:31:16.680181 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55272) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:16.699985 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-550a7e0d-fbc1-424f-8966-863fe2bc543f req-c700f226-cb96-4edd-bbf8-7b5c6d8cea50 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:16.701698 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-550a7e0d-fbc1-424f-8966-863fe2bc543f req-c700f226-cb96-4edd-bbf8-7b5c6d8cea50 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/ports?device_id=9c4e58e3-39e4-4212-b106-50b44d4c4e28 HTTP/1.1" status: 200 len: 931 time: 0.2402220 Nov 09 04:31:16.714792 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2dcd9ead-046a-401f-9519-fb3ef49b21f4 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:16.754502 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d23e3b95-e081-4696-b0ec-4f5a84b95279 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:16.755533 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d23e3b95-e081-4696-b0ec-4f5a84b95279 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:16.765847 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6a9c89b5-66b2-4e67-9e4c-edaa71244618 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:16.776268 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bb73051-0917-4513-86b7-58dd741e7e38 req-8d064f38-8381-4402-a88b-2ec98eb70de2 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:16.785882 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1bb73051-0917-4513-86b7-58dd741e7e38 req-8d064f38-8381-4402-a88b-2ec98eb70de2 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 944 time: 0.4458721 Nov 09 04:31:16.830238 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-550a7e0d-fbc1-424f-8966-863fe2bc543f req-db3e6f14-ba33-44a2-af7a-562ebda76fe5 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/security-groups?id=4ff68177-77d2-4250-b11c-4d5b55fd3619&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1092749 Nov 09 04:31:16.840895 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-704e7966-8c0e-4b57-99c7-b690ae9bb7d0 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 789 time: 1.5887086 Nov 09 04:31:16.845284 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55274) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:16.846271 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2dcd9ead-046a-401f-9519-fb3ef49b21f4 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:16.847251 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-d5824bd0-5dc6-4109-9483-fdbac2eadc41 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Deleting port 5a94a8e9-5741-464a-a62d-787955cf0970 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:31:16.848898 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d5824bd0-5dc6-4109-9483-fdbac2eadc41 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:16.857723 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-97c1d40c-0373-4a35-a005-35d012e5aa71 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Request body: {'subnet': {'network_id': '03811c18-3b1c-42b8-9413-4db7f837fa52', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:16.942417 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 03811c18-3b1c-42b8-9413-4db7f837fa52 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:31:16.954035 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-9177f774-0aac-48d2-8851-8f028899add7 None None] For port 7086c1a6-ddfa-4612-9396-d70dbb558c5c, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=7086c1a6-ddfa-4612-9396-d70dbb558c5c,segment=NetworkSegment(303916b3-0435-4d77-9e83-60967f186bbf),segment_id=303916b3-0435-4d77-9e83-60967f186bbf)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:31:16.964006 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3bbaeb84-9404-4018-bbcf-79fc8e7adf04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:16.970930 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:17.051275 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9177f774-0aac-48d2-8851-8f028899add7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:17.095152 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 99ad1d96-b35b-4120-b5a9-c95c47bd3ffc up at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:31:17.117500 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-d5824bd0-5dc6-4109-9483-fdbac2eadc41 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] For port 5a94a8e9-5741-464a-a62d-787955cf0970, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=5a94a8e9-5741-464a-a62d-787955cf0970,segment=NetworkSegment(3defe9f8-d112-4c13-83df-42da5cffbca1),segment_id=3defe9f8-d112-4c13-83df-42da5cffbca1)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:31:17.117500 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d5824bd0-5dc6-4109-9483-fdbac2eadc41 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:17.120430 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2dcd9ead-046a-401f-9519-fb3ef49b21f4 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event updated for resources: {'Port': ['ID=9e44f1ae-891b-4a24-90bf-230a42b37820,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:17.136794 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-8dc9ba93-3b91-4023-a0ca-5fac9bb62732 None None] Allocated IP 172.20.0.2 (6e2848bc-b428-4045-8127-510baced6460/4b3485de-3625-4aed-aab6-5ac993d0f4c3/fa3ed53c-9d43-4ea3-b780-2ad74f003fed) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:31:17.150442 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [req-f56f1e8d-4b6d-451a-a6f3-42120c90c40d req-6241d26b-3b91-4857-a410-b4dde0a3df49 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 9c023fad-c8fa-4120-b9cc-4ea22c1718e4 {{(pid=102161) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:31:17.155373 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-d5824bd0-5dc6-4109-9483-fdbac2eadc41 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Calling delete_port for 5a94a8e9-5741-464a-a62d-787955cf0970 owned by network:dhcp {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:31:17.162921 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [req-f56f1e8d-4b6d-451a-a6f3-42120c90c40d req-6241d26b-3b91-4857-a410-b4dde0a3df49 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:17.186057 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1bb73051-0917-4513-86b7-58dd741e7e38 req-738f5ff1-3b7b-4b7e-bdfa-48edd57d89af tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3954117 Nov 09 04:31:17.197563 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d23e3b95-e081-4696-b0ec-4f5a84b95279 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:17.212693 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.provisioning_blocks [req-f56f1e8d-4b6d-451a-a6f3-42120c90c40d req-6241d26b-3b91-4857-a410-b4dde0a3df49 service neutron] Transition to ACTIVE for port object 9c023fad-c8fa-4120-b9cc-4ea22c1718e4 will not be triggered until provisioned by entity L2. {{(pid=102161) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 09 04:31:17.242264 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:17.256919 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-97c1d40c-0373-4a35-a005-35d012e5aa71 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Made reservation on behalf of 6acf678d74da4512a431e262bbd32037 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:17.260337 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6d9949be-1e22-4595-8680-5a8073cacd76 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks [] for router, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:17.260797 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-97c1d40c-0373-4a35-a005-35d012e5aa71 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:17.289113 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-fccd78cc-e5de-4ff1-9fd4-ff18d5980547 None None] Deleting port 7086c1a6-ddfa-4612-9396-d70dbb558c5c {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:31:17.289485 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-fccd78cc-e5de-4ff1-9fd4-ff18d5980547 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:17.300763 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [req-f56f1e8d-4b6d-451a-a6f3-42120c90c40d req-6241d26b-3b91-4857-a410-b4dde0a3df49 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:17.342026 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6a9c89b5-66b2-4e67-9e4c-edaa71244618 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:17.360876 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d23e3b95-e081-4696-b0ec-4f5a84b95279 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:17.401965 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-fccd78cc-e5de-4ff1-9fd4-ff18d5980547 None None] For port 7086c1a6-ddfa-4612-9396-d70dbb558c5c, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=7086c1a6-ddfa-4612-9396-d70dbb558c5c,segment=NetworkSegment(303916b3-0435-4d77-9e83-60967f186bbf),segment_id=303916b3-0435-4d77-9e83-60967f186bbf)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:31:17.402727 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-fccd78cc-e5de-4ff1-9fd4-ff18d5980547 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:17.416296 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-fccd78cc-e5de-4ff1-9fd4-ff18d5980547 None None] Calling delete_port for 7086c1a6-ddfa-4612-9396-d70dbb558c5c owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:31:17.463632 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6241d26b-3b91-4857-a410-b4dde0a3df49 service neutron] Pushing event updated for resources: {'Port': ['ID=9c023fad-c8fa-4120-b9cc-4ea22c1718e4,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:17.492413 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6241d26b-3b91-4857-a410-b4dde0a3df49 service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:31:17.492879 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6241d26b-3b91-4857-a410-b4dde0a3df49 service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:31:17.493275 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6241d26b-3b91-4857-a410-b4dde0a3df49 service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:31:17.493616 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6241d26b-3b91-4857-a410-b4dde0a3df49 service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:31:17.493948 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6241d26b-3b91-4857-a410-b4dde0a3df49 service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:31:17.494274 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6241d26b-3b91-4857-a410-b4dde0a3df49 service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:31:17.494621 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6241d26b-3b91-4857-a410-b4dde0a3df49 service neutron] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:31:17.494944 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6241d26b-3b91-4857-a410-b4dde0a3df49 service neutron] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:31:17.495267 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6241d26b-3b91-4857-a410-b4dde0a3df49 service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:31:17.495587 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6241d26b-3b91-4857-a410-b4dde0a3df49 service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:31:17.495905 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6241d26b-3b91-4857-a410-b4dde0a3df49 service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:31:17.496218 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6241d26b-3b91-4857-a410-b4dde0a3df49 service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:31:17.501721 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a53d710-439b-416b-ba57-cb3af8dd3901 None None] Pushing event updated for resources: {'Port': ['ID=cacdee0a-4fb3-484e-936f-fbc190a2cb37,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:17.511243 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-39c80f7d-cc19-43aa-8ea2-661286ea15fd None None] Network 34540b11-0cc5-4059-9dc2-d2360b37c1c4 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:17.542206 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d5824bd0-5dc6-4109-9483-fdbac2eadc41 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:17.559755 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-2dcd9ead-046a-401f-9519-fb3ef49b21f4 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] In _notify_port_updated(), no bound segment for port 9e44f1ae-891b-4a24-90bf-230a42b37820 on network 472e0931-6be9-4332-83a6-c65cb3b98b7d {{(pid=102162) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 09 04:31:17.578190 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2dcd9ead-046a-401f-9519-fb3ef49b21f4 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:17.578883 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2dcd9ead-046a-401f-9519-fb3ef49b21f4 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:17.588939 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-2dcd9ead-046a-401f-9519-fb3ef49b21f4 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "PUT /v2.0/ports/9e44f1ae-891b-4a24-90bf-230a42b37820 HTTP/1.1" status: 200 len: 920 time: 2.4593897 Nov 09 04:31:17.589742 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55276) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:17.604392 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-fccd78cc-e5de-4ff1-9fd4-ff18d5980547 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:17.610875 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d5824bd0-5dc6-4109-9483-fdbac2eadc41 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] No DVR routers for this DVR port 5a94a8e9-5741-464a-a62d-787955cf0970 on host dv-neutron-816802-2-hyperv {{(pid=102161) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:31:17.616005 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5824bd0-5dc6-4109-9483-fdbac2eadc41 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event deleted for resources: {'Port': ['ID=5a94a8e9-5741-464a-a62d-787955cf0970,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:17.616703 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-088fc49d-4b15-4c16-bcde-2c713a8453be tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Request body: {'port': {'fixed_ips': [{'subnet_id': 'a38fa5e5-0ac0-4d69-8fb6-dcbb9f935dc1'}, {'subnet_id': '853593ba-982b-48a1-b01d-006ead90d6dd'}]}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:17.627922 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d23e3b95-e081-4696-b0ec-4f5a84b95279 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:17.638785 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-d23e3b95-e081-4696-b0ec-4f5a84b95279 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 699 time: 1.4527781 Nov 09 04:31:17.644683 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55278) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:17.652074 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-2ee16f9b-a300-4ffc-a90c-fbe2dee119c5 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Request body: {'port': {'network_id': '6e2848bc-b428-4045-8127-510baced6460', 'name': 'tempest-RoutersTest-540714601'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:17.738455 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-9efb0552-63e6-4c4d-96af-5f2234295a91 None None] Provisioning complete for port 9e44f1ae-891b-4a24-90bf-230a42b37820 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:17.738823 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9efb0552-63e6-4c4d-96af-5f2234295a91 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:17.757069 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6d9949be-1e22-4595-8680-5a8073cacd76 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks [] for router_gateway, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:17.773793 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6a9c89b5-66b2-4e67-9e4c-edaa71244618 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:17.794537 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fccd78cc-e5de-4ff1-9fd4-ff18d5980547 None None] No DVR routers for this DVR port 7086c1a6-ddfa-4612-9396-d70dbb558c5c on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:31:17.798293 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 7086c1a6-ddfa-4612-9396-d70dbb558c5c up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:31:17.811466 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6a9c89b5-66b2-4e67-9e4c-edaa71244618 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:17.817454 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-6a9c89b5-66b2-4e67-9e4c-edaa71244618 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/1bcc611a-d3c8-4019-aae7-12b401d69e2f HTTP/1.1" status: 204 len: 168 time: 1.3176374 Nov 09 04:31:17.817454 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a9c89b5-66b2-4e67-9e4c-edaa71244618 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event deleted for resources: {'Subnet': ['ID=1bcc611a-d3c8-4019-aae7-12b401d69e2f,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:17.817733 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55280) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:17.841966 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d5824bd0-5dc6-4109-9483-fdbac2eadc41 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:17.860269 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning for port 99ad1d96-b35b-4120-b5a9-c95c47bd3ffc completed by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 09 04:31:17.863669 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 7086c1a6-ddfa-4612-9396-d70dbb558c5c {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:31:17.864360 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 7086c1a6-ddfa-4612-9396-d70dbb558c5c not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:304}} Nov 09 04:31:17.866207 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [req-f56f1e8d-4b6d-451a-a6f3-42120c90c40d req-6241d26b-3b91-4857-a410-b4dde0a3df49 service neutron] Attempting to bind port 9c023fad-c8fa-4120-b9cc-4ea22c1718e4 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:31:17.866638 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [req-f56f1e8d-4b6d-451a-a6f3-42120c90c40d req-6241d26b-3b91-4857-a410-b4dde0a3df49 service neutron] Attempting to bind port 9c023fad-c8fa-4120-b9cc-4ea22c1718e4 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'd5411e15-1506-4025-8472-ba7118358f68', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 313, 'network_id': '9c94e7dc-d679-4a7e-b264-6d619dbc935e'}] {{(pid=102161) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:31:17.867028 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f56f1e8d-4b6d-451a-a6f3-42120c90c40d req-6241d26b-3b91-4857-a410-b4dde0a3df49 service neutron] Attempting to bind port 9c023fad-c8fa-4120-b9cc-4ea22c1718e4 on network 9c94e7dc-d679-4a7e-b264-6d619dbc935e {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:31:17.903933 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a9c89b5-66b2-4e67-9e4c-edaa71244618 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:31:17.904191 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a9c89b5-66b2-4e67-9e4c-edaa71244618 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:31:17.904535 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a9c89b5-66b2-4e67-9e4c-edaa71244618 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:31:17.904901 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a9c89b5-66b2-4e67-9e4c-edaa71244618 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:31:17.905268 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a9c89b5-66b2-4e67-9e4c-edaa71244618 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:31:17.905600 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a9c89b5-66b2-4e67-9e4c-edaa71244618 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:31:17.905933 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a9c89b5-66b2-4e67-9e4c-edaa71244618 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:31:17.906830 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a9c89b5-66b2-4e67-9e4c-edaa71244618 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:31:17.906927 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a9c89b5-66b2-4e67-9e4c-edaa71244618 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:31:17.907246 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a9c89b5-66b2-4e67-9e4c-edaa71244618 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:31:17.907580 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a9c89b5-66b2-4e67-9e4c-edaa71244618 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:31:17.907906 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a9c89b5-66b2-4e67-9e4c-edaa71244618 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:31:17.913293 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-0866fc77-0040-449a-9be5-028900cb3739 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0914233 Nov 09 04:31:17.914800 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-d5824bd0-5dc6-4109-9483-fdbac2eadc41 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['34540b11-0cc5-4059-9dc2-d2360b37c1c4']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:17.917227 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f56f1e8d-4b6d-451a-a6f3-42120c90c40d req-6241d26b-3b91-4857-a410-b4dde0a3df49 service neutron] Port 9c023fad-c8fa-4120-b9cc-4ea22c1718e4 on network 9c94e7dc-d679-4a7e-b264-6d619dbc935e not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:31:17.917555 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f56f1e8d-4b6d-451a-a6f3-42120c90c40d req-6241d26b-3b91-4857-a410-b4dde0a3df49 service neutron] Attempting to bind port 9c023fad-c8fa-4120-b9cc-4ea22c1718e4 on network 9c94e7dc-d679-4a7e-b264-6d619dbc935e {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:31:17.934539 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55284) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:17.936875 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bbaeb84-9404-4018-bbcf-79fc8e7adf04 None None] Pushing event updated for resources: {'Port': ['ID=5a94a8e9-5741-464a-a62d-787955cf0970,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:17.940680 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-3741a81c-c87e-4157-97cf-089ae81f4379 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'subnet': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:17.952906 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning complete for port 99ad1d96-b35b-4120-b5a9-c95c47bd3ffc triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:17.953418 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:17.964483 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Port 7086c1a6-ddfa-4612-9396-d70dbb558c5c not found, will not notify nova. {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:314}} Nov 09 04:31:17.970586 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-d5824bd0-5dc6-4109-9483-fdbac2eadc41 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3defe9f8-d112-4c13-83df-42da5cffbca1') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:17.971084 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-d5824bd0-5dc6-4109-9483-fdbac2eadc41 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3defe9f8-d112-4c13-83df-42da5cffbca1') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:17.993135 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f56f1e8d-4b6d-451a-a6f3-42120c90c40d req-6241d26b-3b91-4857-a410-b4dde0a3df49 service neutron] Checking agent: {'id': '7d36b884-4ad2-4878-9464-bf647030b544', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'started_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 31, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:31:17.993757 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f56f1e8d-4b6d-451a-a6f3-42120c90c40d req-6241d26b-3b91-4857-a410-b4dde0a3df49 service neutron] Checking segment: {'id': 'd5411e15-1506-4025-8472-ba7118358f68', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 313, 'network_id': '9c94e7dc-d679-4a7e-b264-6d619dbc935e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:31:17.994436 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f56f1e8d-4b6d-451a-a6f3-42120c90c40d req-6241d26b-3b91-4857-a410-b4dde0a3df49 service neutron] Bound using segment: {'id': 'd5411e15-1506-4025-8472-ba7118358f68', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 313, 'network_id': '9c94e7dc-d679-4a7e-b264-6d619dbc935e'} {{(pid=102161) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:31:17.995029 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.managers [req-f56f1e8d-4b6d-451a-a6f3-42120c90c40d req-6241d26b-3b91-4857-a410-b4dde0a3df49 service neutron] Bound port: 9c023fad-c8fa-4120-b9cc-4ea22c1718e4, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd5411e15-1506-4025-8472-ba7118358f68', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 313, 'network_id': '9c94e7dc-d679-4a7e-b264-6d619dbc935e'}}] {{(pid=102161) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:31:17.995529 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [req-f56f1e8d-4b6d-451a-a6f3-42120c90c40d req-6241d26b-3b91-4857-a410-b4dde0a3df49 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:18.007692 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d5824bd0-5dc6-4109-9483-fdbac2eadc41 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:18.031572 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9177f774-0aac-48d2-8851-8f028899add7 None None] Pushing event deleted for resources: {'Port': ['ID=7086c1a6-ddfa-4612-9396-d70dbb558c5c,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:18.041978 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-9efb0552-63e6-4c4d-96af-5f2234295a91 None None] Port 9e44f1ae-891b-4a24-90bf-230a42b37820 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:31:18.049312 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-088fc49d-4b15-4c16-bcde-2c713a8453be tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:18.073153 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d5824bd0-5dc6-4109-9483-fdbac2eadc41 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:18.123517 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fccd78cc-e5de-4ff1-9fd4-ff18d5980547 None None] Pushing event deleted for resources: {'Port': ['ID=7086c1a6-ddfa-4612-9396-d70dbb558c5c,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:18.156379 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d5824bd0-5dc6-4109-9483-fdbac2eadc41 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Releasing vlan 326 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:31:18.156706 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d5824bd0-5dc6-4109-9483-fdbac2eadc41 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:18.162080 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:31:18.162080 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:31:18.162080 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:31:18.162080 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:31:18.162080 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:31:18.162080 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:31:18.162080 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:31:18.162080 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:31:18.162080 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:31:18.162080 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:31:18.162080 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:31:18.162080 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:31:18.162080 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:31:18.162080 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:31:18.162080 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:31:18.162080 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:31:18.162080 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:31:18.162080 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:31:18.162080 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:31:18.162080 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:31:18.162080 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:31:18.162080 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:31:18.162080 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:31:18.162080 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:31:18.162080 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:31:18.162080 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:31:18.162080 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:31:18.162080 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:31:18.162080 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:31:18.162080 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:31:18.162080 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:31:18.162080 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:31:18.166878 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [req-f56f1e8d-4b6d-451a-a6f3-42120c90c40d req-6241d26b-3b91-4857-a410-b4dde0a3df49 service neutron] For port 9c023fad-c8fa-4120-b9cc-4ea22c1718e4, host hv-neutron-8168, cleared binding levels {{(pid=102161) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:31:18.218449 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-9efb0552-63e6-4c4d-96af-5f2234295a91 None None] Provisioning complete for port ab8e63ae-1230-482f-a48d-68b82b5ab45b triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:18.218449 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9efb0552-63e6-4c4d-96af-5f2234295a91 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:18.254018 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8dc9ba93-3b91-4023-a0ca-5fac9bb62732 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:18.275277 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [req-f56f1e8d-4b6d-451a-a6f3-42120c90c40d req-6241d26b-3b91-4857-a410-b4dde0a3df49 service neutron] For port 9c023fad-c8fa-4120-b9cc-4ea22c1718e4, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=9c023fad-c8fa-4120-b9cc-4ea22c1718e4,segment=NetworkSegment(d5411e15-1506-4025-8472-ba7118358f68),segment_id=d5411e15-1506-4025-8472-ba7118358f68)] {{(pid=102161) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:31:18.299280 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e25726e-2114-4804-8b22-7e6f636a1905 req-fafbc8fd-887e-4fa0-836a-93fc309cd246 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:18.301282 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-5e25726e-2114-4804-8b22-7e6f636a1905 req-fafbc8fd-887e-4fa0-836a-93fc309cd246 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/ports?device_id=9c4e58e3-39e4-4212-b106-50b44d4c4e28 HTTP/1.1" status: 200 len: 943 time: 0.2902145 Nov 09 04:31:18.328395 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8dc9ba93-3b91-4023-a0ca-5fac9bb62732 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:18.355170 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.objects.ports [None req-97c1d40c-0373-4a35-a005-35d012e5aa71 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=102161) get_objects /opt/stack/neutron/neutron/objects/ports.py:444}} Nov 09 04:31:18.360948 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device ab8e63ae-1230-482f-a48d-68b82b5ab45b up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:31:18.361478 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2ee16f9b-a300-4ffc-a90c-fbe2dee119c5 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Made reservation on behalf of 188f23ef0cb54006875c672b78f5249f for: {'port': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:18.365151 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2ee16f9b-a300-4ffc-a90c-fbe2dee119c5 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:18.367811 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [req-f56f1e8d-4b6d-451a-a6f3-42120c90c40d req-6241d26b-3b91-4857-a410-b4dde0a3df49 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:18.369610 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d5824bd0-5dc6-4109-9483-fdbac2eadc41 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:18.375207 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d5824bd0-5dc6-4109-9483-fdbac2eadc41 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:18.381027 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-d5824bd0-5dc6-4109-9483-fdbac2eadc41 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "DELETE /v2.0/networks/34540b11-0cc5-4059-9dc2-d2360b37c1c4 HTTP/1.1" status: 204 len: 168 time: 5.5232282 Nov 09 04:31:18.386242 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-97c1d40c-0373-4a35-a005-35d012e5aa71 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:18.398840 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55288) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:18.422074 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:18.433519 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8dc9ba93-3b91-4023-a0ca-5fac9bb62732 None None] Network 6e2848bc-b428-4045-8127-510baced6460 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:31:18.463092 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-8dc9ba93-3b91-4023-a0ca-5fac9bb62732 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:18.473832 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8dc9ba93-3b91-4023-a0ca-5fac9bb62732 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:31:18.477319 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dc9ba93-3b91-4023-a0ca-5fac9bb62732 None None] Pushing event updated for resources: {'Port': ['ID=fa3ed53c-9d43-4ea3-b780-2ad74f003fed,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:18.534319 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '433dca8f-3e84-4693-93ed-4f8fcd69553a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '99ad1d96-b35b-4120-b5a9-c95c47bd3ffc'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:31:18.537886 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7bec5768-bc23-484c-94e1-1544479ad6e9" -d '{"events": [{"server_uuid": "433dca8f-3e84-4693-93ed-4f8fcd69553a", "name": "network-vif-plugged", "status": "completed", "tag": "99ad1d96-b35b-4120-b5a9-c95c47bd3ffc"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:31:18.596288 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 99ad1d96-b35b-4120-b5a9-c95c47bd3ffc, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=99ad1d96-b35b-4120-b5a9-c95c47bd3ffc,segment=NetworkSegment(e211d893-ee7a-48e3-bc29-b8824167e15b),segment_id=e211d893-ee7a-48e3-bc29-b8824167e15b)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:31:18.646383 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-8dc9ba93-3b91-4023-a0ca-5fac9bb62732 None None] Attempting to bind port fa3ed53c-9d43-4ea3-b780-2ad74f003fed on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:31:18.647376 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-8dc9ba93-3b91-4023-a0ca-5fac9bb62732 None None] Attempting to bind port fa3ed53c-9d43-4ea3-b780-2ad74f003fed by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'ab066ae5-0f1f-4c66-aa12-5d1f0c9bbe81', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 312, 'network_id': '6e2848bc-b428-4045-8127-510baced6460'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:31:18.648003 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8dc9ba93-3b91-4023-a0ca-5fac9bb62732 None None] Attempting to bind port fa3ed53c-9d43-4ea3-b780-2ad74f003fed on network 6e2848bc-b428-4045-8127-510baced6460 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:31:18.659319 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:18.667538 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8dc9ba93-3b91-4023-a0ca-5fac9bb62732 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 31, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:31:18.667538 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8dc9ba93-3b91-4023-a0ca-5fac9bb62732 None None] Checking segment: {'id': 'ab066ae5-0f1f-4c66-aa12-5d1f0c9bbe81', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 312, 'network_id': '6e2848bc-b428-4045-8127-510baced6460'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:31:18.667538 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8dc9ba93-3b91-4023-a0ca-5fac9bb62732 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:18.667538 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8dc9ba93-3b91-4023-a0ca-5fac9bb62732 None None] Bound using segment: {'id': 'ab066ae5-0f1f-4c66-aa12-5d1f0c9bbe81', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 312, 'network_id': '6e2848bc-b428-4045-8127-510baced6460'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:31:18.667538 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-8dc9ba93-3b91-4023-a0ca-5fac9bb62732 None None] Bound port: fa3ed53c-9d43-4ea3-b780-2ad74f003fed, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ab066ae5-0f1f-4c66-aa12-5d1f0c9bbe81', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 312, 'network_id': '6e2848bc-b428-4045-8127-510baced6460'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:31:18.669557 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8dc9ba93-3b91-4023-a0ca-5fac9bb62732 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:18.673073 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port ab8e63ae-1230-482f-a48d-68b82b5ab45b triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:18.673562 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:18.687360 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-573672a1-266a-4356-a465-71f654a3cf7c None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:18.691931 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-6d9949be-1e22-4595-8680-5a8073cacd76 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Deleting port 2ad7cfe1-e3b0-4322-8461-1f16258cb9f9 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:31:18.692466 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6d9949be-1e22-4595-8680-5a8073cacd76 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:18.759705 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14c859e8-f2ba-4e02-9eba-9ecad17aff7d req-21efdd2d-407e-4626-87b6-2190d8aa2005 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:18.761274 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-14c859e8-f2ba-4e02-9eba-9ecad17aff7d req-21efdd2d-407e-4626-87b6-2190d8aa2005 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 944 time: 0.1540198 Nov 09 04:31:18.766679 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3741a81c-c87e-4157-97cf-089ae81f4379 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:18.770405 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3741a81c-c87e-4157-97cf-089ae81f4379 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:18.811788 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5824bd0-5dc6-4109-9483-fdbac2eadc41 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event deleted for resources: {'Network': ['ID=34540b11-0cc5-4059-9dc2-d2360b37c1c4,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:18.822892 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-36a77c9b-b543-4cfb-9c56-1156a1629f09 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] GET failed (client error): The resource could not be found. Nov 09 04:31:18.824476 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-36a77c9b-b543-4cfb-9c56-1156a1629f09 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "GET /v2.0/subnets/d360fc46-82eb-4904-9996-d0675d95d2e3 HTTP/1.1" status: 404 len: 337 time: 0.4175766 Nov 09 04:31:18.838027 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55292) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:18.853046 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f56f1e8d-4b6d-451a-a6f3-42120c90c40d req-6241d26b-3b91-4857-a410-b4dde0a3df49 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:18.853969 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [req-f56f1e8d-4b6d-451a-a6f3-42120c90c40d req-6241d26b-3b91-4857-a410-b4dde0a3df49 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:18.855412 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f56f1e8d-4b6d-451a-a6f3-42120c90c40d req-6241d26b-3b91-4857-a410-b4dde0a3df49 service neutron] 10.222.0.26 "PUT /v2.0/ports/9c023fad-c8fa-4120-b9cc-4ea22c1718e4 HTTP/1.1" status: 200 len: 1093 time: 2.7579579 Nov 09 04:31:18.864413 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [None req-2ee16f9b-a300-4ffc-a90c-fbe2dee119c5 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] device_id is not set on port f3596fb5-0eb8-49ea-acb9-6ea4bc4b920e yet. {{(pid=102161) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:31:18.869508 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9c4e58e3-39e4-4212-b106-50b44d4c4e28', 'tag': '9c023fad-c8fa-4120-b9cc-4ea22c1718e4'}] {{(pid=102161) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:31:18.874535 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}99dfdda0def497b4372884ef2eb87f06b1e425c8eba5ceda5f64bbab037a07d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a7fe0226-86a7-4672-a011-97b36cc024e8" -d '{"events": [{"name": "network-changed", "server_uuid": "9c4e58e3-39e4-4212-b106-50b44d4c4e28", "tag": "9c023fad-c8fa-4120-b9cc-4ea22c1718e4"}]}' {{(pid=102161) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:31:18.888393 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-2c6b7995-87b9-4747-b753-6c3e64bd36e6 None None] Provisioning complete for port 9e44f1ae-891b-4a24-90bf-230a42b37820 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:18.888755 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-2c6b7995-87b9-4747-b753-6c3e64bd36e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:18.892585 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=99ad1d96-b35b-4120-b5a9-c95c47bd3ffc,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:18.946003 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-5e25726e-2114-4804-8b22-7e6f636a1905 req-986a74ab-dc99-41b3-b75e-d3a0ca2db6a2 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/security-groups?id=4ff68177-77d2-4250-b11c-4d5b55fd3619&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.6354516 Nov 09 04:31:19.025657 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-dfc16a60-1e15-4038-8e5e-1b57e2f7b26c tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] DELETE failed (client error): The resource could not be found. Nov 09 04:31:19.026511 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-dfc16a60-1e15-4038-8e5e-1b57e2f7b26c tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:31:19.029872 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-dfc16a60-1e15-4038-8e5e-1b57e2f7b26c tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "DELETE /v2.0/networks/34540b11-0cc5-4059-9dc2-d2360b37c1c4 HTTP/1.1" status: 404 len: 339 time: 0.1848795 Nov 09 04:31:19.040399 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6d9949be-1e22-4595-8680-5a8073cacd76 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:19.046594 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55296) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:19.068954 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97c1d40c-0373-4a35-a005-35d012e5aa71 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Pushing event updated for resources: {'Subnet': ['ID=d464265c-8221-4b17-812a-e1630fa487e5,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:19.111064 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6241d26b-3b91-4857-a410-b4dde0a3df49 service neutron] Pushing event updated for resources: {'Port': ['ID=9c023fad-c8fa-4120-b9cc-4ea22c1718e4,revision_number=3']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:19.130260 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-14c859e8-f2ba-4e02-9eba-9ecad17aff7d req-d023e71d-090b-40e9-9f38-df593562aa2e tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3516474 Nov 09 04:31:19.148831 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-6d9949be-1e22-4595-8680-5a8073cacd76 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Calling delete_port for 2ad7cfe1-e3b0-4322-8461-1f16258cb9f9 owned by network:router_gateway {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:31:19.153959 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-97c1d40c-0373-4a35-a005-35d012e5aa71 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Checking segment: {'id': 'b769ba14-e21e-411b-82e2-2dd33164c868', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 331, 'network_id': '03811c18-3b1c-42b8-9413-4db7f837fa52'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:31:19.153959 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-97c1d40c-0373-4a35-a005-35d012e5aa71 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Network hostable DHCP agents. Network: 03811c18-3b1c-42b8-9413-4db7f837fa52, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:31:19.179087 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f56f1e8d-4b6d-451a-a6f3-42120c90c40d req-c9d0a4f9-81a5-44f6-bedb-959880ee5014 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:19.180638 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f56f1e8d-4b6d-451a-a6f3-42120c90c40d req-c9d0a4f9-81a5-44f6-bedb-959880ee5014 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=fd7df27e425449dfb80d0838c8f7fb89&device_id=9c4e58e3-39e4-4212-b106-50b44d4c4e28 HTTP/1.1" status: 200 len: 1096 time: 0.1496432 Nov 09 04:31:19.193392 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:31:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ae22dd9e-7037-4442-9d03-518152226c2d x-openstack-request-id: req-ae22dd9e-7037-4442-9d03-518152226c2d {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:31:19.193949 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "433dca8f-3e84-4693-93ed-4f8fcd69553a", "name": "network-vif-plugged", "status": "completed", "tag": "99ad1d96-b35b-4120-b5a9-c95c47bd3ffc", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:31:19.193949 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-ae22dd9e-7037-4442-9d03-518152226c2d {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:31:19.194292 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '433dca8f-3e84-4693-93ed-4f8fcd69553a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '99ad1d96-b35b-4120-b5a9-c95c47bd3ffc', 'code': 200} Nov 09 04:31:19.198712 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:31:19.199087 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:31:19.199429 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:31:19.199761 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:31:19.200096 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:31:19.200434 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:31:19.200733 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:31:19.201064 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:31:19.201406 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:31:19.202255 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:31:19.202611 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:31:19.203071 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:31:19.209714 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-8dc9ba93-3b91-4023-a0ca-5fac9bb62732 None None] For port fa3ed53c-9d43-4ea3-b780-2ad74f003fed, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:31:19.226465 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:31:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5e61410e-2c4b-4ae5-91ac-7a20a3b063ce x-openstack-request-id: req-5e61410e-2c4b-4ae5-91ac-7a20a3b063ce {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:31:19.226821 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9c4e58e3-39e4-4212-b106-50b44d4c4e28", "tag": "9c023fad-c8fa-4120-b9cc-4ea22c1718e4", "status": "completed", "code": 200}]} {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:31:19.227062 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-5e61410e-2c4b-4ae5-91ac-7a20a3b063ce {{(pid=102161) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:31:19.227433 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9c4e58e3-39e4-4212-b106-50b44d4c4e28', 'tag': '9c023fad-c8fa-4120-b9cc-4ea22c1718e4', 'status': 'completed', 'code': 200} Nov 09 04:31:19.272670 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f56f1e8d-4b6d-451a-a6f3-42120c90c40d req-9ef71890-e294-488c-81f1-7ac36760828a service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=9c023fad-c8fa-4120-b9cc-4ea22c1718e4 HTTP/1.1" status: 200 len: 217 time: 0.0813339 Nov 09 04:31:19.282066 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-8dc9ba93-3b91-4023-a0ca-5fac9bb62732 None None] For port fa3ed53c-9d43-4ea3-b780-2ad74f003fed, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=fa3ed53c-9d43-4ea3-b780-2ad74f003fed,segment=NetworkSegment(ab066ae5-0f1f-4c66-aa12-5d1f0c9bbe81),segment_id=ab066ae5-0f1f-4c66-aa12-5d1f0c9bbe81)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:31:19.286129 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-2c6b7995-87b9-4747-b753-6c3e64bd36e6 None None] Port 9e44f1ae-891b-4a24-90bf-230a42b37820 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:31:19.313845 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device cacdee0a-4fb3-484e-936f-fbc190a2cb37 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:31:19.325560 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-2ee16f9b-a300-4ffc-a90c-fbe2dee119c5 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Allocated IP 172.20.0.9 (6e2848bc-b428-4045-8127-510baced6460/4b3485de-3625-4aed-aab6-5ac993d0f4c3/f3596fb5-0eb8-49ea-acb9-6ea4bc4b920e) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:31:19.357592 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8dc9ba93-3b91-4023-a0ca-5fac9bb62732 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:19.378968 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f56f1e8d-4b6d-451a-a6f3-42120c90c40d req-30e2eb7d-ebd0-456e-bded-295a21f5e7f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:19.381627 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f56f1e8d-4b6d-451a-a6f3-42120c90c40d req-30e2eb7d-ebd0-456e-bded-295a21f5e7f3 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=003822ea-7d1a-41fa-a15f-16fc8c9f624c HTTP/1.1" status: 200 len: 834 time: 0.1006300 Nov 09 04:31:19.384505 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-97c1d40c-0373-4a35-a005-35d012e5aa71 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Network 03811c18-3b1c-42b8-9413-4db7f837fa52 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:31:19.432927 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eaf9cb82-fc9e-41d0-bda5-dc9fd737bd0a None None] DHCP port deletion for 988d2354-693c-4d52-af17-25e0643eaa0c request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:31:19.458233 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-2c6b7995-87b9-4747-b753-6c3e64bd36e6 None None] Provisioning complete for port cacdee0a-4fb3-484e-936f-fbc190a2cb37 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:19.458759 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-2c6b7995-87b9-4747-b753-6c3e64bd36e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:19.485992 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-14c261af-9eb9-445f-84d2-a31f606bdab5 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:19.485992 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-14c261af-9eb9-445f-84d2-a31f606bdab5 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 782 time: 0.4351544 Nov 09 04:31:19.504983 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55298) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:19.520583 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-97c1d40c-0373-4a35-a005-35d012e5aa71 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 03811c18-3b1c-42b8-9413-4db7f837fa52) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:19.527327 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dc9ba93-3b91-4023-a0ca-5fac9bb62732 None None] Pushing event updated for resources: {'Port': ['ID=fa3ed53c-9d43-4ea3-b780-2ad74f003fed,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:19.544156 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f56f1e8d-4b6d-451a-a6f3-42120c90c40d req-3e663112-8e30-4865-a3df-cb77bd945aa5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:19.546104 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f56f1e8d-4b6d-451a-a6f3-42120c90c40d req-3e663112-8e30-4865-a3df-cb77bd945aa5 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=9c94e7dc-d679-4a7e-b264-6d619dbc935e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1478221 Nov 09 04:31:19.553532 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-97c1d40c-0373-4a35-a005-35d012e5aa71 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:19.554530 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-97c1d40c-0373-4a35-a005-35d012e5aa71 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:19.562530 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0a684e09-2cae-4aba-ad0a-6072a196dcd0 None None] Network 03811c18-3b1c-42b8-9413-4db7f837fa52 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:19.563433 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-8e956ed3-403a-40d5-b3da-daaeb00599b8 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "GET /v2.0/subnets?network_id=2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 HTTP/1.1" status: 200 len: 207 time: 0.0549622 Nov 09 04:31:19.565395 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55300) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:19.585707 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port cacdee0a-4fb3-484e-936f-fbc190a2cb37 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:19.586076 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:19.597696 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-088fc49d-4b15-4c16-bcde-2c713a8453be tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Allocated IP 172.20.0.27 (472e0931-6be9-4332-83a6-c65cb3b98b7d/853593ba-982b-48a1-b01d-006ead90d6dd/9e44f1ae-891b-4a24-90bf-230a42b37820) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:31:19.651299 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4bd6ff4-3845-47a9-a337-6446cead365f req-f56a2e4b-9c33-4726-9880-dd2fdcc85eb7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:19.652828 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a4bd6ff4-3845-47a9-a337-6446cead365f req-f56a2e4b-9c33-4726-9880-dd2fdcc85eb7 service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 1098 time: 0.2499497 Nov 09 04:31:19.711233 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3741a81c-c87e-4157-97cf-089ae81f4379 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:19.724665 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-eaf9cb82-fc9e-41d0-bda5-dc9fd737bd0a None None] Deleting port cacdee0a-4fb3-484e-936f-fbc190a2cb37 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:31:19.725035 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-eaf9cb82-fc9e-41d0-bda5-dc9fd737bd0a None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:19.751131 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-97c1d40c-0373-4a35-a005-35d012e5aa71 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 2.8969195 Nov 09 04:31:19.760632 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55302) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:19.769345 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-eeeae3c7-a8cf-4211-9a44-0ba0c431857b tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Request body: {'port': {'network_id': '03811c18-3b1c-42b8-9413-4db7f837fa52', 'name': 'tempest-NetworksIpV6TestAttrs-155118375'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:19.777423 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2ee16f9b-a300-4ffc-a90c-fbe2dee119c5 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:19.798161 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-2c6b7995-87b9-4747-b753-6c3e64bd36e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:19.813152 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3741a81c-c87e-4157-97cf-089ae81f4379 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:31:19.824262 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a4bd6ff4-3845-47a9-a337-6446cead365f req-f88cdc81-1033-46b4-b360-b2a71c98cd50 service neutron] 10.222.0.26 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1619370 Nov 09 04:31:19.831335 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-3741a81c-c87e-4157-97cf-089ae81f4379 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:19.859151 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3741a81c-c87e-4157-97cf-089ae81f4379 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:19.859767 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3741a81c-c87e-4157-97cf-089ae81f4379 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:19.913106 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-78f675a4-d2df-4cf6-be72-bb9ffc2ffaa3 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:19.916761 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3741a81c-c87e-4157-97cf-089ae81f4379 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Subnet': ['ID=f87f05fc-e7ae-49d9-a997-c37a6526719b,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:19.919725 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-78f675a4-d2df-4cf6-be72-bb9ffc2ffaa3 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:19.925637 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6d9949be-1e22-4595-8680-5a8073cacd76 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:19.928748 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-78f675a4-d2df-4cf6-be72-bb9ffc2ffaa3 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:19.935818 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-78f675a4-d2df-4cf6-be72-bb9ffc2ffaa3 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:19.936046 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-088fc49d-4b15-4c16-bcde-2c713a8453be tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:19.940136 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:19.941326 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-78f675a4-d2df-4cf6-be72-bb9ffc2ffaa3 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "GET /v2.0/networks HTTP/1.1" status: 200 len: 2486 time: 0.3697445 Nov 09 04:31:19.944455 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55304) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:19.955596 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-2c6b7995-87b9-4747-b753-6c3e64bd36e6 None None] For port cacdee0a-4fb3-484e-936f-fbc190a2cb37, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=cacdee0a-4fb3-484e-936f-fbc190a2cb37,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:31:19.964209 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f56f1e8d-4b6d-451a-a6f3-42120c90c40d req-e9ec9d52-9974-4b36-88e0-a3d4fbe72232 service neutron] 10.222.0.26 "GET /v2.0/networks/9c94e7dc-d679-4a7e-b264-6d619dbc935e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3975317 Nov 09 04:31:19.977115 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-eaf9cb82-fc9e-41d0-bda5-dc9fd737bd0a None None] For port cacdee0a-4fb3-484e-936f-fbc190a2cb37, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=cacdee0a-4fb3-484e-936f-fbc190a2cb37,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:31:19.977526 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-eaf9cb82-fc9e-41d0-bda5-dc9fd737bd0a None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:20.016186 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d9949be-1e22-4595-8680-5a8073cacd76 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Pushing event deleted for resources: {'Port': ['ID=2ad7cfe1-e3b0-4322-8461-1f16258cb9f9,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:20.018299 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-eaf9cb82-fc9e-41d0-bda5-dc9fd737bd0a None None] Calling delete_port for cacdee0a-4fb3-484e-936f-fbc190a2cb37 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:31:20.021503 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2a990b0a-9939-4d82-9f94-d3eb36df34d5 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-03811c18-3b1c-42b8-9413-4db7f837fa52', 'network_id': '03811c18-3b1c-42b8-9413-4db7f837fa52', 'tenant_id': '6acf678d74da4512a431e262bbd32037', 'fixed_ips': [{'subnet_id': 'd464265c-8221-4b17-812a-e1630fa487e5'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:31:20.022082 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-088fc49d-4b15-4c16-bcde-2c713a8453be tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:20.022353 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-2a990b0a-9939-4d82-9f94-d3eb36df34d5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:20.039391 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-2c6b7995-87b9-4747-b753-6c3e64bd36e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:20.214392 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-3741a81c-c87e-4157-97cf-089ae81f4379 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 2.2779462 Nov 09 04:31:20.218449 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55310) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:20.246446 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-ed8edb37-273f-461c-ad7d-0f7ac07b9360 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'port': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'name': 'tempest-NetworksTestDHCPv6-254661197'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:20.250326 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.db.api [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=102163) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:31:20.250856 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG oslo_db.api [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:31:20.265668 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-80155236-593a-424f-bcbc-79411e6a7c98 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "GET /v2.0/networks?fields=id&fields=name&fields=mtu HTTP/1.1" status: 200 len: 575 time: 0.3153179 Nov 09 04:31:20.265874 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c6b7995-87b9-4747-b753-6c3e64bd36e6 None None] Pushing event updated for resources: {'Port': ['ID=cacdee0a-4fb3-484e-936f-fbc190a2cb37,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:20.278580 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2ee16f9b-a300-4ffc-a90c-fbe2dee119c5 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:20.285263 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55312) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:20.302934 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-088fc49d-4b15-4c16-bcde-2c713a8453be tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event updated for resources: {'Port': ['ID=9e44f1ae-891b-4a24-90bf-230a42b37820,revision_number=3']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:20.378714 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6d9949be-1e22-4595-8680-5a8073cacd76 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-466373'] for router_gateway, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:20.387474 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-eeeae3c7-a8cf-4211-9a44-0ba0c431857b tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Made reservation on behalf of 6acf678d74da4512a431e262bbd32037 for: {'port': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:20.388045 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-2a990b0a-9939-4d82-9f94-d3eb36df34d5 None None] Allocated IP 2001:db8::f816:3eff:fe5e:61d5 (03811c18-3b1c-42b8-9413-4db7f837fa52/d464265c-8221-4b17-812a-e1630fa487e5/354045bc-3baa-405c-8e61-0c526ba2160d) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:31:20.391826 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-eeeae3c7-a8cf-4211-9a44-0ba0c431857b tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:20.452630 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [None req-eeeae3c7-a8cf-4211-9a44-0ba0c431857b tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] device_id is not set on port a098c58e-5d4e-419f-93a6-52f36149fdfb yet. {{(pid=102161) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:31:20.461081 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f56f1e8d-4b6d-451a-a6f3-42120c90c40d req-ee293d22-41f5-4f2b-8954-5eae96433ff7 service neutron] 10.222.0.26 "GET /v2.0/networks/9c94e7dc-d679-4a7e-b264-6d619dbc935e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3844094 Nov 09 04:31:20.461620 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ee16f9b-a300-4ffc-a90c-fbe2dee119c5 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event updated for resources: {'Port': ['ID=f3596fb5-0eb8-49ea-acb9-6ea4bc4b920e,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:20.464160 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b907bfb-9857-4339-81a0-ecb18bcb35b2 req-778bbfe4-79ac-4cf3-9397-2fc5ae19d18b tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:20.480847 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7b907bfb-9857-4339-81a0-ecb18bcb35b2 req-778bbfe4-79ac-4cf3-9397-2fc5ae19d18b tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/ports?device_id=9c4e58e3-39e4-4212-b106-50b44d4c4e28 HTTP/1.1" status: 200 len: 943 time: 0.3848333 Nov 09 04:31:20.481055 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2ee16f9b-a300-4ffc-a90c-fbe2dee119c5 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Network 6e2848bc-b428-4045-8127-510baced6460 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:31:20.481329 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-eaf9cb82-fc9e-41d0-bda5-dc9fd737bd0a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:20.481494 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-088fc49d-4b15-4c16-bcde-2c713a8453be tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] In _notify_port_updated(), no bound segment for port 9e44f1ae-891b-4a24-90bf-230a42b37820 on network 472e0931-6be9-4332-83a6-c65cb3b98b7d {{(pid=102162) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 09 04:31:20.490838 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-088fc49d-4b15-4c16-bcde-2c713a8453be tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:20.491751 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-088fc49d-4b15-4c16-bcde-2c713a8453be tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:20.494780 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-088fc49d-4b15-4c16-bcde-2c713a8453be tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "PUT /v2.0/ports/9e44f1ae-891b-4a24-90bf-230a42b37820 HTTP/1.1" status: 200 len: 1000 time: 2.8969634 Nov 09 04:31:20.499316 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-2ee16f9b-a300-4ffc-a90c-fbe2dee119c5 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:20.501081 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55314) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:20.535912 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eaf9cb82-fc9e-41d0-bda5-dc9fd737bd0a None None] No DVR routers for this DVR port cacdee0a-4fb3-484e-936f-fbc190a2cb37 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:31:20.539323 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eaf9cb82-fc9e-41d0-bda5-dc9fd737bd0a None None] Pushing event deleted for resources: {'Port': ['ID=cacdee0a-4fb3-484e-936f-fbc190a2cb37,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:20.573063 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4e6a94fe-f25e-49bb-a5a4-d74fc3482af2 None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:20.589026 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6d9949be-1e22-4595-8680-5a8073cacd76 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:20.595089 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6d9949be-1e22-4595-8680-5a8073cacd76 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:20.595280 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2ee16f9b-a300-4ffc-a90c-fbe2dee119c5 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:31:20.602428 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-19bcdf21-45c1-48b2-9da5-d317a36988e1 None None] Provisioning complete for port 9e44f1ae-891b-4a24-90bf-230a42b37820 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:20.602808 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-19bcdf21-45c1-48b2-9da5-d317a36988e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:20.676167 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7b907bfb-9857-4339-81a0-ecb18bcb35b2 req-c409c6cc-e93a-4e9e-9280-b547203ffe13 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/security-groups?id=4ff68177-77d2-4250-b11c-4d5b55fd3619&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1447999 Nov 09 04:31:20.703955 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0f2c5872-0dcd-4d69-b8b7-5a05525ada3b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:20.703955 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0f2c5872-0dcd-4d69-b8b7-5a05525ada3b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:20.703955 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-0f2c5872-0dcd-4d69-b8b7-5a05525ada3b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1446 time: 0.3780832 Nov 09 04:31:20.707370 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55316) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:20.744501 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-19bcdf21-45c1-48b2-9da5-d317a36988e1 None None] Port 9e44f1ae-891b-4a24-90bf-230a42b37820 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:31:20.754643 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35317531-5b3d-4ddd-a397-12be26a59c4e req-c0704ec3-eea7-4841-b5b9-57944a0d27d2 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:20.755851 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-35317531-5b3d-4ddd-a397-12be26a59c4e req-c0704ec3-eea7-4841-b5b9-57944a0d27d2 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 945 time: 0.4921649 Nov 09 04:31:20.757099 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-2a990b0a-9939-4d82-9f94-d3eb36df34d5 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:20.766185 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6d9949be-1e22-4595-8680-5a8073cacd76 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:20.766824 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6d9949be-1e22-4595-8680-5a8073cacd76 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Fanout notify agent at l3_agent the message router_deleted on router 59f4ff39-f644-4f83-8a3a-2a6f1674e434 {{(pid=102162) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:31:20.774583 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6d9949be-1e22-4595-8680-5a8073cacd76 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:20.775589 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-6d9949be-1e22-4595-8680-5a8073cacd76 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] 10.222.0.24 "DELETE /v2.0/routers/59f4ff39-f644-4f83-8a3a-2a6f1674e434 HTTP/1.1" status: 204 len: 168 time: 4.0770438 Nov 09 04:31:20.784345 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55318) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:20.790313 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-1f89a04b-0193-4223-836e-0ffe6a05bcc2 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Request body: {'router': {'name': 'tempest-RoutersAdminTest-router-936709201', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:20.805220 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Port cacdee0a-4fb3-484e-936f-fbc190a2cb37 update to ACTIVE by agent not found {{(pid=102163) update_port_statuses /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2167}} Nov 09 04:31:20.812455 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1c8ffa26-321e-481d-9457-bf7808a8b081 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Attributes excluded by policy engine: ['shared'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:20.815688 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1c8ffa26-321e-481d-9457-bf7808a8b081 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Attributes excluded by policy engine: ['shared'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:20.820981 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-1c8ffa26-321e-481d-9457-bf7808a8b081 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "GET /v2.0/subnets?fields=id&fields=network_id HTTP/1.1" status: 200 len: 403 time: 0.1090069 Nov 09 04:31:20.820981 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ed8edb37-273f-461c-ad7d-0f7ac07b9360 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:20.828831 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ed8edb37-273f-461c-ad7d-0f7ac07b9360 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:20.835889 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55320) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:20.855864 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [None req-ed8edb37-273f-461c-ad7d-0f7ac07b9360 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] device_id is not set on port 2c47b2ed-7da9-4d5e-b302-869d6b6e0fb5 yet. {{(pid=102162) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:31:20.871996 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2ee16f9b-a300-4ffc-a90c-fbe2dee119c5 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:20.871996 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2ee16f9b-a300-4ffc-a90c-fbe2dee119c5 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:20.915623 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-2a990b0a-9939-4d82-9f94-d3eb36df34d5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:20.938706 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1f89a04b-0193-4223-836e-0ffe6a05bcc2 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:20.939932 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1f89a04b-0193-4223-836e-0ffe6a05bcc2 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:20.964970 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 7086c1a6-ddfa-4612-9396-d70dbb558c5c no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:31:20.993264 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a990b0a-9939-4d82-9f94-d3eb36df34d5 None None] Pushing event updated for resources: {'Port': ['ID=354045bc-3baa-405c-8e61-0c526ba2160d,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:21.002389 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 7086c1a6-ddfa-4612-9396-d70dbb558c5c {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:31:21.002719 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 7086c1a6-ddfa-4612-9396-d70dbb558c5c not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:31:21.006885 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d95f060e-c5a9-430f-af16-06810faba960 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-988d2354-693c-4d52-af17-25e0643eaa0c', 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'tenant_id': '8b0758f781884982bf5b94e6609237f6', 'fixed_ips': [{'subnet_id': 'f87f05fc-e7ae-49d9-a997-c37a6526719b'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:31:21.007779 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d95f060e-c5a9-430f-af16-06810faba960 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:21.052572 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1f89a04b-0193-4223-836e-0ffe6a05bcc2 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:21.079601 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-ed8edb37-273f-461c-ad7d-0f7ac07b9360 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Allocated IP 2001:db8::314 (988d2354-693c-4d52-af17-25e0643eaa0c/f87f05fc-e7ae-49d9-a997-c37a6526719b/2c47b2ed-7da9-4d5e-b302-869d6b6e0fb5) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:31:21.098974 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-eeeae3c7-a8cf-4211-9a44-0ba0c431857b tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Allocated IP 2001:db8::f816:3eff:fe1a:c0fa (03811c18-3b1c-42b8-9413-4db7f837fa52/d464265c-8221-4b17-812a-e1630fa487e5/a098c58e-5d4e-419f-93a6-52f36149fdfb) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:31:21.124434 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7fe0226-86a7-4672-a011-97b36cc024e8 req-76153a58-7d5c-4e0e-b82f-ea566ce41f05 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:21.126021 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-a7fe0226-86a7-4672-a011-97b36cc024e8 req-76153a58-7d5c-4e0e-b82f-ea566ce41f05 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=fd7df27e425449dfb80d0838c8f7fb89&device_id=9c4e58e3-39e4-4212-b106-50b44d4c4e28 HTTP/1.1" status: 200 len: 1096 time: 0.5071099 Nov 09 04:31:21.126238 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2a990b0a-9939-4d82-9f94-d3eb36df34d5 None None] Network 03811c18-3b1c-42b8-9413-4db7f837fa52 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:31:21.129375 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-2a990b0a-9939-4d82-9f94-d3eb36df34d5 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:21.135969 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1f89a04b-0193-4223-836e-0ffe6a05bcc2 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:21.143352 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-2ee16f9b-a300-4ffc-a90c-fbe2dee119c5 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 921 time: 3.4958012 Nov 09 04:31:21.159009 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2a990b0a-9939-4d82-9f94-d3eb36df34d5 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:31:21.159216 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55322) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:21.207582 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-35317531-5b3d-4ddd-a397-12be26a59c4e req-e62c00bf-6602-4f0f-8f04-dc51c690f3d7 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4042754 Nov 09 04:31:21.225907 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-2a990b0a-9939-4d82-9f94-d3eb36df34d5 None None] Attempting to bind port 354045bc-3baa-405c-8e61-0c526ba2160d on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:31:21.226697 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-2a990b0a-9939-4d82-9f94-d3eb36df34d5 None None] Attempting to bind port 354045bc-3baa-405c-8e61-0c526ba2160d by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'b769ba14-e21e-411b-82e2-2dd33164c868', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 331, 'network_id': '03811c18-3b1c-42b8-9413-4db7f837fa52'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:31:21.227428 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2a990b0a-9939-4d82-9f94-d3eb36df34d5 None None] Attempting to bind port 354045bc-3baa-405c-8e61-0c526ba2160d on network 03811c18-3b1c-42b8-9413-4db7f837fa52 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:31:21.241184 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2a990b0a-9939-4d82-9f94-d3eb36df34d5 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 31, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:31:21.241548 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2a990b0a-9939-4d82-9f94-d3eb36df34d5 None None] Checking segment: {'id': 'b769ba14-e21e-411b-82e2-2dd33164c868', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 331, 'network_id': '03811c18-3b1c-42b8-9413-4db7f837fa52'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:31:21.241894 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-2a990b0a-9939-4d82-9f94-d3eb36df34d5 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:21.242311 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2a990b0a-9939-4d82-9f94-d3eb36df34d5 None None] Bound using segment: {'id': 'b769ba14-e21e-411b-82e2-2dd33164c868', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 331, 'network_id': '03811c18-3b1c-42b8-9413-4db7f837fa52'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:31:21.245042 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-2a990b0a-9939-4d82-9f94-d3eb36df34d5 None None] Bound port: 354045bc-3baa-405c-8e61-0c526ba2160d, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b769ba14-e21e-411b-82e2-2dd33164c868', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 331, 'network_id': '03811c18-3b1c-42b8-9413-4db7f837fa52'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:31:21.245442 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-2a990b0a-9939-4d82-9f94-d3eb36df34d5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:21.268114 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-04e886c3-107d-4bd5-838b-1c0ec60458b7 None None] Network 6e2848bc-b428-4045-8127-510baced6460 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:21.288137 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device fa3ed53c-9d43-4ea3-b780-2ad74f003fed up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:31:21.296570 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-33bb60a7-d720-4b17-b4a7-8fc3c8160f24 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Deleting port 9e44f1ae-891b-4a24-90bf-230a42b37820 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:31:21.296909 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-33bb60a7-d720-4b17-b4a7-8fc3c8160f24 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:21.382744 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1f89a04b-0193-4223-836e-0ffe6a05bcc2 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:21.383934 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-1f89a04b-0193-4223-836e-0ffe6a05bcc2 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 704 time: 0.5986347 Nov 09 04:31:21.394888 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55324) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:21.408949 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-44827251-eebb-4e60-b653-399cd1440183 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'enable_snat': False}}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:21.431943 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fd9fb433-d575-419a-a68c-773ec6e13473 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:21.438460 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-fd9fb433-d575-419a-a68c-773ec6e13473 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "GET /v2.0/networks/3669a9e4-d853-4e8c-90ad-c544516ed2c5 HTTP/1.1" status: 200 len: 800 time: 0.5958424 Nov 09 04:31:21.438664 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55326) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:21.565391 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-9b90f115-ed49-463c-bb0e-4949892f3ee2 None None] Provisioning complete for port fa3ed53c-9d43-4ea3-b780-2ad74f003fed triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:21.565776 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9b90f115-ed49-463c-bb0e-4949892f3ee2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:21.577526 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7fe0226-86a7-4672-a011-97b36cc024e8 req-d791dbdc-ea68-4f6a-9482-edb73e316c2f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:21.579075 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-a7fe0226-86a7-4672-a011-97b36cc024e8 req-d791dbdc-ea68-4f6a-9482-edb73e316c2f service neutron] 10.222.0.26 "GET /v2.0/networks?id=9c94e7dc-d679-4a7e-b264-6d619dbc935e HTTP/1.1" status: 200 len: 898 time: 0.4286363 Nov 09 04:31:21.604651 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-33bb60a7-d720-4b17-b4a7-8fc3c8160f24 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:21.643518 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-2a990b0a-9939-4d82-9f94-d3eb36df34d5 None None] For port 354045bc-3baa-405c-8e61-0c526ba2160d, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:31:21.663542 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-2a990b0a-9939-4d82-9f94-d3eb36df34d5 None None] For port 354045bc-3baa-405c-8e61-0c526ba2160d, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=354045bc-3baa-405c-8e61-0c526ba2160d,segment=NetworkSegment(b769ba14-e21e-411b-82e2-2dd33164c868),segment_id=b769ba14-e21e-411b-82e2-2dd33164c868)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:31:21.698136 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port fa3ed53c-9d43-4ea3-b780-2ad74f003fed triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:21.698605 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:21.735515 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-a7fe0226-86a7-4672-a011-97b36cc024e8 req-acc13f96-e46f-4689-af35-0d5fd0c52f57 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=9c023fad-c8fa-4120-b9cc-4ea22c1718e4 HTTP/1.1" status: 200 len: 217 time: 0.1425147 Nov 09 04:31:21.736524 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-33bb60a7-d720-4b17-b4a7-8fc3c8160f24 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Calling delete_port for 9e44f1ae-891b-4a24-90bf-230a42b37820 owned by {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:31:21.772874 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-2a990b0a-9939-4d82-9f94-d3eb36df34d5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:21.938845 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9b90f115-ed49-463c-bb0e-4949892f3ee2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:21.942574 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ed8edb37-273f-461c-ad7d-0f7ac07b9360 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:21.970224 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a990b0a-9939-4d82-9f94-d3eb36df34d5 None None] Pushing event updated for resources: {'Port': ['ID=354045bc-3baa-405c-8e61-0c526ba2160d,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:22.017524 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:22.023966 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-9b90f115-ed49-463c-bb0e-4949892f3ee2 None None] For port fa3ed53c-9d43-4ea3-b780-2ad74f003fed, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=fa3ed53c-9d43-4ea3-b780-2ad74f003fed,segment=NetworkSegment(ab066ae5-0f1f-4c66-aa12-5d1f0c9bbe81),segment_id=ab066ae5-0f1f-4c66-aa12-5d1f0c9bbe81)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:31:22.034532 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-946bfd35-6ad4-4c5d-ade8-8e16d3a9f7dd tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "GET /v2.0/networks/3669a9e4-d853-4e8c-90ad-c544516ed2c5?fields=id&fields=name&fields=mtu HTTP/1.1" status: 200 len: 316 time: 0.5957336 Nov 09 04:31:22.037914 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55330) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:22.095205 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9b90f115-ed49-463c-bb0e-4949892f3ee2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:22.133218 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7eade622-b3e2-431a-87aa-4cf4a15bb2e6 req-4c6b4131-4e5b-42f9-82c4-52843b26408b tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:22.134813 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7eade622-b3e2-431a-87aa-4cf4a15bb2e6 req-4c6b4131-4e5b-42f9-82c4-52843b26408b tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/ports?device_id=9c4e58e3-39e4-4212-b106-50b44d4c4e28 HTTP/1.1" status: 200 len: 943 time: 0.1881964 Nov 09 04:31:22.138710 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ed8edb37-273f-461c-ad7d-0f7ac07b9360 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:22.142758 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-66ea9979-b671-4d51-84a9-0cbbde30b85d tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:22.166822 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1458b851-bd71-4bd6-94df-bc58f090652b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:22.168187 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-1458b851-bd71-4bd6-94df-bc58f090652b tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "GET /v2.0/subnets/366772a4-c45a-4129-af01-4f834e98308c HTTP/1.1" status: 200 len: 811 time: 0.1274586 Nov 09 04:31:22.210905 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b90f115-ed49-463c-bb0e-4949892f3ee2 None None] Pushing event updated for resources: {'Port': ['ID=fa3ed53c-9d43-4ea3-b780-2ad74f003fed,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:22.216557 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55332) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:22.221246 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-eeeae3c7-a8cf-4211-9a44-0ba0c431857b tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:22.258185 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7fe0226-86a7-4672-a011-97b36cc024e8 req-311ce3a4-6464-4322-b970-2f69dcb907b4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:22.259890 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-a7fe0226-86a7-4672-a011-97b36cc024e8 req-311ce3a4-6464-4322-b970-2f69dcb907b4 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=003822ea-7d1a-41fa-a15f-16fc8c9f624c HTTP/1.1" status: 200 len: 834 time: 0.5127673 Nov 09 04:31:22.302142 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ed8edb37-273f-461c-ad7d-0f7ac07b9360 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:31:22.339681 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.db.api [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=102163) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:31:22.340552 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG oslo_db.api [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:31:22.348743 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-d95f060e-c5a9-430f-af16-06810faba960 None None] Allocated IP 2001:db8::2 (988d2354-693c-4d52-af17-25e0643eaa0c/f87f05fc-e7ae-49d9-a997-c37a6526719b/04db5523-e7ce-41ee-bfbf-a776db27700f) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:31:22.374577 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-ed8edb37-273f-461c-ad7d-0f7ac07b9360 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:22.382744 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed8edb37-273f-461c-ad7d-0f7ac07b9360 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Port': ['ID=2c47b2ed-7da9-4d5e-b302-869d6b6e0fb5,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:22.403301 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ed8edb37-273f-461c-ad7d-0f7ac07b9360 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:31:22.407265 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ed8edb37-273f-461c-ad7d-0f7ac07b9360 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:22.408065 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ed8edb37-273f-461c-ad7d-0f7ac07b9360 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:22.421812 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-44827251-eebb-4e60-b653-399cd1440183 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:22.432694 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e7bddd0c-b732-4c92-b436-4c3581523345 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Attributes excluded by policy engine: ['shared'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:22.434124 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e7bddd0c-b732-4c92-b436-4c3581523345 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "GET /v2.0/subnets/366772a4-c45a-4129-af01-4f834e98308c?fields=id&fields=network_id HTTP/1.1" status: 200 len: 302 time: 0.2150946 Nov 09 04:31:22.438652 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7eade622-b3e2-431a-87aa-4cf4a15bb2e6 req-14883872-58df-43fa-bfa1-c9f5fc7343d2 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/security-groups?id=4ff68177-77d2-4250-b11c-4d5b55fd3619&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2909374 Nov 09 04:31:22.445592 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55336) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:22.456186 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-5caf1c24-e3d8-432a-ab23-2fe6e9281398 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-933771574'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:22.472318 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:31:22.556879 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-05f8ab77-022a-4156-a1c1-9005593cae0e None None] Provisioning complete for port f3596fb5-0eb8-49ea-acb9-6ea4bc4b920e triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:22.557884 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-05f8ab77-022a-4156-a1c1-9005593cae0e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:22.602811 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-ed8edb37-273f-461c-ad7d-0f7ac07b9360 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 931 time: 2.3656511 Nov 09 04:31:22.608308 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55338) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:22.616658 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7fe0226-86a7-4672-a011-97b36cc024e8 req-ef708fc4-6fc4-47a4-9e7a-20d5276cc6d6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:22.620232 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d95f060e-c5a9-430f-af16-06810faba960 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:22.622380 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-05f8ab77-022a-4156-a1c1-9005593cae0e None None] Port f3596fb5-0eb8-49ea-acb9-6ea4bc4b920e cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:31:22.623941 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-a7fe0226-86a7-4672-a011-97b36cc024e8 req-ef708fc4-6fc4-47a4-9e7a-20d5276cc6d6 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=9c94e7dc-d679-4a7e-b264-6d619dbc935e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.2558110 Nov 09 04:31:22.633787 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-05f8ab77-022a-4156-a1c1-9005593cae0e None None] Provisioning complete for port fa3ed53c-9d43-4ea3-b780-2ad74f003fed triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:22.634094 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-05f8ab77-022a-4156-a1c1-9005593cae0e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:22.646194 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dabb74f8-5750-4732-a858-ad24b0ad2d5f req-165cdbc7-1a49-46c2-88a1-a9a8e72da72e tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:22.648260 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-dabb74f8-5750-4732-a858-ad24b0ad2d5f req-165cdbc7-1a49-46c2-88a1-a9a8e72da72e tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 945 time: 0.2170603 Nov 09 04:31:22.710337 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d95f060e-c5a9-430f-af16-06810faba960 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:22.711110 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ac4a7c4a-2db6-434d-9c72-c91257d3b1e9 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:22.715376 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-ac4a7c4a-2db6-434d-9c72-c91257d3b1e9 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/ports HTTP/1.1" status: 200 len: 929 time: 0.1034520 Nov 09 04:31:22.716559 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55340) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:22.719138 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5caf1c24-e3d8-432a-ab23-2fe6e9281398 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Made reservation on behalf of 6761c80dbfa84798bb6517a9b532f870 for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:22.722608 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5caf1c24-e3d8-432a-ab23-2fe6e9281398 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:22.756364 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d95f060e-c5a9-430f-af16-06810faba960 None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:31:22.761468 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-d95f060e-c5a9-430f-af16-06810faba960 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:22.764579 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d95f060e-c5a9-430f-af16-06810faba960 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:31:22.786828 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-66ea9979-b671-4d51-84a9-0cbbde30b85d tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:22.793386 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-eeeae3c7-a8cf-4211-9a44-0ba0c431857b tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:22.824670 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5caf1c24-e3d8-432a-ab23-2fe6e9281398 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 348} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:31:22.838179 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5caf1c24-e3d8-432a-ab23-2fe6e9281398 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:22.838563 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-5caf1c24-e3d8-432a-ab23-2fe6e9281398 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Added segment 42483626-cfc4-4451-9541-bfe7f7bb69c1 of type vlan for network 25e3bbc0-5445-480c-91b2-4ec51922d90a Nov 09 04:31:22.852608 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d95f060e-c5a9-430f-af16-06810faba960 None None] Pushing event updated for resources: {'Port': ['ID=04db5523-e7ce-41ee-bfbf-a776db27700f,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:22.853312 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-66ea9979-b671-4d51-84a9-0cbbde30b85d tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:22.886741 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-d95f060e-c5a9-430f-af16-06810faba960 None None] Attempting to bind port 04db5523-e7ce-41ee-bfbf-a776db27700f on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:31:22.886940 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-d95f060e-c5a9-430f-af16-06810faba960 None None] Attempting to bind port 04db5523-e7ce-41ee-bfbf-a776db27700f by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:31:22.887325 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d95f060e-c5a9-430f-af16-06810faba960 None None] Attempting to bind port 04db5523-e7ce-41ee-bfbf-a776db27700f on network 988d2354-693c-4d52-af17-25e0643eaa0c {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:31:22.906185 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d95f060e-c5a9-430f-af16-06810faba960 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 31, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:31:22.906589 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d95f060e-c5a9-430f-af16-06810faba960 None None] Checking segment: {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:31:22.910334 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d95f060e-c5a9-430f-af16-06810faba960 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:22.910334 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d95f060e-c5a9-430f-af16-06810faba960 None None] Bound using segment: {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:31:22.910334 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-d95f060e-c5a9-430f-af16-06810faba960 None None] Bound port: 04db5523-e7ce-41ee-bfbf-a776db27700f, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:31:22.910334 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d95f060e-c5a9-430f-af16-06810faba960 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:22.960178 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5caf1c24-e3d8-432a-ab23-2fe6e9281398 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:22.972567 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eeeae3c7-a8cf-4211-9a44-0ba0c431857b tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Network 03811c18-3b1c-42b8-9413-4db7f837fa52 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:31:22.993682 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-567178af-c38f-4a0e-85d7-1f5bb598f3bc None None] Provisioning complete for port f3596fb5-0eb8-49ea-acb9-6ea4bc4b920e triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:22.994056 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-567178af-c38f-4a0e-85d7-1f5bb598f3bc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:23.030264 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-d95f060e-c5a9-430f-af16-06810faba960 None None] For port 04db5523-e7ce-41ee-bfbf-a776db27700f, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:31:23.037016 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eeeae3c7-a8cf-4211-9a44-0ba0c431857b tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Pushing event updated for resources: {'Port': ['ID=a098c58e-5d4e-419f-93a6-52f36149fdfb,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:23.039079 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-30e58be9-2d5e-4960-97db-ba882cadebab tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Deleting port 2c47b2ed-7da9-4d5e-b302-869d6b6e0fb5 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:31:23.039523 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-30e58be9-2d5e-4960-97db-ba882cadebab tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:23.044689 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-eeeae3c7-a8cf-4211-9a44-0ba0c431857b tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:23.051800 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-d95f060e-c5a9-430f-af16-06810faba960 None None] For port 04db5523-e7ce-41ee-bfbf-a776db27700f, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=04db5523-e7ce-41ee-bfbf-a776db27700f,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:31:23.057474 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-567178af-c38f-4a0e-85d7-1f5bb598f3bc None None] Port f3596fb5-0eb8-49ea-acb9-6ea4bc4b920e cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:31:23.074885 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66ea9979-b671-4d51-84a9-0cbbde30b85d tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event updated for resources: {'Port': ['ID=f3596fb5-0eb8-49ea-acb9-6ea4bc4b920e,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:23.087300 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 9c023fad-c8fa-4120-b9cc-4ea22c1718e4 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=102163) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 09 04:31:23.088522 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-a7fe0226-86a7-4672-a011-97b36cc024e8 req-a0141ef7-be9d-4f07-9043-7cb822a16aaa service neutron] 10.222.0.26 "GET /v2.0/networks/9c94e7dc-d679-4a7e-b264-6d619dbc935e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4389896 Nov 09 04:31:23.099263 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eeeae3c7-a8cf-4211-9a44-0ba0c431857b tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:31:23.108745 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eeeae3c7-a8cf-4211-9a44-0ba0c431857b tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:23.108745 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-eeeae3c7-a8cf-4211-9a44-0ba0c431857b tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:23.119847 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device cacdee0a-4fb3-484e-936f-fbc190a2cb37 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:31:23.122814 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-dabb74f8-5750-4732-a858-ad24b0ad2d5f req-217532de-ce9c-40e9-9a27-20e37fbe0d25 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4529526 Nov 09 04:31:23.150414 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: cacdee0a-4fb3-484e-936f-fbc190a2cb37 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:31:23.150693 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device cacdee0a-4fb3-484e-936f-fbc190a2cb37 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:31:23.177970 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d95f060e-c5a9-430f-af16-06810faba960 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:23.238883 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-30e58be9-2d5e-4960-97db-ba882cadebab tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:23.259538 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-30e58be9-2d5e-4960-97db-ba882cadebab tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Calling delete_port for 2c47b2ed-7da9-4d5e-b302-869d6b6e0fb5 owned by {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:31:23.307125 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5caf1c24-e3d8-432a-ab23-2fe6e9281398 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:23.325663 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5caf1c24-e3d8-432a-ab23-2fe6e9281398 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:23.327350 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5caf1c24-e3d8-432a-ab23-2fe6e9281398 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:23.334804 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-eeeae3c7-a8cf-4211-9a44-0ba0c431857b tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 950 time: 3.5673957 Nov 09 04:31:23.338383 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55344) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:23.425318 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d95f060e-c5a9-430f-af16-06810faba960 None None] Pushing event updated for resources: {'Port': ['ID=04db5523-e7ce-41ee-bfbf-a776db27700f,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:23.427989 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-33bb60a7-d720-4b17-b4a7-8fc3c8160f24 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:23.458284 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-5caf1c24-e3d8-432a-ab23-2fe6e9281398 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 779 time: 1.0094666 Nov 09 04:31:23.469492 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55346) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:23.480740 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 354045bc-3baa-405c-8e61-0c526ba2160d up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:31:23.511091 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-626090c3-c75a-4177-8b91-d351a2a6f84a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Request body: {'subnet': {'network_id': '25e3bbc0-5445-480c-91b2-4ec51922d90a', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'host_routes': [{'destination': '10.20.0.0/32', 'nexthop': '10.100.1.1'}], 'dns_nameservers': ['8.8.4.4', '8.8.8.8'], 'allocation_pools': [{'start': '172.20.0.3', 'end': '172.20.0.7'}]}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:23.516695 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33bb60a7-d720-4b17-b4a7-8fc3c8160f24 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event deleted for resources: {'Port': ['ID=9e44f1ae-891b-4a24-90bf-230a42b37820,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:23.536491 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-8421d1bb-d251-4947-b246-62bf03ce9fb5 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Deleting subnet d464265c-8221-4b17-812a-e1630fa487e5 {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:31:23.537894 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 9c023fad-c8fa-4120-b9cc-4ea22c1718e4, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=9c023fad-c8fa-4120-b9cc-4ea22c1718e4,segment=NetworkSegment(d5411e15-1506-4025-8472-ba7118358f68),segment_id=d5411e15-1506-4025-8472-ba7118358f68)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:31:23.544088 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-a7fe0226-86a7-4672-a011-97b36cc024e8 req-f4302f92-407c-4b5d-a5b4-9cd29cca482e service neutron] 10.222.0.26 "GET /v2.0/networks/9c94e7dc-d679-4a7e-b264-6d619dbc935e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4201679 Nov 09 04:31:23.547369 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8421d1bb-d251-4947-b246-62bf03ce9fb5 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:23.588584 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Returning: {'device': '9c023fad-c8fa-4120-b9cc-4ea22c1718e4', 'network_id': '9c94e7dc-d679-4a7e-b264-6d619dbc935e', 'port_id': '9c023fad-c8fa-4120-b9cc-4ea22c1718e4', 'mac_address': 'fa:16:3e:cd:a2:82', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 313, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '003822ea-7d1a-41fa-a15f-16fc8c9f624c', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102163) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 09 04:31:23.642575 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0a63c2f9-f82d-4d0b-a549-3c9fd23306ce None None] Network 03811c18-3b1c-42b8-9413-4db7f837fa52 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:23.644400 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-f39d8070-d03d-48e3-a1ba-ac68e80f4044 None None] Provisioning complete for port f3596fb5-0eb8-49ea-acb9-6ea4bc4b920e triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:23.644400 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f39d8070-d03d-48e3-a1ba-ac68e80f4044 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:23.745675 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 354045bc-3baa-405c-8e61-0c526ba2160d triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:23.746303 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:23.800595 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32b1a872-e5e4-4ca6-8846-787f935a365f req-ff8d9f54-80a0-4320-8dbf-4b57a844917b tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:23.807492 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-32b1a872-e5e4-4ca6-8846-787f935a365f req-ff8d9f54-80a0-4320-8dbf-4b57a844917b tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 945 time: 0.5434146 Nov 09 04:31:23.815425 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5caf1c24-e3d8-432a-ab23-2fe6e9281398 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event updated for resources: {'Network': ['ID=25e3bbc0-5445-480c-91b2-4ec51922d90a,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:23.845244 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 25e3bbc0-5445-480c-91b2-4ec51922d90a details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:31:23.860922 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55350) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:23.863499 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-66ea9979-b671-4d51-84a9-0cbbde30b85d tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:23.888793 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-964b4262-ba53-49c8-ae6c-e8564d27ba0e tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Request body: {'floatingip': {'port_id': '99ad1d96-b35b-4120-b5a9-c95c47bd3ffc'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:23.913155 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:23.952391 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-44827251-eebb-4e60-b653-399cd1440183 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:23.955626 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8421d1bb-d251-4947-b246-62bf03ce9fb5 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:23.961875 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-f39d8070-d03d-48e3-a1ba-ac68e80f4044 None None] Port f3596fb5-0eb8-49ea-acb9-6ea4bc4b920e cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:31:23.977876 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9c023fad-c8fa-4120-b9cc-4ea22c1718e4 {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:31:23.994174 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-964b4262-ba53-49c8-ae6c-e8564d27ba0e tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Publish callbacks [] for floatingip, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:24.014492 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-44827251-eebb-4e60-b653-399cd1440183 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:24.026914 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-33bb60a7-d720-4b17-b4a7-8fc3c8160f24 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:24.033768 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-33bb60a7-d720-4b17-b4a7-8fc3c8160f24 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "DELETE /v2.0/ports/9e44f1ae-891b-4a24-90bf-230a42b37820 HTTP/1.1" status: 204 len: 168 time: 3.5245156 Nov 09 04:31:24.042662 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 9c023fad-c8fa-4120-b9cc-4ea22c1718e4, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=9c023fad-c8fa-4120-b9cc-4ea22c1718e4,segment=NetworkSegment(d5411e15-1506-4025-8472-ba7118358f68),segment_id=d5411e15-1506-4025-8472-ba7118358f68)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:31:24.042856 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55352) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:24.069511 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f5656ef-4415-4112-83fd-ae96f50d8d7e req-b50e002a-6352-447a-a7af-21280b3912b0 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:24.071189 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-8f5656ef-4415-4112-83fd-ae96f50d8d7e req-b50e002a-6352-447a-a7af-21280b3912b0 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/ports?device_id=9c4e58e3-39e4-4212-b106-50b44d4c4e28 HTTP/1.1" status: 200 len: 943 time: 0.3571682 Nov 09 04:31:24.110792 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:24.129319 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-a0abae33-b388-4cbf-b9d4-54190fede2c9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] GET failed (client error): The resource could not be found. Nov 09 04:31:24.133799 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a0abae33-b388-4cbf-b9d4-54190fede2c9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "GET /v2.0/ports/9e44f1ae-891b-4a24-90bf-230a42b37820 HTTP/1.1" status: 404 len: 333 time: 0.0850275 Nov 09 04:31:24.141650 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55354) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:24.144709 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:24.152102 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-3aaf141c-a820-477c-aa9a-ca2900226ae7 None None] Provisioning complete for port 354045bc-3baa-405c-8e61-0c526ba2160d triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:24.152475 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3aaf141c-a820-477c-aa9a-ca2900226ae7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:24.183102 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-626090c3-c75a-4177-8b91-d351a2a6f84a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Made reservation on behalf of 6761c80dbfa84798bb6517a9b532f870 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:24.187221 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-626090c3-c75a-4177-8b91-d351a2a6f84a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:24.233905 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=9c023fad-c8fa-4120-b9cc-4ea22c1718e4,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:24.246291 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 354045bc-3baa-405c-8e61-0c526ba2160d, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=354045bc-3baa-405c-8e61-0c526ba2160d,segment=NetworkSegment(b769ba14-e21e-411b-82e2-2dd33164c868),segment_id=b769ba14-e21e-411b-82e2-2dd33164c868)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:31:24.300584 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3aaf141c-a820-477c-aa9a-ca2900226ae7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:24.313173 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:24.314185 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device fa3ed53c-9d43-4ea3-b780-2ad74f003fed up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:31:24.321302 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-30e58be9-2d5e-4960-97db-ba882cadebab tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:24.336393 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-a1b38389-b284-4ca9-978d-d0c6f3e466f0 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Deleting subnet 853593ba-982b-48a1-b01d-006ead90d6dd {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:31:24.337638 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.ipam_backend_mixin [None req-626090c3-c75a-4177-8b91-d351a2a6f84a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Performing IP validity checks on allocation pools {{(pid=102162) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:325}} Nov 09 04:31:24.338157 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.ipam_backend_mixin [None req-626090c3-c75a-4177-8b91-d351a2a6f84a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Checking for overlaps among allocation pools and gateway ip {{(pid=102162) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:346}} Nov 09 04:31:24.342172 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-8f5656ef-4415-4112-83fd-ae96f50d8d7e req-0bc25407-2651-4d1c-b329-8f885e65cbee tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/security-groups?id=4ff68177-77d2-4250-b11c-4d5b55fd3619&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2246826 Nov 09 04:31:24.353990 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a1b38389-b284-4ca9-978d-d0c6f3e466f0 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:24.366302 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['9c023fad-c8fa-4120-b9cc-4ea22c1718e4'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 04:31:24.376915 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-66ea9979-b671-4d51-84a9-0cbbde30b85d tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:24.392038 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30e58be9-2d5e-4960-97db-ba882cadebab tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event deleted for resources: {'Port': ['ID=2c47b2ed-7da9-4d5e-b302-869d6b6e0fb5,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:24.406604 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8421d1bb-d251-4947-b246-62bf03ce9fb5 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:24.436369 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-44827251-eebb-4e60-b653-399cd1440183 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Allocated IP 172.26.0.241 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/d780812c-40ad-4f61-ba29-63d923158ab4) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:31:24.479631 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a1b38389-b284-4ca9-978d-d0c6f3e466f0 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:24.490574 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=354045bc-3baa-405c-8e61-0c526ba2160d,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:24.505150 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-30e58be9-2d5e-4960-97db-ba882cadebab tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:24.509798 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-30e58be9-2d5e-4960-97db-ba882cadebab tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/ports/2c47b2ed-7da9-4d5e-b302-869d6b6e0fb5 HTTP/1.1" status: 204 len: 168 time: 1.7893884 Nov 09 04:31:24.509969 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port fa3ed53c-9d43-4ea3-b780-2ad74f003fed triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:24.509969 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:24.515193 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55356) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:24.677117 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3ee66066-ba6d-4c22-80cd-81228db1cd28 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:24.678868 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3ee66066-ba6d-4c22-80cd-81228db1cd28 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:24.680386 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-3ee66066-ba6d-4c22-80cd-81228db1cd28 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1464 time: 0.1667442 Nov 09 04:31:24.684874 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55358) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:24.743530 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8421d1bb-d251-4947-b246-62bf03ce9fb5 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:24.774841 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-44827251-eebb-4e60-b653-399cd1440183 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:24.789443 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a1b38389-b284-4ca9-978d-d0c6f3e466f0 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:24.797656 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.db.api [None req-3aaf141c-a820-477c-aa9a-ca2900226ae7 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=102163) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:31:24.798044 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG oslo_db.api [None req-3aaf141c-a820-477c-aa9a-ca2900226ae7 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:31:24.838590 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8421d1bb-d251-4947-b246-62bf03ce9fb5 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:24.845490 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-8421d1bb-d251-4947-b246-62bf03ce9fb5 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] 10.222.0.24 "DELETE /v2.0/subnets/d464265c-8221-4b17-812a-e1630fa487e5 HTTP/1.1" status: 204 len: 168 time: 1.5059624 Nov 09 04:31:24.847956 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55360) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:24.852916 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8421d1bb-d251-4947-b246-62bf03ce9fb5 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Pushing event deleted for resources: {'Subnet': ['ID=d464265c-8221-4b17-812a-e1630fa487e5,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:24.877521 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-71d29310-0035-4022-b19e-1ef2384f2b9e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Deleting subnet f87f05fc-e7ae-49d9-a997-c37a6526719b {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:31:24.916804 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-71d29310-0035-4022-b19e-1ef2384f2b9e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:25.011321 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-71d29310-0035-4022-b19e-1ef2384f2b9e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:25.019163 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-075513c3-09a0-4286-8f59-e4a74babb2ab tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:25.020912 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-075513c3-09a0-4286-8f59-e4a74babb2ab tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:25.025301 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55362) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:25.025822 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-075513c3-09a0-4286-8f59-e4a74babb2ab tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] 10.222.0.24 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1478 time: 0.1688743 Nov 09 04:31:25.113328 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a1b38389-b284-4ca9-978d-d0c6f3e466f0 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:25.151177 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-44827251-eebb-4e60-b653-399cd1440183 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:25.167244 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6dbeea59-f0cf-477a-b24b-8d323bd4f3bd None None] Network 03811c18-3b1c-42b8-9413-4db7f837fa52 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:25.175056 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-626090c3-c75a-4177-8b91-d351a2a6f84a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:25.208347 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1b38389-b284-4ca9-978d-d0c6f3e466f0 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event deleted for resources: {'Subnet': ['ID=853593ba-982b-48a1-b01d-006ead90d6dd,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:25.212347 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-71d29310-0035-4022-b19e-1ef2384f2b9e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:25.216219 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44827251-eebb-4e60-b653-399cd1440183 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Pushing event updated for resources: {'Port': ['ID=d780812c-40ad-4f61-ba29-63d923158ab4,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:25.238719 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a1b38389-b284-4ca9-978d-d0c6f3e466f0 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:25.245429 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a1b38389-b284-4ca9-978d-d0c6f3e466f0 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "DELETE /v2.0/subnets/853593ba-982b-48a1-b01d-006ead90d6dd HTTP/1.1" status: 204 len: 168 time: 1.0854836 Nov 09 04:31:25.251161 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55364) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:25.267395 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-44827251-eebb-4e60-b653-399cd1440183 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:31:25.271714 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c079ae2d-87b7-4cb9-a2fa-0f768b8ffd02 None None] Network 472e0931-6be9-4332-83a6-c65cb3b98b7d requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:25.276082 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-44827251-eebb-4e60-b653-399cd1440183 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:25.289366 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-08dfb91e-f49d-4cbe-b853-72ae604c1391 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:25.308680 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-44827251-eebb-4e60-b653-399cd1440183 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:31:25.324727 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-66ea9979-b671-4d51-84a9-0cbbde30b85d tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:25.365296 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-08dfb91e-f49d-4cbe-b853-72ae604c1391 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] DELETE failed (client error): There was a conflict when trying to complete your request. Nov 09 04:31:25.365669 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-08dfb91e-f49d-4cbe-b853-72ae604c1391 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] No notification will be sent due to unsuccessful status code: 409 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:31:25.370743 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-08dfb91e-f49d-4cbe-b853-72ae604c1391 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] 10.222.0.24 "DELETE /v2.0/networks/03811c18-3b1c-42b8-9413-4db7f837fa52 HTTP/1.1" status: 409 len: 405 time: 0.3403094 Nov 09 04:31:25.377472 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-626090c3-c75a-4177-8b91-d351a2a6f84a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event updated for resources: {'Subnet': ['ID=15dc27c4-9bd7-4408-a8a7-9496f35be828,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:25.380003 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55366) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:25.391832 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-a7e5bebc-6a81-47f3-9fb7-90141409d0fb tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Request body: {'network': {'name': 'tempest-NetworksIpV6TestAttrs-test-network-1765545656'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:25.467450 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-66ea9979-b671-4d51-84a9-0cbbde30b85d tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:25.538219 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-66ea9979-b671-4d51-84a9-0cbbde30b85d tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:25.541046 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a7e5bebc-6a81-47f3-9fb7-90141409d0fb tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Made reservation on behalf of 6acf678d74da4512a431e262bbd32037 for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:25.546738 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a7e5bebc-6a81-47f3-9fb7-90141409d0fb tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:25.569888 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 354045bc-3baa-405c-8e61-0c526ba2160d up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:31:25.642438 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a7e5bebc-6a81-47f3-9fb7-90141409d0fb tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 335} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:31:25.672744 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-626090c3-c75a-4177-8b91-d351a2a6f84a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Checking segment: {'id': '42483626-cfc4-4451-9541-bfe7f7bb69c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 348, 'network_id': '25e3bbc0-5445-480c-91b2-4ec51922d90a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:31:25.673195 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-626090c3-c75a-4177-8b91-d351a2a6f84a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Network hostable DHCP agents. Network: 25e3bbc0-5445-480c-91b2-4ec51922d90a, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:31:25.776237 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-66ea9979-b671-4d51-84a9-0cbbde30b85d tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Network 6e2848bc-b428-4045-8127-510baced6460 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:31:25.782825 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 354045bc-3baa-405c-8e61-0c526ba2160d triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:25.783190 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:25.785210 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-66ea9979-b671-4d51-84a9-0cbbde30b85d tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:25.796904 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a7e5bebc-6a81-47f3-9fb7-90141409d0fb tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:25.797378 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-a7e5bebc-6a81-47f3-9fb7-90141409d0fb tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Added segment 7425d687-add6-4065-ae0f-e86a77653f3b of type vlan for network 9009edec-59ad-46af-a520-e6c0852ebf0d Nov 09 04:31:25.802466 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-964b4262-ba53-49c8-ae6c-e8564d27ba0e tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:25.829805 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eeac906c-6d38-4016-b908-4348216fd778 req-2b6dd4cb-dcd6-45a4-a4a5-e8d54b7346eb tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:25.831667 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-eeac906c-6d38-4016-b908-4348216fd778 req-2b6dd4cb-dcd6-45a4-a4a5-e8d54b7346eb tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/ports?device_id=9c4e58e3-39e4-4212-b106-50b44d4c4e28 HTTP/1.1" status: 200 len: 944 time: 0.2667837 Nov 09 04:31:25.869041 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-253bac9c-db9c-4984-b124-2a92fb12e56f None None] Provisioning complete for port a098c58e-5d4e-419f-93a6-52f36149fdfb triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:25.869659 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-253bac9c-db9c-4984-b124-2a92fb12e56f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:25.882147 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-ce03030a-ee9f-422b-9c68-c1767f606efd tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Deleting subnet a38fa5e5-0ac0-4d69-8fb6-dcbb9f935dc1 {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:31:25.904755 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ce03030a-ee9f-422b-9c68-c1767f606efd tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:25.939391 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66ea9979-b671-4d51-84a9-0cbbde30b85d tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event updated for resources: {'Port': ['ID=f3596fb5-0eb8-49ea-acb9-6ea4bc4b920e,revision_number=3']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:25.942927 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-253bac9c-db9c-4984-b124-2a92fb12e56f None None] Port a098c58e-5d4e-419f-93a6-52f36149fdfb cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:31:25.969608 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-253bac9c-db9c-4984-b124-2a92fb12e56f None None] Could not find standard attr ID for object 2c47b2ed-7da9-4d5e-b302-869d6b6e0fb5. {{(pid=102163) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 09 04:31:25.978036 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-626090c3-c75a-4177-8b91-d351a2a6f84a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Network 25e3bbc0-5445-480c-91b2-4ec51922d90a is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:31:25.992534 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-253bac9c-db9c-4984-b124-2a92fb12e56f None None] Could not find standard attr ID for object ee6eccfd-1357-4b13-bf25-4d1cef0fd60e. {{(pid=102163) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 09 04:31:25.998601 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c73cc4ea-16ca-4caa-897e-eebb73199a36 None None] DHCP port deletion for 03811c18-3b1c-42b8-9413-4db7f837fa52 request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:31:26.006812 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 04db5523-e7ce-41ee-bfbf-a776db27700f up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:31:26.048768 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-964b4262-ba53-49c8-ae6c-e8564d27ba0e tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:26.055278 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-71d29310-0035-4022-b19e-1ef2384f2b9e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:26.073821 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-253bac9c-db9c-4984-b124-2a92fb12e56f None None] Provisioning complete for port 04db5523-e7ce-41ee-bfbf-a776db27700f triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:26.074183 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-253bac9c-db9c-4984-b124-2a92fb12e56f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:26.090896 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ce03030a-ee9f-422b-9c68-c1767f606efd tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:26.100931 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-71d29310-0035-4022-b19e-1ef2384f2b9e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:26.109760 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-71d29310-0035-4022-b19e-1ef2384f2b9e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/f87f05fc-e7ae-49d9-a997-c37a6526719b HTTP/1.1" status: 204 len: 168 time: 1.4198995 Nov 09 04:31:26.152297 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-c73cc4ea-16ca-4caa-897e-eebb73199a36 None None] Deleting port 354045bc-3baa-405c-8e61-0c526ba2160d {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:31:26.152645 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c73cc4ea-16ca-4caa-897e-eebb73199a36 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:26.155640 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 04db5523-e7ce-41ee-bfbf-a776db27700f triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:26.155998 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:26.159838 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55370) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:26.253073 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-9110a7d5-d243-4835-85ea-81308453a73c tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0919571 Nov 09 04:31:26.253703 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55372) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:26.262641 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-0703ad1a-7ecd-48ba-a1a2-1da4b5592023 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'subnet': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:26.269768 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71d29310-0035-4022-b19e-1ef2384f2b9e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event deleted for resources: {'Subnet': ['ID=f87f05fc-e7ae-49d9-a997-c37a6526719b,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:26.318749 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a2f63e9d-e77a-4c9c-9ece-523bf98cd84d None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:26.372745 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-c73cc4ea-16ca-4caa-897e-eebb73199a36 None None] For port 354045bc-3baa-405c-8e61-0c526ba2160d, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=354045bc-3baa-405c-8e61-0c526ba2160d,segment=NetworkSegment(b769ba14-e21e-411b-82e2-2dd33164c868),segment_id=b769ba14-e21e-411b-82e2-2dd33164c868)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:31:26.373228 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c73cc4ea-16ca-4caa-897e-eebb73199a36 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:26.396102 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-c73cc4ea-16ca-4caa-897e-eebb73199a36 None None] Calling delete_port for 354045bc-3baa-405c-8e61-0c526ba2160d owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:31:26.414036 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-253bac9c-db9c-4984-b124-2a92fb12e56f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:26.426024 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-44827251-eebb-4e60-b653-399cd1440183 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:26.500301 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ce03030a-ee9f-422b-9c68-c1767f606efd tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:26.510259 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a7e5bebc-6a81-47f3-9fb7-90141409d0fb tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:26.564517 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-253bac9c-db9c-4984-b124-2a92fb12e56f None None] For port 04db5523-e7ce-41ee-bfbf-a776db27700f, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=04db5523-e7ce-41ee-bfbf-a776db27700f,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:31:26.604987 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:26.638469 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-253bac9c-db9c-4984-b124-2a92fb12e56f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:26.706177 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-44827251-eebb-4e60-b653-399cd1440183 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-466202', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-464271', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-936'] for router, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:26.712076 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-44827251-eebb-4e60-b653-399cd1440183 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-466195', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-466408', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-464260'] for router, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:26.718934 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0703ad1a-7ecd-48ba-a1a2-1da4b5592023 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:26.722687 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0703ad1a-7ecd-48ba-a1a2-1da4b5592023 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:26.746629 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-253bac9c-db9c-4984-b124-2a92fb12e56f None None] Provisioning complete for port 354045bc-3baa-405c-8e61-0c526ba2160d triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:26.747067 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-253bac9c-db9c-4984-b124-2a92fb12e56f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:26.756886 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a7e5bebc-6a81-47f3-9fb7-90141409d0fb tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:26.759348 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-253bac9c-db9c-4984-b124-2a92fb12e56f None None] Pushing event updated for resources: {'Port': ['ID=04db5523-e7ce-41ee-bfbf-a776db27700f,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:26.775733 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a7e5bebc-6a81-47f3-9fb7-90141409d0fb tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:26.776570 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a7e5bebc-6a81-47f3-9fb7-90141409d0fb tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:26.782837 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c73cc4ea-16ca-4caa-897e-eebb73199a36 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:26.783063 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.l3_db [None req-964b4262-ba53-49c8-ae6c-e8564d27ba0e tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Floating IP a95b836b-fec6-4af9-8970-923ef2700539 associated. External IP: 172.26.0.108, port: 99ad1d96-b35b-4120-b5a9-c95c47bd3ffc. Nov 09 04:31:26.786858 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.db.api [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=102163) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:31:26.787204 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG oslo_db.api [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:31:26.808233 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ce03030a-ee9f-422b-9c68-c1767f606efd tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:26.828008 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c73cc4ea-16ca-4caa-897e-eebb73199a36 None None] No DVR routers for this DVR port 354045bc-3baa-405c-8e61-0c526ba2160d on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:31:26.832501 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c73cc4ea-16ca-4caa-897e-eebb73199a36 None None] Pushing event deleted for resources: {'Port': ['ID=354045bc-3baa-405c-8e61-0c526ba2160d,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:26.842815 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-253bac9c-db9c-4984-b124-2a92fb12e56f None None] Could not find standard attr ID for object 354045bc-3baa-405c-8e61-0c526ba2160d. {{(pid=102163) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 09 04:31:26.845347 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.plugins.ml2.db [None req-253bac9c-db9c-4984-b124-2a92fb12e56f None None] No ports have port_id starting with 354045bc-3baa-405c-8e61-0c526ba2160d Nov 09 04:31:26.863453 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-98bac1d2-5930-4aeb-ae54-5f82fd1a58a1 None None] DHCP port deletion for 988d2354-693c-4d52-af17-25e0643eaa0c request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:31:26.871668 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-626090c3-c75a-4177-8b91-d351a2a6f84a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 25e3bbc0-5445-480c-91b2-4ec51922d90a) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:26.905638 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c5c9e11e-009d-47db-b7e7-76c1c6df0c48 None None] Network 25e3bbc0-5445-480c-91b2-4ec51922d90a requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:26.907660 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-626090c3-c75a-4177-8b91-d351a2a6f84a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:26.908327 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-626090c3-c75a-4177-8b91-d351a2a6f84a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:26.924928 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce03030a-ee9f-422b-9c68-c1767f606efd tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event deleted for resources: {'Subnet': ['ID=a38fa5e5-0ac0-4d69-8fb6-dcbb9f935dc1,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:26.934850 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ce03030a-ee9f-422b-9c68-c1767f606efd tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:26.939266 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-ce03030a-ee9f-422b-9c68-c1767f606efd tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "DELETE /v2.0/subnets/a38fa5e5-0ac0-4d69-8fb6-dcbb9f935dc1 HTTP/1.1" status: 204 len: 168 time: 1.6865516 Nov 09 04:31:26.939418 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-eeac906c-6d38-4016-b908-4348216fd778 req-56715d79-a1f6-43b6-ad8d-8559a9aa0c8e tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/security-groups?id=4ff68177-77d2-4250-b11c-4d5b55fd3619&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 1.0922198 Nov 09 04:31:26.949674 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55374) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:26.965392 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7fc7ed17-2dca-4287-b2a3-426aefaaa7bd None None] Network 472e0931-6be9-4332-83a6-c65cb3b98b7d requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:27.026589 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a7e5bebc-6a81-47f3-9fb7-90141409d0fb tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 789 time: 1.6386967 Nov 09 04:31:27.029441 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55376) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:27.038035 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-322f740f-be09-4d51-ad35-fd85ea61a27e tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Request body: {'subnet': {'network_id': '9009edec-59ad-46af-a520-e6c0852ebf0d', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': None, 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:27.049428 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7e5bebc-6a81-47f3-9fb7-90141409d0fb tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Pushing event updated for resources: {'Network': ['ID=9009edec-59ad-46af-a520-e6c0852ebf0d,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:27.082448 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-626090c3-c75a-4177-8b91-d351a2a6f84a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 872 time: 3.5816483 Nov 09 04:31:27.088007 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55378) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:27.096145 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-7632fe93-22b9-4b56-a99a-b0922d7636df tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Request body: {'subnet': {'name': 'New_subnet', 'host_routes': [{'destination': '10.20.0.0/32', 'nexthop': '10.100.1.2'}], 'dns_nameservers': ['7.8.8.8', '7.8.4.4'], 'gateway_ip': '172.20.0.2', 'enable_dhcp': True}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:27.103346 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-3a0b0fa8-49eb-4ab3-ae16-ee75ebe27639 None None] Provisioning complete for port f3596fb5-0eb8-49ea-acb9-6ea4bc4b920e triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:27.104489 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3a0b0fa8-49eb-4ab3-ae16-ee75ebe27639 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:27.106179 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 9009edec-59ad-46af-a520-e6c0852ebf0d details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:31:27.108321 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 9c023fad-c8fa-4120-b9cc-4ea22c1718e4 up at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:31:27.110985 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-570c9711-4762-481d-9588-d36d01f39f35 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:27.118315 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-98bac1d2-5930-4aeb-ae54-5f82fd1a58a1 None None] Deleting port 04db5523-e7ce-41ee-bfbf-a776db27700f {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:31:27.118711 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-98bac1d2-5930-4aeb-ae54-5f82fd1a58a1 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:27.169682 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-66ea9979-b671-4d51-84a9-0cbbde30b85d tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Router b8b1c097-8cb2-4caa-bfe4-9e8b15227604 is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102162) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:31:27.196671 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-44827251-eebb-4e60-b653-399cd1440183 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Router 3d66d565-d8a3-411f-95ad-0f9d3efda35b is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102161) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:31:27.387546 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-322f740f-be09-4d51-ad35-fd85ea61a27e tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Made reservation on behalf of 6acf678d74da4512a431e262bbd32037 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:27.391823 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-322f740f-be09-4d51-ad35-fd85ea61a27e tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:27.395926 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-570c9711-4762-481d-9588-d36d01f39f35 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Deleting port ab8e63ae-1230-482f-a48d-68b82b5ab45b {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:31:27.396241 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-570c9711-4762-481d-9588-d36d01f39f35 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:27.457948 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0703ad1a-7ecd-48ba-a1a2-1da4b5592023 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:27.511450 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-44827251-eebb-4e60-b653-399cd1440183 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:31:27.523921 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d94018b7-36ba-4958-97e7-9e94fd0b9489 None None] Sync routers for ids ['3d66d565-d8a3-411f-95ad-0f9d3efda35b'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:31:27.524534 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-44827251-eebb-4e60-b653-399cd1440183 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:27.529858 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-44827251-eebb-4e60-b653-399cd1440183 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] 10.222.0.24 "PUT /v2.0/routers/3d66d565-d8a3-411f-95ad-0f9d3efda35b HTTP/1.1" status: 200 len: 915 time: 6.1266534 Nov 09 04:31:27.534788 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d94018b7-36ba-4958-97e7-9e94fd0b9489 None None] Routers {'3d66d565-d8a3-411f-95ad-0f9d3efda35b'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:31:27.535413 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-d94018b7-36ba-4958-97e7-9e94fd0b9489 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:31:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['3d66d565-d8a3-411f-95ad-0f9d3efda35b'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:27.536916 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55380) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:27.539097 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-570c9711-4762-481d-9588-d36d01f39f35 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] For port ab8e63ae-1230-482f-a48d-68b82b5ab45b, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=ab8e63ae-1230-482f-a48d-68b82b5ab45b,segment=NetworkSegment(f9c6a9a1-e5a3-4af2-8413-8cf5b0d1e3ae),segment_id=f9c6a9a1-e5a3-4af2-8413-8cf5b0d1e3ae)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:31:27.539464 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-570c9711-4762-481d-9588-d36d01f39f35 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:27.553059 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7632fe93-22b9-4b56-a99a-b0922d7636df tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_update-5794779'] for subnet, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:27.557574 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-3a0b0fa8-49eb-4ab3-ae16-ee75ebe27639 None None] Port f3596fb5-0eb8-49ea-acb9-6ea4bc4b920e cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:31:27.564952 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-570c9711-4762-481d-9588-d36d01f39f35 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Calling delete_port for ab8e63ae-1230-482f-a48d-68b82b5ab45b owned by network:dhcp {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:31:27.573058 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0703ad1a-7ecd-48ba-a1a2-1da4b5592023 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:31:27.595040 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-98bac1d2-5930-4aeb-ae54-5f82fd1a58a1 None None] For port 04db5523-e7ce-41ee-bfbf-a776db27700f, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=04db5523-e7ce-41ee-bfbf-a776db27700f,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:31:27.595454 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-98bac1d2-5930-4aeb-ae54-5f82fd1a58a1 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:27.598895 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-0703ad1a-7ecd-48ba-a1a2-1da4b5592023 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:27.604088 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-66ea9979-b671-4d51-84a9-0cbbde30b85d tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:31:27.604919 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0703ad1a-7ecd-48ba-a1a2-1da4b5592023 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Subnet': ['ID=67140727-f9f7-4047-9fd5-43683f7c06a7,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:27.610939 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0703ad1a-7ecd-48ba-a1a2-1da4b5592023 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:27.612092 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0703ad1a-7ecd-48ba-a1a2-1da4b5592023 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:27.634808 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-66ea9979-b671-4d51-84a9-0cbbde30b85d tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "PUT /v2.0/routers/b8b1c097-8cb2-4caa-bfe4-9e8b15227604/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.4785864 Nov 09 04:31:27.635781 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55382) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:27.639982 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a3b3040a-d5a6-432f-9e53-0b6a26752889 None None] Sync routers for ids ['b8b1c097-8cb2-4caa-bfe4-9e8b15227604'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:31:27.650131 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-d94018b7-36ba-4958-97e7-9e94fd0b9489 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:27.668860 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-98bac1d2-5930-4aeb-ae54-5f82fd1a58a1 None None] Calling delete_port for 04db5523-e7ce-41ee-bfbf-a776db27700f owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:31:27.693774 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d94018b7-36ba-4958-97e7-9e94fd0b9489 None None] Routers {'3d66d565-d8a3-411f-95ad-0f9d3efda35b'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:31:27.695928 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-d94018b7-36ba-4958-97e7-9e94fd0b9489 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:31:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['3d66d565-d8a3-411f-95ad-0f9d3efda35b'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:27.706991 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4e727813-d53e-44af-90a9-93ede1ccc8b8 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-25e3bbc0-5445-480c-91b2-4ec51922d90a', 'network_id': '25e3bbc0-5445-480c-91b2-4ec51922d90a', 'tenant_id': '6761c80dbfa84798bb6517a9b532f870', 'fixed_ips': [{'subnet_id': '15dc27c4-9bd7-4408-a8a7-9496f35be828'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:31:27.707252 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4e727813-d53e-44af-90a9-93ede1ccc8b8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:27.709159 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3f297bc5-0153-4806-ac24-05e5a84d60ad tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:27.713853 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55384) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:27.715352 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-3f297bc5-0153-4806-ac24-05e5a84d60ad tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "GET /v2.0/ports/f3596fb5-0eb8-49ea-acb9-6ea4bc4b920e HTTP/1.1" status: 200 len: 976 time: 0.0784960 Nov 09 04:31:27.746244 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-3a0b0fa8-49eb-4ab3-ae16-ee75ebe27639 None None] Provisioning complete for port ab8e63ae-1230-482f-a48d-68b82b5ab45b triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:27.753847 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3a0b0fa8-49eb-4ab3-ae16-ee75ebe27639 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:27.764818 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-0703ad1a-7ecd-48ba-a1a2-1da4b5592023 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 1.5061073 Nov 09 04:31:27.765765 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55386) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:27.783745 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-6cf76d21-fc04-46d9-9cff-1dcc42f206c5 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'port': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'name': 'tempest-NetworksTestDHCPv6-270354179'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:27.783962 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-964b4262-ba53-49c8-ae6c-e8564d27ba0e tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Router 5023cfbb-afb2-4e33-bdc1-c1173218f6bf has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:31:27.806022 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-d94018b7-36ba-4958-97e7-9e94fd0b9489 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:27.807012 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d94018b7-36ba-4958-97e7-9e94fd0b9489 None None] The sync data for ids ['3d66d565-d8a3-411f-95ad-0f9d3efda35b'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:31:27.865029 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a3b3040a-d5a6-432f-9e53-0b6a26752889 None None] Routers {'b8b1c097-8cb2-4caa-bfe4-9e8b15227604'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:31:27.867094 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-a3b3040a-d5a6-432f-9e53-0b6a26752889 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:31:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['b8b1c097-8cb2-4caa-bfe4-9e8b15227604'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:27.947425 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 354045bc-3baa-405c-8e61-0c526ba2160d no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:31:27.956414 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-a3b3040a-d5a6-432f-9e53-0b6a26752889 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:27.958449 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning for port 9c023fad-c8fa-4120-b9cc-4ea22c1718e4 completed by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 09 04:31:27.990068 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ceac1c44-0bb0-4c9d-80dc-f9c184d1b282 None None] DHCP port deletion for 472e0931-6be9-4332-83a6-c65cb3b98b7d request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:31:27.997834 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning complete for port 9c023fad-c8fa-4120-b9cc-4ea22c1718e4 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:27.998818 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:28.000744 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 354045bc-3baa-405c-8e61-0c526ba2160d {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:31:28.003161 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 354045bc-3baa-405c-8e61-0c526ba2160d not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:31:28.003161 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 04db5523-e7ce-41ee-bfbf-a776db27700f no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:31:28.018428 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-570c9711-4762-481d-9588-d36d01f39f35 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:28.051188 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-0ab33445-75ad-4a68-a366-5bc479d5c613 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] 10.222.0.24 "GET /v2.0/routers/3d66d565-d8a3-411f-95ad-0f9d3efda35b HTTP/1.1" status: 200 len: 921 time: 0.5027673 Nov 09 04:31:28.061467 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55390) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:28.067416 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-570c9711-4762-481d-9588-d36d01f39f35 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] No DVR routers for this DVR port ab8e63ae-1230-482f-a48d-68b82b5ab45b on host dv-neutron-816802-2-hyperv {{(pid=102161) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:31:28.087431 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-570c9711-4762-481d-9588-d36d01f39f35 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event deleted for resources: {'Port': ['ID=ab8e63ae-1230-482f-a48d-68b82b5ab45b,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:28.127250 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6cf76d21-fc04-46d9-9cff-1dcc42f206c5 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'port': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:28.130792 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6cf76d21-fc04-46d9-9cff-1dcc42f206c5 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:28.139031 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a3b3040a-d5a6-432f-9e53-0b6a26752889 None None] Routers {'b8b1c097-8cb2-4caa-bfe4-9e8b15227604'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:31:28.139670 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-a3b3040a-d5a6-432f-9e53-0b6a26752889 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:31:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['b8b1c097-8cb2-4caa-bfe4-9e8b15227604'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:28.151370 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-ceac1c44-0bb0-4c9d-80dc-f9c184d1b282 None None] The port 'ab8e63ae-1230-482f-a48d-68b82b5ab45b' was deleted {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1958}} Nov 09 04:31:28.194597 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.plugins.ml2.db [None req-3a0b0fa8-49eb-4ab3-ae16-ee75ebe27639 None None] No ports have port_id starting with ab8e63ae-1230-482f-a48d-68b82b5ab45b Nov 09 04:31:28.207830 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [None req-6cf76d21-fc04-46d9-9cff-1dcc42f206c5 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] device_id is not set on port 03891abd-b2fb-4d81-b80b-a9984a414409 yet. {{(pid=102161) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:31:28.212584 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-a3b3040a-d5a6-432f-9e53-0b6a26752889 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:28.213406 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a3b3040a-d5a6-432f-9e53-0b6a26752889 None None] The sync data for ids ['b8b1c097-8cb2-4caa-bfe4-9e8b15227604'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:31:28.224780 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a54f230-4d86-4b0d-aa45-1310fdb94063 req-9dad7481-e3d1-4cfd-91c6-d8af1c051c34 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:28.226606 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-0a54f230-4d86-4b0d-aa45-1310fdb94063 req-9dad7481-e3d1-4cfd-91c6-d8af1c051c34 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/ports?device_id=9c4e58e3-39e4-4212-b106-50b44d4c4e28 HTTP/1.1" status: 200 len: 944 time: 0.1741676 Nov 09 04:31:28.231916 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-570c9711-4762-481d-9588-d36d01f39f35 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:28.309825 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-570c9711-4762-481d-9588-d36d01f39f35 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['472e0931-6be9-4332-83a6-c65cb3b98b7d']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:28.321042 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-98bac1d2-5930-4aeb-ae54-5f82fd1a58a1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:28.333546 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-570c9711-4762-481d-9588-d36d01f39f35 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f9c6a9a1-e5a3-4af2-8413-8cf5b0d1e3ae') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:28.333938 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-47478980-4218-4904-83dc-c2126ea7dc03 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:28.334082 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-570c9711-4762-481d-9588-d36d01f39f35 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f9c6a9a1-e5a3-4af2-8413-8cf5b0d1e3ae') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:28.338238 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-47478980-4218-4904-83dc-c2126ea7dc03 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] 10.222.0.24 "GET /v2.0/ports?network_id=2b6725f5-ebfe-485a-8f42-ccb5a241ddb5&device_id=3d66d565-d8a3-411f-95ad-0f9d3efda35b&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 945 time: 0.2729056 Nov 09 04:31:28.338238 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-964b4262-ba53-49c8-ae6c-e8564d27ba0e tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:31:28.338511 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:28.347075 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55392) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:28.348452 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a6ce8b95-3aa9-4ba8-8c1a-45c485b97999 None None] Sync routers for ids ['5023cfbb-afb2-4e33-bdc1-c1173218f6bf'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:31:28.356556 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-964b4262-ba53-49c8-ae6c-e8564d27ba0e tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:28.372753 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a6ce8b95-3aa9-4ba8-8c1a-45c485b97999 None None] Routers {'5023cfbb-afb2-4e33-bdc1-c1173218f6bf'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:31:28.374110 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-a6ce8b95-3aa9-4ba8-8c1a-45c485b97999 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:31:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['5023cfbb-afb2-4e33-bdc1-c1173218f6bf'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:28.375820 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98bac1d2-5930-4aeb-ae54-5f82fd1a58a1 None None] Pushing event deleted for resources: {'Port': ['ID=04db5523-e7ce-41ee-bfbf-a776db27700f,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:28.377414 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:28.392098 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-98bac1d2-5930-4aeb-ae54-5f82fd1a58a1 None None] No DVR routers for this DVR port 04db5523-e7ce-41ee-bfbf-a776db27700f on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:31:28.400826 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-570c9711-4762-481d-9588-d36d01f39f35 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:28.441736 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7632fe93-22b9-4b56-a99a-b0922d7636df tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8756747267211', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_updated-5729887'] for subnet, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:28.468715 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8023aa6c-4cc4-4017-95ee-9c0ec16230ca None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:28.488374 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-964b4262-ba53-49c8-ae6c-e8564d27ba0e tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "PUT /v2.0/floatingips/a95b836b-fec6-4af9-8970-923ef2700539 HTTP/1.1" status: 200 len: 991 time: 4.6210899 Nov 09 04:31:28.502007 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-0a54f230-4d86-4b0d-aa45-1310fdb94063 req-8b759c67-5600-4d88-bb1d-9a23bf00be6e tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/security-groups?id=4ff68177-77d2-4250-b11c-4d5b55fd3619&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2330499 Nov 09 04:31:28.505086 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-570c9711-4762-481d-9588-d36d01f39f35 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:28.512934 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '433dca8f-3e84-4693-93ed-4f8fcd69553a', 'tag': '99ad1d96-b35b-4120-b5a9-c95c47bd3ffc'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:31:28.515523 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ba31bd77-72d2-4469-acfd-8eba11dc5589" -d '{"events": [{"name": "network-changed", "server_uuid": "433dca8f-3e84-4693-93ed-4f8fcd69553a", "tag": "99ad1d96-b35b-4120-b5a9-c95c47bd3ffc"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:31:28.522137 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-570c9711-4762-481d-9588-d36d01f39f35 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Releasing vlan 327 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:31:28.522595 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-570c9711-4762-481d-9588-d36d01f39f35 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:28.530348 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:31:28.530348 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:31:28.530348 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:31:28.530348 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:31:28.530348 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:31:28.530348 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:31:28.530348 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:31:28.530348 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:31:28.530348 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:31:28.530348 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:31:28.530348 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:31:28.530348 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:31:28.530348 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:31:28.530348 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:31:28.530348 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:31:28.530348 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:31:28.530348 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:31:28.530348 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:31:28.530348 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:31:28.530348 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:31:28.530348 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:31:28.530348 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:31:28.530348 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:31:28.530348 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:31:28.530348 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:31:28.530348 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:31:28.530348 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:31:28.530348 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:31:28.530348 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:31:28.530348 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:31:28.530348 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:31:28.530348 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:31:28.562774 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9c4e58e3-39e4-4212-b106-50b44d4c4e28', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9c023fad-c8fa-4120-b9cc-4ea22c1718e4'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:31:28.565303 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-273835ae-f432-405d-a1cd-ada9377e6864" -d '{"events": [{"server_uuid": "9c4e58e3-39e4-4212-b106-50b44d4c4e28", "name": "network-vif-plugged", "status": "completed", "tag": "9c023fad-c8fa-4120-b9cc-4ea22c1718e4"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:31:28.576274 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-a6ce8b95-3aa9-4ba8-8c1a-45c485b97999 None None] Set router 5023cfbb-afb2-4e33-bdc1-c1173218f6bf gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:31:28.611783 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:31:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ad2ee056-930c-4303-b8cc-905240d7a803 x-openstack-request-id: req-ad2ee056-930c-4303-b8cc-905240d7a803 {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:31:28.612578 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "433dca8f-3e84-4693-93ed-4f8fcd69553a", "tag": "99ad1d96-b35b-4120-b5a9-c95c47bd3ffc", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:31:28.613042 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-ad2ee056-930c-4303-b8cc-905240d7a803 {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:31:28.613649 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '433dca8f-3e84-4693-93ed-4f8fcd69553a', 'tag': '99ad1d96-b35b-4120-b5a9-c95c47bd3ffc', 'status': 'completed', 'code': 200} Nov 09 04:31:28.614969 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7632fe93-22b9-4b56-a99a-b0922d7636df tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:28.615789 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7632fe93-22b9-4b56-a99a-b0922d7636df tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:28.617352 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-7632fe93-22b9-4b56-a99a-b0922d7636df tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "PUT /v2.0/subnets/15dc27c4-9bd7-4408-a8a7-9496f35be828 HTTP/1.1" status: 200 len: 877 time: 1.5276592 Nov 09 04:31:28.624190 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7632fe93-22b9-4b56-a99a-b0922d7636df tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event updated for resources: {'Subnet': ['ID=15dc27c4-9bd7-4408-a8a7-9496f35be828,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:28.628676 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55400) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:28.642379 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 9c023fad-c8fa-4120-b9cc-4ea22c1718e4, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=9c023fad-c8fa-4120-b9cc-4ea22c1718e4,segment=NetworkSegment(d5411e15-1506-4025-8472-ba7118358f68),segment_id=d5411e15-1506-4025-8472-ba7118358f68)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:31:28.647830 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-4e727813-d53e-44af-90a9-93ede1ccc8b8 None None] Allocated IP 172.20.0.3 (25e3bbc0-5445-480c-91b2-4ec51922d90a/15dc27c4-9bd7-4408-a8a7-9496f35be828/830f53d5-aa7d-4a58-b347-5c259d19a5be) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:31:28.673455 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:31:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a8c22d70-7164-45f6-ab53-519d16684fe7 x-openstack-request-id: req-a8c22d70-7164-45f6-ab53-519d16684fe7 {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:31:28.673455 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9c4e58e3-39e4-4212-b106-50b44d4c4e28", "name": "network-vif-plugged", "status": "completed", "tag": "9c023fad-c8fa-4120-b9cc-4ea22c1718e4", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:31:28.673807 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-a8c22d70-7164-45f6-ab53-519d16684fe7 {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:31:28.674080 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9c4e58e3-39e4-4212-b106-50b44d4c4e28', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9c023fad-c8fa-4120-b9cc-4ea22c1718e4', 'code': 200} Nov 09 04:31:28.720536 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.objects.ports [None req-322f740f-be09-4d51-ad35-fd85ea61a27e tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=102162) get_objects /opt/stack/neutron/neutron/objects/ports.py:444}} Nov 09 04:31:28.722187 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:28.724423 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-6cf76d21-fc04-46d9-9cff-1dcc42f206c5 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Allocated IP 2001:db8::225 (988d2354-693c-4d52-af17-25e0643eaa0c/67140727-f9f7-4047-9fd5-43683f7c06a7/03891abd-b2fb-4d81-b80b-a9984a414409) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:31:28.733383 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bdc49fbc-6227-48b9-8c04-f06122a5165c tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:28.737492 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-bdc49fbc-6227-48b9-8c04-f06122a5165c tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] 10.222.0.24 "GET /v2.0/networks/2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 HTTP/1.1" status: 200 len: 881 time: 0.3865521 Nov 09 04:31:28.738694 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55402) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:28.751108 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-322f740f-be09-4d51-ad35-fd85ea61a27e tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:28.791208 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-80d9de30-dde4-4d47-a570-0411a3a786bd tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] 10.222.0.24 "GET /v2.0/ports?device_id=3d66d565-d8a3-411f-95ad-0f9d3efda35b HTTP/1.1" status: 200 len: 205 time: 0.0494785 Nov 09 04:31:28.797309 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55404) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:28.843533 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba31bd77-72d2-4469-acfd-8eba11dc5589 req-e1b4a3bc-3113-4fdd-a3d6-e558c6aae2df service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:28.845175 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ba31bd77-72d2-4469-acfd-8eba11dc5589 req-e1b4a3bc-3113-4fdd-a3d6-e558c6aae2df service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=6015befde7f546d881cb247ae5bc81ae&device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 1098 time: 0.1982813 Nov 09 04:31:28.845970 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-570c9711-4762-481d-9588-d36d01f39f35 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:28.861817 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-570c9711-4762-481d-9588-d36d01f39f35 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:28.868922 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-570c9711-4762-481d-9588-d36d01f39f35 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "DELETE /v2.0/networks/472e0931-6be9-4332-83a6-c65cb3b98b7d HTTP/1.1" status: 204 len: 168 time: 1.9147098 Nov 09 04:31:28.925454 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-455ef8b2-2665-4f17-bc07-9d077e3ed143 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-988d2354-693c-4d52-af17-25e0643eaa0c', 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'tenant_id': '8b0758f781884982bf5b94e6609237f6', 'fixed_ips': [{'subnet_id': '67140727-f9f7-4047-9fd5-43683f7c06a7'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:31:28.925454 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-455ef8b2-2665-4f17-bc07-9d077e3ed143 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:28.955917 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55406) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:28.958179 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=9c023fad-c8fa-4120-b9cc-4ea22c1718e4,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:29.033675 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-a6ce8b95-3aa9-4ba8-8c1a-45c485b97999 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5023cfbb-afb2-4e33-bdc1-c1173218f6bf', 'name': 'tempest-ServerActionsTestJSON-1211051012-router', 'tenant_id': '6015befde7f546d881cb247ae5bc81ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.95'}], 'enable_snat': True}, 'gw_port_id': 'a4e20770-3342-4c9b-a9bf-d4dab52b7d8d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:30:28Z', 'updated_at': '2021-11-09T04:30:43Z', 'revision_number': 4, 'project_id': '6015befde7f546d881cb247ae5bc81ae', 'gw_port': {'id': 'a4e20770-3342-4c9b-a9bf-d4dab52b7d8d', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:03:2b:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5023cfbb-afb2-4e33-bdc1-c1173218f6bf', 'device_owner': 'network:router_gateway', 'standard_attr_id': 499, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:30:29Z', 'updated_at': '2021-11-09T04:30:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': 'a95b836b-fec6-4af9-8970-923ef2700539', 'tenant_id': '6015befde7f546d881cb247ae5bc81ae', 'floating_ip_address': '172.26.0.108', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '5023cfbb-afb2-4e33-bdc1-c1173218f6bf', 'port_id': '99ad1d96-b35b-4120-b5a9-c95c47bd3ffc', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 587, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a270b61c-1f4f-4d97-be79-4a24c65fddc2', 'mac_address': 'fa:16:3e:b2:a6:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '433dca8f-3e84-4693-93ed-4f8fcd69553a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:30:53Z', 'updated_at': '2021-11-09T04:31:25Z', 'revision_number': 1, 'project_id': '6015befde7f546d881cb247ae5bc81ae', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e025929c-44cc-4832-b4a4-0216288df212', 'name': '', 'network_id': 'a270b61c-1f4f-4d97-be79-4a24c65fddc2', 'tenant_id': '6015befde7f546d881cb247ae5bc81ae', 'mac_address': 'fa:16:3e:7a:69:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5023cfbb-afb2-4e33-bdc1-c1173218f6bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 539, 'fixed_ips': [{'subnet_id': 'b2956e71-9b0f-4060-922c-e54ce6cff80a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:30:40Z', 'updated_at': '2021-11-09T04:30:50Z', 'revision_number': 5, 'project_id': '6015befde7f546d881cb247ae5bc81ae', 'subnets': [{'id': 'b2956e71-9b0f-4060-922c-e54ce6cff80a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:29.053757 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-570c9711-4762-481d-9588-d36d01f39f35 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event deleted for resources: {'Network': ['ID=472e0931-6be9-4332-83a6-c65cb3b98b7d,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:29.186980 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4e727813-d53e-44af-90a9-93ede1ccc8b8 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:29.190178 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a6ce8b95-3aa9-4ba8-8c1a-45c485b97999 None None] Checking router: 5023cfbb-afb2-4e33-bdc1-c1173218f6bf for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:31:29.199312 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a6ce8b95-3aa9-4ba8-8c1a-45c485b97999 None None] Routers {'5023cfbb-afb2-4e33-bdc1-c1173218f6bf'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:31:29.200358 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-a6ce8b95-3aa9-4ba8-8c1a-45c485b97999 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:31:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['5023cfbb-afb2-4e33-bdc1-c1173218f6bf'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:29.260027 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4e727813-d53e-44af-90a9-93ede1ccc8b8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:29.280807 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-322f740f-be09-4d51-ad35-fd85ea61a27e tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Pushing event updated for resources: {'Subnet': ['ID=ebbe76a5-ebde-4216-9171-17985f4f0995,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:29.297079 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0b1a0b29-94cf-4faa-b5ea-1e750d476763 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:29.303274 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4e727813-d53e-44af-90a9-93ede1ccc8b8 None None] Network 25e3bbc0-5445-480c-91b2-4ec51922d90a is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:31:29.307855 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-4e727813-d53e-44af-90a9-93ede1ccc8b8 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:29.332911 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-a6ce8b95-3aa9-4ba8-8c1a-45c485b97999 None None] Set router 5023cfbb-afb2-4e33-bdc1-c1173218f6bf gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:31:29.334641 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31b152f8-ce99-43a1-907b-b92f5cce2a77 req-d432567e-74e4-4cb1-a441-1bfa87d93f08 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:29.336290 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-31b152f8-ce99-43a1-907b-b92f5cce2a77 req-d432567e-74e4-4cb1-a441-1bfa87d93f08 service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=9c4e58e3-39e4-4212-b106-50b44d4c4e28 HTTP/1.1" status: 200 len: 1098 time: 0.1468174 Nov 09 04:31:29.339280 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-322f740f-be09-4d51-ad35-fd85ea61a27e tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Checking segment: {'id': '7425d687-add6-4065-ae0f-e86a77653f3b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 335, 'network_id': '9009edec-59ad-46af-a520-e6c0852ebf0d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:31:29.339927 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-322f740f-be09-4d51-ad35-fd85ea61a27e tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Network hostable DHCP agents. Network: 9009edec-59ad-46af-a520-e6c0852ebf0d, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:31:29.345842 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4e727813-d53e-44af-90a9-93ede1ccc8b8 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:31:29.441480 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e727813-d53e-44af-90a9-93ede1ccc8b8 None None] Pushing event updated for resources: {'Port': ['ID=830f53d5-aa7d-4a58-b347-5c259d19a5be,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:29.455228 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-4e727813-d53e-44af-90a9-93ede1ccc8b8 None None] Attempting to bind port 830f53d5-aa7d-4a58-b347-5c259d19a5be on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:31:29.457142 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-4e727813-d53e-44af-90a9-93ede1ccc8b8 None None] Attempting to bind port 830f53d5-aa7d-4a58-b347-5c259d19a5be by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '42483626-cfc4-4451-9541-bfe7f7bb69c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 348, 'network_id': '25e3bbc0-5445-480c-91b2-4ec51922d90a'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:31:29.458213 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4e727813-d53e-44af-90a9-93ede1ccc8b8 None None] Attempting to bind port 830f53d5-aa7d-4a58-b347-5c259d19a5be on network 25e3bbc0-5445-480c-91b2-4ec51922d90a {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:31:29.466995 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4e727813-d53e-44af-90a9-93ede1ccc8b8 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 31, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:31:29.467829 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4e727813-d53e-44af-90a9-93ede1ccc8b8 None None] Checking segment: {'id': '42483626-cfc4-4451-9541-bfe7f7bb69c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 348, 'network_id': '25e3bbc0-5445-480c-91b2-4ec51922d90a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:31:29.468481 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4e727813-d53e-44af-90a9-93ede1ccc8b8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:29.469044 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4e727813-d53e-44af-90a9-93ede1ccc8b8 None None] Bound using segment: {'id': '42483626-cfc4-4451-9541-bfe7f7bb69c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 348, 'network_id': '25e3bbc0-5445-480c-91b2-4ec51922d90a'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:31:29.469829 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-4e727813-d53e-44af-90a9-93ede1ccc8b8 None None] Bound port: 830f53d5-aa7d-4a58-b347-5c259d19a5be, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '42483626-cfc4-4451-9541-bfe7f7bb69c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 348, 'network_id': '25e3bbc0-5445-480c-91b2-4ec51922d90a'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:31:29.470505 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4e727813-d53e-44af-90a9-93ede1ccc8b8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:29.574258 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-4e727813-d53e-44af-90a9-93ede1ccc8b8 None None] For port 830f53d5-aa7d-4a58-b347-5c259d19a5be, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:31:29.579460 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-4e727813-d53e-44af-90a9-93ede1ccc8b8 None None] For port 830f53d5-aa7d-4a58-b347-5c259d19a5be, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=830f53d5-aa7d-4a58-b347-5c259d19a5be,segment=NetworkSegment(42483626-cfc4-4451-9541-bfe7f7bb69c1),segment_id=42483626-cfc4-4451-9541-bfe7f7bb69c1)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:31:29.584617 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-31b152f8-ce99-43a1-907b-b92f5cce2a77 req-3f1e7180-89fd-4c0e-892a-a7cfbc47f9f4 service neutron] 10.222.0.26 "GET /v2.0/security-groups?id=4ff68177-77d2-4250-b11c-4d5b55fd3619&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2396636 Nov 09 04:31:29.595715 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-85b7ad50-355a-4133-884b-247045b544f7 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks [] for router, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:29.597978 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-322f740f-be09-4d51-ad35-fd85ea61a27e tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Network 9009edec-59ad-46af-a520-e6c0852ebf0d is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:31:29.601994 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-16a348ed-55a6-463a-b5f4-e37997c5df96 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:29.609061 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-a6ce8b95-3aa9-4ba8-8c1a-45c485b97999 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5023cfbb-afb2-4e33-bdc1-c1173218f6bf', 'name': 'tempest-ServerActionsTestJSON-1211051012-router', 'tenant_id': '6015befde7f546d881cb247ae5bc81ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.95'}], 'enable_snat': True}, 'gw_port_id': 'a4e20770-3342-4c9b-a9bf-d4dab52b7d8d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:30:28Z', 'updated_at': '2021-11-09T04:30:43Z', 'revision_number': 4, 'project_id': '6015befde7f546d881cb247ae5bc81ae', 'gw_port': {'id': 'a4e20770-3342-4c9b-a9bf-d4dab52b7d8d', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:03:2b:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5023cfbb-afb2-4e33-bdc1-c1173218f6bf', 'device_owner': 'network:router_gateway', 'standard_attr_id': 499, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:30:29Z', 'updated_at': '2021-11-09T04:30:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': 'a95b836b-fec6-4af9-8970-923ef2700539', 'tenant_id': '6015befde7f546d881cb247ae5bc81ae', 'floating_ip_address': '172.26.0.108', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '5023cfbb-afb2-4e33-bdc1-c1173218f6bf', 'port_id': '99ad1d96-b35b-4120-b5a9-c95c47bd3ffc', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 587, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a270b61c-1f4f-4d97-be79-4a24c65fddc2', 'mac_address': 'fa:16:3e:b2:a6:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '433dca8f-3e84-4693-93ed-4f8fcd69553a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:30:53Z', 'updated_at': '2021-11-09T04:31:25Z', 'revision_number': 1, 'project_id': '6015befde7f546d881cb247ae5bc81ae', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e025929c-44cc-4832-b4a4-0216288df212', 'name': '', 'network_id': 'a270b61c-1f4f-4d97-be79-4a24c65fddc2', 'tenant_id': '6015befde7f546d881cb247ae5bc81ae', 'mac_address': 'fa:16:3e:7a:69:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5023cfbb-afb2-4e33-bdc1-c1173218f6bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 539, 'fixed_ips': [{'subnet_id': 'b2956e71-9b0f-4060-922c-e54ce6cff80a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:30:40Z', 'updated_at': '2021-11-09T04:30:50Z', 'revision_number': 5, 'project_id': '6015befde7f546d881cb247ae5bc81ae', 'subnets': [{'id': 'b2956e71-9b0f-4060-922c-e54ce6cff80a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:29.609682 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-026ce8d4-dae5-4f97-ab6a-5b05aa714284 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:29.614629 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-026ce8d4-dae5-4f97-ab6a-5b05aa714284 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "GET /v2.0/ports HTTP/1.1" status: 200 len: 844 time: 0.6528802 Nov 09 04:31:29.622409 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55412) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:29.659742 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4e727813-d53e-44af-90a9-93ede1ccc8b8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:29.686374 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a6ce8b95-3aa9-4ba8-8c1a-45c485b97999 None None] The sync data for ids ['5023cfbb-afb2-4e33-bdc1-c1173218f6bf'] in dv-neutron-816802-2-hyperv is: [{'id': '5023cfbb-afb2-4e33-bdc1-c1173218f6bf', 'name': 'tempest-ServerActionsTestJSON-1211051012-router', 'tenant_id': '6015befde7f546d881cb247ae5bc81ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.95'}], 'enable_snat': True}, 'gw_port_id': 'a4e20770-3342-4c9b-a9bf-d4dab52b7d8d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:30:28Z', 'updated_at': '2021-11-09T04:30:43Z', 'revision_number': 4, 'project_id': '6015befde7f546d881cb247ae5bc81ae', 'gw_port': {'id': 'a4e20770-3342-4c9b-a9bf-d4dab52b7d8d', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:03:2b:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5023cfbb-afb2-4e33-bdc1-c1173218f6bf', 'device_owner': 'network:router_gateway', 'standard_attr_id': 499, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:30:29Z', 'updated_at': '2021-11-09T04:30:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': 'a95b836b-fec6-4af9-8970-923ef2700539', 'tenant_id': '6015befde7f546d881cb247ae5bc81ae', 'floating_ip_address': '172.26.0.108', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '5023cfbb-afb2-4e33-bdc1-c1173218f6bf', 'port_id': '99ad1d96-b35b-4120-b5a9-c95c47bd3ffc', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 587, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a270b61c-1f4f-4d97-be79-4a24c65fddc2', 'mac_address': 'fa:16:3e:b2:a6:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '433dca8f-3e84-4693-93ed-4f8fcd69553a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:30:53Z', 'updated_at': '2021-11-09T04:31:25Z', 'revision_number': 1, 'project_id': '6015befde7f546d881cb247ae5bc81ae', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e025929c-44cc-4832-b4a4-0216288df212', 'name': '', 'network_id': 'a270b61c-1f4f-4d97-be79-4a24c65fddc2', 'tenant_id': '6015befde7f546d881cb247ae5bc81ae', 'mac_address': 'fa:16:3e:7a:69:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5023cfbb-afb2-4e33-bdc1-c1173218f6bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 539, 'fixed_ips': [{'subnet_id': 'b2956e71-9b0f-4060-922c-e54ce6cff80a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:30:40Z', 'updated_at': '2021-11-09T04:30:50Z', 'revision_number': 5, 'project_id': '6015befde7f546d881cb247ae5bc81ae', 'subnets': [{'id': 'b2956e71-9b0f-4060-922c-e54ce6cff80a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:31:29.723889 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba31bd77-72d2-4469-acfd-8eba11dc5589 req-f966881e-9122-4a7f-baff-48b8617b4f26 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:29.725694 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ba31bd77-72d2-4469-acfd-8eba11dc5589 req-f966881e-9122-4a7f-baff-48b8617b4f26 service neutron] 10.222.0.26 "GET /v2.0/networks?id=a270b61c-1f4f-4d97-be79-4a24c65fddc2 HTTP/1.1" status: 200 len: 913 time: 0.7913218 Nov 09 04:31:29.778672 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6cf76d21-fc04-46d9-9cff-1dcc42f206c5 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:29.778928 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-322f740f-be09-4d51-ad35-fd85ea61a27e tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 9009edec-59ad-46af-a520-e6c0852ebf0d) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:29.781890 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device ab8e63ae-1230-482f-a48d-68b82b5ab45b no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:31:29.797923 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-322f740f-be09-4d51-ad35-fd85ea61a27e tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:29.800536 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-322f740f-be09-4d51-ad35-fd85ea61a27e tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:29.811183 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-0b1a0b29-94cf-4faa-b5ea-1e750d476763 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Deleting port 830f53d5-aa7d-4a58-b347-5c259d19a5be {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:31:29.811621 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0b1a0b29-94cf-4faa-b5ea-1e750d476763 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:29.815789 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-352f28fe-f482-425d-9b8e-e4dda09addca None None] Network 9009edec-59ad-46af-a520-e6c0852ebf0d requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:29.870394 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-03defafc-2df0-47f8-b7c6-4d44315ac295 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "GET /v2.0/ports?fields=id&fields=mac_address HTTP/1.1" status: 200 len: 284 time: 0.2131670 Nov 09 04:31:29.872793 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55414) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:29.882019 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: ab8e63ae-1230-482f-a48d-68b82b5ab45b {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:31:29.882384 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device ab8e63ae-1230-482f-a48d-68b82b5ab45b not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:31:29.892093 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e727813-d53e-44af-90a9-93ede1ccc8b8 None None] Pushing event updated for resources: {'Port': ['ID=830f53d5-aa7d-4a58-b347-5c259d19a5be,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:29.921624 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-85b7ad50-355a-4133-884b-247045b544f7 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks [] for router_gateway, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:29.929423 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ba31bd77-72d2-4469-acfd-8eba11dc5589 req-841f9e9d-0b1e-4f94-be32-1f25753761dd service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=99ad1d96-b35b-4120-b5a9-c95c47bd3ffc HTTP/1.1" status: 200 len: 999 time: 0.1445746 Nov 09 04:31:29.949006 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-4cfccf91-34a0-4069-9d13-4c9be4f32b8b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-323569182'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:30.016984 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba31bd77-72d2-4469-acfd-8eba11dc5589 req-6be4116f-0552-4dfd-a601-f202091822be service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:30.016984 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ba31bd77-72d2-4469-acfd-8eba11dc5589 req-6be4116f-0552-4dfd-a601-f202091822be service neutron] 10.222.0.26 "GET /v2.0/subnets?id=b2956e71-9b0f-4060-922c-e54ce6cff80a HTTP/1.1" status: 200 len: 851 time: 0.0738461 Nov 09 04:31:30.022864 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-322f740f-be09-4d51-ad35-fd85ea61a27e tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 818 time: 2.9868023 Nov 09 04:31:30.034129 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55416) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:30.068626 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29f57bfe-ba7f-4662-8228-c21fb4d06694 req-f0a7af93-0d9d-4d57-9121-56c182e86bb5 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:30.070524 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-29f57bfe-ba7f-4662-8228-c21fb4d06694 req-f0a7af93-0d9d-4d57-9121-56c182e86bb5 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/ports?device_id=9c4e58e3-39e4-4212-b106-50b44d4c4e28 HTTP/1.1" status: 200 len: 945 time: 0.3595304 Nov 09 04:31:30.087513 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5e78ffb3-3ed7-4915-a7a2-8c84d6bceaaa None None] New status for floating IP a95b836b-fec6-4af9-8970-923ef2700539: ACTIVE {{(pid=102163) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 04:31:30.132138 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6cf76d21-fc04-46d9-9cff-1dcc42f206c5 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:30.134879 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4cfccf91-34a0-4069-9d13-4c9be4f32b8b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Made reservation on behalf of 88f9f8da29bf4a8793b45130d483a6e6 for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:30.138779 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4cfccf91-34a0-4069-9d13-4c9be4f32b8b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:30.170656 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c1a63de1-25b1-4f1d-a6de-e55b8a17b604 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-9009edec-59ad-46af-a520-e6c0852ebf0d', 'network_id': '9009edec-59ad-46af-a520-e6c0852ebf0d', 'tenant_id': '6acf678d74da4512a431e262bbd32037', 'fixed_ips': [{'subnet_id': 'ebbe76a5-ebde-4216-9171-17985f4f0995'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:31:30.171677 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c1a63de1-25b1-4f1d-a6de-e55b8a17b604 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:30.221393 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-29f57bfe-ba7f-4662-8228-c21fb4d06694 req-f08086bd-2d11-430b-8f95-7d1c1dde8f3b tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/security-groups?id=4ff68177-77d2-4250-b11c-4d5b55fd3619&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1288517 Nov 09 04:31:30.267957 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4cfccf91-34a0-4069-9d13-4c9be4f32b8b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 338} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:31:30.288809 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6cf76d21-fc04-46d9-9cff-1dcc42f206c5 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:31:30.291481 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cf76d21-fc04-46d9-9cff-1dcc42f206c5 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Port': ['ID=03891abd-b2fb-4d81-b80b-a9984a414409,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:30.297656 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-455ef8b2-2665-4f17-bc07-9d077e3ed143 None None] Allocated IP 2001:db8::2 (988d2354-693c-4d52-af17-25e0643eaa0c/67140727-f9f7-4047-9fd5-43683f7c06a7/5cca359a-c0bf-453d-a350-59ef893974e4) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:31:30.302708 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba31bd77-72d2-4469-acfd-8eba11dc5589 req-9ca658b3-2f38-4b33-a139-978421b9b92b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:30.312091 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ba31bd77-72d2-4469-acfd-8eba11dc5589 req-9ca658b3-2f38-4b33-a139-978421b9b92b service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=a270b61c-1f4f-4d97-be79-4a24c65fddc2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.2839642 Nov 09 04:31:30.312285 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-0b1a0b29-94cf-4faa-b5ea-1e750d476763 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] For port 830f53d5-aa7d-4a58-b347-5c259d19a5be, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=830f53d5-aa7d-4a58-b347-5c259d19a5be,segment=NetworkSegment(42483626-cfc4-4451-9541-bfe7f7bb69c1),segment_id=42483626-cfc4-4451-9541-bfe7f7bb69c1)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:31:30.312285 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0b1a0b29-94cf-4faa-b5ea-1e750d476763 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:30.312865 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-6cf76d21-fc04-46d9-9cff-1dcc42f206c5 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:30.319448 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-0b1a0b29-94cf-4faa-b5ea-1e750d476763 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Calling delete_port for 830f53d5-aa7d-4a58-b347-5c259d19a5be owned by network:dhcp {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:31:30.319662 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6cf76d21-fc04-46d9-9cff-1dcc42f206c5 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:31:30.325303 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6cf76d21-fc04-46d9-9cff-1dcc42f206c5 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:30.326559 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6cf76d21-fc04-46d9-9cff-1dcc42f206c5 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:30.343665 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4cfccf91-34a0-4069-9d13-4c9be4f32b8b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:30.344345 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-4cfccf91-34a0-4069-9d13-4c9be4f32b8b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Added segment 2f186152-3244-4ac7-9a61-268e892ccb4c of type vlan for network 4b71592d-70d0-4093-95b2-aac46ce97cc3 Nov 09 04:31:30.375229 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4cddc517-6487-4cd8-aed9-50dbb17de1c1 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:30.421250 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-85b7ad50-355a-4133-884b-247045b544f7 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Deleting port d780812c-40ad-4f61-ba29-63d923158ab4 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:31:30.421673 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-85b7ad50-355a-4133-884b-247045b544f7 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:30.432803 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-6cf76d21-fc04-46d9-9cff-1dcc42f206c5 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 931 time: 2.6615522 Nov 09 04:31:30.441937 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55418) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:30.468515 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4cfccf91-34a0-4069-9d13-4c9be4f32b8b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:30.514434 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-c1a63de1-25b1-4f1d-a6de-e55b8a17b604 None None] Allocated IP 2001:db8::f816:3eff:fe29:92b4 (9009edec-59ad-46af-a520-e6c0852ebf0d/ebbe76a5-ebde-4216-9171-17985f4f0995/2998ceb2-b3ba-418f-9b65-969fbbb45ee1) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:31:30.550671 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3411b721-af82-4b76-95af-711d08a1c889 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:30.555169 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-3411b721-af82-4b76-95af-711d08a1c889 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/ports HTTP/1.1" status: 200 len: 929 time: 0.1086826 Nov 09 04:31:30.559639 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55420) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:30.582546 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4cddc517-6487-4cd8-aed9-50dbb17de1c1 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:30.592955 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ba31bd77-72d2-4469-acfd-8eba11dc5589 req-8808a72d-3124-41c1-82cc-aff2b73580a8 service neutron] 10.222.0.26 "GET /v2.0/networks/a270b61c-1f4f-4d97-be79-4a24c65fddc2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2577901 Nov 09 04:31:30.592955 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-85b7ad50-355a-4133-884b-247045b544f7 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:30.595249 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-16a348ed-55a6-463a-b5f4-e37997c5df96 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Deleting port f3596fb5-0eb8-49ea-acb9-6ea4bc4b920e {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:31:30.595679 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-16a348ed-55a6-463a-b5f4-e37997c5df96 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:30.663568 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-85b7ad50-355a-4133-884b-247045b544f7 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Calling delete_port for d780812c-40ad-4f61-ba29-63d923158ab4 owned by network:router_gateway {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:31:30.665892 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-455ef8b2-2665-4f17-bc07-9d077e3ed143 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:30.730353 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-455ef8b2-2665-4f17-bc07-9d077e3ed143 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:30.741316 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4cfccf91-34a0-4069-9d13-4c9be4f32b8b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:30.747202 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4cfccf91-34a0-4069-9d13-4c9be4f32b8b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:30.748342 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4cfccf91-34a0-4069-9d13-4c9be4f32b8b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:30.790163 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c1a63de1-25b1-4f1d-a6de-e55b8a17b604 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:30.831094 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ba31bd77-72d2-4469-acfd-8eba11dc5589 req-79a3d18a-9f58-4a26-9bc5-a46989884a1c service neutron] 10.222.0.26 "GET /v2.0/networks/a270b61c-1f4f-4d97-be79-4a24c65fddc2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2023947 Nov 09 04:31:30.884656 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-16a348ed-55a6-463a-b5f4-e37997c5df96 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:30.920389 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-16a348ed-55a6-463a-b5f4-e37997c5df96 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Calling delete_port for f3596fb5-0eb8-49ea-acb9-6ea4bc4b920e owned by network:router_interface {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:31:30.943889 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-4cfccf91-34a0-4069-9d13-4c9be4f32b8b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 767 time: 0.9990613 Nov 09 04:31:30.945130 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55424) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:30.960955 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-417df6ac-5717-44cd-a26e-0b750dea9faa tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Request body: {'subnet': {'network_id': '4b71592d-70d0-4093-95b2-aac46ce97cc3', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:30.985707 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-a9168d9d-137a-4920-a8e5-9cabc5a5e2e8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Deleting port 03891abd-b2fb-4d81-b80b-a9984a414409 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:31:30.986111 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a9168d9d-137a-4920-a8e5-9cabc5a5e2e8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:30.989001 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cfccf91-34a0-4069-9d13-4c9be4f32b8b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event updated for resources: {'Network': ['ID=4b71592d-70d0-4093-95b2-aac46ce97cc3,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:31.000398 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4cddc517-6487-4cd8-aed9-50dbb17de1c1 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:31.001123 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0b1a0b29-94cf-4faa-b5ea-1e750d476763 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:31.051156 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cddc517-6487-4cd8-aed9-50dbb17de1c1 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Pushing event deleted for resources: {'Subnet': ['ID=ebbe76a5-ebde-4216-9171-17985f4f0995,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:31.055893 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 4b71592d-70d0-4093-95b2-aac46ce97cc3 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:31:31.058198 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b1a0b29-94cf-4faa-b5ea-1e750d476763 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event deleted for resources: {'Port': ['ID=830f53d5-aa7d-4a58-b347-5c259d19a5be,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:31.058797 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-455ef8b2-2665-4f17-bc07-9d077e3ed143 None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:31:31.062158 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c1a63de1-25b1-4f1d-a6de-e55b8a17b604 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:31.085578 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-455ef8b2-2665-4f17-bc07-9d077e3ed143 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:31.098591 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-455ef8b2-2665-4f17-bc07-9d077e3ed143 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:31:31.126453 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-85b7ad50-355a-4133-884b-247045b544f7 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:31.176480 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-455ef8b2-2665-4f17-bc07-9d077e3ed143 None None] Pushing event updated for resources: {'Port': ['ID=5cca359a-c0bf-453d-a350-59ef893974e4,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:31.180038 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c1a63de1-25b1-4f1d-a6de-e55b8a17b604 None None] Network 9009edec-59ad-46af-a520-e6c0852ebf0d is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:31:31.187231 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85b7ad50-355a-4133-884b-247045b544f7 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Pushing event deleted for resources: {'Port': ['ID=d780812c-40ad-4f61-ba29-63d923158ab4,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:31.212247 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-c1a63de1-25b1-4f1d-a6de-e55b8a17b604 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:31.218818 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4cddc517-6487-4cd8-aed9-50dbb17de1c1 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:31.241137 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c1a63de1-25b1-4f1d-a6de-e55b8a17b604 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:31:31.278352 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-4cddc517-6487-4cd8-aed9-50dbb17de1c1 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9009edec-59ad-46af-a520-e6c0852ebf0d']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:31.287238 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-455ef8b2-2665-4f17-bc07-9d077e3ed143 None None] Attempting to bind port 5cca359a-c0bf-453d-a350-59ef893974e4 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:31:31.287596 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-455ef8b2-2665-4f17-bc07-9d077e3ed143 None None] Attempting to bind port 5cca359a-c0bf-453d-a350-59ef893974e4 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:31:31.287948 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-455ef8b2-2665-4f17-bc07-9d077e3ed143 None None] Attempting to bind port 5cca359a-c0bf-453d-a350-59ef893974e4 on network 988d2354-693c-4d52-af17-25e0643eaa0c {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:31:31.298686 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0b1a0b29-94cf-4faa-b5ea-1e750d476763 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] No DVR routers for this DVR port 830f53d5-aa7d-4a58-b347-5c259d19a5be on host dv-neutron-816802-2-hyperv {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:31:31.313323 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-85b7ad50-355a-4133-884b-247045b544f7 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-466373'] for router_gateway, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:31.316507 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-4cddc517-6487-4cd8-aed9-50dbb17de1c1 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '7425d687-add6-4065-ae0f-e86a77653f3b') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:31.316909 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-4cddc517-6487-4cd8-aed9-50dbb17de1c1 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '7425d687-add6-4065-ae0f-e86a77653f3b') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:31.324830 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-455ef8b2-2665-4f17-bc07-9d077e3ed143 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 31, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:31:31.325199 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-455ef8b2-2665-4f17-bc07-9d077e3ed143 None None] Checking segment: {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:31:31.325590 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-455ef8b2-2665-4f17-bc07-9d077e3ed143 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:31.326558 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-455ef8b2-2665-4f17-bc07-9d077e3ed143 None None] Bound using segment: {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:31:31.327021 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-455ef8b2-2665-4f17-bc07-9d077e3ed143 None None] Bound port: 5cca359a-c0bf-453d-a350-59ef893974e4, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:31:31.327389 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-455ef8b2-2665-4f17-bc07-9d077e3ed143 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:31.331166 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1a63de1-25b1-4f1d-a6de-e55b8a17b604 None None] Pushing event updated for resources: {'Port': ['ID=2998ceb2-b3ba-418f-9b65-969fbbb45ee1,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:31.344937 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6959503d-6471-4cc6-8781-6db422fb2324 None None] Network 25e3bbc0-5445-480c-91b2-4ec51922d90a requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:31.373662 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-c1a63de1-25b1-4f1d-a6de-e55b8a17b604 None None] Attempting to bind port 2998ceb2-b3ba-418f-9b65-969fbbb45ee1 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:31:31.374022 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-c1a63de1-25b1-4f1d-a6de-e55b8a17b604 None None] Attempting to bind port 2998ceb2-b3ba-418f-9b65-969fbbb45ee1 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '7425d687-add6-4065-ae0f-e86a77653f3b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 335, 'network_id': '9009edec-59ad-46af-a520-e6c0852ebf0d'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:31:31.374404 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c1a63de1-25b1-4f1d-a6de-e55b8a17b604 None None] Attempting to bind port 2998ceb2-b3ba-418f-9b65-969fbbb45ee1 on network 9009edec-59ad-46af-a520-e6c0852ebf0d {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:31:31.393307 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4cddc517-6487-4cd8-aed9-50dbb17de1c1 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:31.425939 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-1c18d362-d484-47e0-81fc-e00ace23264c None None] Could not find standard attr ID for object 830f53d5-aa7d-4a58-b347-5c259d19a5be. {{(pid=102163) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 09 04:31:31.430983 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c1a63de1-25b1-4f1d-a6de-e55b8a17b604 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 31, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:31:31.431341 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c1a63de1-25b1-4f1d-a6de-e55b8a17b604 None None] Checking segment: {'id': '7425d687-add6-4065-ae0f-e86a77653f3b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 335, 'network_id': '9009edec-59ad-46af-a520-e6c0852ebf0d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:31:31.431736 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c1a63de1-25b1-4f1d-a6de-e55b8a17b604 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:31.432363 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c1a63de1-25b1-4f1d-a6de-e55b8a17b604 None None] Bound using segment: {'id': '7425d687-add6-4065-ae0f-e86a77653f3b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 335, 'network_id': '9009edec-59ad-46af-a520-e6c0852ebf0d'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:31:31.432582 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-c1a63de1-25b1-4f1d-a6de-e55b8a17b604 None None] Bound port: 2998ceb2-b3ba-418f-9b65-969fbbb45ee1, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7425d687-add6-4065-ae0f-e86a77653f3b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 335, 'network_id': '9009edec-59ad-46af-a520-e6c0852ebf0d'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:31:31.432962 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c1a63de1-25b1-4f1d-a6de-e55b8a17b604 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:31.438603 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-85b7ad50-355a-4133-884b-247045b544f7 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:31.440478 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4cddc517-6487-4cd8-aed9-50dbb17de1c1 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:31.442872 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a9168d9d-137a-4920-a8e5-9cabc5a5e2e8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:31.444929 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-85b7ad50-355a-4133-884b-247045b544f7 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:31.450594 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4cddc517-6487-4cd8-aed9-50dbb17de1c1 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Releasing vlan 335 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:31:31.451078 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4cddc517-6487-4cd8-aed9-50dbb17de1c1 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:31.454322 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:31:31.454322 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:31:31.454322 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:31:31.454322 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:31:31.454322 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:31:31.454322 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:31:31.454322 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:31:31.454322 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:31:31.454322 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:31:31.454322 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:31:31.454322 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:31:31.454322 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:31:31.454322 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:31:31.454322 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:31:31.454322 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:31:31.454322 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:31:31.454322 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:31:31.454322 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:31:31.454322 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:31:31.454322 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:31:31.454322 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:31:31.454322 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:31:31.454322 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:31:31.454322 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:31:31.454322 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:31:31.454322 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:31:31.454322 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:31:31.454322 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:31:31.454322 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:31:31.454322 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:31:31.454322 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:31:31.454322 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:31:31.479138 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-a9168d9d-137a-4920-a8e5-9cabc5a5e2e8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Calling delete_port for 03891abd-b2fb-4d81-b80b-a9984a414409 owned by {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:31:31.502325 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0b1a0b29-94cf-4faa-b5ea-1e750d476763 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:31.537338 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-455ef8b2-2665-4f17-bc07-9d077e3ed143 None None] For port 5cca359a-c0bf-453d-a350-59ef893974e4, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:31:31.573670 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.db.api [None req-4cddc517-6487-4cd8-aed9-50dbb17de1c1 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Nov 09 04:31:31.573670 dv-neutron-816802-2-hyperv neutron-server[102161]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Nov 09 04:31:31.573670 dv-neutron-816802-2-hyperv neutron-server[102161]: [parameters: {'id': '9009edec-59ad-46af-a520-e6c0852ebf0d'}] Nov 09 04:31:31.573670 dv-neutron-816802-2-hyperv neutron-server[102161]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=102161) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:31:31.574616 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG oslo_db.api [None req-4cddc517-6487-4cd8-aed9-50dbb17de1c1 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:31:31.576599 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-c1a63de1-25b1-4f1d-a6de-e55b8a17b604 None None] For port 2998ceb2-b3ba-418f-9b65-969fbbb45ee1, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:31:31.577507 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e83e37b0-d797-468c-8783-2b50614b4884 req-4e695c75-67ef-405c-ac27-95f6673e6749 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:31.578457 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-455ef8b2-2665-4f17-bc07-9d077e3ed143 None None] For port 5cca359a-c0bf-453d-a350-59ef893974e4, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=5cca359a-c0bf-453d-a350-59ef893974e4,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:31:31.579217 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e83e37b0-d797-468c-8783-2b50614b4884 req-4e695c75-67ef-405c-ac27-95f6673e6749 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/ports?device_id=9c4e58e3-39e4-4212-b106-50b44d4c4e28 HTTP/1.1" status: 200 len: 945 time: 0.2366905 Nov 09 04:31:31.584172 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-417df6ac-5717-44cd-a26e-0b750dea9faa tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Made reservation on behalf of 88f9f8da29bf4a8793b45130d483a6e6 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:31.587562 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-417df6ac-5717-44cd-a26e-0b750dea9faa tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:31.595029 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-c1a63de1-25b1-4f1d-a6de-e55b8a17b604 None None] For port 2998ceb2-b3ba-418f-9b65-969fbbb45ee1, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=2998ceb2-b3ba-418f-9b65-969fbbb45ee1,segment=NetworkSegment(7425d687-add6-4065-ae0f-e86a77653f3b),segment_id=7425d687-add6-4065-ae0f-e86a77653f3b)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:31:31.596608 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-85b7ad50-355a-4133-884b-247045b544f7 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:31.596965 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-85b7ad50-355a-4133-884b-247045b544f7 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Fanout notify agent at l3_agent the message router_deleted on router 3d66d565-d8a3-411f-95ad-0f9d3efda35b {{(pid=102161) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:31:31.605929 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-85b7ad50-355a-4133-884b-247045b544f7 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:31.610077 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-85b7ad50-355a-4133-884b-247045b544f7 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] 10.222.0.24 "DELETE /v2.0/routers/3d66d565-d8a3-411f-95ad-0f9d3efda35b HTTP/1.1" status: 204 len: 168 time: 2.7821126 Nov 09 04:31:31.610776 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55428) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:31.616566 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-5b518c70-48e9-4651-b9c7-94fc076a36fd tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Request body: {'router': {'name': 'tempest-RoutersAdminTest-router-2010850542', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}, 'admin_state_up': False}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:31.654270 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-455ef8b2-2665-4f17-bc07-9d077e3ed143 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:31.695410 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c1a63de1-25b1-4f1d-a6de-e55b8a17b604 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:31.750791 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5b518c70-48e9-4651-b9c7-94fc076a36fd tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:31.752221 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5b518c70-48e9-4651-b9c7-94fc076a36fd tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:31.758233 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-455ef8b2-2665-4f17-bc07-9d077e3ed143 None None] Pushing event updated for resources: {'Port': ['ID=5cca359a-c0bf-453d-a350-59ef893974e4,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:31.808896 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e83e37b0-d797-468c-8783-2b50614b4884 req-afb4c814-5f5d-448e-977f-c6931ca1c8b4 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/security-groups?id=4ff68177-77d2-4250-b11c-4d5b55fd3619&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2113700 Nov 09 04:31:31.820130 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0b1a0b29-94cf-4faa-b5ea-1e750d476763 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:31.831865 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5771f9d4-3aac-458c-8602-7e2e76287fda None None] Network 9009edec-59ad-46af-a520-e6c0852ebf0d requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:31.858544 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5b518c70-48e9-4651-b9c7-94fc076a36fd tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:31.864546 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1a63de1-25b1-4f1d-a6de-e55b8a17b604 None None] Pushing event updated for resources: {'Port': ['ID=2998ceb2-b3ba-418f-9b65-969fbbb45ee1,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:31.983238 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b1a0b29-94cf-4faa-b5ea-1e750d476763 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event deleted for resources: {'Subnet': ['ID=15dc27c4-9bd7-4408-a8a7-9496f35be828,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:32.000519 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0b1a0b29-94cf-4faa-b5ea-1e750d476763 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:32.060141 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b8b8c795-b635-434e-8e6a-26a2faf9084d None None] Network 25e3bbc0-5445-480c-91b2-4ec51922d90a requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:32.076822 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4cddc517-6487-4cd8-aed9-50dbb17de1c1 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:32.090452 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-16a348ed-55a6-463a-b5f4-e37997c5df96 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:32.095913 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-0b1a0b29-94cf-4faa-b5ea-1e750d476763 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['25e3bbc0-5445-480c-91b2-4ec51922d90a']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:32.126581 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-0b1a0b29-94cf-4faa-b5ea-1e750d476763 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '42483626-cfc4-4451-9541-bfe7f7bb69c1') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:32.126878 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-0b1a0b29-94cf-4faa-b5ea-1e750d476763 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '42483626-cfc4-4451-9541-bfe7f7bb69c1') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:32.170775 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16a348ed-55a6-463a-b5f4-e37997c5df96 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event deleted for resources: {'Port': ['ID=f3596fb5-0eb8-49ea-acb9-6ea4bc4b920e,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:32.176797 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0b1a0b29-94cf-4faa-b5ea-1e750d476763 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:32.251887 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0b1a0b29-94cf-4faa-b5ea-1e750d476763 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:32.261535 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5b518c70-48e9-4651-b9c7-94fc076a36fd tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:32.277746 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2841bd92-2d81-4f3d-8362-9993edfa42bf req-f32f0f6d-0e07-4f31-a1fb-0ef0d6e32149 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:32.279861 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-2841bd92-2d81-4f3d-8362-9993edfa42bf req-f32f0f6d-0e07-4f31-a1fb-0ef0d6e32149 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/ports?device_id=9c4e58e3-39e4-4212-b106-50b44d4c4e28 HTTP/1.1" status: 200 len: 945 time: 0.2769918 Nov 09 04:31:32.293649 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-0b1a0b29-94cf-4faa-b5ea-1e750d476763 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Releasing vlan 348 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:31:32.294065 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0b1a0b29-94cf-4faa-b5ea-1e750d476763 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:32.301927 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:31:32.301927 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:31:32.301927 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:31:32.301927 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:31:32.301927 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:31:32.301927 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:31:32.301927 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:31:32.301927 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:31:32.301927 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:31:32.301927 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:31:32.301927 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:31:32.301927 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:31:32.301927 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:31:32.301927 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:31:32.301927 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:31:32.301927 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:31:32.301927 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:31:32.301927 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:31:32.301927 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:31:32.301927 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:31:32.301927 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:31:32.301927 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:31:32.301927 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:31:32.301927 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:31:32.301927 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:31:32.301927 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:31:32.301927 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:31:32.301927 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:31:32.301927 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:31:32.301927 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:31:32.301927 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:31:32.301927 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:31:32.340528 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-039c3cd8-997c-464c-9e79-fcaaddc1b1bd None None] DHCP port deletion for 25e3bbc0-5445-480c-91b2-4ec51922d90a request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:31:32.341935 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a9168d9d-137a-4920-a8e5-9cabc5a5e2e8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:32.351919 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-4cddc517-6487-4cd8-aed9-50dbb17de1c1 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Deleting port 2998ceb2-b3ba-418f-9b65-969fbbb45ee1 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:31:32.352255 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4cddc517-6487-4cd8-aed9-50dbb17de1c1 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:32.400933 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-2841bd92-2d81-4f3d-8362-9993edfa42bf req-23516e5a-2183-448b-b82a-0ee2878b7c91 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/security-groups?id=4ff68177-77d2-4250-b11c-4d5b55fd3619&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1082675 Nov 09 04:31:32.441057 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55434) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:32.462172 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9168d9d-137a-4920-a8e5-9cabc5a5e2e8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event deleted for resources: {'Port': ['ID=03891abd-b2fb-4d81-b80b-a9984a414409,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:32.513763 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-4cddc517-6487-4cd8-aed9-50dbb17de1c1 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] For port 2998ceb2-b3ba-418f-9b65-969fbbb45ee1, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=2998ceb2-b3ba-418f-9b65-969fbbb45ee1,segment=NetworkSegment(7425d687-add6-4065-ae0f-e86a77653f3b),segment_id=7425d687-add6-4065-ae0f-e86a77653f3b)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:31:32.514136 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4cddc517-6487-4cd8-aed9-50dbb17de1c1 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:32.531123 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a9168d9d-137a-4920-a8e5-9cabc5a5e2e8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:32.534415 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a9168d9d-137a-4920-a8e5-9cabc5a5e2e8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/ports/03891abd-b2fb-4d81-b80b-a9984a414409 HTTP/1.1" status: 204 len: 168 time: 1.9695899 Nov 09 04:31:32.537670 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55436) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:32.541668 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-4cddc517-6487-4cd8-aed9-50dbb17de1c1 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Calling delete_port for 2998ceb2-b3ba-418f-9b65-969fbbb45ee1 owned by network:dhcp {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:31:32.594121 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0b1a0b29-94cf-4faa-b5ea-1e750d476763 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:32.595934 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-417df6ac-5717-44cd-a26e-0b750dea9faa tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:32.612664 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0b1a0b29-94cf-4faa-b5ea-1e750d476763 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:32.615901 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-0b1a0b29-94cf-4faa-b5ea-1e750d476763 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "DELETE /v2.0/networks/25e3bbc0-5445-480c-91b2-4ec51922d90a HTTP/1.1" status: 204 len: 168 time: 3.9858410 Nov 09 04:31:32.621251 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55438) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:32.661412 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-16a348ed-55a6-463a-b5f4-e37997c5df96 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:32.698489 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b1a0b29-94cf-4faa-b5ea-1e750d476763 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event deleted for resources: {'Network': ['ID=25e3bbc0-5445-480c-91b2-4ec51922d90a,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:32.720345 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-9fc33aa8-88dd-438d-abdb-7eff61dfc39c tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] DELETE failed (client error): The resource could not be found. Nov 09 04:31:32.720801 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9fc33aa8-88dd-438d-abdb-7eff61dfc39c tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:31:32.726425 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-9fc33aa8-88dd-438d-abdb-7eff61dfc39c tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "DELETE /v2.0/subnets/15dc27c4-9bd7-4408-a8a7-9496f35be828 HTTP/1.1" status: 404 len: 337 time: 0.0827000 Nov 09 04:31:32.735285 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55440) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:32.738553 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-79c77d37-388d-48ec-a507-dbb96f98e249 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:32.740207 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-79c77d37-388d-48ec-a507-dbb96f98e249 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:32.744302 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-79c77d37-388d-48ec-a507-dbb96f98e249 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1464 time: 0.2040811 Nov 09 04:31:32.751980 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55442) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:32.932079 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9b968ff4-7598-463d-9dd4-2f2b0b5ad81b tempest-TestNetworkAdvancedServerOps-649297627 tempest-TestNetworkAdvancedServerOps-649297627-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:32.933504 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-9b968ff4-7598-463d-9dd4-2f2b0b5ad81b tempest-TestNetworkAdvancedServerOps-649297627 tempest-TestNetworkAdvancedServerOps-649297627-project-admin] 10.222.0.24 "GET /v2.0/ports?device_id=9c4e58e3-39e4-4212-b106-50b44d4c4e28 HTTP/1.1" status: 200 len: 1093 time: 0.4915233 Nov 09 04:31:32.937113 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55444) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:32.943774 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-dca37877-6072-4605-b21a-332876b50bd2 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Request body: {'floatingip': {'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'port_id': '9c023fad-c8fa-4120-b9cc-4ea22c1718e4', 'tenant_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'fixed_ip_address': '172.20.0.6'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:33.079947 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-459355b4-6448-4cd7-88bb-6bb0e0661a62 None None] Provisioning complete for port 5cca359a-c0bf-453d-a350-59ef893974e4 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:33.080553 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-459355b4-6448-4cd7-88bb-6bb0e0661a62 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:33.095916 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4cddc517-6487-4cd8-aed9-50dbb17de1c1 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:33.102638 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dca37877-6072-4605-b21a-332876b50bd2 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks [] for floatingip, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:33.168320 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cddc517-6487-4cd8-aed9-50dbb17de1c1 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Pushing event deleted for resources: {'Port': ['ID=2998ceb2-b3ba-418f-9b65-969fbbb45ee1,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:33.181724 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4cddc517-6487-4cd8-aed9-50dbb17de1c1 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] No DVR routers for this DVR port 2998ceb2-b3ba-418f-9b65-969fbbb45ee1 on host dv-neutron-816802-2-hyperv {{(pid=102161) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:31:33.187140 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-8735a2c3-b063-427b-b53b-4bc2532b79a1 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] DELETE failed (client error): The resource could not be found. Nov 09 04:31:33.187598 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-8735a2c3-b063-427b-b53b-4bc2532b79a1 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:31:33.190782 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-8735a2c3-b063-427b-b53b-4bc2532b79a1 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "DELETE /v2.0/networks/25e3bbc0-5445-480c-91b2-4ec51922d90a HTTP/1.1" status: 404 len: 339 time: 0.4479053 Nov 09 04:31:33.191520 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-417df6ac-5717-44cd-a26e-0b750dea9faa tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event updated for resources: {'Subnet': ['ID=437c42c6-b7c7-44c0-b5de-f9e368fcfb4a,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:33.193429 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55448) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:33.239735 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5b518c70-48e9-4651-b9c7-94fc076a36fd tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks [] for router_gateway, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:33.250188 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-459355b4-6448-4cd7-88bb-6bb0e0661a62 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:33.292601 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-459355b4-6448-4cd7-88bb-6bb0e0661a62 None None] For port 5cca359a-c0bf-453d-a350-59ef893974e4, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=5cca359a-c0bf-453d-a350-59ef893974e4,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:31:33.294958 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-1116eefa-8f2e-43d2-8294-fd82608d8739 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] DELETE failed (client error): The resource could not be found. Nov 09 04:31:33.295544 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-1116eefa-8f2e-43d2-8294-fd82608d8739 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:31:33.298900 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-1116eefa-8f2e-43d2-8294-fd82608d8739 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "DELETE /v2.0/subnets/d360fc46-82eb-4904-9996-d0675d95d2e3 HTTP/1.1" status: 404 len: 337 time: 0.0662599 Nov 09 04:31:33.305774 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55450) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:33.313998 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5b518c70-48e9-4651-b9c7-94fc076a36fd tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:33.327348 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-417df6ac-5717-44cd-a26e-0b750dea9faa tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Checking segment: {'id': '2f186152-3244-4ac7-9a61-268e892ccb4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 338, 'network_id': '4b71592d-70d0-4093-95b2-aac46ce97cc3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:31:33.327348 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-417df6ac-5717-44cd-a26e-0b750dea9faa tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Network hostable DHCP agents. Network: 4b71592d-70d0-4093-95b2-aac46ce97cc3, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:31:33.373105 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-6844558d-7e03-456a-9819-8dc7e6f889dd tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Deleting subnet 67140727-f9f7-4047-9fd5-43683f7c06a7 {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:31:33.387712 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-b98ed0d2-10ec-4a41-9d94-566ac8878786 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] DELETE failed (client error): The resource could not be found. Nov 09 04:31:33.388848 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b98ed0d2-10ec-4a41-9d94-566ac8878786 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:31:33.391078 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-459355b4-6448-4cd7-88bb-6bb0e0661a62 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:33.392015 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-b98ed0d2-10ec-4a41-9d94-566ac8878786 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "DELETE /v2.0/networks/34540b11-0cc5-4059-9dc2-d2360b37c1c4 HTTP/1.1" status: 404 len: 339 time: 0.0824313 Nov 09 04:31:33.392928 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6844558d-7e03-456a-9819-8dc7e6f889dd tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:33.411785 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55452) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:33.422650 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4cddc517-6487-4cd8-aed9-50dbb17de1c1 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:33.458875 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-459355b4-6448-4cd7-88bb-6bb0e0661a62 None None] Pushing event updated for resources: {'Port': ['ID=5cca359a-c0bf-453d-a350-59ef893974e4,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:33.471260 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6844558d-7e03-456a-9819-8dc7e6f889dd tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:33.481650 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3da2ee1b-b078-4f39-b988-d389a54f146c None None] get_active_networks_info from dv-neutron-816802-2-hyperv {{(pid=102163) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}} Nov 09 04:31:33.484687 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-4cddc517-6487-4cd8-aed9-50dbb17de1c1 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9009edec-59ad-46af-a520-e6c0852ebf0d']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:33.501203 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-16a348ed-55a6-463a-b5f4-e37997c5df96 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Router b8b1c097-8cb2-4caa-bfe4-9e8b15227604 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:31:33.511634 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-0ff9d665-d46a-41c3-8469-2e9d30486155 None None] Could not find standard attr ID for object 03891abd-b2fb-4d81-b80b-a9984a414409. {{(pid=102163) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 09 04:31:33.512434 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-417df6ac-5717-44cd-a26e-0b750dea9faa tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Network 4b71592d-70d0-4093-95b2-aac46ce97cc3 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:31:33.539772 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-4cddc517-6487-4cd8-aed9-50dbb17de1c1 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '7425d687-add6-4065-ae0f-e86a77653f3b') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:33.540346 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-4cddc517-6487-4cd8-aed9-50dbb17de1c1 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '7425d687-add6-4065-ae0f-e86a77653f3b') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:33.583345 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4cddc517-6487-4cd8-aed9-50dbb17de1c1 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:33.603269 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-657b9eac-d6c4-4e44-b250-b60b3b574db7 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:33.608236 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-417df6ac-5717-44cd-a26e-0b750dea9faa tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 4b71592d-70d0-4093-95b2-aac46ce97cc3) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:33.608686 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4cddc517-6487-4cd8-aed9-50dbb17de1c1 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:33.630302 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4cddc517-6487-4cd8-aed9-50dbb17de1c1 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Releasing vlan 335 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:31:33.630881 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4cddc517-6487-4cd8-aed9-50dbb17de1c1 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:33.632752 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-417df6ac-5717-44cd-a26e-0b750dea9faa tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:33.634420 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-417df6ac-5717-44cd-a26e-0b750dea9faa tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:33.634661 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:31:33.634661 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:31:33.634661 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:31:33.634661 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:31:33.634661 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:31:33.634661 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:31:33.634661 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:31:33.634661 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:31:33.634661 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:31:33.634661 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:31:33.634661 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:31:33.634661 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:31:33.634661 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:31:33.634661 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:31:33.634661 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:31:33.634661 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:31:33.634661 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:31:33.634661 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:31:33.634661 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:31:33.634661 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:31:33.634661 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:31:33.634661 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:31:33.634661 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:31:33.634661 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:31:33.634661 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:31:33.634661 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:31:33.634661 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:31:33.634661 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:31:33.634661 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:31:33.634661 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:31:33.634661 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:31:33.634661 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:31:33.644382 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-16a348ed-55a6-463a-b5f4-e37997c5df96 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:31:33.652940 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-16a348ed-55a6-463a-b5f4-e37997c5df96 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "PUT /v2.0/routers/b8b1c097-8cb2-4caa-bfe4-9e8b15227604/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 5.9320142 Nov 09 04:31:33.655786 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55454) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:33.656625 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-5b518c70-48e9-4651-b9c7-94fc076a36fd tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Allocated IP 172.26.0.237 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/3cebcc02-772d-4914-8986-8fd16a236d90) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:31:33.665539 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eaaa7ba5-88ed-4296-aca8-4703f7e5f1c5 None None] Sync routers for ids ['b8b1c097-8cb2-4caa-bfe4-9e8b15227604'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:31:33.676599 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eaaa7ba5-88ed-4296-aca8-4703f7e5f1c5 None None] Routers {'b8b1c097-8cb2-4caa-bfe4-9e8b15227604'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:31:33.677571 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-eaaa7ba5-88ed-4296-aca8-4703f7e5f1c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:31:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['b8b1c097-8cb2-4caa-bfe4-9e8b15227604'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:33.717684 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-eaaa7ba5-88ed-4296-aca8-4703f7e5f1c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:33.723638 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dca37877-6072-4605-b21a-332876b50bd2 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:33.731331 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eaaa7ba5-88ed-4296-aca8-4703f7e5f1c5 None None] Routers {'b8b1c097-8cb2-4caa-bfe4-9e8b15227604'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:31:33.732528 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-eaaa7ba5-88ed-4296-aca8-4703f7e5f1c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:31:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['b8b1c097-8cb2-4caa-bfe4-9e8b15227604'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:33.734717 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6844558d-7e03-456a-9819-8dc7e6f889dd tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:33.743047 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-417df6ac-5717-44cd-a26e-0b750dea9faa tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.7902164 Nov 09 04:31:33.769496 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55456) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:33.774590 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-18f2da7d-38fe-4597-8fe0-1648c82da9f0 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Request body: {'port': {'network_id': '4b71592d-70d0-4093-95b2-aac46ce97cc3', 'name': 'tempest-PortsTestJSON-1436856259'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:33.782148 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-eaaa7ba5-88ed-4296-aca8-4703f7e5f1c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:33.783272 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eaaa7ba5-88ed-4296-aca8-4703f7e5f1c5 None None] The sync data for ids ['b8b1c097-8cb2-4caa-bfe4-9e8b15227604'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:31:33.798563 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3da2ee1b-b078-4f39-b988-d389a54f146c None None] Unable to find a vacant binding_index for network 4b71592d-70d0-4093-95b2-aac46ce97cc3 and agent cb24b282-9b2c-4486-bad1-b98e0db75839 {{(pid=102163) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:209}} Nov 09 04:31:33.809764 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3da2ee1b-b078-4f39-b988-d389a54f146c None None] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 4b71592d-70d0-4093-95b2-aac46ce97cc3) {{(pid=102163) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 09 04:31:33.870263 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 5cca359a-c0bf-453d-a350-59ef893974e4 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:31:33.917329 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4cddc517-6487-4cd8-aed9-50dbb17de1c1 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:33.959876 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.api.v2.resource [None req-bf13fc80-8dda-41c5-9fe7-70d33ee905e6 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] remove_router_interface failed (client error): The resource could not be found. Nov 09 04:31:33.964376 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-bf13fc80-8dda-41c5-9fe7-70d33ee905e6 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "PUT /v2.0/routers/b8b1c097-8cb2-4caa-bfe4-9e8b15227604/remove_router_interface HTTP/1.1" status: 404 len: 398 time: 0.3034816 Nov 09 04:31:33.964544 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4cddc517-6487-4cd8-aed9-50dbb17de1c1 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:33.965545 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55458) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:33.971599 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-4cddc517-6487-4cd8-aed9-50dbb17de1c1 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] 10.222.0.24 "DELETE /v2.0/networks/9009edec-59ad-46af-a520-e6c0852ebf0d HTTP/1.1" status: 204 len: 168 time: 3.9345236 Nov 09 04:31:33.975755 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-657b9eac-d6c4-4e44-b250-b60b3b574db7 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:33.976229 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55460) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:33.983323 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-21b6de07-26db-4af3-a0d6-28b68d08c568 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Request body: {'network': {'name': 'tempest-NetworksIpV6TestAttrs-test-network-1251058484'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:34.005167 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 5cca359a-c0bf-453d-a350-59ef893974e4 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:34.005167 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:34.009555 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cddc517-6487-4cd8-aed9-50dbb17de1c1 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Pushing event deleted for resources: {'Network': ['ID=9009edec-59ad-46af-a520-e6c0852ebf0d,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:34.015156 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-797f4de2-9c1b-4329-9f31-e8041d1a58e0 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "GET /v2.0/ports?device_id=b8b1c097-8cb2-4caa-bfe4-9e8b15227604 HTTP/1.1" status: 200 len: 205 time: 0.0483308 Nov 09 04:31:34.019916 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55462) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:34.045884 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-657b9eac-d6c4-4e44-b250-b60b3b574db7 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['58e0a9a1-6f0d-416b-a47b-26ea5282a8d9']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:34.066895 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-657b9eac-d6c4-4e44-b250-b60b3b574db7 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9a3aa6fe-359f-4370-b4c5-5e9759a7b161') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:34.067180 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-657b9eac-d6c4-4e44-b250-b60b3b574db7 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9a3aa6fe-359f-4370-b4c5-5e9759a7b161') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:34.068364 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6844558d-7e03-456a-9819-8dc7e6f889dd tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:34.088986 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-657b9eac-d6c4-4e44-b250-b60b3b574db7 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:34.093925 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5b518c70-48e9-4651-b9c7-94fc076a36fd tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:34.117418 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-657b9eac-d6c4-4e44-b250-b60b3b574db7 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:34.130927 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-21b6de07-26db-4af3-a0d6-28b68d08c568 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Made reservation on behalf of 6acf678d74da4512a431e262bbd32037 for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:34.133960 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-657b9eac-d6c4-4e44-b250-b60b3b574db7 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Releasing vlan 320 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:31:34.134352 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-657b9eac-d6c4-4e44-b250-b60b3b574db7 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:34.134856 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-21b6de07-26db-4af3-a0d6-28b68d08c568 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:34.137399 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6844558d-7e03-456a-9819-8dc7e6f889dd tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event deleted for resources: {'Subnet': ['ID=67140727-f9f7-4047-9fd5-43683f7c06a7,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:34.137569 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:31:34.137569 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:31:34.137569 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:31:34.137569 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:31:34.137569 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:31:34.137569 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:31:34.137569 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:31:34.137569 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:31:34.137569 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:31:34.137569 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:31:34.137569 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:31:34.137569 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:31:34.137569 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:31:34.137569 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:31:34.137569 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:31:34.137569 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:31:34.137569 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:31:34.137569 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:31:34.137569 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:31:34.137569 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:31:34.137569 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:31:34.137569 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:31:34.137569 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:31:34.137569 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:31:34.137569 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:31:34.137569 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:31:34.137569 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:31:34.137569 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:31:34.137569 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:31:34.137569 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:31:34.137569 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:31:34.137569 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:31:34.142706 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6844558d-7e03-456a-9819-8dc7e6f889dd tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:34.148336 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-6844558d-7e03-456a-9819-8dc7e6f889dd tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/67140727-f9f7-4047-9fd5-43683f7c06a7 HTTP/1.1" status: 204 len: 168 time: 1.3916962 Nov 09 04:31:34.148823 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-617d514d-2496-4e07-95b1-4d77b6fb3d03 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for router, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:34.155381 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55464) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:34.206543 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fd1dac67-3a73-492b-ab55-ff0beb230f5f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-4b71592d-70d0-4093-95b2-aac46ce97cc3', 'network_id': '4b71592d-70d0-4093-95b2-aac46ce97cc3', 'tenant_id': '88f9f8da29bf4a8793b45130d483a6e6', 'fixed_ips': [{'subnet_id': '437c42c6-b7c7-44c0-b5de-f9e368fcfb4a'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:31:34.207402 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-fd1dac67-3a73-492b-ab55-ff0beb230f5f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:34.221208 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 830f53d5-aa7d-4a58-b347-5c259d19a5be no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:31:34.239889 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-55fcad4d-f8b7-4808-a965-6e886ae05a8b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0787637 Nov 09 04:31:34.242432 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55466) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:34.243876 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 830f53d5-aa7d-4a58-b347-5c259d19a5be {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:31:34.247763 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 830f53d5-aa7d-4a58-b347-5c259d19a5be not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:31:34.255224 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-21b6de07-26db-4af3-a0d6-28b68d08c568 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 341} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:31:34.265155 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-18f2da7d-38fe-4597-8fe0-1648c82da9f0 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Made reservation on behalf of 88f9f8da29bf4a8793b45130d483a6e6 for: {'port': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:34.269005 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-18f2da7d-38fe-4597-8fe0-1648c82da9f0 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:34.312143 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [None req-18f2da7d-38fe-4597-8fe0-1648c82da9f0 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] device_id is not set on port dd8ca3d6-4dec-4e1f-99e4-8d77ad7ba47f yet. {{(pid=102161) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:31:34.353745 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-21b6de07-26db-4af3-a0d6-28b68d08c568 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:34.354221 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-21b6de07-26db-4af3-a0d6-28b68d08c568 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Added segment 3b7d7d8b-6cf8-4405-beec-ebfe913df0ab of type vlan for network eee30c13-c6dc-4255-8ec9-5487496489dd Nov 09 04:31:34.368283 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-617d514d-2496-4e07-95b1-4d77b6fb3d03 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:34.371191 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-fd1dac67-3a73-492b-ab55-ff0beb230f5f None None] Allocated IP 172.20.0.2 (4b71592d-70d0-4093-95b2-aac46ce97cc3/437c42c6-b7c7-44c0-b5de-f9e368fcfb4a/a38deaf7-04e8-49cf-b2ac-8058e68dc5bb) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:31:34.371639 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-617d514d-2496-4e07-95b1-4d77b6fb3d03 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:34.372392 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ce98fd4e-612c-4ce9-9526-b672949558af tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:34.376362 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-ce98fd4e-612c-4ce9-9526-b672949558af tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/ports HTTP/1.1" status: 200 len: 866 time: 0.1286142 Nov 09 04:31:34.381070 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5b518c70-48e9-4651-b9c7-94fc076a36fd tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:34.382820 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-657b9eac-d6c4-4e44-b250-b60b3b574db7 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:34.385087 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55470) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:34.438093 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-21b6de07-26db-4af3-a0d6-28b68d08c568 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:34.453499 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-657b9eac-d6c4-4e44-b250-b60b3b574db7 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:34.456717 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-657b9eac-d6c4-4e44-b250-b60b3b574db7 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "DELETE /v2.0/networks/58e0a9a1-6f0d-416b-a47b-26ea5282a8d9 HTTP/1.1" status: 204 len: 168 time: 1.0440025 Nov 09 04:31:34.459353 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55472) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:34.490907 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-8c98be62-79ff-43d8-b568-26f9416bfc05 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] DELETE failed (client error): The resource could not be found. Nov 09 04:31:34.492249 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-8c98be62-79ff-43d8-b568-26f9416bfc05 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:31:34.495628 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-8c98be62-79ff-43d8-b568-26f9416bfc05 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "DELETE /v2.0/subnets/a3e2e2e8-fb66-4d71-950c-ea808ef30228 HTTP/1.1" status: 404 len: 337 time: 0.0350995 Nov 09 04:31:34.498706 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55474) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:34.509562 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-657b9eac-d6c4-4e44-b250-b60b3b574db7 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event deleted for resources: {'Network': ['ID=58e0a9a1-6f0d-416b-a47b-26ea5282a8d9,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:34.522569 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-6f8774b1-f13b-468b-8e37-86a3e5ecad2a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] DELETE failed (client error): The resource could not be found. Nov 09 04:31:34.523216 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-6f8774b1-f13b-468b-8e37-86a3e5ecad2a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:31:34.524950 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5b518c70-48e9-4651-b9c7-94fc076a36fd tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:31:34.526275 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-6f8774b1-f13b-468b-8e37-86a3e5ecad2a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "DELETE /v2.0/networks/515a4841-6c09-4d97-9765-9efc12ff470f HTTP/1.1" status: 404 len: 339 time: 0.0263393 Nov 09 04:31:34.528864 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55476) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:34.538335 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-617d514d-2496-4e07-95b1-4d77b6fb3d03 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:34.541816 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-617d514d-2496-4e07-95b1-4d77b6fb3d03 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Fanout notify agent at l3_agent the message router_deleted on router b8b1c097-8cb2-4caa-bfe4-9e8b15227604 {{(pid=102162) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:31:34.541936 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-fd1dac67-3a73-492b-ab55-ff0beb230f5f None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:34.550908 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-5b518c70-48e9-4651-b9c7-94fc076a36fd tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:34.555370 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-dca37877-6072-4605-b21a-332876b50bd2 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Allocated IP 172.26.0.145 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/8f7c00e8-88ad-4eef-acf1-1a9ed282ba0b) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:31:34.557685 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5b518c70-48e9-4651-b9c7-94fc076a36fd tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:31:34.561761 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-617d514d-2496-4e07-95b1-4d77b6fb3d03 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:34.561939 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b518c70-48e9-4651-b9c7-94fc076a36fd tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Pushing event updated for resources: {'Port': ['ID=3cebcc02-772d-4914-8986-8fd16a236d90,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:34.565265 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-617d514d-2496-4e07-95b1-4d77b6fb3d03 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "DELETE /v2.0/routers/b8b1c097-8cb2-4caa-bfe4-9e8b15227604 HTTP/1.1" status: 204 len: 168 time: 0.5433514 Nov 09 04:31:34.566519 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55478) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:34.574399 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-21b6de07-26db-4af3-a0d6-28b68d08c568 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:34.580572 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-21b6de07-26db-4af3-a0d6-28b68d08c568 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:34.581161 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-21b6de07-26db-4af3-a0d6-28b68d08c568 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:34.583580 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-3a4ffd28-7966-463e-af9d-a912ade05223 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] DELETE failed (client error): The resource could not be found. Nov 09 04:31:34.584004 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-3a4ffd28-7966-463e-af9d-a912ade05223 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:31:34.586945 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-3a4ffd28-7966-463e-af9d-a912ade05223 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "DELETE /v2.0/subnets/553b0892-90f3-4894-b443-571a5b0ef1a0 HTTP/1.1" status: 404 len: 337 time: 0.0571356 Nov 09 04:31:34.592412 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cb16966b-6c00-4378-8921-3e1770dcf84c tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:34.593879 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-cb16966b-6c00-4378-8921-3e1770dcf84c tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.1852233 Nov 09 04:31:34.596360 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55480) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:34.601031 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55482) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:34.619586 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-fd1dac67-3a73-492b-ab55-ff0beb230f5f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:34.650623 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-b79bf72f-59ae-4cec-9bad-fbfea634a725 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0484908 Nov 09 04:31:34.659210 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55484) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:34.664058 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-92fe7af7-a3cd-45ab-9ae1-d6bba3e6ff24 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'subnet': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:34.676576 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fd1dac67-3a73-492b-ab55-ff0beb230f5f None None] Network 4b71592d-70d0-4093-95b2-aac46ce97cc3 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:31:34.680816 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-fd1dac67-3a73-492b-ab55-ff0beb230f5f None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:34.683903 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fd1dac67-3a73-492b-ab55-ff0beb230f5f None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:31:34.686929 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd1dac67-3a73-492b-ab55-ff0beb230f5f None None] Pushing event updated for resources: {'Port': ['ID=a38deaf7-04e8-49cf-b2ac-8058e68dc5bb,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:34.700265 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-9ff57e70-deda-4238-b8ea-8ae2937e555f tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] DELETE failed (client error): The resource could not be found. Nov 09 04:31:34.700538 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9ff57e70-deda-4238-b8ea-8ae2937e555f tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:31:34.703529 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-9ff57e70-deda-4238-b8ea-8ae2937e555f tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "DELETE /v2.0/networks/ac222708-3380-42f2-a528-a2319594bae1 HTTP/1.1" status: 404 len: 339 time: 0.0896916 Nov 09 04:31:34.720636 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55486) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:34.747256 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-fd1dac67-3a73-492b-ab55-ff0beb230f5f None None] Attempting to bind port a38deaf7-04e8-49cf-b2ac-8058e68dc5bb on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:31:34.747740 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-21b6de07-26db-4af3-a0d6-28b68d08c568 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 789 time: 0.7691936 Nov 09 04:31:34.747881 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-fd1dac67-3a73-492b-ab55-ff0beb230f5f None None] Attempting to bind port a38deaf7-04e8-49cf-b2ac-8058e68dc5bb by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '2f186152-3244-4ac7-9a61-268e892ccb4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 338, 'network_id': '4b71592d-70d0-4093-95b2-aac46ce97cc3'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:31:34.748332 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fd1dac67-3a73-492b-ab55-ff0beb230f5f None None] Attempting to bind port a38deaf7-04e8-49cf-b2ac-8058e68dc5bb on network 4b71592d-70d0-4093-95b2-aac46ce97cc3 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:31:34.753435 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fd1dac67-3a73-492b-ab55-ff0beb230f5f None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 31, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:31:34.753913 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fd1dac67-3a73-492b-ab55-ff0beb230f5f None None] Checking segment: {'id': '2f186152-3244-4ac7-9a61-268e892ccb4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 338, 'network_id': '4b71592d-70d0-4093-95b2-aac46ce97cc3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:31:34.754446 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-fd1dac67-3a73-492b-ab55-ff0beb230f5f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:34.754920 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fd1dac67-3a73-492b-ab55-ff0beb230f5f None None] Bound using segment: {'id': '2f186152-3244-4ac7-9a61-268e892ccb4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 338, 'network_id': '4b71592d-70d0-4093-95b2-aac46ce97cc3'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:31:34.755471 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-fd1dac67-3a73-492b-ab55-ff0beb230f5f None None] Bound port: a38deaf7-04e8-49cf-b2ac-8058e68dc5bb, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2f186152-3244-4ac7-9a61-268e892ccb4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 338, 'network_id': '4b71592d-70d0-4093-95b2-aac46ce97cc3'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:31:34.755940 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-fd1dac67-3a73-492b-ab55-ff0beb230f5f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:34.764616 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55488) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:34.776366 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-1f94336d-fa75-4fc8-ad05-56137a7018db tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Request body: {'subnet': {'network_id': 'eee30c13-c6dc-4255-8ec9-5487496489dd', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:34.795977 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-3953737c-c46e-4363-9462-1923768fcd1f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Deleting subnet 4b3485de-3625-4aed-aab6-5ac993d0f4c3 {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:31:34.801807 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-a9e8af8f-ffdc-42c9-b35f-02497b37bb4d tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] DELETE failed (client error): The resource could not be found. Nov 09 04:31:34.802262 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a9e8af8f-ffdc-42c9-b35f-02497b37bb4d tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:31:34.807729 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a9e8af8f-ffdc-42c9-b35f-02497b37bb4d tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "DELETE /v2.0/subnets/c31edbab-096a-4d5c-80c7-21775d0297d8 HTTP/1.1" status: 404 len: 337 time: 0.0837328 Nov 09 04:31:34.807729 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21b6de07-26db-4af3-a0d6-28b68d08c568 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Pushing event updated for resources: {'Network': ['ID=eee30c13-c6dc-4255-8ec9-5487496489dd,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:34.809378 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55490) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:34.811333 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3953737c-c46e-4363-9462-1923768fcd1f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:34.831124 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network eee30c13-c6dc-4255-8ec9-5487496489dd details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:31:34.849133 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-fd1dac67-3a73-492b-ab55-ff0beb230f5f None None] For port a38deaf7-04e8-49cf-b2ac-8058e68dc5bb, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:31:34.873597 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3953737c-c46e-4363-9462-1923768fcd1f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:34.914728 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-18f2da7d-38fe-4597-8fe0-1648c82da9f0 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Allocated IP 172.20.0.7 (4b71592d-70d0-4093-95b2-aac46ce97cc3/437c42c6-b7c7-44c0-b5de-f9e368fcfb4a/dd8ca3d6-4dec-4e1f-99e4-8d77ad7ba47f) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:31:34.916549 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-fd1dac67-3a73-492b-ab55-ff0beb230f5f None None] For port a38deaf7-04e8-49cf-b2ac-8058e68dc5bb, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=a38deaf7-04e8-49cf-b2ac-8058e68dc5bb,segment=NetworkSegment(2f186152-3244-4ac7-9a61-268e892ccb4c),segment_id=2f186152-3244-4ac7-9a61-268e892ccb4c)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:31:34.919196 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-49a28b9d-a97c-4925-94fe-140883c18279 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] DELETE failed (client error): The resource could not be found. Nov 09 04:31:34.920353 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-49a28b9d-a97c-4925-94fe-140883c18279 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:31:34.923420 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-49a28b9d-a97c-4925-94fe-140883c18279 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "DELETE /v2.0/networks/f1806145-f899-452a-9fed-c9a23870b515 HTTP/1.1" status: 404 len: 339 time: 0.1124282 Nov 09 04:31:34.926286 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55492) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:34.974941 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-c6559e58-d68f-4b45-8a07-24bc9c4b8a5a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] DELETE failed (client error): The resource could not be found. Nov 09 04:31:34.976288 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c6559e58-d68f-4b45-8a07-24bc9c4b8a5a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:31:34.979820 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-c6559e58-d68f-4b45-8a07-24bc9c4b8a5a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "DELETE /v2.0/subnets/93d26cc7-2350-4f28-b358-8bc13b541762 HTTP/1.1" status: 404 len: 337 time: 0.0524554 Nov 09 04:31:34.984311 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55494) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:34.996542 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-fd1dac67-3a73-492b-ab55-ff0beb230f5f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:35.009033 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dca37877-6072-4605-b21a-332876b50bd2 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:35.016166 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-e5ca4a9e-a653-4f29-af81-60c3e479f417 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] DELETE failed (client error): The resource could not be found. Nov 09 04:31:35.016720 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e5ca4a9e-a653-4f29-af81-60c3e479f417 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:31:35.022143 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e5ca4a9e-a653-4f29-af81-60c3e479f417 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "DELETE /v2.0/networks/e6c58b7d-aeed-4bbf-9856-1d53b3644115 HTTP/1.1" status: 404 len: 339 time: 0.0346553 Nov 09 04:31:35.022397 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55496) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:35.031788 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3953737c-c46e-4363-9462-1923768fcd1f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:35.057317 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd1dac67-3a73-492b-ab55-ff0beb230f5f None None] Pushing event updated for resources: {'Port': ['ID=a38deaf7-04e8-49cf-b2ac-8058e68dc5bb,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:35.075281 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-92fe7af7-a3cd-45ab-9ae1-d6bba3e6ff24 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:35.079194 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-92fe7af7-a3cd-45ab-9ae1-d6bba3e6ff24 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:35.085882 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-aecc59f5-8193-41ec-b63f-2443d4a51eab tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] DELETE failed (client error): The resource could not be found. Nov 09 04:31:35.086335 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-aecc59f5-8193-41ec-b63f-2443d4a51eab tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:31:35.091779 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-aecc59f5-8193-41ec-b63f-2443d4a51eab tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "DELETE /v2.0/subnets/eb210d12-d586-4808-8538-959ecc2a7819 HTTP/1.1" status: 404 len: 337 time: 0.0661185 Nov 09 04:31:35.108479 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55498) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:35.173965 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-a896c51f-ab50-4dd5-a10c-bc0b8bc681b8 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] DELETE failed (client error): The resource could not be found. Nov 09 04:31:35.173965 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a896c51f-ab50-4dd5-a10c-bc0b8bc681b8 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:31:35.178465 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a896c51f-ab50-4dd5-a10c-bc0b8bc681b8 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "DELETE /v2.0/networks/db90cb04-d853-4680-bcb2-8a3f67843e79 HTTP/1.1" status: 404 len: 339 time: 0.0672014 Nov 09 04:31:35.181284 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55500) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:35.346867 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3953737c-c46e-4363-9462-1923768fcd1f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:35.387820 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3953737c-c46e-4363-9462-1923768fcd1f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event deleted for resources: {'Subnet': ['ID=4b3485de-3625-4aed-aab6-5ac993d0f4c3,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:35.396599 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3953737c-c46e-4363-9462-1923768fcd1f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:35.402941 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-3953737c-c46e-4363-9462-1923768fcd1f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "DELETE /v2.0/subnets/4b3485de-3625-4aed-aab6-5ac993d0f4c3 HTTP/1.1" status: 204 len: 168 time: 0.8353245 Nov 09 04:31:35.403596 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55502) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:35.477284 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-92fe7af7-a3cd-45ab-9ae1-d6bba3e6ff24 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:35.531247 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-92fe7af7-a3cd-45ab-9ae1-d6bba3e6ff24 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:31:35.537693 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-85d98cde-368c-40ce-ac2e-e545ea3492b0 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:35.543305 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-92fe7af7-a3cd-45ab-9ae1-d6bba3e6ff24 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:35.549113 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-92fe7af7-a3cd-45ab-9ae1-d6bba3e6ff24 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:35.549706 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-92fe7af7-a3cd-45ab-9ae1-d6bba3e6ff24 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:35.562542 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92fe7af7-a3cd-45ab-9ae1-d6bba3e6ff24 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Subnet': ['ID=6c3c1072-37d8-461c-8a31-3789e3e5eaf7,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:35.571150 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-c5e6808a-36cc-46e3-84fd-a28776232e05 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] DELETE failed (client error): The resource could not be found. Nov 09 04:31:35.572325 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c5e6808a-36cc-46e3-84fd-a28776232e05 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:31:35.575622 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-c5e6808a-36cc-46e3-84fd-a28776232e05 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "DELETE /v2.0/subnets/a23c1d35-7377-416a-afd7-f17bae47cfc9 HTTP/1.1" status: 404 len: 337 time: 0.3932908 Nov 09 04:31:35.578225 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55506) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:35.583577 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dca37877-6072-4605-b21a-332876b50bd2 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:35.585370 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1f94336d-fa75-4fc8-ad05-56137a7018db tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Made reservation on behalf of 6acf678d74da4512a431e262bbd32037 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:35.589148 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1f94336d-fa75-4fc8-ad05-56137a7018db tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:35.620002 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-87ba6e6d-e85a-4029-9175-784e3945d082 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] DELETE failed (client error): The resource could not be found. Nov 09 04:31:35.620555 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-87ba6e6d-e85a-4029-9175-784e3945d082 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:31:35.626600 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-87ba6e6d-e85a-4029-9175-784e3945d082 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "DELETE /v2.0/networks/f16672d2-3d55-4ccc-844f-a1ab468ad9db HTTP/1.1" status: 404 len: 339 time: 0.0450425 Nov 09 04:31:35.627201 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55508) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:35.640275 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-92fe7af7-a3cd-45ab-9ae1-d6bba3e6ff24 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.9775445 Nov 09 04:31:35.652178 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55510) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:35.659823 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-2b96902b-a7c0-4b62-854e-a6142f2a1df0 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] DELETE failed (client error): The resource could not be found. Nov 09 04:31:35.660278 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2b96902b-a7c0-4b62-854e-a6142f2a1df0 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:31:35.663481 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-2b96902b-a7c0-4b62-854e-a6142f2a1df0 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "DELETE /v2.0/subnets/8e52d510-3a3d-4e0d-bb67-46938c0bbbc3 HTTP/1.1" status: 404 len: 337 time: 0.0353487 Nov 09 04:31:35.666437 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55512) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:35.670557 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-38acd7a2-dd73-47b8-af88-74b8efe32f55 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'port': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'fixed_ips': [{'subnet_id': '6c3c1072-37d8-461c-8a31-3789e3e5eaf7', 'ip_address': '2001:db8::d99f:dceb:2dbf:197c'}], 'name': 'tempest-NetworksTestDHCPv6-774485479'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:35.687210 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-18f2da7d-38fe-4597-8fe0-1648c82da9f0 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:35.691888 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-5f0a012b-df38-4fe4-9b85-7d46ae3f8c0a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] DELETE failed (client error): The resource could not be found. Nov 09 04:31:35.692511 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5f0a012b-df38-4fe4-9b85-7d46ae3f8c0a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:31:35.695735 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-5f0a012b-df38-4fe4-9b85-7d46ae3f8c0a tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "DELETE /v2.0/networks/58a373ab-b4cf-47d5-bc63-c38afd9d795e HTTP/1.1" status: 404 len: 339 time: 0.0284121 Nov 09 04:31:35.698710 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55514) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:35.700939 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dca37877-6072-4605-b21a-332876b50bd2 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:31:35.727290 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-85d98cde-368c-40ce-ac2e-e545ea3492b0 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Deleting port fa3ed53c-9d43-4ea3-b780-2ad74f003fed {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:31:35.727630 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-85d98cde-368c-40ce-ac2e-e545ea3492b0 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:35.730541 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-f94e072d-16be-49e8-be13-8029bd606698 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] DELETE failed (client error): The resource could not be found. Nov 09 04:31:35.730998 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-f94e072d-16be-49e8-be13-8029bd606698 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:31:35.734669 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-f94e072d-16be-49e8-be13-8029bd606698 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "DELETE /v2.0/subnets/17925b38-b947-433f-a9f5-c6477a234b2f HTTP/1.1" status: 404 len: 337 time: 0.0352912 Nov 09 04:31:35.743770 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55516) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:35.749318 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-dca37877-6072-4605-b21a-332876b50bd2 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:35.767758 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dca37877-6072-4605-b21a-332876b50bd2 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:31:35.788916 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5b518c70-48e9-4651-b9c7-94fc076a36fd tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks [] for router_gateway, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:35.811249 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-85d98cde-368c-40ce-ac2e-e545ea3492b0 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] For port fa3ed53c-9d43-4ea3-b780-2ad74f003fed, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=fa3ed53c-9d43-4ea3-b780-2ad74f003fed,segment=NetworkSegment(ab066ae5-0f1f-4c66-aa12-5d1f0c9bbe81),segment_id=ab066ae5-0f1f-4c66-aa12-5d1f0c9bbe81)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:31:35.811249 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-85d98cde-368c-40ce-ac2e-e545ea3492b0 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:35.830789 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device a38deaf7-04e8-49cf-b2ac-8058e68dc5bb up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:31:35.833387 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-85d98cde-368c-40ce-ac2e-e545ea3492b0 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Calling delete_port for fa3ed53c-9d43-4ea3-b780-2ad74f003fed owned by network:dhcp {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:31:35.845938 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dca37877-6072-4605-b21a-332876b50bd2 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Pushing event updated for resources: {'Port': ['ID=8f7c00e8-88ad-4eef-acf1-1a9ed282ba0b,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:35.889141 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-1176054a-6a0a-4e33-92a6-eccb33d42ea2 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] DELETE failed (client error): The resource could not be found. Nov 09 04:31:35.889769 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-1176054a-6a0a-4e33-92a6-eccb33d42ea2 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:31:35.896020 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1176054a-6a0a-4e33-92a6-eccb33d42ea2 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "DELETE /v2.0/networks/4a546e0a-7b29-4243-aab6-ce90674959a5 HTTP/1.1" status: 404 len: 339 time: 0.1440258 Nov 09 04:31:35.898635 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55518) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:35.921285 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port a38deaf7-04e8-49cf-b2ac-8058e68dc5bb triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:35.921988 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:35.977787 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-034cd406-60da-4a0e-bb48-773aedb04b83 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Deleting subnet 366772a4-c45a-4129-af01-4f834e98308c {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:31:35.981865 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-034cd406-60da-4a0e-bb48-773aedb04b83 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:36.034302 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-034cd406-60da-4a0e-bb48-773aedb04b83 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:36.042437 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:36.080169 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port a38deaf7-04e8-49cf-b2ac-8058e68dc5bb, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=a38deaf7-04e8-49cf-b2ac-8058e68dc5bb,segment=NetworkSegment(2f186152-3244-4ac7-9a61-268e892ccb4c),segment_id=2f186152-3244-4ac7-9a61-268e892ccb4c)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:31:36.157410 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:36.233687 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=a38deaf7-04e8-49cf-b2ac-8058e68dc5bb,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:36.250798 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4c0b8d37-93c2-4b61-9eb7-08f585e7387e None None] get_active_networks_info from dv-neutron-816802-2-hyperv {{(pid=102163) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}} Nov 09 04:31:36.261368 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-18f2da7d-38fe-4597-8fe0-1648c82da9f0 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:36.301761 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-bef2447e-0523-4b6d-a82d-5088996984ab None None] Provisioning complete for port a38deaf7-04e8-49cf-b2ac-8058e68dc5bb triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:36.302174 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-bef2447e-0523-4b6d-a82d-5088996984ab None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:36.306544 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-85d98cde-368c-40ce-ac2e-e545ea3492b0 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:36.338627 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85d98cde-368c-40ce-ac2e-e545ea3492b0 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event deleted for resources: {'Port': ['ID=fa3ed53c-9d43-4ea3-b780-2ad74f003fed,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:36.347668 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-85d98cde-368c-40ce-ac2e-e545ea3492b0 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] No DVR routers for this DVR port fa3ed53c-9d43-4ea3-b780-2ad74f003fed on host dv-neutron-816802-2-hyperv {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:31:36.422583 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-38acd7a2-dd73-47b8-af88-74b8efe32f55 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'port': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:36.432015 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4c0b8d37-93c2-4b61-9eb7-08f585e7387e None None] Resources bound (agent type, host, resource id): {{(pid=102163) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 09 04:31:36.448698 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-18f2da7d-38fe-4597-8fe0-1648c82da9f0 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Network 4b71592d-70d0-4093-95b2-aac46ce97cc3 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:31:36.459035 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1f94336d-fa75-4fc8-ad05-56137a7018db tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:36.467214 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-85d98cde-368c-40ce-ac2e-e545ea3492b0 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:36.476900 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-18f2da7d-38fe-4597-8fe0-1648c82da9f0 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:36.477936 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18f2da7d-38fe-4597-8fe0-1648c82da9f0 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event updated for resources: {'Port': ['ID=dd8ca3d6-4dec-4e1f-99e4-8d77ad7ba47f,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:36.485862 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-18f2da7d-38fe-4597-8fe0-1648c82da9f0 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:31:36.496170 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-034cd406-60da-4a0e-bb48-773aedb04b83 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:36.500717 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-85d98cde-368c-40ce-ac2e-e545ea3492b0 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6e2848bc-b428-4045-8127-510baced6460']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:36.531265 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-85d98cde-368c-40ce-ac2e-e545ea3492b0 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ab066ae5-0f1f-4c66-aa12-5d1f0c9bbe81') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:36.531848 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-85d98cde-368c-40ce-ac2e-e545ea3492b0 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ab066ae5-0f1f-4c66-aa12-5d1f0c9bbe81') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:36.548842 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-85d98cde-368c-40ce-ac2e-e545ea3492b0 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:36.570694 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-85d98cde-368c-40ce-ac2e-e545ea3492b0 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:36.582139 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-85d98cde-368c-40ce-ac2e-e545ea3492b0 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Releasing vlan 312 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:31:36.586512 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-85d98cde-368c-40ce-ac2e-e545ea3492b0 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:36.586512 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:31:36.586512 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:31:36.586512 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:31:36.586512 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:31:36.586512 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:31:36.586512 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:31:36.586512 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:31:36.586512 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:31:36.586512 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:31:36.586512 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:31:36.586512 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:31:36.586512 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:31:36.586512 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:31:36.586512 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:31:36.586512 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:31:36.586512 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:31:36.586512 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:31:36.586512 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:31:36.586512 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:31:36.586512 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:31:36.586512 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:31:36.586512 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:31:36.586512 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:31:36.586512 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:31:36.586512 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:31:36.586512 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:31:36.586512 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:31:36.586512 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:31:36.586512 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:31:36.586512 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:31:36.586512 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:31:36.586512 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:31:36.693376 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-034cd406-60da-4a0e-bb48-773aedb04b83 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:36.714032 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5b518c70-48e9-4651-b9c7-94fc076a36fd tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:36.722626 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-034cd406-60da-4a0e-bb48-773aedb04b83 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event deleted for resources: {'Subnet': ['ID=366772a4-c45a-4129-af01-4f834e98308c,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:36.726251 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-85d98cde-368c-40ce-ac2e-e545ea3492b0 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:36.734090 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-85d98cde-368c-40ce-ac2e-e545ea3492b0 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:36.741505 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-85d98cde-368c-40ce-ac2e-e545ea3492b0 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "DELETE /v2.0/networks/6e2848bc-b428-4045-8127-510baced6460 HTTP/1.1" status: 204 len: 168 time: 1.3364968 Nov 09 04:31:36.742377 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-034cd406-60da-4a0e-bb48-773aedb04b83 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:36.744212 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f94336d-fa75-4fc8-ad05-56137a7018db tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Pushing event updated for resources: {'Subnet': ['ID=4ac558bd-1cff-41b6-ad18-f310e319efa7,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:36.745493 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-034cd406-60da-4a0e-bb48-773aedb04b83 tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "DELETE /v2.0/subnets/366772a4-c45a-4129-af01-4f834e98308c HTTP/1.1" status: 204 len: 168 time: 0.8456593 Nov 09 04:31:36.748023 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55522) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:36.748567 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55524) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:36.753635 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-4220f240-8a31-425c-9782-1ab8f049de26 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Request body: {'network': {'name': 'tempest-RoutersTest-1391191836'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:36.770649 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-18f2da7d-38fe-4597-8fe0-1648c82da9f0 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:36.771252 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-18f2da7d-38fe-4597-8fe0-1648c82da9f0 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:36.792316 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85d98cde-368c-40ce-ac2e-e545ea3492b0 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event deleted for resources: {'Network': ['ID=6e2848bc-b428-4045-8127-510baced6460,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:36.816334 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-38acd7a2-dd73-47b8-af88-74b8efe32f55 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:36.856344 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5ce22031-17d3-4f2d-96b2-f4bb52250d0e tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:36.881483 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-83abd9bb-0d70-4c18-a3c8-ca5528289b02 None None] Network 4b71592d-70d0-4093-95b2-aac46ce97cc3 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:36.909953 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-89936095-7f87-40e0-896f-222662f989d3 None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:36.913164 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a3895cd7-169e-41e4-9a5a-78e66c094225 None None] Network 6e2848bc-b428-4045-8127-510baced6460 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:36.914188 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-5ce22031-17d3-4f2d-96b2-f4bb52250d0e tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Deleting port a1b1ba13-9d9c-4bc5-8c09-5a9619df2802 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:31:36.914579 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5ce22031-17d3-4f2d-96b2-f4bb52250d0e tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:36.956818 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1f94336d-fa75-4fc8-ad05-56137a7018db tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Checking segment: {'id': '3b7d7d8b-6cf8-4405-beec-ebfe913df0ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 341, 'network_id': 'eee30c13-c6dc-4255-8ec9-5487496489dd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:31:36.957132 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1f94336d-fa75-4fc8-ad05-56137a7018db tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Network hostable DHCP agents. Network: eee30c13-c6dc-4255-8ec9-5487496489dd, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:31:36.964667 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4220f240-8a31-425c-9782-1ab8f049de26 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Made reservation on behalf of 188f23ef0cb54006875c672b78f5249f for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:36.965870 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a3895cd7-169e-41e4-9a5a-78e66c094225 None None] Network 6e2848bc-b428-4045-8127-510baced6460 could not be found, it might have been deleted concurrently. {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:225}} Nov 09 04:31:36.972284 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4220f240-8a31-425c-9782-1ab8f049de26 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:36.972454 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [None req-38acd7a2-dd73-47b8-af88-74b8efe32f55 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] device_id is not set on port aed3591a-5327-45ab-8bfc-73eccafb40bf yet. {{(pid=102161) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:31:36.975006 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-004fa843-67e4-4d37-9a80-a8f8510f6675 None None] Network 3669a9e4-d853-4e8c-90ad-c544516ed2c5 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:37.002150 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-5ce22031-17d3-4f2d-96b2-f4bb52250d0e tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] For port a1b1ba13-9d9c-4bc5-8c09-5a9619df2802, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=a1b1ba13-9d9c-4bc5-8c09-5a9619df2802,segment=NetworkSegment(b5cec454-4fbe-451b-b90e-7cf65688ef8c),segment_id=b5cec454-4fbe-451b-b90e-7cf65688ef8c)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:31:37.002542 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5ce22031-17d3-4f2d-96b2-f4bb52250d0e tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:37.019884 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-5ce22031-17d3-4f2d-96b2-f4bb52250d0e tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Calling delete_port for a1b1ba13-9d9c-4bc5-8c09-5a9619df2802 owned by network:dhcp {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:31:37.025598 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4220f240-8a31-425c-9782-1ab8f049de26 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 302} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:31:37.041548 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4220f240-8a31-425c-9782-1ab8f049de26 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:37.041914 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-4220f240-8a31-425c-9782-1ab8f049de26 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Added segment d2b8b706-bc72-4a78-bf25-9333dc47e65b of type vlan for network e3317a1c-ad42-41af-9362-06b75b19b024 Nov 09 04:31:37.083873 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ff634d4d-1c74-4958-800b-8070b36993ce None None] DHCP port deletion for 6e2848bc-b428-4045-8127-510baced6460 request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:31:37.085832 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-18f2da7d-38fe-4597-8fe0-1648c82da9f0 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 924 time: 3.3152647 Nov 09 04:31:37.088912 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55528) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:37.098633 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-b3d32246-7488-4f4a-ad93-246e373a6348 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Request body: {'port': {'network_id': '4b71592d-70d0-4093-95b2-aac46ce97cc3', 'name': 'tempest-PortsTestJSON-2042048594'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:37.190536 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4220f240-8a31-425c-9782-1ab8f049de26 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:37.245345 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1f94336d-fa75-4fc8-ad05-56137a7018db tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Network eee30c13-c6dc-4255-8ec9-5487496489dd is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:31:37.305886 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4220f240-8a31-425c-9782-1ab8f049de26 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:37.312215 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dca37877-6072-4605-b21a-332876b50bd2 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:37.317002 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4220f240-8a31-425c-9782-1ab8f049de26 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:37.318242 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4220f240-8a31-425c-9782-1ab8f049de26 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:37.332819 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5ce22031-17d3-4f2d-96b2-f4bb52250d0e tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:37.375203 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-1f94336d-fa75-4fc8-ad05-56137a7018db tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, eee30c13-c6dc-4255-8ec9-5487496489dd) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:37.380037 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1f94336d-fa75-4fc8-ad05-56137a7018db tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:37.380918 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1f94336d-fa75-4fc8-ad05-56137a7018db tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:37.403454 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b3d32246-7488-4f4a-ad93-246e373a6348 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Made reservation on behalf of 88f9f8da29bf4a8793b45130d483a6e6 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:37.407281 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b3d32246-7488-4f4a-ad93-246e373a6348 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:37.410117 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cb5b80bc-c076-44cb-be76-1765c5ddece1 None None] Network eee30c13-c6dc-4255-8ec9-5487496489dd requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:37.411167 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ce22031-17d3-4f2d-96b2-f4bb52250d0e tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event deleted for resources: {'Port': ['ID=a1b1ba13-9d9c-4bc5-8c09-5a9619df2802,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:37.413994 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5ce22031-17d3-4f2d-96b2-f4bb52250d0e tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] No DVR routers for this DVR port a1b1ba13-9d9c-4bc5-8c09-5a9619df2802 on host dv-neutron-816802-2-hyperv {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:31:37.492261 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ec176004-121c-4632-afa8-d84502501eaf None None] DHCP port deletion for 3669a9e4-d853-4e8c-90ad-c544516ed2c5 request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:31:37.495267 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-4220f240-8a31-425c-9782-1ab8f049de26 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 766 time: 0.7456074 Nov 09 04:31:37.497982 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55530) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:37.505468 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-8103c62d-f7a1-4f88-8824-29fbc1a7928e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Request body: {'subnet': {'network_id': 'e3317a1c-ad42-41af-9362-06b75b19b024', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:37.533500 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4220f240-8a31-425c-9782-1ab8f049de26 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event updated for resources: {'Network': ['ID=e3317a1c-ad42-41af-9362-06b75b19b024,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:37.572655 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [None req-b3d32246-7488-4f4a-ad93-246e373a6348 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] device_id is not set on port e334adce-a4bb-47b5-8fae-79ad5dc2409c yet. {{(pid=102162) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:31:37.581276 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network e3317a1c-ad42-41af-9362-06b75b19b024 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:31:37.702911 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5ce22031-17d3-4f2d-96b2-f4bb52250d0e tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:37.764959 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-5ce22031-17d3-4f2d-96b2-f4bb52250d0e tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3669a9e4-d853-4e8c-90ad-c544516ed2c5']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:37.793734 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-5ce22031-17d3-4f2d-96b2-f4bb52250d0e tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b5cec454-4fbe-451b-b90e-7cf65688ef8c') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:37.794040 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-5ce22031-17d3-4f2d-96b2-f4bb52250d0e tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b5cec454-4fbe-451b-b90e-7cf65688ef8c') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:37.841369 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-92f1124c-8119-46fa-bc85-95aefa4e7aac None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:37.842782 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5ce22031-17d3-4f2d-96b2-f4bb52250d0e tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:37.870875 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1ce39e71-0db9-4811-bf33-0ae58bf0c615 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-eee30c13-c6dc-4255-8ec9-5487496489dd', 'network_id': 'eee30c13-c6dc-4255-8ec9-5487496489dd', 'tenant_id': '6acf678d74da4512a431e262bbd32037', 'fixed_ips': [{'subnet_id': '4ac558bd-1cff-41b6-ad18-f310e319efa7'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:31:37.871751 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1ce39e71-0db9-4811-bf33-0ae58bf0c615 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:37.872171 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5ce22031-17d3-4f2d-96b2-f4bb52250d0e tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:37.882542 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5ce22031-17d3-4f2d-96b2-f4bb52250d0e tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Releasing vlan 324 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:31:37.886549 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5ce22031-17d3-4f2d-96b2-f4bb52250d0e tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:37.900961 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device a38deaf7-04e8-49cf-b2ac-8058e68dc5bb up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:31:37.927416 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5b518c70-48e9-4651-b9c7-94fc076a36fd tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Router e6aca457-3355-4bcc-88b1-a22334db50b0 is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102161) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:31:37.980520 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:31:37.980520 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:31:37.980520 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:31:37.980520 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:31:37.980520 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:31:37.980520 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:31:37.980520 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:31:37.980520 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:31:37.980520 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:31:37.980520 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:31:37.980520 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:31:37.980520 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:31:37.980520 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:31:37.980520 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:31:37.980520 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:31:37.980520 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:31:37.980520 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:31:37.980520 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:31:37.980520 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:31:37.980520 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:31:37.980520 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:31:37.980520 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:31:37.980520 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:31:37.980520 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:31:37.980520 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:31:37.980520 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:31:37.980520 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:31:37.980520 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:31:37.980520 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:31:37.980520 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:31:37.980520 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:31:37.980520 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:31:38.000229 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-38acd7a2-dd73-47b8-af88-74b8efe32f55 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Allocated IP 2001:db8::d99f:dceb:2dbf:197c (988d2354-693c-4d52-af17-25e0643eaa0c/6c3c1072-37d8-461c-8a31-3789e3e5eaf7/aed3591a-5327-45ab-8bfc-73eccafb40bf) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:31:38.000503 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-b3d32246-7488-4f4a-ad93-246e373a6348 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Allocated IP 172.20.0.6 (4b71592d-70d0-4093-95b2-aac46ce97cc3/437c42c6-b7c7-44c0-b5de-f9e368fcfb4a/e334adce-a4bb-47b5-8fae-79ad5dc2409c) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:31:38.014151 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8103c62d-f7a1-4f88-8824-29fbc1a7928e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Made reservation on behalf of 188f23ef0cb54006875c672b78f5249f for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:38.014735 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-638fe16e-47b7-42d4-8cd4-3b0cbcf3aa1b None None] Provisioning complete for port 5cca359a-c0bf-453d-a350-59ef893974e4 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:38.015516 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-638fe16e-47b7-42d4-8cd4-3b0cbcf3aa1b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:38.016980 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8103c62d-f7a1-4f88-8824-29fbc1a7928e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:38.109821 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5ce22031-17d3-4f2d-96b2-f4bb52250d0e tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:38.111385 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1f94336d-fa75-4fc8-ad05-56137a7018db tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 3.3386292 Nov 09 04:31:38.119796 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55534) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:38.140775 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port a38deaf7-04e8-49cf-b2ac-8058e68dc5bb triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:38.141406 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5ce22031-17d3-4f2d-96b2-f4bb52250d0e tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:38.141875 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:38.147524 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-5ce22031-17d3-4f2d-96b2-f4bb52250d0e tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] 10.222.0.24 "DELETE /v2.0/networks/3669a9e4-d853-4e8c-90ad-c544516ed2c5 HTTP/1.1" status: 204 len: 168 time: 1.3879483 Nov 09 04:31:38.147524 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ce22031-17d3-4f2d-96b2-f4bb52250d0e tempest-NetworksTest-367286148 tempest-NetworksTest-367286148-project] Pushing event deleted for resources: {'Network': ['ID=3669a9e4-d853-4e8c-90ad-c544516ed2c5,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:38.258639 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bf192137-691f-4e23-94de-98318ffc550d None None] Network 4b71592d-70d0-4093-95b2-aac46ce97cc3 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:38.316632 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dca37877-6072-4605-b21a-332876b50bd2 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:38.322710 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5b518c70-48e9-4651-b9c7-94fc076a36fd tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:31:38.331334 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b3d32246-7488-4f4a-ad93-246e373a6348 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:38.349017 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bb98fe3f-e735-4aaf-b248-9a826a543f92 None None] Sync routers for ids ['e6aca457-3355-4bcc-88b1-a22334db50b0'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:31:38.448053 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5b518c70-48e9-4651-b9c7-94fc076a36fd tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:38.452376 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-5b518c70-48e9-4651-b9c7-94fc076a36fd tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 885 time: 6.8375661 Nov 09 04:31:38.452824 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55538) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:38.459939 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb98fe3f-e735-4aaf-b248-9a826a543f92 None None] Routers {'e6aca457-3355-4bcc-88b1-a22334db50b0'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:31:38.459939 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-bb98fe3f-e735-4aaf-b248-9a826a543f92 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:31:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['e6aca457-3355-4bcc-88b1-a22334db50b0'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:38.460182 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-95f9722b-eac7-4d41-8da3-0555ce19161f tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Request body: {'router': {'external_gateway_info': {}}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:38.461133 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dc3dfa7a-e488-4991-8d26-e2e560c31736 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:38.507094 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-1ce39e71-0db9-4811-bf33-0ae58bf0c615 None None] Allocated IP 2001:db8::2 (eee30c13-c6dc-4255-8ec9-5487496489dd/4ac558bd-1cff-41b6-ad18-f310e319efa7/545d912c-6e17-404f-a71d-e702f280749b) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:31:38.508960 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8103c62d-f7a1-4f88-8824-29fbc1a7928e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:38.513879 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-38acd7a2-dd73-47b8-af88-74b8efe32f55 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:38.571867 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b3d32246-7488-4f4a-ad93-246e373a6348 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:38.620526 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dc3dfa7a-e488-4991-8d26-e2e560c31736 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:38.661581 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8103c62d-f7a1-4f88-8824-29fbc1a7928e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event updated for resources: {'Subnet': ['ID=10a26071-6216-4b65-b6b6-f23700b8dbf0,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:38.682966 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dca37877-6072-4605-b21a-332876b50bd2 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:38.696831 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b3d32246-7488-4f4a-ad93-246e373a6348 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Network 4b71592d-70d0-4093-95b2-aac46ce97cc3 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:31:38.699728 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8103c62d-f7a1-4f88-8824-29fbc1a7928e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Checking segment: {'id': 'd2b8b706-bc72-4a78-bf25-9333dc47e65b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 302, 'network_id': 'e3317a1c-ad42-41af-9362-06b75b19b024'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:31:38.700163 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8103c62d-f7a1-4f88-8824-29fbc1a7928e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Network hostable DHCP agents. Network: e3317a1c-ad42-41af-9362-06b75b19b024, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:31:38.705102 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-b3d32246-7488-4f4a-ad93-246e373a6348 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:38.707060 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3d32246-7488-4f4a-ad93-246e373a6348 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event updated for resources: {'Port': ['ID=e334adce-a4bb-47b5-8fae-79ad5dc2409c,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:38.709362 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b3d32246-7488-4f4a-ad93-246e373a6348 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:31:38.741169 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-bb98fe3f-e735-4aaf-b248-9a826a543f92 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:38.744846 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-38acd7a2-dd73-47b8-af88-74b8efe32f55 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:38.749651 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55542) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:38.828187 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dca37877-6072-4605-b21a-332876b50bd2 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:38.846213 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b3d32246-7488-4f4a-ad93-246e373a6348 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:38.851205 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b3d32246-7488-4f4a-ad93-246e373a6348 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:38.860193 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-38acd7a2-dd73-47b8-af88-74b8efe32f55 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:31:38.868711 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-38acd7a2-dd73-47b8-af88-74b8efe32f55 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:38.880519 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-38acd7a2-dd73-47b8-af88-74b8efe32f55 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:31:38.887059 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-38acd7a2-dd73-47b8-af88-74b8efe32f55 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:38.887319 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-38acd7a2-dd73-47b8-af88-74b8efe32f55 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:38.894334 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb98fe3f-e735-4aaf-b248-9a826a543f92 None None] Routers {'e6aca457-3355-4bcc-88b1-a22334db50b0'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:31:38.895175 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-bb98fe3f-e735-4aaf-b248-9a826a543f92 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:31:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['e6aca457-3355-4bcc-88b1-a22334db50b0'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:38.929477 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8103c62d-f7a1-4f88-8824-29fbc1a7928e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Network e3317a1c-ad42-41af-9362-06b75b19b024 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:31:38.945789 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dca37877-6072-4605-b21a-332876b50bd2 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:38.947515 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38acd7a2-dd73-47b8-af88-74b8efe32f55 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Port': ['ID=aed3591a-5327-45ab-8bfc-73eccafb40bf,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:38.982231 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-b3d32246-7488-4f4a-ad93-246e373a6348 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 924 time: 1.8891294 Nov 09 04:31:38.984862 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55548) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:39.018072 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-bb98fe3f-e735-4aaf-b248-9a826a543f92 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:39.019375 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bb98fe3f-e735-4aaf-b248-9a826a543f92 None None] The sync data for ids ['e6aca457-3355-4bcc-88b1-a22334db50b0'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:31:39.039389 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-ad36f2cb-6b46-43fc-a67c-7ba3a39f5cb3 None None] Provisioning complete for port dd8ca3d6-4dec-4e1f-99e4-8d77ad7ba47f triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:39.039761 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ad36f2cb-6b46-43fc-a67c-7ba3a39f5cb3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:39.045652 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-8103c62d-f7a1-4f88-8824-29fbc1a7928e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, e3317a1c-ad42-41af-9362-06b75b19b024) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:39.062419 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8103c62d-f7a1-4f88-8824-29fbc1a7928e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:39.063005 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8103c62d-f7a1-4f88-8824-29fbc1a7928e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:39.070105 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dca37877-6072-4605-b21a-332876b50bd2 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Pushing event updated for resources: {'Port': ['ID=8f7c00e8-88ad-4eef-acf1-1a9ed282ba0b,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:39.075472 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-95f9722b-eac7-4d41-8da3-0555ce19161f tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:39.096523 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6929ad3a-016c-404a-b704-b4e2ed9c0dd5 None None] Network e3317a1c-ad42-41af-9362-06b75b19b024 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:39.118583 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-34a1e2ba-6ff7-45d7-a5d0-4669505d2f0f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:39.123055 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-34a1e2ba-6ff7-45d7-a5d0-4669505d2f0f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "GET /v2.0/ports?fixed_ips=ip_address%3D172.20.0.7 HTTP/1.1" status: 200 len: 922 time: 0.1363728 Nov 09 04:31:39.125626 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55550) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:39.131916 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device fa3ed53c-9d43-4ea3-b780-2ad74f003fed no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:31:39.157590 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: fa3ed53c-9d43-4ea3-b780-2ad74f003fed {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:31:39.157932 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device fa3ed53c-9d43-4ea3-b780-2ad74f003fed not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:31:39.158379 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device a1b1ba13-9d9c-4bc5-8c09-5a9619df2802 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:31:39.175737 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-38acd7a2-dd73-47b8-af88-74b8efe32f55 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 947 time: 3.5164068 Nov 09 04:31:39.177097 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55552) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:39.181841 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-8103c62d-f7a1-4f88-8824-29fbc1a7928e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.6806958 Nov 09 04:31:39.187544 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-07828be4-4f2d-487c-8d86-368c515715f0 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=6761c80dbfa84798bb6517a9b532f870&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4336588 Nov 09 04:31:39.187544 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55554) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:39.189522 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55556) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:39.192853 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-95f9722b-eac7-4d41-8da3-0555ce19161f tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks [] for router_gateway, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:39.201748 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-8f08e879-600d-4b74-8c0f-f0543a2e321f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-703643407', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:39.268246 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: a1b1ba13-9d9c-4bc5-8c09-5a9619df2802 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:31:39.268508 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.l3_db [None req-dca37877-6072-4605-b21a-332876b50bd2 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Floating IP c68e1ebb-65d3-4c8e-b1c0-4ae8c774d9ed associated. External IP: 172.26.0.145, port: 9c023fad-c8fa-4120-b9cc-4ea22c1718e4. Nov 09 04:31:39.268659 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device a1b1ba13-9d9c-4bc5-8c09-5a9619df2802 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:31:39.283537 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-ad36f2cb-6b46-43fc-a67c-7ba3a39f5cb3 None None] Port dd8ca3d6-4dec-4e1f-99e4-8d77ad7ba47f cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:31:39.307787 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-70c3fd12-8a91-45a0-8a59-e09165fab41d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:39.315230 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-da173ccf-5c42-4760-8163-6722d5971428 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Deleting port e334adce-a4bb-47b5-8fae-79ad5dc2409c {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:31:39.324197 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-da173ccf-5c42-4760-8163-6722d5971428 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:39.336676 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-78b49de7-c714-4290-9ff7-e2be663bd605 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:39.343544 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-78b49de7-c714-4290-9ff7-e2be663bd605 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:39.347643 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-78b49de7-c714-4290-9ff7-e2be663bd605 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1607 time: 0.1662169 Nov 09 04:31:39.349141 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55558) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:39.359216 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-ad36f2cb-6b46-43fc-a67c-7ba3a39f5cb3 None None] Provisioning complete for port a38deaf7-04e8-49cf-b2ac-8058e68dc5bb triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:39.359602 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ad36f2cb-6b46-43fc-a67c-7ba3a39f5cb3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:39.361218 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8f08e879-600d-4b74-8c0f-f0543a2e321f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:39.362257 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8f08e879-600d-4b74-8c0f-f0543a2e321f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:39.431102 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1ce39e71-0db9-4811-bf33-0ae58bf0c615 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:39.500252 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1a16106a-3abf-42c3-b6a3-c8b1da1584cf None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-e3317a1c-ad42-41af-9362-06b75b19b024', 'network_id': 'e3317a1c-ad42-41af-9362-06b75b19b024', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'fixed_ips': [{'subnet_id': '10a26071-6216-4b65-b6b6-f23700b8dbf0'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:31:39.507088 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1a16106a-3abf-42c3-b6a3-c8b1da1584cf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:39.533266 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1ce39e71-0db9-4811-bf33-0ae58bf0c615 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:39.535513 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8f08e879-600d-4b74-8c0f-f0543a2e321f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:39.564230 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-70c3fd12-8a91-45a0-8a59-e09165fab41d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:39.611704 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1ce39e71-0db9-4811-bf33-0ae58bf0c615 None None] Network eee30c13-c6dc-4255-8ec9-5487496489dd is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:31:39.614766 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ce39e71-0db9-4811-bf33-0ae58bf0c615 None None] Pushing event updated for resources: {'Port': ['ID=545d912c-6e17-404f-a71d-e702f280749b,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:39.645574 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8f08e879-600d-4b74-8c0f-f0543a2e321f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:39.672025 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-1ce39e71-0db9-4811-bf33-0ae58bf0c615 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:39.674755 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-da173ccf-5c42-4760-8163-6722d5971428 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:39.675506 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1ce39e71-0db9-4811-bf33-0ae58bf0c615 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:31:39.701908 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-da173ccf-5c42-4760-8163-6722d5971428 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Calling delete_port for e334adce-a4bb-47b5-8fae-79ad5dc2409c owned by {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:31:39.721149 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-70c3fd12-8a91-45a0-8a59-e09165fab41d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:39.723670 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dc3dfa7a-e488-4991-8d26-e2e560c31736 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:39.731761 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-70c3fd12-8a91-45a0-8a59-e09165fab41d admin admin] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:39.733110 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-70c3fd12-8a91-45a0-8a59-e09165fab41d admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/ed3e80c4-f9aa-4306-90b7-0259ab09dd84 HTTP/1.1" status: 204 len: 168 time: 0.5369961 Nov 09 04:31:39.769957 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70c3fd12-8a91-45a0-8a59-e09165fab41d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ed3e80c4-f9aa-4306-90b7-0259ab09dd84,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:39.805155 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8f08e879-600d-4b74-8c0f-f0543a2e321f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:39.809449 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-8f08e879-600d-4b74-8c0f-f0543a2e321f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 699 time: 0.6130517 Nov 09 04:31:39.822672 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55562) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:39.823795 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc3dfa7a-e488-4991-8d26-e2e560c31736 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Pushing event deleted for resources: {'Subnet': ['ID=4ac558bd-1cff-41b6-ad18-f310e319efa7,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:39.824238 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-c3992a40-f29a-4ef2-9983-6686aad84539 None None] Provisioning complete for port 5cca359a-c0bf-453d-a350-59ef893974e4 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:39.824606 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c3992a40-f29a-4ef2-9983-6686aad84539 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:39.845769 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-1ce39e71-0db9-4811-bf33-0ae58bf0c615 None None] Attempting to bind port 545d912c-6e17-404f-a71d-e702f280749b on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:31:39.845769 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-1ce39e71-0db9-4811-bf33-0ae58bf0c615 None None] Attempting to bind port 545d912c-6e17-404f-a71d-e702f280749b by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '3b7d7d8b-6cf8-4405-beec-ebfe913df0ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 341, 'network_id': 'eee30c13-c6dc-4255-8ec9-5487496489dd'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:31:39.845968 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1ce39e71-0db9-4811-bf33-0ae58bf0c615 None None] Attempting to bind port 545d912c-6e17-404f-a71d-e702f280749b on network eee30c13-c6dc-4255-8ec9-5487496489dd {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:31:39.876213 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-95f9722b-eac7-4d41-8da3-0555ce19161f tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Deleting port 3cebcc02-772d-4914-8986-8fd16a236d90 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:31:39.876823 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-95f9722b-eac7-4d41-8da3-0555ce19161f tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:39.892378 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1ce39e71-0db9-4811-bf33-0ae58bf0c615 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 31, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:31:39.892753 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1ce39e71-0db9-4811-bf33-0ae58bf0c615 None None] Checking segment: {'id': '3b7d7d8b-6cf8-4405-beec-ebfe913df0ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 341, 'network_id': 'eee30c13-c6dc-4255-8ec9-5487496489dd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:31:39.893211 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1ce39e71-0db9-4811-bf33-0ae58bf0c615 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:39.893588 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1ce39e71-0db9-4811-bf33-0ae58bf0c615 None None] Bound using segment: {'id': '3b7d7d8b-6cf8-4405-beec-ebfe913df0ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 341, 'network_id': 'eee30c13-c6dc-4255-8ec9-5487496489dd'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:31:39.894061 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-1ce39e71-0db9-4811-bf33-0ae58bf0c615 None None] Bound port: 545d912c-6e17-404f-a71d-e702f280749b, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3b7d7d8b-6cf8-4405-beec-ebfe913df0ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 341, 'network_id': 'eee30c13-c6dc-4255-8ec9-5487496489dd'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:31:39.894624 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1ce39e71-0db9-4811-bf33-0ae58bf0c615 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:39.932610 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dc3dfa7a-e488-4991-8d26-e2e560c31736 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:39.936543 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-1a16106a-3abf-42c3-b6a3-c8b1da1584cf None None] Allocated IP 172.20.0.2 (e3317a1c-ad42-41af-9362-06b75b19b024/10a26071-6216-4b65-b6b6-f23700b8dbf0/ddadbc85-88b3-4e57-8103-52476bdc4001) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:31:39.998094 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-c4d8dd56-17d8-4629-b67d-6aa33d33798c tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Deleting port aed3591a-5327-45ab-8bfc-73eccafb40bf {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:31:39.998693 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c4d8dd56-17d8-4629-b67d-6aa33d33798c tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:40.049183 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-dc3dfa7a-e488-4991-8d26-e2e560c31736 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['eee30c13-c6dc-4255-8ec9-5487496489dd']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:40.101154 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dca37877-6072-4605-b21a-332876b50bd2 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Router 20fa17b9-5a43-469e-a0de-e9be80c05f6f has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:31:40.103579 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-dc3dfa7a-e488-4991-8d26-e2e560c31736 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3b7d7d8b-6cf8-4405-beec-ebfe913df0ab') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:40.103874 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-dc3dfa7a-e488-4991-8d26-e2e560c31736 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3b7d7d8b-6cf8-4405-beec-ebfe913df0ab') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:40.122352 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-1ce39e71-0db9-4811-bf33-0ae58bf0c615 None None] For port 545d912c-6e17-404f-a71d-e702f280749b, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:31:40.153383 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-1ce39e71-0db9-4811-bf33-0ae58bf0c615 None None] For port 545d912c-6e17-404f-a71d-e702f280749b, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=545d912c-6e17-404f-a71d-e702f280749b,segment=NetworkSegment(3b7d7d8b-6cf8-4405-beec-ebfe913df0ab),segment_id=3b7d7d8b-6cf8-4405-beec-ebfe913df0ab)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:31:40.206541 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dc3dfa7a-e488-4991-8d26-e2e560c31736 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:40.219073 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1ce39e71-0db9-4811-bf33-0ae58bf0c615 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:40.256597 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dc3dfa7a-e488-4991-8d26-e2e560c31736 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:40.298080 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1a16106a-3abf-42c3-b6a3-c8b1da1584cf None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:40.352630 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-ed5ef970-e853-421f-826e-16d96743c2f2 None None] Provisioning complete for port dd8ca3d6-4dec-4e1f-99e4-8d77ad7ba47f triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:40.355486 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ed5ef970-e853-421f-826e-16d96743c2f2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:40.355938 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ce39e71-0db9-4811-bf33-0ae58bf0c615 None None] Pushing event updated for resources: {'Port': ['ID=545d912c-6e17-404f-a71d-e702f280749b,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:40.381233 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-027862fe-0299-4416-85f7-70d4babfa98b None None] Network eee30c13-c6dc-4255-8ec9-5487496489dd requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:40.385417 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1a16106a-3abf-42c3-b6a3-c8b1da1584cf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:40.389907 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-dc3dfa7a-e488-4991-8d26-e2e560c31736 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Releasing vlan 341 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:31:40.390466 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dc3dfa7a-e488-4991-8d26-e2e560c31736 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:40.440015 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:31:40.440015 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:31:40.440015 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:31:40.440015 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:31:40.440015 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:31:40.440015 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:31:40.440015 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:31:40.440015 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:31:40.440015 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:31:40.440015 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:31:40.440015 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:31:40.440015 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:31:40.440015 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:31:40.440015 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:31:40.440015 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:31:40.440015 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:31:40.440015 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:31:40.440015 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:31:40.440015 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:31:40.440015 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:31:40.440015 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:31:40.440015 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:31:40.440015 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:31:40.440015 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:31:40.440015 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:31:40.440015 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:31:40.440015 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:31:40.440015 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:31:40.440015 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:31:40.440015 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:31:40.440015 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:31:40.440015 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:31:40.452799 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-95f9722b-eac7-4d41-8da3-0555ce19161f tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:40.473327 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-95f9722b-eac7-4d41-8da3-0555ce19161f tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Calling delete_port for 3cebcc02-772d-4914-8986-8fd16a236d90 owned by network:router_gateway {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:31:40.488357 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-ed5ef970-e853-421f-826e-16d96743c2f2 None None] Port dd8ca3d6-4dec-4e1f-99e4-8d77ad7ba47f cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:31:40.495516 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1a16106a-3abf-42c3-b6a3-c8b1da1584cf None None] Network e3317a1c-ad42-41af-9362-06b75b19b024 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:31:40.505491 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c4d8dd56-17d8-4629-b67d-6aa33d33798c tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:40.507502 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-1a16106a-3abf-42c3-b6a3-c8b1da1584cf None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:40.510573 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1a16106a-3abf-42c3-b6a3-c8b1da1584cf None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:31:40.516659 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a16106a-3abf-42c3-b6a3-c8b1da1584cf None None] Pushing event updated for resources: {'Port': ['ID=ddadbc85-88b3-4e57-8103-52476bdc4001,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:40.566566 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-ed5ef970-e853-421f-826e-16d96743c2f2 None None] Provisioning complete for port a38deaf7-04e8-49cf-b2ac-8058e68dc5bb triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:40.566848 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ed5ef970-e853-421f-826e-16d96743c2f2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:40.568217 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-c4d8dd56-17d8-4629-b67d-6aa33d33798c tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Calling delete_port for aed3591a-5327-45ab-8bfc-73eccafb40bf owned by {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:31:40.601606 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-da173ccf-5c42-4760-8163-6722d5971428 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:40.638825 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.db.api [None req-dc3dfa7a-e488-4991-8d26-e2e560c31736 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Nov 09 04:31:40.638825 dv-neutron-816802-2-hyperv neutron-server[102161]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Nov 09 04:31:40.638825 dv-neutron-816802-2-hyperv neutron-server[102161]: [parameters: {'id': 'eee30c13-c6dc-4255-8ec9-5487496489dd'}] Nov 09 04:31:40.638825 dv-neutron-816802-2-hyperv neutron-server[102161]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=102161) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:31:40.645554 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG oslo_db.api [None req-dc3dfa7a-e488-4991-8d26-e2e560c31736 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:31:40.645650 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-1a16106a-3abf-42c3-b6a3-c8b1da1584cf None None] Attempting to bind port ddadbc85-88b3-4e57-8103-52476bdc4001 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:31:40.645995 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-1a16106a-3abf-42c3-b6a3-c8b1da1584cf None None] Attempting to bind port ddadbc85-88b3-4e57-8103-52476bdc4001 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'd2b8b706-bc72-4a78-bf25-9333dc47e65b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 302, 'network_id': 'e3317a1c-ad42-41af-9362-06b75b19b024'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:31:40.646352 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a16106a-3abf-42c3-b6a3-c8b1da1584cf None None] Attempting to bind port ddadbc85-88b3-4e57-8103-52476bdc4001 on network e3317a1c-ad42-41af-9362-06b75b19b024 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:31:40.657860 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a16106a-3abf-42c3-b6a3-c8b1da1584cf None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 31, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:31:40.658232 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a16106a-3abf-42c3-b6a3-c8b1da1584cf None None] Checking segment: {'id': 'd2b8b706-bc72-4a78-bf25-9333dc47e65b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 302, 'network_id': 'e3317a1c-ad42-41af-9362-06b75b19b024'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:31:40.658649 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1a16106a-3abf-42c3-b6a3-c8b1da1584cf None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:40.659908 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a16106a-3abf-42c3-b6a3-c8b1da1584cf None None] Bound using segment: {'id': 'd2b8b706-bc72-4a78-bf25-9333dc47e65b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 302, 'network_id': 'e3317a1c-ad42-41af-9362-06b75b19b024'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:31:40.659908 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-1a16106a-3abf-42c3-b6a3-c8b1da1584cf None None] Bound port: ddadbc85-88b3-4e57-8103-52476bdc4001, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd2b8b706-bc72-4a78-bf25-9333dc47e65b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 302, 'network_id': 'e3317a1c-ad42-41af-9362-06b75b19b024'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:31:40.659908 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1a16106a-3abf-42c3-b6a3-c8b1da1584cf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:40.766440 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da173ccf-5c42-4760-8163-6722d5971428 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event deleted for resources: {'Port': ['ID=e334adce-a4bb-47b5-8fae-79ad5dc2409c,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:40.767162 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-ed5ef970-e853-421f-826e-16d96743c2f2 None None] Could not find standard attr ID for object e334adce-a4bb-47b5-8fae-79ad5dc2409c. {{(pid=102163) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 09 04:31:40.778432 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-1a16106a-3abf-42c3-b6a3-c8b1da1584cf None None] For port ddadbc85-88b3-4e57-8103-52476bdc4001, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:31:40.782745 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-1a16106a-3abf-42c3-b6a3-c8b1da1584cf None None] For port ddadbc85-88b3-4e57-8103-52476bdc4001, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=ddadbc85-88b3-4e57-8103-52476bdc4001,segment=NetworkSegment(d2b8b706-bc72-4a78-bf25-9333dc47e65b),segment_id=d2b8b706-bc72-4a78-bf25-9333dc47e65b)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:31:40.789097 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-ed5ef970-e853-421f-826e-16d96743c2f2 None None] Provisioning complete for port aed3591a-5327-45ab-8bfc-73eccafb40bf triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:40.789514 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ed5ef970-e853-421f-826e-16d96743c2f2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:40.796731 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-95f9722b-eac7-4d41-8da3-0555ce19161f tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:40.849112 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-ed5ef970-e853-421f-826e-16d96743c2f2 None None] Port aed3591a-5327-45ab-8bfc-73eccafb40bf cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:31:40.866670 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1a16106a-3abf-42c3-b6a3-c8b1da1584cf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:40.896539 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-da173ccf-5c42-4760-8163-6722d5971428 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:40.902796 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-da173ccf-5c42-4760-8163-6722d5971428 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "DELETE /v2.0/ports/e334adce-a4bb-47b5-8fae-79ad5dc2409c HTTP/1.1" status: 204 len: 168 time: 1.7731848 Nov 09 04:31:40.905327 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55580) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:40.908806 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95f9722b-eac7-4d41-8da3-0555ce19161f tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Pushing event deleted for resources: {'Port': ['ID=3cebcc02-772d-4914-8986-8fd16a236d90,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:40.957708 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-1686206c-727a-438d-8ec3-0fb8585a54af tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] GET failed (client error): The resource could not be found. Nov 09 04:31:40.959433 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-1686206c-727a-438d-8ec3-0fb8585a54af tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "GET /v2.0/ports/e334adce-a4bb-47b5-8fae-79ad5dc2409c HTTP/1.1" status: 404 len: 333 time: 0.0468693 Nov 09 04:31:40.988925 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55584) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:41.059720 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-95f9722b-eac7-4d41-8da3-0555ce19161f tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-466373'] for router_gateway, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:41.105950 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-97156ed7-1222-450c-ac0f-b16700587530 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:41.129489 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dca37877-6072-4605-b21a-332876b50bd2 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:31:41.141361 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-848febc3-a9f0-46c2-8297-a5b6f784f35c None None] Sync routers for ids ['20fa17b9-5a43-469e-a0de-e9be80c05f6f'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:31:41.144216 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dc3dfa7a-e488-4991-8d26-e2e560c31736 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:41.169494 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-848febc3-a9f0-46c2-8297-a5b6f784f35c None None] Routers {'20fa17b9-5a43-469e-a0de-e9be80c05f6f'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:31:41.170638 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-848febc3-a9f0-46c2-8297-a5b6f784f35c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:31:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['20fa17b9-5a43-469e-a0de-e9be80c05f6f'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:41.237019 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55590) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:41.250949 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-0ad06464-d136-4bc6-8a6e-ead3aa8c0c4c None None] Could not find standard attr ID for object e334adce-a4bb-47b5-8fae-79ad5dc2409c. {{(pid=102163) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 09 04:31:41.300667 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a16106a-3abf-42c3-b6a3-c8b1da1584cf None None] Pushing event updated for resources: {'Port': ['ID=ddadbc85-88b3-4e57-8103-52476bdc4001,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:41.363118 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-fcdcebaa-637e-4b42-9f67-299397f9b3d9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:41.376858 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-848febc3-a9f0-46c2-8297-a5b6f784f35c None None] Set router 20fa17b9-5a43-469e-a0de-e9be80c05f6f gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:31:41.396635 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dca37877-6072-4605-b21a-332876b50bd2 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:41.414715 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-c098087f-ceb4-4c14-91b1-164dbeac5ae1 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Deleting port dd8ca3d6-4dec-4e1f-99e4-8d77ad7ba47f {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:31:41.415514 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c098087f-ceb4-4c14-91b1-164dbeac5ae1 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:41.425270 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-95f9722b-eac7-4d41-8da3-0555ce19161f tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-466202', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-464271', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-936'] for router, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:41.467004 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-95f9722b-eac7-4d41-8da3-0555ce19161f tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-466195', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-466408', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-464260'] for router, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:41.491985 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-24ecf401-fe6c-4653-8ba7-a7a0e36908be tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-test-network-546768031'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:41.496029 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-dca37877-6072-4605-b21a-332876b50bd2 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 8.5566828 Nov 09 04:31:41.501357 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9c4e58e3-39e4-4212-b106-50b44d4c4e28', 'tag': '9c023fad-c8fa-4120-b9cc-4ea22c1718e4'}] {{(pid=102161) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:31:41.503702 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}99dfdda0def497b4372884ef2eb87f06b1e425c8eba5ceda5f64bbab037a07d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c1767631-fb0c-4d2f-8e5e-5deea2f85db6" -d '{"events": [{"name": "network-changed", "server_uuid": "9c4e58e3-39e4-4212-b106-50b44d4c4e28", "tag": "9c023fad-c8fa-4120-b9cc-4ea22c1718e4"}]}' {{(pid=102161) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:31:41.590931 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:31:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-318d1528-a316-4a8a-ad44-80c8e9b2fbc7 x-openstack-request-id: req-318d1528-a316-4a8a-ad44-80c8e9b2fbc7 {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:31:41.591488 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9c4e58e3-39e4-4212-b106-50b44d4c4e28", "tag": "9c023fad-c8fa-4120-b9cc-4ea22c1718e4", "status": "completed", "code": 200}]} {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:31:41.591902 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-318d1528-a316-4a8a-ad44-80c8e9b2fbc7 {{(pid=102161) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:31:41.592444 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9c4e58e3-39e4-4212-b106-50b44d4c4e28', 'tag': '9c023fad-c8fa-4120-b9cc-4ea22c1718e4', 'status': 'completed', 'code': 200} Nov 09 04:31:41.618594 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-dc3dfa7a-e488-4991-8d26-e2e560c31736 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Deleting port 545d912c-6e17-404f-a71d-e702f280749b {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:31:41.620888 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dc3dfa7a-e488-4991-8d26-e2e560c31736 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:41.665705 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c098087f-ceb4-4c14-91b1-164dbeac5ae1 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:41.666806 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c4d8dd56-17d8-4629-b67d-6aa33d33798c tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:41.724281 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-97156ed7-1222-450c-ac0f-b16700587530 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Allocated IP 172.20.0.1 (e3317a1c-ad42-41af-9362-06b75b19b024/10a26071-6216-4b65-b6b6-f23700b8dbf0/4a69f229-858a-4210-ad1e-16328d055046) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:31:41.757743 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-848febc3-a9f0-46c2-8297-a5b6f784f35c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '20fa17b9-5a43-469e-a0de-e9be80c05f6f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1135837892', 'tenant_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.69'}], 'enable_snat': True}, 'gw_port_id': '8508be40-2af9-45a5-96f0-06d142f33d8d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:30:45Z', 'updated_at': '2021-11-09T04:31:03Z', 'revision_number': 4, 'project_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'gw_port': {'id': '8508be40-2af9-45a5-96f0-06d142f33d8d', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:95:95:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '20fa17b9-5a43-469e-a0de-e9be80c05f6f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 567, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:30:48Z', 'updated_at': '2021-11-09T04:30:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': 'c68e1ebb-65d3-4c8e-b1c0-4ae8c774d9ed', 'tenant_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'floating_ip_address': '172.26.0.145', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '20fa17b9-5a43-469e-a0de-e9be80c05f6f', 'port_id': '9c023fad-c8fa-4120-b9cc-4ea22c1718e4', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 686, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9c94e7dc-d679-4a7e-b264-6d619dbc935e', 'mac_address': 'fa:16:3e:cd:a2:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c4e58e3-39e4-4212-b106-50b44d4c4e28', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:31:36Z', 'updated_at': '2021-11-09T04:31:36Z', 'revision_number': 0, 'project_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'bab3b0b2-ec0e-464a-b15f-1f71dc13f0f3', 'name': '', 'network_id': '9c94e7dc-d679-4a7e-b264-6d619dbc935e', 'tenant_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'mac_address': 'fa:16:3e:b2:bf:75', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '20fa17b9-5a43-469e-a0de-e9be80c05f6f', 'device_owner': 'network:router_interface', 'standard_attr_id': 610, 'fixed_ips': [{'subnet_id': '003822ea-7d1a-41fa-a15f-16fc8c9f624c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:31:00Z', 'updated_at': '2021-11-09T04:31:12Z', 'revision_number': 5, 'project_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'subnets': [{'id': '003822ea-7d1a-41fa-a15f-16fc8c9f624c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:41.774409 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4d8dd56-17d8-4629-b67d-6aa33d33798c tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event deleted for resources: {'Port': ['ID=aed3591a-5327-45ab-8bfc-73eccafb40bf,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:41.809619 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-dc3dfa7a-e488-4991-8d26-e2e560c31736 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] For port 545d912c-6e17-404f-a71d-e702f280749b, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=545d912c-6e17-404f-a71d-e702f280749b,segment=NetworkSegment(3b7d7d8b-6cf8-4405-beec-ebfe913df0ab),segment_id=3b7d7d8b-6cf8-4405-beec-ebfe913df0ab)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:31:41.810022 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dc3dfa7a-e488-4991-8d26-e2e560c31736 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:41.817285 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-c098087f-ceb4-4c14-91b1-164dbeac5ae1 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Calling delete_port for dd8ca3d6-4dec-4e1f-99e4-8d77ad7ba47f owned by {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:31:41.863773 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-848febc3-a9f0-46c2-8297-a5b6f784f35c None None] Checking router: 20fa17b9-5a43-469e-a0de-e9be80c05f6f for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:31:41.887478 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-848febc3-a9f0-46c2-8297-a5b6f784f35c None None] Routers {'20fa17b9-5a43-469e-a0de-e9be80c05f6f'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:31:41.888658 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-848febc3-a9f0-46c2-8297-a5b6f784f35c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:31:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['20fa17b9-5a43-469e-a0de-e9be80c05f6f'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:41.912860 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device ddadbc85-88b3-4e57-8103-52476bdc4001 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:31:41.957553 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-dc3dfa7a-e488-4991-8d26-e2e560c31736 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Calling delete_port for 545d912c-6e17-404f-a71d-e702f280749b owned by network:dhcp {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:31:41.962048 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c4d8dd56-17d8-4629-b67d-6aa33d33798c tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:41.971132 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-c4d8dd56-17d8-4629-b67d-6aa33d33798c tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/ports/aed3591a-5327-45ab-8bfc-73eccafb40bf HTTP/1.1" status: 204 len: 168 time: 2.6180336 Nov 09 04:31:41.978607 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55598) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:42.000798 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port ddadbc85-88b3-4e57-8103-52476bdc4001 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:42.001752 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:42.009676 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e94aaeb2-2ee9-4914-b24b-c9c72133ff65 req-abc663d1-c68f-49f5-b02a-a817667f21ee tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:42.019201 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e94aaeb2-2ee9-4914-b24b-c9c72133ff65 req-abc663d1-c68f-49f5-b02a-a817667f21ee tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/ports?device_id=9c4e58e3-39e4-4212-b106-50b44d4c4e28 HTTP/1.1" status: 200 len: 945 time: 0.3473582 Nov 09 04:31:42.021086 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-24ecf401-fe6c-4653-8ba7-a7a0e36908be tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Made reservation on behalf of 12e47d8445b5429892cd1b9244512ca8 for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:42.025580 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-24ecf401-fe6c-4653-8ba7-a7a0e36908be tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:42.025766 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1767631-fb0c-4d2f-8e5e-5deea2f85db6 req-f857de4d-fc10-47ef-aa83-ad44136e863c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:42.027156 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c1767631-fb0c-4d2f-8e5e-5deea2f85db6 req-f857de4d-fc10-47ef-aa83-ad44136e863c service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=fd7df27e425449dfb80d0838c8f7fb89&device_id=9c4e58e3-39e4-4212-b106-50b44d4c4e28 HTTP/1.1" status: 200 len: 1098 time: 0.3773024 Nov 09 04:31:42.038690 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-95f9722b-eac7-4d41-8da3-0555ce19161f tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Router e6aca457-3355-4bcc-88b1-a22334db50b0 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:31:42.098734 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-24ecf401-fe6c-4653-8ba7-a7a0e36908be tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:42.123476 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-848febc3-a9f0-46c2-8297-a5b6f784f35c None None] Set router 20fa17b9-5a43-469e-a0de-e9be80c05f6f gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:31:42.174659 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:42.181529 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:42.193233 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-44be7fda-197d-4b96-9dfc-757ab75d14b2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:42.195219 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-44be7fda-197d-4b96-9dfc-757ab75d14b2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:42.196753 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-44be7fda-197d-4b96-9dfc-757ab75d14b2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1477 time: 0.2173431 Nov 09 04:31:42.209524 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55600) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:42.230610 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port ddadbc85-88b3-4e57-8103-52476bdc4001, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=ddadbc85-88b3-4e57-8103-52476bdc4001,segment=NetworkSegment(d2b8b706-bc72-4a78-bf25-9333dc47e65b),segment_id=d2b8b706-bc72-4a78-bf25-9333dc47e65b)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:31:42.234762 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e94aaeb2-2ee9-4914-b24b-c9c72133ff65 req-678222b1-9421-4948-89c0-7d1b144b85cb tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/security-groups?id=4ff68177-77d2-4250-b11c-4d5b55fd3619&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2145996 Nov 09 04:31:42.257673 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-95f9722b-eac7-4d41-8da3-0555ce19161f tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:31:42.270080 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55604) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:42.276542 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-97156ed7-1222-450c-ac0f-b16700587530 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:42.277879 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ea9c4d5a-c5b9-4ff4-8589-cb8ebb5622e5 None None] Sync routers for ids ['e6aca457-3355-4bcc-88b1-a22334db50b0'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:31:42.289598 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-95f9722b-eac7-4d41-8da3-0555ce19161f tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:42.290297 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:42.290815 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-95f9722b-eac7-4d41-8da3-0555ce19161f tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] 10.222.0.24 "PUT /v2.0/routers/e6aca457-3355-4bcc-88b1-a22334db50b0 HTTP/1.1" status: 200 len: 706 time: 3.8369448 Nov 09 04:31:42.308604 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55606) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:42.417258 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ea9c4d5a-c5b9-4ff4-8589-cb8ebb5622e5 None None] Routers {'e6aca457-3355-4bcc-88b1-a22334db50b0'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:31:42.421042 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-ea9c4d5a-c5b9-4ff4-8589-cb8ebb5622e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:31:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['e6aca457-3355-4bcc-88b1-a22334db50b0'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:42.421586 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=ddadbc85-88b3-4e57-8103-52476bdc4001,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:42.430323 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-58292dc9-1c5c-4454-b44d-daf6f1d48226 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/floatingips/c68e1ebb-65d3-4c8e-b1c0-4ae8c774d9ed HTTP/1.1" status: 200 len: 991 time: 0.1580734 Nov 09 04:31:42.443802 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-848febc3-a9f0-46c2-8297-a5b6f784f35c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '20fa17b9-5a43-469e-a0de-e9be80c05f6f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1135837892', 'tenant_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.69'}], 'enable_snat': True}, 'gw_port_id': '8508be40-2af9-45a5-96f0-06d142f33d8d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:30:45Z', 'updated_at': '2021-11-09T04:31:03Z', 'revision_number': 4, 'project_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'gw_port': {'id': '8508be40-2af9-45a5-96f0-06d142f33d8d', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:95:95:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '20fa17b9-5a43-469e-a0de-e9be80c05f6f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 567, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:30:48Z', 'updated_at': '2021-11-09T04:30:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': 'c68e1ebb-65d3-4c8e-b1c0-4ae8c774d9ed', 'tenant_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'floating_ip_address': '172.26.0.145', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '20fa17b9-5a43-469e-a0de-e9be80c05f6f', 'port_id': '9c023fad-c8fa-4120-b9cc-4ea22c1718e4', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 686, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9c94e7dc-d679-4a7e-b264-6d619dbc935e', 'mac_address': 'fa:16:3e:cd:a2:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c4e58e3-39e4-4212-b106-50b44d4c4e28', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:31:36Z', 'updated_at': '2021-11-09T04:31:36Z', 'revision_number': 0, 'project_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'bab3b0b2-ec0e-464a-b15f-1f71dc13f0f3', 'name': '', 'network_id': '9c94e7dc-d679-4a7e-b264-6d619dbc935e', 'tenant_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'mac_address': 'fa:16:3e:b2:bf:75', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '20fa17b9-5a43-469e-a0de-e9be80c05f6f', 'device_owner': 'network:router_interface', 'standard_attr_id': 610, 'fixed_ips': [{'subnet_id': '003822ea-7d1a-41fa-a15f-16fc8c9f624c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:31:00Z', 'updated_at': '2021-11-09T04:31:12Z', 'revision_number': 5, 'project_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'subnets': [{'id': '003822ea-7d1a-41fa-a15f-16fc8c9f624c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:42.460928 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-861d6cde-bfed-4499-97fe-2c8c7be9dfb2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Deleting subnet 6c3c1072-37d8-461c-8a31-3789e3e5eaf7 {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:31:42.476085 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1767631-fb0c-4d2f-8e5e-5deea2f85db6 req-f146c7d8-19cf-409b-91e3-1a7ef8ed328d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:42.481160 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c1767631-fb0c-4d2f-8e5e-5deea2f85db6 req-f146c7d8-19cf-409b-91e3-1a7ef8ed328d service neutron] 10.222.0.26 "GET /v2.0/networks?id=9c94e7dc-d679-4a7e-b264-6d619dbc935e HTTP/1.1" status: 200 len: 898 time: 0.4425490 Nov 09 04:31:42.487493 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-ea9c4d5a-c5b9-4ff4-8589-cb8ebb5622e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:42.498873 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-f05bebab-3199-4535-8911-b645d64af2d1 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] 10.222.0.24 "GET /v2.0/routers/e6aca457-3355-4bcc-88b1-a22334db50b0 HTTP/1.1" status: 200 len: 741 time: 0.1891029 Nov 09 04:31:42.501805 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-861d6cde-bfed-4499-97fe-2c8c7be9dfb2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:42.502481 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55608) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:42.502977 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-848febc3-a9f0-46c2-8297-a5b6f784f35c None None] The sync data for ids ['20fa17b9-5a43-469e-a0de-e9be80c05f6f'] in dv-neutron-816802-2-hyperv is: [{'id': '20fa17b9-5a43-469e-a0de-e9be80c05f6f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1135837892', 'tenant_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.69'}], 'enable_snat': True}, 'gw_port_id': '8508be40-2af9-45a5-96f0-06d142f33d8d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:30:45Z', 'updated_at': '2021-11-09T04:31:03Z', 'revision_number': 4, 'project_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'gw_port': {'id': '8508be40-2af9-45a5-96f0-06d142f33d8d', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:95:95:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '20fa17b9-5a43-469e-a0de-e9be80c05f6f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 567, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:30:48Z', 'updated_at': '2021-11-09T04:30:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': 'c68e1ebb-65d3-4c8e-b1c0-4ae8c774d9ed', 'tenant_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'floating_ip_address': '172.26.0.145', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '20fa17b9-5a43-469e-a0de-e9be80c05f6f', 'port_id': '9c023fad-c8fa-4120-b9cc-4ea22c1718e4', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 686, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9c94e7dc-d679-4a7e-b264-6d619dbc935e', 'mac_address': 'fa:16:3e:cd:a2:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c4e58e3-39e4-4212-b106-50b44d4c4e28', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:31:36Z', 'updated_at': '2021-11-09T04:31:36Z', 'revision_number': 0, 'project_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'bab3b0b2-ec0e-464a-b15f-1f71dc13f0f3', 'name': '', 'network_id': '9c94e7dc-d679-4a7e-b264-6d619dbc935e', 'tenant_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'mac_address': 'fa:16:3e:b2:bf:75', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '20fa17b9-5a43-469e-a0de-e9be80c05f6f', 'device_owner': 'network:router_interface', 'standard_attr_id': 610, 'fixed_ips': [{'subnet_id': '003822ea-7d1a-41fa-a15f-16fc8c9f624c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:31:00Z', 'updated_at': '2021-11-09T04:31:12Z', 'revision_number': 5, 'project_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'subnets': [{'id': '003822ea-7d1a-41fa-a15f-16fc8c9f624c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:31:42.506161 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ea9c4d5a-c5b9-4ff4-8589-cb8ebb5622e5 None None] Routers {'e6aca457-3355-4bcc-88b1-a22334db50b0'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:31:42.506683 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-ea9c4d5a-c5b9-4ff4-8589-cb8ebb5622e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:31:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['e6aca457-3355-4bcc-88b1-a22334db50b0'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:42.542074 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-ea9c4d5a-c5b9-4ff4-8589-cb8ebb5622e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:42.543039 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ea9c4d5a-c5b9-4ff4-8589-cb8ebb5622e5 None None] The sync data for ids ['e6aca457-3355-4bcc-88b1-a22334db50b0'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:31:42.581912 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-abdb8018-906f-4f81-9215-2c7b85f0e304 tempest-RoutersAdminTest-621841158 tempest-RoutersAdminTest-621841158-project-admin] 10.222.0.24 "GET /v2.0/ports?network_id=2b6725f5-ebfe-485a-8f42-ccb5a241ddb5&device_id=e6aca457-3355-4bcc-88b1-a22334db50b0 HTTP/1.1" status: 200 len: 205 time: 0.0755045 Nov 09 04:31:42.582149 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dc3dfa7a-e488-4991-8d26-e2e560c31736 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:42.588532 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55610) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:42.602134 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c098087f-ceb4-4c14-91b1-164dbeac5ae1 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:42.632223 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-93e736bf-5ba5-4b5c-8582-702a73ac02c9 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] 10.222.0.24 "GET /v2.0/ports?device_id=e6aca457-3355-4bcc-88b1-a22334db50b0 HTTP/1.1" status: 200 len: 205 time: 0.0450890 Nov 09 04:31:42.640181 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55612) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:42.657497 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c098087f-ceb4-4c14-91b1-164dbeac5ae1 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event deleted for resources: {'Port': ['ID=dd8ca3d6-4dec-4e1f-99e4-8d77ad7ba47f,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:42.726999 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dc3dfa7a-e488-4991-8d26-e2e560c31736 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] No DVR routers for this DVR port 545d912c-6e17-404f-a71d-e702f280749b on host dv-neutron-816802-2-hyperv {{(pid=102161) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:31:42.741261 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc3dfa7a-e488-4991-8d26-e2e560c31736 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Pushing event deleted for resources: {'Port': ['ID=545d912c-6e17-404f-a71d-e702f280749b,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:42.749832 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-861d6cde-bfed-4499-97fe-2c8c7be9dfb2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:42.772937 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-97156ed7-1222-450c-ac0f-b16700587530 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:42.777965 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c098087f-ceb4-4c14-91b1-164dbeac5ae1 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:42.784672 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-c098087f-ceb4-4c14-91b1-164dbeac5ae1 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "DELETE /v2.0/ports/dd8ca3d6-4dec-4e1f-99e4-8d77ad7ba47f HTTP/1.1" status: 204 len: 168 time: 1.7924058 Nov 09 04:31:42.788332 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55614) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:42.802273 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-29b071dc-70dc-456b-896c-a24e2b6d3696 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks [] for router, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:42.803181 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-24ecf401-fe6c-4653-8ba7-a7a0e36908be tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:42.817819 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ca6911ee-3f2e-4275-929d-0a2de3b6623c None None] New status for floating IP c68e1ebb-65d3-4c8e-b1c0-4ae8c774d9ed: ACTIVE {{(pid=102164) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 04:31:42.827426 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-a41e4caa-8cbe-425e-86bc-ff233fd3f73d tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] GET failed (client error): The resource could not be found. Nov 09 04:31:42.831595 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a41e4caa-8cbe-425e-86bc-ff233fd3f73d tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "GET /v2.0/ports/dd8ca3d6-4dec-4e1f-99e4-8d77ad7ba47f HTTP/1.1" status: 404 len: 333 time: 0.0398092 Nov 09 04:31:42.831844 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55616) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:42.874109 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-24ecf401-fe6c-4653-8ba7-a7a0e36908be tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:42.880884 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c1767631-fb0c-4d2f-8e5e-5deea2f85db6 req-53ccfbfb-eef2-42a0-8f7c-f88fdc6cb8a2 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=9c023fad-c8fa-4120-b9cc-4ea22c1718e4 HTTP/1.1" status: 200 len: 999 time: 0.3528473 Nov 09 04:31:42.974091 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24ecf401-fe6c-4653-8ba7-a7a0e36908be tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event updated for resources: {'SecurityGroup': ['ID=72e76adb-375a-4051-bf58-72b97c5a3a12,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:42.983135 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-24ecf401-fe6c-4653-8ba7-a7a0e36908be tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 324} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:31:42.999109 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-35a3872b-ae95-4e55-8c5b-893efd9571b9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Deleting subnet 437c42c6-b7c7-44c0-b5de-f9e368fcfb4a {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:31:43.007797 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-24ecf401-fe6c-4653-8ba7-a7a0e36908be tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:43.008140 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-24ecf401-fe6c-4653-8ba7-a7a0e36908be tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Added segment 53b7b761-0c0a-4377-98bf-58d99642533b of type vlan for network 002d27a0-2fb8-4426-9550-42c444556a8e Nov 09 04:31:43.009650 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-35a3872b-ae95-4e55-8c5b-893efd9571b9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:43.039862 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-97156ed7-1222-450c-ac0f-b16700587530 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Network e3317a1c-ad42-41af-9362-06b75b19b024 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:31:43.045748 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7e57dd9c-6a38-4e6e-a488-87cd2747332c req-03c5a254-2d5e-468a-8e05-20b3fa949264 service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1726263 Nov 09 04:31:43.078978 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e6a758ba-91a0-40d2-9b9c-5ea92a57343f None None] Network e3317a1c-ad42-41af-9362-06b75b19b024 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:43.157066 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dc3dfa7a-e488-4991-8d26-e2e560c31736 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:43.164145 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-24ecf401-fe6c-4653-8ba7-a7a0e36908be tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:43.190880 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-1c655703-7d2e-4e98-b224-8e76b8ca40c9 None None] Provisioning complete for port ddadbc85-88b3-4e57-8103-52476bdc4001 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:43.191245 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1c655703-7d2e-4e98-b224-8e76b8ca40c9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:43.203343 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-35a3872b-ae95-4e55-8c5b-893efd9571b9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:43.244995 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-861d6cde-bfed-4499-97fe-2c8c7be9dfb2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:43.249779 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-97156ed7-1222-450c-ac0f-b16700587530 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:43.275806 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-dc3dfa7a-e488-4991-8d26-e2e560c31736 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['eee30c13-c6dc-4255-8ec9-5487496489dd']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:43.278220 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97156ed7-1222-450c-ac0f-b16700587530 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event updated for resources: {'Port': ['ID=4a69f229-858a-4210-ad1e-16328d055046,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:43.324850 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-97156ed7-1222-450c-ac0f-b16700587530 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:31:43.336256 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-dc3dfa7a-e488-4991-8d26-e2e560c31736 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3b7d7d8b-6cf8-4405-beec-ebfe913df0ab') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:43.336563 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-dc3dfa7a-e488-4991-8d26-e2e560c31736 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3b7d7d8b-6cf8-4405-beec-ebfe913df0ab') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:43.337604 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e57dd9c-6a38-4e6e-a488-87cd2747332c req-93aa6af0-7c9b-40e2-88d5-06cf29ee8b53 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:43.340487 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7e57dd9c-6a38-4e6e-a488-87cd2747332c req-93aa6af0-7c9b-40e2-88d5-06cf29ee8b53 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=6015befde7f546d881cb247ae5bc81ae&device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 1098 time: 0.2244699 Nov 09 04:31:43.368283 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1767631-fb0c-4d2f-8e5e-5deea2f85db6 req-fa9bddc3-7d44-49dc-aa48-4dc31e2d58ff service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:43.369763 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c1767631-fb0c-4d2f-8e5e-5deea2f85db6 req-fa9bddc3-7d44-49dc-aa48-4dc31e2d58ff service neutron] 10.222.0.26 "GET /v2.0/subnets?id=003822ea-7d1a-41fa-a15f-16fc8c9f624c HTTP/1.1" status: 200 len: 834 time: 0.4316213 Nov 09 04:31:43.377943 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-29b071dc-70dc-456b-896c-a24e2b6d3696 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:43.392501 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dc3dfa7a-e488-4991-8d26-e2e560c31736 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:43.399120 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-29b071dc-70dc-456b-896c-a24e2b6d3696 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:43.405366 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-24ecf401-fe6c-4653-8ba7-a7a0e36908be tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:43.406630 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-24ecf401-fe6c-4653-8ba7-a7a0e36908be tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:43.407600 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-24ecf401-fe6c-4653-8ba7-a7a0e36908be tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:43.444382 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55620) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:43.524269 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dc3dfa7a-e488-4991-8d26-e2e560c31736 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:43.544691 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-35a3872b-ae95-4e55-8c5b-893efd9571b9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:43.548099 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-dc3dfa7a-e488-4991-8d26-e2e560c31736 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Releasing vlan 341 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:31:43.548421 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dc3dfa7a-e488-4991-8d26-e2e560c31736 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:43.553535 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-97156ed7-1222-450c-ac0f-b16700587530 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:43.555703 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:31:43.555703 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:31:43.555703 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:31:43.555703 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:31:43.555703 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:31:43.555703 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:31:43.555703 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:31:43.555703 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:31:43.555703 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:31:43.555703 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:31:43.555703 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:31:43.555703 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:31:43.555703 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:31:43.555703 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:31:43.555703 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:31:43.555703 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:31:43.555703 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:31:43.555703 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:31:43.555703 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:31:43.555703 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:31:43.555703 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:31:43.555703 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:31:43.555703 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:31:43.555703 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:31:43.555703 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:31:43.555703 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:31:43.555703 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:31:43.555703 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:31:43.555703 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:31:43.555703 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:31:43.555703 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:31:43.555703 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:31:43.658884 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-403df49a-428f-42de-9d4e-2688151cf030 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:43.731005 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-0d483db1-9a9f-48f5-80d3-23ee6d275d19 None None] Provisioning complete for port ddadbc85-88b3-4e57-8103-52476bdc4001 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:43.731568 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0d483db1-9a9f-48f5-80d3-23ee6d275d19 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:43.804505 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device ddadbc85-88b3-4e57-8103-52476bdc4001 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:31:43.873442 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-97735b1c-aeba-42ae-8f19-9775b42ba06a None None] get_active_networks_info from dv-neutron-816802-2-hyperv {{(pid=102163) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}} Nov 09 04:31:43.904448 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-24ecf401-fe6c-4653-8ba7-a7a0e36908be tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 2.6661708 Nov 09 04:31:43.921605 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55622) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:43.939656 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-b5c8a9c2-1145-4bb4-81b0-f180939b003a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Request body: {'port': {'network_id': '002d27a0-2fb8-4426-9550-42c444556a8e', 'name': 'tempest-PortsIpV6TestJSON-1799108103'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:43.942915 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24ecf401-fe6c-4653-8ba7-a7a0e36908be tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event updated for resources: {'Network': ['ID=002d27a0-2fb8-4426-9550-42c444556a8e,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:43.958564 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 002d27a0-2fb8-4426-9550-42c444556a8e details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:31:43.962524 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port ddadbc85-88b3-4e57-8103-52476bdc4001 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:43.962888 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:44.014231 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-0d483db1-9a9f-48f5-80d3-23ee6d275d19 None None] Provisioning complete for port 4a69f229-858a-4210-ad1e-16328d055046 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:44.014591 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0d483db1-9a9f-48f5-80d3-23ee6d275d19 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:44.046801 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e57dd9c-6a38-4e6e-a488-87cd2747332c req-34d783b1-3ead-42b4-9bdd-6454a1522391 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:44.048264 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7e57dd9c-6a38-4e6e-a488-87cd2747332c req-34d783b1-3ead-42b4-9bdd-6454a1522391 service neutron] 10.222.0.26 "GET /v2.0/networks?id=a270b61c-1f4f-4d97-be79-4a24c65fddc2 HTTP/1.1" status: 200 len: 913 time: 0.6681862 Nov 09 04:31:44.073649 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-29b071dc-70dc-456b-896c-a24e2b6d3696 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:44.075072 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-29b071dc-70dc-456b-896c-a24e2b6d3696 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Fanout notify agent at l3_agent the message router_deleted on router e6aca457-3355-4bcc-88b1-a22334db50b0 {{(pid=102161) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:31:44.091860 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-29b071dc-70dc-456b-896c-a24e2b6d3696 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:44.096360 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-29b071dc-70dc-456b-896c-a24e2b6d3696 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] 10.222.0.24 "DELETE /v2.0/routers/e6aca457-3355-4bcc-88b1-a22334db50b0 HTTP/1.1" status: 204 len: 168 time: 1.4495144 Nov 09 04:31:44.120757 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55624) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:44.127858 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-861d6cde-bfed-4499-97fe-2c8c7be9dfb2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:44.128362 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-0d483db1-9a9f-48f5-80d3-23ee6d275d19 None None] Port 4a69f229-858a-4210-ad1e-16328d055046 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:31:44.140215 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-97735b1c-aeba-42ae-8f19-9775b42ba06a None None] Resources bound (agent type, host, resource id): {{(pid=102163) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 09 04:31:44.148563 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1767631-fb0c-4d2f-8e5e-5deea2f85db6 req-c1d8ae61-51c5-4c83-988d-e01d079a5664 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:44.150398 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c1767631-fb0c-4d2f-8e5e-5deea2f85db6 req-c1d8ae61-51c5-4c83-988d-e01d079a5664 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=9c94e7dc-d679-4a7e-b264-6d619dbc935e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.7702892 Nov 09 04:31:44.169897 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-35a3872b-ae95-4e55-8c5b-893efd9571b9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:44.182414 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e60745d6-9eb2-42b2-8b8d-fb25e8ceae1c tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] 10.222.0.24 "GET /v2.0/ports?device_id=e6aca457-3355-4bcc-88b1-a22334db50b0 HTTP/1.1" status: 200 len: 205 time: 0.0574758 Nov 09 04:31:44.191504 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-3c20e50f-1b58-4a23-b42f-404469e1e6f0 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/floatingips/c68e1ebb-65d3-4c8e-b1c0-4ae8c774d9ed HTTP/1.1" status: 200 len: 993 time: 0.7337630 Nov 09 04:31:44.191504 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55626) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:44.191504 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-861d6cde-bfed-4499-97fe-2c8c7be9dfb2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event deleted for resources: {'Subnet': ['ID=6c3c1072-37d8-461c-8a31-3789e3e5eaf7,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:44.229681 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35a3872b-ae95-4e55-8c5b-893efd9571b9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event deleted for resources: {'Subnet': ['ID=437c42c6-b7c7-44c0-b5de-f9e368fcfb4a,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:44.234469 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-35a3872b-ae95-4e55-8c5b-893efd9571b9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:44.237649 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-35a3872b-ae95-4e55-8c5b-893efd9571b9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "DELETE /v2.0/subnets/437c42c6-b7c7-44c0-b5de-f9e368fcfb4a HTTP/1.1" status: 204 len: 168 time: 1.4048722 Nov 09 04:31:44.240500 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7e57dd9c-6a38-4e6e-a488-87cd2747332c req-049923a3-47f2-46ff-afbd-12624ac0efa1 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=99ad1d96-b35b-4120-b5a9-c95c47bd3ffc HTTP/1.1" status: 200 len: 1001 time: 0.1814568 Nov 09 04:31:44.240955 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55628) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:44.242504 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-861d6cde-bfed-4499-97fe-2c8c7be9dfb2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:44.246404 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-861d6cde-bfed-4499-97fe-2c8c7be9dfb2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/6c3c1072-37d8-461c-8a31-3789e3e5eaf7 HTTP/1.1" status: 204 len: 168 time: 2.0293288 Nov 09 04:31:44.250866 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b5c8a9c2-1145-4bb4-81b0-f180939b003a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Made reservation on behalf of 12e47d8445b5429892cd1b9244512ca8 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:44.254814 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b5c8a9c2-1145-4bb4-81b0-f180939b003a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:44.256626 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55630) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:44.259839 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-a2854698-f8f2-4581-b8d6-dfdbeb3cb626 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] delete failed (client error): The resource could not be found. Nov 09 04:31:44.260600 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a2854698-f8f2-4581-b8d6-dfdbeb3cb626 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] 10.222.0.24 "DELETE /v2.0/routers/e6aca457-3355-4bcc-88b1-a22334db50b0 HTTP/1.1" status: 404 len: 336 time: 0.0655985 Nov 09 04:31:44.272441 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dc3dfa7a-e488-4991-8d26-e2e560c31736 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:44.275324 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55632) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:44.277566 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dc3dfa7a-e488-4991-8d26-e2e560c31736 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:44.282154 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-dc3dfa7a-e488-4991-8d26-e2e560c31736 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] 10.222.0.24 "DELETE /v2.0/networks/eee30c13-c6dc-4255-8ec9-5487496489dd HTTP/1.1" status: 204 len: 168 time: 6.1592443 Nov 09 04:31:44.291035 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-96f75dfa-cdba-467f-945f-3bd986d507ef None None] Provisioning complete for port 4a69f229-858a-4210-ad1e-16328d055046 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:44.292682 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-96f75dfa-cdba-467f-945f-3bd986d507ef None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:44.292832 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55634) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:44.298657 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-cbd90781-61b9-4bc2-a70d-a8202fb8086e tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Request body: {'network': {'name': 'tempest-NetworksIpV6TestAttrs-test-network-911149139'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:44.339174 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc3dfa7a-e488-4991-8d26-e2e560c31736 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Pushing event deleted for resources: {'Network': ['ID=eee30c13-c6dc-4255-8ec9-5487496489dd,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:44.357529 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-96f75dfa-cdba-467f-945f-3bd986d507ef None None] Port 4a69f229-858a-4210-ad1e-16328d055046 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:31:44.380766 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-db54f2c9-430f-4831-bc01-b46164450e11 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1181650 Nov 09 04:31:44.396072 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55636) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:44.401130 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-f63c35be-e2a7-4b06-8104-45f396dbf947 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'subnet': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:44.426414 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-2331f569-4c6a-4dae-8d60-ed864aa33803 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] 10.222.0.24 "GET /v2.0/ports?device_id=3d66d565-d8a3-411f-95ad-0f9d3efda35b HTTP/1.1" status: 200 len: 205 time: 0.1319771 Nov 09 04:31:44.432489 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55638) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:44.452218 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [None req-b5c8a9c2-1145-4bb4-81b0-f180939b003a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] device_id is not set on port 77290ebd-f244-4a68-94af-4d033c4a6349 yet. {{(pid=102162) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:31:44.457181 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c1767631-fb0c-4d2f-8e5e-5deea2f85db6 req-c4254072-cfb1-4e67-836f-78a2d080e6d4 service neutron] 10.222.0.26 "GET /v2.0/networks/9c94e7dc-d679-4a7e-b264-6d619dbc935e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2856641 Nov 09 04:31:44.457742 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cbd90781-61b9-4bc2-a70d-a8202fb8086e tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Made reservation on behalf of 6acf678d74da4512a431e262bbd32037 for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:44.461088 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cbd90781-61b9-4bc2-a70d-a8202fb8086e tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:44.473974 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e57dd9c-6a38-4e6e-a488-87cd2747332c req-70977e32-1aa3-4187-972c-e2fc355f7f46 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:44.475749 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7e57dd9c-6a38-4e6e-a488-87cd2747332c req-70977e32-1aa3-4187-972c-e2fc355f7f46 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=b2956e71-9b0f-4060-922c-e54ce6cff80a HTTP/1.1" status: 200 len: 851 time: 0.2182636 Nov 09 04:31:44.481438 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-06beadf4-5899-4267-a99a-74f18262a4e9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:44.505667 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e79314ad-e04b-4e95-8eda-1e7210a4b76a None None] Network 4b71592d-70d0-4093-95b2-aac46ce97cc3 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:44.509660 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aac1436a-cdd9-4259-9955-7c351388edc1 None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:44.532590 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-97156ed7-1222-450c-ac0f-b16700587530 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:44.557225 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-fc5a00f0-f22b-4799-8205-da8e65a7ce10 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] delete failed (client error): The resource could not be found. Nov 09 04:31:44.558251 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-fc5a00f0-f22b-4799-8205-da8e65a7ce10 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] 10.222.0.24 "DELETE /v2.0/routers/3d66d565-d8a3-411f-95ad-0f9d3efda35b HTTP/1.1" status: 404 len: 336 time: 0.1169651 Nov 09 04:31:44.580635 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55642) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:44.663593 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-82c86092-3b88-4c67-85ae-53afdd70ef54 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] 10.222.0.24 "GET /v2.0/ports?device_id=59f4ff39-f644-4f83-8a3a-2a6f1674e434 HTTP/1.1" status: 200 len: 205 time: 0.0701363 Nov 09 04:31:44.668655 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55644) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:44.674288 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e57dd9c-6a38-4e6e-a488-87cd2747332c req-9c825569-c42a-448c-af78-b1619730ffde service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:44.675967 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7e57dd9c-6a38-4e6e-a488-87cd2747332c req-9c825569-c42a-448c-af78-b1619730ffde service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=a270b61c-1f4f-4d97-be79-4a24c65fddc2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1626542 Nov 09 04:31:44.755542 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-de5993f1-eca5-473b-b8df-c27e6ab13f9c tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] delete failed (client error): The resource could not be found. Nov 09 04:31:44.756832 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-de5993f1-eca5-473b-b8df-c27e6ab13f9c tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] 10.222.0.24 "DELETE /v2.0/routers/59f4ff39-f644-4f83-8a3a-2a6f1674e434 HTTP/1.1" status: 404 len: 336 time: 0.0651102 Nov 09 04:31:44.769642 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55646) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:44.770614 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-cbd90781-61b9-4bc2-a70d-a8202fb8086e tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 327} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:31:44.829775 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-03e41322-e734-4ff1-9816-dd95fabc4ea0 None None] DHCP port deletion for 4b71592d-70d0-4093-95b2-aac46ce97cc3 request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:31:44.848427 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-3af88bb6-d853-4b8e-9f6d-100923ff13e1 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] 10.222.0.24 "GET /v2.0/ports?device_id=e9b01a01-61f1-462d-88a5-1936b443614d HTTP/1.1" status: 200 len: 205 time: 0.0751429 Nov 09 04:31:44.851751 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55648) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:44.867242 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b3aa86d9-13a5-4b95-a264-329ea93ee332 None None] DHCP port deletion for 988d2354-693c-4d52-af17-25e0643eaa0c request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:31:44.903946 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cbd90781-61b9-4bc2-a70d-a8202fb8086e tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:44.905036 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-cbd90781-61b9-4bc2-a70d-a8202fb8086e tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Added segment 209765d0-635f-487d-8781-d5ae386b3e9c of type vlan for network 5aa1232d-f31a-4cc6-ac6d-901779fb1e90 Nov 09 04:31:44.913175 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-06beadf4-5899-4267-a99a-74f18262a4e9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Deleting port a38deaf7-04e8-49cf-b2ac-8058e68dc5bb {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:31:44.913626 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-06beadf4-5899-4267-a99a-74f18262a4e9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:44.919059 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b5c8a9c2-1145-4bb4-81b0-f180939b003a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:44.921644 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c1767631-fb0c-4d2f-8e5e-5deea2f85db6 req-62a83205-64bb-40db-90c4-3b7d5dd0d0e1 service neutron] 10.222.0.26 "GET /v2.0/networks/9c94e7dc-d679-4a7e-b264-6d619dbc935e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3808732 Nov 09 04:31:44.921789 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.api.v2.resource [None req-e140e00c-b5e6-437c-ae63-ae7af1869628 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] delete failed (client error): The resource could not be found. Nov 09 04:31:44.922680 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e140e00c-b5e6-437c-ae63-ae7af1869628 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] 10.222.0.24 "DELETE /v2.0/routers/e9b01a01-61f1-462d-88a5-1936b443614d HTTP/1.1" status: 404 len: 336 time: 0.0671492 Nov 09 04:31:44.925784 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-03e41322-e734-4ff1-9816-dd95fabc4ea0 None None] Deleting port a38deaf7-04e8-49cf-b2ac-8058e68dc5bb {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:31:44.926133 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-03e41322-e734-4ff1-9816-dd95fabc4ea0 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:44.931154 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f63c35be-e2a7-4b06-8104-45f396dbf947 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:44.935686 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f63c35be-e2a7-4b06-8104-45f396dbf947 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:44.948636 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55650) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:45.010543 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7e57dd9c-6a38-4e6e-a488-87cd2747332c req-9721f149-2a38-4cc5-a699-a67465eef282 service neutron] 10.222.0.26 "GET /v2.0/networks/a270b61c-1f4f-4d97-be79-4a24c65fddc2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3215001 Nov 09 04:31:45.016299 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-b356ccb9-a86c-4e55-a0db-d5439caadfea tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] 10.222.0.24 "GET /v2.0/ports?device_id=454f4384-6780-4402-98ea-5edbe666cd33 HTTP/1.1" status: 200 len: 205 time: 0.0665622 Nov 09 04:31:45.018931 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-b3aa86d9-13a5-4b95-a264-329ea93ee332 None None] Deleting port 5cca359a-c0bf-453d-a350-59ef893974e4 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:31:45.019305 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b3aa86d9-13a5-4b95-a264-329ea93ee332 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:45.021963 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55652) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:45.042525 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-03e41322-e734-4ff1-9816-dd95fabc4ea0 None None] For port a38deaf7-04e8-49cf-b2ac-8058e68dc5bb, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=a38deaf7-04e8-49cf-b2ac-8058e68dc5bb,segment=NetworkSegment(2f186152-3244-4ac7-9a61-268e892ccb4c),segment_id=2f186152-3244-4ac7-9a61-268e892ccb4c)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:31:45.042841 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-03e41322-e734-4ff1-9816-dd95fabc4ea0 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:45.069629 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-06beadf4-5899-4267-a99a-74f18262a4e9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] For port a38deaf7-04e8-49cf-b2ac-8058e68dc5bb, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=a38deaf7-04e8-49cf-b2ac-8058e68dc5bb,segment=NetworkSegment(2f186152-3244-4ac7-9a61-268e892ccb4c),segment_id=2f186152-3244-4ac7-9a61-268e892ccb4c)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:31:45.069992 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-06beadf4-5899-4267-a99a-74f18262a4e9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:45.082782 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-03e41322-e734-4ff1-9816-dd95fabc4ea0 None None] Calling delete_port for a38deaf7-04e8-49cf-b2ac-8058e68dc5bb owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:31:45.084516 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:45.108729 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-b3aa86d9-13a5-4b95-a264-329ea93ee332 None None] For port 5cca359a-c0bf-453d-a350-59ef893974e4, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=5cca359a-c0bf-453d-a350-59ef893974e4,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:31:45.109125 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b3aa86d9-13a5-4b95-a264-329ea93ee332 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:45.115546 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cbd90781-61b9-4bc2-a70d-a8202fb8086e tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:45.117437 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-06beadf4-5899-4267-a99a-74f18262a4e9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Calling delete_port for a38deaf7-04e8-49cf-b2ac-8058e68dc5bb owned by network:dhcp {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:31:45.133913 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-f93027dc-945f-4861-8589-83457a683c08 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] delete failed (client error): The resource could not be found. Nov 09 04:31:45.137844 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-f93027dc-945f-4861-8589-83457a683c08 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] 10.222.0.24 "DELETE /v2.0/routers/454f4384-6780-4402-98ea-5edbe666cd33 HTTP/1.1" status: 404 len: 336 time: 0.1098635 Nov 09 04:31:45.138245 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55654) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:45.155031 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-b3aa86d9-13a5-4b95-a264-329ea93ee332 None None] Calling delete_port for 5cca359a-c0bf-453d-a350-59ef893974e4 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:31:45.207101 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-f45e2588-a843-4913-8be9-1704ede14406 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] 10.222.0.24 "GET /v2.0/ports?device_id=51b84bbe-6de2-4db7-8c1e-f355ca5a4450 HTTP/1.1" status: 200 len: 205 time: 0.0641947 Nov 09 04:31:45.207783 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55656) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:45.214548 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7e57dd9c-6a38-4e6e-a488-87cd2747332c req-9955d736-8dee-42e8-9fa3-9f65c5b6eb2b service neutron] 10.222.0.26 "GET /v2.0/networks/a270b61c-1f4f-4d97-be79-4a24c65fddc2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1925118 Nov 09 04:31:45.217577 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b5c8a9c2-1145-4bb4-81b0-f180939b003a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:45.288571 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5c8a9c2-1145-4bb4-81b0-f180939b003a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event updated for resources: {'Port': ['ID=77290ebd-f244-4a68-94af-4d033c4a6349,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:45.302609 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-b86b8e8a-6765-48df-9be8-80cf43f138cc tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] delete failed (client error): The resource could not be found. Nov 09 04:31:45.303997 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-b86b8e8a-6765-48df-9be8-80cf43f138cc tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] 10.222.0.24 "DELETE /v2.0/routers/51b84bbe-6de2-4db7-8c1e-f355ca5a4450 HTTP/1.1" status: 404 len: 336 time: 0.0929420 Nov 09 04:31:45.306787 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55658) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:45.324749 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cbd90781-61b9-4bc2-a70d-a8202fb8086e tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:45.331081 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cbd90781-61b9-4bc2-a70d-a8202fb8086e tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:45.331728 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cbd90781-61b9-4bc2-a70d-a8202fb8086e tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:45.339417 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-eb1d2f81-37b8-427c-be67-3971ac7df1e8 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] DELETE failed (client error): The resource could not be found. Nov 09 04:31:45.339867 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-eb1d2f81-37b8-427c-be67-3971ac7df1e8 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:31:45.343471 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-eb1d2f81-37b8-427c-be67-3971ac7df1e8 tempest-RoutersAdminTest-775268931 tempest-RoutersAdminTest-775268931-project] 10.222.0.24 "DELETE /v2.0/subnets/2af48489-6c72-46b4-8eb9-1e92215d96e9 HTTP/1.1" status: 404 len: 337 time: 0.0357447 Nov 09 04:31:45.348881 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b5c8a9c2-1145-4bb4-81b0-f180939b003a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Checking segment: {'id': '53b7b761-0c0a-4377-98bf-58d99642533b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 324, 'network_id': '002d27a0-2fb8-4426-9550-42c444556a8e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:31:45.349290 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b5c8a9c2-1145-4bb4-81b0-f180939b003a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Network hostable DHCP agents. Network: 002d27a0-2fb8-4426-9550-42c444556a8e, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:31:45.373472 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-03e41322-e734-4ff1-9816-dd95fabc4ea0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:45.382295 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-06beadf4-5899-4267-a99a-74f18262a4e9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:45.407988 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03e41322-e734-4ff1-9816-dd95fabc4ea0 None None] Pushing event deleted for resources: {'Port': ['ID=a38deaf7-04e8-49cf-b2ac-8058e68dc5bb,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:45.409402 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b3aa86d9-13a5-4b95-a264-329ea93ee332 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:45.412399 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-03e41322-e734-4ff1-9816-dd95fabc4ea0 None None] No DVR routers for this DVR port a38deaf7-04e8-49cf-b2ac-8058e68dc5bb on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:31:45.419895 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06beadf4-5899-4267-a99a-74f18262a4e9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event deleted for resources: {'Port': ['ID=a38deaf7-04e8-49cf-b2ac-8058e68dc5bb,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:45.424197 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-06beadf4-5899-4267-a99a-74f18262a4e9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] No DVR routers for this DVR port a38deaf7-04e8-49cf-b2ac-8058e68dc5bb on host dv-neutron-816802-2-hyperv {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:31:45.430345 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b5c8a9c2-1145-4bb4-81b0-f180939b003a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Network 002d27a0-2fb8-4426-9550-42c444556a8e is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:31:45.445053 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b3aa86d9-13a5-4b95-a264-329ea93ee332 None None] No DVR routers for this DVR port 5cca359a-c0bf-453d-a350-59ef893974e4 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:31:45.446783 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3aa86d9-13a5-4b95-a264-329ea93ee332 None None] Pushing event deleted for resources: {'Port': ['ID=5cca359a-c0bf-453d-a350-59ef893974e4,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:45.480966 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbd90781-61b9-4bc2-a70d-a8202fb8086e tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Pushing event updated for resources: {'Network': ['ID=5aa1232d-f31a-4cc6-ac6d-901779fb1e90,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:45.492620 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 5aa1232d-f31a-4cc6-ac6d-901779fb1e90 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:31:45.515546 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-cbd90781-61b9-4bc2-a70d-a8202fb8086e tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 788 time: 1.2208707 Nov 09 04:31:45.523963 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55662) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:45.528994 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-7a7c53f4-0cfc-4db5-ba34-708f6ca7a62d tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Request body: {'subnet': {'network_id': '5aa1232d-f31a-4cc6-ac6d-901779fb1e90', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': None, 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:45.541389 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-06beadf4-5899-4267-a99a-74f18262a4e9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:45.567265 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-b5c8a9c2-1145-4bb4-81b0-f180939b003a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 002d27a0-2fb8-4426-9550-42c444556a8e) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:45.568085 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-06beadf4-5899-4267-a99a-74f18262a4e9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4b71592d-70d0-4093-95b2-aac46ce97cc3']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:45.570166 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b5c8a9c2-1145-4bb4-81b0-f180939b003a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:31:45.571195 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-97156ed7-1222-450c-ac0f-b16700587530 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:45.576237 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b5c8a9c2-1145-4bb4-81b0-f180939b003a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:45.576858 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b5c8a9c2-1145-4bb4-81b0-f180939b003a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:45.579716 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d6421bac-2736-4b3a-aca4-7ee5d38ce339 None None] Network 002d27a0-2fb8-4426-9550-42c444556a8e requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:45.587824 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-06beadf4-5899-4267-a99a-74f18262a4e9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2f186152-3244-4ac7-9a61-268e892ccb4c') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:45.588121 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-06beadf4-5899-4267-a99a-74f18262a4e9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2f186152-3244-4ac7-9a61-268e892ccb4c') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:45.603064 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-06beadf4-5899-4267-a99a-74f18262a4e9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:45.609683 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f63c35be-e2a7-4b06-8104-45f396dbf947 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:45.618553 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-06beadf4-5899-4267-a99a-74f18262a4e9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:45.628788 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-06beadf4-5899-4267-a99a-74f18262a4e9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Releasing vlan 338 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:31:45.629789 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-06beadf4-5899-4267-a99a-74f18262a4e9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:45.664406 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-97156ed7-1222-450c-ac0f-b16700587530 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:45.693439 dv-neutron-816802-2-hyperv neutron-server[102162]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:31:45.693439 dv-neutron-816802-2-hyperv neutron-server[102162]: self.session.flush() Nov 09 04:31:45.693439 dv-neutron-816802-2-hyperv neutron-server[102162]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:31:45.693439 dv-neutron-816802-2-hyperv neutron-server[102162]: self.session.flush() Nov 09 04:31:45.693439 dv-neutron-816802-2-hyperv neutron-server[102162]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:31:45.693439 dv-neutron-816802-2-hyperv neutron-server[102162]: self.session.flush() Nov 09 04:31:45.693439 dv-neutron-816802-2-hyperv neutron-server[102162]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:31:45.693439 dv-neutron-816802-2-hyperv neutron-server[102162]: self.session.flush() Nov 09 04:31:45.693439 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:31:45.693439 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:31:45.693439 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:31:45.693439 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:31:45.693439 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:31:45.693439 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:31:45.693439 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:31:45.693439 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:31:45.693439 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:31:45.693439 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:31:45.693439 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:31:45.693439 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:31:45.693439 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:31:45.693439 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:31:45.693439 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:31:45.693439 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:31:45.693439 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:31:45.693439 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:31:45.693439 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:31:45.693439 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:31:45.693439 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:31:45.693439 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:31:45.693439 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:31:45.693439 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:31:45.693439 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:31:45.693439 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:31:45.693439 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:31:45.693439 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:31:45.693439 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:31:45.693439 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:31:45.693439 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:31:45.693439 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:31:45.748242 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f63c35be-e2a7-4b06-8104-45f396dbf947 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:31:45.758134 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-b5c8a9c2-1145-4bb4-81b0-f180939b003a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 850 time: 1.8287172 Nov 09 04:31:45.759009 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55666) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:45.761476 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-f63c35be-e2a7-4b06-8104-45f396dbf947 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:45.768359 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-7742c6cf-20b0-49cf-a07c-c06a101355bf tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-1409895303'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:45.773620 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f63c35be-e2a7-4b06-8104-45f396dbf947 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:45.774218 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f63c35be-e2a7-4b06-8104-45f396dbf947 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:45.776654 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device a38deaf7-04e8-49cf-b2ac-8058e68dc5bb no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:31:45.779625 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d0b327c7-da18-4d37-bb29-2e4d450d390e None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:45.793097 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f63c35be-e2a7-4b06-8104-45f396dbf947 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Subnet': ['ID=c0f38e80-422e-45b9-9f12-68df700bab47,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:45.797903 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97156ed7-1222-450c-ac0f-b16700587530 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event updated for resources: {'Port': ['ID=4a69f229-858a-4210-ad1e-16328d055046,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:45.803148 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-97156ed7-1222-450c-ac0f-b16700587530 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:45.803481 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: a38deaf7-04e8-49cf-b2ac-8058e68dc5bb {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:31:45.803924 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device a38deaf7-04e8-49cf-b2ac-8058e68dc5bb not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:31:45.804643 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 5cca359a-c0bf-453d-a350-59ef893974e4 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:31:45.830253 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-06beadf4-5899-4267-a99a-74f18262a4e9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:45.836826 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7a7c53f4-0cfc-4db5-ba34-708f6ca7a62d tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Made reservation on behalf of 6acf678d74da4512a431e262bbd32037 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:45.839095 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-06beadf4-5899-4267-a99a-74f18262a4e9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:45.840959 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7a7c53f4-0cfc-4db5-ba34-708f6ca7a62d tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:45.845990 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-06beadf4-5899-4267-a99a-74f18262a4e9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "DELETE /v2.0/networks/4b71592d-70d0-4093-95b2-aac46ce97cc3 HTTP/1.1" status: 204 len: 168 time: 1.6035621 Nov 09 04:31:45.850972 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55668) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:45.859270 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06beadf4-5899-4267-a99a-74f18262a4e9 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event deleted for resources: {'Network': ['ID=4b71592d-70d0-4093-95b2-aac46ce97cc3,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:45.865675 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-c62560f3-e004-41b5-b180-145e8c6a3d89 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-1909706872'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:45.877639 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 5cca359a-c0bf-453d-a350-59ef893974e4 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:31:45.877639 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 5cca359a-c0bf-453d-a350-59ef893974e4 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:31:45.916878 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-f63c35be-e2a7-4b06-8104-45f396dbf947 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 1.5197363 Nov 09 04:31:45.919980 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55670) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:45.926400 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-9a9c7121-bf23-44fd-9aeb-8f4171f40cf2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'port': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'fixed_ips': [{'subnet_id': 'c0f38e80-422e-45b9-9f12-68df700bab47', 'ip_address': '2001:db8::1017:f4ed:6b8d:fc67'}], 'name': 'tempest-NetworksTestDHCPv6-647938160'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:46.015351 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4728b2b5-9b91-4ff8-ab3d-c4255d003f5f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-988d2354-693c-4d52-af17-25e0643eaa0c', 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'tenant_id': '8b0758f781884982bf5b94e6609237f6', 'fixed_ips': [{'subnet_id': 'c0f38e80-422e-45b9-9f12-68df700bab47'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:31:46.016349 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4728b2b5-9b91-4ff8-ab3d-c4255d003f5f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:46.016470 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-97156ed7-1222-450c-ac0f-b16700587530 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Network e3317a1c-ad42-41af-9362-06b75b19b024 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:31:46.019186 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-97156ed7-1222-450c-ac0f-b16700587530 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:46.028594 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55674) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:46.121078 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7742c6cf-20b0-49cf-a07c-c06a101355bf tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Made reservation on behalf of 12e47d8445b5429892cd1b9244512ca8 for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:46.125487 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7742c6cf-20b0-49cf-a07c-c06a101355bf tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:46.154319 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.db.api [None req-9a9c7121-bf23-44fd-9aeb-8f4171f40cf2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Nov 09 04:31:46.154319 dv-neutron-816802-2-hyperv neutron-server[102162]: [SQL: DELETE FROM reservations WHERE reservations.project_id = %(project_id_1)s AND reservations.expiration < %(expiration_1)s] Nov 09 04:31:46.154319 dv-neutron-816802-2-hyperv neutron-server[102162]: [parameters: {'project_id_1': '8b0758f781884982bf5b94e6609237f6', 'expiration_1': datetime.datetime(2021, 11, 9, 4, 31, 26, 37783)}] Nov 09 04:31:46.154319 dv-neutron-816802-2-hyperv neutron-server[102162]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=102162) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:31:46.155023 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG oslo_db.api [None req-9a9c7121-bf23-44fd-9aeb-8f4171f40cf2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Performing DB retry for function neutron.db.quota.driver_nolock.DbQuotaNoLockDriver.make_reservation {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:31:46.172674 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7742c6cf-20b0-49cf-a07c-c06a101355bf tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 341} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:31:46.187092 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7742c6cf-20b0-49cf-a07c-c06a101355bf tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:46.187450 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-7742c6cf-20b0-49cf-a07c-c06a101355bf tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Added segment 4f24ec86-e856-4521-94e9-d073a256b635 of type vlan for network aae922f8-feeb-4960-8f09-cf16836975ff Nov 09 04:31:46.211275 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-4728b2b5-9b91-4ff8-ab3d-c4255d003f5f None None] Allocated IP 2001:db8::2 (988d2354-693c-4d52-af17-25e0643eaa0c/c0f38e80-422e-45b9-9f12-68df700bab47/98e8f3dd-7b0f-4505-a30f-352681a1b560) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:31:46.244330 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-aa73d30a-86dc-46bb-96ad-e42a8ae93790 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:46.256820 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c62560f3-e004-41b5-b180-145e8c6a3d89 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Made reservation on behalf of 88f9f8da29bf4a8793b45130d483a6e6 for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:46.259970 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7742c6cf-20b0-49cf-a07c-c06a101355bf tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:46.261746 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c62560f3-e004-41b5-b180-145e8c6a3d89 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:46.346597 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c62560f3-e004-41b5-b180-145e8c6a3d89 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 314} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:31:46.357239 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-97156ed7-1222-450c-ac0f-b16700587530 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Router cdc40031-5d8e-4301-8c14-526915537ddc is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102161) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:31:46.366434 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c62560f3-e004-41b5-b180-145e8c6a3d89 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:46.366787 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-c62560f3-e004-41b5-b180-145e8c6a3d89 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Added segment 667f2f48-63ef-4391-830e-9180dff2b93f of type vlan for network f8dfd1cc-6ee7-4112-9ceb-eb2ba064609b Nov 09 04:31:46.368046 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-aa73d30a-86dc-46bb-96ad-e42a8ae93790 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:46.369085 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7742c6cf-20b0-49cf-a07c-c06a101355bf tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:46.375134 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7742c6cf-20b0-49cf-a07c-c06a101355bf tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:46.375847 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7742c6cf-20b0-49cf-a07c-c06a101355bf tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:46.404135 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.objects.ports [None req-7a7c53f4-0cfc-4db5-ba34-708f6ca7a62d tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=102161) get_objects /opt/stack/neutron/neutron/objects/ports.py:444}} Nov 09 04:31:46.426904 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7a7c53f4-0cfc-4db5-ba34-708f6ca7a62d tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:46.444113 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-aa73d30a-86dc-46bb-96ad-e42a8ae93790 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:46.466847 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7742c6cf-20b0-49cf-a07c-c06a101355bf tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event updated for resources: {'Network': ['ID=aae922f8-feeb-4960-8f09-cf16836975ff,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:46.479392 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-7742c6cf-20b0-49cf-a07c-c06a101355bf tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 0.7153468 Nov 09 04:31:46.490063 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55678) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:46.498237 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-31bd4495-58c8-4ab9-afe7-dd64ea8babd5 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Request body: {'ports': [{'network_id': '002d27a0-2fb8-4426-9550-42c444556a8e'}, {'network_id': 'aae922f8-feeb-4960-8f09-cf16836975ff'}]} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:46.498664 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-31bd4495-58c8-4ab9-afe7-dd64ea8babd5 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Request body: {'port': {'network_id': '002d27a0-2fb8-4426-9550-42c444556a8e'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:46.499206 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-31bd4495-58c8-4ab9-afe7-dd64ea8babd5 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Request body: {'port': {'network_id': 'aae922f8-feeb-4960-8f09-cf16836975ff'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:46.518694 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa73d30a-86dc-46bb-96ad-e42a8ae93790 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0145ea39-06da-4651-ab72-bc8d342c62ff,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:46.529300 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network aae922f8-feeb-4960-8f09-cf16836975ff details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:31:46.530967 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-aa73d30a-86dc-46bb-96ad-e42a8ae93790 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=60dc857bfedd42aaa56662a743ebf896&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4994164 Nov 09 04:31:46.533520 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55680) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:46.539121 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c62560f3-e004-41b5-b180-145e8c6a3d89 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:46.588075 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a7c53f4-0cfc-4db5-ba34-708f6ca7a62d tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Pushing event updated for resources: {'Subnet': ['ID=79c7b6ce-4c68-4f72-add3-35ec03b2be83,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:46.597814 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-97156ed7-1222-450c-ac0f-b16700587530 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:31:46.609353 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-97156ed7-1222-450c-ac0f-b16700587530 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "PUT /v2.0/routers/cdc40031-5d8e-4301-8c14-526915537ddc/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.7818558 Nov 09 04:31:46.609974 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55682) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:46.646071 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7a7c53f4-0cfc-4db5-ba34-708f6ca7a62d tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Checking segment: {'id': '209765d0-635f-487d-8781-d5ae386b3e9c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 327, 'network_id': '5aa1232d-f31a-4cc6-ac6d-901779fb1e90'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:31:46.646777 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7a7c53f4-0cfc-4db5-ba34-708f6ca7a62d tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Network hostable DHCP agents. Network: 5aa1232d-f31a-4cc6-ac6d-901779fb1e90, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:31:46.669468 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-78535962-cae9-4511-abb0-b213f54c013c tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:46.671158 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-78535962-cae9-4511-abb0-b213f54c013c tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "GET /v2.0/ports/4a69f229-858a-4210-ad1e-16328d055046 HTTP/1.1" status: 200 len: 910 time: 0.0586710 Nov 09 04:31:46.672369 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-35b8f935-2a56-46d4-ba83-46ff2da6ddd1 None None] Sync routers for ids ['cdc40031-5d8e-4301-8c14-526915537ddc'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:31:46.673984 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55686) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:46.691334 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:46.698195 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-35b8f935-2a56-46d4-ba83-46ff2da6ddd1 None None] Routers {'cdc40031-5d8e-4301-8c14-526915537ddc'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:31:46.699556 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-35b8f935-2a56-46d4-ba83-46ff2da6ddd1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:31:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['cdc40031-5d8e-4301-8c14-526915537ddc'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:46.716439 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4b64e055-b216-4a71-8673-ad9b8c6451ae admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:46.722525 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c62560f3-e004-41b5-b180-145e8c6a3d89 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:46.728767 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c62560f3-e004-41b5-b180-145e8c6a3d89 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:46.734630 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c62560f3-e004-41b5-b180-145e8c6a3d89 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:46.743726 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-49e7e4e1-3360-48d3-a4b3-aad8138a61c2 None None] Provisioning complete for port 4a69f229-858a-4210-ad1e-16328d055046 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:46.744183 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-49e7e4e1-3360-48d3-a4b3-aad8138a61c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:46.752406 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4b64e055-b216-4a71-8673-ad9b8c6451ae admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:46.812972 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9a9c7121-bf23-44fd-9aeb-8f4171f40cf2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:46.820845 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-35b8f935-2a56-46d4-ba83-46ff2da6ddd1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:46.825739 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-49e7e4e1-3360-48d3-a4b3-aad8138a61c2 None None] Port 4a69f229-858a-4210-ad1e-16328d055046 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:31:46.874468 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4728b2b5-9b91-4ff8-ab3d-c4255d003f5f None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:46.908927 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-35b8f935-2a56-46d4-ba83-46ff2da6ddd1 None None] Routers {'cdc40031-5d8e-4301-8c14-526915537ddc'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:31:46.909837 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-35b8f935-2a56-46d4-ba83-46ff2da6ddd1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:31:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['cdc40031-5d8e-4301-8c14-526915537ddc'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:46.955463 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-35b8f935-2a56-46d4-ba83-46ff2da6ddd1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:46.956127 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-35b8f935-2a56-46d4-ba83-46ff2da6ddd1 None None] The sync data for ids ['cdc40031-5d8e-4301-8c14-526915537ddc'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:31:46.996681 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4728b2b5-9b91-4ff8-ab3d-c4255d003f5f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:47.029706 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:47.040398 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4728b2b5-9b91-4ff8-ab3d-c4255d003f5f None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:31:47.044149 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-4728b2b5-9b91-4ff8-ab3d-c4255d003f5f None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:47.050894 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4728b2b5-9b91-4ff8-ab3d-c4255d003f5f None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:31:47.061027 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4728b2b5-9b91-4ff8-ab3d-c4255d003f5f None None] Pushing event updated for resources: {'Port': ['ID=98e8f3dd-7b0f-4505-a30f-352681a1b560,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:47.122402 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-4728b2b5-9b91-4ff8-ab3d-c4255d003f5f None None] Attempting to bind port 98e8f3dd-7b0f-4505-a30f-352681a1b560 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:31:47.122691 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-4728b2b5-9b91-4ff8-ab3d-c4255d003f5f None None] Attempting to bind port 98e8f3dd-7b0f-4505-a30f-352681a1b560 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:31:47.123291 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4728b2b5-9b91-4ff8-ab3d-c4255d003f5f None None] Attempting to bind port 98e8f3dd-7b0f-4505-a30f-352681a1b560 on network 988d2354-693c-4d52-af17-25e0643eaa0c {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:31:47.129005 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4728b2b5-9b91-4ff8-ab3d-c4255d003f5f None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 31, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:31:47.129670 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4728b2b5-9b91-4ff8-ab3d-c4255d003f5f None None] Checking segment: {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:31:47.130871 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4728b2b5-9b91-4ff8-ab3d-c4255d003f5f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:47.131317 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4728b2b5-9b91-4ff8-ab3d-c4255d003f5f None None] Bound using segment: {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:31:47.131956 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-4728b2b5-9b91-4ff8-ab3d-c4255d003f5f None None] Bound port: 98e8f3dd-7b0f-4505-a30f-352681a1b560, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:31:47.132666 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4728b2b5-9b91-4ff8-ab3d-c4255d003f5f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:47.180314 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-31bd4495-58c8-4ab9-afe7-dd64ea8babd5 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Made reservation on behalf of 12e47d8445b5429892cd1b9244512ca8 for: {'port': 2} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:47.186991 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-31bd4495-58c8-4ab9-afe7-dd64ea8babd5 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:47.188935 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4b64e055-b216-4a71-8673-ad9b8c6451ae admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:47.192365 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4b64e055-b216-4a71-8673-ad9b8c6451ae admin admin] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:47.197694 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-4b64e055-b216-4a71-8673-ad9b8c6451ae admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/0145ea39-06da-4651-ab72-bc8d342c62ff HTTP/1.1" status: 204 len: 168 time: 0.6627178 Nov 09 04:31:47.218009 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b64e055-b216-4a71-8673-ad9b8c6451ae admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0145ea39-06da-4651-ab72-bc8d342c62ff,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:47.236750 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-31bd4495-58c8-4ab9-afe7-dd64ea8babd5 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:47.245933 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-4728b2b5-9b91-4ff8-ab3d-c4255d003f5f None None] For port 98e8f3dd-7b0f-4505-a30f-352681a1b560, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:31:47.257583 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-4728b2b5-9b91-4ff8-ab3d-c4255d003f5f None None] For port 98e8f3dd-7b0f-4505-a30f-352681a1b560, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=98e8f3dd-7b0f-4505-a30f-352681a1b560,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:31:47.286337 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7a7c53f4-0cfc-4db5-ba34-708f6ca7a62d tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Network 5aa1232d-f31a-4cc6-ac6d-901779fb1e90 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:31:47.306041 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c62560f3-e004-41b5-b180-145e8c6a3d89 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event updated for resources: {'Network': ['ID=f8dfd1cc-6ee7-4112-9ceb-eb2ba064609b,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:47.324217 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9a9c7121-bf23-44fd-9aeb-8f4171f40cf2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:47.325903 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-c62560f3-e004-41b5-b180-145e8c6a3d89 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 1.4644089 Nov 09 04:31:47.330035 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55692) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:47.332458 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network f8dfd1cc-6ee7-4112-9ceb-eb2ba064609b details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:31:47.337599 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-49475489-f8d3-4ee9-8d35-14cd15644bde tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Request body: {'subnet': {'network_id': 'f8dfd1cc-6ee7-4112-9ceb-eb2ba064609b', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:47.353356 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4728b2b5-9b91-4ff8-ab3d-c4255d003f5f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:47.374554 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [None req-31bd4495-58c8-4ab9-afe7-dd64ea8babd5 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] device_id is not set on port b7759ec5-6631-48fb-aabd-d9ec8a957fff yet. {{(pid=102162) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:31:47.409029 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-7a7c53f4-0cfc-4db5-ba34-708f6ca7a62d tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 5aa1232d-f31a-4cc6-ac6d-901779fb1e90) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:47.425440 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [None req-9a9c7121-bf23-44fd-9aeb-8f4171f40cf2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] device_id is not set on port bee544d4-6429-4229-89e5-f084b5b13d62 yet. {{(pid=102162) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:31:47.426016 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-62a3dd95-982b-44ac-b674-af31fed4209b None None] Network 5aa1232d-f31a-4cc6-ac6d-901779fb1e90 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:47.438782 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7a7c53f4-0cfc-4db5-ba34-708f6ca7a62d tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:47.439548 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7a7c53f4-0cfc-4db5-ba34-708f6ca7a62d tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:47.511588 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4728b2b5-9b91-4ff8-ab3d-c4255d003f5f None None] Pushing event updated for resources: {'Port': ['ID=98e8f3dd-7b0f-4505-a30f-352681a1b560,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:47.556367 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ca530d92-95f8-4dda-bf37-0eef5d058123 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:47.616487 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-7a7c53f4-0cfc-4db5-ba34-708f6ca7a62d tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 840 time: 2.0913808 Nov 09 04:31:47.617526 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55696) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:47.666212 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1c015963-03ef-41ba-af5e-514ddc092577 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-5aa1232d-f31a-4cc6-ac6d-901779fb1e90', 'network_id': '5aa1232d-f31a-4cc6-ac6d-901779fb1e90', 'tenant_id': '6acf678d74da4512a431e262bbd32037', 'fixed_ips': [{'subnet_id': '79c7b6ce-4c68-4f72-add3-35ec03b2be83'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:31:47.667790 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1c015963-03ef-41ba-af5e-514ddc092577 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:47.734013 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-49475489-f8d3-4ee9-8d35-14cd15644bde tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Made reservation on behalf of 88f9f8da29bf4a8793b45130d483a6e6 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:47.737731 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-49475489-f8d3-4ee9-8d35-14cd15644bde tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:47.804254 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1fcd3518-b095-49fe-b72d-08d1ded6e098 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:47.820098 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-9a9c7121-bf23-44fd-9aeb-8f4171f40cf2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Allocated IP 2001:db8::1017:f4ed:6b8d:fc67 (988d2354-693c-4d52-af17-25e0643eaa0c/c0f38e80-422e-45b9-9f12-68df700bab47/bee544d4-6429-4229-89e5-f084b5b13d62) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:31:47.877923 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1fcd3518-b095-49fe-b72d-08d1ded6e098 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:47.926874 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-1c015963-03ef-41ba-af5e-514ddc092577 None None] Allocated IP 2001:db8::f816:3eff:fe23:3c90 (5aa1232d-f31a-4cc6-ac6d-901779fb1e90/79c7b6ce-4c68-4f72-add3-35ec03b2be83/78e14681-b73e-4eb8-94ca-8b3e3fe1bcf3) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:31:47.956120 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-31bd4495-58c8-4ab9-afe7-dd64ea8babd5 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:48.081952 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9a9c7121-bf23-44fd-9aeb-8f4171f40cf2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:48.094914 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55700) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:48.099142 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [None req-31bd4495-58c8-4ab9-afe7-dd64ea8babd5 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] device_id is not set on port 2cbb91af-c589-4b0a-8eb5-e860509da6d6 yet. {{(pid=102162) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:31:48.134399 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1c015963-03ef-41ba-af5e-514ddc092577 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:48.143563 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-ca530d92-95f8-4dda-bf37-0eef5d058123 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Deleting port 4a69f229-858a-4210-ad1e-16328d055046 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:31:48.143563 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ca530d92-95f8-4dda-bf37-0eef5d058123 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:48.179183 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-65246812-6408-4417-838d-733ac2c81444 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=cf43ca7e091f42ca80c78a3f7dbeba63&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0831301 Nov 09 04:31:48.182175 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55702) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:48.196224 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1c015963-03ef-41ba-af5e-514ddc092577 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:48.243761 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1c015963-03ef-41ba-af5e-514ddc092577 None None] Network 5aa1232d-f31a-4cc6-ac6d-901779fb1e90 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:31:48.250083 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-1c015963-03ef-41ba-af5e-514ddc092577 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:48.252065 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c015963-03ef-41ba-af5e-514ddc092577 None None] Pushing event updated for resources: {'Port': ['ID=78e14681-b73e-4eb8-94ca-8b3e3fe1bcf3,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:48.259497 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1c015963-03ef-41ba-af5e-514ddc092577 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:31:48.270313 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9a9c7121-bf23-44fd-9aeb-8f4171f40cf2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:48.302221 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ca530d92-95f8-4dda-bf37-0eef5d058123 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:48.311356 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-409faef5-af16-447d-8c34-e23ab05383bd admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:48.315580 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-1c015963-03ef-41ba-af5e-514ddc092577 None None] Attempting to bind port 78e14681-b73e-4eb8-94ca-8b3e3fe1bcf3 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:31:48.315953 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-1c015963-03ef-41ba-af5e-514ddc092577 None None] Attempting to bind port 78e14681-b73e-4eb8-94ca-8b3e3fe1bcf3 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '209765d0-635f-487d-8781-d5ae386b3e9c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 327, 'network_id': '5aa1232d-f31a-4cc6-ac6d-901779fb1e90'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:31:48.316318 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c015963-03ef-41ba-af5e-514ddc092577 None None] Attempting to bind port 78e14681-b73e-4eb8-94ca-8b3e3fe1bcf3 on network 5aa1232d-f31a-4cc6-ac6d-901779fb1e90 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:31:48.321513 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c015963-03ef-41ba-af5e-514ddc092577 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 31, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:31:48.321888 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c015963-03ef-41ba-af5e-514ddc092577 None None] Checking segment: {'id': '209765d0-635f-487d-8781-d5ae386b3e9c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 327, 'network_id': '5aa1232d-f31a-4cc6-ac6d-901779fb1e90'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:31:48.322288 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1c015963-03ef-41ba-af5e-514ddc092577 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:48.322724 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c015963-03ef-41ba-af5e-514ddc092577 None None] Bound using segment: {'id': '209765d0-635f-487d-8781-d5ae386b3e9c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 327, 'network_id': '5aa1232d-f31a-4cc6-ac6d-901779fb1e90'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:31:48.323428 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-1c015963-03ef-41ba-af5e-514ddc092577 None None] Bound port: 78e14681-b73e-4eb8-94ca-8b3e3fe1bcf3, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '209765d0-635f-487d-8781-d5ae386b3e9c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 327, 'network_id': '5aa1232d-f31a-4cc6-ac6d-901779fb1e90'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:31:48.323576 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1c015963-03ef-41ba-af5e-514ddc092577 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:48.325204 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-ca530d92-95f8-4dda-bf37-0eef5d058123 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Calling delete_port for 4a69f229-858a-4210-ad1e-16328d055046 owned by network:router_interface {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:31:48.330668 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1fcd3518-b095-49fe-b72d-08d1ded6e098 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:48.336805 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9a9c7121-bf23-44fd-9aeb-8f4171f40cf2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:31:48.348711 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-9a9c7121-bf23-44fd-9aeb-8f4171f40cf2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:48.351577 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9a9c7121-bf23-44fd-9aeb-8f4171f40cf2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:31:48.358229 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9a9c7121-bf23-44fd-9aeb-8f4171f40cf2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:48.358989 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9a9c7121-bf23-44fd-9aeb-8f4171f40cf2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:48.385204 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fcd3518-b095-49fe-b72d-08d1ded6e098 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Pushing event deleted for resources: {'Subnet': ['ID=79c7b6ce-4c68-4f72-add3-35ec03b2be83,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:48.390055 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-409faef5-af16-447d-8c34-e23ab05383bd admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:48.399316 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a9c7121-bf23-44fd-9aeb-8f4171f40cf2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Port': ['ID=bee544d4-6429-4229-89e5-f084b5b13d62,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:48.402385 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-49475489-f8d3-4ee9-8d35-14cd15644bde tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:48.405959 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-1c015963-03ef-41ba-af5e-514ddc092577 None None] For port 78e14681-b73e-4eb8-94ca-8b3e3fe1bcf3, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:31:48.409457 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-1c015963-03ef-41ba-af5e-514ddc092577 None None] For port 78e14681-b73e-4eb8-94ca-8b3e3fe1bcf3, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=78e14681-b73e-4eb8-94ca-8b3e3fe1bcf3,segment=NetworkSegment(209765d0-635f-487d-8781-d5ae386b3e9c),segment_id=209765d0-635f-487d-8781-d5ae386b3e9c)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:31:48.459208 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-9a9c7121-bf23-44fd-9aeb-8f4171f40cf2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 947 time: 2.5347371 Nov 09 04:31:48.460815 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55704) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:48.465848 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1c015963-03ef-41ba-af5e-514ddc092577 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:48.512962 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-31bd4495-58c8-4ab9-afe7-dd64ea8babd5 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:48.515419 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-49475489-f8d3-4ee9-8d35-14cd15644bde tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Checking segment: {'id': '667f2f48-63ef-4391-830e-9180dff2b93f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 314, 'network_id': 'f8dfd1cc-6ee7-4112-9ceb-eb2ba064609b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:31:48.515845 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-49475489-f8d3-4ee9-8d35-14cd15644bde tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Network hostable DHCP agents. Network: f8dfd1cc-6ee7-4112-9ceb-eb2ba064609b, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:31:48.560666 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49475489-f8d3-4ee9-8d35-14cd15644bde tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event updated for resources: {'Subnet': ['ID=41cf4118-3cde-44c5-8308-f2610de95450,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:48.564156 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1fcd3518-b095-49fe-b72d-08d1ded6e098 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:48.599447 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c015963-03ef-41ba-af5e-514ddc092577 None None] Pushing event updated for resources: {'Port': ['ID=78e14681-b73e-4eb8-94ca-8b3e3fe1bcf3,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:48.618704 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-49475489-f8d3-4ee9-8d35-14cd15644bde tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Network f8dfd1cc-6ee7-4112-9ceb-eb2ba064609b is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:31:48.631626 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5e455c72-282b-4961-82a7-9b41f60acbcc None None] Network 5aa1232d-f31a-4cc6-ac6d-901779fb1e90 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:48.641676 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-31bd4495-58c8-4ab9-afe7-dd64ea8babd5 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:48.643485 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3ac5900c-5b7e-4563-b23e-ebc966a6e763 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:48.652363 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3ac5900c-5b7e-4563-b23e-ebc966a6e763 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:48.652363 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-3ac5900c-5b7e-4563-b23e-ebc966a6e763 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1684 time: 0.1803758 Nov 09 04:31:48.653931 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-1fcd3518-b095-49fe-b72d-08d1ded6e098 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5aa1232d-f31a-4cc6-ac6d-901779fb1e90']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:48.662255 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55706) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:48.686112 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-1fcd3518-b095-49fe-b72d-08d1ded6e098 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '209765d0-635f-487d-8781-d5ae386b3e9c') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:48.686486 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-1fcd3518-b095-49fe-b72d-08d1ded6e098 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '209765d0-635f-487d-8781-d5ae386b3e9c') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:48.708290 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-49475489-f8d3-4ee9-8d35-14cd15644bde tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, f8dfd1cc-6ee7-4112-9ceb-eb2ba064609b) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:48.716913 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-49475489-f8d3-4ee9-8d35-14cd15644bde tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:48.717993 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-49475489-f8d3-4ee9-8d35-14cd15644bde tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:48.730260 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0f0608fd-ef51-4af3-be62-e352904a0e22 None None] Network f8dfd1cc-6ee7-4112-9ceb-eb2ba064609b requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:48.733367 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1fcd3518-b095-49fe-b72d-08d1ded6e098 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:48.747948 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31bd4495-58c8-4ab9-afe7-dd64ea8babd5 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event updated for resources: {'Port': ['ID=b7759ec5-6631-48fb-aabd-d9ec8a957fff,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:48.752569 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-31bd4495-58c8-4ab9-afe7-dd64ea8babd5 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Network 002d27a0-2fb8-4426-9550-42c444556a8e is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:31:48.757599 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-31bd4495-58c8-4ab9-afe7-dd64ea8babd5 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:48.760289 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-31bd4495-58c8-4ab9-afe7-dd64ea8babd5 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:31:48.761328 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-31bd4495-58c8-4ab9-afe7-dd64ea8babd5 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:48.804997 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1fcd3518-b095-49fe-b72d-08d1ded6e098 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:48.808215 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-409faef5-af16-447d-8c34-e23ab05383bd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:48.811899 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-409faef5-af16-447d-8c34-e23ab05383bd admin admin] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:48.814451 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-49475489-f8d3-4ee9-8d35-14cd15644bde tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.4805911 Nov 09 04:31:48.818688 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-409faef5-af16-447d-8c34-e23ab05383bd admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/a6e228fc-6893-40b8-ade5-54bd7135830b HTTP/1.1" status: 204 len: 168 time: 0.6356695 Nov 09 04:31:48.819682 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55708) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:48.828465 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-68367756-373f-4e5c-b815-6b8000114150 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Request body: {'port': {'network_id': 'f8dfd1cc-6ee7-4112-9ceb-eb2ba064609b', 'name': 'tempest-PortsTestJSON-47883331', 'fixed_ips': [{'subnet_id': '41cf4118-3cde-44c5-8308-f2610de95450', 'ip_address': '172.20.0.10'}]}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:48.836840 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1fcd3518-b095-49fe-b72d-08d1ded6e098 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Releasing vlan 327 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:31:48.837522 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1fcd3518-b095-49fe-b72d-08d1ded6e098 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:48.841762 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:31:48.841762 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:31:48.841762 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:31:48.841762 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:31:48.841762 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:31:48.841762 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:31:48.841762 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:31:48.841762 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:31:48.841762 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:31:48.841762 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:31:48.841762 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:31:48.841762 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:31:48.841762 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:31:48.841762 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:31:48.841762 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:31:48.841762 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:31:48.841762 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:31:48.841762 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:31:48.841762 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:31:48.841762 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:31:48.841762 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:31:48.841762 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:31:48.841762 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:31:48.841762 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:31:48.841762 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:31:48.841762 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:31:48.841762 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:31:48.841762 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:31:48.841762 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:31:48.841762 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:31:48.841762 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:31:48.841762 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:31:48.867718 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31bd4495-58c8-4ab9-afe7-dd64ea8babd5 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event updated for resources: {'Port': ['ID=2cbb91af-c589-4b0a-8eb5-e860509da6d6,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:48.875573 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-409faef5-af16-447d-8c34-e23ab05383bd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a6e228fc-6893-40b8-ade5-54bd7135830b,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:48.914638 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-31bd4495-58c8-4ab9-afe7-dd64ea8babd5 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Checking segment: {'id': '4f24ec86-e856-4521-94e9-d073a256b635', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 341, 'network_id': 'aae922f8-feeb-4960-8f09-cf16836975ff'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:31:48.915006 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-31bd4495-58c8-4ab9-afe7-dd64ea8babd5 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Network hostable DHCP agents. Network: aae922f8-feeb-4960-8f09-cf16836975ff, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:31:48.949341 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-bc68ce30-f00e-4141-9b6e-6c3d929b586b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Deleting port bee544d4-6429-4229-89e5-f084b5b13d62 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:31:48.949812 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bc68ce30-f00e-4141-9b6e-6c3d929b586b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:49.003717 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.db.api [None req-1fcd3518-b095-49fe-b72d-08d1ded6e098 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Nov 09 04:31:49.003717 dv-neutron-816802-2-hyperv neutron-server[102161]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Nov 09 04:31:49.003717 dv-neutron-816802-2-hyperv neutron-server[102161]: [parameters: {'id': '5aa1232d-f31a-4cc6-ac6d-901779fb1e90'}] Nov 09 04:31:49.003717 dv-neutron-816802-2-hyperv neutron-server[102161]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=102161) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:31:49.004693 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG oslo_db.api [None req-1fcd3518-b095-49fe-b72d-08d1ded6e098 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:31:49.007948 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ca530d92-95f8-4dda-bf37-0eef5d058123 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:49.013734 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-c866da24-0136-46e5-bc6b-228b2db486b6 None None] Provisioning complete for port 98e8f3dd-7b0f-4505-a30f-352681a1b560 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:49.014139 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c866da24-0136-46e5-bc6b-228b2db486b6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:49.032745 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-31bd4495-58c8-4ab9-afe7-dd64ea8babd5 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Network aae922f8-feeb-4960-8f09-cf16836975ff is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:31:49.057484 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca530d92-95f8-4dda-bf37-0eef5d058123 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event deleted for resources: {'Port': ['ID=4a69f229-858a-4210-ad1e-16328d055046,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:49.104053 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a3617222-982e-4deb-9a77-cd0b1ae1cd05 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-f8dfd1cc-6ee7-4112-9ceb-eb2ba064609b', 'network_id': 'f8dfd1cc-6ee7-4112-9ceb-eb2ba064609b', 'tenant_id': '88f9f8da29bf4a8793b45130d483a6e6', 'fixed_ips': [{'subnet_id': '41cf4118-3cde-44c5-8308-f2610de95450'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:31:49.104946 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a3617222-982e-4deb-9a77-cd0b1ae1cd05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:49.122554 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-31bd4495-58c8-4ab9-afe7-dd64ea8babd5 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, aae922f8-feeb-4960-8f09-cf16836975ff) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:49.126329 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-31bd4495-58c8-4ab9-afe7-dd64ea8babd5 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:31:49.132249 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-31bd4495-58c8-4ab9-afe7-dd64ea8babd5 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:49.143467 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-32e839d1-0572-4f8f-8c82-af79cd7ddbdf None None] Network aae922f8-feeb-4960-8f09-cf16836975ff requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:49.146257 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-31bd4495-58c8-4ab9-afe7-dd64ea8babd5 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:49.148676 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-31bd4495-58c8-4ab9-afe7-dd64ea8babd5 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:49.196815 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-68367756-373f-4e5c-b815-6b8000114150 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Made reservation on behalf of 88f9f8da29bf4a8793b45130d483a6e6 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:49.200675 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bc68ce30-f00e-4141-9b6e-6c3d929b586b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:49.220910 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-bc68ce30-f00e-4141-9b6e-6c3d929b586b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Calling delete_port for bee544d4-6429-4229-89e5-f084b5b13d62 owned by {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:31:49.239998 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-31bd4495-58c8-4ab9-afe7-dd64ea8babd5 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1425 time: 2.7487364 Nov 09 04:31:49.243356 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55714) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:49.386139 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ca530d92-95f8-4dda-bf37-0eef5d058123 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:49.420107 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-68367756-373f-4e5c-b815-6b8000114150 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:49.453691 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [None req-68367756-373f-4e5c-b815-6b8000114150 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] device_id is not set on port c6b9cb9d-f1ff-41ab-8c15-689fc5f79093 yet. {{(pid=102162) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:31:49.518156 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1fcd3518-b095-49fe-b72d-08d1ded6e098 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:49.520562 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-9a2c690a-71f6-471d-ba4f-0502a5a59b90 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Deleting port 2cbb91af-c589-4b0a-8eb5-e860509da6d6 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:31:49.521057 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c866da24-0136-46e5-bc6b-228b2db486b6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:49.521358 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9a2c690a-71f6-471d-ba4f-0502a5a59b90 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:49.571440 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-a3617222-982e-4deb-9a77-cd0b1ae1cd05 None None] Allocated IP 172.20.0.2 (f8dfd1cc-6ee7-4112-9ceb-eb2ba064609b/41cf4118-3cde-44c5-8308-f2610de95450/f99ae9c3-073d-4901-bb48-618d8ce40895) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:31:49.587520 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-c866da24-0136-46e5-bc6b-228b2db486b6 None None] For port 98e8f3dd-7b0f-4505-a30f-352681a1b560, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=98e8f3dd-7b0f-4505-a30f-352681a1b560,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:31:49.648463 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9a2c690a-71f6-471d-ba4f-0502a5a59b90 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:49.663893 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c866da24-0136-46e5-bc6b-228b2db486b6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:49.671371 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-9a2c690a-71f6-471d-ba4f-0502a5a59b90 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Calling delete_port for 2cbb91af-c589-4b0a-8eb5-e860509da6d6 owned by {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:31:49.749981 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ca530d92-95f8-4dda-bf37-0eef5d058123 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Router cdc40031-5d8e-4301-8c14-526915537ddc has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:31:49.754786 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c866da24-0136-46e5-bc6b-228b2db486b6 None None] Pushing event updated for resources: {'Port': ['ID=98e8f3dd-7b0f-4505-a30f-352681a1b560,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:49.760659 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bc68ce30-f00e-4141-9b6e-6c3d929b586b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:49.779700 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a3617222-982e-4deb-9a77-cd0b1ae1cd05 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:49.783895 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-74479a6c-c145-4928-a02d-80260fb2a5b4 None None] Could not find standard attr ID for object bee544d4-6429-4229-89e5-f084b5b13d62. {{(pid=102163) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 09 04:31:49.854418 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc68ce30-f00e-4141-9b6e-6c3d929b586b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event deleted for resources: {'Port': ['ID=bee544d4-6429-4229-89e5-f084b5b13d62,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:49.863418 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a3617222-982e-4deb-9a77-cd0b1ae1cd05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:49.883784 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-1fcd3518-b095-49fe-b72d-08d1ded6e098 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Deleting port 78e14681-b73e-4eb8-94ca-8b3e3fe1bcf3 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:31:49.891529 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1fcd3518-b095-49fe-b72d-08d1ded6e098 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:49.907358 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 98e8f3dd-7b0f-4505-a30f-352681a1b560 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:31:49.919183 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9a2c690a-71f6-471d-ba4f-0502a5a59b90 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:49.963555 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-1fcd3518-b095-49fe-b72d-08d1ded6e098 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] For port 78e14681-b73e-4eb8-94ca-8b3e3fe1bcf3, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=78e14681-b73e-4eb8-94ca-8b3e3fe1bcf3,segment=NetworkSegment(209765d0-635f-487d-8781-d5ae386b3e9c),segment_id=209765d0-635f-487d-8781-d5ae386b3e9c)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:31:49.963555 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1fcd3518-b095-49fe-b72d-08d1ded6e098 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:49.973545 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-1fcd3518-b095-49fe-b72d-08d1ded6e098 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Calling delete_port for 78e14681-b73e-4eb8-94ca-8b3e3fe1bcf3 owned by network:dhcp {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:31:49.980049 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a3617222-982e-4deb-9a77-cd0b1ae1cd05 None None] Network f8dfd1cc-6ee7-4112-9ceb-eb2ba064609b is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:31:49.980265 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9a2c690a-71f6-471d-ba4f-0502a5a59b90 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:49.984675 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-9a2c690a-71f6-471d-ba4f-0502a5a59b90 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "DELETE /v2.0/ports/2cbb91af-c589-4b0a-8eb5-e860509da6d6 HTTP/1.1" status: 204 len: 168 time: 0.7157054 Nov 09 04:31:49.985924 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a2c690a-71f6-471d-ba4f-0502a5a59b90 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event deleted for resources: {'Port': ['ID=2cbb91af-c589-4b0a-8eb5-e860509da6d6,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:49.987802 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55728) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:49.988274 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-a3617222-982e-4deb-9a77-cd0b1ae1cd05 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:49.992482 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3617222-982e-4deb-9a77-cd0b1ae1cd05 None None] Pushing event updated for resources: {'Port': ['ID=f99ae9c3-073d-4901-bb48-618d8ce40895,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:49.997945 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a3617222-982e-4deb-9a77-cd0b1ae1cd05 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:31:50.007580 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-68367756-373f-4e5c-b815-6b8000114150 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Allocated IP 172.20.0.10 (f8dfd1cc-6ee7-4112-9ceb-eb2ba064609b/41cf4118-3cde-44c5-8308-f2610de95450/c6b9cb9d-f1ff-41ab-8c15-689fc5f79093) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:31:50.108855 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8e3f8819-3435-44c2-b5d3-701ba757deb9 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:50.115224 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bc68ce30-f00e-4141-9b6e-6c3d929b586b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:50.116906 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8e3f8819-3435-44c2-b5d3-701ba757deb9 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:50.118978 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-8e3f8819-3435-44c2-b5d3-701ba757deb9 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1456 time: 0.1077540 Nov 09 04:31:50.121813 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-bc68ce30-f00e-4141-9b6e-6c3d929b586b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/ports/bee544d4-6429-4229-89e5-f084b5b13d62 HTTP/1.1" status: 204 len: 168 time: 1.4474983 Nov 09 04:31:50.122591 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55734) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:50.124078 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55736) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:50.136681 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-a3617222-982e-4deb-9a77-cd0b1ae1cd05 None None] Attempting to bind port f99ae9c3-073d-4901-bb48-618d8ce40895 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:31:50.138176 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-a3617222-982e-4deb-9a77-cd0b1ae1cd05 None None] Attempting to bind port f99ae9c3-073d-4901-bb48-618d8ce40895 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '667f2f48-63ef-4391-830e-9180dff2b93f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 314, 'network_id': 'f8dfd1cc-6ee7-4112-9ceb-eb2ba064609b'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:31:50.138566 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a3617222-982e-4deb-9a77-cd0b1ae1cd05 None None] Attempting to bind port f99ae9c3-073d-4901-bb48-618d8ce40895 on network f8dfd1cc-6ee7-4112-9ceb-eb2ba064609b {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:31:50.143781 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 98e8f3dd-7b0f-4505-a30f-352681a1b560 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:50.144150 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:50.212864 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a3617222-982e-4deb-9a77-cd0b1ae1cd05 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 31, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:31:50.213108 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1fcd3518-b095-49fe-b72d-08d1ded6e098 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:50.213311 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a3617222-982e-4deb-9a77-cd0b1ae1cd05 None None] Checking segment: {'id': '667f2f48-63ef-4391-830e-9180dff2b93f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 314, 'network_id': 'f8dfd1cc-6ee7-4112-9ceb-eb2ba064609b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:31:50.213688 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a3617222-982e-4deb-9a77-cd0b1ae1cd05 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:50.214022 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a3617222-982e-4deb-9a77-cd0b1ae1cd05 None None] Bound using segment: {'id': '667f2f48-63ef-4391-830e-9180dff2b93f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 314, 'network_id': 'f8dfd1cc-6ee7-4112-9ceb-eb2ba064609b'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:31:50.214529 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-a3617222-982e-4deb-9a77-cd0b1ae1cd05 None None] Bound port: f99ae9c3-073d-4901-bb48-618d8ce40895, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '667f2f48-63ef-4391-830e-9180dff2b93f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 314, 'network_id': 'f8dfd1cc-6ee7-4112-9ceb-eb2ba064609b'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:31:50.214906 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a3617222-982e-4deb-9a77-cd0b1ae1cd05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:50.215647 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ca530d92-95f8-4dda-bf37-0eef5d058123 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:31:50.226959 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cd871b94-d350-4263-ab9e-48afa07185da None None] Sync routers for ids ['cdc40031-5d8e-4301-8c14-526915537ddc'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:31:50.243754 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cd871b94-d350-4263-ab9e-48afa07185da None None] Routers {'cdc40031-5d8e-4301-8c14-526915537ddc'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:31:50.244208 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-ca530d92-95f8-4dda-bf37-0eef5d058123 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "PUT /v2.0/routers/cdc40031-5d8e-4301-8c14-526915537ddc/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.5688505 Nov 09 04:31:50.245011 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-cd871b94-d350-4263-ab9e-48afa07185da None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:31:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['cdc40031-5d8e-4301-8c14-526915537ddc'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:50.250726 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55740) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:50.297821 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fcd3518-b095-49fe-b72d-08d1ded6e098 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Pushing event deleted for resources: {'Port': ['ID=78e14681-b73e-4eb8-94ca-8b3e3fe1bcf3,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:50.299959 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1fcd3518-b095-49fe-b72d-08d1ded6e098 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] No DVR routers for this DVR port 78e14681-b73e-4eb8-94ca-8b3e3fe1bcf3 on host dv-neutron-816802-2-hyperv {{(pid=102161) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:31:50.319988 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-cd871b94-d350-4263-ab9e-48afa07185da None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:50.325533 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-cd629e2d-ab4d-4468-bf33-6622d1629b43 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "GET /v2.0/ports?device_id=cdc40031-5d8e-4301-8c14-526915537ddc HTTP/1.1" status: 200 len: 205 time: 0.0708156 Nov 09 04:31:50.336018 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55744) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:50.340868 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cf021f30-d235-4f6b-99f9-ddbdc0773b51 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:50.342575 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cf021f30-d235-4f6b-99f9-ddbdc0773b51 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:50.350269 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-cf021f30-d235-4f6b-99f9-ddbdc0773b51 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1464 time: 0.2209506 Nov 09 04:31:50.350576 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cd871b94-d350-4263-ab9e-48afa07185da None None] Routers {'cdc40031-5d8e-4301-8c14-526915537ddc'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:31:50.351388 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-cd871b94-d350-4263-ab9e-48afa07185da None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:31:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['cdc40031-5d8e-4301-8c14-526915537ddc'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:50.356417 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55746) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:50.379817 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-a3617222-982e-4deb-9a77-cd0b1ae1cd05 None None] For port f99ae9c3-073d-4901-bb48-618d8ce40895, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:31:50.384920 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-a3617222-982e-4deb-9a77-cd0b1ae1cd05 None None] For port f99ae9c3-073d-4901-bb48-618d8ce40895, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=f99ae9c3-073d-4901-bb48-618d8ce40895,segment=NetworkSegment(667f2f48-63ef-4391-830e-9180dff2b93f),segment_id=667f2f48-63ef-4391-830e-9180dff2b93f)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:31:50.421563 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-68367756-373f-4e5c-b815-6b8000114150 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:50.423682 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-cd871b94-d350-4263-ab9e-48afa07185da None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:50.424419 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cd871b94-d350-4263-ab9e-48afa07185da None None] The sync data for ids ['cdc40031-5d8e-4301-8c14-526915537ddc'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:31:50.485549 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a3617222-982e-4deb-9a77-cd0b1ae1cd05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:50.527192 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-68367756-373f-4e5c-b815-6b8000114150 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:50.551213 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3617222-982e-4deb-9a77-cd0b1ae1cd05 None None] Pushing event updated for resources: {'Port': ['ID=f99ae9c3-073d-4901-bb48-618d8ce40895,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:50.573207 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-45f9e407-ac88-4eda-b59f-f3591b46f9c4 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for router, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:50.616672 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-68367756-373f-4e5c-b815-6b8000114150 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Network f8dfd1cc-6ee7-4112-9ceb-eb2ba064609b is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:31:50.620672 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1fcd3518-b095-49fe-b72d-08d1ded6e098 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:50.621139 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-68367756-373f-4e5c-b815-6b8000114150 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:50.623583 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68367756-373f-4e5c-b815-6b8000114150 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event updated for resources: {'Port': ['ID=c6b9cb9d-f1ff-41ab-8c15-689fc5f79093,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:50.625771 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-68367756-373f-4e5c-b815-6b8000114150 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:31:50.627481 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-8f15591f-5dd9-4ffb-b9c5-77703730a180 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Deleting subnet c0f38e80-422e-45b9-9f12-68df700bab47 {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:31:50.666395 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8f15591f-5dd9-4ffb-b9c5-77703730a180 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:50.680426 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-68367756-373f-4e5c-b815-6b8000114150 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:50.681214 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-68367756-373f-4e5c-b815-6b8000114150 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:50.721745 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-1fcd3518-b095-49fe-b72d-08d1ded6e098 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5aa1232d-f31a-4cc6-ac6d-901779fb1e90']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:50.730028 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-ad8f7ea9-4ac7-474d-ade6-0b93005b8abc tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Deleting port b7759ec5-6631-48fb-aabd-d9ec8a957fff {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:31:50.730028 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ad8f7ea9-4ac7-474d-ade6-0b93005b8abc tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:50.764204 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-68367756-373f-4e5c-b815-6b8000114150 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 923 time: 1.9412813 Nov 09 04:31:50.767312 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55752) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:50.772578 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-ed32cff2-4de0-4162-aa14-08f64ec7917c tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Request body: {'port': {'network_id': 'f8dfd1cc-6ee7-4112-9ceb-eb2ba064609b', 'name': 'tempest-PortsTestJSON-1064837667', 'fixed_ips': [{'subnet_id': '41cf4118-3cde-44c5-8308-f2610de95450', 'ip_address': '172.20.0.9'}]}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:51.007167 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ed32cff2-4de0-4162-aa14-08f64ec7917c tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Made reservation on behalf of 88f9f8da29bf4a8793b45130d483a6e6 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:51.013481 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ed32cff2-4de0-4162-aa14-08f64ec7917c tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:51.039345 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [None req-ed32cff2-4de0-4162-aa14-08f64ec7917c tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] device_id is not set on port 792ca1a1-5d94-4a2b-806d-206d5b7fac73 yet. {{(pid=102162) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:31:51.104841 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-1fcd3518-b095-49fe-b72d-08d1ded6e098 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '209765d0-635f-487d-8781-d5ae386b3e9c') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:51.105136 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-1fcd3518-b095-49fe-b72d-08d1ded6e098 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '209765d0-635f-487d-8781-d5ae386b3e9c') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:51.150221 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8f15591f-5dd9-4ffb-b9c5-77703730a180 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:51.200752 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-ed32cff2-4de0-4162-aa14-08f64ec7917c tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Allocated IP 172.20.0.9 (f8dfd1cc-6ee7-4112-9ceb-eb2ba064609b/41cf4118-3cde-44c5-8308-f2610de95450/792ca1a1-5d94-4a2b-806d-206d5b7fac73) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:31:51.205899 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1fcd3518-b095-49fe-b72d-08d1ded6e098 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:51.251905 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-45f9e407-ac88-4eda-b59f-f3591b46f9c4 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:51.257656 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-45f9e407-ac88-4eda-b59f-f3591b46f9c4 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:51.261448 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1fcd3518-b095-49fe-b72d-08d1ded6e098 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:51.282669 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ad8f7ea9-4ac7-474d-ade6-0b93005b8abc tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:51.300478 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1fcd3518-b095-49fe-b72d-08d1ded6e098 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Releasing vlan 327 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:31:51.300478 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1fcd3518-b095-49fe-b72d-08d1ded6e098 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:51.329951 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:31:51.329951 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:31:51.329951 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:31:51.329951 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:31:51.329951 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:31:51.329951 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:31:51.329951 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:31:51.329951 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:31:51.329951 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:31:51.329951 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:31:51.329951 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:31:51.329951 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:31:51.329951 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:31:51.329951 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:31:51.329951 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:31:51.329951 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:31:51.329951 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:31:51.329951 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:31:51.329951 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:31:51.329951 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:31:51.329951 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:31:51.329951 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:31:51.329951 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:31:51.329951 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:31:51.329951 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:31:51.329951 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:31:51.329951 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:31:51.329951 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:31:51.329951 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:31:51.329951 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:31:51.329951 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:31:51.329951 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:31:51.350836 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-ad8f7ea9-4ac7-474d-ade6-0b93005b8abc tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Calling delete_port for b7759ec5-6631-48fb-aabd-d9ec8a957fff owned by {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:31:51.447011 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ed32cff2-4de0-4162-aa14-08f64ec7917c tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:51.471868 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-45f9e407-ac88-4eda-b59f-f3591b46f9c4 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:51.472498 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-45f9e407-ac88-4eda-b59f-f3591b46f9c4 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Fanout notify agent at l3_agent the message router_deleted on router cdc40031-5d8e-4301-8c14-526915537ddc {{(pid=102161) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:31:51.484535 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-45f9e407-ac88-4eda-b59f-f3591b46f9c4 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:51.485654 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-45f9e407-ac88-4eda-b59f-f3591b46f9c4 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "DELETE /v2.0/routers/cdc40031-5d8e-4301-8c14-526915537ddc HTTP/1.1" status: 204 len: 168 time: 1.1342406 Nov 09 04:31:51.488544 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55766) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:51.506849 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8f15591f-5dd9-4ffb-b9c5-77703730a180 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:51.544935 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55768) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:51.559566 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-c140f82f-e97c-4861-8a36-817a541c0054 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Deleting subnet 10a26071-6216-4b65-b6b6-f23700b8dbf0 {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:31:51.567091 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c140f82f-e97c-4861-8a36-817a541c0054 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:51.567323 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1fcd3518-b095-49fe-b72d-08d1ded6e098 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:51.582657 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1fcd3518-b095-49fe-b72d-08d1ded6e098 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:51.589649 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1fcd3518-b095-49fe-b72d-08d1ded6e098 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] 10.222.0.24 "DELETE /v2.0/networks/5aa1232d-f31a-4cc6-ac6d-901779fb1e90 HTTP/1.1" status: 204 len: 168 time: 3.9385071 Nov 09 04:31:51.589834 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55772) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:51.596692 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ed32cff2-4de0-4162-aa14-08f64ec7917c tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:51.605313 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fcd3518-b095-49fe-b72d-08d1ded6e098 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Pushing event deleted for resources: {'Network': ['ID=5aa1232d-f31a-4cc6-ac6d-901779fb1e90,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:51.667822 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-1c1a6d59-7f64-4c26-9d12-8781a0ea8ce8 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] DELETE failed (client error): The resource could not be found. Nov 09 04:31:51.668850 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-1c1a6d59-7f64-4c26-9d12-8781a0ea8ce8 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:31:51.671989 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-1c1a6d59-7f64-4c26-9d12-8781a0ea8ce8 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] 10.222.0.24 "DELETE /v2.0/subnets/79c7b6ce-4c68-4f72-add3-35ec03b2be83 HTTP/1.1" status: 404 len: 337 time: 0.0810013 Nov 09 04:31:51.674279 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c140f82f-e97c-4861-8a36-817a541c0054 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:51.674895 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55774) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:51.687700 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-23ec2d91-fe3b-4b83-954c-a4610cb027df tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Request body: {'router': {'name': 'tempest-pretest-check-2068428854'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:51.707489 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8f15591f-5dd9-4ffb-b9c5-77703730a180 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:51.713078 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ed32cff2-4de0-4162-aa14-08f64ec7917c tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Network f8dfd1cc-6ee7-4112-9ceb-eb2ba064609b is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:31:51.716282 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ad8f7ea9-4ac7-474d-ade6-0b93005b8abc tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:51.733252 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-eda84754-d52e-4c4b-9524-5b292055b817 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] DELETE failed (client error): The resource could not be found. Nov 09 04:31:51.734096 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-eda84754-d52e-4c4b-9524-5b292055b817 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:31:51.737388 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-eda84754-d52e-4c4b-9524-5b292055b817 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] 10.222.0.24 "DELETE /v2.0/networks/5aa1232d-f31a-4cc6-ac6d-901779fb1e90 HTTP/1.1" status: 404 len: 339 time: 0.0614626 Nov 09 04:31:51.747080 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-ed32cff2-4de0-4162-aa14-08f64ec7917c tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:51.749045 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55776) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:51.756022 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ed32cff2-4de0-4162-aa14-08f64ec7917c tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:31:51.766861 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f15591f-5dd9-4ffb-b9c5-77703730a180 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event deleted for resources: {'Subnet': ['ID=c0f38e80-422e-45b9-9f12-68df700bab47,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:51.785735 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-25d6c984-b39d-4fa3-948c-be991df787d6 None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:51.791580 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-0136cff0-6e24-43e3-9df7-46813fa2bc9e tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] DELETE failed (client error): The resource could not be found. Nov 09 04:31:51.792070 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-0136cff0-6e24-43e3-9df7-46813fa2bc9e tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:31:51.798649 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-0136cff0-6e24-43e3-9df7-46813fa2bc9e tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] 10.222.0.24 "DELETE /v2.0/subnets/4ac558bd-1cff-41b6-ad18-f310e319efa7 HTTP/1.1" status: 404 len: 337 time: 0.0423579 Nov 09 04:31:51.798649 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed32cff2-4de0-4162-aa14-08f64ec7917c tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event updated for resources: {'Port': ['ID=792ca1a1-5d94-4a2b-806d-206d5b7fac73,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:51.799364 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8f15591f-5dd9-4ffb-b9c5-77703730a180 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:51.801602 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55778) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:51.805248 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-8f15591f-5dd9-4ffb-b9c5-77703730a180 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/c0f38e80-422e-45b9-9f12-68df700bab47 HTTP/1.1" status: 204 len: 168 time: 1.4201603 Nov 09 04:31:51.806082 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55780) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:51.813347 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad8f7ea9-4ac7-474d-ade6-0b93005b8abc tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event deleted for resources: {'Port': ['ID=b7759ec5-6631-48fb-aabd-d9ec8a957fff,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:51.844371 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8a773998-2d95-42d6-99a5-725640171736 None None] Network f8dfd1cc-6ee7-4112-9ceb-eb2ba064609b requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:51.854979 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ad8f7ea9-4ac7-474d-ade6-0b93005b8abc tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:51.858950 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-479552db-e7cf-44f3-bd34-27471fd9233c tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] DELETE failed (client error): The resource could not be found. Nov 09 04:31:51.859096 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-ad8f7ea9-4ac7-474d-ade6-0b93005b8abc tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "DELETE /v2.0/ports/b7759ec5-6631-48fb-aabd-d9ec8a957fff HTTP/1.1" status: 204 len: 168 time: 1.7261670 Nov 09 04:31:51.859582 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-479552db-e7cf-44f3-bd34-27471fd9233c tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:31:51.862886 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-479552db-e7cf-44f3-bd34-27471fd9233c tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] 10.222.0.24 "DELETE /v2.0/networks/eee30c13-c6dc-4255-8ec9-5487496489dd HTTP/1.1" status: 404 len: 339 time: 0.0565889 Nov 09 04:31:51.867277 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55782) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:51.867605 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55784) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:51.867915 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55786) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:51.868057 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-4b195cea-90b0-43fe-ae71-96fa912d5a22 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0548382 Nov 09 04:31:51.875132 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-72dec9b6-29c4-4da2-ab04-8029229a4944 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'subnet': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:51.910348 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-23ec2d91-fe3b-4b83-954c-a4610cb027df tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:51.914068 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-23ec2d91-fe3b-4b83-954c-a4610cb027df tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:51.953384 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ed32cff2-4de0-4162-aa14-08f64ec7917c tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:51.954188 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ed32cff2-4de0-4162-aa14-08f64ec7917c tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:51.968421 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-23ec2d91-fe3b-4b83-954c-a4610cb027df tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:52.006305 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-3366e917-30c5-42e8-8513-f8e2c5bf3fd0 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] DELETE failed (client error): The resource could not be found. Nov 09 04:31:52.006783 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-3366e917-30c5-42e8-8513-f8e2c5bf3fd0 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:31:52.010016 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-3366e917-30c5-42e8-8513-f8e2c5bf3fd0 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] 10.222.0.24 "DELETE /v2.0/subnets/ebbe76a5-ebde-4216-9171-17985f4f0995 HTTP/1.1" status: 404 len: 337 time: 0.1389470 Nov 09 04:31:52.013307 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55790) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:52.036512 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-70f4d2d7-8614-4656-9f33-290cad2b1cd9 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] DELETE failed (client error): The resource could not be found. Nov 09 04:31:52.037109 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-70f4d2d7-8614-4656-9f33-290cad2b1cd9 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:31:52.042913 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-70f4d2d7-8614-4656-9f33-290cad2b1cd9 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] 10.222.0.24 "DELETE /v2.0/networks/9009edec-59ad-46af-a520-e6c0852ebf0d HTTP/1.1" status: 404 len: 339 time: 0.0261683 Nov 09 04:31:52.043315 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55792) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:52.073817 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-23ec2d91-fe3b-4b83-954c-a4610cb027df tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:52.082632 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c140f82f-e97c-4861-8a36-817a541c0054 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:52.112361 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 98e8f3dd-7b0f-4505-a30f-352681a1b560 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:31:52.126725 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2039bb32-e9d7-424b-a750-c65b736965d8 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:52.129034 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-2039bb32-e9d7-424b-a750-c65b736965d8 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "GET /v2.0/ports HTTP/1.1" status: 200 len: 848 time: 0.2601731 Nov 09 04:31:52.131630 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55794) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:52.138887 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-71ad0a2c-e007-4eeb-bc22-045f820ecaa1 None None] Provisioning complete for port f99ae9c3-073d-4901-bb48-618d8ce40895 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:52.139252 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-71ad0a2c-e007-4eeb-bc22-045f820ecaa1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:52.140704 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-ed32cff2-4de0-4162-aa14-08f64ec7917c tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 924 time: 1.3722041 Nov 09 04:31:52.142236 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55796) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:52.192345 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-23ec2d91-fe3b-4b83-954c-a4610cb027df tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:52.192674 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-23ec2d91-fe3b-4b83-954c-a4610cb027df tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 729 time: 0.6457047 Nov 09 04:31:52.195520 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55798) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:52.209658 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-c6b4fc7a-e76e-46a0-a5a0-772942587b59 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] GET failed (client error): The resource could not be found. Nov 09 04:31:52.211313 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-c6b4fc7a-e76e-46a0-a5a0-772942587b59 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "GET /v2.0/ports/2cbb91af-c589-4b0a-8eb5-e860509da6d6 HTTP/1.1" status: 404 len: 333 time: 0.0787411 Nov 09 04:31:52.222394 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55800) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:52.241571 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-72dec9b6-29c4-4da2-ab04-8029229a4944 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:52.244275 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-72dec9b6-29c4-4da2-ab04-8029229a4944 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:52.247770 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c140f82f-e97c-4861-8a36-817a541c0054 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:52.270902 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-205031a3-81c1-4042-87f1-c4b1ad827169 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] GET failed (client error): The resource could not be found. Nov 09 04:31:52.276255 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-205031a3-81c1-4042-87f1-c4b1ad827169 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "GET /v2.0/ports/b7759ec5-6631-48fb-aabd-d9ec8a957fff HTTP/1.1" status: 404 len: 333 time: 0.0495169 Nov 09 04:31:52.276255 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55802) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:52.312987 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ca7969b9-28f6-41f8-80ac-16aec70a268a tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:52.314606 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-ca7969b9-28f6-41f8-80ac-16aec70a268a tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "GET /v2.0/ports?fixed_ips=ip_address_substr%3D172.20.0.1 HTTP/1.1" status: 200 len: 921 time: 0.1702163 Nov 09 04:31:52.321290 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55804) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:52.325685 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-2e86cec6-5567-4e60-b97a-0523c0326597 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Deleting port a098c58e-5d4e-419f-93a6-52f36149fdfb {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:31:52.325685 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2e86cec6-5567-4e60-b97a-0523c0326597 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:52.341719 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c140f82f-e97c-4861-8a36-817a541c0054 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event deleted for resources: {'Subnet': ['ID=10a26071-6216-4b65-b6b6-f23700b8dbf0,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:52.353250 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 98e8f3dd-7b0f-4505-a30f-352681a1b560 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:52.353618 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:52.443883 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3c0896e1-4ec8-4006-9a8e-99efb34b00a0 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:52.452290 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2e86cec6-5567-4e60-b97a-0523c0326597 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:52.465208 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-099fe1ca-c7a3-4ae9-8365-0cf146b86deb None None] DHCP port deletion for 988d2354-693c-4d52-af17-25e0643eaa0c request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:31:52.470027 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-2e86cec6-5567-4e60-b97a-0523c0326597 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Calling delete_port for a098c58e-5d4e-419f-93a6-52f36149fdfb owned by {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:31:52.483518 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-71ad0a2c-e007-4eeb-bc22-045f820ecaa1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:52.594490 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-71ad0a2c-e007-4eeb-bc22-045f820ecaa1 None None] For port f99ae9c3-073d-4901-bb48-618d8ce40895, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=f99ae9c3-073d-4901-bb48-618d8ce40895,segment=NetworkSegment(667f2f48-63ef-4391-830e-9180dff2b93f),segment_id=667f2f48-63ef-4391-830e-9180dff2b93f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:31:52.611455 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device f99ae9c3-073d-4901-bb48-618d8ce40895 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:31:52.651321 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3c0896e1-4ec8-4006-9a8e-99efb34b00a0 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:52.657733 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-71ad0a2c-e007-4eeb-bc22-045f820ecaa1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:52.684265 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-3c0896e1-4ec8-4006-9a8e-99efb34b00a0 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['aae922f8-feeb-4960-8f09-cf16836975ff']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:52.689730 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-099fe1ca-c7a3-4ae9-8365-0cf146b86deb None None] Deleting port 98e8f3dd-7b0f-4505-a30f-352681a1b560 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:31:52.690100 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-099fe1ca-c7a3-4ae9-8365-0cf146b86deb None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:52.691497 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-3c0896e1-4ec8-4006-9a8e-99efb34b00a0 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4f24ec86-e856-4521-94e9-d073a256b635') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:52.691928 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-3c0896e1-4ec8-4006-9a8e-99efb34b00a0 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4f24ec86-e856-4521-94e9-d073a256b635') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:52.703933 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3c0896e1-4ec8-4006-9a8e-99efb34b00a0 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:52.719117 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3c0896e1-4ec8-4006-9a8e-99efb34b00a0 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:52.733198 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3c0896e1-4ec8-4006-9a8e-99efb34b00a0 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Releasing vlan 341 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:31:52.733679 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3c0896e1-4ec8-4006-9a8e-99efb34b00a0 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:52.762975 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71ad0a2c-e007-4eeb-bc22-045f820ecaa1 None None] Pushing event updated for resources: {'Port': ['ID=f99ae9c3-073d-4901-bb48-618d8ce40895,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:52.765726 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-118d81ca-081f-4428-985c-9de7b772bc16 tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Publish callbacks [] for router, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:52.791226 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-099fe1ca-c7a3-4ae9-8365-0cf146b86deb None None] For port 98e8f3dd-7b0f-4505-a30f-352681a1b560, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=98e8f3dd-7b0f-4505-a30f-352681a1b560,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:31:52.791734 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-099fe1ca-c7a3-4ae9-8365-0cf146b86deb None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:52.800773 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port f99ae9c3-073d-4901-bb48-618d8ce40895 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:52.801139 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:52.811259 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-85d46c25-3291-4938-8645-c42fa4d49af1 None None] Network e3317a1c-ad42-41af-9362-06b75b19b024 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:52.811677 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:31:52.811677 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:31:52.811677 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:31:52.811677 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:31:52.811677 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:31:52.811677 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:31:52.811677 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:31:52.811677 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:31:52.811677 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:31:52.811677 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:31:52.811677 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:31:52.811677 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:31:52.811677 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:31:52.811677 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:31:52.811677 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:31:52.811677 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:31:52.811677 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:31:52.811677 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:31:52.811677 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:31:52.811677 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:31:52.811677 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:31:52.811677 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:31:52.811677 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:31:52.811677 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:31:52.811677 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:31:52.811677 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:31:52.811677 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:31:52.811677 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:31:52.811677 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:31:52.811677 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:31:52.811677 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:31:52.811677 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:31:52.813660 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-099fe1ca-c7a3-4ae9-8365-0cf146b86deb None None] Calling delete_port for 98e8f3dd-7b0f-4505-a30f-352681a1b560 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:31:52.820081 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c140f82f-e97c-4861-8a36-817a541c0054 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:52.820405 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2e86cec6-5567-4e60-b97a-0523c0326597 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:52.826180 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-c140f82f-e97c-4861-8a36-817a541c0054 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "DELETE /v2.0/subnets/10a26071-6216-4b65-b6b6-f23700b8dbf0 HTTP/1.1" status: 204 len: 168 time: 1.3337924 Nov 09 04:31:52.832304 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55808) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:52.852614 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-28d7ee3f-ba33-4fb1-97b9-472f8e83282b None None] Provisioning complete for port f99ae9c3-073d-4901-bb48-618d8ce40895 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:52.852980 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-28d7ee3f-ba33-4fb1-97b9-472f8e83282b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:52.858618 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e86cec6-5567-4e60-b97a-0523c0326597 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Pushing event deleted for resources: {'Port': ['ID=a098c58e-5d4e-419f-93a6-52f36149fdfb,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:52.873263 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2e86cec6-5567-4e60-b97a-0523c0326597 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:52.878470 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-2e86cec6-5567-4e60-b97a-0523c0326597 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] 10.222.0.24 "DELETE /v2.0/ports/a098c58e-5d4e-419f-93a6-52f36149fdfb HTTP/1.1" status: 204 len: 168 time: 0.8341525 Nov 09 04:31:52.880803 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55810) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:52.915006 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-f298aeb2-6b50-4cb0-affe-e2eb361177b6 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] DELETE failed (client error): The resource could not be found. Nov 09 04:31:52.915006 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-f298aeb2-6b50-4cb0-affe-e2eb361177b6 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:31:52.919096 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-f298aeb2-6b50-4cb0-affe-e2eb361177b6 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] 10.222.0.24 "DELETE /v2.0/subnets/d464265c-8221-4b17-812a-e1630fa487e5 HTTP/1.1" status: 404 len: 337 time: 0.0370705 Nov 09 04:31:52.921604 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55812) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:53.014045 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3c0896e1-4ec8-4006-9a8e-99efb34b00a0 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:53.021574 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3c0896e1-4ec8-4006-9a8e-99efb34b00a0 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:53.029192 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-3c0896e1-4ec8-4006-9a8e-99efb34b00a0 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "DELETE /v2.0/networks/aae922f8-feeb-4960-8f09-cf16836975ff HTTP/1.1" status: 204 len: 168 time: 0.7520483 Nov 09 04:31:53.033507 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55814) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:53.041681 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-d05d8898-4a27-4b60-988b-34cfe2b03f10 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-312000311'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:53.077221 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c0896e1-4ec8-4006-9a8e-99efb34b00a0 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event deleted for resources: {'Network': ['ID=aae922f8-feeb-4960-8f09-cf16836975ff,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:53.109471 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-31ece115-8bf9-49b6-b922-19b988ac38a9 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:53.132035 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f7cb3040-3b42-4129-b173-ce4f690eef3d tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:53.138463 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f7cb3040-3b42-4129-b173-ce4f690eef3d tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:53.144963 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f7cb3040-3b42-4129-b173-ce4f690eef3d tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:53.149945 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-f7cb3040-3b42-4129-b173-ce4f690eef3d tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "GET /v2.0/ports?fixed_ips=ip_address_substr%3D172.20.0. HTTP/1.1" status: 200 len: 2376 time: 0.8206797 Nov 09 04:31:53.152305 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55816) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:53.155976 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-118d81ca-081f-4428-985c-9de7b772bc16 tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:53.166403 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d3e300e7-1d93-4e3b-9695-0f38d06bd62c tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:53.177877 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-118d81ca-081f-4428-985c-9de7b772bc16 tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:53.183311 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-28d7ee3f-ba33-4fb1-97b9-472f8e83282b None None] Provisioning complete for port c6b9cb9d-f1ff-41ab-8c15-689fc5f79093 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:53.188273 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-28d7ee3f-ba33-4fb1-97b9-472f8e83282b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:53.232638 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-31ece115-8bf9-49b6-b922-19b988ac38a9 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:53.235262 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-28d7ee3f-ba33-4fb1-97b9-472f8e83282b None None] Port c6b9cb9d-f1ff-41ab-8c15-689fc5f79093 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:31:53.248647 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-099fe1ca-c7a3-4ae9-8365-0cf146b86deb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:53.254252 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-31ece115-8bf9-49b6-b922-19b988ac38a9 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['03811c18-3b1c-42b8-9413-4db7f837fa52']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:53.258797 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e4e86996-e7e5-4452-bb13-d93a89217153 None None] DHCP port deletion for e3317a1c-ad42-41af-9362-06b75b19b024 request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:31:53.264151 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-31ece115-8bf9-49b6-b922-19b988ac38a9 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b769ba14-e21e-411b-82e2-2dd33164c868') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:53.264447 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-31ece115-8bf9-49b6-b922-19b988ac38a9 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b769ba14-e21e-411b-82e2-2dd33164c868') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:53.300159 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-31ece115-8bf9-49b6-b922-19b988ac38a9 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:53.310068 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d05d8898-4a27-4b60-988b-34cfe2b03f10 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Made reservation on behalf of 12e47d8445b5429892cd1b9244512ca8 for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:53.313656 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d05d8898-4a27-4b60-988b-34cfe2b03f10 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:53.323504 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-099fe1ca-c7a3-4ae9-8365-0cf146b86deb None None] Pushing event deleted for resources: {'Port': ['ID=98e8f3dd-7b0f-4505-a30f-352681a1b560,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:53.328498 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-28d7ee3f-ba33-4fb1-97b9-472f8e83282b None None] Provisioning complete for port 792ca1a1-5d94-4a2b-806d-206d5b7fac73 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:53.329063 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-28d7ee3f-ba33-4fb1-97b9-472f8e83282b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:53.337043 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-099fe1ca-c7a3-4ae9-8365-0cf146b86deb None None] No DVR routers for this DVR port 98e8f3dd-7b0f-4505-a30f-352681a1b560 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:31:53.399922 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-d3e300e7-1d93-4e3b-9695-0f38d06bd62c tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Deleting port ddadbc85-88b3-4e57-8103-52476bdc4001 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:31:53.399922 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d3e300e7-1d93-4e3b-9695-0f38d06bd62c tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:53.403328 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-118d81ca-081f-4428-985c-9de7b772bc16 tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:53.404167 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-118d81ca-081f-4428-985c-9de7b772bc16 tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 8e8b0423-e617-43b3-b409-dda6aa5395ec {{(pid=102162) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:31:53.404539 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-28d7ee3f-ba33-4fb1-97b9-472f8e83282b None None] Port 792ca1a1-5d94-4a2b-806d-206d5b7fac73 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:31:53.405186 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d05d8898-4a27-4b60-988b-34cfe2b03f10 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 334} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:31:53.410770 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-118d81ca-081f-4428-985c-9de7b772bc16 tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:53.412107 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-118d81ca-081f-4428-985c-9de7b772bc16 tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] 10.222.0.24 "DELETE /v2.0/routers/8e8b0423-e617-43b3-b409-dda6aa5395ec HTTP/1.1" status: 204 len: 168 time: 1.2155449 Nov 09 04:31:53.420606 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d05d8898-4a27-4b60-988b-34cfe2b03f10 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:53.421100 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-d05d8898-4a27-4b60-988b-34cfe2b03f10 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Added segment 5de340bc-e914-414a-bf00-93f5a53b7096 of type vlan for network c13d2b06-c5c0-4f58-bc5d-0e00561d7e6f Nov 09 04:31:53.424705 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55818) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:53.424904 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e4e86996-e7e5-4452-bb13-d93a89217153 None None] Deleting port ddadbc85-88b3-4e57-8103-52476bdc4001 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:31:53.425251 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e4e86996-e7e5-4452-bb13-d93a89217153 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:53.429252 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-31ece115-8bf9-49b6-b922-19b988ac38a9 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:53.430241 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-52477ef5-65fb-4d5b-af74-eaf50a929d06 tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Request body: {'router': {'name': 'tempest-router-1937395558', 'distributed': False}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:53.456405 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-31ece115-8bf9-49b6-b922-19b988ac38a9 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Releasing vlan 331 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:31:53.456821 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-31ece115-8bf9-49b6-b922-19b988ac38a9 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:53.459959 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:31:53.459959 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:31:53.459959 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:31:53.459959 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:31:53.459959 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:31:53.459959 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:31:53.459959 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:31:53.459959 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:31:53.459959 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:31:53.459959 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:31:53.459959 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:31:53.459959 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:31:53.459959 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:31:53.459959 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:31:53.459959 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:31:53.459959 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:31:53.459959 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:31:53.459959 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:31:53.459959 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:31:53.459959 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:31:53.459959 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:31:53.459959 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:31:53.459959 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:31:53.459959 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:31:53.459959 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:31:53.459959 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:31:53.459959 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:31:53.459959 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:31:53.459959 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:31:53.459959 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:31:53.459959 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:31:53.459959 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:31:53.477703 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-72dec9b6-29c4-4da2-ab04-8029229a4944 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:53.495006 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e4e86996-e7e5-4452-bb13-d93a89217153 None None] For port ddadbc85-88b3-4e57-8103-52476bdc4001, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=ddadbc85-88b3-4e57-8103-52476bdc4001,segment=NetworkSegment(d2b8b706-bc72-4a78-bf25-9333dc47e65b),segment_id=d2b8b706-bc72-4a78-bf25-9333dc47e65b)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:31:53.495542 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e4e86996-e7e5-4452-bb13-d93a89217153 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:53.508620 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e4e86996-e7e5-4452-bb13-d93a89217153 None None] Calling delete_port for ddadbc85-88b3-4e57-8103-52476bdc4001 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:31:53.526647 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d05d8898-4a27-4b60-988b-34cfe2b03f10 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:53.549035 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-d3e300e7-1d93-4e3b-9695-0f38d06bd62c tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] For port ddadbc85-88b3-4e57-8103-52476bdc4001, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=ddadbc85-88b3-4e57-8103-52476bdc4001,segment=NetworkSegment(d2b8b706-bc72-4a78-bf25-9333dc47e65b),segment_id=d2b8b706-bc72-4a78-bf25-9333dc47e65b)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:31:53.549395 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d3e300e7-1d93-4e3b-9695-0f38d06bd62c tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:53.566824 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-72dec9b6-29c4-4da2-ab04-8029229a4944 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:31:53.567073 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-0e3e9e92-c0d8-4751-8575-91991d59630d None None] Provisioning complete for port c6b9cb9d-f1ff-41ab-8c15-689fc5f79093 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:53.567432 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0e3e9e92-c0d8-4751-8575-91991d59630d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:53.569191 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-05a0350c-2674-42c2-ac9c-86ac9b3d8338 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Deleting port 792ca1a1-5d94-4a2b-806d-206d5b7fac73 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:31:53.569531 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-05a0350c-2674-42c2-ac9c-86ac9b3d8338 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:53.583633 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-d3e300e7-1d93-4e3b-9695-0f38d06bd62c tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Calling delete_port for ddadbc85-88b3-4e57-8103-52476bdc4001 owned by network:dhcp {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:31:53.602135 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-72dec9b6-29c4-4da2-ab04-8029229a4944 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:53.609869 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-72dec9b6-29c4-4da2-ab04-8029229a4944 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:53.610878 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-72dec9b6-29c4-4da2-ab04-8029229a4944 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:53.613442 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6d0bc73b-80b6-4e63-9580-b72c9fa652e9 None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:53.621596 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-0e3e9e92-c0d8-4751-8575-91991d59630d None None] Port c6b9cb9d-f1ff-41ab-8c15-689fc5f79093 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:31:53.633196 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-31ece115-8bf9-49b6-b922-19b988ac38a9 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:53.638873 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-31ece115-8bf9-49b6-b922-19b988ac38a9 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:53.642929 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-31ece115-8bf9-49b6-b922-19b988ac38a9 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] 10.222.0.24 "DELETE /v2.0/networks/03811c18-3b1c-42b8-9413-4db7f837fa52 HTTP/1.1" status: 204 len: 168 time: 0.7199848 Nov 09 04:31:53.651332 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55822) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:53.659779 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d05d8898-4a27-4b60-988b-34cfe2b03f10 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:53.665352 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d05d8898-4a27-4b60-988b-34cfe2b03f10 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:53.665934 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d05d8898-4a27-4b60-988b-34cfe2b03f10 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:53.667645 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-52477ef5-65fb-4d5b-af74-eaf50a929d06 tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:53.668830 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-52477ef5-65fb-4d5b-af74-eaf50a929d06 tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:53.679412 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72dec9b6-29c4-4da2-ab04-8029229a4944 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Subnet': ['ID=9bad9202-55ee-47a4-8bff-0df555101d70,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:53.693961 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-0e3e9e92-c0d8-4751-8575-91991d59630d None None] Provisioning complete for port 792ca1a1-5d94-4a2b-806d-206d5b7fac73 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:53.694741 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0e3e9e92-c0d8-4751-8575-91991d59630d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:53.746614 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31ece115-8bf9-49b6-b922-19b988ac38a9 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Pushing event deleted for resources: {'Network': ['ID=03811c18-3b1c-42b8-9413-4db7f837fa52,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:53.747648 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e4e86996-e7e5-4452-bb13-d93a89217153 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:53.757261 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-0e3e9e92-c0d8-4751-8575-91991d59630d None None] Port 792ca1a1-5d94-4a2b-806d-206d5b7fac73 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:31:53.790196 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-05a0350c-2674-42c2-ac9c-86ac9b3d8338 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:53.802194 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4e86996-e7e5-4452-bb13-d93a89217153 None None] Pushing event deleted for resources: {'Port': ['ID=ddadbc85-88b3-4e57-8103-52476bdc4001,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:53.814169 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e4e86996-e7e5-4452-bb13-d93a89217153 None None] No DVR routers for this DVR port ddadbc85-88b3-4e57-8103-52476bdc4001 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:31:53.824097 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-52477ef5-65fb-4d5b-af74-eaf50a929d06 tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:53.827854 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d3e300e7-1d93-4e3b-9695-0f38d06bd62c tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:53.831844 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device f99ae9c3-073d-4901-bb48-618d8ce40895 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:31:53.844813 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-72dec9b6-29c4-4da2-ab04-8029229a4944 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 1.9720674 Nov 09 04:31:53.845051 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55824) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:53.852255 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-b8a965cc-e446-4aae-94ab-22c5f41f9164 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'port': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'fixed_ips': [{'subnet_id': '9bad9202-55ee-47a4-8bff-0df555101d70', 'ip_address': '2001:db8::f822:e400:2a49:1408'}], 'name': 'tempest-NetworksTestDHCPv6-64844851'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:53.856677 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d3e300e7-1d93-4e3b-9695-0f38d06bd62c tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] No DVR routers for this DVR port ddadbc85-88b3-4e57-8103-52476bdc4001 on host dv-neutron-816802-2-hyperv {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:31:53.866117 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-05a0350c-2674-42c2-ac9c-86ac9b3d8338 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Calling delete_port for 792ca1a1-5d94-4a2b-806d-206d5b7fac73 owned by {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:31:53.877068 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-d05d8898-4a27-4b60-988b-34cfe2b03f10 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 771 time: 0.8370974 Nov 09 04:31:53.880089 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55826) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:53.887703 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d05d8898-4a27-4b60-988b-34cfe2b03f10 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event updated for resources: {'Network': ['ID=c13d2b06-c5c0-4f58-bc5d-0e00561d7e6f,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:53.894679 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-14b92626-a972-4144-a8e5-1fe76cb55786 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Request body: {'subnet': {'network_id': 'c13d2b06-c5c0-4f58-bc5d-0e00561d7e6f', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'allocation_pools': [{'start': '2001:db8::2', 'end': '2001:db8::ffff:ffff:ffff:fffe'}]}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:53.911513 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network c13d2b06-c5c0-4f58-bc5d-0e00561d7e6f details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:31:53.925594 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3e300e7-1d93-4e3b-9695-0f38d06bd62c tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event deleted for resources: {'Port': ['ID=ddadbc85-88b3-4e57-8103-52476bdc4001,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:53.930505 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-52477ef5-65fb-4d5b-af74-eaf50a929d06 tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:53.943367 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-433bf20b-9ca8-4eaa-916b-80e4cfc3b23a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-988d2354-693c-4d52-af17-25e0643eaa0c', 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'tenant_id': '8b0758f781884982bf5b94e6609237f6', 'fixed_ips': [{'subnet_id': '9bad9202-55ee-47a4-8bff-0df555101d70'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:31:53.944215 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-433bf20b-9ca8-4eaa-916b-80e4cfc3b23a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:54.051959 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-e04ef988-f1ac-4293-bd6c-e62306cc218d tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Deleting port 390ecda3-53a0-42c3-9d18-914395f6acad {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:31:54.052329 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e04ef988-f1ac-4293-bd6c-e62306cc218d tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:54.054673 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-52477ef5-65fb-4d5b-af74-eaf50a929d06 tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:54.060869 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-52477ef5-65fb-4d5b-af74-eaf50a929d06 tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 722 time: 0.6349146 Nov 09 04:31:54.071318 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55828) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:54.123431 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d3e300e7-1d93-4e3b-9695-0f38d06bd62c tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:54.153164 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port f99ae9c3-073d-4901-bb48-618d8ce40895 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:54.153778 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:54.175547 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-d3e300e7-1d93-4e3b-9695-0f38d06bd62c tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e3317a1c-ad42-41af-9362-06b75b19b024']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:54.204008 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-14b92626-a972-4144-a8e5-1fe76cb55786 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Made reservation on behalf of 12e47d8445b5429892cd1b9244512ca8 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:54.204554 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-d3e300e7-1d93-4e3b-9695-0f38d06bd62c tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd2b8b706-bc72-4a78-bf25-9333dc47e65b') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:54.205027 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-d3e300e7-1d93-4e3b-9695-0f38d06bd62c tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd2b8b706-bc72-4a78-bf25-9333dc47e65b') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:54.207864 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-14b92626-a972-4144-a8e5-1fe76cb55786 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:54.230579 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d3e300e7-1d93-4e3b-9695-0f38d06bd62c tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:54.253477 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3ff007af-22db-43e8-94e7-d1ef48bd9f36 tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Publish callbacks [] for router, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:54.259988 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e04ef988-f1ac-4293-bd6c-e62306cc218d tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:54.263281 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d3e300e7-1d93-4e3b-9695-0f38d06bd62c tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:54.271748 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d3e300e7-1d93-4e3b-9695-0f38d06bd62c tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Releasing vlan 302 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:31:54.272293 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d3e300e7-1d93-4e3b-9695-0f38d06bd62c tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:54.276375 dv-neutron-816802-2-hyperv neutron-server[102162]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:31:54.276375 dv-neutron-816802-2-hyperv neutron-server[102162]: self.session.flush() Nov 09 04:31:54.276375 dv-neutron-816802-2-hyperv neutron-server[102162]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:31:54.276375 dv-neutron-816802-2-hyperv neutron-server[102162]: self.session.flush() Nov 09 04:31:54.276375 dv-neutron-816802-2-hyperv neutron-server[102162]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:31:54.276375 dv-neutron-816802-2-hyperv neutron-server[102162]: self.session.flush() Nov 09 04:31:54.276375 dv-neutron-816802-2-hyperv neutron-server[102162]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:31:54.276375 dv-neutron-816802-2-hyperv neutron-server[102162]: self.session.flush() Nov 09 04:31:54.276375 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:31:54.276375 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:31:54.276375 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:31:54.276375 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:31:54.276375 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:31:54.276375 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:31:54.276375 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:31:54.276375 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:31:54.276375 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:31:54.276375 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:31:54.276375 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:31:54.276375 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:31:54.276375 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:31:54.276375 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:31:54.276375 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:31:54.276375 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:31:54.276375 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:31:54.276375 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:31:54.276375 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:31:54.276375 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:31:54.276375 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:31:54.276375 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:31:54.276375 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:31:54.276375 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:31:54.276375 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:31:54.276375 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:31:54.276375 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:31:54.276375 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:31:54.276375 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:31:54.276375 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:31:54.276375 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:31:54.276375 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:31:54.325131 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-433bf20b-9ca8-4eaa-916b-80e4cfc3b23a None None] Allocated IP 2001:db8::2 (988d2354-693c-4d52-af17-25e0643eaa0c/9bad9202-55ee-47a4-8bff-0df555101d70/79262866-3eda-4bfd-a563-a0cf04a76c36) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:31:54.331069 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.ipam_backend_mixin [None req-14b92626-a972-4144-a8e5-1fe76cb55786 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Performing IP validity checks on allocation pools {{(pid=102161) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:325}} Nov 09 04:31:54.333843 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.ipam_backend_mixin [None req-14b92626-a972-4144-a8e5-1fe76cb55786 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Checking for overlaps among allocation pools and gateway ip {{(pid=102161) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:346}} Nov 09 04:31:54.343669 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-e04ef988-f1ac-4293-bd6c-e62306cc218d tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Calling delete_port for 390ecda3-53a0-42c3-9d18-914395f6acad owned by {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:31:54.360732 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b8a965cc-e446-4aae-94ab-22c5f41f9164 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:54.394484 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 98e8f3dd-7b0f-4505-a30f-352681a1b560 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:31:54.422786 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 98e8f3dd-7b0f-4505-a30f-352681a1b560 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:31:54.423466 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 98e8f3dd-7b0f-4505-a30f-352681a1b560 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:31:54.424055 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device ddadbc85-88b3-4e57-8103-52476bdc4001 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:31:54.448249 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b8a965cc-e446-4aae-94ab-22c5f41f9164 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:54.453578 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: ddadbc85-88b3-4e57-8103-52476bdc4001 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:31:54.453938 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device ddadbc85-88b3-4e57-8103-52476bdc4001 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:31:54.469743 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [None req-b8a965cc-e446-4aae-94ab-22c5f41f9164 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] device_id is not set on port 01784344-5ca6-436b-acf7-fe0e2b04265f yet. {{(pid=102162) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:31:54.493235 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-05a0350c-2674-42c2-ac9c-86ac9b3d8338 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:54.518696 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d3e300e7-1d93-4e3b-9695-0f38d06bd62c tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:54.523782 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d3e300e7-1d93-4e3b-9695-0f38d06bd62c tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:54.531391 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-d3e300e7-1d93-4e3b-9695-0f38d06bd62c tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "DELETE /v2.0/networks/e3317a1c-ad42-41af-9362-06b75b19b024 HTTP/1.1" status: 204 len: 168 time: 1.6979282 Nov 09 04:31:54.531906 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55830) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:54.546343 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-1e90e77e-477b-447c-899a-c278ac56abff tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-1303690218', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}, 'admin_state_up': False}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:54.573030 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3e300e7-1d93-4e3b-9695-0f38d06bd62c tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event deleted for resources: {'Network': ['ID=e3317a1c-ad42-41af-9362-06b75b19b024,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:54.573846 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05a0350c-2674-42c2-ac9c-86ac9b3d8338 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event deleted for resources: {'Port': ['ID=792ca1a1-5d94-4a2b-806d-206d5b7fac73,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:54.576945 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3ff007af-22db-43e8-94e7-d1ef48bd9f36 tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:54.584638 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3ff007af-22db-43e8-94e7-d1ef48bd9f36 tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:54.631301 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-433bf20b-9ca8-4eaa-916b-80e4cfc3b23a None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:54.721653 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1e90e77e-477b-447c-899a-c278ac56abff tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:54.728815 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1e90e77e-477b-447c-899a-c278ac56abff tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:54.754661 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-433bf20b-9ca8-4eaa-916b-80e4cfc3b23a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:54.814453 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-b8a965cc-e446-4aae-94ab-22c5f41f9164 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Allocated IP 2001:db8::f822:e400:2a49:1408 (988d2354-693c-4d52-af17-25e0643eaa0c/9bad9202-55ee-47a4-8bff-0df555101d70/01784344-5ca6-436b-acf7-fe0e2b04265f) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:31:54.874609 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1e90e77e-477b-447c-899a-c278ac56abff tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:54.954711 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-433bf20b-9ca8-4eaa-916b-80e4cfc3b23a None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:31:54.957784 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-433bf20b-9ca8-4eaa-916b-80e4cfc3b23a None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:54.960426 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-433bf20b-9ca8-4eaa-916b-80e4cfc3b23a None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:31:55.017781 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-433bf20b-9ca8-4eaa-916b-80e4cfc3b23a None None] Pushing event updated for resources: {'Port': ['ID=79262866-3eda-4bfd-a563-a0cf04a76c36,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:55.035990 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-433bf20b-9ca8-4eaa-916b-80e4cfc3b23a None None] Attempting to bind port 79262866-3eda-4bfd-a563-a0cf04a76c36 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:31:55.036357 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-433bf20b-9ca8-4eaa-916b-80e4cfc3b23a None None] Attempting to bind port 79262866-3eda-4bfd-a563-a0cf04a76c36 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:31:55.036710 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-433bf20b-9ca8-4eaa-916b-80e4cfc3b23a None None] Attempting to bind port 79262866-3eda-4bfd-a563-a0cf04a76c36 on network 988d2354-693c-4d52-af17-25e0643eaa0c {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:31:55.042276 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-433bf20b-9ca8-4eaa-916b-80e4cfc3b23a None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 31, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:31:55.042680 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-433bf20b-9ca8-4eaa-916b-80e4cfc3b23a None None] Checking segment: {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:31:55.043183 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-433bf20b-9ca8-4eaa-916b-80e4cfc3b23a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:55.043600 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-433bf20b-9ca8-4eaa-916b-80e4cfc3b23a None None] Bound using segment: {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:31:55.044062 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-433bf20b-9ca8-4eaa-916b-80e4cfc3b23a None None] Bound port: 79262866-3eda-4bfd-a563-a0cf04a76c36, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:31:55.044434 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-433bf20b-9ca8-4eaa-916b-80e4cfc3b23a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:55.113028 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-433bf20b-9ca8-4eaa-916b-80e4cfc3b23a None None] For port 79262866-3eda-4bfd-a563-a0cf04a76c36, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:31:55.116746 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-433bf20b-9ca8-4eaa-916b-80e4cfc3b23a None None] For port 79262866-3eda-4bfd-a563-a0cf04a76c36, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=79262866-3eda-4bfd-a563-a0cf04a76c36,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:31:55.119461 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e04ef988-f1ac-4293-bd6c-e62306cc218d tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:55.121230 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3ff007af-22db-43e8-94e7-d1ef48bd9f36 tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:55.121791 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3ff007af-22db-43e8-94e7-d1ef48bd9f36 tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Fanout notify agent at l3_agent the message router_deleted on router fc5ed265-044c-4e07-a39c-4c0d088bde6b {{(pid=102161) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:31:55.133076 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3ff007af-22db-43e8-94e7-d1ef48bd9f36 tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:55.134187 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-3ff007af-22db-43e8-94e7-d1ef48bd9f36 tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] 10.222.0.24 "DELETE /v2.0/routers/fc5ed265-044c-4e07-a39c-4c0d088bde6b HTTP/1.1" status: 204 len: 168 time: 1.0619414 Nov 09 04:31:55.135310 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-05a0350c-2674-42c2-ac9c-86ac9b3d8338 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:55.138883 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-05a0350c-2674-42c2-ac9c-86ac9b3d8338 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "DELETE /v2.0/ports/792ca1a1-5d94-4a2b-806d-206d5b7fac73 HTTP/1.1" status: 204 len: 168 time: 1.9855194 Nov 09 04:31:55.139559 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55834) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:55.141495 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1e90e77e-477b-447c-899a-c278ac56abff tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:55.144952 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55836) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:55.151382 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-7b2fd9b5-f6bb-4ed9-b41a-5b766ea83be1 tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Request body: {'router': {'name': 'tempest-router-1403664227', 'distributed': False, 'admin_state_up': False, 'ha': False, 'project_id': '2b8533cbd8a546068ed7e0599e43eff7'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:55.165998 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b8a965cc-e446-4aae-94ab-22c5f41f9164 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:55.180316 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e04ef988-f1ac-4293-bd6c-e62306cc218d tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Pushing event deleted for resources: {'Port': ['ID=390ecda3-53a0-42c3-9d18-914395f6acad,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:55.201813 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-c9c7e648-9148-4033-820b-68271e8f9c84 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] GET failed (client error): The resource could not be found. Nov 09 04:31:55.203468 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-c9c7e648-9148-4033-820b-68271e8f9c84 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "GET /v2.0/ports/792ca1a1-5d94-4a2b-806d-206d5b7fac73 HTTP/1.1" status: 404 len: 333 time: 0.0392554 Nov 09 04:31:55.204563 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e04ef988-f1ac-4293-bd6c-e62306cc218d tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:55.206312 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55838) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:55.207720 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-e04ef988-f1ac-4293-bd6c-e62306cc218d tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] 10.222.0.24 "DELETE /v2.0/ports/390ecda3-53a0-42c3-9d18-914395f6acad HTTP/1.1" status: 204 len: 168 time: 1.5550888 Nov 09 04:31:55.210006 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55840) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:55.224007 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-433bf20b-9ca8-4eaa-916b-80e4cfc3b23a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:55.236889 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-1b683723-58b0-4a3b-bf18-68651c2140f6 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] DELETE failed (client error): The resource could not be found. Nov 09 04:31:55.237803 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-1b683723-58b0-4a3b-bf18-68651c2140f6 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:31:55.241325 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1b683723-58b0-4a3b-bf18-68651c2140f6 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] 10.222.0.24 "DELETE /v2.0/subnets/0a62af1b-0b59-428b-9d98-66562f1625b1 HTTP/1.1" status: 404 len: 337 time: 0.0293691 Nov 09 04:31:55.245026 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55842) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:55.260598 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7b2fd9b5-f6bb-4ed9-b41a-5b766ea83be1 tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:55.262133 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7b2fd9b5-f6bb-4ed9-b41a-5b766ea83be1 tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:55.291741 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-433bf20b-9ca8-4eaa-916b-80e4cfc3b23a None None] Pushing event updated for resources: {'Port': ['ID=79262866-3eda-4bfd-a563-a0cf04a76c36,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:55.309876 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-14b92626-a972-4144-a8e5-1fe76cb55786 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:55.318492 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b8a965cc-e446-4aae-94ab-22c5f41f9164 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:55.387758 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14b92626-a972-4144-a8e5-1fe76cb55786 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event updated for resources: {'Subnet': ['ID=64bf7731-477c-4c79-a0da-552481e8a442,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:55.395975 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-14b92626-a972-4144-a8e5-1fe76cb55786 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Checking segment: {'id': '5de340bc-e914-414a-bf00-93f5a53b7096', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 334, 'network_id': 'c13d2b06-c5c0-4f58-bc5d-0e00561d7e6f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:31:55.396329 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-14b92626-a972-4144-a8e5-1fe76cb55786 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Network hostable DHCP agents. Network: c13d2b06-c5c0-4f58-bc5d-0e00561d7e6f, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:31:55.477786 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a965cc-e446-4aae-94ab-22c5f41f9164 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Port': ['ID=01784344-5ca6-436b-acf7-fe0e2b04265f,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:55.483380 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b8a965cc-e446-4aae-94ab-22c5f41f9164 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:31:55.492303 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-14b92626-a972-4144-a8e5-1fe76cb55786 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Network c13d2b06-c5c0-4f58-bc5d-0e00561d7e6f is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:31:55.513972 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f2161a85-c365-4c35-8507-628a600a3da9 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:55.522429 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-b8a965cc-e446-4aae-94ab-22c5f41f9164 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:55.525484 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7b2fd9b5-f6bb-4ed9-b41a-5b766ea83be1 tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:55.553832 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b8a965cc-e446-4aae-94ab-22c5f41f9164 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:31:55.560028 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b8a965cc-e446-4aae-94ab-22c5f41f9164 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:55.560651 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b8a965cc-e446-4aae-94ab-22c5f41f9164 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:55.589513 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-14b92626-a972-4144-a8e5-1fe76cb55786 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, c13d2b06-c5c0-4f58-bc5d-0e00561d7e6f) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:55.594077 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-14b92626-a972-4144-a8e5-1fe76cb55786 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:55.594951 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-14b92626-a972-4144-a8e5-1fe76cb55786 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:55.600155 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-effa5e42-ead6-411b-9f67-43c1c0208017 None None] Network c13d2b06-c5c0-4f58-bc5d-0e00561d7e6f requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:55.618707 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-cd7255e5-a673-4e5b-9309-a62c2946be88 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Deleting port c6b9cb9d-f1ff-41ab-8c15-689fc5f79093 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:31:55.619041 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cd7255e5-a673-4e5b-9309-a62c2946be88 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:55.624048 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7b2fd9b5-f6bb-4ed9-b41a-5b766ea83be1 tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:55.708954 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-b8a965cc-e446-4aae-94ab-22c5f41f9164 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 946 time: 1.8615074 Nov 09 04:31:55.712433 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55844) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:55.725040 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-14b92626-a972-4144-a8e5-1fe76cb55786 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.8420713 Nov 09 04:31:55.730467 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55846) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:55.737659 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-ff2f746a-3289-4899-8e11-858c5e832503 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Request body: {'port': {'network_id': 'c13d2b06-c5c0-4f58-bc5d-0e00561d7e6f', 'name': 'tempest-PortsIpV6TestJSON-893943255'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:55.763250 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7b2fd9b5-f6bb-4ed9-b41a-5b766ea83be1 tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:55.764455 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-7b2fd9b5-f6bb-4ed9-b41a-5b766ea83be1 tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 723 time: 0.6198981 Nov 09 04:31:55.771449 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55848) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:55.775118 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7c335a69-3f96-4284-ad70-626f728c96ff None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-c13d2b06-c5c0-4f58-bc5d-0e00561d7e6f', 'network_id': 'c13d2b06-c5c0-4f58-bc5d-0e00561d7e6f', 'tenant_id': '12e47d8445b5429892cd1b9244512ca8', 'fixed_ips': [{'subnet_id': '64bf7731-477c-4c79-a0da-552481e8a442'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:31:55.782879 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7c335a69-3f96-4284-ad70-626f728c96ff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:55.782973 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f2161a85-c365-4c35-8507-628a600a3da9 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:55.785387 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-b981ce75-76ad-401e-880b-e8ecaf3551f4 tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Request body: {'router': {'distributed': True}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:55.876127 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 79262866-3eda-4bfd-a563-a0cf04a76c36 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:31:55.960789 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9083559c-21cd-4539-be24-6fc232e20d40 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:55.970490 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9083559c-21cd-4539-be24-6fc232e20d40 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:55.972244 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-9083559c-21cd-4539-be24-6fc232e20d40 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1683 time: 0.2588644 Nov 09 04:31:55.975968 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55852) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:56.026440 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-7c335a69-3f96-4284-ad70-626f728c96ff None None] Allocated IP 2001:db8::2 (c13d2b06-c5c0-4f58-bc5d-0e00561d7e6f/64bf7731-477c-4c79-a0da-552481e8a442/13d0ccda-34e5-4558-864a-b6a3ac214cb5) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:31:56.140054 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-46767ef3-261f-41e9-a8a2-5fe3f8781f27 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Deleting port 01784344-5ca6-436b-acf7-fe0e2b04265f {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:31:56.140675 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-46767ef3-261f-41e9-a8a2-5fe3f8781f27 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:56.188667 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7c335a69-3f96-4284-ad70-626f728c96ff None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:56.191567 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 79262866-3eda-4bfd-a563-a0cf04a76c36 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:56.191928 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:56.240705 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ff2f746a-3289-4899-8e11-858c5e832503 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Made reservation on behalf of 12e47d8445b5429892cd1b9244512ca8 for: {'port': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:56.241222 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ff2f746a-3289-4899-8e11-858c5e832503 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:56.251187 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-f2161a85-c365-4c35-8507-628a600a3da9 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b64bd442-d79d-4349-b9b3-5833909b2409']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:56.273114 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [None req-ff2f746a-3289-4899-8e11-858c5e832503 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] device_id is not set on port 04f4ded2-6eac-4d36-a779-c0966bd1d933 yet. {{(pid=102161) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:31:56.275003 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cd7255e5-a673-4e5b-9309-a62c2946be88 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:56.279241 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7c335a69-3f96-4284-ad70-626f728c96ff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:56.280601 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-f2161a85-c365-4c35-8507-628a600a3da9 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '303916b3-0435-4d77-9e83-60967f186bbf') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:56.280896 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-f2161a85-c365-4c35-8507-628a600a3da9 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '303916b3-0435-4d77-9e83-60967f186bbf') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:31:56.335496 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-46767ef3-261f-41e9-a8a2-5fe3f8781f27 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:56.341178 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7c335a69-3f96-4284-ad70-626f728c96ff None None] Network c13d2b06-c5c0-4f58-bc5d-0e00561d7e6f is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:31:56.341862 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f2161a85-c365-4c35-8507-628a600a3da9 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:56.349592 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-cd7255e5-a673-4e5b-9309-a62c2946be88 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Calling delete_port for c6b9cb9d-f1ff-41ab-8c15-689fc5f79093 owned by {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:31:56.350212 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:56.350838 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-7c335a69-3f96-4284-ad70-626f728c96ff None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:56.356226 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7c335a69-3f96-4284-ad70-626f728c96ff None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:31:56.368064 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-46767ef3-261f-41e9-a8a2-5fe3f8781f27 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Calling delete_port for 01784344-5ca6-436b-acf7-fe0e2b04265f owned by {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:31:56.380251 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c335a69-3f96-4284-ad70-626f728c96ff None None] Pushing event updated for resources: {'Port': ['ID=13d0ccda-34e5-4558-864a-b6a3ac214cb5,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:56.454526 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 79262866-3eda-4bfd-a563-a0cf04a76c36, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=79262866-3eda-4bfd-a563-a0cf04a76c36,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:31:56.459847 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-7c335a69-3f96-4284-ad70-626f728c96ff None None] Attempting to bind port 13d0ccda-34e5-4558-864a-b6a3ac214cb5 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:31:56.460210 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-7c335a69-3f96-4284-ad70-626f728c96ff None None] Attempting to bind port 13d0ccda-34e5-4558-864a-b6a3ac214cb5 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '5de340bc-e914-414a-bf00-93f5a53b7096', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 334, 'network_id': 'c13d2b06-c5c0-4f58-bc5d-0e00561d7e6f'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:31:56.460630 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7c335a69-3f96-4284-ad70-626f728c96ff None None] Attempting to bind port 13d0ccda-34e5-4558-864a-b6a3ac214cb5 on network c13d2b06-c5c0-4f58-bc5d-0e00561d7e6f {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:31:56.462471 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f2161a85-c365-4c35-8507-628a600a3da9 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:56.468055 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7c335a69-3f96-4284-ad70-626f728c96ff None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 31, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:31:56.468357 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7c335a69-3f96-4284-ad70-626f728c96ff None None] Checking segment: {'id': '5de340bc-e914-414a-bf00-93f5a53b7096', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 334, 'network_id': 'c13d2b06-c5c0-4f58-bc5d-0e00561d7e6f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:31:56.468665 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7c335a69-3f96-4284-ad70-626f728c96ff None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:56.469050 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7c335a69-3f96-4284-ad70-626f728c96ff None None] Bound using segment: {'id': '5de340bc-e914-414a-bf00-93f5a53b7096', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 334, 'network_id': 'c13d2b06-c5c0-4f58-bc5d-0e00561d7e6f'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:31:56.469518 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-7c335a69-3f96-4284-ad70-626f728c96ff None None] Bound port: 13d0ccda-34e5-4558-864a-b6a3ac214cb5, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5de340bc-e914-414a-bf00-93f5a53b7096', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 334, 'network_id': 'c13d2b06-c5c0-4f58-bc5d-0e00561d7e6f'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:31:56.469892 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7c335a69-3f96-4284-ad70-626f728c96ff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:56.474560 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f2161a85-c365-4c35-8507-628a600a3da9 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Releasing vlan 330 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:31:56.475231 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f2161a85-c365-4c35-8507-628a600a3da9 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:56.482407 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:31:56.482407 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:31:56.482407 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:31:56.482407 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:31:56.482407 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:31:56.482407 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:31:56.482407 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:31:56.482407 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:31:56.482407 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:31:56.482407 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:31:56.482407 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:31:56.482407 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:31:56.482407 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:31:56.482407 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:31:56.482407 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:31:56.482407 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:31:56.482407 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:31:56.482407 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:31:56.482407 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:31:56.482407 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:31:56.482407 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:31:56.482407 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:31:56.482407 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:31:56.482407 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:31:56.482407 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:31:56.482407 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:31:56.482407 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:31:56.482407 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:31:56.482407 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:31:56.482407 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:31:56.482407 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:31:56.482407 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:31:56.498004 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-ff2f746a-3289-4899-8e11-858c5e832503 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Allocated IP 2001:db8::3b2 (c13d2b06-c5c0-4f58-bc5d-0e00561d7e6f/64bf7731-477c-4c79-a0da-552481e8a442/04f4ded2-6eac-4d36-a779-c0966bd1d933) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:31:56.539938 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:56.586848 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-5a3f784b-f176-4cc4-81a7-f1df6d5155be None None] Provisioning complete for port 79262866-3eda-4bfd-a563-a0cf04a76c36 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:56.587640 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5a3f784b-f176-4cc4-81a7-f1df6d5155be None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:56.621471 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-7c335a69-3f96-4284-ad70-626f728c96ff None None] For port 13d0ccda-34e5-4558-864a-b6a3ac214cb5, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:31:56.633273 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1e90e77e-477b-447c-899a-c278ac56abff tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for router_gateway, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:56.647457 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b981ce75-76ad-401e-880b-e8ecaf3551f4 tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-466202', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-464271', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-936'] for router, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:56.647700 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=79262866-3eda-4bfd-a563-a0cf04a76c36,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:56.647877 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b981ce75-76ad-401e-880b-e8ecaf3551f4 tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Publish callbacks [] for router, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:56.668491 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-46767ef3-261f-41e9-a8a2-5fe3f8781f27 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:56.710541 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1e90e77e-477b-447c-899a-c278ac56abff tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:56.729394 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46767ef3-261f-41e9-a8a2-5fe3f8781f27 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event deleted for resources: {'Port': ['ID=01784344-5ca6-436b-acf7-fe0e2b04265f,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:56.786437 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-46767ef3-261f-41e9-a8a2-5fe3f8781f27 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:56.789691 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-46767ef3-261f-41e9-a8a2-5fe3f8781f27 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/ports/01784344-5ca6-436b-acf7-fe0e2b04265f HTTP/1.1" status: 204 len: 168 time: 0.8127928 Nov 09 04:31:56.796715 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55854) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:56.812177 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-7c335a69-3f96-4284-ad70-626f728c96ff None None] For port 13d0ccda-34e5-4558-864a-b6a3ac214cb5, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=13d0ccda-34e5-4558-864a-b6a3ac214cb5,segment=NetworkSegment(5de340bc-e914-414a-bf00-93f5a53b7096),segment_id=5de340bc-e914-414a-bf00-93f5a53b7096)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:31:56.825601 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f2161a85-c365-4c35-8507-628a600a3da9 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:56.827519 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.l3_router.service_providers.driver_controller [None req-b981ce75-76ad-401e-880b-e8ecaf3551f4 tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Get a provider driver handle based on the ha flag: False and distributed flag: True {{(pid=102162) _update_router_provider /opt/stack/neutron/neutron/services/l3_router/service_providers/driver_controller.py:160}} Nov 09 04:31:56.827857 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.l3_router.service_providers.driver_controller [None req-b981ce75-76ad-401e-880b-e8ecaf3551f4 tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Router 672275de-ecc4-4cde-9de1-349821358d01 migrating from provider to provider. {{(pid=102162) _update_router_provider /opt/stack/neutron/neutron/services/l3_router/service_providers/driver_controller.py:167}} Nov 09 04:31:56.828227 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b981ce75-76ad-401e-880b-e8ecaf3551f4 tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:56.841335 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f2161a85-c365-4c35-8507-628a600a3da9 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:56.842673 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-2aed8d3a-54c8-4eca-b968-83646e9165e5 None None] Could not find standard attr ID for object 01784344-5ca6-436b-acf7-fe0e2b04265f. {{(pid=102163) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 09 04:31:56.844554 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-f2161a85-c365-4c35-8507-628a600a3da9 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] 10.222.0.24 "DELETE /v2.0/networks/b64bd442-d79d-4349-b9b3-5833909b2409 HTTP/1.1" status: 204 len: 168 time: 1.5986054 Nov 09 04:31:56.864770 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55856) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:56.865938 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b981ce75-76ad-401e-880b-e8ecaf3551f4 tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:56.868259 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2161a85-c365-4c35-8507-628a600a3da9 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Pushing event deleted for resources: {'Network': ['ID=b64bd442-d79d-4349-b9b3-5833909b2409,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:56.887738 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7c335a69-3f96-4284-ad70-626f728c96ff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:56.937273 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6ce93525-9c85-48ab-b855-f68ffc7953f3 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:56.939095 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6ce93525-9c85-48ab-b855-f68ffc7953f3 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:56.943674 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-6ce93525-9c85-48ab-b855-f68ffc7953f3 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1464 time: 0.1456511 Nov 09 04:31:56.946480 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55858) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:57.007428 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c335a69-3f96-4284-ad70-626f728c96ff None None] Pushing event updated for resources: {'Port': ['ID=13d0ccda-34e5-4558-864a-b6a3ac214cb5,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:57.012188 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ff2f746a-3289-4899-8e11-858c5e832503 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:57.020478 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-9e5b9f66-8ab6-436b-8d88-01dd64448033 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Deleting subnet 9bad9202-55ee-47a4-8bff-0df555101d70 {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:31:57.022930 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9e5b9f66-8ab6-436b-8d88-01dd64448033 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:57.072483 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9e5b9f66-8ab6-436b-8d88-01dd64448033 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:57.073213 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b981ce75-76ad-401e-880b-e8ecaf3551f4 tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-466195', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-466408', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-464260'] for router, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:57.185039 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9e5b9f66-8ab6-436b-8d88-01dd64448033 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:57.227791 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ff2f746a-3289-4899-8e11-858c5e832503 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:57.297859 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-9746a24c-9bbf-4f2b-99f5-50696b1307e8 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Deleting subnet 1bdc3844-b17a-4a9a-934e-eee20137f970 {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:31:57.302735 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-1e90e77e-477b-447c-899a-c278ac56abff tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Allocated IP 172.26.0.158 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/feafe305-1bba-4f69-ad09-d2015efadb82) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:31:57.306013 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cd7255e5-a673-4e5b-9309-a62c2946be88 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:57.319734 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ff2f746a-3289-4899-8e11-858c5e832503 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Network c13d2b06-c5c0-4f58-bc5d-0e00561d7e6f is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:31:57.323030 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff2f746a-3289-4899-8e11-858c5e832503 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event updated for resources: {'Port': ['ID=04f4ded2-6eac-4d36-a779-c0966bd1d933,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:57.326157 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-ff2f746a-3289-4899-8e11-858c5e832503 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:57.328711 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ff2f746a-3289-4899-8e11-858c5e832503 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:31:57.335064 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ff2f746a-3289-4899-8e11-858c5e832503 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:57.335861 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ff2f746a-3289-4899-8e11-858c5e832503 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:57.343732 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9746a24c-9bbf-4f2b-99f5-50696b1307e8 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:57.422742 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-ff2f746a-3289-4899-8e11-858c5e832503 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 930 time: 1.6863148 Nov 09 04:31:57.423499 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55862) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:57.435211 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd7255e5-a673-4e5b-9309-a62c2946be88 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event deleted for resources: {'Port': ['ID=c6b9cb9d-f1ff-41ab-8c15-689fc5f79093,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:57.462242 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9e5b9f66-8ab6-436b-8d88-01dd64448033 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:57.486575 dv-neutron-816802-2-hyperv neutron-server[102162]: WARNING neutron.scheduler.l3_agent_scheduler [None req-b981ce75-76ad-401e-880b-e8ecaf3551f4 tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] No L3 agents can host the router 672275de-ecc4-4cde-9de1-349821358d01 Nov 09 04:31:57.502681 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a00d1525-1474-4f5f-99e9-cb10c6aa9cbe None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:57.529250 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9e5b9f66-8ab6-436b-8d88-01dd64448033 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:57.534957 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-9e5b9f66-8ab6-436b-8d88-01dd64448033 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/9bad9202-55ee-47a4-8bff-0df555101d70 HTTP/1.1" status: 204 len: 168 time: 0.5850885 Nov 09 04:31:57.544462 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55864) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:57.548936 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e5b9f66-8ab6-436b-8d88-01dd64448033 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event deleted for resources: {'Subnet': ['ID=9bad9202-55ee-47a4-8bff-0df555101d70,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:57.592742 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1e90e77e-477b-447c-899a-c278ac56abff tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:57.629291 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9746a24c-9bbf-4f2b-99f5-50696b1307e8 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:57.653118 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-00ec7cea-5b45-4606-a42d-80483a94af00 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1036451 Nov 09 04:31:57.653380 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55866) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:57.726917 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-53bf69c0-449a-40fa-98d0-2aac440efeac tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:57.728414 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-53bf69c0-449a-40fa-98d0-2aac440efeac tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/ports HTTP/1.1" status: 200 len: 866 time: 0.0741196 Nov 09 04:31:57.731530 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1e90e77e-477b-447c-899a-c278ac56abff tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:57.732515 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55868) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:57.745189 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-51f5b8a3-474a-48ac-b1b8-a5d4d962cc19 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Deleting port 04f4ded2-6eac-4d36-a779-c0966bd1d933 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:31:57.746322 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-51f5b8a3-474a-48ac-b1b8-a5d4d962cc19 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:57.756939 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1e90e77e-477b-447c-899a-c278ac56abff tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:31:57.765413 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-1e90e77e-477b-447c-899a-c278ac56abff tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:57.768674 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1e90e77e-477b-447c-899a-c278ac56abff tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:31:57.776013 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ae6a5006-25f8-418c-8da6-e8fdb08b9bed None None] DHCP port deletion for 988d2354-693c-4d52-af17-25e0643eaa0c request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:31:57.870388 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-ae6a5006-25f8-418c-8da6-e8fdb08b9bed None None] Deleting port 79262866-3eda-4bfd-a563-a0cf04a76c36 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:31:57.870388 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ae6a5006-25f8-418c-8da6-e8fdb08b9bed None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:57.896313 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e90e77e-477b-447c-899a-c278ac56abff tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event updated for resources: {'Port': ['ID=feafe305-1bba-4f69-ad09-d2015efadb82,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:57.926080 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cd7255e5-a673-4e5b-9309-a62c2946be88 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:57.933923 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4397ea23-2378-416f-a232-bdf86c45b88c tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:57.936186 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-4397ea23-2378-416f-a232-bdf86c45b88c tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.2028205 Nov 09 04:31:57.944024 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55870) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:57.948436 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 13d0ccda-34e5-4558-864a-b6a3ac214cb5 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:31:57.951321 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-cd7255e5-a673-4e5b-9309-a62c2946be88 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "DELETE /v2.0/ports/c6b9cb9d-f1ff-41ab-8c15-689fc5f79093 HTTP/1.1" status: 204 len: 168 time: 2.7440026 Nov 09 04:31:57.958308 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55872) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:57.993942 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-ae6a5006-25f8-418c-8da6-e8fdb08b9bed None None] For port 79262866-3eda-4bfd-a563-a0cf04a76c36, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=79262866-3eda-4bfd-a563-a0cf04a76c36,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:31:57.994334 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ae6a5006-25f8-418c-8da6-e8fdb08b9bed None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:58.011112 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-5e054d41-fc27-452a-b747-0ce6c5f3a9ce tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0655510 Nov 09 04:31:58.023899 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55874) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:58.031790 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-351e5018-ba8b-4352-b2d4-e47e25208d05 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] GET failed (client error): The resource could not be found. Nov 09 04:31:58.033849 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-351e5018-ba8b-4352-b2d4-e47e25208d05 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "GET /v2.0/ports/c6b9cb9d-f1ff-41ab-8c15-689fc5f79093 HTTP/1.1" status: 404 len: 333 time: 0.0741639 Nov 09 04:31:58.036612 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55876) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:58.040789 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-ae6a5006-25f8-418c-8da6-e8fdb08b9bed None None] Calling delete_port for 79262866-3eda-4bfd-a563-a0cf04a76c36 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:31:58.106429 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-13c03c93-457a-47db-a4ce-e23a83ecb686 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'subnet': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:58.107505 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 13d0ccda-34e5-4558-864a-b6a3ac214cb5 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:58.107871 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:58.111340 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-51f5b8a3-474a-48ac-b1b8-a5d4d962cc19 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:58.144924 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-edc488ab-70ef-469e-9923-32ac9e698bc4 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Deleting subnet 41cf4118-3cde-44c5-8308-f2610de95450 {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:31:58.156774 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-51f5b8a3-474a-48ac-b1b8-a5d4d962cc19 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Calling delete_port for 04f4ded2-6eac-4d36-a779-c0966bd1d933 owned by {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:31:58.158974 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-edc488ab-70ef-469e-9923-32ac9e698bc4 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:58.226048 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:58.282282 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 13d0ccda-34e5-4558-864a-b6a3ac214cb5, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=13d0ccda-34e5-4558-864a-b6a3ac214cb5,segment=NetworkSegment(5de340bc-e914-414a-bf00-93f5a53b7096),segment_id=5de340bc-e914-414a-bf00-93f5a53b7096)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:31:58.325247 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-edc488ab-70ef-469e-9923-32ac9e698bc4 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:58.356154 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:58.407279 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ae6a5006-25f8-418c-8da6-e8fdb08b9bed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:58.433502 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ae6a5006-25f8-418c-8da6-e8fdb08b9bed None None] No DVR routers for this DVR port 79262866-3eda-4bfd-a563-a0cf04a76c36 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:31:58.449295 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b981ce75-76ad-401e-880b-e8ecaf3551f4 tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Hosts for router 672275de-ecc4-4cde-9de1-349821358d01: [] {{(pid=102162) _get_dvr_hosts_for_router /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:328}} Nov 09 04:31:58.464013 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=13d0ccda-34e5-4558-864a-b6a3ac214cb5,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:58.519554 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-edc488ab-70ef-469e-9923-32ac9e698bc4 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:58.525554 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae6a5006-25f8-418c-8da6-e8fdb08b9bed None None] Pushing event deleted for resources: {'Port': ['ID=79262866-3eda-4bfd-a563-a0cf04a76c36,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:58.552447 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-985d6c3b-e6df-4729-aea5-fe85c6ae552a None None] Network c13d2b06-c5c0-4f58-bc5d-0e00561d7e6f requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:58.564082 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9746a24c-9bbf-4f2b-99f5-50696b1307e8 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:58.593482 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b981ce75-76ad-401e-880b-e8ecaf3551f4 tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Hosts for other DVR routers connected to router 672275de-ecc4-4cde-9de1-349821358d01: set() {{(pid=102162) _get_other_dvr_hosts /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:345}} Nov 09 04:31:58.596030 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b981ce75-76ad-401e-880b-e8ecaf3551f4 tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:58.597248 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-b981ce75-76ad-401e-880b-e8ecaf3551f4 tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] 10.222.0.24 "PUT /v2.0/routers/672275de-ecc4-4cde-9de1-349821358d01 HTTP/1.1" status: 200 len: 717 time: 2.8228626 Nov 09 04:31:58.602200 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55884) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:58.624604 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-28c55b73-926b-4ee0-8f7d-a2327f07e741 None None] Provisioning complete for port 13d0ccda-34e5-4558-864a-b6a3ac214cb5 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:58.624604 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-28c55b73-926b-4ee0-8f7d-a2327f07e741 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:58.662603 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1e90e77e-477b-447c-899a-c278ac56abff tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for router_gateway, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:58.679489 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-51f5b8a3-474a-48ac-b1b8-a5d4d962cc19 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:58.683315 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-edc488ab-70ef-469e-9923-32ac9e698bc4 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:58.720274 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-13c03c93-457a-47db-a4ce-e23a83ecb686 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:31:58.723674 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-13c03c93-457a-47db-a4ce-e23a83ecb686 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:58.750811 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-5b1d443d-7cb5-4d03-98d4-ecc5cd445533 tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] 10.222.0.24 "GET /v2.0/routers/672275de-ecc4-4cde-9de1-349821358d01 HTTP/1.1" status: 200 len: 717 time: 0.1450820 Nov 09 04:31:58.751037 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edc488ab-70ef-469e-9923-32ac9e698bc4 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event deleted for resources: {'Subnet': ['ID=41cf4118-3cde-44c5-8308-f2610de95450,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:58.752613 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51f5b8a3-474a-48ac-b1b8-a5d4d962cc19 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event deleted for resources: {'Port': ['ID=04f4ded2-6eac-4d36-a779-c0966bd1d933,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:58.756766 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55886) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:58.782555 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-edc488ab-70ef-469e-9923-32ac9e698bc4 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:58.782555 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-edc488ab-70ef-469e-9923-32ac9e698bc4 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "DELETE /v2.0/subnets/41cf4118-3cde-44c5-8308-f2610de95450 HTTP/1.1" status: 204 len: 168 time: 0.7318215 Nov 09 04:31:58.786675 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55890) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:58.795768 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-081f7f27-05b9-4610-aa20-1db455c6cbb7 None None] Network f8dfd1cc-6ee7-4112-9ceb-eb2ba064609b requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:58.798067 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-51f5b8a3-474a-48ac-b1b8-a5d4d962cc19 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:58.803734 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-51f5b8a3-474a-48ac-b1b8-a5d4d962cc19 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "DELETE /v2.0/ports/04f4ded2-6eac-4d36-a779-c0966bd1d933 HTTP/1.1" status: 204 len: 168 time: 1.3767395 Nov 09 04:31:58.812112 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55892) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:58.861684 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-3c3ff64f-0296-48ae-8d06-76b855c2642e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] DELETE failed (client error): The resource could not be found. Nov 09 04:31:58.862440 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-3c3ff64f-0296-48ae-8d06-76b855c2642e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:31:58.865904 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-3c3ff64f-0296-48ae-8d06-76b855c2642e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "DELETE /v2.0/ports/04f4ded2-6eac-4d36-a779-c0966bd1d933 HTTP/1.1" status: 404 len: 333 time: 0.0528736 Nov 09 04:31:58.896583 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55894) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:58.931165 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-e98446e1-88e5-4d98-aa70-bf7b1b51b69a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] GET failed (client error): The resource could not be found. Nov 09 04:31:58.932960 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-e98446e1-88e5-4d98-aa70-bf7b1b51b69a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "GET /v2.0/ports/04f4ded2-6eac-4d36-a779-c0966bd1d933 HTTP/1.1" status: 404 len: 333 time: 0.0352962 Nov 09 04:31:58.938867 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55896) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:59.044446 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2585f7c9-fd00-4925-bb76-d90d5e31d655 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:59.073147 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e754ea64-3d6f-4686-8a00-e26b45c918d9 None None] DHCP port deletion for f8dfd1cc-6ee7-4112-9ceb-eb2ba064609b request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:31:59.082163 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-9448f042-6d21-4906-8dfc-8a793aed2b0d tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Deleting subnet 64bf7731-477c-4c79-a0da-552481e8a442 {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:31:59.089346 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9448f042-6d21-4906-8dfc-8a793aed2b0d tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:59.101021 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-bcbb7443-60be-493c-b902-f0d6f52484d8 tempest-RoutersTestDVR-2067598862 tempest-RoutersTestDVR-2067598862-project] 10.222.0.24 "GET /v2.0/routers/672275de-ecc4-4cde-9de1-349821358d01 HTTP/1.1" status: 200 len: 683 time: 0.3397582 Nov 09 04:31:59.119165 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55898) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:59.135583 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-dce6d7bb-9e65-44ac-b2a0-1df056feb42a None None] Provisioning complete for port 13d0ccda-34e5-4558-864a-b6a3ac214cb5 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:31:59.135942 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-dce6d7bb-9e65-44ac-b2a0-1df056feb42a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:59.182730 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9746a24c-9bbf-4f2b-99f5-50696b1307e8 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:59.198650 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e754ea64-3d6f-4686-8a00-e26b45c918d9 None None] Deleting port f99ae9c3-073d-4901-bb48-618d8ce40895 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:31:59.200464 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e754ea64-3d6f-4686-8a00-e26b45c918d9 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:59.233898 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9746a24c-9bbf-4f2b-99f5-50696b1307e8 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Pushing event deleted for resources: {'Subnet': ['ID=1bdc3844-b17a-4a9a-934e-eee20137f970,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:59.234972 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9448f042-6d21-4906-8dfc-8a793aed2b0d tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:59.245047 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9746a24c-9bbf-4f2b-99f5-50696b1307e8 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:59.249548 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-9746a24c-9bbf-4f2b-99f5-50696b1307e8 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] 10.222.0.24 "DELETE /v2.0/subnets/1bdc3844-b17a-4a9a-934e-eee20137f970 HTTP/1.1" status: 204 len: 168 time: 2.3771987 Nov 09 04:31:59.252064 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55900) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:59.258906 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ebb53580-6dc0-4e97-99ec-f6e01121dd0d tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Publish callbacks [] for router, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:59.286024 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7005250c-233e-4b60-a6ac-997dee3cd210 None None] Network 40dee9cb-19f2-4ff9-b4f7-f821196139d9 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:59.435752 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e754ea64-3d6f-4686-8a00-e26b45c918d9 None None] For port f99ae9c3-073d-4901-bb48-618d8ce40895, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=f99ae9c3-073d-4901-bb48-618d8ce40895,segment=NetworkSegment(667f2f48-63ef-4391-830e-9180dff2b93f),segment_id=667f2f48-63ef-4391-830e-9180dff2b93f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:31:59.436154 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e754ea64-3d6f-4686-8a00-e26b45c918d9 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:59.451469 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e754ea64-3d6f-4686-8a00-e26b45c918d9 None None] Calling delete_port for f99ae9c3-073d-4901-bb48-618d8ce40895 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:31:59.471973 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:31:59.511121 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ebb53580-6dc0-4e97-99ec-f6e01121dd0d tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:59.525426 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ebb53580-6dc0-4e97-99ec-f6e01121dd0d tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:59.539136 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d695c52f-375d-4c5c-b444-726a8128d1a2 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:59.573712 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1e90e77e-477b-447c-899a-c278ac56abff tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:59.579654 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-2585f7c9-fd00-4925-bb76-d90d5e31d655 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Deleting port f99ae9c3-073d-4901-bb48-618d8ce40895 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:31:59.579961 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2585f7c9-fd00-4925-bb76-d90d5e31d655 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:59.599192 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9448f042-6d21-4906-8dfc-8a793aed2b0d tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:59.672307 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-13c03c93-457a-47db-a4ce-e23a83ecb686 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:59.675406 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ebb53580-6dc0-4e97-99ec-f6e01121dd0d tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:59.675698 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ebb53580-6dc0-4e97-99ec-f6e01121dd0d tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 672275de-ecc4-4cde-9de1-349821358d01 {{(pid=102161) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:31:59.687045 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ebb53580-6dc0-4e97-99ec-f6e01121dd0d tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:59.687649 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-ebb53580-6dc0-4e97-99ec-f6e01121dd0d tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] 10.222.0.24 "DELETE /v2.0/routers/672275de-ecc4-4cde-9de1-349821358d01 HTTP/1.1" status: 204 len: 168 time: 0.5656307 Nov 09 04:31:59.691377 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55904) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:59.697106 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-c3643e3b-473a-4d6a-bbaa-edaa55e1b204 tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Request body: {'router': {'name': 'tempest-router-730683734', 'distributed': True}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:59.704728 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-2585f7c9-fd00-4925-bb76-d90d5e31d655 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] For port f99ae9c3-073d-4901-bb48-618d8ce40895, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=f99ae9c3-073d-4901-bb48-618d8ce40895,segment=NetworkSegment(667f2f48-63ef-4391-830e-9180dff2b93f),segment_id=667f2f48-63ef-4391-830e-9180dff2b93f)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:31:59.705049 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2585f7c9-fd00-4925-bb76-d90d5e31d655 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:59.729245 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-2585f7c9-fd00-4925-bb76-d90d5e31d655 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Calling delete_port for f99ae9c3-073d-4901-bb48-618d8ce40895 owned by network:dhcp {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:31:59.798688 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-13c03c93-457a-47db-a4ce-e23a83ecb686 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:31:59.799742 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13c03c93-457a-47db-a4ce-e23a83ecb686 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Subnet': ['ID=e1e90599-9e6d-4f55-825b-7f5eee66d7b4,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:31:59.808718 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-13c03c93-457a-47db-a4ce-e23a83ecb686 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:31:59.815792 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-13c03c93-457a-47db-a4ce-e23a83ecb686 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:31:59.816446 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-13c03c93-457a-47db-a4ce-e23a83ecb686 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:59.820924 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 13d0ccda-34e5-4558-864a-b6a3ac214cb5 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:31:59.826913 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9448f042-6d21-4906-8dfc-8a793aed2b0d tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:59.851571 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-d695c52f-375d-4c5c-b444-726a8128d1a2 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Deleting port 627d2dd9-7b3b-4b20-a4e4-18764ff393f3 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:31:59.851991 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d695c52f-375d-4c5c-b444-726a8128d1a2 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:59.863287 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-353fb120-a7d6-44fd-807f-decedb70b4cc None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:31:59.888299 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bddeb11d-b59c-4e1a-8e56-0037fcdd98bd None None] DHCP port deletion for 40dee9cb-19f2-4ff9-b4f7-f821196139d9 request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:31:59.901487 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-665a0341-30fe-4fdd-a304-fbdf1e6dca18 None None] Could not find standard attr ID for object 04f4ded2-6eac-4d36-a779-c0966bd1d933. {{(pid=102163) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 09 04:31:59.942316 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-13c03c93-457a-47db-a4ce-e23a83ecb686 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 1.9140756 Nov 09 04:31:59.946629 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55906) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:31:59.950525 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-d695c52f-375d-4c5c-b444-726a8128d1a2 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] For port 627d2dd9-7b3b-4b20-a4e4-18764ff393f3, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=627d2dd9-7b3b-4b20-a4e4-18764ff393f3,segment=NetworkSegment(a5dc97b2-9efa-4398-bd82-7057a61e12f5),segment_id=a5dc97b2-9efa-4398-bd82-7057a61e12f5)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:31:59.950888 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d695c52f-375d-4c5c-b444-726a8128d1a2 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:59.958104 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-dd8fc524-d065-4fea-8b1c-23b6f331c1b3 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'port': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'fixed_ips': [{'subnet_id': 'e1e90599-9e6d-4f55-825b-7f5eee66d7b4', 'ip_address': '2001:db8::781d:bb17:1a5a:b769'}], 'name': 'tempest-NetworksTestDHCPv6-1445336741'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:31:59.962245 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e754ea64-3d6f-4686-8a00-e26b45c918d9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:31:59.996230 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-d695c52f-375d-4c5c-b444-726a8128d1a2 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Calling delete_port for 627d2dd9-7b3b-4b20-a4e4-18764ff393f3 owned by network:dhcp {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:32:00.012674 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e754ea64-3d6f-4686-8a00-e26b45c918d9 None None] Pushing event deleted for resources: {'Port': ['ID=f99ae9c3-073d-4901-bb48-618d8ce40895,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:00.037132 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e754ea64-3d6f-4686-8a00-e26b45c918d9 None None] No DVR routers for this DVR port f99ae9c3-073d-4901-bb48-618d8ce40895 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:32:00.075923 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 13d0ccda-34e5-4558-864a-b6a3ac214cb5 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:00.076322 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:00.169217 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1e90e77e-477b-447c-899a-c278ac56abff tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Router 215e107d-c97d-47d2-b086-7c223276dc25 is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102162) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:32:00.169543 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-bddeb11d-b59c-4e1a-8e56-0037fcdd98bd None None] Deleting port 627d2dd9-7b3b-4b20-a4e4-18764ff393f3 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:32:00.169543 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-bddeb11d-b59c-4e1a-8e56-0037fcdd98bd None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:00.204557 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c3643e3b-473a-4d6a-bbaa-edaa55e1b204 tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:00.205791 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c3643e3b-473a-4d6a-bbaa-edaa55e1b204 tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:00.215762 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-bddeb11d-b59c-4e1a-8e56-0037fcdd98bd None None] For port 627d2dd9-7b3b-4b20-a4e4-18764ff393f3, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=627d2dd9-7b3b-4b20-a4e4-18764ff393f3,segment=NetworkSegment(a5dc97b2-9efa-4398-bd82-7057a61e12f5),segment_id=a5dc97b2-9efa-4398-bd82-7057a61e12f5)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:32:00.216153 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-bddeb11d-b59c-4e1a-8e56-0037fcdd98bd None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:00.233484 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9448f042-6d21-4906-8dfc-8a793aed2b0d tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:00.239530 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55908) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:00.240304 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-9448f042-6d21-4906-8dfc-8a793aed2b0d tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "DELETE /v2.0/subnets/64bf7731-477c-4c79-a0da-552481e8a442 HTTP/1.1" status: 204 len: 168 time: 1.3004255 Nov 09 04:32:00.243908 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9448f042-6d21-4906-8dfc-8a793aed2b0d tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event deleted for resources: {'Subnet': ['ID=64bf7731-477c-4c79-a0da-552481e8a442,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:00.249663 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eb2967ac-a306-4390-b57a-692bfe3eccaa None None] Network c13d2b06-c5c0-4f58-bc5d-0e00561d7e6f requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:32:00.253379 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-bddeb11d-b59c-4e1a-8e56-0037fcdd98bd None None] Calling delete_port for 627d2dd9-7b3b-4b20-a4e4-18764ff393f3 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:32:00.258862 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2585f7c9-fd00-4925-bb76-d90d5e31d655 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:00.286556 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4972b2e5-dd78-4b8a-88f4-1eb9bd88db20 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-988d2354-693c-4d52-af17-25e0643eaa0c', 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'tenant_id': '8b0758f781884982bf5b94e6609237f6', 'fixed_ips': [{'subnet_id': 'e1e90599-9e6d-4f55-825b-7f5eee66d7b4'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:32:00.287398 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4972b2e5-dd78-4b8a-88f4-1eb9bd88db20 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:00.296259 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2585f7c9-fd00-4925-bb76-d90d5e31d655 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event deleted for resources: {'Port': ['ID=f99ae9c3-073d-4901-bb48-618d8ce40895,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:00.312323 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2585f7c9-fd00-4925-bb76-d90d5e31d655 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] No DVR routers for this DVR port f99ae9c3-073d-4901-bb48-618d8ce40895 on host dv-neutron-816802-2-hyperv {{(pid=102161) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:32:00.325084 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1e90e77e-477b-447c-899a-c278ac56abff tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:32:00.336622 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5fac688b-bcde-400e-ad72-b5b006af1561 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:00.381474 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c3643e3b-473a-4d6a-bbaa-edaa55e1b204 tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:00.381804 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4ebd29bc-cb91-4965-809b-3354a23e970d None None] Sync routers for ids ['215e107d-c97d-47d2-b086-7c223276dc25'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:32:00.399629 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-5fac688b-bcde-400e-ad72-b5b006af1561 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Deleting port 13d0ccda-34e5-4558-864a-b6a3ac214cb5 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:32:00.404214 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5fac688b-bcde-400e-ad72-b5b006af1561 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:00.404214 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dd8fc524-d065-4fea-8b1c-23b6f331c1b3 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:00.430979 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2585f7c9-fd00-4925-bb76-d90d5e31d655 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:00.438402 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d695c52f-375d-4c5c-b444-726a8128d1a2 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:00.455611 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-2585f7c9-fd00-4925-bb76-d90d5e31d655 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f8dfd1cc-6ee7-4112-9ceb-eb2ba064609b']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:00.456134 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4ebd29bc-cb91-4965-809b-3354a23e970d None None] Routers {'215e107d-c97d-47d2-b086-7c223276dc25'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:32:00.456562 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-4ebd29bc-cb91-4965-809b-3354a23e970d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:31:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['215e107d-c97d-47d2-b086-7c223276dc25'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:00.467850 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-2585f7c9-fd00-4925-bb76-d90d5e31d655 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '667f2f48-63ef-4391-830e-9180dff2b93f') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:00.468146 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-2585f7c9-fd00-4925-bb76-d90d5e31d655 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '667f2f48-63ef-4391-830e-9180dff2b93f') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:00.478247 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c3643e3b-473a-4d6a-bbaa-edaa55e1b204 tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:00.482487 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2585f7c9-fd00-4925-bb76-d90d5e31d655 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:00.502862 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2585f7c9-fd00-4925-bb76-d90d5e31d655 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:00.518072 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2585f7c9-fd00-4925-bb76-d90d5e31d655 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Releasing vlan 314 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:32:00.519155 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2585f7c9-fd00-4925-bb76-d90d5e31d655 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:00.520661 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-5fac688b-bcde-400e-ad72-b5b006af1561 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] For port 13d0ccda-34e5-4558-864a-b6a3ac214cb5, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=13d0ccda-34e5-4558-864a-b6a3ac214cb5,segment=NetworkSegment(5de340bc-e914-414a-bf00-93f5a53b7096),segment_id=5de340bc-e914-414a-bf00-93f5a53b7096)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:32:00.521076 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5fac688b-bcde-400e-ad72-b5b006af1561 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:00.522719 dv-neutron-816802-2-hyperv neutron-server[102161]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:32:00.522719 dv-neutron-816802-2-hyperv neutron-server[102161]: self.session.flush() Nov 09 04:32:00.522719 dv-neutron-816802-2-hyperv neutron-server[102161]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:32:00.522719 dv-neutron-816802-2-hyperv neutron-server[102161]: self.session.flush() Nov 09 04:32:00.522719 dv-neutron-816802-2-hyperv neutron-server[102161]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:32:00.522719 dv-neutron-816802-2-hyperv neutron-server[102161]: self.session.flush() Nov 09 04:32:00.522719 dv-neutron-816802-2-hyperv neutron-server[102161]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:32:00.522719 dv-neutron-816802-2-hyperv neutron-server[102161]: self.session.flush() Nov 09 04:32:00.522719 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:32:00.522719 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:32:00.522719 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:32:00.522719 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:32:00.522719 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:32:00.522719 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:32:00.522719 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:32:00.522719 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:32:00.522719 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:32:00.522719 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:32:00.522719 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:32:00.522719 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:32:00.522719 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:32:00.522719 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:32:00.522719 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:32:00.522719 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:32:00.522719 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:32:00.522719 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:32:00.522719 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:32:00.522719 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:32:00.522719 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:32:00.522719 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:32:00.522719 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:32:00.522719 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:32:00.522719 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:32:00.522719 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:32:00.522719 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:32:00.522719 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:32:00.522719 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:32:00.522719 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:32:00.522719 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:32:00.522719 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:32:00.542679 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1e90e77e-477b-447c-899a-c278ac56abff tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:00.546599 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-1e90e77e-477b-447c-899a-c278ac56abff tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 880 time: 6.0050778 Nov 09 04:32:00.561518 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 79262866-3eda-4bfd-a563-a0cf04a76c36 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:32:00.594047 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-4ebd29bc-cb91-4965-809b-3354a23e970d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:00.600444 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55912) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:00.611750 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-5fac688b-bcde-400e-ad72-b5b006af1561 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Calling delete_port for 13d0ccda-34e5-4558-864a-b6a3ac214cb5 owned by network:dhcp {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:32:00.612538 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 79262866-3eda-4bfd-a563-a0cf04a76c36 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:32:00.612769 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 79262866-3eda-4bfd-a563-a0cf04a76c36 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:32:00.613191 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device f99ae9c3-073d-4901-bb48-618d8ce40895 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:32:00.613354 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d695c52f-375d-4c5c-b444-726a8128d1a2 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Pushing event deleted for resources: {'Port': ['ID=627d2dd9-7b3b-4b20-a4e4-18764ff393f3,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:00.615358 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d695c52f-375d-4c5c-b444-726a8128d1a2 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] No DVR routers for this DVR port 627d2dd9-7b3b-4b20-a4e4-18764ff393f3 on host dv-neutron-816802-2-hyperv {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:32:00.657046 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c3643e3b-473a-4d6a-bbaa-edaa55e1b204 tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:00.661254 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-c3643e3b-473a-4d6a-bbaa-edaa55e1b204 tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 720 time: 0.9675200 Nov 09 04:32:00.663574 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55914) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:00.666640 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: f99ae9c3-073d-4901-bb48-618d8ce40895 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:32:00.666788 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device f99ae9c3-073d-4901-bb48-618d8ce40895 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:32:00.676141 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-bddeb11d-b59c-4e1a-8e56-0037fcdd98bd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:00.680088 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4ebd29bc-cb91-4965-809b-3354a23e970d None None] Routers {'215e107d-c97d-47d2-b086-7c223276dc25'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:32:00.680088 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-4ebd29bc-cb91-4965-809b-3354a23e970d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:31:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['215e107d-c97d-47d2-b086-7c223276dc25'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:00.747353 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-4ebd29bc-cb91-4965-809b-3354a23e970d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:00.748035 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4ebd29bc-cb91-4965-809b-3354a23e970d None None] The sync data for ids ['215e107d-c97d-47d2-b086-7c223276dc25'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:32:00.754991 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bddeb11d-b59c-4e1a-8e56-0037fcdd98bd None None] Pushing event deleted for resources: {'Port': ['ID=627d2dd9-7b3b-4b20-a4e4-18764ff393f3,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:00.759863 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bddeb11d-b59c-4e1a-8e56-0037fcdd98bd None None] No DVR routers for this DVR port 627d2dd9-7b3b-4b20-a4e4-18764ff393f3 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:32:00.772623 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-4972b2e5-dd78-4b8a-88f4-1eb9bd88db20 None None] Allocated IP 2001:db8::2 (988d2354-693c-4d52-af17-25e0643eaa0c/e1e90599-9e6d-4f55-825b-7f5eee66d7b4/5b85443d-ddbf-426c-ae60-bb23f1f3f035) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:32:00.778334 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d695c52f-375d-4c5c-b444-726a8128d1a2 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:00.796751 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-dd8fc524-d065-4fea-8b1c-23b6f331c1b3 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:00.822023 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0d5b697a-f584-4fe2-bbd7-8fa63d38f88e tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Publish callbacks [] for router, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:00.828367 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-d695c52f-375d-4c5c-b444-726a8128d1a2 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['40dee9cb-19f2-4ff9-b4f7-f821196139d9']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:00.845337 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-d695c52f-375d-4c5c-b444-726a8128d1a2 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a5dc97b2-9efa-4398-bd82-7057a61e12f5') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:00.845611 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-d695c52f-375d-4c5c-b444-726a8128d1a2 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a5dc97b2-9efa-4398-bd82-7057a61e12f5') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:00.848891 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [None req-dd8fc524-d065-4fea-8b1c-23b6f331c1b3 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] device_id is not set on port 296fa527-86e8-4695-a10c-f0465f5343cd yet. {{(pid=102162) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:32:00.855586 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9e58b12a-e924-4d58-8ddb-a945ab65ecef None None] DHCP port deletion for c13d2b06-c5c0-4f58-bc5d-0e00561d7e6f request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:32:00.864377 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2585f7c9-fd00-4925-bb76-d90d5e31d655 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:00.875121 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d695c52f-375d-4c5c-b444-726a8128d1a2 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:00.902958 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2585f7c9-fd00-4925-bb76-d90d5e31d655 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:00.909773 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-2585f7c9-fd00-4925-bb76-d90d5e31d655 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "DELETE /v2.0/networks/f8dfd1cc-6ee7-4112-9ceb-eb2ba064609b HTTP/1.1" status: 204 len: 168 time: 2.1183429 Nov 09 04:32:00.931388 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55916) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:00.931388 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-f9d5ba1f-9a41-4d0c-87c3-e0e1d66f4e11 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-1323038302'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:00.936538 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2585f7c9-fd00-4925-bb76-d90d5e31d655 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event deleted for resources: {'Network': ['ID=f8dfd1cc-6ee7-4112-9ceb-eb2ba064609b,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:00.947702 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-9d84f8ce-b0bf-4233-b0e8-22566eeb0a57 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "GET /v2.0/routers/215e107d-c97d-47d2-b086-7c223276dc25 HTTP/1.1" status: 200 len: 881 time: 0.3457193 Nov 09 04:32:00.950759 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55920) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:00.954061 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d695c52f-375d-4c5c-b444-726a8128d1a2 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:00.960807 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-9e58b12a-e924-4d58-8ddb-a945ab65ecef None None] Deleting port 13d0ccda-34e5-4558-864a-b6a3ac214cb5 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:32:00.961268 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9e58b12a-e924-4d58-8ddb-a945ab65ecef None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:01.006995 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d695c52f-375d-4c5c-b444-726a8128d1a2 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Releasing vlan 309 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:32:01.007335 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d695c52f-375d-4c5c-b444-726a8128d1a2 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:01.011122 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:32:01.011122 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:32:01.011122 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:32:01.011122 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:32:01.011122 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:32:01.011122 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:32:01.011122 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:32:01.011122 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:32:01.011122 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:32:01.011122 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:32:01.011122 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:32:01.011122 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:32:01.011122 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:32:01.011122 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:32:01.011122 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:32:01.011122 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:32:01.011122 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:32:01.011122 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:32:01.011122 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:32:01.011122 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:32:01.011122 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:32:01.011122 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:32:01.011122 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:32:01.011122 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:32:01.011122 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:32:01.011122 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:32:01.011122 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:32:01.011122 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:32:01.011122 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:32:01.011122 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:32:01.011122 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:32:01.011122 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:32:01.051131 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0d5b697a-f584-4fe2-bbd7-8fa63d38f88e tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:01.053337 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0d5b697a-f584-4fe2-bbd7-8fa63d38f88e tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:01.063617 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-9e58b12a-e924-4d58-8ddb-a945ab65ecef None None] For port 13d0ccda-34e5-4558-864a-b6a3ac214cb5, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=13d0ccda-34e5-4558-864a-b6a3ac214cb5,segment=NetworkSegment(5de340bc-e914-414a-bf00-93f5a53b7096),segment_id=5de340bc-e914-414a-bf00-93f5a53b7096)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:32:01.064017 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9e58b12a-e924-4d58-8ddb-a945ab65ecef None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:01.073375 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4972b2e5-dd78-4b8a-88f4-1eb9bd88db20 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:01.080267 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-9e58b12a-e924-4d58-8ddb-a945ab65ecef None None] Calling delete_port for 13d0ccda-34e5-4558-864a-b6a3ac214cb5 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:32:01.085554 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5fac688b-bcde-400e-ad72-b5b006af1561 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:01.092904 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f9d5ba1f-9a41-4d0c-87c3-e0e1d66f4e11 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Made reservation on behalf of 88f9f8da29bf4a8793b45130d483a6e6 for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:01.096305 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f9d5ba1f-9a41-4d0c-87c3-e0e1d66f4e11 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:01.140708 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fac688b-bcde-400e-ad72-b5b006af1561 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event deleted for resources: {'Port': ['ID=13d0ccda-34e5-4558-864a-b6a3ac214cb5,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:01.149460 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4972b2e5-dd78-4b8a-88f4-1eb9bd88db20 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:01.153930 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5fac688b-bcde-400e-ad72-b5b006af1561 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] No DVR routers for this DVR port 13d0ccda-34e5-4558-864a-b6a3ac214cb5 on host dv-neutron-816802-2-hyperv {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:32:01.183144 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0d5b697a-f584-4fe2-bbd7-8fa63d38f88e tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:01.185267 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0d5b697a-f584-4fe2-bbd7-8fa63d38f88e tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 73bc45ab-2222-4150-9d24-240949c6d6fa {{(pid=102161) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:32:01.192533 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0d5b697a-f584-4fe2-bbd7-8fa63d38f88e tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:01.203470 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-0d5b697a-f584-4fe2-bbd7-8fa63d38f88e tempest-RoutersTestDVR-1214364211 tempest-RoutersTestDVR-1214364211-project-admin] 10.222.0.24 "DELETE /v2.0/routers/73bc45ab-2222-4150-9d24-240949c6d6fa HTTP/1.1" status: 204 len: 168 time: 0.5345275 Nov 09 04:32:01.203470 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f9d5ba1f-9a41-4d0c-87c3-e0e1d66f4e11 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 326} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:32:01.208443 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4972b2e5-dd78-4b8a-88f4-1eb9bd88db20 None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:01.219340 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f9d5ba1f-9a41-4d0c-87c3-e0e1d66f4e11 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:01.219741 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-f9d5ba1f-9a41-4d0c-87c3-e0e1d66f4e11 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Added segment fea13daf-8155-4861-aabe-2f76164307c9 of type vlan for network fc0e205f-0635-4987-822b-ebf9e58e15c0 Nov 09 04:32:01.238902 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-4972b2e5-dd78-4b8a-88f4-1eb9bd88db20 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:01.244235 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4972b2e5-dd78-4b8a-88f4-1eb9bd88db20 None None] Pushing event updated for resources: {'Port': ['ID=5b85443d-ddbf-426c-ae60-bb23f1f3f035,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:01.246253 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d695c52f-375d-4c5c-b444-726a8128d1a2 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:01.248689 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9e58b12a-e924-4d58-8ddb-a945ab65ecef None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:01.266009 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4972b2e5-dd78-4b8a-88f4-1eb9bd88db20 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:32:01.278657 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f9d5ba1f-9a41-4d0c-87c3-e0e1d66f4e11 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:01.288970 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d695c52f-375d-4c5c-b444-726a8128d1a2 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:01.293180 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-d695c52f-375d-4c5c-b444-726a8128d1a2 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] 10.222.0.24 "DELETE /v2.0/networks/40dee9cb-19f2-4ff9-b4f7-f821196139d9 HTTP/1.1" status: 204 len: 168 time: 2.0324504 Nov 09 04:32:01.310056 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9e58b12a-e924-4d58-8ddb-a945ab65ecef None None] No DVR routers for this DVR port 13d0ccda-34e5-4558-864a-b6a3ac214cb5 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:32:01.312114 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e58b12a-e924-4d58-8ddb-a945ab65ecef None None] Pushing event deleted for resources: {'Port': ['ID=13d0ccda-34e5-4558-864a-b6a3ac214cb5,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:01.316106 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5fac688b-bcde-400e-ad72-b5b006af1561 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:01.322986 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d695c52f-375d-4c5c-b444-726a8128d1a2 tempest-NetworksIpV6TestAttrs-314089272 tempest-NetworksIpV6TestAttrs-314089272-project] Pushing event deleted for resources: {'Network': ['ID=40dee9cb-19f2-4ff9-b4f7-f821196139d9,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:01.337311 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-dd8fc524-d065-4fea-8b1c-23b6f331c1b3 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Allocated IP 2001:db8::781d:bb17:1a5a:b769 (988d2354-693c-4d52-af17-25e0643eaa0c/e1e90599-9e6d-4f55-825b-7f5eee66d7b4/296fa527-86e8-4695-a10c-f0465f5343cd) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:32:01.375547 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-4972b2e5-dd78-4b8a-88f4-1eb9bd88db20 None None] Attempting to bind port 5b85443d-ddbf-426c-ae60-bb23f1f3f035 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:32:01.393318 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-4972b2e5-dd78-4b8a-88f4-1eb9bd88db20 None None] Attempting to bind port 5b85443d-ddbf-426c-ae60-bb23f1f3f035 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:32:01.393318 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4972b2e5-dd78-4b8a-88f4-1eb9bd88db20 None None] Attempting to bind port 5b85443d-ddbf-426c-ae60-bb23f1f3f035 on network 988d2354-693c-4d52-af17-25e0643eaa0c {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:32:01.393600 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-5fac688b-bcde-400e-ad72-b5b006af1561 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c13d2b06-c5c0-4f58-bc5d-0e00561d7e6f']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:01.393715 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4972b2e5-dd78-4b8a-88f4-1eb9bd88db20 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 31, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:32:01.393715 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4972b2e5-dd78-4b8a-88f4-1eb9bd88db20 None None] Checking segment: {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:32:01.393715 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4972b2e5-dd78-4b8a-88f4-1eb9bd88db20 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:01.393715 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4972b2e5-dd78-4b8a-88f4-1eb9bd88db20 None None] Bound using segment: {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:32:01.393715 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-4972b2e5-dd78-4b8a-88f4-1eb9bd88db20 None None] Bound port: 5b85443d-ddbf-426c-ae60-bb23f1f3f035, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:32:01.393715 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4972b2e5-dd78-4b8a-88f4-1eb9bd88db20 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:01.415322 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f9d5ba1f-9a41-4d0c-87c3-e0e1d66f4e11 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:01.423316 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f9d5ba1f-9a41-4d0c-87c3-e0e1d66f4e11 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:01.425382 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f9d5ba1f-9a41-4d0c-87c3-e0e1d66f4e11 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:01.427446 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-5fac688b-bcde-400e-ad72-b5b006af1561 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5de340bc-e914-414a-bf00-93f5a53b7096') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:01.427745 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-5fac688b-bcde-400e-ad72-b5b006af1561 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5de340bc-e914-414a-bf00-93f5a53b7096') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:01.457568 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5fac688b-bcde-400e-ad72-b5b006af1561 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:01.457877 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-4972b2e5-dd78-4b8a-88f4-1eb9bd88db20 None None] For port 5b85443d-ddbf-426c-ae60-bb23f1f3f035, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:32:01.461364 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-4972b2e5-dd78-4b8a-88f4-1eb9bd88db20 None None] For port 5b85443d-ddbf-426c-ae60-bb23f1f3f035, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=5b85443d-ddbf-426c-ae60-bb23f1f3f035,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:32:01.497902 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5fac688b-bcde-400e-ad72-b5b006af1561 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:01.499701 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9d5ba1f-9a41-4d0c-87c3-e0e1d66f4e11 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event updated for resources: {'Network': ['ID=fc0e205f-0635-4987-822b-ebf9e58e15c0,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:01.509832 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network fc0e205f-0635-4987-822b-ebf9e58e15c0 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:32:01.532409 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5fac688b-bcde-400e-ad72-b5b006af1561 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Releasing vlan 334 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:32:01.532811 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5fac688b-bcde-400e-ad72-b5b006af1561 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:01.535758 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:32:01.535758 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:32:01.535758 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:32:01.535758 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:32:01.535758 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:32:01.535758 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:32:01.535758 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:32:01.535758 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:32:01.535758 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:32:01.535758 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:32:01.535758 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:32:01.535758 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:32:01.535758 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:32:01.535758 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:32:01.535758 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:32:01.535758 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:32:01.535758 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:32:01.535758 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:32:01.535758 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:32:01.535758 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:32:01.535758 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:32:01.535758 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:32:01.535758 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:32:01.535758 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:32:01.535758 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:32:01.535758 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:32:01.535758 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:32:01.535758 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:32:01.535758 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:32:01.535758 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:32:01.535758 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:32:01.535758 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:32:01.545372 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-f9d5ba1f-9a41-4d0c-87c3-e0e1d66f4e11 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.6206539 Nov 09 04:32:01.548045 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55926) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:01.553796 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-bcbe3f4e-b3af-41a8-9243-228d4c315bbd tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Request body: {'subnet': {'network_id': 'fc0e205f-0635-4987-822b-ebf9e58e15c0', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:01.569137 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4972b2e5-dd78-4b8a-88f4-1eb9bd88db20 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:01.648416 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4972b2e5-dd78-4b8a-88f4-1eb9bd88db20 None None] Pushing event updated for resources: {'Port': ['ID=5b85443d-ddbf-426c-ae60-bb23f1f3f035,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:01.701154 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-777e818e-b55e-4655-8af3-bfb6d6c7b85b tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "GET /v2.0/routers HTTP/1.1" status: 200 len: 884 time: 0.7481077 Nov 09 04:32:01.709194 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55932) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:01.713813 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-dd8fc524-d065-4fea-8b1c-23b6f331c1b3 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:01.717147 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-1d18507e-339b-4d03-a67c-36387aa06ba8 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Request body: {'router': {'name': 'updatedtempest-RoutersTest-router-1303690218'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:01.741266 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5fac688b-bcde-400e-ad72-b5b006af1561 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:01.761082 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5fac688b-bcde-400e-ad72-b5b006af1561 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:01.765518 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-5fac688b-bcde-400e-ad72-b5b006af1561 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "DELETE /v2.0/networks/c13d2b06-c5c0-4f58-bc5d-0e00561d7e6f HTTP/1.1" status: 204 len: 168 time: 1.5249262 Nov 09 04:32:01.776323 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55934) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:01.784170 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-8390dd89-e70c-4384-8534-1602316f04c6 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-1835038200'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:01.795878 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fac688b-bcde-400e-ad72-b5b006af1561 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event deleted for resources: {'Network': ['ID=c13d2b06-c5c0-4f58-bc5d-0e00561d7e6f,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:01.838056 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bcbe3f4e-b3af-41a8-9243-228d4c315bbd tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Made reservation on behalf of 88f9f8da29bf4a8793b45130d483a6e6 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:01.843492 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bcbe3f4e-b3af-41a8-9243-228d4c315bbd tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:01.858069 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 627d2dd9-7b3b-4b20-a4e4-18764ff393f3 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:32:01.889424 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 627d2dd9-7b3b-4b20-a4e4-18764ff393f3 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:32:01.890034 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 627d2dd9-7b3b-4b20-a4e4-18764ff393f3 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:32:01.890704 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 13d0ccda-34e5-4558-864a-b6a3ac214cb5 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:32:01.897429 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-dd8fc524-d065-4fea-8b1c-23b6f331c1b3 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:01.920011 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 13d0ccda-34e5-4558-864a-b6a3ac214cb5 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:32:01.920728 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 13d0ccda-34e5-4558-864a-b6a3ac214cb5 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:32:01.970796 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55940) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:01.976600 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55942) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:01.980604 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8390dd89-e70c-4384-8534-1602316f04c6 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Made reservation on behalf of 12e47d8445b5429892cd1b9244512ca8 for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:01.980853 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8390dd89-e70c-4384-8534-1602316f04c6 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:02.038614 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd8fc524-d065-4fea-8b1c-23b6f331c1b3 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Port': ['ID=296fa527-86e8-4695-a10c-f0465f5343cd,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:02.049040 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dd8fc524-d065-4fea-8b1c-23b6f331c1b3 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:02.052619 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-dd8fc524-d065-4fea-8b1c-23b6f331c1b3 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:02.056672 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dd8fc524-d065-4fea-8b1c-23b6f331c1b3 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:32:02.062726 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dd8fc524-d065-4fea-8b1c-23b6f331c1b3 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:02.063375 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-dd8fc524-d065-4fea-8b1c-23b6f331c1b3 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:02.071730 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8390dd89-e70c-4384-8534-1602316f04c6 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 320} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:32:02.090673 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8390dd89-e70c-4384-8534-1602316f04c6 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:02.090959 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-8390dd89-e70c-4384-8534-1602316f04c6 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Added segment f1691606-ae5e-41a8-8c56-8eaae5cd581f of type vlan for network fb1e2ac5-e13c-42f7-b9fd-cb0de04d8c8f Nov 09 04:32:02.145469 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0d2b480-3d2f-4c92-bcb5-628ebb161da8 req-9b0f3d9b-e747-43ed-9bd6-69001ae8d837 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:02.148619 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b0d2b480-3d2f-4c92-bcb5-628ebb161da8 req-9b0f3d9b-e747-43ed-9bd6-69001ae8d837 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 945 time: 0.2454236 Nov 09 04:32:02.326721 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b0d2b480-3d2f-4c92-bcb5-628ebb161da8 req-a15fae8d-885b-4fb6-82d9-726a6aee9e98 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1690552 Nov 09 04:32:02.446611 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-dd8fc524-d065-4fea-8b1c-23b6f331c1b3 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 948 time: 2.4960678 Nov 09 04:32:02.457317 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55950) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:02.468476 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-5cda9903-c3da-4db6-b173-0ef1a4cd24f0 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'port': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'fixed_ips': [{'subnet_id': 'e1e90599-9e6d-4f55-825b-7f5eee66d7b4', 'ip_address': '2001:db8::781d:bb17:1a5a:b769'}], 'name': 'tempest-NetworksTestDHCPv6-1388617987'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:02.475849 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ec23bd86-6fcd-4993-86bd-1f0b3199bedb admin admin] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:02.486393 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1d18507e-339b-4d03-a67c-36387aa06ba8 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-466202', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-464271', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-936'] for router, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:02.488105 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8390dd89-e70c-4384-8534-1602316f04c6 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:02.491670 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bcbe3f4e-b3af-41a8-9243-228d4c315bbd tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:02.566726 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bcbe3f4e-b3af-41a8-9243-228d4c315bbd tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event updated for resources: {'Subnet': ['ID=7e4bed86-250f-46a6-8bf4-3eef8c055b29,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:02.580214 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1d18507e-339b-4d03-a67c-36387aa06ba8 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-466195', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-466408', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-464260'] for router, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:02.584886 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bcbe3f4e-b3af-41a8-9243-228d4c315bbd tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Checking segment: {'id': 'fea13daf-8155-4861-aabe-2f76164307c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 326, 'network_id': 'fc0e205f-0635-4987-822b-ebf9e58e15c0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:32:02.585289 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bcbe3f4e-b3af-41a8-9243-228d4c315bbd tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Network hostable DHCP agents. Network: fc0e205f-0635-4987-822b-ebf9e58e15c0, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:32:02.602597 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-0d02d53c-c60c-4ca0-9072-12c333b87ef3 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=6acf678d74da4512a431e262bbd32037&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5797935 Nov 09 04:32:02.606993 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55952) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:02.680753 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8390dd89-e70c-4384-8534-1602316f04c6 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:02.686977 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8390dd89-e70c-4384-8534-1602316f04c6 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:02.687579 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8390dd89-e70c-4384-8534-1602316f04c6 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:02.716199 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1d18507e-339b-4d03-a67c-36387aa06ba8 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Router 215e107d-c97d-47d2-b086-7c223276dc25 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:32:02.774596 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bcbe3f4e-b3af-41a8-9243-228d4c315bbd tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Network fc0e205f-0635-4987-822b-ebf9e58e15c0 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:32:02.822143 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1fc344eb-cdf3-45eb-b912-3f707bc2c7bd admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:02.824978 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ec23bd86-6fcd-4993-86bd-1f0b3199bedb admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:02.827171 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8390dd89-e70c-4384-8534-1602316f04c6 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event updated for resources: {'Network': ['ID=fb1e2ac5-e13c-42f7-b9fd-cb0de04d8c8f,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:02.840711 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network fb1e2ac5-e13c-42f7-b9fd-cb0de04d8c8f details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:32:02.862112 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1fc344eb-cdf3-45eb-b912-3f707bc2c7bd admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:02.881573 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61633ae9-67a1-4113-9b96-ae2aca33b4ab req-9ae12752-c6d0-4f48-9117-e1250372a5a4 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:02.883178 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-61633ae9-67a1-4113-9b96-ae2aca33b4ab req-9ae12752-c6d0-4f48-9117-e1250372a5a4 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 945 time: 0.1122971 Nov 09 04:32:02.890336 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1d18507e-339b-4d03-a67c-36387aa06ba8 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:32:02.898648 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1d18507e-339b-4d03-a67c-36387aa06ba8 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:02.902865 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d8d5d2cb-ec63-44ea-aa4f-346a37ef184a None None] Sync routers for ids ['215e107d-c97d-47d2-b086-7c223276dc25'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:32:02.904583 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1d18507e-339b-4d03-a67c-36387aa06ba8 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "PUT /v2.0/routers/215e107d-c97d-47d2-b086-7c223276dc25 HTTP/1.1" status: 200 len: 888 time: 1.1947644 Nov 09 04:32:02.905274 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55956) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:02.916213 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d8d5d2cb-ec63-44ea-aa4f-346a37ef184a None None] Routers {'215e107d-c97d-47d2-b086-7c223276dc25'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:32:02.920948 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-d8d5d2cb-ec63-44ea-aa4f-346a37ef184a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:31:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['215e107d-c97d-47d2-b086-7c223276dc25'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:02.935482 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5cda9903-c3da-4db6-b173-0ef1a4cd24f0 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:02.943012 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5cda9903-c3da-4db6-b173-0ef1a4cd24f0 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:02.959690 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ec23bd86-6fcd-4993-86bd-1f0b3199bedb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:02.966049 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-bcbe3f4e-b3af-41a8-9243-228d4c315bbd tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, fc0e205f-0635-4987-822b-ebf9e58e15c0) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:02.971500 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bcbe3f4e-b3af-41a8-9243-228d4c315bbd tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:02.972877 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bcbe3f4e-b3af-41a8-9243-228d4c315bbd tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:02.983566 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b2f3d3ae-b7e6-4ae2-b611-189e80c3f96f None None] Network fc0e205f-0635-4987-822b-ebf9e58e15c0 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:32:02.984755 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-d8d5d2cb-ec63-44ea-aa4f-346a37ef184a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:02.996154 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d8d5d2cb-ec63-44ea-aa4f-346a37ef184a None None] Routers {'215e107d-c97d-47d2-b086-7c223276dc25'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:32:02.996725 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-d8d5d2cb-ec63-44ea-aa4f-346a37ef184a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:31:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['215e107d-c97d-47d2-b086-7c223276dc25'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:03.023056 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-ec23bd86-6fcd-4993-86bd-1f0b3199bedb admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=2b8533cbd8a546068ed7e0599e43eff7&name=default HTTP/1.1" status: 200 len: 2996 time: 1.0495791 Nov 09 04:32:03.023056 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec23bd86-6fcd-4993-86bd-1f0b3199bedb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ff932d3d-eade-4f03-b327-8d87aeca6767,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:03.029730 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-8390dd89-e70c-4384-8534-1602316f04c6 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 1.2488902 Nov 09 04:32:03.029730 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55958) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:03.033976 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55960) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:03.042964 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1fc344eb-cdf3-45eb-b912-3f707bc2c7bd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:03.046062 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1fc344eb-cdf3-45eb-b912-3f707bc2c7bd admin admin] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:03.055719 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-d8d5d2cb-ec63-44ea-aa4f-346a37ef184a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:03.055719 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d8d5d2cb-ec63-44ea-aa4f-346a37ef184a None None] The sync data for ids ['215e107d-c97d-47d2-b086-7c223276dc25'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:32:03.061224 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-1fc344eb-cdf3-45eb-b912-3f707bc2c7bd admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/2daac299-4729-4f4d-a9da-781f03c02e4c HTTP/1.1" status: 204 len: 168 time: 0.4367814 Nov 09 04:32:03.065303 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-5740ddc2-f202-47ac-b222-654e4617f1b8 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Request body: {'subnet': {'network_id': 'fb1e2ac5-e13c-42f7-b9fd-cb0de04d8c8f', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:03.078261 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [None req-5cda9903-c3da-4db6-b173-0ef1a4cd24f0 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] device_id is not set on port 757d210f-649e-48ee-9ec5-e437544712ab yet. {{(pid=102162) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:32:03.093131 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-61633ae9-67a1-4113-9b96-ae2aca33b4ab req-bdd5f58a-82d1-4ca6-ada0-3887169a2ca2 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1867454 Nov 09 04:32:03.121847 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-8c99bcad-425c-4005-9f49-5460f521be57 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "GET /v2.0/routers/215e107d-c97d-47d2-b086-7c223276dc25 HTTP/1.1" status: 200 len: 888 time: 0.2142022 Nov 09 04:32:03.123006 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55966) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:03.143817 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fc344eb-cdf3-45eb-b912-3f707bc2c7bd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2daac299-4729-4f4d-a9da-781f03c02e4c,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:03.156615 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-063802fb-55dd-421b-996c-0773e7bfdd5a tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "GET /v2.0/ports?device_id=215e107d-c97d-47d2-b086-7c223276dc25 HTTP/1.1" status: 200 len: 205 time: 0.0323980 Nov 09 04:32:03.157738 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55968) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:03.166921 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-bcbe3f4e-b3af-41a8-9243-228d4c315bbd tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.6174572 Nov 09 04:32:03.177376 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55970) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:03.251082 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-358d81af-ad67-417d-a393-11390cec9bf6 None None] Provisioning complete for port 5b85443d-ddbf-426c-ae60-bb23f1f3f035 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:03.251450 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-358d81af-ad67-417d-a393-11390cec9bf6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:03.283863 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-a725426b-4a7a-4b8c-9dc0-d609ea41c619 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Request body: {'router': {'name': 'tempest-PortsTestJSON-router-1643501727', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:03.298079 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aababaf7-4916-448b-ae1b-2e80a44204df None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-fc0e205f-0635-4987-822b-ebf9e58e15c0', 'network_id': 'fc0e205f-0635-4987-822b-ebf9e58e15c0', 'tenant_id': '88f9f8da29bf4a8793b45130d483a6e6', 'fixed_ips': [{'subnet_id': '7e4bed86-250f-46a6-8bf4-3eef8c055b29'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:32:03.298953 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-aababaf7-4916-448b-ae1b-2e80a44204df None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:03.331361 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0d6fb521-f884-41f2-bd6c-4fc31d4f697a tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for router, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:03.502222 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-631a9224-12fd-4b36-b001-1a83b0633165 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:03.541283 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-aababaf7-4916-448b-ae1b-2e80a44204df None None] Allocated IP 172.20.0.2 (fc0e205f-0635-4987-822b-ebf9e58e15c0/7e4bed86-250f-46a6-8bf4-3eef8c055b29/105ad6c8-270b-4e0c-8982-38119be4eea7) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:32:03.580431 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-631a9224-12fd-4b36-b001-1a83b0633165 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:03.580431 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a725426b-4a7a-4b8c-9dc0-d609ea41c619 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:03.580431 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a725426b-4a7a-4b8c-9dc0-d609ea41c619 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:03.696993 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5740ddc2-f202-47ac-b222-654e4617f1b8 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Made reservation on behalf of 12e47d8445b5429892cd1b9244512ca8 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:03.701441 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5740ddc2-f202-47ac-b222-654e4617f1b8 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:03.705107 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-5cda9903-c3da-4db6-b173-0ef1a4cd24f0 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] POST failed (client error): There was a conflict when trying to complete your request. Nov 09 04:32:03.705631 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5cda9903-c3da-4db6-b173-0ef1a4cd24f0 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 409 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:32:03.726632 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a725426b-4a7a-4b8c-9dc0-d609ea41c619 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:03.736066 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-358d81af-ad67-417d-a393-11390cec9bf6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:03.807002 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a725426b-4a7a-4b8c-9dc0-d609ea41c619 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:03.838885 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0d6fb521-f884-41f2-bd6c-4fc31d4f697a tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for router_gateway, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:03.910305 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-5cda9903-c3da-4db6-b173-0ef1a4cd24f0 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 409 len: 389 time: 1.4453855 Nov 09 04:32:03.911195 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55986) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:03.962531 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dfa38e0a-503c-4415-8826-6d4ed05f5a53 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:03.967689 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 5b85443d-ddbf-426c-ae60-bb23f1f3f035 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:32:03.970142 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dfa38e0a-503c-4415-8826-6d4ed05f5a53 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:03.972927 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-dfa38e0a-503c-4415-8826-6d4ed05f5a53 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1685 time: 0.0610776 Nov 09 04:32:03.976063 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 55988) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:03.997274 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-631a9224-12fd-4b36-b001-1a83b0633165 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:04.002861 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-631a9224-12fd-4b36-b001-1a83b0633165 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:04.005076 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-631a9224-12fd-4b36-b001-1a83b0633165 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/ff932d3d-eade-4f03-b327-8d87aeca6767 HTTP/1.1" status: 204 len: 168 time: 0.9713688 Nov 09 04:32:04.038945 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-358d81af-ad67-417d-a393-11390cec9bf6 None None] For port 5b85443d-ddbf-426c-ae60-bb23f1f3f035, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=5b85443d-ddbf-426c-ae60-bb23f1f3f035,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:32:04.040840 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a725426b-4a7a-4b8c-9dc0-d609ea41c619 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:04.043406 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a725426b-4a7a-4b8c-9dc0-d609ea41c619 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 702 time: 0.8565812 Nov 09 04:32:04.048441 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 55996) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:04.069569 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-0d6fb521-f884-41f2-bd6c-4fc31d4f697a tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Deleting port feafe305-1bba-4f69-ad09-d2015efadb82 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:32:04.070035 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0d6fb521-f884-41f2-bd6c-4fc31d4f697a tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:04.075078 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-631a9224-12fd-4b36-b001-1a83b0633165 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ff932d3d-eade-4f03-b327-8d87aeca6767,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:04.095468 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-1e905559-c4cd-436d-9d8e-3bc9d203ec9e tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Request body: {'port': {'network_id': 'fc0e205f-0635-4987-822b-ebf9e58e15c0', 'name': 'tempest-PortsTestJSON-96616905'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:04.142390 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-358d81af-ad67-417d-a393-11390cec9bf6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:04.213268 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-aababaf7-4916-448b-ae1b-2e80a44204df None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:04.287785 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-939bea39-48bc-479e-b1f0-18ac10f15c42 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Deleting port 296fa527-86e8-4695-a10c-f0465f5343cd {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:32:04.288310 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-aababaf7-4916-448b-ae1b-2e80a44204df None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:04.288751 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-939bea39-48bc-479e-b1f0-18ac10f15c42 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:04.300054 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 5b85443d-ddbf-426c-ae60-bb23f1f3f035 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:04.306818 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:04.306818 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-358d81af-ad67-417d-a393-11390cec9bf6 None None] Pushing event updated for resources: {'Port': ['ID=5b85443d-ddbf-426c-ae60-bb23f1f3f035,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:04.335884 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aababaf7-4916-448b-ae1b-2e80a44204df None None] Network fc0e205f-0635-4987-822b-ebf9e58e15c0 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:04.359921 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-aababaf7-4916-448b-ae1b-2e80a44204df None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:04.360155 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5d6221d-ca8d-4df6-9df1-cf548139778e req-187eb807-c5cc-4e99-a0b8-fd773d3f69c9 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:04.361736 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d5d6221d-ca8d-4df6-9df1-cf548139778e req-187eb807-c5cc-4e99-a0b8-fd773d3f69c9 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 945 time: 0.1944015 Nov 09 04:32:04.362582 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aababaf7-4916-448b-ae1b-2e80a44204df None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:32:04.374468 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-b5e78a5b-d8ff-4ca2-94bb-d7bf16db6657 None None] Provisioning complete for port 296fa527-86e8-4695-a10c-f0465f5343cd triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:04.380502 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b5e78a5b-d8ff-4ca2-94bb-d7bf16db6657 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:04.407852 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0d6fb521-f884-41f2-bd6c-4fc31d4f697a tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:04.429428 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56006) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:04.443101 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-0d6fb521-f884-41f2-bd6c-4fc31d4f697a tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Calling delete_port for feafe305-1bba-4f69-ad09-d2015efadb82 owned by network:router_gateway {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:32:04.469465 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aababaf7-4916-448b-ae1b-2e80a44204df None None] Pushing event updated for resources: {'Port': ['ID=105ad6c8-270b-4e0c-8982-38119be4eea7,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:04.482269 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d5d6221d-ca8d-4df6-9df1-cf548139778e req-4ec3be8c-9cc9-4f82-be9c-b67ef21d999c tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1023092 Nov 09 04:32:04.504737 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-939bea39-48bc-479e-b1f0-18ac10f15c42 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:04.526173 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-b5e78a5b-d8ff-4ca2-94bb-d7bf16db6657 None None] Port 296fa527-86e8-4695-a10c-f0465f5343cd cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:32:04.526779 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-939bea39-48bc-479e-b1f0-18ac10f15c42 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Calling delete_port for 296fa527-86e8-4695-a10c-f0465f5343cd owned by {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:32:04.545039 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-aababaf7-4916-448b-ae1b-2e80a44204df None None] Attempting to bind port 105ad6c8-270b-4e0c-8982-38119be4eea7 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:32:04.545291 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-aababaf7-4916-448b-ae1b-2e80a44204df None None] Attempting to bind port 105ad6c8-270b-4e0c-8982-38119be4eea7 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'fea13daf-8155-4861-aabe-2f76164307c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 326, 'network_id': 'fc0e205f-0635-4987-822b-ebf9e58e15c0'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:32:04.545563 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aababaf7-4916-448b-ae1b-2e80a44204df None None] Attempting to bind port 105ad6c8-270b-4e0c-8982-38119be4eea7 on network fc0e205f-0635-4987-822b-ebf9e58e15c0 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:32:04.572449 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aababaf7-4916-448b-ae1b-2e80a44204df None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 31, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:32:04.572990 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aababaf7-4916-448b-ae1b-2e80a44204df None None] Checking segment: {'id': 'fea13daf-8155-4861-aabe-2f76164307c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 326, 'network_id': 'fc0e205f-0635-4987-822b-ebf9e58e15c0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:32:04.574191 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-aababaf7-4916-448b-ae1b-2e80a44204df None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:04.574798 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aababaf7-4916-448b-ae1b-2e80a44204df None None] Bound using segment: {'id': 'fea13daf-8155-4861-aabe-2f76164307c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 326, 'network_id': 'fc0e205f-0635-4987-822b-ebf9e58e15c0'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:32:04.575438 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-aababaf7-4916-448b-ae1b-2e80a44204df None None] Bound port: 105ad6c8-270b-4e0c-8982-38119be4eea7, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fea13daf-8155-4861-aabe-2f76164307c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 326, 'network_id': 'fc0e205f-0635-4987-822b-ebf9e58e15c0'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:32:04.575989 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-aababaf7-4916-448b-ae1b-2e80a44204df None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:04.602945 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5740ddc2-f202-47ac-b222-654e4617f1b8 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:04.612094 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-2ccf33ae-1d71-426c-8b47-4702de2b2d3c tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Request body: {'router': {'name': 'tempest-RoutersNegativeTest-router-485547612', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:04.619143 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1e905559-c4cd-436d-9d8e-3bc9d203ec9e tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Made reservation on behalf of 88f9f8da29bf4a8793b45130d483a6e6 for: {'port': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:04.623174 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1e905559-c4cd-436d-9d8e-3bc9d203ec9e tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:04.661726 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [None req-1e905559-c4cd-436d-9d8e-3bc9d203ec9e tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] device_id is not set on port ce0ce71c-3b39-43c6-918b-56098eb9c226 yet. {{(pid=102161) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:32:04.681414 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5740ddc2-f202-47ac-b222-654e4617f1b8 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event updated for resources: {'Subnet': ['ID=2daa3dbc-869c-4c7e-a5ab-08b0680089b6,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:04.707690 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-aababaf7-4916-448b-ae1b-2e80a44204df None None] For port 105ad6c8-270b-4e0c-8982-38119be4eea7, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:32:04.711203 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-aababaf7-4916-448b-ae1b-2e80a44204df None None] For port 105ad6c8-270b-4e0c-8982-38119be4eea7, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=105ad6c8-270b-4e0c-8982-38119be4eea7,segment=NetworkSegment(fea13daf-8155-4861-aabe-2f76164307c9),segment_id=fea13daf-8155-4861-aabe-2f76164307c9)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:32:04.729092 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5740ddc2-f202-47ac-b222-654e4617f1b8 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Checking segment: {'id': 'f1691606-ae5e-41a8-8c56-8eaae5cd581f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 320, 'network_id': 'fb1e2ac5-e13c-42f7-b9fd-cb0de04d8c8f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:32:04.729457 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5740ddc2-f202-47ac-b222-654e4617f1b8 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Network hostable DHCP agents. Network: fb1e2ac5-e13c-42f7-b9fd-cb0de04d8c8f, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:32:04.734158 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2ccf33ae-1d71-426c-8b47-4702de2b2d3c tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:04.735211 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2ccf33ae-1d71-426c-8b47-4702de2b2d3c tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:04.795114 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-aababaf7-4916-448b-ae1b-2e80a44204df None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:04.823948 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5740ddc2-f202-47ac-b222-654e4617f1b8 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Network fb1e2ac5-e13c-42f7-b9fd-cb0de04d8c8f is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:32:04.827073 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-939bea39-48bc-479e-b1f0-18ac10f15c42 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:04.853869 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2ccf33ae-1d71-426c-8b47-4702de2b2d3c tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:04.861663 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-939bea39-48bc-479e-b1f0-18ac10f15c42 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event deleted for resources: {'Port': ['ID=296fa527-86e8-4695-a10c-f0465f5343cd,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:04.874348 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-1e905559-c4cd-436d-9d8e-3bc9d203ec9e tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Allocated IP 172.20.0.11 (fc0e205f-0635-4987-822b-ebf9e58e15c0/7e4bed86-250f-46a6-8bf4-3eef8c055b29/ce0ce71c-3b39-43c6-918b-56098eb9c226) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:32:04.878947 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aababaf7-4916-448b-ae1b-2e80a44204df None None] Pushing event updated for resources: {'Port': ['ID=105ad6c8-270b-4e0c-8982-38119be4eea7,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:04.909424 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-939bea39-48bc-479e-b1f0-18ac10f15c42 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:04.913022 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-939bea39-48bc-479e-b1f0-18ac10f15c42 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/ports/296fa527-86e8-4695-a10c-f0465f5343cd HTTP/1.1" status: 204 len: 168 time: 0.9358690 Nov 09 04:32:04.913702 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56012) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:04.917408 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56014) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:04.930591 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9e0e9a2c-8687-4269-850d-0f2dc1ba15a7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:04.950704 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-5740ddc2-f202-47ac-b222-654e4617f1b8 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, fb1e2ac5-e13c-42f7-b9fd-cb0de04d8c8f) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:04.957112 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5740ddc2-f202-47ac-b222-654e4617f1b8 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:04.957574 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5740ddc2-f202-47ac-b222-654e4617f1b8 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:04.959430 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4c66d6c6-9312-419d-a83e-811e16aba96c None None] Network fb1e2ac5-e13c-42f7-b9fd-cb0de04d8c8f requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:32:04.988991 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0d6fb521-f884-41f2-bd6c-4fc31d4f697a tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:05.046592 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9e0e9a2c-8687-4269-850d-0f2dc1ba15a7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:05.078165 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2ccf33ae-1d71-426c-8b47-4702de2b2d3c tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:05.095975 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-5740ddc2-f202-47ac-b222-654e4617f1b8 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 2.0523667 Nov 09 04:32:05.097370 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56016) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:05.098522 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d6fb521-f884-41f2-bd6c-4fc31d4f697a tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event deleted for resources: {'Port': ['ID=feafe305-1bba-4f69-ad09-d2015efadb82,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:05.122012 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-8235876b-3c78-4329-98b1-aa117883504b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Request body: {'port': {'network_id': 'fb1e2ac5-e13c-42f7-b9fd-cb0de04d8c8f', 'security_groups': [], 'name': 'tempest-PortsIpV6TestJSON-1163693188'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:05.137677 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d953d37c-72aa-4639-b505-39d07e37dc51 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:05.139425 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d953d37c-72aa-4639-b505-39d07e37dc51 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:05.141123 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-d953d37c-72aa-4639-b505-39d07e37dc51 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1477 time: 0.2227569 Nov 09 04:32:05.154623 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56018) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:05.159644 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9e0e9a2c-8687-4269-850d-0f2dc1ba15a7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:05.218740 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e4b22f7e-87f2-431d-ae77-e6174b0a5b22 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-fb1e2ac5-e13c-42f7-b9fd-cb0de04d8c8f', 'network_id': 'fb1e2ac5-e13c-42f7-b9fd-cb0de04d8c8f', 'tenant_id': '12e47d8445b5429892cd1b9244512ca8', 'fixed_ips': [{'subnet_id': '2daa3dbc-869c-4c7e-a5ab-08b0680089b6'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:32:05.219608 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e4b22f7e-87f2-431d-ae77-e6174b0a5b22 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:05.235241 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2ccf33ae-1d71-426c-8b47-4702de2b2d3c tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:05.238141 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-2ccf33ae-1d71-426c-8b47-4702de2b2d3c tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 707 time: 0.8031275 Nov 09 04:32:05.242941 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56020) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:05.286327 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-50fc13ae-6b29-417c-a74e-6cff6faa7757 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Request body: {'network': {'name': 'tempest-RoutersNegativeTest-test-network-1346316286'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:05.313078 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e0e9a2c-8687-4269-850d-0f2dc1ba15a7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=88828d03-5fa8-4762-b2b8-367eb0629d5f,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:05.326604 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0d6fb521-f884-41f2-bd6c-4fc31d4f697a tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-466373'] for router_gateway, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:05.339752 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-9e0e9a2c-8687-4269-850d-0f2dc1ba15a7 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=698356887b684c7ea356487e0e19581a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4245341 Nov 09 04:32:05.348244 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56022) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:05.392329 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-5c4f40eb-52c7-4bc5-bda2-a70e23cb65c8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Deleting subnet e1e90599-9e6d-4f55-825b-7f5eee66d7b4 {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:32:05.411978 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-e4b22f7e-87f2-431d-ae77-e6174b0a5b22 None None] Allocated IP 2001:db8::2 (fb1e2ac5-e13c-42f7-b9fd-cb0de04d8c8f/2daa3dbc-869c-4c7e-a5ab-08b0680089b6/3999190d-ff35-4862-8f22-536238ca30c6) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:32:05.413270 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5c4f40eb-52c7-4bc5-bda2-a70e23cb65c8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:05.450773 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0d6fb521-f884-41f2-bd6c-4fc31d4f697a tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:05.454153 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0d6fb521-f884-41f2-bd6c-4fc31d4f697a tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:05.487690 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5c4f40eb-52c7-4bc5-bda2-a70e23cb65c8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:05.502821 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1e905559-c4cd-436d-9d8e-3bc9d203ec9e tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:05.512016 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1e15f917-182d-46b0-a70d-d799540a8835 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:05.516871 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-50fc13ae-6b29-417c-a74e-6cff6faa7757 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Made reservation on behalf of d84cfa063d124c7aaef56e163790a6eb for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:05.520963 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-50fc13ae-6b29-417c-a74e-6cff6faa7757 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:05.563502 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1e15f917-182d-46b0-a70d-d799540a8835 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:05.568159 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-50fc13ae-6b29-417c-a74e-6cff6faa7757 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:05.572559 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0d6fb521-f884-41f2-bd6c-4fc31d4f697a tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:05.574012 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0d6fb521-f884-41f2-bd6c-4fc31d4f697a tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Fanout notify agent at l3_agent the message router_deleted on router 215e107d-c97d-47d2-b086-7c223276dc25 {{(pid=102161) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:32:05.585063 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e4b22f7e-87f2-431d-ae77-e6174b0a5b22 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:05.587857 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0d6fb521-f884-41f2-bd6c-4fc31d4f697a tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:05.592890 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-0d6fb521-f884-41f2-bd6c-4fc31d4f697a tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "DELETE /v2.0/routers/215e107d-c97d-47d2-b086-7c223276dc25 HTTP/1.1" status: 204 len: 168 time: 2.4302287 Nov 09 04:32:05.596491 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56026) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:05.604279 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-378be0f1-9b30-499b-8e25-bd9fdbcc6c84 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Request body: {'network': {'name': 'tempest-RoutersTest-660738380'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:05.649840 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8235876b-3c78-4329-98b1-aa117883504b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Made reservation on behalf of 12e47d8445b5429892cd1b9244512ca8 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:05.653568 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1e905559-c4cd-436d-9d8e-3bc9d203ec9e tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:05.653743 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e4b22f7e-87f2-431d-ae77-e6174b0a5b22 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:05.653944 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8235876b-3c78-4329-98b1-aa117883504b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:05.692663 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5c4f40eb-52c7-4bc5-bda2-a70e23cb65c8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:05.696480 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [None req-8235876b-3c78-4329-98b1-aa117883504b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] device_id is not set on port a6125eab-1cdb-4c29-9aa5-fadf6122f492 yet. {{(pid=102162) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:32:05.717044 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-378be0f1-9b30-499b-8e25-bd9fdbcc6c84 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Made reservation on behalf of 188f23ef0cb54006875c672b78f5249f for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:05.721184 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e4b22f7e-87f2-431d-ae77-e6174b0a5b22 None None] Network fb1e2ac5-e13c-42f7-b9fd-cb0de04d8c8f is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:05.724487 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-e4b22f7e-87f2-431d-ae77-e6174b0a5b22 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:05.725578 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-378be0f1-9b30-499b-8e25-bd9fdbcc6c84 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:05.728998 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4b22f7e-87f2-431d-ae77-e6174b0a5b22 None None] Pushing event updated for resources: {'Port': ['ID=3999190d-ff35-4862-8f22-536238ca30c6,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:05.732156 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e4b22f7e-87f2-431d-ae77-e6174b0a5b22 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:32:05.740064 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e905559-c4cd-436d-9d8e-3bc9d203ec9e tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event updated for resources: {'Port': ['ID=ce0ce71c-3b39-43c6-918b-56098eb9c226,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:05.749881 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f65db961-985f-4a9b-9b3c-1e8cd983f753 req-58cbbddf-7a9a-4864-b27f-e839fce62a91 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:05.752688 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f65db961-985f-4a9b-9b3c-1e8cd983f753 req-58cbbddf-7a9a-4864-b27f-e839fce62a91 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 945 time: 0.1759663 Nov 09 04:32:05.752966 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1e905559-c4cd-436d-9d8e-3bc9d203ec9e tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Network fc0e205f-0635-4987-822b-ebf9e58e15c0 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:05.761502 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-1e905559-c4cd-436d-9d8e-3bc9d203ec9e tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:05.765847 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1e905559-c4cd-436d-9d8e-3bc9d203ec9e tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:32:05.833779 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-50fc13ae-6b29-417c-a74e-6cff6faa7757 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:05.833876 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1e15f917-182d-46b0-a70d-d799540a8835 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:05.833960 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1e15f917-182d-46b0-a70d-d799540a8835 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:05.838117 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-1e15f917-182d-46b0-a70d-d799540a8835 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/88828d03-5fa8-4762-b2b8-367eb0629d5f HTTP/1.1" status: 204 len: 168 time: 0.4860651 Nov 09 04:32:05.851973 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-e4b22f7e-87f2-431d-ae77-e6174b0a5b22 None None] Attempting to bind port 3999190d-ff35-4862-8f22-536238ca30c6 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:32:05.852346 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-e4b22f7e-87f2-431d-ae77-e6174b0a5b22 None None] Attempting to bind port 3999190d-ff35-4862-8f22-536238ca30c6 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'f1691606-ae5e-41a8-8c56-8eaae5cd581f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 320, 'network_id': 'fb1e2ac5-e13c-42f7-b9fd-cb0de04d8c8f'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:32:05.852793 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e4b22f7e-87f2-431d-ae77-e6174b0a5b22 None None] Attempting to bind port 3999190d-ff35-4862-8f22-536238ca30c6 on network fb1e2ac5-e13c-42f7-b9fd-cb0de04d8c8f {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:32:05.856866 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-378be0f1-9b30-499b-8e25-bd9fdbcc6c84 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 331} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:32:05.865330 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e4b22f7e-87f2-431d-ae77-e6174b0a5b22 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 31, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:32:05.865752 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e4b22f7e-87f2-431d-ae77-e6174b0a5b22 None None] Checking segment: {'id': 'f1691606-ae5e-41a8-8c56-8eaae5cd581f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 320, 'network_id': 'fb1e2ac5-e13c-42f7-b9fd-cb0de04d8c8f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:32:05.878186 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e15f917-182d-46b0-a70d-d799540a8835 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=88828d03-5fa8-4762-b2b8-367eb0629d5f,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:05.887377 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e4b22f7e-87f2-431d-ae77-e6174b0a5b22 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:05.887808 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e4b22f7e-87f2-431d-ae77-e6174b0a5b22 None None] Bound using segment: {'id': 'f1691606-ae5e-41a8-8c56-8eaae5cd581f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 320, 'network_id': 'fb1e2ac5-e13c-42f7-b9fd-cb0de04d8c8f'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:32:05.890111 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-e4b22f7e-87f2-431d-ae77-e6174b0a5b22 None None] Bound port: 3999190d-ff35-4862-8f22-536238ca30c6, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f1691606-ae5e-41a8-8c56-8eaae5cd581f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 320, 'network_id': 'fb1e2ac5-e13c-42f7-b9fd-cb0de04d8c8f'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:32:05.893046 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e4b22f7e-87f2-431d-ae77-e6174b0a5b22 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:05.922209 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1e905559-c4cd-436d-9d8e-3bc9d203ec9e tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:05.923174 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1e905559-c4cd-436d-9d8e-3bc9d203ec9e tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:05.927478 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-378be0f1-9b30-499b-8e25-bd9fdbcc6c84 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:05.928021 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-378be0f1-9b30-499b-8e25-bd9fdbcc6c84 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Added segment ae912d78-94a1-4dc6-b6d3-fe081af3dd50 of type vlan for network f13b9063-d49d-4d06-9927-5d96599dbf36 Nov 09 04:32:05.931942 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-50fc13ae-6b29-417c-a74e-6cff6faa7757 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:05.987981 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f65db961-985f-4a9b-9b3c-1e8cd983f753 req-f1a86247-7b43-499b-a2f7-adb7cc32202e tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1800313 Nov 09 04:32:06.025421 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-8235876b-3c78-4329-98b1-aa117883504b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Allocated IP 2001:db8::a1 (fb1e2ac5-e13c-42f7-b9fd-cb0de04d8c8f/2daa3dbc-869c-4c7e-a5ab-08b0680089b6/a6125eab-1cdb-4c29-9aa5-fadf6122f492) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:32:06.044546 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-50fc13ae-6b29-417c-a74e-6cff6faa7757 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 306} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:32:06.058240 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5c4f40eb-52c7-4bc5-bda2-a70e23cb65c8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:06.076813 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50fc13ae-6b29-417c-a74e-6cff6faa7757 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c353752a-437e-4bc7-8fdb-25051ad289d3,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:06.081440 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-378be0f1-9b30-499b-8e25-bd9fdbcc6c84 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:06.084844 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e4b22f7e-87f2-431d-ae77-e6174b0a5b22 None None] For port 3999190d-ff35-4862-8f22-536238ca30c6, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:32:06.087141 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-50fc13ae-6b29-417c-a74e-6cff6faa7757 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:06.087486 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-50fc13ae-6b29-417c-a74e-6cff6faa7757 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Added segment 1f6a556b-7415-4805-8bc7-b0f0bdc903ab of type vlan for network 3f7c1cab-fc9e-407c-99b6-915196a89a79 Nov 09 04:32:06.095378 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e4b22f7e-87f2-431d-ae77-e6174b0a5b22 None None] For port 3999190d-ff35-4862-8f22-536238ca30c6, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=3999190d-ff35-4862-8f22-536238ca30c6,segment=NetworkSegment(f1691606-ae5e-41a8-8c56-8eaae5cd581f),segment_id=f1691606-ae5e-41a8-8c56-8eaae5cd581f)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:32:06.105187 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4f40eb-52c7-4bc5-bda2-a70e23cb65c8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event deleted for resources: {'Subnet': ['ID=e1e90599-9e6d-4f55-825b-7f5eee66d7b4,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:06.114417 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 5b85443d-ddbf-426c-ae60-bb23f1f3f035 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:32:06.116348 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1e905559-c4cd-436d-9d8e-3bc9d203ec9e tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 923 time: 2.0652678 Nov 09 04:32:06.123624 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56030) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:06.154529 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5c4f40eb-52c7-4bc5-bda2-a70e23cb65c8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:06.160031 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-5c4f40eb-52c7-4bc5-bda2-a70e23cb65c8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/e1e90599-9e6d-4f55-825b-7f5eee66d7b4 HTTP/1.1" status: 204 len: 168 time: 0.9995148 Nov 09 04:32:06.161016 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56032) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:06.171556 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7caff6ed-0412-443d-ae6c-3949633c8a26 None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:32:06.186872 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e4b22f7e-87f2-431d-ae77-e6174b0a5b22 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:06.207886 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-6cf5ffcc-a15f-4169-ac57-f843f80f38d5 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0461936 Nov 09 04:32:06.217630 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56034) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:06.233278 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-663f9d2f-859b-47fe-96c5-4f5245fab7e9 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'subnet': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:06.269259 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-50fc13ae-6b29-417c-a74e-6cff6faa7757 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:06.310675 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-378be0f1-9b30-499b-8e25-bd9fdbcc6c84 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:06.315967 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-378be0f1-9b30-499b-8e25-bd9fdbcc6c84 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:06.316566 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-378be0f1-9b30-499b-8e25-bd9fdbcc6c84 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:06.387945 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4b22f7e-87f2-431d-ae77-e6174b0a5b22 None None] Pushing event updated for resources: {'Port': ['ID=3999190d-ff35-4862-8f22-536238ca30c6,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:06.394561 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 5b85443d-ddbf-426c-ae60-bb23f1f3f035 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:06.395001 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:06.396553 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2bf6a734-e309-4a8b-98c5-bf4e9387486b None None] Network fc0e205f-0635-4987-822b-ebf9e58e15c0 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:32:06.429997 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8235876b-3c78-4329-98b1-aa117883504b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:06.508985 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-663f9d2f-859b-47fe-96c5-4f5245fab7e9 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:06.512544 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-378be0f1-9b30-499b-8e25-bd9fdbcc6c84 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event updated for resources: {'Network': ['ID=f13b9063-d49d-4d06-9927-5d96599dbf36,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:06.518789 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-663f9d2f-859b-47fe-96c5-4f5245fab7e9 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:06.540139 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-d2eed563-9abd-4f23-a979-8caa1e4346c6 None None] Provisioning complete for port 105ad6c8-270b-4e0c-8982-38119be4eea7 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:06.540139 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d2eed563-9abd-4f23-a979-8caa1e4346c6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:06.578195 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network f13b9063-d49d-4d06-9927-5d96599dbf36 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:32:06.600020 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-50fc13ae-6b29-417c-a74e-6cff6faa7757 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:06.602926 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8235876b-3c78-4329-98b1-aa117883504b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:06.616368 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-98c6281c-8e79-4d15-a51c-2b7cd3b3fda9 None None] DHCP port deletion for 988d2354-693c-4d52-af17-25e0643eaa0c request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:32:06.617005 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-50fc13ae-6b29-417c-a74e-6cff6faa7757 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:06.617662 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-50fc13ae-6b29-417c-a74e-6cff6faa7757 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:06.681408 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-378be0f1-9b30-499b-8e25-bd9fdbcc6c84 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 765 time: 1.0838745 Nov 09 04:32:06.702656 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56042) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:06.726081 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-97e464fc-6f2b-49ae-9b02-b29dc2c88be1 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Request body: {'subnet': {'network_id': 'f13b9063-d49d-4d06-9927-5d96599dbf36', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:06.817880 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-50fc13ae-6b29-417c-a74e-6cff6faa7757 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 787 time: 1.5721185 Nov 09 04:32:06.831929 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56046) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:06.841667 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-c7b1830c-eb4d-4538-ba39-056dfb5c2059 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Request body: {'subnet': {'network_id': '3f7c1cab-fc9e-407c-99b6-915196a89a79', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:06.848862 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50fc13ae-6b29-417c-a74e-6cff6faa7757 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Pushing event updated for resources: {'Network': ['ID=3f7c1cab-fc9e-407c-99b6-915196a89a79,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:06.869494 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8235876b-3c78-4329-98b1-aa117883504b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Network fb1e2ac5-e13c-42f7-b9fd-cb0de04d8c8f is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:06.874430 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 3f7c1cab-fc9e-407c-99b6-915196a89a79 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:32:06.885465 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 105ad6c8-270b-4e0c-8982-38119be4eea7 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:32:06.886300 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-8235876b-3c78-4329-98b1-aa117883504b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:06.897182 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8235876b-3c78-4329-98b1-aa117883504b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:32:06.903695 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8235876b-3c78-4329-98b1-aa117883504b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:06.904247 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8235876b-3c78-4329-98b1-aa117883504b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:06.967825 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8235876b-3c78-4329-98b1-aa117883504b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event updated for resources: {'Port': ['ID=a6125eab-1cdb-4c29-9aa5-fadf6122f492,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:07.011871 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-48f87f1a-3ae4-4be2-8ffb-7befb82da654 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:07.031823 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-8235876b-3c78-4329-98b1-aa117883504b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 892 time: 1.9339845 Nov 09 04:32:07.034472 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56052) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:07.045406 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-663f9d2f-859b-47fe-96c5-4f5245fab7e9 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:07.122409 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-663f9d2f-859b-47fe-96c5-4f5245fab7e9 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Subnet': ['ID=e58f2a23-3422-4da7-b1e2-ec6064e2517b,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:07.122668 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-97e464fc-6f2b-49ae-9b02-b29dc2c88be1 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Made reservation on behalf of 188f23ef0cb54006875c672b78f5249f for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:07.126408 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-97e464fc-6f2b-49ae-9b02-b29dc2c88be1 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:07.141235 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-663f9d2f-859b-47fe-96c5-4f5245fab7e9 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:07.145835 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-663f9d2f-859b-47fe-96c5-4f5245fab7e9 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:07.146869 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d2eed563-9abd-4f23-a979-8caa1e4346c6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:07.148039 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-663f9d2f-859b-47fe-96c5-4f5245fab7e9 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:07.149065 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-663f9d2f-859b-47fe-96c5-4f5245fab7e9 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:07.231506 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-66828222-9139-4efd-9f22-558c32d66d58 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Deleting port a6125eab-1cdb-4c29-9aa5-fadf6122f492 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:32:07.231968 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-66828222-9139-4efd-9f22-558c32d66d58 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:07.253495 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-98c6281c-8e79-4d15-a51c-2b7cd3b3fda9 None None] Deleting port 5b85443d-ddbf-426c-ae60-bb23f1f3f035 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:32:07.254186 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-98c6281c-8e79-4d15-a51c-2b7cd3b3fda9 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:07.301085 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c7b1830c-eb4d-4538-ba39-056dfb5c2059 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Made reservation on behalf of d84cfa063d124c7aaef56e163790a6eb for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:07.304645 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c7b1830c-eb4d-4538-ba39-056dfb5c2059 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:07.333601 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-d2eed563-9abd-4f23-a979-8caa1e4346c6 None None] For port 105ad6c8-270b-4e0c-8982-38119be4eea7, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=105ad6c8-270b-4e0c-8982-38119be4eea7,segment=NetworkSegment(fea13daf-8155-4861-aabe-2f76164307c9),segment_id=fea13daf-8155-4861-aabe-2f76164307c9)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:32:07.354319 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 105ad6c8-270b-4e0c-8982-38119be4eea7 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:07.354872 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:07.362218 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-663f9d2f-859b-47fe-96c5-4f5245fab7e9 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 1.1432583 Nov 09 04:32:07.368015 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56058) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:07.385090 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-bdb0a8e7-1577-41eb-8df7-14c422b43da9 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'port': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'fixed_ips': [{'subnet_id': 'e58f2a23-3422-4da7-b1e2-ec6064e2517b', 'ip_address': '2001:db8:0:1::2'}], 'name': 'tempest-NetworksTestDHCPv6-1019567888'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:07.406133 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-66828222-9139-4efd-9f22-558c32d66d58 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:07.435598 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d2eed563-9abd-4f23-a979-8caa1e4346c6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:07.472914 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-66828222-9139-4efd-9f22-558c32d66d58 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Calling delete_port for a6125eab-1cdb-4c29-9aa5-fadf6122f492 owned by {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:32:07.479203 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-98c6281c-8e79-4d15-a51c-2b7cd3b3fda9 None None] For port 5b85443d-ddbf-426c-ae60-bb23f1f3f035, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=5b85443d-ddbf-426c-ae60-bb23f1f3f035,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:32:07.479536 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-98c6281c-8e79-4d15-a51c-2b7cd3b3fda9 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:07.493833 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-98c6281c-8e79-4d15-a51c-2b7cd3b3fda9 None None] Calling delete_port for 5b85443d-ddbf-426c-ae60-bb23f1f3f035 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:32:07.574539 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-48f87f1a-3ae4-4be2-8ffb-7befb82da654 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:07.592486 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bba4a44-5ac3-4cb8-8639-57df407ce511 req-fca3c1bd-a715-4baf-87b9-bb71bcac8560 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:07.595087 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-3bba4a44-5ac3-4cb8-8639-57df407ce511 req-fca3c1bd-a715-4baf-87b9-bb71bcac8560 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 945 time: 0.4735496 Nov 09 04:32:07.659933 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2eed563-9abd-4f23-a979-8caa1e4346c6 None None] Pushing event updated for resources: {'Port': ['ID=105ad6c8-270b-4e0c-8982-38119be4eea7,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:07.689315 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-98c6281c-8e79-4d15-a51c-2b7cd3b3fda9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:07.724174 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98c6281c-8e79-4d15-a51c-2b7cd3b3fda9 None None] Pushing event deleted for resources: {'Port': ['ID=5b85443d-ddbf-426c-ae60-bb23f1f3f035,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:07.732654 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-48f87f1a-3ae4-4be2-8ffb-7befb82da654 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:07.777797 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56064) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:07.779322 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bdb0a8e7-1577-41eb-8df7-14c422b43da9 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:07.789217 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [-] 10.222.0.24 "GET / HTTP/1.1" status: 200 len: 248 time: 0.0047543 Nov 09 04:32:07.795571 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56066) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:07.808420 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-98c6281c-8e79-4d15-a51c-2b7cd3b3fda9 None None] No DVR routers for this DVR port 5b85443d-ddbf-426c-ae60-bb23f1f3f035 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:32:07.831768 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-467b50b3-35a1-412d-a259-4bcfff57b6fc None None] Provisioning complete for port 105ad6c8-270b-4e0c-8982-38119be4eea7 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:07.832243 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-467b50b3-35a1-412d-a259-4bcfff57b6fc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:07.887963 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7ca2d1e2-b531-4f69-a7ca-790e51b35c54 None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:32:08.023306 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-66828222-9139-4efd-9f22-558c32d66d58 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:08.071042 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-f3ae0e84-d9b2-4637-90db-e3b2ac5c58d3 tempest-NetworksApiDiscovery-1038479090 tempest-NetworksApiDiscovery-1038479090-project] 10.222.0.24 "GET /v2.0/ HTTP/1.1" status: 200 len: 702 time: 0.2731097 Nov 09 04:32:08.083533 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bdb0a8e7-1577-41eb-8df7-14c422b43da9 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:08.109835 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66828222-9139-4efd-9f22-558c32d66d58 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event deleted for resources: {'Port': ['ID=a6125eab-1cdb-4c29-9aa5-fadf6122f492,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:08.159664 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-467b50b3-35a1-412d-a259-4bcfff57b6fc None None] Provisioning complete for port ce0ce71c-3b39-43c6-918b-56098eb9c226 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:08.160253 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-467b50b3-35a1-412d-a259-4bcfff57b6fc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:08.201366 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [None req-bdb0a8e7-1577-41eb-8df7-14c422b43da9 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] device_id is not set on port 52015d66-ecfb-485e-bd9f-527041517a41 yet. {{(pid=102162) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:32:08.207327 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-af764664-5325-4886-9d35-51913d9bb3be None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-988d2354-693c-4d52-af17-25e0643eaa0c', 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'tenant_id': '8b0758f781884982bf5b94e6609237f6', 'fixed_ips': [{'subnet_id': 'e58f2a23-3422-4da7-b1e2-ec6064e2517b'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:32:08.208764 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-af764664-5325-4886-9d35-51913d9bb3be None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:08.211132 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1986023b-66e4-4459-8195-f131e0e3ac1f None None] Network fb1e2ac5-e13c-42f7-b9fd-cb0de04d8c8f requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:32:08.211367 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-66828222-9139-4efd-9f22-558c32d66d58 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:08.213054 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 3999190d-ff35-4862-8f22-536238ca30c6 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:32:08.227167 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-66828222-9139-4efd-9f22-558c32d66d58 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "DELETE /v2.0/ports/a6125eab-1cdb-4c29-9aa5-fadf6122f492 HTTP/1.1" status: 204 len: 168 time: 1.1914012 Nov 09 04:32:08.231805 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56072) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:08.267773 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-467b50b3-35a1-412d-a259-4bcfff57b6fc None None] Port ce0ce71c-3b39-43c6-918b-56098eb9c226 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:32:08.291424 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-945102cc-6948-463b-bd11-c0af11bbec17 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] GET failed (client error): The resource could not be found. Nov 09 04:32:08.295689 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-945102cc-6948-463b-bd11-c0af11bbec17 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "GET /v2.0/ports/a6125eab-1cdb-4c29-9aa5-fadf6122f492 HTTP/1.1" status: 404 len: 333 time: 0.0602427 Nov 09 04:32:08.295821 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56074) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:08.399233 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48f87f1a-3ae4-4be2-8ffb-7befb82da654 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event updated for resources: {'Port': ['ID=ce0ce71c-3b39-43c6-918b-56098eb9c226,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:08.399930 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-3971a26e-ac84-4be2-9fc7-e8253d95fb5a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Deleting subnet 2daa3dbc-869c-4c7e-a5ab-08b0680089b6 {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:32:08.399930 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3971a26e-ac84-4be2-9fc7-e8253d95fb5a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:08.407232 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-af764664-5325-4886-9d35-51913d9bb3be None None] Allocated IP 2001:db8::2 (988d2354-693c-4d52-af17-25e0643eaa0c/e58f2a23-3422-4da7-b1e2-ec6064e2517b/cf73b71e-0017-4a6d-aff1-912942f0c2fe) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:32:08.441499 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3971a26e-ac84-4be2-9fc7-e8253d95fb5a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:08.482011 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-3bba4a44-5ac3-4cb8-8639-57df407ce511 req-729de8b3-c748-4cb1-9ff0-264e82c28330 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.8729498 Nov 09 04:32:08.580292 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c7b1830c-eb4d-4538-ba39-056dfb5c2059 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:08.639472 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7b1830c-eb4d-4538-ba39-056dfb5c2059 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Pushing event updated for resources: {'Subnet': ['ID=44ed129a-8e24-4400-8a39-18df545f0a06,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:08.700568 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-97e464fc-6f2b-49ae-9b02-b29dc2c88be1 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:08.702443 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-a747a2c9-14e1-4d30-a8e2-a8f09db4d92e None None] Provisioning complete for port ce0ce71c-3b39-43c6-918b-56098eb9c226 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:08.703016 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a747a2c9-14e1-4d30-a8e2-a8f09db4d92e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:08.752827 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-a747a2c9-14e1-4d30-a8e2-a8f09db4d92e None None] Port ce0ce71c-3b39-43c6-918b-56098eb9c226 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:32:08.765781 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97e464fc-6f2b-49ae-9b02-b29dc2c88be1 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event updated for resources: {'Subnet': ['ID=adf8b20e-473c-44ad-9d34-b1b2c888a296,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:08.812352 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56078) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:08.825939 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-af764664-5325-4886-9d35-51913d9bb3be None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:08.830408 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-a747a2c9-14e1-4d30-a8e2-a8f09db4d92e None None] Provisioning complete for port 3999190d-ff35-4862-8f22-536238ca30c6 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:08.830805 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a747a2c9-14e1-4d30-a8e2-a8f09db4d92e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:08.832442 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 3999190d-ff35-4862-8f22-536238ca30c6 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:08.832989 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:08.839654 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c7b1830c-eb4d-4538-ba39-056dfb5c2059 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Checking segment: {'id': '1f6a556b-7415-4805-8bc7-b0f0bdc903ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 306, 'network_id': '3f7c1cab-fc9e-407c-99b6-915196a89a79'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:32:08.839654 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c7b1830c-eb4d-4538-ba39-056dfb5c2059 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Network hostable DHCP agents. Network: 3f7c1cab-fc9e-407c-99b6-915196a89a79, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:32:08.894744 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3971a26e-ac84-4be2-9fc7-e8253d95fb5a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:08.897761 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-48f87f1a-3ae4-4be2-8ffb-7befb82da654 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:08.951621 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-af764664-5325-4886-9d35-51913d9bb3be None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:08.957767 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-97e464fc-6f2b-49ae-9b02-b29dc2c88be1 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Checking segment: {'id': 'ae912d78-94a1-4dc6-b6d3-fe081af3dd50', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 331, 'network_id': 'f13b9063-d49d-4d06-9927-5d96599dbf36'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:32:08.958124 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-97e464fc-6f2b-49ae-9b02-b29dc2c88be1 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Network hostable DHCP agents. Network: f13b9063-d49d-4d06-9927-5d96599dbf36, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:32:08.974935 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-31de1ea9-fccd-4df5-91e4-e3c81518aeb2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:09.005899 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-bdb0a8e7-1577-41eb-8df7-14c422b43da9 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:32:09.006779 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-bdb0a8e7-1577-41eb-8df7-14c422b43da9 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:32:09.007670 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-af764664-5325-4886-9d35-51913d9bb3be None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:09.034727 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c7b1830c-eb4d-4538-ba39-056dfb5c2059 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Network 3f7c1cab-fc9e-407c-99b6-915196a89a79 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:32:09.037039 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-af764664-5325-4886-9d35-51913d9bb3be None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:09.045832 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af764664-5325-4886-9d35-51913d9bb3be None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:32:09.047190 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3971a26e-ac84-4be2-9fc7-e8253d95fb5a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:09.065538 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af764664-5325-4886-9d35-51913d9bb3be None None] Pushing event updated for resources: {'Port': ['ID=cf73b71e-0017-4a6d-aff1-912942f0c2fe,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:09.077385 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3971a26e-ac84-4be2-9fc7-e8253d95fb5a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event deleted for resources: {'Subnet': ['ID=2daa3dbc-869c-4c7e-a5ab-08b0680089b6,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:09.081468 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3971a26e-ac84-4be2-9fc7-e8253d95fb5a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:09.085079 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-3971a26e-ac84-4be2-9fc7-e8253d95fb5a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "DELETE /v2.0/subnets/2daa3dbc-869c-4c7e-a5ab-08b0680089b6 HTTP/1.1" status: 204 len: 168 time: 0.7882729 Nov 09 04:32:09.088590 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56082) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:09.090824 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-bdb0a8e7-1577-41eb-8df7-14c422b43da9 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 400 len: 350 time: 1.7210143 Nov 09 04:32:09.096462 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56084) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:09.134895 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:09.135092 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-97e464fc-6f2b-49ae-9b02-b29dc2c88be1 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Network f13b9063-d49d-4d06-9927-5d96599dbf36 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:32:09.170176 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-20e55356-17e8-462d-a5f3-8a02771b1aed tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:09.174332 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-20e55356-17e8-462d-a5f3-8a02771b1aed tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/ports HTTP/1.1" status: 200 len: 943 time: 0.0753419 Nov 09 04:32:09.175364 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56086) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:09.179662 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-af764664-5325-4886-9d35-51913d9bb3be None None] Attempting to bind port cf73b71e-0017-4a6d-aff1-912942f0c2fe on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:32:09.180012 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-af764664-5325-4886-9d35-51913d9bb3be None None] Attempting to bind port cf73b71e-0017-4a6d-aff1-912942f0c2fe by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:32:09.180379 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-af764664-5325-4886-9d35-51913d9bb3be None None] Attempting to bind port cf73b71e-0017-4a6d-aff1-912942f0c2fe on network 988d2354-693c-4d52-af17-25e0643eaa0c {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:32:09.191746 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a747a2c9-14e1-4d30-a8e2-a8f09db4d92e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:09.195946 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-af764664-5325-4886-9d35-51913d9bb3be None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 31, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:32:09.196307 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-af764664-5325-4886-9d35-51913d9bb3be None None] Checking segment: {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:32:09.196640 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-af764664-5325-4886-9d35-51913d9bb3be None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:09.197036 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-af764664-5325-4886-9d35-51913d9bb3be None None] Bound using segment: {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:32:09.197521 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-af764664-5325-4886-9d35-51913d9bb3be None None] Bound port: cf73b71e-0017-4a6d-aff1-912942f0c2fe, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:32:09.197900 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-af764664-5325-4886-9d35-51913d9bb3be None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:09.205533 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-31de1ea9-fccd-4df5-91e4-e3c81518aeb2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:09.212821 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-c7b1830c-eb4d-4538-ba39-056dfb5c2059 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 3f7c1cab-fc9e-407c-99b6-915196a89a79) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:09.220141 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c7b1830c-eb4d-4538-ba39-056dfb5c2059 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:09.220141 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c7b1830c-eb4d-4538-ba39-056dfb5c2059 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:09.225653 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4a3b027b-153a-4998-898f-4b9016c893f6 None None] Network 3f7c1cab-fc9e-407c-99b6-915196a89a79 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:32:09.229409 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-97e464fc-6f2b-49ae-9b02-b29dc2c88be1 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, f13b9063-d49d-4d06-9927-5d96599dbf36) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:09.236057 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-97e464fc-6f2b-49ae-9b02-b29dc2c88be1 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:09.236650 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-97e464fc-6f2b-49ae-9b02-b29dc2c88be1 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:09.254095 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2b607f57-3b45-4f44-885d-f7a7b3035a91 None None] Network f13b9063-d49d-4d06-9927-5d96599dbf36 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:32:09.264745 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b87dda6c-71d4-4040-956e-e623977462f4 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:09.268196 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b87dda6c-71d4-4040-956e-e623977462f4 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:09.276448 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-b87dda6c-71d4-4040-956e-e623977462f4 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1477 time: 0.0974042 Nov 09 04:32:09.276643 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-48f87f1a-3ae4-4be2-8ffb-7befb82da654 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:09.277541 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-31de1ea9-fccd-4df5-91e4-e3c81518aeb2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:09.278324 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56090) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:09.297409 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dfc09761-1aa6-4aec-8109-be9fb84bac9e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:09.370197 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-c2bb34ea-af50-4ee5-80bc-2d5f99d37c7f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Deleting subnet e58f2a23-3422-4da7-b1e2-ec6064e2517b {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:32:09.375223 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c2bb34ea-af50-4ee5-80bc-2d5f99d37c7f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:09.388181 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-c7b1830c-eb4d-4538-ba39-056dfb5c2059 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.5551579 Nov 09 04:32:09.390226 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56098) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:09.396312 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-31de1ea9-fccd-4df5-91e4-e3c81518aeb2 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=38c8a567721e4cb0864541e7c959b5a8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5828509 Nov 09 04:32:09.403333 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-69c0a75f-631f-4cca-8233-50f39560409a tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Request body: {'network': {'name': 'tempest-router-network01--1957097714'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:09.412159 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-97e464fc-6f2b-49ae-9b02-b29dc2c88be1 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.6928334 Nov 09 04:32:09.416295 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56100) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:09.417801 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56102) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:09.421544 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31de1ea9-fccd-4df5-91e4-e3c81518aeb2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1ad29e1e-9e69-45f5-ab51-166a8365de1f,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:09.436890 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-830ae8a1-2a9b-4109-8956-60c67ed5ae57 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-344967450', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:09.445215 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c2bb34ea-af50-4ee5-80bc-2d5f99d37c7f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:09.551409 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.db.api [None req-830ae8a1-2a9b-4109-8956-60c67ed5ae57 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Nov 09 04:32:09.551409 dv-neutron-816802-2-hyperv neutron-server[102161]: [SQL: DELETE FROM reservations WHERE reservations.project_id = %(project_id_1)s AND reservations.expiration < %(expiration_1)s] Nov 09 04:32:09.551409 dv-neutron-816802-2-hyperv neutron-server[102161]: [parameters: {'project_id_1': '188f23ef0cb54006875c672b78f5249f', 'expiration_1': datetime.datetime(2021, 11, 9, 4, 31, 49, 453758)}] Nov 09 04:32:09.551409 dv-neutron-816802-2-hyperv neutron-server[102161]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=102161) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:32:09.551859 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG oslo_db.api [None req-830ae8a1-2a9b-4109-8956-60c67ed5ae57 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Performing DB retry for function neutron.db.quota.driver_nolock.DbQuotaNoLockDriver.make_reservation {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:32:09.575683 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.db.api [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=102163) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:32:09.576566 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG oslo_db.api [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:32:09.583905 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-a747a2c9-14e1-4d30-a8e2-a8f09db4d92e None None] For port 3999190d-ff35-4862-8f22-536238ca30c6, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=3999190d-ff35-4862-8f22-536238ca30c6,segment=NetworkSegment(f1691606-ae5e-41a8-8c56-8eaae5cd581f),segment_id=f1691606-ae5e-41a8-8c56-8eaae5cd581f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:32:09.585071 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-034ebd8a-8825-4a5b-a520-c6b966999662 None None] Network fb1e2ac5-e13c-42f7-b9fd-cb0de04d8c8f requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:32:09.647848 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c2bb34ea-af50-4ee5-80bc-2d5f99d37c7f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:09.722079 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-96e86cf8-8f36-4e7f-becc-badb6fd72fd3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:09.736288 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-69c0a75f-631f-4cca-8233-50f39560409a tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Made reservation on behalf of d84cfa063d124c7aaef56e163790a6eb for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:09.739758 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-69c0a75f-631f-4cca-8233-50f39560409a tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:09.754558 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-dfc09761-1aa6-4aec-8109-be9fb84bac9e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Deleting port 3999190d-ff35-4862-8f22-536238ca30c6 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:32:09.754892 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dfc09761-1aa6-4aec-8109-be9fb84bac9e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:09.765552 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a747a2c9-14e1-4d30-a8e2-a8f09db4d92e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:09.801099 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c2bb34ea-af50-4ee5-80bc-2d5f99d37c7f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:09.825067 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-96e86cf8-8f36-4e7f-becc-badb6fd72fd3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:09.835308 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c2bb34ea-af50-4ee5-80bc-2d5f99d37c7f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:09.844150 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-c2bb34ea-af50-4ee5-80bc-2d5f99d37c7f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/e58f2a23-3422-4da7-b1e2-ec6064e2517b HTTP/1.1" status: 204 len: 168 time: 0.5595264 Nov 09 04:32:09.844150 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2bb34ea-af50-4ee5-80bc-2d5f99d37c7f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event deleted for resources: {'Subnet': ['ID=e58f2a23-3422-4da7-b1e2-ec6064e2517b,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:09.848362 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56110) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:09.851827 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-af764664-5325-4886-9d35-51913d9bb3be None None] For port cf73b71e-0017-4a6d-aff1-912942f0c2fe, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:32:09.880718 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-af764664-5325-4886-9d35-51913d9bb3be None None] For port cf73b71e-0017-4a6d-aff1-912942f0c2fe, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=cf73b71e-0017-4a6d-aff1-912942f0c2fe,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:32:09.893887 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b112e7c-d490-4fc2-a2d9-32aa96a3e448 req-baeeb40b-70b5-4f24-8b20-46dd78779a0a tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:09.895328 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-7b112e7c-d490-4fc2-a2d9-32aa96a3e448 req-baeeb40b-70b5-4f24-8b20-46dd78779a0a tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 945 time: 0.2762148 Nov 09 04:32:09.927304 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-d90d75e0-9163-4607-b976-47023455503c tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0743086 Nov 09 04:32:09.929233 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56112) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:09.930962 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-69c0a75f-631f-4cca-8233-50f39560409a tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 308} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:32:09.933825 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a747a2c9-14e1-4d30-a8e2-a8f09db4d92e None None] Pushing event updated for resources: {'Port': ['ID=3999190d-ff35-4862-8f22-536238ca30c6,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:09.940124 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-648761ee-6a63-44a0-9967-8d0dbc6b1cdf None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-3f7c1cab-fc9e-407c-99b6-915196a89a79', 'network_id': '3f7c1cab-fc9e-407c-99b6-915196a89a79', 'tenant_id': 'd84cfa063d124c7aaef56e163790a6eb', 'fixed_ips': [{'subnet_id': '44ed129a-8e24-4400-8a39-18df545f0a06'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:32:09.940877 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-648761ee-6a63-44a0-9967-8d0dbc6b1cdf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:09.946108 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-01aada91-1d9b-4dde-bf21-78785e6ec2d2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'subnet': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:09.959436 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8707a667-24db-4c53-818c-524571f9413b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-f13b9063-d49d-4d06-9927-5d96599dbf36', 'network_id': 'f13b9063-d49d-4d06-9927-5d96599dbf36', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'fixed_ips': [{'subnet_id': 'adf8b20e-473c-44ad-9d34-b1b2c888a296'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:32:09.960259 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8707a667-24db-4c53-818c-524571f9413b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:09.972338 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-3331e9bd-00db-47f4-ab91-0fcbbf7d8b95 None None] Provisioning complete for port ce0ce71c-3b39-43c6-918b-56098eb9c226 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:09.972642 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3331e9bd-00db-47f4-ab91-0fcbbf7d8b95 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:10.004236 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-af764664-5325-4886-9d35-51913d9bb3be None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:10.007276 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-dfc09761-1aa6-4aec-8109-be9fb84bac9e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] For port 3999190d-ff35-4862-8f22-536238ca30c6, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=3999190d-ff35-4862-8f22-536238ca30c6,segment=NetworkSegment(f1691606-ae5e-41a8-8c56-8eaae5cd581f),segment_id=f1691606-ae5e-41a8-8c56-8eaae5cd581f)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:32:10.007649 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dfc09761-1aa6-4aec-8109-be9fb84bac9e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:10.026947 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-69c0a75f-631f-4cca-8233-50f39560409a tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:10.027304 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-69c0a75f-631f-4cca-8233-50f39560409a tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Added segment f5cf6e05-866f-4624-bd85-417651ec848e of type vlan for network edc7865f-a24c-4291-8dc6-52e11b6930c1 Nov 09 04:32:10.065976 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-dfc09761-1aa6-4aec-8109-be9fb84bac9e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Calling delete_port for 3999190d-ff35-4862-8f22-536238ca30c6 owned by network:dhcp {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:32:10.131890 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.db.api [None req-01aada91-1d9b-4dde-bf21-78785e6ec2d2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Nov 09 04:32:10.131890 dv-neutron-816802-2-hyperv neutron-server[102162]: [SQL: DELETE FROM reservations WHERE reservations.project_id = %(project_id_1)s AND reservations.expiration < %(expiration_1)s] Nov 09 04:32:10.131890 dv-neutron-816802-2-hyperv neutron-server[102162]: [parameters: {'project_id_1': '8b0758f781884982bf5b94e6609237f6', 'expiration_1': datetime.datetime(2021, 11, 9, 4, 31, 50, 97526)}] Nov 09 04:32:10.131890 dv-neutron-816802-2-hyperv neutron-server[102162]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=102162) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:32:10.133383 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG oslo_db.api [None req-01aada91-1d9b-4dde-bf21-78785e6ec2d2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Performing DB retry for function neutron.db.quota.driver_nolock.DbQuotaNoLockDriver.make_reservation {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:32:10.147851 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-7b112e7c-d490-4fc2-a2d9-32aa96a3e448 req-cab519b2-9b3c-4b79-9ca4-48cf2bb3e5c6 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2367516 Nov 09 04:32:10.152999 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-69c0a75f-631f-4cca-8233-50f39560409a tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:10.187338 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-00cd717b-ffeb-49fa-a68e-a02de9fcb07b None None] DHCP port deletion for fb1e2ac5-e13c-42f7-b9fd-cb0de04d8c8f request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:32:10.206523 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-48f87f1a-3ae4-4be2-8ffb-7befb82da654 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:10.207043 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d275c57a-24fe-464e-b690-8d8a18fdb984 req-7cd6c033-5214-4dcb-b7e9-c237be2969b8 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:10.211094 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d275c57a-24fe-464e-b690-8d8a18fdb984 req-7cd6c033-5214-4dcb-b7e9-c237be2969b8 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/ports?device_id=9c4e58e3-39e4-4212-b106-50b44d4c4e28 HTTP/1.1" status: 200 len: 945 time: 0.0718238 Nov 09 04:32:10.214571 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-96e86cf8-8f36-4e7f-becc-badb6fd72fd3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:10.217196 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-96e86cf8-8f36-4e7f-becc-badb6fd72fd3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:10.218317 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-96e86cf8-8f36-4e7f-becc-badb6fd72fd3 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/1ad29e1e-9e69-45f5-ab51-166a8365de1f HTTP/1.1" status: 204 len: 168 time: 0.7994049 Nov 09 04:32:10.234969 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96e86cf8-8f36-4e7f-becc-badb6fd72fd3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1ad29e1e-9e69-45f5-ab51-166a8365de1f,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:10.243410 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-3331e9bd-00db-47f4-ab91-0fcbbf7d8b95 None None] Port ce0ce71c-3b39-43c6-918b-56098eb9c226 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:32:10.292853 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-830ae8a1-2a9b-4109-8956-60c67ed5ae57 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:10.293968 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-830ae8a1-2a9b-4109-8956-60c67ed5ae57 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:10.297703 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-48f87f1a-3ae4-4be2-8ffb-7befb82da654 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:10.299561 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af764664-5325-4886-9d35-51913d9bb3be None None] Pushing event updated for resources: {'Port': ['ID=cf73b71e-0017-4a6d-aff1-912942f0c2fe,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:10.306963 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d275c57a-24fe-464e-b690-8d8a18fdb984 req-ddc87055-6b22-437c-b8a2-2f66c358be08 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/security-groups?id=4ff68177-77d2-4250-b11c-4d5b55fd3619&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0882165 Nov 09 04:32:10.389778 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dfc09761-1aa6-4aec-8109-be9fb84bac9e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:10.402403 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-69c0a75f-631f-4cca-8233-50f39560409a tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:10.408232 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-69c0a75f-631f-4cca-8233-50f39560409a tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:10.408849 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-69c0a75f-631f-4cca-8233-50f39560409a tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:10.413099 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-3331e9bd-00db-47f4-ab91-0fcbbf7d8b95 None None] Provisioning complete for port 3999190d-ff35-4862-8f22-536238ca30c6 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:10.416327 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3331e9bd-00db-47f4-ab91-0fcbbf7d8b95 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:10.425550 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-48f87f1a-3ae4-4be2-8ffb-7befb82da654 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:10.426005 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 105ad6c8-270b-4e0c-8982-38119be4eea7 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:32:10.449853 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48f87f1a-3ae4-4be2-8ffb-7befb82da654 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event updated for resources: {'Port': ['ID=ce0ce71c-3b39-43c6-918b-56098eb9c226,revision_number=3']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:10.465315 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dfc09761-1aa6-4aec-8109-be9fb84bac9e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] No DVR routers for this DVR port 3999190d-ff35-4862-8f22-536238ca30c6 on host dv-neutron-816802-2-hyperv {{(pid=102161) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:32:10.487100 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-3331e9bd-00db-47f4-ab91-0fcbbf7d8b95 None None] Port 3999190d-ff35-4862-8f22-536238ca30c6 was deleted so its status cannot be updated. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:335}} Nov 09 04:32:10.552526 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-648761ee-6a63-44a0-9967-8d0dbc6b1cdf None None] Allocated IP 172.20.0.2 (3f7c1cab-fc9e-407c-99b6-915196a89a79/44ed129a-8e24-4400-8a39-18df545f0a06/5ba9b4c1-bfcf-44bf-a4f7-3ccc08804da0) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:32:10.590456 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-8707a667-24db-4c53-818c-524571f9413b None None] Allocated IP 172.20.0.2 (f13b9063-d49d-4d06-9927-5d96599dbf36/adf8b20e-473c-44ad-9d34-b1b2c888a296/29e1d202-6531-4c31-84ef-22c38324e054) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:32:10.592619 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfc09761-1aa6-4aec-8109-be9fb84bac9e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event deleted for resources: {'Port': ['ID=3999190d-ff35-4862-8f22-536238ca30c6,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:10.608700 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-00cd717b-ffeb-49fa-a68e-a02de9fcb07b None None] Deleting port 3999190d-ff35-4862-8f22-536238ca30c6 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:32:10.609071 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-00cd717b-ffeb-49fa-a68e-a02de9fcb07b None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:10.687538 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-830ae8a1-2a9b-4109-8956-60c67ed5ae57 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:10.709046 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56124) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:10.709480 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-69c0a75f-631f-4cca-8233-50f39560409a tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 1.3123307 Nov 09 04:32:10.716789 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-13fc681c-d3ee-4c56-b7c4-e6c4ce9951c2 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Request body: {'network': {'name': 'tempest-router-network02--1730984176'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:10.751576 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-830ae8a1-2a9b-4109-8956-60c67ed5ae57 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:10.761768 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69c0a75f-631f-4cca-8233-50f39560409a tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Pushing event updated for resources: {'Network': ['ID=edc7865f-a24c-4291-8dc6-52e11b6930c1,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:10.766441 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-01aada91-1d9b-4dde-bf21-78785e6ec2d2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:10.776056 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-01aada91-1d9b-4dde-bf21-78785e6ec2d2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:10.814953 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dfc09761-1aa6-4aec-8109-be9fb84bac9e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:10.843995 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-dfc09761-1aa6-4aec-8109-be9fb84bac9e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['fb1e2ac5-e13c-42f7-b9fd-cb0de04d8c8f']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:10.868287 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-dfc09761-1aa6-4aec-8109-be9fb84bac9e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f1691606-ae5e-41a8-8c56-8eaae5cd581f') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:10.869335 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-dfc09761-1aa6-4aec-8109-be9fb84bac9e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f1691606-ae5e-41a8-8c56-8eaae5cd581f') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:10.894177 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-13fc681c-d3ee-4c56-b7c4-e6c4ce9951c2 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Made reservation on behalf of d84cfa063d124c7aaef56e163790a6eb for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:10.898009 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-13fc681c-d3ee-4c56-b7c4-e6c4ce9951c2 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:10.898665 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dfc09761-1aa6-4aec-8109-be9fb84bac9e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:10.907103 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-48f87f1a-3ae4-4be2-8ffb-7befb82da654 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Network fc0e205f-0635-4987-822b-ebf9e58e15c0 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:10.910120 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-48f87f1a-3ae4-4be2-8ffb-7befb82da654 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:10.926482 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dfc09761-1aa6-4aec-8109-be9fb84bac9e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:10.930960 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-00cd717b-ffeb-49fa-a68e-a02de9fcb07b None None] For port 3999190d-ff35-4862-8f22-536238ca30c6, host dv-neutron-816802-2-hyperv, got binding levels [] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:32:10.931452 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-00cd717b-ffeb-49fa-a68e-a02de9fcb07b None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:10.943168 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-dfc09761-1aa6-4aec-8109-be9fb84bac9e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Releasing vlan 320 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:32:10.943545 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dfc09761-1aa6-4aec-8109-be9fb84bac9e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:10.946851 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:32:10.946851 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:32:10.946851 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:32:10.946851 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:32:10.946851 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:32:10.946851 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:32:10.946851 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:32:10.946851 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:32:10.946851 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:32:10.946851 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:32:10.946851 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:32:10.946851 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:32:10.946851 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:32:10.946851 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:32:10.946851 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:32:10.946851 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:32:10.946851 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:32:10.946851 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:32:10.946851 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:32:10.946851 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:32:10.946851 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:32:10.946851 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:32:10.946851 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:32:10.946851 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:32:10.946851 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:32:10.946851 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:32:10.946851 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:32:10.946851 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:32:10.946851 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:32:10.946851 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:32:10.946851 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:32:10.946851 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:32:10.950309 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-00cd717b-ffeb-49fa-a68e-a02de9fcb07b None None] Calling delete_port for 3999190d-ff35-4862-8f22-536238ca30c6 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:32:10.953398 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.ipam_backend_mixin [None req-00cd717b-ffeb-49fa-a68e-a02de9fcb07b None None] Port 3999190d-ff35-4862-8f22-536238ca30c6 was not found and therefore no delete operation was performed {{(pid=102163) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Nov 09 04:32:10.972962 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-13fc681c-d3ee-4c56-b7c4-e6c4ce9951c2 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 344} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:32:11.004886 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-830ae8a1-2a9b-4109-8956-60c67ed5ae57 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:11.006085 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-830ae8a1-2a9b-4109-8956-60c67ed5ae57 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 699 time: 1.5858486 Nov 09 04:32:11.016600 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56126) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:11.022481 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-13fc681c-d3ee-4c56-b7c4-e6c4ce9951c2 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:11.022827 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-13fc681c-d3ee-4c56-b7c4-e6c4ce9951c2 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Added segment 2886750e-78b9-461d-a046-d26e527b0e3f of type vlan for network f5f331fb-d0d2-40d3-ae47-5628a07f50e3 Nov 09 04:32:11.052301 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-00cd717b-ffeb-49fa-a68e-a02de9fcb07b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:11.054885 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network edc7865f-a24c-4291-8dc6-52e11b6930c1 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:32:11.084220 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-13fc681c-d3ee-4c56-b7c4-e6c4ce9951c2 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:11.100438 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 105ad6c8-270b-4e0c-8982-38119be4eea7 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:11.101068 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:11.131927 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-01aada91-1d9b-4dde-bf21-78785e6ec2d2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:11.175480 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00cd717b-ffeb-49fa-a68e-a02de9fcb07b None None] Pushing event deleted for resources: {'Port': ['ID=3999190d-ff35-4862-8f22-536238ca30c6,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:11.219358 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-00cd717b-ffeb-49fa-a68e-a02de9fcb07b None None] No DVR routers for this DVR port 3999190d-ff35-4862-8f22-536238ca30c6 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:32:11.225099 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-13fc681c-d3ee-4c56-b7c4-e6c4ce9951c2 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:11.239727 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-13fc681c-d3ee-4c56-b7c4-e6c4ce9951c2 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:11.241478 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-13fc681c-d3ee-4c56-b7c4-e6c4ce9951c2 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:11.251543 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-01aada91-1d9b-4dde-bf21-78785e6ec2d2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:11.256752 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8707a667-24db-4c53-818c-524571f9413b None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:11.270212 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dfc09761-1aa6-4aec-8109-be9fb84bac9e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:11.272764 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-01aada91-1d9b-4dde-bf21-78785e6ec2d2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:11.275810 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dfc09761-1aa6-4aec-8109-be9fb84bac9e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:11.284584 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-dfc09761-1aa6-4aec-8109-be9fb84bac9e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "DELETE /v2.0/networks/fb1e2ac5-e13c-42f7-b9fd-cb0de04d8c8f HTTP/1.1" status: 204 len: 168 time: 2.1942713 Nov 09 04:32:11.285281 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56130) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:11.299992 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-566e46e1-734c-4240-ab64-30c3004bb6a3 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Request body: {'port': {'network_id': '002d27a0-2fb8-4426-9550-42c444556a8e', 'name': 'tempest-PortsIpV6TestJSON-609938609'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:11.301997 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-648761ee-6a63-44a0-9967-8d0dbc6b1cdf None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:11.312512 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-01aada91-1d9b-4dde-bf21-78785e6ec2d2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:11.313176 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-01aada91-1d9b-4dde-bf21-78785e6ec2d2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:11.351183 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-b5c7f84a-986b-436c-8b73-13f3b02568ef None None] Provisioning complete for port ce0ce71c-3b39-43c6-918b-56098eb9c226 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:11.351528 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b5c7f84a-986b-436c-8b73-13f3b02568ef None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:11.365060 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8707a667-24db-4c53-818c-524571f9413b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:11.371778 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01aada91-1d9b-4dde-bf21-78785e6ec2d2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Subnet': ['ID=98e87e5b-5029-4179-8c5e-5a54cfdbc402,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:11.380622 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13fc681c-d3ee-4c56-b7c4-e6c4ce9951c2 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Pushing event updated for resources: {'Network': ['ID=f5f331fb-d0d2-40d3-ae47-5628a07f50e3,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:11.425755 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfc09761-1aa6-4aec-8109-be9fb84bac9e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event deleted for resources: {'Network': ['ID=fb1e2ac5-e13c-42f7-b9fd-cb0de04d8c8f,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:11.426733 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network f5f331fb-d0d2-40d3-ae47-5628a07f50e3 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:32:11.434517 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-13fc681c-d3ee-4c56-b7c4-e6c4ce9951c2 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 0.7237039 Nov 09 04:32:11.438810 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56134) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:11.444852 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-a6234a7c-f526-4452-8843-abd5eb9ecad7 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Request body: {'subnet': {'network_id': 'edc7865f-a24c-4291-8dc6-52e11b6930c1', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:11.453144 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-01aada91-1d9b-4dde-bf21-78785e6ec2d2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 1.5240657 Nov 09 04:32:11.465805 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56136) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:11.484520 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-efcbee08-4849-4cfc-a8ee-f58782a13606 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'router': {'name': 'tempest-NetworksTestDHCPv6-router-688048628', 'external_gateway_info': {}, 'admin_state_up': True}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:11.593128 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbba996a-be66-4d80-a263-89c961f9a59d req-ebef221e-cb2d-4d14-b129-47e6f936d474 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:11.602245 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-cbba996a-be66-4d80-a263-89c961f9a59d req-ebef221e-cb2d-4d14-b129-47e6f936d474 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/ports?device_id=9c4e58e3-39e4-4212-b106-50b44d4c4e28 HTTP/1.1" status: 200 len: 945 time: 0.2018023 Nov 09 04:32:11.614198 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-efcbee08-4849-4cfc-a8ee-f58782a13606 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:11.615255 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-efcbee08-4849-4cfc-a8ee-f58782a13606 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:11.624766 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0a138f9b-6e40-475e-b7fa-cdd9c6c6c0e9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:11.626869 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8707a667-24db-4c53-818c-524571f9413b None None] Pushing event updated for resources: {'Port': ['ID=29e1d202-6531-4c31-84ef-22c38324e054,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:11.631050 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-648761ee-6a63-44a0-9967-8d0dbc6b1cdf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:11.652576 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8707a667-24db-4c53-818c-524571f9413b None None] Network f13b9063-d49d-4d06-9927-5d96599dbf36 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:11.654138 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-b5c7f84a-986b-436c-8b73-13f3b02568ef None None] Port ce0ce71c-3b39-43c6-918b-56098eb9c226 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:32:11.675210 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-867cf40b-19bc-44f5-ac62-2f1a60866f98 req-aad5312f-d3c4-4be7-81b1-741d3f2369be tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:11.677074 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-867cf40b-19bc-44f5-ac62-2f1a60866f98 req-aad5312f-d3c4-4be7-81b1-741d3f2369be tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 945 time: 0.3811722 Nov 09 04:32:11.677255 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-8707a667-24db-4c53-818c-524571f9413b None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:11.677433 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-48f87f1a-3ae4-4be2-8ffb-7befb82da654 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Router 1daadb67-9ef3-44c1-8af1-f242e2c79aca is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102161) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:32:11.687373 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8707a667-24db-4c53-818c-524571f9413b None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:32:11.697236 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-cbba996a-be66-4d80-a263-89c961f9a59d req-57250f09-fc73-4b64-bf83-9476eefb9c0f tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/security-groups?id=4ff68177-77d2-4250-b11c-4d5b55fd3619&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0875931 Nov 09 04:32:11.718448 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-444a00d0-c059-4f42-951b-c3e63934481f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:11.749909 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-648761ee-6a63-44a0-9967-8d0dbc6b1cdf None None] Network 3f7c1cab-fc9e-407c-99b6-915196a89a79 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:11.777768 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0a509cc9-ee24-4874-a233-49b8ce9e12cb None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:32:11.779069 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-efcbee08-4849-4cfc-a8ee-f58782a13606 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:11.782642 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-648761ee-6a63-44a0-9967-8d0dbc6b1cdf None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:11.782775 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a6234a7c-f526-4452-8843-abd5eb9ecad7 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Made reservation on behalf of d84cfa063d124c7aaef56e163790a6eb for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:11.789951 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a6234a7c-f526-4452-8843-abd5eb9ecad7 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:11.825271 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-efcbee08-4849-4cfc-a8ee-f58782a13606 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:12.004424 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-648761ee-6a63-44a0-9967-8d0dbc6b1cdf None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:32:12.007065 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 5b85443d-ddbf-426c-ae60-bb23f1f3f035 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:32:12.061978 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-8707a667-24db-4c53-818c-524571f9413b None None] Attempting to bind port 29e1d202-6531-4c31-84ef-22c38324e054 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:32:12.062468 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-8707a667-24db-4c53-818c-524571f9413b None None] Attempting to bind port 29e1d202-6531-4c31-84ef-22c38324e054 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'ae912d78-94a1-4dc6-b6d3-fe081af3dd50', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 331, 'network_id': 'f13b9063-d49d-4d06-9927-5d96599dbf36'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:32:12.062914 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8707a667-24db-4c53-818c-524571f9413b None None] Attempting to bind port 29e1d202-6531-4c31-84ef-22c38324e054 on network f13b9063-d49d-4d06-9927-5d96599dbf36 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:32:12.101265 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 5b85443d-ddbf-426c-ae60-bb23f1f3f035 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:32:12.101609 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 5b85443d-ddbf-426c-ae60-bb23f1f3f035 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:32:12.110399 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a6234a7c-f526-4452-8843-abd5eb9ecad7 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:12.111063 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-648761ee-6a63-44a0-9967-8d0dbc6b1cdf None None] Pushing event updated for resources: {'Port': ['ID=5ba9b4c1-bfcf-44bf-a4f7-3ccc08804da0,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:12.141598 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8707a667-24db-4c53-818c-524571f9413b None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 31, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:32:12.141993 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8707a667-24db-4c53-818c-524571f9413b None None] Checking segment: {'id': 'ae912d78-94a1-4dc6-b6d3-fe081af3dd50', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 331, 'network_id': 'f13b9063-d49d-4d06-9927-5d96599dbf36'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:32:12.142408 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8707a667-24db-4c53-818c-524571f9413b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:12.142879 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8707a667-24db-4c53-818c-524571f9413b None None] Bound using segment: {'id': 'ae912d78-94a1-4dc6-b6d3-fe081af3dd50', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 331, 'network_id': 'f13b9063-d49d-4d06-9927-5d96599dbf36'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:32:12.143503 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-8707a667-24db-4c53-818c-524571f9413b None None] Bound port: 29e1d202-6531-4c31-84ef-22c38324e054, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ae912d78-94a1-4dc6-b6d3-fe081af3dd50', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 331, 'network_id': 'f13b9063-d49d-4d06-9927-5d96599dbf36'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:32:12.144130 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8707a667-24db-4c53-818c-524571f9413b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:12.156700 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-fd23ca08-73cd-40e6-adee-36ed3c905296 None None] Provisioning complete for port cf73b71e-0017-4a6d-aff1-912942f0c2fe triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:12.156905 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-fd23ca08-73cd-40e6-adee-36ed3c905296 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:12.198108 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6234a7c-f526-4452-8843-abd5eb9ecad7 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Pushing event updated for resources: {'Subnet': ['ID=bdebff0a-5c2f-4480-b618-3bfe5768fa74,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:12.203122 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-48f87f1a-3ae4-4be2-8ffb-7befb82da654 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:32:12.205499 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a6234a7c-f526-4452-8843-abd5eb9ecad7 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Checking segment: {'id': 'f5cf6e05-866f-4624-bd85-417651ec848e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 308, 'network_id': 'edc7865f-a24c-4291-8dc6-52e11b6930c1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:32:12.205883 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a6234a7c-f526-4452-8843-abd5eb9ecad7 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Network hostable DHCP agents. Network: edc7865f-a24c-4291-8dc6-52e11b6930c1, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:32:12.235477 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1f2fe76b-a388-45de-9e21-00989890e99e None None] Sync routers for ids ['1daadb67-9ef3-44c1-8af1-f242e2c79aca'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:32:12.261210 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-867cf40b-19bc-44f5-ac62-2f1a60866f98 req-48109e3b-3916-4fb5-9e0e-f43f5f39bd49 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.5548997 Nov 09 04:32:12.265628 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:12.265810 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-48f87f1a-3ae4-4be2-8ffb-7befb82da654 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "PUT /v2.0/routers/1daadb67-9ef3-44c1-8af1-f242e2c79aca/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.1410456 Nov 09 04:32:12.265902 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56140) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:12.276872 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-648761ee-6a63-44a0-9967-8d0dbc6b1cdf None None] Attempting to bind port 5ba9b4c1-bfcf-44bf-a4f7-3ccc08804da0 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:32:12.277244 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-648761ee-6a63-44a0-9967-8d0dbc6b1cdf None None] Attempting to bind port 5ba9b4c1-bfcf-44bf-a4f7-3ccc08804da0 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '1f6a556b-7415-4805-8bc7-b0f0bdc903ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 306, 'network_id': '3f7c1cab-fc9e-407c-99b6-915196a89a79'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:32:12.277615 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-648761ee-6a63-44a0-9967-8d0dbc6b1cdf None None] Attempting to bind port 5ba9b4c1-bfcf-44bf-a4f7-3ccc08804da0 on network 3f7c1cab-fc9e-407c-99b6-915196a89a79 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:32:12.285941 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a6234a7c-f526-4452-8843-abd5eb9ecad7 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Network edc7865f-a24c-4291-8dc6-52e11b6930c1 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:32:12.299522 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-648761ee-6a63-44a0-9967-8d0dbc6b1cdf None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 31, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:32:12.299954 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-648761ee-6a63-44a0-9967-8d0dbc6b1cdf None None] Checking segment: {'id': '1f6a556b-7415-4805-8bc7-b0f0bdc903ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 306, 'network_id': '3f7c1cab-fc9e-407c-99b6-915196a89a79'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:32:12.300354 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-648761ee-6a63-44a0-9967-8d0dbc6b1cdf None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:12.300784 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-648761ee-6a63-44a0-9967-8d0dbc6b1cdf None None] Bound using segment: {'id': '1f6a556b-7415-4805-8bc7-b0f0bdc903ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 306, 'network_id': '3f7c1cab-fc9e-407c-99b6-915196a89a79'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:32:12.301271 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-648761ee-6a63-44a0-9967-8d0dbc6b1cdf None None] Bound port: 5ba9b4c1-bfcf-44bf-a4f7-3ccc08804da0, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1f6a556b-7415-4805-8bc7-b0f0bdc903ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 306, 'network_id': '3f7c1cab-fc9e-407c-99b6-915196a89a79'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:32:12.301654 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-648761ee-6a63-44a0-9967-8d0dbc6b1cdf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:12.346492 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1f2fe76b-a388-45de-9e21-00989890e99e None None] Routers {'1daadb67-9ef3-44c1-8af1-f242e2c79aca'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:32:12.346492 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-1f2fe76b-a388-45de-9e21-00989890e99e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:31:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['1daadb67-9ef3-44c1-8af1-f242e2c79aca'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:12.361974 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-08328e80-06f2-4468-b2d0-ad27d690c473 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:12.364640 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-08328e80-06f2-4468-b2d0-ad27d690c473 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "GET /v2.0/ports?device_id=1daadb67-9ef3-44c1-8af1-f242e2c79aca HTTP/1.1" status: 200 len: 981 time: 0.0979795 Nov 09 04:32:12.368400 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56142) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:12.399376 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device cf73b71e-0017-4a6d-aff1-912942f0c2fe up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:32:12.408094 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-1f2fe76b-a388-45de-9e21-00989890e99e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:12.433497 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-566e46e1-734c-4240-ab64-30c3004bb6a3 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Made reservation on behalf of 12e47d8445b5429892cd1b9244512ca8 for: {'port': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:12.438078 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-566e46e1-734c-4240-ab64-30c3004bb6a3 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:12.445310 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-a6234a7c-f526-4452-8843-abd5eb9ecad7 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, edc7865f-a24c-4291-8dc6-52e11b6930c1) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:12.450946 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a6234a7c-f526-4452-8843-abd5eb9ecad7 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:12.452213 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a6234a7c-f526-4452-8843-abd5eb9ecad7 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:12.462163 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-8707a667-24db-4c53-818c-524571f9413b None None] For port 29e1d202-6531-4c31-84ef-22c38324e054, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:32:12.473342 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6ffed6d2-3d4a-4612-9654-890fc37a8e07 None None] Network edc7865f-a24c-4291-8dc6-52e11b6930c1 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:32:12.474741 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [None req-566e46e1-734c-4240-ab64-30c3004bb6a3 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] device_id is not set on port 1722b7b2-a19d-4251-8764-dbd3612af342 yet. {{(pid=102161) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:32:12.530231 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-efcbee08-4849-4cfc-a8ee-f58782a13606 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:12.531465 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-efcbee08-4849-4cfc-a8ee-f58782a13606 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 705 time: 1.0554488 Nov 09 04:32:12.541394 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-8707a667-24db-4c53-818c-524571f9413b None None] For port 29e1d202-6531-4c31-84ef-22c38324e054, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=29e1d202-6531-4c31-84ef-22c38324e054,segment=NetworkSegment(ae912d78-94a1-4dc6-b6d3-fe081af3dd50),segment_id=ae912d78-94a1-4dc6-b6d3-fe081af3dd50)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:32:12.556509 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56144) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:12.558745 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1f2fe76b-a388-45de-9e21-00989890e99e None None] Routers {'1daadb67-9ef3-44c1-8af1-f242e2c79aca'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:32:12.560649 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-1f2fe76b-a388-45de-9e21-00989890e99e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:31:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['1daadb67-9ef3-44c1-8af1-f242e2c79aca'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:12.564998 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a6234a7c-f526-4452-8843-abd5eb9ecad7 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.1250095 Nov 09 04:32:12.565616 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56146) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:12.575067 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-5d99f410-cc59-4e65-9bb8-a6af63e6b24c tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Request body: {'subnet': {'network_id': 'f5f331fb-d0d2-40d3-ae47-5628a07f50e3', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:12.654147 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-1f2fe76b-a388-45de-9e21-00989890e99e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:12.654703 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1f2fe76b-a388-45de-9e21-00989890e99e None None] The sync data for ids ['1daadb67-9ef3-44c1-8af1-f242e2c79aca'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:32:12.656571 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8707a667-24db-4c53-818c-524571f9413b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:12.680510 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-fd23ca08-73cd-40e6-adee-36ed3c905296 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:12.697158 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-444a00d0-c059-4f42-951b-c3e63934481f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Allocated IP 172.20.0.1 (f13b9063-d49d-4d06-9927-5d96599dbf36/adf8b20e-473c-44ad-9d34-b1b2c888a296/723467bb-162d-440d-9796-0ba8fd2d6233) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:32:12.726499 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-648761ee-6a63-44a0-9967-8d0dbc6b1cdf None None] For port 5ba9b4c1-bfcf-44bf-a4f7-3ccc08804da0, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:32:12.757681 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5d99f410-cc59-4e65-9bb8-a6af63e6b24c tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Made reservation on behalf of d84cfa063d124c7aaef56e163790a6eb for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:12.762600 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5d99f410-cc59-4e65-9bb8-a6af63e6b24c tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:12.791476 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-648761ee-6a63-44a0-9967-8d0dbc6b1cdf None None] For port 5ba9b4c1-bfcf-44bf-a4f7-3ccc08804da0, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=5ba9b4c1-bfcf-44bf-a4f7-3ccc08804da0,segment=NetworkSegment(1f6a556b-7415-4805-8bc7-b0f0bdc903ab),segment_id=1f6a556b-7415-4805-8bc7-b0f0bdc903ab)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:32:12.851785 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port cf73b71e-0017-4a6d-aff1-912942f0c2fe triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:12.852162 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:12.856019 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-fd23ca08-73cd-40e6-adee-36ed3c905296 None None] For port cf73b71e-0017-4a6d-aff1-912942f0c2fe, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=cf73b71e-0017-4a6d-aff1-912942f0c2fe,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:32:12.978011 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8707a667-24db-4c53-818c-524571f9413b None None] Pushing event updated for resources: {'Port': ['ID=29e1d202-6531-4c31-84ef-22c38324e054,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:12.981789 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-648761ee-6a63-44a0-9967-8d0dbc6b1cdf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:13.009771 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-409b2a93-d355-465c-9a1c-bf69fd6361c1 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:13.050197 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-648761ee-6a63-44a0-9967-8d0dbc6b1cdf None None] Pushing event updated for resources: {'Port': ['ID=5ba9b4c1-bfcf-44bf-a4f7-3ccc08804da0,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:13.053839 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-fd23ca08-73cd-40e6-adee-36ed3c905296 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:13.087024 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-28192ad4-66bb-49ab-b01a-796b5ccedd61 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-edc7865f-a24c-4291-8dc6-52e11b6930c1', 'network_id': 'edc7865f-a24c-4291-8dc6-52e11b6930c1', 'tenant_id': 'd84cfa063d124c7aaef56e163790a6eb', 'fixed_ips': [{'subnet_id': 'bdebff0a-5c2f-4480-b618-3bfe5768fa74'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:32:13.088035 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-28192ad4-66bb-49ab-b01a-796b5ccedd61 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:13.139393 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42f22272-5ac2-4f82-8ca3-87bcc2245bea req-bd8a5d2c-1684-44be-8b34-1a58e0ba2f22 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:13.140998 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-42f22272-5ac2-4f82-8ca3-87bcc2245bea req-bd8a5d2c-1684-44be-8b34-1a58e0ba2f22 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/ports?device_id=9c4e58e3-39e4-4212-b106-50b44d4c4e28 HTTP/1.1" status: 200 len: 945 time: 0.2708299 Nov 09 04:32:13.220876 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-566e46e1-734c-4240-ab64-30c3004bb6a3 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:13.275044 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd23ca08-73cd-40e6-adee-36ed3c905296 None None] Pushing event updated for resources: {'Port': ['ID=cf73b71e-0017-4a6d-aff1-912942f0c2fe,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:13.368117 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-444a00d0-c059-4f42-951b-c3e63934481f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:13.380238 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-42f22272-5ac2-4f82-8ca3-87bcc2245bea req-823db20b-d0df-49a5-9c05-6aadd788d98d tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/security-groups?id=4ff68177-77d2-4250-b11c-4d5b55fd3619&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2276847 Nov 09 04:32:13.410219 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-ff5222cc-070d-455a-bdaa-262b72240c94 None None] Provisioning complete for port cf73b71e-0017-4a6d-aff1-912942f0c2fe triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:13.410772 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ff5222cc-070d-455a-bdaa-262b72240c94 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:13.431841 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-566e46e1-734c-4240-ab64-30c3004bb6a3 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:13.447318 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-28192ad4-66bb-49ab-b01a-796b5ccedd61 None None] Allocated IP 172.20.0.2 (edc7865f-a24c-4291-8dc6-52e11b6930c1/bdebff0a-5c2f-4480-b618-3bfe5768fa74/b5f72cef-acd0-4924-8988-5d9cdcd366e6) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:32:13.482064 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5d99f410-cc59-4e65-9bb8-a6af63e6b24c tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:13.497631 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 3999190d-ff35-4862-8f22-536238ca30c6 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:32:13.556778 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-237b9d2f-8779-48fa-884d-1de825cef4f1 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:13.601919 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 3999190d-ff35-4862-8f22-536238ca30c6 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:32:13.602271 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 3999190d-ff35-4862-8f22-536238ca30c6 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:32:13.632304 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d99f410-cc59-4e65-9bb8-a6af63e6b24c tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Pushing event updated for resources: {'Subnet': ['ID=71d05232-2996-4b4b-88a3-b9f571ff6741,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:13.649260 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-409b2a93-d355-465c-9a1c-bf69fd6361c1 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Deleting port ce0ce71c-3b39-43c6-918b-56098eb9c226 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:32:13.653495 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-409b2a93-d355-465c-9a1c-bf69fd6361c1 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:13.681913 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5d99f410-cc59-4e65-9bb8-a6af63e6b24c tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Checking segment: {'id': '2886750e-78b9-461d-a046-d26e527b0e3f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 344, 'network_id': 'f5f331fb-d0d2-40d3-ae47-5628a07f50e3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:32:13.682754 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5d99f410-cc59-4e65-9bb8-a6af63e6b24c tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Network hostable DHCP agents. Network: f5f331fb-d0d2-40d3-ae47-5628a07f50e3, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:32:13.682898 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d86e0b92-b560-4c29-8211-8b2f323c7b69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:13.769786 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-444a00d0-c059-4f42-951b-c3e63934481f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:13.777595 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-28192ad4-66bb-49ab-b01a-796b5ccedd61 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:13.791103 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-566e46e1-734c-4240-ab64-30c3004bb6a3 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Network 002d27a0-2fb8-4426-9550-42c444556a8e is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:13.793610 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-409b2a93-d355-465c-9a1c-bf69fd6361c1 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:13.808579 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-409b2a93-d355-465c-9a1c-bf69fd6361c1 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Calling delete_port for ce0ce71c-3b39-43c6-918b-56098eb9c226 owned by network:router_interface {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:32:13.809909 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-566e46e1-734c-4240-ab64-30c3004bb6a3 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:13.813057 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-566e46e1-734c-4240-ab64-30c3004bb6a3 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:32:13.818888 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-566e46e1-734c-4240-ab64-30c3004bb6a3 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:13.819513 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-566e46e1-734c-4240-ab64-30c3004bb6a3 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:13.850117 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-566e46e1-734c-4240-ab64-30c3004bb6a3 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event updated for resources: {'Port': ['ID=1722b7b2-a19d-4251-8764-dbd3612af342,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:13.857892 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5d99f410-cc59-4e65-9bb8-a6af63e6b24c tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Network f5f331fb-d0d2-40d3-ae47-5628a07f50e3 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:32:13.861070 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-444a00d0-c059-4f42-951b-c3e63934481f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Network f13b9063-d49d-4d06-9927-5d96599dbf36 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:13.909870 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-28192ad4-66bb-49ab-b01a-796b5ccedd61 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:13.919371 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-444a00d0-c059-4f42-951b-c3e63934481f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:13.921808 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-444a00d0-c059-4f42-951b-c3e63934481f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:32:13.937341 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e92e20d3-fd49-4195-8fc2-e9ff676dff49 req-b4b26d51-ba1a-4dda-975f-40947ba82a41 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:13.938991 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-e92e20d3-fd49-4195-8fc2-e9ff676dff49 req-b4b26d51-ba1a-4dda-975f-40947ba82a41 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 945 time: 0.5287476 Nov 09 04:32:13.955657 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-5d99f410-cc59-4e65-9bb8-a6af63e6b24c tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, f5f331fb-d0d2-40d3-ae47-5628a07f50e3) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:13.964476 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5d99f410-cc59-4e65-9bb8-a6af63e6b24c tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:13.965925 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5d99f410-cc59-4e65-9bb8-a6af63e6b24c tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:14.005897 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-444a00d0-c059-4f42-951b-c3e63934481f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event updated for resources: {'Port': ['ID=723467bb-162d-440d-9796-0ba8fd2d6233,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:14.007696 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28192ad4-66bb-49ab-b01a-796b5ccedd61 None None] Pushing event updated for resources: {'Port': ['ID=b5f72cef-acd0-4924-8988-5d9cdcd366e6,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:14.010157 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-07af4daf-7dd1-4dd9-8018-07d22c018ddb None None] Network f5f331fb-d0d2-40d3-ae47-5628a07f50e3 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:32:14.040087 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-566e46e1-734c-4240-ab64-30c3004bb6a3 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 849 time: 2.7456069 Nov 09 04:32:14.047890 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56152) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:14.060028 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-237b9d2f-8779-48fa-884d-1de825cef4f1 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Allocated IP 2001:db8::1 (988d2354-693c-4d52-af17-25e0643eaa0c/98e87e5b-5029-4179-8c5e-5a54cfdbc402/235156de-a96d-45b6-b3b1-096d4e0072c3) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:32:14.067057 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-444a00d0-c059-4f42-951b-c3e63934481f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:14.100168 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-28192ad4-66bb-49ab-b01a-796b5ccedd61 None None] Network edc7865f-a24c-4291-8dc6-52e11b6930c1 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:14.102766 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-28192ad4-66bb-49ab-b01a-796b5ccedd61 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:14.113903 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-28192ad4-66bb-49ab-b01a-796b5ccedd61 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:32:14.156144 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-e92e20d3-fd49-4195-8fc2-e9ff676dff49 req-dcb0d704-bf5b-4429-bd0f-45cc9dff40e2 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1860669 Nov 09 04:32:14.195397 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-5d99f410-cc59-4e65-9bb8-a6af63e6b24c tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.6248353 Nov 09 04:32:14.206028 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56154) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:14.287832 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d95704e8-6e1f-4af6-be8f-9e36ab8cf419 None None] Network f13b9063-d49d-4d06-9927-5d96599dbf36 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:32:14.348362 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-237b9d2f-8779-48fa-884d-1de825cef4f1 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:14.359608 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-409b2a93-d355-465c-9a1c-bf69fd6361c1 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:14.438649 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-409b2a93-d355-465c-9a1c-bf69fd6361c1 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event deleted for resources: {'Port': ['ID=ce0ce71c-3b39-43c6-918b-56098eb9c226,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:14.472766 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-444a00d0-c059-4f42-951b-c3e63934481f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:14.634667 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-237b9d2f-8779-48fa-884d-1de825cef4f1 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:14.647967 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 5ba9b4c1-bfcf-44bf-a4f7-3ccc08804da0 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:32:14.742815 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-237b9d2f-8779-48fa-884d-1de825cef4f1 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:14.752679 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-28192ad4-66bb-49ab-b01a-796b5ccedd61 None None] Attempting to bind port b5f72cef-acd0-4924-8988-5d9cdcd366e6 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:32:14.753132 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-28192ad4-66bb-49ab-b01a-796b5ccedd61 None None] Attempting to bind port b5f72cef-acd0-4924-8988-5d9cdcd366e6 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'f5cf6e05-866f-4624-bd85-417651ec848e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 308, 'network_id': 'edc7865f-a24c-4291-8dc6-52e11b6930c1'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:32:14.753578 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-28192ad4-66bb-49ab-b01a-796b5ccedd61 None None] Attempting to bind port b5f72cef-acd0-4924-8988-5d9cdcd366e6 on network edc7865f-a24c-4291-8dc6-52e11b6930c1 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:32:14.756334 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-237b9d2f-8779-48fa-884d-1de825cef4f1 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:14.766704 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-237b9d2f-8779-48fa-884d-1de825cef4f1 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:32:14.767593 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-237b9d2f-8779-48fa-884d-1de825cef4f1 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:14.774896 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-28192ad4-66bb-49ab-b01a-796b5ccedd61 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 31, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:32:14.777067 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-28192ad4-66bb-49ab-b01a-796b5ccedd61 None None] Checking segment: {'id': 'f5cf6e05-866f-4624-bd85-417651ec848e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 308, 'network_id': 'edc7865f-a24c-4291-8dc6-52e11b6930c1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:32:14.780410 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-28192ad4-66bb-49ab-b01a-796b5ccedd61 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:14.786999 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-28192ad4-66bb-49ab-b01a-796b5ccedd61 None None] Bound using segment: {'id': 'f5cf6e05-866f-4624-bd85-417651ec848e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 308, 'network_id': 'edc7865f-a24c-4291-8dc6-52e11b6930c1'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:32:14.787672 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-28192ad4-66bb-49ab-b01a-796b5ccedd61 None None] Bound port: b5f72cef-acd0-4924-8988-5d9cdcd366e6, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f5cf6e05-866f-4624-bd85-417651ec848e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 308, 'network_id': 'edc7865f-a24c-4291-8dc6-52e11b6930c1'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:32:14.788180 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-28192ad4-66bb-49ab-b01a-796b5ccedd61 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:14.819777 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-dbad892b-069c-46ca-a2f4-b2b88e34654c None None] Provisioning complete for port 29e1d202-6531-4c31-84ef-22c38324e054 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:14.819777 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-dbad892b-069c-46ca-a2f4-b2b88e34654c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:14.820435 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-237b9d2f-8779-48fa-884d-1de825cef4f1 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Port': ['ID=235156de-a96d-45b6-b3b1-096d4e0072c3,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:14.854855 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f46fdafa-f50b-4191-a4e9-bdcba2abdbf5 None None] Network 3f7c1cab-fc9e-407c-99b6-915196a89a79 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:32:15.019163 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-444a00d0-c059-4f42-951b-c3e63934481f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:15.039361 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-0df4f21d-7f16-4463-ada9-1b30b572acc3 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Deleting port 1722b7b2-a19d-4251-8764-dbd3612af342 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:32:15.039732 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0df4f21d-7f16-4463-ada9-1b30b572acc3 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:15.060084 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-444a00d0-c059-4f42-951b-c3e63934481f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:15.092944 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dd412973-75ce-409c-8c42-879f36a2c2a8 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-f5f331fb-d0d2-40d3-ae47-5628a07f50e3', 'network_id': 'f5f331fb-d0d2-40d3-ae47-5628a07f50e3', 'tenant_id': 'd84cfa063d124c7aaef56e163790a6eb', 'fixed_ips': [{'subnet_id': '71d05232-2996-4b4b-88a3-b9f571ff6741'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:32:15.093882 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-dd412973-75ce-409c-8c42-879f36a2c2a8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:15.133997 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-237b9d2f-8779-48fa-884d-1de825cef4f1 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:15.144853 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:15.178669 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 5ba9b4c1-bfcf-44bf-a4f7-3ccc08804da0 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:15.179163 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:15.186035 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-28192ad4-66bb-49ab-b01a-796b5ccedd61 None None] For port b5f72cef-acd0-4924-8988-5d9cdcd366e6, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:32:15.186243 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-444a00d0-c059-4f42-951b-c3e63934481f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:15.228630 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-444a00d0-c059-4f42-951b-c3e63934481f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event updated for resources: {'Port': ['ID=723467bb-162d-440d-9796-0ba8fd2d6233,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:15.298402 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-28192ad4-66bb-49ab-b01a-796b5ccedd61 None None] For port b5f72cef-acd0-4924-8988-5d9cdcd366e6, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=b5f72cef-acd0-4924-8988-5d9cdcd366e6,segment=NetworkSegment(f5cf6e05-866f-4624-bd85-417651ec848e),segment_id=f5cf6e05-866f-4624-bd85-417651ec848e)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:32:15.314759 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0df4f21d-7f16-4463-ada9-1b30b572acc3 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:15.367360 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95fae243-ad0e-4915-a4e1-b7866d42d539 req-15ecb4a7-db19-48f0-b3bb-8b5a814385fc tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:15.371188 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-28192ad4-66bb-49ab-b01a-796b5ccedd61 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:15.374573 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-95fae243-ad0e-4915-a4e1-b7866d42d539 req-15ecb4a7-db19-48f0-b3bb-8b5a814385fc tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/ports?device_id=9c4e58e3-39e4-4212-b106-50b44d4c4e28 HTTP/1.1" status: 200 len: 945 time: 0.4275775 Nov 09 04:32:15.392421 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-0df4f21d-7f16-4463-ada9-1b30b572acc3 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Calling delete_port for 1722b7b2-a19d-4251-8764-dbd3612af342 owned by {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:32:15.417298 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-409b2a93-d355-465c-9a1c-bf69fd6361c1 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:15.453652 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-dbad892b-069c-46ca-a2f4-b2b88e34654c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:15.479552 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-399a7445-5006-4c04-b7af-e614092c97a8 req-0ceee87c-1848-4229-b215-c83dc55f3076 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:15.481149 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-399a7445-5006-4c04-b7af-e614092c97a8 req-0ceee87c-1848-4229-b215-c83dc55f3076 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 945 time: 0.1666915 Nov 09 04:32:15.514852 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-15afddb4-390f-4a8a-8574-6ed775482140 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:15.555599 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-444a00d0-c059-4f42-951b-c3e63934481f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Network f13b9063-d49d-4d06-9927-5d96599dbf36 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:15.557855 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28192ad4-66bb-49ab-b01a-796b5ccedd61 None None] Pushing event updated for resources: {'Port': ['ID=b5f72cef-acd0-4924-8988-5d9cdcd366e6,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:15.578782 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-444a00d0-c059-4f42-951b-c3e63934481f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:15.598734 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-dd412973-75ce-409c-8c42-879f36a2c2a8 None None] Allocated IP 172.20.0.2 (f5f331fb-d0d2-40d3-ae47-5628a07f50e3/71d05232-2996-4b4b-88a3-b9f571ff6741/0436bdb7-90d1-4607-b19a-81c26177275b) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:32:15.613247 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-dbad892b-069c-46ca-a2f4-b2b88e34654c None None] For port 29e1d202-6531-4c31-84ef-22c38324e054, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=29e1d202-6531-4c31-84ef-22c38324e054,segment=NetworkSegment(ae912d78-94a1-4dc6-b6d3-fe081af3dd50),segment_id=ae912d78-94a1-4dc6-b6d3-fe081af3dd50)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:32:15.641255 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:15.705653 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-dbad892b-069c-46ca-a2f4-b2b88e34654c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:15.825651 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 5ba9b4c1-bfcf-44bf-a4f7-3ccc08804da0, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=5ba9b4c1-bfcf-44bf-a4f7-3ccc08804da0,segment=NetworkSegment(1f6a556b-7415-4805-8bc7-b0f0bdc903ab),segment_id=1f6a556b-7415-4805-8bc7-b0f0bdc903ab)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:32:15.854353 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-399a7445-5006-4c04-b7af-e614092c97a8 req-51a680d2-6626-48d8-95c4-3a428e15cabd tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3528802 Nov 09 04:32:15.883548 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-409b2a93-d355-465c-9a1c-bf69fd6361c1 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Router 1daadb67-9ef3-44c1-8af1-f242e2c79aca has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:32:15.884810 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0df4f21d-7f16-4463-ada9-1b30b572acc3 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:15.898051 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:15.912945 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device cf73b71e-0017-4a6d-aff1-912942f0c2fe up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:32:15.937058 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0df4f21d-7f16-4463-ada9-1b30b572acc3 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:15.944453 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-0df4f21d-7f16-4463-ada9-1b30b572acc3 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "DELETE /v2.0/ports/1722b7b2-a19d-4251-8764-dbd3612af342 HTTP/1.1" status: 204 len: 168 time: 1.8950794 Nov 09 04:32:16.048278 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-d7994077-ae49-4d08-b002-dc7914405c1e None None] Provisioning complete for port 235156de-a96d-45b6-b3b1-096d4e0072c3 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:16.048739 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d7994077-ae49-4d08-b002-dc7914405c1e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:16.121940 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbad892b-069c-46ca-a2f4-b2b88e34654c None None] Pushing event updated for resources: {'Port': ['ID=29e1d202-6531-4c31-84ef-22c38324e054,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:16.196583 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=5ba9b4c1-bfcf-44bf-a4f7-3ccc08804da0,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:16.213022 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56162) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:16.214815 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0df4f21d-7f16-4463-ada9-1b30b572acc3 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event deleted for resources: {'Port': ['ID=1722b7b2-a19d-4251-8764-dbd3612af342,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:16.223163 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-95fae243-ad0e-4915-a4e1-b7866d42d539 req-ea0a6a35-acad-4c76-98f2-2e010d90c603 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/security-groups?id=4ff68177-77d2-4250-b11c-4d5b55fd3619&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.8477297 Nov 09 04:32:16.232748 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-841512c1-93e0-4175-9b22-288a38a12e9e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Request body: {'port': {'network_id': '002d27a0-2fb8-4426-9550-42c444556a8e', 'mac_address': 'fa:16:3e:ed:58:16', 'name': 'tempest-PortsIpV6TestJSON-47793309'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:16.253080 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-d7994077-ae49-4d08-b002-dc7914405c1e None None] Port 235156de-a96d-45b6-b3b1-096d4e0072c3 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:32:16.284056 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-dd412973-75ce-409c-8c42-879f36a2c2a8 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:16.291287 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-d7994077-ae49-4d08-b002-dc7914405c1e None None] Provisioning complete for port 5ba9b4c1-bfcf-44bf-a4f7-3ccc08804da0 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:16.292564 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d7994077-ae49-4d08-b002-dc7914405c1e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:16.322011 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port cf73b71e-0017-4a6d-aff1-912942f0c2fe triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:16.322700 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:16.360026 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-15afddb4-390f-4a8a-8574-6ed775482140 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Allocated IP 172.20.0.1 (edc7865f-a24c-4291-8dc6-52e11b6930c1/bdebff0a-5c2f-4480-b618-3bfe5768fa74/07c59aaf-3ba9-42e7-83af-e9e867a8860a) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:32:16.387579 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-dd412973-75ce-409c-8c42-879f36a2c2a8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:16.410271 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dd412973-75ce-409c-8c42-879f36a2c2a8 None None] Network f5f331fb-d0d2-40d3-ae47-5628a07f50e3 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:16.415243 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-dd412973-75ce-409c-8c42-879f36a2c2a8 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:16.440645 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dd412973-75ce-409c-8c42-879f36a2c2a8 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:32:16.441675 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-237b9d2f-8779-48fa-884d-1de825cef4f1 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:16.450032 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-409b2a93-d355-465c-9a1c-bf69fd6361c1 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:32:16.457140 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-409b2a93-d355-465c-9a1c-bf69fd6361c1 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "PUT /v2.0/routers/1daadb67-9ef3-44c1-8af1-f242e2c79aca/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 4.0870979 Nov 09 04:32:16.459997 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-841512c1-93e0-4175-9b22-288a38a12e9e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Made reservation on behalf of 12e47d8445b5429892cd1b9244512ca8 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:16.460390 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56166) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:16.465224 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cd3c530f-c877-4426-81ec-3ce5c248fc42 None None] Sync routers for ids ['1daadb67-9ef3-44c1-8af1-f242e2c79aca'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:32:16.477989 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cd3c530f-c877-4426-81ec-3ce5c248fc42 None None] Routers {'1daadb67-9ef3-44c1-8af1-f242e2c79aca'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:32:16.480536 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-cd3c530f-c877-4426-81ec-3ce5c248fc42 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:32:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['1daadb67-9ef3-44c1-8af1-f242e2c79aca'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:16.501666 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-30051161-aa69-4a50-959b-b1ddf9a3e167 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] GET failed (client error): The resource could not be found. Nov 09 04:32:16.508929 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-30051161-aa69-4a50-959b-b1ddf9a3e167 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "GET /v2.0/ports/ce0ce71c-3b39-43c6-918b-56098eb9c226 HTTP/1.1" status: 404 len: 333 time: 0.0478027 Nov 09 04:32:16.512042 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56168) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:16.535966 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-cd3c530f-c877-4426-81ec-3ce5c248fc42 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:16.547921 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cd3c530f-c877-4426-81ec-3ce5c248fc42 None None] Routers {'1daadb67-9ef3-44c1-8af1-f242e2c79aca'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:32:16.548872 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-cd3c530f-c877-4426-81ec-3ce5c248fc42 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:32:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['1daadb67-9ef3-44c1-8af1-f242e2c79aca'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:16.558830 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-237b9d2f-8779-48fa-884d-1de825cef4f1 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:16.559612 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-237b9d2f-8779-48fa-884d-1de825cef4f1 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:16.561165 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:16.586196 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd412973-75ce-409c-8c42-879f36a2c2a8 None None] Pushing event updated for resources: {'Port': ['ID=0436bdb7-90d1-4607-b19a-81c26177275b,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:16.603554 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-cd3c530f-c877-4426-81ec-3ce5c248fc42 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:16.607189 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cd3c530f-c877-4426-81ec-3ce5c248fc42 None None] The sync data for ids ['1daadb67-9ef3-44c1-8af1-f242e2c79aca'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:32:16.666149 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9111d620-2e95-4bdc-8af4-a55a996e1903 req-c79f1cb8-97c7-461e-99f6-d3cfa4a015c3 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:16.666149 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9111d620-2e95-4bdc-8af4-a55a996e1903 req-c79f1cb8-97c7-461e-99f6-d3cfa4a015c3 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 945 time: 0.2169509 Nov 09 04:32:16.712585 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-dd412973-75ce-409c-8c42-879f36a2c2a8 None None] Attempting to bind port 0436bdb7-90d1-4607-b19a-81c26177275b on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:32:16.713091 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-dd412973-75ce-409c-8c42-879f36a2c2a8 None None] Attempting to bind port 0436bdb7-90d1-4607-b19a-81c26177275b by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '2886750e-78b9-461d-a046-d26e527b0e3f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 344, 'network_id': 'f5f331fb-d0d2-40d3-ae47-5628a07f50e3'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:32:16.714571 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dd412973-75ce-409c-8c42-879f36a2c2a8 None None] Attempting to bind port 0436bdb7-90d1-4607-b19a-81c26177275b on network f5f331fb-d0d2-40d3-ae47-5628a07f50e3 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:32:16.725407 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dd412973-75ce-409c-8c42-879f36a2c2a8 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 31, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:32:16.725944 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dd412973-75ce-409c-8c42-879f36a2c2a8 None None] Checking segment: {'id': '2886750e-78b9-461d-a046-d26e527b0e3f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 344, 'network_id': 'f5f331fb-d0d2-40d3-ae47-5628a07f50e3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:32:16.726533 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-dd412973-75ce-409c-8c42-879f36a2c2a8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:16.726948 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dd412973-75ce-409c-8c42-879f36a2c2a8 None None] Bound using segment: {'id': '2886750e-78b9-461d-a046-d26e527b0e3f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 344, 'network_id': 'f5f331fb-d0d2-40d3-ae47-5628a07f50e3'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:32:16.727524 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-dd412973-75ce-409c-8c42-879f36a2c2a8 None None] Bound port: 0436bdb7-90d1-4607-b19a-81c26177275b, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2886750e-78b9-461d-a046-d26e527b0e3f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 344, 'network_id': 'f5f331fb-d0d2-40d3-ae47-5628a07f50e3'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:32:16.727997 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-dd412973-75ce-409c-8c42-879f36a2c2a8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:16.747946 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-d7994077-ae49-4d08-b002-dc7914405c1e None None] Provisioning complete for port 29e1d202-6531-4c31-84ef-22c38324e054 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:16.748407 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d7994077-ae49-4d08-b002-dc7914405c1e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:16.748521 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-444a00d0-c059-4f42-951b-c3e63934481f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Router 6b62cf76-7264-405c-b119-c70d950c1388 is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102161) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:32:16.757449 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-237b9d2f-8779-48fa-884d-1de825cef4f1 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:16.760043 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1e596c18-d26f-41ec-8a8d-3dcccffe6bd3 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for router, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:16.766880 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-237b9d2f-8779-48fa-884d-1de825cef4f1 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:16.790183 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e99df7a-ba96-4802-b6fb-9d9f86399cff req-27b03ac3-07d8-47ce-8bb5-eaffc6b0b4fa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:16.792103 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6e99df7a-ba96-4802-b6fb-9d9f86399cff req-27b03ac3-07d8-47ce-8bb5-eaffc6b0b4fa service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=6015befde7f546d881cb247ae5bc81ae&device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 1098 time: 0.1494513 Nov 09 04:32:16.798074 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-841512c1-93e0-4175-9b22-288a38a12e9e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:16.885932 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-dd412973-75ce-409c-8c42-879f36a2c2a8 None None] For port 0436bdb7-90d1-4607-b19a-81c26177275b, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:32:16.896163 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-dd412973-75ce-409c-8c42-879f36a2c2a8 None None] For port 0436bdb7-90d1-4607-b19a-81c26177275b, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=0436bdb7-90d1-4607-b19a-81c26177275b,segment=NetworkSegment(2886750e-78b9-461d-a046-d26e527b0e3f),segment_id=2886750e-78b9-461d-a046-d26e527b0e3f)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:32:16.904026 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 29e1d202-6531-4c31-84ef-22c38324e054 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:32:16.925675 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9111d620-2e95-4bdc-8af4-a55a996e1903 req-dc3cd8fa-16c4-4c82-8452-ea3669b4fd17 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2223372 Nov 09 04:32:16.936478 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [None req-841512c1-93e0-4175-9b22-288a38a12e9e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] device_id is not set on port 8cbda000-7df0-438e-a92b-6652e2f6286c yet. {{(pid=102162) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:32:17.038406 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-dd412973-75ce-409c-8c42-879f36a2c2a8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:17.129890 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-237b9d2f-8779-48fa-884d-1de825cef4f1 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Port': ['ID=235156de-a96d-45b6-b3b1-096d4e0072c3,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:17.130433 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f4e91344-64fd-40b4-ba4a-015d6c68be4f None None] Network edc7865f-a24c-4291-8dc6-52e11b6930c1 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:32:17.135773 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-d7994077-ae49-4d08-b002-dc7914405c1e None None] Provisioning complete for port 723467bb-162d-440d-9796-0ba8fd2d6233 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:17.135773 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d7994077-ae49-4d08-b002-dc7914405c1e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:17.135773 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd412973-75ce-409c-8c42-879f36a2c2a8 None None] Pushing event updated for resources: {'Port': ['ID=0436bdb7-90d1-4607-b19a-81c26177275b,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:17.139483 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:17.168363 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-841512c1-93e0-4175-9b22-288a38a12e9e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:17.184822 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-15afddb4-390f-4a8a-8574-6ed775482140 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:17.208988 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e99df7a-ba96-4802-b6fb-9d9f86399cff req-fb511f3e-9451-4aad-8f53-d6040095345c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:17.210673 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6e99df7a-ba96-4802-b6fb-9d9f86399cff req-fb511f3e-9451-4aad-8f53-d6040095345c service neutron] 10.222.0.26 "GET /v2.0/networks?id=a270b61c-1f4f-4d97-be79-4a24c65fddc2 HTTP/1.1" status: 200 len: 913 time: 0.4067960 Nov 09 04:32:17.210829 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 29e1d202-6531-4c31-84ef-22c38324e054 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:17.211364 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:17.250712 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-444a00d0-c059-4f42-951b-c3e63934481f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:32:17.256515 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1e596c18-d26f-41ec-8a8d-3dcccffe6bd3 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:17.262318 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-444a00d0-c059-4f42-951b-c3e63934481f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "PUT /v2.0/routers/6b62cf76-7264-405c-b119-c70d950c1388/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.2154603 Nov 09 04:32:17.263821 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1e596c18-d26f-41ec-8a8d-3dcccffe6bd3 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:17.265890 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56172) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:17.339265 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6e99df7a-ba96-4802-b6fb-9d9f86399cff req-f62ffd02-75d2-46eb-afc1-2326461f8f52 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=99ad1d96-b35b-4120-b5a9-c95c47bd3ffc HTTP/1.1" status: 200 len: 1001 time: 0.1134727 Nov 09 04:32:17.356209 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1613b0cf-9636-4693-9723-6fe2818cca78 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:17.360098 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1613b0cf-9636-4693-9723-6fe2818cca78 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "GET /v2.0/ports/723467bb-162d-440d-9796-0ba8fd2d6233 HTTP/1.1" status: 200 len: 910 time: 0.0894520 Nov 09 04:32:17.368867 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56174) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:17.378655 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-0fa48986-7e7b-48c8-9f87-f55d6e8d2ebb tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Request body: {'port': {'fixed_ips': [{'subnet_id': 'adf8b20e-473c-44ad-9d34-b1b2c888a296'}]}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:17.407695 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e99df7a-ba96-4802-b6fb-9d9f86399cff req-94ee4251-0135-46d2-b9e7-b36846e3a345 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:17.409198 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6e99df7a-ba96-4802-b6fb-9d9f86399cff req-94ee4251-0135-46d2-b9e7-b36846e3a345 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=b2956e71-9b0f-4060-922c-e54ce6cff80a HTTP/1.1" status: 200 len: 851 time: 0.0632522 Nov 09 04:32:17.418182 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-841512c1-93e0-4175-9b22-288a38a12e9e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:17.424618 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-237b9d2f-8779-48fa-884d-1de825cef4f1 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Router e32c32b3-649c-4478-b86a-b410c5d84442 is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102161) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:32:17.431158 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1e596c18-d26f-41ec-8a8d-3dcccffe6bd3 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:17.431158 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1e596c18-d26f-41ec-8a8d-3dcccffe6bd3 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Fanout notify agent at l3_agent the message router_deleted on router 1daadb67-9ef3-44c1-8af1-f242e2c79aca {{(pid=102161) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:32:17.439419 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1e596c18-d26f-41ec-8a8d-3dcccffe6bd3 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:17.442895 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1e596c18-d26f-41ec-8a8d-3dcccffe6bd3 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "DELETE /v2.0/routers/1daadb67-9ef3-44c1-8af1-f242e2c79aca HTTP/1.1" status: 204 len: 168 time: 0.9274981 Nov 09 04:32:17.448465 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56176) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:17.499812 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-15afddb4-390f-4a8a-8574-6ed775482140 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:17.535400 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-841512c1-93e0-4175-9b22-288a38a12e9e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Network 002d27a0-2fb8-4426-9550-42c444556a8e is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:17.543693 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-841512c1-93e0-4175-9b22-288a38a12e9e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:17.551958 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-841512c1-93e0-4175-9b22-288a38a12e9e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:32:17.560585 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-841512c1-93e0-4175-9b22-288a38a12e9e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:17.562053 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-841512c1-93e0-4175-9b22-288a38a12e9e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:17.562344 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-52d19a38-0533-4b3f-b727-3b25478b2775 None None] Sync routers for ids ['6b62cf76-7264-405c-b119-c70d950c1388'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:32:17.569452 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd3cb5f0-eb1d-4ad0-9446-cb859190a32f req-338916fe-44ef-4e67-ad0d-c199ebcb9a09 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:17.571510 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-bd3cb5f0-eb1d-4ad0-9446-cb859190a32f req-338916fe-44ef-4e67-ad0d-c199ebcb9a09 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/ports?device_id=9c4e58e3-39e4-4212-b106-50b44d4c4e28 HTTP/1.1" status: 200 len: 945 time: 0.2243311 Nov 09 04:32:17.596647 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e99df7a-ba96-4802-b6fb-9d9f86399cff req-90252a2b-09b2-4ece-8fd0-58d65073b7c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:17.598190 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6e99df7a-ba96-4802-b6fb-9d9f86399cff req-90252a2b-09b2-4ece-8fd0-58d65073b7c0 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=a270b61c-1f4f-4d97-be79-4a24c65fddc2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1777906 Nov 09 04:32:17.600427 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-15afddb4-390f-4a8a-8574-6ed775482140 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Network edc7865f-a24c-4291-8dc6-52e11b6930c1 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:17.603625 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-841512c1-93e0-4175-9b22-288a38a12e9e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event updated for resources: {'Port': ['ID=8cbda000-7df0-438e-a92b-6652e2f6286c,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:17.606627 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-d7994077-ae49-4d08-b002-dc7914405c1e None None] Port 723467bb-162d-440d-9796-0ba8fd2d6233 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:32:17.612760 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-15afddb4-390f-4a8a-8574-6ed775482140 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:17.618637 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-52d19a38-0533-4b3f-b727-3b25478b2775 None None] Routers {'6b62cf76-7264-405c-b119-c70d950c1388'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:32:17.619509 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-52d19a38-0533-4b3f-b727-3b25478b2775 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:32:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['6b62cf76-7264-405c-b119-c70d950c1388'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:17.643777 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-15afddb4-390f-4a8a-8574-6ed775482140 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:32:17.672040 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-52d19a38-0533-4b3f-b727-3b25478b2775 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:17.689377 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-b6a31418-be5d-4afd-aefd-3af2e2d97cba tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Deleting subnet 7e4bed86-250f-46a6-8bf4-3eef8c055b29 {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:32:17.698981 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-841512c1-93e0-4175-9b22-288a38a12e9e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 848 time: 1.4804502 Nov 09 04:32:17.705168 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b6a31418-be5d-4afd-aefd-3af2e2d97cba tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:17.707607 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56178) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:17.720413 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-52d19a38-0533-4b3f-b727-3b25478b2775 None None] Routers {'6b62cf76-7264-405c-b119-c70d950c1388'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:32:17.721204 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-52d19a38-0533-4b3f-b727-3b25478b2775 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:32:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['6b62cf76-7264-405c-b119-c70d950c1388'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:17.765264 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15afddb4-390f-4a8a-8574-6ed775482140 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Pushing event updated for resources: {'Port': ['ID=07c59aaf-3ba9-42e7-83af-e9e867a8860a,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:17.769715 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-15afddb4-390f-4a8a-8574-6ed775482140 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:17.790021 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-52d19a38-0533-4b3f-b727-3b25478b2775 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:17.790859 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-52d19a38-0533-4b3f-b727-3b25478b2775 None None] The sync data for ids ['6b62cf76-7264-405c-b119-c70d950c1388'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:32:17.813190 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-fe989a5f-68ce-458e-b698-657dd06b6ea2 None None] Provisioning complete for port b5f72cef-acd0-4924-8988-5d9cdcd366e6 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:17.813409 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-fe989a5f-68ce-458e-b698-657dd06b6ea2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:17.823421 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-237b9d2f-8779-48fa-884d-1de825cef4f1 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:32:17.834716 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-237b9d2f-8779-48fa-884d-1de825cef4f1 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "PUT /v2.0/routers/e32c32b3-649c-4478-b86a-b410c5d84442/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.2681239 Nov 09 04:32:17.834850 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6e99df7a-ba96-4802-b6fb-9d9f86399cff req-402818be-b3f0-419e-9388-639d16031fcd service neutron] 10.222.0.26 "GET /v2.0/networks/a270b61c-1f4f-4d97-be79-4a24c65fddc2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2244372 Nov 09 04:32:17.838713 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-909676e2-10a6-44df-8418-a12785c4f4a0 None None] Sync routers for ids ['e32c32b3-649c-4478-b86a-b410c5d84442'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:32:17.852883 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56180) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:17.859152 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-909676e2-10a6-44df-8418-a12785c4f4a0 None None] Routers {'e32c32b3-649c-4478-b86a-b410c5d84442'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:32:17.860072 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-909676e2-10a6-44df-8418-a12785c4f4a0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:32:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['e32c32b3-649c-4478-b86a-b410c5d84442'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:17.865875 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-bd3cb5f0-eb1d-4ad0-9446-cb859190a32f req-c439d347-371f-495e-994f-8b0402f8d47f tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/security-groups?id=4ff68177-77d2-4250-b11c-4d5b55fd3619&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2137303 Nov 09 04:32:17.882333 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6b47aac4-52e4-4d73-87bf-4c1b618bd62d tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:17.885080 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-6b47aac4-52e4-4d73-87bf-4c1b618bd62d tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "GET /v2.0/ports/8cbda000-7df0-438e-a92b-6652e2f6286c HTTP/1.1" status: 200 len: 843 time: 0.1716657 Nov 09 04:32:17.888044 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b6a31418-be5d-4afd-aefd-3af2e2d97cba tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:17.897456 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56182) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:17.924402 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0fa48986-7e7b-48c8-9f87-f55d6e8d2ebb tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:18.056489 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-fe989a5f-68ce-458e-b698-657dd06b6ea2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:18.073764 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d306a4ad-7d1f-447f-b884-5c486e631823 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:18.077559 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-d306a4ad-7d1f-447f-b884-5c486e631823 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/ports/235156de-a96d-45b6-b3b1-096d4e0072c3 HTTP/1.1" status: 200 len: 911 time: 0.2218485 Nov 09 04:32:18.082396 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56186) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:18.114934 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-909676e2-10a6-44df-8418-a12785c4f4a0 None None] Set router e32c32b3-649c-4478-b86a-b410c5d84442 gateway port host: None {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:32:18.116572 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-fe989a5f-68ce-458e-b698-657dd06b6ea2 None None] For port b5f72cef-acd0-4924-8988-5d9cdcd366e6, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=b5f72cef-acd0-4924-8988-5d9cdcd366e6,segment=NetworkSegment(f5cf6e05-866f-4624-bd85-417651ec848e),segment_id=f5cf6e05-866f-4624-bd85-417651ec848e)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:32:18.212564 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-fe989a5f-68ce-458e-b698-657dd06b6ea2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:18.242000 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b6a31418-be5d-4afd-aefd-3af2e2d97cba tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:18.277313 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6e99df7a-ba96-4802-b6fb-9d9f86399cff req-b73ab609-b7d8-48ad-bcbe-3db063774c54 service neutron] 10.222.0.26 "GET /v2.0/networks/a270b61c-1f4f-4d97-be79-4a24c65fddc2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4196234 Nov 09 04:32:18.280752 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 0436bdb7-90d1-4607-b19a-81c26177275b up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:32:18.288925 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d894fd81-af2c-40de-8584-ecb4d4f7cd9f req-c18ed07c-2381-44f5-9e10-af8a7254fb2d tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:18.289783 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d894fd81-af2c-40de-8584-ecb4d4f7cd9f req-c18ed07c-2381-44f5-9e10-af8a7254fb2d tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 945 time: 0.1957533 Nov 09 04:32:18.332723 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-15afddb4-390f-4a8a-8574-6ed775482140 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:18.411671 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-fe989a5f-68ce-458e-b698-657dd06b6ea2 None None] Provisioning complete for port 235156de-a96d-45b6-b3b1-096d4e0072c3 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:18.412041 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-fe989a5f-68ce-458e-b698-657dd06b6ea2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:18.442628 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-b5108ce7-f17f-4345-a3d9-a3337c0eed62 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Deleting port 8cbda000-7df0-438e-a92b-6652e2f6286c {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:32:18.442971 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b5108ce7-f17f-4345-a3d9-a3337c0eed62 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:18.443553 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe989a5f-68ce-458e-b698-657dd06b6ea2 None None] Pushing event updated for resources: {'Port': ['ID=b5f72cef-acd0-4924-8988-5d9cdcd366e6,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:18.450528 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-909676e2-10a6-44df-8418-a12785c4f4a0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e32c32b3-649c-4478-b86a-b410c5d84442', 'name': 'tempest-NetworksTestDHCPv6-router-688048628', 'tenant_id': '8b0758f781884982bf5b94e6609237f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:32:11Z', 'updated_at': '2021-11-09T04:32:14Z', 'revision_number': 2, 'project_id': '8b0758f781884982bf5b94e6609237f6', 'gw_port_host': None, '_interfaces': [{'id': '235156de-a96d-45b6-b3b1-096d4e0072c3', 'name': '', 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'tenant_id': '8b0758f781884982bf5b94e6609237f6', 'mac_address': 'fa:16:3e:68:1b:89', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e32c32b3-649c-4478-b86a-b410c5d84442', 'device_owner': 'network:router_interface', 'standard_attr_id': 799, 'fixed_ips': [{'subnet_id': '98e87e5b-5029-4179-8c5e-5a54cfdbc402', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:13Z', 'updated_at': '2021-11-09T04:32:15Z', 'revision_number': 2, 'project_id': '8b0758f781884982bf5b94e6609237f6', 'subnets': [{'id': '98e87e5b-5029-4179-8c5e-5a54cfdbc402', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': 'dhcpv6-stateful', 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:18.473410 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-46cd4ebb-677b-4204-acc0-fcc31b634f69 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:18.479881 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-fe989a5f-68ce-458e-b698-657dd06b6ea2 None None] Port 235156de-a96d-45b6-b3b1-096d4e0072c3 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:32:18.482558 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d894fd81-af2c-40de-8584-ecb4d4f7cd9f req-7ec81baa-c871-44b7-82b5-64129c16e459 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1774957 Nov 09 04:32:18.488411 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 0436bdb7-90d1-4607-b19a-81c26177275b triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:18.488779 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:18.490689 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-46cd4ebb-677b-4204-acc0-fcc31b634f69 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:18.492332 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-46cd4ebb-677b-4204-acc0-fcc31b634f69 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1576 time: 0.4084883 Nov 09 04:32:18.496895 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56188) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:18.503554 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-909676e2-10a6-44df-8418-a12785c4f4a0 None None] Checking router: e32c32b3-649c-4478-b86a-b410c5d84442 for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:32:18.503991 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-909676e2-10a6-44df-8418-a12785c4f4a0 None None] Updating router e32c32b3-649c-4478-b86a-b410c5d84442 port 235156de-a96d-45b6-b3b1-096d4e0072c3 binding host dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 04:32:18.543535 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-fe989a5f-68ce-458e-b698-657dd06b6ea2 None None] Provisioning complete for port 723467bb-162d-440d-9796-0ba8fd2d6233 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:18.543906 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-fe989a5f-68ce-458e-b698-657dd06b6ea2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:18.551953 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-909676e2-10a6-44df-8418-a12785c4f4a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:18.594062 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b6a31418-be5d-4afd-aefd-3af2e2d97cba tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:18.612413 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-fe989a5f-68ce-458e-b698-657dd06b6ea2 None None] Port 723467bb-162d-440d-9796-0ba8fd2d6233 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:32:18.695950 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:18.698502 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-fe989a5f-68ce-458e-b698-657dd06b6ea2 None None] Provisioning complete for port 5ba9b4c1-bfcf-44bf-a4f7-3ccc08804da0 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:18.698845 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-fe989a5f-68ce-458e-b698-657dd06b6ea2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:18.717194 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6a31418-be5d-4afd-aefd-3af2e2d97cba tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event deleted for resources: {'Subnet': ['ID=7e4bed86-250f-46a6-8bf4-3eef8c055b29,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:18.726339 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b6a31418-be5d-4afd-aefd-3af2e2d97cba tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:18.736855 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-b6a31418-be5d-4afd-aefd-3af2e2d97cba tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "DELETE /v2.0/subnets/7e4bed86-250f-46a6-8bf4-3eef8c055b29 HTTP/1.1" status: 204 len: 168 time: 1.2844427 Nov 09 04:32:18.767982 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-32c057ef-01c5-477f-b8ef-d9c499e98d2e None None] Network fc0e205f-0635-4987-822b-ebf9e58e15c0 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:32:18.777908 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56190) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:18.806071 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b5108ce7-f17f-4345-a3d9-a3337c0eed62 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:18.917461 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-b5108ce7-f17f-4345-a3d9-a3337c0eed62 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Calling delete_port for 8cbda000-7df0-438e-a92b-6652e2f6286c owned by {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:32:18.942640 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b6a31418-be5d-4afd-aefd-3af2e2d97cba tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:32:18.943316 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b6a31418-be5d-4afd-aefd-3af2e2d97cba tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:32:18.943887 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b6a31418-be5d-4afd-aefd-3af2e2d97cba tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:32:18.945069 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b6a31418-be5d-4afd-aefd-3af2e2d97cba tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:32:18.945979 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b6a31418-be5d-4afd-aefd-3af2e2d97cba tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:32:18.946783 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b6a31418-be5d-4afd-aefd-3af2e2d97cba tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:32:18.949728 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b6a31418-be5d-4afd-aefd-3af2e2d97cba tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:32:18.950321 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b6a31418-be5d-4afd-aefd-3af2e2d97cba tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:32:18.952076 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b6a31418-be5d-4afd-aefd-3af2e2d97cba tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:32:18.952521 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b6a31418-be5d-4afd-aefd-3af2e2d97cba tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:32:18.952988 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b6a31418-be5d-4afd-aefd-3af2e2d97cba tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:32:18.954090 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b6a31418-be5d-4afd-aefd-3af2e2d97cba tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:32:19.006860 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-23e58b61-e3e1-4f91-8fcb-66e374ef7fce None None] Network f5f331fb-d0d2-40d3-ae47-5628a07f50e3 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:32:19.017780 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-909676e2-10a6-44df-8418-a12785c4f4a0 None None] Publish callbacks [] for port, precommit_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:19.055424 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 0436bdb7-90d1-4607-b19a-81c26177275b, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=0436bdb7-90d1-4607-b19a-81c26177275b,segment=NetworkSegment(2886750e-78b9-461d-a046-d26e527b0e3f),segment_id=2886750e-78b9-461d-a046-d26e527b0e3f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:32:19.104720 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-909676e2-10a6-44df-8418-a12785c4f4a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:19.134711 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:19.135634 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 5ba9b4c1-bfcf-44bf-a4f7-3ccc08804da0 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:32:19.203513 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20b5842d-5dfc-411d-909d-6fc29698b2d2 None None] Pushing event updated for resources: {'Port': ['ID=235156de-a96d-45b6-b3b1-096d4e0072c3,revision_number=3']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:19.217430 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20b5842d-5dfc-411d-909d-6fc29698b2d2 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:32:19.218061 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20b5842d-5dfc-411d-909d-6fc29698b2d2 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:32:19.218625 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20b5842d-5dfc-411d-909d-6fc29698b2d2 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:32:19.219405 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20b5842d-5dfc-411d-909d-6fc29698b2d2 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:32:19.219889 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20b5842d-5dfc-411d-909d-6fc29698b2d2 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:32:19.220696 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20b5842d-5dfc-411d-909d-6fc29698b2d2 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:32:19.221189 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20b5842d-5dfc-411d-909d-6fc29698b2d2 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:32:19.221836 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20b5842d-5dfc-411d-909d-6fc29698b2d2 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:32:19.222333 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20b5842d-5dfc-411d-909d-6fc29698b2d2 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:32:19.222855 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20b5842d-5dfc-411d-909d-6fc29698b2d2 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:32:19.223350 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20b5842d-5dfc-411d-909d-6fc29698b2d2 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:32:19.223855 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20b5842d-5dfc-411d-909d-6fc29698b2d2 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:32:19.274762 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=0436bdb7-90d1-4607-b19a-81c26177275b,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:19.277072 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4ff045bf-3d3c-4555-9d73-66b87b229fbd None None] DHCP port deletion for fc0e205f-0635-4987-822b-ebf9e58e15c0 request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:32:19.323867 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:32:19.324365 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:32:19.324807 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:32:19.325911 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:32:19.326385 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:32:19.326842 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:32:19.327879 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:32:19.328780 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:32:19.329233 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:32:19.329666 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:32:19.330102 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:32:19.330596 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:32:19.332345 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-909676e2-10a6-44df-8418-a12785c4f4a0 None None] Attempting to bind port 235156de-a96d-45b6-b3b1-096d4e0072c3 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:32:19.332845 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-909676e2-10a6-44df-8418-a12785c4f4a0 None None] Attempting to bind port 235156de-a96d-45b6-b3b1-096d4e0072c3 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:32:19.333379 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-909676e2-10a6-44df-8418-a12785c4f4a0 None None] Attempting to bind port 235156de-a96d-45b6-b3b1-096d4e0072c3 on network 988d2354-693c-4d52-af17-25e0643eaa0c {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:32:19.339788 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-909676e2-10a6-44df-8418-a12785c4f4a0 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 32, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:32:19.340157 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-909676e2-10a6-44df-8418-a12785c4f4a0 None None] Checking segment: {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102164) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:32:19.340554 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-909676e2-10a6-44df-8418-a12785c4f4a0 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:19.340941 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-909676e2-10a6-44df-8418-a12785c4f4a0 None None] Bound using segment: {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:32:19.341414 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-909676e2-10a6-44df-8418-a12785c4f4a0 None None] Bound port: 235156de-a96d-45b6-b3b1-096d4e0072c3, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'}}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:32:19.342234 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-909676e2-10a6-44df-8418-a12785c4f4a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:19.365907 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 5ba9b4c1-bfcf-44bf-a4f7-3ccc08804da0 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:19.366477 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:19.467870 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-909676e2-10a6-44df-8418-a12785c4f4a0 None None] For port 235156de-a96d-45b6-b3b1-096d4e0072c3, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102164) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:32:19.471433 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-909676e2-10a6-44df-8418-a12785c4f4a0 None None] For port 235156de-a96d-45b6-b3b1-096d4e0072c3, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=235156de-a96d-45b6-b3b1-096d4e0072c3,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102164) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:32:19.473763 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-15afddb4-390f-4a8a-8574-6ed775482140 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:19.503990 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-dc3f77b3-b1f7-4c96-8d6c-db5e4a5a67c9 None None] Provisioning complete for port b5f72cef-acd0-4924-8988-5d9cdcd366e6 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:19.504366 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-dc3f77b3-b1f7-4c96-8d6c-db5e4a5a67c9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:19.531517 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-909676e2-10a6-44df-8418-a12785c4f4a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:19.552967 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-15afddb4-390f-4a8a-8574-6ed775482140 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:19.597672 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7cbf2390-89b5-402d-9451-653ff02f8b13 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:19.609183 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-4ff045bf-3d3c-4555-9d73-66b87b229fbd None None] Deleting port 105ad6c8-270b-4e0c-8982-38119be4eea7 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:32:19.609535 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4ff045bf-3d3c-4555-9d73-66b87b229fbd None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:19.649466 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-909676e2-10a6-44df-8418-a12785c4f4a0 None None] Routers {'e32c32b3-649c-4478-b86a-b410c5d84442'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:32:19.650415 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-909676e2-10a6-44df-8418-a12785c4f4a0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:32:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['e32c32b3-649c-4478-b86a-b410c5d84442'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:19.665479 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f88528b-c9cd-4244-a078-54a106dcc49f req-dcd2a320-6b65-4c9e-be35-35c94c0a058b tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:19.672697 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-2f88528b-c9cd-4244-a078-54a106dcc49f req-dcd2a320-6b65-4c9e-be35-35c94c0a058b tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/ports?device_id=9c4e58e3-39e4-4212-b106-50b44d4c4e28 HTTP/1.1" status: 200 len: 945 time: 0.6808188 Nov 09 04:32:19.783832 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b5108ce7-f17f-4345-a3d9-a3337c0eed62 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:19.789618 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-15afddb4-390f-4a8a-8574-6ed775482140 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:19.804234 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-43cc0a88-7334-4d78-8827-e7cc0399b80f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:19.806560 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15afddb4-390f-4a8a-8574-6ed775482140 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Pushing event updated for resources: {'Port': ['ID=07c59aaf-3ba9-42e7-83af-e9e867a8860a,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:19.820323 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-909676e2-10a6-44df-8418-a12785c4f4a0 None None] Set router e32c32b3-649c-4478-b86a-b410c5d84442 gateway port host: None {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:32:19.862695 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-4ff045bf-3d3c-4555-9d73-66b87b229fbd None None] For port 105ad6c8-270b-4e0c-8982-38119be4eea7, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=105ad6c8-270b-4e0c-8982-38119be4eea7,segment=NetworkSegment(fea13daf-8155-4861-aabe-2f76164307c9),segment_id=fea13daf-8155-4861-aabe-2f76164307c9)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:32:19.862695 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4ff045bf-3d3c-4555-9d73-66b87b229fbd None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:19.873210 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15afddb4-390f-4a8a-8574-6ed775482140 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:32:19.873798 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15afddb4-390f-4a8a-8574-6ed775482140 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:32:19.874651 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15afddb4-390f-4a8a-8574-6ed775482140 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:32:19.875279 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15afddb4-390f-4a8a-8574-6ed775482140 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:32:19.875829 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15afddb4-390f-4a8a-8574-6ed775482140 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:32:19.876374 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15afddb4-390f-4a8a-8574-6ed775482140 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:32:19.876942 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15afddb4-390f-4a8a-8574-6ed775482140 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:32:19.877785 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15afddb4-390f-4a8a-8574-6ed775482140 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:32:19.878491 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15afddb4-390f-4a8a-8574-6ed775482140 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:32:19.885711 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15afddb4-390f-4a8a-8574-6ed775482140 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:32:19.885711 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15afddb4-390f-4a8a-8574-6ed775482140 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:32:19.885711 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15afddb4-390f-4a8a-8574-6ed775482140 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:32:19.905679 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-2f88528b-c9cd-4244-a078-54a106dcc49f req-4d538ceb-943f-429f-bfde-610be39faa25 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/security-groups?id=4ff68177-77d2-4250-b11c-4d5b55fd3619&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2320008 Nov 09 04:32:19.908584 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e312a200-58f0-4a1b-ac0a-c01c8ba1ae58 req-f6760303-07b8-4550-abcc-35d10c77f642 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:19.910898 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e312a200-58f0-4a1b-ac0a-c01c8ba1ae58 req-f6760303-07b8-4550-abcc-35d10c77f642 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 945 time: 0.2452905 Nov 09 04:32:19.926800 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5108ce7-f17f-4345-a3d9-a3337c0eed62 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event deleted for resources: {'Port': ['ID=8cbda000-7df0-438e-a92b-6652e2f6286c,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:19.927277 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-4ff045bf-3d3c-4555-9d73-66b87b229fbd None None] Calling delete_port for 105ad6c8-270b-4e0c-8982-38119be4eea7 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:32:19.959457 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b5108ce7-f17f-4345-a3d9-a3337c0eed62 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:19.962792 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-b5108ce7-f17f-4345-a3d9-a3337c0eed62 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "DELETE /v2.0/ports/8cbda000-7df0-438e-a92b-6652e2f6286c HTTP/1.1" status: 204 len: 168 time: 2.0678470 Nov 09 04:32:19.968463 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56196) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:19.992621 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device b5f72cef-acd0-4924-8988-5d9cdcd366e6 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:32:19.995233 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0fa48986-7e7b-48c8-9f87-f55d6e8d2ebb tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:20.005903 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-7cbf2390-89b5-402d-9451-653ff02f8b13 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Deleting port 105ad6c8-270b-4e0c-8982-38119be4eea7 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:32:20.006242 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7cbf2390-89b5-402d-9451-653ff02f8b13 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:20.029620 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-33a3f285-4155-42eb-8c62-997c59f86386 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] GET failed (client error): The resource could not be found. Nov 09 04:32:20.038860 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-33a3f285-4155-42eb-8c62-997c59f86386 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "GET /v2.0/ports/8cbda000-7df0-438e-a92b-6652e2f6286c HTTP/1.1" status: 404 len: 333 time: 0.0533755 Nov 09 04:32:20.045739 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56198) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:20.052398 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-f1f2a638-a659-4b31-b9ce-c3cf780510c1 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Request body: {'port': {'network_id': '002d27a0-2fb8-4426-9550-42c444556a8e', 'name': 'tempest-PortsIpV6TestJSON-1042636160'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:20.058509 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20b5842d-5dfc-411d-909d-6fc29698b2d2 None None] Pushing event updated for resources: {'Port': ['ID=235156de-a96d-45b6-b3b1-096d4e0072c3,revision_number=4']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:20.084195 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0fa48986-7e7b-48c8-9f87-f55d6e8d2ebb tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:20.126679 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-909676e2-10a6-44df-8418-a12785c4f4a0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e32c32b3-649c-4478-b86a-b410c5d84442', 'name': 'tempest-NetworksTestDHCPv6-router-688048628', 'tenant_id': '8b0758f781884982bf5b94e6609237f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:32:11Z', 'updated_at': '2021-11-09T04:32:14Z', 'revision_number': 2, 'project_id': '8b0758f781884982bf5b94e6609237f6', 'gw_port_host': None, '_interfaces': [{'id': '235156de-a96d-45b6-b3b1-096d4e0072c3', 'name': '', 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'tenant_id': '8b0758f781884982bf5b94e6609237f6', 'mac_address': 'fa:16:3e:68:1b:89', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e32c32b3-649c-4478-b86a-b410c5d84442', 'device_owner': 'network:router_interface', 'standard_attr_id': 799, 'fixed_ips': [{'subnet_id': '98e87e5b-5029-4179-8c5e-5a54cfdbc402', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:13Z', 'updated_at': '2021-11-09T04:32:19Z', 'revision_number': 4, 'project_id': '8b0758f781884982bf5b94e6609237f6', 'subnets': [{'id': '98e87e5b-5029-4179-8c5e-5a54cfdbc402', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': 'dhcpv6-stateful', 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:20.154142 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-dc3f77b3-b1f7-4c96-8d6c-db5e4a5a67c9 None None] Provisioning complete for port 07c59aaf-3ba9-42e7-83af-e9e867a8860a triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:20.154639 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-dc3f77b3-b1f7-4c96-8d6c-db5e4a5a67c9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:20.189012 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e312a200-58f0-4a1b-ac0a-c01c8ba1ae58 req-6d2d8b04-3705-4690-9ad9-b88edb033bd3 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2291148 Nov 09 04:32:20.232794 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-dc3f77b3-b1f7-4c96-8d6c-db5e4a5a67c9 None None] Port 07c59aaf-3ba9-42e7-83af-e9e867a8860a cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:32:20.259768 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-15afddb4-390f-4a8a-8574-6ed775482140 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Network edc7865f-a24c-4291-8dc6-52e11b6930c1 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:20.263742 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-15afddb4-390f-4a8a-8574-6ed775482140 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:20.267510 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-dc3f77b3-b1f7-4c96-8d6c-db5e4a5a67c9 None None] Provisioning complete for port 0436bdb7-90d1-4607-b19a-81c26177275b triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:20.268017 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-dc3f77b3-b1f7-4c96-8d6c-db5e4a5a67c9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:20.287666 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-909676e2-10a6-44df-8418-a12785c4f4a0 None None] The sync data for ids ['e32c32b3-649c-4478-b86a-b410c5d84442'] in dv-neutron-816802-2-hyperv is: [{'id': 'e32c32b3-649c-4478-b86a-b410c5d84442', 'name': 'tempest-NetworksTestDHCPv6-router-688048628', 'tenant_id': '8b0758f781884982bf5b94e6609237f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:32:11Z', 'updated_at': '2021-11-09T04:32:14Z', 'revision_number': 2, 'project_id': '8b0758f781884982bf5b94e6609237f6', 'gw_port_host': None, '_interfaces': [{'id': '235156de-a96d-45b6-b3b1-096d4e0072c3', 'name': '', 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'tenant_id': '8b0758f781884982bf5b94e6609237f6', 'mac_address': 'fa:16:3e:68:1b:89', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e32c32b3-649c-4478-b86a-b410c5d84442', 'device_owner': 'network:router_interface', 'standard_attr_id': 799, 'fixed_ips': [{'subnet_id': '98e87e5b-5029-4179-8c5e-5a54cfdbc402', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:13Z', 'updated_at': '2021-11-09T04:32:19Z', 'revision_number': 4, 'project_id': '8b0758f781884982bf5b94e6609237f6', 'subnets': [{'id': '98e87e5b-5029-4179-8c5e-5a54cfdbc402', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': 'dhcpv6-stateful', 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:32:20.333629 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port b5f72cef-acd0-4924-8988-5d9cdcd366e6 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:20.334225 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:20.426746 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-7cbf2390-89b5-402d-9451-653ff02f8b13 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] For port 105ad6c8-270b-4e0c-8982-38119be4eea7, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=105ad6c8-270b-4e0c-8982-38119be4eea7,segment=NetworkSegment(fea13daf-8155-4861-aabe-2f76164307c9),segment_id=fea13daf-8155-4861-aabe-2f76164307c9)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:32:20.427106 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7cbf2390-89b5-402d-9451-653ff02f8b13 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:20.436489 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0fa48986-7e7b-48c8-9f87-f55d6e8d2ebb tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:20.436893 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0fa48986-7e7b-48c8-9f87-f55d6e8d2ebb tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:20.438336 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-0fa48986-7e7b-48c8-9f87-f55d6e8d2ebb tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "PUT /v2.0/ports/723467bb-162d-440d-9796-0ba8fd2d6233 HTTP/1.1" status: 200 len: 910 time: 3.0648775 Nov 09 04:32:20.439202 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fa48986-7e7b-48c8-9f87-f55d6e8d2ebb tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event updated for resources: {'Port': ['ID=723467bb-162d-440d-9796-0ba8fd2d6233,revision_number=3']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:20.450841 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56202) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:20.478532 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-7cbf2390-89b5-402d-9451-653ff02f8b13 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Calling delete_port for 105ad6c8-270b-4e0c-8982-38119be4eea7 owned by network:dhcp {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:32:20.525027 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7b82d6c-f7a8-45c5-a21d-f6df0787ace2 req-385d3362-427b-4618-8786-056783b8badb tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:20.527082 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f7b82d6c-f7a8-45c5-a21d-f6df0787ace2 req-385d3362-427b-4618-8786-056783b8badb tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 945 time: 0.1510358 Nov 09 04:32:20.588109 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f1f2a638-a659-4b31-b9ce-c3cf780510c1 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Made reservation on behalf of 12e47d8445b5429892cd1b9244512ca8 for: {'port': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:20.591084 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f1f2a638-a659-4b31-b9ce-c3cf780510c1 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:20.657181 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [None req-f1f2a638-a659-4b31-b9ce-c3cf780510c1 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] device_id is not set on port 06fddf62-e714-4175-af86-766b297a107e yet. {{(pid=102161) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:32:20.695457 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f7b82d6c-f7a8-45c5-a21d-f6df0787ace2 req-15e7679e-08c9-4921-a043-e57a15822308 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1266043 Nov 09 04:32:20.696638 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-15afddb4-390f-4a8a-8574-6ed775482140 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Router 1f829b23-19d3-4aa7-98b0-5096e56cda7c is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102162) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:32:20.702274 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-43cc0a88-7334-4d78-8827-e7cc0399b80f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Deleting port 235156de-a96d-45b6-b3b1-096d4e0072c3 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:32:20.702641 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-43cc0a88-7334-4d78-8827-e7cc0399b80f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:20.703289 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4ff045bf-3d3c-4555-9d73-66b87b229fbd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:20.755824 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7cbf2390-89b5-402d-9451-653ff02f8b13 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:20.788671 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ff045bf-3d3c-4555-9d73-66b87b229fbd None None] Pushing event deleted for resources: {'Port': ['ID=105ad6c8-270b-4e0c-8982-38119be4eea7,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:20.802905 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4ff045bf-3d3c-4555-9d73-66b87b229fbd None None] No DVR routers for this DVR port 105ad6c8-270b-4e0c-8982-38119be4eea7 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:32:20.807605 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7cbf2390-89b5-402d-9451-653ff02f8b13 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] No DVR routers for this DVR port 105ad6c8-270b-4e0c-8982-38119be4eea7 on host dv-neutron-816802-2-hyperv {{(pid=102161) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:32:20.809442 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cbf2390-89b5-402d-9451-653ff02f8b13 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event deleted for resources: {'Port': ['ID=105ad6c8-270b-4e0c-8982-38119be4eea7,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:20.846393 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-62938508-1ae1-4d79-8a2c-b9f8aec55ba8 None None] get_active_networks_info from dv-neutron-816802-2-hyperv {{(pid=102163) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}} Nov 09 04:32:20.851581 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 29e1d202-6531-4c31-84ef-22c38324e054 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:32:20.960504 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7cbf2390-89b5-402d-9451-653ff02f8b13 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:21.016669 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-7cbf2390-89b5-402d-9451-653ff02f8b13 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['fc0e205f-0635-4987-822b-ebf9e58e15c0']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:21.026513 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-62938508-1ae1-4d79-8a2c-b9f8aec55ba8 None None] Resources bound (agent type, host, resource id): {{(pid=102163) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 09 04:32:21.057234 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-43cc0a88-7334-4d78-8827-e7cc0399b80f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] For port 235156de-a96d-45b6-b3b1-096d4e0072c3, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=235156de-a96d-45b6-b3b1-096d4e0072c3,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:32:21.057954 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-43cc0a88-7334-4d78-8827-e7cc0399b80f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:21.060011 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 29e1d202-6531-4c31-84ef-22c38324e054 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:21.060402 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:21.070907 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-7cbf2390-89b5-402d-9451-653ff02f8b13 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'fea13daf-8155-4861-aabe-2f76164307c9') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:21.071276 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-7cbf2390-89b5-402d-9451-653ff02f8b13 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'fea13daf-8155-4861-aabe-2f76164307c9') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:21.084371 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-8c277f4f-0f35-4a55-99b6-86d767205b58 None None] Provisioning complete for port 235156de-a96d-45b6-b3b1-096d4e0072c3 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:21.084917 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8c277f4f-0f35-4a55-99b6-86d767205b58 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:21.096416 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-15afddb4-390f-4a8a-8574-6ed775482140 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:32:21.104457 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-15afddb4-390f-4a8a-8574-6ed775482140 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] 10.222.0.24 "PUT /v2.0/routers/1f829b23-19d3-4aa7-98b0-5096e56cda7c/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.8965933 Nov 09 04:32:21.108161 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56208) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:21.125347 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-43cc0a88-7334-4d78-8827-e7cc0399b80f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Calling delete_port for 235156de-a96d-45b6-b3b1-096d4e0072c3 owned by network:router_interface {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:32:21.130208 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7cbf2390-89b5-402d-9451-653ff02f8b13 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:21.155539 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8c7148e6-0ccb-490d-86e9-9428761e30a6 None None] Sync routers for ids ['1f829b23-19d3-4aa7-98b0-5096e56cda7c'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:32:21.235466 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7cbf2390-89b5-402d-9451-653ff02f8b13 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:21.246091 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7cbf2390-89b5-402d-9451-653ff02f8b13 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Releasing vlan 326 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:32:21.246845 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7cbf2390-89b5-402d-9451-653ff02f8b13 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:21.252102 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8c7148e6-0ccb-490d-86e9-9428761e30a6 None None] Routers {'1f829b23-19d3-4aa7-98b0-5096e56cda7c'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:32:21.252862 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-8c7148e6-0ccb-490d-86e9-9428761e30a6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:32:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['1f829b23-19d3-4aa7-98b0-5096e56cda7c'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:21.271593 dv-neutron-816802-2-hyperv neutron-server[102161]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:32:21.271593 dv-neutron-816802-2-hyperv neutron-server[102161]: self.session.flush() Nov 09 04:32:21.271593 dv-neutron-816802-2-hyperv neutron-server[102161]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:32:21.271593 dv-neutron-816802-2-hyperv neutron-server[102161]: self.session.flush() Nov 09 04:32:21.271593 dv-neutron-816802-2-hyperv neutron-server[102161]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:32:21.271593 dv-neutron-816802-2-hyperv neutron-server[102161]: self.session.flush() Nov 09 04:32:21.271593 dv-neutron-816802-2-hyperv neutron-server[102161]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:32:21.271593 dv-neutron-816802-2-hyperv neutron-server[102161]: self.session.flush() Nov 09 04:32:21.271593 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:32:21.271593 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:32:21.271593 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:32:21.271593 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:32:21.271593 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:32:21.271593 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:32:21.271593 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:32:21.271593 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:32:21.271593 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:32:21.271593 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:32:21.271593 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:32:21.271593 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:32:21.271593 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:32:21.271593 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:32:21.271593 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:32:21.271593 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:32:21.271593 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:32:21.271593 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:32:21.271593 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:32:21.271593 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:32:21.271593 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:32:21.271593 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:32:21.271593 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:32:21.271593 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:32:21.271593 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:32:21.271593 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:32:21.271593 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:32:21.271593 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:32:21.271593 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:32:21.271593 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:32:21.271593 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:32:21.271593 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:32:21.305323 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-8c7148e6-0ccb-490d-86e9-9428761e30a6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:21.322074 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc6de7ce-d3aa-4c73-929b-32c5ae4162f1 req-85b60018-8c1f-46dc-98e1-48e4b34a61c8 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:21.324788 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-fc6de7ce-d3aa-4c73-929b-32c5ae4162f1 req-85b60018-8c1f-46dc-98e1-48e4b34a61c8 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/ports?device_id=9c4e58e3-39e4-4212-b106-50b44d4c4e28 HTTP/1.1" status: 200 len: 945 time: 0.2940323 Nov 09 04:32:21.358760 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8c7148e6-0ccb-490d-86e9-9428761e30a6 None None] Routers {'1f829b23-19d3-4aa7-98b0-5096e56cda7c'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:32:21.359468 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-8c7148e6-0ccb-490d-86e9-9428761e30a6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:32:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['1f829b23-19d3-4aa7-98b0-5096e56cda7c'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:21.367594 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f1f2a638-a659-4b31-b9ce-c3cf780510c1 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:21.398055 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-8c7148e6-0ccb-490d-86e9-9428761e30a6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:21.398812 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8c7148e6-0ccb-490d-86e9-9428761e30a6 None None] The sync data for ids ['1f829b23-19d3-4aa7-98b0-5096e56cda7c'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:32:21.445850 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7cbf2390-89b5-402d-9451-653ff02f8b13 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:21.469061 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-fc6de7ce-d3aa-4c73-929b-32c5ae4162f1 req-8dfcbd25-592c-4305-8035-ac77edfdb7f8 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/security-groups?id=4ff68177-77d2-4250-b11c-4d5b55fd3619&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1205711 Nov 09 04:32:21.499725 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8c277f4f-0f35-4a55-99b6-86d767205b58 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:21.508053 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7cbf2390-89b5-402d-9451-653ff02f8b13 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:21.513205 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-7cbf2390-89b5-402d-9451-653ff02f8b13 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "DELETE /v2.0/networks/fc0e205f-0635-4987-822b-ebf9e58e15c0 HTTP/1.1" status: 204 len: 168 time: 2.7336342 Nov 09 04:32:21.515023 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cbf2390-89b5-402d-9451-653ff02f8b13 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event deleted for resources: {'Network': ['ID=fc0e205f-0635-4987-822b-ebf9e58e15c0,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:21.518612 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f1f2a638-a659-4b31-b9ce-c3cf780510c1 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:21.520031 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56212) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:21.562113 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-8c277f4f-0f35-4a55-99b6-86d767205b58 None None] For port 235156de-a96d-45b6-b3b1-096d4e0072c3, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=235156de-a96d-45b6-b3b1-096d4e0072c3,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:32:21.629814 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8c277f4f-0f35-4a55-99b6-86d767205b58 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:21.631916 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f1f2a638-a659-4b31-b9ce-c3cf780510c1 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Network 002d27a0-2fb8-4426-9550-42c444556a8e is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:21.646351 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-f1f2a638-a659-4b31-b9ce-c3cf780510c1 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:21.656283 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f1f2a638-a659-4b31-b9ce-c3cf780510c1 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:32:21.667655 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f1f2a638-a659-4b31-b9ce-c3cf780510c1 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:21.668613 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f1f2a638-a659-4b31-b9ce-c3cf780510c1 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:21.682516 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1f2a638-a659-4b31-b9ce-c3cf780510c1 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event updated for resources: {'Port': ['ID=06fddf62-e714-4175-af86-766b297a107e,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:21.695375 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-29c7ddda-fc97-42a8-9f3b-4b540eaeccd7 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:21.701550 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-29c7ddda-fc97-42a8-9f3b-4b540eaeccd7 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "GET /v2.0/ports/a4de75ae-2dab-4896-8d2a-cdfef3f44fab HTTP/1.1" status: 200 len: 841 time: 0.1800051 Nov 09 04:32:21.702712 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56214) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:21.739787 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-8c277f4f-0f35-4a55-99b6-86d767205b58 None None] Provisioning complete for port 07c59aaf-3ba9-42e7-83af-e9e867a8860a triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:21.740731 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8c277f4f-0f35-4a55-99b6-86d767205b58 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:21.783377 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-03f69928-a8d6-4fb8-b171-492318216be5 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "GET /v2.0/ports/a4de75ae-2dab-4896-8d2a-cdfef3f44fab?fields=id&fields=mac_address HTTP/1.1" status: 200 len: 281 time: 0.0770824 Nov 09 04:32:21.784380 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56216) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:21.789020 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-fbc2eddd-1f35-43be-aa9d-689d09837144 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Request body: {'subnet': {'network_id': 'cc397c48-c4cc-4846-a1ef-380b64be450d', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:21.793606 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device b5f72cef-acd0-4924-8988-5d9cdcd366e6 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:32:21.803155 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c277f4f-0f35-4a55-99b6-86d767205b58 None None] Pushing event updated for resources: {'Port': ['ID=235156de-a96d-45b6-b3b1-096d4e0072c3,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:21.834282 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-8c277f4f-0f35-4a55-99b6-86d767205b58 None None] Port 07c59aaf-3ba9-42e7-83af-e9e867a8860a cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:32:21.856661 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-8c277f4f-0f35-4a55-99b6-86d767205b58 None None] Provisioning complete for port 0436bdb7-90d1-4607-b19a-81c26177275b triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:21.857086 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8c277f4f-0f35-4a55-99b6-86d767205b58 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:21.861191 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64fe316b-fa8c-47fc-9812-f861e834f7c8 req-92add409-4f89-4116-b1f3-5a752a0e12d7 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:21.862789 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-64fe316b-fa8c-47fc-9812-f861e834f7c8 req-92add409-4f89-4116-b1f3-5a752a0e12d7 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 945 time: 0.6103675 Nov 09 04:32:21.873362 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-f1f2a638-a659-4b31-b9ce-c3cf780510c1 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 850 time: 1.8262908 Nov 09 04:32:21.876407 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56218) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:21.881540 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-2a0e96ac-3052-4a56-8acd-4c392d8bd473 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Request body: {'port': {'name': 'New_Port', 'admin_state_up': False}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:21.932239 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port b5f72cef-acd0-4924-8988-5d9cdcd366e6 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:21.932907 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:21.964808 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2a0e96ac-3052-4a56-8acd-4c392d8bd473 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:21.983352 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fbc2eddd-1f35-43be-aa9d-689d09837144 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Made reservation on behalf of 88f9f8da29bf4a8793b45130d483a6e6 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:21.988251 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-fbc2eddd-1f35-43be-aa9d-689d09837144 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:22.052785 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-dc5f5bc4-5b06-44ab-8533-a9d7ef56bce7 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:22.073420 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 0436bdb7-90d1-4607-b19a-81c26177275b up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:32:22.124786 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 0436bdb7-90d1-4607-b19a-81c26177275b triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:22.125650 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:22.137598 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-64fe316b-fa8c-47fc-9812-f861e834f7c8 req-f335191a-15d5-4c71-919d-dc9d888711e3 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2642074 Nov 09 04:32:22.235492 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-43cc0a88-7334-4d78-8827-e7cc0399b80f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:22.267815 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 235156de-a96d-45b6-b3b1-096d4e0072c3 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:32:22.280816 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2a0e96ac-3052-4a56-8acd-4c392d8bd473 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:22.305886 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 235156de-a96d-45b6-b3b1-096d4e0072c3 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:32:22.306283 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 235156de-a96d-45b6-b3b1-096d4e0072c3 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:304}} Nov 09 04:32:22.325762 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43cc0a88-7334-4d78-8827-e7cc0399b80f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event deleted for resources: {'Port': ['ID=235156de-a96d-45b6-b3b1-096d4e0072c3,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:22.333491 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Port 235156de-a96d-45b6-b3b1-096d4e0072c3 not found, will not notify nova. {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:314}} Nov 09 04:32:22.355388 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2a0e96ac-3052-4a56-8acd-4c392d8bd473 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:22.401412 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-2a0e96ac-3052-4a56-8acd-4c392d8bd473 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] In _notify_port_updated(), no bound segment for port 06fddf62-e714-4175-af86-766b297a107e on network 002d27a0-2fb8-4426-9550-42c444556a8e {{(pid=102161) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 09 04:32:22.409764 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2a0e96ac-3052-4a56-8acd-4c392d8bd473 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:22.410567 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2a0e96ac-3052-4a56-8acd-4c392d8bd473 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:22.413530 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-2a0e96ac-3052-4a56-8acd-4c392d8bd473 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "PUT /v2.0/ports/06fddf62-e714-4175-af86-766b297a107e HTTP/1.1" status: 200 len: 818 time: 0.5349851 Nov 09 04:32:22.413753 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.api.v2.resource [None req-c906aa53-8446-43f7-8c4a-7b339e6dcf9a tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] add_router_interface failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:32:22.414618 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-c906aa53-8446-43f7-8c4a-7b339e6dcf9a tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] 10.222.0.24 "PUT /v2.0/routers/1f829b23-19d3-4aa7-98b0-5096e56cda7c/add_router_interface HTTP/1.1" status: 400 len: 438 time: 1.3035014 Nov 09 04:32:22.417392 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56224) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:22.427580 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56226) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:22.458561 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-43cc0a88-7334-4d78-8827-e7cc0399b80f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:22.469643 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 105ad6c8-270b-4e0c-8982-38119be4eea7 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:32:22.514929 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 105ad6c8-270b-4e0c-8982-38119be4eea7 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:32:22.518613 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 105ad6c8-270b-4e0c-8982-38119be4eea7 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:32:22.537788 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a0e96ac-3052-4a56-8acd-4c392d8bd473 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event updated for resources: {'Port': ['ID=06fddf62-e714-4175-af86-766b297a107e,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:22.545803 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-fbc2eddd-1f35-43be-aa9d-689d09837144 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:22.667583 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fbc2eddd-1f35-43be-aa9d-689d09837144 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Network cc397c48-c4cc-4846-a1ef-380b64be450d is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:22.706663 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-fbc2eddd-1f35-43be-aa9d-689d09837144 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:22.716295 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-56f43f46-5ed7-445f-8241-20bca70024e0 None None] Network cc397c48-c4cc-4846-a1ef-380b64be450d requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:32:22.721401 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fbc2eddd-1f35-43be-aa9d-689d09837144 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:22.721983 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-fbc2eddd-1f35-43be-aa9d-689d09837144 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:22.740640 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbc2eddd-1f35-43be-aa9d-689d09837144 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event updated for resources: {'Subnet': ['ID=3479ab9e-17ee-493e-93ef-61596c974f8d,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:22.777388 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22df649d-8444-4f9b-bfdd-c6250e6e39d4 req-042a2422-3d81-4a22-9866-c6b779ba14e1 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:22.778981 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-22df649d-8444-4f9b-bfdd-c6250e6e39d4 req-042a2422-3d81-4a22-9866-c6b779ba14e1 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 945 time: 0.2930884 Nov 09 04:32:22.799154 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-43cc0a88-7334-4d78-8827-e7cc0399b80f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Router e32c32b3-649c-4478-b86a-b410c5d84442 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:32:22.841576 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-fbc2eddd-1f35-43be-aa9d-689d09837144 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.0563095 Nov 09 04:32:22.844922 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56230) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:22.847081 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-dc5f5bc4-5b06-44ab-8533-a9d7ef56bce7 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Deleting port 723467bb-162d-440d-9796-0ba8fd2d6233 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:32:22.847415 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-dc5f5bc4-5b06-44ab-8533-a9d7ef56bce7 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:22.849535 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cc529e2-0fe8-4369-877e-62a942963f39 req-2aea092b-df36-46ac-b6d8-705a8155d505 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:22.851058 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-7cc529e2-0fe8-4369-877e-62a942963f39 req-2aea092b-df36-46ac-b6d8-705a8155d505 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/ports?device_id=9c4e58e3-39e4-4212-b106-50b44d4c4e28 HTTP/1.1" status: 200 len: 945 time: 0.2134385 Nov 09 04:32:22.860229 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-e406a03c-3dac-4379-86e5-6231ff7a84e6 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Request body: {'security_group': {'name': 'tempest-secgroup-852437678'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:22.868094 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-21f98ebf-5c04-431d-9044-a2362e57c4bd tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Deleting port 06fddf62-e714-4175-af86-766b297a107e {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:32:22.868790 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-21f98ebf-5c04-431d-9044-a2362e57c4bd tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:22.938160 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b9fa4d0f-2b92-4ee2-8fd5-c0c7f5b81612 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-cc397c48-c4cc-4846-a1ef-380b64be450d', 'network_id': 'cc397c48-c4cc-4846-a1ef-380b64be450d', 'tenant_id': '88f9f8da29bf4a8793b45130d483a6e6', 'fixed_ips': [{'subnet_id': '3479ab9e-17ee-493e-93ef-61596c974f8d'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:32:22.939423 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b9fa4d0f-2b92-4ee2-8fd5-c0c7f5b81612 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:22.976203 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-22df649d-8444-4f9b-bfdd-c6250e6e39d4 req-3b13d724-d075-4fec-a7ba-d5e018797fef tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1877205 Nov 09 04:32:23.013254 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-43cc0a88-7334-4d78-8827-e7cc0399b80f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:32:23.018976 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-43cc0a88-7334-4d78-8827-e7cc0399b80f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "PUT /v2.0/routers/e32c32b3-649c-4478-b86a-b410c5d84442/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 4.5211048 Nov 09 04:32:23.024927 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56232) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:23.030624 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0b1126c0-c17f-4a02-9010-eba862cfc15a None None] Sync routers for ids ['e32c32b3-649c-4478-b86a-b410c5d84442'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:32:23.034974 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-21f98ebf-5c04-431d-9044-a2362e57c4bd tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:23.052259 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0b1126c0-c17f-4a02-9010-eba862cfc15a None None] Routers {'e32c32b3-649c-4478-b86a-b410c5d84442'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:32:23.053866 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-0b1126c0-c17f-4a02-9010-eba862cfc15a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:32:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['e32c32b3-649c-4478-b86a-b410c5d84442'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:23.074423 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-21f98ebf-5c04-431d-9044-a2362e57c4bd tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Calling delete_port for 06fddf62-e714-4175-af86-766b297a107e owned by {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:32:23.093803 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-7cc529e2-0fe8-4369-877e-62a942963f39 req-4f798552-76d5-477f-801b-817e44c8e9b4 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/security-groups?id=4ff68177-77d2-4250-b11c-4d5b55fd3619&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2290175 Nov 09 04:32:23.099033 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-dc5f5bc4-5b06-44ab-8533-a9d7ef56bce7 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:23.105510 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3945db74-a45c-474f-96d5-7f63d54303d4 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:23.108099 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3945db74-a45c-474f-96d5-7f63d54303d4 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:23.108955 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-3945db74-a45c-474f-96d5-7f63d54303d4 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1477 time: 0.0828042 Nov 09 04:32:23.109362 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-b9fa4d0f-2b92-4ee2-8fd5-c0c7f5b81612 None None] Allocated IP 172.20.0.2 (cc397c48-c4cc-4846-a1ef-380b64be450d/3479ab9e-17ee-493e-93ef-61596c974f8d/775e1b75-6b4e-4b53-8c8d-2c5aea990d99) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:32:23.115375 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e406a03c-3dac-4379-86e5-6231ff7a84e6 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:23.118733 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56234) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:23.139983 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-dc5f5bc4-5b06-44ab-8533-a9d7ef56bce7 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Calling delete_port for 723467bb-162d-440d-9796-0ba8fd2d6233 owned by network:router_interface {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:32:23.169041 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-0b1126c0-c17f-4a02-9010-eba862cfc15a None None] Set router e32c32b3-649c-4478-b86a-b410c5d84442 gateway port host: None {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:32:23.230106 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-0b1126c0-c17f-4a02-9010-eba862cfc15a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e32c32b3-649c-4478-b86a-b410c5d84442', 'name': 'tempest-NetworksTestDHCPv6-router-688048628', 'tenant_id': '8b0758f781884982bf5b94e6609237f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:32:11Z', 'updated_at': '2021-11-09T04:32:21Z', 'revision_number': 3, 'project_id': '8b0758f781884982bf5b94e6609237f6', 'gw_port_host': None}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:23.255885 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-ad2752cb-6b11-4e44-8570-8d1e207e4e1d tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Deleting subnet 98e87e5b-5029-4179-8c5e-5a54cfdbc402 {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:32:23.260127 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ad2752cb-6b11-4e44-8570-8d1e207e4e1d tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:23.267403 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0b1126c0-c17f-4a02-9010-eba862cfc15a None None] Checking router: e32c32b3-649c-4478-b86a-b410c5d84442 for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:32:23.276899 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-63aa0b22-5b54-436d-a781-780b2afa06b7 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:23.279175 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0b1126c0-c17f-4a02-9010-eba862cfc15a None None] Routers {'e32c32b3-649c-4478-b86a-b410c5d84442'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:32:23.279973 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-0b1126c0-c17f-4a02-9010-eba862cfc15a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:32:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['e32c32b3-649c-4478-b86a-b410c5d84442'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:23.316210 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ad2752cb-6b11-4e44-8570-8d1e207e4e1d tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:23.319847 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-21f98ebf-5c04-431d-9044-a2362e57c4bd tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:23.327948 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b9fa4d0f-2b92-4ee2-8fd5-c0c7f5b81612 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:23.359728 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-0b1126c0-c17f-4a02-9010-eba862cfc15a None None] Set router e32c32b3-649c-4478-b86a-b410c5d84442 gateway port host: None {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:32:23.386281 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21f98ebf-5c04-431d-9044-a2362e57c4bd tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event deleted for resources: {'Port': ['ID=06fddf62-e714-4175-af86-766b297a107e,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:23.395622 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-21f98ebf-5c04-431d-9044-a2362e57c4bd tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:23.402202 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-21f98ebf-5c04-431d-9044-a2362e57c4bd tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "DELETE /v2.0/ports/06fddf62-e714-4175-af86-766b297a107e HTTP/1.1" status: 204 len: 168 time: 0.9837797 Nov 09 04:32:23.405080 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56236) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:23.406039 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b9fa4d0f-2b92-4ee2-8fd5-c0c7f5b81612 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:23.430519 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-0b1126c0-c17f-4a02-9010-eba862cfc15a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e32c32b3-649c-4478-b86a-b410c5d84442', 'name': 'tempest-NetworksTestDHCPv6-router-688048628', 'tenant_id': '8b0758f781884982bf5b94e6609237f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:32:11Z', 'updated_at': '2021-11-09T04:32:21Z', 'revision_number': 3, 'project_id': '8b0758f781884982bf5b94e6609237f6', 'gw_port_host': None}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:23.447212 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b9fa4d0f-2b92-4ee2-8fd5-c0c7f5b81612 None None] Network cc397c48-c4cc-4846-a1ef-380b64be450d is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:23.451072 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-b9fa4d0f-2b92-4ee2-8fd5-c0c7f5b81612 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:23.458149 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b9fa4d0f-2b92-4ee2-8fd5-c0c7f5b81612 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:32:23.460371 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9fa4d0f-2b92-4ee2-8fd5-c0c7f5b81612 None None] Pushing event updated for resources: {'Port': ['ID=775e1b75-6b4e-4b53-8c8d-2c5aea990d99,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:23.473828 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ad2752cb-6b11-4e44-8570-8d1e207e4e1d tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:23.477914 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e406a03c-3dac-4379-86e5-6231ff7a84e6 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:23.519050 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-b9fa4d0f-2b92-4ee2-8fd5-c0c7f5b81612 None None] Attempting to bind port 775e1b75-6b4e-4b53-8c8d-2c5aea990d99 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:32:23.519523 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-b9fa4d0f-2b92-4ee2-8fd5-c0c7f5b81612 None None] Attempting to bind port 775e1b75-6b4e-4b53-8c8d-2c5aea990d99 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '5cb8d89b-c83c-4beb-ac61-4edae91bc9e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 315, 'network_id': 'cc397c48-c4cc-4846-a1ef-380b64be450d'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:32:23.519939 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b9fa4d0f-2b92-4ee2-8fd5-c0c7f5b81612 None None] Attempting to bind port 775e1b75-6b4e-4b53-8c8d-2c5aea990d99 on network cc397c48-c4cc-4846-a1ef-380b64be450d {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:32:23.520980 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0b1126c0-c17f-4a02-9010-eba862cfc15a None None] The sync data for ids ['e32c32b3-649c-4478-b86a-b410c5d84442'] in dv-neutron-816802-2-hyperv is: [{'id': 'e32c32b3-649c-4478-b86a-b410c5d84442', 'name': 'tempest-NetworksTestDHCPv6-router-688048628', 'tenant_id': '8b0758f781884982bf5b94e6609237f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:32:11Z', 'updated_at': '2021-11-09T04:32:21Z', 'revision_number': 3, 'project_id': '8b0758f781884982bf5b94e6609237f6', 'gw_port_host': None}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:32:23.526073 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b9fa4d0f-2b92-4ee2-8fd5-c0c7f5b81612 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 32, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:32:23.526473 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b9fa4d0f-2b92-4ee2-8fd5-c0c7f5b81612 None None] Checking segment: {'id': '5cb8d89b-c83c-4beb-ac61-4edae91bc9e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 315, 'network_id': 'cc397c48-c4cc-4846-a1ef-380b64be450d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:32:23.526872 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b9fa4d0f-2b92-4ee2-8fd5-c0c7f5b81612 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:23.527253 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b9fa4d0f-2b92-4ee2-8fd5-c0c7f5b81612 None None] Bound using segment: {'id': '5cb8d89b-c83c-4beb-ac61-4edae91bc9e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 315, 'network_id': 'cc397c48-c4cc-4846-a1ef-380b64be450d'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:32:23.527721 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-b9fa4d0f-2b92-4ee2-8fd5-c0c7f5b81612 None None] Bound port: 775e1b75-6b4e-4b53-8c8d-2c5aea990d99, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5cb8d89b-c83c-4beb-ac61-4edae91bc9e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 315, 'network_id': 'cc397c48-c4cc-4846-a1ef-380b64be450d'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:32:23.528135 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b9fa4d0f-2b92-4ee2-8fd5-c0c7f5b81612 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:23.547639 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-87b0aed5-7baa-418d-a2c4-b1f25e6eba15 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:23.549452 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-87b0aed5-7baa-418d-a2c4-b1f25e6eba15 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "GET /v2.0/ports HTTP/1.1" status: 200 len: 848 time: 0.1435757 Nov 09 04:32:23.552240 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56238) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:23.565372 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e406a03c-3dac-4379-86e5-6231ff7a84e6 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:23.583098 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-baf6decf-666b-49bf-a6cb-d3000fc4e811 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] GET failed (client error): The resource could not be found. Nov 09 04:32:23.600303 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-baf6decf-666b-49bf-a6cb-d3000fc4e811 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "GET /v2.0/ports/06fddf62-e714-4175-af86-766b297a107e HTTP/1.1" status: 404 len: 333 time: 0.0460927 Nov 09 04:32:23.607371 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56240) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:23.615308 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-822fded2-bf5f-4508-ab4e-1987b861148a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-109805175'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:23.630928 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e406a03c-3dac-4379-86e5-6231ff7a84e6 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event updated for resources: {'SecurityGroup': ['ID=632771a5-fb1e-4549-8c87-bc5ecfe932cd,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:23.633538 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-b9fa4d0f-2b92-4ee2-8fd5-c0c7f5b81612 None None] For port 775e1b75-6b4e-4b53-8c8d-2c5aea990d99, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:32:23.682974 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e406a03c-3dac-4379-86e5-6231ff7a84e6 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:23.684604 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e406a03c-3dac-4379-86e5-6231ff7a84e6 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1759 time: 0.8326759 Nov 09 04:32:23.692163 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56242) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:23.692311 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-d8034eac-b0ec-46af-85b7-9df7104b948a tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Request body: {'security_group': {'name': 'tempest-secgroup-1639395505'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:23.709015 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-dc5f5bc4-5b06-44ab-8533-a9d7ef56bce7 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:23.710469 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-b9fa4d0f-2b92-4ee2-8fd5-c0c7f5b81612 None None] For port 775e1b75-6b4e-4b53-8c8d-2c5aea990d99, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=775e1b75-6b4e-4b53-8c8d-2c5aea990d99,segment=NetworkSegment(5cb8d89b-c83c-4beb-ac61-4edae91bc9e8),segment_id=5cb8d89b-c83c-4beb-ac61-4edae91bc9e8)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:32:23.712259 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ad2752cb-6b11-4e44-8570-8d1e207e4e1d tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:23.750636 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-63aa0b22-5b54-436d-a781-780b2afa06b7 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Deleting port 07c59aaf-3ba9-42e7-83af-e9e867a8860a {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:32:23.751255 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-63aa0b22-5b54-436d-a781-780b2afa06b7 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:23.767561 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad2752cb-6b11-4e44-8570-8d1e207e4e1d tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event deleted for resources: {'Subnet': ['ID=98e87e5b-5029-4179-8c5e-5a54cfdbc402,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:23.771229 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc5f5bc4-5b06-44ab-8533-a9d7ef56bce7 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event deleted for resources: {'Port': ['ID=723467bb-162d-440d-9796-0ba8fd2d6233,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:23.782619 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ad2752cb-6b11-4e44-8570-8d1e207e4e1d tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:23.786580 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-ad2752cb-6b11-4e44-8570-8d1e207e4e1d tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/98e87e5b-5029-4179-8c5e-5a54cfdbc402 HTTP/1.1" status: 204 len: 168 time: 0.6661499 Nov 09 04:32:23.788521 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56244) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:23.808839 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f8b3b1d9-f46f-4ee3-903a-df6c8ebd7006 None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:32:23.828137 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b9fa4d0f-2b92-4ee2-8fd5-c0c7f5b81612 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:23.876188 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-822fded2-bf5f-4508-ab4e-1987b861148a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Made reservation on behalf of 12e47d8445b5429892cd1b9244512ca8 for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:23.882461 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-822fded2-bf5f-4508-ab4e-1987b861148a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:23.960874 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-dc5f5bc4-5b06-44ab-8533-a9d7ef56bce7 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:23.972019 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9fa4d0f-2b92-4ee2-8fd5-c0c7f5b81612 None None] Pushing event updated for resources: {'Port': ['ID=775e1b75-6b4e-4b53-8c8d-2c5aea990d99,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:24.065342 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d8034eac-b0ec-46af-85b7-9df7104b948a tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:24.223395 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3fc23859-130e-4597-8938-ef3c61417d1d None None] DHCP port deletion for 988d2354-693c-4d52-af17-25e0643eaa0c request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:32:24.302265 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dc5f5bc4-5b06-44ab-8533-a9d7ef56bce7 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Router 6b62cf76-7264-405c-b119-c70d950c1388 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:32:24.304749 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-3fc23859-130e-4597-8938-ef3c61417d1d None None] Deleting port cf73b71e-0017-4a6d-aff1-912942f0c2fe {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:32:24.305124 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3fc23859-130e-4597-8938-ef3c61417d1d None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:24.340928 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-682f1710-74b2-4337-b4b3-42cb4ad99292 req-06b7d5ba-6ad2-4045-aa64-41ae33aa6e10 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:24.342343 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-682f1710-74b2-4337-b4b3-42cb4ad99292 req-06b7d5ba-6ad2-4045-aa64-41ae33aa6e10 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 945 time: 0.2373219 Nov 09 04:32:24.430035 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-3fc23859-130e-4597-8938-ef3c61417d1d None None] For port cf73b71e-0017-4a6d-aff1-912942f0c2fe, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=cf73b71e-0017-4a6d-aff1-912942f0c2fe,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:32:24.430575 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3fc23859-130e-4597-8938-ef3c61417d1d None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:24.445269 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-3fc23859-130e-4597-8938-ef3c61417d1d None None] Calling delete_port for cf73b71e-0017-4a6d-aff1-912942f0c2fe owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:32:24.464335 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d8034eac-b0ec-46af-85b7-9df7104b948a tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:24.471391 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dc5f5bc4-5b06-44ab-8533-a9d7ef56bce7 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:32:24.489927 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-dc5f5bc4-5b06-44ab-8533-a9d7ef56bce7 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "PUT /v2.0/routers/6b62cf76-7264-405c-b119-c70d950c1388/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 4.0349801 Nov 09 04:32:24.492685 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56250) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:24.503135 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-63aa0b22-5b54-436d-a781-780b2afa06b7 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:24.520118 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9a3b63fb-f173-4d60-baaf-26ebde41d9f6 None None] Sync routers for ids ['6b62cf76-7264-405c-b119-c70d950c1388'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:32:24.523030 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-387caea8-e8a0-462c-96a1-7c2c337a2bfc tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "GET /v2.0/ports?device_id=6b62cf76-7264-405c-b119-c70d950c1388 HTTP/1.1" status: 200 len: 205 time: 0.0292058 Nov 09 04:32:24.528391 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56252) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:24.530053 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-822fded2-bf5f-4508-ab4e-1987b861148a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 346} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:32:24.533633 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d8034eac-b0ec-46af-85b7-9df7104b948a tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:24.543487 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-63aa0b22-5b54-436d-a781-780b2afa06b7 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Calling delete_port for 07c59aaf-3ba9-42e7-83af-e9e867a8860a owned by network:router_interface {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:32:24.553981 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-363748de-6f7e-43ca-b1d6-f020d50f941d tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/routers HTTP/1.1" status: 200 len: 709 time: 0.7624993 Nov 09 04:32:24.554206 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9a3b63fb-f173-4d60-baaf-26ebde41d9f6 None None] Routers {'6b62cf76-7264-405c-b119-c70d950c1388'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:32:24.554350 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-682f1710-74b2-4337-b4b3-42cb4ad99292 req-8eaf20d3-e7cd-4f04-bb74-d443310da8b3 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1949573 Nov 09 04:32:24.561211 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56254) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:24.564529 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-9a3b63fb-f173-4d60-baaf-26ebde41d9f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:32:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['6b62cf76-7264-405c-b119-c70d950c1388'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:24.568751 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-822fded2-bf5f-4508-ab4e-1987b861148a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:24.569147 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-822fded2-bf5f-4508-ab4e-1987b861148a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Added segment b075afef-177a-45c6-aea2-b9b2a8e5703d of type vlan for network 8f3e78d2-7b2e-446f-bf17-7f6ff24daa5e Nov 09 04:32:24.630497 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aeb38d70-63e8-4b2d-9b66-8c1afa5e3553 req-a97e1bcb-dbf2-4ee4-b47b-03b1040bf2a3 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:24.631172 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-9a3b63fb-f173-4d60-baaf-26ebde41d9f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:24.635852 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-aeb38d70-63e8-4b2d-9b66-8c1afa5e3553 req-a97e1bcb-dbf2-4ee4-b47b-03b1040bf2a3 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/ports?device_id=9c4e58e3-39e4-4212-b106-50b44d4c4e28 HTTP/1.1" status: 200 len: 945 time: 0.2095094 Nov 09 04:32:24.653588 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9a3b63fb-f173-4d60-baaf-26ebde41d9f6 None None] Routers {'6b62cf76-7264-405c-b119-c70d950c1388'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:32:24.654206 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-9a3b63fb-f173-4d60-baaf-26ebde41d9f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:32:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['6b62cf76-7264-405c-b119-c70d950c1388'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:24.725074 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-822fded2-bf5f-4508-ab4e-1987b861148a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:24.747136 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-aeb38d70-63e8-4b2d-9b66-8c1afa5e3553 req-e7c0cd62-9f51-4cde-b619-21f7cf632a49 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/security-groups?id=4ff68177-77d2-4250-b11c-4d5b55fd3619&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0915802 Nov 09 04:32:24.852805 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-9a3b63fb-f173-4d60-baaf-26ebde41d9f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:24.853161 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9a3b63fb-f173-4d60-baaf-26ebde41d9f6 None None] The sync data for ids ['6b62cf76-7264-405c-b119-c70d950c1388'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:32:24.855424 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3fc23859-130e-4597-8938-ef3c61417d1d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:24.883312 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fc23859-130e-4597-8938-ef3c61417d1d None None] Pushing event deleted for resources: {'Port': ['ID=cf73b71e-0017-4a6d-aff1-912942f0c2fe,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:24.887490 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3fc23859-130e-4597-8938-ef3c61417d1d None None] No DVR routers for this DVR port cf73b71e-0017-4a6d-aff1-912942f0c2fe on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:32:24.893139 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-822fded2-bf5f-4508-ab4e-1987b861148a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:24.907807 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-822fded2-bf5f-4508-ab4e-1987b861148a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:24.908486 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-822fded2-bf5f-4508-ab4e-1987b861148a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:25.018886 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d8034eac-b0ec-46af-85b7-9df7104b948a tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:25.019976 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-d8034eac-b0ec-46af-85b7-9df7104b948a tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1760 time: 1.3315573 Nov 09 04:32:25.026890 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56260) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:25.033617 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-d9dd95b3-c1ca-42d8-aa10-8b4e6b16f237 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Request body: {'port': {'name': 'tempest-PortsTestJSON-2121756764', 'security_groups': ['8e3ca282-18c1-45bc-bc5b-d723549eb1d8'], 'network_id': 'cc397c48-c4cc-4846-a1ef-380b64be450d', 'admin_state_up': True, 'fixed_ips': [{'subnet_id': '3479ab9e-17ee-493e-93ef-61596c974f8d'}]}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:25.055954 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-822fded2-bf5f-4508-ab4e-1987b861148a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 771 time: 1.4446261 Nov 09 04:32:25.063915 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-822fded2-bf5f-4508-ab4e-1987b861148a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event updated for resources: {'Network': ['ID=8f3e78d2-7b2e-446f-bf17-7f6ff24daa5e,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:25.064384 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56262) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:25.071058 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-ed7a406c-d469-4c97-aef8-71c1cbf82b01 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Request body: {'subnet': {'network_id': '8f3e78d2-7b2e-446f-bf17-7f6ff24daa5e', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:25.079754 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 8f3e78d2-7b2e-446f-bf17-7f6ff24daa5e details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:32:25.103931 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-63aa0b22-5b54-436d-a781-780b2afa06b7 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:25.105210 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-212855d8-da7e-47b2-aa46-7b1e08553c81 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for router, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:25.126068 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8034eac-b0ec-46af-85b7-9df7104b948a tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event updated for resources: {'SecurityGroup': ['ID=8e3ca282-18c1-45bc-bc5b-d723549eb1d8,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:25.140373 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a5d0417f-b206-42c8-accd-180f0599ed4b tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for router, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:25.155037 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53a8c538-e31c-4b58-bd5b-495f0a6c7474 req-9f46299e-b62e-4012-a71e-e6b8daa95fcd tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:25.156513 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-53a8c538-e31c-4b58-bd5b-495f0a6c7474 req-9f46299e-b62e-4012-a71e-e6b8daa95fcd tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 945 time: 0.1999567 Nov 09 04:32:25.161613 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63aa0b22-5b54-436d-a781-780b2afa06b7 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Pushing event deleted for resources: {'Port': ['ID=07c59aaf-3ba9-42e7-83af-e9e867a8860a,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:25.296973 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-53a8c538-e31c-4b58-bd5b-495f0a6c7474 req-974f34af-8377-4f33-83ff-d91c566c5e54 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1286373 Nov 09 04:32:25.397692 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d9dd95b3-c1ca-42d8-aa10-8b4e6b16f237 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Made reservation on behalf of 88f9f8da29bf4a8793b45130d483a6e6 for: {'port': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:25.425334 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-63aa0b22-5b54-436d-a781-780b2afa06b7 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:25.457443 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-acf1d9a3-5774-409e-a65d-e5efe56aaafa None None] Provisioning complete for port 775e1b75-6b4e-4b53-8c8d-2c5aea990d99 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:25.458194 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-acf1d9a3-5774-409e-a65d-e5efe56aaafa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:25.538149 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-212855d8-da7e-47b2-aa46-7b1e08553c81 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:25.552377 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-acf1d9a3-5774-409e-a65d-e5efe56aaafa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:25.564592 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-212855d8-da7e-47b2-aa46-7b1e08553c81 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:25.574990 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a5d0417f-b206-42c8-accd-180f0599ed4b tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:25.579414 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a5d0417f-b206-42c8-accd-180f0599ed4b tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:25.600747 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-acf1d9a3-5774-409e-a65d-e5efe56aaafa None None] For port 775e1b75-6b4e-4b53-8c8d-2c5aea990d99, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=775e1b75-6b4e-4b53-8c8d-2c5aea990d99,segment=NetworkSegment(5cb8d89b-c83c-4beb-ac61-4edae91bc9e8),segment_id=5cb8d89b-c83c-4beb-ac61-4edae91bc9e8)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:32:25.621913 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d9dd95b3-c1ca-42d8-aa10-8b4e6b16f237 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:25.662776 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-acf1d9a3-5774-409e-a65d-e5efe56aaafa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:25.668808 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [None req-d9dd95b3-c1ca-42d8-aa10-8b4e6b16f237 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] device_id is not set on port 40862cdd-67e2-4a4b-b626-fc77daba8868 yet. {{(pid=102161) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:32:25.669545 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 775e1b75-6b4e-4b53-8c8d-2c5aea990d99 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:32:25.682437 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-63aa0b22-5b54-436d-a781-780b2afa06b7 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Router 1f829b23-19d3-4aa7-98b0-5096e56cda7c has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:32:25.721809 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-acf1d9a3-5774-409e-a65d-e5efe56aaafa None None] Provisioning complete for port a4de75ae-2dab-4896-8d2a-cdfef3f44fab triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:25.722174 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-acf1d9a3-5774-409e-a65d-e5efe56aaafa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:25.726054 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-212855d8-da7e-47b2-aa46-7b1e08553c81 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:25.726765 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-212855d8-da7e-47b2-aa46-7b1e08553c81 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Fanout notify agent at l3_agent the message router_deleted on router e32c32b3-649c-4478-b86a-b410c5d84442 {{(pid=102162) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:32:25.739088 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-212855d8-da7e-47b2-aa46-7b1e08553c81 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:25.741425 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-212855d8-da7e-47b2-aa46-7b1e08553c81 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/routers/e32c32b3-649c-4478-b86a-b410c5d84442 HTTP/1.1" status: 204 len: 168 time: 1.1468296 Nov 09 04:32:25.744264 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a5d0417f-b206-42c8-accd-180f0599ed4b tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:25.744889 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a5d0417f-b206-42c8-accd-180f0599ed4b tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Fanout notify agent at l3_agent the message router_deleted on router 6b62cf76-7264-405c-b119-c70d950c1388 {{(pid=102162) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:32:25.746568 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56264) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:25.747254 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ed7a406c-d469-4c97-aef8-71c1cbf82b01 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Made reservation on behalf of 12e47d8445b5429892cd1b9244512ca8 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:25.755921 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ed7a406c-d469-4c97-aef8-71c1cbf82b01 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:25.761031 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-00f0b246-1b75-402f-a4ac-08e4e6e4b26e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'subnet': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:25.774664 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a5d0417f-b206-42c8-accd-180f0599ed4b tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:25.779053 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a5d0417f-b206-42c8-accd-180f0599ed4b tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "DELETE /v2.0/routers/6b62cf76-7264-405c-b119-c70d950c1388 HTTP/1.1" status: 204 len: 168 time: 1.2441361 Nov 09 04:32:25.796117 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56268) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:25.796558 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acf1d9a3-5774-409e-a65d-e5efe56aaafa None None] Pushing event updated for resources: {'Port': ['ID=775e1b75-6b4e-4b53-8c8d-2c5aea990d99,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:25.803266 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-acf1d9a3-5774-409e-a65d-e5efe56aaafa None None] Port a4de75ae-2dab-4896-8d2a-cdfef3f44fab cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:32:25.813828 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 775e1b75-6b4e-4b53-8c8d-2c5aea990d99 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:25.814204 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:25.901481 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-63aa0b22-5b54-436d-a781-780b2afa06b7 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:32:25.914903 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-63aa0b22-5b54-436d-a781-780b2afa06b7 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] 10.222.0.24 "PUT /v2.0/routers/1f829b23-19d3-4aa7-98b0-5096e56cda7c/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.4807065 Nov 09 04:32:25.915073 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-96a79fa8-1185-4055-9b9d-b3aea9a563a0 None None] Sync routers for ids ['1f829b23-19d3-4aa7-98b0-5096e56cda7c'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:32:25.918172 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56270) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:25.937151 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-96a79fa8-1185-4055-9b9d-b3aea9a563a0 None None] Routers {'1f829b23-19d3-4aa7-98b0-5096e56cda7c'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:32:25.942128 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-96a79fa8-1185-4055-9b9d-b3aea9a563a0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:32:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['1f829b23-19d3-4aa7-98b0-5096e56cda7c'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:26.001093 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-9ced0650-3d67-4fed-af43-19e31f4c7ffe tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Deleting subnet adf8b20e-473c-44ad-9d34-b1b2c888a296 {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:32:26.008984 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-96a79fa8-1185-4055-9b9d-b3aea9a563a0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:26.009214 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-374104a9-9d9e-42f0-9578-f7f9a236a400 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] delete failed (client error): The resource could not be found. Nov 09 04:32:26.010971 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-374104a9-9d9e-42f0-9578-f7f9a236a400 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] 10.222.0.24 "DELETE /v2.0/routers/tempest-non_exist_router-637923238 HTTP/1.1" status: 404 len: 334 time: 0.0918453 Nov 09 04:32:26.014077 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9ced0650-3d67-4fed-af43-19e31f4c7ffe tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:26.016064 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56272) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:26.017193 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device cf73b71e-0017-4a6d-aff1-912942f0c2fe no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:32:26.023854 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-a359c3de-c26f-49b6-a368-9cb1eb447d9a tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Request body: {'router': {'external_gateway_info': {'network_id': '1f829b23-19d3-4aa7-98b0-5096e56cda7c'}}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:26.031511 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-96a79fa8-1185-4055-9b9d-b3aea9a563a0 None None] Routers {'1f829b23-19d3-4aa7-98b0-5096e56cda7c'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:32:26.032398 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-96a79fa8-1185-4055-9b9d-b3aea9a563a0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:32:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['1f829b23-19d3-4aa7-98b0-5096e56cda7c'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:26.044163 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: cf73b71e-0017-4a6d-aff1-912942f0c2fe {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:32:26.044869 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device cf73b71e-0017-4a6d-aff1-912942f0c2fe not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:32:26.045533 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 235156de-a96d-45b6-b3b1-096d4e0072c3 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:32:26.055659 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9da3a5da-fe1b-4575-abb5-8c0a5db388dd req-08cbde51-5312-4bfe-aba9-02356f843c3c tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:26.057225 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9da3a5da-fe1b-4575-abb5-8c0a5db388dd req-08cbde51-5312-4bfe-aba9-02356f843c3c tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/ports?device_id=9c4e58e3-39e4-4212-b106-50b44d4c4e28 HTTP/1.1" status: 200 len: 945 time: 0.1324334 Nov 09 04:32:26.068370 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 235156de-a96d-45b6-b3b1-096d4e0072c3 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:32:26.069048 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 235156de-a96d-45b6-b3b1-096d4e0072c3 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:32:26.087172 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-96a79fa8-1185-4055-9b9d-b3aea9a563a0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:26.088489 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-96a79fa8-1185-4055-9b9d-b3aea9a563a0 None None] The sync data for ids ['1f829b23-19d3-4aa7-98b0-5096e56cda7c'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:32:26.132027 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-d9dd95b3-c1ca-42d8-aa10-8b4e6b16f237 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Allocated IP 172.20.0.9 (cc397c48-c4cc-4846-a1ef-380b64be450d/3479ab9e-17ee-493e-93ef-61596c974f8d/40862cdd-67e2-4a4b-b626-fc77daba8868) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:32:26.143371 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9ced0650-3d67-4fed-af43-19e31f4c7ffe tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:26.167685 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-00f0b246-1b75-402f-a4ac-08e4e6e4b26e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:26.171136 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-00f0b246-1b75-402f-a4ac-08e4e6e4b26e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:26.185941 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9da3a5da-fe1b-4575-abb5-8c0a5db388dd req-a3302fed-a035-45d4-bd62-330c3a5e2a19 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/security-groups?id=4ff68177-77d2-4250-b11c-4d5b55fd3619&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1201181 Nov 09 04:32:26.341834 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ed7a406c-d469-4c97-aef8-71c1cbf82b01 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:26.421013 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a359c3de-c26f-49b6-a368-9cb1eb447d9a tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:26.440711 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed7a406c-d469-4c97-aef8-71c1cbf82b01 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event updated for resources: {'Subnet': ['ID=b197c77c-5641-42b9-8c7b-8025e4dab56c,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:26.469483 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed7a406c-d469-4c97-aef8-71c1cbf82b01 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Checking segment: {'id': 'b075afef-177a-45c6-aea2-b9b2a8e5703d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 346, 'network_id': '8f3e78d2-7b2e-446f-bf17-7f6ff24daa5e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:32:26.469847 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ed7a406c-d469-4c97-aef8-71c1cbf82b01 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Network hostable DHCP agents. Network: 8f3e78d2-7b2e-446f-bf17-7f6ff24daa5e, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:32:26.484286 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9ced0650-3d67-4fed-af43-19e31f4c7ffe tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:26.529205 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d9dd95b3-c1ca-42d8-aa10-8b4e6b16f237 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:26.537168 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-00f0b246-1b75-402f-a4ac-08e4e6e4b26e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:26.542279 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-a359c3de-c26f-49b6-a368-9cb1eb447d9a tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] update failed (client error): The resource could not be found. Nov 09 04:32:26.543339 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a359c3de-c26f-49b6-a368-9cb1eb447d9a tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] 10.222.0.24 "PUT /v2.0/routers/1f829b23-19d3-4aa7-98b0-5096e56cda7c HTTP/1.1" status: 404 len: 339 time: 0.5230641 Nov 09 04:32:26.547176 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56276) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:26.563883 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4c6da78-6924-47ea-b089-22bc5aa2ce81 req-4ac115a5-57d7-4e32-9226-82d10bb067ef tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:26.565404 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c4c6da78-6924-47ea-b089-22bc5aa2ce81 req-4ac115a5-57d7-4e32-9226-82d10bb067ef tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 945 time: 0.1766136 Nov 09 04:32:26.582879 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ed7a406c-d469-4c97-aef8-71c1cbf82b01 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Network 8f3e78d2-7b2e-446f-bf17-7f6ff24daa5e is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:32:26.637425 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c4c6da78-6924-47ea-b089-22bc5aa2ce81 req-b63e8181-d537-4902-81a6-7936125d3382 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0631609 Nov 09 04:32:26.658495 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-00f0b246-1b75-402f-a4ac-08e4e6e4b26e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:26.665362 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-00f0b246-1b75-402f-a4ac-08e4e6e4b26e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:26.668999 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9ced0650-3d67-4fed-af43-19e31f4c7ffe tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:26.670814 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-00f0b246-1b75-402f-a4ac-08e4e6e4b26e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:26.679113 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-00f0b246-1b75-402f-a4ac-08e4e6e4b26e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:26.680236 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8140754b-cacb-4734-bc80-d7db32c9752a None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:32:26.682768 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00f0b246-1b75-402f-a4ac-08e4e6e4b26e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Subnet': ['ID=f01a9e64-acbf-4c7c-800c-5ec2adc6fdff,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:26.706542 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ced0650-3d67-4fed-af43-19e31f4c7ffe tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event deleted for resources: {'Subnet': ['ID=adf8b20e-473c-44ad-9d34-b1b2c888a296,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:26.711694 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9ced0650-3d67-4fed-af43-19e31f4c7ffe tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:26.715474 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-9ced0650-3d67-4fed-af43-19e31f4c7ffe tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "DELETE /v2.0/subnets/adf8b20e-473c-44ad-9d34-b1b2c888a296 HTTP/1.1" status: 204 len: 168 time: 0.9169312 Nov 09 04:32:26.716687 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d9dd95b3-c1ca-42d8-aa10-8b4e6b16f237 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:26.718569 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56280) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:26.734315 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aa382faf-8c5b-4094-9273-874b86664dae None None] Network f13b9063-d49d-4d06-9927-5d96599dbf36 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:32:26.764612 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-ed7a406c-d469-4c97-aef8-71c1cbf82b01 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 8f3e78d2-7b2e-446f-bf17-7f6ff24daa5e) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:26.784732 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-318d8bae-bff2-4c84-85fe-641f5950eff8 None None] Network 8f3e78d2-7b2e-446f-bf17-7f6ff24daa5e requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:32:26.788221 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ed7a406c-d469-4c97-aef8-71c1cbf82b01 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:26.788817 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ed7a406c-d469-4c97-aef8-71c1cbf82b01 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:26.837349 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d9dd95b3-c1ca-42d8-aa10-8b4e6b16f237 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Network cc397c48-c4cc-4846-a1ef-380b64be450d is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:26.854016 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-d9dd95b3-c1ca-42d8-aa10-8b4e6b16f237 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:26.857842 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9dd95b3-c1ca-42d8-aa10-8b4e6b16f237 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event updated for resources: {'Port': ['ID=40862cdd-67e2-4a4b-b626-fc77daba8868,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:26.862159 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d9dd95b3-c1ca-42d8-aa10-8b4e6b16f237 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:32:26.880009 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-903536be-f37c-431c-bb7e-8ad961262a4f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:26.880144 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-00f0b246-1b75-402f-a4ac-08e4e6e4b26e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 1.1151068 Nov 09 04:32:26.880144 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56282) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:26.880144 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-ae23a97e-7e62-4983-bbe2-7bd9db461c01 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'router': {'name': 'tempest-NetworksTestDHCPv6-router-94262758', 'external_gateway_info': {}, 'admin_state_up': True}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:26.919817 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b72e82fd-0417-4022-b773-17af86431570 req-ecdbb48c-5551-40b5-8b5f-602f2797274c tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:26.921838 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b72e82fd-0417-4022-b773-17af86431570 req-ecdbb48c-5551-40b5-8b5f-602f2797274c tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 945 time: 0.1982591 Nov 09 04:32:26.954096 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d9dd95b3-c1ca-42d8-aa10-8b4e6b16f237 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:26.955458 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d9dd95b3-c1ca-42d8-aa10-8b4e6b16f237 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:26.987111 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-ed7a406c-d469-4c97-aef8-71c1cbf82b01 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.9212999 Nov 09 04:32:26.990871 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56284) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:26.998478 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-af8a2217-bc9c-49a2-8dc8-735b9583b894 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Request body: {'subnet': {'network_id': '8f3e78d2-7b2e-446f-bf17-7f6ff24daa5e', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:26.998766 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-903536be-f37c-431c-bb7e-8ad961262a4f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Deleting port 29e1d202-6531-4c31-84ef-22c38324e054 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:32:26.999510 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-903536be-f37c-431c-bb7e-8ad961262a4f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:27.055287 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ae23a97e-7e62-4983-bbe2-7bd9db461c01 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:27.056475 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ae23a97e-7e62-4983-bbe2-7bd9db461c01 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:27.080053 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-903536be-f37c-431c-bb7e-8ad961262a4f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] For port 29e1d202-6531-4c31-84ef-22c38324e054, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=29e1d202-6531-4c31-84ef-22c38324e054,segment=NetworkSegment(ae912d78-94a1-4dc6-b6d3-fe081af3dd50),segment_id=ae912d78-94a1-4dc6-b6d3-fe081af3dd50)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:32:27.080742 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-903536be-f37c-431c-bb7e-8ad961262a4f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:27.097309 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-903536be-f37c-431c-bb7e-8ad961262a4f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Calling delete_port for 29e1d202-6531-4c31-84ef-22c38324e054 owned by network:dhcp {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:32:27.114192 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9b58d2f3-dda3-4586-b50f-0004639b33bc None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-988d2354-693c-4d52-af17-25e0643eaa0c', 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'tenant_id': '8b0758f781884982bf5b94e6609237f6', 'fixed_ips': [{'subnet_id': 'f01a9e64-acbf-4c7c-800c-5ec2adc6fdff'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:32:27.119395 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9b58d2f3-dda3-4586-b50f-0004639b33bc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:27.152022 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-38062f8f-b4d4-45a8-8963-e84a5b3814b1 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-8f3e78d2-7b2e-446f-bf17-7f6ff24daa5e', 'network_id': '8f3e78d2-7b2e-446f-bf17-7f6ff24daa5e', 'tenant_id': '12e47d8445b5429892cd1b9244512ca8', 'fixed_ips': [{'subnet_id': 'b197c77c-5641-42b9-8c7b-8025e4dab56c'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:32:27.153336 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-38062f8f-b4d4-45a8-8963-e84a5b3814b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:27.155866 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-d9dd95b3-c1ca-42d8-aa10-8b4e6b16f237 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 924 time: 2.1263242 Nov 09 04:32:27.158627 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56286) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:27.161555 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-15334271-825e-4ceb-86c4-0d7e1bd9db00 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:27.163820 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-db7106fe-5019-4d35-944b-86089115b18d tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Request body: {'subnet': {'network_id': 'cc397c48-c4cc-4846-a1ef-380b64be450d', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:27.186433 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b72e82fd-0417-4022-b773-17af86431570 req-b4b3340a-de87-4fdb-be9a-06e70227edb3 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2518277 Nov 09 04:32:27.236225 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ae23a97e-7e62-4983-bbe2-7bd9db461c01 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:27.356762 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c729111b-f501-4316-abbf-6e2f1b3e7f97 None None] DHCP port deletion for f13b9063-d49d-4d06-9927-5d96599dbf36 request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:32:27.372095 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-9b58d2f3-dda3-4586-b50f-0004639b33bc None None] Allocated IP 2001:db8::2 (988d2354-693c-4d52-af17-25e0643eaa0c/f01a9e64-acbf-4c7c-800c-5ec2adc6fdff/475084e5-a1f4-489d-aaad-e5c375775a1b) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:32:27.487682 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-167507ae-c2bf-456c-929d-7a79fafbb877 None None] Provisioning complete for port 40862cdd-67e2-4a4b-b626-fc77daba8868 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:27.487953 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-167507ae-c2bf-456c-929d-7a79fafbb877 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:27.491746 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ae23a97e-7e62-4983-bbe2-7bd9db461c01 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:27.588568 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-167507ae-c2bf-456c-929d-7a79fafbb877 None None] Port 40862cdd-67e2-4a4b-b626-fc77daba8868 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:32:27.604549 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d8cb4bd-8170-410f-873b-b009a124f3c3 req-dac1fe62-c634-4dc1-8727-018e7446ead3 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:27.612165 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2d8cb4bd-8170-410f-873b-b009a124f3c3 req-dac1fe62-c634-4dc1-8727-018e7446ead3 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 945 time: 0.2756541 Nov 09 04:32:27.631603 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-af8a2217-bc9c-49a2-8dc8-735b9583b894 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Made reservation on behalf of 12e47d8445b5429892cd1b9244512ca8 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:27.637349 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-af8a2217-bc9c-49a2-8dc8-735b9583b894 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:27.675990 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 775e1b75-6b4e-4b53-8c8d-2c5aea990d99 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:32:27.690781 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-15334271-825e-4ceb-86c4-0d7e1bd9db00 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Allocated IP 172.20.0.1 (3f7c1cab-fc9e-407c-99b6-915196a89a79/44ed129a-8e24-4400-8a39-18df545f0a06/b2e44f0e-0ca9-431b-9da8-d24e82cb3044) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:32:27.695704 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ae23a97e-7e62-4983-bbe2-7bd9db461c01 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:27.696931 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-ae23a97e-7e62-4983-bbe2-7bd9db461c01 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 704 time: 0.8221269 Nov 09 04:32:27.704050 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56292) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:27.716481 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-38062f8f-b4d4-45a8-8963-e84a5b3814b1 None None] Allocated IP 2001:db8::2 (8f3e78d2-7b2e-446f-bf17-7f6ff24daa5e/b197c77c-5641-42b9-8c7b-8025e4dab56c/bb3407cb-b257-46ba-b15b-69a174e46e25) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:32:27.778764 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2d8cb4bd-8170-410f-873b-b009a124f3c3 req-7ef70c71-3798-4af4-bea4-177659b97af1 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1654730 Nov 09 04:32:27.782151 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-c729111b-f501-4316-abbf-6e2f1b3e7f97 None None] Deleting port 29e1d202-6531-4c31-84ef-22c38324e054 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:32:27.783300 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c729111b-f501-4316-abbf-6e2f1b3e7f97 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:27.826020 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe81ece1-7383-4664-83cb-c190e70dbbd9 req-922d0dea-eea5-4024-9d2e-f5a4efda4ca1 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:27.830789 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-fe81ece1-7383-4664-83cb-c190e70dbbd9 req-922d0dea-eea5-4024-9d2e-f5a4efda4ca1 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/ports?device_id=9c4e58e3-39e4-4212-b106-50b44d4c4e28 HTTP/1.1" status: 200 len: 945 time: 0.5155280 Nov 09 04:32:27.868492 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.ipam_backend_mixin [None req-af8a2217-bc9c-49a2-8dc8-735b9583b894 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet b197c77c-5641-42b9-8c7b-8025e4dab56c (CIDR: 2001:db8::/64) Nov 09 04:32:27.914485 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9b58d2f3-dda3-4586-b50f-0004639b33bc None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:27.926255 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-af8a2217-bc9c-49a2-8dc8-735b9583b894 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:32:27.927048 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-af8a2217-bc9c-49a2-8dc8-735b9583b894 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:32:27.944972 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-903536be-f37c-431c-bb7e-8ad961262a4f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:27.990075 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9b58d2f3-dda3-4586-b50f-0004639b33bc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:27.990310 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-15334271-825e-4ceb-86c4-0d7e1bd9db00 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:28.008244 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe6b303e-ae00-408d-afdd-89e7b7c15542 req-97bb7d40-f32d-4a27-b2c1-ea6f20ce80c0 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:28.010596 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fe6b303e-ae00-408d-afdd-89e7b7c15542 req-97bb7d40-f32d-4a27-b2c1-ea6f20ce80c0 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 945 time: 0.1170728 Nov 09 04:32:28.011539 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-c729111b-f501-4316-abbf-6e2f1b3e7f97 None None] For port 29e1d202-6531-4c31-84ef-22c38324e054, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=29e1d202-6531-4c31-84ef-22c38324e054,segment=NetworkSegment(ae912d78-94a1-4dc6-b6d3-fe081af3dd50),segment_id=ae912d78-94a1-4dc6-b6d3-fe081af3dd50)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:32:28.012088 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c729111b-f501-4316-abbf-6e2f1b3e7f97 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:28.067129 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9b58d2f3-dda3-4586-b50f-0004639b33bc None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:28.076981 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-9b58d2f3-dda3-4586-b50f-0004639b33bc None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:28.078191 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-af8a2217-bc9c-49a2-8dc8-735b9583b894 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 1.0838048 Nov 09 04:32:28.081725 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56300) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:28.084380 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-c729111b-f501-4316-abbf-6e2f1b3e7f97 None None] Calling delete_port for 29e1d202-6531-4c31-84ef-22c38324e054 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:32:28.087049 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-1db82bae-8d32-46c7-ad11-b132b7df8145 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Request body: {'subnet': {'network_id': '8f3e78d2-7b2e-446f-bf17-7f6ff24daa5e', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:28.091616 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b58d2f3-dda3-4586-b50f-0004639b33bc None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:32:28.122125 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-15334271-825e-4ceb-86c4-0d7e1bd9db00 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:28.136668 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-903536be-f37c-431c-bb7e-8ad961262a4f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event deleted for resources: {'Port': ['ID=29e1d202-6531-4c31-84ef-22c38324e054,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:28.139218 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-db7106fe-5019-4d35-944b-86089115b18d tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Made reservation on behalf of 88f9f8da29bf4a8793b45130d483a6e6 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:28.140443 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fe6b303e-ae00-408d-afdd-89e7b7c15542 req-e0886d8e-a811-4b24-a25c-38c304c67f87 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1011496 Nov 09 04:32:28.166831 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-db7106fe-5019-4d35-944b-86089115b18d tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:28.166831 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-903536be-f37c-431c-bb7e-8ad961262a4f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] No DVR routers for this DVR port 29e1d202-6531-4c31-84ef-22c38324e054 on host dv-neutron-816802-2-hyperv {{(pid=102161) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:32:28.180531 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-fe81ece1-7383-4664-83cb-c190e70dbbd9 req-59132f5c-483a-488b-aeb6-7255c1f7d976 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/security-groups?id=4ff68177-77d2-4250-b11c-4d5b55fd3619&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2935808 Nov 09 04:32:28.180744 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 775e1b75-6b4e-4b53-8c8d-2c5aea990d99 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:28.180744 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:28.209841 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-15334271-825e-4ceb-86c4-0d7e1bd9db00 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Network 3f7c1cab-fc9e-407c-99b6-915196a89a79 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:28.215663 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-15334271-825e-4ceb-86c4-0d7e1bd9db00 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:28.225018 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-15334271-825e-4ceb-86c4-0d7e1bd9db00 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:32:28.241063 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3a13c14c-ec14-4859-8541-1676fc84dffa tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:28.253934 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b58d2f3-dda3-4586-b50f-0004639b33bc None None] Pushing event updated for resources: {'Port': ['ID=475084e5-a1f4-489d-aaad-e5c375775a1b,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:28.298414 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15334271-825e-4ceb-86c4-0d7e1bd9db00 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Pushing event updated for resources: {'Port': ['ID=b2e44f0e-0ca9-431b-9da8-d24e82cb3044,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:28.333534 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-15334271-825e-4ceb-86c4-0d7e1bd9db00 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:28.400960 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-903536be-f37c-431c-bb7e-8ad961262a4f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:28.434882 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1db82bae-8d32-46c7-ad11-b132b7df8145 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Made reservation on behalf of 12e47d8445b5429892cd1b9244512ca8 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:28.439334 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1db82bae-8d32-46c7-ad11-b132b7df8145 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:28.463071 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-9b58d2f3-dda3-4586-b50f-0004639b33bc None None] Attempting to bind port 475084e5-a1f4-489d-aaad-e5c375775a1b on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:32:28.463453 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-9b58d2f3-dda3-4586-b50f-0004639b33bc None None] Attempting to bind port 475084e5-a1f4-489d-aaad-e5c375775a1b by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:32:28.463815 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9b58d2f3-dda3-4586-b50f-0004639b33bc None None] Attempting to bind port 475084e5-a1f4-489d-aaad-e5c375775a1b on network 988d2354-693c-4d52-af17-25e0643eaa0c {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:32:28.496599 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9b58d2f3-dda3-4586-b50f-0004639b33bc None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 32, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:32:28.496887 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9b58d2f3-dda3-4586-b50f-0004639b33bc None None] Checking segment: {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:32:28.497281 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9b58d2f3-dda3-4586-b50f-0004639b33bc None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:28.497666 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9b58d2f3-dda3-4586-b50f-0004639b33bc None None] Bound using segment: {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:32:28.498143 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-9b58d2f3-dda3-4586-b50f-0004639b33bc None None] Bound port: 475084e5-a1f4-489d-aaad-e5c375775a1b, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:32:28.498542 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9b58d2f3-dda3-4586-b50f-0004639b33bc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:28.522820 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-38062f8f-b4d4-45a8-8963-e84a5b3814b1 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:28.560918 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-903536be-f37c-431c-bb7e-8ad961262a4f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f13b9063-d49d-4d06-9927-5d96599dbf36']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:28.613596 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-903536be-f37c-431c-bb7e-8ad961262a4f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ae912d78-94a1-4dc6-b6d3-fe081af3dd50') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:28.619587 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-903536be-f37c-431c-bb7e-8ad961262a4f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ae912d78-94a1-4dc6-b6d3-fe081af3dd50') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:28.633255 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-15334271-825e-4ceb-86c4-0d7e1bd9db00 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:28.640692 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-903536be-f37c-431c-bb7e-8ad961262a4f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:28.696170 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-903536be-f37c-431c-bb7e-8ad961262a4f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:28.712487 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.ipam_backend_mixin [None req-db7106fe-5019-4d35-944b-86089115b18d tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Validation for CIDR: 172.20.0.0/28 failed - overlaps with subnet 3479ab9e-17ee-493e-93ef-61596c974f8d (CIDR: 172.20.0.0/28) Nov 09 04:32:28.721366 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-903536be-f37c-431c-bb7e-8ad961262a4f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Releasing vlan 331 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:32:28.721776 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-903536be-f37c-431c-bb7e-8ad961262a4f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:28.725063 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:32:28.725063 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:32:28.725063 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:32:28.725063 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:32:28.725063 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:32:28.725063 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:32:28.725063 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:32:28.725063 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:32:28.725063 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:32:28.725063 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:32:28.725063 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:32:28.725063 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:32:28.725063 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:32:28.725063 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:32:28.725063 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:32:28.725063 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:32:28.725063 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:32:28.725063 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:32:28.725063 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:32:28.725063 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:32:28.725063 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:32:28.725063 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:32:28.725063 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:32:28.725063 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:32:28.725063 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:32:28.725063 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:32:28.725063 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:32:28.725063 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:32:28.725063 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:32:28.725063 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:32:28.725063 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:32:28.725063 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:32:28.735759 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c729111b-f501-4316-abbf-6e2f1b3e7f97 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:28.780194 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-db7106fe-5019-4d35-944b-86089115b18d tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:32:28.780634 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-db7106fe-5019-4d35-944b-86089115b18d tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:32:28.804907 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c729111b-f501-4316-abbf-6e2f1b3e7f97 None None] No DVR routers for this DVR port 29e1d202-6531-4c31-84ef-22c38324e054 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:32:28.809661 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-fec3db9d-2f32-4ccb-a9d1-7dc222341884 None None] Provisioning complete for port b2e44f0e-0ca9-431b-9da8-d24e82cb3044 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:28.810148 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-fec3db9d-2f32-4ccb-a9d1-7dc222341884 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:28.813066 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c729111b-f501-4316-abbf-6e2f1b3e7f97 None None] Pushing event deleted for resources: {'Port': ['ID=29e1d202-6531-4c31-84ef-22c38324e054,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:28.823969 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-38062f8f-b4d4-45a8-8963-e84a5b3814b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:28.857973 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-3a13c14c-ec14-4859-8541-1676fc84dffa tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Allocated IP 2001:db8::1 (988d2354-693c-4d52-af17-25e0643eaa0c/f01a9e64-acbf-4c7c-800c-5ec2adc6fdff/80086735-c739-415d-8466-93db6194fe50) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:32:28.910752 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-903536be-f37c-431c-bb7e-8ad961262a4f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:28.923157 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-9b58d2f3-dda3-4586-b50f-0004639b33bc None None] For port 475084e5-a1f4-489d-aaad-e5c375775a1b, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:32:28.926244 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-903536be-f37c-431c-bb7e-8ad961262a4f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:28.928773 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-38062f8f-b4d4-45a8-8963-e84a5b3814b1 None None] Network 8f3e78d2-7b2e-446f-bf17-7f6ff24daa5e is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:28.929898 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-903536be-f37c-431c-bb7e-8ad961262a4f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "DELETE /v2.0/networks/f13b9063-d49d-4d06-9927-5d96599dbf36 HTTP/1.1" status: 204 len: 168 time: 2.2103591 Nov 09 04:32:28.947642 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-db7106fe-5019-4d35-944b-86089115b18d tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 1.7851491 Nov 09 04:32:28.947858 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-9b58d2f3-dda3-4586-b50f-0004639b33bc None None] For port 475084e5-a1f4-489d-aaad-e5c375775a1b, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=475084e5-a1f4-489d-aaad-e5c375775a1b,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:32:28.949207 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-38062f8f-b4d4-45a8-8963-e84a5b3814b1 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:28.951882 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-38062f8f-b4d4-45a8-8963-e84a5b3814b1 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:32:28.953565 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56304) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:28.953721 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56306) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:28.960566 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-fec3db9d-2f32-4ccb-a9d1-7dc222341884 None None] Port b2e44f0e-0ca9-431b-9da8-d24e82cb3044 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:32:28.963089 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-49c033c4-6563-4e4d-a350-0320a3c9ae13 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-1490827103', 'external_gateway_info': {}, 'admin_state_up': True}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:28.968381 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38062f8f-b4d4-45a8-8963-e84a5b3814b1 None None] Pushing event updated for resources: {'Port': ['ID=bb3407cb-b257-46ba-b15b-69a174e46e25,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:29.007646 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-5a68a921-51a0-4bce-851e-d88823846716 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Request body: {'subnet': {'network_id': 'cc397c48-c4cc-4846-a1ef-380b64be450d', 'cidr': '172.20.0.16/28', 'ip_version': 4, 'gateway_ip': '172.20.0.17'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:29.011918 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-903536be-f37c-431c-bb7e-8ad961262a4f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event deleted for resources: {'Network': ['ID=f13b9063-d49d-4d06-9927-5d96599dbf36,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:29.015133 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9b58d2f3-dda3-4586-b50f-0004639b33bc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:29.057409 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 29e1d202-6531-4c31-84ef-22c38324e054 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:32:29.090035 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-38062f8f-b4d4-45a8-8963-e84a5b3814b1 None None] Attempting to bind port bb3407cb-b257-46ba-b15b-69a174e46e25 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:32:29.090698 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-38062f8f-b4d4-45a8-8963-e84a5b3814b1 None None] Attempting to bind port bb3407cb-b257-46ba-b15b-69a174e46e25 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'b075afef-177a-45c6-aea2-b9b2a8e5703d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 346, 'network_id': '8f3e78d2-7b2e-446f-bf17-7f6ff24daa5e'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:32:29.091160 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-38062f8f-b4d4-45a8-8963-e84a5b3814b1 None None] Attempting to bind port bb3407cb-b257-46ba-b15b-69a174e46e25 on network 8f3e78d2-7b2e-446f-bf17-7f6ff24daa5e {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:32:29.099728 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 29e1d202-6531-4c31-84ef-22c38324e054 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:32:29.099728 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 29e1d202-6531-4c31-84ef-22c38324e054 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:32:29.120203 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-38062f8f-b4d4-45a8-8963-e84a5b3814b1 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 32, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:32:29.121151 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-38062f8f-b4d4-45a8-8963-e84a5b3814b1 None None] Checking segment: {'id': 'b075afef-177a-45c6-aea2-b9b2a8e5703d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 346, 'network_id': '8f3e78d2-7b2e-446f-bf17-7f6ff24daa5e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:32:29.121151 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-38062f8f-b4d4-45a8-8963-e84a5b3814b1 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:29.121727 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-38062f8f-b4d4-45a8-8963-e84a5b3814b1 None None] Bound using segment: {'id': 'b075afef-177a-45c6-aea2-b9b2a8e5703d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 346, 'network_id': '8f3e78d2-7b2e-446f-bf17-7f6ff24daa5e'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:32:29.122801 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-38062f8f-b4d4-45a8-8963-e84a5b3814b1 None None] Bound port: bb3407cb-b257-46ba-b15b-69a174e46e25, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b075afef-177a-45c6-aea2-b9b2a8e5703d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 346, 'network_id': '8f3e78d2-7b2e-446f-bf17-7f6ff24daa5e'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:32:29.122801 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-38062f8f-b4d4-45a8-8963-e84a5b3814b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:29.147739 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b58d2f3-dda3-4586-b50f-0004639b33bc None None] Pushing event updated for resources: {'Port': ['ID=475084e5-a1f4-489d-aaad-e5c375775a1b,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:29.178301 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3a13c14c-ec14-4859-8541-1676fc84dffa tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:29.193554 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-49c033c4-6563-4e4d-a350-0320a3c9ae13 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:29.195209 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-49c033c4-6563-4e4d-a350-0320a3c9ae13 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:29.229617 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-38062f8f-b4d4-45a8-8963-e84a5b3814b1 None None] For port bb3407cb-b257-46ba-b15b-69a174e46e25, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:32:29.234278 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-38062f8f-b4d4-45a8-8963-e84a5b3814b1 None None] For port bb3407cb-b257-46ba-b15b-69a174e46e25, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=bb3407cb-b257-46ba-b15b-69a174e46e25,segment=NetworkSegment(b075afef-177a-45c6-aea2-b9b2a8e5703d),segment_id=b075afef-177a-45c6-aea2-b9b2a8e5703d)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:32:29.253335 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f4b9e8a-7490-42c4-9a6c-cf5ecbb1d067 req-703a3ade-1d64-4596-8ed9-98706d81d7a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:29.254880 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6f4b9e8a-7490-42c4-9a6c-cf5ecbb1d067 req-703a3ade-1d64-4596-8ed9-98706d81d7a3 service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=9c4e58e3-39e4-4212-b106-50b44d4c4e28 HTTP/1.1" status: 200 len: 1098 time: 0.0976954 Nov 09 04:32:29.293720 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-49c033c4-6563-4e4d-a350-0320a3c9ae13 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:29.336791 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-38062f8f-b4d4-45a8-8963-e84a5b3814b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:29.351358 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1db82bae-8d32-46c7-ad11-b132b7df8145 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:29.396782 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-49c033c4-6563-4e4d-a350-0320a3c9ae13 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:29.420649 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3a13c14c-ec14-4859-8541-1676fc84dffa tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:29.421107 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38062f8f-b4d4-45a8-8963-e84a5b3814b1 None None] Pushing event updated for resources: {'Port': ['ID=bb3407cb-b257-46ba-b15b-69a174e46e25,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:29.439669 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5a68a921-51a0-4bce-851e-d88823846716 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Made reservation on behalf of 88f9f8da29bf4a8793b45130d483a6e6 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:29.443742 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5a68a921-51a0-4bce-851e-d88823846716 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:29.489299 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1db82bae-8d32-46c7-ad11-b132b7df8145 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Network 8f3e78d2-7b2e-446f-bf17-7f6ff24daa5e is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:29.505953 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3a13c14c-ec14-4859-8541-1676fc84dffa tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:29.515328 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-3a13c14c-ec14-4859-8541-1676fc84dffa tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:29.520156 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcb5dca5-806d-4902-84c1-033d2b57ec27 req-7fcb7db6-f765-452a-981b-9278e43ec3fd tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:29.521702 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-bcb5dca5-806d-4902-84c1-033d2b57ec27 req-7fcb7db6-f765-452a-981b-9278e43ec3fd tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/ports?device_id=9c4e58e3-39e4-4212-b106-50b44d4c4e28 HTTP/1.1" status: 200 len: 945 time: 0.2485611 Nov 09 04:32:29.522672 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-1db82bae-8d32-46c7-ad11-b132b7df8145 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:29.530039 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6f4b9e8a-7490-42c4-9a6c-cf5ecbb1d067 req-70e5f9e5-9185-45bf-9727-021c45c8bf44 service neutron] 10.222.0.26 "GET /v2.0/security-groups?id=4ff68177-77d2-4250-b11c-4d5b55fd3619&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2579474 Nov 09 04:32:29.531384 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1db82bae-8d32-46c7-ad11-b132b7df8145 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:29.531964 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1db82bae-8d32-46c7-ad11-b132b7df8145 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:29.536916 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1db82bae-8d32-46c7-ad11-b132b7df8145 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event updated for resources: {'Subnet': ['ID=d4895447-5025-41d7-a1d1-fd578440707f,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:29.545060 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3a13c14c-ec14-4859-8541-1676fc84dffa tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:32:29.545546 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3a13c14c-ec14-4859-8541-1676fc84dffa tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:29.554158 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-49c033c4-6563-4e4d-a350-0320a3c9ae13 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:29.555457 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-49c033c4-6563-4e4d-a350-0320a3c9ae13 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 699 time: 0.6008697 Nov 09 04:32:29.562547 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56310) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:29.574609 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-b3b04fe5-36ba-46ea-990f-21f7eb327af4 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Request body: {'network': {'name': 'tempest-RoutersTest-946673398'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:29.612310 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a13c14c-ec14-4859-8541-1676fc84dffa tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Port': ['ID=80086735-c739-415d-8466-93db6194fe50,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:29.652054 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-bcb5dca5-806d-4902-84c1-033d2b57ec27 req-0d91efa4-4363-4323-a68b-c1c6bea534f2 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/security-groups?id=4ff68177-77d2-4250-b11c-4d5b55fd3619&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1093915 Nov 09 04:32:29.654082 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-15334271-825e-4ceb-86c4-0d7e1bd9db00 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:29.741208 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b3b04fe5-36ba-46ea-990f-21f7eb327af4 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Made reservation on behalf of 188f23ef0cb54006875c672b78f5249f for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:29.752674 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b3b04fe5-36ba-46ea-990f-21f7eb327af4 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:29.762435 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 475084e5-a1f4-489d-aaad-e5c375775a1b up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:32:29.769139 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-15334271-825e-4ceb-86c4-0d7e1bd9db00 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:29.828917 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3a13c14c-ec14-4859-8541-1676fc84dffa tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:29.835782 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 475084e5-a1f4-489d-aaad-e5c375775a1b triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:29.836152 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:29.844105 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56312) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:29.844312 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-1db82bae-8d32-46c7-ad11-b132b7df8145 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 836 time: 1.7613719 Nov 09 04:32:29.855253 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-a937634a-0c0b-42a2-b0aa-eedfabdc0e34 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Request body: {'port': {'network_id': '8f3e78d2-7b2e-446f-bf17-7f6ff24daa5e', 'fixed_ips': [{'subnet_id': 'b197c77c-5641-42b9-8c7b-8025e4dab56c'}, {'subnet_id': 'd4895447-5025-41d7-a1d1-fd578440707f'}], 'name': 'tempest-PortsIpV6TestJSON-484700805'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:29.864875 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b3b04fe5-36ba-46ea-990f-21f7eb327af4 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 302} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:32:29.882938 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15334271-825e-4ceb-86c4-0d7e1bd9db00 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Pushing event updated for resources: {'Port': ['ID=b2e44f0e-0ca9-431b-9da8-d24e82cb3044,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:29.888755 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b3b04fe5-36ba-46ea-990f-21f7eb327af4 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:29.889095 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-b3b04fe5-36ba-46ea-990f-21f7eb327af4 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Added segment 57d559af-ebd5-42c2-b187-251c0ee907e1 of type vlan for network 35e2f2d1-ee40-4328-9fe2-48e5a5c19938 Nov 09 04:32:29.897267 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-15334271-825e-4ceb-86c4-0d7e1bd9db00 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:29.945540 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:29.955086 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b3b04fe5-36ba-46ea-990f-21f7eb327af4 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:29.985537 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 475084e5-a1f4-489d-aaad-e5c375775a1b, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=475084e5-a1f4-489d-aaad-e5c375775a1b,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:32:30.057115 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:30.068238 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-15334271-825e-4ceb-86c4-0d7e1bd9db00 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Network 3f7c1cab-fc9e-407c-99b6-915196a89a79 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:30.069865 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-15334271-825e-4ceb-86c4-0d7e1bd9db00 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:30.133245 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b3b04fe5-36ba-46ea-990f-21f7eb327af4 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:30.142034 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b3b04fe5-36ba-46ea-990f-21f7eb327af4 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:30.142776 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b3b04fe5-36ba-46ea-990f-21f7eb327af4 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:30.155797 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=475084e5-a1f4-489d-aaad-e5c375775a1b,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:30.161949 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5a68a921-51a0-4bce-851e-d88823846716 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:30.265531 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a937634a-0c0b-42a2-b0aa-eedfabdc0e34 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Made reservation on behalf of 12e47d8445b5429892cd1b9244512ca8 for: {'port': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:30.284729 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-15334271-825e-4ceb-86c4-0d7e1bd9db00 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Router 1f829b23-19d3-4aa7-98b0-5096e56cda7c has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:32:30.298544 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3b04fe5-36ba-46ea-990f-21f7eb327af4 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event updated for resources: {'Network': ['ID=35e2f2d1-ee40-4328-9fe2-48e5a5c19938,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:30.321447 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 35e2f2d1-ee40-4328-9fe2-48e5a5c19938 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:32:30.326935 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5a68a921-51a0-4bce-851e-d88823846716 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Network cc397c48-c4cc-4846-a1ef-380b64be450d is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:30.331645 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a68a921-51a0-4bce-851e-d88823846716 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event updated for resources: {'Subnet': ['ID=775bb7b9-6a44-44d8-a29c-1b53db6d50e5,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:30.337860 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-5a68a921-51a0-4bce-851e-d88823846716 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:30.343865 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5a68a921-51a0-4bce-851e-d88823846716 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:30.344454 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5a68a921-51a0-4bce-851e-d88823846716 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:30.372739 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-b3b04fe5-36ba-46ea-990f-21f7eb327af4 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 765 time: 0.8034434 Nov 09 04:32:30.387374 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56314) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:30.451523 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-54426321-7b77-453e-b75f-d5731284e856 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Request body: {'subnet': {'network_id': '35e2f2d1-ee40-4328-9fe2-48e5a5c19938', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:30.469076 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-29a6ec5f-315c-4977-b849-dfc69fe15427 None None] Network cc397c48-c4cc-4846-a1ef-380b64be450d requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:32:30.490696 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-5a68a921-51a0-4bce-851e-d88823846716 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 804 time: 1.5341687 Nov 09 04:32:30.496070 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56316) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:30.500478 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3a13c14c-ec14-4859-8541-1676fc84dffa tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:30.504731 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-86bf866b-50db-463c-b13e-abef9a9b7cf6 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Request body: {'port': {'name': 'tempest-PortsTestJSON-107731479', 'admin_state_up': False, 'fixed_ips': [{'subnet_id': '775bb7b9-6a44-44d8-a29c-1b53db6d50e5'}], 'security_groups': ['632771a5-fb1e-4549-8c87-bc5ecfe932cd']}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:30.530427 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a937634a-0c0b-42a2-b0aa-eedfabdc0e34 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:30.553781 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-7fb1d6d0-37ff-40bf-b802-7b18df7ebfde None None] Provisioning complete for port b2e44f0e-0ca9-431b-9da8-d24e82cb3044 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:30.554159 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7fb1d6d0-37ff-40bf-b802-7b18df7ebfde None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:30.565397 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [None req-a937634a-0c0b-42a2-b0aa-eedfabdc0e34 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] device_id is not set on port 27629a82-8855-48a5-a4c1-c20ca2bea522 yet. {{(pid=102161) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:32:30.615820 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-7fb1d6d0-37ff-40bf-b802-7b18df7ebfde None None] Port b2e44f0e-0ca9-431b-9da8-d24e82cb3044 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:32:30.641263 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3a13c14c-ec14-4859-8541-1676fc84dffa tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:30.642074 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3a13c14c-ec14-4859-8541-1676fc84dffa tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:30.652668 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-15334271-825e-4ceb-86c4-0d7e1bd9db00 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:32:30.666189 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-15334271-825e-4ceb-86c4-0d7e1bd9db00 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] 10.222.0.24 "PUT /v2.0/routers/1f829b23-19d3-4aa7-98b0-5096e56cda7c/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.0944109 Nov 09 04:32:30.671071 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56318) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:30.673146 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6fe0afb5-65da-49fd-9116-6990d32a127c None None] Sync routers for ids ['1f829b23-19d3-4aa7-98b0-5096e56cda7c'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:32:30.726971 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a13c14c-ec14-4859-8541-1676fc84dffa tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Port': ['ID=80086735-c739-415d-8466-93db6194fe50,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:30.733077 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6fe0afb5-65da-49fd-9116-6990d32a127c None None] Routers {'1f829b23-19d3-4aa7-98b0-5096e56cda7c'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:32:30.733077 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-6fe0afb5-65da-49fd-9116-6990d32a127c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:32:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['1f829b23-19d3-4aa7-98b0-5096e56cda7c'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:30.789243 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-6fe0afb5-65da-49fd-9116-6990d32a127c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:30.814202 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-392f0846-2dbc-45d3-858a-ce9dca73eaef None None] Provisioning complete for port 475084e5-a1f4-489d-aaad-e5c375775a1b triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:30.814202 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-392f0846-2dbc-45d3-858a-ce9dca73eaef None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:30.841663 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6fe0afb5-65da-49fd-9116-6990d32a127c None None] Routers {'1f829b23-19d3-4aa7-98b0-5096e56cda7c'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:32:30.842592 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-6fe0afb5-65da-49fd-9116-6990d32a127c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:32:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['1f829b23-19d3-4aa7-98b0-5096e56cda7c'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:30.898974 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2077b8a6-62a5-4913-9ef2-ee75a9cece71 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks [] for router, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:30.928651 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-6fe0afb5-65da-49fd-9116-6990d32a127c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:30.929835 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6fe0afb5-65da-49fd-9116-6990d32a127c None None] The sync data for ids ['1f829b23-19d3-4aa7-98b0-5096e56cda7c'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:32:30.961681 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8fbbb94c-48a6-4da0-9c61-bf63279f768a None None] Update dhcp port {'port': {'network_id': 'cc397c48-c4cc-4846-a1ef-380b64be450d', 'fixed_ips': [{'subnet_id': '3479ab9e-17ee-493e-93ef-61596c974f8d', 'ip_address': '172.20.0.2'}, {'subnet_id': '775bb7b9-6a44-44d8-a29c-1b53db6d50e5'}], 'binding:host_id': 'dv-neutron-816802-2-hyperv'}, 'id': '775e1b75-6b4e-4b53-8c8d-2c5aea990d99'} from dv-neutron-816802-2-hyperv. {{(pid=102163) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:328}} Nov 09 04:32:31.002108 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-54426321-7b77-453e-b75f-d5731284e856 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Made reservation on behalf of 188f23ef0cb54006875c672b78f5249f for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:31.060745 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8fbbb94c-48a6-4da0-9c61-bf63279f768a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:31.061652 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-54426321-7b77-453e-b75f-d5731284e856 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:31.208238 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-86bf866b-50db-463c-b13e-abef9a9b7cf6 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:31.213804 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-61455a33-1519-4ec1-a116-8121302ac64d None None] Network 8f3e78d2-7b2e-446f-bf17-7f6ff24daa5e requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:32:31.345058 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.api.v2.resource [None req-2077b8a6-62a5-4913-9ef2-ee75a9cece71 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] delete failed (client error): There was a conflict when trying to complete your request. Nov 09 04:32:31.345058 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-2077b8a6-62a5-4913-9ef2-ee75a9cece71 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] 10.222.0.24 "DELETE /v2.0/routers/1f829b23-19d3-4aa7-98b0-5096e56cda7c HTTP/1.1" status: 409 len: 329 time: 0.5707238 Nov 09 04:32:31.348926 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-8fbbb94c-48a6-4da0-9c61-bf63279f768a None None] Allocated IP 172.20.0.18 (cc397c48-c4cc-4846-a1ef-380b64be450d/775bb7b9-6a44-44d8-a29c-1b53db6d50e5/775e1b75-6b4e-4b53-8c8d-2c5aea990d99) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:32:31.357957 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-f0cb84ad-dc46-4fb8-a07d-4ade8cb41578 None None] Provisioning complete for port 80086735-c739-415d-8466-93db6194fe50 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:31.358330 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f0cb84ad-dc46-4fb8-a07d-4ade8cb41578 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:31.361618 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56322) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:31.386700 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 9c023fad-c8fa-4120-b9cc-4ea22c1718e4 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=102163) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 09 04:32:31.389517 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 9c023fad-c8fa-4120-b9cc-4ea22c1718e4 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:32:31.418187 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3a13c14c-ec14-4859-8541-1676fc84dffa tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:31.473552 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-3a13c14c-ec14-4859-8541-1676fc84dffa tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:31.490137 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-54426321-7b77-453e-b75f-d5731284e856 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:31.531002 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-f0cb84ad-dc46-4fb8-a07d-4ade8cb41578 None None] Port 80086735-c739-415d-8466-93db6194fe50 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:32:31.553819 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-791c4af7-537e-489d-8f23-bbe0ff4b639c req-e8ae480f-9426-4723-8e51-199788fe1a83 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:31.554900 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-791c4af7-537e-489d-8f23-bbe0ff4b639c req-e8ae480f-9426-4723-8e51-199788fe1a83 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/ports?device_id=9c4e58e3-39e4-4212-b106-50b44d4c4e28 HTTP/1.1" status: 200 len: 945 time: 0.6429019 Nov 09 04:32:31.655013 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54426321-7b77-453e-b75f-d5731284e856 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event updated for resources: {'Subnet': ['ID=f60d3eec-6988-47b0-9f2f-6319fa99064d,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:31.667315 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-54426321-7b77-453e-b75f-d5731284e856 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Checking segment: {'id': '57d559af-ebd5-42c2-b187-251c0ee907e1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 302, 'network_id': '35e2f2d1-ee40-4328-9fe2-48e5a5c19938'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:32:31.667681 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-54426321-7b77-453e-b75f-d5731284e856 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Network hostable DHCP agents. Network: 35e2f2d1-ee40-4328-9fe2-48e5a5c19938, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:32:31.716799 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-f0cb84ad-dc46-4fb8-a07d-4ade8cb41578 None None] Provisioning complete for port bb3407cb-b257-46ba-b15b-69a174e46e25 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:31.717174 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f0cb84ad-dc46-4fb8-a07d-4ade8cb41578 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:31.776239 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-54426321-7b77-453e-b75f-d5731284e856 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Network 35e2f2d1-ee40-4328-9fe2-48e5a5c19938 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:32:31.861894 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-54426321-7b77-453e-b75f-d5731284e856 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 35e2f2d1-ee40-4328-9fe2-48e5a5c19938) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:31.869495 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-54426321-7b77-453e-b75f-d5731284e856 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:31.870088 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-54426321-7b77-453e-b75f-d5731284e856 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:31.953325 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device bb3407cb-b257-46ba-b15b-69a174e46e25 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:32:31.955146 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-741da3bb-e678-48e1-91e1-7a7b5e8e19f8 None None] Network 35e2f2d1-ee40-4328-9fe2-48e5a5c19938 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:32:31.957540 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-791c4af7-537e-489d-8f23-bbe0ff4b639c req-48afb251-dd6c-4821-86eb-e7291b88efc1 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/security-groups?id=4ff68177-77d2-4250-b11c-4d5b55fd3619&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3688149 Nov 09 04:32:31.975301 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-54426321-7b77-453e-b75f-d5731284e856 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.5343971 Nov 09 04:32:31.977665 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56324) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:31.988540 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56326) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:32.018806 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-a937634a-0c0b-42a2-b0aa-eedfabdc0e34 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Allocated IP 2001:db8::1b (8f3e78d2-7b2e-446f-bf17-7f6ff24daa5e/b197c77c-5641-42b9-8c7b-8025e4dab56c/27629a82-8855-48a5-a4c1-c20ca2bea522) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:32:32.029623 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-a937634a-0c0b-42a2-b0aa-eedfabdc0e34 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Allocated IP 2001:db8:0:1::18a (8f3e78d2-7b2e-446f-bf17-7f6ff24daa5e/d4895447-5025-41d7-a1d1-fd578440707f/27629a82-8855-48a5-a4c1-c20ca2bea522) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:32:32.053083 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-8fbbb94c-48a6-4da0-9c61-bf63279f768a None None] For port 775e1b75-6b4e-4b53-8c8d-2c5aea990d99, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=775e1b75-6b4e-4b53-8c8d-2c5aea990d99,segment=NetworkSegment(5cb8d89b-c83c-4beb-ac61-4edae91bc9e8),segment_id=5cb8d89b-c83c-4beb-ac61-4edae91bc9e8)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:32:32.068414 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3a13c14c-ec14-4859-8541-1676fc84dffa tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Router 12f1801e-1293-4cba-b48b-b9becf0da441 is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102161) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:32:32.113548 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:32.137361 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 9c023fad-c8fa-4120-b9cc-4ea22c1718e4, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=9c023fad-c8fa-4120-b9cc-4ea22c1718e4,segment=NetworkSegment(d5411e15-1506-4025-8472-ba7118358f68),segment_id=d5411e15-1506-4025-8472-ba7118358f68)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:32:32.176905 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-91b92bdd-b899-464a-956b-a0e4a1fe78a9 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/floatingips/c68e1ebb-65d3-4c8e-b1c0-4ae8c774d9ed HTTP/1.1" status: 200 len: 993 time: 0.1869259 Nov 09 04:32:32.197277 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Returning: {'device': '9c023fad-c8fa-4120-b9cc-4ea22c1718e4', 'network_id': '9c94e7dc-d679-4a7e-b264-6d619dbc935e', 'port_id': '9c023fad-c8fa-4120-b9cc-4ea22c1718e4', 'mac_address': 'fa:16:3e:cd:a2:82', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 313, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '003822ea-7d1a-41fa-a15f-16fc8c9f624c', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102163) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 09 04:32:32.214565 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8fbbb94c-48a6-4da0-9c61-bf63279f768a None None] Publish callbacks [] for port, precommit_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:32.220050 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9c4e58e3-39e4-4212-b106-50b44d4c4e28', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '9c023fad-c8fa-4120-b9cc-4ea22c1718e4'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:32:32.222387 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f26a0af2-5ca6-467e-a1dc-7063dff6680c" -d '{"events": [{"server_uuid": "9c4e58e3-39e4-4212-b106-50b44d4c4e28", "name": "network-vif-unplugged", "status": "completed", "tag": "9c023fad-c8fa-4120-b9cc-4ea22c1718e4"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:32:32.307857 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3a13c14c-ec14-4859-8541-1676fc84dffa tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:32:32.317102 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-3a13c14c-ec14-4859-8541-1676fc84dffa tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "PUT /v2.0/routers/12f1801e-1293-4cba-b48b-b9becf0da441/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.6093736 Nov 09 04:32:32.317250 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 9c023fad-c8fa-4120-b9cc-4ea22c1718e4, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=9c023fad-c8fa-4120-b9cc-4ea22c1718e4,segment=NetworkSegment(d5411e15-1506-4025-8472-ba7118358f68),segment_id=d5411e15-1506-4025-8472-ba7118358f68)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:32:32.318820 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f0cb84ad-dc46-4fb8-a07d-4ade8cb41578 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:32.323594 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56330) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:32.323731 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 09 Nov 2021 04:32:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-508db189-035c-45c5-8ca5-ded7736b628e x-openstack-request-id: req-508db189-035c-45c5-8ca5-ded7736b628e {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:32:32.323731 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9c4e58e3-39e4-4212-b106-50b44d4c4e28", "name": "network-vif-unplugged", "status": "completed", "tag": "9c023fad-c8fa-4120-b9cc-4ea22c1718e4", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:32:32.323925 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-508db189-035c-45c5-8ca5-ded7736b628e {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:32:32.324264 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9c4e58e3-39e4-4212-b106-50b44d4c4e28', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '9c023fad-c8fa-4120-b9cc-4ea22c1718e4', 'code': 200} Nov 09 04:32:32.324646 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-276f49a3-ba34-4325-b1e2-65388ff2d3a0 None None] Sync routers for ids ['12f1801e-1293-4cba-b48b-b9becf0da441'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:32:32.333052 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8fbbb94c-48a6-4da0-9c61-bf63279f768a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:32.357676 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-276f49a3-ba34-4325-b1e2-65388ff2d3a0 None None] Routers {'12f1801e-1293-4cba-b48b-b9becf0da441'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:32:32.358315 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-276f49a3-ba34-4325-b1e2-65388ff2d3a0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:32:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['12f1801e-1293-4cba-b48b-b9becf0da441'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:32.419068 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ad4e8557-38e5-4928-877f-35fa5173ea49 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:32.420648 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-ad4e8557-38e5-4928-877f-35fa5173ea49 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/ports/80086735-c739-415d-8466-93db6194fe50 HTTP/1.1" status: 200 len: 911 time: 0.0983469 Nov 09 04:32:32.426206 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56332) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:32.429996 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a937634a-0c0b-42a2-b0aa-eedfabdc0e34 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:32.480552 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7a442350-4c32-4e1f-bb36-cbff337ebb3e tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:32.487706 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:32.501618 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-276f49a3-ba34-4325-b1e2-65388ff2d3a0 None None] Set router 12f1801e-1293-4cba-b48b-b9becf0da441 gateway port host: None {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:32:32.520922 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-f0cb84ad-dc46-4fb8-a07d-4ade8cb41578 None None] For port bb3407cb-b257-46ba-b15b-69a174e46e25, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=bb3407cb-b257-46ba-b15b-69a174e46e25,segment=NetworkSegment(b075afef-177a-45c6-aea2-b9b2a8e5703d),segment_id=b075afef-177a-45c6-aea2-b9b2a8e5703d)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:32:32.546027 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-13867b78-bac8-4741-916b-bfc9638bc5ac None None] Update dhcp port {'port': {'network_id': '8f3e78d2-7b2e-446f-bf17-7f6ff24daa5e', 'fixed_ips': [{'subnet_id': 'b197c77c-5641-42b9-8c7b-8025e4dab56c', 'ip_address': '2001:db8::2'}, {'subnet_id': 'd4895447-5025-41d7-a1d1-fd578440707f'}], 'binding:host_id': 'dv-neutron-816802-2-hyperv'}, 'id': 'bb3407cb-b257-46ba-b15b-69a174e46e25'} from dv-neutron-816802-2-hyperv. {{(pid=102163) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:328}} Nov 09 04:32:32.577849 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port bb3407cb-b257-46ba-b15b-69a174e46e25 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:32.578278 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:32.589970 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:32.610750 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2553f0f1-8f69-4ad6-a0f7-94461935eedd tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:32.621612 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2553f0f1-8f69-4ad6-a0f7-94461935eedd tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:32.625945 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-2553f0f1-8f69-4ad6-a0f7-94461935eedd tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1655 time: 0.1914506 Nov 09 04:32:32.626992 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56334) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:32.669389 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f0cb84ad-dc46-4fb8-a07d-4ade8cb41578 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:32.679158 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a937634a-0c0b-42a2-b0aa-eedfabdc0e34 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:32.724270 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-13867b78-bac8-4741-916b-bfc9638bc5ac None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:32.736863 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fbbb94c-48a6-4da0-9c61-bf63279f768a None None] Pushing event updated for resources: {'Port': ['ID=775e1b75-6b4e-4b53-8c8d-2c5aea990d99,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:32.771801 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 9c023fad-c8fa-4120-b9cc-4ea22c1718e4 {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:32:32.781342 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-276f49a3-ba34-4325-b1e2-65388ff2d3a0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '12f1801e-1293-4cba-b48b-b9becf0da441', 'name': 'tempest-NetworksTestDHCPv6-router-94262758', 'tenant_id': '8b0758f781884982bf5b94e6609237f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:32:27Z', 'updated_at': '2021-11-09T04:32:29Z', 'revision_number': 2, 'project_id': '8b0758f781884982bf5b94e6609237f6', 'gw_port_host': None, '_interfaces': [{'id': '80086735-c739-415d-8466-93db6194fe50', 'name': '', 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'tenant_id': '8b0758f781884982bf5b94e6609237f6', 'mac_address': 'fa:16:3e:28:37:43', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '12f1801e-1293-4cba-b48b-b9becf0da441', 'device_owner': 'network:router_interface', 'standard_attr_id': 821, 'fixed_ips': [{'subnet_id': 'f01a9e64-acbf-4c7c-800c-5ec2adc6fdff', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:28Z', 'updated_at': '2021-11-09T04:32:30Z', 'revision_number': 2, 'project_id': '8b0758f781884982bf5b94e6609237f6', 'subnets': [{'id': 'f01a9e64-acbf-4c7c-800c-5ec2adc6fdff', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': 'dhcpv6-stateful', 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:32.793353 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-86bf866b-50db-463c-b13e-abef9a9b7cf6 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Delete allocated IP 172.20.0.9 (cc397c48-c4cc-4846-a1ef-380b64be450d/3479ab9e-17ee-493e-93ef-61596c974f8d) {{(pid=102162) _delete_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:118}} Nov 09 04:32:32.800321 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aad0b8fd-16ad-4436-9c96-355f1ae4104f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-35e2f2d1-ee40-4328-9fe2-48e5a5c19938', 'network_id': '35e2f2d1-ee40-4328-9fe2-48e5a5c19938', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'fixed_ips': [{'subnet_id': 'f60d3eec-6988-47b0-9f2f-6319fa99064d'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:32:32.801514 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-aad0b8fd-16ad-4436-9c96-355f1ae4104f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:32.806082 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-86bf866b-50db-463c-b13e-abef9a9b7cf6 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Allocated IP 172.20.0.19 (cc397c48-c4cc-4846-a1ef-380b64be450d/775bb7b9-6a44-44d8-a29c-1b53db6d50e5/40862cdd-67e2-4a4b-b626-fc77daba8868) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:32:32.816183 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-276f49a3-ba34-4325-b1e2-65388ff2d3a0 None None] Checking router: 12f1801e-1293-4cba-b48b-b9becf0da441 for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:32:32.817846 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-276f49a3-ba34-4325-b1e2-65388ff2d3a0 None None] Updating router 12f1801e-1293-4cba-b48b-b9becf0da441 port 80086735-c739-415d-8466-93db6194fe50 binding host dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 04:32:32.836516 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a937634a-0c0b-42a2-b0aa-eedfabdc0e34 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Network 8f3e78d2-7b2e-446f-bf17-7f6ff24daa5e is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:32.849483 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-a937634a-0c0b-42a2-b0aa-eedfabdc0e34 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:32.854814 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-276f49a3-ba34-4325-b1e2-65388ff2d3a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:32.857005 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a937634a-0c0b-42a2-b0aa-eedfabdc0e34 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:32:32.862768 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a937634a-0c0b-42a2-b0aa-eedfabdc0e34 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:32.863416 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a937634a-0c0b-42a2-b0aa-eedfabdc0e34 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:32.877984 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a937634a-0c0b-42a2-b0aa-eedfabdc0e34 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event updated for resources: {'Port': ['ID=27629a82-8855-48a5-a4c1-c20ca2bea522,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:32.943771 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.db.api [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=102163) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:32:32.944235 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG oslo_db.api [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:32:33.018312 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-86bf866b-50db-463c-b13e-abef9a9b7cf6 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:33.078517 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-614d143f-f2fb-4b01-aac7-c9ec48b18ed5 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:33.080734 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a937634a-0c0b-42a2-b0aa-eedfabdc0e34 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1015 time: 3.2295792 Nov 09 04:32:33.094976 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56336) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:33.095371 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-bf0bbafd-6f22-4b52-89ac-05c42ae03a5e None None] Provisioning complete for port 80086735-c739-415d-8466-93db6194fe50 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:33.095839 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-bf0bbafd-6f22-4b52-89ac-05c42ae03a5e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:33.105193 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-4d23f148-9734-42c3-a1da-6e13f0005f98 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Request body: {'port': {'fixed_ips': [{'subnet_id': 'b197c77c-5641-42b9-8c7b-8025e4dab56c'}]}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:33.175992 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-86bf866b-50db-463c-b13e-abef9a9b7cf6 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:33.226950 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-276f49a3-ba34-4325-b1e2-65388ff2d3a0 None None] Publish callbacks [] for port, precommit_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:33.266149 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=9c023fad-c8fa-4120-b9cc-4ea22c1718e4,revision_number=6']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:33.314866 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-7a442350-4c32-4e1f-bb36-cbff337ebb3e tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Deleting port b2e44f0e-0ca9-431b-9da8-d24e82cb3044 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:32:33.315172 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7a442350-4c32-4e1f-bb36-cbff337ebb3e tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:33.330501 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86bf866b-50db-463c-b13e-abef9a9b7cf6 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event updated for resources: {'Port': ['ID=40862cdd-67e2-4a4b-b626-fc77daba8868,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:33.336404 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-276f49a3-ba34-4325-b1e2-65388ff2d3a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:33.346954 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 475084e5-a1f4-489d-aaad-e5c375775a1b up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:32:33.370345 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-bf0bbafd-6f22-4b52-89ac-05c42ae03a5e None None] Port 80086735-c739-415d-8466-93db6194fe50 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:32:33.494703 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:33.519313 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-aad0b8fd-16ad-4436-9c96-355f1ae4104f None None] Allocated IP 172.20.0.2 (35e2f2d1-ee40-4328-9fe2-48e5a5c19938/f60d3eec-6988-47b0-9f2f-6319fa99064d/843328c7-08ce-4c76-a55f-3396fabab904) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:32:33.574491 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0cb84ad-dc46-4fb8-a07d-4ade8cb41578 None None] Pushing event updated for resources: {'Port': ['ID=bb3407cb-b257-46ba-b15b-69a174e46e25,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:33.588106 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9c023fad-c8fa-4120-b9cc-4ea22c1718e4 {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:32:33.604614 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-276f49a3-ba34-4325-b1e2-65388ff2d3a0 None None] Attempting to bind port 80086735-c739-415d-8466-93db6194fe50 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:32:33.604614 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-276f49a3-ba34-4325-b1e2-65388ff2d3a0 None None] Attempting to bind port 80086735-c739-415d-8466-93db6194fe50 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:32:33.604614 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-276f49a3-ba34-4325-b1e2-65388ff2d3a0 None None] Attempting to bind port 80086735-c739-415d-8466-93db6194fe50 on network 988d2354-693c-4d52-af17-25e0643eaa0c {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:32:33.604869 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4d23f148-9734-42c3-a1da-6e13f0005f98 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:33.628193 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-276f49a3-ba34-4325-b1e2-65388ff2d3a0 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 32, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:32:33.629007 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-276f49a3-ba34-4325-b1e2-65388ff2d3a0 None None] Checking segment: {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102164) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:32:33.629675 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-276f49a3-ba34-4325-b1e2-65388ff2d3a0 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:33.639621 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-86bf866b-50db-463c-b13e-abef9a9b7cf6 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] In _notify_port_updated(), no bound segment for port 40862cdd-67e2-4a4b-b626-fc77daba8868 on network cc397c48-c4cc-4846-a1ef-380b64be450d {{(pid=102162) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 09 04:32:33.640428 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-276f49a3-ba34-4325-b1e2-65388ff2d3a0 None None] Bound using segment: {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:32:33.641197 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-276f49a3-ba34-4325-b1e2-65388ff2d3a0 None None] Bound port: 80086735-c739-415d-8466-93db6194fe50, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'}}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:32:33.641803 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-276f49a3-ba34-4325-b1e2-65388ff2d3a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:33.646923 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-86bf866b-50db-463c-b13e-abef9a9b7cf6 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:33.647632 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-86bf866b-50db-463c-b13e-abef9a9b7cf6 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:33.649008 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-86bf866b-50db-463c-b13e-abef9a9b7cf6 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "PUT /v2.0/ports/40862cdd-67e2-4a4b-b626-fc77daba8868 HTTP/1.1" status: 200 len: 920 time: 3.1487010 Nov 09 04:32:33.654714 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56338) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:33.661251 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-13867b78-bac8-4741-916b-bfc9638bc5ac None None] Allocated IP 2001:db8:0:1::2 (8f3e78d2-7b2e-446f-bf17-7f6ff24daa5e/d4895447-5025-41d7-a1d1-fd578440707f/bb3407cb-b257-46ba-b15b-69a174e46e25) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:32:33.739414 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 9c023fad-c8fa-4120-b9cc-4ea22c1718e4, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=9c023fad-c8fa-4120-b9cc-4ea22c1718e4,segment=NetworkSegment(d5411e15-1506-4025-8472-ba7118358f68),segment_id=d5411e15-1506-4025-8472-ba7118358f68)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:32:33.743557 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-276f49a3-ba34-4325-b1e2-65388ff2d3a0 None None] For port 80086735-c739-415d-8466-93db6194fe50, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102164) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:32:33.751046 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-276f49a3-ba34-4325-b1e2-65388ff2d3a0 None None] For port 80086735-c739-415d-8466-93db6194fe50, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=80086735-c739-415d-8466-93db6194fe50,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102164) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:32:33.759178 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3713b6dc-5ab5-450c-a157-690ffac75248 None None] Pushing event updated for resources: {'Port': ['ID=80086735-c739-415d-8466-93db6194fe50,revision_number=3']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:33.822862 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-19ca7fb1-fca0-448f-91e5-6466f083050b None None] Provisioning complete for port 775e1b75-6b4e-4b53-8c8d-2c5aea990d99 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:33.823675 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-19ca7fb1-fca0-448f-91e5-6466f083050b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:33.833198 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:33.837636 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 475084e5-a1f4-489d-aaad-e5c375775a1b triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:33.837636 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:33.860784 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-276f49a3-ba34-4325-b1e2-65388ff2d3a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:33.896606 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7a442350-4c32-4e1f-bb36-cbff337ebb3e tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:33.932671 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-29df6519-43cc-4a71-8dea-4b58cd7abd7a tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:33.939865 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-7a442350-4c32-4e1f-bb36-cbff337ebb3e tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Calling delete_port for b2e44f0e-0ca9-431b-9da8-d24e82cb3044 owned by network:router_interface {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:32:33.954465 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3713b6dc-5ab5-450c-a157-690ffac75248 None None] Pushing event updated for resources: {'Port': ['ID=80086735-c739-415d-8466-93db6194fe50,revision_number=4']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:33.989263 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-276f49a3-ba34-4325-b1e2-65388ff2d3a0 None None] Routers {'12f1801e-1293-4cba-b48b-b9becf0da441'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:32:33.989263 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-276f49a3-ba34-4325-b1e2-65388ff2d3a0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:32:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['12f1801e-1293-4cba-b48b-b9becf0da441'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:34.039212 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-b04d3d83-01b1-4e4a-bccb-8ef69737cc00 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Deleting port 40862cdd-67e2-4a4b-b626-fc77daba8868 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:32:34.039782 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b04d3d83-01b1-4e4a-bccb-8ef69737cc00 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:34.126748 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['9c023fad-c8fa-4120-b9cc-4ea22c1718e4'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 04:32:34.136868 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-13867b78-bac8-4741-916b-bfc9638bc5ac None None] For port bb3407cb-b257-46ba-b15b-69a174e46e25, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=bb3407cb-b257-46ba-b15b-69a174e46e25,segment=NetworkSegment(b075afef-177a-45c6-aea2-b9b2a8e5703d),segment_id=b075afef-177a-45c6-aea2-b9b2a8e5703d)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:32:34.142654 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=9c023fad-c8fa-4120-b9cc-4ea22c1718e4,revision_number=7']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:34.216702 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b04d3d83-01b1-4e4a-bccb-8ef69737cc00 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:34.222637 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-aad0b8fd-16ad-4436-9c96-355f1ae4104f None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:34.265282 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-b04d3d83-01b1-4e4a-bccb-8ef69737cc00 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Calling delete_port for 40862cdd-67e2-4a4b-b626-fc77daba8868 owned by {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:32:34.287001 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-276f49a3-ba34-4325-b1e2-65388ff2d3a0 None None] Set router 12f1801e-1293-4cba-b48b-b9becf0da441 gateway port host: None {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:32:34.307335 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-13867b78-bac8-4741-916b-bfc9638bc5ac None None] Publish callbacks [] for port, precommit_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:34.350518 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-aad0b8fd-16ad-4436-9c96-355f1ae4104f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:34.512113 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-614d143f-f2fb-4b01-aac7-c9ec48b18ed5 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Allocated IP 172.20.0.1 (35e2f2d1-ee40-4328-9fe2-48e5a5c19938/f60d3eec-6988-47b0-9f2f-6319fa99064d/bf77ddc4-4ed9-472d-842b-1fb79d55e2e4) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:32:34.519138 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-4d23f148-9734-42c3-a1da-6e13f0005f98 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Delete allocated IP 2001:db8:0:1::18a (8f3e78d2-7b2e-446f-bf17-7f6ff24daa5e/d4895447-5025-41d7-a1d1-fd578440707f) {{(pid=102162) _delete_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:118}} Nov 09 04:32:34.604466 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-29df6519-43cc-4a71-8dea-4b58cd7abd7a tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Deleting port 80086735-c739-415d-8466-93db6194fe50 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:32:34.605104 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-29df6519-43cc-4a71-8dea-4b58cd7abd7a tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:34.616776 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-276f49a3-ba34-4325-b1e2-65388ff2d3a0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '12f1801e-1293-4cba-b48b-b9becf0da441', 'name': 'tempest-NetworksTestDHCPv6-router-94262758', 'tenant_id': '8b0758f781884982bf5b94e6609237f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:32:27Z', 'updated_at': '2021-11-09T04:32:29Z', 'revision_number': 2, 'project_id': '8b0758f781884982bf5b94e6609237f6', 'gw_port_host': None, '_interfaces': [{'id': '80086735-c739-415d-8466-93db6194fe50', 'name': '', 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'tenant_id': '8b0758f781884982bf5b94e6609237f6', 'mac_address': 'fa:16:3e:28:37:43', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '12f1801e-1293-4cba-b48b-b9becf0da441', 'device_owner': 'network:router_interface', 'standard_attr_id': 821, 'fixed_ips': [{'subnet_id': 'f01a9e64-acbf-4c7c-800c-5ec2adc6fdff', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:28Z', 'updated_at': '2021-11-09T04:32:33Z', 'revision_number': 4, 'project_id': '8b0758f781884982bf5b94e6609237f6', 'subnets': [{'id': 'f01a9e64-acbf-4c7c-800c-5ec2adc6fdff', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': 'dhcpv6-stateful', 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:34.622157 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device bb3407cb-b257-46ba-b15b-69a174e46e25 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:32:34.625967 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7a442350-4c32-4e1f-bb36-cbff337ebb3e tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:34.631027 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-13867b78-bac8-4741-916b-bfc9638bc5ac None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:34.657215 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-276f49a3-ba34-4325-b1e2-65388ff2d3a0 None None] The sync data for ids ['12f1801e-1293-4cba-b48b-b9becf0da441'] in dv-neutron-816802-2-hyperv is: [{'id': '12f1801e-1293-4cba-b48b-b9becf0da441', 'name': 'tempest-NetworksTestDHCPv6-router-94262758', 'tenant_id': '8b0758f781884982bf5b94e6609237f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:32:27Z', 'updated_at': '2021-11-09T04:32:29Z', 'revision_number': 2, 'project_id': '8b0758f781884982bf5b94e6609237f6', 'gw_port_host': None, '_interfaces': [{'id': '80086735-c739-415d-8466-93db6194fe50', 'name': '', 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'tenant_id': '8b0758f781884982bf5b94e6609237f6', 'mac_address': 'fa:16:3e:28:37:43', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '12f1801e-1293-4cba-b48b-b9becf0da441', 'device_owner': 'network:router_interface', 'standard_attr_id': 821, 'fixed_ips': [{'subnet_id': 'f01a9e64-acbf-4c7c-800c-5ec2adc6fdff', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:28Z', 'updated_at': '2021-11-09T04:32:33Z', 'revision_number': 4, 'project_id': '8b0758f781884982bf5b94e6609237f6', 'subnets': [{'id': 'f01a9e64-acbf-4c7c-800c-5ec2adc6fdff', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': 'dhcpv6-stateful', 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:32:34.659243 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-19ca7fb1-fca0-448f-91e5-6466f083050b None None] Provisioning complete for port 40862cdd-67e2-4a4b-b626-fc77daba8868 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:34.659625 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-19ca7fb1-fca0-448f-91e5-6466f083050b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:34.674860 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aad0b8fd-16ad-4436-9c96-355f1ae4104f None None] Network 35e2f2d1-ee40-4328-9fe2-48e5a5c19938 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:34.721502 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-aad0b8fd-16ad-4436-9c96-355f1ae4104f None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:34.723822 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aad0b8fd-16ad-4436-9c96-355f1ae4104f None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:32:34.727522 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a442350-4c32-4e1f-bb36-cbff337ebb3e tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Pushing event deleted for resources: {'Port': ['ID=b2e44f0e-0ca9-431b-9da8-d24e82cb3044,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:34.783547 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b04d3d83-01b1-4e4a-bccb-8ef69737cc00 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:34.783887 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aad0b8fd-16ad-4436-9c96-355f1ae4104f None None] Pushing event updated for resources: {'Port': ['ID=843328c7-08ce-4c76-a55f-3396fabab904,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:34.788246 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-614d143f-f2fb-4b01-aac7-c9ec48b18ed5 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:34.836466 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b04d3d83-01b1-4e4a-bccb-8ef69737cc00 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event deleted for resources: {'Port': ['ID=40862cdd-67e2-4a4b-b626-fc77daba8868,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:34.871030 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-19ca7fb1-fca0-448f-91e5-6466f083050b None None] Port 40862cdd-67e2-4a4b-b626-fc77daba8868 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:32:34.897787 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-29df6519-43cc-4a71-8dea-4b58cd7abd7a tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] For port 80086735-c739-415d-8466-93db6194fe50, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=80086735-c739-415d-8466-93db6194fe50,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:32:34.898291 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-29df6519-43cc-4a71-8dea-4b58cd7abd7a tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:34.999268 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13867b78-bac8-4741-916b-bfc9638bc5ac None None] Pushing event updated for resources: {'Port': ['ID=bb3407cb-b257-46ba-b15b-69a174e46e25,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:35.030265 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-29df6519-43cc-4a71-8dea-4b58cd7abd7a tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Calling delete_port for 80086735-c739-415d-8466-93db6194fe50 owned by network:router_interface {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:32:35.043890 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-aad0b8fd-16ad-4436-9c96-355f1ae4104f None None] Attempting to bind port 843328c7-08ce-4c76-a55f-3396fabab904 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:32:35.044266 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-aad0b8fd-16ad-4436-9c96-355f1ae4104f None None] Attempting to bind port 843328c7-08ce-4c76-a55f-3396fabab904 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '57d559af-ebd5-42c2-b187-251c0ee907e1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 302, 'network_id': '35e2f2d1-ee40-4328-9fe2-48e5a5c19938'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:32:35.050781 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4d23f148-9734-42c3-a1da-6e13f0005f98 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:35.055602 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b04d3d83-01b1-4e4a-bccb-8ef69737cc00 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:35.057978 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aad0b8fd-16ad-4436-9c96-355f1ae4104f None None] Attempting to bind port 843328c7-08ce-4c76-a55f-3396fabab904 on network 35e2f2d1-ee40-4328-9fe2-48e5a5c19938 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:32:35.063290 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-19ca7fb1-fca0-448f-91e5-6466f083050b None None] Provisioning complete for port a4de75ae-2dab-4896-8d2a-cdfef3f44fab triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:35.064284 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-19ca7fb1-fca0-448f-91e5-6466f083050b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:35.064405 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-b04d3d83-01b1-4e4a-bccb-8ef69737cc00 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "DELETE /v2.0/ports/40862cdd-67e2-4a4b-b626-fc77daba8868 HTTP/1.1" status: 204 len: 168 time: 1.4081066 Nov 09 04:32:35.077413 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56342) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:35.111493 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7a442350-4c32-4e1f-bb36-cbff337ebb3e tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:35.112576 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port bb3407cb-b257-46ba-b15b-69a174e46e25 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:35.112942 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:35.141563 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4d23f148-9734-42c3-a1da-6e13f0005f98 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:35.150673 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-c46c14bb-31af-45a2-9bba-8aa7c339430d tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] GET failed (client error): The resource could not be found. Nov 09 04:32:35.160001 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-c46c14bb-31af-45a2-9bba-8aa7c339430d tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "GET /v2.0/ports/40862cdd-67e2-4a4b-b626-fc77daba8868 HTTP/1.1" status: 404 len: 333 time: 0.0809703 Nov 09 04:32:35.160786 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56344) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:35.187183 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aad0b8fd-16ad-4436-9c96-355f1ae4104f None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 32, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:32:35.187876 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aad0b8fd-16ad-4436-9c96-355f1ae4104f None None] Checking segment: {'id': '57d559af-ebd5-42c2-b187-251c0ee907e1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 302, 'network_id': '35e2f2d1-ee40-4328-9fe2-48e5a5c19938'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:32:35.188102 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-aad0b8fd-16ad-4436-9c96-355f1ae4104f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:35.188793 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aad0b8fd-16ad-4436-9c96-355f1ae4104f None None] Bound using segment: {'id': '57d559af-ebd5-42c2-b187-251c0ee907e1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 302, 'network_id': '35e2f2d1-ee40-4328-9fe2-48e5a5c19938'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:32:35.192195 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-aad0b8fd-16ad-4436-9c96-355f1ae4104f None None] Bound port: 843328c7-08ce-4c76-a55f-3396fabab904, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '57d559af-ebd5-42c2-b187-251c0ee907e1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 302, 'network_id': '35e2f2d1-ee40-4328-9fe2-48e5a5c19938'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:32:35.196046 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-aad0b8fd-16ad-4436-9c96-355f1ae4104f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:35.263076 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-19ca7fb1-fca0-448f-91e5-6466f083050b None None] Port a4de75ae-2dab-4896-8d2a-cdfef3f44fab cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:32:35.344838 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-4d23f148-9734-42c3-a1da-6e13f0005f98 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] In _notify_port_updated(), no bound segment for port 27629a82-8855-48a5-a4c1-c20ca2bea522 on network 8f3e78d2-7b2e-446f-bf17-7f6ff24daa5e {{(pid=102162) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 09 04:32:35.351263 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4d23f148-9734-42c3-a1da-6e13f0005f98 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:35.351971 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4d23f148-9734-42c3-a1da-6e13f0005f98 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:35.356276 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-4d23f148-9734-42c3-a1da-6e13f0005f98 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "PUT /v2.0/ports/27629a82-8855-48a5-a4c1-c20ca2bea522 HTTP/1.1" status: 200 len: 924 time: 2.2561405 Nov 09 04:32:35.361769 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56346) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:35.370026 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-3b966e05-a6be-4353-8e2d-b5a50619f92c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Request body: {'port': {'fixed_ips': [{'subnet_id': 'b197c77c-5641-42b9-8c7b-8025e4dab56c'}, {'subnet_id': 'd4895447-5025-41d7-a1d1-fd578440707f'}]}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:35.381447 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-aad0b8fd-16ad-4436-9c96-355f1ae4104f None None] For port 843328c7-08ce-4c76-a55f-3396fabab904, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:32:35.387656 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-aad0b8fd-16ad-4436-9c96-355f1ae4104f None None] For port 843328c7-08ce-4c76-a55f-3396fabab904, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=843328c7-08ce-4c76-a55f-3396fabab904,segment=NetworkSegment(57d559af-ebd5-42c2-b187-251c0ee907e1),segment_id=57d559af-ebd5-42c2-b187-251c0ee907e1)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:32:35.403933 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d23f148-9734-42c3-a1da-6e13f0005f98 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event updated for resources: {'Port': ['ID=27629a82-8855-48a5-a4c1-c20ca2bea522,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:35.407952 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-614d143f-f2fb-4b01-aac7-c9ec48b18ed5 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:35.426783 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-5916d27f-f6f8-47fc-a643-49adf34d8a60 None None] Could not find standard attr ID for object 40862cdd-67e2-4a4b-b626-fc77daba8868. {{(pid=102163) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 09 04:32:35.479330 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-aad0b8fd-16ad-4436-9c96-355f1ae4104f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:35.503718 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-614d143f-f2fb-4b01-aac7-c9ec48b18ed5 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Network 35e2f2d1-ee40-4328-9fe2-48e5a5c19938 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:35.544549 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-541ab447-26c9-4841-acf2-a14839130df6 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:35.555213 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-614d143f-f2fb-4b01-aac7-c9ec48b18ed5 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:35.559582 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-614d143f-f2fb-4b01-aac7-c9ec48b18ed5 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:32:35.613306 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-5916d27f-f6f8-47fc-a643-49adf34d8a60 None None] Provisioning complete for port 80086735-c739-415d-8466-93db6194fe50 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:35.614080 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5916d27f-f6f8-47fc-a643-49adf34d8a60 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:35.617199 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7a442350-4c32-4e1f-bb36-cbff337ebb3e tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Router 1f829b23-19d3-4aa7-98b0-5096e56cda7c has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:32:35.618909 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 775e1b75-6b4e-4b53-8c8d-2c5aea990d99 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:32:35.623241 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3b966e05-a6be-4353-8e2d-b5a50619f92c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:35.625970 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-614d143f-f2fb-4b01-aac7-c9ec48b18ed5 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event updated for resources: {'Port': ['ID=bf77ddc4-4ed9-472d-842b-1fb79d55e2e4,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:35.655352 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-541ab447-26c9-4841-acf2-a14839130df6 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:35.726687 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aad0b8fd-16ad-4436-9c96-355f1ae4104f None None] Pushing event updated for resources: {'Port': ['ID=843328c7-08ce-4c76-a55f-3396fabab904,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:35.749214 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-614d143f-f2fb-4b01-aac7-c9ec48b18ed5 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:35.798868 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7a442350-4c32-4e1f-bb36-cbff337ebb3e tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:32:35.811620 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-7a442350-4c32-4e1f-bb36-cbff337ebb3e tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] 10.222.0.24 "PUT /v2.0/routers/1f829b23-19d3-4aa7-98b0-5096e56cda7c/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 4.4433813 Nov 09 04:32:35.815759 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56348) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:35.837569 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-541ab447-26c9-4841-acf2-a14839130df6 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:35.839474 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b819d43b-1c1e-48d5-8051-78c98319d0b8 None None] Network 8f3e78d2-7b2e-446f-bf17-7f6ff24daa5e requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:32:35.845283 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-541ab447-26c9-4841-acf2-a14839130df6 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:35.845283 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-541ab447-26c9-4841-acf2-a14839130df6 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "DELETE /v2.0/security-groups/8e3ca282-18c1-45bc-bc5b-d723549eb1d8 HTTP/1.1" status: 204 len: 168 time: 0.6684680 Nov 09 04:32:35.856643 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56350) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:35.860722 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-541ab447-26c9-4841-acf2-a14839130df6 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=8e3ca282-18c1-45bc-bc5b-d723549eb1d8,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:35.906254 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-830b75db-b5ba-408c-82bc-4a3d42b321a3 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] show failed (client error): The resource could not be found. Nov 09 04:32:35.907531 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-830b75db-b5ba-408c-82bc-4a3d42b321a3 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] 10.222.0.24 "GET /v2.0/routers/tempest-non_exist_router-1400189583 HTTP/1.1" status: 404 len: 335 time: 0.0906608 Nov 09 04:32:35.913062 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56352) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:35.919093 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-ce77e1f4-b5b4-4055-89c3-1aea881b708a tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Request body: {'router': {'name': 'new_name'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:35.974973 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-211d7c0a-adec-41d1-b22a-2449109adaac None None] Sync routers for ids ['1f829b23-19d3-4aa7-98b0-5096e56cda7c'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:32:35.992299 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-ce77e1f4-b5b4-4055-89c3-1aea881b708a tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] update failed (client error): The resource could not be found. Nov 09 04:32:35.992299 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-ce77e1f4-b5b4-4055-89c3-1aea881b708a tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] 10.222.0.24 "PUT /v2.0/routers/tempest-non_exist_router-1957282911 HTTP/1.1" status: 404 len: 335 time: 0.0777605 Nov 09 04:32:36.002847 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 775e1b75-6b4e-4b53-8c8d-2c5aea990d99 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:36.003474 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:36.004936 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56354) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:36.075405 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4bdb82b5-3ef6-4aaf-bd2e-ffb4d7f4e890 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:36.093198 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-6e40c36f-e4dd-46c4-b671-973b57bc29d7 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Deleting subnet 71d05232-2996-4b4b-88a3-b9f571ff6741 {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:32:36.097082 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-29df6519-43cc-4a71-8dea-4b58cd7abd7a tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:36.099198 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6e40c36f-e4dd-46c4-b671-973b57bc29d7 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:36.122453 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-211d7c0a-adec-41d1-b22a-2449109adaac None None] Routers {'1f829b23-19d3-4aa7-98b0-5096e56cda7c'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:32:36.123009 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-211d7c0a-adec-41d1-b22a-2449109adaac None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:32:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['1f829b23-19d3-4aa7-98b0-5096e56cda7c'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:36.125030 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5916d27f-f6f8-47fc-a643-49adf34d8a60 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:36.156929 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29df6519-43cc-4a71-8dea-4b58cd7abd7a tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event deleted for resources: {'Port': ['ID=80086735-c739-415d-8466-93db6194fe50,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:36.161462 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4bdb82b5-3ef6-4aaf-bd2e-ffb4d7f4e890 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:36.177925 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-211d7c0a-adec-41d1-b22a-2449109adaac None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:36.207643 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-614d143f-f2fb-4b01-aac7-c9ec48b18ed5 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:36.240967 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-211d7c0a-adec-41d1-b22a-2449109adaac None None] Routers {'1f829b23-19d3-4aa7-98b0-5096e56cda7c'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:32:36.242185 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-211d7c0a-adec-41d1-b22a-2449109adaac None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:32:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['1f829b23-19d3-4aa7-98b0-5096e56cda7c'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:36.279464 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6e40c36f-e4dd-46c4-b671-973b57bc29d7 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:36.312071 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-211d7c0a-adec-41d1-b22a-2449109adaac None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:36.312805 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-211d7c0a-adec-41d1-b22a-2449109adaac None None] The sync data for ids ['1f829b23-19d3-4aa7-98b0-5096e56cda7c'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:32:36.373213 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-29df6519-43cc-4a71-8dea-4b58cd7abd7a tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:36.424497 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4bdb82b5-3ef6-4aaf-bd2e-ffb4d7f4e890 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:36.427483 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4bdb82b5-3ef6-4aaf-bd2e-ffb4d7f4e890 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:36.428302 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-4bdb82b5-3ef6-4aaf-bd2e-ffb4d7f4e890 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "DELETE /v2.0/security-groups/632771a5-fb1e-4549-8c87-bc5ecfe932cd HTTP/1.1" status: 204 len: 168 time: 0.5645540 Nov 09 04:32:36.436753 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-40ba2532-99d9-4323-b8d4-7d7ad12891d6 None None] Provisioning complete for port bb3407cb-b257-46ba-b15b-69a174e46e25 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:36.437219 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-40ba2532-99d9-4323-b8d4-7d7ad12891d6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:36.437718 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56356) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:36.455336 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bdb82b5-3ef6-4aaf-bd2e-ffb4d7f4e890 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=632771a5-fb1e-4549-8c87-bc5ecfe932cd,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:36.479199 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:32:36.486665 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-3b966e05-a6be-4353-8e2d-b5a50619f92c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Allocated IP 2001:db8:0:1::37 (8f3e78d2-7b2e-446f-bf17-7f6ff24daa5e/d4895447-5025-41d7-a1d1-fd578440707f/27629a82-8855-48a5-a4c1-c20ca2bea522) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:32:36.667899 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6e40c36f-e4dd-46c4-b671-973b57bc29d7 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:36.675228 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-2a17ab19-071f-47c8-a821-382e5b2b239a tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Deleting subnet 3479ab9e-17ee-493e-93ef-61596c974f8d {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:32:36.692808 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device bb3407cb-b257-46ba-b15b-69a174e46e25 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:32:36.758187 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2a17ab19-071f-47c8-a821-382e5b2b239a tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:36.766106 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port bb3407cb-b257-46ba-b15b-69a174e46e25 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:36.766590 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:36.767476 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3b966e05-a6be-4353-8e2d-b5a50619f92c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:36.779370 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-614d143f-f2fb-4b01-aac7-c9ec48b18ed5 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:36.828185 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3b966e05-a6be-4353-8e2d-b5a50619f92c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:36.832795 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-02785d3f-ebad-4ebd-94ab-64f0495c901f None None] Provisioning complete for port 27629a82-8855-48a5-a4c1-c20ca2bea522 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:36.833229 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-02785d3f-ebad-4ebd-94ab-64f0495c901f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:36.858890 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2a17ab19-071f-47c8-a821-382e5b2b239a tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:36.863586 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-29df6519-43cc-4a71-8dea-4b58cd7abd7a tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Router 12f1801e-1293-4cba-b48b-b9becf0da441 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:32:36.871772 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-614d143f-f2fb-4b01-aac7-c9ec48b18ed5 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:36.907356 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-02785d3f-ebad-4ebd-94ab-64f0495c901f None None] Port 27629a82-8855-48a5-a4c1-c20ca2bea522 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:32:36.909840 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 843328c7-08ce-4c76-a55f-3396fabab904 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:32:36.949141 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-02785d3f-ebad-4ebd-94ab-64f0495c901f None None] Provisioning complete for port bb3407cb-b257-46ba-b15b-69a174e46e25 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:36.949515 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-02785d3f-ebad-4ebd-94ab-64f0495c901f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:37.021869 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-3b966e05-a6be-4353-8e2d-b5a50619f92c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] In _notify_port_updated(), no bound segment for port 27629a82-8855-48a5-a4c1-c20ca2bea522 on network 8f3e78d2-7b2e-446f-bf17-7f6ff24daa5e {{(pid=102162) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 09 04:32:37.031232 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3b966e05-a6be-4353-8e2d-b5a50619f92c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:37.033602 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3b966e05-a6be-4353-8e2d-b5a50619f92c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:37.041079 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-3b966e05-a6be-4353-8e2d-b5a50619f92c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "PUT /v2.0/ports/27629a82-8855-48a5-a4c1-c20ca2bea522 HTTP/1.1" status: 200 len: 1009 time: 1.6759903 Nov 09 04:32:37.043119 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b966e05-a6be-4353-8e2d-b5a50619f92c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event updated for resources: {'Port': ['ID=27629a82-8855-48a5-a4c1-c20ca2bea522,revision_number=3']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:37.050790 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56358) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:37.076569 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6e40c36f-e4dd-46c4-b671-973b57bc29d7 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:37.089241 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 843328c7-08ce-4c76-a55f-3396fabab904 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:37.089697 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:37.089938 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-29df6519-43cc-4a71-8dea-4b58cd7abd7a tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:32:37.101078 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-29df6519-43cc-4a71-8dea-4b58cd7abd7a tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "PUT /v2.0/routers/12f1801e-1293-4cba-b48b-b9becf0da441/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 4.4730225 Nov 09 04:32:37.111687 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56360) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:37.119179 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-614d143f-f2fb-4b01-aac7-c9ec48b18ed5 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:37.159045 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-614d143f-f2fb-4b01-aac7-c9ec48b18ed5 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event updated for resources: {'Port': ['ID=bf77ddc4-4ed9-472d-842b-1fb79d55e2e4,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:37.160387 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e40c36f-e4dd-46c4-b671-973b57bc29d7 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Pushing event deleted for resources: {'Subnet': ['ID=71d05232-2996-4b4b-88a3-b9f571ff6741,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:37.220071 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6e40c36f-e4dd-46c4-b671-973b57bc29d7 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:37.226988 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-6e40c36f-e4dd-46c4-b671-973b57bc29d7 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] 10.222.0.24 "DELETE /v2.0/subnets/71d05232-2996-4b4b-88a3-b9f571ff6741 HTTP/1.1" status: 204 len: 168 time: 1.2186646 Nov 09 04:32:37.229946 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2a17ab19-071f-47c8-a821-382e5b2b239a tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:37.232994 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56362) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:37.246039 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dd995cc3-93af-47ad-b7fe-384f0f441b52 None None] Network f5f331fb-d0d2-40d3-ae47-5628a07f50e3 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:32:37.322957 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a11fb28-b998-4c50-a793-9ebb540a7ded None None] Sync routers for ids ['12f1801e-1293-4cba-b48b-b9becf0da441'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:32:37.338483 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3c9b91a4-b4cd-4594-9a92-4d06a5be3b44 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:37.348570 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3c9b91a4-b4cd-4594-9a92-4d06a5be3b44 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:37.351723 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1a11fb28-b998-4c50-a793-9ebb540a7ded None None] Routers {'12f1801e-1293-4cba-b48b-b9becf0da441'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:32:37.354389 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-1a11fb28-b998-4c50-a793-9ebb540a7ded None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:32:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['12f1801e-1293-4cba-b48b-b9becf0da441'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:37.355335 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-3c9b91a4-b4cd-4594-9a92-4d06a5be3b44 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1464 time: 0.2164271 Nov 09 04:32:37.360390 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56364) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:37.361390 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:37.418844 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-018b6c14-75fa-4aff-95e2-bd8f57fd08c9 None None] Provisioning complete for port 27629a82-8855-48a5-a4c1-c20ca2bea522 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:37.419508 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-018b6c14-75fa-4aff-95e2-bd8f57fd08c9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:37.495379 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-87f63fb3-c86d-4e9c-884b-f2a55b070542 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Deleting subnet f01a9e64-acbf-4c7c-800c-5ec2adc6fdff {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:32:37.518864 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-87f63fb3-c86d-4e9c-884b-f2a55b070542 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:37.531190 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-1a11fb28-b998-4c50-a793-9ebb540a7ded None None] Set router 12f1801e-1293-4cba-b48b-b9becf0da441 gateway port host: None {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:32:37.536242 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 843328c7-08ce-4c76-a55f-3396fabab904, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=843328c7-08ce-4c76-a55f-3396fabab904,segment=NetworkSegment(57d559af-ebd5-42c2-b187-251c0ee907e1),segment_id=57d559af-ebd5-42c2-b187-251c0ee907e1)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:32:37.543382 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-018b6c14-75fa-4aff-95e2-bd8f57fd08c9 None None] Port 27629a82-8855-48a5-a4c1-c20ca2bea522 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:32:37.598754 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:37.612274 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-f04f40c7-f442-41b6-9de9-49accc5a1336 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Deleting subnet bdebff0a-5c2f-4480-b618-3bfe5768fa74 {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:32:37.616264 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f04f40c7-f442-41b6-9de9-49accc5a1336 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:37.645688 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-1a11fb28-b998-4c50-a793-9ebb540a7ded None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '12f1801e-1293-4cba-b48b-b9becf0da441', 'name': 'tempest-NetworksTestDHCPv6-router-94262758', 'tenant_id': '8b0758f781884982bf5b94e6609237f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:32:27Z', 'updated_at': '2021-11-09T04:32:35Z', 'revision_number': 3, 'project_id': '8b0758f781884982bf5b94e6609237f6', 'gw_port_host': None}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:37.683926 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9ec3fe63-e2ef-4113-a24b-932e4384bbd0 None None] Network 35e2f2d1-ee40-4328-9fe2-48e5a5c19938 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:32:37.687610 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a11fb28-b998-4c50-a793-9ebb540a7ded None None] Checking router: 12f1801e-1293-4cba-b48b-b9becf0da441 for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:32:37.689594 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f04f40c7-f442-41b6-9de9-49accc5a1336 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:37.698643 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-51d6d36f-32e4-4ec4-8c52-2ae38d4634ee None None] DHCP port deletion for f5f331fb-d0d2-40d3-ae47-5628a07f50e3 request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:32:37.700763 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1a11fb28-b998-4c50-a793-9ebb540a7ded None None] Routers {'12f1801e-1293-4cba-b48b-b9becf0da441'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:32:37.701589 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-1a11fb28-b998-4c50-a793-9ebb540a7ded None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:32:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['12f1801e-1293-4cba-b48b-b9becf0da441'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:37.784841 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f04f40c7-f442-41b6-9de9-49accc5a1336 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:37.805040 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-1a11fb28-b998-4c50-a793-9ebb540a7ded None None] Set router 12f1801e-1293-4cba-b48b-b9becf0da441 gateway port host: None {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:32:37.809190 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-614d143f-f2fb-4b01-aac7-c9ec48b18ed5 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Network 35e2f2d1-ee40-4328-9fe2-48e5a5c19938 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:37.812465 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-614d143f-f2fb-4b01-aac7-c9ec48b18ed5 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:37.828834 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-6d56d0f8-f4f9-4836-bcbc-9c9a03f5f588 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Deleting port 27629a82-8855-48a5-a4c1-c20ca2bea522 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:32:37.829222 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6d56d0f8-f4f9-4836-bcbc-9c9a03f5f588 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:37.872201 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-87f63fb3-c86d-4e9c-884b-f2a55b070542 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:37.894145 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-1a11fb28-b998-4c50-a793-9ebb540a7ded None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '12f1801e-1293-4cba-b48b-b9becf0da441', 'name': 'tempest-NetworksTestDHCPv6-router-94262758', 'tenant_id': '8b0758f781884982bf5b94e6609237f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:32:27Z', 'updated_at': '2021-11-09T04:32:35Z', 'revision_number': 3, 'project_id': '8b0758f781884982bf5b94e6609237f6', 'gw_port_host': None}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:37.927702 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f04f40c7-f442-41b6-9de9-49accc5a1336 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:37.936135 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a11fb28-b998-4c50-a793-9ebb540a7ded None None] The sync data for ids ['12f1801e-1293-4cba-b48b-b9becf0da441'] in dv-neutron-816802-2-hyperv is: [{'id': '12f1801e-1293-4cba-b48b-b9becf0da441', 'name': 'tempest-NetworksTestDHCPv6-router-94262758', 'tenant_id': '8b0758f781884982bf5b94e6609237f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:32:27Z', 'updated_at': '2021-11-09T04:32:35Z', 'revision_number': 3, 'project_id': '8b0758f781884982bf5b94e6609237f6', 'gw_port_host': None}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:32:37.956137 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2a17ab19-071f-47c8-a821-382e5b2b239a tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:38.023991 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f04f40c7-f442-41b6-9de9-49accc5a1336 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:38.028133 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-f04f40c7-f442-41b6-9de9-49accc5a1336 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] 10.222.0.24 "DELETE /v2.0/subnets/bdebff0a-5c2f-4480-b618-3bfe5768fa74 HTTP/1.1" status: 204 len: 168 time: 0.7944918 Nov 09 04:32:38.031370 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56366) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:38.032701 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f04f40c7-f442-41b6-9de9-49accc5a1336 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Pushing event deleted for resources: {'Subnet': ['ID=bdebff0a-5c2f-4480-b618-3bfe5768fa74,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:38.042265 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2a17ab19-071f-47c8-a821-382e5b2b239a tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:38.045760 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-2a17ab19-071f-47c8-a821-382e5b2b239a tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "DELETE /v2.0/subnets/3479ab9e-17ee-493e-93ef-61596c974f8d HTTP/1.1" status: 204 len: 168 time: 1.6061068 Nov 09 04:32:38.051005 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56368) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:38.062526 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-9c4a6702-2795-4e91-bea1-44a1c402c89f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Request body: {'subnet': {'network_id': 'cc397c48-c4cc-4846-a1ef-380b64be450d', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:38.062904 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 9c023fad-c8fa-4120-b9cc-4ea22c1718e4 up at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:32:38.064939 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e5f73788-7f27-4b70-ad97-844a80177777 None None] Network edc7865f-a24c-4291-8dc6-52e11b6930c1 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:32:38.066548 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8e375f91-78d8-4afe-b08e-4c81b46c3c78 None None] Network cc397c48-c4cc-4846-a1ef-380b64be450d requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:32:38.075498 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a17ab19-071f-47c8-a821-382e5b2b239a tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event deleted for resources: {'Subnet': ['ID=3479ab9e-17ee-493e-93ef-61596c974f8d,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:38.111652 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-87f63fb3-c86d-4e9c-884b-f2a55b070542 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:38.136476 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=843328c7-08ce-4c76-a55f-3396fabab904,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:38.166281 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6d56d0f8-f4f9-4836-bcbc-9c9a03f5f588 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:38.230328 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-6d56d0f8-f4f9-4836-bcbc-9c9a03f5f588 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Calling delete_port for 27629a82-8855-48a5-a4c1-c20ca2bea522 owned by {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:32:38.239749 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-87f63fb3-c86d-4e9c-884b-f2a55b070542 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:38.249006 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-2afb37cb-4259-4562-affe-0bc9e1857cdf None None] Provisioning complete for port 27629a82-8855-48a5-a4c1-c20ca2bea522 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:38.249589 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-2afb37cb-4259-4562-affe-0bc9e1857cdf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:38.251043 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e0ce1f7a-3bea-4a9d-bb66-9ea0c29b1537 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:38.281302 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-87f63fb3-c86d-4e9c-884b-f2a55b070542 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:38.287889 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-87f63fb3-c86d-4e9c-884b-f2a55b070542 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/f01a9e64-acbf-4c7c-800c-5ec2adc6fdff HTTP/1.1" status: 204 len: 168 time: 0.9093435 Nov 09 04:32:38.290954 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56370) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:38.301316 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87f63fb3-c86d-4e9c-884b-f2a55b070542 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event deleted for resources: {'Subnet': ['ID=f01a9e64-acbf-4c7c-800c-5ec2adc6fdff,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:38.311333 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a0af0da8-557e-4be2-b178-7731e3b77fc1 None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:32:38.370325 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-614d143f-f2fb-4b01-aac7-c9ec48b18ed5 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Router fa30d24d-d721-4675-ad7b-09f35105e633 is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102162) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:32:38.482646 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-51d6d36f-32e4-4ec4-8c52-2ae38d4634ee None None] Deleting port 0436bdb7-90d1-4607-b19a-81c26177275b {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:32:38.483313 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-51d6d36f-32e4-4ec4-8c52-2ae38d4634ee None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:38.502164 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-2afb37cb-4259-4562-affe-0bc9e1857cdf None None] Port 27629a82-8855-48a5-a4c1-c20ca2bea522 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:32:38.503318 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9c4a6702-2795-4e91-bea1-44a1c402c89f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Made reservation on behalf of 88f9f8da29bf4a8793b45130d483a6e6 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:38.507016 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9c4a6702-2795-4e91-bea1-44a1c402c89f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:38.569077 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-e0ce1f7a-3bea-4a9d-bb66-9ea0c29b1537 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Deleting port 0436bdb7-90d1-4607-b19a-81c26177275b {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:32:38.569342 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e0ce1f7a-3bea-4a9d-bb66-9ea0c29b1537 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:38.618080 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning complete for port 9c023fad-c8fa-4120-b9cc-4ea22c1718e4 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:38.619308 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:38.642723 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 843328c7-08ce-4c76-a55f-3396fabab904 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:32:38.686614 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-614d143f-f2fb-4b01-aac7-c9ec48b18ed5 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:32:38.700347 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-614d143f-f2fb-4b01-aac7-c9ec48b18ed5 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "PUT /v2.0/routers/fa30d24d-d721-4675-ad7b-09f35105e633/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.7208483 Nov 09 04:32:38.716135 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56372) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:38.722209 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-90fe6143-af8b-472e-88fa-78ea9ee0ab1b tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Request body: {'network': {'name': 'tempest-RoutersTest-929471939'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:38.739110 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-460e8f89-782b-4dd0-b180-68598558ffed None None] Sync routers for ids ['fa30d24d-d721-4675-ad7b-09f35105e633'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:32:38.750990 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-d180ee3e-872f-4b58-a8d8-b390778256fe tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/routers HTTP/1.1" status: 200 len: 708 time: 0.4581099 Nov 09 04:32:38.753091 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56374) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:38.764383 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-e0ce1f7a-3bea-4a9d-bb66-9ea0c29b1537 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] For port 0436bdb7-90d1-4607-b19a-81c26177275b, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=0436bdb7-90d1-4607-b19a-81c26177275b,segment=NetworkSegment(2886750e-78b9-461d-a046-d26e527b0e3f),segment_id=2886750e-78b9-461d-a046-d26e527b0e3f)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:32:38.764762 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e0ce1f7a-3bea-4a9d-bb66-9ea0c29b1537 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:38.772033 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-51d6d36f-32e4-4ec4-8c52-2ae38d4634ee None None] For port 0436bdb7-90d1-4607-b19a-81c26177275b, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=0436bdb7-90d1-4607-b19a-81c26177275b,segment=NetworkSegment(2886750e-78b9-461d-a046-d26e527b0e3f),segment_id=2886750e-78b9-461d-a046-d26e527b0e3f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:32:38.772540 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-51d6d36f-32e4-4ec4-8c52-2ae38d4634ee None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:38.795419 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-e0ce1f7a-3bea-4a9d-bb66-9ea0c29b1537 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Calling delete_port for 0436bdb7-90d1-4607-b19a-81c26177275b owned by network:dhcp {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:32:38.816609 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-2afb37cb-4259-4562-affe-0bc9e1857cdf None None] Provisioning complete for port 843328c7-08ce-4c76-a55f-3396fabab904 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:38.816961 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-2afb37cb-4259-4562-affe-0bc9e1857cdf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:38.841080 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-12867e23-a5a5-4227-8290-74e06604a891 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for router, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:38.856247 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-51d6d36f-32e4-4ec4-8c52-2ae38d4634ee None None] Calling delete_port for 0436bdb7-90d1-4607-b19a-81c26177275b owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:32:38.887701 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-460e8f89-782b-4dd0-b180-68598558ffed None None] Routers {'fa30d24d-d721-4675-ad7b-09f35105e633'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:32:38.888431 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-460e8f89-782b-4dd0-b180-68598558ffed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:32:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['fa30d24d-d721-4675-ad7b-09f35105e633'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:38.927524 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-90fe6143-af8b-472e-88fa-78ea9ee0ab1b tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Made reservation on behalf of 188f23ef0cb54006875c672b78f5249f for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:38.932853 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-90fe6143-af8b-472e-88fa-78ea9ee0ab1b tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:38.935293 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6d56d0f8-f4f9-4836-bcbc-9c9a03f5f588 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:39.019734 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-12867e23-a5a5-4227-8290-74e06604a891 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:39.022211 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-12867e23-a5a5-4227-8290-74e06604a891 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:39.032271 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e0ce1f7a-3bea-4a9d-bb66-9ea0c29b1537 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:39.042109 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-111494d6-530a-4ea0-a3ad-29a9b9493970 None None] DHCP port deletion for edc7865f-a24c-4291-8dc6-52e11b6930c1 request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:32:39.122040 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d56d0f8-f4f9-4836-bcbc-9c9a03f5f588 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event deleted for resources: {'Port': ['ID=27629a82-8855-48a5-a4c1-c20ca2bea522,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:39.147630 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-12867e23-a5a5-4227-8290-74e06604a891 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:39.148121 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-12867e23-a5a5-4227-8290-74e06604a891 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Fanout notify agent at l3_agent the message router_deleted on router 12f1801e-1293-4cba-b48b-b9becf0da441 {{(pid=102161) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:32:39.155045 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-12867e23-a5a5-4227-8290-74e06604a891 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:39.158958 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-12867e23-a5a5-4227-8290-74e06604a891 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/routers/12f1801e-1293-4cba-b48b-b9becf0da441 HTTP/1.1" status: 204 len: 168 time: 0.4019210 Nov 09 04:32:39.159167 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56376) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:39.202993 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-460e8f89-782b-4dd0-b180-68598558ffed None None] Set router fa30d24d-d721-4675-ad7b-09f35105e633 gateway port host: None {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:32:39.214142 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-32a94494-d601-461f-8385-a9385bbb3be3 None None] DHCP port deletion for 988d2354-693c-4d52-af17-25e0643eaa0c request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:32:39.235763 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-90fe6143-af8b-472e-88fa-78ea9ee0ab1b tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 310} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:32:39.256910 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 843328c7-08ce-4c76-a55f-3396fabab904 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:39.257816 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:39.267216 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0c828a5c-7f08-4928-9ad8-42d138bf57e7 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:39.268819 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-0c828a5c-7f08-4928-9ad8-42d138bf57e7 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/ports HTTP/1.1" status: 200 len: 866 time: 0.1084614 Nov 09 04:32:39.288172 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56378) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:39.298291 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6d56d0f8-f4f9-4836-bcbc-9c9a03f5f588 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:39.302795 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-6d56d0f8-f4f9-4836-bcbc-9c9a03f5f588 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "DELETE /v2.0/ports/27629a82-8855-48a5-a4c1-c20ca2bea522 HTTP/1.1" status: 204 len: 168 time: 2.2506247 Nov 09 04:32:39.312766 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56380) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:39.314756 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0ce1f7a-3bea-4a9d-bb66-9ea0c29b1537 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Pushing event deleted for resources: {'Port': ['ID=0436bdb7-90d1-4607-b19a-81c26177275b,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:39.349429 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e0ce1f7a-3bea-4a9d-bb66-9ea0c29b1537 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] No DVR routers for this DVR port 0436bdb7-90d1-4607-b19a-81c26177275b on host dv-neutron-816802-2-hyperv {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:32:39.349429 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-90fe6143-af8b-472e-88fa-78ea9ee0ab1b tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:39.349429 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-90fe6143-af8b-472e-88fa-78ea9ee0ab1b tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Added segment d324ad80-31e0-4532-9d92-4601f8a04c92 of type vlan for network e1b06497-74dd-47e6-9b9a-79074e9bf0e8 Nov 09 04:32:39.402266 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-76639166-9003-42f3-8f4d-3d054f05eca3 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:39.404688 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-76639166-9003-42f3-8f4d-3d054f05eca3 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.1147919 Nov 09 04:32:39.406879 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56382) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:39.411358 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:39.429809 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-191a0b22-064a-492d-b9b7-0e15b111a109 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] GET failed (client error): The resource could not be found. Nov 09 04:32:39.435378 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-191a0b22-064a-492d-b9b7-0e15b111a109 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "GET /v2.0/ports/27629a82-8855-48a5-a4c1-c20ca2bea522 HTTP/1.1" status: 404 len: 333 time: 0.1163082 Nov 09 04:32:39.454124 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56384) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:39.471038 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-75299d61-0df9-4c62-8315-def797a7cf3b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0628195 Nov 09 04:32:39.480193 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56386) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:39.485457 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-bc17da1d-141f-4b1b-8e63-524add064a9b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'subnet': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:39.560039 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 9c023fad-c8fa-4120-b9cc-4ea22c1718e4, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=9c023fad-c8fa-4120-b9cc-4ea22c1718e4,segment=NetworkSegment(d5411e15-1506-4025-8472-ba7118358f68),segment_id=d5411e15-1506-4025-8472-ba7118358f68)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:32:39.561398 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-51d6d36f-32e4-4ec4-8c52-2ae38d4634ee None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:39.573602 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9c4e58e3-39e4-4212-b106-50b44d4c4e28', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9c023fad-c8fa-4120-b9cc-4ea22c1718e4'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:32:39.576052 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c668910d-9c03-4115-8d33-2a2bc2d2c1dd" -d '{"events": [{"server_uuid": "9c4e58e3-39e4-4212-b106-50b44d4c4e28", "name": "network-vif-plugged", "status": "completed", "tag": "9c023fad-c8fa-4120-b9cc-4ea22c1718e4"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:32:39.642006 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e0ce1f7a-3bea-4a9d-bb66-9ea0c29b1537 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:39.653978 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-90fe6143-af8b-472e-88fa-78ea9ee0ab1b tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:39.703491 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-e0ce1f7a-3bea-4a9d-bb66-9ea0c29b1537 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f5f331fb-d0d2-40d3-ae47-5628a07f50e3']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:39.708405 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9c4a6702-2795-4e91-bea1-44a1c402c89f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:39.717872 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51d6d36f-32e4-4ec4-8c52-2ae38d4634ee None None] Pushing event deleted for resources: {'Port': ['ID=0436bdb7-90d1-4607-b19a-81c26177275b,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:39.725670 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bc17da1d-141f-4b1b-8e63-524add064a9b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:39.730814 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bc17da1d-141f-4b1b-8e63-524add064a9b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:39.753613 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-93a2fde5-84dd-40f8-9257-f7e5a887f180 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Deleting subnet d4895447-5025-41d7-a1d1-fd578440707f {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:32:39.756509 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:39.772293 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-e0ce1f7a-3bea-4a9d-bb66-9ea0c29b1537 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2886750e-78b9-461d-a046-d26e527b0e3f') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:39.772581 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-e0ce1f7a-3bea-4a9d-bb66-9ea0c29b1537 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2886750e-78b9-461d-a046-d26e527b0e3f') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:39.775967 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-93a2fde5-84dd-40f8-9257-f7e5a887f180 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:39.821802 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e0ce1f7a-3bea-4a9d-bb66-9ea0c29b1537 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:39.824791 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-51d6d36f-32e4-4ec4-8c52-2ae38d4634ee None None] No DVR routers for this DVR port 0436bdb7-90d1-4607-b19a-81c26177275b on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:32:39.840211 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:32:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5f62fb35-3e0b-4a8c-a65f-4e23b2d02dd3 x-openstack-request-id: req-5f62fb35-3e0b-4a8c-a65f-4e23b2d02dd3 {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:32:39.841192 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9c4e58e3-39e4-4212-b106-50b44d4c4e28", "name": "network-vif-plugged", "status": "completed", "tag": "9c023fad-c8fa-4120-b9cc-4ea22c1718e4", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:32:39.841192 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-5f62fb35-3e0b-4a8c-a65f-4e23b2d02dd3 {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:32:39.841192 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9c4e58e3-39e4-4212-b106-50b44d4c4e28', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9c023fad-c8fa-4120-b9cc-4ea22c1718e4', 'code': 200} Nov 09 04:32:39.841850 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=9c023fad-c8fa-4120-b9cc-4ea22c1718e4,revision_number=8']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:39.846259 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-52cc61e6-65b1-4d34-ad68-1d9681560bc1 None None] Could not find standard attr ID for object 27629a82-8855-48a5-a4c1-c20ca2bea522. {{(pid=102163) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 09 04:32:39.862253 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-111494d6-530a-4ea0-a3ad-29a9b9493970 None None] Deleting port b5f72cef-acd0-4924-8988-5d9cdcd366e6 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:32:39.863278 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-111494d6-530a-4ea0-a3ad-29a9b9493970 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:39.873968 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9c4a6702-2795-4e91-bea1-44a1c402c89f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Network cc397c48-c4cc-4846-a1ef-380b64be450d is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:39.880400 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-9c4a6702-2795-4e91-bea1-44a1c402c89f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:39.886337 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c4a6702-2795-4e91-bea1-44a1c402c89f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event updated for resources: {'Subnet': ['ID=a9f45838-17f7-49da-abfb-42e7219b00a2,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:39.888259 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-93a2fde5-84dd-40f8-9257-f7e5a887f180 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:39.903936 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e0ce1f7a-3bea-4a9d-bb66-9ea0c29b1537 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:39.908143 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9c4a6702-2795-4e91-bea1-44a1c402c89f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:39.909043 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9c4a6702-2795-4e91-bea1-44a1c402c89f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:39.950334 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-90fe6143-af8b-472e-88fa-78ea9ee0ab1b tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:39.956568 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-90fe6143-af8b-472e-88fa-78ea9ee0ab1b tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:39.956568 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-90fe6143-af8b-472e-88fa-78ea9ee0ab1b tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:39.981542 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e0ce1f7a-3bea-4a9d-bb66-9ea0c29b1537 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Releasing vlan 344 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:32:39.981954 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e0ce1f7a-3bea-4a9d-bb66-9ea0c29b1537 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:39.990340 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:32:39.990340 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:32:39.990340 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:32:39.990340 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:32:39.990340 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:32:39.990340 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:32:39.990340 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:32:39.990340 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:32:39.990340 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:32:39.990340 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:32:39.990340 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:32:39.990340 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:32:39.990340 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:32:39.990340 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:32:39.990340 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:32:39.990340 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:32:39.990340 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:32:39.990340 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:32:39.990340 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:32:39.990340 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:32:39.990340 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:32:39.990340 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:32:39.990340 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:32:39.990340 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:32:39.990340 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:32:39.990340 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:32:39.990340 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:32:39.990340 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:32:39.990340 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:32:39.990340 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:32:39.990340 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:32:39.990340 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:32:40.148181 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-9c4a6702-2795-4e91-bea1-44a1c402c89f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.0932007 Nov 09 04:32:40.152485 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56390) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:40.157688 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-3cc171b7-c786-4ce2-a72d-f8349e5be8fa tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Request body: {'security_group': {'name': 'tempest-secgroup-1901550738'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:40.166396 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-90fe6143-af8b-472e-88fa-78ea9ee0ab1b tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 765 time: 1.4471412 Nov 09 04:32:40.167745 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56392) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:40.179755 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90fe6143-af8b-472e-88fa-78ea9ee0ab1b tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event updated for resources: {'Network': ['ID=e1b06497-74dd-47e6-9b9a-79074e9bf0e8,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:40.181320 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-c6d563df-4b47-4aad-846b-9a39feaac38e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Request body: {'subnet': {'network_id': 'e1b06497-74dd-47e6-9b9a-79074e9bf0e8', 'cidr': '172.21.0.0/28', 'ip_version': 4, 'gateway_ip': '172.21.0.1'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:40.182952 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a3bd8a74-0c57-4aac-804b-baa5b8f32736 None None] Network cc397c48-c4cc-4846-a1ef-380b64be450d requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:32:40.199362 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-32a94494-d601-461f-8385-a9385bbb3be3 None None] Deleting port 475084e5-a1f4-489d-aaad-e5c375775a1b {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:32:40.200511 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-32a94494-d601-461f-8385-a9385bbb3be3 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:40.201474 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network e1b06497-74dd-47e6-9b9a-79074e9bf0e8 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:32:40.230850 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-52cc61e6-65b1-4d34-ad68-1d9681560bc1 None None] Provisioning complete for port 843328c7-08ce-4c76-a55f-3396fabab904 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:40.231622 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-52cc61e6-65b1-4d34-ad68-1d9681560bc1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:40.233892 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-93a2fde5-84dd-40f8-9257-f7e5a887f180 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:40.283479 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3cc171b7-c786-4ce2-a72d-f8349e5be8fa tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:40.286027 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e0ce1f7a-3bea-4a9d-bb66-9ea0c29b1537 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:40.298834 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e0ce1f7a-3bea-4a9d-bb66-9ea0c29b1537 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:40.302744 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e0ce1f7a-3bea-4a9d-bb66-9ea0c29b1537 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] 10.222.0.24 "DELETE /v2.0/networks/f5f331fb-d0d2-40d3-ae47-5628a07f50e3 HTTP/1.1" status: 204 len: 168 time: 2.2665114 Nov 09 04:32:40.306829 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56394) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:40.318086 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0ce1f7a-3bea-4a9d-bb66-9ea0c29b1537 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Pushing event deleted for resources: {'Network': ['ID=f5f331fb-d0d2-40d3-ae47-5628a07f50e3,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:40.359782 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-93a2fde5-84dd-40f8-9257-f7e5a887f180 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:40.361283 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-111494d6-530a-4ea0-a3ad-29a9b9493970 None None] For port b5f72cef-acd0-4924-8988-5d9cdcd366e6, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=b5f72cef-acd0-4924-8988-5d9cdcd366e6,segment=NetworkSegment(f5cf6e05-866f-4624-bd85-417651ec848e),segment_id=f5cf6e05-866f-4624-bd85-417651ec848e)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:32:40.361802 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-111494d6-530a-4ea0-a3ad-29a9b9493970 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:40.390631 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93a2fde5-84dd-40f8-9257-f7e5a887f180 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event deleted for resources: {'Subnet': ['ID=d4895447-5025-41d7-a1d1-fd578440707f,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:40.394305 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-93a2fde5-84dd-40f8-9257-f7e5a887f180 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:40.401826 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-93a2fde5-84dd-40f8-9257-f7e5a887f180 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "DELETE /v2.0/subnets/d4895447-5025-41d7-a1d1-fd578440707f HTTP/1.1" status: 204 len: 168 time: 0.9286649 Nov 09 04:32:40.402115 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56396) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:40.421650 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8f64437e-6a16-4f8a-8c7c-525dee054e61 None None] Network 8f3e78d2-7b2e-446f-bf17-7f6ff24daa5e requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:32:40.456731 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-111494d6-530a-4ea0-a3ad-29a9b9493970 None None] Calling delete_port for b5f72cef-acd0-4924-8988-5d9cdcd366e6 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:32:40.474746 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-1d13a8c6-7bb1-4193-b861-30632474caf7 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Deleting subnet b197c77c-5641-42b9-8c7b-8025e4dab56c {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:32:40.478862 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1d13a8c6-7bb1-4193-b861-30632474caf7 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:40.524481 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.objects.ports [None req-bc17da1d-141f-4b1b-8e63-524add064a9b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=102161) get_objects /opt/stack/neutron/neutron/objects/ports.py:444}} Nov 09 04:32:40.528894 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7b80dd60-961d-4551-aef5-372d3d304d09 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:40.533507 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 0436bdb7-90d1-4607-b19a-81c26177275b no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:32:40.533674 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1d13a8c6-7bb1-4193-b861-30632474caf7 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:40.620504 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 0436bdb7-90d1-4607-b19a-81c26177275b {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:32:40.620759 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 0436bdb7-90d1-4607-b19a-81c26177275b not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:32:40.621143 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 80086735-c739-415d-8466-93db6194fe50 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:32:40.624011 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c6d563df-4b47-4aad-846b-9a39feaac38e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Made reservation on behalf of 188f23ef0cb54006875c672b78f5249f for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:40.627717 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c6d563df-4b47-4aad-846b-9a39feaac38e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:40.637026 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1d13a8c6-7bb1-4193-b861-30632474caf7 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:40.660927 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-460e8f89-782b-4dd0-b180-68598558ffed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'name': 'tempest-RoutersTest-router-1490827103', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:32:29Z', 'updated_at': '2021-11-09T04:32:36Z', 'revision_number': 2, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'gw_port_host': None, '_interfaces': [{'id': 'bf77ddc4-4ed9-472d-842b-1fb79d55e2e4', 'name': '', 'network_id': '35e2f2d1-ee40-4328-9fe2-48e5a5c19938', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:66:29:f1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 830, 'fixed_ips': [{'subnet_id': 'f60d3eec-6988-47b0-9f2f-6319fa99064d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:33Z', 'updated_at': '2021-11-09T04:32:36Z', 'revision_number': 2, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'f60d3eec-6988-47b0-9f2f-6319fa99064d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:40.671690 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 80086735-c739-415d-8466-93db6194fe50 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:32:40.672039 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 80086735-c739-415d-8466-93db6194fe50 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:32:40.730940 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-32a94494-d601-461f-8385-a9385bbb3be3 None None] For port 475084e5-a1f4-489d-aaad-e5c375775a1b, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=475084e5-a1f4-489d-aaad-e5c375775a1b,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:32:40.731389 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-32a94494-d601-461f-8385-a9385bbb3be3 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:40.770833 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-460e8f89-782b-4dd0-b180-68598558ffed None None] Checking router: fa30d24d-d721-4675-ad7b-09f35105e633 for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:32:40.771191 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-460e8f89-782b-4dd0-b180-68598558ffed None None] Updating router fa30d24d-d721-4675-ad7b-09f35105e633 port bf77ddc4-4ed9-472d-842b-1fb79d55e2e4 binding host dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 04:32:40.789078 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1d13a8c6-7bb1-4193-b861-30632474caf7 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:40.806811 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device b5f72cef-acd0-4924-8988-5d9cdcd366e6 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:32:40.809210 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-32a94494-d601-461f-8385-a9385bbb3be3 None None] Calling delete_port for 475084e5-a1f4-489d-aaad-e5c375775a1b owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:32:40.824779 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3cc171b7-c786-4ce2-a72d-f8349e5be8fa tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:40.832056 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d13a8c6-7bb1-4193-b861-30632474caf7 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event deleted for resources: {'Subnet': ['ID=b197c77c-5641-42b9-8c7b-8025e4dab56c,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:40.834695 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1d13a8c6-7bb1-4193-b861-30632474caf7 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:40.843428 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-1d13a8c6-7bb1-4193-b861-30632474caf7 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "DELETE /v2.0/subnets/b197c77c-5641-42b9-8c7b-8025e4dab56c HTTP/1.1" status: 204 len: 168 time: 0.4401963 Nov 09 04:32:40.848281 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56400) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:40.904536 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-460e8f89-782b-4dd0-b180-68598558ffed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:40.936505 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3cc171b7-c786-4ce2-a72d-f8349e5be8fa tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:40.947310 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-7b80dd60-961d-4551-aef5-372d3d304d09 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Deleting port b5f72cef-acd0-4924-8988-5d9cdcd366e6 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:32:40.947648 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7b80dd60-961d-4551-aef5-372d3d304d09 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:41.037564 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No ports have port_id starting with b5f72cef-acd0-4924-8988-5d9cdcd366e6 Nov 09 04:32:41.047044 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-111494d6-530a-4ea0-a3ad-29a9b9493970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:41.055069 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-52cc61e6-65b1-4d34-ad68-1d9681560bc1 None None] Provisioning complete for port bf77ddc4-4ed9-472d-842b-1fb79d55e2e4 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:41.055985 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-52cc61e6-65b1-4d34-ad68-1d9681560bc1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:41.065846 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 475084e5-a1f4-489d-aaad-e5c375775a1b no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:32:41.078800 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-241e1bd2-4f38-4d93-88b7-1904f50c92a2 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:41.095057 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3cc171b7-c786-4ce2-a72d-f8349e5be8fa tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:41.099030 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-3cc171b7-c786-4ce2-a72d-f8349e5be8fa tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1760 time: 0.9427371 Nov 09 04:32:41.099522 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56402) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:41.104620 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3cc171b7-c786-4ce2-a72d-f8349e5be8fa tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event updated for resources: {'SecurityGroup': ['ID=ec71de09-adca-48c6-bf05-ec0ddc8b3406,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:41.105955 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-b0c04873-9bfa-4222-9393-2b7658902634 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Request body: {'security_group': {'name': 'tempest-secgroup-1632274421'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:41.136869 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111494d6-530a-4ea0-a3ad-29a9b9493970 None None] Pushing event deleted for resources: {'Port': ['ID=b5f72cef-acd0-4924-8988-5d9cdcd366e6,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:41.140229 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bc17da1d-141f-4b1b-8e63-524add064a9b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:41.152537 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-7b80dd60-961d-4551-aef5-372d3d304d09 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] For port b5f72cef-acd0-4924-8988-5d9cdcd366e6, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=b5f72cef-acd0-4924-8988-5d9cdcd366e6,segment=NetworkSegment(f5cf6e05-866f-4624-bd85-417651ec848e),segment_id=f5cf6e05-866f-4624-bd85-417651ec848e)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:32:41.153187 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7b80dd60-961d-4551-aef5-372d3d304d09 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:41.158316 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-111494d6-530a-4ea0-a3ad-29a9b9493970 None None] No DVR routers for this DVR port b5f72cef-acd0-4924-8988-5d9cdcd366e6 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:32:41.186467 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-7b80dd60-961d-4551-aef5-372d3d304d09 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Calling delete_port for b5f72cef-acd0-4924-8988-5d9cdcd366e6 owned by network:dhcp {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:32:41.192255 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b0c04873-9bfa-4222-9393-2b7658902634 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:41.255592 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-52cc61e6-65b1-4d34-ad68-1d9681560bc1 None None] Port bf77ddc4-4ed9-472d-842b-1fb79d55e2e4 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:32:41.259336 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c6d563df-4b47-4aad-846b-9a39feaac38e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:41.311014 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b0c04873-9bfa-4222-9393-2b7658902634 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:41.321877 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2c94b0c4-7ffe-47a8-b5e0-e14b3e5d3aef None None] Update dhcp port {'port': {'network_id': 'cc397c48-c4cc-4846-a1ef-380b64be450d', 'fixed_ips': [{'subnet_id': '775bb7b9-6a44-44d8-a29c-1b53db6d50e5', 'ip_address': '172.20.0.18'}, {'subnet_id': 'a9f45838-17f7-49da-abfb-42e7219b00a2'}], 'binding:host_id': 'dv-neutron-816802-2-hyperv'}, 'id': '775e1b75-6b4e-4b53-8c8d-2c5aea990d99'} from dv-neutron-816802-2-hyperv. {{(pid=102163) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:328}} Nov 09 04:32:41.323962 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-32a94494-d601-461f-8385-a9385bbb3be3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:41.392140 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a57f3c2c-14cd-48b8-b22e-7f9c85b4d225 None None] DHCP port deletion for 8f3e78d2-7b2e-446f-bf17-7f6ff24daa5e request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:32:41.399666 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b0c04873-9bfa-4222-9393-2b7658902634 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:41.405479 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f6cf0a1f-07ba-49fc-b708-7a71de03026f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:41.407810 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Port 475084e5-a1f4-489d-aaad-e5c375775a1b update to DOWN by agent not found {{(pid=102163) update_port_statuses /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2167}} Nov 09 04:32:41.419030 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6d563df-4b47-4aad-846b-9a39feaac38e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event updated for resources: {'Subnet': ['ID=f0939bd8-617d-4f5c-9f7b-272de792edac,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:41.437636 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-32a94494-d601-461f-8385-a9385bbb3be3 None None] No DVR routers for this DVR port 475084e5-a1f4-489d-aaad-e5c375775a1b on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:32:41.442068 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32a94494-d601-461f-8385-a9385bbb3be3 None None] Pushing event deleted for resources: {'Port': ['ID=475084e5-a1f4-489d-aaad-e5c375775a1b,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:41.469743 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-2c94b0c4-7ffe-47a8-b5e0-e14b3e5d3aef None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:41.469933 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-241e1bd2-4f38-4d93-88b7-1904f50c92a2 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Deleting port bb3407cb-b257-46ba-b15b-69a174e46e25 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:32:41.470222 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-241e1bd2-4f38-4d93-88b7-1904f50c92a2 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:41.472227 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0c04873-9bfa-4222-9393-2b7658902634 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event updated for resources: {'SecurityGroup': ['ID=a5f16ce1-934f-440f-8bb9-bb56e4fe5d78,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:41.501462 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-257d584a-e772-4496-9317-c90b2be3a305 None None] Provisioning complete for port 775e1b75-6b4e-4b53-8c8d-2c5aea990d99 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:41.501823 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-257d584a-e772-4496-9317-c90b2be3a305 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:41.510625 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7b80dd60-961d-4551-aef5-372d3d304d09 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:41.538602 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b0c04873-9bfa-4222-9393-2b7658902634 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:41.544798 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56404) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:41.545330 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-b0c04873-9bfa-4222-9393-2b7658902634 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1760 time: 0.4444487 Nov 09 04:32:41.555963 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-7d152681-f0b0-42c4-9ebe-18670fc777a4 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Request body: {'security_group': {'name': 'tempest-secgroup-1835847172'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:41.562125 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c6d563df-4b47-4aad-846b-9a39feaac38e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Checking segment: {'id': 'd324ad80-31e0-4532-9d92-4601f8a04c92', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': 'e1b06497-74dd-47e6-9b9a-79074e9bf0e8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:32:41.562125 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c6d563df-4b47-4aad-846b-9a39feaac38e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Network hostable DHCP agents. Network: e1b06497-74dd-47e6-9b9a-79074e9bf0e8, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:32:41.611544 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b80dd60-961d-4551-aef5-372d3d304d09 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Pushing event deleted for resources: {'Port': ['ID=b5f72cef-acd0-4924-8988-5d9cdcd366e6,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:41.614877 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7b80dd60-961d-4551-aef5-372d3d304d09 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] No DVR routers for this DVR port b5f72cef-acd0-4924-8988-5d9cdcd366e6 on host dv-neutron-816802-2-hyperv {{(pid=102161) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:32:41.633878 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-241e1bd2-4f38-4d93-88b7-1904f50c92a2 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] For port bb3407cb-b257-46ba-b15b-69a174e46e25, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=bb3407cb-b257-46ba-b15b-69a174e46e25,segment=NetworkSegment(b075afef-177a-45c6-aea2-b9b2a8e5703d),segment_id=b075afef-177a-45c6-aea2-b9b2a8e5703d)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:32:41.634241 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-241e1bd2-4f38-4d93-88b7-1904f50c92a2 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:41.637651 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-bc17da1d-141f-4b1b-8e63-524add064a9b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] For port 475084e5-a1f4-489d-aaad-e5c375775a1b, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=475084e5-a1f4-489d-aaad-e5c375775a1b,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:32:41.685269 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-241e1bd2-4f38-4d93-88b7-1904f50c92a2 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Calling delete_port for bb3407cb-b257-46ba-b15b-69a174e46e25 owned by network:dhcp {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:32:41.766224 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7d152681-f0b0-42c4-9ebe-18670fc777a4 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:41.800885 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bc17da1d-141f-4b1b-8e63-524add064a9b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:41.804734 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7b80dd60-961d-4551-aef5-372d3d304d09 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:41.814719 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c6d563df-4b47-4aad-846b-9a39feaac38e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Network e1b06497-74dd-47e6-9b9a-79074e9bf0e8 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:32:41.855465 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-a57f3c2c-14cd-48b8-b22e-7f9c85b4d225 None None] Deleting port bb3407cb-b257-46ba-b15b-69a174e46e25 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:32:41.855858 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a57f3c2c-14cd-48b8-b22e-7f9c85b4d225 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:41.862605 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-7b80dd60-961d-4551-aef5-372d3d304d09 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['edc7865f-a24c-4291-8dc6-52e11b6930c1']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:41.879267 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-7b80dd60-961d-4551-aef5-372d3d304d09 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f5cf6e05-866f-4624-bd85-417651ec848e') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:41.879568 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-7b80dd60-961d-4551-aef5-372d3d304d09 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f5cf6e05-866f-4624-bd85-417651ec848e') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:41.905213 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7b80dd60-961d-4551-aef5-372d3d304d09 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:41.909612 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bc17da1d-141f-4b1b-8e63-524add064a9b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:41.910338 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bc17da1d-141f-4b1b-8e63-524add064a9b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:41.951881 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-c6d563df-4b47-4aad-846b-9a39feaac38e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, e1b06497-74dd-47e6-9b9a-79074e9bf0e8) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:41.969073 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-381fae7b-f0db-4ee5-b131-252e92f0deb4 None None] Network e1b06497-74dd-47e6-9b9a-79074e9bf0e8 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:32:41.974597 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-460e8f89-782b-4dd0-b180-68598558ffed None None] Publish callbacks [] for port, precommit_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:41.982145 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7b80dd60-961d-4551-aef5-372d3d304d09 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:41.983160 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc17da1d-141f-4b1b-8e63-524add064a9b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event deleted for resources: {'Port': ['ID=475084e5-a1f4-489d-aaad-e5c375775a1b,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:41.985532 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c6d563df-4b47-4aad-846b-9a39feaac38e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:41.986121 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c6d563df-4b47-4aad-846b-9a39feaac38e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:42.001142 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7b80dd60-961d-4551-aef5-372d3d304d09 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Releasing vlan 308 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:32:42.001550 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7b80dd60-961d-4551-aef5-372d3d304d09 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:42.009922 dv-neutron-816802-2-hyperv neutron-server[102161]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:32:42.009922 dv-neutron-816802-2-hyperv neutron-server[102161]: self.session.flush() Nov 09 04:32:42.009922 dv-neutron-816802-2-hyperv neutron-server[102161]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:32:42.009922 dv-neutron-816802-2-hyperv neutron-server[102161]: self.session.flush() Nov 09 04:32:42.009922 dv-neutron-816802-2-hyperv neutron-server[102161]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:32:42.009922 dv-neutron-816802-2-hyperv neutron-server[102161]: self.session.flush() Nov 09 04:32:42.009922 dv-neutron-816802-2-hyperv neutron-server[102161]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:32:42.009922 dv-neutron-816802-2-hyperv neutron-server[102161]: self.session.flush() Nov 09 04:32:42.009922 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:32:42.009922 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:32:42.009922 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:32:42.009922 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:32:42.009922 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:32:42.009922 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:32:42.009922 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:32:42.009922 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:32:42.009922 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:32:42.009922 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:32:42.009922 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:32:42.009922 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:32:42.009922 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:32:42.009922 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:32:42.009922 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:32:42.009922 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:32:42.009922 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:32:42.009922 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:32:42.009922 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:32:42.009922 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:32:42.009922 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:32:42.009922 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:32:42.009922 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:32:42.009922 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:32:42.009922 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:32:42.009922 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:32:42.009922 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:32:42.009922 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:32:42.009922 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:32:42.009922 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:32:42.009922 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:32:42.009922 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:32:42.027641 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-a57f3c2c-14cd-48b8-b22e-7f9c85b4d225 None None] For port bb3407cb-b257-46ba-b15b-69a174e46e25, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=bb3407cb-b257-46ba-b15b-69a174e46e25,segment=NetworkSegment(b075afef-177a-45c6-aea2-b9b2a8e5703d),segment_id=b075afef-177a-45c6-aea2-b9b2a8e5703d)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:32:42.029963 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a57f3c2c-14cd-48b8-b22e-7f9c85b4d225 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:42.044285 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bc17da1d-141f-4b1b-8e63-524add064a9b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:42.077481 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-2c94b0c4-7ffe-47a8-b5e0-e14b3e5d3aef None None] Allocated IP 172.20.0.2 (cc397c48-c4cc-4846-a1ef-380b64be450d/a9f45838-17f7-49da-abfb-42e7219b00a2/775e1b75-6b4e-4b53-8c8d-2c5aea990d99) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:32:42.090109 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-a57f3c2c-14cd-48b8-b22e-7f9c85b4d225 None None] Calling delete_port for bb3407cb-b257-46ba-b15b-69a174e46e25 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:32:42.090510 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-bc17da1d-141f-4b1b-8e63-524add064a9b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:42.094174 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7d152681-f0b0-42c4-9ebe-18670fc777a4 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:42.101312 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-460e8f89-782b-4dd0-b180-68598558ffed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:42.101677 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bc17da1d-141f-4b1b-8e63-524add064a9b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:42.102999 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bc17da1d-141f-4b1b-8e63-524add064a9b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:42.105040 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-241e1bd2-4f38-4d93-88b7-1904f50c92a2 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:42.116394 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc17da1d-141f-4b1b-8e63-524add064a9b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Subnet': ['ID=499c6d67-335c-447c-a852-480d77db57cd,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:42.116866 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b0bdb58d-c7af-4265-9b22-327cba050be8 None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:32:42.140900 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-241e1bd2-4f38-4d93-88b7-1904f50c92a2 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event deleted for resources: {'Port': ['ID=bb3407cb-b257-46ba-b15b-69a174e46e25,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:42.145604 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-241e1bd2-4f38-4d93-88b7-1904f50c92a2 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] No DVR routers for this DVR port bb3407cb-b257-46ba-b15b-69a174e46e25 on host dv-neutron-816802-2-hyperv {{(pid=102161) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:32:42.174642 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-c6d563df-4b47-4aad-846b-9a39feaac38e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.9999728 Nov 09 04:32:42.177561 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56406) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:42.229981 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7d152681-f0b0-42c4-9ebe-18670fc777a4 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:42.241899 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-241e1bd2-4f38-4d93-88b7-1904f50c92a2 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:42.266748 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7b80dd60-961d-4551-aef5-372d3d304d09 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:42.273676 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-bc17da1d-141f-4b1b-8e63-524add064a9b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 827 time: 2.7895207 Nov 09 04:32:42.280545 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:42.289693 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-257d584a-e772-4496-9317-c90b2be3a305 None None] Provisioning complete for port a4de75ae-2dab-4896-8d2a-cdfef3f44fab triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:42.290419 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-257d584a-e772-4496-9317-c90b2be3a305 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:42.290535 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7b80dd60-961d-4551-aef5-372d3d304d09 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:42.296056 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-7b80dd60-961d-4551-aef5-372d3d304d09 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] 10.222.0.24 "DELETE /v2.0/networks/edc7865f-a24c-4291-8dc6-52e11b6930c1 HTTP/1.1" status: 204 len: 168 time: 1.9824386 Nov 09 04:32:42.298076 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56408) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:42.298466 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56410) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:42.303431 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-7d285ae5-e858-4bee-8a40-aa22f700c5a8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'subnet': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:42.370634 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f934c50-a7ad-484a-92f5-18beaa39282f None None] Pushing event updated for resources: {'Port': ['ID=bf77ddc4-4ed9-472d-842b-1fb79d55e2e4,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:42.373882 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-241e1bd2-4f38-4d93-88b7-1904f50c92a2 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8f3e78d2-7b2e-446f-bf17-7f6ff24daa5e']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:42.378801 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7d152681-f0b0-42c4-9ebe-18670fc777a4 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:42.382018 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-7d152681-f0b0-42c4-9ebe-18670fc777a4 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1760 time: 0.8276742 Nov 09 04:32:42.382585 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d152681-f0b0-42c4-9ebe-18670fc777a4 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event updated for resources: {'SecurityGroup': ['ID=0f579a62-f1dd-49dd-bc50-30e401b588b8,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:42.400086 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56412) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:42.400880 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b80dd60-961d-4551-aef5-372d3d304d09 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Pushing event deleted for resources: {'Network': ['ID=edc7865f-a24c-4291-8dc6-52e11b6930c1,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:42.409906 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-4c6a24a8-c52f-4213-8e92-1ca8eb903f07 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Request body: {'port': {'name': 'tempest-PortsTestJSON-361142558', 'security_groups': ['0f579a62-f1dd-49dd-bc50-30e401b588b8'], 'network_id': 'cc397c48-c4cc-4846-a1ef-380b64be450d', 'admin_state_up': True, 'fixed_ips': [{'subnet_id': 'a9f45838-17f7-49da-abfb-42e7219b00a2'}]}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:42.468248 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-241e1bd2-4f38-4d93-88b7-1904f50c92a2 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b075afef-177a-45c6-aea2-b9b2a8e5703d') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:42.468474 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-241e1bd2-4f38-4d93-88b7-1904f50c92a2 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b075afef-177a-45c6-aea2-b9b2a8e5703d') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:42.497281 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-241e1bd2-4f38-4d93-88b7-1904f50c92a2 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:42.502171 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-257d584a-e772-4496-9317-c90b2be3a305 None None] Port a4de75ae-2dab-4896-8d2a-cdfef3f44fab cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:32:42.546811 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-7b21ce1f-a8d8-4cf6-bff9-1ee9714d226a tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Deleting subnet 44ed129a-8e24-4400-8a39-18df545f0a06 {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:32:42.555441 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7b21ce1f-a8d8-4cf6-bff9-1ee9714d226a tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:42.582687 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-241e1bd2-4f38-4d93-88b7-1904f50c92a2 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:42.587576 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-460e8f89-782b-4dd0-b180-68598558ffed None None] Attempting to bind port bf77ddc4-4ed9-472d-842b-1fb79d55e2e4 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:32:42.587943 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-460e8f89-782b-4dd0-b180-68598558ffed None None] Attempting to bind port bf77ddc4-4ed9-472d-842b-1fb79d55e2e4 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '57d559af-ebd5-42c2-b187-251c0ee907e1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 302, 'network_id': '35e2f2d1-ee40-4328-9fe2-48e5a5c19938'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:32:42.588742 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-460e8f89-782b-4dd0-b180-68598558ffed None None] Attempting to bind port bf77ddc4-4ed9-472d-842b-1fb79d55e2e4 on network 35e2f2d1-ee40-4328-9fe2-48e5a5c19938 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:32:42.605333 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a57f3c2c-14cd-48b8-b22e-7f9c85b4d225 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:42.608575 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-2c94b0c4-7ffe-47a8-b5e0-e14b3e5d3aef None None] For port 775e1b75-6b4e-4b53-8c8d-2c5aea990d99, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=775e1b75-6b4e-4b53-8c8d-2c5aea990d99,segment=NetworkSegment(5cb8d89b-c83c-4beb-ac61-4edae91bc9e8),segment_id=5cb8d89b-c83c-4beb-ac61-4edae91bc9e8)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:32:42.615551 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-241e1bd2-4f38-4d93-88b7-1904f50c92a2 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Releasing vlan 346 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:32:42.615812 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-241e1bd2-4f38-4d93-88b7-1904f50c92a2 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:42.616659 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-257d584a-e772-4496-9317-c90b2be3a305 None None] Provisioning complete for port bf77ddc4-4ed9-472d-842b-1fb79d55e2e4 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:42.617034 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-257d584a-e772-4496-9317-c90b2be3a305 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:42.619226 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:32:42.619226 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:32:42.619226 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:32:42.619226 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:32:42.619226 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:32:42.619226 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:32:42.619226 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:32:42.619226 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:32:42.619226 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:32:42.619226 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:32:42.619226 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:32:42.619226 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:32:42.619226 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:32:42.619226 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:32:42.619226 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:32:42.619226 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:32:42.619226 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:32:42.619226 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:32:42.619226 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:32:42.619226 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:32:42.619226 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:32:42.619226 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:32:42.619226 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:32:42.619226 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:32:42.619226 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:32:42.619226 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:32:42.619226 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:32:42.619226 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:32:42.619226 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:32:42.619226 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:32:42.619226 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:32:42.619226 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:32:42.636791 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-460e8f89-782b-4dd0-b180-68598558ffed None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 32, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:32:42.637113 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-460e8f89-782b-4dd0-b180-68598558ffed None None] Checking segment: {'id': '57d559af-ebd5-42c2-b187-251c0ee907e1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 302, 'network_id': '35e2f2d1-ee40-4328-9fe2-48e5a5c19938'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:32:42.637498 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-460e8f89-782b-4dd0-b180-68598558ffed None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:42.637888 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-460e8f89-782b-4dd0-b180-68598558ffed None None] Bound using segment: {'id': '57d559af-ebd5-42c2-b187-251c0ee907e1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 302, 'network_id': '35e2f2d1-ee40-4328-9fe2-48e5a5c19938'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:32:42.639179 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-460e8f89-782b-4dd0-b180-68598558ffed None None] Bound port: bf77ddc4-4ed9-472d-842b-1fb79d55e2e4, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '57d559af-ebd5-42c2-b187-251c0ee907e1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 302, 'network_id': '35e2f2d1-ee40-4328-9fe2-48e5a5c19938'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:32:42.639179 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-460e8f89-782b-4dd0-b180-68598558ffed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:42.645918 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9518ac49-f07e-4da4-82e8-59f0e214d5a6 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-e1b06497-74dd-47e6-9b9a-79074e9bf0e8', 'network_id': 'e1b06497-74dd-47e6-9b9a-79074e9bf0e8', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'fixed_ips': [{'subnet_id': 'f0939bd8-617d-4f5c-9f7b-272de792edac'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:32:42.645918 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9518ac49-f07e-4da4-82e8-59f0e214d5a6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:42.678728 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7b21ce1f-a8d8-4cf6-bff9-1ee9714d226a tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:42.710780 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a57f3c2c-14cd-48b8-b22e-7f9c85b4d225 None None] Pushing event deleted for resources: {'Port': ['ID=bb3407cb-b257-46ba-b15b-69a174e46e25,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:42.716119 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a57f3c2c-14cd-48b8-b22e-7f9c85b4d225 None None] No DVR routers for this DVR port bb3407cb-b257-46ba-b15b-69a174e46e25 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:32:42.786672 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1cee5b95-d3cc-41aa-9df9-09df855b2a10 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-988d2354-693c-4d52-af17-25e0643eaa0c', 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'tenant_id': '8b0758f781884982bf5b94e6609237f6', 'fixed_ips': [{'subnet_id': '499c6d67-335c-447c-a852-480d77db57cd'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:32:42.787509 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1cee5b95-d3cc-41aa-9df9-09df855b2a10 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:42.802663 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-2c94b0c4-7ffe-47a8-b5e0-e14b3e5d3aef None None] Publish callbacks [] for port, precommit_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:42.820326 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7b21ce1f-a8d8-4cf6-bff9-1ee9714d226a tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:42.834919 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-257d584a-e772-4496-9317-c90b2be3a305 None None] Port bf77ddc4-4ed9-472d-842b-1fb79d55e2e4 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:32:42.856041 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-241e1bd2-4f38-4d93-88b7-1904f50c92a2 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:42.866504 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7d285ae5-e858-4bee-8a40-aa22f700c5a8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:42.870758 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7d285ae5-e858-4bee-8a40-aa22f700c5a8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:42.903462 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device bb3407cb-b257-46ba-b15b-69a174e46e25 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:32:42.917124 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-2c94b0c4-7ffe-47a8-b5e0-e14b3e5d3aef None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:42.965137 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-241e1bd2-4f38-4d93-88b7-1904f50c92a2 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:42.968812 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-241e1bd2-4f38-4d93-88b7-1904f50c92a2 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "DELETE /v2.0/networks/8f3e78d2-7b2e-446f-bf17-7f6ff24daa5e HTTP/1.1" status: 204 len: 168 time: 2.1203718 Nov 09 04:32:42.985676 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: bb3407cb-b257-46ba-b15b-69a174e46e25 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:32:42.985994 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56414) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:42.986503 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device bb3407cb-b257-46ba-b15b-69a174e46e25 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:32:43.041137 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-006df466-3e4f-4cfc-b9c0-1db471b0e8b2 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:43.065487 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-460e8f89-782b-4dd0-b180-68598558ffed None None] For port bf77ddc4-4ed9-472d-842b-1fb79d55e2e4, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:32:43.071010 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-90581202-afbc-4c1d-97f2-3b3762e889e9 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:43.076105 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-90581202-afbc-4c1d-97f2-3b3762e889e9 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "GET /v2.0/ports HTTP/1.1" status: 200 len: 848 time: 0.0842569 Nov 09 04:32:43.077607 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56416) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:43.142171 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-460e8f89-782b-4dd0-b180-68598558ffed None None] For port bf77ddc4-4ed9-472d-842b-1fb79d55e2e4, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=bf77ddc4-4ed9-472d-842b-1fb79d55e2e4,segment=NetworkSegment(57d559af-ebd5-42c2-b187-251c0ee907e1),segment_id=57d559af-ebd5-42c2-b187-251c0ee907e1)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:32:43.176842 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-9ae40076-06bc-4e94-8548-003c94cd6eba None None] Provisioning complete for port bf77ddc4-4ed9-472d-842b-1fb79d55e2e4 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:43.177210 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9ae40076-06bc-4e94-8548-003c94cd6eba None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:43.199880 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c94b0c4-7ffe-47a8-b5e0-e14b3e5d3aef None None] Pushing event updated for resources: {'Port': ['ID=775e1b75-6b4e-4b53-8c8d-2c5aea990d99,revision_number=6']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:43.201286 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-2dba615d-5904-4b5b-9ec3-7c4d20206228 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "GET /v2.0/ports?fields=id&fields=mac_address HTTP/1.1" status: 200 len: 284 time: 0.1236491 Nov 09 04:32:43.206047 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56418) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:43.211907 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-65709260-7478-4549-9c66-898a939d1f02 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-1118555011'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:43.239704 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-460e8f89-782b-4dd0-b180-68598558ffed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:43.251615 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-9518ac49-f07e-4da4-82e8-59f0e214d5a6 None None] Allocated IP 172.21.0.2 (e1b06497-74dd-47e6-9b9a-79074e9bf0e8/f0939bd8-617d-4f5c-9f7b-272de792edac/64baf918-08fa-4394-98c8-06a2cc60530a) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:32:43.320106 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-1cee5b95-d3cc-41aa-9df9-09df855b2a10 None None] Allocated IP 2001:db8::f816:3eff:fe92:9c3a (988d2354-693c-4d52-af17-25e0643eaa0c/499c6d67-335c-447c-a852-480d77db57cd/92e4e3f0-c7f9-44d9-83a9-4ee03917e49e) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:32:43.360595 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-9ae40076-06bc-4e94-8548-003c94cd6eba None None] Port bf77ddc4-4ed9-472d-842b-1fb79d55e2e4 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:32:43.397526 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.db.api [None req-65709260-7478-4549-9c66-898a939d1f02 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Nov 09 04:32:43.397526 dv-neutron-816802-2-hyperv neutron-server[102162]: [SQL: DELETE FROM reservations WHERE reservations.project_id = %(project_id_1)s AND reservations.expiration < %(expiration_1)s] Nov 09 04:32:43.397526 dv-neutron-816802-2-hyperv neutron-server[102162]: [parameters: {'project_id_1': '12e47d8445b5429892cd1b9244512ca8', 'expiration_1': datetime.datetime(2021, 11, 9, 4, 32, 23, 221641)}] Nov 09 04:32:43.397526 dv-neutron-816802-2-hyperv neutron-server[102162]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=102162) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:32:43.400779 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-241e1bd2-4f38-4d93-88b7-1904f50c92a2 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event deleted for resources: {'Network': ['ID=8f3e78d2-7b2e-446f-bf17-7f6ff24daa5e,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:43.402727 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG oslo_db.api [None req-65709260-7478-4549-9c66-898a939d1f02 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Performing DB retry for function neutron.db.quota.driver_nolock.DbQuotaNoLockDriver.make_reservation {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:32:43.432504 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f934c50-a7ad-484a-92f5-18beaa39282f None None] Pushing event updated for resources: {'Port': ['ID=bf77ddc4-4ed9-472d-842b-1fb79d55e2e4,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:43.452229 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-460e8f89-782b-4dd0-b180-68598558ffed None None] Routers {'fa30d24d-d721-4675-ad7b-09f35105e633'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:32:43.453226 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-460e8f89-782b-4dd0-b180-68598558ffed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:32:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['fa30d24d-d721-4675-ad7b-09f35105e633'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:43.501746 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4c6a24a8-c52f-4213-8e92-1ca8eb903f07 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Made reservation on behalf of 88f9f8da29bf4a8793b45130d483a6e6 for: {'port': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:43.536943 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7b21ce1f-a8d8-4cf6-bff9-1ee9714d226a tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:43.604300 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b21ce1f-a8d8-4cf6-bff9-1ee9714d226a tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Pushing event deleted for resources: {'Subnet': ['ID=44ed129a-8e24-4400-8a39-18df545f0a06,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:43.620555 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7b21ce1f-a8d8-4cf6-bff9-1ee9714d226a tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:43.624309 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-7b21ce1f-a8d8-4cf6-bff9-1ee9714d226a tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] 10.222.0.24 "DELETE /v2.0/subnets/44ed129a-8e24-4400-8a39-18df545f0a06 HTTP/1.1" status: 204 len: 168 time: 1.3172321 Nov 09 04:32:43.627762 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56420) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:43.689857 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4c6a24a8-c52f-4213-8e92-1ca8eb903f07 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:43.729369 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [None req-4c6a24a8-c52f-4213-8e92-1ca8eb903f07 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] device_id is not set on port ad941d16-029f-42bb-8c21-8d90d927494e yet. {{(pid=102161) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:32:43.762128 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c353fbb4-567a-4902-8de6-51c6b02b7027 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:43.786535 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2168c81e-4877-4c3e-9292-32b02c9c3094 None None] Network 3f7c1cab-fc9e-407c-99b6-915196a89a79 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:32:43.830694 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-c353fbb4-567a-4902-8de6-51c6b02b7027 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Deleting port 5ba9b4c1-bfcf-44bf-a4f7-3ccc08804da0 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:32:43.831035 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c353fbb4-567a-4902-8de6-51c6b02b7027 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:43.849492 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7d285ae5-e858-4bee-8a40-aa22f700c5a8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:43.927294 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-c353fbb4-567a-4902-8de6-51c6b02b7027 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] For port 5ba9b4c1-bfcf-44bf-a4f7-3ccc08804da0, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=5ba9b4c1-bfcf-44bf-a4f7-3ccc08804da0,segment=NetworkSegment(1f6a556b-7415-4805-8bc7-b0f0bdc903ab),segment_id=1f6a556b-7415-4805-8bc7-b0f0bdc903ab)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:32:43.927974 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c353fbb4-567a-4902-8de6-51c6b02b7027 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:43.938930 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7d285ae5-e858-4bee-8a40-aa22f700c5a8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:43.946569 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-c353fbb4-567a-4902-8de6-51c6b02b7027 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Calling delete_port for 5ba9b4c1-bfcf-44bf-a4f7-3ccc08804da0 owned by network:dhcp {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:32:43.951231 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e70d3861-d9f5-4767-b4f3-4f7c41d2c300 None None] Provisioning complete for port bf77ddc4-4ed9-472d-842b-1fb79d55e2e4 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:43.951732 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e70d3861-d9f5-4767-b4f3-4f7c41d2c300 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:43.964763 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-7d285ae5-e858-4bee-8a40-aa22f700c5a8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:43.971163 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7d285ae5-e858-4bee-8a40-aa22f700c5a8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:43.971770 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7d285ae5-e858-4bee-8a40-aa22f700c5a8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:43.973223 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-460e8f89-782b-4dd0-b180-68598558ffed None None] Set router fa30d24d-d721-4675-ad7b-09f35105e633 gateway port host: None {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:32:43.979736 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d285ae5-e858-4bee-8a40-aa22f700c5a8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Subnet': ['ID=5601d7cd-bce5-40c4-a86c-ee5755339edb,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:44.010433 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-4c6a24a8-c52f-4213-8e92-1ca8eb903f07 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Allocated IP 172.20.0.6 (cc397c48-c4cc-4846-a1ef-380b64be450d/a9f45838-17f7-49da-abfb-42e7219b00a2/ad941d16-029f-42bb-8c21-8d90d927494e) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:32:44.032610 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-65709260-7478-4549-9c66-898a939d1f02 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Made reservation on behalf of 12e47d8445b5429892cd1b9244512ca8 for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:44.037055 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-65709260-7478-4549-9c66-898a939d1f02 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:44.045782 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9eca18e0-9abe-4726-b7ba-3ebe5c37b357 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:44.072563 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-65709260-7478-4549-9c66-898a939d1f02 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 337} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:32:44.083013 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-65709260-7478-4549-9c66-898a939d1f02 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:44.083197 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-65709260-7478-4549-9c66-898a939d1f02 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Added segment 4f6bb1f5-74af-4566-9205-8a358168ad9d of type vlan for network ecb7b134-532e-4633-869a-87791c77a3ae Nov 09 04:32:44.129372 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-65709260-7478-4549-9c66-898a939d1f02 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:44.134884 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-7d285ae5-e858-4bee-8a40-aa22f700c5a8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.8352132 Nov 09 04:32:44.138027 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56422) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:44.142689 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-1703e356-4f4e-4a3c-a27a-76138108522e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'port': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'mac_address': 'fa:16:3e:c6:77:d3', 'name': 'tempest-NetworksTestDHCPv6-1568398319'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:44.164184 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c353fbb4-567a-4902-8de6-51c6b02b7027 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:44.165979 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9518ac49-f07e-4da4-82e8-59f0e214d5a6 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:44.198929 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c353fbb4-567a-4902-8de6-51c6b02b7027 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Pushing event deleted for resources: {'Port': ['ID=5ba9b4c1-bfcf-44bf-a4f7-3ccc08804da0,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:44.200775 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c353fbb4-567a-4902-8de6-51c6b02b7027 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] No DVR routers for this DVR port 5ba9b4c1-bfcf-44bf-a4f7-3ccc08804da0 on host dv-neutron-816802-2-hyperv {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:32:44.245602 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1cee5b95-d3cc-41aa-9df9-09df855b2a10 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:44.247725 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-65709260-7478-4549-9c66-898a939d1f02 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:44.253479 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-65709260-7478-4549-9c66-898a939d1f02 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:44.254276 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4c6a24a8-c52f-4213-8e92-1ca8eb903f07 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:44.257319 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-65709260-7478-4549-9c66-898a939d1f02 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:44.271757 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9518ac49-f07e-4da4-82e8-59f0e214d5a6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:44.360877 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1cee5b95-d3cc-41aa-9df9-09df855b2a10 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:44.367477 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c353fbb4-567a-4902-8de6-51c6b02b7027 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:44.376070 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9518ac49-f07e-4da4-82e8-59f0e214d5a6 None None] Network e1b06497-74dd-47e6-9b9a-79074e9bf0e8 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:44.381539 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9518ac49-f07e-4da4-82e8-59f0e214d5a6 None None] Pushing event updated for resources: {'Port': ['ID=64baf918-08fa-4394-98c8-06a2cc60530a,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:44.406605 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e70d3861-d9f5-4767-b4f3-4f7c41d2c300 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:44.408463 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-9518ac49-f07e-4da4-82e8-59f0e214d5a6 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:44.410286 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6874d0b8-1c67-4000-8a2f-8a3e29a2085b None None] DHCP port deletion for 3f7c1cab-fc9e-407c-99b6-915196a89a79 request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:32:44.410879 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4c6a24a8-c52f-4213-8e92-1ca8eb903f07 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:44.415434 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9518ac49-f07e-4da4-82e8-59f0e214d5a6 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:32:44.454678 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-65709260-7478-4549-9c66-898a939d1f02 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 1.2474318 Nov 09 04:32:44.456453 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-c353fbb4-567a-4902-8de6-51c6b02b7027 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3f7c1cab-fc9e-407c-99b6-915196a89a79']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:44.459778 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-006df466-3e4f-4cfc-b9c0-1db471b0e8b2 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Allocated IP 172.21.0.1 (e1b06497-74dd-47e6-9b9a-79074e9bf0e8/f0939bd8-617d-4f5c-9f7b-272de792edac/98741773-362a-4c6e-b503-923f0f367a2a) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:32:44.460118 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56424) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:44.461833 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1cee5b95-d3cc-41aa-9df9-09df855b2a10 None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:44.464260 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65709260-7478-4549-9c66-898a939d1f02 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event updated for resources: {'Network': ['ID=ecb7b134-532e-4633-869a-87791c77a3ae,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:44.476723 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-17039982-ff2b-4bb1-9267-d635c5ac629e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Request body: {'subnet': {'network_id': 'ecb7b134-532e-4633-869a-87791c77a3ae', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:44.483847 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-c353fbb4-567a-4902-8de6-51c6b02b7027 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1f6a556b-7415-4805-8bc7-b0f0bdc903ab') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:44.483847 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-c353fbb4-567a-4902-8de6-51c6b02b7027 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1f6a556b-7415-4805-8bc7-b0f0bdc903ab') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:44.487502 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-1cee5b95-d3cc-41aa-9df9-09df855b2a10 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:44.504591 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1cee5b95-d3cc-41aa-9df9-09df855b2a10 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:32:44.506285 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network ecb7b134-532e-4633-869a-87791c77a3ae details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:32:44.506476 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c353fbb4-567a-4902-8de6-51c6b02b7027 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:44.533073 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4c6a24a8-c52f-4213-8e92-1ca8eb903f07 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Network cc397c48-c4cc-4846-a1ef-380b64be450d is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:44.533296 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-bcea034d-37c5-4986-a39f-b084491e348c req-62f2a3d1-cc19-4632-8d55-733870a21a05 service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=9c4e58e3-39e4-4212-b106-50b44d4c4e28&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1756468 Nov 09 04:32:44.547086 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c353fbb4-567a-4902-8de6-51c6b02b7027 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:44.547329 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cee5b95-d3cc-41aa-9df9-09df855b2a10 None None] Pushing event updated for resources: {'Port': ['ID=92e4e3f0-c7f9-44d9-83a9-4ee03917e49e,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:44.563019 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-4c6a24a8-c52f-4213-8e92-1ca8eb903f07 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:44.569934 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e70d3861-d9f5-4767-b4f3-4f7c41d2c300 None None] For port bf77ddc4-4ed9-472d-842b-1fb79d55e2e4, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=bf77ddc4-4ed9-472d-842b-1fb79d55e2e4,segment=NetworkSegment(57d559af-ebd5-42c2-b187-251c0ee907e1),segment_id=57d559af-ebd5-42c2-b187-251c0ee907e1)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:32:44.577255 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4c6a24a8-c52f-4213-8e92-1ca8eb903f07 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:32:44.602827 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c353fbb4-567a-4902-8de6-51c6b02b7027 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Releasing vlan 306 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:32:44.603234 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c353fbb4-567a-4902-8de6-51c6b02b7027 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:44.607363 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:32:44.607363 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:32:44.607363 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:32:44.607363 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:32:44.607363 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:32:44.607363 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:32:44.607363 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:32:44.607363 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:32:44.607363 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:32:44.607363 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:32:44.607363 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:32:44.607363 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:32:44.607363 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:32:44.607363 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:32:44.607363 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:32:44.607363 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:32:44.607363 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:32:44.607363 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:32:44.607363 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:32:44.607363 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:32:44.607363 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:32:44.607363 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:32:44.607363 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:32:44.607363 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:32:44.607363 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:32:44.607363 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:32:44.607363 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:32:44.607363 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:32:44.607363 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:32:44.607363 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:32:44.607363 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:32:44.607363 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:32:44.662586 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-9518ac49-f07e-4da4-82e8-59f0e214d5a6 None None] Attempting to bind port 64baf918-08fa-4394-98c8-06a2cc60530a on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:32:44.662951 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-9518ac49-f07e-4da4-82e8-59f0e214d5a6 None None] Attempting to bind port 64baf918-08fa-4394-98c8-06a2cc60530a by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'd324ad80-31e0-4532-9d92-4601f8a04c92', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': 'e1b06497-74dd-47e6-9b9a-79074e9bf0e8'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:32:44.663308 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9518ac49-f07e-4da4-82e8-59f0e214d5a6 None None] Attempting to bind port 64baf918-08fa-4394-98c8-06a2cc60530a on network e1b06497-74dd-47e6-9b9a-79074e9bf0e8 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:32:44.666803 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c6a24a8-c52f-4213-8e92-1ca8eb903f07 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event updated for resources: {'Port': ['ID=ad941d16-029f-42bb-8c21-8d90d927494e,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:44.680563 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1703e356-4f4e-4a3c-a27a-76138108522e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'port': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:44.684417 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9518ac49-f07e-4da4-82e8-59f0e214d5a6 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 32, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:32:44.684795 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9518ac49-f07e-4da4-82e8-59f0e214d5a6 None None] Checking segment: {'id': 'd324ad80-31e0-4532-9d92-4601f8a04c92', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': 'e1b06497-74dd-47e6-9b9a-79074e9bf0e8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:32:44.685195 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9518ac49-f07e-4da4-82e8-59f0e214d5a6 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:44.685573 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9518ac49-f07e-4da4-82e8-59f0e214d5a6 None None] Bound using segment: {'id': 'd324ad80-31e0-4532-9d92-4601f8a04c92', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': 'e1b06497-74dd-47e6-9b9a-79074e9bf0e8'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:32:44.686052 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-9518ac49-f07e-4da4-82e8-59f0e214d5a6 None None] Bound port: 64baf918-08fa-4394-98c8-06a2cc60530a, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd324ad80-31e0-4532-9d92-4601f8a04c92', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': 'e1b06497-74dd-47e6-9b9a-79074e9bf0e8'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:32:44.686461 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9518ac49-f07e-4da4-82e8-59f0e214d5a6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:44.692465 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e70d3861-d9f5-4767-b4f3-4f7c41d2c300 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:44.707529 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-1cee5b95-d3cc-41aa-9df9-09df855b2a10 None None] Attempting to bind port 92e4e3f0-c7f9-44d9-83a9-4ee03917e49e on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:32:44.707906 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-1cee5b95-d3cc-41aa-9df9-09df855b2a10 None None] Attempting to bind port 92e4e3f0-c7f9-44d9-83a9-4ee03917e49e by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:32:44.709760 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1cee5b95-d3cc-41aa-9df9-09df855b2a10 None None] Attempting to bind port 92e4e3f0-c7f9-44d9-83a9-4ee03917e49e on network 988d2354-693c-4d52-af17-25e0643eaa0c {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:32:44.711034 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-460e8f89-782b-4dd0-b180-68598558ffed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'name': 'tempest-RoutersTest-router-1490827103', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:32:29Z', 'updated_at': '2021-11-09T04:32:36Z', 'revision_number': 2, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'gw_port_host': None, '_interfaces': [{'id': 'bf77ddc4-4ed9-472d-842b-1fb79d55e2e4', 'name': '', 'network_id': '35e2f2d1-ee40-4328-9fe2-48e5a5c19938', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:66:29:f1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 830, 'fixed_ips': [{'subnet_id': 'f60d3eec-6988-47b0-9f2f-6319fa99064d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:33Z', 'updated_at': '2021-11-09T04:32:42Z', 'revision_number': 4, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'f60d3eec-6988-47b0-9f2f-6319fa99064d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:44.724442 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcea034d-37c5-4986-a39f-b084491e348c req-6d443356-9739-43c1-b851-e96297e4a247 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:44.725962 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-bcea034d-37c5-4986-a39f-b084491e348c req-6d443356-9739-43c1-b851-e96297e4a247 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=fd7df27e425449dfb80d0838c8f7fb89&device_id=9c4e58e3-39e4-4212-b106-50b44d4c4e28 HTTP/1.1" status: 200 len: 1098 time: 0.1507137 Nov 09 04:32:44.738677 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-006df466-3e4f-4cfc-b9c0-1db471b0e8b2 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:44.796549 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1cee5b95-d3cc-41aa-9df9-09df855b2a10 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 32, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:32:44.797164 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1cee5b95-d3cc-41aa-9df9-09df855b2a10 None None] Checking segment: {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:32:44.797573 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1cee5b95-d3cc-41aa-9df9-09df855b2a10 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:44.797705 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1cee5b95-d3cc-41aa-9df9-09df855b2a10 None None] Bound using segment: {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:32:44.798543 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-1cee5b95-d3cc-41aa-9df9-09df855b2a10 None None] Bound port: 92e4e3f0-c7f9-44d9-83a9-4ee03917e49e, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:32:44.798689 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1cee5b95-d3cc-41aa-9df9-09df855b2a10 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:44.800981 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4c6a24a8-c52f-4213-8e92-1ca8eb903f07 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:44.801622 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4c6a24a8-c52f-4213-8e92-1ca8eb903f07 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:44.809471 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c353fbb4-567a-4902-8de6-51c6b02b7027 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:44.820193 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-460e8f89-782b-4dd0-b180-68598558ffed None None] The sync data for ids ['fa30d24d-d721-4675-ad7b-09f35105e633'] in dv-neutron-816802-2-hyperv is: [{'id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'name': 'tempest-RoutersTest-router-1490827103', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:32:29Z', 'updated_at': '2021-11-09T04:32:36Z', 'revision_number': 2, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'gw_port_host': None, '_interfaces': [{'id': 'bf77ddc4-4ed9-472d-842b-1fb79d55e2e4', 'name': '', 'network_id': '35e2f2d1-ee40-4328-9fe2-48e5a5c19938', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:66:29:f1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 830, 'fixed_ips': [{'subnet_id': 'f60d3eec-6988-47b0-9f2f-6319fa99064d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:33Z', 'updated_at': '2021-11-09T04:32:42Z', 'revision_number': 4, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'f60d3eec-6988-47b0-9f2f-6319fa99064d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:32:44.858580 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1703e356-4f4e-4a3c-a27a-76138108522e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:44.872867 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c353fbb4-567a-4902-8de6-51c6b02b7027 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:44.879255 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-c353fbb4-567a-4902-8de6-51c6b02b7027 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] 10.222.0.24 "DELETE /v2.0/networks/3f7c1cab-fc9e-407c-99b6-915196a89a79 HTTP/1.1" status: 204 len: 168 time: 1.2480881 Nov 09 04:32:44.890657 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [None req-1703e356-4f4e-4a3c-a27a-76138108522e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] device_id is not set on port 996d0c64-fb2e-4dd3-84a6-1d4ca6cc05c9 yet. {{(pid=102161) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:32:44.903846 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56426) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:44.911641 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 775e1b75-6b4e-4b53-8c8d-2c5aea990d99 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:32:44.951874 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-ecd9f067-d4da-4471-9886-d61159b82bed tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] 10.222.0.24 "GET /v2.0/ports?device_id=1f829b23-19d3-4aa7-98b0-5096e56cda7c HTTP/1.1" status: 200 len: 205 time: 0.0449603 Nov 09 04:32:44.954522 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56428) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:44.957122 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c353fbb4-567a-4902-8de6-51c6b02b7027 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Pushing event deleted for resources: {'Network': ['ID=3f7c1cab-fc9e-407c-99b6-915196a89a79,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:44.967107 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-17039982-ff2b-4bb1-9267-d635c5ac629e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Made reservation on behalf of 12e47d8445b5429892cd1b9244512ca8 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:44.972189 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-17039982-ff2b-4bb1-9267-d635c5ac629e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:45.041817 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-006df466-3e4f-4cfc-b9c0-1db471b0e8b2 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:45.056202 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e70d3861-d9f5-4767-b4f3-4f7c41d2c300 None None] Pushing event updated for resources: {'Port': ['ID=bf77ddc4-4ed9-472d-842b-1fb79d55e2e4,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:45.059801 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-4c6a24a8-c52f-4213-8e92-1ca8eb903f07 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 923 time: 2.6562490 Nov 09 04:32:45.060431 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56430) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:45.070280 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-877beb11-ce99-4df6-ac22-cfac92f9b279 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Request body: {'subnet': {'network_id': 'cc397c48-c4cc-4846-a1ef-380b64be450d', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:45.070528 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-9f970839-0782-4ffd-8127-4ad34567ea04 None None] Provisioning complete for port 775e1b75-6b4e-4b53-8c8d-2c5aea990d99 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:45.070928 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9f970839-0782-4ffd-8127-4ad34567ea04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:45.082505 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-9518ac49-f07e-4da4-82e8-59f0e214d5a6 None None] For port 64baf918-08fa-4394-98c8-06a2cc60530a, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:32:45.087790 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8dbb4e37-6c98-4750-8316-c0f576f9d052 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks [] for router, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:45.088748 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-9518ac49-f07e-4da4-82e8-59f0e214d5a6 None None] For port 64baf918-08fa-4394-98c8-06a2cc60530a, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=64baf918-08fa-4394-98c8-06a2cc60530a,segment=NetworkSegment(d324ad80-31e0-4532-9d92-4601f8a04c92),segment_id=d324ad80-31e0-4532-9d92-4601f8a04c92)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:32:45.136252 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:45.165508 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9518ac49-f07e-4da4-82e8-59f0e214d5a6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:45.171533 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-1cee5b95-d3cc-41aa-9df9-09df855b2a10 None None] For port 92e4e3f0-c7f9-44d9-83a9-4ee03917e49e, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:32:45.172977 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-006df466-3e4f-4cfc-b9c0-1db471b0e8b2 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Network e1b06497-74dd-47e6-9b9a-79074e9bf0e8 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:45.213289 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcea034d-37c5-4986-a39f-b084491e348c req-f4ad467e-3e64-4b85-8182-060a693720d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:45.215067 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-bcea034d-37c5-4986-a39f-b084491e348c req-f4ad467e-3e64-4b85-8182-060a693720d4 service neutron] 10.222.0.26 "GET /v2.0/networks?id=9c94e7dc-d679-4a7e-b264-6d619dbc935e HTTP/1.1" status: 200 len: 898 time: 0.4482081 Nov 09 04:32:45.220555 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 775e1b75-6b4e-4b53-8c8d-2c5aea990d99 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:45.221155 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:45.224425 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-1cee5b95-d3cc-41aa-9df9-09df855b2a10 None None] For port 92e4e3f0-c7f9-44d9-83a9-4ee03917e49e, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=92e4e3f0-c7f9-44d9-83a9-4ee03917e49e,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:32:45.225672 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-006df466-3e4f-4cfc-b9c0-1db471b0e8b2 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:45.231372 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-006df466-3e4f-4cfc-b9c0-1db471b0e8b2 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:32:45.248019 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-006df466-3e4f-4cfc-b9c0-1db471b0e8b2 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event updated for resources: {'Port': ['ID=98741773-362a-4c6e-b503-923f0f367a2a,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:45.315489 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1cee5b95-d3cc-41aa-9df9-09df855b2a10 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:45.344756 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9518ac49-f07e-4da4-82e8-59f0e214d5a6 None None] Pushing event updated for resources: {'Port': ['ID=64baf918-08fa-4394-98c8-06a2cc60530a,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:45.381917 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-1703e356-4f4e-4a3c-a27a-76138108522e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Allocated IP 172.20.0.14 (988d2354-693c-4d52-af17-25e0643eaa0c/5601d7cd-bce5-40c4-a86c-ee5755339edb/996d0c64-fb2e-4dd3-84a6-1d4ca6cc05c9) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:32:45.413801 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-1703e356-4f4e-4a3c-a27a-76138108522e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Allocated IP 2001:db8::f816:3eff:fec6:77d3 (988d2354-693c-4d52-af17-25e0643eaa0c/499c6d67-335c-447c-a852-480d77db57cd/996d0c64-fb2e-4dd3-84a6-1d4ca6cc05c9) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:32:45.441350 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8dbb4e37-6c98-4750-8316-c0f576f9d052 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:45.447832 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8dbb4e37-6c98-4750-8316-c0f576f9d052 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:45.466595 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-006df466-3e4f-4cfc-b9c0-1db471b0e8b2 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:45.572553 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-bcea034d-37c5-4986-a39f-b084491e348c req-6f05ab91-ce1f-4561-b49b-b478fcb8b8f1 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=9c023fad-c8fa-4120-b9cc-4ea22c1718e4 HTTP/1.1" status: 200 len: 1001 time: 0.3354776 Nov 09 04:32:45.579961 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cee5b95-d3cc-41aa-9df9-09df855b2a10 None None] Pushing event updated for resources: {'Port': ['ID=92e4e3f0-c7f9-44d9-83a9-4ee03917e49e,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:45.615837 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-9f970839-0782-4ffd-8127-4ad34567ea04 None None] Provisioning complete for port a4de75ae-2dab-4896-8d2a-cdfef3f44fab triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:45.616196 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9f970839-0782-4ffd-8127-4ad34567ea04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:45.705591 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 5ba9b4c1-bfcf-44bf-a4f7-3ccc08804da0 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:32:45.710755 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-9f970839-0782-4ffd-8127-4ad34567ea04 None None] Port a4de75ae-2dab-4896-8d2a-cdfef3f44fab cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:32:45.713718 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-17039982-ff2b-4bb1-9267-d635c5ac629e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:45.715562 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-877beb11-ce99-4df6-ac22-cfac92f9b279 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Made reservation on behalf of 88f9f8da29bf4a8793b45130d483a6e6 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:45.719617 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-877beb11-ce99-4df6-ac22-cfac92f9b279 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:45.726449 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcea034d-37c5-4986-a39f-b084491e348c req-f37ffd5c-52d1-401e-a02a-7bc7bef4bb0f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:45.729026 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-bcea034d-37c5-4986-a39f-b084491e348c req-f37ffd5c-52d1-401e-a02a-7bc7bef4bb0f service neutron] 10.222.0.26 "GET /v2.0/subnets?id=003822ea-7d1a-41fa-a15f-16fc8c9f624c HTTP/1.1" status: 200 len: 834 time: 0.0948234 Nov 09 04:32:45.759425 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8dbb4e37-6c98-4750-8316-c0f576f9d052 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:45.760237 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8dbb4e37-6c98-4750-8316-c0f576f9d052 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Fanout notify agent at l3_agent the message router_deleted on router 1f829b23-19d3-4aa7-98b0-5096e56cda7c {{(pid=102162) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:32:45.767112 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 5ba9b4c1-bfcf-44bf-a4f7-3ccc08804da0 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:32:45.767444 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 5ba9b4c1-bfcf-44bf-a4f7-3ccc08804da0 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:32:45.780235 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8dbb4e37-6c98-4750-8316-c0f576f9d052 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:45.784457 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-8dbb4e37-6c98-4750-8316-c0f576f9d052 tempest-RoutersNegativeTest-2133049312 tempest-RoutersNegativeTest-2133049312-project] 10.222.0.24 "DELETE /v2.0/routers/1f829b23-19d3-4aa7-98b0-5096e56cda7c HTTP/1.1" status: 204 len: 168 time: 0.8284018 Nov 09 04:32:45.853323 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-14a7f157-4fa1-4dba-b02d-988f28f5091d None None] Provisioning complete for port ad941d16-029f-42bb-8c21-8d90d927494e triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:45.853900 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-14a7f157-4fa1-4dba-b02d-988f28f5091d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:45.868171 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcea034d-37c5-4986-a39f-b084491e348c req-9a3c6bc7-e3bb-4802-b887-2dd49b3f8250 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:45.869711 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-bcea034d-37c5-4986-a39f-b084491e348c req-9a3c6bc7-e3bb-4802-b887-2dd49b3f8250 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=9c94e7dc-d679-4a7e-b264-6d619dbc935e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1072710 Nov 09 04:32:45.966700 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-006df466-3e4f-4cfc-b9c0-1db471b0e8b2 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:45.973475 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-14a7f157-4fa1-4dba-b02d-988f28f5091d None None] Port ad941d16-029f-42bb-8c21-8d90d927494e cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:32:46.091439 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17039982-ff2b-4bb1-9267-d635c5ac629e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event updated for resources: {'Subnet': ['ID=f071c371-6950-43fa-96e1-49e6709f9fc9,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:46.128509 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1703e356-4f4e-4a3c-a27a-76138108522e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:46.129971 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-17039982-ff2b-4bb1-9267-d635c5ac629e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Checking segment: {'id': '4f6bb1f5-74af-4566-9205-8a358168ad9d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 337, 'network_id': 'ecb7b134-532e-4633-869a-87791c77a3ae'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:32:46.130340 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-17039982-ff2b-4bb1-9267-d635c5ac629e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Network hostable DHCP agents. Network: ecb7b134-532e-4633-869a-87791c77a3ae, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:32:46.164037 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.ipam_backend_mixin [None req-877beb11-ce99-4df6-ac22-cfac92f9b279 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Validation for CIDR: 172.20.0.0/28 failed - overlaps with subnet a9f45838-17f7-49da-abfb-42e7219b00a2 (CIDR: 172.20.0.0/28) Nov 09 04:32:46.205004 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-877beb11-ce99-4df6-ac22-cfac92f9b279 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:32:46.205487 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-877beb11-ce99-4df6-ac22-cfac92f9b279 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:32:46.227041 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-17039982-ff2b-4bb1-9267-d635c5ac629e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Network ecb7b134-532e-4633-869a-87791c77a3ae is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:32:46.247636 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-bcea034d-37c5-4986-a39f-b084491e348c req-a2b39596-821f-4ba9-a297-495561bb1a0e service neutron] 10.222.0.26 "GET /v2.0/networks/9c94e7dc-d679-4a7e-b264-6d619dbc935e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2463033 Nov 09 04:32:46.250775 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1703e356-4f4e-4a3c-a27a-76138108522e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:46.300562 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1703e356-4f4e-4a3c-a27a-76138108522e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:46.315122 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-877beb11-ce99-4df6-ac22-cfac92f9b279 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 1.2426126 Nov 09 04:32:46.315122 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56436) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:46.322285 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-250f0bb0-9db9-433a-8005-72626b36208f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Request body: {'subnet': {'network_id': 'cc397c48-c4cc-4846-a1ef-380b64be450d', 'cidr': '172.20.0.16/28', 'ip_version': 4, 'gateway_ip': '172.20.0.17'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:46.328907 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-1703e356-4f4e-4a3c-a27a-76138108522e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:46.332289 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1703e356-4f4e-4a3c-a27a-76138108522e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:32:46.370831 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-17039982-ff2b-4bb1-9267-d635c5ac629e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, ecb7b134-532e-4633-869a-87791c77a3ae) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:46.376356 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-17039982-ff2b-4bb1-9267-d635c5ac629e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:46.377004 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-17039982-ff2b-4bb1-9267-d635c5ac629e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:46.388120 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-872db85f-3a55-4363-aba3-f6856e30c022 None None] Network ecb7b134-532e-4633-869a-87791c77a3ae requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:32:46.402918 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56438) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:46.407372 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1703e356-4f4e-4a3c-a27a-76138108522e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Port': ['ID=996d0c64-fb2e-4dd3-84a6-1d4ca6cc05c9,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:46.426474 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:46.485957 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1703e356-4f4e-4a3c-a27a-76138108522e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:46.487415 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1703e356-4f4e-4a3c-a27a-76138108522e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:46.530689 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-17039982-ff2b-4bb1-9267-d635c5ac629e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 2.0690625 Nov 09 04:32:46.531337 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56442) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:46.541935 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-8b5d9035-f6e5-467b-945a-30d7a5722b5b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Request body: {'port': {'network_id': 'ecb7b134-532e-4633-869a-87791c77a3ae', 'name': 'tempest-PortsIpV6TestJSON-1957255937'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:46.579642 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1703e356-4f4e-4a3c-a27a-76138108522e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1028 time: 2.4405732 Nov 09 04:32:46.597233 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56444) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:46.756497 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-bcea034d-37c5-4986-a39f-b084491e348c req-9e84b9d9-6db2-46f9-b8d8-eabe294a97b4 service neutron] 10.222.0.26 "GET /v2.0/networks/9c94e7dc-d679-4a7e-b264-6d619dbc935e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4871318 Nov 09 04:32:46.774603 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-006df466-3e4f-4cfc-b9c0-1db471b0e8b2 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:46.784518 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-22d9bf89-2eff-4619-96ac-302157a7195c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-ecb7b134-532e-4633-869a-87791c77a3ae', 'network_id': 'ecb7b134-532e-4633-869a-87791c77a3ae', 'tenant_id': '12e47d8445b5429892cd1b9244512ca8', 'fixed_ips': [{'subnet_id': 'f071c371-6950-43fa-96e1-49e6709f9fc9'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:32:46.785926 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-22d9bf89-2eff-4619-96ac-302157a7195c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:46.793899 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cc36443a-efee-4ff0-8172-b8386a922611 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:46.801002 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cc36443a-efee-4ff0-8172-b8386a922611 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:46.802672 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-cc36443a-efee-4ff0-8172-b8386a922611 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1783 time: 0.2033043 Nov 09 04:32:46.806806 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56446) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:46.827452 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-940601bd-2ed8-4661-b6be-588612ec860e admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=d84cfa063d124c7aaef56e163790a6eb&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4210160 Nov 09 04:32:46.830832 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56448) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:46.855178 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-006df466-3e4f-4cfc-b9c0-1db471b0e8b2 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:46.905304 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-250f0bb0-9db9-433a-8005-72626b36208f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Made reservation on behalf of 88f9f8da29bf4a8793b45130d483a6e6 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:46.914186 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-250f0bb0-9db9-433a-8005-72626b36208f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:47.025803 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-22d9bf89-2eff-4619-96ac-302157a7195c None None] Allocated IP 2001:db8::2 (ecb7b134-532e-4633-869a-87791c77a3ae/f071c371-6950-43fa-96e1-49e6709f9fc9/85170025-780d-40aa-8e55-163af488af0e) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:32:47.028581 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:47.033164 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-006df466-3e4f-4cfc-b9c0-1db471b0e8b2 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event updated for resources: {'Port': ['ID=98741773-362a-4c6e-b503-923f0f367a2a,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:47.041201 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-006df466-3e4f-4cfc-b9c0-1db471b0e8b2 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:47.072334 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 64baf918-08fa-4394-98c8-06a2cc60530a up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:32:47.124840 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.ipam_backend_mixin [None req-250f0bb0-9db9-433a-8005-72626b36208f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Validation for CIDR: 172.20.0.16/28 failed - overlaps with subnet 775bb7b9-6a44-44d8-a29c-1b53db6d50e5 (CIDR: 172.20.0.16/28) Nov 09 04:32:47.126007 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-54c32a59-eace-4feb-a4f3-c330078749a8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Deleting port 996d0c64-fb2e-4dd3-84a6-1d4ca6cc05c9 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:32:47.126295 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-54c32a59-eace-4feb-a4f3-c330078749a8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:47.128546 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8b5d9035-f6e5-467b-945a-30d7a5722b5b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Made reservation on behalf of 12e47d8445b5429892cd1b9244512ca8 for: {'port': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:47.132099 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8b5d9035-f6e5-467b-945a-30d7a5722b5b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:47.154309 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1edd1696-e7b6-4dd2-a918-15f3127ce3e2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:47.172419 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-250f0bb0-9db9-433a-8005-72626b36208f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:32:47.172793 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-250f0bb0-9db9-433a-8005-72626b36208f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:32:47.178493 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [None req-8b5d9035-f6e5-467b-945a-30d7a5722b5b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] device_id is not set on port 7cec9ece-ccf1-461e-a604-8e15e0d56c1e yet. {{(pid=102161) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:32:47.197823 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1edd1696-e7b6-4dd2-a918-15f3127ce3e2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:47.242527 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 64baf918-08fa-4394-98c8-06a2cc60530a triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:47.242973 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:47.243140 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-006df466-3e4f-4cfc-b9c0-1db471b0e8b2 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Network e1b06497-74dd-47e6-9b9a-79074e9bf0e8 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:47.250894 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-006df466-3e4f-4cfc-b9c0-1db471b0e8b2 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:47.274337 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-54c32a59-eace-4feb-a4f3-c330078749a8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:47.341426 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-250f0bb0-9db9-433a-8005-72626b36208f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 425 time: 1.0252552 Nov 09 04:32:47.363613 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56450) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:47.364164 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-22d9bf89-2eff-4619-96ac-302157a7195c None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:47.373958 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-0f5e1a8c-b5bc-45d0-9495-4a86de473e4a tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Request body: {'subnet': {'network_id': 'cc397c48-c4cc-4846-a1ef-380b64be450d', 'cidr': '172.20.0.32/28', 'ip_version': 4, 'gateway_ip': '172.20.0.33'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:47.396297 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-54c32a59-eace-4feb-a4f3-c330078749a8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Calling delete_port for 996d0c64-fb2e-4dd3-84a6-1d4ca6cc05c9 owned by {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:32:47.443216 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:47.471017 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1edd1696-e7b6-4dd2-a918-15f3127ce3e2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:47.481136 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1edd1696-e7b6-4dd2-a918-15f3127ce3e2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:47.485271 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-22d9bf89-2eff-4619-96ac-302157a7195c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:47.485597 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1edd1696-e7b6-4dd2-a918-15f3127ce3e2 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/c353752a-437e-4bc7-8fdb-25051ad289d3 HTTP/1.1" status: 204 len: 168 time: 0.6508877 Nov 09 04:32:47.498174 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-006df466-3e4f-4cfc-b9c0-1db471b0e8b2 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Router fa30d24d-d721-4675-ad7b-09f35105e633 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:32:47.505180 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 64baf918-08fa-4394-98c8-06a2cc60530a, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=64baf918-08fa-4394-98c8-06a2cc60530a,segment=NetworkSegment(d324ad80-31e0-4532-9d92-4601f8a04c92),segment_id=d324ad80-31e0-4532-9d92-4601f8a04c92)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:32:47.545161 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-22d9bf89-2eff-4619-96ac-302157a7195c None None] Network ecb7b134-532e-4633-869a-87791c77a3ae is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:47.551311 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-22d9bf89-2eff-4619-96ac-302157a7195c None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:47.554604 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-22d9bf89-2eff-4619-96ac-302157a7195c None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:32:47.570167 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22d9bf89-2eff-4619-96ac-302157a7195c None None] Pushing event updated for resources: {'Port': ['ID=85170025-780d-40aa-8e55-163af488af0e,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:47.632148 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:47.633482 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 92e4e3f0-c7f9-44d9-83a9-4ee03917e49e up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:32:47.647544 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-8b5d9035-f6e5-467b-945a-30d7a5722b5b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Allocated IP 2001:db8::1ca (ecb7b134-532e-4633-869a-87791c77a3ae/f071c371-6950-43fa-96e1-49e6709f9fc9/7cec9ece-ccf1-461e-a604-8e15e0d56c1e) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:32:47.736295 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1edd1696-e7b6-4dd2-a918-15f3127ce3e2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c353752a-437e-4bc7-8fdb-25051ad289d3,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:47.773852 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-54c32a59-eace-4feb-a4f3-c330078749a8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:47.802490 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=64baf918-08fa-4394-98c8-06a2cc60530a,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:47.813905 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-71f3e083-48a7-4cbb-b46d-1ffa73cbe15f None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:32:47.819490 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54c32a59-eace-4feb-a4f3-c330078749a8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event deleted for resources: {'Port': ['ID=996d0c64-fb2e-4dd3-84a6-1d4ca6cc05c9,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:47.877093 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ea94c60f-2cec-4618-9591-29f85c54adbe None None] Network e1b06497-74dd-47e6-9b9a-79074e9bf0e8 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:32:47.898391 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8b5d9035-f6e5-467b-945a-30d7a5722b5b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:47.942135 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-006df466-3e4f-4cfc-b9c0-1db471b0e8b2 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:32:47.949104 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-006df466-3e4f-4cfc-b9c0-1db471b0e8b2 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "PUT /v2.0/routers/fa30d24d-d721-4675-ad7b-09f35105e633/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.7697740 Nov 09 04:32:47.952437 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56458) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:47.953424 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-764117e3-f75e-49f5-8157-69904168aec5 None None] Sync routers for ids ['fa30d24d-d721-4675-ad7b-09f35105e633'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:32:47.958910 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-66ec16f0-8aa1-4bc0-b9c1-a00b814b19eb tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Request body: {'network': {'name': 'tempest-RoutersTest-1421332107'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:47.966823 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-764117e3-f75e-49f5-8157-69904168aec5 None None] Routers {'fa30d24d-d721-4675-ad7b-09f35105e633'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:32:47.967451 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-764117e3-f75e-49f5-8157-69904168aec5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:32:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['fa30d24d-d721-4675-ad7b-09f35105e633'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:47.979709 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0f5e1a8c-b5bc-45d0-9495-4a86de473e4a tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Made reservation on behalf of 88f9f8da29bf4a8793b45130d483a6e6 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:47.983510 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0f5e1a8c-b5bc-45d0-9495-4a86de473e4a tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:47.995482 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-22d9bf89-2eff-4619-96ac-302157a7195c None None] Attempting to bind port 85170025-780d-40aa-8e55-163af488af0e on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:32:47.997298 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-22d9bf89-2eff-4619-96ac-302157a7195c None None] Attempting to bind port 85170025-780d-40aa-8e55-163af488af0e by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '4f6bb1f5-74af-4566-9205-8a358168ad9d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 337, 'network_id': 'ecb7b134-532e-4633-869a-87791c77a3ae'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:32:47.997424 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-54c32a59-eace-4feb-a4f3-c330078749a8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:47.997531 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-22d9bf89-2eff-4619-96ac-302157a7195c None None] Attempting to bind port 85170025-780d-40aa-8e55-163af488af0e on network ecb7b134-532e-4633-869a-87791c77a3ae {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:32:48.008940 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-54c32a59-eace-4feb-a4f3-c330078749a8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/ports/996d0c64-fb2e-4dd3-84a6-1d4ca6cc05c9 HTTP/1.1" status: 204 len: 168 time: 1.1987820 Nov 09 04:32:48.009902 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56462) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:48.026078 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8b5d9035-f6e5-467b-945a-30d7a5722b5b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:48.049251 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 92e4e3f0-c7f9-44d9-83a9-4ee03917e49e triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:48.049821 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:48.057684 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-aafd0d1b-2ffb-49f9-b01f-c2dedf8a74e4 None None] Provisioning complete for port 92e4e3f0-c7f9-44d9-83a9-4ee03917e49e triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:48.057977 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-aafd0d1b-2ffb-49f9-b01f-c2dedf8a74e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:48.082491 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-22d9bf89-2eff-4619-96ac-302157a7195c None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 32, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:32:48.083117 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-22d9bf89-2eff-4619-96ac-302157a7195c None None] Checking segment: {'id': '4f6bb1f5-74af-4566-9205-8a358168ad9d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 337, 'network_id': 'ecb7b134-532e-4633-869a-87791c77a3ae'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:32:48.083353 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-764117e3-f75e-49f5-8157-69904168aec5 None None] Set router fa30d24d-d721-4675-ad7b-09f35105e633 gateway port host: None {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:32:48.083524 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-22d9bf89-2eff-4619-96ac-302157a7195c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:48.083898 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-22d9bf89-2eff-4619-96ac-302157a7195c None None] Bound using segment: {'id': '4f6bb1f5-74af-4566-9205-8a358168ad9d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 337, 'network_id': 'ecb7b134-532e-4633-869a-87791c77a3ae'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:32:48.084379 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-22d9bf89-2eff-4619-96ac-302157a7195c None None] Bound port: 85170025-780d-40aa-8e55-163af488af0e, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4f6bb1f5-74af-4566-9205-8a358168ad9d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 337, 'network_id': 'ecb7b134-532e-4633-869a-87791c77a3ae'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:32:48.084757 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-22d9bf89-2eff-4619-96ac-302157a7195c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:48.107672 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-66ec16f0-8aa1-4bc0-b9c1-a00b814b19eb tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Made reservation on behalf of 188f23ef0cb54006875c672b78f5249f for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:48.111697 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-66ec16f0-8aa1-4bc0-b9c1-a00b814b19eb tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:48.225064 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8b5d9035-f6e5-467b-945a-30d7a5722b5b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Network ecb7b134-532e-4633-869a-87791c77a3ae is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:48.242016 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-08f032b2-81d0-4df8-b703-b1cc1d62d03a tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:48.244120 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-08f032b2-81d0-4df8-b703-b1cc1d62d03a tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:48.245813 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-08f032b2-81d0-4df8-b703-b1cc1d62d03a tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:48.250850 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56470) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:48.251168 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-08f032b2-81d0-4df8-b703-b1cc1d62d03a tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2049 time: 0.2401168 Nov 09 04:32:48.252488 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-8b5d9035-f6e5-467b-945a-30d7a5722b5b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:48.255401 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8b5d9035-f6e5-467b-945a-30d7a5722b5b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:32:48.262510 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8b5d9035-f6e5-467b-945a-30d7a5722b5b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:48.263235 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8b5d9035-f6e5-467b-945a-30d7a5722b5b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:48.266766 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-66ec16f0-8aa1-4bc0-b9c1-a00b814b19eb tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 344} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:32:48.271159 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b5d9035-f6e5-467b-945a-30d7a5722b5b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event updated for resources: {'Port': ['ID=7cec9ece-ccf1-461e-a604-8e15e0d56c1e,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:48.316468 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-66ec16f0-8aa1-4bc0-b9c1-a00b814b19eb tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:48.316820 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-66ec16f0-8aa1-4bc0-b9c1-a00b814b19eb tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Added segment 696f4512-dd80-4379-a21b-b923df29bba5 of type vlan for network 9e8670b3-5b0d-4ce5-8329-3af82c94231c Nov 09 04:32:48.327291 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-764117e3-f75e-49f5-8157-69904168aec5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'name': 'tempest-RoutersTest-router-1490827103', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:32:29Z', 'updated_at': '2021-11-09T04:32:45Z', 'revision_number': 3, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'gw_port_host': None, '_interfaces': [{'id': '98741773-362a-4c6e-b503-923f0f367a2a', 'name': '', 'network_id': 'e1b06497-74dd-47e6-9b9a-79074e9bf0e8', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:d2:bc:95', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 847, 'fixed_ips': [{'subnet_id': 'f0939bd8-617d-4f5c-9f7b-272de792edac', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:43Z', 'updated_at': '2021-11-09T04:32:46Z', 'revision_number': 2, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'f0939bd8-617d-4f5c-9f7b-272de792edac', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'bf77ddc4-4ed9-472d-842b-1fb79d55e2e4', 'name': '', 'network_id': '35e2f2d1-ee40-4328-9fe2-48e5a5c19938', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:66:29:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 830, 'fixed_ips': [{'subnet_id': 'f60d3eec-6988-47b0-9f2f-6319fa99064d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:33Z', 'updated_at': '2021-11-09T04:32:44Z', 'revision_number': 5, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'f60d3eec-6988-47b0-9f2f-6319fa99064d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:48.355775 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-764117e3-f75e-49f5-8157-69904168aec5 None None] Checking router: fa30d24d-d721-4675-ad7b-09f35105e633 for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:32:48.356500 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-764117e3-f75e-49f5-8157-69904168aec5 None None] Updating router fa30d24d-d721-4675-ad7b-09f35105e633 port 98741773-362a-4c6e-b503-923f0f367a2a binding host dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 04:32:48.360146 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-bf7c6e61-cc24-48cd-b8b3-acdfb75e9853 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Deleting subnet 499c6d67-335c-447c-a852-480d77db57cd {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:32:48.362949 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-22d9bf89-2eff-4619-96ac-302157a7195c None None] For port 85170025-780d-40aa-8e55-163af488af0e, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:32:48.368865 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bf7c6e61-cc24-48cd-b8b3-acdfb75e9853 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:48.389245 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-764117e3-f75e-49f5-8157-69904168aec5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:48.417559 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56474) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:48.418181 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-22d9bf89-2eff-4619-96ac-302157a7195c None None] For port 85170025-780d-40aa-8e55-163af488af0e, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=85170025-780d-40aa-8e55-163af488af0e,segment=NetworkSegment(4f6bb1f5-74af-4566-9205-8a358168ad9d),segment_id=4f6bb1f5-74af-4566-9205-8a358168ad9d)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:32:48.423013 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-d72133fc-d00d-4df3-9d28-7aef1c9d610c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Request body: {'port': {'network_id': 'ecb7b134-532e-4633-869a-87791c77a3ae', 'name': 'tempest-PortsIpV6TestJSON-1169432981'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:48.432152 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-8b5d9035-f6e5-467b-945a-30d7a5722b5b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 931 time: 1.8962412 Nov 09 04:32:48.447287 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-66ec16f0-8aa1-4bc0-b9c1-a00b814b19eb tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:48.470401 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:48.472823 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-aafd0d1b-2ffb-49f9-b01f-c2dedf8a74e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:48.500137 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-22d9bf89-2eff-4619-96ac-302157a7195c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:48.510141 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bf7c6e61-cc24-48cd-b8b3-acdfb75e9853 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:48.569947 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-66ec16f0-8aa1-4bc0-b9c1-a00b814b19eb tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:48.579136 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-66ec16f0-8aa1-4bc0-b9c1-a00b814b19eb tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:48.589665 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-66ec16f0-8aa1-4bc0-b9c1-a00b814b19eb tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:48.616339 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-aafd0d1b-2ffb-49f9-b01f-c2dedf8a74e4 None None] For port 92e4e3f0-c7f9-44d9-83a9-4ee03917e49e, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=92e4e3f0-c7f9-44d9-83a9-4ee03917e49e,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:32:48.641869 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22d9bf89-2eff-4619-96ac-302157a7195c None None] Pushing event updated for resources: {'Port': ['ID=85170025-780d-40aa-8e55-163af488af0e,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:48.673860 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-aafd0d1b-2ffb-49f9-b01f-c2dedf8a74e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:48.676829 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bf7c6e61-cc24-48cd-b8b3-acdfb75e9853 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:48.732456 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d72133fc-d00d-4df3-9d28-7aef1c9d610c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Made reservation on behalf of 12e47d8445b5429892cd1b9244512ca8 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:48.736931 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d72133fc-d00d-4df3-9d28-7aef1c9d610c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:48.776336 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [None req-d72133fc-d00d-4df3-9d28-7aef1c9d610c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] device_id is not set on port c45e2812-7525-4960-9ce2-86999a9d7686 yet. {{(pid=102162) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:32:48.824734 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-764117e3-f75e-49f5-8157-69904168aec5 None None] Publish callbacks [] for port, precommit_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:48.835252 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-66ec16f0-8aa1-4bc0-b9c1-a00b814b19eb tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 766 time: 0.8787651 Nov 09 04:32:48.843282 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56482) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:48.882228 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aafd0d1b-2ffb-49f9-b01f-c2dedf8a74e4 None None] Pushing event updated for resources: {'Port': ['ID=92e4e3f0-c7f9-44d9-83a9-4ee03917e49e,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:48.884769 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-764117e3-f75e-49f5-8157-69904168aec5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:48.901762 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.db.api [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=102163) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:32:48.902119 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG oslo_db.api [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:32:48.948322 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bf7c6e61-cc24-48cd-b8b3-acdfb75e9853 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:48.962388 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-7b309cdb-c656-4170-9acf-0441d0d2519c tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Request body: {'subnet': {'network_id': '9e8670b3-5b0d-4ce5-8329-3af82c94231c', 'cidr': '172.22.0.0/28', 'ip_version': 4, 'gateway_ip': '172.22.0.1'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:48.970955 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66ec16f0-8aa1-4bc0-b9c1-a00b814b19eb tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event updated for resources: {'Network': ['ID=9e8670b3-5b0d-4ce5-8329-3af82c94231c,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:48.999503 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bf7c6e61-cc24-48cd-b8b3-acdfb75e9853 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:49.009090 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-bf7c6e61-cc24-48cd-b8b3-acdfb75e9853 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/499c6d67-335c-447c-a852-480d77db57cd HTTP/1.1" status: 204 len: 168 time: 0.7570827 Nov 09 04:32:49.012378 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf7c6e61-cc24-48cd-b8b3-acdfb75e9853 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event deleted for resources: {'Subnet': ['ID=499c6d67-335c-447c-a852-480d77db57cd,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:49.016071 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0f5e1a8c-b5bc-45d0-9495-4a86de473e4a tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:49.017778 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56486) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:49.075812 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-d72133fc-d00d-4df3-9d28-7aef1c9d610c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Allocated IP 2001:db8::15a (ecb7b134-532e-4633-869a-87791c77a3ae/f071c371-6950-43fa-96e1-49e6709f9fc9/c45e2812-7525-4960-9ce2-86999a9d7686) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:32:49.077984 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 9e8670b3-5b0d-4ce5-8329-3af82c94231c details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:32:49.080625 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1c3b5015-b265-42d9-9593-18ff97229534 None None] Update dhcp port {'port': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'fixed_ips': [{'subnet_id': '499c6d67-335c-447c-a852-480d77db57cd', 'ip_address': '2001:db8::f816:3eff:fe92:9c3a'}, {'subnet_id': '5601d7cd-bce5-40c4-a86c-ee5755339edb'}], 'binding:host_id': 'dv-neutron-816802-2-hyperv'}, 'id': '92e4e3f0-c7f9-44d9-83a9-4ee03917e49e'} from dv-neutron-816802-2-hyperv. {{(pid=102163) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:328}} Nov 09 04:32:49.148089 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-df932b99-a03d-4bc2-bd46-25de24004bc0 None None] Provisioning complete for port 64baf918-08fa-4394-98c8-06a2cc60530a triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:49.148370 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-df932b99-a03d-4bc2-bd46-25de24004bc0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:49.233711 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56488) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:49.247011 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1c3b5015-b265-42d9-9593-18ff97229534 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:49.270818 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-19e5fb2b-5dee-457f-ad5f-090d9fd430c8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Deleting subnet 5601d7cd-bce5-40c4-a86c-ee5755339edb {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:32:49.293469 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0f5e1a8c-b5bc-45d0-9495-4a86de473e4a tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Network cc397c48-c4cc-4846-a1ef-380b64be450d is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:49.306611 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-0f5e1a8c-b5bc-45d0-9495-4a86de473e4a tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:49.322023 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f5e1a8c-b5bc-45d0-9495-4a86de473e4a tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event updated for resources: {'Subnet': ['ID=dcda61a8-5577-4d3c-b013-75d4a2348e40,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:49.335996 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-19e5fb2b-5dee-457f-ad5f-090d9fd430c8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:49.344635 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0f5e1a8c-b5bc-45d0-9495-4a86de473e4a tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:49.346151 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0f5e1a8c-b5bc-45d0-9495-4a86de473e4a tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:49.388046 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64941194-dead-42d6-8e17-bb8bbbd063ae None None] Pushing event updated for resources: {'Port': ['ID=98741773-362a-4c6e-b503-923f0f367a2a,revision_number=3']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:49.412358 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-764117e3-f75e-49f5-8157-69904168aec5 None None] Attempting to bind port 98741773-362a-4c6e-b503-923f0f367a2a on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:32:49.412808 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-764117e3-f75e-49f5-8157-69904168aec5 None None] Attempting to bind port 98741773-362a-4c6e-b503-923f0f367a2a by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'd324ad80-31e0-4532-9d92-4601f8a04c92', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': 'e1b06497-74dd-47e6-9b9a-79074e9bf0e8'}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:32:49.413233 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-764117e3-f75e-49f5-8157-69904168aec5 None None] Attempting to bind port 98741773-362a-4c6e-b503-923f0f367a2a on network e1b06497-74dd-47e6-9b9a-79074e9bf0e8 {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:32:49.425305 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-764117e3-f75e-49f5-8157-69904168aec5 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 32, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:32:49.425762 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-764117e3-f75e-49f5-8157-69904168aec5 None None] Checking segment: {'id': 'd324ad80-31e0-4532-9d92-4601f8a04c92', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': 'e1b06497-74dd-47e6-9b9a-79074e9bf0e8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102164) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:32:49.426224 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-764117e3-f75e-49f5-8157-69904168aec5 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:49.428606 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-764117e3-f75e-49f5-8157-69904168aec5 None None] Bound using segment: {'id': 'd324ad80-31e0-4532-9d92-4601f8a04c92', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': 'e1b06497-74dd-47e6-9b9a-79074e9bf0e8'} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:32:49.429329 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-764117e3-f75e-49f5-8157-69904168aec5 None None] Bound port: 98741773-362a-4c6e-b503-923f0f367a2a, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd324ad80-31e0-4532-9d92-4601f8a04c92', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': 'e1b06497-74dd-47e6-9b9a-79074e9bf0e8'}}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:32:49.429777 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-764117e3-f75e-49f5-8157-69904168aec5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:49.440553 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-1f86dcf1-a9f6-4376-a980-1e97c91b76e9 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Request body: {'security_group': {'name': 'default'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:49.444510 dv-neutron-816802-2-hyperv neutron-server[102162]: WARNING neutron.api.v2.base [None req-1f86dcf1-a9f6-4376-a980-1e97c91b76e9 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] An exception happened while processing the request body. The exception message is [Default security group already exists.].: neutron.extensions.securitygroup.SecurityGroupDefaultAlreadyExists: Default security group already exists. Nov 09 04:32:49.451719 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.api.v2.resource [None req-1f86dcf1-a9f6-4376-a980-1e97c91b76e9 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] create failed (client error): There was a conflict when trying to complete your request. Nov 09 04:32:49.456012 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-1f86dcf1-a9f6-4376-a980-1e97c91b76e9 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 409 len: 330 time: 0.2050450 Nov 09 04:32:49.456188 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-19e5fb2b-5dee-457f-ad5f-090d9fd430c8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:49.458717 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56492) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:49.463782 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-5cd7ff60-d61b-465d-bae0-05b7d058695f tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Request body: {'security_group': {'name': 'tempest-secgroup--1165351609'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:49.471788 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d72133fc-d00d-4df3-9d28-7aef1c9d610c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:49.520109 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-764117e3-f75e-49f5-8157-69904168aec5 None None] For port 98741773-362a-4c6e-b503-923f0f367a2a, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102164) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:32:49.526144 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-764117e3-f75e-49f5-8157-69904168aec5 None None] For port 98741773-362a-4c6e-b503-923f0f367a2a, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=98741773-362a-4c6e-b503-923f0f367a2a,segment=NetworkSegment(d324ad80-31e0-4532-9d92-4601f8a04c92),segment_id=d324ad80-31e0-4532-9d92-4601f8a04c92)] {{(pid=102164) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:32:49.535476 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7b309cdb-c656-4170-9acf-0441d0d2519c tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Made reservation on behalf of 188f23ef0cb54006875c672b78f5249f for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:49.538998 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7b309cdb-c656-4170-9acf-0441d0d2519c tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:49.582426 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d72133fc-d00d-4df3-9d28-7aef1c9d610c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:49.582661 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-19e5fb2b-5dee-457f-ad5f-090d9fd430c8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:49.603379 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0aca4ddf-351e-475d-965e-c7c0e128da86 None None] Network cc397c48-c4cc-4846-a1ef-380b64be450d requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:32:49.621558 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-764117e3-f75e-49f5-8157-69904168aec5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:49.664784 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d72133fc-d00d-4df3-9d28-7aef1c9d610c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event updated for resources: {'Port': ['ID=c45e2812-7525-4960-9ce2-86999a9d7686,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:49.689818 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-0f5e1a8c-b5bc-45d0-9495-4a86de473e4a tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 804 time: 2.3250918 Nov 09 04:32:49.698643 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56494) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:49.703366 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d72133fc-d00d-4df3-9d28-7aef1c9d610c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Network ecb7b134-532e-4633-869a-87791c77a3ae is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:49.703787 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-18da1482-fe25-49f9-b05b-407c8bfbe952 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Request body: {'port': {'name': 'tempest-PortsTestJSON-2013651465', 'admin_state_up': False, 'fixed_ips': [{'subnet_id': 'dcda61a8-5577-4d3c-b013-75d4a2348e40'}], 'security_groups': ['ec71de09-adca-48c6-bf05-ec0ddc8b3406', 'a5f16ce1-934f-440f-8bb9-bb56e4fe5d78']}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:49.705727 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-d72133fc-d00d-4df3-9d28-7aef1c9d610c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:49.710542 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d72133fc-d00d-4df3-9d28-7aef1c9d610c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:32:49.736003 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d72133fc-d00d-4df3-9d28-7aef1c9d610c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:49.736977 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d72133fc-d00d-4df3-9d28-7aef1c9d610c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:49.751460 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-764117e3-f75e-49f5-8157-69904168aec5 None None] Routers {'fa30d24d-d721-4675-ad7b-09f35105e633'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:32:49.752292 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-764117e3-f75e-49f5-8157-69904168aec5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:32:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['fa30d24d-d721-4675-ad7b-09f35105e633'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:49.809324 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5cd7ff60-d61b-465d-bae0-05b7d058695f tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:49.822722 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device bf77ddc4-4ed9-472d-842b-1fb79d55e2e4 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:32:49.864160 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-d72133fc-d00d-4df3-9d28-7aef1c9d610c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 931 time: 1.4454651 Nov 09 04:32:49.865190 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56496) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:49.916920 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64941194-dead-42d6-8e17-bb8bbbd063ae None None] Pushing event updated for resources: {'Port': ['ID=98741773-362a-4c6e-b503-923f0f367a2a,revision_number=4']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:49.926649 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5cd7ff60-d61b-465d-bae0-05b7d058695f tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:49.949738 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-6643b823-89e6-49ce-a7a9-67a718ee449c None None] Provisioning complete for port 64baf918-08fa-4394-98c8-06a2cc60530a triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:49.950390 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6643b823-89e6-49ce-a7a9-67a718ee449c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:49.959366 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-764117e3-f75e-49f5-8157-69904168aec5 None None] Set router fa30d24d-d721-4675-ad7b-09f35105e633 gateway port host: None {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:32:49.966821 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b4d56d88-35d5-421f-8db8-6e70e772869b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:49.973776 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-b4d56d88-35d5-421f-8db8-6e70e772869b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "GET /v2.0/ports?fixed_ips=ip_address%3D2001%3Adb8%3A%3A1ca HTTP/1.1" status: 200 len: 929 time: 0.1068559 Nov 09 04:32:49.974807 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56498) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:50.087584 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-19e5fb2b-5dee-457f-ad5f-090d9fd430c8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:50.126211 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-7ea517be-16f0-4fdd-a820-dfab5e17b518 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Deleting port c45e2812-7525-4960-9ce2-86999a9d7686 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:32:50.126823 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7ea517be-16f0-4fdd-a820-dfab5e17b518 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:50.147029 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server [None req-1c3b5015-b265-42d9-9593-18ff97229534 None None] Exception during message handling: neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 5601d7cd-bce5-40c4-a86c-ee5755339edb: This subnet is being modified by another concurrent operation. Nov 09 04:32:50.147029 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 09 04:32:50.147029 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 09 04:32:50.147029 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 09 04:32:50.147029 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 09 04:32:50.147029 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 09 04:32:50.147029 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 09 04:32:50.147029 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 09 04:32:50.147029 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Nov 09 04:32:50.147029 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Nov 09 04:32:50.147029 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Nov 09 04:32:50.147029 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Nov 09 04:32:50.147029 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Nov 09 04:32:50.147029 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Nov 09 04:32:50.147029 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 09 04:32:50.147029 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 09 04:32:50.147029 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 09 04:32:50.147029 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server raise self.value Nov 09 04:32:50.147029 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Nov 09 04:32:50.147029 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 09 04:32:50.147029 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Nov 09 04:32:50.147029 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Nov 09 04:32:50.147029 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 09 04:32:50.147029 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 09 04:32:50.147029 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 09 04:32:50.147029 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server raise self.value Nov 09 04:32:50.147029 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Nov 09 04:32:50.147029 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 09 04:32:50.147029 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Nov 09 04:32:50.147029 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Nov 09 04:32:50.147029 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 09 04:32:50.147029 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 09 04:32:50.147029 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 09 04:32:50.147029 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server raise self.value Nov 09 04:32:50.147029 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Nov 09 04:32:50.147029 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Nov 09 04:32:50.147029 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 332, in update_dhcp_port Nov 09 04:32:50.147029 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server return self._port_action(plugin, context, port, 'update_port') Nov 09 04:32:50.147029 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 117, in _port_action Nov 09 04:32:50.147029 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server return plugin.update_port(context, port['id'], port) Nov 09 04:32:50.147029 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/common/utils.py", line 694, in inner Nov 09 04:32:50.147029 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 09 04:32:50.147029 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 218, in wrapped Nov 09 04:32:50.147029 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Nov 09 04:32:50.147029 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Nov 09 04:32:50.147029 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Nov 09 04:32:50.147029 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 09 04:32:50.147029 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 09 04:32:50.147029 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 09 04:32:50.147029 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server raise self.value Nov 09 04:32:50.147029 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Nov 09 04:32:50.147029 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 09 04:32:50.147029 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Nov 09 04:32:50.147029 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Nov 09 04:32:50.152688 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 09 04:32:50.152688 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 09 04:32:50.152688 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 09 04:32:50.152688 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server raise self.value Nov 09 04:32:50.152688 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Nov 09 04:32:50.152688 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 09 04:32:50.152688 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Nov 09 04:32:50.152688 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Nov 09 04:32:50.152688 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 09 04:32:50.152688 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 09 04:32:50.152688 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 09 04:32:50.152688 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server raise self.value Nov 09 04:32:50.152688 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Nov 09 04:32:50.152688 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Nov 09 04:32:50.152688 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1744, in update_port Nov 09 04:32:50.152688 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server updated_port = super(Ml2Plugin, self).update_port(context, id, Nov 09 04:32:50.152688 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 218, in wrapped Nov 09 04:32:50.152688 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Nov 09 04:32:50.152688 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/db_base_plugin_v2.py", line 1515, in update_port Nov 09 04:32:50.152688 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server self.ipam.update_port( Nov 09 04:32:50.152688 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 737, in update_port Nov 09 04:32:50.152688 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server changes = self.update_port_with_ips(context, Nov 09 04:32:50.152688 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 427, in update_port_with_ips Nov 09 04:32:50.152688 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server changes = self._update_ips_for_port(context, Nov 09 04:32:50.152688 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 351, in _update_ips_for_port Nov 09 04:32:50.152688 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server subnets = self._ipam_get_subnets( Nov 09 04:32:50.152688 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 694, in _ipam_get_subnets Nov 09 04:32:50.152688 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server subnet.lock_register( Nov 09 04:32:50.152688 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/models_v2.py", line 55, in lock_register Nov 09 04:32:50.152688 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server raise exception Nov 09 04:32:50.152688 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 5601d7cd-bce5-40c4-a86c-ee5755339edb: This subnet is being modified by another concurrent operation. Nov 09 04:32:50.152688 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server Nov 09 04:32:50.253152 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-764117e3-f75e-49f5-8157-69904168aec5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'name': 'tempest-RoutersTest-router-1490827103', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:32:29Z', 'updated_at': '2021-11-09T04:32:45Z', 'revision_number': 3, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'gw_port_host': None, '_interfaces': [{'id': '98741773-362a-4c6e-b503-923f0f367a2a', 'name': '', 'network_id': 'e1b06497-74dd-47e6-9b9a-79074e9bf0e8', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:d2:bc:95', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 847, 'fixed_ips': [{'subnet_id': 'f0939bd8-617d-4f5c-9f7b-272de792edac', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:43Z', 'updated_at': '2021-11-09T04:32:49Z', 'revision_number': 4, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'f0939bd8-617d-4f5c-9f7b-272de792edac', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'bf77ddc4-4ed9-472d-842b-1fb79d55e2e4', 'name': '', 'network_id': '35e2f2d1-ee40-4328-9fe2-48e5a5c19938', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:66:29:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 830, 'fixed_ips': [{'subnet_id': 'f60d3eec-6988-47b0-9f2f-6319fa99064d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:33Z', 'updated_at': '2021-11-09T04:32:44Z', 'revision_number': 5, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'f60d3eec-6988-47b0-9f2f-6319fa99064d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:50.264923 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port bf77ddc4-4ed9-472d-842b-1fb79d55e2e4 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:50.266730 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:50.272457 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7ea517be-16f0-4fdd-a820-dfab5e17b518 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:50.277309 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e3bbe771-3af8-4b84-b9f8-e64c6b155cbe None None] Network ecb7b134-532e-4633-869a-87791c77a3ae requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:32:50.287337 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19e5fb2b-5dee-457f-ad5f-090d9fd430c8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event deleted for resources: {'Subnet': ['ID=5601d7cd-bce5-40c4-a86c-ee5755339edb,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:50.300642 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-7ea517be-16f0-4fdd-a820-dfab5e17b518 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Calling delete_port for c45e2812-7525-4960-9ce2-86999a9d7686 owned by {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:32:50.306319 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-19e5fb2b-5dee-457f-ad5f-090d9fd430c8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:50.318460 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56500) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:50.325747 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-19e5fb2b-5dee-457f-ad5f-090d9fd430c8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/5601d7cd-bce5-40c4-a86c-ee5755339edb HTTP/1.1" status: 204 len: 168 time: 1.2778671 Nov 09 04:32:50.325884 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-764117e3-f75e-49f5-8157-69904168aec5 None None] The sync data for ids ['fa30d24d-d721-4675-ad7b-09f35105e633'] in dv-neutron-816802-2-hyperv is: [{'id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'name': 'tempest-RoutersTest-router-1490827103', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:32:29Z', 'updated_at': '2021-11-09T04:32:45Z', 'revision_number': 3, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'gw_port_host': None, '_interfaces': [{'id': '98741773-362a-4c6e-b503-923f0f367a2a', 'name': '', 'network_id': 'e1b06497-74dd-47e6-9b9a-79074e9bf0e8', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:d2:bc:95', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 847, 'fixed_ips': [{'subnet_id': 'f0939bd8-617d-4f5c-9f7b-272de792edac', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:43Z', 'updated_at': '2021-11-09T04:32:49Z', 'revision_number': 4, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'f0939bd8-617d-4f5c-9f7b-272de792edac', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'bf77ddc4-4ed9-472d-842b-1fb79d55e2e4', 'name': '', 'network_id': '35e2f2d1-ee40-4328-9fe2-48e5a5c19938', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:66:29:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 830, 'fixed_ips': [{'subnet_id': 'f60d3eec-6988-47b0-9f2f-6319fa99064d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:33Z', 'updated_at': '2021-11-09T04:32:44Z', 'revision_number': 5, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'f60d3eec-6988-47b0-9f2f-6319fa99064d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:32:50.416417 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-868849ca-caf8-470c-a7e0-799c7f58815e None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:32:50.438871 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a9d4e4b2-337d-4b8c-ba78-80107d98e895 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1174419 Nov 09 04:32:50.442727 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56502) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:50.463523 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-97d90505-7323-4080-b017-0499f490bc14 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'subnet': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:50.464383 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-18da1482-fe25-49f9-b05b-407c8bfbe952 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:50.538874 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5cd7ff60-d61b-465d-bae0-05b7d058695f tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:50.585667 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7b309cdb-c656-4170-9acf-0441d0d2519c tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:50.683821 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a566cec1-aa6e-4e31-8e30-9e710d349c4a None None] Update dhcp port {'port': {'network_id': 'cc397c48-c4cc-4846-a1ef-380b64be450d', 'fixed_ips': [{'subnet_id': '775bb7b9-6a44-44d8-a29c-1b53db6d50e5', 'ip_address': '172.20.0.18'}, {'subnet_id': 'a9f45838-17f7-49da-abfb-42e7219b00a2', 'ip_address': '172.20.0.2'}, {'subnet_id': 'dcda61a8-5577-4d3c-b013-75d4a2348e40'}], 'binding:host_id': 'dv-neutron-816802-2-hyperv'}, 'id': '775e1b75-6b4e-4b53-8c8d-2c5aea990d99'} from dv-neutron-816802-2-hyperv. {{(pid=102163) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:328}} Nov 09 04:32:50.729898 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-97d90505-7323-4080-b017-0499f490bc14 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:50.734269 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-97d90505-7323-4080-b017-0499f490bc14 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:50.764139 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7ea517be-16f0-4fdd-a820-dfab5e17b518 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:50.793780 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a566cec1-aa6e-4e31-8e30-9e710d349c4a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:50.795709 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-6643b823-89e6-49ce-a7a9-67a718ee449c None None] Provisioning complete for port 98741773-362a-4c6e-b503-923f0f367a2a triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:50.796072 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6643b823-89e6-49ce-a7a9-67a718ee449c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:50.831505 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ea517be-16f0-4fdd-a820-dfab5e17b518 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event deleted for resources: {'Port': ['ID=c45e2812-7525-4960-9ce2-86999a9d7686,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:50.879089 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7ea517be-16f0-4fdd-a820-dfab5e17b518 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:50.882411 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-7ea517be-16f0-4fdd-a820-dfab5e17b518 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "DELETE /v2.0/ports/c45e2812-7525-4960-9ce2-86999a9d7686 HTTP/1.1" status: 204 len: 168 time: 0.9064100 Nov 09 04:32:50.887736 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56504) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:50.919828 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-2bffddd9-ed22-45a2-a8ea-c664755b662f tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] GET failed (client error): The resource could not be found. Nov 09 04:32:50.921503 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-2bffddd9-ed22-45a2-a8ea-c664755b662f tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "GET /v2.0/ports/c45e2812-7525-4960-9ce2-86999a9d7686 HTTP/1.1" status: 404 len: 333 time: 0.0326734 Nov 09 04:32:50.924606 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56506) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:50.969002 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-73ea20ad-de99-49ec-8822-856fb70cf1d3 None None] DHCP port deletion for 988d2354-693c-4d52-af17-25e0643eaa0c request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:32:51.159823 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-3294ff0e-fceb-4dea-befa-32768644f12c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Deleting port 7cec9ece-ccf1-461e-a604-8e15e0d56c1e {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:32:51.160161 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3294ff0e-fceb-4dea-befa-32768644f12c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:51.237014 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-a566cec1-aa6e-4e31-8e30-9e710d349c4a None None] Allocated IP 172.20.0.34 (cc397c48-c4cc-4846-a1ef-380b64be450d/dcda61a8-5577-4d3c-b013-75d4a2348e40/775e1b75-6b4e-4b53-8c8d-2c5aea990d99) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:32:51.262004 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b309cdb-c656-4170-9acf-0441d0d2519c tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event updated for resources: {'Subnet': ['ID=d7a7c5ae-922f-4fe2-ad19-b31fd352c9d1,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:51.270937 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5cd7ff60-d61b-465d-bae0-05b7d058695f tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:51.332649 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3294ff0e-fceb-4dea-befa-32768644f12c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:51.342991 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 85170025-780d-40aa-8e55-163af488af0e up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:32:51.392526 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7b309cdb-c656-4170-9acf-0441d0d2519c tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Checking segment: {'id': '696f4512-dd80-4379-a21b-b923df29bba5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 344, 'network_id': '9e8670b3-5b0d-4ce5-8329-3af82c94231c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:32:51.392874 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7b309cdb-c656-4170-9acf-0441d0d2519c tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Network hostable DHCP agents. Network: 9e8670b3-5b0d-4ce5-8329-3af82c94231c, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:32:51.399838 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5cd7ff60-d61b-465d-bae0-05b7d058695f tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:51.404350 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5cd7ff60-d61b-465d-bae0-05b7d058695f tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Pushing event updated for resources: {'SecurityGroup': ['ID=3b60d16d-37ff-4257-bd8d-ec6198b1398e,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:51.444164 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5cd7ff60-d61b-465d-bae0-05b7d058695f tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:51.449579 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.objects.ports [None req-97d90505-7323-4080-b017-0499f490bc14 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=102162) get_objects /opt/stack/neutron/neutron/objects/ports.py:444}} Nov 09 04:32:51.455712 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-3294ff0e-fceb-4dea-befa-32768644f12c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Calling delete_port for 7cec9ece-ccf1-461e-a604-8e15e0d56c1e owned by {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:32:51.455855 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6643b823-89e6-49ce-a7a9-67a718ee449c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:51.494797 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5cd7ff60-d61b-465d-bae0-05b7d058695f tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c612ad20-494f-4f54-ac2c-fa8eacaae670,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:51.498461 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7b309cdb-c656-4170-9acf-0441d0d2519c tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Network 9e8670b3-5b0d-4ce5-8329-3af82c94231c is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:32:51.521472 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-6643b823-89e6-49ce-a7a9-67a718ee449c None None] For port 98741773-362a-4c6e-b503-923f0f367a2a, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=98741773-362a-4c6e-b503-923f0f367a2a,segment=NetworkSegment(d324ad80-31e0-4532-9d92-4601f8a04c92),segment_id=d324ad80-31e0-4532-9d92-4601f8a04c92)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:32:51.527243 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5cd7ff60-d61b-465d-bae0-05b7d058695f tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:51.529064 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-5cd7ff60-d61b-465d-bae0-05b7d058695f tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 2.0693870 Nov 09 04:32:51.532299 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56508) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:51.537568 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-661d4dda-6d46-4092-acab-425eadd0ac01 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Request body: {'security_group_rule': {'security_group_id': 'c612ad20-494f-4f54-ac2c-fa8eacaae670', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'tcp', 'port_range_min': 66, 'port_range_max': 67}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:51.553053 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-a566cec1-aa6e-4e31-8e30-9e710d349c4a None None] For port 775e1b75-6b4e-4b53-8c8d-2c5aea990d99, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=775e1b75-6b4e-4b53-8c8d-2c5aea990d99,segment=NetworkSegment(5cb8d89b-c83c-4beb-ac61-4edae91bc9e8),segment_id=5cb8d89b-c83c-4beb-ac61-4edae91bc9e8)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:32:51.565479 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 85170025-780d-40aa-8e55-163af488af0e triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:51.565853 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:51.581451 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-7b309cdb-c656-4170-9acf-0441d0d2519c tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 9e8670b3-5b0d-4ce5-8329-3af82c94231c) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:51.590406 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7b309cdb-c656-4170-9acf-0441d0d2519c tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:51.593653 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-73ea20ad-de99-49ec-8822-856fb70cf1d3 None None] Deleting port 92e4e3f0-c7f9-44d9-83a9-4ee03917e49e {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:32:51.594002 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7b309cdb-c656-4170-9acf-0441d0d2519c tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:51.594120 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-73ea20ad-de99-49ec-8822-856fb70cf1d3 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:51.625762 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1d9bd290-fce3-4aae-aef0-4383a96391f7 None None] Network 9e8670b3-5b0d-4ce5-8329-3af82c94231c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:32:51.635792 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6643b823-89e6-49ce-a7a9-67a718ee449c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:51.680808 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-661d4dda-6d46-4092-acab-425eadd0ac01 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:51.738739 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-7b309cdb-c656-4170-9acf-0441d0d2519c tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.8942695 Nov 09 04:32:51.740397 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a566cec1-aa6e-4e31-8e30-9e710d349c4a None None] Publish callbacks [] for port, precommit_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:51.741790 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56510) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:51.819372 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-97d90505-7323-4080-b017-0499f490bc14 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:51.833809 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a566cec1-aa6e-4e31-8e30-9e710d349c4a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:51.863192 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3294ff0e-fceb-4dea-befa-32768644f12c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:51.868814 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-661d4dda-6d46-4092-acab-425eadd0ac01 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:51.905429 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3294ff0e-fceb-4dea-befa-32768644f12c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event deleted for resources: {'Port': ['ID=7cec9ece-ccf1-461e-a604-8e15e0d56c1e,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:51.912922 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6643b823-89e6-49ce-a7a9-67a718ee449c None None] Pushing event updated for resources: {'Port': ['ID=98741773-362a-4c6e-b503-923f0f367a2a,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:51.950445 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3294ff0e-fceb-4dea-befa-32768644f12c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:51.961507 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-73ea20ad-de99-49ec-8822-856fb70cf1d3 None None] For port 92e4e3f0-c7f9-44d9-83a9-4ee03917e49e, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=92e4e3f0-c7f9-44d9-83a9-4ee03917e49e,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:32:51.961507 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-73ea20ad-de99-49ec-8822-856fb70cf1d3 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:51.961903 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-3294ff0e-fceb-4dea-befa-32768644f12c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "DELETE /v2.0/ports/7cec9ece-ccf1-461e-a604-8e15e0d56c1e HTTP/1.1" status: 204 len: 168 time: 1.0285208 Nov 09 04:32:51.961903 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56512) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:51.979235 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-73ea20ad-de99-49ec-8822-856fb70cf1d3 None None] Calling delete_port for 92e4e3f0-c7f9-44d9-83a9-4ee03917e49e owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:32:52.006765 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-661d4dda-6d46-4092-acab-425eadd0ac01 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:52.077553 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-661d4dda-6d46-4092-acab-425eadd0ac01 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b21a549d-63da-4b2c-985c-909824bf9c2f,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:52.122883 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-18da1482-fe25-49f9-b05b-407c8bfbe952 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Delete allocated IP 172.20.0.6 (cc397c48-c4cc-4846-a1ef-380b64be450d/a9f45838-17f7-49da-abfb-42e7219b00a2) {{(pid=102161) _delete_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:118}} Nov 09 04:32:52.178981 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-661d4dda-6d46-4092-acab-425eadd0ac01 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:52.183164 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-661d4dda-6d46-4092-acab-425eadd0ac01 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.6474547 Nov 09 04:32:52.219563 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56514) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:52.227470 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-a77b426b-165d-4b6d-a84b-22a2a4e12606 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Request body: {'security_group_rule': {'security_group_id': 'c612ad20-494f-4f54-ac2c-fa8eacaae670', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'port_range_min': 66, 'port_range_max': 67}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:52.234195 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-18da1482-fe25-49f9-b05b-407c8bfbe952 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Allocated IP 172.20.0.45 (cc397c48-c4cc-4846-a1ef-380b64be450d/dcda61a8-5577-4d3c-b013-75d4a2348e40/ad941d16-029f-42bb-8c21-8d90d927494e) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:32:52.303648 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-95758c46-6221-4c08-82dc-18b133bf87b3 None None] Provisioning complete for port 7cec9ece-ccf1-461e-a604-8e15e0d56c1e triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:52.304190 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-95758c46-6221-4c08-82dc-18b133bf87b3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:52.337275 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a566cec1-aa6e-4e31-8e30-9e710d349c4a None None] Pushing event updated for resources: {'Port': ['ID=775e1b75-6b4e-4b53-8c8d-2c5aea990d99,revision_number=7']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:52.350485 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-b2faa951-2807-444a-b7ac-ce431719b2c6 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] GET failed (client error): The resource could not be found. Nov 09 04:32:52.352509 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-b2faa951-2807-444a-b7ac-ce431719b2c6 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "GET /v2.0/ports/7cec9ece-ccf1-461e-a604-8e15e0d56c1e HTTP/1.1" status: 404 len: 333 time: 0.3923166 Nov 09 04:32:52.362680 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56516) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:52.369020 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-95758c46-6221-4c08-82dc-18b133bf87b3 None None] Port 7cec9ece-ccf1-461e-a604-8e15e0d56c1e was deleted so its status cannot be updated. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:335}} Nov 09 04:32:52.437689 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:52.440238 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-97d90505-7323-4080-b017-0499f490bc14 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] For port 92e4e3f0-c7f9-44d9-83a9-4ee03917e49e, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=92e4e3f0-c7f9-44d9-83a9-4ee03917e49e,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:32:52.466225 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a77b426b-165d-4b6d-a84b-22a2a4e12606 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:52.483025 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-97d90505-7323-4080-b017-0499f490bc14 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:52.495355 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-95758c46-6221-4c08-82dc-18b133bf87b3 None None] Provisioning complete for port 98741773-362a-4c6e-b503-923f0f367a2a triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:52.495355 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-95758c46-6221-4c08-82dc-18b133bf87b3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:52.539732 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 85170025-780d-40aa-8e55-163af488af0e, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=85170025-780d-40aa-8e55-163af488af0e,segment=NetworkSegment(4f6bb1f5-74af-4566-9205-8a358168ad9d),segment_id=4f6bb1f5-74af-4566-9205-8a358168ad9d)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:32:52.548072 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-97d90505-7323-4080-b017-0499f490bc14 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:52.550237 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-97d90505-7323-4080-b017-0499f490bc14 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:52.574825 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-c9afbf83-583d-472b-8c61-36f223b39b22 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Deleting subnet f071c371-6950-43fa-96e1-49e6709f9fc9 {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:32:52.587641 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c9afbf83-583d-472b-8c61-36f223b39b22 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:52.591556 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-de7ab7c5-2410-471d-8a40-c172e8d34d60 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-9e8670b3-5b0d-4ce5-8329-3af82c94231c', 'network_id': '9e8670b3-5b0d-4ce5-8329-3af82c94231c', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'fixed_ips': [{'subnet_id': 'd7a7c5ae-922f-4fe2-ad19-b31fd352c9d1'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:32:52.594677 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-de7ab7c5-2410-471d-8a40-c172e8d34d60 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:52.609158 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-97d90505-7323-4080-b017-0499f490bc14 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:52.636043 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-97d90505-7323-4080-b017-0499f490bc14 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:52.639691 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-97d90505-7323-4080-b017-0499f490bc14 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:52.640290 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-97d90505-7323-4080-b017-0499f490bc14 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:52.688360 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97d90505-7323-4080-b017-0499f490bc14 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Subnet': ['ID=4d70f328-6f2a-4019-a3c5-3a110db5d988,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:52.692900 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97d90505-7323-4080-b017-0499f490bc14 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Port': ['ID=92e4e3f0-c7f9-44d9-83a9-4ee03917e49e,revision_number=6']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:52.693684 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f83c746f-4887-43f6-9be1-4c90b9452c32 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:52.728509 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c9afbf83-583d-472b-8c61-36f223b39b22 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:52.741641 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-97d90505-7323-4080-b017-0499f490bc14 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 2.2943642 Nov 09 04:32:52.743031 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56518) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:52.747883 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:52.748681 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 64baf918-08fa-4394-98c8-06a2cc60530a up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:32:52.754980 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-67d2face-855d-40cb-8c63-c33f8750c7a1 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'subnet': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:52.767760 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-73ea20ad-de99-49ec-8822-856fb70cf1d3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:52.785870 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-a77b426b-165d-4b6d-a84b-22a2a4e12606 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] create failed (client error): There was a conflict when trying to complete your request. Nov 09 04:32:52.790909 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a77b426b-165d-4b6d-a84b-22a2a4e12606 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 409 len: 366 time: 0.5678413 Nov 09 04:32:52.791440 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56520) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:52.852165 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-73ea20ad-de99-49ec-8822-856fb70cf1d3 None None] No DVR routers for this DVR port 92e4e3f0-c7f9-44d9-83a9-4ee03917e49e on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:32:52.903912 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-20a8a2b4-ee16-487a-a825-4e08fc4b854f None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:32:52.917483 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-95758c46-6221-4c08-82dc-18b133bf87b3 None None] Could not find standard attr ID for object 92e4e3f0-c7f9-44d9-83a9-4ee03917e49e. {{(pid=102163) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 09 04:32:52.959129 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-18da1482-fe25-49f9-b05b-407c8bfbe952 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:52.981754 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-67d2face-855d-40cb-8c63-c33f8750c7a1 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:52.982299 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-67d2face-855d-40cb-8c63-c33f8750c7a1 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:53.007873 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=85170025-780d-40aa-8e55-163af488af0e,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:53.039601 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-95758c46-6221-4c08-82dc-18b133bf87b3 None None] Provisioning complete for port 85170025-780d-40aa-8e55-163af488af0e triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:53.039973 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-95758c46-6221-4c08-82dc-18b133bf87b3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:53.075528 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-18da1482-fe25-49f9-b05b-407c8bfbe952 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:53.077118 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7e4e9401-19ef-4c69-bac6-347a99970a16 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:53.124772 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73ea20ad-de99-49ec-8822-856fb70cf1d3 None None] Pushing event deleted for resources: {'Port': ['ID=92e4e3f0-c7f9-44d9-83a9-4ee03917e49e,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:53.145654 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-de7ab7c5-2410-471d-8a40-c172e8d34d60 None None] Allocated IP 172.22.0.2 (9e8670b3-5b0d-4ce5-8329-3af82c94231c/d7a7c5ae-922f-4fe2-ad19-b31fd352c9d1/d2861372-0b19-4d5f-98f4-c8dcca66d64f) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:32:53.149990 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c9afbf83-583d-472b-8c61-36f223b39b22 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:53.150117 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 64baf918-08fa-4394-98c8-06a2cc60530a triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:53.150117 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:53.207126 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7e4e9401-19ef-4c69-bac6-347a99970a16 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:53.310896 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18da1482-fe25-49f9-b05b-407c8bfbe952 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event updated for resources: {'Port': ['ID=ad941d16-029f-42bb-8c21-8d90d927494e,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:53.353974 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-67d2face-855d-40cb-8c63-c33f8750c7a1 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:53.375003 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-18da1482-fe25-49f9-b05b-407c8bfbe952 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] In _notify_port_updated(), no bound segment for port ad941d16-029f-42bb-8c21-8d90d927494e on network cc397c48-c4cc-4846-a1ef-380b64be450d {{(pid=102161) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 09 04:32:53.381052 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-18da1482-fe25-49f9-b05b-407c8bfbe952 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:53.381691 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-18da1482-fe25-49f9-b05b-407c8bfbe952 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:53.385868 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-18da1482-fe25-49f9-b05b-407c8bfbe952 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "PUT /v2.0/ports/ad941d16-029f-42bb-8c21-8d90d927494e HTTP/1.1" status: 200 len: 960 time: 3.6834671 Nov 09 04:32:53.387615 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56522) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:53.403997 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 98741773-362a-4c6e-b503-923f0f367a2a up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:32:53.419940 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-67d2face-855d-40cb-8c63-c33f8750c7a1 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:53.425399 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-67d2face-855d-40cb-8c63-c33f8750c7a1 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:53.429802 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-67d2face-855d-40cb-8c63-c33f8750c7a1 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:53.430414 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-67d2face-855d-40cb-8c63-c33f8750c7a1 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:53.436932 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67d2face-855d-40cb-8c63-c33f8750c7a1 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Subnet': ['ID=0443928b-d719-43d8-9ea7-e1f06c3fe17d,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:53.453900 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ca11dc9d-ccdb-43bd-bc4e-2a59b9079d18 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-988d2354-693c-4d52-af17-25e0643eaa0c', 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'tenant_id': '8b0758f781884982bf5b94e6609237f6', 'fixed_ips': [{'subnet_id': '4d70f328-6f2a-4019-a3c5-3a110db5d988'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:32:53.454784 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ca11dc9d-ccdb-43bd-bc4e-2a59b9079d18 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:53.470991 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7e4e9401-19ef-4c69-bac6-347a99970a16 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:53.473820 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7e4e9401-19ef-4c69-bac6-347a99970a16 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:53.474979 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-7e4e9401-19ef-4c69-bac6-347a99970a16 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "DELETE /v2.0/security-groups/c612ad20-494f-4f54-ac2c-fa8eacaae670 HTTP/1.1" status: 204 len: 168 time: 0.6759293 Nov 09 04:32:53.478719 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56524) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:53.489541 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c9afbf83-583d-472b-8c61-36f223b39b22 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:53.497045 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e4e9401-19ef-4c69-bac6-347a99970a16 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=c612ad20-494f-4f54-ac2c-fa8eacaae670,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:53.513342 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-67d2face-855d-40cb-8c63-c33f8750c7a1 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.7692935 Nov 09 04:32:53.524807 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56528) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:53.529596 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9afbf83-583d-472b-8c61-36f223b39b22 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event deleted for resources: {'Subnet': ['ID=f071c371-6950-43fa-96e1-49e6709f9fc9,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:53.531155 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-96a2b2ee-624f-4035-9756-35ba0ce7c4ba tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'port': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'mac_address': 'fa:16:3e:f5:1b:d2', 'name': 'tempest-NetworksTestDHCPv6-338941100'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:53.533732 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c9afbf83-583d-472b-8c61-36f223b39b22 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:53.536918 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-c9afbf83-583d-472b-8c61-36f223b39b22 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "DELETE /v2.0/subnets/f071c371-6950-43fa-96e1-49e6709f9fc9 HTTP/1.1" status: 204 len: 168 time: 1.1732683 Nov 09 04:32:53.539947 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56530) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:53.555739 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-24c613ee-d443-4e17-bd8e-47d4d1d764b9 None None] Network ecb7b134-532e-4633-869a-87791c77a3ae requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:32:53.582394 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56532) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:53.582640 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-21c7a34f-9361-49ae-be2e-12a5dcb74aff tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.0977767 Nov 09 04:32:53.588540 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-c63578f7-6a9d-45f6-b222-e2b5759aed9a tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Request body: {'security_group': {'name': 'tempest-secgroup--2065259854'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:53.631650 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-be638ce9-55a6-4c4e-904c-b5c599f8932f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Deleting port ad941d16-029f-42bb-8c21-8d90d927494e {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:32:53.634545 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-be638ce9-55a6-4c4e-904c-b5c599f8932f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:53.688489 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-6836fede-bc13-4cc8-a382-b0a33fb90ec5 None None] Provisioning complete for port 775e1b75-6b4e-4b53-8c8d-2c5aea990d99 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:53.688921 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6836fede-bc13-4cc8-a382-b0a33fb90ec5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:53.702914 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-de7ab7c5-2410-471d-8a40-c172e8d34d60 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:53.741456 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1188565a-93b9-4ba8-b5cc-2cdc61f4d0a5 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:53.756421 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 98741773-362a-4c6e-b503-923f0f367a2a triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:53.756787 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:53.799759 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c63578f7-6a9d-45f6-b222-e2b5759aed9a tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:53.818159 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-be638ce9-55a6-4c4e-904c-b5c599f8932f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:53.839217 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-de7ab7c5-2410-471d-8a40-c172e8d34d60 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:53.884000 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-be638ce9-55a6-4c4e-904c-b5c599f8932f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Calling delete_port for ad941d16-029f-42bb-8c21-8d90d927494e owned by {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:32:53.901636 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-96a2b2ee-624f-4035-9756-35ba0ce7c4ba tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:53.917403 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-ca11dc9d-ccdb-43bd-bc4e-2a59b9079d18 None None] Allocated IP 2001:db8::f816:3eff:fee1:dd55 (988d2354-693c-4d52-af17-25e0643eaa0c/4d70f328-6f2a-4019-a3c5-3a110db5d988/1849d4a8-7f58-4a68-ad8b-4b9fd74ebd07) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:32:53.923709 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-f83c746f-4887-43f6-9be1-4c90b9452c32 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Allocated IP 172.22.0.1 (9e8670b3-5b0d-4ce5-8329-3af82c94231c/d7a7c5ae-922f-4fe2-ad19-b31fd352c9d1/20195bcd-85f4-4bce-bae2-63cdf464f57f) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:32:53.952341 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-de7ab7c5-2410-471d-8a40-c172e8d34d60 None None] Network 9e8670b3-5b0d-4ce5-8329-3af82c94231c is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:53.981004 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-de7ab7c5-2410-471d-8a40-c172e8d34d60 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:53.987463 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de7ab7c5-2410-471d-8a40-c172e8d34d60 None None] Pushing event updated for resources: {'Port': ['ID=d2861372-0b19-4d5f-98f4-c8dcca66d64f,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:53.992021 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de7ab7c5-2410-471d-8a40-c172e8d34d60 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:32:53.999870 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-96a2b2ee-624f-4035-9756-35ba0ce7c4ba tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:54.011389 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-1188565a-93b9-4ba8-b5cc-2cdc61f4d0a5 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Deleting port 85170025-780d-40aa-8e55-163af488af0e {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:32:54.014230 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1188565a-93b9-4ba8-b5cc-2cdc61f4d0a5 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:54.021522 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [None req-96a2b2ee-624f-4035-9756-35ba0ce7c4ba tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] device_id is not set on port 72a65b9f-24dc-4ee2-a165-b8c907953cbf yet. {{(pid=102162) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:32:54.165546 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c63578f7-6a9d-45f6-b222-e2b5759aed9a tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:54.176591 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-1188565a-93b9-4ba8-b5cc-2cdc61f4d0a5 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] For port 85170025-780d-40aa-8e55-163af488af0e, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=85170025-780d-40aa-8e55-163af488af0e,segment=NetworkSegment(4f6bb1f5-74af-4566-9205-8a358168ad9d),segment_id=4f6bb1f5-74af-4566-9205-8a358168ad9d)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:32:54.176958 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1188565a-93b9-4ba8-b5cc-2cdc61f4d0a5 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:54.209506 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-1188565a-93b9-4ba8-b5cc-2cdc61f4d0a5 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Calling delete_port for 85170025-780d-40aa-8e55-163af488af0e owned by network:dhcp {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:32:54.247030 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c63578f7-6a9d-45f6-b222-e2b5759aed9a tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:54.285849 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f83c746f-4887-43f6-9be1-4c90b9452c32 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:54.294030 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-df17b06f-b400-4800-9b48-ba5c2ac8e5d2 None None] DHCP port deletion for ecb7b134-532e-4633-869a-87791c77a3ae request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:32:54.327735 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-de7ab7c5-2410-471d-8a40-c172e8d34d60 None None] Attempting to bind port d2861372-0b19-4d5f-98f4-c8dcca66d64f on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:32:54.328272 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-de7ab7c5-2410-471d-8a40-c172e8d34d60 None None] Attempting to bind port d2861372-0b19-4d5f-98f4-c8dcca66d64f by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '696f4512-dd80-4379-a21b-b923df29bba5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 344, 'network_id': '9e8670b3-5b0d-4ce5-8329-3af82c94231c'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:32:54.328635 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de7ab7c5-2410-471d-8a40-c172e8d34d60 None None] Attempting to bind port d2861372-0b19-4d5f-98f4-c8dcca66d64f on network 9e8670b3-5b0d-4ce5-8329-3af82c94231c {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:32:54.351400 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-6836fede-bc13-4cc8-a382-b0a33fb90ec5 None None] Provisioning complete for port a4de75ae-2dab-4896-8d2a-cdfef3f44fab triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:54.355791 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6836fede-bc13-4cc8-a382-b0a33fb90ec5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:54.355925 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c63578f7-6a9d-45f6-b222-e2b5759aed9a tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Pushing event updated for resources: {'SecurityGroup': ['ID=8b15a7a0-2ea1-4036-9b48-8db8e8bf1fec,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:54.360020 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 92e4e3f0-c7f9-44d9-83a9-4ee03917e49e no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:32:54.405646 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c63578f7-6a9d-45f6-b222-e2b5759aed9a tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:54.406923 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-c63578f7-6a9d-45f6-b222-e2b5759aed9a tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.8243568 Nov 09 04:32:54.412491 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de7ab7c5-2410-471d-8a40-c172e8d34d60 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 32, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:32:54.413220 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de7ab7c5-2410-471d-8a40-c172e8d34d60 None None] Checking segment: {'id': '696f4512-dd80-4379-a21b-b923df29bba5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 344, 'network_id': '9e8670b3-5b0d-4ce5-8329-3af82c94231c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:32:54.413220 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-de7ab7c5-2410-471d-8a40-c172e8d34d60 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:54.413613 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de7ab7c5-2410-471d-8a40-c172e8d34d60 None None] Bound using segment: {'id': '696f4512-dd80-4379-a21b-b923df29bba5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 344, 'network_id': '9e8670b3-5b0d-4ce5-8329-3af82c94231c'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:32:54.414117 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-de7ab7c5-2410-471d-8a40-c172e8d34d60 None None] Bound port: d2861372-0b19-4d5f-98f4-c8dcca66d64f, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '696f4512-dd80-4379-a21b-b923df29bba5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 344, 'network_id': '9e8670b3-5b0d-4ce5-8329-3af82c94231c'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:32:54.414714 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-de7ab7c5-2410-471d-8a40-c172e8d34d60 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:54.415307 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56536) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:54.419905 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-633193cc-cf35-484d-a155-b5c0beb8b1ae tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Request body: {'security_group_rule': {'security_group_id': '8b15a7a0-2ea1-4036-9b48-8db8e8bf1fec', 'protocol': 'udp', 'direction': 'ingress', 'ethertype': 'bad_ethertype'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:54.420744 dv-neutron-816802-2-hyperv neutron-server[102161]: WARNING neutron.api.v2.base [None req-633193cc-cf35-484d-a155-b5c0beb8b1ae tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] An exception happened while processing the request body. The exception message is [Security group rule for ethertype 'bad_ethertype' not supported. Allowed values are ['IPv4', 'IPv6'].].: securitygroup.SecurityGroupRuleInvalidEtherType: Security group rule for ethertype 'bad_ethertype' not supported. Allowed values are ['IPv4', 'IPv6']. Nov 09 04:32:54.421243 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-633193cc-cf35-484d-a155-b5c0beb8b1ae tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:32:54.424547 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-633193cc-cf35-484d-a155-b5c0beb8b1ae tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 396 time: 0.0059540 Nov 09 04:32:54.424700 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 92e4e3f0-c7f9-44d9-83a9-4ee03917e49e {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:32:54.424961 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 92e4e3f0-c7f9-44d9-83a9-4ee03917e49e not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:32:54.425077 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56538) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:54.447064 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-be638ce9-55a6-4c4e-904c-b5c599f8932f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:54.477295 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-6836fede-bc13-4cc8-a382-b0a33fb90ec5 None None] Port a4de75ae-2dab-4896-8d2a-cdfef3f44fab cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:32:54.493062 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be638ce9-55a6-4c4e-904c-b5c599f8932f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event deleted for resources: {'Port': ['ID=ad941d16-029f-42bb-8c21-8d90d927494e,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:54.512981 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-6836fede-bc13-4cc8-a382-b0a33fb90ec5 None None] Could not find standard attr ID for object ad941d16-029f-42bb-8c21-8d90d927494e. {{(pid=102163) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 09 04:32:54.521023 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f83c746f-4887-43f6-9be1-4c90b9452c32 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:54.523117 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1188565a-93b9-4ba8-b5cc-2cdc61f4d0a5 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:54.525024 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ca11dc9d-ccdb-43bd-bc4e-2a59b9079d18 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:54.538490 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-6836fede-bc13-4cc8-a382-b0a33fb90ec5 None None] Could not find standard attr ID for object 7cec9ece-ccf1-461e-a604-8e15e0d56c1e. {{(pid=102163) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 09 04:32:54.549506 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 775e1b75-6b4e-4b53-8c8d-2c5aea990d99 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:32:54.558298 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-6836fede-bc13-4cc8-a382-b0a33fb90ec5 None None] Could not find standard attr ID for object c45e2812-7525-4960-9ce2-86999a9d7686. {{(pid=102163) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 09 04:32:54.583501 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-df17b06f-b400-4800-9b48-ba5c2ac8e5d2 None None] Deleting port 85170025-780d-40aa-8e55-163af488af0e {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:32:54.583869 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-df17b06f-b400-4800-9b48-ba5c2ac8e5d2 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:54.589459 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-de7ab7c5-2410-471d-8a40-c172e8d34d60 None None] For port d2861372-0b19-4d5f-98f4-c8dcca66d64f, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:32:54.613068 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1188565a-93b9-4ba8-b5cc-2cdc61f4d0a5 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] No DVR routers for this DVR port 85170025-780d-40aa-8e55-163af488af0e on host dv-neutron-816802-2-hyperv {{(pid=102161) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:32:54.632175 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-de7ab7c5-2410-471d-8a40-c172e8d34d60 None None] For port d2861372-0b19-4d5f-98f4-c8dcca66d64f, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=d2861372-0b19-4d5f-98f4-c8dcca66d64f,segment=NetworkSegment(696f4512-dd80-4379-a21b-b923df29bba5),segment_id=696f4512-dd80-4379-a21b-b923df29bba5)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:32:54.661041 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ca11dc9d-ccdb-43bd-bc4e-2a59b9079d18 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:54.677720 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f83c746f-4887-43f6-9be1-4c90b9452c32 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Network 9e8670b3-5b0d-4ce5-8329-3af82c94231c is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:54.687091 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-36b3669c-14e8-4744-98fc-ba86315cb932 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:54.694655 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f83c746f-4887-43f6-9be1-4c90b9452c32 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event updated for resources: {'Port': ['ID=20195bcd-85f4-4bce-bae2-63cdf464f57f,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:54.698686 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-f83c746f-4887-43f6-9be1-4c90b9452c32 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:54.719771 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-de7ab7c5-2410-471d-8a40-c172e8d34d60 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:54.719771 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-26453da1-d694-4c93-9118-200640329349 None None] Could not find standard attr ID for object ad941d16-029f-42bb-8c21-8d90d927494e. {{(pid=102163) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 09 04:32:54.720014 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f83c746f-4887-43f6-9be1-4c90b9452c32 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:32:54.724115 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-df17b06f-b400-4800-9b48-ba5c2ac8e5d2 None None] For port 85170025-780d-40aa-8e55-163af488af0e, host dv-neutron-816802-2-hyperv, got binding levels [] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:32:54.725982 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-df17b06f-b400-4800-9b48-ba5c2ac8e5d2 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:54.748889 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ca11dc9d-ccdb-43bd-bc4e-2a59b9079d18 None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:54.759833 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-df17b06f-b400-4800-9b48-ba5c2ac8e5d2 None None] Calling delete_port for 85170025-780d-40aa-8e55-163af488af0e owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:32:54.763587 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-ca11dc9d-ccdb-43bd-bc4e-2a59b9079d18 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:54.766155 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.ipam_backend_mixin [None req-df17b06f-b400-4800-9b48-ba5c2ac8e5d2 None None] Port 85170025-780d-40aa-8e55-163af488af0e was not found and therefore no delete operation was performed {{(pid=102163) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Nov 09 04:32:54.771309 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca11dc9d-ccdb-43bd-bc4e-2a59b9079d18 None None] Pushing event updated for resources: {'Port': ['ID=1849d4a8-7f58-4a68-ad8b-4b9fd74ebd07,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:54.775122 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ca11dc9d-ccdb-43bd-bc4e-2a59b9079d18 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:32:54.781020 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-df17b06f-b400-4800-9b48-ba5c2ac8e5d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:54.785087 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1188565a-93b9-4ba8-b5cc-2cdc61f4d0a5 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event deleted for resources: {'Port': ['ID=85170025-780d-40aa-8e55-163af488af0e,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:54.787551 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-be638ce9-55a6-4c4e-904c-b5c599f8932f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:54.793276 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-be638ce9-55a6-4c4e-904c-b5c599f8932f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "DELETE /v2.0/ports/ad941d16-029f-42bb-8c21-8d90d927494e HTTP/1.1" status: 204 len: 168 time: 1.4031665 Nov 09 04:32:54.803187 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56540) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:54.835090 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 775e1b75-6b4e-4b53-8c8d-2c5aea990d99 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:54.835451 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:54.841707 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1188565a-93b9-4ba8-b5cc-2cdc61f4d0a5 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:54.856826 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-df17b06f-b400-4800-9b48-ba5c2ac8e5d2 None None] No DVR routers for this DVR port 85170025-780d-40aa-8e55-163af488af0e on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:32:54.857934 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-a180f1c8-ba92-41f3-b40c-13378bd9c3b0 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] GET failed (client error): The resource could not be found. Nov 09 04:32:54.859483 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a180f1c8-ba92-41f3-b40c-13378bd9c3b0 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "GET /v2.0/ports/ad941d16-029f-42bb-8c21-8d90d927494e HTTP/1.1" status: 404 len: 333 time: 0.0535088 Nov 09 04:32:54.862326 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56542) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:54.868445 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-1188565a-93b9-4ba8-b5cc-2cdc61f4d0a5 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ecb7b134-532e-4633-869a-87791c77a3ae']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:54.876993 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-96a2b2ee-624f-4035-9756-35ba0ce7c4ba tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Allocated IP 172.20.0.11 (988d2354-693c-4d52-af17-25e0643eaa0c/0443928b-d719-43d8-9ea7-e1f06c3fe17d/72a65b9f-24dc-4ee2-a165-b8c907953cbf) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:32:54.898613 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-96a2b2ee-624f-4035-9756-35ba0ce7c4ba tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Allocated IP 2001:db8::f816:3eff:fef5:1bd2 (988d2354-693c-4d52-af17-25e0643eaa0c/4d70f328-6f2a-4019-a3c5-3a110db5d988/72a65b9f-24dc-4ee2-a165-b8c907953cbf) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:32:54.907587 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-36b3669c-14e8-4744-98fc-ba86315cb932 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:54.908532 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-1188565a-93b9-4ba8-b5cc-2cdc61f4d0a5 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4f6bb1f5-74af-4566-9205-8a358168ad9d') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:54.908836 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-1188565a-93b9-4ba8-b5cc-2cdc61f4d0a5 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4f6bb1f5-74af-4566-9205-8a358168ad9d') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:54.936935 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1188565a-93b9-4ba8-b5cc-2cdc61f4d0a5 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:54.947865 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de7ab7c5-2410-471d-8a40-c172e8d34d60 None None] Pushing event updated for resources: {'Port': ['ID=d2861372-0b19-4d5f-98f4-c8dcca66d64f,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:54.952287 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-ca11dc9d-ccdb-43bd-bc4e-2a59b9079d18 None None] Attempting to bind port 1849d4a8-7f58-4a68-ad8b-4b9fd74ebd07 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:32:54.952649 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-ca11dc9d-ccdb-43bd-bc4e-2a59b9079d18 None None] Attempting to bind port 1849d4a8-7f58-4a68-ad8b-4b9fd74ebd07 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:32:54.953017 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ca11dc9d-ccdb-43bd-bc4e-2a59b9079d18 None None] Attempting to bind port 1849d4a8-7f58-4a68-ad8b-4b9fd74ebd07 on network 988d2354-693c-4d52-af17-25e0643eaa0c {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:32:54.967226 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f83c746f-4887-43f6-9be1-4c90b9452c32 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:54.975281 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1188565a-93b9-4ba8-b5cc-2cdc61f4d0a5 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:54.985308 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ca11dc9d-ccdb-43bd-bc4e-2a59b9079d18 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 32, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:32:54.985706 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ca11dc9d-ccdb-43bd-bc4e-2a59b9079d18 None None] Checking segment: {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:32:54.986062 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ca11dc9d-ccdb-43bd-bc4e-2a59b9079d18 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:54.986469 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ca11dc9d-ccdb-43bd-bc4e-2a59b9079d18 None None] Bound using segment: {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:32:54.986946 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-ca11dc9d-ccdb-43bd-bc4e-2a59b9079d18 None None] Bound port: 1849d4a8-7f58-4a68-ad8b-4b9fd74ebd07, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:32:54.987321 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ca11dc9d-ccdb-43bd-bc4e-2a59b9079d18 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:54.989104 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df17b06f-b400-4800-9b48-ba5c2ac8e5d2 None None] Pushing event deleted for resources: {'Port': ['ID=85170025-780d-40aa-8e55-163af488af0e,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:55.001661 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-13ad378c-c900-4417-8838-4a167ec1931d tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:55.023146 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1188565a-93b9-4ba8-b5cc-2cdc61f4d0a5 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Releasing vlan 337 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:32:55.023562 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1188565a-93b9-4ba8-b5cc-2cdc61f4d0a5 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:55.028856 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:32:55.028856 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:32:55.028856 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:32:55.028856 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:32:55.028856 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:32:55.028856 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:32:55.028856 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:32:55.028856 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:32:55.028856 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:32:55.028856 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:32:55.028856 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:32:55.028856 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:32:55.028856 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:32:55.028856 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:32:55.028856 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:32:55.028856 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:32:55.028856 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:32:55.028856 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:32:55.028856 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:32:55.028856 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:32:55.028856 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:32:55.028856 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:32:55.028856 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:32:55.028856 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:32:55.028856 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:32:55.028856 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:32:55.028856 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:32:55.028856 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:32:55.028856 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:32:55.028856 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:32:55.028856 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:32:55.028856 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:32:55.057514 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-13ad378c-c900-4417-8838-4a167ec1931d tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:55.085388 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 98741773-362a-4c6e-b503-923f0f367a2a up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:32:55.144737 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-ca11dc9d-ccdb-43bd-bc4e-2a59b9079d18 None None] For port 1849d4a8-7f58-4a68-ad8b-4b9fd74ebd07, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:32:55.161963 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-36b3669c-14e8-4744-98fc-ba86315cb932 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:55.168486 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-36b3669c-14e8-4744-98fc-ba86315cb932 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:55.172130 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-36b3669c-14e8-4744-98fc-ba86315cb932 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "DELETE /v2.0/security-groups/8b15a7a0-2ea1-4036-9b48-8db8e8bf1fec HTTP/1.1" status: 204 len: 168 time: 0.7438054 Nov 09 04:32:55.173149 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56546) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:55.193636 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-ca11dc9d-ccdb-43bd-bc4e-2a59b9079d18 None None] For port 1849d4a8-7f58-4a68-ad8b-4b9fd74ebd07, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=1849d4a8-7f58-4a68-ad8b-4b9fd74ebd07,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:32:55.194163 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36b3669c-14e8-4744-98fc-ba86315cb932 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=8b15a7a0-2ea1-4036-9b48-8db8e8bf1fec,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:55.237540 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 98741773-362a-4c6e-b503-923f0f367a2a triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:55.237907 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:55.239591 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1188565a-93b9-4ba8-b5cc-2cdc61f4d0a5 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:55.245565 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1188565a-93b9-4ba8-b5cc-2cdc61f4d0a5 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:55.253284 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1188565a-93b9-4ba8-b5cc-2cdc61f4d0a5 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "DELETE /v2.0/networks/ecb7b134-532e-4633-869a-87791c77a3ae HTTP/1.1" status: 204 len: 168 time: 1.7083879 Nov 09 04:32:55.253404 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56548) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:55.262111 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-8c2cce4a-4313-4f64-a9c6-dc53e01f39b2 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-630276114'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:55.288494 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56550) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:55.289245 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-2e0ef879-b64d-4537-91f5-42849252f221 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.1082876 Nov 09 04:32:55.306193 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-ce281615-d3b1-4681-9043-2156b77602fb tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Request body: {'security_group': {'name': 'tempest-secgroup--935887912'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:55.307317 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1188565a-93b9-4ba8-b5cc-2cdc61f4d0a5 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event deleted for resources: {'Network': ['ID=ecb7b134-532e-4633-869a-87791c77a3ae,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:55.315024 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ca11dc9d-ccdb-43bd-bc4e-2a59b9079d18 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:55.324517 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f83c746f-4887-43f6-9be1-4c90b9452c32 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:55.345837 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-13ad378c-c900-4417-8838-4a167ec1931d tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:55.349698 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-13ad378c-c900-4417-8838-4a167ec1931d tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:55.353356 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-13ad378c-c900-4417-8838-4a167ec1931d tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "DELETE /v2.0/security-groups/0f579a62-f1dd-49dd-bc50-30e401b588b8 HTTP/1.1" status: 204 len: 168 time: 0.4870410 Nov 09 04:32:55.360850 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56552) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:55.394498 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-96a2b2ee-624f-4035-9756-35ba0ce7c4ba tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:55.430483 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13ad378c-c900-4417-8838-4a167ec1931d tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=0f579a62-f1dd-49dd-bc50-30e401b588b8,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:55.433223 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca11dc9d-ccdb-43bd-bc4e-2a59b9079d18 None None] Pushing event updated for resources: {'Port': ['ID=1849d4a8-7f58-4a68-ad8b-4b9fd74ebd07,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:55.483134 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8c2cce4a-4313-4f64-a9c6-dc53e01f39b2 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Made reservation on behalf of 12e47d8445b5429892cd1b9244512ca8 for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:55.486680 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8c2cce4a-4313-4f64-a9c6-dc53e01f39b2 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:55.522905 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bf5996c1-1347-4883-b247-0ae9829bc629 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:55.557233 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bf5996c1-1347-4883-b247-0ae9829bc629 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:55.563944 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 85170025-780d-40aa-8e55-163af488af0e no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:32:55.586055 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8c2cce4a-4313-4f64-a9c6-dc53e01f39b2 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 305} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:32:55.594944 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 85170025-780d-40aa-8e55-163af488af0e {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:32:55.595441 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 85170025-780d-40aa-8e55-163af488af0e not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:32:55.609211 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8c2cce4a-4313-4f64-a9c6-dc53e01f39b2 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:55.609567 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-8c2cce4a-4313-4f64-a9c6-dc53e01f39b2 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Added segment 48c90ef7-c819-495a-b369-c2ba95c6d696 of type vlan for network f3f8d961-ce10-4756-a07a-6ea2265beb22 Nov 09 04:32:55.670567 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-96a2b2ee-624f-4035-9756-35ba0ce7c4ba tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:55.672503 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ce281615-d3b1-4681-9043-2156b77602fb tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:55.678793 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8c2cce4a-4313-4f64-a9c6-dc53e01f39b2 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:55.759754 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bf5996c1-1347-4883-b247-0ae9829bc629 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:55.762425 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bf5996c1-1347-4883-b247-0ae9829bc629 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:55.766395 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-bf5996c1-1347-4883-b247-0ae9829bc629 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "DELETE /v2.0/security-groups/a5f16ce1-934f-440f-8bb9-bb56e4fe5d78 HTTP/1.1" status: 204 len: 168 time: 0.4008472 Nov 09 04:32:55.773994 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56556) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:55.840552 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf5996c1-1347-4883-b247-0ae9829bc629 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=a5f16ce1-934f-440f-8bb9-bb56e4fe5d78,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:55.848262 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-96a2b2ee-624f-4035-9756-35ba0ce7c4ba tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:55.869874 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-96a2b2ee-624f-4035-9756-35ba0ce7c4ba tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:55.890952 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-96a2b2ee-624f-4035-9756-35ba0ce7c4ba tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:32:55.953450 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96a2b2ee-624f-4035-9756-35ba0ce7c4ba tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Port': ['ID=72a65b9f-24dc-4ee2-a165-b8c907953cbf,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:55.972962 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8c2cce4a-4313-4f64-a9c6-dc53e01f39b2 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:55.979258 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8c2cce4a-4313-4f64-a9c6-dc53e01f39b2 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:55.980161 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8c2cce4a-4313-4f64-a9c6-dc53e01f39b2 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:56.015855 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13c2aa59-7844-4159-bbb9-bb429092123f req-1be283e2-86b3-46a8-a2c5-c6e2f4466d6e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:56.017326 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-13c2aa59-7844-4159-bbb9-bb429092123f req-1be283e2-86b3-46a8-a2c5-c6e2f4466d6e service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=6015befde7f546d881cb247ae5bc81ae&device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 1098 time: 0.3368838 Nov 09 04:32:56.042241 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-96a2b2ee-624f-4035-9756-35ba0ce7c4ba tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:56.042977 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-96a2b2ee-624f-4035-9756-35ba0ce7c4ba tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:56.090008 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58c931b3-7451-4d24-99b2-bffaf52c315a req-87eaeb93-e484-4671-8d1a-3569b65cb568 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:56.091612 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-58c931b3-7451-4d24-99b2-bffaf52c315a req-87eaeb93-e484-4671-8d1a-3569b65cb568 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 945 time: 0.0954912 Nov 09 04:32:56.138149 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-8c2cce4a-4313-4f64-a9c6-dc53e01f39b2 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 771 time: 0.8811653 Nov 09 04:32:56.145902 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56558) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:56.157211 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-31ce40cc-5670-4909-985c-32bf3cf1e090 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Request body: {'subnet': {'network_id': 'f3f8d961-ce10-4756-a07a-6ea2265beb22', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:56.180310 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f83c746f-4887-43f6-9be1-4c90b9452c32 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:56.187191 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bd36e66a-60dc-4e88-a2e3-a616f554b44b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:56.193239 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c2cce4a-4313-4f64-a9c6-dc53e01f39b2 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event updated for resources: {'Network': ['ID=f3f8d961-ce10-4756-a07a-6ea2265beb22,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:56.213443 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network f3f8d961-ce10-4756-a07a-6ea2265beb22 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:32:56.214017 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ce281615-d3b1-4681-9043-2156b77602fb tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:56.229057 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-96a2b2ee-624f-4035-9756-35ba0ce7c4ba tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1027 time: 2.7030983 Nov 09 04:32:56.230434 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-58c931b3-7451-4d24-99b2-bffaf52c315a req-dfb35635-a056-4a96-9a63-7352ba329926 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1307061 Nov 09 04:32:56.233185 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56560) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:56.253044 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bd36e66a-60dc-4e88-a2e3-a616f554b44b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:56.274690 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f83c746f-4887-43f6-9be1-4c90b9452c32 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:56.301685 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13c2aa59-7844-4159-bbb9-bb429092123f req-5c26f75c-3d8f-4708-933f-0b6674e02ad9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:56.303439 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-13c2aa59-7844-4159-bbb9-bb429092123f req-5c26f75c-3d8f-4708-933f-0b6674e02ad9 service neutron] 10.222.0.26 "GET /v2.0/networks?id=a270b61c-1f4f-4d97-be79-4a24c65fddc2 HTTP/1.1" status: 200 len: 913 time: 0.2714138 Nov 09 04:32:56.317474 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2b12f81e-b3ff-41fb-bd6c-6f105b07722e None None] Network 9e8670b3-5b0d-4ce5-8329-3af82c94231c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:32:56.335971 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ce281615-d3b1-4681-9043-2156b77602fb tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:56.383013 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f83c746f-4887-43f6-9be1-4c90b9452c32 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:56.399304 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b5089e64-84b6-4153-9e14-63f01b1b5a45 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:56.405495 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b5089e64-84b6-4153-9e14-63f01b1b5a45 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:56.409710 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-b5089e64-84b6-4153-9e14-63f01b1b5a45 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1782 time: 0.1730902 Nov 09 04:32:56.411422 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56566) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:56.412079 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f83c746f-4887-43f6-9be1-4c90b9452c32 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event updated for resources: {'Port': ['ID=20195bcd-85f4-4bce-bae2-63cdf464f57f,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:56.483665 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-31ce40cc-5670-4909-985c-32bf3cf1e090 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Made reservation on behalf of 12e47d8445b5429892cd1b9244512ca8 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:56.487251 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-31ce40cc-5670-4909-985c-32bf3cf1e090 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:56.488847 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce281615-d3b1-4681-9043-2156b77602fb tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Pushing event updated for resources: {'SecurityGroup': ['ID=a799d15b-7fec-47c8-a3e0-a4d30ae5aff3,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:56.495399 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-13c2aa59-7844-4159-bbb9-bb429092123f req-7d8ba5d5-7e12-4407-8566-04c5b8c513b2 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=99ad1d96-b35b-4120-b5a9-c95c47bd3ffc HTTP/1.1" status: 200 len: 1001 time: 0.1618872 Nov 09 04:32:56.531181 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-88ae78d6-9617-403c-91cb-018098d212f9 None None] Provisioning complete for port d2861372-0b19-4d5f-98f4-c8dcca66d64f triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:56.532201 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-88ae78d6-9617-403c-91cb-018098d212f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:56.599949 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13c2aa59-7844-4159-bbb9-bb429092123f req-60749541-28c0-4990-962c-520c8c2cb38f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:56.602170 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-13c2aa59-7844-4159-bbb9-bb429092123f req-60749541-28c0-4990-962c-520c8c2cb38f service neutron] 10.222.0.26 "GET /v2.0/subnets?id=b2956e71-9b0f-4060-922c-e54ce6cff80a HTTP/1.1" status: 200 len: 851 time: 0.0981500 Nov 09 04:32:56.605984 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ce281615-d3b1-4681-9043-2156b77602fb tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:56.609798 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-ce281615-d3b1-4681-9043-2156b77602fb tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1760 time: 1.3118141 Nov 09 04:32:56.609798 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bd36e66a-60dc-4e88-a2e3-a616f554b44b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:56.610582 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bd36e66a-60dc-4e88-a2e3-a616f554b44b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:56.612971 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-bd36e66a-60dc-4e88-a2e3-a616f554b44b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "DELETE /v2.0/security-groups/ec71de09-adca-48c6-bf05-ec0ddc8b3406 HTTP/1.1" status: 204 len: 168 time: 0.8311267 Nov 09 04:32:56.628161 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56568) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:56.628161 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56570) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:56.635331 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-04947d87-0fe9-4f33-b214-7dbce35c2265 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Request body: {'security_group_rule': {'security_group_id': 'a799d15b-7fec-47c8-a3e0-a4d30ae5aff3', 'protocol': 'bad_protocol_name', 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:56.636182 dv-neutron-816802-2-hyperv neutron-server[102162]: WARNING neutron.api.v2.base [None req-04947d87-0fe9-4f33-b214-7dbce35c2265 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] An exception happened while processing the request body. The exception message is [Security group rule protocol bad_protocol_name not supported. Only protocol values [None, 'ah', 'dccp', 'egp', 'esp', 'gre', 'hopopt', 'icmp', 'igmp', 'ip', 'ipip', 'ipv6-encap', 'ipv6-frag', 'ipv6-icmp', 'icmpv6', 'ipv6-nonxt', 'ipv6-opts', 'ipv6-route', 'ospf', 'pgm', 'rsvp', 'sctp', 'tcp', 'udp', 'udplite', 'vrrp'] and integer representations [0 to 255] are supported.].: securitygroup.SecurityGroupRuleInvalidProtocol: Security group rule protocol bad_protocol_name not supported. Only protocol values [None, 'ah', 'dccp', 'egp', 'esp', 'gre', 'hopopt', 'icmp', 'igmp', 'ip', 'ipip', 'ipv6-encap', 'ipv6-frag', 'ipv6-icmp', 'icmpv6', 'ipv6-nonxt', 'ipv6-opts', 'ipv6-route', 'ospf', 'pgm', 'rsvp', 'sctp', 'tcp', 'udp', 'udplite', 'vrrp'] and integer representations [0 to 255] are supported. Nov 09 04:32:56.636694 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.api.v2.resource [None req-04947d87-0fe9-4f33-b214-7dbce35c2265 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:32:56.637710 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-04947d87-0fe9-4f33-b214-7dbce35c2265 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 667 time: 0.0072727 Nov 09 04:32:56.645444 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56572) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:56.701786 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-88ae78d6-9617-403c-91cb-018098d212f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:56.752512 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-88ae78d6-9617-403c-91cb-018098d212f9 None None] For port d2861372-0b19-4d5f-98f4-c8dcca66d64f, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=d2861372-0b19-4d5f-98f4-c8dcca66d64f,segment=NetworkSegment(696f4512-dd80-4379-a21b-b923df29bba5),segment_id=696f4512-dd80-4379-a21b-b923df29bba5)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:32:56.770006 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device d2861372-0b19-4d5f-98f4-c8dcca66d64f up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:32:56.791180 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd36e66a-60dc-4e88-a2e3-a616f554b44b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=ec71de09-adca-48c6-bf05-ec0ddc8b3406,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:56.825563 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-e8169832-e471-4fbf-9ccd-7452beb8c88f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Deleting port 72a65b9f-24dc-4ee2-a165-b8c907953cbf {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:32:56.829421 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e8169832-e471-4fbf-9ccd-7452beb8c88f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:56.835056 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f83c746f-4887-43f6-9be1-4c90b9452c32 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Network 9e8670b3-5b0d-4ce5-8329-3af82c94231c is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:32:56.849723 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13c2aa59-7844-4159-bbb9-bb429092123f req-c5d421fe-a367-4fb8-91ae-dd307633c3f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:56.853296 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-13c2aa59-7844-4159-bbb9-bb429092123f req-c5d421fe-a367-4fb8-91ae-dd307633c3f1 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=a270b61c-1f4f-4d97-be79-4a24c65fddc2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.2392824 Nov 09 04:32:56.854487 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-50fad598-d0e6-40ae-ba55-e22805f5157f tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:56.861399 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-9e0e3975-3573-48bd-b710-9692810ad63b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Deleting subnet a9f45838-17f7-49da-abfb-42e7219b00a2 {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:32:56.869853 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port d2861372-0b19-4d5f-98f4-c8dcca66d64f triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:56.870622 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:56.874075 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-88ae78d6-9617-403c-91cb-018098d212f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:56.878383 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-f83c746f-4887-43f6-9be1-4c90b9452c32 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:56.981510 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9e0e3975-3573-48bd-b710-9692810ad63b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:57.012391 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-13c2aa59-7844-4159-bbb9-bb429092123f req-3accb79d-dbcb-45c1-ab94-2d27adb3cd4a service neutron] 10.222.0.26 "GET /v2.0/networks/a270b61c-1f4f-4d97-be79-4a24c65fddc2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1454086 Nov 09 04:32:57.050899 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88ae78d6-9617-403c-91cb-018098d212f9 None None] Pushing event updated for resources: {'Port': ['ID=d2861372-0b19-4d5f-98f4-c8dcca66d64f,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:57.069521 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-50fad598-d0e6-40ae-ba55-e22805f5157f tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:57.070576 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4d8be64f-1cbb-4d04-bdee-78492fe43134 None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:32:57.149580 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9e0e3975-3573-48bd-b710-9692810ad63b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:57.202623 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 1849d4a8-7f58-4a68-ad8b-4b9fd74ebd07 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:32:57.233377 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-885dc6a2-d3cb-4b30-8b71-fc51dee888b6 None None] Provisioning complete for port 20195bcd-85f4-4bce-bae2-63cdf464f57f triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:57.233751 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-885dc6a2-d3cb-4b30-8b71-fc51dee888b6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:57.260451 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f83c746f-4887-43f6-9be1-4c90b9452c32 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Router fa30d24d-d721-4675-ad7b-09f35105e633 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:32:57.285811 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-13c2aa59-7844-4159-bbb9-bb429092123f req-9aceb0ff-23b1-4c7f-95da-cf806506519a service neutron] 10.222.0.26 "GET /v2.0/networks/a270b61c-1f4f-4d97-be79-4a24c65fddc2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2618034 Nov 09 04:32:57.305150 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e8169832-e471-4fbf-9ccd-7452beb8c88f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:57.369647 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-885dc6a2-d3cb-4b30-8b71-fc51dee888b6 None None] Port 20195bcd-85f4-4bce-bae2-63cdf464f57f cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:32:57.397472 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9e0e3975-3573-48bd-b710-9692810ad63b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:57.420853 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-31ce40cc-5670-4909-985c-32bf3cf1e090 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:57.424678 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-885dc6a2-d3cb-4b30-8b71-fc51dee888b6 None None] Provisioning complete for port d2861372-0b19-4d5f-98f4-c8dcca66d64f triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:57.430416 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-885dc6a2-d3cb-4b30-8b71-fc51dee888b6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:57.508368 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-50fad598-d0e6-40ae-ba55-e22805f5157f tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:57.511253 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-50fad598-d0e6-40ae-ba55-e22805f5157f tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:57.512917 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-50fad598-d0e6-40ae-ba55-e22805f5157f tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "DELETE /v2.0/security-groups/a799d15b-7fec-47c8-a3e0-a4d30ae5aff3 HTTP/1.1" status: 204 len: 168 time: 0.8352015 Nov 09 04:32:57.541095 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56576) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:57.541906 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50fad598-d0e6-40ae-ba55-e22805f5157f tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=a799d15b-7fec-47c8-a3e0-a4d30ae5aff3,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:57.569650 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31ce40cc-5670-4909-985c-32bf3cf1e090 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event updated for resources: {'Subnet': ['ID=57a6fd15-e149-473d-85de-d7cbbf8fa903,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:57.579735 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-e8169832-e471-4fbf-9ccd-7452beb8c88f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Calling delete_port for 72a65b9f-24dc-4ee2-a165-b8c907953cbf owned by {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:32:57.591667 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 1849d4a8-7f58-4a68-ad8b-4b9fd74ebd07 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:57.592768 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:57.622755 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9e0e3975-3573-48bd-b710-9692810ad63b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:57.644866 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f83c746f-4887-43f6-9be1-4c90b9452c32 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:32:57.661816 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-f83c746f-4887-43f6-9be1-4c90b9452c32 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "PUT /v2.0/routers/fa30d24d-d721-4675-ad7b-09f35105e633/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.9108202 Nov 09 04:32:57.661816 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56578) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:57.668679 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-20f2136a-7bdf-4d7e-8357-178b081c60b8 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Request body: {'network': {'name': 'tempest-RoutersTest-461201111'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:57.682160 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-0ada1915-739d-40c3-887c-04b11fb00065 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.1365838 Nov 09 04:32:57.682825 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56580) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:57.689431 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-3bc236d1-dc78-4d03-a59a-1b49d2d8d146 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Request body: {'security_group': {'name': 'tempest-secgroup--1127211982'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:57.694334 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e0e3975-3573-48bd-b710-9692810ad63b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event deleted for resources: {'Subnet': ['ID=a9f45838-17f7-49da-abfb-42e7219b00a2,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:57.700430 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-20104a3e-d219-4d60-a84e-fcb6353c864e None None] Sync routers for ids ['fa30d24d-d721-4675-ad7b-09f35105e633'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:32:57.730600 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9e0e3975-3573-48bd-b710-9692810ad63b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:57.734579 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-9e0e3975-3573-48bd-b710-9692810ad63b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "DELETE /v2.0/subnets/a9f45838-17f7-49da-abfb-42e7219b00a2 HTTP/1.1" status: 204 len: 168 time: 1.0957808 Nov 09 04:32:57.741281 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56582) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:57.752823 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.db.api [None req-3bc236d1-dc78-4d03-a59a-1b49d2d8d146 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Nov 09 04:32:57.752823 dv-neutron-816802-2-hyperv neutron-server[102162]: [SQL: DELETE FROM reservations WHERE reservations.project_id = %(project_id_1)s AND reservations.expiration < %(expiration_1)s] Nov 09 04:32:57.752823 dv-neutron-816802-2-hyperv neutron-server[102162]: [parameters: {'project_id_1': '7ab8c5da87614044ba13ccf0c18cd124', 'expiration_1': datetime.datetime(2021, 11, 9, 4, 32, 37, 714592)}] Nov 09 04:32:57.752823 dv-neutron-816802-2-hyperv neutron-server[102162]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=102162) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:32:57.753293 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG oslo_db.api [None req-3bc236d1-dc78-4d03-a59a-1b49d2d8d146 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Performing DB retry for function neutron.db.quota.driver_nolock.DbQuotaNoLockDriver.make_reservation {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:32:57.763482 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4cf032a-bdb7-4abb-902b-d8ee479ce52d req-4475b4c9-ee35-42a1-826e-055f51b947a8 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:57.765536 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b4cf032a-bdb7-4abb-902b-d8ee479ce52d req-4475b4c9-ee35-42a1-826e-055f51b947a8 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 945 time: 0.3634548 Nov 09 04:32:57.795634 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-31ce40cc-5670-4909-985c-32bf3cf1e090 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Checking segment: {'id': '48c90ef7-c819-495a-b369-c2ba95c6d696', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 305, 'network_id': 'f3f8d961-ce10-4756-a07a-6ea2265beb22'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:32:57.796062 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-31ce40cc-5670-4909-985c-32bf3cf1e090 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Network hostable DHCP agents. Network: f3f8d961-ce10-4756-a07a-6ea2265beb22, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:32:57.812150 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-99e502f2-3735-4ae5-ad93-1aaae03346d1 None None] Network cc397c48-c4cc-4846-a1ef-380b64be450d requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:32:57.814380 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-78c17f5c-0cd7-411f-98d4-d5e3ac0bfc5b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Deleting subnet dcda61a8-5577-4d3c-b013-75d4a2348e40 {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:32:57.818778 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-78c17f5c-0cd7-411f-98d4-d5e3ac0bfc5b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:57.829068 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-20104a3e-d219-4d60-a84e-fcb6353c864e None None] Routers {'fa30d24d-d721-4675-ad7b-09f35105e633'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:32:57.829845 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-20104a3e-d219-4d60-a84e-fcb6353c864e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:32:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['fa30d24d-d721-4675-ad7b-09f35105e633'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:57.866074 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b4cf032a-bdb7-4abb-902b-d8ee479ce52d req-54c974f2-9a56-45a9-b508-1880d9000aa8 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0867252 Nov 09 04:32:57.879198 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-20f2136a-7bdf-4d7e-8357-178b081c60b8 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Made reservation on behalf of 188f23ef0cb54006875c672b78f5249f for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:57.883751 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-20f2136a-7bdf-4d7e-8357-178b081c60b8 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:57.885374 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-78c17f5c-0cd7-411f-98d4-d5e3ac0bfc5b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:57.941156 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-20f2136a-7bdf-4d7e-8357-178b081c60b8 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 334} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:32:57.948953 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-31ce40cc-5670-4909-985c-32bf3cf1e090 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Network f3f8d961-ce10-4756-a07a-6ea2265beb22 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:32:57.968440 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-20f2136a-7bdf-4d7e-8357-178b081c60b8 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:57.972334 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-20f2136a-7bdf-4d7e-8357-178b081c60b8 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Added segment 4adb05ec-46fe-428a-86b2-7b7107e35fdd of type vlan for network 0bab5ed1-b8b1-45ba-b633-5bee32c71edd Nov 09 04:32:58.045119 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-78c17f5c-0cd7-411f-98d4-d5e3ac0bfc5b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:58.059926 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-31ce40cc-5670-4909-985c-32bf3cf1e090 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, f3f8d961-ce10-4756-a07a-6ea2265beb22) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:58.067186 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-20f2136a-7bdf-4d7e-8357-178b081c60b8 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:58.072222 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-31ce40cc-5670-4909-985c-32bf3cf1e090 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:58.072661 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-885dc6a2-d3cb-4b30-8b71-fc51dee888b6 None None] Provisioning complete for port 1849d4a8-7f58-4a68-ad8b-4b9fd74ebd07 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:58.072872 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-31ce40cc-5670-4909-985c-32bf3cf1e090 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:58.073888 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-885dc6a2-d3cb-4b30-8b71-fc51dee888b6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:58.156567 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a77a3597-9f54-4402-9236-8d919451769b None None] Network f3f8d961-ce10-4756-a07a-6ea2265beb22 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:32:58.195878 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-31ce40cc-5670-4909-985c-32bf3cf1e090 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 2.0485303 Nov 09 04:32:58.210105 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56584) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:58.215751 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-270cfc38-d561-4234-bec2-9e938249ebd8 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Request body: {'port': {'network_id': 'f3f8d961-ce10-4756-a07a-6ea2265beb22', 'name': 'tempest-PortsIpV6TestJSON-1527756588', 'fixed_ips': [{'subnet_id': '57a6fd15-e149-473d-85de-d7cbbf8fa903', 'ip_address': '2001:db8::10'}]}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:58.228721 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e8169832-e471-4fbf-9ccd-7452beb8c88f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:58.245597 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-78c17f5c-0cd7-411f-98d4-d5e3ac0bfc5b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:58.247366 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-20f2136a-7bdf-4d7e-8357-178b081c60b8 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:58.256506 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-20f2136a-7bdf-4d7e-8357-178b081c60b8 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:58.258823 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-20f2136a-7bdf-4d7e-8357-178b081c60b8 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:58.316738 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78c17f5c-0cd7-411f-98d4-d5e3ac0bfc5b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event deleted for resources: {'Subnet': ['ID=dcda61a8-5577-4d3c-b013-75d4a2348e40,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:58.324126 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-78c17f5c-0cd7-411f-98d4-d5e3ac0bfc5b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:58.330418 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-78c17f5c-0cd7-411f-98d4-d5e3ac0bfc5b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "DELETE /v2.0/subnets/dcda61a8-5577-4d3c-b013-75d4a2348e40 HTTP/1.1" status: 204 len: 168 time: 0.5870357 Nov 09 04:32:58.335169 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56586) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:58.358865 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8169832-e471-4fbf-9ccd-7452beb8c88f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event deleted for resources: {'Port': ['ID=72a65b9f-24dc-4ee2-a165-b8c907953cbf,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:58.394024 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-61f59c44-6259-414d-8f79-ae54433faf51 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] DELETE failed (client error): The resource could not be found. Nov 09 04:32:58.394945 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-61f59c44-6259-414d-8f79-ae54433faf51 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:32:58.407325 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-61f59c44-6259-414d-8f79-ae54433faf51 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "DELETE /v2.0/subnets/a9f45838-17f7-49da-abfb-42e7219b00a2 HTTP/1.1" status: 404 len: 337 time: 0.0711346 Nov 09 04:32:58.412708 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56588) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:58.421838 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-20104a3e-d219-4d60-a84e-fcb6353c864e None None] Set router fa30d24d-d721-4675-ad7b-09f35105e633 gateway port host: None {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:32:58.424110 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:58.447271 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20f2136a-7bdf-4d7e-8357-178b081c60b8 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event updated for resources: {'Network': ['ID=0bab5ed1-b8b1-45ba-b633-5bee32c71edd,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:58.481639 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e8169832-e471-4fbf-9ccd-7452beb8c88f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:58.487312 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 0bab5ed1-b8b1-45ba-b633-5bee32c71edd details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:32:58.489491 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-5463d148-3778-4d0b-9b7a-8e5abddf1a7a tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Deleting subnet 775bb7b9-6a44-44d8-a29c-1b53db6d50e5 {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:32:58.493257 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-e8169832-e471-4fbf-9ccd-7452beb8c88f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/ports/72a65b9f-24dc-4ee2-a165-b8c907953cbf HTTP/1.1" status: 204 len: 168 time: 2.0740614 Nov 09 04:32:58.495388 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56590) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:58.498408 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5463d148-3778-4d0b-9b7a-8e5abddf1a7a tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:58.504675 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3bc236d1-dc78-4d03-a59a-1b49d2d8d146 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:58.509892 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-20f2136a-7bdf-4d7e-8357-178b081c60b8 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 765 time: 0.8426561 Nov 09 04:32:58.510071 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56592) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:58.515728 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-bc871d1b-36c7-408c-9cac-d7d5f70f173e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Request body: {'subnet': {'network_id': '0bab5ed1-b8b1-45ba-b633-5bee32c71edd', 'cidr': '172.23.0.0/28', 'ip_version': 4, 'gateway_ip': '172.23.0.1'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:58.642145 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5463d148-3778-4d0b-9b7a-8e5abddf1a7a tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:58.678214 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bc871d1b-36c7-408c-9cac-d7d5f70f173e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Made reservation on behalf of 188f23ef0cb54006875c672b78f5249f for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:58.682651 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bc871d1b-36c7-408c-9cac-d7d5f70f173e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:58.684342 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-434d007b-5218-4e4e-bb52-ba276198ae28 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:58.685828 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-434d007b-5218-4e4e-bb52-ba276198ae28 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:58.687196 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-434d007b-5218-4e4e-bb52-ba276198ae28 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:58.691229 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-434d007b-5218-4e4e-bb52-ba276198ae28 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2071 time: 0.1915476 Nov 09 04:32:58.698969 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56594) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:58.710122 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6095f267-7744-41ac-9c66-42292acc32f6 None None] Update dhcp port {'port': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'fixed_ips': [{'subnet_id': '4d70f328-6f2a-4019-a3c5-3a110db5d988', 'ip_address': '2001:db8::f816:3eff:fee1:dd55'}, {'subnet_id': '0443928b-d719-43d8-9ea7-e1f06c3fe17d'}], 'binding:host_id': 'dv-neutron-816802-2-hyperv'}, 'id': '1849d4a8-7f58-4a68-ad8b-4b9fd74ebd07'} from dv-neutron-816802-2-hyperv. {{(pid=102163) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:328}} Nov 09 04:32:58.753714 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 1849d4a8-7f58-4a68-ad8b-4b9fd74ebd07, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=1849d4a8-7f58-4a68-ad8b-4b9fd74ebd07,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:32:58.758180 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-885dc6a2-d3cb-4b30-8b71-fc51dee888b6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:58.761212 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3bc236d1-dc78-4d03-a59a-1b49d2d8d146 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:58.782525 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5463d148-3778-4d0b-9b7a-8e5abddf1a7a tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:58.804205 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-de897ffb-17f4-41ff-b627-62de24e61d16 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Deleting subnet 0443928b-d719-43d8-9ea7-e1f06c3fe17d {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:32:58.807659 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-270cfc38-d561-4234-bec2-9e938249ebd8 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Made reservation on behalf of 12e47d8445b5429892cd1b9244512ca8 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:32:58.808979 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-de897ffb-17f4-41ff-b627-62de24e61d16 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:58.837830 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:58.844465 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6095f267-7744-41ac-9c66-42292acc32f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:58.862664 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-de897ffb-17f4-41ff-b627-62de24e61d16 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:58.935715 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3bc236d1-dc78-4d03-a59a-1b49d2d8d146 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:58.961864 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-de897ffb-17f4-41ff-b627-62de24e61d16 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:59.040750 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device d2861372-0b19-4d5f-98f4-c8dcca66d64f up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:32:59.043799 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-25bf0b6b-5b57-46e8-8375-7e4fa7ccd7e8 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-f3f8d961-ce10-4756-a07a-6ea2265beb22', 'network_id': 'f3f8d961-ce10-4756-a07a-6ea2265beb22', 'tenant_id': '12e47d8445b5429892cd1b9244512ca8', 'fixed_ips': [{'subnet_id': '57a6fd15-e149-473d-85de-d7cbbf8fa903'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:32:59.044615 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-25bf0b6b-5b57-46e8-8375-7e4fa7ccd7e8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:59.045744 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-270cfc38-d561-4234-bec2-9e938249ebd8 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:59.049593 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bc236d1-dc78-4d03-a59a-1b49d2d8d146 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Pushing event updated for resources: {'SecurityGroup': ['ID=19806280-9b09-40ba-a21f-c6b96a478fa0,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:59.068242 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5463d148-3778-4d0b-9b7a-8e5abddf1a7a tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:59.084982 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bc871d1b-36c7-408c-9cac-d7d5f70f173e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:59.103150 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [None req-270cfc38-d561-4234-bec2-9e938249ebd8 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] device_id is not set on port 4a85b143-c5ea-43e5-99de-a9256f7a8642 yet. {{(pid=102162) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:32:59.111395 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3bc236d1-dc78-4d03-a59a-1b49d2d8d146 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:59.115662 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-3bc236d1-dc78-4d03-a59a-1b49d2d8d146 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 1.4295707 Nov 09 04:32:59.117674 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56600) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:59.122241 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5463d148-3778-4d0b-9b7a-8e5abddf1a7a tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event deleted for resources: {'Subnet': ['ID=775bb7b9-6a44-44d8-a29c-1b53db6d50e5,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:59.126316 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-d4424e78-eb73-4d72-abc0-0ad410e7a6d6 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Request body: {'security_group_rule': {'security_group_id': '19806280-9b09-40ba-a21f-c6b96a478fa0', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_ip_prefix': '192.168.1./24'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:59.144107 dv-neutron-816802-2-hyperv neutron-server[102162]: WARNING neutron.api.v2.base [None req-d4424e78-eb73-4d72-abc0-0ad410e7a6d6 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] An exception happened while processing the request body. The exception message is [Invalid CIDR 192.168.1./24 given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR 192.168.1./24 given as IP prefix. Nov 09 04:32:59.144286 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-de897ffb-17f4-41ff-b627-62de24e61d16 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:59.145119 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.api.v2.resource [None req-d4424e78-eb73-4d72-abc0-0ad410e7a6d6 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:32:59.149992 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-d4424e78-eb73-4d72-abc0-0ad410e7a6d6 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 319 time: 0.0300727 Nov 09 04:32:59.151215 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5463d148-3778-4d0b-9b7a-8e5abddf1a7a tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:59.157723 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-5463d148-3778-4d0b-9b7a-8e5abddf1a7a tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "DELETE /v2.0/subnets/775bb7b9-6a44-44d8-a29c-1b53db6d50e5 HTTP/1.1" status: 204 len: 168 time: 0.7401233 Nov 09 04:32:59.157893 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56602) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:59.164293 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-b7db801b-1cfc-48fa-98b8-9afe39fc6e94 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Request body: {'security_group_rule': {'security_group_id': '19806280-9b09-40ba-a21f-c6b96a478fa0', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_ip_prefix': '192.168.1.1/33'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:59.166413 dv-neutron-816802-2-hyperv neutron-server[102161]: WARNING neutron.api.v2.base [None req-b7db801b-1cfc-48fa-98b8-9afe39fc6e94 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] An exception happened while processing the request body. The exception message is [Invalid CIDR 192.168.1.1/33 given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR 192.168.1.1/33 given as IP prefix. Nov 09 04:32:59.166966 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-b7db801b-1cfc-48fa-98b8-9afe39fc6e94 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:32:59.167085 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64aab6a0-c0ad-4989-b50c-d76cd07e278b req-0ed9cde4-f060-4f56-a93f-ef79aa8ae99a tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:59.169632 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-b7db801b-1cfc-48fa-98b8-9afe39fc6e94 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 320 time: 0.0104361 Nov 09 04:32:59.171474 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-64aab6a0-c0ad-4989-b50c-d76cd07e278b req-0ed9cde4-f060-4f56-a93f-ef79aa8ae99a tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 945 time: 0.1730556 Nov 09 04:32:59.175912 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56604) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:59.176252 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56606) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:59.179793 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.db.api [None req-885dc6a2-d3cb-4b30-8b71-fc51dee888b6 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=102163) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:32:59.180148 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG oslo_db.api [None req-885dc6a2-d3cb-4b30-8b71-fc51dee888b6 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:32:59.185525 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc871d1b-36c7-408c-9cac-d7d5f70f173e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event updated for resources: {'Subnet': ['ID=abf2dc1a-091f-4460-a83f-5c4275733a2f,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:59.193824 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-7b92567b-eccc-4e91-a41c-336cb5519027 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Request body: {'security_group_rule': {'security_group_id': '19806280-9b09-40ba-a21f-c6b96a478fa0', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_ip_prefix': 'bad_prefix'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:59.195716 dv-neutron-816802-2-hyperv neutron-server[102161]: WARNING neutron.api.v2.base [None req-7b92567b-eccc-4e91-a41c-336cb5519027 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] An exception happened while processing the request body. The exception message is [Invalid CIDR bad_prefix given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR bad_prefix given as IP prefix. Nov 09 04:32:59.196216 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-7b92567b-eccc-4e91-a41c-336cb5519027 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:32:59.197196 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-7b92567b-eccc-4e91-a41c-336cb5519027 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 316 time: 0.0125704 Nov 09 04:32:59.202657 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56608) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:59.210916 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-2b4dd193-0c9b-4005-8843-5902edbadaa6 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Request body: {'security_group_rule': {'security_group_id': '19806280-9b09-40ba-a21f-c6b96a478fa0', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_ip_prefix': '256'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:32:59.212655 dv-neutron-816802-2-hyperv neutron-server[102162]: WARNING neutron.api.v2.base [None req-2b4dd193-0c9b-4005-8843-5902edbadaa6 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] An exception happened while processing the request body. The exception message is [Invalid CIDR 256 given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR 256 given as IP prefix. Nov 09 04:32:59.213213 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.api.v2.resource [None req-2b4dd193-0c9b-4005-8843-5902edbadaa6 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:32:59.214416 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-2b4dd193-0c9b-4005-8843-5902edbadaa6 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 309 time: 0.0102859 Nov 09 04:32:59.223762 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56610) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:59.233243 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bc871d1b-36c7-408c-9cac-d7d5f70f173e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Checking segment: {'id': '4adb05ec-46fe-428a-86b2-7b7107e35fdd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 334, 'network_id': '0bab5ed1-b8b1-45ba-b633-5bee32c71edd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:32:59.233608 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bc871d1b-36c7-408c-9cac-d7d5f70f173e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Network hostable DHCP agents. Network: 0bab5ed1-b8b1-45ba-b633-5bee32c71edd, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:32:59.238091 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-de897ffb-17f4-41ff-b627-62de24e61d16 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:59.239355 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=1849d4a8-7f58-4a68-ad8b-4b9fd74ebd07,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:59.244251 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-de897ffb-17f4-41ff-b627-62de24e61d16 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/0443928b-d719-43d8-9ea7-e1f06c3fe17d HTTP/1.1" status: 204 len: 168 time: 0.5415432 Nov 09 04:32:59.259243 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56612) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:59.269992 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-f26792d4-ffae-4a37-90b6-5aab1e034fc1 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] DELETE failed (client error): The resource could not be found. Nov 09 04:32:59.269992 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-f26792d4-ffae-4a37-90b6-5aab1e034fc1 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:32:59.269992 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-f26792d4-ffae-4a37-90b6-5aab1e034fc1 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "DELETE /v2.0/subnets/3479ab9e-17ee-493e-93ef-61596c974f8d HTTP/1.1" status: 404 len: 337 time: 0.0858772 Nov 09 04:32:59.272901 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de897ffb-17f4-41ff-b627-62de24e61d16 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event deleted for resources: {'Subnet': ['ID=0443928b-d719-43d8-9ea7-e1f06c3fe17d,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:32:59.274617 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56614) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:59.307851 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-01071f8a-7e63-4469-a2a4-39084f944aa8 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "GET /v2.0/ports?device_id=1daadb67-9ef3-44c1-8af1-f242e2c79aca HTTP/1.1" status: 200 len: 205 time: 0.0300126 Nov 09 04:32:59.309312 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56616) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:59.354607 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-fdc0ef17-489e-41a6-895c-efa0fb391422 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] delete failed (client error): The resource could not be found. Nov 09 04:32:59.358070 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-fdc0ef17-489e-41a6-895c-efa0fb391422 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "DELETE /v2.0/routers/1daadb67-9ef3-44c1-8af1-f242e2c79aca HTTP/1.1" status: 404 len: 336 time: 0.0453956 Nov 09 04:32:59.358878 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56618) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:59.393159 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-0c4db377-43cb-49ec-926a-ef48f4147e7b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] DELETE failed (client error): The resource could not be found. Nov 09 04:32:59.394233 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-0c4db377-43cb-49ec-926a-ef48f4147e7b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:32:59.401729 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-0c4db377-43cb-49ec-926a-ef48f4147e7b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "DELETE /v2.0/subnets/7e4bed86-250f-46a6-8bf4-3eef8c055b29 HTTP/1.1" status: 404 len: 337 time: 0.0400348 Nov 09 04:32:59.402029 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56620) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:59.418294 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-7e804e38-4dec-43d8-a449-42d572c0cedd tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Deleting subnet 4d70f328-6f2a-4019-a3c5-3a110db5d988 {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:32:59.430532 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server [None req-6095f267-7744-41ac-9c66-42292acc32f6 None None] Exception during message handling: neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 0443928b-d719-43d8-9ea7-e1f06c3fe17d: This subnet is being modified by another concurrent operation. Nov 09 04:32:59.430532 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 09 04:32:59.430532 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 09 04:32:59.430532 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 09 04:32:59.430532 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 09 04:32:59.430532 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 09 04:32:59.430532 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 09 04:32:59.430532 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 09 04:32:59.430532 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Nov 09 04:32:59.430532 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Nov 09 04:32:59.430532 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Nov 09 04:32:59.430532 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Nov 09 04:32:59.430532 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Nov 09 04:32:59.430532 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Nov 09 04:32:59.430532 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 09 04:32:59.430532 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 09 04:32:59.430532 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 09 04:32:59.430532 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server raise self.value Nov 09 04:32:59.430532 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Nov 09 04:32:59.430532 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 09 04:32:59.430532 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Nov 09 04:32:59.430532 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Nov 09 04:32:59.430532 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 09 04:32:59.430532 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 09 04:32:59.430532 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 09 04:32:59.430532 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server raise self.value Nov 09 04:32:59.430532 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Nov 09 04:32:59.430532 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 09 04:32:59.430532 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Nov 09 04:32:59.430532 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Nov 09 04:32:59.430532 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 09 04:32:59.430532 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 09 04:32:59.430532 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 09 04:32:59.430532 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server raise self.value Nov 09 04:32:59.430532 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Nov 09 04:32:59.430532 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Nov 09 04:32:59.430532 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 332, in update_dhcp_port Nov 09 04:32:59.430532 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server return self._port_action(plugin, context, port, 'update_port') Nov 09 04:32:59.430532 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 117, in _port_action Nov 09 04:32:59.430532 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server return plugin.update_port(context, port['id'], port) Nov 09 04:32:59.430532 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/common/utils.py", line 694, in inner Nov 09 04:32:59.430532 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 09 04:32:59.430532 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 218, in wrapped Nov 09 04:32:59.430532 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Nov 09 04:32:59.430532 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Nov 09 04:32:59.430532 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Nov 09 04:32:59.430532 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 09 04:32:59.430532 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 09 04:32:59.430532 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 09 04:32:59.430532 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server raise self.value Nov 09 04:32:59.430532 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Nov 09 04:32:59.430532 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 09 04:32:59.430532 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Nov 09 04:32:59.430532 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Nov 09 04:32:59.433832 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 09 04:32:59.433832 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 09 04:32:59.433832 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 09 04:32:59.433832 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server raise self.value Nov 09 04:32:59.433832 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Nov 09 04:32:59.433832 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 09 04:32:59.433832 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Nov 09 04:32:59.433832 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Nov 09 04:32:59.433832 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 09 04:32:59.433832 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 09 04:32:59.433832 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 09 04:32:59.433832 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server raise self.value Nov 09 04:32:59.433832 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Nov 09 04:32:59.433832 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Nov 09 04:32:59.433832 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1744, in update_port Nov 09 04:32:59.433832 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server updated_port = super(Ml2Plugin, self).update_port(context, id, Nov 09 04:32:59.433832 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 218, in wrapped Nov 09 04:32:59.433832 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Nov 09 04:32:59.433832 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/db_base_plugin_v2.py", line 1515, in update_port Nov 09 04:32:59.433832 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server self.ipam.update_port( Nov 09 04:32:59.433832 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 737, in update_port Nov 09 04:32:59.433832 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server changes = self.update_port_with_ips(context, Nov 09 04:32:59.433832 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 427, in update_port_with_ips Nov 09 04:32:59.433832 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server changes = self._update_ips_for_port(context, Nov 09 04:32:59.433832 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 351, in _update_ips_for_port Nov 09 04:32:59.433832 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server subnets = self._ipam_get_subnets( Nov 09 04:32:59.433832 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 694, in _ipam_get_subnets Nov 09 04:32:59.433832 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server subnet.lock_register( Nov 09 04:32:59.433832 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/models_v2.py", line 55, in lock_register Nov 09 04:32:59.433832 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server raise exception Nov 09 04:32:59.433832 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 0443928b-d719-43d8-9ea7-e1f06c3fe17d: This subnet is being modified by another concurrent operation. Nov 09 04:32:59.433832 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server Nov 09 04:32:59.442444 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-64aab6a0-c0ad-4989-b50c-d76cd07e278b req-0f40b6ca-17ad-4270-9fda-7632647b40de tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2269371 Nov 09 04:32:59.442623 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bc871d1b-36c7-408c-9cac-d7d5f70f173e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Network 0bab5ed1-b8b1-45ba-b633-5bee32c71edd is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:32:59.448478 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7e804e38-4dec-43d8-a449-42d572c0cedd tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:59.451886 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-d65e8cb0-bd2c-4bbb-a7e2-d136039a6e3f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] DELETE failed (client error): The resource could not be found. Nov 09 04:32:59.452856 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d65e8cb0-bd2c-4bbb-a7e2-d136039a6e3f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:32:59.456130 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-d65e8cb0-bd2c-4bbb-a7e2-d136039a6e3f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "DELETE /v2.0/subnets/41cf4118-3cde-44c5-8308-f2610de95450 HTTP/1.1" status: 404 len: 337 time: 0.0530622 Nov 09 04:32:59.459198 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56622) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:59.481742 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-25bf0b6b-5b57-46e8-8375-7e4fa7ccd7e8 None None] Allocated IP 2001:db8::2 (f3f8d961-ce10-4756-a07a-6ea2265beb22/57a6fd15-e149-473d-85de-d7cbbf8fa903/a0a06470-4c5f-4ee5-bd7e-e74cb33969da) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:32:59.500400 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-fb931961-ea11-4f2f-a6cd-419c906abd1d tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] DELETE failed (client error): The resource could not be found. Nov 09 04:32:59.501055 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-fb931961-ea11-4f2f-a6cd-419c906abd1d tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:32:59.501461 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port d2861372-0b19-4d5f-98f4-c8dcca66d64f triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:32:59.502649 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:59.503700 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-58146827-8461-413d-a3a7-5ddb24c470b3 None None] Update dhcp port {'port': {'network_id': 'cc397c48-c4cc-4846-a1ef-380b64be450d', 'fixed_ips': [{'subnet_id': '775bb7b9-6a44-44d8-a29c-1b53db6d50e5'}], 'binding:host_id': 'dv-neutron-816802-2-hyperv'}, 'id': '775e1b75-6b4e-4b53-8c8d-2c5aea990d99'} from dv-neutron-816802-2-hyperv. {{(pid=102163) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:328}} Nov 09 04:32:59.506417 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-fb931961-ea11-4f2f-a6cd-419c906abd1d tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "DELETE /v2.0/subnets/437c42c6-b7c7-44c0-b5de-f9e368fcfb4a HTTP/1.1" status: 404 len: 337 time: 0.0439970 Nov 09 04:32:59.506557 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7e804e38-4dec-43d8-a449-42d572c0cedd tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:59.507732 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56626) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:59.518975 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-bc871d1b-36c7-408c-9cac-d7d5f70f173e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 0bab5ed1-b8b1-45ba-b633-5bee32c71edd) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:32:59.523884 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bc871d1b-36c7-408c-9cac-d7d5f70f173e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:32:59.524477 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bc871d1b-36c7-408c-9cac-d7d5f70f173e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:59.537762 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-58146827-8461-413d-a3a7-5ddb24c470b3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:59.546778 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-9bf65708-3f9b-48ed-9d22-dac65e12de05 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] DELETE failed (client error): The resource could not be found. Nov 09 04:32:59.547499 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9bf65708-3f9b-48ed-9d22-dac65e12de05 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:32:59.553464 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-9bf65708-3f9b-48ed-9d22-dac65e12de05 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "DELETE /v2.0/ports/9e44f1ae-891b-4a24-90bf-230a42b37820 HTTP/1.1" status: 404 len: 333 time: 0.0422902 Nov 09 04:32:59.553864 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56628) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:59.583638 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-d318695e-96a7-4e14-8ccc-a3dd34be471b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] DELETE failed (client error): The resource could not be found. Nov 09 04:32:59.584099 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d318695e-96a7-4e14-8ccc-a3dd34be471b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:32:59.589694 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-d318695e-96a7-4e14-8ccc-a3dd34be471b tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "DELETE /v2.0/subnets/853593ba-982b-48a1-b01d-006ead90d6dd HTTP/1.1" status: 404 len: 337 time: 0.0315676 Nov 09 04:32:59.589999 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56630) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:59.598776 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7e804e38-4dec-43d8-a449-42d572c0cedd tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:59.624888 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-2df36ed7-539a-4ec7-a855-acadc563197c tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] DELETE failed (client error): The resource could not be found. Nov 09 04:32:59.625349 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2df36ed7-539a-4ec7-a855-acadc563197c tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:32:59.631063 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-2df36ed7-539a-4ec7-a855-acadc563197c tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "DELETE /v2.0/subnets/a38fa5e5-0ac0-4d69-8fb6-dcbb9f935dc1 HTTP/1.1" status: 404 len: 337 time: 0.0375099 Nov 09 04:32:59.632786 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56632) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:59.646917 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-bc871d1b-36c7-408c-9cac-d7d5f70f173e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.1325817 Nov 09 04:32:59.653949 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56634) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:59.654600 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-224d9c4e-2af2-448f-aafe-529fa38557ca tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:59.661471 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-60dbe4f7-27ca-4b34-bd07-f47b31366363 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] DELETE failed (client error): The resource could not be found. Nov 09 04:32:59.662160 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-60dbe4f7-27ca-4b34-bd07-f47b31366363 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:32:59.667112 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-60dbe4f7-27ca-4b34-bd07-f47b31366363 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "DELETE /v2.0/ports/153089ec-acc0-413b-ae5f-f0f91ab5ceca HTTP/1.1" status: 404 len: 333 time: 0.0325248 Nov 09 04:32:59.671143 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56636) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:59.675157 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-20104a3e-d219-4d60-a84e-fcb6353c864e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'name': 'tempest-RoutersTest-router-1490827103', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:32:29Z', 'updated_at': '2021-11-09T04:32:55Z', 'revision_number': 4, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'gw_port_host': None, '_interfaces': [{'id': '20195bcd-85f4-4bce-bae2-63cdf464f57f', 'name': '', 'network_id': '9e8670b3-5b0d-4ce5-8329-3af82c94231c', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:01:36:44', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 872, 'fixed_ips': [{'subnet_id': 'd7a7c5ae-922f-4fe2-ad19-b31fd352c9d1', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:52Z', 'updated_at': '2021-11-09T04:32:55Z', 'revision_number': 2, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'd7a7c5ae-922f-4fe2-ad19-b31fd352c9d1', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '98741773-362a-4c6e-b503-923f0f367a2a', 'name': '', 'network_id': 'e1b06497-74dd-47e6-9b9a-79074e9bf0e8', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:d2:bc:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 847, 'fixed_ips': [{'subnet_id': 'f0939bd8-617d-4f5c-9f7b-272de792edac', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:43Z', 'updated_at': '2021-11-09T04:32:51Z', 'revision_number': 5, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'f0939bd8-617d-4f5c-9f7b-272de792edac', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'bf77ddc4-4ed9-472d-842b-1fb79d55e2e4', 'name': '', 'network_id': '35e2f2d1-ee40-4328-9fe2-48e5a5c19938', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:66:29:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 830, 'fixed_ips': [{'subnet_id': 'f60d3eec-6988-47b0-9f2f-6319fa99064d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:33Z', 'updated_at': '2021-11-09T04:32:44Z', 'revision_number': 5, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'f60d3eec-6988-47b0-9f2f-6319fa99064d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:32:59.677079 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5f994218-036e-4a7f-a31b-56b9dc685259 None None] Network 0bab5ed1-b8b1-45ba-b633-5bee32c71edd requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:32:59.699719 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-2bdc0b45-c82c-4bbe-aa33-84755c82a126 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] DELETE failed (client error): The resource could not be found. Nov 09 04:32:59.707979 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2bdc0b45-c82c-4bbe-aa33-84755c82a126 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:32:59.707979 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-2bdc0b45-c82c-4bbe-aa33-84755c82a126 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "DELETE /v2.0/subnets/65e6912e-4232-4d7d-9de9-d0574b22fe1f HTTP/1.1" status: 404 len: 337 time: 0.0313072 Nov 09 04:32:59.713782 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56638) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:59.747945 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-9d9acd2e-5a1e-48c9-a98f-cb30af828a6f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] DELETE failed (client error): The resource could not be found. Nov 09 04:32:59.748629 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9d9acd2e-5a1e-48c9-a98f-cb30af828a6f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:32:59.752125 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-9d9acd2e-5a1e-48c9-a98f-cb30af828a6f tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "DELETE /v2.0/subnets/d07738e5-a445-49bf-89a9-f648661cbc55 HTTP/1.1" status: 404 len: 337 time: 0.0370400 Nov 09 04:32:59.757772 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56640) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:32:59.764737 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-20104a3e-d219-4d60-a84e-fcb6353c864e None None] Checking router: fa30d24d-d721-4675-ad7b-09f35105e633 for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:32:59.765400 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-20104a3e-d219-4d60-a84e-fcb6353c864e None None] Updating router fa30d24d-d721-4675-ad7b-09f35105e633 port 20195bcd-85f4-4bce-bae2-63cdf464f57f binding host dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 04:32:59.900072 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-144a8c2f-6729-46f5-9ae7-74f379ae0c22 None None] Network cc397c48-c4cc-4846-a1ef-380b64be450d requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:32:59.919975 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-b0c523f3-34cb-4df4-8340-1414c689daea tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Deleting port a4de75ae-2dab-4896-8d2a-cdfef3f44fab {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:32:59.920455 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b0c523f3-34cb-4df4-8340-1414c689daea tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:32:59.928047 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-20104a3e-d219-4d60-a84e-fcb6353c864e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:00.013840 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b0c523f3-34cb-4df4-8340-1414c689daea tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:00.027969 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-b0c523f3-34cb-4df4-8340-1414c689daea tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Calling delete_port for a4de75ae-2dab-4896-8d2a-cdfef3f44fab owned by {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:33:00.077841 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7e804e38-4dec-43d8-a449-42d572c0cedd tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:00.135265 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-224d9c4e-2af2-448f-aafe-529fa38557ca tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:00.153371 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e804e38-4dec-43d8-a449-42d572c0cedd tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event deleted for resources: {'Subnet': ['ID=4d70f328-6f2a-4019-a3c5-3a110db5d988,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:00.156595 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7e804e38-4dec-43d8-a449-42d572c0cedd tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:00.161501 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-7e804e38-4dec-43d8-a449-42d572c0cedd tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/4d70f328-6f2a-4019-a3c5-3a110db5d988 HTTP/1.1" status: 204 len: 168 time: 0.9008739 Nov 09 04:33:00.164723 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56642) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:00.207717 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1c5c0e3e-8d64-4923-9144-27ce5289a055 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0389080 Nov 09 04:33:00.207717 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b0c523f3-34cb-4df4-8340-1414c689daea tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:00.214221 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56644) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:00.223569 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-f4292323-4f36-450b-9723-dbc235a24ae2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'subnet': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:00.273477 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0279114e-a282-44b6-bba0-30bbb9ecbe29 None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:33:00.297949 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0c523f3-34cb-4df4-8340-1414c689daea tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event deleted for resources: {'Port': ['ID=a4de75ae-2dab-4896-8d2a-cdfef3f44fab,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:00.308918 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b0c523f3-34cb-4df4-8340-1414c689daea tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:00.312338 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-b0c523f3-34cb-4df4-8340-1414c689daea tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "DELETE /v2.0/ports/a4de75ae-2dab-4896-8d2a-cdfef3f44fab HTTP/1.1" status: 204 len: 168 time: 0.5535042 Nov 09 04:33:00.315191 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56646) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:00.349090 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-224d9c4e-2af2-448f-aafe-529fa38557ca tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:00.352172 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-224d9c4e-2af2-448f-aafe-529fa38557ca tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:00.356057 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-224d9c4e-2af2-448f-aafe-529fa38557ca tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "DELETE /v2.0/security-groups/19806280-9b09-40ba-a21f-c6b96a478fa0 HTTP/1.1" status: 204 len: 168 time: 1.1286118 Nov 09 04:33:00.357396 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56648) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:00.409304 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-fa82d1f7-af3a-4aed-83c1-f5293df3f091 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.0471127 Nov 09 04:33:00.410007 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56650) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:00.414143 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-e39291fe-982b-4856-9dc3-44fd55e96450 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Request body: {'security_group': {'name': 'tempest-secgroup--458200128'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:00.423079 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f4292323-4f36-450b-9723-dbc235a24ae2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:33:00.427034 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f4292323-4f36-450b-9723-dbc235a24ae2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:00.455443 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-224d9c4e-2af2-448f-aafe-529fa38557ca tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=19806280-9b09-40ba-a21f-c6b96a478fa0,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:00.487926 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-86b3b986-72fc-4dd3-a37f-5f6a8b3f5200 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:00.529376 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-ae634f14-0d9b-4697-87e2-43f845591751 None None] Provisioning complete for port 775e1b75-6b4e-4b53-8c8d-2c5aea990d99 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:00.529838 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ae634f14-0d9b-4697-87e2-43f845591751 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:00.535587 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e39291fe-982b-4856-9dc3-44fd55e96450 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:00.610583 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-25bf0b6b-5b57-46e8-8375-7e4fa7ccd7e8 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:00.619856 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-31211263-702d-4174-ab4b-559c2cb2bcbc tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:00.633928 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-86b3b986-72fc-4dd3-a37f-5f6a8b3f5200 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Deleting port 775e1b75-6b4e-4b53-8c8d-2c5aea990d99 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:33:00.634261 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-86b3b986-72fc-4dd3-a37f-5f6a8b3f5200 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:00.689374 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e39291fe-982b-4856-9dc3-44fd55e96450 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:00.747076 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e39291fe-982b-4856-9dc3-44fd55e96450 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:00.747697 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3e581b0d-66ea-493c-9383-62ef8d04172f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-0bab5ed1-b8b1-45ba-b633-5bee32c71edd', 'network_id': '0bab5ed1-b8b1-45ba-b633-5bee32c71edd', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'fixed_ips': [{'subnet_id': 'abf2dc1a-091f-4460-a83f-5c4275733a2f'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:33:00.748558 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3e581b0d-66ea-493c-9383-62ef8d04172f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:00.750973 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-25bf0b6b-5b57-46e8-8375-7e4fa7ccd7e8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:00.763015 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a6e97540-6364-4ba5-9368-c8b397772dc2 None None] DHCP port deletion for cc397c48-c4cc-4846-a1ef-380b64be450d request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:33:00.773010 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f4292323-4f36-450b-9723-dbc235a24ae2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:00.795174 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-86b3b986-72fc-4dd3-a37f-5f6a8b3f5200 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] For port 775e1b75-6b4e-4b53-8c8d-2c5aea990d99, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=775e1b75-6b4e-4b53-8c8d-2c5aea990d99,segment=NetworkSegment(5cb8d89b-c83c-4beb-ac61-4edae91bc9e8),segment_id=5cb8d89b-c83c-4beb-ac61-4edae91bc9e8)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:33:00.795536 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-86b3b986-72fc-4dd3-a37f-5f6a8b3f5200 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:00.823013 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e39291fe-982b-4856-9dc3-44fd55e96450 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Pushing event updated for resources: {'SecurityGroup': ['ID=5893f497-2547-4b4c-8aae-115951e0db0f,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:00.826048 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-86b3b986-72fc-4dd3-a37f-5f6a8b3f5200 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Calling delete_port for 775e1b75-6b4e-4b53-8c8d-2c5aea990d99 owned by network:dhcp {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:33:00.843788 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f4292323-4f36-450b-9723-dbc235a24ae2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:33:00.844923 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4292323-4f36-450b-9723-dbc235a24ae2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Subnet': ['ID=cb7a4f2f-e10f-465c-a22b-b22e65acbf38,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:00.847625 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-f4292323-4f36-450b-9723-dbc235a24ae2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:33:00.850386 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f4292323-4f36-450b-9723-dbc235a24ae2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:00.851080 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f4292323-4f36-450b-9723-dbc235a24ae2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:00.854765 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-270cfc38-d561-4234-bec2-9e938249ebd8 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Allocated IP 2001:db8::10 (f3f8d961-ce10-4756-a07a-6ea2265beb22/57a6fd15-e149-473d-85de-d7cbbf8fa903/4a85b143-c5ea-43e5-99de-a9256f7a8642) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:33:00.870092 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-25bf0b6b-5b57-46e8-8375-7e4fa7ccd7e8 None None] Network f3f8d961-ce10-4756-a07a-6ea2265beb22 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:33:00.871952 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e39291fe-982b-4856-9dc3-44fd55e96450 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:00.877376 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-e39291fe-982b-4856-9dc3-44fd55e96450 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1760 time: 0.4665003 Nov 09 04:33:00.878048 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56652) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:00.884339 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-f8eb2557-bee7-4454-b0df-cc1966b495a0 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Request body: {'security_group_rule': {'security_group_id': '5893f497-2547-4b4c-8aae-115951e0db0f', 'protocol': 'tcp', 'port_range_min': -16, 'port_range_max': 80, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:00.885110 dv-neutron-816802-2-hyperv neutron-server[102161]: WARNING neutron.api.v2.base [None req-f8eb2557-bee7-4454-b0df-cc1966b495a0 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] An exception happened while processing the request body. The exception message is [Invalid value for port -16].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port -16 Nov 09 04:33:00.886401 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-f8eb2557-bee7-4454-b0df-cc1966b495a0 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:33:00.890577 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-f8eb2557-bee7-4454-b0df-cc1966b495a0 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 317 time: 0.0114868 Nov 09 04:33:00.891209 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56654) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:00.895999 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-d3a3026c-494d-46c5-a5be-df5505bfe25f tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Request body: {'security_group_rule': {'security_group_id': '5893f497-2547-4b4c-8aae-115951e0db0f', 'protocol': 'tcp', 'port_range_min': 80, 'port_range_max': 79, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:00.909249 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-25bf0b6b-5b57-46e8-8375-7e4fa7ccd7e8 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:33:00.912317 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-25bf0b6b-5b57-46e8-8375-7e4fa7ccd7e8 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:33:00.966174 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25bf0b6b-5b57-46e8-8375-7e4fa7ccd7e8 None None] Pushing event updated for resources: {'Port': ['ID=a0a06470-4c5f-4ee5-bd7e-e74cb33969da,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:00.988826 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-f4292323-4f36-450b-9723-dbc235a24ae2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.7694430 Nov 09 04:33:00.996511 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56656) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:01.002218 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-80d47097-78b2-4ce4-ad0e-2d6799dadba2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'subnet': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:01.008628 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 775e1b75-6b4e-4b53-8c8d-2c5aea990d99 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:33:01.010453 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a638336f-d11a-46fa-8f2b-36a15c6241d0 None None] DHCP port deletion for 988d2354-693c-4d52-af17-25e0643eaa0c request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:33:01.162614 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-d3a3026c-494d-46c5-a5be-df5505bfe25f tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:33:01.167413 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-d3a3026c-494d-46c5-a5be-df5505bfe25f tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 354 time: 0.2751427 Nov 09 04:33:01.167982 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56658) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:01.174685 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-e07d3c21-d82e-4792-9b94-d6547d305c22 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Request body: {'security_group_rule': {'security_group_id': '5893f497-2547-4b4c-8aae-115951e0db0f', 'protocol': 'tcp', 'port_range_min': 80, 'port_range_max': 65536, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:01.175398 dv-neutron-816802-2-hyperv neutron-server[102161]: WARNING neutron.api.v2.base [None req-e07d3c21-d82e-4792-9b94-d6547d305c22 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] An exception happened while processing the request body. The exception message is [Invalid value for port 65536].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port 65536 Nov 09 04:33:01.176513 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-e07d3c21-d82e-4792-9b94-d6547d305c22 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:33:01.180708 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56660) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:01.181253 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-e07d3c21-d82e-4792-9b94-d6547d305c22 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 319 time: 0.0094414 Nov 09 04:33:01.181360 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-25bf0b6b-5b57-46e8-8375-7e4fa7ccd7e8 None None] Attempting to bind port a0a06470-4c5f-4ee5-bd7e-e74cb33969da on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:33:01.181840 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-25bf0b6b-5b57-46e8-8375-7e4fa7ccd7e8 None None] Attempting to bind port a0a06470-4c5f-4ee5-bd7e-e74cb33969da by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '48c90ef7-c819-495a-b369-c2ba95c6d696', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 305, 'network_id': 'f3f8d961-ce10-4756-a07a-6ea2265beb22'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:33:01.181974 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-25bf0b6b-5b57-46e8-8375-7e4fa7ccd7e8 None None] Attempting to bind port a0a06470-4c5f-4ee5-bd7e-e74cb33969da on network f3f8d961-ce10-4756-a07a-6ea2265beb22 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:33:01.189054 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-1ea41023-18c5-42d1-a52b-9041a2ade3ce tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Request body: {'security_group_rule': {'security_group_id': '5893f497-2547-4b4c-8aae-115951e0db0f', 'protocol': 'tcp', 'port_range_min': None, 'port_range_max': 6, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:01.201585 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-25bf0b6b-5b57-46e8-8375-7e4fa7ccd7e8 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 32, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:33:01.201960 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-25bf0b6b-5b57-46e8-8375-7e4fa7ccd7e8 None None] Checking segment: {'id': '48c90ef7-c819-495a-b369-c2ba95c6d696', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 305, 'network_id': 'f3f8d961-ce10-4756-a07a-6ea2265beb22'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:33:01.202395 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-25bf0b6b-5b57-46e8-8375-7e4fa7ccd7e8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:01.202776 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-25bf0b6b-5b57-46e8-8375-7e4fa7ccd7e8 None None] Bound using segment: {'id': '48c90ef7-c819-495a-b369-c2ba95c6d696', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 305, 'network_id': 'f3f8d961-ce10-4756-a07a-6ea2265beb22'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:33:01.203250 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-25bf0b6b-5b57-46e8-8375-7e4fa7ccd7e8 None None] Bound port: a0a06470-4c5f-4ee5-bd7e-e74cb33969da, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '48c90ef7-c819-495a-b369-c2ba95c6d696', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 305, 'network_id': 'f3f8d961-ce10-4756-a07a-6ea2265beb22'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:33:01.203470 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-31211263-702d-4174-ab4b-559c2cb2bcbc tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Allocated IP 172.23.0.1 (0bab5ed1-b8b1-45ba-b633-5bee32c71edd/abf2dc1a-091f-4460-a83f-5c4275733a2f/3bdf32a7-774a-4983-98a1-9b8a12c4fd05) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:33:01.203687 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-25bf0b6b-5b57-46e8-8375-7e4fa7ccd7e8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:01.205442 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-ae634f14-0d9b-4697-87e2-43f845591751 None None] Provisioning complete for port 20195bcd-85f4-4bce-bae2-63cdf464f57f triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:01.205841 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ae634f14-0d9b-4697-87e2-43f845591751 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:01.214038 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-a6e97540-6364-4ba5-9368-c8b397772dc2 None None] Deleting port 775e1b75-6b4e-4b53-8c8d-2c5aea990d99 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:33:01.214502 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a6e97540-6364-4ba5-9368-c8b397772dc2 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:01.236282 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-86b3b986-72fc-4dd3-a37f-5f6a8b3f5200 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:01.268513 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-270cfc38-d561-4234-bec2-9e938249ebd8 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:01.275309 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No ports have port_id starting with 775e1b75-6b4e-4b53-8c8d-2c5aea990d99 Nov 09 04:33:01.278870 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-20104a3e-d219-4d60-a84e-fcb6353c864e None None] Publish callbacks [] for port, precommit_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:01.284207 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-80d47097-78b2-4ce4-ad0e-2d6799dadba2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:33:01.287458 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 1849d4a8-7f58-4a68-ad8b-4b9fd74ebd07 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:33:01.287956 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-80d47097-78b2-4ce4-ad0e-2d6799dadba2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:01.299953 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86b3b986-72fc-4dd3-a37f-5f6a8b3f5200 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event deleted for resources: {'Port': ['ID=775e1b75-6b4e-4b53-8c8d-2c5aea990d99,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:01.301835 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-86b3b986-72fc-4dd3-a37f-5f6a8b3f5200 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] No DVR routers for this DVR port 775e1b75-6b4e-4b53-8c8d-2c5aea990d99 on host dv-neutron-816802-2-hyperv {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:33:01.386553 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-20104a3e-d219-4d60-a84e-fcb6353c864e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:01.436289 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-ae634f14-0d9b-4697-87e2-43f845591751 None None] Port 20195bcd-85f4-4bce-bae2-63cdf464f57f cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:33:01.450475 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-a6e97540-6364-4ba5-9368-c8b397772dc2 None None] For port 775e1b75-6b4e-4b53-8c8d-2c5aea990d99, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=775e1b75-6b4e-4b53-8c8d-2c5aea990d99,segment=NetworkSegment(5cb8d89b-c83c-4beb-ac61-4edae91bc9e8),segment_id=5cb8d89b-c83c-4beb-ac61-4edae91bc9e8)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:33:01.450879 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a6e97540-6364-4ba5-9368-c8b397772dc2 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:01.458081 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-a638336f-d11a-46fa-8f2b-36a15c6241d0 None None] Deleting port 1849d4a8-7f58-4a68-ad8b-4b9fd74ebd07 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:33:01.458475 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a638336f-d11a-46fa-8f2b-36a15c6241d0 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:01.465322 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-86b3b986-72fc-4dd3-a37f-5f6a8b3f5200 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:01.477341 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-ae634f14-0d9b-4697-87e2-43f845591751 None None] Could not find standard attr ID for object 72a65b9f-24dc-4ee2-a165-b8c907953cbf. {{(pid=102163) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 09 04:33:01.479269 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-25bf0b6b-5b57-46e8-8375-7e4fa7ccd7e8 None None] For port a0a06470-4c5f-4ee5-bd7e-e74cb33969da, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:33:01.490497 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-31211263-702d-4174-ab4b-559c2cb2bcbc tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:01.500618 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-86b3b986-72fc-4dd3-a37f-5f6a8b3f5200 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['cc397c48-c4cc-4846-a1ef-380b64be450d']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:01.506403 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-a6e97540-6364-4ba5-9368-c8b397772dc2 None None] Calling delete_port for 775e1b75-6b4e-4b53-8c8d-2c5aea990d99 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:33:01.516600 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-86b3b986-72fc-4dd3-a37f-5f6a8b3f5200 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5cb8d89b-c83c-4beb-ac61-4edae91bc9e8') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:01.519640 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-86b3b986-72fc-4dd3-a37f-5f6a8b3f5200 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5cb8d89b-c83c-4beb-ac61-4edae91bc9e8') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:01.535974 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-86b3b986-72fc-4dd3-a37f-5f6a8b3f5200 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:01.536405 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-25bf0b6b-5b57-46e8-8375-7e4fa7ccd7e8 None None] For port a0a06470-4c5f-4ee5-bd7e-e74cb33969da, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=a0a06470-4c5f-4ee5-bd7e-e74cb33969da,segment=NetworkSegment(48c90ef7-c819-495a-b369-c2ba95c6d696),segment_id=48c90ef7-c819-495a-b369-c2ba95c6d696)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:33:01.549308 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-ae634f14-0d9b-4697-87e2-43f845591751 None None] Could not find standard attr ID for object a4de75ae-2dab-4896-8d2a-cdfef3f44fab. {{(pid=102163) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 09 04:33:01.562543 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-270cfc38-d561-4234-bec2-9e938249ebd8 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:01.581096 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-86b3b986-72fc-4dd3-a37f-5f6a8b3f5200 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:01.593579 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f3ecff1-ce1a-47dc-9c01-880b3507268c None None] Pushing event updated for resources: {'Port': ['ID=20195bcd-85f4-4bce-bae2-63cdf464f57f,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:01.615237 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-86b3b986-72fc-4dd3-a37f-5f6a8b3f5200 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Releasing vlan 315 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:33:01.615644 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-86b3b986-72fc-4dd3-a37f-5f6a8b3f5200 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:01.620504 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:33:01.620504 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:33:01.620504 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:33:01.620504 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:33:01.620504 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:33:01.620504 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:33:01.620504 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:33:01.620504 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:33:01.620504 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:33:01.620504 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:33:01.620504 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:33:01.620504 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:33:01.620504 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:33:01.620504 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:33:01.620504 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:33:01.620504 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:33:01.620504 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:33:01.620504 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:33:01.620504 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:33:01.620504 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:33:01.620504 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:33:01.620504 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:33:01.620504 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:33:01.620504 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:33:01.620504 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:33:01.620504 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:33:01.620504 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:33:01.620504 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:33:01.620504 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:33:01.620504 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:33:01.620504 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:33:01.620504 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:33:01.647491 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-25bf0b6b-5b57-46e8-8375-7e4fa7ccd7e8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:01.681640 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.api.v2.resource [None req-1ea41023-18c5-42d1-a52b-9041a2ade3ce tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:33:01.681640 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-1ea41023-18c5-42d1-a52b-9041a2ade3ce tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 354 time: 0.4955106 Nov 09 04:33:01.681640 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-270cfc38-d561-4234-bec2-9e938249ebd8 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Network f3f8d961-ce10-4756-a07a-6ea2265beb22 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:33:01.687569 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56662) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:01.688640 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-31211263-702d-4174-ab4b-559c2cb2bcbc tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:01.714846 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-56636f31-988d-4227-9bb6-875ce7251a99 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Request body: {'security_group_rule': {'security_group_id': '5893f497-2547-4b4c-8aae-115951e0db0f', 'protocol': 'tcp', 'port_range_min': -16, 'port_range_max': 65536, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:01.715635 dv-neutron-816802-2-hyperv neutron-server[102162]: WARNING neutron.api.v2.base [None req-56636f31-988d-4227-9bb6-875ce7251a99 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] An exception happened while processing the request body. The exception message is [Invalid value for port -16].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port -16 Nov 09 04:33:01.716144 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.api.v2.resource [None req-56636f31-988d-4227-9bb6-875ce7251a99 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:33:01.720256 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-56636f31-988d-4227-9bb6-875ce7251a99 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 317 time: 0.0269346 Nov 09 04:33:01.720256 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-270cfc38-d561-4234-bec2-9e938249ebd8 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:33:01.739527 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.objects.ports [None req-80d47097-78b2-4ce4-ad0e-2d6799dadba2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=102161) get_objects /opt/stack/neutron/neutron/objects/ports.py:444}} Nov 09 04:33:01.741340 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56664) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:01.750493 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-dd211f33-a6d6-4654-b259-d5d0ee4e6695 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Request body: {'security_group_rule': {'security_group_id': '5893f497-2547-4b4c-8aae-115951e0db0f', 'protocol': 'icmp', 'port_range_min': 1, 'port_range_max': 256, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:01.752776 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-31211263-702d-4174-ab4b-559c2cb2bcbc tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Network 0bab5ed1-b8b1-45ba-b633-5bee32c71edd is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:33:01.754715 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-270cfc38-d561-4234-bec2-9e938249ebd8 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event updated for resources: {'Port': ['ID=4a85b143-c5ea-43e5-99de-a9256f7a8642,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:01.754856 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-20104a3e-d219-4d60-a84e-fcb6353c864e None None] Attempting to bind port 20195bcd-85f4-4bce-bae2-63cdf464f57f on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:33:01.755308 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-20104a3e-d219-4d60-a84e-fcb6353c864e None None] Attempting to bind port 20195bcd-85f4-4bce-bae2-63cdf464f57f by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '696f4512-dd80-4379-a21b-b923df29bba5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 344, 'network_id': '9e8670b3-5b0d-4ce5-8329-3af82c94231c'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:33:01.755748 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-20104a3e-d219-4d60-a84e-fcb6353c864e None None] Attempting to bind port 20195bcd-85f4-4bce-bae2-63cdf464f57f on network 9e8670b3-5b0d-4ce5-8329-3af82c94231c {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:33:01.770614 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-270cfc38-d561-4234-bec2-9e938249ebd8 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:33:01.779391 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-270cfc38-d561-4234-bec2-9e938249ebd8 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:01.779958 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-270cfc38-d561-4234-bec2-9e938249ebd8 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:01.787254 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-31211263-702d-4174-ab4b-559c2cb2bcbc tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:33:01.791293 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-20104a3e-d219-4d60-a84e-fcb6353c864e None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 32, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:33:01.791667 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-20104a3e-d219-4d60-a84e-fcb6353c864e None None] Checking segment: {'id': '696f4512-dd80-4379-a21b-b923df29bba5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 344, 'network_id': '9e8670b3-5b0d-4ce5-8329-3af82c94231c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:33:01.792479 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-20104a3e-d219-4d60-a84e-fcb6353c864e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:01.792939 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-20104a3e-d219-4d60-a84e-fcb6353c864e None None] Bound using segment: {'id': '696f4512-dd80-4379-a21b-b923df29bba5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 344, 'network_id': '9e8670b3-5b0d-4ce5-8329-3af82c94231c'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:33:01.793427 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-20104a3e-d219-4d60-a84e-fcb6353c864e None None] Bound port: 20195bcd-85f4-4bce-bae2-63cdf464f57f, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '696f4512-dd80-4379-a21b-b923df29bba5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 344, 'network_id': '9e8670b3-5b0d-4ce5-8329-3af82c94231c'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:33:01.793807 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-20104a3e-d219-4d60-a84e-fcb6353c864e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:01.795835 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-ae634f14-0d9b-4697-87e2-43f845591751 None None] Provisioning complete for port 1849d4a8-7f58-4a68-ad8b-4b9fd74ebd07 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:01.796188 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-31211263-702d-4174-ab4b-559c2cb2bcbc tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:33:01.796302 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ae634f14-0d9b-4697-87e2-43f845591751 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:01.911478 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31211263-702d-4174-ab4b-559c2cb2bcbc tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event updated for resources: {'Port': ['ID=3bdf32a7-774a-4983-98a1-9b8a12c4fd05,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:01.917678 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-31211263-702d-4174-ab4b-559c2cb2bcbc tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:01.924804 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.securitygroups_db [None req-dd211f33-a6d6-4654-b259-d5d0ee4e6695 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Project 7ab8c5da87614044ba13ccf0c18cd124 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 09 04:33:01.965471 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-86b3b986-72fc-4dd3-a37f-5f6a8b3f5200 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:01.983351 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-86b3b986-72fc-4dd3-a37f-5f6a8b3f5200 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:01.987375 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-86b3b986-72fc-4dd3-a37f-5f6a8b3f5200 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] 10.222.0.24 "DELETE /v2.0/networks/cc397c48-c4cc-4846-a1ef-380b64be450d HTTP/1.1" status: 204 len: 168 time: 1.6704831 Nov 09 04:33:02.014994 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86b3b986-72fc-4dd3-a37f-5f6a8b3f5200 tempest-PortsTestJSON-548164815 tempest-PortsTestJSON-548164815-project] Pushing event deleted for resources: {'Network': ['ID=cc397c48-c4cc-4846-a1ef-380b64be450d,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:02.104113 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:02.155719 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-a638336f-d11a-46fa-8f2b-36a15c6241d0 None None] For port 1849d4a8-7f58-4a68-ad8b-4b9fd74ebd07, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=1849d4a8-7f58-4a68-ad8b-4b9fd74ebd07,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:33:02.156181 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a638336f-d11a-46fa-8f2b-36a15c6241d0 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:02.169819 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-3e581b0d-66ea-493c-9383-62ef8d04172f None None] Allocated IP 172.23.0.2 (0bab5ed1-b8b1-45ba-b633-5bee32c71edd/abf2dc1a-091f-4460-a83f-5c4275733a2f/3653fdce-278e-4d4b-b712-fb2641dbb781) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:33:02.197923 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25bf0b6b-5b57-46e8-8375-7e4fa7ccd7e8 None None] Pushing event updated for resources: {'Port': ['ID=a0a06470-4c5f-4ee5-bd7e-e74cb33969da,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:02.226281 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-a638336f-d11a-46fa-8f2b-36a15c6241d0 None None] Calling delete_port for 1849d4a8-7f58-4a68-ad8b-4b9fd74ebd07 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:33:02.238555 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-80d47097-78b2-4ce4-ad0e-2d6799dadba2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:02.271789 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a6e97540-6364-4ba5-9368-c8b397772dc2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:02.280000 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-dd211f33-a6d6-4654-b259-d5d0ee4e6695 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:33:02.282907 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-dd211f33-a6d6-4654-b259-d5d0ee4e6695 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 361 time: 0.5360756 Nov 09 04:33:02.284170 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-270cfc38-d561-4234-bec2-9e938249ebd8 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 930 time: 4.0724869 Nov 09 04:33:02.290095 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56668) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:02.294699 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56670) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:02.298253 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-4a95e8e8-2395-4ea6-9dc4-4f1cb4e2efc2 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Request body: {'security_group_rule': {'security_group_id': '5893f497-2547-4b4c-8aae-115951e0db0f', 'protocol': 'icmp', 'port_range_min': -1, 'port_range_max': 25, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:02.298766 dv-neutron-816802-2-hyperv neutron-server[102162]: WARNING neutron.api.v2.base [None req-4a95e8e8-2395-4ea6-9dc4-4f1cb4e2efc2 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] An exception happened while processing the request body. The exception message is [Invalid value for port -1].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port -1 Nov 09 04:33:02.299275 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.api.v2.resource [None req-4a95e8e8-2395-4ea6-9dc4-4f1cb4e2efc2 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:33:02.301947 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-e9608c3c-2b03-429d-b321-5f5b8de1e69b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Request body: {'port': {'network_id': 'f3f8d961-ce10-4756-a07a-6ea2265beb22', 'name': 'tempest-PortsIpV6TestJSON-1420761176', 'fixed_ips': [{'subnet_id': '57a6fd15-e149-473d-85de-d7cbbf8fa903', 'ip_address': '2001:db8::f'}]}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:02.308627 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-4a95e8e8-2395-4ea6-9dc4-4f1cb4e2efc2 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 316 time: 0.0120091 Nov 09 04:33:02.311793 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56672) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:02.336434 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-31211263-702d-4174-ab4b-559c2cb2bcbc tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:02.351497 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-bf65bcd9-bb31-4200-a7db-9bc9e13b73ab tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Request body: {'security_group_rule': {'security_group_id': '5893f497-2547-4b4c-8aae-115951e0db0f', 'protocol': 'icmp', 'port_range_min': None, 'port_range_max': 6, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:02.389067 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-a6e97540-6364-4ba5-9368-c8b397772dc2 None None] Network cc397c48-c4cc-4846-a1ef-380b64be450d is not hosted by any dhcp agent {{(pid=102163) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Nov 09 04:33:02.389442 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a6e97540-6364-4ba5-9368-c8b397772dc2 None None] No DVR routers for this DVR port 775e1b75-6b4e-4b53-8c8d-2c5aea990d99 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:33:02.402810 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-20104a3e-d219-4d60-a84e-fcb6353c864e None None] For port 20195bcd-85f4-4bce-bae2-63cdf464f57f, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:33:02.406395 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6e97540-6364-4ba5-9368-c8b397772dc2 None None] Pushing event deleted for resources: {'Port': ['ID=775e1b75-6b4e-4b53-8c8d-2c5aea990d99,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:02.482734 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.db.api [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=102163) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:33:02.483094 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG oslo_db.api [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:33:02.485046 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-20104a3e-d219-4d60-a84e-fcb6353c864e None None] For port 20195bcd-85f4-4bce-bae2-63cdf464f57f, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=20195bcd-85f4-4bce-bae2-63cdf464f57f,segment=NetworkSegment(696f4512-dd80-4379-a21b-b923df29bba5),segment_id=696f4512-dd80-4379-a21b-b923df29bba5)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:33:02.508138 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-ae634f14-0d9b-4697-87e2-43f845591751 None None] Could not find standard attr ID for object 996d0c64-fb2e-4dd3-84a6-1d4ca6cc05c9. {{(pid=102163) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 09 04:33:02.568970 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-20104a3e-d219-4d60-a84e-fcb6353c864e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:02.647006 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a638336f-d11a-46fa-8f2b-36a15c6241d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:02.685996 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a638336f-d11a-46fa-8f2b-36a15c6241d0 None None] No DVR routers for this DVR port 1849d4a8-7f58-4a68-ad8b-4b9fd74ebd07 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:33:02.720193 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-31211263-702d-4174-ab4b-559c2cb2bcbc tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:02.731935 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f3ecff1-ce1a-47dc-9c01-880b3507268c None None] Pushing event updated for resources: {'Port': ['ID=20195bcd-85f4-4bce-bae2-63cdf464f57f,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:02.746837 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56678) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:02.767404 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3e581b0d-66ea-493c-9383-62ef8d04172f None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:02.771628 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-18c45c1b-3967-4bc1-a28d-f9b0df446256 None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:33:02.796331 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-31211263-702d-4174-ab4b-559c2cb2bcbc tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:02.819154 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-4d930358-b8e2-4345-84eb-e63ef14693a9 None None] Provisioning complete for port 20195bcd-85f4-4bce-bae2-63cdf464f57f triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:02.819154 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4d930358-b8e2-4345-84eb-e63ef14693a9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:02.833210 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-20104a3e-d219-4d60-a84e-fcb6353c864e None None] Routers {'fa30d24d-d721-4675-ad7b-09f35105e633'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:33:02.833873 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-20104a3e-d219-4d60-a84e-fcb6353c864e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:32:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['fa30d24d-d721-4675-ad7b-09f35105e633'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:02.882042 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a638336f-d11a-46fa-8f2b-36a15c6241d0 None None] Pushing event deleted for resources: {'Port': ['ID=1849d4a8-7f58-4a68-ad8b-4b9fd74ebd07,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:02.954428 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3e581b0d-66ea-493c-9383-62ef8d04172f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:02.985023 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31211263-702d-4174-ab4b-559c2cb2bcbc tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event updated for resources: {'Port': ['ID=3bdf32a7-774a-4983-98a1-9b8a12c4fd05,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:02.993318 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-31211263-702d-4174-ab4b-559c2cb2bcbc tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:03.043303 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.securitygroups_db [None req-bf65bcd9-bb31-4200-a7db-9bc9e13b73ab tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Project 7ab8c5da87614044ba13ccf0c18cd124 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 09 04:33:03.065168 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-46eb2b94-7c4d-4010-b555-f2ac005c7856 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=88f9f8da29bf4a8793b45130d483a6e6&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3169127 Nov 09 04:33:03.069037 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56682) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:03.136426 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e581b0d-66ea-493c-9383-62ef8d04172f None None] Pushing event updated for resources: {'Port': ['ID=3653fdce-278e-4d4b-b712-fb2641dbb781,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:03.167384 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-80d47097-78b2-4ce4-ad0e-2d6799dadba2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] For port 1849d4a8-7f58-4a68-ad8b-4b9fd74ebd07, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=1849d4a8-7f58-4a68-ad8b-4b9fd74ebd07,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:33:03.170985 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Port 1849d4a8-7f58-4a68-ad8b-4b9fd74ebd07 update to DOWN by agent not found {{(pid=102163) update_port_statuses /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2167}} Nov 09 04:33:03.186459 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-31211263-702d-4174-ab4b-559c2cb2bcbc tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Network 0bab5ed1-b8b1-45ba-b633-5bee32c71edd is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:33:03.187666 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-193b8c0d-680e-47df-a87a-455f35208555 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:03.191284 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-31211263-702d-4174-ab4b-559c2cb2bcbc tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:33:03.199332 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e9608c3c-2b03-429d-b321-5f5b8de1e69b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Made reservation on behalf of 12e47d8445b5429892cd1b9244512ca8 for: {'port': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:33:03.209780 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-20104a3e-d219-4d60-a84e-fcb6353c864e None None] Set router fa30d24d-d721-4675-ad7b-09f35105e633 gateway port host: None {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:33:03.275416 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3e581b0d-66ea-493c-9383-62ef8d04172f None None] Network 0bab5ed1-b8b1-45ba-b633-5bee32c71edd is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:33:03.279714 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-193b8c0d-680e-47df-a87a-455f35208555 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:03.289271 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-3e581b0d-66ea-493c-9383-62ef8d04172f None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:33:03.292300 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3e581b0d-66ea-493c-9383-62ef8d04172f None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:33:03.300772 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-bf65bcd9-bb31-4200-a7db-9bc9e13b73ab tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:33:03.301891 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-bf65bcd9-bb31-4200-a7db-9bc9e13b73ab tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 373 time: 0.9863842 Nov 09 04:33:03.306874 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56684) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:03.315403 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-f87eeecb-7c68-41f0-bec2-9a6b07d00cca tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Request body: {'security_group_rule': {'security_group_id': '5893f497-2547-4b4c-8aae-115951e0db0f', 'protocol': 'icmp', 'port_range_min': 300, 'port_range_max': 1, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:03.345426 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-568d6a6b-e124-44be-a31a-76f54ad361cc None None] Network f3f8d961-ce10-4756-a07a-6ea2265beb22 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:33:03.354887 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-80d47097-78b2-4ce4-ad0e-2d6799dadba2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:03.367841 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device a0a06470-4c5f-4ee5-bd7e-e74cb33969da up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:33:03.383445 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e9608c3c-2b03-429d-b321-5f5b8de1e69b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:03.386522 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-31211263-702d-4174-ab4b-559c2cb2bcbc tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Router fa30d24d-d721-4675-ad7b-09f35105e633 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:33:03.405996 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [None req-e9608c3c-2b03-429d-b321-5f5b8de1e69b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] device_id is not set on port 18baa777-17d6-468a-8ca9-4720faae2a79 yet. {{(pid=102161) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:33:03.450830 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-80d47097-78b2-4ce4-ad0e-2d6799dadba2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:03.451838 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-80d47097-78b2-4ce4-ad0e-2d6799dadba2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:03.489893 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-193b8c0d-680e-47df-a87a-455f35208555 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:03.492753 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-193b8c0d-680e-47df-a87a-455f35208555 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:03.496293 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-193b8c0d-680e-47df-a87a-455f35208555 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/93a8d386-4318-4da6-951d-9b8ee3c4f24a HTTP/1.1" status: 204 len: 168 time: 0.4237194 Nov 09 04:33:03.496293 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-31211263-702d-4174-ab4b-559c2cb2bcbc tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:33:03.506218 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-31211263-702d-4174-ab4b-559c2cb2bcbc tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "PUT /v2.0/routers/fa30d24d-d721-4675-ad7b-09f35105e633/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.8496096 Nov 09 04:33:03.511245 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56688) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:03.516095 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-28b94aa3-9339-4a31-9c77-656d73d5e949 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Request body: {'router': {'routes': [{'nexthop': '172.20.0.2', 'destination': '172.20.0.0/28'}, {'nexthop': '172.21.0.2', 'destination': '172.21.0.0/28'}, {'nexthop': '172.22.0.2', 'destination': '172.22.0.0/28'}, {'nexthop': '172.23.0.2', 'destination': '172.23.0.0/28'}]}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:03.518772 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-193b8c0d-680e-47df-a87a-455f35208555 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=93a8d386-4318-4da6-951d-9b8ee3c4f24a,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:03.553487 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.securitygroups_db [None req-f87eeecb-7c68-41f0-bec2-9a6b07d00cca tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Project 7ab8c5da87614044ba13ccf0c18cd124 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 09 04:33:03.560327 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80d47097-78b2-4ce4-ad0e-2d6799dadba2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event deleted for resources: {'Port': ['ID=1849d4a8-7f58-4a68-ad8b-4b9fd74ebd07,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:03.571102 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80d47097-78b2-4ce4-ad0e-2d6799dadba2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Subnet': ['ID=f6183641-d788-4054-bf47-99f434449c17,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:03.588165 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-80d47097-78b2-4ce4-ad0e-2d6799dadba2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:33:03.594987 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-80d47097-78b2-4ce4-ad0e-2d6799dadba2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:33:03.602193 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-80d47097-78b2-4ce4-ad0e-2d6799dadba2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:03.602818 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-80d47097-78b2-4ce4-ad0e-2d6799dadba2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:03.649831 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-f87eeecb-7c68-41f0-bec2-9a6b07d00cca tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:33:03.650923 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-f87eeecb-7c68-41f0-bec2-9a6b07d00cca tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 361 time: 0.3393667 Nov 09 04:33:03.653861 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56690) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:03.675942 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-3e581b0d-66ea-493c-9383-62ef8d04172f None None] Attempting to bind port 3653fdce-278e-4d4b-b712-fb2641dbb781 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:33:03.676301 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-3e581b0d-66ea-493c-9383-62ef8d04172f None None] Attempting to bind port 3653fdce-278e-4d4b-b712-fb2641dbb781 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '4adb05ec-46fe-428a-86b2-7b7107e35fdd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 334, 'network_id': '0bab5ed1-b8b1-45ba-b633-5bee32c71edd'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:33:03.676675 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3e581b0d-66ea-493c-9383-62ef8d04172f None None] Attempting to bind port 3653fdce-278e-4d4b-b712-fb2641dbb781 on network 0bab5ed1-b8b1-45ba-b633-5bee32c71edd {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:33:03.692263 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3e581b0d-66ea-493c-9383-62ef8d04172f None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 32, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:33:03.694893 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3e581b0d-66ea-493c-9383-62ef8d04172f None None] Checking segment: {'id': '4adb05ec-46fe-428a-86b2-7b7107e35fdd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 334, 'network_id': '0bab5ed1-b8b1-45ba-b633-5bee32c71edd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:33:03.699707 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3e581b0d-66ea-493c-9383-62ef8d04172f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:03.699707 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3e581b0d-66ea-493c-9383-62ef8d04172f None None] Bound using segment: {'id': '4adb05ec-46fe-428a-86b2-7b7107e35fdd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 334, 'network_id': '0bab5ed1-b8b1-45ba-b633-5bee32c71edd'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:33:03.699707 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-3e581b0d-66ea-493c-9383-62ef8d04172f None None] Bound port: 3653fdce-278e-4d4b-b712-fb2641dbb781, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4adb05ec-46fe-428a-86b2-7b7107e35fdd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 334, 'network_id': '0bab5ed1-b8b1-45ba-b633-5bee32c71edd'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:33:03.699707 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3e581b0d-66ea-493c-9383-62ef8d04172f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:03.718734 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-10c72904-4bfa-4fee-ab0a-e2c6ef5fab55 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-988d2354-693c-4d52-af17-25e0643eaa0c', 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'tenant_id': '8b0758f781884982bf5b94e6609237f6', 'fixed_ips': [{'subnet_id': 'cb7a4f2f-e10f-465c-a22b-b22e65acbf38'}, {'subnet_id': 'f6183641-d788-4054-bf47-99f434449c17'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:33:03.719529 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-10c72904-4bfa-4fee-ab0a-e2c6ef5fab55 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:03.739688 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-80d47097-78b2-4ce4-ad0e-2d6799dadba2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 827 time: 2.7417526 Nov 09 04:33:03.747497 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56692) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:03.752460 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-28ea5441-9786-437c-bdc6-e79f8a00cfc5 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'port': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'mac_address': 'fa:16:3e:00:bf:e1', 'name': 'tempest-NetworksTestDHCPv6-1959442119'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:03.789126 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4d930358-b8e2-4345-84eb-e63ef14693a9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:03.842232 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-e9608c3c-2b03-429d-b321-5f5b8de1e69b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Allocated IP 2001:db8::f (f3f8d961-ce10-4756-a07a-6ea2265beb22/57a6fd15-e149-473d-85de-d7cbbf8fa903/18baa777-17d6-468a-8ca9-4720faae2a79) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:33:03.860681 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-90e1cb94-7b8c-4a35-a673-8476b28a7b47 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:03.958159 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port a0a06470-4c5f-4ee5-bd7e-e74cb33969da triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:03.958559 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:03.976725 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.extraroute_db [None req-28b94aa3-9339-4a31-9c77-656d73d5e949 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Added routes are [{'destination': '172.23.0.0/28', 'nexthop': '172.23.0.2'}, {'destination': '172.22.0.0/28', 'nexthop': '172.22.0.2'}, {'destination': '172.21.0.0/28', 'nexthop': '172.21.0.2'}, {'destination': '172.20.0.0/28', 'nexthop': '172.20.0.2'}] {{(pid=102162) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:126}} Nov 09 04:33:03.986510 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-90e1cb94-7b8c-4a35-a673-8476b28a7b47 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:04.005985 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.extraroute_db [None req-28b94aa3-9339-4a31-9c77-656d73d5e949 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Removed routes are [] {{(pid=102162) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:134}} Nov 09 04:33:04.006592 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-28b94aa3-9339-4a31-9c77-656d73d5e949 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-466202', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-464271', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-936'] for router, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:04.037209 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-4d930358-b8e2-4345-84eb-e63ef14693a9 None None] For port 20195bcd-85f4-4bce-bae2-63cdf464f57f, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=20195bcd-85f4-4bce-bae2-63cdf464f57f,segment=NetworkSegment(696f4512-dd80-4379-a21b-b923df29bba5),segment_id=696f4512-dd80-4379-a21b-b923df29bba5)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:33:04.051296 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-3e581b0d-66ea-493c-9383-62ef8d04172f None None] For port 3653fdce-278e-4d4b-b712-fb2641dbb781, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:33:04.134733 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e9608c3c-2b03-429d-b321-5f5b8de1e69b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:04.192609 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-90e1cb94-7b8c-4a35-a673-8476b28a7b47 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:04.195669 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-90e1cb94-7b8c-4a35-a673-8476b28a7b47 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:04.199500 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-90e1cb94-7b8c-4a35-a673-8476b28a7b47 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "DELETE /v2.0/security-groups/5893f497-2547-4b4c-8aae-115951e0db0f HTTP/1.1" status: 204 len: 168 time: 0.5422094 Nov 09 04:33:04.205094 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56702) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:04.224104 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90e1cb94-7b8c-4a35-a673-8476b28a7b47 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=5893f497-2547-4b4c-8aae-115951e0db0f,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:04.238568 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-28ea5441-9786-437c-bdc6-e79f8a00cfc5 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'port': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:33:04.275372 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-3e581b0d-66ea-493c-9383-62ef8d04172f None None] For port 3653fdce-278e-4d4b-b712-fb2641dbb781, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=3653fdce-278e-4d4b-b712-fb2641dbb781,segment=NetworkSegment(4adb05ec-46fe-428a-86b2-7b7107e35fdd),segment_id=4adb05ec-46fe-428a-86b2-7b7107e35fdd)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:33:04.286545 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4d930358-b8e2-4345-84eb-e63ef14693a9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:04.315486 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e9608c3c-2b03-429d-b321-5f5b8de1e69b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:04.372204 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3e581b0d-66ea-493c-9383-62ef8d04172f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:04.395379 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-9b556f4f-4714-4cb4-afcb-56913a95a039 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.1933019 Nov 09 04:33:04.408924 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56706) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:04.410509 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-20104a3e-d219-4d60-a84e-fcb6353c864e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'name': 'tempest-RoutersTest-router-1490827103', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:32:29Z', 'updated_at': '2021-11-09T04:33:02Z', 'revision_number': 5, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'gw_port_host': None, '_interfaces': [{'id': '20195bcd-85f4-4bce-bae2-63cdf464f57f', 'name': '', 'network_id': '9e8670b3-5b0d-4ce5-8329-3af82c94231c', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:01:36:44', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 872, 'fixed_ips': [{'subnet_id': 'd7a7c5ae-922f-4fe2-ad19-b31fd352c9d1', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:52Z', 'updated_at': '2021-11-09T04:33:02Z', 'revision_number': 4, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'd7a7c5ae-922f-4fe2-ad19-b31fd352c9d1', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '3bdf32a7-774a-4983-98a1-9b8a12c4fd05', 'name': '', 'network_id': '0bab5ed1-b8b1-45ba-b633-5bee32c71edd', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:53:d1:9f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 898, 'fixed_ips': [{'subnet_id': 'abf2dc1a-091f-4460-a83f-5c4275733a2f', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:33:00Z', 'updated_at': '2021-11-09T04:33:02Z', 'revision_number': 2, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'abf2dc1a-091f-4460-a83f-5c4275733a2f', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '98741773-362a-4c6e-b503-923f0f367a2a', 'name': '', 'network_id': 'e1b06497-74dd-47e6-9b9a-79074e9bf0e8', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:d2:bc:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 847, 'fixed_ips': [{'subnet_id': 'f0939bd8-617d-4f5c-9f7b-272de792edac', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:43Z', 'updated_at': '2021-11-09T04:32:51Z', 'revision_number': 5, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'f0939bd8-617d-4f5c-9f7b-272de792edac', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'bf77ddc4-4ed9-472d-842b-1fb79d55e2e4', 'name': '', 'network_id': '35e2f2d1-ee40-4328-9fe2-48e5a5c19938', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:66:29:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 830, 'fixed_ips': [{'subnet_id': 'f60d3eec-6988-47b0-9f2f-6319fa99064d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:33Z', 'updated_at': '2021-11-09T04:32:44Z', 'revision_number': 5, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'f60d3eec-6988-47b0-9f2f-6319fa99064d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:04.414353 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9608c3c-2b03-429d-b321-5f5b8de1e69b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event updated for resources: {'Port': ['ID=18baa777-17d6-468a-8ca9-4720faae2a79,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:04.425840 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-1acda835-4382-4869-8730-f5daa3a2f3c1 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Request body: {'security_group': {'name': 'tempest-secgroup--1709564611'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:04.480481 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e9608c3c-2b03-429d-b321-5f5b8de1e69b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Network f3f8d961-ce10-4756-a07a-6ea2265beb22 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:33:04.484753 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-e9608c3c-2b03-429d-b321-5f5b8de1e69b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:33:04.485917 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d930358-b8e2-4345-84eb-e63ef14693a9 None None] Pushing event updated for resources: {'Port': ['ID=20195bcd-85f4-4bce-bae2-63cdf464f57f,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:04.488718 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-20104a3e-d219-4d60-a84e-fcb6353c864e None None] The sync data for ids ['fa30d24d-d721-4675-ad7b-09f35105e633'] in dv-neutron-816802-2-hyperv is: [{'id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'name': 'tempest-RoutersTest-router-1490827103', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:32:29Z', 'updated_at': '2021-11-09T04:33:02Z', 'revision_number': 5, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'gw_port_host': None, '_interfaces': [{'id': '20195bcd-85f4-4bce-bae2-63cdf464f57f', 'name': '', 'network_id': '9e8670b3-5b0d-4ce5-8329-3af82c94231c', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:01:36:44', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 872, 'fixed_ips': [{'subnet_id': 'd7a7c5ae-922f-4fe2-ad19-b31fd352c9d1', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:52Z', 'updated_at': '2021-11-09T04:33:02Z', 'revision_number': 4, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'd7a7c5ae-922f-4fe2-ad19-b31fd352c9d1', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '3bdf32a7-774a-4983-98a1-9b8a12c4fd05', 'name': '', 'network_id': '0bab5ed1-b8b1-45ba-b633-5bee32c71edd', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:53:d1:9f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 898, 'fixed_ips': [{'subnet_id': 'abf2dc1a-091f-4460-a83f-5c4275733a2f', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:33:00Z', 'updated_at': '2021-11-09T04:33:02Z', 'revision_number': 2, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'abf2dc1a-091f-4460-a83f-5c4275733a2f', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '98741773-362a-4c6e-b503-923f0f367a2a', 'name': '', 'network_id': 'e1b06497-74dd-47e6-9b9a-79074e9bf0e8', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:d2:bc:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 847, 'fixed_ips': [{'subnet_id': 'f0939bd8-617d-4f5c-9f7b-272de792edac', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:43Z', 'updated_at': '2021-11-09T04:32:51Z', 'revision_number': 5, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'f0939bd8-617d-4f5c-9f7b-272de792edac', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'bf77ddc4-4ed9-472d-842b-1fb79d55e2e4', 'name': '', 'network_id': '35e2f2d1-ee40-4328-9fe2-48e5a5c19938', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:66:29:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 830, 'fixed_ips': [{'subnet_id': 'f60d3eec-6988-47b0-9f2f-6319fa99064d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:33Z', 'updated_at': '2021-11-09T04:32:44Z', 'revision_number': 5, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'f60d3eec-6988-47b0-9f2f-6319fa99064d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:33:04.506167 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e9608c3c-2b03-429d-b321-5f5b8de1e69b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:33:04.522207 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e9608c3c-2b03-429d-b321-5f5b8de1e69b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:04.523800 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e9608c3c-2b03-429d-b321-5f5b8de1e69b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:04.579741 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-10c72904-4bfa-4fee-ab0a-e2c6ef5fab55 None None] Allocated IP 172.20.0.2 (988d2354-693c-4d52-af17-25e0643eaa0c/cb7a4f2f-e10f-465c-a22b-b22e65acbf38/3ff49245-babc-4cfa-95cc-55873e124258) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:33:04.607584 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-28ea5441-9786-437c-bdc6-e79f8a00cfc5 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:04.616584 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:04.622490 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-312e3f2b-1407-43c3-a088-04ac5d1f3b23 None None] Provisioning complete for port a0a06470-4c5f-4ee5-bd7e-e74cb33969da triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:04.622860 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-312e3f2b-1407-43c3-a088-04ac5d1f3b23 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:04.625568 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-10c72904-4bfa-4fee-ab0a-e2c6ef5fab55 None None] Allocated IP 2001:db8::f816:3eff:fe33:f087 (988d2354-693c-4d52-af17-25e0643eaa0c/f6183641-d788-4054-bf47-99f434449c17/3ff49245-babc-4cfa-95cc-55873e124258) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:33:04.693834 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1acda835-4382-4869-8730-f5daa3a2f3c1 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:04.705356 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e581b0d-66ea-493c-9383-62ef8d04172f None None] Pushing event updated for resources: {'Port': ['ID=3653fdce-278e-4d4b-b712-fb2641dbb781,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:04.740295 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-28b94aa3-9339-4a31-9c77-656d73d5e949 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-466202', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-464271', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-936'] for router, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:04.743883 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-28b94aa3-9339-4a31-9c77-656d73d5e949 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-466195', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-466408', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-464260'] for router, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:04.820886 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-e9608c3c-2b03-429d-b321-5f5b8de1e69b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 929 time: 2.5248399 Nov 09 04:33:04.826892 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56714) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:04.852364 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port a0a06470-4c5f-4ee5-bd7e-e74cb33969da, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=a0a06470-4c5f-4ee5-bd7e-e74cb33969da,segment=NetworkSegment(48c90ef7-c819-495a-b369-c2ba95c6d696),segment_id=48c90ef7-c819-495a-b369-c2ba95c6d696)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:33:04.857365 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [None req-28ea5441-9786-437c-bdc6-e79f8a00cfc5 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] device_id is not set on port de609b86-479b-4346-af49-b48a6472918a yet. {{(pid=102161) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:33:04.993959 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1acda835-4382-4869-8730-f5daa3a2f3c1 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:05.009288 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-28b94aa3-9339-4a31-9c77-656d73d5e949 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Router fa30d24d-d721-4675-ad7b-09f35105e633 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:33:05.055394 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1acda835-4382-4869-8730-f5daa3a2f3c1 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:05.084344 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-10c72904-4bfa-4fee-ab0a-e2c6ef5fab55 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:05.089355 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:05.141228 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1acda835-4382-4869-8730-f5daa3a2f3c1 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Pushing event updated for resources: {'SecurityGroup': ['ID=42e9ac84-359f-4746-8955-2e714cec70bd,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:05.204881 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=a0a06470-4c5f-4ee5-bd7e-e74cb33969da,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:05.208277 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-10c72904-4bfa-4fee-ab0a-e2c6ef5fab55 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:05.246137 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56718) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:05.251543 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1acda835-4382-4869-8730-f5daa3a2f3c1 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:05.255396 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1acda835-4382-4869-8730-f5daa3a2f3c1 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.8452401 Nov 09 04:33:05.261986 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56720) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:05.273996 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-fa4ab5fd-4fc2-4bc8-970c-5fc99507774f tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Request body: {'security_group_rule': {'security_group_id': '42e9ac84-359f-4746-8955-2e714cec70bd', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_group_id': 'bad_group_id'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:05.299864 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-312e3f2b-1407-43c3-a088-04ac5d1f3b23 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:05.306054 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-28b94aa3-9339-4a31-9c77-656d73d5e949 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:33:05.331918 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-10c72904-4bfa-4fee-ab0a-e2c6ef5fab55 None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:33:05.335918 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-10c72904-4bfa-4fee-ab0a-e2c6ef5fab55 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:33:05.354845 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0ae47cee-b28d-4ff9-9965-38743d197622 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:05.362335 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-0ae47cee-b28d-4ff9-9965-38743d197622 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "GET /v2.0/ports?fixed_ips=ip_address_substr%3D2001%3Adb8%3A%3A1 HTTP/1.1" status: 200 len: 928 time: 0.5318148 Nov 09 04:33:05.385472 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-10c72904-4bfa-4fee-ab0a-e2c6ef5fab55 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:33:05.398233 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-28b94aa3-9339-4a31-9c77-656d73d5e949 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:05.401959 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-28b94aa3-9339-4a31-9c77-656d73d5e949 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "PUT /v2.0/routers/fa30d24d-d721-4675-ad7b-09f35105e633 HTTP/1.1" status: 200 len: 934 time: 1.8872278 Nov 09 04:33:05.401959 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56724) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:05.424334 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10c72904-4bfa-4fee-ab0a-e2c6ef5fab55 None None] Pushing event updated for resources: {'Port': ['ID=3ff49245-babc-4cfa-95cc-55873e124258,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:05.436577 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56726) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:05.533394 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aa896526-40f8-4cd1-9552-5ac3a5eefe0a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:05.533699 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 20195bcd-85f4-4bce-bae2-63cdf464f57f up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:33:05.545417 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aa896526-40f8-4cd1-9552-5ac3a5eefe0a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:05.552326 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aa896526-40f8-4cd1-9552-5ac3a5eefe0a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:05.554647 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-aa896526-40f8-4cd1-9552-5ac3a5eefe0a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "GET /v2.0/ports?fixed_ips=ip_address_substr%3D2001%3Adb8%3A%3A HTTP/1.1" status: 200 len: 2391 time: 0.1512270 Nov 09 04:33:05.556436 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-9d21b44d-1654-40b9-9407-62bdd9b46657 tempest-SubnetPoolsTestJSON-772133239 tempest-SubnetPoolsTestJSON-772133239-project] Request body: {'subnetpool': {'name': 'tempest-subnetpools-973841048', 'prefixes': ['172.20.0.0/16']}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:05.558887 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56728) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:05.629761 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.db.api [None req-312e3f2b-1407-43c3-a088-04ac5d1f3b23 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=102163) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:33:05.629761 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG oslo_db.api [None req-312e3f2b-1407-43c3-a088-04ac5d1f3b23 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:33:05.649131 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-10c72904-4bfa-4fee-ab0a-e2c6ef5fab55 None None] Attempting to bind port 3ff49245-babc-4cfa-95cc-55873e124258 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:33:05.649557 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-10c72904-4bfa-4fee-ab0a-e2c6ef5fab55 None None] Attempting to bind port 3ff49245-babc-4cfa-95cc-55873e124258 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:33:05.649915 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-10c72904-4bfa-4fee-ab0a-e2c6ef5fab55 None None] Attempting to bind port 3ff49245-babc-4cfa-95cc-55873e124258 on network 988d2354-693c-4d52-af17-25e0643eaa0c {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:33:05.658805 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-28ea5441-9786-437c-bdc6-e79f8a00cfc5 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Allocated IP 172.20.0.9 (988d2354-693c-4d52-af17-25e0643eaa0c/cb7a4f2f-e10f-465c-a22b-b22e65acbf38/de609b86-479b-4346-af49-b48a6472918a) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:33:05.659390 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-10c72904-4bfa-4fee-ab0a-e2c6ef5fab55 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 32, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:33:05.659800 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-10c72904-4bfa-4fee-ab0a-e2c6ef5fab55 None None] Checking segment: {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:33:05.660200 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-10c72904-4bfa-4fee-ab0a-e2c6ef5fab55 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:05.660591 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-10c72904-4bfa-4fee-ab0a-e2c6ef5fab55 None None] Bound using segment: {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:33:05.661115 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-10c72904-4bfa-4fee-ab0a-e2c6ef5fab55 None None] Bound port: 3ff49245-babc-4cfa-95cc-55873e124258, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:33:05.661493 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-10c72904-4bfa-4fee-ab0a-e2c6ef5fab55 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:05.681000 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 20195bcd-85f4-4bce-bae2-63cdf464f57f triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:05.681771 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.api.v2.resource [None req-fa4ab5fd-4fc2-4bc8-970c-5fc99507774f tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] create failed (client error): The resource could not be found. Nov 09 04:33:05.686070 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-28ea5441-9786-437c-bdc6-e79f8a00cfc5 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Allocated IP 2001:db8::f816:3eff:fe00:bfe1 (988d2354-693c-4d52-af17-25e0643eaa0c/f6183641-d788-4054-bf47-99f434449c17/de609b86-479b-4346-af49-b48a6472918a) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:33:05.686276 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:05.687000 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-fa4ab5fd-4fc2-4bc8-970c-5fc99507774f tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 404 len: 323 time: 0.4216394 Nov 09 04:33:05.689697 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56730) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:05.704761 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-d9a06af2-2337-4cf0-b56c-0cd99b1eb8c5 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Request body: {'security_group_rule': {'security_group_id': '42e9ac84-359f-4746-8955-2e714cec70bd', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_group_id': 'fd285dfa-adf4-4e51-b141-4ce0672c6e8e'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:05.728711 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-0a7ccdf8-69d9-470e-a468-8d6ededa34eb tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Deleting port 18baa777-17d6-468a-8ca9-4720faae2a79 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:33:05.730534 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0a7ccdf8-69d9-470e-a468-8d6ededa34eb tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:05.742593 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-bbc44830-c455-4f65-be9c-5dbef816af32 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "GET /v2.0/routers/fa30d24d-d721-4675-ad7b-09f35105e633 HTTP/1.1" status: 200 len: 934 time: 0.3021188 Nov 09 04:33:05.742793 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56732) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:05.773199 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-ec55bcb8-fe79-47ca-baa0-e0e180441afe tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Request body: {'router': {'routes': None}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:05.820699 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-10c72904-4bfa-4fee-ab0a-e2c6ef5fab55 None None] For port 3ff49245-babc-4cfa-95cc-55873e124258, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:33:05.825018 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-10c72904-4bfa-4fee-ab0a-e2c6ef5fab55 None None] For port 3ff49245-babc-4cfa-95cc-55873e124258, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=3ff49245-babc-4cfa-95cc-55873e124258,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:33:05.904977 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 3653fdce-278e-4d4b-b712-fb2641dbb781 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:33:05.954745 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-10c72904-4bfa-4fee-ab0a-e2c6ef5fab55 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:06.009726 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-28ea5441-9786-437c-bdc6-e79f8a00cfc5 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:06.120640 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0a7ccdf8-69d9-470e-a468-8d6ededa34eb tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:06.126617 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 3653fdce-278e-4d4b-b712-fb2641dbb781 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:06.126617 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:06.160148 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-28ea5441-9786-437c-bdc6-e79f8a00cfc5 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:06.176549 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-0a7ccdf8-69d9-470e-a468-8d6ededa34eb tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Calling delete_port for 18baa777-17d6-468a-8ca9-4720faae2a79 owned by {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:33:06.211466 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10c72904-4bfa-4fee-ab0a-e2c6ef5fab55 None None] Pushing event updated for resources: {'Port': ['ID=3ff49245-babc-4cfa-95cc-55873e124258,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:06.223982 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-28ea5441-9786-437c-bdc6-e79f8a00cfc5 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:33:06.238796 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9d21b44d-1654-40b9-9407-62bdd9b46657 tempest-SubnetPoolsTestJSON-772133239 tempest-SubnetPoolsTestJSON-772133239-project] Publish callbacks [] for subnetpool, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:06.242414 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-9d21b44d-1654-40b9-9407-62bdd9b46657 tempest-SubnetPoolsTestJSON-772133239 tempest-SubnetPoolsTestJSON-772133239-project] 10.222.0.24 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 736 time: 0.9817491 Nov 09 04:33:06.242414 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-d9a06af2-2337-4cf0-b56c-0cd99b1eb8c5 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] create failed (client error): The resource could not be found. Nov 09 04:33:06.242414 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-d9a06af2-2337-4cf0-b56c-0cd99b1eb8c5 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 404 len: 347 time: 0.5433295 Nov 09 04:33:06.275271 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-28ea5441-9786-437c-bdc6-e79f8a00cfc5 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:33:06.286272 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-28ea5441-9786-437c-bdc6-e79f8a00cfc5 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:33:06.290124 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56734) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:06.290498 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56736) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:06.326509 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:06.331791 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-312e3f2b-1407-43c3-a088-04ac5d1f3b23 None None] Provisioning complete for port 20195bcd-85f4-4bce-bae2-63cdf464f57f triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:06.332414 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-312e3f2b-1407-43c3-a088-04ac5d1f3b23 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:06.394930 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28ea5441-9786-437c-bdc6-e79f8a00cfc5 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Port': ['ID=de609b86-479b-4346-af49-b48a6472918a,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:06.406116 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-19adc761-53df-4c30-84f1-0706f5d4950e None None] Network 0bab5ed1-b8b1-45ba-b633-5bee32c71edd requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:33:06.437522 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-adb39708-b47c-4786-bdc1-bd1f821b5b29 None None] Sync routers for ids ['fa30d24d-d721-4675-ad7b-09f35105e633'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:33:06.444751 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-28ea5441-9786-437c-bdc6-e79f8a00cfc5 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:06.445719 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-28ea5441-9786-437c-bdc6-e79f8a00cfc5 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:06.452411 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-adb39708-b47c-4786-bdc1-bd1f821b5b29 None None] Routers {'fa30d24d-d721-4675-ad7b-09f35105e633'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:33:06.453373 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-adb39708-b47c-4786-bdc1-bd1f821b5b29 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:32:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['fa30d24d-d721-4675-ad7b-09f35105e633'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:06.498684 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-84f6a33c-86cf-4abf-b3bb-db670271386f tempest-SubnetPoolsTestJSON-772133239 tempest-SubnetPoolsTestJSON-772133239-project] 10.222.0.24 "GET /v2.0/subnetpools/73ba02d2-aa8a-4ae6-ae15-0998eea605ef HTTP/1.1" status: 200 len: 731 time: 0.2053745 Nov 09 04:33:06.501032 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56738) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:06.507224 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-be176e75-556b-4ecf-aa3f-b2d900afdacf tempest-SubnetPoolsTestJSON-772133239 tempest-SubnetPoolsTestJSON-772133239-project] Request body: {'subnetpool': {'name': 'tempest-subnetpools_update-362388421'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:06.540673 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 3653fdce-278e-4d4b-b712-fb2641dbb781, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=3653fdce-278e-4d4b-b712-fb2641dbb781,segment=NetworkSegment(4adb05ec-46fe-428a-86b2-7b7107e35fdd),segment_id=4adb05ec-46fe-428a-86b2-7b7107e35fdd)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:33:06.584759 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4b987c1c-f569-4f37-a3b9-eede5d4e309f tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:06.586917 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-adb39708-b47c-4786-bdc1-bd1f821b5b29 None None] Set router fa30d24d-d721-4675-ad7b-09f35105e633 gateway port host: None {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:33:06.590099 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-28ea5441-9786-437c-bdc6-e79f8a00cfc5 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1027 time: 2.8361342 Nov 09 04:33:06.591379 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56740) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:06.624991 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:06.720244 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-be176e75-556b-4ecf-aa3f-b2d900afdacf tempest-SubnetPoolsTestJSON-772133239 tempest-SubnetPoolsTestJSON-772133239-project] Publish callbacks [] for subnetpool, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:06.721627 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-be176e75-556b-4ecf-aa3f-b2d900afdacf tempest-SubnetPoolsTestJSON-772133239 tempest-SubnetPoolsTestJSON-772133239-project] 10.222.0.24 "PUT /v2.0/subnetpools/73ba02d2-aa8a-4ae6-ae15-0998eea605ef HTTP/1.1" status: 200 len: 683 time: 0.2191563 Nov 09 04:33:06.724452 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56742) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:06.737422 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-4eb1d067-e2bd-404a-a1f2-4514bda0a1bb None None] Provisioning complete for port 18baa777-17d6-468a-8ca9-4720faae2a79 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:06.740651 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4eb1d067-e2bd-404a-a1f2-4514bda0a1bb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:06.740651 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=3653fdce-278e-4d4b-b712-fb2641dbb781,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:06.743227 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4b987c1c-f569-4f37-a3b9-eede5d4e309f tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:06.793905 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-4eb1d067-e2bd-404a-a1f2-4514bda0a1bb None None] Port 18baa777-17d6-468a-8ca9-4720faae2a79 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:33:06.809475 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9f364bd1-a644-452b-a0c7-d17795448817 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:06.810624 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-4eb1d067-e2bd-404a-a1f2-4514bda0a1bb None None] Provisioning complete for port 3653fdce-278e-4d4b-b712-fb2641dbb781 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:06.811214 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4eb1d067-e2bd-404a-a1f2-4514bda0a1bb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:06.815701 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9f364bd1-a644-452b-a0c7-d17795448817 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:06.827452 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-9f364bd1-a644-452b-a0c7-d17795448817 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1861 time: 0.2340527 Nov 09 04:33:06.828165 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56744) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:06.863300 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-adb39708-b47c-4786-bdc1-bd1f821b5b29 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'name': 'tempest-RoutersTest-router-1490827103', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [{'destination': '172.20.0.0/28', 'nexthop': '172.20.0.2'}, {'destination': '172.21.0.0/28', 'nexthop': '172.21.0.2'}, {'destination': '172.22.0.0/28', 'nexthop': '172.22.0.2'}, {'destination': '172.23.0.0/28', 'nexthop': '172.23.0.2'}], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:32:29Z', 'updated_at': '2021-11-09T04:33:03Z', 'revision_number': 6, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'gw_port_host': None, '_interfaces': [{'id': '20195bcd-85f4-4bce-bae2-63cdf464f57f', 'name': '', 'network_id': '9e8670b3-5b0d-4ce5-8329-3af82c94231c', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:01:36:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 872, 'fixed_ips': [{'subnet_id': 'd7a7c5ae-922f-4fe2-ad19-b31fd352c9d1', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:52Z', 'updated_at': '2021-11-09T04:33:03Z', 'revision_number': 5, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'd7a7c5ae-922f-4fe2-ad19-b31fd352c9d1', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '3bdf32a7-774a-4983-98a1-9b8a12c4fd05', 'name': '', 'network_id': '0bab5ed1-b8b1-45ba-b633-5bee32c71edd', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:53:d1:9f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 898, 'fixed_ips': [{'subnet_id': 'abf2dc1a-091f-4460-a83f-5c4275733a2f', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:33:00Z', 'updated_at': '2021-11-09T04:33:02Z', 'revision_number': 2, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'abf2dc1a-091f-4460-a83f-5c4275733a2f', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '98741773-362a-4c6e-b503-923f0f367a2a', 'name': '', 'network_id': 'e1b06497-74dd-47e6-9b9a-79074e9bf0e8', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:d2:bc:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 847, 'fixed_ips': [{'subnet_id': 'f0939bd8-617d-4f5c-9f7b-272de792edac', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:43Z', 'updated_at': '2021-11-09T04:32:51Z', 'revision_number': 5, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'f0939bd8-617d-4f5c-9f7b-272de792edac', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'bf77ddc4-4ed9-472d-842b-1fb79d55e2e4', 'name': '', 'network_id': '35e2f2d1-ee40-4328-9fe2-48e5a5c19938', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:66:29:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 830, 'fixed_ips': [{'subnet_id': 'f60d3eec-6988-47b0-9f2f-6319fa99064d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:33Z', 'updated_at': '2021-11-09T04:32:44Z', 'revision_number': 5, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'f60d3eec-6988-47b0-9f2f-6319fa99064d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:06.883236 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0a7ccdf8-69d9-470e-a468-8d6ededa34eb tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:06.903064 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-adb39708-b47c-4786-bdc1-bd1f821b5b29 None None] Checking router: fa30d24d-d721-4675-ad7b-09f35105e633 for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:33:06.904159 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-adb39708-b47c-4786-bdc1-bd1f821b5b29 None None] Updating router fa30d24d-d721-4675-ad7b-09f35105e633 port 3bdf32a7-774a-4983-98a1-9b8a12c4fd05 binding host dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 04:33:06.932974 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-4eb1d067-e2bd-404a-a1f2-4514bda0a1bb None None] Provisioning complete for port a0a06470-4c5f-4ee5-bd7e-e74cb33969da triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:06.933788 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4eb1d067-e2bd-404a-a1f2-4514bda0a1bb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:06.963045 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-efd6c58e-072a-4504-8b87-76009248478f tempest-SubnetPoolsTestJSON-772133239 tempest-SubnetPoolsTestJSON-772133239-project] Publish callbacks [] for subnetpool, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:06.963045 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-efd6c58e-072a-4504-8b87-76009248478f tempest-SubnetPoolsTestJSON-772133239 tempest-SubnetPoolsTestJSON-772133239-project] 10.222.0.24 "DELETE /v2.0/subnetpools/73ba02d2-aa8a-4ae6-ae15-0998eea605ef HTTP/1.1" status: 204 len: 168 time: 0.2362742 Nov 09 04:33:06.964572 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56746) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:06.979876 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-adb39708-b47c-4786-bdc1-bd1f821b5b29 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:06.997180 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-eb91077b-61da-427c-a4a0-0bbf01cfecd7 tempest-SubnetPoolsTestJSON-772133239 tempest-SubnetPoolsTestJSON-772133239-project] show failed (client error): The resource could not be found. Nov 09 04:33:06.998282 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-eb91077b-61da-427c-a4a0-0bbf01cfecd7 tempest-SubnetPoolsTestJSON-772133239 tempest-SubnetPoolsTestJSON-772133239-project] 10.222.0.24 "GET /v2.0/subnetpools/73ba02d2-aa8a-4ae6-ae15-0998eea605ef HTTP/1.1" status: 404 len: 346 time: 0.0326200 Nov 09 04:33:07.001091 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56748) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:07.008778 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a7ccdf8-69d9-470e-a468-8d6ededa34eb tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event deleted for resources: {'Port': ['ID=18baa777-17d6-468a-8ca9-4720faae2a79,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:07.030245 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-43c9b500-49f5-45f5-8872-a74b0665407f tempest-SubnetPoolsTestJSON-772133239 tempest-SubnetPoolsTestJSON-772133239-project] delete failed (client error): The resource could not be found. Nov 09 04:33:07.045557 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-43c9b500-49f5-45f5-8872-a74b0665407f tempest-SubnetPoolsTestJSON-772133239 tempest-SubnetPoolsTestJSON-772133239-project] 10.222.0.24 "DELETE /v2.0/subnetpools/73ba02d2-aa8a-4ae6-ae15-0998eea605ef HTTP/1.1" status: 404 len: 346 time: 0.0374119 Nov 09 04:33:07.109256 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-4eb1d067-e2bd-404a-a1f2-4514bda0a1bb None None] Provisioning complete for port 4a85b143-c5ea-43e5-99de-a9256f7a8642 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:07.109701 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4eb1d067-e2bd-404a-a1f2-4514bda0a1bb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:07.122995 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0a7ccdf8-69d9-470e-a468-8d6ededa34eb tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:07.130272 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56754) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:07.131698 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-0a7ccdf8-69d9-470e-a468-8d6ededa34eb tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "DELETE /v2.0/ports/18baa777-17d6-468a-8ca9-4720faae2a79 HTTP/1.1" status: 204 len: 168 time: 1.5717347 Nov 09 04:33:07.150054 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4b987c1c-f569-4f37-a3b9-eede5d4e309f tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:07.158564 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4b987c1c-f569-4f37-a3b9-eede5d4e309f tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:07.164041 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-4b987c1c-f569-4f37-a3b9-eede5d4e309f tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "DELETE /v2.0/security-groups/42e9ac84-359f-4746-8955-2e714cec70bd HTTP/1.1" status: 204 len: 168 time: 0.8672216 Nov 09 04:33:07.169368 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.extraroute_db [None req-ec55bcb8-fe79-47ca-baa0-e0e180441afe tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Added routes are [] {{(pid=102162) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:126}} Nov 09 04:33:07.169368 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.extraroute_db [None req-ec55bcb8-fe79-47ca-baa0-e0e180441afe tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Removed routes are [{'destination': '172.23.0.0/28', 'nexthop': '172.23.0.2'}, {'destination': '172.22.0.0/28', 'nexthop': '172.22.0.2'}, {'destination': '172.21.0.0/28', 'nexthop': '172.21.0.2'}, {'destination': '172.20.0.0/28', 'nexthop': '172.20.0.2'}] {{(pid=102162) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:134}} Nov 09 04:33:07.185143 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-4eb1d067-e2bd-404a-a1f2-4514bda0a1bb None None] Port 4a85b143-c5ea-43e5-99de-a9256f7a8642 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:33:07.193648 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56756) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:07.193969 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-06199567-8c9d-4fea-9383-e741ac2ed4e9 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] GET failed (client error): The resource could not be found. Nov 09 04:33:07.195562 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-06199567-8c9d-4fea-9383-e741ac2ed4e9 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "GET /v2.0/ports/18baa777-17d6-468a-8ca9-4720faae2a79 HTTP/1.1" status: 404 len: 333 time: 0.0625679 Nov 09 04:33:07.198201 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56758) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:07.248709 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56760) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:07.253099 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b987c1c-f569-4f37-a3b9-eede5d4e309f tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=42e9ac84-359f-4746-8955-2e714cec70bd,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:07.375179 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-df4056f1-110e-4b59-bbda-d90dac5155fe None None] Provisioning complete for port 3653fdce-278e-4d4b-b712-fb2641dbb781 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:07.375735 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-df4056f1-110e-4b59-bbda-d90dac5155fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:07.478931 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-0732f53b-10c1-42e2-bed7-14c347d7407c tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Deleting port de609b86-479b-4346-af49-b48a6472918a {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:33:07.482250 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0732f53b-10c1-42e2-bed7-14c347d7407c tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:07.563534 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-628b07d7-32f6-4371-ad2a-17dbe3f2a073 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.3116515 Nov 09 04:33:07.570497 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56762) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:07.575342 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-68477773-8952-4b09-9d12-54576561f7b2 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Request body: {'security_group_rule': {'security_group_id': '00369433-20ae-447b-b01e-cbd7dbedbeb2', 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:07.593978 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ec55bcb8-fe79-47ca-baa0-e0e180441afe tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-466202', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-464271', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-936'] for router, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:07.621246 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-adb39708-b47c-4786-bdc1-bd1f821b5b29 None None] Publish callbacks [] for port, precommit_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:07.635615 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-ddf486b7-a73c-45ef-ad55-4822e85c063b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Deleting port 4a85b143-c5ea-43e5-99de-a9256f7a8642 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:33:07.635964 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ddf486b7-a73c-45ef-ad55-4822e85c063b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:07.688231 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-df4056f1-110e-4b59-bbda-d90dac5155fe None None] Provisioning complete for port 3bdf32a7-774a-4983-98a1-9b8a12c4fd05 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:07.695344 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-df4056f1-110e-4b59-bbda-d90dac5155fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:07.729200 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-adb39708-b47c-4786-bdc1-bd1f821b5b29 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:07.741582 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 3653fdce-278e-4d4b-b712-fb2641dbb781 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:33:07.783231 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0732f53b-10c1-42e2-bed7-14c347d7407c tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:07.803389 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56766) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:07.852203 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-df4056f1-110e-4b59-bbda-d90dac5155fe None None] Port 3bdf32a7-774a-4983-98a1-9b8a12c4fd05 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:33:07.908406 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 3653fdce-278e-4d4b-b712-fb2641dbb781 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:07.909151 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:07.936571 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-adb39708-b47c-4786-bdc1-bd1f821b5b29 None None] Attempting to bind port 3bdf32a7-774a-4983-98a1-9b8a12c4fd05 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:33:07.937361 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-adb39708-b47c-4786-bdc1-bd1f821b5b29 None None] Attempting to bind port 3bdf32a7-774a-4983-98a1-9b8a12c4fd05 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '4adb05ec-46fe-428a-86b2-7b7107e35fdd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 334, 'network_id': '0bab5ed1-b8b1-45ba-b633-5bee32c71edd'}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:33:07.938008 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-adb39708-b47c-4786-bdc1-bd1f821b5b29 None None] Attempting to bind port 3bdf32a7-774a-4983-98a1-9b8a12c4fd05 on network 0bab5ed1-b8b1-45ba-b633-5bee32c71edd {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:33:07.946156 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-adb39708-b47c-4786-bdc1-bd1f821b5b29 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 32, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:33:07.947132 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-adb39708-b47c-4786-bdc1-bd1f821b5b29 None None] Checking segment: {'id': '4adb05ec-46fe-428a-86b2-7b7107e35fdd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 334, 'network_id': '0bab5ed1-b8b1-45ba-b633-5bee32c71edd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102164) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:33:07.948243 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-adb39708-b47c-4786-bdc1-bd1f821b5b29 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:07.949071 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-adb39708-b47c-4786-bdc1-bd1f821b5b29 None None] Bound using segment: {'id': '4adb05ec-46fe-428a-86b2-7b7107e35fdd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 334, 'network_id': '0bab5ed1-b8b1-45ba-b633-5bee32c71edd'} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:33:07.950639 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-0732f53b-10c1-42e2-bed7-14c347d7407c tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Calling delete_port for de609b86-479b-4346-af49-b48a6472918a owned by {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:33:07.952004 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-adb39708-b47c-4786-bdc1-bd1f821b5b29 None None] Bound port: 3bdf32a7-774a-4983-98a1-9b8a12c4fd05, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4adb05ec-46fe-428a-86b2-7b7107e35fdd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 334, 'network_id': '0bab5ed1-b8b1-45ba-b633-5bee32c71edd'}}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:33:07.953512 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-adb39708-b47c-4786-bdc1-bd1f821b5b29 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:07.987831 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ddf486b7-a73c-45ef-ad55-4822e85c063b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:08.005324 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3b6bdec9-49a1-437b-b7db-f191701f9ef1 None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:33:08.026598 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-ddf486b7-a73c-45ef-ad55-4822e85c063b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Calling delete_port for 4a85b143-c5ea-43e5-99de-a9256f7a8642 owned by {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:33:08.051362 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-0ae1c6b8-2ed6-4776-879f-e06fc3b56045 None None] Provisioning complete for port 3bdf32a7-774a-4983-98a1-9b8a12c4fd05 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:08.052093 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0ae1c6b8-2ed6-4776-879f-e06fc3b56045 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:08.074528 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-adb39708-b47c-4786-bdc1-bd1f821b5b29 None None] For port 3bdf32a7-774a-4983-98a1-9b8a12c4fd05, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102164) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:33:08.077528 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-29f212de-49f2-4556-891b-0ef886cae118 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:08.078885 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-adb39708-b47c-4786-bdc1-bd1f821b5b29 None None] For port 3bdf32a7-774a-4983-98a1-9b8a12c4fd05, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=3bdf32a7-774a-4983-98a1-9b8a12c4fd05,segment=NetworkSegment(4adb05ec-46fe-428a-86b2-7b7107e35fdd),segment_id=4adb05ec-46fe-428a-86b2-7b7107e35fdd)] {{(pid=102164) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:33:08.080266 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbbb1dc9-a5ff-4952-834e-72356da75772 None None] Pushing event updated for resources: {'Port': ['ID=3bdf32a7-774a-4983-98a1-9b8a12c4fd05,revision_number=3']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:08.099022 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-68477773-8952-4b09-9d12-54576561f7b2 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] create failed (client error): The resource could not be found. Nov 09 04:33:08.103447 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-68477773-8952-4b09-9d12-54576561f7b2 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 404 len: 347 time: 0.5287991 Nov 09 04:33:08.105019 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56770) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:08.116894 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-356bcac1-2d9d-429a-99a9-0e730c31aa5e tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Request body: {'security_group': {'name': 'tempest-secgroup--814003194'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:08.148732 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-adb39708-b47c-4786-bdc1-bd1f821b5b29 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:08.151821 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-3763f26a-4c1e-4197-bfe1-b7cb6440a6d9 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Deleting port 8f7c00e8-88ad-4eef-acf1-1a9ed282ba0b {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:33:08.152482 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3763f26a-4c1e-4197-bfe1-b7cb6440a6d9 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:08.158819 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-0ae1c6b8-2ed6-4776-879f-e06fc3b56045 None None] Port 3bdf32a7-774a-4983-98a1-9b8a12c4fd05 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:33:08.224512 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ec55bcb8-fe79-47ca-baa0-e0e180441afe tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-466202', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-464271', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-936'] for router, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:08.229254 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-356bcac1-2d9d-429a-99a9-0e730c31aa5e tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:08.230703 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ec55bcb8-fe79-47ca-baa0-e0e180441afe tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-466195', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-466408', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-464260'] for router, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:08.240177 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbbb1dc9-a5ff-4952-834e-72356da75772 None None] Pushing event updated for resources: {'Port': ['ID=3bdf32a7-774a-4983-98a1-9b8a12c4fd05,revision_number=4']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:08.265473 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 3ff49245-babc-4cfa-95cc-55873e124258 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:33:08.276826 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-adb39708-b47c-4786-bdc1-bd1f821b5b29 None None] Routers {'fa30d24d-d721-4675-ad7b-09f35105e633'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:33:08.277591 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-adb39708-b47c-4786-bdc1-bd1f821b5b29 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:32:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['fa30d24d-d721-4675-ad7b-09f35105e633'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:08.361631 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3763f26a-4c1e-4197-bfe1-b7cb6440a6d9 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:08.361961 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3763f26a-4c1e-4197-bfe1-b7cb6440a6d9 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:08.375677 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 3ff49245-babc-4cfa-95cc-55873e124258 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:08.375677 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:08.377710 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-6c3dcc4a-d0af-4e53-a89f-6818a3fdca0f None None] Provisioning complete for port 3ff49245-babc-4cfa-95cc-55873e124258 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:08.378136 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6c3dcc4a-d0af-4e53-a89f-6818a3fdca0f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:08.390048 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-3763f26a-4c1e-4197-bfe1-b7cb6440a6d9 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Calling delete_port for 8f7c00e8-88ad-4eef-acf1-1a9ed282ba0b owned by network:floatingip {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:33:08.475181 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ec55bcb8-fe79-47ca-baa0-e0e180441afe tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Router fa30d24d-d721-4675-ad7b-09f35105e633 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:33:08.539848 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-adb39708-b47c-4786-bdc1-bd1f821b5b29 None None] Set router fa30d24d-d721-4675-ad7b-09f35105e633 gateway port host: None {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:33:08.625591 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ddf486b7-a73c-45ef-ad55-4822e85c063b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:08.678265 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ec55bcb8-fe79-47ca-baa0-e0e180441afe tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:33:08.682801 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddf486b7-a73c-45ef-ad55-4822e85c063b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event deleted for resources: {'Port': ['ID=4a85b143-c5ea-43e5-99de-a9256f7a8642,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:08.695888 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ec55bcb8-fe79-47ca-baa0-e0e180441afe tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:08.697126 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-ec55bcb8-fe79-47ca-baa0-e0e180441afe tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "PUT /v2.0/routers/fa30d24d-d721-4675-ad7b-09f35105e633 HTTP/1.1" status: 200 len: 700 time: 2.9533536 Nov 09 04:33:08.699863 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56772) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:08.706998 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3763f26a-4c1e-4197-bfe1-b7cb6440a6d9 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:08.719196 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ddf486b7-a73c-45ef-ad55-4822e85c063b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:08.725838 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-ddf486b7-a73c-45ef-ad55-4822e85c063b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "DELETE /v2.0/ports/4a85b143-c5ea-43e5-99de-a9256f7a8642 HTTP/1.1" status: 204 len: 168 time: 1.5235248 Nov 09 04:33:08.729841 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56774) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:08.779427 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0732f53b-10c1-42e2-bed7-14c347d7407c tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:08.793399 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3763f26a-4c1e-4197-bfe1-b7cb6440a6d9 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Pushing event deleted for resources: {'Port': ['ID=8f7c00e8-88ad-4eef-acf1-1a9ed282ba0b,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:08.824258 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-e7380fd5-955a-416c-83ce-0c1db147b848 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] GET failed (client error): The resource could not be found. Nov 09 04:33:08.828508 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-e7380fd5-955a-416c-83ce-0c1db147b848 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "GET /v2.0/ports/4a85b143-c5ea-43e5-99de-a9256f7a8642 HTTP/1.1" status: 404 len: 333 time: 0.0765195 Nov 09 04:33:08.852515 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56776) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:08.856077 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-adb39708-b47c-4786-bdc1-bd1f821b5b29 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'name': 'tempest-RoutersTest-router-1490827103', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:32:29Z', 'updated_at': '2021-11-09T04:33:07Z', 'revision_number': 7, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'gw_port_host': None, '_interfaces': [{'id': '20195bcd-85f4-4bce-bae2-63cdf464f57f', 'name': '', 'network_id': '9e8670b3-5b0d-4ce5-8329-3af82c94231c', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:01:36:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 872, 'fixed_ips': [{'subnet_id': 'd7a7c5ae-922f-4fe2-ad19-b31fd352c9d1', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:52Z', 'updated_at': '2021-11-09T04:33:03Z', 'revision_number': 5, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'd7a7c5ae-922f-4fe2-ad19-b31fd352c9d1', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '3bdf32a7-774a-4983-98a1-9b8a12c4fd05', 'name': '', 'network_id': '0bab5ed1-b8b1-45ba-b633-5bee32c71edd', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:53:d1:9f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 898, 'fixed_ips': [{'subnet_id': 'abf2dc1a-091f-4460-a83f-5c4275733a2f', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:33:00Z', 'updated_at': '2021-11-09T04:33:08Z', 'revision_number': 4, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'abf2dc1a-091f-4460-a83f-5c4275733a2f', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '98741773-362a-4c6e-b503-923f0f367a2a', 'name': '', 'network_id': 'e1b06497-74dd-47e6-9b9a-79074e9bf0e8', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:d2:bc:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 847, 'fixed_ips': [{'subnet_id': 'f0939bd8-617d-4f5c-9f7b-272de792edac', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:43Z', 'updated_at': '2021-11-09T04:32:51Z', 'revision_number': 5, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'f0939bd8-617d-4f5c-9f7b-272de792edac', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'bf77ddc4-4ed9-472d-842b-1fb79d55e2e4', 'name': '', 'network_id': '35e2f2d1-ee40-4328-9fe2-48e5a5c19938', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:66:29:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 830, 'fixed_ips': [{'subnet_id': 'f60d3eec-6988-47b0-9f2f-6319fa99064d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:33Z', 'updated_at': '2021-11-09T04:32:44Z', 'revision_number': 5, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'f60d3eec-6988-47b0-9f2f-6319fa99064d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:08.911199 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6c3dcc4a-d0af-4e53-a89f-6818a3fdca0f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:08.913854 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:08.926752 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-adb39708-b47c-4786-bdc1-bd1f821b5b29 None None] The sync data for ids ['fa30d24d-d721-4675-ad7b-09f35105e633'] in dv-neutron-816802-2-hyperv is: [{'id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'name': 'tempest-RoutersTest-router-1490827103', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:32:29Z', 'updated_at': '2021-11-09T04:33:07Z', 'revision_number': 7, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'gw_port_host': None, '_interfaces': [{'id': '20195bcd-85f4-4bce-bae2-63cdf464f57f', 'name': '', 'network_id': '9e8670b3-5b0d-4ce5-8329-3af82c94231c', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:01:36:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 872, 'fixed_ips': [{'subnet_id': 'd7a7c5ae-922f-4fe2-ad19-b31fd352c9d1', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:52Z', 'updated_at': '2021-11-09T04:33:03Z', 'revision_number': 5, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'd7a7c5ae-922f-4fe2-ad19-b31fd352c9d1', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '3bdf32a7-774a-4983-98a1-9b8a12c4fd05', 'name': '', 'network_id': '0bab5ed1-b8b1-45ba-b633-5bee32c71edd', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:53:d1:9f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 898, 'fixed_ips': [{'subnet_id': 'abf2dc1a-091f-4460-a83f-5c4275733a2f', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:33:00Z', 'updated_at': '2021-11-09T04:33:08Z', 'revision_number': 4, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'abf2dc1a-091f-4460-a83f-5c4275733a2f', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '98741773-362a-4c6e-b503-923f0f367a2a', 'name': '', 'network_id': 'e1b06497-74dd-47e6-9b9a-79074e9bf0e8', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:d2:bc:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 847, 'fixed_ips': [{'subnet_id': 'f0939bd8-617d-4f5c-9f7b-272de792edac', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:43Z', 'updated_at': '2021-11-09T04:32:51Z', 'revision_number': 5, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'f0939bd8-617d-4f5c-9f7b-272de792edac', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'bf77ddc4-4ed9-472d-842b-1fb79d55e2e4', 'name': '', 'network_id': '35e2f2d1-ee40-4328-9fe2-48e5a5c19938', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:66:29:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 830, 'fixed_ips': [{'subnet_id': 'f60d3eec-6988-47b0-9f2f-6319fa99064d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:33Z', 'updated_at': '2021-11-09T04:32:44Z', 'revision_number': 5, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'f60d3eec-6988-47b0-9f2f-6319fa99064d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:33:08.993936 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-6c3dcc4a-d0af-4e53-a89f-6818a3fdca0f None None] For port 3ff49245-babc-4cfa-95cc-55873e124258, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=3ff49245-babc-4cfa-95cc-55873e124258,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:33:09.072656 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-64ad7aad-3eb2-4277-aff5-7cdc10de7a7b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Deleting subnet 57a6fd15-e149-473d-85de-d7cbbf8fa903 {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:33:09.084108 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6c3dcc4a-d0af-4e53-a89f-6818a3fdca0f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:09.086937 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-356bcac1-2d9d-429a-99a9-0e730c31aa5e tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:09.086937 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-64ad7aad-3eb2-4277-aff5-7cdc10de7a7b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:09.088887 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3763f26a-4c1e-4197-bfe1-b7cb6440a6d9 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks [] for floatingip, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:09.089216 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.l3_db [None req-3763f26a-4c1e-4197-bfe1-b7cb6440a6d9 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Floating IP c68e1ebb-65d3-4c8e-b1c0-4ae8c774d9ed disassociated (deleted). External IP: 172.26.0.145, port: 9c023fad-c8fa-4120-b9cc-4ea22c1718e4. Nov 09 04:33:09.170528 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-356bcac1-2d9d-429a-99a9-0e730c31aa5e tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:09.193814 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-6c3dcc4a-d0af-4e53-a89f-6818a3fdca0f None None] Provisioning complete for port 3bdf32a7-774a-4983-98a1-9b8a12c4fd05 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:09.194635 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6c3dcc4a-d0af-4e53-a89f-6818a3fdca0f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:09.202583 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d73c436c-d5fa-4f59-894f-14beff1a38e7 None None] Sync routers for ids ['fa30d24d-d721-4675-ad7b-09f35105e633'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:33:09.226767 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-64ad7aad-3eb2-4277-aff5-7cdc10de7a7b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:09.279612 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-356bcac1-2d9d-429a-99a9-0e730c31aa5e tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f79cf005-f764-4021-b546-a91aed6fc08d,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:09.295130 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.db.api [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=102163) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:33:09.296835 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG oslo_db.api [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:33:09.300004 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d73c436c-d5fa-4f59-894f-14beff1a38e7 None None] Routers {'fa30d24d-d721-4675-ad7b-09f35105e633'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:33:09.301129 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-d73c436c-d5fa-4f59-894f-14beff1a38e7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:32:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['fa30d24d-d721-4675-ad7b-09f35105e633'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:09.306737 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c3dcc4a-d0af-4e53-a89f-6818a3fdca0f None None] Pushing event updated for resources: {'Port': ['ID=3ff49245-babc-4cfa-95cc-55873e124258,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:09.310146 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0732f53b-10c1-42e2-bed7-14c347d7407c tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event deleted for resources: {'Port': ['ID=de609b86-479b-4346-af49-b48a6472918a,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:09.356742 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-356bcac1-2d9d-429a-99a9-0e730c31aa5e tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:09.358015 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-356bcac1-2d9d-429a-99a9-0e730c31aa5e tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1760 time: 1.2488627 Nov 09 04:33:09.374253 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56778) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:09.383450 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-83ea0c25-1a8c-4b86-b4f5-49fdf63a3a98 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Request body: {'security_group': {'name': 'tempest-secgroup--632577125'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:09.432639 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-64ad7aad-3eb2-4277-aff5-7cdc10de7a7b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:09.436405 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e6f399f1-337e-4345-a7a1-ce7c1c4b1415 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "GET /v2.0/routers/fa30d24d-d721-4675-ad7b-09f35105e633 HTTP/1.1" status: 200 len: 700 time: 0.7354431 Nov 09 04:33:09.443808 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56780) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:09.448070 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-d73c436c-d5fa-4f59-894f-14beff1a38e7 None None] Set router fa30d24d-d721-4675-ad7b-09f35105e633 gateway port host: None {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:33:09.477136 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6c3dcc4a-d0af-4e53-a89f-6818a3fdca0f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:09.498604 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0732f53b-10c1-42e2-bed7-14c347d7407c tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:09.502539 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-0732f53b-10c1-42e2-bed7-14c347d7407c tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/ports/de609b86-479b-4346-af49-b48a6472918a HTTP/1.1" status: 204 len: 168 time: 2.6340570 Nov 09 04:33:09.532756 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56782) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:09.548827 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-83ea0c25-1a8c-4b86-b4f5-49fdf63a3a98 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:09.585434 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-6c3dcc4a-d0af-4e53-a89f-6818a3fdca0f None None] For port 3bdf32a7-774a-4983-98a1-9b8a12c4fd05, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=3bdf32a7-774a-4983-98a1-9b8a12c4fd05,segment=NetworkSegment(4adb05ec-46fe-428a-86b2-7b7107e35fdd),segment_id=4adb05ec-46fe-428a-86b2-7b7107e35fdd)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:33:09.618724 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-29f212de-49f2-4556-891b-0ef886cae118 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:09.652365 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6c3dcc4a-d0af-4e53-a89f-6818a3fdca0f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:09.655707 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fc96d30b-9c82-4ce2-b966-61c6cfdfbe10 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:09.657422 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fc96d30b-9c82-4ce2-b966-61c6cfdfbe10 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:09.659700 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fc96d30b-9c82-4ce2-b966-61c6cfdfbe10 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:09.664310 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-fc96d30b-9c82-4ce2-b966-61c6cfdfbe10 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2049 time: 0.1252234 Nov 09 04:33:09.664310 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56784) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:09.714054 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-29f212de-49f2-4556-891b-0ef886cae118 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:09.742953 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c3dcc4a-d0af-4e53-a89f-6818a3fdca0f None None] Pushing event updated for resources: {'Port': ['ID=3bdf32a7-774a-4983-98a1-9b8a12c4fd05,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:09.777661 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-436ca382-7917-4295-9083-0bf66d859b17 None None] Could not find standard attr ID for object de609b86-479b-4346-af49-b48a6472918a. {{(pid=102163) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 09 04:33:09.838483 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-436ca382-7917-4295-9083-0bf66d859b17 None None] Provisioning complete for port 3ff49245-babc-4cfa-95cc-55873e124258 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:09.839291 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-436ca382-7917-4295-9083-0bf66d859b17 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:09.876039 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-d73c436c-d5fa-4f59-894f-14beff1a38e7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'name': 'tempest-RoutersTest-router-1490827103', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:32:29Z', 'updated_at': '2021-11-09T04:33:07Z', 'revision_number': 7, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'gw_port_host': None, '_interfaces': [{'id': '20195bcd-85f4-4bce-bae2-63cdf464f57f', 'name': '', 'network_id': '9e8670b3-5b0d-4ce5-8329-3af82c94231c', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:01:36:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 872, 'fixed_ips': [{'subnet_id': 'd7a7c5ae-922f-4fe2-ad19-b31fd352c9d1', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:52Z', 'updated_at': '2021-11-09T04:33:03Z', 'revision_number': 5, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'd7a7c5ae-922f-4fe2-ad19-b31fd352c9d1', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '3bdf32a7-774a-4983-98a1-9b8a12c4fd05', 'name': '', 'network_id': '0bab5ed1-b8b1-45ba-b633-5bee32c71edd', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:53:d1:9f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 898, 'fixed_ips': [{'subnet_id': 'abf2dc1a-091f-4460-a83f-5c4275733a2f', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:33:00Z', 'updated_at': '2021-11-09T04:33:08Z', 'revision_number': 4, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'abf2dc1a-091f-4460-a83f-5c4275733a2f', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '98741773-362a-4c6e-b503-923f0f367a2a', 'name': '', 'network_id': 'e1b06497-74dd-47e6-9b9a-79074e9bf0e8', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:d2:bc:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 847, 'fixed_ips': [{'subnet_id': 'f0939bd8-617d-4f5c-9f7b-272de792edac', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:43Z', 'updated_at': '2021-11-09T04:32:51Z', 'revision_number': 5, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'f0939bd8-617d-4f5c-9f7b-272de792edac', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'bf77ddc4-4ed9-472d-842b-1fb79d55e2e4', 'name': '', 'network_id': '35e2f2d1-ee40-4328-9fe2-48e5a5c19938', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:66:29:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 830, 'fixed_ips': [{'subnet_id': 'f60d3eec-6988-47b0-9f2f-6319fa99064d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:33Z', 'updated_at': '2021-11-09T04:32:44Z', 'revision_number': 5, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'f60d3eec-6988-47b0-9f2f-6319fa99064d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:09.902895 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-81e776cf-8f08-45e1-9a96-4562f163a9f9 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Deleting subnet cb7a4f2f-e10f-465c-a22b-b22e65acbf38 {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:33:09.914918 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-29f212de-49f2-4556-891b-0ef886cae118 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=8b3c7825f00045a5a79d3afbb8127504&name=default HTTP/1.1" status: 200 len: 2996 time: 2.1104150 Nov 09 04:33:09.918602 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d73c436c-d5fa-4f59-894f-14beff1a38e7 None None] Checking router: fa30d24d-d721-4675-ad7b-09f35105e633 for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:33:09.919136 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-83ea0c25-1a8c-4b86-b4f5-49fdf63a3a98 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:09.922766 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56786) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:09.923436 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29f212de-49f2-4556-891b-0ef886cae118 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=87c95aa0-d830-4035-b26b-6592d6c0bfc9,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:09.929666 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device a0a06470-4c5f-4ee5-bd7e-e74cb33969da up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:33:09.933977 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-81e776cf-8f08-45e1-9a96-4562f163a9f9 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:09.987450 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d73c436c-d5fa-4f59-894f-14beff1a38e7 None None] Routers {'fa30d24d-d721-4675-ad7b-09f35105e633'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:33:09.988098 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-d73c436c-d5fa-4f59-894f-14beff1a38e7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:32:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['fa30d24d-d721-4675-ad7b-09f35105e633'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:10.016329 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-83ea0c25-1a8c-4b86-b4f5-49fdf63a3a98 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:10.020559 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3763f26a-4c1e-4197-bfe1-b7cb6440a6d9 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Router 20fa17b9-5a43-469e-a0de-e9be80c05f6f has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:33:10.033189 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9a08c4e7-3bc7-4a58-92dc-399ad5215c4a None None] get_active_networks_info from dv-neutron-816802-2-hyperv {{(pid=102163) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}} Nov 09 04:33:10.085853 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-81e776cf-8f08-45e1-9a96-4562f163a9f9 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:10.121174 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83ea0c25-1a8c-4b86-b4f5-49fdf63a3a98 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Pushing event updated for resources: {'SecurityGroup': ['ID=36c27878-76b2-4060-b70c-84506fb52c79,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:10.130257 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port a0a06470-4c5f-4ee5-bd7e-e74cb33969da triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:10.137880 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:10.137975 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-64ad7aad-3eb2-4277-aff5-7cdc10de7a7b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:10.172164 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64ad7aad-3eb2-4277-aff5-7cdc10de7a7b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event deleted for resources: {'Subnet': ['ID=57a6fd15-e149-473d-85de-d7cbbf8fa903,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:10.174681 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-83ea0c25-1a8c-4b86-b4f5-49fdf63a3a98 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:10.175236 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-64ad7aad-3eb2-4277-aff5-7cdc10de7a7b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:10.175903 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-83ea0c25-1a8c-4b86-b4f5-49fdf63a3a98 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1760 time: 0.7975070 Nov 09 04:33:10.179031 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-64ad7aad-3eb2-4277-aff5-7cdc10de7a7b tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "DELETE /v2.0/subnets/57a6fd15-e149-473d-85de-d7cbbf8fa903 HTTP/1.1" status: 204 len: 168 time: 1.3248060 Nov 09 04:33:10.179643 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56788) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:10.183940 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c48e6017-47f8-4796-85c7-163174d58581 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:10.187666 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-a4ce4956-8e8a-40bf-bc9d-82bf20f3ec59 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Request body: {'security_group_rule': {'security_group_id': 'f79cf005-f764-4021-b546-a91aed6fc08d', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_ip_prefix': '2001:db8::/48', 'remote_group_id': '36c27878-76b2-4060-b70c-84506fb52c79'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:10.188624 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56790) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:10.203808 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3763f26a-4c1e-4197-bfe1-b7cb6440a6d9 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:33:10.210288 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3763f26a-4c1e-4197-bfe1-b7cb6440a6d9 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:10.211847 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-d73c436c-d5fa-4f59-894f-14beff1a38e7 None None] Set router fa30d24d-d721-4675-ad7b-09f35105e633 gateway port host: None {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:33:10.224451 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aa29e370-a39a-46aa-b6bc-2133bcfab02f None None] Sync routers for ids ['20fa17b9-5a43-469e-a0de-e9be80c05f6f'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:33:10.234753 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aa29e370-a39a-46aa-b6bc-2133bcfab02f None None] Routers {'20fa17b9-5a43-469e-a0de-e9be80c05f6f'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:33:10.235605 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-aa29e370-a39a-46aa-b6bc-2133bcfab02f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:32:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['20fa17b9-5a43-469e-a0de-e9be80c05f6f'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:10.245366 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-3763f26a-4c1e-4197-bfe1-b7cb6440a6d9 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "DELETE /v2.0/floatingips/c68e1ebb-65d3-4c8e-b1c0-4ae8c774d9ed HTTP/1.1" status: 204 len: 168 time: 2.9920509 Nov 09 04:33:10.245366 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9c4e58e3-39e4-4212-b106-50b44d4c4e28', 'tag': '9c023fad-c8fa-4120-b9cc-4ea22c1718e4'}] {{(pid=102161) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:33:10.256237 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}99dfdda0def497b4372884ef2eb87f06b1e425c8eba5ceda5f64bbab037a07d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2b678e3b-f2ca-4a64-bb52-645d05a12084" -d '{"events": [{"name": "network-changed", "server_uuid": "9c4e58e3-39e4-4212-b106-50b44d4c4e28", "tag": "9c023fad-c8fa-4120-b9cc-4ea22c1718e4"}]}' {{(pid=102161) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:33:10.340748 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:33:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-32a534ef-5471-4965-a8b1-f5e899c17b70 x-openstack-request-id: req-32a534ef-5471-4965-a8b1-f5e899c17b70 {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:33:10.341583 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9c4e58e3-39e4-4212-b106-50b44d4c4e28", "tag": "9c023fad-c8fa-4120-b9cc-4ea22c1718e4", "status": "completed", "code": 200}]} {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:33:10.341583 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-32a534ef-5471-4965-a8b1-f5e899c17b70 {{(pid=102161) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:33:10.341913 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9c4e58e3-39e4-4212-b106-50b44d4c4e28', 'tag': '9c023fad-c8fa-4120-b9cc-4ea22c1718e4', 'status': 'completed', 'code': 200} Nov 09 04:33:10.380453 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-81e776cf-8f08-45e1-9a96-4562f163a9f9 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:10.399943 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-436ca382-7917-4295-9083-0bf66d859b17 None None] Provisioning complete for port 3bdf32a7-774a-4983-98a1-9b8a12c4fd05 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:10.400316 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-436ca382-7917-4295-9083-0bf66d859b17 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:10.415798 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-aa29e370-a39a-46aa-b6bc-2133bcfab02f None None] Set router 20fa17b9-5a43-469e-a0de-e9be80c05f6f gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:33:10.425478 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-a4ce4956-8e8a-40bf-bc9d-82bf20f3ec59 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:33:10.429853 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a4ce4956-8e8a-40bf-bc9d-82bf20f3ec59 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 387 time: 0.2430198 Nov 09 04:33:10.429990 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9bf70763-3678-412c-a52e-847f53686f50 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:10.430153 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56796) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:10.470953 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c48e6017-47f8-4796-85c7-163174d58581 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:10.487708 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9a08c4e7-3bc7-4a58-92dc-399ad5215c4a None None] Resources bound (agent type, host, resource id): {{(pid=102163) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 09 04:33:10.510311 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ccaceb98-7e85-4d58-af48-70b53342578c tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:10.561930 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ccaceb98-7e85-4d58-af48-70b53342578c tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:10.685968 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c48e6017-47f8-4796-85c7-163174d58581 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:10.696007 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-aa29e370-a39a-46aa-b6bc-2133bcfab02f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '20fa17b9-5a43-469e-a0de-e9be80c05f6f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1135837892', 'tenant_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.69'}], 'enable_snat': True}, 'gw_port_id': '8508be40-2af9-45a5-96f0-06d142f33d8d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:30:45Z', 'updated_at': '2021-11-09T04:31:03Z', 'revision_number': 4, 'project_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'gw_port': {'id': '8508be40-2af9-45a5-96f0-06d142f33d8d', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:95:95:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '20fa17b9-5a43-469e-a0de-e9be80c05f6f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 567, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:30:48Z', 'updated_at': '2021-11-09T04:30:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'bab3b0b2-ec0e-464a-b15f-1f71dc13f0f3', 'name': '', 'network_id': '9c94e7dc-d679-4a7e-b264-6d619dbc935e', 'tenant_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'mac_address': 'fa:16:3e:b2:bf:75', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '20fa17b9-5a43-469e-a0de-e9be80c05f6f', 'device_owner': 'network:router_interface', 'standard_attr_id': 610, 'fixed_ips': [{'subnet_id': '003822ea-7d1a-41fa-a15f-16fc8c9f624c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:31:00Z', 'updated_at': '2021-11-09T04:31:12Z', 'revision_number': 5, 'project_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'subnets': [{'id': '003822ea-7d1a-41fa-a15f-16fc8c9f624c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:10.697516 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c48e6017-47f8-4796-85c7-163174d58581 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:10.698829 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-c48e6017-47f8-4796-85c7-163174d58581 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/87c95aa0-d830-4035-b26b-6592d6c0bfc9 HTTP/1.1" status: 204 len: 168 time: 0.7714312 Nov 09 04:33:10.711710 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ccaceb98-7e85-4d58-af48-70b53342578c tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:10.714504 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ccaceb98-7e85-4d58-af48-70b53342578c tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:10.718133 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-ccaceb98-7e85-4d58-af48-70b53342578c tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "DELETE /v2.0/security-groups/36c27878-76b2-4060-b70c-84506fb52c79 HTTP/1.1" status: 204 len: 168 time: 0.2847984 Nov 09 04:33:10.719146 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56802) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:10.730537 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aa29e370-a39a-46aa-b6bc-2133bcfab02f None None] Checking router: 20fa17b9-5a43-469e-a0de-e9be80c05f6f for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:33:10.745266 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aa29e370-a39a-46aa-b6bc-2133bcfab02f None None] Routers {'20fa17b9-5a43-469e-a0de-e9be80c05f6f'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:33:10.746317 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-aa29e370-a39a-46aa-b6bc-2133bcfab02f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:32:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['20fa17b9-5a43-469e-a0de-e9be80c05f6f'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:10.767164 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccaceb98-7e85-4d58-af48-70b53342578c tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=36c27878-76b2-4060-b70c-84506fb52c79,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:10.818116 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c48e6017-47f8-4796-85c7-163174d58581 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=87c95aa0-d830-4035-b26b-6592d6c0bfc9,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:10.849232 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 3bdf32a7-774a-4983-98a1-9b8a12c4fd05 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:33:10.857567 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-239b5cb0-c1bd-4344-a39e-6c9ce7bdc2d5 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 4538 time: 0.1369064 Nov 09 04:33:10.860478 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56804) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:10.898406 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b678e3b-f2ca-4a64-bb52-645d05a12084 req-994e2cbd-7400-469f-9381-3b866786702d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:10.900018 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2b678e3b-f2ca-4a64-bb52-645d05a12084 req-994e2cbd-7400-469f-9381-3b866786702d service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=fd7df27e425449dfb80d0838c8f7fb89&device_id=9c4e58e3-39e4-4212-b106-50b44d4c4e28 HTTP/1.1" status: 200 len: 1098 time: 0.4560962 Nov 09 04:33:10.962072 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-12a76a52-5548-4c4f-8a94-96110531346a tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:10.988720 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-aa29e370-a39a-46aa-b6bc-2133bcfab02f None None] Set router 20fa17b9-5a43-469e-a0de-e9be80c05f6f gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:33:11.001394 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-12a76a52-5548-4c4f-8a94-96110531346a tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:11.015827 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-81e776cf-8f08-45e1-9a96-4562f163a9f9 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:11.026904 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f547ed1-1794-4f43-94e1-208367e3d89f req-6579e9ba-821a-42f0-8f20-0206619bfd37 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:11.043329 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7f547ed1-1794-4f43-94e1-208367e3d89f req-6579e9ba-821a-42f0-8f20-0206619bfd37 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/ports?device_id=9c4e58e3-39e4-4212-b106-50b44d4c4e28 HTTP/1.1" status: 200 len: 945 time: 0.2397676 Nov 09 04:33:11.043564 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 3bdf32a7-774a-4983-98a1-9b8a12c4fd05 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:11.043564 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:11.054106 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-d73c436c-d5fa-4f59-894f-14beff1a38e7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'name': 'tempest-RoutersTest-router-1490827103', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:32:29Z', 'updated_at': '2021-11-09T04:33:07Z', 'revision_number': 7, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'gw_port_host': None, '_interfaces': [{'id': '20195bcd-85f4-4bce-bae2-63cdf464f57f', 'name': '', 'network_id': '9e8670b3-5b0d-4ce5-8329-3af82c94231c', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:01:36:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 872, 'fixed_ips': [{'subnet_id': 'd7a7c5ae-922f-4fe2-ad19-b31fd352c9d1', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:52Z', 'updated_at': '2021-11-09T04:33:03Z', 'revision_number': 5, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'd7a7c5ae-922f-4fe2-ad19-b31fd352c9d1', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '3bdf32a7-774a-4983-98a1-9b8a12c4fd05', 'name': '', 'network_id': '0bab5ed1-b8b1-45ba-b633-5bee32c71edd', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:53:d1:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 898, 'fixed_ips': [{'subnet_id': 'abf2dc1a-091f-4460-a83f-5c4275733a2f', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:33:00Z', 'updated_at': '2021-11-09T04:33:09Z', 'revision_number': 5, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'abf2dc1a-091f-4460-a83f-5c4275733a2f', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '98741773-362a-4c6e-b503-923f0f367a2a', 'name': '', 'network_id': 'e1b06497-74dd-47e6-9b9a-79074e9bf0e8', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:d2:bc:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 847, 'fixed_ips': [{'subnet_id': 'f0939bd8-617d-4f5c-9f7b-272de792edac', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:43Z', 'updated_at': '2021-11-09T04:32:51Z', 'revision_number': 5, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'f0939bd8-617d-4f5c-9f7b-272de792edac', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'bf77ddc4-4ed9-472d-842b-1fb79d55e2e4', 'name': '', 'network_id': '35e2f2d1-ee40-4328-9fe2-48e5a5c19938', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:66:29:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 830, 'fixed_ips': [{'subnet_id': 'f60d3eec-6988-47b0-9f2f-6319fa99064d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:33Z', 'updated_at': '2021-11-09T04:32:44Z', 'revision_number': 5, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'f60d3eec-6988-47b0-9f2f-6319fa99064d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:11.122268 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d73c436c-d5fa-4f59-894f-14beff1a38e7 None None] The sync data for ids ['fa30d24d-d721-4675-ad7b-09f35105e633'] in dv-neutron-816802-2-hyperv is: [{'id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'name': 'tempest-RoutersTest-router-1490827103', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:32:29Z', 'updated_at': '2021-11-09T04:33:07Z', 'revision_number': 7, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'gw_port_host': None, '_interfaces': [{'id': '20195bcd-85f4-4bce-bae2-63cdf464f57f', 'name': '', 'network_id': '9e8670b3-5b0d-4ce5-8329-3af82c94231c', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:01:36:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 872, 'fixed_ips': [{'subnet_id': 'd7a7c5ae-922f-4fe2-ad19-b31fd352c9d1', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:52Z', 'updated_at': '2021-11-09T04:33:03Z', 'revision_number': 5, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'd7a7c5ae-922f-4fe2-ad19-b31fd352c9d1', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '3bdf32a7-774a-4983-98a1-9b8a12c4fd05', 'name': '', 'network_id': '0bab5ed1-b8b1-45ba-b633-5bee32c71edd', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:53:d1:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 898, 'fixed_ips': [{'subnet_id': 'abf2dc1a-091f-4460-a83f-5c4275733a2f', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:33:00Z', 'updated_at': '2021-11-09T04:33:09Z', 'revision_number': 5, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'abf2dc1a-091f-4460-a83f-5c4275733a2f', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '98741773-362a-4c6e-b503-923f0f367a2a', 'name': '', 'network_id': 'e1b06497-74dd-47e6-9b9a-79074e9bf0e8', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:d2:bc:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 847, 'fixed_ips': [{'subnet_id': 'f0939bd8-617d-4f5c-9f7b-272de792edac', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:43Z', 'updated_at': '2021-11-09T04:32:51Z', 'revision_number': 5, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'f0939bd8-617d-4f5c-9f7b-272de792edac', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'bf77ddc4-4ed9-472d-842b-1fb79d55e2e4', 'name': '', 'network_id': '35e2f2d1-ee40-4328-9fe2-48e5a5c19938', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:66:29:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 830, 'fixed_ips': [{'subnet_id': 'f60d3eec-6988-47b0-9f2f-6319fa99064d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:33Z', 'updated_at': '2021-11-09T04:32:44Z', 'revision_number': 5, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'f60d3eec-6988-47b0-9f2f-6319fa99064d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:33:11.125876 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81e776cf-8f08-45e1-9a96-4562f163a9f9 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event deleted for resources: {'Subnet': ['ID=cb7a4f2f-e10f-465c-a22b-b22e65acbf38,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:11.131117 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-81e776cf-8f08-45e1-9a96-4562f163a9f9 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:11.135417 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-81e776cf-8f08-45e1-9a96-4562f163a9f9 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/cb7a4f2f-e10f-465c-a22b-b22e65acbf38 HTTP/1.1" status: 204 len: 168 time: 1.4690466 Nov 09 04:33:11.138148 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56806) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:11.148056 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-9bf70763-3678-412c-a52e-847f53686f50 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Deleting port a0a06470-4c5f-4ee5-bd7e-e74cb33969da {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:33:11.148436 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9bf70763-3678-412c-a52e-847f53686f50 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:11.237459 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-12a76a52-5548-4c4f-8a94-96110531346a tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:11.240105 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-12a76a52-5548-4c4f-8a94-96110531346a tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:11.241295 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-12a76a52-5548-4c4f-8a94-96110531346a tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "DELETE /v2.0/security-groups/f79cf005-f764-4021-b546-a91aed6fc08d HTTP/1.1" status: 204 len: 168 time: 0.3796523 Nov 09 04:33:11.246064 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b678e3b-f2ca-4a64-bb52-645d05a12084 req-aa11c5c4-898e-44e3-b0ed-682ec5052ed7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:11.246495 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56808) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:11.247842 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2b678e3b-f2ca-4a64-bb52-645d05a12084 req-aa11c5c4-898e-44e3-b0ed-682ec5052ed7 service neutron] 10.222.0.26 "GET /v2.0/networks?id=9c94e7dc-d679-4a7e-b264-6d619dbc935e HTTP/1.1" status: 200 len: 898 time: 0.3260903 Nov 09 04:33:11.258648 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7f547ed1-1794-4f43-94e1-208367e3d89f req-acb23b88-edab-465f-b123-c3307fcb6521 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/security-groups?id=4ff68177-77d2-4250-b11c-4d5b55fd3619&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2234149 Nov 09 04:33:11.301413 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12a76a52-5548-4c4f-8a94-96110531346a tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=f79cf005-f764-4021-b546-a91aed6fc08d,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:11.330911 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-aa29e370-a39a-46aa-b6bc-2133bcfab02f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '20fa17b9-5a43-469e-a0de-e9be80c05f6f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1135837892', 'tenant_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.69'}], 'enable_snat': True}, 'gw_port_id': '8508be40-2af9-45a5-96f0-06d142f33d8d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:30:45Z', 'updated_at': '2021-11-09T04:31:03Z', 'revision_number': 4, 'project_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'gw_port': {'id': '8508be40-2af9-45a5-96f0-06d142f33d8d', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:95:95:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '20fa17b9-5a43-469e-a0de-e9be80c05f6f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 567, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:30:48Z', 'updated_at': '2021-11-09T04:30:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'bab3b0b2-ec0e-464a-b15f-1f71dc13f0f3', 'name': '', 'network_id': '9c94e7dc-d679-4a7e-b264-6d619dbc935e', 'tenant_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'mac_address': 'fa:16:3e:b2:bf:75', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '20fa17b9-5a43-469e-a0de-e9be80c05f6f', 'device_owner': 'network:router_interface', 'standard_attr_id': 610, 'fixed_ips': [{'subnet_id': '003822ea-7d1a-41fa-a15f-16fc8c9f624c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:31:00Z', 'updated_at': '2021-11-09T04:31:12Z', 'revision_number': 5, 'project_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'subnets': [{'id': '003822ea-7d1a-41fa-a15f-16fc8c9f624c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:11.359650 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-171b8dbb-a344-496d-9be5-b15c68984da7 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.1102345 Nov 09 04:33:11.366832 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-902b7c9d-400c-48f9-b0b6-d125aec5ec71 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Deleting subnet f6183641-d788-4054-bf47-99f434449c17 {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:33:11.367039 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aa29e370-a39a-46aa-b6bc-2133bcfab02f None None] The sync data for ids ['20fa17b9-5a43-469e-a0de-e9be80c05f6f'] in dv-neutron-816802-2-hyperv is: [{'id': '20fa17b9-5a43-469e-a0de-e9be80c05f6f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1135837892', 'tenant_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.69'}], 'enable_snat': True}, 'gw_port_id': '8508be40-2af9-45a5-96f0-06d142f33d8d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:30:45Z', 'updated_at': '2021-11-09T04:31:03Z', 'revision_number': 4, 'project_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'gw_port': {'id': '8508be40-2af9-45a5-96f0-06d142f33d8d', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:95:95:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '20fa17b9-5a43-469e-a0de-e9be80c05f6f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 567, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:30:48Z', 'updated_at': '2021-11-09T04:30:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'bab3b0b2-ec0e-464a-b15f-1f71dc13f0f3', 'name': '', 'network_id': '9c94e7dc-d679-4a7e-b264-6d619dbc935e', 'tenant_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'mac_address': 'fa:16:3e:b2:bf:75', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '20fa17b9-5a43-469e-a0de-e9be80c05f6f', 'device_owner': 'network:router_interface', 'standard_attr_id': 610, 'fixed_ips': [{'subnet_id': '003822ea-7d1a-41fa-a15f-16fc8c9f624c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:31:00Z', 'updated_at': '2021-11-09T04:31:12Z', 'revision_number': 5, 'project_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'subnets': [{'id': '003822ea-7d1a-41fa-a15f-16fc8c9f624c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:33:11.370278 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56810) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:11.376449 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-cf1ec479-1b99-4f61-8324-73c5130994ae tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Request body: {'security_group': {'name': 'tempest-secgroup--1420801290'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:11.381287 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2b678e3b-f2ca-4a64-bb52-645d05a12084 req-278c9018-fff9-47ab-85af-cd0f3f93a828 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=9c023fad-c8fa-4120-b9cc-4ea22c1718e4 HTTP/1.1" status: 200 len: 217 time: 0.0969219 Nov 09 04:33:11.382246 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-902b7c9d-400c-48f9-b0b6-d125aec5ec71 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:11.429561 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-902b7c9d-400c-48f9-b0b6-d125aec5ec71 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:11.482455 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-9bf70763-3678-412c-a52e-847f53686f50 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] For port a0a06470-4c5f-4ee5-bd7e-e74cb33969da, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=a0a06470-4c5f-4ee5-bd7e-e74cb33969da,segment=NetworkSegment(48c90ef7-c819-495a-b369-c2ba95c6d696),segment_id=48c90ef7-c819-495a-b369-c2ba95c6d696)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:33:11.482840 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9bf70763-3678-412c-a52e-847f53686f50 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:11.487708 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8b35978b-af73-453e-a0cb-5c7d3389b33c tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:11.489301 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 3ff49245-babc-4cfa-95cc-55873e124258 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:33:11.497988 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8d27b1bf-a065-4ab7-a3af-348f5d860300 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:11.527690 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-902b7c9d-400c-48f9-b0b6-d125aec5ec71 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:11.561531 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 3ff49245-babc-4cfa-95cc-55873e124258 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:11.561901 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:11.573754 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-9bf70763-3678-412c-a52e-847f53686f50 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Calling delete_port for a0a06470-4c5f-4ee5-bd7e-e74cb33969da owned by network:dhcp {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:33:11.633584 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b678e3b-f2ca-4a64-bb52-645d05a12084 req-3566025a-3bcc-423b-8a7f-a2d40d9b955e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:11.635715 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2b678e3b-f2ca-4a64-bb52-645d05a12084 req-3566025a-3bcc-423b-8a7f-a2d40d9b955e service neutron] 10.222.0.26 "GET /v2.0/subnets?id=003822ea-7d1a-41fa-a15f-16fc8c9f624c HTTP/1.1" status: 200 len: 834 time: 0.2373977 Nov 09 04:33:11.677819 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cf1ec479-1b99-4f61-8324-73c5130994ae tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:11.682490 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-902b7c9d-400c-48f9-b0b6-d125aec5ec71 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:11.737405 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-902b7c9d-400c-48f9-b0b6-d125aec5ec71 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:11.743499 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-902b7c9d-400c-48f9-b0b6-d125aec5ec71 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/f6183641-d788-4054-bf47-99f434449c17 HTTP/1.1" status: 204 len: 168 time: 0.6041918 Nov 09 04:33:11.744418 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-902b7c9d-400c-48f9-b0b6-d125aec5ec71 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event deleted for resources: {'Subnet': ['ID=f6183641-d788-4054-bf47-99f434449c17,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:11.746431 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56812) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:11.805869 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-470b9692-0f89-4630-9349-ffa145f701cd tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0558372 Nov 09 04:33:11.809813 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56814) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:11.816300 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-60ea6420-b2a8-4b5c-9099-53f93baf166a tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'subnet': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:11.819884 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b61c2fdd-ac7e-41f9-896e-ed58b2178b87 None None] New status for floating IP c68e1ebb-65d3-4c8e-b1c0-4ae8c774d9ed: DOWN {{(pid=102163) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 04:33:11.826375 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b678e3b-f2ca-4a64-bb52-645d05a12084 req-7e145e2f-e17f-4503-ab1f-95e0351b30fa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:11.827918 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2b678e3b-f2ca-4a64-bb52-645d05a12084 req-7e145e2f-e17f-4503-ab1f-95e0351b30fa service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=9c94e7dc-d679-4a7e-b264-6d619dbc935e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1839950 Nov 09 04:33:11.871827 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cf1ec479-1b99-4f61-8324-73c5130994ae tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:11.962098 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cf1ec479-1b99-4f61-8324-73c5130994ae tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:11.993015 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9bf70763-3678-412c-a52e-847f53686f50 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:12.005062 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf1ec479-1b99-4f61-8324-73c5130994ae tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Pushing event updated for resources: {'SecurityGroup': ['ID=da09d5cb-f9c9-4ac9-99b2-6538ee01f24a,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:12.035318 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bf70763-3678-412c-a52e-847f53686f50 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event deleted for resources: {'Port': ['ID=a0a06470-4c5f-4ee5-bd7e-e74cb33969da,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:12.043013 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9bf70763-3678-412c-a52e-847f53686f50 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] No DVR routers for this DVR port a0a06470-4c5f-4ee5-bd7e-e74cb33969da on host dv-neutron-816802-2-hyperv {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:33:12.084960 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-89b1ed48-0461-4de0-bc2a-cc0f12827285 None None] get_active_networks_info from dv-neutron-816802-2-hyperv {{(pid=102163) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}} Nov 09 04:33:12.094037 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cf1ec479-1b99-4f61-8324-73c5130994ae tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:12.096817 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-cf1ec479-1b99-4f61-8324-73c5130994ae tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.7235351 Nov 09 04:33:12.098939 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56816) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:12.104074 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-0a2376fb-9893-456c-871f-0a9b46ee5c0f tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Request body: {'security_group_rule': {'security_group_id': 'da09d5cb-f9c9-4ac9-99b2-6538ee01f24a', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_ip_prefix': '172.20.0.0/16'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:12.113852 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:12.134705 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a49fe3f0-f476-4056-af8b-583730ef1f61 req-264c1bfe-a3e9-451b-8132-1fae71d10e28 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:12.136369 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-a49fe3f0-f476-4056-af8b-583730ef1f61 req-264c1bfe-a3e9-451b-8132-1fae71d10e28 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.26 "GET /v2.0/ports?device_id=9c4e58e3-39e4-4212-b106-50b44d4c4e28 HTTP/1.1" status: 200 len: 945 time: 0.0782838 Nov 09 04:33:12.146559 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2b678e3b-f2ca-4a64-bb52-645d05a12084 req-bcb2badc-8259-443f-bf87-a2dad26abe98 service neutron] 10.222.0.26 "GET /v2.0/networks/9c94e7dc-d679-4a7e-b264-6d619dbc935e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2992876 Nov 09 04:33:12.209183 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-c95b1d3d-c223-4a3a-bae5-6d28b843181a None None] Provisioning complete for port 3ff49245-babc-4cfa-95cc-55873e124258 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:12.209601 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c95b1d3d-c223-4a3a-bae5-6d28b843181a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:12.212524 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-89b1ed48-0461-4de0-bc2a-cc0f12827285 None None] Resources bound (agent type, host, resource id): {{(pid=102163) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 09 04:33:12.216790 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9bf70763-3678-412c-a52e-847f53686f50 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:12.246905 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-60ea6420-b2a8-4b5c-9099-53f93baf166a tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:33:12.249915 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-60ea6420-b2a8-4b5c-9099-53f93baf166a tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:12.251290 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [req-a49fe3f0-f476-4056-af8b-583730ef1f61 req-5ca06323-7bd6-44f5-9862-6f426fd2cf7e tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Deleting port 9c023fad-c8fa-4120-b9cc-4ea22c1718e4 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:33:12.251699 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [req-a49fe3f0-f476-4056-af8b-583730ef1f61 req-5ca06323-7bd6-44f5-9862-6f426fd2cf7e tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:12.312265 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-9bf70763-3678-412c-a52e-847f53686f50 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f3f8d961-ce10-4756-a07a-6ea2265beb22']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:12.359052 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-9bf70763-3678-412c-a52e-847f53686f50 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '48c90ef7-c819-495a-b369-c2ba95c6d696') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:12.359335 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-9bf70763-3678-412c-a52e-847f53686f50 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '48c90ef7-c819-495a-b369-c2ba95c6d696') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:12.363609 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [req-a49fe3f0-f476-4056-af8b-583730ef1f61 req-5ca06323-7bd6-44f5-9862-6f426fd2cf7e tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] For port 9c023fad-c8fa-4120-b9cc-4ea22c1718e4, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=9c023fad-c8fa-4120-b9cc-4ea22c1718e4,segment=NetworkSegment(d5411e15-1506-4025-8472-ba7118358f68),segment_id=d5411e15-1506-4025-8472-ba7118358f68)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:33:12.364173 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [req-a49fe3f0-f476-4056-af8b-583730ef1f61 req-5ca06323-7bd6-44f5-9862-6f426fd2cf7e tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:12.389205 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [req-a49fe3f0-f476-4056-af8b-583730ef1f61 req-5ca06323-7bd6-44f5-9862-6f426fd2cf7e tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Calling delete_port for 9c023fad-c8fa-4120-b9cc-4ea22c1718e4 owned by compute:nova {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:33:12.404672 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9bf70763-3678-412c-a52e-847f53686f50 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:12.445131 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-0a2376fb-9893-456c-871f-0a9b46ee5c0f tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:33:12.447104 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9bf70763-3678-412c-a52e-847f53686f50 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:12.450492 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-0a2376fb-9893-456c-871f-0a9b46ee5c0f tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 351 time: 0.3503284 Nov 09 04:33:12.452507 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56820) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:12.467872 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-6808f775-f130-49ad-b0f9-82e2b6329016 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Request body: {'security_group_rule': {'security_group_id': 'da09d5cb-f9c9-4ac9-99b2-6538ee01f24a', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_ip_prefix': '2001:db8::/48'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:12.479541 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9bf70763-3678-412c-a52e-847f53686f50 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Releasing vlan 305 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:33:12.479950 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9bf70763-3678-412c-a52e-847f53686f50 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:12.486194 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-8b35978b-af73-453e-a0cb-5c7d3389b33c tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Deleting port 3bdf32a7-774a-4983-98a1-9b8a12c4fd05 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:33:12.486769 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8b35978b-af73-453e-a0cb-5c7d3389b33c tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:12.490039 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:33:12.490039 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:33:12.490039 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:33:12.490039 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:33:12.490039 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:33:12.490039 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:33:12.490039 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:33:12.490039 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:33:12.490039 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:33:12.490039 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:33:12.490039 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:33:12.490039 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:33:12.490039 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:33:12.490039 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:33:12.490039 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:33:12.490039 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:33:12.490039 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:33:12.490039 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:33:12.490039 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:33:12.490039 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:33:12.490039 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:33:12.490039 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:33:12.490039 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:33:12.490039 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:33:12.490039 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:33:12.490039 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:33:12.490039 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:33:12.490039 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:33:12.490039 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:33:12.490039 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:33:12.490039 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:33:12.490039 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:33:12.551561 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c1ae9a8-4f64-46b9-b9be-406a9fc13a8e req-a66ff38d-44bd-41bd-93e5-a88b215304dd tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:12.551561 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-5c1ae9a8-4f64-46b9-b9be-406a9fc13a8e req-a66ff38d-44bd-41bd-93e5-a88b215304dd tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/ports?device_id=9c4e58e3-39e4-4212-b106-50b44d4c4e28 HTTP/1.1" status: 200 len: 945 time: 0.1075158 Nov 09 04:33:12.608961 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-37910547-3adf-4c0c-a282-a20c4f5181e7 None None] Network f3f8d961-ce10-4756-a07a-6ea2265beb22 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:33:12.611867 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-52c6b60d-3227-4b9d-8392-498600ea26c4 None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:33:12.673589 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-5c1ae9a8-4f64-46b9-b9be-406a9fc13a8e req-32fc20e1-34fc-4bc6-8c36-97b98bf263aa tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/security-groups?id=4ff68177-77d2-4250-b11c-4d5b55fd3619&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1090715 Nov 09 04:33:12.736546 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-6808f775-f130-49ad-b0f9-82e2b6329016 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:33:12.740855 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-6808f775-f130-49ad-b0f9-82e2b6329016 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 351 time: 0.2801435 Nov 09 04:33:12.741730 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56822) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:12.750321 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-2b5cd1d1-a0b6-4826-99ef-c37a9e93ae91 None None] Provisioning complete for port 3ff49245-babc-4cfa-95cc-55873e124258 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:12.750829 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-2b5cd1d1-a0b6-4826-99ef-c37a9e93ae91 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:12.754198 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [req-a49fe3f0-f476-4056-af8b-583730ef1f61 req-5ca06323-7bd6-44f5-9862-6f426fd2cf7e tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:12.813652 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ca06323-7bd6-44f5-9862-6f426fd2cf7e tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Pushing event deleted for resources: {'Port': ['ID=9c023fad-c8fa-4120-b9cc-4ea22c1718e4,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:12.874343 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [req-a49fe3f0-f476-4056-af8b-583730ef1f61 req-5ca06323-7bd6-44f5-9862-6f426fd2cf7e tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] No DVR routers for this DVR port 9c023fad-c8fa-4120-b9cc-4ea22c1718e4 on host hv-neutron-8168 {{(pid=102161) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:33:12.880664 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [req-a49fe3f0-f476-4056-af8b-583730ef1f61 req-5ca06323-7bd6-44f5-9862-6f426fd2cf7e tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:12.888069 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-a49fe3f0-f476-4056-af8b-583730ef1f61 req-5ca06323-7bd6-44f5-9862-6f426fd2cf7e tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.26 "DELETE /v2.0/ports/9c023fad-c8fa-4120-b9cc-4ea22c1718e4 HTTP/1.1" status: 204 len: 173 time: 0.7414391 Nov 09 04:33:12.890930 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9c4e58e3-39e4-4212-b106-50b44d4c4e28', 'name': 'network-vif-deleted', 'tag': '9c023fad-c8fa-4120-b9cc-4ea22c1718e4'}] {{(pid=102161) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:33:12.893671 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}99dfdda0def497b4372884ef2eb87f06b1e425c8eba5ceda5f64bbab037a07d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-593a6fa5-fd1e-4ecb-9795-4a84383cd57a" -d '{"events": [{"server_uuid": "9c4e58e3-39e4-4212-b106-50b44d4c4e28", "name": "network-vif-deleted", "tag": "9c023fad-c8fa-4120-b9cc-4ea22c1718e4"}]}' {{(pid=102161) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:33:12.937405 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7db7fe88-4005-4c47-b3d0-337c90a9ada7 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:12.951811 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2b678e3b-f2ca-4a64-bb52-645d05a12084 req-5dc6c324-4fde-4bee-8e7a-203842da5e46 service neutron] 10.222.0.26 "GET /v2.0/networks/9c94e7dc-d679-4a7e-b264-6d619dbc935e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7645962 Nov 09 04:33:12.963406 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:33:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b623eb8e-f29e-4193-9a40-01e13f74a5c2 x-openstack-request-id: req-b623eb8e-f29e-4193-9a40-01e13f74a5c2 {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:33:12.963701 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9c4e58e3-39e4-4212-b106-50b44d4c4e28", "name": "network-vif-deleted", "tag": "9c023fad-c8fa-4120-b9cc-4ea22c1718e4", "status": "completed", "code": 200}]} {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:33:12.963970 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-b623eb8e-f29e-4193-9a40-01e13f74a5c2 {{(pid=102161) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:33:12.964352 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9c4e58e3-39e4-4212-b106-50b44d4c4e28', 'name': 'network-vif-deleted', 'tag': '9c023fad-c8fa-4120-b9cc-4ea22c1718e4', 'status': 'completed', 'code': 200} Nov 09 04:33:13.008617 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7db7fe88-4005-4c47-b3d0-337c90a9ada7 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:13.061014 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2e35b855-9370-41b3-80a7-933d190fa27c None None] DHCP port deletion for 988d2354-693c-4d52-af17-25e0643eaa0c request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:33:13.103687 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-05ee447e-4621-4111-92ba-6f512f27ec57 None None] DHCP port deletion for f3f8d961-ce10-4756-a07a-6ea2265beb22 request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:33:13.114023 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-8b35978b-af73-453e-a0cb-5c7d3389b33c tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] For port 3bdf32a7-774a-4983-98a1-9b8a12c4fd05, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=3bdf32a7-774a-4983-98a1-9b8a12c4fd05,segment=NetworkSegment(4adb05ec-46fe-428a-86b2-7b7107e35fdd),segment_id=4adb05ec-46fe-428a-86b2-7b7107e35fdd)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:33:13.118372 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8b35978b-af73-453e-a0cb-5c7d3389b33c tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:13.126154 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7db7fe88-4005-4c47-b3d0-337c90a9ada7 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:13.126154 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7db7fe88-4005-4c47-b3d0-337c90a9ada7 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:13.127270 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9bf70763-3678-412c-a52e-847f53686f50 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:13.127864 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-7db7fe88-4005-4c47-b3d0-337c90a9ada7 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "DELETE /v2.0/security-groups/da09d5cb-f9c9-4ac9-99b2-6538ee01f24a HTTP/1.1" status: 204 len: 168 time: 0.3839104 Nov 09 04:33:13.130214 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56826) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:13.134107 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-2e35b855-9370-41b3-80a7-933d190fa27c None None] Deleting port 3ff49245-babc-4cfa-95cc-55873e124258 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:33:13.134801 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-2e35b855-9370-41b3-80a7-933d190fa27c None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:13.144346 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7db7fe88-4005-4c47-b3d0-337c90a9ada7 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=da09d5cb-f9c9-4ac9-99b2-6538ee01f24a,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:13.159685 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-8b35978b-af73-453e-a0cb-5c7d3389b33c tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Calling delete_port for 3bdf32a7-774a-4983-98a1-9b8a12c4fd05 owned by network:router_interface {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:33:13.170378 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9bf70763-3678-412c-a52e-847f53686f50 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:13.173591 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-9bf70763-3678-412c-a52e-847f53686f50 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "DELETE /v2.0/networks/f3f8d961-ce10-4756-a07a-6ea2265beb22 HTTP/1.1" status: 204 len: 168 time: 2.9826632 Nov 09 04:33:13.178097 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56828) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:13.185483 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-e8adffb3-c1ff-4e51-a8f4-22c66f25080c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-2016056388'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:13.205690 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bf70763-3678-412c-a52e-847f53686f50 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event deleted for resources: {'Network': ['ID=f3f8d961-ce10-4756-a07a-6ea2265beb22,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:13.217749 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-f18701c5-5cb8-47e9-9b1b-b6b4c9957481 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.0788338 Nov 09 04:33:13.220529 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56830) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:13.226098 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-71cc1ed5-0985-4514-b857-739f867398b3 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Request body: {'security_group': {'name': 'tempest-secgroup--1138082014'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:13.255862 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-2e35b855-9370-41b3-80a7-933d190fa27c None None] For port 3ff49245-babc-4cfa-95cc-55873e124258, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=3ff49245-babc-4cfa-95cc-55873e124258,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:33:13.257188 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-2e35b855-9370-41b3-80a7-933d190fa27c None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:13.275273 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-2e35b855-9370-41b3-80a7-933d190fa27c None None] Calling delete_port for 3ff49245-babc-4cfa-95cc-55873e124258 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:33:13.332942 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-60ea6420-b2a8-4b5c-9099-53f93baf166a tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:13.339712 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e8adffb3-c1ff-4e51-a8f4-22c66f25080c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Made reservation on behalf of 12e47d8445b5429892cd1b9244512ca8 for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:33:13.345792 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e8adffb3-c1ff-4e51-a8f4-22c66f25080c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:13.395035 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-60ea6420-b2a8-4b5c-9099-53f93baf166a tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:33:13.405990 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-60ea6420-b2a8-4b5c-9099-53f93baf166a tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:33:13.414554 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-60ea6420-b2a8-4b5c-9099-53f93baf166a tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:13.415319 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-60ea6420-b2a8-4b5c-9099-53f93baf166a tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:13.435428 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60ea6420-b2a8-4b5c-9099-53f93baf166a tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Subnet': ['ID=5d327042-2b73-4cd6-9415-7970deef9f1f,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:13.462689 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-2e35b855-9370-41b3-80a7-933d190fa27c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:13.468871 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:33:13.489232 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-71cc1ed5-0985-4514-b857-739f867398b3 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:13.489878 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e35b855-9370-41b3-80a7-933d190fa27c None None] Pushing event deleted for resources: {'Port': ['ID=3ff49245-babc-4cfa-95cc-55873e124258,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:13.492597 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2e35b855-9370-41b3-80a7-933d190fa27c None None] No DVR routers for this DVR port 3ff49245-babc-4cfa-95cc-55873e124258 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:33:13.513251 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-20c62e54-428d-446d-9961-fbc0cbf3fc32 None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:33:13.561781 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-71cc1ed5-0985-4514-b857-739f867398b3 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:13.574500 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8b35978b-af73-453e-a0cb-5c7d3389b33c tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:13.580046 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e8adffb3-c1ff-4e51-a8f4-22c66f25080c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 331} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:33:13.601035 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b35978b-af73-453e-a0cb-5c7d3389b33c tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event deleted for resources: {'Port': ['ID=3bdf32a7-774a-4983-98a1-9b8a12c4fd05,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:13.603244 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e8adffb3-c1ff-4e51-a8f4-22c66f25080c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:13.604959 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-e8adffb3-c1ff-4e51-a8f4-22c66f25080c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Added segment 201b1b4b-3524-4db3-a248-d7e7fd388c3f of type vlan for network ab0b8074-97a9-41d7-9124-7c9d6548032d Nov 09 04:33:13.616404 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-60ea6420-b2a8-4b5c-9099-53f93baf166a tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.8015349 Nov 09 04:33:13.618500 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56832) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:13.623636 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-c358a50e-6578-44ab-bb29-48e40bc11110 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'subnet': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:13.674190 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-71cc1ed5-0985-4514-b857-739f867398b3 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:13.705604 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7acd772c-6563-4087-8538-5f28c5f5b64a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:13.724295 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7e7b6135-0f59-43bd-8ad5-adcf5836535f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-988d2354-693c-4d52-af17-25e0643eaa0c', 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'tenant_id': '8b0758f781884982bf5b94e6609237f6', 'fixed_ips': [{'subnet_id': '5d327042-2b73-4cd6-9415-7970deef9f1f'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:33:13.726001 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7e7b6135-0f59-43bd-8ad5-adcf5836535f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:13.751516 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e8adffb3-c1ff-4e51-a8f4-22c66f25080c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:13.798014 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71cc1ed5-0985-4514-b857-739f867398b3 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Pushing event updated for resources: {'SecurityGroup': ['ID=fab8acaa-4f71-4bde-ba33-411a5077c3a4,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:13.818295 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8b35978b-af73-453e-a0cb-5c7d3389b33c tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:13.874952 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d2e528cf-aaf5-4291-bdc8-ee08dc24e419 req-435ab211-8136-4e3f-a45e-72a7eb28aca4 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "GET /v2.0/ports?device_id=9c4e58e3-39e4-4212-b106-50b44d4c4e28 HTTP/1.1" status: 200 len: 210 time: 0.0403998 Nov 09 04:33:13.880080 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-71cc1ed5-0985-4514-b857-739f867398b3 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:13.881403 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-71cc1ed5-0985-4514-b857-739f867398b3 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.6593540 Nov 09 04:33:13.884685 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56838) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:13.891261 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-aaad585c-12dc-4ae7-9006-ce312f50faf4 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Request body: {'security_group': {'name': 'default'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:13.891375 dv-neutron-816802-2-hyperv neutron-server[102161]: WARNING neutron.api.v2.base [None req-aaad585c-12dc-4ae7-9006-ce312f50faf4 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] An exception happened while processing the request body. The exception message is [Default security group already exists.].: neutron.extensions.securitygroup.SecurityGroupDefaultAlreadyExists: Default security group already exists. Nov 09 04:33:13.894345 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-aaad585c-12dc-4ae7-9006-ce312f50faf4 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] update failed (client error): There was a conflict when trying to complete your request. Nov 09 04:33:13.897933 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-aaad585c-12dc-4ae7-9006-ce312f50faf4 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "PUT /v2.0/security-groups/fab8acaa-4f71-4bde-ba33-411a5077c3a4 HTTP/1.1" status: 409 len: 330 time: 0.0097816 Nov 09 04:33:13.898470 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56840) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:13.968246 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0a6b1508-2210-4245-bae3-9e7a7e8ba0a6 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:13.980526 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e8adffb3-c1ff-4e51-a8f4-22c66f25080c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:13.983431 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-7e7b6135-0f59-43bd-8ad5-adcf5836535f None None] Allocated IP 172.20.0.2 (988d2354-693c-4d52-af17-25e0643eaa0c/5d327042-2b73-4cd6-9415-7970deef9f1f/1e4c4297-f9b1-473b-a97a-22003faa3119) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:33:13.986449 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e8adffb3-c1ff-4e51-a8f4-22c66f25080c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:13.987041 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e8adffb3-c1ff-4e51-a8f4-22c66f25080c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:14.026036 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c358a50e-6578-44ab-bb29-48e40bc11110 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:33:14.030102 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c358a50e-6578-44ab-bb29-48e40bc11110 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:14.051269 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0a6b1508-2210-4245-bae3-9e7a7e8ba0a6 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:14.123864 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8b35978b-af73-453e-a0cb-5c7d3389b33c tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Router fa30d24d-d721-4675-ad7b-09f35105e633 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:33:14.165792 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-e8adffb3-c1ff-4e51-a8f4-22c66f25080c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 0.9826088 Nov 09 04:33:14.170694 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56842) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:14.177165 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-e5f03291-8fce-46a7-ade6-ccb40647836a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Request body: {'subnet': {'network_id': 'ab0b8074-97a9-41d7-9124-7c9d6548032d', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:14.179477 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8adffb3-c1ff-4e51-a8f4-22c66f25080c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event updated for resources: {'Network': ['ID=ab0b8074-97a9-41d7-9124-7c9d6548032d,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:14.179700 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7e7b6135-0f59-43bd-8ad5-adcf5836535f None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:14.204040 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network ab0b8074-97a9-41d7-9124-7c9d6548032d details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:33:14.263654 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7e7b6135-0f59-43bd-8ad5-adcf5836535f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:14.292788 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0a6b1508-2210-4245-bae3-9e7a7e8ba0a6 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:14.295891 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0a6b1508-2210-4245-bae3-9e7a7e8ba0a6 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:14.299554 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-0a6b1508-2210-4245-bae3-9e7a7e8ba0a6 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "DELETE /v2.0/security-groups/fab8acaa-4f71-4bde-ba33-411a5077c3a4 HTTP/1.1" status: 204 len: 168 time: 0.3976004 Nov 09 04:33:14.301037 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56844) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:14.308968 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8b35978b-af73-453e-a0cb-5c7d3389b33c tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:33:14.310389 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a6b1508-2210-4245-bae3-9e7a7e8ba0a6 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=fab8acaa-4f71-4bde-ba33-411a5077c3a4,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:14.311750 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7e7b6135-0f59-43bd-8ad5-adcf5836535f None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:33:14.317188 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-8b35978b-af73-453e-a0cb-5c7d3389b33c tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "PUT /v2.0/routers/fa30d24d-d721-4675-ad7b-09f35105e633/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 4.8676066 Nov 09 04:33:14.318597 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-7e7b6135-0f59-43bd-8ad5-adcf5836535f None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:33:14.321967 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7e7b6135-0f59-43bd-8ad5-adcf5836535f None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:33:14.326682 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9de279f9-9eec-4ae7-bf4d-bf3727f7a6a1 None None] Sync routers for ids ['fa30d24d-d721-4675-ad7b-09f35105e633'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:33:14.330040 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7b6135-0f59-43bd-8ad5-adcf5836535f None None] Pushing event updated for resources: {'Port': ['ID=1e4c4297-f9b1-473b-a97a-22003faa3119,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:14.342192 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56846) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:14.347230 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9de279f9-9eec-4ae7-bf4d-bf3727f7a6a1 None None] Routers {'fa30d24d-d721-4675-ad7b-09f35105e633'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:33:14.351190 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-9de279f9-9eec-4ae7-bf4d-bf3727f7a6a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:33:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['fa30d24d-d721-4675-ad7b-09f35105e633'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:14.390655 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-7e7b6135-0f59-43bd-8ad5-adcf5836535f None None] Attempting to bind port 1e4c4297-f9b1-473b-a97a-22003faa3119 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:33:14.391293 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-7e7b6135-0f59-43bd-8ad5-adcf5836535f None None] Attempting to bind port 1e4c4297-f9b1-473b-a97a-22003faa3119 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:33:14.391967 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7e7b6135-0f59-43bd-8ad5-adcf5836535f None None] Attempting to bind port 1e4c4297-f9b1-473b-a97a-22003faa3119 on network 988d2354-693c-4d52-af17-25e0643eaa0c {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:33:14.401980 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7e7b6135-0f59-43bd-8ad5-adcf5836535f None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 32, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:33:14.402542 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7e7b6135-0f59-43bd-8ad5-adcf5836535f None None] Checking segment: {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:33:14.402929 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7e7b6135-0f59-43bd-8ad5-adcf5836535f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:14.403327 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7e7b6135-0f59-43bd-8ad5-adcf5836535f None None] Bound using segment: {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:33:14.403856 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-7e7b6135-0f59-43bd-8ad5-adcf5836535f None None] Bound port: 1e4c4297-f9b1-473b-a97a-22003faa3119, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:33:14.404583 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7e7b6135-0f59-43bd-8ad5-adcf5836535f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:14.415276 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e5f03291-8fce-46a7-ade6-ccb40647836a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Made reservation on behalf of 12e47d8445b5429892cd1b9244512ca8 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:33:14.419805 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e5f03291-8fce-46a7-ade6-ccb40647836a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:14.476976 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-9de279f9-9eec-4ae7-bf4d-bf3727f7a6a1 None None] Set router fa30d24d-d721-4675-ad7b-09f35105e633 gateway port host: None {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:33:14.483909 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-7e7b6135-0f59-43bd-8ad5-adcf5836535f None None] For port 1e4c4297-f9b1-473b-a97a-22003faa3119, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:33:14.487149 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-7e7b6135-0f59-43bd-8ad5-adcf5836535f None None] For port 1e4c4297-f9b1-473b-a97a-22003faa3119, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=1e4c4297-f9b1-473b-a97a-22003faa3119,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:33:14.497731 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-101d64f5-b005-4a32-8798-6aa77fbf060d tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Deleting subnet abf2dc1a-091f-4460-a83f-5c4275733a2f {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:33:14.512516 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-684f7907-246f-4f61-baf3-82b3936f9a12 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.2068448 Nov 09 04:33:14.512516 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-101d64f5-b005-4a32-8798-6aa77fbf060d tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:14.520296 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56848) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:14.533605 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-fb66cab0-6f64-444e-843b-7f6d9c9e2a06 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] delete failed (client error): The resource could not be found. Nov 09 04:33:14.534904 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-fb66cab0-6f64-444e-843b-7f6d9c9e2a06 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "DELETE /v2.0/security-groups/4ee32da9-b180-4d89-aeef-89a4f01af261 HTTP/1.1" status: 404 len: 347 time: 0.0134077 Nov 09 04:33:14.539879 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56850) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:14.579329 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.api.v2.resource [None req-80d5c2ad-c268-40be-b708-6c4c909058b5 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] show failed (client error): The resource could not be found. Nov 09 04:33:14.586831 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7e7b6135-0f59-43bd-8ad5-adcf5836535f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:14.587005 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-80d5c2ad-c268-40be-b708-6c4c909058b5 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "GET /v2.0/security-groups/fa5d2d8a-d362-4bbd-b481-bb60522ab1c9 HTTP/1.1" status: 404 len: 347 time: 0.0378368 Nov 09 04:33:14.587097 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56852) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:14.589016 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-101d64f5-b005-4a32-8798-6aa77fbf060d tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:14.630125 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-544d0374-60b2-453e-888f-8dac5c990188 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] show failed (client error): The resource could not be found. Nov 09 04:33:14.653315 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-544d0374-60b2-453e-888f-8dac5c990188 tempest-NegativeSecGroupIPv6Test-263242322 tempest-NegativeSecGroupIPv6Test-263242322-project] 10.222.0.24 "GET /v2.0/security-group-rules/e00a0ec4-8aa1-4624-abfe-5e4714502c28 HTTP/1.1" status: 404 len: 356 time: 0.0603926 Nov 09 04:33:14.704629 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7b6135-0f59-43bd-8ad5-adcf5836535f None None] Pushing event updated for resources: {'Port': ['ID=1e4c4297-f9b1-473b-a97a-22003faa3119,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:14.766209 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device a0a06470-4c5f-4ee5-bd7e-e74cb33969da no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:33:14.797276 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-101d64f5-b005-4a32-8798-6aa77fbf060d tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:14.806195 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: a0a06470-4c5f-4ee5-bd7e-e74cb33969da {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:33:14.806709 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device a0a06470-4c5f-4ee5-bd7e-e74cb33969da not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:33:14.813348 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 3ff49245-babc-4cfa-95cc-55873e124258 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:33:14.831229 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-9de279f9-9eec-4ae7-bf4d-bf3727f7a6a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'name': 'tempest-RoutersTest-router-1490827103', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:32:29Z', 'updated_at': '2021-11-09T04:33:13Z', 'revision_number': 8, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'gw_port_host': None, '_interfaces': [{'id': '20195bcd-85f4-4bce-bae2-63cdf464f57f', 'name': '', 'network_id': '9e8670b3-5b0d-4ce5-8329-3af82c94231c', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:01:36:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 872, 'fixed_ips': [{'subnet_id': 'd7a7c5ae-922f-4fe2-ad19-b31fd352c9d1', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:52Z', 'updated_at': '2021-11-09T04:33:03Z', 'revision_number': 5, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'd7a7c5ae-922f-4fe2-ad19-b31fd352c9d1', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '98741773-362a-4c6e-b503-923f0f367a2a', 'name': '', 'network_id': 'e1b06497-74dd-47e6-9b9a-79074e9bf0e8', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:d2:bc:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 847, 'fixed_ips': [{'subnet_id': 'f0939bd8-617d-4f5c-9f7b-272de792edac', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:43Z', 'updated_at': '2021-11-09T04:32:51Z', 'revision_number': 5, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'f0939bd8-617d-4f5c-9f7b-272de792edac', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'bf77ddc4-4ed9-472d-842b-1fb79d55e2e4', 'name': '', 'network_id': '35e2f2d1-ee40-4328-9fe2-48e5a5c19938', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:66:29:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 830, 'fixed_ips': [{'subnet_id': 'f60d3eec-6988-47b0-9f2f-6319fa99064d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:33Z', 'updated_at': '2021-11-09T04:32:44Z', 'revision_number': 5, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'f60d3eec-6988-47b0-9f2f-6319fa99064d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:14.858907 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 3ff49245-babc-4cfa-95cc-55873e124258 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:33:14.859758 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 3ff49245-babc-4cfa-95cc-55873e124258 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:33:14.864190 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.objects.ports [None req-c358a50e-6578-44ab-bb29-48e40bc11110 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=102161) get_objects /opt/stack/neutron/neutron/objects/ports.py:444}} Nov 09 04:33:14.900671 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9de279f9-9eec-4ae7-bf4d-bf3727f7a6a1 None None] Checking router: fa30d24d-d721-4675-ad7b-09f35105e633 for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:33:14.919393 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9de279f9-9eec-4ae7-bf4d-bf3727f7a6a1 None None] Routers {'fa30d24d-d721-4675-ad7b-09f35105e633'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:33:14.920348 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-9de279f9-9eec-4ae7-bf4d-bf3727f7a6a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:33:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['fa30d24d-d721-4675-ad7b-09f35105e633'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:14.946611 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e5f03291-8fce-46a7-ade6-ccb40647836a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:15.004516 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56858) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:15.041323 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-101d64f5-b005-4a32-8798-6aa77fbf060d tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:15.082184 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-101d64f5-b005-4a32-8798-6aa77fbf060d tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:15.084885 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2dc197f7-9ff0-41af-a3e8-d60a21305615 None None] Network 0bab5ed1-b8b1-45ba-b633-5bee32c71edd requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:33:15.087435 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-101d64f5-b005-4a32-8798-6aa77fbf060d tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "DELETE /v2.0/subnets/abf2dc1a-091f-4460-a83f-5c4275733a2f HTTP/1.1" status: 204 len: 168 time: 0.7440128 Nov 09 04:33:15.090971 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56860) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:15.104454 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5f03291-8fce-46a7-ade6-ccb40647836a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event updated for resources: {'Subnet': ['ID=aec9d80c-825b-434b-b01c-c5b0a638be76,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:15.137282 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-101d64f5-b005-4a32-8798-6aa77fbf060d tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event deleted for resources: {'Subnet': ['ID=abf2dc1a-091f-4460-a83f-5c4275733a2f,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:15.152665 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e5f03291-8fce-46a7-ade6-ccb40647836a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Checking segment: {'id': '201b1b4b-3524-4db3-a248-d7e7fd388c3f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 331, 'network_id': 'ab0b8074-97a9-41d7-9124-7c9d6548032d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:33:15.153031 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e5f03291-8fce-46a7-ade6-ccb40647836a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Network hostable DHCP agents. Network: ab0b8074-97a9-41d7-9124-7c9d6548032d, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:33:15.179852 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:15.198511 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-9de279f9-9eec-4ae7-bf4d-bf3727f7a6a1 None None] Set router fa30d24d-d721-4675-ad7b-09f35105e633 gateway port host: None {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:33:15.255459 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1aa501a1-9c94-4b5e-acca-11687a255947 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:15.272791 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e5f03291-8fce-46a7-ade6-ccb40647836a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Network ab0b8074-97a9-41d7-9124-7c9d6548032d is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:33:15.331326 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-e5f03291-8fce-46a7-ade6-ccb40647836a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, ab0b8074-97a9-41d7-9124-7c9d6548032d) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:33:15.349447 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e5f03291-8fce-46a7-ade6-ccb40647836a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:15.352704 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e5f03291-8fce-46a7-ade6-ccb40647836a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:15.376831 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c358a50e-6578-44ab-bb29-48e40bc11110 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:15.412713 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bf7d2338-39ef-49b0-98e7-434794d885d9 None None] Network ab0b8074-97a9-41d7-9124-7c9d6548032d requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:33:15.420741 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56864) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:15.458044 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e5f03291-8fce-46a7-ade6-ccb40647836a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.2835026 Nov 09 04:33:15.458882 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56868) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:15.467628 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-8292b43d-d935-44d6-8d89-ef133eee9d59 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Request body: {'router': {'name': 'tempest-PortsIpV6TestJSON-router-517889674', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:15.557843 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-9de279f9-9eec-4ae7-bf4d-bf3727f7a6a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'name': 'tempest-RoutersTest-router-1490827103', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:32:29Z', 'updated_at': '2021-11-09T04:33:13Z', 'revision_number': 8, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'gw_port_host': None, '_interfaces': [{'id': '20195bcd-85f4-4bce-bae2-63cdf464f57f', 'name': '', 'network_id': '9e8670b3-5b0d-4ce5-8329-3af82c94231c', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:01:36:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 872, 'fixed_ips': [{'subnet_id': 'd7a7c5ae-922f-4fe2-ad19-b31fd352c9d1', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:52Z', 'updated_at': '2021-11-09T04:33:03Z', 'revision_number': 5, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'd7a7c5ae-922f-4fe2-ad19-b31fd352c9d1', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '98741773-362a-4c6e-b503-923f0f367a2a', 'name': '', 'network_id': 'e1b06497-74dd-47e6-9b9a-79074e9bf0e8', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:d2:bc:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 847, 'fixed_ips': [{'subnet_id': 'f0939bd8-617d-4f5c-9f7b-272de792edac', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:43Z', 'updated_at': '2021-11-09T04:32:51Z', 'revision_number': 5, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'f0939bd8-617d-4f5c-9f7b-272de792edac', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'bf77ddc4-4ed9-472d-842b-1fb79d55e2e4', 'name': '', 'network_id': '35e2f2d1-ee40-4328-9fe2-48e5a5c19938', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:66:29:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 830, 'fixed_ips': [{'subnet_id': 'f60d3eec-6988-47b0-9f2f-6319fa99064d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:33Z', 'updated_at': '2021-11-09T04:32:44Z', 'revision_number': 5, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'f60d3eec-6988-47b0-9f2f-6319fa99064d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:15.587261 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8292b43d-d935-44d6-8d89-ef133eee9d59 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:15.588653 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8292b43d-d935-44d6-8d89-ef133eee9d59 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:15.598615 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9de279f9-9eec-4ae7-bf4d-bf3727f7a6a1 None None] The sync data for ids ['fa30d24d-d721-4675-ad7b-09f35105e633'] in dv-neutron-816802-2-hyperv is: [{'id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'name': 'tempest-RoutersTest-router-1490827103', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:32:29Z', 'updated_at': '2021-11-09T04:33:13Z', 'revision_number': 8, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'gw_port_host': None, '_interfaces': [{'id': '20195bcd-85f4-4bce-bae2-63cdf464f57f', 'name': '', 'network_id': '9e8670b3-5b0d-4ce5-8329-3af82c94231c', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:01:36:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 872, 'fixed_ips': [{'subnet_id': 'd7a7c5ae-922f-4fe2-ad19-b31fd352c9d1', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:52Z', 'updated_at': '2021-11-09T04:33:03Z', 'revision_number': 5, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'd7a7c5ae-922f-4fe2-ad19-b31fd352c9d1', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '98741773-362a-4c6e-b503-923f0f367a2a', 'name': '', 'network_id': 'e1b06497-74dd-47e6-9b9a-79074e9bf0e8', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:d2:bc:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 847, 'fixed_ips': [{'subnet_id': 'f0939bd8-617d-4f5c-9f7b-272de792edac', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:43Z', 'updated_at': '2021-11-09T04:32:51Z', 'revision_number': 5, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'f0939bd8-617d-4f5c-9f7b-272de792edac', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'bf77ddc4-4ed9-472d-842b-1fb79d55e2e4', 'name': '', 'network_id': '35e2f2d1-ee40-4328-9fe2-48e5a5c19938', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:66:29:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 830, 'fixed_ips': [{'subnet_id': 'f60d3eec-6988-47b0-9f2f-6319fa99064d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:33Z', 'updated_at': '2021-11-09T04:32:44Z', 'revision_number': 5, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'f60d3eec-6988-47b0-9f2f-6319fa99064d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:33:15.620370 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-1aa501a1-9c94-4b5e-acca-11687a255947 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Deleting port 3653fdce-278e-4d4b-b712-fb2641dbb781 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:33:15.620370 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1aa501a1-9c94-4b5e-acca-11687a255947 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:15.710824 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8292b43d-d935-44d6-8d89-ef133eee9d59 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:15.736272 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-79155ac8-d137-4a07-b48b-d05635fd9fa1 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-ab0b8074-97a9-41d7-9124-7c9d6548032d', 'network_id': 'ab0b8074-97a9-41d7-9124-7c9d6548032d', 'tenant_id': '12e47d8445b5429892cd1b9244512ca8', 'fixed_ips': [{'subnet_id': 'aec9d80c-825b-434b-b01c-c5b0a638be76'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:33:15.737820 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-79155ac8-d137-4a07-b48b-d05635fd9fa1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:15.746033 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-f439fd98-be1a-4664-a9c8-3b36d61e43b1 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=7ab8c5da87614044ba13ccf0c18cd124&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3225386 Nov 09 04:33:15.749843 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56870) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:15.772309 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-c358a50e-6578-44ab-bb29-48e40bc11110 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] For port 1e4c4297-f9b1-473b-a97a-22003faa3119, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=1e4c4297-f9b1-473b-a97a-22003faa3119,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:33:15.778112 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-1aa501a1-9c94-4b5e-acca-11687a255947 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] For port 3653fdce-278e-4d4b-b712-fb2641dbb781, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=3653fdce-278e-4d4b-b712-fb2641dbb781,segment=NetworkSegment(4adb05ec-46fe-428a-86b2-7b7107e35fdd),segment_id=4adb05ec-46fe-428a-86b2-7b7107e35fdd)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:33:15.779116 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1aa501a1-9c94-4b5e-acca-11687a255947 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:15.784684 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8292b43d-d935-44d6-8d89-ef133eee9d59 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:15.810375 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-1aa501a1-9c94-4b5e-acca-11687a255947 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Calling delete_port for 3653fdce-278e-4d4b-b712-fb2641dbb781 owned by network:dhcp {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:33:15.827956 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e7353e63-4c66-46d0-b6b8-89cd38d07350 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:15.836099 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c358a50e-6578-44ab-bb29-48e40bc11110 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:15.856688 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e7353e63-4c66-46d0-b6b8-89cd38d07350 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:15.906326 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8292b43d-d935-44d6-8d89-ef133eee9d59 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:15.910414 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-8292b43d-d935-44d6-8d89-ef133eee9d59 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 705 time: 0.4472992 Nov 09 04:33:15.910975 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56872) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:15.916766 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-98d0153f-73e1-48b7-aace-fcab69996929 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Request body: {'port': {'network_id': 'ab0b8074-97a9-41d7-9124-7c9d6548032d', 'name': 'tempest-PortsIpV6TestJSON-912845665'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:15.932920 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c358a50e-6578-44ab-bb29-48e40bc11110 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:15.933443 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c358a50e-6578-44ab-bb29-48e40bc11110 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:15.961507 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 9c023fad-c8fa-4120-b9cc-4ea22c1718e4 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:33:15.965415 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-79155ac8-d137-4a07-b48b-d05635fd9fa1 None None] Allocated IP 2001:db8::2 (ab0b8074-97a9-41d7-9124-7c9d6548032d/aec9d80c-825b-434b-b01c-c5b0a638be76/3c3189c5-4de3-41eb-acd8-21a984377732) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:33:15.993753 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] No Port match for: 9c023fad-c8fa-4120-b9cc-4ea22c1718e4 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:33:15.994180 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 9c023fad-c8fa-4120-b9cc-4ea22c1718e4 not bound to the agent host hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:33:16.000832 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-82a54d66-4dfd-4e1d-8473-ab064f66bc4a None None] DHCP port deletion for 0bab5ed1-b8b1-45ba-b633-5bee32c71edd request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:33:16.056909 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c358a50e-6578-44ab-bb29-48e40bc11110 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:33:16.066901 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1aa501a1-9c94-4b5e-acca-11687a255947 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:16.077965 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-c358a50e-6578-44ab-bb29-48e40bc11110 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:33:16.087299 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e7353e63-4c66-46d0-b6b8-89cd38d07350 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:16.090723 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e7353e63-4c66-46d0-b6b8-89cd38d07350 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:16.096895 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e7353e63-4c66-46d0-b6b8-89cd38d07350 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/3b60d16d-37ff-4257-bd8d-ec6198b1398e HTTP/1.1" status: 204 len: 168 time: 0.3403747 Nov 09 04:33:16.107557 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c358a50e-6578-44ab-bb29-48e40bc11110 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:16.108160 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c358a50e-6578-44ab-bb29-48e40bc11110 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:16.119379 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7353e63-4c66-46d0-b6b8-89cd38d07350 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3b60d16d-37ff-4257-bd8d-ec6198b1398e,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:16.124767 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c358a50e-6578-44ab-bb29-48e40bc11110 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Subnet': ['ID=6e776c80-24f7-4cd9-bb19-6bb8a2dcb279,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:16.160118 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c358a50e-6578-44ab-bb29-48e40bc11110 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Port': ['ID=1e4c4297-f9b1-473b-a97a-22003faa3119,revision_number=4']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:16.163899 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1aa501a1-9c94-4b5e-acca-11687a255947 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] No DVR routers for this DVR port 3653fdce-278e-4d4b-b712-fb2641dbb781 on host dv-neutron-816802-2-hyperv {{(pid=102161) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:33:16.209257 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-98d0153f-73e1-48b7-aace-fcab69996929 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Made reservation on behalf of 12e47d8445b5429892cd1b9244512ca8 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:33:16.213024 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-98d0153f-73e1-48b7-aace-fcab69996929 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:16.218072 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-82a54d66-4dfd-4e1d-8473-ab064f66bc4a None None] Deleting port 3653fdce-278e-4d4b-b712-fb2641dbb781 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:33:16.218072 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-82a54d66-4dfd-4e1d-8473-ab064f66bc4a None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:16.232330 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1aa501a1-9c94-4b5e-acca-11687a255947 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event deleted for resources: {'Port': ['ID=3653fdce-278e-4d4b-b712-fb2641dbb781,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:16.247976 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [None req-98d0153f-73e1-48b7-aace-fcab69996929 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] device_id is not set on port 2c0fbb8b-e998-40f6-8b3e-aba376e4d260 yet. {{(pid=102162) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:33:16.300599 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cef7ca34-9753-4494-8720-fb6f12503300 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:16.330552 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ab369715-2ce3-4a6f-8393-98b59d660fa7 None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:33:16.337553 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-c358a50e-6578-44ab-bb29-48e40bc11110 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 2.7178986 Nov 09 04:33:16.342553 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56876) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:16.344585 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1aa501a1-9c94-4b5e-acca-11687a255947 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:16.346610 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-82a54d66-4dfd-4e1d-8473-ab064f66bc4a None None] For port 3653fdce-278e-4d4b-b712-fb2641dbb781, host dv-neutron-816802-2-hyperv, got binding levels [] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:33:16.347009 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-82a54d66-4dfd-4e1d-8473-ab064f66bc4a None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:16.351400 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-e8fc9072-de21-44bd-87e2-ec79ffda2c54 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'port': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'mac_address': 'fa:16:3e:de:ef:33', 'name': 'tempest-NetworksTestDHCPv6-845544560'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:16.409541 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-82a54d66-4dfd-4e1d-8473-ab064f66bc4a None None] Calling delete_port for 3653fdce-278e-4d4b-b712-fb2641dbb781 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:33:16.438022 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-1aa501a1-9c94-4b5e-acca-11687a255947 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0bab5ed1-b8b1-45ba-b633-5bee32c71edd']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:16.449905 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.ipam_backend_mixin [None req-82a54d66-4dfd-4e1d-8473-ab064f66bc4a None None] Port 3653fdce-278e-4d4b-b712-fb2641dbb781 was not found and therefore no delete operation was performed {{(pid=102163) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Nov 09 04:33:16.451957 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-79155ac8-d137-4a07-b48b-d05635fd9fa1 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:16.457651 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-82a54d66-4dfd-4e1d-8473-ab064f66bc4a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:16.474303 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-6b1c66f2-9af7-454a-b4f9-395d88704361 None None] Provisioning complete for port 1e4c4297-f9b1-473b-a97a-22003faa3119 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:16.475368 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6b1c66f2-9af7-454a-b4f9-395d88704361 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:16.486323 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-1aa501a1-9c94-4b5e-acca-11687a255947 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4adb05ec-46fe-428a-86b2-7b7107e35fdd') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:16.486640 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-1aa501a1-9c94-4b5e-acca-11687a255947 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4adb05ec-46fe-428a-86b2-7b7107e35fdd') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:16.497576 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:16.503823 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1aa501a1-9c94-4b5e-acca-11687a255947 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:16.517699 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-82a54d66-4dfd-4e1d-8473-ab064f66bc4a None None] No DVR routers for this DVR port 3653fdce-278e-4d4b-b712-fb2641dbb781 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:33:16.523696 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82a54d66-4dfd-4e1d-8473-ab064f66bc4a None None] Pushing event deleted for resources: {'Port': ['ID=3653fdce-278e-4d4b-b712-fb2641dbb781,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:16.541622 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1aa501a1-9c94-4b5e-acca-11687a255947 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:16.585325 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1aa501a1-9c94-4b5e-acca-11687a255947 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Releasing vlan 334 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:33:16.585935 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1aa501a1-9c94-4b5e-acca-11687a255947 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:16.591294 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:33:16.591294 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:33:16.591294 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:33:16.591294 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:33:16.591294 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:33:16.591294 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:33:16.591294 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:33:16.591294 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:33:16.591294 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:33:16.591294 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:33:16.591294 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:33:16.591294 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:33:16.591294 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:33:16.591294 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:33:16.591294 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:33:16.591294 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:33:16.591294 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:33:16.591294 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:33:16.591294 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:33:16.591294 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:33:16.591294 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:33:16.591294 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:33:16.591294 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:33:16.591294 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:33:16.591294 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:33:16.591294 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:33:16.591294 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:33:16.591294 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:33:16.591294 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:33:16.591294 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:33:16.591294 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:33:16.591294 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:33:16.593688 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-79155ac8-d137-4a07-b48b-d05635fd9fa1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:16.659359 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-79155ac8-d137-4a07-b48b-d05635fd9fa1 None None] Network ab0b8074-97a9-41d7-9124-7c9d6548032d is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:33:16.671067 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-79155ac8-d137-4a07-b48b-d05635fd9fa1 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:33:16.674701 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-79155ac8-d137-4a07-b48b-d05635fd9fa1 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:33:16.718023 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-98d0153f-73e1-48b7-aace-fcab69996929 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Allocated IP 2001:db8::2d0 (ab0b8074-97a9-41d7-9124-7c9d6548032d/aec9d80c-825b-434b-b01c-c5b0a638be76/2c0fbb8b-e998-40f6-8b3e-aba376e4d260) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:33:16.731862 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79155ac8-d137-4a07-b48b-d05635fd9fa1 None None] Pushing event updated for resources: {'Port': ['ID=3c3189c5-4de3-41eb-acd8-21a984377732,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:16.752392 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e8fc9072-de21-44bd-87e2-ec79ffda2c54 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'port': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:33:16.787685 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6b1c66f2-9af7-454a-b4f9-395d88704361 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:16.821238 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 1e4c4297-f9b1-473b-a97a-22003faa3119 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:33:16.830947 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1aa501a1-9c94-4b5e-acca-11687a255947 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:16.831552 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-79155ac8-d137-4a07-b48b-d05635fd9fa1 None None] Attempting to bind port 3c3189c5-4de3-41eb-acd8-21a984377732 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:33:16.831998 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-79155ac8-d137-4a07-b48b-d05635fd9fa1 None None] Attempting to bind port 3c3189c5-4de3-41eb-acd8-21a984377732 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '201b1b4b-3524-4db3-a248-d7e7fd388c3f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 331, 'network_id': 'ab0b8074-97a9-41d7-9124-7c9d6548032d'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:33:16.832671 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-79155ac8-d137-4a07-b48b-d05635fd9fa1 None None] Attempting to bind port 3c3189c5-4de3-41eb-acd8-21a984377732 on network ab0b8074-97a9-41d7-9124-7c9d6548032d {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:33:16.846402 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1aa501a1-9c94-4b5e-acca-11687a255947 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:16.849869 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1aa501a1-9c94-4b5e-acca-11687a255947 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "DELETE /v2.0/networks/0bab5ed1-b8b1-45ba-b633-5bee32c71edd HTTP/1.1" status: 204 len: 168 time: 1.7538209 Nov 09 04:33:16.853192 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56886) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:16.891969 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1aa501a1-9c94-4b5e-acca-11687a255947 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event deleted for resources: {'Network': ['ID=0bab5ed1-b8b1-45ba-b633-5bee32c71edd,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:16.903463 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e8fc9072-de21-44bd-87e2-ec79ffda2c54 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:16.917170 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-79155ac8-d137-4a07-b48b-d05635fd9fa1 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 32, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:33:16.918656 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-79155ac8-d137-4a07-b48b-d05635fd9fa1 None None] Checking segment: {'id': '201b1b4b-3524-4db3-a248-d7e7fd388c3f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 331, 'network_id': 'ab0b8074-97a9-41d7-9124-7c9d6548032d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:33:16.919353 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-79155ac8-d137-4a07-b48b-d05635fd9fa1 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:16.919976 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-79155ac8-d137-4a07-b48b-d05635fd9fa1 None None] Bound using segment: {'id': '201b1b4b-3524-4db3-a248-d7e7fd388c3f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 331, 'network_id': 'ab0b8074-97a9-41d7-9124-7c9d6548032d'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:33:16.920681 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-79155ac8-d137-4a07-b48b-d05635fd9fa1 None None] Bound port: 3c3189c5-4de3-41eb-acd8-21a984377732, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '201b1b4b-3524-4db3-a248-d7e7fd388c3f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 331, 'network_id': 'ab0b8074-97a9-41d7-9124-7c9d6548032d'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:33:16.921281 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-79155ac8-d137-4a07-b48b-d05635fd9fa1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:16.936946 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [None req-e8fc9072-de21-44bd-87e2-ec79ffda2c54 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] device_id is not set on port 695fbdef-2a5a-46bf-93c9-95c121ee6ece yet. {{(pid=102161) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:33:16.953000 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-6b1c66f2-9af7-454a-b4f9-395d88704361 None None] For port 1e4c4297-f9b1-473b-a97a-22003faa3119, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=1e4c4297-f9b1-473b-a97a-22003faa3119,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:33:17.037230 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 1e4c4297-f9b1-473b-a97a-22003faa3119 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:17.041877 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:17.066435 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-79155ac8-d137-4a07-b48b-d05635fd9fa1 None None] For port 3c3189c5-4de3-41eb-acd8-21a984377732, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:33:17.070856 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6b1c66f2-9af7-454a-b4f9-395d88704361 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:17.109372 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-79155ac8-d137-4a07-b48b-d05635fd9fa1 None None] For port 3c3189c5-4de3-41eb-acd8-21a984377732, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=3c3189c5-4de3-41eb-acd8-21a984377732,segment=NetworkSegment(201b1b4b-3524-4db3-a248-d7e7fd388c3f),segment_id=201b1b4b-3524-4db3-a248-d7e7fd388c3f)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:33:17.113303 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:17.129951 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-e8fc9072-de21-44bd-87e2-ec79ffda2c54 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Allocated IP 172.20.0.5 (988d2354-693c-4d52-af17-25e0643eaa0c/5d327042-2b73-4cd6-9415-7970deef9f1f/695fbdef-2a5a-46bf-93c9-95c121ee6ece) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:33:17.136584 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-e8fc9072-de21-44bd-87e2-ec79ffda2c54 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Allocated IP 2001:db8::f816:3eff:fede:ef33 (988d2354-693c-4d52-af17-25e0643eaa0c/6e776c80-24f7-4cd9-bb19-6bb8a2dcb279/695fbdef-2a5a-46bf-93c9-95c121ee6ece) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:33:17.147671 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b1c66f2-9af7-454a-b4f9-395d88704361 None None] Pushing event updated for resources: {'Port': ['ID=1e4c4297-f9b1-473b-a97a-22003faa3119,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:17.213878 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-98d0153f-73e1-48b7-aace-fcab69996929 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:17.233437 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-79155ac8-d137-4a07-b48b-d05635fd9fa1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:17.324528 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 3653fdce-278e-4d4b-b712-fb2641dbb781 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:33:17.373552 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 3653fdce-278e-4d4b-b712-fb2641dbb781 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:33:17.373896 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 3653fdce-278e-4d4b-b712-fb2641dbb781 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:33:17.374326 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 3bdf32a7-774a-4983-98a1-9b8a12c4fd05 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:33:17.409767 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-98d0153f-73e1-48b7-aace-fcab69996929 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:17.412892 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79155ac8-d137-4a07-b48b-d05635fd9fa1 None None] Pushing event updated for resources: {'Port': ['ID=3c3189c5-4de3-41eb-acd8-21a984377732,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:17.425659 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 3bdf32a7-774a-4983-98a1-9b8a12c4fd05 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:33:17.426003 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 3bdf32a7-774a-4983-98a1-9b8a12c4fd05 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:33:17.488693 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98d0153f-73e1-48b7-aace-fcab69996929 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event updated for resources: {'Port': ['ID=2c0fbb8b-e998-40f6-8b3e-aba376e4d260,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:17.503264 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-98d0153f-73e1-48b7-aace-fcab69996929 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Network ab0b8074-97a9-41d7-9124-7c9d6548032d is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:33:17.516629 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-98d0153f-73e1-48b7-aace-fcab69996929 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:33:17.521374 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-98d0153f-73e1-48b7-aace-fcab69996929 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:33:17.527663 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-98d0153f-73e1-48b7-aace-fcab69996929 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:17.529071 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-98d0153f-73e1-48b7-aace-fcab69996929 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:17.639988 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-98d0153f-73e1-48b7-aace-fcab69996929 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 930 time: 1.7279434 Nov 09 04:33:17.645185 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56898) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:17.657750 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56900) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:17.806760 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-cef7ca34-9753-4494-8720-fb6f12503300 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Deleting port bab3b0b2-ec0e-464a-b15f-1f71dc13f0f3 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:33:17.806760 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cef7ca34-9753-4494-8720-fb6f12503300 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:17.817008 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-007e5642-9cfb-423c-babc-11929b4c4157 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:17.938753 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-7dbba5b4-676d-4352-aa9b-18e3339ce877 admin admin] Request body: {'network': {'name': 'tempest-TestServerAdvancedOps-370544024-network', 'tenant_id': 'a7dd369fc9b947d2b50f9f75551d326d'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:17.987096 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-cef7ca34-9753-4494-8720-fb6f12503300 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] For port bab3b0b2-ec0e-464a-b15f-1f71dc13f0f3, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=bab3b0b2-ec0e-464a-b15f-1f71dc13f0f3,segment=NetworkSegment(d5411e15-1506-4025-8472-ba7118358f68),segment_id=d5411e15-1506-4025-8472-ba7118358f68)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:33:17.987466 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cef7ca34-9753-4494-8720-fb6f12503300 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:18.001114 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e8fc9072-de21-44bd-87e2-ec79ffda2c54 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:18.008495 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-76d23860-9038-4e18-bdb5-a4c5b3652763 None None] Provisioning complete for port 1e4c4297-f9b1-473b-a97a-22003faa3119 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:18.009460 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-76d23860-9038-4e18-bdb5-a4c5b3652763 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:18.010534 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-cef7ca34-9753-4494-8720-fb6f12503300 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Calling delete_port for bab3b0b2-ec0e-464a-b15f-1f71dc13f0f3 owned by network:router_interface {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:33:18.163175 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e8fc9072-de21-44bd-87e2-ec79ffda2c54 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:18.223966 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e8fc9072-de21-44bd-87e2-ec79ffda2c54 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:33:18.231110 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-e8fc9072-de21-44bd-87e2-ec79ffda2c54 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:33:18.236272 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e8fc9072-de21-44bd-87e2-ec79ffda2c54 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:33:18.245477 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8fc9072-de21-44bd-87e2-ec79ffda2c54 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Port': ['ID=695fbdef-2a5a-46bf-93c9-95c121ee6ece,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:18.329025 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e8fc9072-de21-44bd-87e2-ec79ffda2c54 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:18.329698 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e8fc9072-de21-44bd-87e2-ec79ffda2c54 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:18.415697 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7dbba5b4-676d-4352-aa9b-18e3339ce877 admin admin] Made reservation on behalf of a7dd369fc9b947d2b50f9f75551d326d for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:33:18.418014 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7dbba5b4-676d-4352-aa9b-18e3339ce877 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:18.419962 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cef7ca34-9753-4494-8720-fb6f12503300 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:18.452107 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7dbba5b4-676d-4352-aa9b-18e3339ce877 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:18.455249 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cef7ca34-9753-4494-8720-fb6f12503300 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Pushing event deleted for resources: {'Port': ['ID=bab3b0b2-ec0e-464a-b15f-1f71dc13f0f3,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:18.531060 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-e8fc9072-de21-44bd-87e2-ec79ffda2c54 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1026 time: 2.1803906 Nov 09 04:33:18.531060 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56904) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:18.645928 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f9f556b7-7679-453b-8843-f14ea2b38dc9 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:18.648090 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f3337371-3d26-456f-8279-6afa629409d6 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:18.652291 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f9f556b7-7679-453b-8843-f14ea2b38dc9 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:18.654506 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-f9f556b7-7679-453b-8843-f14ea2b38dc9 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1862 time: 0.1230991 Nov 09 04:33:18.656827 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56906) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:18.738852 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-b821df7e-b559-45ca-b68a-3f2e75f9581d None None] Provisioning complete for port 695fbdef-2a5a-46bf-93c9-95c121ee6ece triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:18.739333 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b821df7e-b559-45ca-b68a-3f2e75f9581d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:18.780983 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cef7ca34-9753-4494-8720-fb6f12503300 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:18.835386 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-b821df7e-b559-45ca-b68a-3f2e75f9581d None None] Port 695fbdef-2a5a-46bf-93c9-95c121ee6ece cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:33:18.886249 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 1e4c4297-f9b1-473b-a97a-22003faa3119 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:33:18.907866 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7dbba5b4-676d-4352-aa9b-18e3339ce877 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:18.940909 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-8b3117d2-0b6d-4e53-b9e0-b8e6973cab18 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Deleting port 695fbdef-2a5a-46bf-93c9-95c121ee6ece {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:33:18.941450 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8b3117d2-0b6d-4e53-b9e0-b8e6973cab18 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:18.957248 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 1e4c4297-f9b1-473b-a97a-22003faa3119 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:18.958527 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:18.985494 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bed7c455-89dc-4467-8093-4e130a1d7e8b None None] Network ab0b8074-97a9-41d7-9124-7c9d6548032d requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:33:19.017148 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7dbba5b4-676d-4352-aa9b-18e3339ce877 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:19.059355 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7dbba5b4-676d-4352-aa9b-18e3339ce877 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 333} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:33:19.081709 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-ec5c86b7-14f0-40af-a51d-fe87e9e8b8c9 None None] Provisioning complete for port 3c3189c5-4de3-41eb-acd8-21a984377732 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:19.082400 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ec5c86b7-14f0-40af-a51d-fe87e9e8b8c9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:19.086662 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8b3117d2-0b6d-4e53-b9e0-b8e6973cab18 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:19.109220 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7dbba5b4-676d-4352-aa9b-18e3339ce877 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8fd0adbd-57c5-4583-8e2d-9a55d7973976,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:19.112507 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7dbba5b4-676d-4352-aa9b-18e3339ce877 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:19.112923 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-7dbba5b4-676d-4352-aa9b-18e3339ce877 admin admin] Added segment 63a401e5-97f0-4f3a-b762-8fc66b1b215f of type vlan for network 10e5206a-1d3b-409b-a3ee-0f6a311d6819 Nov 09 04:33:19.132209 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-8b3117d2-0b6d-4e53-b9e0-b8e6973cab18 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Calling delete_port for 695fbdef-2a5a-46bf-93c9-95c121ee6ece owned by {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:33:19.142729 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-007e5642-9cfb-423c-babc-11929b4c4157 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Deleting port 20195bcd-85f4-4bce-bae2-63cdf464f57f {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:33:19.143334 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-007e5642-9cfb-423c-babc-11929b4c4157 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:19.185081 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 3c3189c5-4de3-41eb-acd8-21a984377732 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:33:19.199890 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cef7ca34-9753-4494-8720-fb6f12503300 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Router 20fa17b9-5a43-469e-a0de-e9be80c05f6f has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:33:19.260851 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7dbba5b4-676d-4352-aa9b-18e3339ce877 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:19.297476 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ec5c86b7-14f0-40af-a51d-fe87e9e8b8c9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:19.321297 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 3c3189c5-4de3-41eb-acd8-21a984377732 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:19.321669 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:19.348191 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-007e5642-9cfb-423c-babc-11929b4c4157 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] For port 20195bcd-85f4-4bce-bae2-63cdf464f57f, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=20195bcd-85f4-4bce-bae2-63cdf464f57f,segment=NetworkSegment(696f4512-dd80-4379-a21b-b923df29bba5),segment_id=696f4512-dd80-4379-a21b-b923df29bba5)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:33:19.349013 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-007e5642-9cfb-423c-babc-11929b4c4157 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:19.359391 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-ec5c86b7-14f0-40af-a51d-fe87e9e8b8c9 None None] For port 3c3189c5-4de3-41eb-acd8-21a984377732, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=3c3189c5-4de3-41eb-acd8-21a984377732,segment=NetworkSegment(201b1b4b-3524-4db3-a248-d7e7fd388c3f),segment_id=201b1b4b-3524-4db3-a248-d7e7fd388c3f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:33:19.359881 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f3337371-3d26-456f-8279-6afa629409d6 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:19.367611 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-007e5642-9cfb-423c-babc-11929b4c4157 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Calling delete_port for 20195bcd-85f4-4bce-bae2-63cdf464f57f owned by network:router_interface {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:33:19.411279 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7dbba5b4-676d-4352-aa9b-18e3339ce877 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:19.412845 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7dbba5b4-676d-4352-aa9b-18e3339ce877 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:19.413524 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7dbba5b4-676d-4352-aa9b-18e3339ce877 admin admin] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:19.413685 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cef7ca34-9753-4494-8720-fb6f12503300 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:33:19.423258 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-cef7ca34-9753-4494-8720-fb6f12503300 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "PUT /v2.0/routers/20fa17b9-5a43-469e-a0de-e9be80c05f6f/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 4.4176085 Nov 09 04:33:19.423869 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56908) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:19.427232 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-16f92108-c40f-4260-ab89-1e8f514d72a9 None None] Sync routers for ids ['20fa17b9-5a43-469e-a0de-e9be80c05f6f'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:33:19.438821 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:19.449684 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-16f92108-c40f-4260-ab89-1e8f514d72a9 None None] Routers {'20fa17b9-5a43-469e-a0de-e9be80c05f6f'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:33:19.450411 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-16f92108-c40f-4260-ab89-1e8f514d72a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:33:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['20fa17b9-5a43-469e-a0de-e9be80c05f6f'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:19.489747 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-a3e59d38-8d37-4a82-99b7-c0486e704823 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Deleting subnet 003822ea-7d1a-41fa-a15f-16fc8c9f624c {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:33:19.492808 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ec5c86b7-14f0-40af-a51d-fe87e9e8b8c9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:19.493890 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a3e59d38-8d37-4a82-99b7-c0486e704823 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:19.538328 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8b3117d2-0b6d-4e53-b9e0-b8e6973cab18 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:19.542017 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a3e59d38-8d37-4a82-99b7-c0486e704823 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:19.544395 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f3337371-3d26-456f-8279-6afa629409d6 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:19.600611 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7dbba5b4-676d-4352-aa9b-18e3339ce877 admin admin] Pushing event updated for resources: {'Network': ['ID=10e5206a-1d3b-409b-a3ee-0f6a311d6819,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:19.607510 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b3117d2-0b6d-4e53-b9e0-b8e6973cab18 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event deleted for resources: {'Port': ['ID=695fbdef-2a5a-46bf-93c9-95c121ee6ece,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:19.669431 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-7dbba5b4-676d-4352-aa9b-18e3339ce877 admin admin] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 2.0053287 Nov 09 04:33:19.703339 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56910) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:19.709592 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-9b42bdd2-9509-422a-8df5-72623e0c574d admin admin] Request body: {'subnet': {'network_id': '10e5206a-1d3b-409b-a3ee-0f6a311d6819', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestServerAdvancedOps-370544024-subnet', 'tenant_id': 'a7dd369fc9b947d2b50f9f75551d326d', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:19.719548 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3337371-3d26-456f-8279-6afa629409d6 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event updated for resources: {'Port': ['ID=2c0fbb8b-e998-40f6-8b3e-aba376e4d260,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:19.743461 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a3e59d38-8d37-4a82-99b7-c0486e704823 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:19.818970 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b3117d2-0b6d-4e53-b9e0-b8e6973cab18 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:19.819893 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b3117d2-0b6d-4e53-b9e0-b8e6973cab18 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:19.820249 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b3117d2-0b6d-4e53-b9e0-b8e6973cab18 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:19.820592 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b3117d2-0b6d-4e53-b9e0-b8e6973cab18 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:19.820927 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b3117d2-0b6d-4e53-b9e0-b8e6973cab18 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:19.821260 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b3117d2-0b6d-4e53-b9e0-b8e6973cab18 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:19.821598 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b3117d2-0b6d-4e53-b9e0-b8e6973cab18 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:19.821923 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b3117d2-0b6d-4e53-b9e0-b8e6973cab18 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:19.822249 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b3117d2-0b6d-4e53-b9e0-b8e6973cab18 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:19.822600 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b3117d2-0b6d-4e53-b9e0-b8e6973cab18 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:19.823061 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b3117d2-0b6d-4e53-b9e0-b8e6973cab18 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:19.823387 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b3117d2-0b6d-4e53-b9e0-b8e6973cab18 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:19.831562 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 10e5206a-1d3b-409b-a3ee-0f6a311d6819 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:33:19.894796 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec5c86b7-14f0-40af-a51d-fe87e9e8b8c9 None None] Pushing event updated for resources: {'Port': ['ID=3c3189c5-4de3-41eb-acd8-21a984377732,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:19.900369 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9b42bdd2-9509-422a-8df5-72623e0c574d admin admin] Made reservation on behalf of a7dd369fc9b947d2b50f9f75551d326d for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:33:19.902745 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9b42bdd2-9509-422a-8df5-72623e0c574d admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:19.916191 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec5c86b7-14f0-40af-a51d-fe87e9e8b8c9 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:19.917314 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec5c86b7-14f0-40af-a51d-fe87e9e8b8c9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:19.917756 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec5c86b7-14f0-40af-a51d-fe87e9e8b8c9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:19.918596 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec5c86b7-14f0-40af-a51d-fe87e9e8b8c9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:19.919055 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec5c86b7-14f0-40af-a51d-fe87e9e8b8c9 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:19.919462 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec5c86b7-14f0-40af-a51d-fe87e9e8b8c9 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:19.919865 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec5c86b7-14f0-40af-a51d-fe87e9e8b8c9 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:19.920448 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec5c86b7-14f0-40af-a51d-fe87e9e8b8c9 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:19.920856 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec5c86b7-14f0-40af-a51d-fe87e9e8b8c9 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:19.921335 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec5c86b7-14f0-40af-a51d-fe87e9e8b8c9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:19.921742 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec5c86b7-14f0-40af-a51d-fe87e9e8b8c9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:19.922177 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec5c86b7-14f0-40af-a51d-fe87e9e8b8c9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:19.930555 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.db.api [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=102163) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:33:19.931044 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG oslo_db.api [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:33:19.972785 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f3337371-3d26-456f-8279-6afa629409d6 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:19.980999 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8b3117d2-0b6d-4e53-b9e0-b8e6973cab18 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:19.985150 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-8b3117d2-0b6d-4e53-b9e0-b8e6973cab18 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/ports/695fbdef-2a5a-46bf-93c9-95c121ee6ece HTTP/1.1" status: 204 len: 168 time: 1.3273633 Nov 09 04:33:19.988181 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56912) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:19.996867 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-16f92108-c40f-4260-ab89-1e8f514d72a9 None None] Set router 20fa17b9-5a43-469e-a0de-e9be80c05f6f gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:33:20.056759 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-08dc7f31-8314-4d46-b213-44cf970a80e0 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:20.058633 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-08dc7f31-8314-4d46-b213-44cf970a80e0 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:20.060576 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-08dc7f31-8314-4d46-b213-44cf970a80e0 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:20.064923 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-08dc7f31-8314-4d46-b213-44cf970a80e0 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2071 time: 0.0735424 Nov 09 04:33:20.064923 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a3e59d38-8d37-4a82-99b7-c0486e704823 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:20.075613 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56914) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:20.079332 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-dc316056-a180-454d-95dd-7d16cffca5e5 None None] Provisioning complete for port 3c3189c5-4de3-41eb-acd8-21a984377732 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:20.079956 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-dc316056-a180-454d-95dd-7d16cffca5e5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:20.106746 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a3e59d38-8d37-4a82-99b7-c0486e704823 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:20.111245 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a3e59d38-8d37-4a82-99b7-c0486e704823 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "DELETE /v2.0/subnets/003822ea-7d1a-41fa-a15f-16fc8c9f624c HTTP/1.1" status: 204 len: 168 time: 0.6842959 Nov 09 04:33:20.113548 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3e59d38-8d37-4a82-99b7-c0486e704823 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Pushing event deleted for resources: {'Subnet': ['ID=003822ea-7d1a-41fa-a15f-16fc8c9f624c,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:20.133966 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-057fb242-00ae-437b-bf33-f09fc3549a9a None None] Network 9c94e7dc-d679-4a7e-b264-6d619dbc935e requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:33:20.147973 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56916) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:20.211512 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9b42bdd2-9509-422a-8df5-72623e0c574d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:20.240846 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-51112fe7-eaf4-4e6c-b186-f159a439a3a2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Deleting subnet 5d327042-2b73-4cd6-9415-7970deef9f1f {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:33:20.265389 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-007e5642-9cfb-423c-babc-11929b4c4157 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:20.279639 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-51112fe7-eaf4-4e6c-b186-f159a439a3a2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:20.347564 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-51112fe7-eaf4-4e6c-b186-f159a439a3a2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:20.381327 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7e7c44a7-08e7-47e8-ae1a-52f6e54e4df2 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks [] for router, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:20.392640 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b42bdd2-9509-422a-8df5-72623e0c574d admin admin] Pushing event updated for resources: {'Subnet': ['ID=73ee2bd1-c2b2-478f-96c9-301b99515bfe,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:20.427575 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-007e5642-9cfb-423c-babc-11929b4c4157 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event deleted for resources: {'Port': ['ID=20195bcd-85f4-4bce-bae2-63cdf464f57f,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:20.431288 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-dc316056-a180-454d-95dd-7d16cffca5e5 None None] Provisioning complete for port 2c0fbb8b-e998-40f6-8b3e-aba376e4d260 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:20.431654 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-dc316056-a180-454d-95dd-7d16cffca5e5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:20.514048 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-16f92108-c40f-4260-ab89-1e8f514d72a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '20fa17b9-5a43-469e-a0de-e9be80c05f6f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1135837892', 'tenant_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.69'}], 'enable_snat': True}, 'gw_port_id': '8508be40-2af9-45a5-96f0-06d142f33d8d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:30:45Z', 'updated_at': '2021-11-09T04:33:18Z', 'revision_number': 5, 'project_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'gw_port': {'id': '8508be40-2af9-45a5-96f0-06d142f33d8d', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:95:95:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '20fa17b9-5a43-469e-a0de-e9be80c05f6f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 567, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:30:48Z', 'updated_at': '2021-11-09T04:30:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:20.517925 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-dc316056-a180-454d-95dd-7d16cffca5e5 None None] Port 2c0fbb8b-e998-40f6-8b3e-aba376e4d260 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:33:20.522332 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-007e5642-9cfb-423c-babc-11929b4c4157 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:20.522480 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-007e5642-9cfb-423c-babc-11929b4c4157 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:20.522819 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-007e5642-9cfb-423c-babc-11929b4c4157 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:20.523155 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-007e5642-9cfb-423c-babc-11929b4c4157 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:20.523490 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-007e5642-9cfb-423c-babc-11929b4c4157 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:20.523752 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-768d7bc5-6961-4e16-b065-8d15ecd9add3 None None] DHCP port deletion for 9c94e7dc-d679-4a7e-b264-6d619dbc935e request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:33:20.523903 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-007e5642-9cfb-423c-babc-11929b4c4157 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:20.524196 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-007e5642-9cfb-423c-babc-11929b4c4157 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:20.524497 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-007e5642-9cfb-423c-babc-11929b4c4157 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:20.524823 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-007e5642-9cfb-423c-babc-11929b4c4157 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:20.525148 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-007e5642-9cfb-423c-babc-11929b4c4157 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:20.525473 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-007e5642-9cfb-423c-babc-11929b4c4157 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:20.525792 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-007e5642-9cfb-423c-babc-11929b4c4157 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:20.558843 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-16f92108-c40f-4260-ab89-1e8f514d72a9 None None] Checking router: 20fa17b9-5a43-469e-a0de-e9be80c05f6f for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:33:20.576585 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7e7c44a7-08e7-47e8-ae1a-52f6e54e4df2 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks [] for router_gateway, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:20.602946 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b42bdd2-9509-422a-8df5-72623e0c574d admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:20.603677 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b42bdd2-9509-422a-8df5-72623e0c574d admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:20.603677 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b42bdd2-9509-422a-8df5-72623e0c574d admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:20.603952 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b42bdd2-9509-422a-8df5-72623e0c574d admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:20.607214 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b42bdd2-9509-422a-8df5-72623e0c574d admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:20.607583 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b42bdd2-9509-422a-8df5-72623e0c574d admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:20.613262 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b42bdd2-9509-422a-8df5-72623e0c574d admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:20.613262 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b42bdd2-9509-422a-8df5-72623e0c574d admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:20.613262 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b42bdd2-9509-422a-8df5-72623e0c574d admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:20.613262 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b42bdd2-9509-422a-8df5-72623e0c574d admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:20.613262 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b42bdd2-9509-422a-8df5-72623e0c574d admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:20.613262 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b42bdd2-9509-422a-8df5-72623e0c574d admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:20.613679 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-51112fe7-eaf4-4e6c-b186-f159a439a3a2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:20.619346 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-16f92108-c40f-4260-ab89-1e8f514d72a9 None None] Routers {'20fa17b9-5a43-469e-a0de-e9be80c05f6f'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:33:20.620322 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-16f92108-c40f-4260-ab89-1e8f514d72a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:33:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['20fa17b9-5a43-469e-a0de-e9be80c05f6f'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:20.696318 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9b42bdd2-9509-422a-8df5-72623e0c574d admin admin] Checking segment: {'id': '63a401e5-97f0-4f3a-b762-8fc66b1b215f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 333, 'network_id': '10e5206a-1d3b-409b-a3ee-0f6a311d6819'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:33:20.696812 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9b42bdd2-9509-422a-8df5-72623e0c574d admin admin] Network hostable DHCP agents. Network: 10e5206a-1d3b-409b-a3ee-0f6a311d6819, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:33:20.729834 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-7e7c44a7-08e7-47e8-ae1a-52f6e54e4df2 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Deleting port 8508be40-2af9-45a5-96f0-06d142f33d8d {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:33:20.730236 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7e7c44a7-08e7-47e8-ae1a-52f6e54e4df2 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:20.731024 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f3337371-3d26-456f-8279-6afa629409d6 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:20.743243 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-16f92108-c40f-4260-ab89-1e8f514d72a9 None None] Set router 20fa17b9-5a43-469e-a0de-e9be80c05f6f gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:33:20.758188 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-007e5642-9cfb-423c-babc-11929b4c4157 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:20.774650 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 3c3189c5-4de3-41eb-acd8-21a984377732 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:33:20.793307 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-51112fe7-eaf4-4e6c-b186-f159a439a3a2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:20.830112 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-51112fe7-eaf4-4e6c-b186-f159a439a3a2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:20.833652 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-51112fe7-eaf4-4e6c-b186-f159a439a3a2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/5d327042-2b73-4cd6-9415-7970deef9f1f HTTP/1.1" status: 204 len: 168 time: 0.7212844 Nov 09 04:33:20.835323 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51112fe7-eaf4-4e6c-b186-f159a439a3a2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event deleted for resources: {'Subnet': ['ID=5d327042-2b73-4cd6-9415-7970deef9f1f,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:20.837607 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56918) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:20.861304 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f0d0b863-d200-496f-81c5-8ab900f558d3 None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:33:20.867353 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9b42bdd2-9509-422a-8df5-72623e0c574d admin admin] Network 10e5206a-1d3b-409b-a3ee-0f6a311d6819 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:33:20.887346 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-7e7c44a7-08e7-47e8-ae1a-52f6e54e4df2 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] For port 8508be40-2af9-45a5-96f0-06d142f33d8d, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=8508be40-2af9-45a5-96f0-06d142f33d8d,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:33:20.887346 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7e7c44a7-08e7-47e8-ae1a-52f6e54e4df2 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:20.911342 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-7e7c44a7-08e7-47e8-ae1a-52f6e54e4df2 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Calling delete_port for 8508be40-2af9-45a5-96f0-06d142f33d8d owned by network:router_gateway {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:33:20.923670 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-a850728e-d907-41a5-8ad0-20563cb572ef None None] Provisioning complete for port 2c0fbb8b-e998-40f6-8b3e-aba376e4d260 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:20.924056 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a850728e-d907-41a5-8ad0-20563cb572ef None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:20.931382 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-ae697150-b652-4006-98f2-97fe4fd7876d tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Deleting subnet 6e776c80-24f7-4cd9-bb19-6bb8a2dcb279 {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:33:20.936281 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ae697150-b652-4006-98f2-97fe4fd7876d tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:20.975200 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-9b42bdd2-9509-422a-8df5-72623e0c574d admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 10e5206a-1d3b-409b-a3ee-0f6a311d6819) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:33:20.989413 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9b42bdd2-9509-422a-8df5-72623e0c574d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:20.989694 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9b42bdd2-9509-422a-8df5-72623e0c574d admin admin] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:21.000171 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-768d7bc5-6961-4e16-b065-8d15ecd9add3 None None] Deleting port 8c90ef15-e112-469b-9b84-e60842294cb2 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:33:21.000541 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-768d7bc5-6961-4e16-b065-8d15ecd9add3 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:21.014852 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ae697150-b652-4006-98f2-97fe4fd7876d tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:21.020564 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-91e9f2ab-d357-49a7-95ff-89d7c444f1e6 None None] Network 10e5206a-1d3b-409b-a3ee-0f6a311d6819 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:33:21.074311 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-a850728e-d907-41a5-8ad0-20563cb572ef None None] Port 2c0fbb8b-e998-40f6-8b3e-aba376e4d260 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:33:21.091359 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-9b42bdd2-9509-422a-8df5-72623e0c574d admin admin] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 1.3782909 Nov 09 04:33:21.171150 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-007e5642-9cfb-423c-babc-11929b4c4157 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Router fa30d24d-d721-4675-ad7b-09f35105e633 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:33:21.182612 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 3c3189c5-4de3-41eb-acd8-21a984377732 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:21.183017 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:21.185636 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ae697150-b652-4006-98f2-97fe4fd7876d tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:21.222317 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-768d7bc5-6961-4e16-b065-8d15ecd9add3 None None] For port 8c90ef15-e112-469b-9b84-e60842294cb2, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=8c90ef15-e112-469b-9b84-e60842294cb2,segment=NetworkSegment(d5411e15-1506-4025-8472-ba7118358f68),segment_id=d5411e15-1506-4025-8472-ba7118358f68)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:33:21.222740 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-768d7bc5-6961-4e16-b065-8d15ecd9add3 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:21.295540 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-768d7bc5-6961-4e16-b065-8d15ecd9add3 None None] Calling delete_port for 8c90ef15-e112-469b-9b84-e60842294cb2 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:33:21.334309 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-007e5642-9cfb-423c-babc-11929b4c4157 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:33:21.349138 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-007e5642-9cfb-423c-babc-11929b4c4157 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "PUT /v2.0/routers/fa30d24d-d721-4675-ad7b-09f35105e633/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 4.4870749 Nov 09 04:33:21.349138 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56924) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:21.351399 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f3337371-3d26-456f-8279-6afa629409d6 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:21.359791 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-766712e9-4470-4b7c-ba94-c59b8e26aedc None None] Sync routers for ids ['fa30d24d-d721-4675-ad7b-09f35105e633'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:33:21.375687 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-766712e9-4470-4b7c-ba94-c59b8e26aedc None None] Routers {'fa30d24d-d721-4675-ad7b-09f35105e633'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:33:21.376321 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-766712e9-4470-4b7c-ba94-c59b8e26aedc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:33:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['fa30d24d-d721-4675-ad7b-09f35105e633'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:21.393961 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ae697150-b652-4006-98f2-97fe4fd7876d tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:21.404880 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-18c9fa1b-230c-471f-8598-27aa91f4b463 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Deleting subnet d7a7c5ae-922f-4fe2-ad19-b31fd352c9d1 {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:33:21.408707 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-18c9fa1b-230c-471f-8598-27aa91f4b463 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:21.440481 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f3337371-3d26-456f-8279-6afa629409d6 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:21.441313 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f3337371-3d26-456f-8279-6afa629409d6 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:21.475390 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7e7c44a7-08e7-47e8-ae1a-52f6e54e4df2 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:21.496650 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-18c9fa1b-230c-471f-8598-27aa91f4b463 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:21.502159 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae697150-b652-4006-98f2-97fe4fd7876d tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event deleted for resources: {'Subnet': ['ID=6e776c80-24f7-4cd9-bb19-6bb8a2dcb279,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:21.504079 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-766712e9-4470-4b7c-ba94-c59b8e26aedc None None] Set router fa30d24d-d721-4675-ad7b-09f35105e633 gateway port host: None {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:33:21.525860 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ae697150-b652-4006-98f2-97fe4fd7876d tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:21.537932 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-ae697150-b652-4006-98f2-97fe4fd7876d tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/6e776c80-24f7-4cd9-bb19-6bb8a2dcb279 HTTP/1.1" status: 204 len: 168 time: 0.6962349 Nov 09 04:33:21.551150 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56928) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:21.614784 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3337371-3d26-456f-8279-6afa629409d6 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event updated for resources: {'Port': ['ID=2c0fbb8b-e998-40f6-8b3e-aba376e4d260,revision_number=3']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:21.661586 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-0936c86a-37c3-4890-b2a8-f04a5872baa7 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0981953 Nov 09 04:33:21.664933 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56932) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:21.665365 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-db6748e8-7f09-490b-a086-7973576a4efb None None] Network 10e5206a-1d3b-409b-a3ee-0f6a311d6819 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:33:21.691384 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7e7c44a7-08e7-47e8-ae1a-52f6e54e4df2 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-466373'] for router_gateway, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:21.759104 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-16f92108-c40f-4260-ab89-1e8f514d72a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '20fa17b9-5a43-469e-a0de-e9be80c05f6f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1135837892', 'tenant_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.69'}], 'enable_snat': True}, 'gw_port_id': '8508be40-2af9-45a5-96f0-06d142f33d8d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:30:45Z', 'updated_at': '2021-11-09T04:33:18Z', 'revision_number': 5, 'project_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'gw_port': {'id': '8508be40-2af9-45a5-96f0-06d142f33d8d', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:95:95:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '20fa17b9-5a43-469e-a0de-e9be80c05f6f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 567, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:30:48Z', 'updated_at': '2021-11-09T04:30:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:21.771315 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7c44a7-08e7-47e8-ae1a-52f6e54e4df2 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Pushing event deleted for resources: {'Port': ['ID=8508be40-2af9-45a5-96f0-06d142f33d8d,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:21.820711 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-16f92108-c40f-4260-ab89-1e8f514d72a9 None None] The sync data for ids ['20fa17b9-5a43-469e-a0de-e9be80c05f6f'] in dv-neutron-816802-2-hyperv is: [{'id': '20fa17b9-5a43-469e-a0de-e9be80c05f6f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1135837892', 'tenant_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.69'}], 'enable_snat': True}, 'gw_port_id': '8508be40-2af9-45a5-96f0-06d142f33d8d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:30:45Z', 'updated_at': '2021-11-09T04:33:18Z', 'revision_number': 5, 'project_id': 'fd7df27e425449dfb80d0838c8f7fb89', 'gw_port': {'id': '8508be40-2af9-45a5-96f0-06d142f33d8d', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:95:95:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '20fa17b9-5a43-469e-a0de-e9be80c05f6f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 567, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:30:48Z', 'updated_at': '2021-11-09T04:30:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:33:21.878730 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 8c90ef15-e112-469b-9b84-e60842294cb2 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:33:21.903148 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7e7c44a7-08e7-47e8-ae1a-52f6e54e4df2 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:21.906328 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7e7c44a7-08e7-47e8-ae1a-52f6e54e4df2 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:21.950026 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-768d7bc5-6961-4e16-b065-8d15ecd9add3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:21.973498 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cf6a52c8-1a08-41a0-b078-478b2ec6edb0 None None] Update dhcp port {'port': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'fixed_ips': [{'subnet_id': '6e776c80-24f7-4cd9-bb19-6bb8a2dcb279'}], 'binding:host_id': 'dv-neutron-816802-2-hyperv'}, 'id': '1e4c4297-f9b1-473b-a97a-22003faa3119'} from dv-neutron-816802-2-hyperv. {{(pid=102163) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:328}} Nov 09 04:33:21.983909 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-766712e9-4470-4b7c-ba94-c59b8e26aedc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'name': 'tempest-RoutersTest-router-1490827103', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:32:29Z', 'updated_at': '2021-11-09T04:33:19Z', 'revision_number': 9, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'gw_port_host': None, '_interfaces': [{'id': '98741773-362a-4c6e-b503-923f0f367a2a', 'name': '', 'network_id': 'e1b06497-74dd-47e6-9b9a-79074e9bf0e8', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:d2:bc:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 847, 'fixed_ips': [{'subnet_id': 'f0939bd8-617d-4f5c-9f7b-272de792edac', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:43Z', 'updated_at': '2021-11-09T04:32:51Z', 'revision_number': 5, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'f0939bd8-617d-4f5c-9f7b-272de792edac', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'bf77ddc4-4ed9-472d-842b-1fb79d55e2e4', 'name': '', 'network_id': '35e2f2d1-ee40-4328-9fe2-48e5a5c19938', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:66:29:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 830, 'fixed_ips': [{'subnet_id': 'f60d3eec-6988-47b0-9f2f-6319fa99064d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:33Z', 'updated_at': '2021-11-09T04:32:44Z', 'revision_number': 5, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'f60d3eec-6988-47b0-9f2f-6319fa99064d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:22.017434 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-766712e9-4470-4b7c-ba94-c59b8e26aedc None None] Checking router: fa30d24d-d721-4675-ad7b-09f35105e633 for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:33:22.019978 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7e7c44a7-08e7-47e8-ae1a-52f6e54e4df2 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:22.022410 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7e7c44a7-08e7-47e8-ae1a-52f6e54e4df2 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Fanout notify agent at l3_agent the message router_deleted on router 20fa17b9-5a43-469e-a0de-e9be80c05f6f {{(pid=102161) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:33:22.028572 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-768d7bc5-6961-4e16-b065-8d15ecd9add3 None None] Pushing event deleted for resources: {'Port': ['ID=8c90ef15-e112-469b-9b84-e60842294cb2,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:22.041026 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7e7c44a7-08e7-47e8-ae1a-52f6e54e4df2 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:22.041026 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-7e7c44a7-08e7-47e8-ae1a-52f6e54e4df2 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "DELETE /v2.0/routers/20fa17b9-5a43-469e-a0de-e9be80c05f6f HTTP/1.1" status: 204 len: 168 time: 1.8892922 Nov 09 04:33:22.041686 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-766712e9-4470-4b7c-ba94-c59b8e26aedc None None] Routers {'fa30d24d-d721-4675-ad7b-09f35105e633'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:33:22.041769 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56938) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:22.042078 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-766712e9-4470-4b7c-ba94-c59b8e26aedc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:33:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['fa30d24d-d721-4675-ad7b-09f35105e633'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:22.061597 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-768d7bc5-6961-4e16-b065-8d15ecd9add3 None None] No DVR routers for this DVR port 8c90ef15-e112-469b-9b84-e60842294cb2 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:33:22.063724 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No active binding found for port 8c90ef15-e112-469b-9b84-e60842294cb2 {{(pid=102163) get_port_binding_host /opt/stack/neutron/neutron/plugins/ml2/db.py:216}} Nov 09 04:33:22.064221 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 8c90ef15-e112-469b-9b84-e60842294cb2 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:33:22.071827 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-cf6a52c8-1a08-41a0-b078-478b2ec6edb0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:22.140469 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56942) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:22.148208 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-3c82e874-54d1-4019-bf9d-712dbc5e73c1 admin admin] Request body: {'network': {'name': 'tempest-TestServerAdvancedOps-1793191261-network', 'tenant_id': '446490ea609e4e4788a45d2b3796f6b4'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:22.219414 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-766712e9-4470-4b7c-ba94-c59b8e26aedc None None] Set router fa30d24d-d721-4675-ad7b-09f35105e633 gateway port host: None {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:33:22.225522 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f3337371-3d26-456f-8279-6afa629409d6 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Network ab0b8074-97a9-41d7-9124-7c9d6548032d is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:33:22.238734 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-f3337371-3d26-456f-8279-6afa629409d6 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:33:22.253176 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-18c9fa1b-230c-471f-8598-27aa91f4b463 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:22.330584 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-02d5466e-c4fb-41c1-81d2-07251d7bc187 None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:33:22.391745 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-56aa1531-fe37-4ae6-8e5b-10efd2562834 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:22.393655 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-56aa1531-fe37-4ae6-8e5b-10efd2562834 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/ports HTTP/1.1" status: 200 len: 866 time: 0.7251570 Nov 09 04:33:22.428301 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56944) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:22.502791 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3c82e874-54d1-4019-bf9d-712dbc5e73c1 admin admin] Made reservation on behalf of 446490ea609e4e4788a45d2b3796f6b4 for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:33:22.506822 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3c82e874-54d1-4019-bf9d-712dbc5e73c1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:22.541083 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3c82e874-54d1-4019-bf9d-712dbc5e73c1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:22.561589 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-060396b0-2c83-486f-8f23-fc9b56288877 None None] Provisioning complete for port 1e4c4297-f9b1-473b-a97a-22003faa3119 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:22.562440 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-060396b0-2c83-486f-8f23-fc9b56288877 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:22.579565 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-48c5c8cd-2edf-4171-bde6-6686e01622d5 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:22.579565 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-48c5c8cd-2edf-4171-bde6-6686e01622d5 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.1409020 Nov 09 04:33:22.579565 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56946) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:22.633643 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f3337371-3d26-456f-8279-6afa629409d6 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Router bb7d9014-4e7d-4079-ab37-3a9531a32f7d is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102162) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:33:22.648102 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-c900df94-00f4-43db-b774-816c2a7d5fca tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0689120 Nov 09 04:33:22.668477 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56948) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:22.671958 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-18c9fa1b-230c-471f-8598-27aa91f4b463 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:22.694371 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-954a7254-ebaa-450a-86a1-ad09357abba0 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'subnet': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:22.733526 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1ee9e060-f50d-4dbd-a1df-203807cee2c9 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:22.751237 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-766712e9-4470-4b7c-ba94-c59b8e26aedc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'name': 'tempest-RoutersTest-router-1490827103', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:32:29Z', 'updated_at': '2021-11-09T04:33:19Z', 'revision_number': 9, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'gw_port_host': None, '_interfaces': [{'id': '98741773-362a-4c6e-b503-923f0f367a2a', 'name': '', 'network_id': 'e1b06497-74dd-47e6-9b9a-79074e9bf0e8', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:d2:bc:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 847, 'fixed_ips': [{'subnet_id': 'f0939bd8-617d-4f5c-9f7b-272de792edac', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:43Z', 'updated_at': '2021-11-09T04:32:51Z', 'revision_number': 5, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'f0939bd8-617d-4f5c-9f7b-272de792edac', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'bf77ddc4-4ed9-472d-842b-1fb79d55e2e4', 'name': '', 'network_id': '35e2f2d1-ee40-4328-9fe2-48e5a5c19938', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:66:29:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 830, 'fixed_ips': [{'subnet_id': 'f60d3eec-6988-47b0-9f2f-6319fa99064d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:33Z', 'updated_at': '2021-11-09T04:32:44Z', 'revision_number': 5, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'f60d3eec-6988-47b0-9f2f-6319fa99064d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:22.805839 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f2764c96-e759-4c8f-a838-d669dab85ae4 None None] DHCP port deletion for 988d2354-693c-4d52-af17-25e0643eaa0c request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:33:22.808627 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-18c9fa1b-230c-471f-8598-27aa91f4b463 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:22.817836 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-18c9fa1b-230c-471f-8598-27aa91f4b463 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "DELETE /v2.0/subnets/d7a7c5ae-922f-4fe2-ad19-b31fd352c9d1 HTTP/1.1" status: 204 len: 168 time: 1.4700317 Nov 09 04:33:22.826269 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-16be69e9-b586-43be-b431-0b663a392ea5 None None] Network 9e8670b3-5b0d-4ce5-8329-3af82c94231c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:33:22.826619 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56950) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:22.831211 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-766712e9-4470-4b7c-ba94-c59b8e26aedc None None] The sync data for ids ['fa30d24d-d721-4675-ad7b-09f35105e633'] in dv-neutron-816802-2-hyperv is: [{'id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'name': 'tempest-RoutersTest-router-1490827103', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:32:29Z', 'updated_at': '2021-11-09T04:33:19Z', 'revision_number': 9, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'gw_port_host': None, '_interfaces': [{'id': '98741773-362a-4c6e-b503-923f0f367a2a', 'name': '', 'network_id': 'e1b06497-74dd-47e6-9b9a-79074e9bf0e8', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:d2:bc:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 847, 'fixed_ips': [{'subnet_id': 'f0939bd8-617d-4f5c-9f7b-272de792edac', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:43Z', 'updated_at': '2021-11-09T04:32:51Z', 'revision_number': 5, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'f0939bd8-617d-4f5c-9f7b-272de792edac', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'bf77ddc4-4ed9-472d-842b-1fb79d55e2e4', 'name': '', 'network_id': '35e2f2d1-ee40-4328-9fe2-48e5a5c19938', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:66:29:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 830, 'fixed_ips': [{'subnet_id': 'f60d3eec-6988-47b0-9f2f-6319fa99064d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:33Z', 'updated_at': '2021-11-09T04:32:44Z', 'revision_number': 5, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'f60d3eec-6988-47b0-9f2f-6319fa99064d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:33:22.832151 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device bab3b0b2-ec0e-464a-b15f-1f71dc13f0f3 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:33:22.910868 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: bab3b0b2-ec0e-464a-b15f-1f71dc13f0f3 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:33:22.911590 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device bab3b0b2-ec0e-464a-b15f-1f71dc13f0f3 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:33:22.912573 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 1e4c4297-f9b1-473b-a97a-22003faa3119 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:33:22.920277 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1ee9e060-f50d-4dbd-a1df-203807cee2c9 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:22.939323 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18c9fa1b-230c-471f-8598-27aa91f4b463 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event deleted for resources: {'Subnet': ['ID=d7a7c5ae-922f-4fe2-ad19-b31fd352c9d1,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:22.979111 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-1ee9e060-f50d-4dbd-a1df-203807cee2c9 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9c94e7dc-d679-4a7e-b264-6d619dbc935e']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:22.992266 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7b3b2acc-42fc-4e8c-ac79-5ce2d815f869 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:22.995305 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-1ee9e060-f50d-4dbd-a1df-203807cee2c9 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd5411e15-1506-4025-8472-ba7118358f68') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:22.995455 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-1ee9e060-f50d-4dbd-a1df-203807cee2c9 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd5411e15-1506-4025-8472-ba7118358f68') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:23.007675 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1ee9e060-f50d-4dbd-a1df-203807cee2c9 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:23.015362 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f3337371-3d26-456f-8279-6afa629409d6 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:33:23.025078 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1ee9e060-f50d-4dbd-a1df-203807cee2c9 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:23.028108 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-f3337371-3d26-456f-8279-6afa629409d6 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "PUT /v2.0/routers/bb7d9014-4e7d-4079-ab37-3a9531a32f7d/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.3816934 Nov 09 04:33:23.034502 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56952) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:23.050309 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1ee9e060-f50d-4dbd-a1df-203807cee2c9 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Releasing vlan 313 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:33:23.050738 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1ee9e060-f50d-4dbd-a1df-203807cee2c9 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:23.054399 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:33:23.054399 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:33:23.054399 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:33:23.054399 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:33:23.054399 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:33:23.054399 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:33:23.054399 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:33:23.054399 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:33:23.054399 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:33:23.054399 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:33:23.054399 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:33:23.054399 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:33:23.054399 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:33:23.054399 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:33:23.054399 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:33:23.054399 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:33:23.054399 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:33:23.054399 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:33:23.054399 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:33:23.054399 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:33:23.054399 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:33:23.054399 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:33:23.054399 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:33:23.054399 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:33:23.054399 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:33:23.054399 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:33:23.054399 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:33:23.054399 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:33:23.054399 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:33:23.054399 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:33:23.054399 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:33:23.054399 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:33:23.056899 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9e341c37-19c0-4bec-85b3-9be9dfc1f33d None None] Sync routers for ids ['bb7d9014-4e7d-4079-ab37-3a9531a32f7d'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:33:23.084918 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3c82e874-54d1-4019-bf9d-712dbc5e73c1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:23.095460 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-954a7254-ebaa-450a-86a1-ad09357abba0 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:33:23.099307 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-954a7254-ebaa-450a-86a1-ad09357abba0 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:23.101955 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-954a7254-ebaa-450a-86a1-ad09357abba0 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:33:23.102403 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-954a7254-ebaa-450a-86a1-ad09357abba0 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:33:23.108874 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-f2764c96-e759-4c8f-a838-d669dab85ae4 None None] Deleting port 1e4c4297-f9b1-473b-a97a-22003faa3119 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:33:23.109365 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f2764c96-e759-4c8f-a838-d669dab85ae4 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:23.117507 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b88ada60-943c-48f1-a6cb-dc781bd18d3e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:23.119056 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-b88ada60-943c-48f1-a6cb-dc781bd18d3e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "GET /v2.0/ports?device_id=bb7d9014-4e7d-4079-ab37-3a9531a32f7d HTTP/1.1" status: 200 len: 988 time: 0.0836449 Nov 09 04:33:23.122030 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56954) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:23.127667 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-7b3b2acc-42fc-4e8c-ac79-5ce2d815f869 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Deleting port d2861372-0b19-4d5f-98f4-c8dcca66d64f {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:33:23.128006 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7b3b2acc-42fc-4e8c-ac79-5ce2d815f869 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:23.133207 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9e341c37-19c0-4bec-85b3-9be9dfc1f33d None None] Routers {'bb7d9014-4e7d-4079-ab37-3a9531a32f7d'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:33:23.133878 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-9e341c37-19c0-4bec-85b3-9be9dfc1f33d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:33:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['bb7d9014-4e7d-4079-ab37-3a9531a32f7d'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:23.160768 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3c82e874-54d1-4019-bf9d-712dbc5e73c1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:23.202684 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-7b3b2acc-42fc-4e8c-ac79-5ce2d815f869 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] For port d2861372-0b19-4d5f-98f4-c8dcca66d64f, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=d2861372-0b19-4d5f-98f4-c8dcca66d64f,segment=NetworkSegment(696f4512-dd80-4379-a21b-b923df29bba5),segment_id=696f4512-dd80-4379-a21b-b923df29bba5)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:33:23.203265 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7b3b2acc-42fc-4e8c-ac79-5ce2d815f869 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:23.213755 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1ee9e060-f50d-4dbd-a1df-203807cee2c9 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:23.224127 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-9e341c37-19c0-4bec-85b3-9be9dfc1f33d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:23.227900 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1ee9e060-f50d-4dbd-a1df-203807cee2c9 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:23.229793 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:23.235516 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1ee9e060-f50d-4dbd-a1df-203807cee2c9 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "DELETE /v2.0/networks/9c94e7dc-d679-4a7e-b264-6d619dbc935e HTTP/1.1" status: 204 len: 168 time: 1.1924205 Nov 09 04:33:23.236819 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-7b3b2acc-42fc-4e8c-ac79-5ce2d815f869 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Calling delete_port for d2861372-0b19-4d5f-98f4-c8dcca66d64f owned by network:dhcp {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:33:23.237320 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-ea79a956-36d7-4c56-b9e5-149639ae57dc None None] Provisioning complete for port 2c0fbb8b-e998-40f6-8b3e-aba376e4d260 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:23.237866 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ea79a956-36d7-4c56-b9e5-149639ae57dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:23.238771 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56956) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:23.241566 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3c82e874-54d1-4019-bf9d-712dbc5e73c1 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 312} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:33:23.251274 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-954a7254-ebaa-450a-86a1-ad09357abba0 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 460 time: 0.5620604 Nov 09 04:33:23.259300 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56958) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:23.266610 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ee9e060-f50d-4dbd-a1df-203807cee2c9 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Pushing event deleted for resources: {'Network': ['ID=9c94e7dc-d679-4a7e-b264-6d619dbc935e,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:23.266850 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-cf52e962-3987-42ad-aa1b-4c2399c273cf tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'subnet': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'slaac'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:23.279141 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c82e874-54d1-4019-bf9d-712dbc5e73c1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a8f3bb12-bbbd-4259-bd64-05bf9032be92,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:23.282970 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-f2764c96-e759-4c8f-a838-d669dab85ae4 None None] For port 1e4c4297-f9b1-473b-a97a-22003faa3119, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=1e4c4297-f9b1-473b-a97a-22003faa3119,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:33:23.283482 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f2764c96-e759-4c8f-a838-d669dab85ae4 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:23.293258 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3c82e874-54d1-4019-bf9d-712dbc5e73c1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:23.293603 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-3c82e874-54d1-4019-bf9d-712dbc5e73c1 admin admin] Added segment 73e05a91-1d5e-42b3-bfd6-ebbbd224075d of type vlan for network a7a2b30d-fd9d-4c33-a20f-568e8a85bd27 Nov 09 04:33:23.330391 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-f2764c96-e759-4c8f-a838-d669dab85ae4 None None] Calling delete_port for 1e4c4297-f9b1-473b-a97a-22003faa3119 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:33:23.332110 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9e341c37-19c0-4bec-85b3-9be9dfc1f33d None None] Routers {'bb7d9014-4e7d-4079-ab37-3a9531a32f7d'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:33:23.332947 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-9e341c37-19c0-4bec-85b3-9be9dfc1f33d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:33:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['bb7d9014-4e7d-4079-ab37-3a9531a32f7d'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:23.381205 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-ea79a956-36d7-4c56-b9e5-149639ae57dc None None] Port 2c0fbb8b-e998-40f6-8b3e-aba376e4d260 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:33:23.387673 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-9e341c37-19c0-4bec-85b3-9be9dfc1f33d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:23.388455 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9e341c37-19c0-4bec-85b3-9be9dfc1f33d None None] The sync data for ids ['bb7d9014-4e7d-4079-ab37-3a9531a32f7d'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:33:23.392775 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 1e4c4297-f9b1-473b-a97a-22003faa3119, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=1e4c4297-f9b1-473b-a97a-22003faa3119,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:33:23.417697 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2be6bd1c-f534-4e7c-ae95-bfa43e0f2913 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:23.452959 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2be6bd1c-f534-4e7c-ae95-bfa43e0f2913 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:23.455380 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:23.490946 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3c82e874-54d1-4019-bf9d-712dbc5e73c1 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:23.525439 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7b3b2acc-42fc-4e8c-ac79-5ce2d815f869 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:23.527985 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-946852ff-2453-4770-8493-adabcd3523e6 None None] DHCP port deletion for 9e8670b3-5b0d-4ce5-8329-3af82c94231c request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:33:23.539423 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=1e4c4297-f9b1-473b-a97a-22003faa3119,revision_number=8']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:23.573311 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7b3b2acc-42fc-4e8c-ac79-5ce2d815f869 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] No DVR routers for this DVR port d2861372-0b19-4d5f-98f4-c8dcca66d64f on host dv-neutron-816802-2-hyperv {{(pid=102161) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:33:23.600698 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b3b2acc-42fc-4e8c-ac79-5ce2d815f869 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event deleted for resources: {'Port': ['ID=d2861372-0b19-4d5f-98f4-c8dcca66d64f,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:23.609140 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f2764c96-e759-4c8f-a838-d669dab85ae4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:23.648284 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3c82e874-54d1-4019-bf9d-712dbc5e73c1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:23.649389 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2764c96-e759-4c8f-a838-d669dab85ae4 None None] Pushing event deleted for resources: {'Port': ['ID=1e4c4297-f9b1-473b-a97a-22003faa3119,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:23.649844 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3c82e874-54d1-4019-bf9d-712dbc5e73c1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:23.661937 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f2764c96-e759-4c8f-a838-d669dab85ae4 None None] No DVR routers for this DVR port 1e4c4297-f9b1-473b-a97a-22003faa3119 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:33:23.662539 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3c82e874-54d1-4019-bf9d-712dbc5e73c1 admin admin] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:23.674129 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7b3b2acc-42fc-4e8c-ac79-5ce2d815f869 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:23.695726 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-7b3b2acc-42fc-4e8c-ac79-5ce2d815f869 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9e8670b3-5b0d-4ce5-8329-3af82c94231c']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:23.705088 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-7b3b2acc-42fc-4e8c-ac79-5ce2d815f869 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '696f4512-dd80-4379-a21b-b923df29bba5') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:23.710234 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-7b3b2acc-42fc-4e8c-ac79-5ce2d815f869 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '696f4512-dd80-4379-a21b-b923df29bba5') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:23.715409 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7b3b2acc-42fc-4e8c-ac79-5ce2d815f869 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:23.717386 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cf52e962-3987-42ad-aa1b-4c2399c273cf tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:33:23.720876 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cf52e962-3987-42ad-aa1b-4c2399c273cf tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:23.722240 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-cf52e962-3987-42ad-aa1b-4c2399c273cf tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:33:23.722694 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-cf52e962-3987-42ad-aa1b-4c2399c273cf tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:33:23.729454 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7b3b2acc-42fc-4e8c-ac79-5ce2d815f869 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:23.735517 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7b3b2acc-42fc-4e8c-ac79-5ce2d815f869 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Releasing vlan 344 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:33:23.735899 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7b3b2acc-42fc-4e8c-ac79-5ce2d815f869 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:23.736854 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c82e874-54d1-4019-bf9d-712dbc5e73c1 admin admin] Pushing event updated for resources: {'Network': ['ID=a7a2b30d-fd9d-4c33-a20f-568e8a85bd27,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:23.739518 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:33:23.739518 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:33:23.739518 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:33:23.739518 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:33:23.739518 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:33:23.739518 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:33:23.739518 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:33:23.739518 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:33:23.739518 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:33:23.739518 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:33:23.739518 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:33:23.739518 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:33:23.739518 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:33:23.739518 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:33:23.739518 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:33:23.739518 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:33:23.739518 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:33:23.739518 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:33:23.739518 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:33:23.739518 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:33:23.739518 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:33:23.739518 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:33:23.739518 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:33:23.739518 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:33:23.739518 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:33:23.739518 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:33:23.739518 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:33:23.739518 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:33:23.739518 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:33:23.739518 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:33:23.739518 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:33:23.739518 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:33:23.752882 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network a7a2b30d-fd9d-4c33-a20f-568e8a85bd27 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:33:23.762899 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2be6bd1c-f534-4e7c-ae95-bfa43e0f2913 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:23.765501 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2be6bd1c-f534-4e7c-ae95-bfa43e0f2913 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:23.767704 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-2be6bd1c-f534-4e7c-ae95-bfa43e0f2913 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] 10.222.0.24 "DELETE /v2.0/security-groups/4ff68177-77d2-4250-b11c-4d5b55fd3619 HTTP/1.1" status: 204 len: 168 time: 0.5173316 Nov 09 04:33:23.804556 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2be6bd1c-f534-4e7c-ae95-bfa43e0f2913 tempest-TestNetworkAdvancedServerOps-747699447 tempest-TestNetworkAdvancedServerOps-747699447-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=4ff68177-77d2-4250-b11c-4d5b55fd3619,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:23.813334 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9f57b230-f103-466b-9a99-8b9a1b637f6c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:23.819969 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-3c82e874-54d1-4019-bf9d-712dbc5e73c1 admin admin] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 1.6784725 Nov 09 04:33:23.822860 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56962) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:23.827929 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-ec20fadb-3b4d-4b9d-b86f-e2c9748ba9c1 admin admin] Request body: {'subnet': {'network_id': 'a7a2b30d-fd9d-4c33-a20f-568e8a85bd27', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestServerAdvancedOps-1793191261-subnet', 'tenant_id': '446490ea609e4e4788a45d2b3796f6b4', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:23.860281 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56964) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:23.860419 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-cf52e962-3987-42ad-aa1b-4c2399c273cf tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 450 time: 0.5983224 Nov 09 04:33:23.870760 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-966cd538-42e3-4d94-b9ca-5f8789f8326d tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'subnet': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:23.931100 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7b3b2acc-42fc-4e8c-ac79-5ce2d815f869 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:23.940044 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7b3b2acc-42fc-4e8c-ac79-5ce2d815f869 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:23.943459 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-7b3b2acc-42fc-4e8c-ac79-5ce2d815f869 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "DELETE /v2.0/networks/9e8670b3-5b0d-4ce5-8329-3af82c94231c HTTP/1.1" status: 204 len: 168 time: 1.1157367 Nov 09 04:33:23.946917 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56968) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:24.007167 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ec20fadb-3b4d-4b9d-b86f-e2c9748ba9c1 admin admin] Made reservation on behalf of 446490ea609e4e4788a45d2b3796f6b4 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:33:24.009522 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ec20fadb-3b4d-4b9d-b86f-e2c9748ba9c1 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:24.024770 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b3b2acc-42fc-4e8c-ac79-5ce2d815f869 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event deleted for resources: {'Network': ['ID=9e8670b3-5b0d-4ce5-8329-3af82c94231c,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:24.067297 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-9f57b230-f103-466b-9a99-8b9a1b637f6c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Deleting port 2c0fbb8b-e998-40f6-8b3e-aba376e4d260 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:33:24.067633 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9f57b230-f103-466b-9a99-8b9a1b637f6c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:24.159778 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9f57b230-f103-466b-9a99-8b9a1b637f6c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:24.172925 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-9f57b230-f103-466b-9a99-8b9a1b637f6c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Calling delete_port for 2c0fbb8b-e998-40f6-8b3e-aba376e4d260 owned by network:router_interface {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:33:24.227248 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-966cd538-42e3-4d94-b9ca-5f8789f8326d tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:33:24.230744 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-966cd538-42e3-4d94-b9ca-5f8789f8326d tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:24.232866 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-966cd538-42e3-4d94-b9ca-5f8789f8326d tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:33:24.233293 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-966cd538-42e3-4d94-b9ca-5f8789f8326d tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:33:24.397136 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9f57b230-f103-466b-9a99-8b9a1b637f6c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:24.401719 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-966cd538-42e3-4d94-b9ca-5f8789f8326d tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 449 time: 0.5402966 Nov 09 04:33:24.405581 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56972) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:24.412994 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-7ea2d9ca-97ee-43ce-8364-61dc78960b2b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'subnet': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:24.431882 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f57b230-f103-466b-9a99-8b9a1b637f6c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event deleted for resources: {'Port': ['ID=2c0fbb8b-e998-40f6-8b3e-aba376e4d260,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:24.444009 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56974) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:24.523372 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ec20fadb-3b4d-4b9d-b86f-e2c9748ba9c1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:24.557397 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9f57b230-f103-466b-9a99-8b9a1b637f6c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:24.578412 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec20fadb-3b4d-4b9d-b86f-e2c9748ba9c1 admin admin] Pushing event updated for resources: {'Subnet': ['ID=0b9d2143-9a73-40b5-993e-e0be24c95bc4,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:24.667642 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ec20fadb-3b4d-4b9d-b86f-e2c9748ba9c1 admin admin] Checking segment: {'id': '73e05a91-1d5e-42b3-bfd6-ebbbd224075d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 312, 'network_id': 'a7a2b30d-fd9d-4c33-a20f-568e8a85bd27'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:33:24.667642 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ec20fadb-3b4d-4b9d-b86f-e2c9748ba9c1 admin admin] Network hostable DHCP agents. Network: a7a2b30d-fd9d-4c33-a20f-568e8a85bd27, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:33:24.685379 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f1afe036-f038-4a66-89ad-14b3496ca51e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:24.689262 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7ea2d9ca-97ee-43ce-8364-61dc78960b2b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:33:24.693376 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7ea2d9ca-97ee-43ce-8364-61dc78960b2b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:24.694533 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 20195bcd-85f4-4bce-bae2-63cdf464f57f no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:33:24.695023 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-7ea2d9ca-97ee-43ce-8364-61dc78960b2b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:33:24.695317 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-7ea2d9ca-97ee-43ce-8364-61dc78960b2b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:33:24.719848 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 20195bcd-85f4-4bce-bae2-63cdf464f57f {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:33:24.720052 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 20195bcd-85f4-4bce-bae2-63cdf464f57f not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:33:24.720580 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 8508be40-2af9-45a5-96f0-06d142f33d8d no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:33:24.726406 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-d80989e3-3964-4fa1-b803-f8bed5ac7daa admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=fd7df27e425449dfb80d0838c8f7fb89&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2806580 Nov 09 04:33:24.730497 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56978) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:24.741149 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 8508be40-2af9-45a5-96f0-06d142f33d8d {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:33:24.741498 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 8508be40-2af9-45a5-96f0-06d142f33d8d not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:33:24.741891 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device d2861372-0b19-4d5f-98f4-c8dcca66d64f no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:33:24.762258 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: d2861372-0b19-4d5f-98f4-c8dcca66d64f {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:33:24.762792 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device d2861372-0b19-4d5f-98f4-c8dcca66d64f not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:33:24.820406 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ec20fadb-3b4d-4b9d-b86f-e2c9748ba9c1 admin admin] Network a7a2b30d-fd9d-4c33-a20f-568e8a85bd27 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:33:24.851057 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-7ea2d9ca-97ee-43ce-8364-61dc78960b2b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 460 time: 0.4402878 Nov 09 04:33:24.851272 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9f57b230-f103-466b-9a99-8b9a1b637f6c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Router bb7d9014-4e7d-4079-ab37-3a9531a32f7d has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:33:24.852544 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56980) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:24.857550 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-513c1c18-30a5-4628-abe6-44297a2b3d3f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'subnet': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'slaac'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:24.877866 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1de5e1f5-4681-4483-ac1b-97a1ae1c861f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:24.923188 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-ec20fadb-3b4d-4b9d-b86f-e2c9748ba9c1 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, a7a2b30d-fd9d-4c33-a20f-568e8a85bd27) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:33:24.931389 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-61797646-bd99-4b2b-95b2-1e18cd2bd537 None None] Network a7a2b30d-fd9d-4c33-a20f-568e8a85bd27 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:33:24.942263 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ec20fadb-3b4d-4b9d-b86f-e2c9748ba9c1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:24.943458 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ec20fadb-3b4d-4b9d-b86f-e2c9748ba9c1 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:24.966502 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9f57b230-f103-466b-9a99-8b9a1b637f6c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:33:24.979105 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-9f57b230-f103-466b-9a99-8b9a1b637f6c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "PUT /v2.0/routers/bb7d9014-4e7d-4079-ab37-3a9531a32f7d/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8540959 Nov 09 04:33:24.982688 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-63be151d-2665-4b3f-a90b-cf1711fd2c9c None None] Sync routers for ids ['bb7d9014-4e7d-4079-ab37-3a9531a32f7d'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:33:24.983421 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56982) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:24.984000 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1de5e1f5-4681-4483-ac1b-97a1ae1c861f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:24.996792 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-63be151d-2665-4b3f-a90b-cf1711fd2c9c None None] Routers {'bb7d9014-4e7d-4079-ab37-3a9531a32f7d'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:33:24.997673 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-63be151d-2665-4b3f-a90b-cf1711fd2c9c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:33:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['bb7d9014-4e7d-4079-ab37-3a9531a32f7d'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:25.028754 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-0956964e-fcae-4771-a5c9-0ec427b5ba08 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] GET failed (client error): The resource could not be found. Nov 09 04:33:25.036078 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-0956964e-fcae-4771-a5c9-0ec427b5ba08 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "GET /v2.0/ports/2c0fbb8b-e998-40f6-8b3e-aba376e4d260 HTTP/1.1" status: 404 len: 333 time: 0.0490179 Nov 09 04:33:25.037091 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56984) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:25.039016 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-63be151d-2665-4b3f-a90b-cf1711fd2c9c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:25.044412 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-ec20fadb-3b4d-4b9d-b86f-e2c9748ba9c1 admin admin] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 1.2204044 Nov 09 04:33:25.049445 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-63be151d-2665-4b3f-a90b-cf1711fd2c9c None None] Routers {'bb7d9014-4e7d-4079-ab37-3a9531a32f7d'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:33:25.050229 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-63be151d-2665-4b3f-a90b-cf1711fd2c9c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:33:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['bb7d9014-4e7d-4079-ab37-3a9531a32f7d'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:25.081445 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-f1afe036-f038-4a66-89ad-14b3496ca51e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Deleting port 98741773-362a-4c6e-b503-923f0f367a2a {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:33:25.081880 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f1afe036-f038-4a66-89ad-14b3496ca51e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:25.092683 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-63be151d-2665-4b3f-a90b-cf1711fd2c9c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:25.093578 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-63be151d-2665-4b3f-a90b-cf1711fd2c9c None None] The sync data for ids ['bb7d9014-4e7d-4079-ab37-3a9531a32f7d'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:33:25.128567 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-102c8fde-6506-4a5a-bdad-63a6422317e6 None None] Network a7a2b30d-fd9d-4c33-a20f-568e8a85bd27 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:33:25.146991 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-dce69e1f-1da2-46ed-8172-4e03b81315dd tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for router, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:25.164327 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-513c1c18-30a5-4628-abe6-44297a2b3d3f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:33:25.169768 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-513c1c18-30a5-4628-abe6-44297a2b3d3f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:25.171876 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-513c1c18-30a5-4628-abe6-44297a2b3d3f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:33:25.172384 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-513c1c18-30a5-4628-abe6-44297a2b3d3f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:33:25.257521 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-513c1c18-30a5-4628-abe6-44297a2b3d3f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 449 time: 0.4038010 Nov 09 04:33:25.258240 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 56988) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:25.267847 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-5ed615ca-fc5a-4396-8678-cc0028c8dccb tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'subnet': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:25.320765 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1de5e1f5-4681-4483-ac1b-97a1ae1c861f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:25.323537 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1de5e1f5-4681-4483-ac1b-97a1ae1c861f admin admin] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:25.324671 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-1de5e1f5-4681-4483-ac1b-97a1ae1c861f admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/0c33fb12-86ce-4d95-80c8-24801f8f332f HTTP/1.1" status: 204 len: 168 time: 0.5921359 Nov 09 04:33:25.337935 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-f1afe036-f038-4a66-89ad-14b3496ca51e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] For port 98741773-362a-4c6e-b503-923f0f367a2a, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=98741773-362a-4c6e-b503-923f0f367a2a,segment=NetworkSegment(d324ad80-31e0-4532-9d92-4601f8a04c92),segment_id=d324ad80-31e0-4532-9d92-4601f8a04c92)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:33:25.338303 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f1afe036-f038-4a66-89ad-14b3496ca51e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:25.358461 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-f1afe036-f038-4a66-89ad-14b3496ca51e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Calling delete_port for 98741773-362a-4c6e-b503-923f0f367a2a owned by network:router_interface {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:33:25.362046 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-dce69e1f-1da2-46ed-8172-4e03b81315dd tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:25.363933 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1de5e1f5-4681-4483-ac1b-97a1ae1c861f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0c33fb12-86ce-4d95-80c8-24801f8f332f,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:25.366902 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-dce69e1f-1da2-46ed-8172-4e03b81315dd tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:25.423869 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5ed615ca-fc5a-4396-8678-cc0028c8dccb tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:33:25.428179 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5ed615ca-fc5a-4396-8678-cc0028c8dccb tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:25.429875 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-5ed615ca-fc5a-4396-8678-cc0028c8dccb tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:33:25.430042 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5ed615ca-fc5a-4396-8678-cc0028c8dccb tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:33:25.471614 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-dce69e1f-1da2-46ed-8172-4e03b81315dd tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:25.473125 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dce69e1f-1da2-46ed-8172-4e03b81315dd tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Fanout notify agent at l3_agent the message router_deleted on router bb7d9014-4e7d-4079-ab37-3a9531a32f7d {{(pid=102162) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:33:25.481950 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-dce69e1f-1da2-46ed-8172-4e03b81315dd tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:25.485944 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-dce69e1f-1da2-46ed-8172-4e03b81315dd tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "DELETE /v2.0/routers/bb7d9014-4e7d-4079-ab37-3a9531a32f7d HTTP/1.1" status: 204 len: 168 time: 0.4445515 Nov 09 04:33:25.486668 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 56998) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:25.504158 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-5ed615ca-fc5a-4396-8678-cc0028c8dccb tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 450 time: 0.2385993 Nov 09 04:33:25.504404 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57000) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:25.538951 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a6c5ffb9-9df0-4373-a101-31649f33330f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/ports HTTP/1.1" status: 200 len: 205 time: 0.0334408 Nov 09 04:33:25.541571 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57002) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:25.548649 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-a58cb39c-cc48-40e2-a0a2-3ece9a02dea4 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Deleting subnet aec9d80c-825b-434b-b01c-c5b0a638be76 {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:33:25.554843 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a58cb39c-cc48-40e2-a0a2-3ece9a02dea4 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:25.601417 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a58cb39c-cc48-40e2-a0a2-3ece9a02dea4 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:25.628009 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-842cb9ed-4af6-429e-837d-f389cf07e6fd tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:25.629662 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-842cb9ed-4af6-429e-837d-f389cf07e6fd tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.0871866 Nov 09 04:33:25.633802 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57004) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:25.682806 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-3ef3d952-1c05-4304-b1e4-fa1da3082972 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0478373 Nov 09 04:33:25.687369 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57008) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:25.695821 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-d69d8ef4-db0c-4c5b-abaf-355af8ec924e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'subnet': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:25.699072 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a58cb39c-cc48-40e2-a0a2-3ece9a02dea4 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:25.759873 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f1afe036-f038-4a66-89ad-14b3496ca51e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:25.802597 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1afe036-f038-4a66-89ad-14b3496ca51e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event deleted for resources: {'Port': ['ID=98741773-362a-4c6e-b503-923f0f367a2a,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:25.858829 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a58cb39c-cc48-40e2-a0a2-3ece9a02dea4 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:25.932113 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a58cb39c-cc48-40e2-a0a2-3ece9a02dea4 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event deleted for resources: {'Subnet': ['ID=aec9d80c-825b-434b-b01c-c5b0a638be76,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:25.936682 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a58cb39c-cc48-40e2-a0a2-3ece9a02dea4 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:25.940400 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-731abcde-7055-4365-b171-4965e0e910de None None] Network ab0b8074-97a9-41d7-9124-7c9d6548032d requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:33:25.941567 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a58cb39c-cc48-40e2-a0a2-3ece9a02dea4 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "DELETE /v2.0/subnets/aec9d80c-825b-434b-b01c-c5b0a638be76 HTTP/1.1" status: 204 len: 168 time: 0.4533553 Nov 09 04:33:25.945403 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57018) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:25.950988 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d69d8ef4-db0c-4c5b-abaf-355af8ec924e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:33:25.954815 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d69d8ef4-db0c-4c5b-abaf-355af8ec924e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:26.062834 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ef1af4f5-1b01-4e33-acd6-1aee2d870248 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:26.080960 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eaf21388-8c21-445f-bd1a-9f0b098538ba req-4c46f005-0129-4b3f-804f-2284a65a79f3 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:26.090148 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-eaf21388-8c21-445f-bd1a-9f0b098538ba req-4c46f005-0129-4b3f-804f-2284a65a79f3 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/networks?id=10e5206a-1d3b-409b-a3ee-0f6a311d6819 HTTP/1.1" status: 200 len: 811 time: 0.2545016 Nov 09 04:33:26.113136 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-eaf21388-8c21-445f-bd1a-9f0b098538ba req-964ad358-55af-4739-8f31-a2f06e6ed2de tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/quotas/a7dd369fc9b947d2b50f9f75551d326d HTTP/1.1" status: 200 len: 375 time: 0.0220199 Nov 09 04:33:26.134914 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f1afe036-f038-4a66-89ad-14b3496ca51e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:26.146745 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-eaf21388-8c21-445f-bd1a-9f0b098538ba req-ccf26ddb-23e0-4a70-bddc-664b83fe79f6 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/ports?tenant_id=a7dd369fc9b947d2b50f9f75551d326d&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0327284 Nov 09 04:33:26.163080 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a0210584-1788-4313-bb08-ff1339bb9025 None None] DHCP port deletion for ab0b8074-97a9-41d7-9124-7c9d6548032d request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:33:26.219024 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-a0210584-1788-4313-bb08-ff1339bb9025 None None] Deleting port 3c3189c5-4de3-41eb-acd8-21a984377732 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:33:26.219693 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a0210584-1788-4313-bb08-ff1339bb9025 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:26.241212 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57020) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:26.263562 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c5107487-6aa0-48a3-a789-ec56c3f9f5e1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:26.292482 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-a0210584-1788-4313-bb08-ff1339bb9025 None None] For port 3c3189c5-4de3-41eb-acd8-21a984377732, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=3c3189c5-4de3-41eb-acd8-21a984377732,segment=NetworkSegment(201b1b4b-3524-4db3-a248-d7e7fd388c3f),segment_id=201b1b4b-3524-4db3-a248-d7e7fd388c3f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:33:26.292878 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a0210584-1788-4313-bb08-ff1339bb9025 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:26.310557 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-a0210584-1788-4313-bb08-ff1339bb9025 None None] Calling delete_port for 3c3189c5-4de3-41eb-acd8-21a984377732 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:33:26.312701 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-ef1af4f5-1b01-4e33-acd6-1aee2d870248 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Deleting port 3c3189c5-4de3-41eb-acd8-21a984377732 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:33:26.313028 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ef1af4f5-1b01-4e33-acd6-1aee2d870248 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:26.330388 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-eaf21388-8c21-445f-bd1a-9f0b098538ba req-541c3bbd-2395-441a-b9f4-72a15f73bf85 service neutron] 10.222.0.24 "GET /v2.0/networks/10e5206a-1d3b-409b-a3ee-0f6a311d6819?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1592040 Nov 09 04:33:26.446835 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.objects.ports [None req-d69d8ef4-db0c-4c5b-abaf-355af8ec924e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=102161) get_objects /opt/stack/neutron/neutron/objects/ports.py:444}} Nov 09 04:33:26.449038 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f1afe036-f038-4a66-89ad-14b3496ca51e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Router fa30d24d-d721-4675-ad7b-09f35105e633 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:33:26.453601 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d69d8ef4-db0c-4c5b-abaf-355af8ec924e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:26.468483 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-ef1af4f5-1b01-4e33-acd6-1aee2d870248 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] For port 3c3189c5-4de3-41eb-acd8-21a984377732, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=3c3189c5-4de3-41eb-acd8-21a984377732,segment=NetworkSegment(201b1b4b-3524-4db3-a248-d7e7fd388c3f),segment_id=201b1b4b-3524-4db3-a248-d7e7fd388c3f)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:33:26.470680 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ef1af4f5-1b01-4e33-acd6-1aee2d870248 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:26.496755 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-ef1af4f5-1b01-4e33-acd6-1aee2d870248 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Calling delete_port for 3c3189c5-4de3-41eb-acd8-21a984377732 owned by network:dhcp {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:33:26.501227 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d69d8ef4-db0c-4c5b-abaf-355af8ec924e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:33:26.540986 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-d69d8ef4-db0c-4c5b-abaf-355af8ec924e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:33:26.544473 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d69d8ef4-db0c-4c5b-abaf-355af8ec924e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:26.545320 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d69d8ef4-db0c-4c5b-abaf-355af8ec924e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:26.551850 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dbee170d-5078-45d0-a1a5-33e62d303dec None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:33:26.571932 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-eaf21388-8c21-445f-bd1a-9f0b098538ba req-6d8a91b2-81fa-4bdc-800f-48d74942a828 service neutron] 10.222.0.24 "GET /v2.0/networks/10e5206a-1d3b-409b-a3ee-0f6a311d6819?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2257345 Nov 09 04:33:26.578819 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c5107487-6aa0-48a3-a789-ec56c3f9f5e1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:26.593968 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d69d8ef4-db0c-4c5b-abaf-355af8ec924e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Subnet': ['ID=23dc2386-fb53-4305-a616-d5e868e5db20,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:26.608095 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a0210584-1788-4313-bb08-ff1339bb9025 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:26.619061 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f1afe036-f038-4a66-89ad-14b3496ca51e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:33:26.630470 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ef1af4f5-1b01-4e33-acd6-1aee2d870248 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:26.632366 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-f1afe036-f038-4a66-89ad-14b3496ca51e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "PUT /v2.0/routers/fa30d24d-d721-4675-ad7b-09f35105e633/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.6829197 Nov 09 04:33:26.633159 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57022) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:26.635756 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c5107487-6aa0-48a3-a789-ec56c3f9f5e1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:26.636383 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0210584-1788-4313-bb08-ff1339bb9025 None None] Pushing event deleted for resources: {'Port': ['ID=3c3189c5-4de3-41eb-acd8-21a984377732,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:26.644752 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bc9eedd1-f459-4e31-b867-a0954239b6ae None None] Sync routers for ids ['fa30d24d-d721-4675-ad7b-09f35105e633'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:33:26.650070 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-d69d8ef4-db0c-4c5b-abaf-355af8ec924e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 827 time: 0.9616604 Nov 09 04:33:26.662883 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a0210584-1788-4313-bb08-ff1339bb9025 None None] No DVR routers for this DVR port 3c3189c5-4de3-41eb-acd8-21a984377732 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:33:26.674150 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57024) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:26.679172 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-12d98a17-d146-4d33-9ffb-f2457ac5e4d0 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'port': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'mac_address': 'fa:16:3e:11:c5:eb', 'name': 'tempest-NetworksTestDHCPv6-692860912'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:26.686776 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef1af4f5-1b01-4e33-acd6-1aee2d870248 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event deleted for resources: {'Port': ['ID=3c3189c5-4de3-41eb-acd8-21a984377732,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:26.687441 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bc9eedd1-f459-4e31-b867-a0954239b6ae None None] Routers {'fa30d24d-d721-4675-ad7b-09f35105e633'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:33:26.688073 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-bc9eedd1-f459-4e31-b867-a0954239b6ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:33:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['fa30d24d-d721-4675-ad7b-09f35105e633'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:26.705809 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ef1af4f5-1b01-4e33-acd6-1aee2d870248 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] No DVR routers for this DVR port 3c3189c5-4de3-41eb-acd8-21a984377732 on host dv-neutron-816802-2-hyperv {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:33:26.721219 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5107487-6aa0-48a3-a789-ec56c3f9f5e1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e25afd0e-1449-46e9-81aa-cd3d872c4fba,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:26.753942 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-c5107487-6aa0-48a3-a789-ec56c3f9f5e1 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=3e958209c6ad4f83b9fa448755ef72b0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5105994 Nov 09 04:33:26.758319 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57026) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:26.807500 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-9db773d1-a427-4d2f-84de-25a84587c975 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Deleting subnet f0939bd8-617d-4f5c-9f7b-272de792edac {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:33:26.813714 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9db773d1-a427-4d2f-84de-25a84587c975 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:26.817718 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-bc9eedd1-f459-4e31-b867-a0954239b6ae None None] Set router fa30d24d-d721-4675-ad7b-09f35105e633 gateway port host: None {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:33:26.900049 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9db773d1-a427-4d2f-84de-25a84587c975 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:26.929675 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3d4bfacd-a3dd-49b8-b809-04768d7cd6ac None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-988d2354-693c-4d52-af17-25e0643eaa0c', 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'tenant_id': '8b0758f781884982bf5b94e6609237f6', 'fixed_ips': [{'subnet_id': '23dc2386-fb53-4305-a616-d5e868e5db20'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:33:26.930486 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3d4bfacd-a3dd-49b8-b809-04768d7cd6ac None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:27.002556 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 3c3189c5-4de3-41eb-acd8-21a984377732 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:33:27.028623 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9db773d1-a427-4d2f-84de-25a84587c975 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:27.053037 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-12d98a17-d146-4d33-9ffb-f2457ac5e4d0 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'port': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:33:27.053546 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 3c3189c5-4de3-41eb-acd8-21a984377732 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:33:27.054109 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 3c3189c5-4de3-41eb-acd8-21a984377732 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:33:27.147304 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-9075baa7-bccb-4b85-88d7-314b75562fe1 req-f5f9cf45-40c7-4052-b60a-931966cdf69e tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/ports?device_id=e145337f-88ba-4f6d-a894-39631a8dd013 HTTP/1.1" status: 200 len: 210 time: 0.0649090 Nov 09 04:33:27.191567 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-12d98a17-d146-4d33-9ffb-f2457ac5e4d0 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:27.213706 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [None req-12d98a17-d146-4d33-9ffb-f2457ac5e4d0 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] device_id is not set on port 53e983bc-c23d-44eb-813f-6843807e95b8 yet. {{(pid=102161) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:33:27.247439 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-3d4bfacd-a3dd-49b8-b809-04768d7cd6ac None None] Allocated IP 2001:db8::f816:3eff:fe3e:f07d (988d2354-693c-4d52-af17-25e0643eaa0c/23dc2386-fb53-4305-a616-d5e868e5db20/323df98f-dd98-4575-9b49-e8e238e9db53) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:33:27.268124 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ef1af4f5-1b01-4e33-acd6-1aee2d870248 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:27.272692 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9db773d1-a427-4d2f-84de-25a84587c975 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:27.305627 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-ef1af4f5-1b01-4e33-acd6-1aee2d870248 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ab0b8074-97a9-41d7-9124-7c9d6548032d']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:27.310221 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9db773d1-a427-4d2f-84de-25a84587c975 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event deleted for resources: {'Subnet': ['ID=f0939bd8-617d-4f5c-9f7b-272de792edac,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:27.317238 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-ef1af4f5-1b01-4e33-acd6-1aee2d870248 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '201b1b4b-3524-4db3-a248-d7e7fd388c3f') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:27.317238 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-ef1af4f5-1b01-4e33-acd6-1aee2d870248 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '201b1b4b-3524-4db3-a248-d7e7fd388c3f') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:27.319709 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-bc9eedd1-f459-4e31-b867-a0954239b6ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'name': 'tempest-RoutersTest-router-1490827103', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:32:29Z', 'updated_at': '2021-11-09T04:33:25Z', 'revision_number': 10, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'gw_port_host': None, '_interfaces': [{'id': 'bf77ddc4-4ed9-472d-842b-1fb79d55e2e4', 'name': '', 'network_id': '35e2f2d1-ee40-4328-9fe2-48e5a5c19938', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:66:29:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 830, 'fixed_ips': [{'subnet_id': 'f60d3eec-6988-47b0-9f2f-6319fa99064d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:33Z', 'updated_at': '2021-11-09T04:32:44Z', 'revision_number': 5, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'f60d3eec-6988-47b0-9f2f-6319fa99064d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:27.322557 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9db773d1-a427-4d2f-84de-25a84587c975 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:27.329458 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-9db773d1-a427-4d2f-84de-25a84587c975 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "DELETE /v2.0/subnets/f0939bd8-617d-4f5c-9f7b-272de792edac HTTP/1.1" status: 204 len: 168 time: 0.6930342 Nov 09 04:33:27.330860 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57036) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:27.335969 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ef1af4f5-1b01-4e33-acd6-1aee2d870248 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:27.344149 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-549ef637-f32d-4db9-afc2-6824db8858c6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:27.355323 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-be273d9a-5fd4-4a85-877d-9019a8fd87b1 None None] Network e1b06497-74dd-47e6-9b9a-79074e9bf0e8 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:33:27.357762 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ef1af4f5-1b01-4e33-acd6-1aee2d870248 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:27.359924 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bc9eedd1-f459-4e31-b867-a0954239b6ae None None] Checking router: fa30d24d-d721-4675-ad7b-09f35105e633 for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:33:27.371283 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ef1af4f5-1b01-4e33-acd6-1aee2d870248 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Releasing vlan 331 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:33:27.372075 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ef1af4f5-1b01-4e33-acd6-1aee2d870248 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:27.374844 dv-neutron-816802-2-hyperv neutron-server[102162]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:33:27.374844 dv-neutron-816802-2-hyperv neutron-server[102162]: self.session.flush() Nov 09 04:33:27.374844 dv-neutron-816802-2-hyperv neutron-server[102162]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:33:27.374844 dv-neutron-816802-2-hyperv neutron-server[102162]: self.session.flush() Nov 09 04:33:27.374844 dv-neutron-816802-2-hyperv neutron-server[102162]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:33:27.374844 dv-neutron-816802-2-hyperv neutron-server[102162]: self.session.flush() Nov 09 04:33:27.374844 dv-neutron-816802-2-hyperv neutron-server[102162]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:33:27.374844 dv-neutron-816802-2-hyperv neutron-server[102162]: self.session.flush() Nov 09 04:33:27.374844 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:33:27.374844 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:33:27.374844 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:33:27.374844 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:33:27.374844 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:33:27.374844 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:33:27.374844 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:33:27.374844 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:33:27.374844 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:33:27.374844 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:33:27.374844 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:33:27.374844 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:33:27.374844 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:33:27.374844 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:33:27.374844 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:33:27.374844 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:33:27.374844 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:33:27.374844 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:33:27.374844 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:33:27.374844 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:33:27.374844 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:33:27.374844 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:33:27.374844 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:33:27.374844 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:33:27.374844 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:33:27.374844 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:33:27.374844 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:33:27.374844 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:33:27.374844 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:33:27.374844 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:33:27.374844 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:33:27.374844 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:33:27.392286 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-549ef637-f32d-4db9-afc2-6824db8858c6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:27.423445 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a654c505-c01e-40dc-b59d-6eb11d381257 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:27.425396 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bc9eedd1-f459-4e31-b867-a0954239b6ae None None] Routers {'fa30d24d-d721-4675-ad7b-09f35105e633'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:33:27.426236 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-bc9eedd1-f459-4e31-b867-a0954239b6ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:33:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['fa30d24d-d721-4675-ad7b-09f35105e633'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:27.497237 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-a654c505-c01e-40dc-b59d-6eb11d381257 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Deleting port 64baf918-08fa-4394-98c8-06a2cc60530a {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:33:27.497854 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a654c505-c01e-40dc-b59d-6eb11d381257 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:27.560596 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-a654c505-c01e-40dc-b59d-6eb11d381257 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] For port 64baf918-08fa-4394-98c8-06a2cc60530a, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=64baf918-08fa-4394-98c8-06a2cc60530a,segment=NetworkSegment(d324ad80-31e0-4532-9d92-4601f8a04c92),segment_id=d324ad80-31e0-4532-9d92-4601f8a04c92)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:33:27.561618 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a654c505-c01e-40dc-b59d-6eb11d381257 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:27.562649 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-549ef637-f32d-4db9-afc2-6824db8858c6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:27.566508 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-549ef637-f32d-4db9-afc2-6824db8858c6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:27.572361 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-549ef637-f32d-4db9-afc2-6824db8858c6 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/e25afd0e-1449-46e9-81aa-cd3d872c4fba HTTP/1.1" status: 204 len: 168 time: 0.8133094 Nov 09 04:33:27.577617 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ef1af4f5-1b01-4e33-acd6-1aee2d870248 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:27.577851 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-a654c505-c01e-40dc-b59d-6eb11d381257 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Calling delete_port for 64baf918-08fa-4394-98c8-06a2cc60530a owned by network:dhcp {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:33:27.591012 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ef1af4f5-1b01-4e33-acd6-1aee2d870248 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:27.596029 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-bc9eedd1-f459-4e31-b867-a0954239b6ae None None] Set router fa30d24d-d721-4675-ad7b-09f35105e633 gateway port host: None {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:33:27.596209 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-ef1af4f5-1b01-4e33-acd6-1aee2d870248 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "DELETE /v2.0/networks/ab0b8074-97a9-41d7-9124-7c9d6548032d HTTP/1.1" status: 204 len: 168 time: 1.6495707 Nov 09 04:33:27.600644 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-549ef637-f32d-4db9-afc2-6824db8858c6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e25afd0e-1449-46e9-81aa-cd3d872c4fba,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:27.601060 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57040) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:27.622988 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef1af4f5-1b01-4e33-acd6-1aee2d870248 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event deleted for resources: {'Network': ['ID=ab0b8074-97a9-41d7-9124-7c9d6548032d,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:27.662673 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b5329684-dcee-457e-a299-34ff791401cd tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:27.663268 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3d4bfacd-a3dd-49b8-b809-04768d7cd6ac None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:27.668103 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-b5329684-dcee-457e-a299-34ff791401cd tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "GET /v2.0/ports/77290ebd-f244-4a68-94af-4d033c4a6349 HTTP/1.1" status: 200 len: 845 time: 0.0524106 Nov 09 04:33:27.668103 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57042) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:27.742554 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-25614d02-58dd-4a09-8338-83823e7ff759 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "GET /v2.0/ports/77290ebd-f244-4a68-94af-4d033c4a6349?fields=id&fields=mac_address HTTP/1.1" status: 200 len: 281 time: 0.0731702 Nov 09 04:33:27.743177 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57044) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:27.753817 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-559d84a8-4bf5-40bf-8486-12618d8f9e00 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Request body: {'subnet': {'network_id': '002d27a0-2fb8-4426-9550-42c444556a8e', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:27.764641 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3d4bfacd-a3dd-49b8-b809-04768d7cd6ac None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:27.821061 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3d4bfacd-a3dd-49b8-b809-04768d7cd6ac None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:33:27.822086 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b370b1aa-e487-4c65-9925-030132b7fe8c None None] DHCP port deletion for e1b06497-74dd-47e6-9b9a-79074e9bf0e8 request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:33:27.839967 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-3d4bfacd-a3dd-49b8-b809-04768d7cd6ac None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:33:27.846617 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3d4bfacd-a3dd-49b8-b809-04768d7cd6ac None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:33:27.857400 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d4bfacd-a3dd-49b8-b809-04768d7cd6ac None None] Pushing event updated for resources: {'Port': ['ID=323df98f-dd98-4575-9b49-e8e238e9db53,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:27.967533 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-3d4bfacd-a3dd-49b8-b809-04768d7cd6ac None None] Attempting to bind port 323df98f-dd98-4575-9b49-e8e238e9db53 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:33:27.968203 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-3d4bfacd-a3dd-49b8-b809-04768d7cd6ac None None] Attempting to bind port 323df98f-dd98-4575-9b49-e8e238e9db53 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:33:27.968737 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3d4bfacd-a3dd-49b8-b809-04768d7cd6ac None None] Attempting to bind port 323df98f-dd98-4575-9b49-e8e238e9db53 on network 988d2354-693c-4d52-af17-25e0643eaa0c {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:33:27.982547 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3d4bfacd-a3dd-49b8-b809-04768d7cd6ac None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 33, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:33:27.983147 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3d4bfacd-a3dd-49b8-b809-04768d7cd6ac None None] Checking segment: {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:33:27.983724 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3d4bfacd-a3dd-49b8-b809-04768d7cd6ac None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:27.984116 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3d4bfacd-a3dd-49b8-b809-04768d7cd6ac None None] Bound using segment: {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:33:27.984626 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-3d4bfacd-a3dd-49b8-b809-04768d7cd6ac None None] Bound port: 323df98f-dd98-4575-9b49-e8e238e9db53, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:33:27.985193 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3d4bfacd-a3dd-49b8-b809-04768d7cd6ac None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:28.017306 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-b370b1aa-e487-4c65-9925-030132b7fe8c None None] Deleting port 64baf918-08fa-4394-98c8-06a2cc60530a {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:33:28.018049 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b370b1aa-e487-4c65-9925-030132b7fe8c None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:28.024969 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-559d84a8-4bf5-40bf-8486-12618d8f9e00 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Made reservation on behalf of 12e47d8445b5429892cd1b9244512ca8 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:33:28.028840 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-559d84a8-4bf5-40bf-8486-12618d8f9e00 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:28.190496 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-12d98a17-d146-4d33-9ffb-f2457ac5e4d0 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Allocated IP 2001:db8::f816:3eff:fe11:c5eb (988d2354-693c-4d52-af17-25e0643eaa0c/23dc2386-fb53-4305-a616-d5e868e5db20/53e983bc-c23d-44eb-813f-6843807e95b8) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:33:28.227755 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-bc9eedd1-f459-4e31-b867-a0954239b6ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'name': 'tempest-RoutersTest-router-1490827103', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:32:29Z', 'updated_at': '2021-11-09T04:33:25Z', 'revision_number': 10, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'gw_port_host': None, '_interfaces': [{'id': 'bf77ddc4-4ed9-472d-842b-1fb79d55e2e4', 'name': '', 'network_id': '35e2f2d1-ee40-4328-9fe2-48e5a5c19938', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:66:29:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 830, 'fixed_ips': [{'subnet_id': 'f60d3eec-6988-47b0-9f2f-6319fa99064d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:33Z', 'updated_at': '2021-11-09T04:32:44Z', 'revision_number': 5, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'f60d3eec-6988-47b0-9f2f-6319fa99064d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:28.309844 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bc9eedd1-f459-4e31-b867-a0954239b6ae None None] The sync data for ids ['fa30d24d-d721-4675-ad7b-09f35105e633'] in dv-neutron-816802-2-hyperv is: [{'id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'name': 'tempest-RoutersTest-router-1490827103', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:32:29Z', 'updated_at': '2021-11-09T04:33:25Z', 'revision_number': 10, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'gw_port_host': None, '_interfaces': [{'id': 'bf77ddc4-4ed9-472d-842b-1fb79d55e2e4', 'name': '', 'network_id': '35e2f2d1-ee40-4328-9fe2-48e5a5c19938', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'mac_address': 'fa:16:3e:66:29:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'device_owner': 'network:router_interface', 'standard_attr_id': 830, 'fixed_ips': [{'subnet_id': 'f60d3eec-6988-47b0-9f2f-6319fa99064d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:32:33Z', 'updated_at': '2021-11-09T04:32:44Z', 'revision_number': 5, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'subnets': [{'id': 'f60d3eec-6988-47b0-9f2f-6319fa99064d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:33:28.312519 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-b370b1aa-e487-4c65-9925-030132b7fe8c None None] For port 64baf918-08fa-4394-98c8-06a2cc60530a, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=64baf918-08fa-4394-98c8-06a2cc60530a,segment=NetworkSegment(d324ad80-31e0-4532-9d92-4601f8a04c92),segment_id=d324ad80-31e0-4532-9d92-4601f8a04c92)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:33:28.315898 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b370b1aa-e487-4c65-9925-030132b7fe8c None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:28.324879 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b402476b-716f-46ad-b3d4-21cd0b910dbd req-9cc8e8a9-996f-48e6-b561-b3afd9401f3c tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/ports?device_id=e145337f-88ba-4f6d-a894-39631a8dd013 HTTP/1.1" status: 200 len: 210 time: 0.0385494 Nov 09 04:33:28.330739 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-b370b1aa-e487-4c65-9925-030132b7fe8c None None] Calling delete_port for 64baf918-08fa-4394-98c8-06a2cc60530a owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:33:28.336814 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a654c505-c01e-40dc-b59d-6eb11d381257 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:28.338320 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-3d4bfacd-a3dd-49b8-b809-04768d7cd6ac None None] For port 323df98f-dd98-4575-9b49-e8e238e9db53, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:33:28.344209 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-3d4bfacd-a3dd-49b8-b809-04768d7cd6ac None None] For port 323df98f-dd98-4575-9b49-e8e238e9db53, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=323df98f-dd98-4575-9b49-e8e238e9db53,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:33:28.422668 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b370b1aa-e487-4c65-9925-030132b7fe8c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:28.433687 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a654c505-c01e-40dc-b59d-6eb11d381257 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event deleted for resources: {'Port': ['ID=64baf918-08fa-4394-98c8-06a2cc60530a,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:28.437208 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a654c505-c01e-40dc-b59d-6eb11d381257 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] No DVR routers for this DVR port 64baf918-08fa-4394-98c8-06a2cc60530a on host dv-neutron-816802-2-hyperv {{(pid=102161) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:33:28.447512 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-559d84a8-4bf5-40bf-8486-12618d8f9e00 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:28.460711 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3d4bfacd-a3dd-49b8-b809-04768d7cd6ac None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:28.476598 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b370b1aa-e487-4c65-9925-030132b7fe8c None None] No DVR routers for this DVR port 64baf918-08fa-4394-98c8-06a2cc60530a on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:33:28.483906 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b370b1aa-e487-4c65-9925-030132b7fe8c None None] Pushing event deleted for resources: {'Port': ['ID=64baf918-08fa-4394-98c8-06a2cc60530a,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:28.509932 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-559d84a8-4bf5-40bf-8486-12618d8f9e00 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Network 002d27a0-2fb8-4426-9550-42c444556a8e is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:33:28.517605 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-559d84a8-4bf5-40bf-8486-12618d8f9e00 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:33:28.527676 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-559d84a8-4bf5-40bf-8486-12618d8f9e00 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:28.528287 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-559d84a8-4bf5-40bf-8486-12618d8f9e00 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:28.559845 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e267be9e-5473-4c04-a94c-d01ce481a4aa None None] Network 002d27a0-2fb8-4426-9550-42c444556a8e requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:33:28.584204 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-559d84a8-4bf5-40bf-8486-12618d8f9e00 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event updated for resources: {'Subnet': ['ID=315097f5-620a-4aee-bad3-44a6cf15bd6d,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:28.642749 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-12d98a17-d146-4d33-9ffb-f2457ac5e4d0 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:28.644368 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-559d84a8-4bf5-40bf-8486-12618d8f9e00 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.8956413 Nov 09 04:33:28.645771 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57060) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:28.653735 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-14e44301-3b8f-4471-9e25-974e55db50ad tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Request body: {'security_group': {'name': 'tempest-secgroup-1008435301'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:28.673830 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d4bfacd-a3dd-49b8-b809-04768d7cd6ac None None] Pushing event updated for resources: {'Port': ['ID=323df98f-dd98-4575-9b49-e8e238e9db53,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:28.712442 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a654c505-c01e-40dc-b59d-6eb11d381257 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:28.769054 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-14e44301-3b8f-4471-9e25-974e55db50ad tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:28.789018 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-12d98a17-d146-4d33-9ffb-f2457ac5e4d0 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:28.795718 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-a654c505-c01e-40dc-b59d-6eb11d381257 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e1b06497-74dd-47e6-9b9a-79074e9bf0e8']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:28.842619 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ba66bc3f-c56a-47bc-9903-007749a5d65c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-002d27a0-2fb8-4426-9550-42c444556a8e', 'network_id': '002d27a0-2fb8-4426-9550-42c444556a8e', 'tenant_id': '12e47d8445b5429892cd1b9244512ca8', 'fixed_ips': [{'subnet_id': '315097f5-620a-4aee-bad3-44a6cf15bd6d'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:33:28.843952 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ba66bc3f-c56a-47bc-9903-007749a5d65c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:28.888614 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 64baf918-08fa-4394-98c8-06a2cc60530a no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:33:28.921433 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-a654c505-c01e-40dc-b59d-6eb11d381257 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd324ad80-31e0-4532-9d92-4601f8a04c92') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:28.921615 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-a654c505-c01e-40dc-b59d-6eb11d381257 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd324ad80-31e0-4532-9d92-4601f8a04c92') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:28.965599 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 64baf918-08fa-4394-98c8-06a2cc60530a {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:33:28.966286 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 64baf918-08fa-4394-98c8-06a2cc60530a not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:33:28.966895 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 98741773-362a-4c6e-b503-923f0f367a2a no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:33:29.014269 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a654c505-c01e-40dc-b59d-6eb11d381257 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:29.019817 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 98741773-362a-4c6e-b503-923f0f367a2a {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:33:29.020813 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 98741773-362a-4c6e-b503-923f0f367a2a not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:33:29.071999 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-12d98a17-d146-4d33-9ffb-f2457ac5e4d0 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:33:29.076515 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a654c505-c01e-40dc-b59d-6eb11d381257 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:29.079155 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-12d98a17-d146-4d33-9ffb-f2457ac5e4d0 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:33:29.083550 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12d98a17-d146-4d33-9ffb-f2457ac5e4d0 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Port': ['ID=53e983bc-c23d-44eb-813f-6843807e95b8,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:29.087300 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-12d98a17-d146-4d33-9ffb-f2457ac5e4d0 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:33:29.093363 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-12d98a17-d146-4d33-9ffb-f2457ac5e4d0 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:29.093995 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-12d98a17-d146-4d33-9ffb-f2457ac5e4d0 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:29.097614 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a654c505-c01e-40dc-b59d-6eb11d381257 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Releasing vlan 310 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:33:29.097614 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a654c505-c01e-40dc-b59d-6eb11d381257 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:29.100872 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:33:29.100872 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:33:29.100872 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:33:29.100872 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:33:29.100872 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:33:29.100872 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:33:29.100872 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:33:29.100872 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:33:29.100872 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:33:29.100872 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:33:29.100872 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:33:29.100872 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:33:29.100872 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:33:29.100872 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:33:29.100872 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:33:29.100872 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:33:29.100872 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:33:29.100872 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:33:29.100872 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:33:29.100872 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:33:29.100872 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:33:29.100872 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:33:29.100872 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:33:29.100872 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:33:29.100872 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:33:29.100872 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:33:29.100872 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:33:29.100872 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:33:29.100872 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:33:29.100872 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:33:29.100872 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:33:29.100872 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:33:29.113656 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-14e44301-3b8f-4471-9e25-974e55db50ad tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:29.180051 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-14e44301-3b8f-4471-9e25-974e55db50ad tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:29.218006 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14e44301-3b8f-4471-9e25-974e55db50ad tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event updated for resources: {'SecurityGroup': ['ID=9e2eb020-1be7-41c8-959e-ea68d2b8ad84,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:29.237366 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-ba66bc3f-c56a-47bc-9903-007749a5d65c None None] Allocated IP 2001:db8::2 (002d27a0-2fb8-4426-9550-42c444556a8e/315097f5-620a-4aee-bad3-44a6cf15bd6d/c315ee21-870f-44c3-b604-c4eb34ea288a) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:33:29.294048 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a654c505-c01e-40dc-b59d-6eb11d381257 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:29.296720 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-14e44301-3b8f-4471-9e25-974e55db50ad tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:29.298573 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-14e44301-3b8f-4471-9e25-974e55db50ad tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1760 time: 0.6507952 Nov 09 04:33:29.300403 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-12d98a17-d146-4d33-9ffb-f2457ac5e4d0 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 947 time: 2.6252813 Nov 09 04:33:29.305732 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57070) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:29.311924 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a654c505-c01e-40dc-b59d-6eb11d381257 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:29.315603 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a654c505-c01e-40dc-b59d-6eb11d381257 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "DELETE /v2.0/networks/e1b06497-74dd-47e6-9b9a-79074e9bf0e8 HTTP/1.1" status: 204 len: 168 time: 1.9845388 Nov 09 04:33:29.316153 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57072) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:29.322594 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-4b273c4e-0a75-4bee-913b-0885efbf7a83 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Request body: {'security_group': {'name': 'tempest-secgroup-142806061'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:29.331762 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57074) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:29.362087 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a654c505-c01e-40dc-b59d-6eb11d381257 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event deleted for resources: {'Network': ['ID=e1b06497-74dd-47e6-9b9a-79074e9bf0e8,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:29.416779 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ba66bc3f-c56a-47bc-9903-007749a5d65c None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:29.419776 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4b273c4e-0a75-4bee-913b-0885efbf7a83 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:29.476389 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-98589033-fc06-4a58-aaf2-067574d0053f req-fc336a1c-9fc5-4881-bada-95810cc03685 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/ports?device_id=e145337f-88ba-4f6d-a894-39631a8dd013 HTTP/1.1" status: 200 len: 210 time: 0.0400097 Nov 09 04:33:29.487131 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-36194d41-0fce-491b-90be-9cb4be1bcf68 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:29.493344 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-36194d41-0fce-491b-90be-9cb4be1bcf68 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:29.494594 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ba66bc3f-c56a-47bc-9903-007749a5d65c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:29.495379 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-36194d41-0fce-491b-90be-9cb4be1bcf68 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1702 time: 0.1779869 Nov 09 04:33:29.498401 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57080) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:29.499713 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4b273c4e-0a75-4bee-913b-0885efbf7a83 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:29.540646 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ba66bc3f-c56a-47bc-9903-007749a5d65c None None] Network 002d27a0-2fb8-4426-9550-42c444556a8e is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:33:29.546074 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-ba66bc3f-c56a-47bc-9903-007749a5d65c None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:33:29.548555 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ba66bc3f-c56a-47bc-9903-007749a5d65c None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:33:29.564036 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba66bc3f-c56a-47bc-9903-007749a5d65c None None] Pushing event updated for resources: {'Port': ['ID=c315ee21-870f-44c3-b604-c4eb34ea288a,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:29.578523 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4b273c4e-0a75-4bee-913b-0885efbf7a83 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:29.630819 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b273c4e-0a75-4bee-913b-0885efbf7a83 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event updated for resources: {'SecurityGroup': ['ID=4465f602-8f70-4e4e-9a0b-378809697d53,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:29.633216 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-ba66bc3f-c56a-47bc-9903-007749a5d65c None None] Attempting to bind port c315ee21-870f-44c3-b604-c4eb34ea288a on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:33:29.633660 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-ba66bc3f-c56a-47bc-9903-007749a5d65c None None] Attempting to bind port c315ee21-870f-44c3-b604-c4eb34ea288a by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '53b7b761-0c0a-4377-98bf-58d99642533b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 324, 'network_id': '002d27a0-2fb8-4426-9550-42c444556a8e'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:33:29.634344 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba66bc3f-c56a-47bc-9903-007749a5d65c None None] Attempting to bind port c315ee21-870f-44c3-b604-c4eb34ea288a on network 002d27a0-2fb8-4426-9550-42c444556a8e {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:33:29.640590 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba66bc3f-c56a-47bc-9903-007749a5d65c None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 33, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:33:29.641255 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba66bc3f-c56a-47bc-9903-007749a5d65c None None] Checking segment: {'id': '53b7b761-0c0a-4377-98bf-58d99642533b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 324, 'network_id': '002d27a0-2fb8-4426-9550-42c444556a8e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:33:29.641673 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ba66bc3f-c56a-47bc-9903-007749a5d65c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:29.643252 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba66bc3f-c56a-47bc-9903-007749a5d65c None None] Bound using segment: {'id': '53b7b761-0c0a-4377-98bf-58d99642533b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 324, 'network_id': '002d27a0-2fb8-4426-9550-42c444556a8e'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:33:29.643252 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-ba66bc3f-c56a-47bc-9903-007749a5d65c None None] Bound port: c315ee21-870f-44c3-b604-c4eb34ea288a, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '53b7b761-0c0a-4377-98bf-58d99642533b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 324, 'network_id': '002d27a0-2fb8-4426-9550-42c444556a8e'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:33:29.643660 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ba66bc3f-c56a-47bc-9903-007749a5d65c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:29.684088 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4b273c4e-0a75-4bee-913b-0885efbf7a83 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:29.685472 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-4b273c4e-0a75-4bee-913b-0885efbf7a83 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1759 time: 0.3779781 Nov 09 04:33:29.689404 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57082) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:29.698427 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-74b0ac6a-28e2-4c36-9f67-a7ade8292fb9 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Request body: {'port': {'name': 'tempest-PortsIpV6TestJSON-429082492', 'security_groups': ['4465f602-8f70-4e4e-9a0b-378809697d53'], 'network_id': '002d27a0-2fb8-4426-9550-42c444556a8e', 'admin_state_up': True, 'fixed_ips': [{'subnet_id': '315097f5-620a-4aee-bad3-44a6cf15bd6d'}]}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:29.761700 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-ba66bc3f-c56a-47bc-9903-007749a5d65c None None] For port c315ee21-870f-44c3-b604-c4eb34ea288a, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:33:29.773253 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-61408767-d6cd-4996-b011-8382fbf19b5b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Deleting port 53e983bc-c23d-44eb-813f-6843807e95b8 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:33:29.773741 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-61408767-d6cd-4996-b011-8382fbf19b5b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:29.778023 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-ba66bc3f-c56a-47bc-9903-007749a5d65c None None] For port c315ee21-870f-44c3-b604-c4eb34ea288a, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=c315ee21-870f-44c3-b604-c4eb34ea288a,segment=NetworkSegment(53b7b761-0c0a-4377-98bf-58d99642533b),segment_id=53b7b761-0c0a-4377-98bf-58d99642533b)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:33:29.866674 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ba66bc3f-c56a-47bc-9903-007749a5d65c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:29.941136 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-61408767-d6cd-4996-b011-8382fbf19b5b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:29.942169 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba66bc3f-c56a-47bc-9903-007749a5d65c None None] Pushing event updated for resources: {'Port': ['ID=c315ee21-870f-44c3-b604-c4eb34ea288a,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:29.972528 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-61408767-d6cd-4996-b011-8382fbf19b5b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Calling delete_port for 53e983bc-c23d-44eb-813f-6843807e95b8 owned by {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:33:30.025985 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eaf21388-8c21-445f-bd1a-9f0b098538ba req-01e97d67-097d-45c7-ab03-ab463c9557eb tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:30.027931 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-eaf21388-8c21-445f-bd1a-9f0b098538ba req-01e97d67-097d-45c7-ab03-ab463c9557eb tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.26 "GET /v2.0/networks?id=10e5206a-1d3b-409b-a3ee-0f6a311d6819 HTTP/1.1" status: 200 len: 811 time: 0.1856842 Nov 09 04:33:30.045295 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-eaf21388-8c21-445f-bd1a-9f0b098538ba req-9aff16e0-0170-4361-9894-3746b4bedbb4 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] Request body: {'port': {'device_id': 'e145337f-88ba-4f6d-a894-39631a8dd013', 'network_id': '10e5206a-1d3b-409b-a3ee-0f6a311d6819', 'admin_state_up': True, 'tenant_id': 'a7dd369fc9b947d2b50f9f75551d326d'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:30.079886 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-74b0ac6a-28e2-4c36-9f67-a7ade8292fb9 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Made reservation on behalf of 12e47d8445b5429892cd1b9244512ca8 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:33:30.181919 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1f8aa1e1-e5a5-46cb-ab02-f8920ac5a3e4 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:30.227655 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-daa19fbc-34a6-4ae4-950d-3a3bea0b6426 None None] Provisioning complete for port 323df98f-dd98-4575-9b49-e8e238e9db53 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:30.229056 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-daa19fbc-34a6-4ae4-950d-3a3bea0b6426 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:30.336792 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-74b0ac6a-28e2-4c36-9f67-a7ade8292fb9 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:30.413761 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-daa19fbc-34a6-4ae4-950d-3a3bea0b6426 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:30.421302 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [None req-74b0ac6a-28e2-4c36-9f67-a7ade8292fb9 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] device_id is not set on port b40e258d-367a-43ed-80aa-4b84b0a0b371 yet. {{(pid=102162) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:33:30.499647 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-daa19fbc-34a6-4ae4-950d-3a3bea0b6426 None None] For port 323df98f-dd98-4575-9b49-e8e238e9db53, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=323df98f-dd98-4575-9b49-e8e238e9db53,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:33:30.505971 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-eaf21388-8c21-445f-bd1a-9f0b098538ba req-9aff16e0-0170-4361-9894-3746b4bedbb4 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] Made reservation on behalf of a7dd369fc9b947d2b50f9f75551d326d for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:33:30.510221 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-eaf21388-8c21-445f-bd1a-9f0b098538ba req-9aff16e0-0170-4361-9894-3746b4bedbb4 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:30.549025 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-61408767-d6cd-4996-b011-8382fbf19b5b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:30.602205 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-daa19fbc-34a6-4ae4-950d-3a3bea0b6426 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:30.647029 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-42616e7a-821c-48f1-bd1e-73efec7fade3 req-d8cf6402-f316-4f1f-aab7-e2f228797088 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/ports?device_id=e145337f-88ba-4f6d-a894-39631a8dd013 HTTP/1.1" status: 200 len: 210 time: 0.0707493 Nov 09 04:33:30.689758 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-daa19fbc-34a6-4ae4-950d-3a3bea0b6426 None None] Pushing event updated for resources: {'Port': ['ID=323df98f-dd98-4575-9b49-e8e238e9db53,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:30.713245 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57102) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:30.717445 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61408767-d6cd-4996-b011-8382fbf19b5b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event deleted for resources: {'Port': ['ID=53e983bc-c23d-44eb-813f-6843807e95b8,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:30.720138 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-6ef62c7b-83f0-450a-b009-f2702e28f749 None None] Could not find standard attr ID for object 53e983bc-c23d-44eb-813f-6843807e95b8. {{(pid=102163) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 09 04:33:30.771151 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-61408767-d6cd-4996-b011-8382fbf19b5b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:30.774546 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-61408767-d6cd-4996-b011-8382fbf19b5b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/ports/53e983bc-c23d-44eb-813f-6843807e95b8 HTTP/1.1" status: 204 len: 168 time: 1.2750044 Nov 09 04:33:30.780039 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57106) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:30.816359 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-1f8aa1e1-e5a5-46cb-ab02-f8920ac5a3e4 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Deleting port bf77ddc4-4ed9-472d-842b-1fb79d55e2e4 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:33:30.816698 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1f8aa1e1-e5a5-46cb-ab02-f8920ac5a3e4 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:30.835789 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 323df98f-dd98-4575-9b49-e8e238e9db53 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:33:30.868733 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-74b0ac6a-28e2-4c36-9f67-a7ade8292fb9 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Allocated IP 2001:db8::298 (002d27a0-2fb8-4426-9550-42c444556a8e/315097f5-620a-4aee-bad3-44a6cf15bd6d/b40e258d-367a-43ed-80aa-4b84b0a0b371) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:33:30.878010 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [req-eaf21388-8c21-445f-bd1a-9f0b098538ba req-9aff16e0-0170-4361-9894-3746b4bedbb4 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] Allocated IP 172.20.0.9 (10e5206a-1d3b-409b-a3ee-0f6a311d6819/73ee2bd1-c2b2-478f-96c9-301b99515bfe/d3617298-af19-45fb-8ddd-9c228bc66aab) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:33:30.919638 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-094c3948-9adf-4e8c-8df0-af6e6e72d4c9 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:30.921200 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-094c3948-9adf-4e8c-8df0-af6e6e72d4c9 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:30.922832 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-094c3948-9adf-4e8c-8df0-af6e6e72d4c9 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1457 time: 0.1418366 Nov 09 04:33:30.926020 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57108) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:30.942084 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 323df98f-dd98-4575-9b49-e8e238e9db53 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:30.943123 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:30.994132 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-1f8aa1e1-e5a5-46cb-ab02-f8920ac5a3e4 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] For port bf77ddc4-4ed9-472d-842b-1fb79d55e2e4, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=bf77ddc4-4ed9-472d-842b-1fb79d55e2e4,segment=NetworkSegment(57d559af-ebd5-42c2-b187-251c0ee907e1),segment_id=57d559af-ebd5-42c2-b187-251c0ee907e1)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:33:30.994766 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1f8aa1e1-e5a5-46cb-ab02-f8920ac5a3e4 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:31.012604 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-1f8aa1e1-e5a5-46cb-ab02-f8920ac5a3e4 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Calling delete_port for bf77ddc4-4ed9-472d-842b-1fb79d55e2e4 owned by network:router_interface {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:33:31.014537 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-946be454-3b74-4bc6-acc6-e0b2879b3b9f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Deleting subnet 23dc2386-fb53-4305-a616-d5e868e5db20 {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:33:31.028352 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-946be454-3b74-4bc6-acc6-e0b2879b3b9f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:31.034240 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-27bba95c-8b3a-4a0d-b179-2b75c1b302e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'network': {'name': 'tempest-network-smoke--695889211', 'project_id': '1d10b4824e524068827e58b55e269af3', 'port_security_enabled': True}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:31.068197 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device c315ee21-870f-44c3-b604-c4eb34ea288a up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:33:31.143380 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port c315ee21-870f-44c3-b604-c4eb34ea288a triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:31.143754 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:31.163989 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-946be454-3b74-4bc6-acc6-e0b2879b3b9f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:31.235164 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:31.254993 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-27bba95c-8b3a-4a0d-b179-2b75c1b302e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Made reservation on behalf of 1d10b4824e524068827e58b55e269af3 for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:33:31.258614 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-27bba95c-8b3a-4a0d-b179-2b75c1b302e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:31.274665 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port c315ee21-870f-44c3-b604-c4eb34ea288a, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=c315ee21-870f-44c3-b604-c4eb34ea288a,segment=NetworkSegment(53b7b761-0c0a-4377-98bf-58d99642533b),segment_id=53b7b761-0c0a-4377-98bf-58d99642533b)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:33:31.315642 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-27bba95c-8b3a-4a0d-b179-2b75c1b302e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:31.318852 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1f8aa1e1-e5a5-46cb-ab02-f8920ac5a3e4 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:31.344960 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:31.377210 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f8aa1e1-e5a5-46cb-ab02-f8920ac5a3e4 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event deleted for resources: {'Port': ['ID=bf77ddc4-4ed9-472d-842b-1fb79d55e2e4,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:31.407032 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=c315ee21-870f-44c3-b604-c4eb34ea288a,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:31.497373 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c3278b9-b54c-4267-810c-ef4a78f8b2e9 req-1022fe56-6ae5-48bd-9e75-a1c4dc4b4603 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:31.498930 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-5c3278b9-b54c-4267-810c-ef4a78f8b2e9 req-1022fe56-6ae5-48bd-9e75-a1c4dc4b4603 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 945 time: 0.1111934 Nov 09 04:33:31.524728 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-27bba95c-8b3a-4a0d-b179-2b75c1b302e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:31.527915 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-eaf21388-8c21-445f-bd1a-9f0b098538ba req-9aff16e0-0170-4361-9894-3746b4bedbb4 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:31.532950 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-74b0ac6a-28e2-4c36-9f67-a7ade8292fb9 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:31.559335 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-946be454-3b74-4bc6-acc6-e0b2879b3b9f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:31.602612 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-27bba95c-8b3a-4a0d-b179-2b75c1b302e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:31.625028 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1f8aa1e1-e5a5-46cb-ab02-f8920ac5a3e4 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:31.635726 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-5c3278b9-b54c-4267-810c-ef4a78f8b2e9 req-07f4ef6d-bd2f-4ece-b389-4784f222866a tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1277940 Nov 09 04:33:31.650463 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-27bba95c-8b3a-4a0d-b179-2b75c1b302e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 313} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:33:31.681623 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-3667b7a5-4ed5-45c9-ac54-d36a0a2acc05 None None] Provisioning complete for port c315ee21-870f-44c3-b604-c4eb34ea288a triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:31.682033 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3667b7a5-4ed5-45c9-ac54-d36a0a2acc05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:31.687785 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-27bba95c-8b3a-4a0d-b179-2b75c1b302e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:31.688123 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-27bba95c-8b3a-4a0d-b179-2b75c1b302e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Added segment 7befff96-69ce-4b76-b9cc-7561279d57a7 of type vlan for network 239a9c72-6384-4d5a-a69d-f4ac0c580e40 Nov 09 04:33:31.698404 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27bba95c-8b3a-4a0d-b179-2b75c1b302e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroup': ['ID=2817c110-1ac7-4efe-9682-6d1a22d5b7a5,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:31.760732 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-27bba95c-8b3a-4a0d-b179-2b75c1b302e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:31.788367 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-eaf21388-8c21-445f-bd1a-9f0b098538ba req-9aff16e0-0170-4361-9894-3746b4bedbb4 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:31.810337 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-3667b7a5-4ed5-45c9-ac54-d36a0a2acc05 None None] Provisioning complete for port 77290ebd-f244-4a68-94af-4d033c4a6349 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:31.810737 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3667b7a5-4ed5-45c9-ac54-d36a0a2acc05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:31.851733 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-3667b7a5-4ed5-45c9-ac54-d36a0a2acc05 None None] Port 77290ebd-f244-4a68-94af-4d033c4a6349 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:33:31.861986 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-946be454-3b74-4bc6-acc6-e0b2879b3b9f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:31.864790 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-74b0ac6a-28e2-4c36-9f67-a7ade8292fb9 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:31.876670 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1f8aa1e1-e5a5-46cb-ab02-f8920ac5a3e4 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Router fa30d24d-d721-4675-ad7b-09f35105e633 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:33:31.904265 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d684fea-5b0e-4680-be78-3178ddd2ea71 req-68f827a4-3c5c-402d-bacb-7118d24ba786 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:31.905727 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-9d684fea-5b0e-4680-be78-3178ddd2ea71 req-68f827a4-3c5c-402d-bacb-7118d24ba786 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/ports?device_id=e145337f-88ba-4f6d-a894-39631a8dd013 HTTP/1.1" status: 200 len: 931 time: 0.1004438 Nov 09 04:33:31.906857 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-eaf21388-8c21-445f-bd1a-9f0b098538ba req-9aff16e0-0170-4361-9894-3746b4bedbb4 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] Network 10e5206a-1d3b-409b-a3ee-0f6a311d6819 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:33:31.920055 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-946be454-3b74-4bc6-acc6-e0b2879b3b9f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event deleted for resources: {'Subnet': ['ID=23dc2386-fb53-4305-a616-d5e868e5db20,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:31.924421 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [req-eaf21388-8c21-445f-bd1a-9f0b098538ba req-9aff16e0-0170-4361-9894-3746b4bedbb4 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:33:31.926550 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-eaf21388-8c21-445f-bd1a-9f0b098538ba req-9aff16e0-0170-4361-9894-3746b4bedbb4 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:33:31.931782 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-946be454-3b74-4bc6-acc6-e0b2879b3b9f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:31.937010 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b0c28e97-91d0-4a78-b927-2a73a85e4cbd None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:33:31.938292 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-946be454-3b74-4bc6-acc6-e0b2879b3b9f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/23dc2386-fb53-4305-a616-d5e868e5db20 HTTP/1.1" status: 204 len: 168 time: 1.0093970 Nov 09 04:33:31.939306 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57118) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:31.972883 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-27bba95c-8b3a-4a0d-b179-2b75c1b302e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:31.979012 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-27bba95c-8b3a-4a0d-b179-2b75c1b302e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:31.979608 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-27bba95c-8b3a-4a0d-b179-2b75c1b302e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:31.990267 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-74b0ac6a-28e2-4c36-9f67-a7ade8292fb9 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Network 002d27a0-2fb8-4426-9550-42c444556a8e is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:33:31.993418 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1f8aa1e1-e5a5-46cb-ab02-f8920ac5a3e4 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:33:31.997569 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9aff16e0-0170-4361-9894-3746b4bedbb4 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] Pushing event updated for resources: {'Port': ['ID=d3617298-af19-45fb-8ddd-9c228bc66aab,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:31.999486 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1f8aa1e1-e5a5-46cb-ab02-f8920ac5a3e4 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "PUT /v2.0/routers/fa30d24d-d721-4675-ad7b-09f35105e633/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.6606858 Nov 09 04:33:32.009543 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-222d4f81-3d95-4e1a-bfdc-ac0391d89340 None None] Sync routers for ids ['fa30d24d-d721-4675-ad7b-09f35105e633'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:33:32.010139 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57120) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:32.021658 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-222d4f81-3d95-4e1a-bfdc-ac0391d89340 None None] Routers {'fa30d24d-d721-4675-ad7b-09f35105e633'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:33:32.022290 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-222d4f81-3d95-4e1a-bfdc-ac0391d89340 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:33:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['fa30d24d-d721-4675-ad7b-09f35105e633'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:32.061692 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-9d684fea-5b0e-4680-be78-3178ddd2ea71 req-54df3da3-5a2d-401b-8342-bcecba7ac160 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/security-groups?id=8fd0adbd-57c5-4583-8e2d-9a55d7973976&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1238418 Nov 09 04:33:32.092160 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-70ee4907-9a10-4789-8519-f36bf098a9a7 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Deleting subnet f60d3eec-6988-47b0-9f2f-6319fa99064d {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:33:32.095545 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-70ee4907-9a10-4789-8519-f36bf098a9a7 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:32.099347 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-222d4f81-3d95-4e1a-bfdc-ac0391d89340 None None] Set router fa30d24d-d721-4675-ad7b-09f35105e633 gateway port host: None {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:33:32.134553 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74b0ac6a-28e2-4c36-9f67-a7ade8292fb9 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event updated for resources: {'Port': ['ID=b40e258d-367a-43ed-80aa-4b84b0a0b371,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:32.137384 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-74b0ac6a-28e2-4c36-9f67-a7ade8292fb9 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:33:32.143190 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-70ee4907-9a10-4789-8519-f36bf098a9a7 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:32.157091 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-222d4f81-3d95-4e1a-bfdc-ac0391d89340 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'name': 'tempest-RoutersTest-router-1490827103', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:32:29Z', 'updated_at': '2021-11-09T04:33:31Z', 'revision_number': 11, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'gw_port_host': None}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:32.176377 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-d862468b-75eb-40ef-b3d4-0039e45a9772 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.2304156 Nov 09 04:33:32.181847 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57122) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:32.185438 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12ca3e5d-ed89-4253-a5f0-42258f100ef9 req-35c8002c-3b86-4fb4-8df7-d74a1621df17 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:32.187517 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-12ca3e5d-ed89-4253-a5f0-42258f100ef9 req-35c8002c-3b86-4fb4-8df7-d74a1621df17 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 945 time: 0.4180272 Nov 09 04:33:32.189868 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-8365c3bd-dfd0-4e9c-b807-9eade4cfd9dc tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'subnet': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:32.191465 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-74b0ac6a-28e2-4c36-9f67-a7ade8292fb9 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:33:32.197881 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-74b0ac6a-28e2-4c36-9f67-a7ade8292fb9 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:32.198728 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-74b0ac6a-28e2-4c36-9f67-a7ade8292fb9 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:32.213054 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-222d4f81-3d95-4e1a-bfdc-ac0391d89340 None None] Checking router: fa30d24d-d721-4675-ad7b-09f35105e633 for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:33:32.219206 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c97aa780-219a-4baa-bef6-8658edb69936 None None] DHCP port deletion for 988d2354-693c-4d52-af17-25e0643eaa0c request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:33:32.232242 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-222d4f81-3d95-4e1a-bfdc-ac0391d89340 None None] Routers {'fa30d24d-d721-4675-ad7b-09f35105e633'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:33:32.232974 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-222d4f81-3d95-4e1a-bfdc-ac0391d89340 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:33:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['fa30d24d-d721-4675-ad7b-09f35105e633'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:32.244642 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27bba95c-8b3a-4a0d-b179-2b75c1b302e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Network': ['ID=239a9c72-6384-4d5a-a69d-f4ac0c580e40,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:32.261197 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eaf21388-8c21-445f-bd1a-9f0b098538ba req-9aff16e0-0170-4361-9894-3746b4bedbb4 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:32.261446 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 239a9c72-6384-4d5a-a69d-f4ac0c580e40 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:33:32.263366 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-eaf21388-8c21-445f-bd1a-9f0b098538ba req-9aff16e0-0170-4361-9894-3746b4bedbb4 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:32.293823 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-74b0ac6a-28e2-4c36-9f67-a7ade8292fb9 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 930 time: 2.6032314 Nov 09 04:33:32.298032 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57124) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:32.307770 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-6e58e085-0137-4e91-84bb-afe695c4abbe tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Request body: {'subnet': {'network_id': '002d27a0-2fb8-4426-9550-42c444556a8e', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:32.332876 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-27bba95c-8b3a-4a0d-b179-2b75c1b302e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 1.6130326 Nov 09 04:33:32.335933 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57126) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:32.342177 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-12ca3e5d-ed89-4253-a5f0-42258f100ef9 req-2c210b2a-bc8c-4622-a1c7-d01c2cb360de tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1262219 Nov 09 04:33:32.366789 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-2ead41c7-e2ae-4c1d-a7c0-c0b983efa12f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'router': {'name': 'tempest-TestNetworkBasicOps-router-1967773701', 'admin_state_up': True, 'project_id': '1d10b4824e524068827e58b55e269af3', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:32.410744 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-70ee4907-9a10-4789-8519-f36bf098a9a7 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:32.422976 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-eaf21388-8c21-445f-bd1a-9f0b098538ba req-9aff16e0-0170-4361-9894-3746b4bedbb4 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.26 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.3846719 Nov 09 04:33:32.437557 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-c97aa780-219a-4baa-bef6-8658edb69936 None None] Deleting port 323df98f-dd98-4575-9b49-e8e238e9db53 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:33:32.437935 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c97aa780-219a-4baa-bef6-8658edb69936 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:32.445247 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-eaf21388-8c21-445f-bd1a-9f0b098538ba req-118861e8-0669-4fea-a93f-d95ade29afa1 service neutron] Request body: {'port': {'device_id': 'e145337f-88ba-4f6d-a894-39631a8dd013', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:32.502782 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8365c3bd-dfd0-4e9c-b807-9eade4cfd9dc tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:33:32.506821 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8365c3bd-dfd0-4e9c-b807-9eade4cfd9dc tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:32.551146 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-c97aa780-219a-4baa-bef6-8658edb69936 None None] For port 323df98f-dd98-4575-9b49-e8e238e9db53, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=323df98f-dd98-4575-9b49-e8e238e9db53,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:33:32.551456 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c97aa780-219a-4baa-bef6-8658edb69936 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:32.565585 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-c97aa780-219a-4baa-bef6-8658edb69936 None None] Calling delete_port for 323df98f-dd98-4575-9b49-e8e238e9db53 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:33:32.582040 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-222d4f81-3d95-4e1a-bfdc-ac0391d89340 None None] Set router fa30d24d-d721-4675-ad7b-09f35105e633 gateway port host: None {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:33:32.604415 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-eaf21388-8c21-445f-bd1a-9f0b098538ba req-118861e8-0669-4fea-a93f-d95ade29afa1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:32.675667 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-222d4f81-3d95-4e1a-bfdc-ac0391d89340 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'name': 'tempest-RoutersTest-router-1490827103', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:32:29Z', 'updated_at': '2021-11-09T04:33:31Z', 'revision_number': 11, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'gw_port_host': None}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:32.688775 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-c7a58b18-ff0e-4602-be72-dff502468c65 None None] Provisioning complete for port b40e258d-367a-43ed-80aa-4b84b0a0b371 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:32.689407 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c7a58b18-ff0e-4602-be72-dff502468c65 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:32.704674 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2ead41c7-e2ae-4c1d-a7c0-c0b983efa12f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:32.709217 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2ead41c7-e2ae-4c1d-a7c0-c0b983efa12f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:32.727964 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-70ee4907-9a10-4789-8519-f36bf098a9a7 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:32.733542 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-c7a58b18-ff0e-4602-be72-dff502468c65 None None] Port b40e258d-367a-43ed-80aa-4b84b0a0b371 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:33:32.752133 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-222d4f81-3d95-4e1a-bfdc-ac0391d89340 None None] The sync data for ids ['fa30d24d-d721-4675-ad7b-09f35105e633'] in dv-neutron-816802-2-hyperv is: [{'id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'name': 'tempest-RoutersTest-router-1490827103', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:32:29Z', 'updated_at': '2021-11-09T04:33:31Z', 'revision_number': 11, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'gw_port_host': None}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:33:32.792857 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device c315ee21-870f-44c3-b604-c4eb34ea288a up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:33:32.802653 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-70ee4907-9a10-4789-8519-f36bf098a9a7 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:32.809115 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-70ee4907-9a10-4789-8519-f36bf098a9a7 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "DELETE /v2.0/subnets/f60d3eec-6988-47b0-9f2f-6319fa99064d HTTP/1.1" status: 204 len: 168 time: 0.7975545 Nov 09 04:33:32.810187 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70ee4907-9a10-4789-8519-f36bf098a9a7 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event deleted for resources: {'Subnet': ['ID=f60d3eec-6988-47b0-9f2f-6319fa99064d,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:32.813108 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57132) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:32.822957 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6e58e085-0137-4e91-84bb-afe695c4abbe tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Made reservation on behalf of 12e47d8445b5429892cd1b9244512ca8 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:33:32.822957 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6e58e085-0137-4e91-84bb-afe695c4abbe tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:32.840436 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aee6fc66-44ab-478c-8ecb-db09eb16b1f0 None None] Network 35e2f2d1-ee40-4328-9fe2-48e5a5c19938 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:33:32.844616 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c97aa780-219a-4baa-bef6-8658edb69936 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:32.913607 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c97aa780-219a-4baa-bef6-8658edb69936 None None] No DVR routers for this DVR port 323df98f-dd98-4575-9b49-e8e238e9db53 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:33:32.920037 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c97aa780-219a-4baa-bef6-8658edb69936 None None] Pushing event deleted for resources: {'Port': ['ID=323df98f-dd98-4575-9b49-e8e238e9db53,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:32.997521 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port c315ee21-870f-44c3-b604-c4eb34ea288a triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:32.997994 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:32.998164 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2ead41c7-e2ae-4c1d-a7c0-c0b983efa12f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:33.027977 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40c7f509-9b62-448c-9ea1-627620507246 req-fd175bb3-4ebd-444c-ac90-e0914df61974 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:33.029473 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-40c7f509-9b62-448c-9ea1-627620507246 req-fd175bb3-4ebd-444c-ac90-e0914df61974 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 945 time: 0.2260046 Nov 09 04:33:33.031969 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.ipam_backend_mixin [None req-6e58e085-0137-4e91-84bb-afe695c4abbe tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet 315097f5-620a-4aee-bad3-44a6cf15bd6d (CIDR: 2001:db8::/64) Nov 09 04:33:33.077971 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-40c7f509-9b62-448c-9ea1-627620507246 req-266b85c4-0c5b-42de-947a-707741deaf3d tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415757 Nov 09 04:33:33.154235 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 323df98f-dd98-4575-9b49-e8e238e9db53 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:33:33.174345 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-6e58e085-0137-4e91-84bb-afe695c4abbe tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:33:33.184948 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-6e58e085-0137-4e91-84bb-afe695c4abbe tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:33:33.185348 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 323df98f-dd98-4575-9b49-e8e238e9db53 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:33:33.185348 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 323df98f-dd98-4575-9b49-e8e238e9db53 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:33:33.194201 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f0de414-58c9-4509-b559-8e1c97fa1b44 req-9fc41ad0-709f-4af8-acf4-cded89a9badc tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:33.195988 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-9f0de414-58c9-4509-b559-8e1c97fa1b44 req-9fc41ad0-709f-4af8-acf4-cded89a9badc tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/ports?device_id=e145337f-88ba-4f6d-a894-39631a8dd013 HTTP/1.1" status: 200 len: 931 time: 0.0574110 Nov 09 04:33:33.274200 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-44e0933c-587d-4f99-ab5c-4f90bac797ef tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:33.302517 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-6e58e085-0137-4e91-84bb-afe695c4abbe tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.9988048 Nov 09 04:33:33.302517 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57136) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:33.315489 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-9dc2d009-e972-4e4f-845e-f50143ce6f80 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Request body: {'subnet': {'network_id': '002d27a0-2fb8-4426-9550-42c444556a8e', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:33.378039 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-9f0de414-58c9-4509-b559-8e1c97fa1b44 req-f73d9fd4-97fb-4a44-9485-6aa68b328062 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/security-groups?id=8fd0adbd-57c5-4583-8e2d-9a55d7973976&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1753457 Nov 09 04:33:33.404285 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-037e56fc-f436-4b0d-8db4-7db34897075c None None] DHCP port deletion for 35e2f2d1-ee40-4328-9fe2-48e5a5c19938 request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:33:33.454911 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-037e56fc-f436-4b0d-8db4-7db34897075c None None] Deleting port 843328c7-08ce-4c76-a55f-3396fabab904 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:33:33.455920 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-037e56fc-f436-4b0d-8db4-7db34897075c None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:33.488987 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2ead41c7-e2ae-4c1d-a7c0-c0b983efa12f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:33.516217 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.objects.ports [None req-8365c3bd-dfd0-4e9c-b807-9eade4cfd9dc tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=102161) get_objects /opt/stack/neutron/neutron/objects/ports.py:444}} Nov 09 04:33:33.524510 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8365c3bd-dfd0-4e9c-b807-9eade4cfd9dc tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:33.526276 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-037e56fc-f436-4b0d-8db4-7db34897075c None None] For port 843328c7-08ce-4c76-a55f-3396fabab904, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=843328c7-08ce-4c76-a55f-3396fabab904,segment=NetworkSegment(57d559af-ebd5-42c2-b187-251c0ee907e1),segment_id=57d559af-ebd5-42c2-b187-251c0ee907e1)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:33:33.527169 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-037e56fc-f436-4b0d-8db4-7db34897075c None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:33.541574 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-037e56fc-f436-4b0d-8db4-7db34897075c None None] Calling delete_port for 843328c7-08ce-4c76-a55f-3396fabab904 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:33:33.576448 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8365c3bd-dfd0-4e9c-b807-9eade4cfd9dc tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:33:33.588515 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-8365c3bd-dfd0-4e9c-b807-9eade4cfd9dc tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:33:33.593891 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8365c3bd-dfd0-4e9c-b807-9eade4cfd9dc tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:33.594605 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8365c3bd-dfd0-4e9c-b807-9eade4cfd9dc tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:33.607626 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2b286b35-f02d-47c8-a922-1bfc254894df None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:33:33.621682 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-44e0933c-587d-4f99-ab5c-4f90bac797ef tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Deleting port 843328c7-08ce-4c76-a55f-3396fabab904 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:33:33.621682 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-44e0933c-587d-4f99-ab5c-4f90bac797ef tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:33.621682 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8365c3bd-dfd0-4e9c-b807-9eade4cfd9dc tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Subnet': ['ID=9929229d-3c0c-42fe-be75-aa3c073412f6,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:33.729443 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-8365c3bd-dfd0-4e9c-b807-9eade4cfd9dc tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 1.5438626 Nov 09 04:33:33.731155 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57138) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:33.738312 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-44e0933c-587d-4f99-ab5c-4f90bac797ef tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] For port 843328c7-08ce-4c76-a55f-3396fabab904, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=843328c7-08ce-4c76-a55f-3396fabab904,segment=NetworkSegment(57d559af-ebd5-42c2-b187-251c0ee907e1),segment_id=57d559af-ebd5-42c2-b187-251c0ee907e1)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:33:33.738312 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-44e0933c-587d-4f99-ab5c-4f90bac797ef tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:33.740212 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-2c0ffe32-3467-41bb-9e99-724583a4a9b5 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'port': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'mac_address': 'fa:16:3e:6c:a0:3c', 'name': 'tempest-NetworksTestDHCPv6-2028327317'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:33.753853 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-44e0933c-587d-4f99-ab5c-4f90bac797ef tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Calling delete_port for 843328c7-08ce-4c76-a55f-3396fabab904 owned by network:dhcp {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:33:33.945364 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [req-eaf21388-8c21-445f-bd1a-9f0b098538ba req-118861e8-0669-4fea-a93f-d95ade29afa1 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d3617298-af19-45fb-8ddd-9c228bc66aab {{(pid=102162) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:33:33.953760 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-291ec7c4-7430-4b01-a966-69bfa6b1b207 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-988d2354-693c-4d52-af17-25e0643eaa0c', 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'tenant_id': '8b0758f781884982bf5b94e6609237f6', 'fixed_ips': [{'subnet_id': '9929229d-3c0c-42fe-be75-aa3c073412f6'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:33:33.954713 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-291ec7c4-7430-4b01-a966-69bfa6b1b207 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:33.955302 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-eaf21388-8c21-445f-bd1a-9f0b098538ba req-118861e8-0669-4fea-a93f-d95ade29afa1 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:33.974618 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.provisioning_blocks [req-eaf21388-8c21-445f-bd1a-9f0b098538ba req-118861e8-0669-4fea-a93f-d95ade29afa1 service neutron] Transition to ACTIVE for port object d3617298-af19-45fb-8ddd-9c228bc66aab will not be triggered until provisioned by entity L2. {{(pid=102162) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 09 04:33:33.979158 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-037e56fc-f436-4b0d-8db4-7db34897075c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:34.061125 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-037e56fc-f436-4b0d-8db4-7db34897075c None None] Pushing event deleted for resources: {'Port': ['ID=843328c7-08ce-4c76-a55f-3396fabab904,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:34.066625 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9dc2d009-e972-4e4f-845e-f50143ce6f80 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Made reservation on behalf of 12e47d8445b5429892cd1b9244512ca8 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:33:34.071047 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9dc2d009-e972-4e4f-845e-f50143ce6f80 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:34.076961 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-037e56fc-f436-4b0d-8db4-7db34897075c None None] No DVR routers for this DVR port 843328c7-08ce-4c76-a55f-3396fabab904 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:33:34.101601 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-eaf21388-8c21-445f-bd1a-9f0b098538ba req-118861e8-0669-4fea-a93f-d95ade29afa1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:34.190603 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-291ec7c4-7430-4b01-a966-69bfa6b1b207 None None] Allocated IP 2001:db8::f816:3eff:fee1:e3af (988d2354-693c-4d52-af17-25e0643eaa0c/9929229d-3c0c-42fe-be75-aa3c073412f6/16584a2a-1536-465e-85d3-cea284b5c20d) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:33:34.232962 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-118861e8-0669-4fea-a93f-d95ade29afa1 service neutron] Pushing event updated for resources: {'Port': ['ID=d3617298-af19-45fb-8ddd-9c228bc66aab,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:34.240656 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2c0ffe32-3467-41bb-9e99-724583a4a9b5 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:33:34.265809 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-44e0933c-587d-4f99-ab5c-4f90bac797ef tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:34.313963 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44e0933c-587d-4f99-ab5c-4f90bac797ef tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event deleted for resources: {'Port': ['ID=843328c7-08ce-4c76-a55f-3396fabab904,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:34.317533 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2ead41c7-e2ae-4c1d-a7c0-c0b983efa12f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router_gateway, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:34.338187 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-44e0933c-587d-4f99-ab5c-4f90bac797ef tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] No DVR routers for this DVR port 843328c7-08ce-4c76-a55f-3396fabab904 on host dv-neutron-816802-2-hyperv {{(pid=102161) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:33:34.339991 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2ead41c7-e2ae-4c1d-a7c0-c0b983efa12f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:34.351815 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-291ec7c4-7430-4b01-a966-69bfa6b1b207 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:34.385462 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8485a5f5-913a-49bd-b304-7bb5a2d1f62d req-3ba17c1d-0243-41cd-8518-80021bfb4a9d tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:34.386995 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8485a5f5-913a-49bd-b304-7bb5a2d1f62d req-3ba17c1d-0243-41cd-8518-80021bfb4a9d tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 945 time: 0.2059422 Nov 09 04:33:34.432369 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-291ec7c4-7430-4b01-a966-69bfa6b1b207 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:34.460119 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2c0ffe32-3467-41bb-9e99-724583a4a9b5 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:34.465541 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-44e0933c-587d-4f99-ab5c-4f90bac797ef tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:34.471167 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-eaf21388-8c21-445f-bd1a-9f0b098538ba req-118861e8-0669-4fea-a93f-d95ade29afa1 service neutron] Attempting to bind port d3617298-af19-45fb-8ddd-9c228bc66aab on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:33:34.471571 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-eaf21388-8c21-445f-bd1a-9f0b098538ba req-118861e8-0669-4fea-a93f-d95ade29afa1 service neutron] Attempting to bind port d3617298-af19-45fb-8ddd-9c228bc66aab by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '63a401e5-97f0-4f3a-b762-8fc66b1b215f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 333, 'network_id': '10e5206a-1d3b-409b-a3ee-0f6a311d6819'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:33:34.471821 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-eaf21388-8c21-445f-bd1a-9f0b098538ba req-118861e8-0669-4fea-a93f-d95ade29afa1 service neutron] Attempting to bind port d3617298-af19-45fb-8ddd-9c228bc66aab on network 10e5206a-1d3b-409b-a3ee-0f6a311d6819 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:33:34.487071 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-291ec7c4-7430-4b01-a966-69bfa6b1b207 None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:33:34.496228 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-291ec7c4-7430-4b01-a966-69bfa6b1b207 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:33:34.502607 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-291ec7c4-7430-4b01-a966-69bfa6b1b207 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:33:34.511289 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-291ec7c4-7430-4b01-a966-69bfa6b1b207 None None] Pushing event updated for resources: {'Port': ['ID=16584a2a-1536-465e-85d3-cea284b5c20d,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:34.521589 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-eaf21388-8c21-445f-bd1a-9f0b098538ba req-118861e8-0669-4fea-a93f-d95ade29afa1 service neutron] Port d3617298-af19-45fb-8ddd-9c228bc66aab on network 10e5206a-1d3b-409b-a3ee-0f6a311d6819 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:33:34.521927 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-eaf21388-8c21-445f-bd1a-9f0b098538ba req-118861e8-0669-4fea-a93f-d95ade29afa1 service neutron] Attempting to bind port d3617298-af19-45fb-8ddd-9c228bc66aab on network 10e5206a-1d3b-409b-a3ee-0f6a311d6819 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:33:34.542758 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8485a5f5-913a-49bd-b304-7bb5a2d1f62d req-23117a97-acb3-4ce2-a46e-6ba7543f6653 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1423786 Nov 09 04:33:34.547588 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [None req-2c0ffe32-3467-41bb-9e99-724583a4a9b5 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] device_id is not set on port f8a4f9ac-0d31-44f6-a037-c56638319eb9 yet. {{(pid=102162) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:33:34.550000 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-44e0933c-587d-4f99-ab5c-4f90bac797ef tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['35e2f2d1-ee40-4328-9fe2-48e5a5c19938']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:34.553057 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-eaf21388-8c21-445f-bd1a-9f0b098538ba req-118861e8-0669-4fea-a93f-d95ade29afa1 service neutron] Checking agent: {'id': '7d36b884-4ad2-4878-9464-bf647030b544', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'started_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 33, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:33:34.553637 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-eaf21388-8c21-445f-bd1a-9f0b098538ba req-118861e8-0669-4fea-a93f-d95ade29afa1 service neutron] Checking segment: {'id': '63a401e5-97f0-4f3a-b762-8fc66b1b215f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 333, 'network_id': '10e5206a-1d3b-409b-a3ee-0f6a311d6819'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:33:34.553821 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-eaf21388-8c21-445f-bd1a-9f0b098538ba req-118861e8-0669-4fea-a93f-d95ade29afa1 service neutron] Bound using segment: {'id': '63a401e5-97f0-4f3a-b762-8fc66b1b215f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 333, 'network_id': '10e5206a-1d3b-409b-a3ee-0f6a311d6819'} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:33:34.554213 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-eaf21388-8c21-445f-bd1a-9f0b098538ba req-118861e8-0669-4fea-a93f-d95ade29afa1 service neutron] Bound port: d3617298-af19-45fb-8ddd-9c228bc66aab, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '63a401e5-97f0-4f3a-b762-8fc66b1b215f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 333, 'network_id': '10e5206a-1d3b-409b-a3ee-0f6a311d6819'}}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:33:34.569549 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-eaf21388-8c21-445f-bd1a-9f0b098538ba req-118861e8-0669-4fea-a93f-d95ade29afa1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:34.580652 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-44e0933c-587d-4f99-ab5c-4f90bac797ef tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '57d559af-ebd5-42c2-b187-251c0ee907e1') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:34.581114 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-44e0933c-587d-4f99-ab5c-4f90bac797ef tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '57d559af-ebd5-42c2-b187-251c0ee907e1') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:34.581846 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-291ec7c4-7430-4b01-a966-69bfa6b1b207 None None] Attempting to bind port 16584a2a-1536-465e-85d3-cea284b5c20d on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:33:34.582548 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-291ec7c4-7430-4b01-a966-69bfa6b1b207 None None] Attempting to bind port 16584a2a-1536-465e-85d3-cea284b5c20d by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:33:34.582857 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-291ec7c4-7430-4b01-a966-69bfa6b1b207 None None] Attempting to bind port 16584a2a-1536-465e-85d3-cea284b5c20d on network 988d2354-693c-4d52-af17-25e0643eaa0c {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:33:34.588565 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-291ec7c4-7430-4b01-a966-69bfa6b1b207 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 33, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:33:34.589099 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-291ec7c4-7430-4b01-a966-69bfa6b1b207 None None] Checking segment: {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:33:34.589822 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-291ec7c4-7430-4b01-a966-69bfa6b1b207 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:34.590083 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-291ec7c4-7430-4b01-a966-69bfa6b1b207 None None] Bound using segment: {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:33:34.591151 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-291ec7c4-7430-4b01-a966-69bfa6b1b207 None None] Bound port: 16584a2a-1536-465e-85d3-cea284b5c20d, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:33:34.591151 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-291ec7c4-7430-4b01-a966-69bfa6b1b207 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:34.594201 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-44e0933c-587d-4f99-ab5c-4f90bac797ef tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:34.621105 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-2ead41c7-e2ae-4c1d-a7c0-c0b983efa12f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Allocated IP 172.26.0.204 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/49bff53a-c208-4aa5-8fcc-e7ec9471fae7) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:33:34.623479 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-44e0933c-587d-4f99-ab5c-4f90bac797ef tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:34.638699 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e890fd79-bb43-4407-8305-e736661d186c req-8a477bb5-9a47-4c54-a4c7-b2d2b6532da3 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:34.640405 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-e890fd79-bb43-4407-8305-e736661d186c req-8a477bb5-9a47-4c54-a4c7-b2d2b6532da3 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/ports?device_id=e145337f-88ba-4f6d-a894-39631a8dd013 HTTP/1.1" status: 200 len: 943 time: 0.1719441 Nov 09 04:33:34.644069 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-44e0933c-587d-4f99-ab5c-4f90bac797ef tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Releasing vlan 302 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:33:34.644478 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-44e0933c-587d-4f99-ab5c-4f90bac797ef tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:34.647918 dv-neutron-816802-2-hyperv neutron-server[102161]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:33:34.647918 dv-neutron-816802-2-hyperv neutron-server[102161]: self.session.flush() Nov 09 04:33:34.647918 dv-neutron-816802-2-hyperv neutron-server[102161]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:33:34.647918 dv-neutron-816802-2-hyperv neutron-server[102161]: self.session.flush() Nov 09 04:33:34.647918 dv-neutron-816802-2-hyperv neutron-server[102161]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:33:34.647918 dv-neutron-816802-2-hyperv neutron-server[102161]: self.session.flush() Nov 09 04:33:34.647918 dv-neutron-816802-2-hyperv neutron-server[102161]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:33:34.647918 dv-neutron-816802-2-hyperv neutron-server[102161]: self.session.flush() Nov 09 04:33:34.647918 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:33:34.647918 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:33:34.647918 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:33:34.647918 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:33:34.647918 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:33:34.647918 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:33:34.647918 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:33:34.647918 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:33:34.647918 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:33:34.647918 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:33:34.647918 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:33:34.647918 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:33:34.647918 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:33:34.647918 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:33:34.647918 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:33:34.647918 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:33:34.647918 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:33:34.647918 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:33:34.647918 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:33:34.647918 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:33:34.647918 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:33:34.647918 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:33:34.647918 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:33:34.647918 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:33:34.647918 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:33:34.647918 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:33:34.647918 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:33:34.647918 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:33:34.647918 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:33:34.647918 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:33:34.647918 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:33:34.647918 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:33:34.676648 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-291ec7c4-7430-4b01-a966-69bfa6b1b207 None None] For port 16584a2a-1536-465e-85d3-cea284b5c20d, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:33:34.711696 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device bf77ddc4-4ed9-472d-842b-1fb79d55e2e4 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:33:34.733264 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: bf77ddc4-4ed9-472d-842b-1fb79d55e2e4 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:33:34.733863 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device bf77ddc4-4ed9-472d-842b-1fb79d55e2e4 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:33:34.734408 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 843328c7-08ce-4c76-a55f-3396fabab904 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:33:34.754111 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 843328c7-08ce-4c76-a55f-3396fabab904 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:33:34.755155 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 843328c7-08ce-4c76-a55f-3396fabab904 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:33:34.765374 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-eaf21388-8c21-445f-bd1a-9f0b098538ba req-118861e8-0669-4fea-a93f-d95ade29afa1 service neutron] For port d3617298-af19-45fb-8ddd-9c228bc66aab, host hv-neutron-8168, cleared binding levels {{(pid=102162) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:33:34.773748 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-2c0ffe32-3467-41bb-9e99-724583a4a9b5 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Allocated IP 2001:db8::f816:3eff:fe6c:a03c (988d2354-693c-4d52-af17-25e0643eaa0c/9929229d-3c0c-42fe-be75-aa3c073412f6/f8a4f9ac-0d31-44f6-a037-c56638319eb9) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:33:34.808477 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-e890fd79-bb43-4407-8305-e736661d186c req-60cbbff6-c1fd-4601-9b6b-d6ed9d13a3a8 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/security-groups?id=8fd0adbd-57c5-4583-8e2d-9a55d7973976&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1565311 Nov 09 04:33:34.829780 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9dc2d009-e972-4e4f-845e-f50143ce6f80 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:34.839208 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-44e0933c-587d-4f99-ab5c-4f90bac797ef tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:34.844010 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2ead41c7-e2ae-4c1d-a7c0-c0b983efa12f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:34.851607 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-44e0933c-587d-4f99-ab5c-4f90bac797ef tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:34.854792 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-44e0933c-587d-4f99-ab5c-4f90bac797ef tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "DELETE /v2.0/networks/35e2f2d1-ee40-4328-9fe2-48e5a5c19938 HTTP/1.1" status: 204 len: 168 time: 2.0383279 Nov 09 04:33:34.855005 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-291ec7c4-7430-4b01-a966-69bfa6b1b207 None None] For port 16584a2a-1536-465e-85d3-cea284b5c20d, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=16584a2a-1536-465e-85d3-cea284b5c20d,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:33:34.866625 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57144) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:34.872475 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-a41625e5-2735-4ed7-a691-6556bce34bf1 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Request body: {'router': {'routes': None}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:34.874664 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44e0933c-587d-4f99-ab5c-4f90bac797ef tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Pushing event deleted for resources: {'Network': ['ID=35e2f2d1-ee40-4328-9fe2-48e5a5c19938,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:34.924173 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9dc2d009-e972-4e4f-845e-f50143ce6f80 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Network 002d27a0-2fb8-4426-9550-42c444556a8e is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:33:34.924430 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-291ec7c4-7430-4b01-a966-69bfa6b1b207 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:34.929632 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-eaf21388-8c21-445f-bd1a-9f0b098538ba req-118861e8-0669-4fea-a93f-d95ade29afa1 service neutron] For port d3617298-af19-45fb-8ddd-9c228bc66aab, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=d3617298-af19-45fb-8ddd-9c228bc66aab,segment=NetworkSegment(63a401e5-97f0-4f3a-b762-8fc66b1b215f),segment_id=63a401e5-97f0-4f3a-b762-8fc66b1b215f)] {{(pid=102162) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:33:34.934910 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-9dc2d009-e972-4e4f-845e-f50143ce6f80 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:33:34.940720 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9dc2d009-e972-4e4f-845e-f50143ce6f80 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:34.941311 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9dc2d009-e972-4e4f-845e-f50143ce6f80 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:34.955031 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dc2d009-e972-4e4f-845e-f50143ce6f80 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event updated for resources: {'Subnet': ['ID=df5c0c2e-73f1-4f11-bae4-c9e63a6467fc,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:34.967659 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e9f83735-1eec-41ab-9bee-b9f1535b276d None None] Network 002d27a0-2fb8-4426-9550-42c444556a8e requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:33:35.006214 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2c0ffe32-3467-41bb-9e99-724583a4a9b5 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:35.027511 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-eaf21388-8c21-445f-bd1a-9f0b098538ba req-118861e8-0669-4fea-a93f-d95ade29afa1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:35.067023 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-291ec7c4-7430-4b01-a966-69bfa6b1b207 None None] Pushing event updated for resources: {'Port': ['ID=16584a2a-1536-465e-85d3-cea284b5c20d,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:35.083420 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-9dc2d009-e972-4e4f-845e-f50143ce6f80 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 836 time: 1.7737112 Nov 09 04:33:35.087028 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57146) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:35.093780 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.extraroute_db [None req-a41625e5-2735-4ed7-a691-6556bce34bf1 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Added routes are [] {{(pid=102161) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:126}} Nov 09 04:33:35.093996 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-f41a83f8-8d64-449e-8ba5-53ae266fa1b4 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Request body: {'port': {'name': 'tempest-PortsIpV6TestJSON-635058023', 'admin_state_up': False, 'fixed_ips': [{'subnet_id': 'df5c0c2e-73f1-4f11-bae4-c9e63a6467fc'}], 'security_groups': ['9e2eb020-1be7-41c8-959e-ea68d2b8ad84']}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:35.094104 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.extraroute_db [None req-a41625e5-2735-4ed7-a691-6556bce34bf1 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Removed routes are [] {{(pid=102161) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:134}} Nov 09 04:33:35.094449 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a41625e5-2735-4ed7-a691-6556bce34bf1 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-466202', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-464271', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-936'] for router, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:35.098415 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2ead41c7-e2ae-4c1d-a7c0-c0b983efa12f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:35.141962 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eaf21388-8c21-445f-bd1a-9f0b098538ba req-118861e8-0669-4fea-a93f-d95ade29afa1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:35.142611 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-eaf21388-8c21-445f-bd1a-9f0b098538ba req-118861e8-0669-4fea-a93f-d95ade29afa1 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:35.143988 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-eaf21388-8c21-445f-bd1a-9f0b098538ba req-118861e8-0669-4fea-a93f-d95ade29afa1 service neutron] 10.222.0.26 "PUT /v2.0/ports/d3617298-af19-45fb-8ddd-9c228bc66aab HTTP/1.1" status: 200 len: 1093 time: 2.7080798 Nov 09 04:33:35.144439 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e145337f-88ba-4f6d-a894-39631a8dd013', 'tag': 'd3617298-af19-45fb-8ddd-9c228bc66aab'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:33:35.147324 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ce0f6388-d275-424e-a60b-9f2907f9cec1" -d '{"events": [{"name": "network-changed", "server_uuid": "e145337f-88ba-4f6d-a894-39631a8dd013", "tag": "d3617298-af19-45fb-8ddd-9c228bc66aab"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:33:35.190910 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-118861e8-0669-4fea-a93f-d95ade29afa1 service neutron] Pushing event updated for resources: {'Port': ['ID=d3617298-af19-45fb-8ddd-9c228bc66aab,revision_number=3']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:35.225028 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2ead41c7-e2ae-4c1d-a7c0-c0b983efa12f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:33:35.225028 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-2ead41c7-e2ae-4c1d-a7c0-c0b983efa12f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:33:35.225217 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:33:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c41cf5df-efcf-4a5e-96fd-6339ada7ca27 x-openstack-request-id: req-c41cf5df-efcf-4a5e-96fd-6339ada7ca27 {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:33:35.225217 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e145337f-88ba-4f6d-a894-39631a8dd013", "tag": "d3617298-af19-45fb-8ddd-9c228bc66aab", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:33:35.225217 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-c41cf5df-efcf-4a5e-96fd-6339ada7ca27 {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:33:35.225217 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e145337f-88ba-4f6d-a894-39631a8dd013', 'tag': 'd3617298-af19-45fb-8ddd-9c228bc66aab', 'status': 'completed', 'code': 200} Nov 09 04:33:35.225534 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ead41c7-e2ae-4c1d-a7c0-c0b983efa12f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Port': ['ID=49bff53a-c208-4aa5-8fcc-e7ec9471fae7,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:35.225763 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2ead41c7-e2ae-4c1d-a7c0-c0b983efa12f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:33:35.226448 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2c0ffe32-3467-41bb-9e99-724583a4a9b5 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:35.330656 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cd038f15-3d22-4960-b4e2-eef46e6edd02 None None] Update dhcp port {'port': {'network_id': '002d27a0-2fb8-4426-9550-42c444556a8e', 'fixed_ips': [{'subnet_id': '315097f5-620a-4aee-bad3-44a6cf15bd6d', 'ip_address': '2001:db8::2'}, {'subnet_id': 'df5c0c2e-73f1-4f11-bae4-c9e63a6467fc'}], 'binding:host_id': 'dv-neutron-816802-2-hyperv'}, 'id': 'c315ee21-870f-44c3-b604-c4eb34ea288a'} from dv-neutron-816802-2-hyperv. {{(pid=102163) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:328}} Nov 09 04:33:35.333655 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c0ffe32-3467-41bb-9e99-724583a4a9b5 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Port': ['ID=f8a4f9ac-0d31-44f6-a037-c56638319eb9,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:35.341558 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a41625e5-2735-4ed7-a691-6556bce34bf1 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-466202', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-464271', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-936'] for router, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:35.346549 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2c0ffe32-3467-41bb-9e99-724583a4a9b5 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:33:35.367292 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-cd038f15-3d22-4960-b4e2-eef46e6edd02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:35.371614 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a41625e5-2735-4ed7-a691-6556bce34bf1 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-466195', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-466408', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-464260'] for router, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:35.381064 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f41a83f8-8d64-449e-8ba5-53ae266fa1b4 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:35.401947 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-2c0ffe32-3467-41bb-9e99-724583a4a9b5 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:33:35.404844 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2c0ffe32-3467-41bb-9e99-724583a4a9b5 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:33:35.413239 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2c0ffe32-3467-41bb-9e99-724583a4a9b5 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:35.414373 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2c0ffe32-3467-41bb-9e99-724583a4a9b5 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:35.471481 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce0f6388-d275-424e-a60b-9f2907f9cec1 req-aebb28da-cdbb-4502-9a2e-77ed3d882326 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:35.473934 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ce0f6388-d275-424e-a60b-9f2907f9cec1 req-aebb28da-cdbb-4502-9a2e-77ed3d882326 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=a7dd369fc9b947d2b50f9f75551d326d&device_id=e145337f-88ba-4f6d-a894-39631a8dd013 HTTP/1.1" status: 200 len: 1096 time: 0.1738317 Nov 09 04:33:35.549325 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a41625e5-2735-4ed7-a691-6556bce34bf1 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Router fa30d24d-d721-4675-ad7b-09f35105e633 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:33:35.553481 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-cd038f15-3d22-4960-b4e2-eef46e6edd02 None None] Allocated IP 2001:db8:0:1::2 (002d27a0-2fb8-4426-9550-42c444556a8e/df5c0c2e-73f1-4f11-bae4-c9e63a6467fc/c315ee21-870f-44c3-b604-c4eb34ea288a) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:33:35.567343 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-2c0ffe32-3467-41bb-9e99-724583a4a9b5 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 948 time: 1.8242400 Nov 09 04:33:35.567558 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57150) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:35.665813 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-cd038f15-3d22-4960-b4e2-eef46e6edd02 None None] For port c315ee21-870f-44c3-b604-c4eb34ea288a, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=c315ee21-870f-44c3-b604-c4eb34ea288a,segment=NetworkSegment(53b7b761-0c0a-4377-98bf-58d99642533b),segment_id=53b7b761-0c0a-4377-98bf-58d99642533b)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:33:35.672239 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1c901cb8-642e-45ed-8954-d7b422fabd5d tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:35.679485 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1c901cb8-642e-45ed-8954-d7b422fabd5d tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:35.683766 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1c901cb8-642e-45ed-8954-d7b422fabd5d tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1703 time: 0.1170137 Nov 09 04:33:35.697720 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-cd038f15-3d22-4960-b4e2-eef46e6edd02 None None] Publish callbacks [] for port, precommit_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:35.700832 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57154) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:35.739416 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-cd038f15-3d22-4960-b4e2-eef46e6edd02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:35.782327 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a41625e5-2735-4ed7-a691-6556bce34bf1 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:33:35.809096 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fd444b63-127c-4166-b106-f483a7357e64 None None] Sync routers for ids ['fa30d24d-d721-4675-ad7b-09f35105e633'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:33:35.813763 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a41625e5-2735-4ed7-a691-6556bce34bf1 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:35.819872 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a41625e5-2735-4ed7-a691-6556bce34bf1 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "PUT /v2.0/routers/fa30d24d-d721-4675-ad7b-09f35105e633 HTTP/1.1" status: 200 len: 701 time: 0.9474299 Nov 09 04:33:35.819872 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57156) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:35.860752 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce0f6388-d275-424e-a60b-9f2907f9cec1 req-aa1b217f-ec34-4dc3-b10d-251b6c523f7f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:35.860752 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ce0f6388-d275-424e-a60b-9f2907f9cec1 req-aa1b217f-ec34-4dc3-b10d-251b6c523f7f service neutron] 10.222.0.26 "GET /v2.0/networks?tenant_id=a7dd369fc9b947d2b50f9f75551d326d&shared=False HTTP/1.1" status: 200 len: 912 time: 0.3770614 Nov 09 04:33:35.894320 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd038f15-3d22-4960-b4e2-eef46e6edd02 None None] Pushing event updated for resources: {'Port': ['ID=c315ee21-870f-44c3-b604-c4eb34ea288a,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:35.901352 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fd444b63-127c-4166-b106-f483a7357e64 None None] Routers {'fa30d24d-d721-4675-ad7b-09f35105e633'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:33:35.902312 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-fd444b63-127c-4166-b106-f483a7357e64 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:33:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['fa30d24d-d721-4675-ad7b-09f35105e633'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:35.966523 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-ee23c9ae-cead-48df-8868-9e941d8e707e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "GET /v2.0/ports?device_id=fa30d24d-d721-4675-ad7b-09f35105e633 HTTP/1.1" status: 200 len: 205 time: 0.1459501 Nov 09 04:33:35.977534 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57160) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:35.986840 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8ed7bea-4375-4458-938c-28d521976a0a req-25fc48a0-b0de-49b6-b2f9-b305623de7d7 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:35.995233 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d8ed7bea-4375-4458-938c-28d521976a0a req-25fc48a0-b0de-49b6-b2f9-b305623de7d7 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 945 time: 0.3128757 Nov 09 04:33:36.006041 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-fd444b63-127c-4166-b106-f483a7357e64 None None] Set router fa30d24d-d721-4675-ad7b-09f35105e633 gateway port host: None {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:33:36.083748 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-fd444b63-127c-4166-b106-f483a7357e64 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'name': 'tempest-RoutersTest-router-1490827103', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:32:29Z', 'updated_at': '2021-11-09T04:33:31Z', 'revision_number': 11, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'gw_port_host': None}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:36.115600 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fd444b63-127c-4166-b106-f483a7357e64 None None] Checking router: fa30d24d-d721-4675-ad7b-09f35105e633 for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:33:36.126837 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fd444b63-127c-4166-b106-f483a7357e64 None None] Routers {'fa30d24d-d721-4675-ad7b-09f35105e633'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:33:36.127577 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-fd444b63-127c-4166-b106-f483a7357e64 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:33:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['fa30d24d-d721-4675-ad7b-09f35105e633'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:36.131132 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b70345e2-3a05-42e1-b70a-1f47a6ca9edb tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for router, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:36.215214 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-f49bd006-6ab8-42fd-9b7c-313439f3497b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Deleting port f8a4f9ac-0d31-44f6-a037-c56638319eb9 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:33:36.216727 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f49bd006-6ab8-42fd-9b7c-313439f3497b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:36.220502 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-fd444b63-127c-4166-b106-f483a7357e64 None None] Set router fa30d24d-d721-4675-ad7b-09f35105e633 gateway port host: None {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:33:36.261960 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2ead41c7-e2ae-4c1d-a7c0-c0b983efa12f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router_gateway, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:36.271007 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d8ed7bea-4375-4458-938c-28d521976a0a req-955bd8e3-823a-470e-b6c9-278f95d1e0f7 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2748947 Nov 09 04:33:36.299082 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-fd444b63-127c-4166-b106-f483a7357e64 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'name': 'tempest-RoutersTest-router-1490827103', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:32:29Z', 'updated_at': '2021-11-09T04:33:31Z', 'revision_number': 11, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'gw_port_host': None}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:36.335310 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fd444b63-127c-4166-b106-f483a7357e64 None None] The sync data for ids ['fa30d24d-d721-4675-ad7b-09f35105e633'] in dv-neutron-816802-2-hyperv is: [{'id': 'fa30d24d-d721-4675-ad7b-09f35105e633', 'name': 'tempest-RoutersTest-router-1490827103', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:32:29Z', 'updated_at': '2021-11-09T04:33:31Z', 'revision_number': 11, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'gw_port_host': None}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:33:36.375286 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-079b87e2-d9bc-40f0-8346-e1046f129b6c req-6efc8d06-c864-4683-8008-c674e3547b87 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:36.384325 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-079b87e2-d9bc-40f0-8346-e1046f129b6c req-6efc8d06-c864-4683-8008-c674e3547b87 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/ports?device_id=e145337f-88ba-4f6d-a894-39631a8dd013 HTTP/1.1" status: 200 len: 943 time: 0.4144678 Nov 09 04:33:36.386430 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-83dac164-7842-4261-8d6f-f9f492102707 None None] Provisioning complete for port 16584a2a-1536-465e-85d3-cea284b5c20d triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:36.386824 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-83dac164-7842-4261-8d6f-f9f492102707 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:36.402468 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce0f6388-d275-424e-a60b-9f2907f9cec1 req-3a09aa2a-79ea-4946-b490-c07d745bc8b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:36.403950 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ce0f6388-d275-424e-a60b-9f2907f9cec1 req-3a09aa2a-79ea-4946-b490-c07d745bc8b1 service neutron] 10.222.0.26 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.5369716 Nov 09 04:33:36.500150 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-f41a83f8-8d64-449e-8ba5-53ae266fa1b4 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Delete allocated IP 2001:db8::298 (002d27a0-2fb8-4426-9550-42c444556a8e/315097f5-620a-4aee-bad3-44a6cf15bd6d) {{(pid=102162) _delete_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:118}} Nov 09 04:33:36.552394 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-83dac164-7842-4261-8d6f-f9f492102707 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:36.565741 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b70345e2-3a05-42e1-b70a-1f47a6ca9edb tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:36.569552 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b70345e2-3a05-42e1-b70a-1f47a6ca9edb tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:36.592342 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-079b87e2-d9bc-40f0-8346-e1046f129b6c req-2c9076b5-ce3c-4735-9a9c-9489a8817afa tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/security-groups?id=8fd0adbd-57c5-4583-8e2d-9a55d7973976&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2070620 Nov 09 04:33:36.595525 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-f41a83f8-8d64-449e-8ba5-53ae266fa1b4 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Allocated IP 2001:db8:0:1::345 (002d27a0-2fb8-4426-9550-42c444556a8e/df5c0c2e-73f1-4f11-bae4-c9e63a6467fc/b40e258d-367a-43ed-80aa-4b84b0a0b371) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:33:36.609797 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f49bd006-6ab8-42fd-9b7c-313439f3497b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:36.657308 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-f49bd006-6ab8-42fd-9b7c-313439f3497b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Calling delete_port for f8a4f9ac-0d31-44f6-a037-c56638319eb9 owned by {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:33:36.678077 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-83dac164-7842-4261-8d6f-f9f492102707 None None] For port 16584a2a-1536-465e-85d3-cea284b5c20d, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=16584a2a-1536-465e-85d3-cea284b5c20d,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:33:36.709662 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eaf21388-8c21-445f-bd1a-9f0b098538ba req-38255ba6-dc86-4756-80ce-fb72b9982cea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:36.711221 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-eaf21388-8c21-445f-bd1a-9f0b098538ba req-38255ba6-dc86-4756-80ce-fb72b9982cea service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=a7dd369fc9b947d2b50f9f75551d326d&device_id=e145337f-88ba-4f6d-a894-39631a8dd013 HTTP/1.1" status: 200 len: 1096 time: 0.2282755 Nov 09 04:33:36.743341 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2ead41c7-e2ae-4c1d-a7c0-c0b983efa12f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:36.755551 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b70345e2-3a05-42e1-b70a-1f47a6ca9edb tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:36.755551 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b70345e2-3a05-42e1-b70a-1f47a6ca9edb tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Fanout notify agent at l3_agent the message router_deleted on router fa30d24d-d721-4675-ad7b-09f35105e633 {{(pid=102161) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:33:36.761929 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b70345e2-3a05-42e1-b70a-1f47a6ca9edb tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:36.763291 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-b70345e2-3a05-42e1-b70a-1f47a6ca9edb tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "DELETE /v2.0/routers/fa30d24d-d721-4675-ad7b-09f35105e633 HTTP/1.1" status: 204 len: 168 time: 0.7659323 Nov 09 04:33:36.775354 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57162) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:36.775586 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-83dac164-7842-4261-8d6f-f9f492102707 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:36.810625 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-ffb39169-2a88-4d3b-a420-d2ad229764b6 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-2065159593', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:36.827450 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-eaf21388-8c21-445f-bd1a-9f0b098538ba req-f3bd5d70-edb8-4a65-810e-63d8b271ec52 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=d3617298-af19-45fb-8ddd-9c228bc66aab HTTP/1.1" status: 200 len: 217 time: 0.0764284 Nov 09 04:33:36.863386 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 16584a2a-1536-465e-85d3-cea284b5c20d up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:33:36.932647 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83dac164-7842-4261-8d6f-f9f492102707 None None] Pushing event updated for resources: {'Port': ['ID=16584a2a-1536-465e-85d3-cea284b5c20d,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:36.958238 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-dc0a1925-1da5-4395-a50d-8c1f1ac8e8ac None None] Provisioning complete for port f8a4f9ac-0d31-44f6-a037-c56638319eb9 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:36.958802 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-dc0a1925-1da5-4395-a50d-8c1f1ac8e8ac None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:36.970759 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eaf21388-8c21-445f-bd1a-9f0b098538ba req-efd164e7-4978-4e9e-a62c-eee4b9e3f1b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:36.972243 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-eaf21388-8c21-445f-bd1a-9f0b098538ba req-efd164e7-4978-4e9e-a62c-eee4b9e3f1b2 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=73ee2bd1-c2b2-478f-96c9-301b99515bfe HTTP/1.1" status: 200 len: 851 time: 0.1007998 Nov 09 04:33:37.009312 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-dc0a1925-1da5-4395-a50d-8c1f1ac8e8ac None None] Port f8a4f9ac-0d31-44f6-a037-c56638319eb9 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:33:37.016232 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 16584a2a-1536-465e-85d3-cea284b5c20d triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:37.016598 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:37.019595 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-eaf21388-8c21-445f-bd1a-9f0b098538ba req-9a09b635-857e-4730-a01a-761d2be05caf service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=10e5206a-1d3b-409b-a3ee-0f6a311d6819&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0386169 Nov 09 04:33:37.047708 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ffb39169-2a88-4d3b-a420-d2ad229764b6 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:37.048702 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ffb39169-2a88-4d3b-a420-d2ad229764b6 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:37.059129 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2ead41c7-e2ae-4c1d-a7c0-c0b983efa12f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Router d05416c2-0293-4ef5-a6e3-5968392cc774 is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102161) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:33:37.096137 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device c315ee21-870f-44c3-b604-c4eb34ea288a up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:33:37.146616 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-81c49304-0e15-4109-bedc-42c4fbbe2185 None None] Provisioning complete for port c315ee21-870f-44c3-b604-c4eb34ea288a triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:37.146990 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-81c49304-0e15-4109-bedc-42c4fbbe2185 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:37.182970 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port c315ee21-870f-44c3-b604-c4eb34ea288a triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:37.183236 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:37.183606 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2ead41c7-e2ae-4c1d-a7c0-c0b983efa12f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:33:37.197147 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e6736b32-abc2-4587-abc7-343a75b09212 None None] Sync routers for ids ['d05416c2-0293-4ef5-a6e3-5968392cc774'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:33:37.206977 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e6736b32-abc2-4587-abc7-343a75b09212 None None] Routers {'d05416c2-0293-4ef5-a6e3-5968392cc774'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:33:37.207969 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-e6736b32-abc2-4587-abc7-343a75b09212 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:33:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['d05416c2-0293-4ef5-a6e3-5968392cc774'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:37.277391 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2ead41c7-e2ae-4c1d-a7c0-c0b983efa12f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:37.281781 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-2ead41c7-e2ae-4c1d-a7c0-c0b983efa12f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 887 time: 4.9447386 Nov 09 04:33:37.285291 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57164) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:37.330780 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-e6736b32-abc2-4587-abc7-343a75b09212 None None] Set router d05416c2-0293-4ef5-a6e3-5968392cc774 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:33:37.364972 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-81c49304-0e15-4109-bedc-42c4fbbe2185 None None] Provisioning complete for port b40e258d-367a-43ed-80aa-4b84b0a0b371 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:37.365358 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-81c49304-0e15-4109-bedc-42c4fbbe2185 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:37.423819 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f41a83f8-8d64-449e-8ba5-53ae266fa1b4 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:37.446467 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-81c49304-0e15-4109-bedc-42c4fbbe2185 None None] Port b40e258d-367a-43ed-80aa-4b84b0a0b371 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:33:37.483444 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a50d44f3-ce27-40e0-8da3-17876fa23ca4 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/subnets?project_id=1d10b4824e524068827e58b55e269af3&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.1961799 Nov 09 04:33:37.484096 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57170) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:37.505962 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af5309ed-a7e8-40cd-8f83-94b5e713b089 req-2ed861dd-e991-4b3a-a0d8-8d4c8203a659 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:37.507557 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-af5309ed-a7e8-40cd-8f83-94b5e713b089 req-2ed861dd-e991-4b3a-a0d8-8d4c8203a659 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 945 time: 0.0958068 Nov 09 04:33:37.509881 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f41a83f8-8d64-449e-8ba5-53ae266fa1b4 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:37.515148 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-81c49304-0e15-4109-bedc-42c4fbbe2185 None None] Provisioning complete for port 77290ebd-f244-4a68-94af-4d033c4a6349 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:37.515644 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-81c49304-0e15-4109-bedc-42c4fbbe2185 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:37.569959 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-81c49304-0e15-4109-bedc-42c4fbbe2185 None None] Port 77290ebd-f244-4a68-94af-4d033c4a6349 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:33:37.577273 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-af5309ed-a7e8-40cd-8f83-94b5e713b089 req-a0f2ba63-7b8e-4c44-ab48-5c2ef68b48bd tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0621698 Nov 09 04:33:37.583083 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-eaf21388-8c21-445f-bd1a-9f0b098538ba req-71714152-8790-4ca3-aaed-0b5c4c73c1e7 service neutron] 10.222.0.26 "GET /v2.0/networks/10e5206a-1d3b-409b-a3ee-0f6a311d6819?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5559113 Nov 09 04:33:37.625457 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-e6736b32-abc2-4587-abc7-343a75b09212 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'name': 'tempest-TestNetworkBasicOps-router-1967773701', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.204'}], 'enable_snat': True}, 'gw_port_id': '49bff53a-c208-4aa5-8fcc-e7ec9471fae7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:33:32Z', 'updated_at': '2021-11-09T04:33:35Z', 'revision_number': 3, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '49bff53a-c208-4aa5-8fcc-e7ec9471fae7', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:85:7f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'device_owner': 'network:router_gateway', 'standard_attr_id': 978, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.204', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:33:34Z', 'updated_at': '2021-11-09T04:33:34Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:37.631334 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f49bd006-6ab8-42fd-9b7c-313439f3497b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:37.663451 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e6736b32-abc2-4587-abc7-343a75b09212 None None] Checking router: d05416c2-0293-4ef5-a6e3-5968392cc774 for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:33:37.663991 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e6736b32-abc2-4587-abc7-343a75b09212 None None] Updating router d05416c2-0293-4ef5-a6e3-5968392cc774 port 49bff53a-c208-4aa5-8fcc-e7ec9471fae7 binding host dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 04:33:37.699185 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-e6736b32-abc2-4587-abc7-343a75b09212 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:37.726582 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-f41a83f8-8d64-449e-8ba5-53ae266fa1b4 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] In _notify_port_updated(), no bound segment for port b40e258d-367a-43ed-80aa-4b84b0a0b371 on network 002d27a0-2fb8-4426-9550-42c444556a8e {{(pid=102162) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 09 04:33:37.732135 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f41a83f8-8d64-449e-8ba5-53ae266fa1b4 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:37.733240 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f41a83f8-8d64-449e-8ba5-53ae266fa1b4 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:37.736691 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-f41a83f8-8d64-449e-8ba5-53ae266fa1b4 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "PUT /v2.0/ports/b40e258d-367a-43ed-80aa-4b84b0a0b371 HTTP/1.1" status: 200 len: 930 time: 2.6461689 Nov 09 04:33:37.737509 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57174) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:37.830680 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f41a83f8-8d64-449e-8ba5-53ae266fa1b4 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event updated for resources: {'Port': ['ID=b40e258d-367a-43ed-80aa-4b84b0a0b371,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:37.859993 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-5672bdb5-96e3-4c11-9278-5640249db4b7 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Deleting port b40e258d-367a-43ed-80aa-4b84b0a0b371 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:33:37.860521 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5672bdb5-96e3-4c11-9278-5640249db4b7 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:37.865224 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ffb39169-2a88-4d3b-a420-d2ad229764b6 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:37.938645 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f49bd006-6ab8-42fd-9b7c-313439f3497b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event deleted for resources: {'Port': ['ID=f8a4f9ac-0d31-44f6-a037-c56638319eb9,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:37.949841 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f49bd006-6ab8-42fd-9b7c-313439f3497b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:37.955682 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-f49bd006-6ab8-42fd-9b7c-313439f3497b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/ports/f8a4f9ac-0d31-44f6-a037-c56638319eb9 HTTP/1.1" status: 204 len: 168 time: 2.2512937 Nov 09 04:33:37.955682 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ffb39169-2a88-4d3b-a420-d2ad229764b6 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:37.962611 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57176) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:37.995380 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3cda75eb-5cb8-47d1-8abd-8595dde382e3 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:37.996914 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-3cda75eb-5cb8-47d1-8abd-8595dde382e3 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.5122039 Nov 09 04:33:38.001180 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57178) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:38.007140 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-b0e4e5c9-5e76-463d-9afb-ae74df8ac15a None None] Provisioning complete for port b40e258d-367a-43ed-80aa-4b84b0a0b371 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:38.007685 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b0e4e5c9-5e76-463d-9afb-ae74df8ac15a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:38.042336 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8168e23c-6a37-4355-88da-1a5671588e68 req-fff1db71-a0be-42c5-8e20-116c16a6e276 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:38.043976 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8168e23c-6a37-4355-88da-1a5671588e68 req-fff1db71-a0be-42c5-8e20-116c16a6e276 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/ports?device_id=e145337f-88ba-4f6d-a894-39631a8dd013 HTTP/1.1" status: 200 len: 943 time: 0.3323791 Nov 09 04:33:38.049716 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5672bdb5-96e3-4c11-9278-5640249db4b7 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:38.058317 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-b0e4e5c9-5e76-463d-9afb-ae74df8ac15a None None] Port b40e258d-367a-43ed-80aa-4b84b0a0b371 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:33:38.058508 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-eaf21388-8c21-445f-bd1a-9f0b098538ba req-f24895f4-1ffc-4ba4-9fa4-b4c17d54db2f service neutron] 10.222.0.26 "GET /v2.0/networks/10e5206a-1d3b-409b-a3ee-0f6a311d6819?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4322183 Nov 09 04:33:38.094773 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-93798ce7-3ac4-48b4-b4c4-b41e00fabe7e tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/subnets?network_id=2b6725f5-ebfe-485a-8f42-ccb5a241ddb5&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0768418 Nov 09 04:33:38.099928 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57180) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:38.104641 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ffb39169-2a88-4d3b-a420-d2ad229764b6 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:38.105333 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-42037c8f-7eea-4472-afff-cf3b6011b5a1 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:38.106973 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-ffb39169-2a88-4d3b-a420-d2ad229764b6 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 700 time: 1.2991266 Nov 09 04:33:38.107127 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-42037c8f-7eea-4472-afff-cf3b6011b5a1 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:38.110418 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-42037c8f-7eea-4472-afff-cf3b6011b5a1 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1498735 Nov 09 04:33:38.110418 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57182) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:38.110418 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-5672bdb5-96e3-4c11-9278-5640249db4b7 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Calling delete_port for b40e258d-367a-43ed-80aa-4b84b0a0b371 owned by {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:33:38.113667 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57184) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:38.115303 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-6d5c5894-0051-410e-99de-4d26c1b5e6e1 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-223162947', 'network_id': '239a9c72-6384-4d5a-a69d-f4ac0c580e40', 'project_id': '1d10b4824e524068827e58b55e269af3', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:38.125021 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-f261c36a-18cd-40ee-a162-e275d0e86b2d tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Request body: {'router': {'admin_state_up': True}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:38.125951 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-e6736b32-abc2-4587-abc7-343a75b09212 None None] Publish callbacks [] for port, precommit_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:38.188665 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-0dcb149d-7de5-41c5-9506-94619115d500 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Deleting subnet 9929229d-3c0c-42fe-be75-aa3c073412f6 {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:33:38.190681 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-e6736b32-abc2-4587-abc7-343a75b09212 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:38.195196 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8168e23c-6a37-4355-88da-1a5671588e68 req-fc3d96a6-dc64-4703-bbcc-39d3999e0941 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/security-groups?id=8fd0adbd-57c5-4583-8e2d-9a55d7973976&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1360424 Nov 09 04:33:38.195872 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0dcb149d-7de5-41c5-9506-94619115d500 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:38.248596 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0dcb149d-7de5-41c5-9506-94619115d500 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:38.261047 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df3414e7-c8d6-4918-81b9-221851614378 None None] Pushing event updated for resources: {'Port': ['ID=49bff53a-c208-4aa5-8fcc-e7ec9471fae7,revision_number=2']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:38.263449 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-e6736b32-abc2-4587-abc7-343a75b09212 None None] Attempting to bind port 49bff53a-c208-4aa5-8fcc-e7ec9471fae7 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:33:38.263882 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-e6736b32-abc2-4587-abc7-343a75b09212 None None] Attempting to bind port 49bff53a-c208-4aa5-8fcc-e7ec9471fae7 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:33:38.264465 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e6736b32-abc2-4587-abc7-343a75b09212 None None] Attempting to bind port 49bff53a-c208-4aa5-8fcc-e7ec9471fae7 on network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:33:38.274010 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df3414e7-c8d6-4918-81b9-221851614378 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:38.274801 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df3414e7-c8d6-4918-81b9-221851614378 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:38.275125 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df3414e7-c8d6-4918-81b9-221851614378 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:38.275633 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df3414e7-c8d6-4918-81b9-221851614378 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:38.276140 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df3414e7-c8d6-4918-81b9-221851614378 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:38.276711 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df3414e7-c8d6-4918-81b9-221851614378 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:38.277044 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df3414e7-c8d6-4918-81b9-221851614378 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:38.277387 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df3414e7-c8d6-4918-81b9-221851614378 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:38.277731 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df3414e7-c8d6-4918-81b9-221851614378 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:38.278056 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df3414e7-c8d6-4918-81b9-221851614378 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:38.278571 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df3414e7-c8d6-4918-81b9-221851614378 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:38.279056 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df3414e7-c8d6-4918-81b9-221851614378 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:33:38.282533 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e6736b32-abc2-4587-abc7-343a75b09212 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 33, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:33:38.282903 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e6736b32-abc2-4587-abc7-343a75b09212 None None] Checking segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102164) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:33:38.283300 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-e6736b32-abc2-4587-abc7-343a75b09212 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:38.283677 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e6736b32-abc2-4587-abc7-343a75b09212 None None] Bound using segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:33:38.284155 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-e6736b32-abc2-4587-abc7-343a75b09212 None None] Bound port: 49bff53a-c208-4aa5-8fcc-e7ec9471fae7, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:33:38.284667 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-e6736b32-abc2-4587-abc7-343a75b09212 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:38.341196 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0dcb149d-7de5-41c5-9506-94619115d500 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:38.344366 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-e6736b32-abc2-4587-abc7-343a75b09212 None None] For port 49bff53a-c208-4aa5-8fcc-e7ec9471fae7, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102164) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:33:38.347434 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-e6736b32-abc2-4587-abc7-343a75b09212 None None] For port 49bff53a-c208-4aa5-8fcc-e7ec9471fae7, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=49bff53a-c208-4aa5-8fcc-e7ec9471fae7,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102164) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:33:38.420016 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-e6736b32-abc2-4587-abc7-343a75b09212 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:38.471168 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0dcb149d-7de5-41c5-9506-94619115d500 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:38.472335 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e6736b32-abc2-4587-abc7-343a75b09212 None None] Routers {'d05416c2-0293-4ef5-a6e3-5968392cc774'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:33:38.473770 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-e6736b32-abc2-4587-abc7-343a75b09212 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:33:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['d05416c2-0293-4ef5-a6e3-5968392cc774'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:38.502301 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0dcb149d-7de5-41c5-9506-94619115d500 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event deleted for resources: {'Subnet': ['ID=9929229d-3c0c-42fe-be75-aa3c073412f6,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:38.504477 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0dcb149d-7de5-41c5-9506-94619115d500 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:38.507978 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-0dcb149d-7de5-41c5-9506-94619115d500 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/9929229d-3c0c-42fe-be75-aa3c073412f6 HTTP/1.1" status: 204 len: 168 time: 0.3924782 Nov 09 04:33:38.510397 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57186) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:38.524571 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9543eb08-f12e-4bf2-814c-f5adbece6d9a None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:33:38.528684 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df3414e7-c8d6-4918-81b9-221851614378 None None] Pushing event updated for resources: {'Port': ['ID=49bff53a-c208-4aa5-8fcc-e7ec9471fae7,revision_number=3']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:38.563551 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-4967ba62-8688-4cd2-b853-d8c373106ff0 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0498736 Nov 09 04:33:38.567043 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57188) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:38.632386 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-e6736b32-abc2-4587-abc7-343a75b09212 None None] Set router d05416c2-0293-4ef5-a6e3-5968392cc774 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:33:38.685211 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0acda87d-ec6b-4c7f-94e6-9f20305b290b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:38.692903 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-0acda87d-ec6b-4c7f-94e6-9f20305b290b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/ports HTTP/1.1" status: 200 len: 866 time: 0.1245832 Nov 09 04:33:38.696303 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57192) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:38.767673 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-21395a5e-005d-4407-8310-a7631f4cd86b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:38.771233 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-21395a5e-005d-4407-8310-a7631f4cd86b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.0731921 Nov 09 04:33:38.773879 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57194) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:38.819004 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 16584a2a-1536-465e-85d3-cea284b5c20d up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:33:38.872254 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f261c36a-18cd-40ee-a162-e275d0e86b2d tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-466202', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-464271', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-936'] for router, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:38.879229 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-17b0b717-5edc-4261-a338-b33b9f4bf15b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1039104 Nov 09 04:33:38.884362 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57196) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:38.890537 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-c3d82099-cc2a-48d5-9911-f82e38aafb29 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'subnet': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'slaac'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:38.907805 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6d5c5894-0051-410e-99de-4d26c1b5e6e1 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Made reservation on behalf of 1d10b4824e524068827e58b55e269af3 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:33:38.911243 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-e6736b32-abc2-4587-abc7-343a75b09212 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'name': 'tempest-TestNetworkBasicOps-router-1967773701', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.204'}], 'enable_snat': True}, 'gw_port_id': '49bff53a-c208-4aa5-8fcc-e7ec9471fae7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:33:32Z', 'updated_at': '2021-11-09T04:33:35Z', 'revision_number': 3, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '49bff53a-c208-4aa5-8fcc-e7ec9471fae7', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:85:7f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'device_owner': 'network:router_gateway', 'standard_attr_id': 978, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.204', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:33:34Z', 'updated_at': '2021-11-09T04:33:38Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:38.912743 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6d5c5894-0051-410e-99de-4d26c1b5e6e1 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:38.920608 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 16584a2a-1536-465e-85d3-cea284b5c20d triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:38.923536 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:38.952258 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-553585d0-97fe-4943-a272-85b2c55c6155 req-5d2b8582-fad2-42c4-8d8f-88d9af904fb0 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:38.952609 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-553585d0-97fe-4943-a272-85b2c55c6155 req-5d2b8582-fad2-42c4-8d8f-88d9af904fb0 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 945 time: 0.2159977 Nov 09 04:33:38.967675 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e6736b32-abc2-4587-abc7-343a75b09212 None None] The sync data for ids ['d05416c2-0293-4ef5-a6e3-5968392cc774'] in dv-neutron-816802-2-hyperv is: [{'id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'name': 'tempest-TestNetworkBasicOps-router-1967773701', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.204'}], 'enable_snat': True}, 'gw_port_id': '49bff53a-c208-4aa5-8fcc-e7ec9471fae7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:33:32Z', 'updated_at': '2021-11-09T04:33:35Z', 'revision_number': 3, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '49bff53a-c208-4aa5-8fcc-e7ec9471fae7', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:85:7f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'device_owner': 'network:router_gateway', 'standard_attr_id': 978, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.204', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:33:34Z', 'updated_at': '2021-11-09T04:33:38Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:33:39.015564 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b4b3266d-a0ec-487a-9297-9f4eb80ba656 None None] DHCP port deletion for 988d2354-693c-4d52-af17-25e0643eaa0c request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:33:39.029608 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f261c36a-18cd-40ee-a162-e275d0e86b2d tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-466195', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-466408', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-464260'] for router, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:39.095299 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-b4b3266d-a0ec-487a-9297-9f4eb80ba656 None None] Deleting port 16584a2a-1536-465e-85d3-cea284b5c20d {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:33:39.095752 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b4b3266d-a0ec-487a-9297-9f4eb80ba656 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:39.122537 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c3d82099-cc2a-48d5-9911-f82e38aafb29 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:33:39.126732 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c3d82099-cc2a-48d5-9911-f82e38aafb29 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:39.161292 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-553585d0-97fe-4943-a272-85b2c55c6155 req-f3da6ff3-be74-4fa7-9f8c-948bf8a2ef86 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1693256 Nov 09 04:33:39.167098 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5672bdb5-96e3-4c11-9278-5640249db4b7 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:39.175938 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-b4b3266d-a0ec-487a-9297-9f4eb80ba656 None None] For port 16584a2a-1536-465e-85d3-cea284b5c20d, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=16584a2a-1536-465e-85d3-cea284b5c20d,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:33:39.177320 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b4b3266d-a0ec-487a-9297-9f4eb80ba656 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:39.194487 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-b4b3266d-a0ec-487a-9297-9f4eb80ba656 None None] Calling delete_port for 16584a2a-1536-465e-85d3-cea284b5c20d owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:33:39.207682 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5672bdb5-96e3-4c11-9278-5640249db4b7 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event deleted for resources: {'Port': ['ID=b40e258d-367a-43ed-80aa-4b84b0a0b371,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:39.333525 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5672bdb5-96e3-4c11-9278-5640249db4b7 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:39.340343 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-5672bdb5-96e3-4c11-9278-5640249db4b7 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "DELETE /v2.0/ports/b40e258d-367a-43ed-80aa-4b84b0a0b371 HTTP/1.1" status: 204 len: 168 time: 1.6013553 Nov 09 04:33:39.345057 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57200) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:39.425543 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-edcffb32-6e32-4424-a051-1e56b56f2f1d tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] GET failed (client error): The resource could not be found. Nov 09 04:33:39.425543 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-edcffb32-6e32-4424-a051-1e56b56f2f1d tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "GET /v2.0/ports/b40e258d-367a-43ed-80aa-4b84b0a0b371 HTTP/1.1" status: 404 len: 333 time: 0.0750914 Nov 09 04:33:39.425763 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57202) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:39.447949 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f261c36a-18cd-40ee-a162-e275d0e86b2d tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Router 58a07ef3-0ba3-4f33-84a6-25ab09c0249d is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102161) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:33:39.451117 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b4b3266d-a0ec-487a-9297-9f4eb80ba656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:39.487627 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4b3266d-a0ec-487a-9297-9f4eb80ba656 None None] Pushing event deleted for resources: {'Port': ['ID=16584a2a-1536-465e-85d3-cea284b5c20d,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:39.497382 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b4b3266d-a0ec-487a-9297-9f4eb80ba656 None None] No DVR routers for this DVR port 16584a2a-1536-465e-85d3-cea284b5c20d on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:33:39.512750 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cf5540d-0622-499f-a266-0915fba2ff56 req-65353df9-0d9c-46c1-9562-0482a4be8653 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:39.516597 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7cf5540d-0622-499f-a266-0915fba2ff56 req-65353df9-0d9c-46c1-9562-0482a4be8653 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/ports?device_id=e145337f-88ba-4f6d-a894-39631a8dd013 HTTP/1.1" status: 200 len: 943 time: 0.1908524 Nov 09 04:33:39.540549 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bfad4dad-c634-415f-bb59-336eb231529a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:39.559546 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f261c36a-18cd-40ee-a162-e275d0e86b2d tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:33:39.561583 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6d5c5894-0051-410e-99de-4d26c1b5e6e1 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:39.569455 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f261c36a-18cd-40ee-a162-e275d0e86b2d tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:39.573592 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-f261c36a-18cd-40ee-a162-e275d0e86b2d tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "PUT /v2.0/routers/58a07ef3-0ba3-4f33-84a6-25ab09c0249d HTTP/1.1" status: 200 len: 694 time: 1.4517837 Nov 09 04:33:39.573754 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57204) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:39.578484 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3303fd32-ee8b-428d-ac7c-ca56a1f7fec7 None None] Sync routers for ids ['58a07ef3-0ba3-4f33-84a6-25ab09c0249d'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:33:39.589705 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3303fd32-ee8b-428d-ac7c-ca56a1f7fec7 None None] Routers {'58a07ef3-0ba3-4f33-84a6-25ab09c0249d'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:33:39.592220 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-3303fd32-ee8b-428d-ac7c-ca56a1f7fec7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:33:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['58a07ef3-0ba3-4f33-84a6-25ab09c0249d'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:39.632343 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d5c5894-0051-410e-99de-4d26c1b5e6e1 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Subnet': ['ID=33b5599d-7ebe-4564-9c72-76f5d540fd80,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:39.661172 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d5c5894-0051-410e-99de-4d26c1b5e6e1 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Checking segment: {'id': '7befff96-69ce-4b76-b9cc-7561279d57a7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 313, 'network_id': '239a9c72-6384-4d5a-a69d-f4ac0c580e40'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:33:39.662524 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6d5c5894-0051-410e-99de-4d26c1b5e6e1 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network hostable DHCP agents. Network: 239a9c72-6384-4d5a-a69d-f4ac0c580e40, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:33:39.687086 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-3303fd32-ee8b-428d-ac7c-ca56a1f7fec7 None None] Set router 58a07ef3-0ba3-4f33-84a6-25ab09c0249d gateway port host: None {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:33:39.688258 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bfad4dad-c634-415f-bb59-336eb231529a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:39.725188 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7cf5540d-0622-499f-a266-0915fba2ff56 req-9c0f6bc9-5a46-4d25-9197-f097f3ac2476 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/security-groups?id=8fd0adbd-57c5-4583-8e2d-9a55d7973976&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1871090 Nov 09 04:33:39.739584 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6d5c5894-0051-410e-99de-4d26c1b5e6e1 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network 239a9c72-6384-4d5a-a69d-f4ac0c580e40 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:33:39.740448 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a30d3485-110b-4167-ad88-ae8ba7bbf04c tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "GET /v2.0/routers/58a07ef3-0ba3-4f33-84a6-25ab09c0249d HTTP/1.1" status: 200 len: 700 time: 0.1660907 Nov 09 04:33:39.743264 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57206) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:39.746333 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-3303fd32-ee8b-428d-ac7c-ca56a1f7fec7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '58a07ef3-0ba3-4f33-84a6-25ab09c0249d', 'name': 'tempest-RoutersTest-router-2065159593', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:33:37Z', 'updated_at': '2021-11-09T04:33:38Z', 'revision_number': 2, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'gw_port_host': None}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:39.775322 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3303fd32-ee8b-428d-ac7c-ca56a1f7fec7 None None] Checking router: 58a07ef3-0ba3-4f33-84a6-25ab09c0249d for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:33:39.787975 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3303fd32-ee8b-428d-ac7c-ca56a1f7fec7 None None] Routers {'58a07ef3-0ba3-4f33-84a6-25ab09c0249d'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:33:39.788669 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-3303fd32-ee8b-428d-ac7c-ca56a1f7fec7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:33:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['58a07ef3-0ba3-4f33-84a6-25ab09c0249d'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:39.811708 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.objects.ports [None req-c3d82099-cc2a-48d5-9911-f82e38aafb29 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=102162) get_objects /opt/stack/neutron/neutron/objects/ports.py:444}} Nov 09 04:33:39.813244 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c3d82099-cc2a-48d5-9911-f82e38aafb29 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:39.814102 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-7a85dfee-4e9c-4bc3-b443-61d5bf7e7298 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "GET /v2.0/ports?device_id=58a07ef3-0ba3-4f33-84a6-25ab09c0249d HTTP/1.1" status: 200 len: 205 time: 0.0673933 Nov 09 04:33:39.817806 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57208) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:39.859334 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-6d5c5894-0051-410e-99de-4d26c1b5e6e1 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 239a9c72-6384-4d5a-a69d-f4ac0c580e40) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:33:39.866981 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6d5c5894-0051-410e-99de-4d26c1b5e6e1 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:39.871426 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6d5c5894-0051-410e-99de-4d26c1b5e6e1 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:39.872188 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-3303fd32-ee8b-428d-ac7c-ca56a1f7fec7 None None] Set router 58a07ef3-0ba3-4f33-84a6-25ab09c0249d gateway port host: None {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:33:39.907638 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5d7b1590-cceb-4aa2-9c0e-24057df47a72 None None] Network 239a9c72-6384-4d5a-a69d-f4ac0c580e40 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:33:39.933599 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c3d82099-cc2a-48d5-9911-f82e38aafb29 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:33:39.935825 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bfad4dad-c634-415f-bb59-336eb231529a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:39.938573 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bfad4dad-c634-415f-bb59-336eb231529a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:39.943562 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-bfad4dad-c634-415f-bb59-336eb231529a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "DELETE /v2.0/security-groups/4465f602-8f70-4e4e-9a0b-378809697d53 HTTP/1.1" status: 204 len: 168 time: 0.5131433 Nov 09 04:33:39.943737 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57210) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:39.952938 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-c3d82099-cc2a-48d5-9911-f82e38aafb29 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:33:39.962143 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8f20635c-88e4-40bd-9b1b-c2a9c32f7bf9 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for router, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:39.965790 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c3d82099-cc2a-48d5-9911-f82e38aafb29 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:39.966474 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c3d82099-cc2a-48d5-9911-f82e38aafb29 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:39.975271 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c0f6b3e3-c373-4f45-a084-9be651e86f9b None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:33:39.977335 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-3303fd32-ee8b-428d-ac7c-ca56a1f7fec7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '58a07ef3-0ba3-4f33-84a6-25ab09c0249d', 'name': 'tempest-RoutersTest-router-2065159593', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:33:37Z', 'updated_at': '2021-11-09T04:33:38Z', 'revision_number': 2, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'gw_port_host': None}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:39.985931 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-6d5c5894-0051-410e-99de-4d26c1b5e6e1 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 831 time: 1.8848133 Nov 09 04:33:39.989036 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57212) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:40.002783 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfad4dad-c634-415f-bb59-336eb231529a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=4465f602-8f70-4e4e-9a0b-378809697d53,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:40.041883 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3d82099-cc2a-48d5-9911-f82e38aafb29 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Subnet': ['ID=30e8ddad-4c7a-4044-b33c-077c25c81181,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:40.057176 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device d3617298-af19-45fb-8ddd-9c228bc66aab details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=102163) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 09 04:33:40.068761 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-733f1e6e-9b85-4033-842e-0f0509fda049 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:40.071313 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3303fd32-ee8b-428d-ac7c-ca56a1f7fec7 None None] The sync data for ids ['58a07ef3-0ba3-4f33-84a6-25ab09c0249d'] in dv-neutron-816802-2-hyperv is: [{'id': '58a07ef3-0ba3-4f33-84a6-25ab09c0249d', 'name': 'tempest-RoutersTest-router-2065159593', 'tenant_id': '188f23ef0cb54006875c672b78f5249f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:33:37Z', 'updated_at': '2021-11-09T04:33:38Z', 'revision_number': 2, 'project_id': '188f23ef0cb54006875c672b78f5249f', 'gw_port_host': None}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:33:40.138397 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-733f1e6e-9b85-4033-842e-0f0509fda049 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:40.154674 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-c3d82099-cc2a-48d5-9911-f82e38aafb29 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 824 time: 1.2690372 Nov 09 04:33:40.161201 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57214) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:40.221167 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-19716762-b560-47cb-9681-eb750d6584fa tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'port': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'mac_address': 'fa:16:3e:e0:af:2d', 'name': 'tempest-NetworksTestDHCPv6-1869179324'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:40.247038 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8f20635c-88e4-40bd-9b1b-c2a9c32f7bf9 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:40.258460 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8f20635c-88e4-40bd-9b1b-c2a9c32f7bf9 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:40.347012 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-733f1e6e-9b85-4033-842e-0f0509fda049 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:40.350573 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-733f1e6e-9b85-4033-842e-0f0509fda049 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:40.351751 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-733f1e6e-9b85-4033-842e-0f0509fda049 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "DELETE /v2.0/security-groups/9e2eb020-1be7-41c8-959e-ea68d2b8ad84 HTTP/1.1" status: 204 len: 168 time: 0.4076769 Nov 09 04:33:40.354505 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57218) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:40.366700 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-733f1e6e-9b85-4033-842e-0f0509fda049 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=9e2eb020-1be7-41c8-959e-ea68d2b8ad84,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:40.396689 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34039c37-6b09-4038-899d-bcfde70357fa req-feb79cef-534e-41ca-9849-f64f39272f00 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:40.398307 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-34039c37-6b09-4038-899d-bcfde70357fa req-feb79cef-534e-41ca-9849-f64f39272f00 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 945 time: 0.1390538 Nov 09 04:33:40.419356 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8f20635c-88e4-40bd-9b1b-c2a9c32f7bf9 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:40.419857 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8f20635c-88e4-40bd-9b1b-c2a9c32f7bf9 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Fanout notify agent at l3_agent the message router_deleted on router 58a07ef3-0ba3-4f33-84a6-25ab09c0249d {{(pid=102162) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:33:40.433217 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8f20635c-88e4-40bd-9b1b-c2a9c32f7bf9 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:40.434712 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-8f20635c-88e4-40bd-9b1b-c2a9c32f7bf9 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "DELETE /v2.0/routers/58a07ef3-0ba3-4f33-84a6-25ab09c0249d HTTP/1.1" status: 204 len: 168 time: 0.6123474 Nov 09 04:33:40.440704 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57220) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:40.458911 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-47964e72-7e19-4413-bcb1-d8465d7015ec tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Deleting subnet 315097f5-620a-4aee-bad3-44a6cf15bd6d {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:33:40.477334 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-47964e72-7e19-4413-bcb1-d8465d7015ec tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:40.482857 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port d3617298-af19-45fb-8ddd-9c228bc66aab, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=d3617298-af19-45fb-8ddd-9c228bc66aab,segment=NetworkSegment(63a401e5-97f0-4f3a-b762-8fc66b1b215f),segment_id=63a401e5-97f0-4f3a-b762-8fc66b1b215f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:33:40.486537 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-c701a0ab-a2ca-486b-9b02-0fdbf7d97b06 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "GET /v2.0/ports?device_id=58a07ef3-0ba3-4f33-84a6-25ab09c0249d HTTP/1.1" status: 200 len: 205 time: 0.0426731 Nov 09 04:33:40.489257 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57222) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:40.508818 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a57eec3f-e986-456b-a48d-790be6c4aef0 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-988d2354-693c-4d52-af17-25e0643eaa0c', 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'tenant_id': '8b0758f781884982bf5b94e6609237f6', 'fixed_ips': [{'subnet_id': '30e8ddad-4c7a-4044-b33c-077c25c81181'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:33:40.509878 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a57eec3f-e986-456b-a48d-790be6c4aef0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:40.531470 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-47964e72-7e19-4413-bcb1-d8465d7015ec tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:40.534191 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Returning: {'device': 'd3617298-af19-45fb-8ddd-9c228bc66aab', 'network_id': '10e5206a-1d3b-409b-a3ee-0f6a311d6819', 'port_id': 'd3617298-af19-45fb-8ddd-9c228bc66aab', 'mac_address': 'fa:16:3e:02:05:43', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 333, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '73ee2bd1-c2b2-478f-96c9-301b99515bfe', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102163) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 09 04:33:40.536605 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b3367032-3c19-404a-8a6d-286c880aff0f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-239a9c72-6384-4d5a-a69d-f4ac0c580e40', 'network_id': '239a9c72-6384-4d5a-a69d-f4ac0c580e40', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ips': [{'subnet_id': '33b5599d-7ebe-4564-9c72-76f5d540fd80'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:33:40.537512 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b3367032-3c19-404a-8a6d-286c880aff0f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:40.556986 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-14a5fab6-0f62-46f4-948c-757db3b8b961 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] delete failed (client error): The resource could not be found. Nov 09 04:33:40.560377 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-14a5fab6-0f62-46f4-948c-757db3b8b961 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "DELETE /v2.0/routers/58a07ef3-0ba3-4f33-84a6-25ab09c0249d HTTP/1.1" status: 404 len: 336 time: 0.0699055 Nov 09 04:33:40.566326 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57224) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:40.594774 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-19716762-b560-47cb-9681-eb750d6584fa tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:33:40.596106 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-b08b8bf7-8b9c-4f70-af92-05d97e367ccb tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] DELETE failed (client error): The resource could not be found. Nov 09 04:33:40.597082 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b08b8bf7-8b9c-4f70-af92-05d97e367ccb tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:33:40.603274 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-b08b8bf7-8b9c-4f70-af92-05d97e367ccb tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "DELETE /v2.0/subnets/abf2dc1a-091f-4460-a83f-5c4275733a2f HTTP/1.1" status: 404 len: 337 time: 0.0391693 Nov 09 04:33:40.603418 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-34039c37-6b09-4038-899d-bcfde70357fa req-bcee85e1-be22-4422-8528-f9519f88adf6 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1930068 Nov 09 04:33:40.603537 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57226) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:40.664245 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:40.668104 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-e86ce6ce-66bb-4234-92c4-7fa17b5bb6a0 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] DELETE failed (client error): The resource could not be found. Nov 09 04:33:40.668914 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e86ce6ce-66bb-4234-92c4-7fa17b5bb6a0 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:33:40.674759 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-e86ce6ce-66bb-4234-92c4-7fa17b5bb6a0 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "DELETE /v2.0/subnets/d7a7c5ae-922f-4fe2-ad19-b31fd352c9d1 HTTP/1.1" status: 404 len: 337 time: 0.0602067 Nov 09 04:33:40.676884 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57228) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:40.700351 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-19716762-b560-47cb-9681-eb750d6584fa tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:40.721185 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-8f4ec338-b6c0-41d3-b326-8e084b6c219a tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] DELETE failed (client error): The resource could not be found. Nov 09 04:33:40.721940 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-8f4ec338-b6c0-41d3-b326-8e084b6c219a tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:33:40.728405 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-8f4ec338-b6c0-41d3-b326-8e084b6c219a tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "DELETE /v2.0/subnets/f0939bd8-617d-4f5c-9f7b-272de792edac HTTP/1.1" status: 404 len: 337 time: 0.0501266 Nov 09 04:33:40.729137 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57230) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:40.752161 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d3617298-af19-45fb-8ddd-9c228bc66aab {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:33:40.754861 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [None req-19716762-b560-47cb-9681-eb750d6584fa tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] device_id is not set on port 5b9cc4cb-652d-459a-b84b-786da879bd9b yet. {{(pid=102162) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:33:40.761840 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 49bff53a-c208-4aa5-8fcc-e7ec9471fae7 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:33:40.775194 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-5cfb9509-04c2-47db-ad88-e412e81369b0 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] DELETE failed (client error): The resource could not be found. Nov 09 04:33:40.775733 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5cfb9509-04c2-47db-ad88-e412e81369b0 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:33:40.781400 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-5cfb9509-04c2-47db-ad88-e412e81369b0 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "DELETE /v2.0/subnets/f60d3eec-6988-47b0-9f2f-6319fa99064d HTTP/1.1" status: 404 len: 337 time: 0.0492136 Nov 09 04:33:40.781971 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57234) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:40.803752 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-47964e72-7e19-4413-bcb1-d8465d7015ec tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:40.840183 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-50d110df-ba22-491e-9f03-636fa4897fbf tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "GET /v2.0/ports?device_id=fa30d24d-d721-4675-ad7b-09f35105e633 HTTP/1.1" status: 200 len: 205 time: 0.0548906 Nov 09 04:33:40.841350 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57236) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:40.868668 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port d3617298-af19-45fb-8ddd-9c228bc66aab, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=d3617298-af19-45fb-8ddd-9c228bc66aab,segment=NetworkSegment(63a401e5-97f0-4f3a-b762-8fc66b1b215f),segment_id=63a401e5-97f0-4f3a-b762-8fc66b1b215f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:33:40.895704 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-a57eec3f-e986-456b-a48d-790be6c4aef0 None None] Allocated IP 2001:db8::f816:3eff:fe2b:f3f5 (988d2354-693c-4d52-af17-25e0643eaa0c/30e8ddad-4c7a-4044-b33c-077c25c81181/07d6da7e-6539-4f5d-9797-da4ea907282b) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:33:40.906140 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.api.v2.resource [None req-d2407999-fb9d-4a10-ad74-8b5c60bc8fd3 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] delete failed (client error): The resource could not be found. Nov 09 04:33:40.909814 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-d2407999-fb9d-4a10-ad74-8b5c60bc8fd3 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "DELETE /v2.0/routers/fa30d24d-d721-4675-ad7b-09f35105e633 HTTP/1.1" status: 404 len: 336 time: 0.0627289 Nov 09 04:33:40.910346 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57240) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:40.939402 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:40.947612 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-15b372e3-90f9-4c3d-ac48-9468af252ef9 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "GET /v2.0/ports?device_id=6b62cf76-7264-405c-b119-c70d950c1388 HTTP/1.1" status: 200 len: 205 time: 0.0343201 Nov 09 04:33:40.948124 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57242) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:40.994415 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-615ed528-8160-4659-9b4c-4596f4b9db1e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:41.018116 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.api.v2.resource [None req-a19ea6ce-e5bd-4f2e-a18a-6765d96ea21e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] delete failed (client error): The resource could not be found. Nov 09 04:33:41.019699 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a19ea6ce-e5bd-4f2e-a18a-6765d96ea21e tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "DELETE /v2.0/routers/6b62cf76-7264-405c-b119-c70d950c1388 HTTP/1.1" status: 404 len: 336 time: 0.0707216 Nov 09 04:33:41.022714 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57244) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:41.034190 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-47964e72-7e19-4413-bcb1-d8465d7015ec tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:41.039421 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-b3367032-3c19-404a-8a6d-286c880aff0f None None] Allocated IP 172.20.0.2 (239a9c72-6384-4d5a-a69d-f4ac0c580e40/33b5599d-7ebe-4564-9c72-76f5d540fd80/0c829017-1d45-4280-bb1e-aecb67547f76) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:33:41.077149 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-47964e72-7e19-4413-bcb1-d8465d7015ec tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:41.081698 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-47964e72-7e19-4413-bcb1-d8465d7015ec tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "DELETE /v2.0/subnets/315097f5-620a-4aee-bad3-44a6cf15bd6d HTTP/1.1" status: 204 len: 168 time: 0.7259181 Nov 09 04:33:41.087015 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57246) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:41.087424 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-9c8a4a15-a5d2-4d9a-888c-260c749567e4 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] DELETE failed (client error): The resource could not be found. Nov 09 04:33:41.088205 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9c8a4a15-a5d2-4d9a-888c-260c749567e4 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:33:41.091977 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-9c8a4a15-a5d2-4d9a-888c-260c749567e4 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "DELETE /v2.0/subnets/adf8b20e-473c-44ad-9d34-b1b2c888a296 HTTP/1.1" status: 404 len: 337 time: 0.0681441 Nov 09 04:33:41.097247 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1ab8b558-5ec1-41f5-83ce-cc2818e1760b None None] Network 002d27a0-2fb8-4426-9550-42c444556a8e requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:33:41.106108 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 49bff53a-c208-4aa5-8fcc-e7ec9471fae7 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:41.106523 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:41.121880 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=d3617298-af19-45fb-8ddd-9c228bc66aab,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:41.129731 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-f4b5cc1f-760d-48f0-bbb1-892364e38435 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Request body: {'subnet': {'network_id': '002d27a0-2fb8-4426-9550-42c444556a8e', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:41.129731 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57248) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:41.130003 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47964e72-7e19-4413-bcb1-d8465d7015ec tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event deleted for resources: {'Subnet': ['ID=315097f5-620a-4aee-bad3-44a6cf15bd6d,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:41.176401 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8b7cb20-1102-419d-a90d-4f8d44000a5c req-5c30298c-1b04-4059-a243-08a278ea29b8 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:41.177581 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['d3617298-af19-45fb-8ddd-9c228bc66aab'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 04:33:41.178291 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b8b7cb20-1102-419d-a90d-4f8d44000a5c req-5c30298c-1b04-4059-a243-08a278ea29b8 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/ports?device_id=e145337f-88ba-4f6d-a894-39631a8dd013 HTTP/1.1" status: 200 len: 944 time: 0.2869751 Nov 09 04:33:41.204089 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-9cf0b96f-c4b9-4a09-86ab-ec6014e7c0ab tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "GET /v2.0/ports?device_id=215e107d-c97d-47d2-b086-7c223276dc25 HTTP/1.1" status: 200 len: 205 time: 0.0701239 Nov 09 04:33:41.204851 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57250) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:41.247150 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.api.v2.resource [None req-0d0f2d4a-5061-4117-8657-e1abb62e8ff1 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] delete failed (client error): The resource could not be found. Nov 09 04:33:41.248427 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-0d0f2d4a-5061-4117-8657-e1abb62e8ff1 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "DELETE /v2.0/routers/215e107d-c97d-47d2-b086-7c223276dc25 HTTP/1.1" status: 404 len: 336 time: 0.0427549 Nov 09 04:33:41.251060 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57252) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:41.305122 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-084edc7a-2ba7-4862-8481-9e03f7ba9ce8 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "GET /v2.0/ports?device_id=cdc40031-5d8e-4301-8c14-526915537ddc HTTP/1.1" status: 200 len: 205 time: 0.0449054 Nov 09 04:33:41.306656 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b8b7cb20-1102-419d-a90d-4f8d44000a5c req-fe57076f-1544-4fbe-8f31-01aa453cf55f tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/security-groups?id=8fd0adbd-57c5-4583-8e2d-9a55d7973976&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1220744 Nov 09 04:33:41.307235 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57254) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:41.349561 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.api.v2.resource [None req-7230719a-020b-43f3-a28b-05a56c2c500a tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] delete failed (client error): The resource could not be found. Nov 09 04:33:41.353044 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-7230719a-020b-43f3-a28b-05a56c2c500a tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "DELETE /v2.0/routers/cdc40031-5d8e-4301-8c14-526915537ddc HTTP/1.1" status: 404 len: 336 time: 0.0425291 Nov 09 04:33:41.353408 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57256) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:41.383479 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-8442c9c1-adde-4b7f-97b1-f224e50fa370 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] DELETE failed (client error): The resource could not be found. Nov 09 04:33:41.383959 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-8442c9c1-adde-4b7f-97b1-f224e50fa370 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:33:41.390473 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-8442c9c1-adde-4b7f-97b1-f224e50fa370 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "DELETE /v2.0/subnets/10a26071-6216-4b65-b6b6-f23700b8dbf0 HTTP/1.1" status: 404 len: 337 time: 0.0336130 Nov 09 04:33:41.391254 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57258) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:41.430639 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-3cb3b080-af6a-4144-82f4-de16fa5a199f tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "GET /v2.0/ports?device_id=b8b1c097-8cb2-4caa-bfe4-9e8b15227604 HTTP/1.1" status: 200 len: 205 time: 0.0312777 Nov 09 04:33:41.431437 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57260) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:41.474248 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.api.v2.resource [None req-466123fe-9127-4a82-87d1-ea35e7632e19 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] delete failed (client error): The resource could not be found. Nov 09 04:33:41.475329 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-466123fe-9127-4a82-87d1-ea35e7632e19 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "DELETE /v2.0/routers/b8b1c097-8cb2-4caa-bfe4-9e8b15227604 HTTP/1.1" status: 404 len: 336 time: 0.0427442 Nov 09 04:33:41.477995 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57262) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:41.493000 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f4b5cc1f-760d-48f0-bbb1-892364e38435 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Made reservation on behalf of 12e47d8445b5429892cd1b9244512ca8 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:33:41.497379 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f4b5cc1f-760d-48f0-bbb1-892364e38435 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:41.507570 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-3dc629e8-f4c4-4621-a2d8-b64d1623e608 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] DELETE failed (client error): The resource could not be found. Nov 09 04:33:41.508166 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-3dc629e8-f4c4-4621-a2d8-b64d1623e608 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:33:41.513926 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-3dc629e8-f4c4-4621-a2d8-b64d1623e608 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "DELETE /v2.0/subnets/4b3485de-3625-4aed-aab6-5ac993d0f4c3 HTTP/1.1" status: 404 len: 337 time: 0.0325875 Nov 09 04:33:41.514224 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57264) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:41.542399 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-496ebbf5-e45d-44e6-af89-984b496b15bb tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "GET /v2.0/ports?device_id=3a5287b2-31f6-4415-beea-0718ba71be47 HTTP/1.1" status: 200 len: 205 time: 0.0261188 Nov 09 04:33:41.550585 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57266) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:41.565383 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c1c80833-9075-4fcf-ba53-167607972b3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:41.633773 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a57eec3f-e986-456b-a48d-790be6c4aef0 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:41.725114 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a57eec3f-e986-456b-a48d-790be6c4aef0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:41.812105 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdfddd30-ff91-4941-ab6a-c8b3db38364f req-18108868-89b5-487b-83ce-1f4d2d5c9331 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:41.814876 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-fdfddd30-ff91-4941-ab6a-c8b3db38364f req-18108868-89b5-487b-83ce-1f4d2d5c9331 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 945 time: 0.0685866 Nov 09 04:33:41.821079 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:41.827589 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a57eec3f-e986-456b-a48d-790be6c4aef0 None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:33:41.858576 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b3367032-3c19-404a-8a6d-286c880aff0f None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:41.860945 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-a57eec3f-e986-456b-a48d-790be6c4aef0 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:33:41.875825 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a57eec3f-e986-456b-a48d-790be6c4aef0 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:33:41.897336 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a57eec3f-e986-456b-a48d-790be6c4aef0 None None] Pushing event updated for resources: {'Port': ['ID=07d6da7e-6539-4f5d-9797-da4ea907282b,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:41.914049 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 49bff53a-c208-4aa5-8fcc-e7ec9471fae7, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=49bff53a-c208-4aa5-8fcc-e7ec9471fae7,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:33:41.916747 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-fdfddd30-ff91-4941-ab6a-c8b3db38364f req-550410ff-6ea1-4384-8489-e94a690a0067 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0824013 Nov 09 04:33:41.946867 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f4b5cc1f-760d-48f0-bbb1-892364e38435 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:41.960535 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.api.v2.resource [None req-c9d2b700-5103-4c93-9da1-2b3cca6b76cd tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] delete failed (client error): The resource could not be found. Nov 09 04:33:41.963933 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-c9d2b700-5103-4c93-9da1-2b3cca6b76cd tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "DELETE /v2.0/routers/3a5287b2-31f6-4415-beea-0718ba71be47 HTTP/1.1" status: 404 len: 336 time: 0.4094129 Nov 09 04:33:41.979178 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57270) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:41.985374 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b3367032-3c19-404a-8a6d-286c880aff0f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:42.011505 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-e16970c9-10ca-4ac6-8e10-54919cfb12d0 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] DELETE failed (client error): The resource could not be found. Nov 09 04:33:42.011670 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e16970c9-10ca-4ac6-8e10-54919cfb12d0 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:33:42.016069 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e16970c9-10ca-4ac6-8e10-54919cfb12d0 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "DELETE /v2.0/subnets/46e2a34a-c423-454a-a4ea-0bc78ae2ec41 HTTP/1.1" status: 404 len: 337 time: 0.0358093 Nov 09 04:33:42.018730 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57272) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:42.058119 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:42.060489 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-7cba2e3c-9048-4fab-aa7d-afd8c31096c0 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] DELETE failed (client error): The resource could not be found. Nov 09 04:33:42.060958 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-7cba2e3c-9048-4fab-aa7d-afd8c31096c0 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:33:42.068405 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-7cba2e3c-9048-4fab-aa7d-afd8c31096c0 tempest-RoutersTest-1674599313 tempest-RoutersTest-1674599313-project] 10.222.0.24 "DELETE /v2.0/subnets/91be2814-c9e6-41c8-8b39-591a057bbda9 HTTP/1.1" status: 404 len: 337 time: 0.0449419 Nov 09 04:33:42.068512 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-a57eec3f-e986-456b-a48d-790be6c4aef0 None None] Attempting to bind port 07d6da7e-6539-4f5d-9797-da4ea907282b on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:33:42.068512 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-a57eec3f-e986-456b-a48d-790be6c4aef0 None None] Attempting to bind port 07d6da7e-6539-4f5d-9797-da4ea907282b by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:33:42.078193 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-19716762-b560-47cb-9681-eb750d6584fa tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Allocated IP 2001:db8::f816:3eff:fee0:af2d (988d2354-693c-4d52-af17-25e0643eaa0c/30e8ddad-4c7a-4044-b33c-077c25c81181/5b9cc4cb-652d-459a-b84b-786da879bd9b) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:33:42.082451 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a57eec3f-e986-456b-a48d-790be6c4aef0 None None] Attempting to bind port 07d6da7e-6539-4f5d-9797-da4ea907282b on network 988d2354-693c-4d52-af17-25e0643eaa0c {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:33:42.085770 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4b5cc1f-760d-48f0-bbb1-892364e38435 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event updated for resources: {'Subnet': ['ID=35a4ba3b-99b7-4b1f-9549-2fc042f492d9,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:42.109005 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f4b5cc1f-760d-48f0-bbb1-892364e38435 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Network 002d27a0-2fb8-4426-9550-42c444556a8e is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:33:42.119588 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-f4b5cc1f-760d-48f0-bbb1-892364e38435 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:33:42.124795 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f4b5cc1f-760d-48f0-bbb1-892364e38435 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:42.125560 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f4b5cc1f-760d-48f0-bbb1-892364e38435 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:42.134217 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b3367032-3c19-404a-8a6d-286c880aff0f None None] Network 239a9c72-6384-4d5a-a69d-f4ac0c580e40 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:33:42.164719 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a57eec3f-e986-456b-a48d-790be6c4aef0 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 33, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:33:42.165099 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a57eec3f-e986-456b-a48d-790be6c4aef0 None None] Checking segment: {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:33:42.176546 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a57eec3f-e986-456b-a48d-790be6c4aef0 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:42.176704 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-615ed528-8160-4659-9b4c-4596f4b9db1e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Allocated IP 172.20.0.1 (239a9c72-6384-4d5a-a69d-f4ac0c580e40/33b5599d-7ebe-4564-9c72-76f5d540fd80/9930d582-2262-4f1d-97bf-b02697a70777) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:33:42.180870 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a57eec3f-e986-456b-a48d-790be6c4aef0 None None] Bound using segment: {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:33:42.181502 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-a57eec3f-e986-456b-a48d-790be6c4aef0 None None] Bound port: 07d6da7e-6539-4f5d-9797-da4ea907282b, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:33:42.181979 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a57eec3f-e986-456b-a48d-790be6c4aef0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:42.184325 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-b3367032-3c19-404a-8a6d-286c880aff0f None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:33:42.212540 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 16584a2a-1536-465e-85d3-cea284b5c20d no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:33:42.212540 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3367032-3c19-404a-8a6d-286c880aff0f None None] Pushing event updated for resources: {'Port': ['ID=0c829017-1d45-4280-bb1e-aecb67547f76,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:42.214839 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b3367032-3c19-404a-8a6d-286c880aff0f None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:33:42.271476 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:42.289058 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 16584a2a-1536-465e-85d3-cea284b5c20d {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:33:42.293726 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 16584a2a-1536-465e-85d3-cea284b5c20d not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:33:42.302219 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-f4b5cc1f-760d-48f0-bbb1-892364e38435 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.1811540 Nov 09 04:33:42.302774 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57276) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:42.314604 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-499be7e4-d4f0-465e-8976-ef196ff1bcec tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Request body: {'security_group': {'name': 'tempest-secgroup-714489730'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:42.337392 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-19716762-b560-47cb-9681-eb750d6584fa tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:42.399989 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-b3367032-3c19-404a-8a6d-286c880aff0f None None] Attempting to bind port 0c829017-1d45-4280-bb1e-aecb67547f76 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:33:42.400713 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-b3367032-3c19-404a-8a6d-286c880aff0f None None] Attempting to bind port 0c829017-1d45-4280-bb1e-aecb67547f76 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '7befff96-69ce-4b76-b9cc-7561279d57a7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 313, 'network_id': '239a9c72-6384-4d5a-a69d-f4ac0c580e40'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:33:42.401251 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b3367032-3c19-404a-8a6d-286c880aff0f None None] Attempting to bind port 0c829017-1d45-4280-bb1e-aecb67547f76 on network 239a9c72-6384-4d5a-a69d-f4ac0c580e40 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:33:42.408848 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-615ed528-8160-4659-9b4c-4596f4b9db1e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:42.425189 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b3367032-3c19-404a-8a6d-286c880aff0f None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 33, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:33:42.425865 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b3367032-3c19-404a-8a6d-286c880aff0f None None] Checking segment: {'id': '7befff96-69ce-4b76-b9cc-7561279d57a7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 313, 'network_id': '239a9c72-6384-4d5a-a69d-f4ac0c580e40'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:33:42.426828 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b3367032-3c19-404a-8a6d-286c880aff0f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:42.427225 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b3367032-3c19-404a-8a6d-286c880aff0f None None] Bound using segment: {'id': '7befff96-69ce-4b76-b9cc-7561279d57a7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 313, 'network_id': '239a9c72-6384-4d5a-a69d-f4ac0c580e40'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:33:42.427707 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-b3367032-3c19-404a-8a6d-286c880aff0f None None] Bound port: 0c829017-1d45-4280-bb1e-aecb67547f76, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7befff96-69ce-4b76-b9cc-7561279d57a7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 313, 'network_id': '239a9c72-6384-4d5a-a69d-f4ac0c580e40'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:33:42.428147 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b3367032-3c19-404a-8a6d-286c880aff0f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:42.437097 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-499be7e4-d4f0-465e-8976-ef196ff1bcec tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:42.445588 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=49bff53a-c208-4aa5-8fcc-e7ec9471fae7,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:42.491610 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-a57eec3f-e986-456b-a48d-790be6c4aef0 None None] For port 07d6da7e-6539-4f5d-9797-da4ea907282b, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:33:42.505096 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-a57eec3f-e986-456b-a48d-790be6c4aef0 None None] For port 07d6da7e-6539-4f5d-9797-da4ea907282b, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=07d6da7e-6539-4f5d-9797-da4ea907282b,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:33:42.535773 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-499be7e4-d4f0-465e-8976-ef196ff1bcec tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:42.543573 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-245b06ff-abd6-459b-a99d-879215b04203 req-d62a73dc-bfdd-4ac0-a6e6-b2dc9e229004 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:42.545679 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-245b06ff-abd6-459b-a99d-879215b04203 req-d62a73dc-bfdd-4ac0-a6e6-b2dc9e229004 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/ports?device_id=e145337f-88ba-4f6d-a894-39631a8dd013 HTTP/1.1" status: 200 len: 944 time: 0.1065791 Nov 09 04:33:42.547383 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-19716762-b560-47cb-9681-eb750d6584fa tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:42.555994 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-b3367032-3c19-404a-8a6d-286c880aff0f None None] For port 0c829017-1d45-4280-bb1e-aecb67547f76, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:33:42.562638 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-b3367032-3c19-404a-8a6d-286c880aff0f None None] For port 0c829017-1d45-4280-bb1e-aecb67547f76, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=0c829017-1d45-4280-bb1e-aecb67547f76,segment=NetworkSegment(7befff96-69ce-4b76-b9cc-7561279d57a7),segment_id=7befff96-69ce-4b76-b9cc-7561279d57a7)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:33:42.615449 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-19716762-b560-47cb-9681-eb750d6584fa tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:33:42.619618 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-615ed528-8160-4659-9b4c-4596f4b9db1e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:42.639707 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-19716762-b560-47cb-9681-eb750d6584fa tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:33:42.643927 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-19716762-b560-47cb-9681-eb750d6584fa tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:33:42.648826 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 49bff53a-c208-4aa5-8fcc-e7ec9471fae7 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:33:42.650573 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-19716762-b560-47cb-9681-eb750d6584fa tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:42.651233 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-19716762-b560-47cb-9681-eb750d6584fa tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:42.656784 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a57eec3f-e986-456b-a48d-790be6c4aef0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:42.659487 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b3367032-3c19-404a-8a6d-286c880aff0f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:42.668271 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19716762-b560-47cb-9681-eb750d6584fa tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Port': ['ID=5b9cc4cb-652d-459a-b84b-786da879bd9b,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:42.695061 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-245b06ff-abd6-459b-a99d-879215b04203 req-a3b31dc1-0b86-44a4-a99a-eb7c339a4fc4 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/security-groups?id=8fd0adbd-57c5-4583-8e2d-9a55d7973976&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1379530 Nov 09 04:33:42.695812 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-499be7e4-d4f0-465e-8976-ef196ff1bcec tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:42.714731 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-615ed528-8160-4659-9b4c-4596f4b9db1e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Port': ['ID=9930d582-2262-4f1d-97bf-b02697a70777,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:42.723651 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-615ed528-8160-4659-9b4c-4596f4b9db1e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network 239a9c72-6384-4d5a-a69d-f4ac0c580e40 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:33:42.731096 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-615ed528-8160-4659-9b4c-4596f4b9db1e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:33:42.740047 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-19716762-b560-47cb-9681-eb750d6584fa tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 948 time: 2.5739908 Nov 09 04:33:42.742187 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57284) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:42.766392 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-499be7e4-d4f0-465e-8976-ef196ff1bcec tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f74c848a-351e-49f1-bf42-2cd07cefe6f9,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:42.772256 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-615ed528-8160-4659-9b4c-4596f4b9db1e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:33:42.779858 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-499be7e4-d4f0-465e-8976-ef196ff1bcec tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:42.781122 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-499be7e4-d4f0-465e-8976-ef196ff1bcec tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1759 time: 0.4770126 Nov 09 04:33:42.787542 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57286) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:42.809584 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-bff09af3-8a0c-4037-b335-5ea24c03e93d tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Request body: {'security_group': {'name': 'tempest-secgroup-418609303'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:42.818072 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57288) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:42.834325 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a57eec3f-e986-456b-a48d-790be6c4aef0 None None] Pushing event updated for resources: {'Port': ['ID=07d6da7e-6539-4f5d-9797-da4ea907282b,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:42.884070 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 49bff53a-c208-4aa5-8fcc-e7ec9471fae7 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:42.884444 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:42.914856 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-615ed528-8160-4659-9b4c-4596f4b9db1e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:42.925315 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6d021400-8cf7-46db-b2f0-db94dd7b1ad4 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:42.931847 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6d021400-8cf7-46db-b2f0-db94dd7b1ad4 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:42.933523 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-6d021400-8cf7-46db-b2f0-db94dd7b1ad4 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1703 time: 0.1921327 Nov 09 04:33:42.936299 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57294) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:42.960154 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d67326f3-8d00-4a5f-87f3-5e1a42dfc051 None None] Network 002d27a0-2fb8-4426-9550-42c444556a8e requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:33:42.980208 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3367032-3c19-404a-8a6d-286c880aff0f None None] Pushing event updated for resources: {'Port': ['ID=0c829017-1d45-4280-bb1e-aecb67547f76,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:43.003859 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bff09af3-8a0c-4037-b335-5ea24c03e93d tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:43.197777 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-de69850e-8e8c-4a5c-8942-e6712179b2c0 None None] Provisioning complete for port c315ee21-870f-44c3-b604-c4eb34ea288a triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:43.198772 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-de69850e-8e8c-4a5c-8942-e6712179b2c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:43.201136 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-209f61cc-ea6a-431e-ae44-0186fc54b5c1 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=188f23ef0cb54006875c672b78f5249f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3829033 Nov 09 04:33:43.206262 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57298) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:43.208524 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-615ed528-8160-4659-9b4c-4596f4b9db1e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:43.376629 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bff09af3-8a0c-4037-b335-5ea24c03e93d tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:43.392437 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-098ac1b6-cc5a-4eb6-a899-adb061ed3650 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Deleting port 5b9cc4cb-652d-459a-b84b-786da879bd9b {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:33:43.393042 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-098ac1b6-cc5a-4eb6-a899-adb061ed3650 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:43.396777 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ddf7fac7-ec1b-4fb0-a1f3-410574614e98 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:43.428876 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ddf7fac7-ec1b-4fb0-a1f3-410574614e98 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:43.487964 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bff09af3-8a0c-4037-b335-5ea24c03e93d tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:43.498237 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0cbb9e4-e416-4cc8-8244-436a771040d8 req-698d0dc6-dd9a-4dba-af9d-ef40af8fbfd2 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:43.499814 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d0cbb9e4-e416-4cc8-8244-436a771040d8 req-698d0dc6-dd9a-4dba-af9d-ef40af8fbfd2 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 945 time: 0.4454224 Nov 09 04:33:43.516562 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-de69850e-8e8c-4a5c-8942-e6712179b2c0 None None] Provisioning complete for port 77290ebd-f244-4a68-94af-4d033c4a6349 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:43.516890 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-de69850e-8e8c-4a5c-8942-e6712179b2c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:43.564818 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-de69850e-8e8c-4a5c-8942-e6712179b2c0 None None] Port 77290ebd-f244-4a68-94af-4d033c4a6349 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:33:43.568218 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bff09af3-8a0c-4037-b335-5ea24c03e93d tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event updated for resources: {'SecurityGroup': ['ID=0747fda9-7fb9-4f58-9f75-ef05efa51913,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:43.588730 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-098ac1b6-cc5a-4eb6-a899-adb061ed3650 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:43.605613 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-098ac1b6-cc5a-4eb6-a899-adb061ed3650 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Calling delete_port for 5b9cc4cb-652d-459a-b84b-786da879bd9b owned by {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:33:43.627828 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d0cbb9e4-e416-4cc8-8244-436a771040d8 req-f6cb6425-846d-46d1-8b41-fab51ef0210e tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1185977 Nov 09 04:33:43.658995 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-425b6920-0d97-4bd5-a619-aba859bd0ec4 None None] Update dhcp port {'port': {'network_id': '002d27a0-2fb8-4426-9550-42c444556a8e', 'fixed_ips': [{'subnet_id': 'df5c0c2e-73f1-4f11-bae4-c9e63a6467fc', 'ip_address': '2001:db8:0:1::2'}, {'subnet_id': '35a4ba3b-99b7-4b1f-9549-2fc042f492d9'}], 'binding:host_id': 'dv-neutron-816802-2-hyperv'}, 'id': 'c315ee21-870f-44c3-b604-c4eb34ea288a'} from dv-neutron-816802-2-hyperv. {{(pid=102163) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:328}} Nov 09 04:33:43.664678 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bff09af3-8a0c-4037-b335-5ea24c03e93d tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:43.666801 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-bff09af3-8a0c-4037-b335-5ea24c03e93d tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1759 time: 0.8737049 Nov 09 04:33:43.669443 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57300) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:43.674078 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-1dc92ca9-a0ef-4a6e-bab3-1735e551ec7a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Request body: {'security_group': {'name': 'tempest-secgroup-577715461'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:43.691111 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-425b6920-0d97-4bd5-a619-aba859bd0ec4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:43.703438 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-615ed528-8160-4659-9b4c-4596f4b9db1e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:43.712957 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ddf7fac7-ec1b-4fb0-a1f3-410574614e98 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:43.712957 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ddf7fac7-ec1b-4fb0-a1f3-410574614e98 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:43.712957 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-ddf7fac7-ec1b-4fb0-a1f3-410574614e98 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/7280840c-7ed6-415f-a063-64e6385482d1 HTTP/1.1" status: 204 len: 168 time: 0.4990475 Nov 09 04:33:43.723585 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddf7fac7-ec1b-4fb0-a1f3-410574614e98 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7280840c-7ed6-415f-a063-64e6385482d1,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:43.737946 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-756f4be6-d4f4-4b78-bcf2-d0fb87830f18 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:43.785022 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-615ed528-8160-4659-9b4c-4596f4b9db1e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:43.836542 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1dc92ca9-a0ef-4a6e-bab3-1735e551ec7a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:43.883997 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-615ed528-8160-4659-9b4c-4596f4b9db1e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:43.893822 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-615ed528-8160-4659-9b4c-4596f4b9db1e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Port': ['ID=9930d582-2262-4f1d-97bf-b02697a70777,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:43.921907 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-425b6920-0d97-4bd5-a619-aba859bd0ec4 None None] Allocated IP 2001:db8::2 (002d27a0-2fb8-4426-9550-42c444556a8e/35a4ba3b-99b7-4b1f-9549-2fc042f492d9/c315ee21-870f-44c3-b604-c4eb34ea288a) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:33:43.931256 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7212d9cc-5bb1-40a2-aa99-003f0bb16d59 req-91b4a9f2-2e07-4dd4-bb73-9f1bd8f54fed tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:43.933241 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7212d9cc-5bb1-40a2-aa99-003f0bb16d59 req-91b4a9f2-2e07-4dd4-bb73-9f1bd8f54fed tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/ports?device_id=e145337f-88ba-4f6d-a894-39631a8dd013 HTTP/1.1" status: 200 len: 944 time: 0.1114311 Nov 09 04:33:43.949792 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-098ac1b6-cc5a-4eb6-a899-adb061ed3650 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:44.021942 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-098ac1b6-cc5a-4eb6-a899-adb061ed3650 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event deleted for resources: {'Port': ['ID=5b9cc4cb-652d-459a-b84b-786da879bd9b,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:44.038119 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device d3617298-af19-45fb-8ddd-9c228bc66aab up at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:33:44.038221 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-615ed528-8160-4659-9b4c-4596f4b9db1e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network 239a9c72-6384-4d5a-a69d-f4ac0c580e40 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:33:44.039937 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-615ed528-8160-4659-9b4c-4596f4b9db1e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:33:44.080141 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-098ac1b6-cc5a-4eb6-a899-adb061ed3650 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:44.084348 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-098ac1b6-cc5a-4eb6-a899-adb061ed3650 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/ports/5b9cc4cb-652d-459a-b84b-786da879bd9b HTTP/1.1" status: 204 len: 168 time: 1.1470990 Nov 09 04:33:44.087658 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57308) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:44.093254 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-425b6920-0d97-4bd5-a619-aba859bd0ec4 None None] For port c315ee21-870f-44c3-b604-c4eb34ea288a, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=c315ee21-870f-44c3-b604-c4eb34ea288a,segment=NetworkSegment(53b7b761-0c0a-4377-98bf-58d99642533b),segment_id=53b7b761-0c0a-4377-98bf-58d99642533b)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:33:44.118908 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7212d9cc-5bb1-40a2-aa99-003f0bb16d59 req-dc2e88f5-4723-4fd7-84b5-0fc54b260f38 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/security-groups?id=8fd0adbd-57c5-4583-8e2d-9a55d7973976&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1752515 Nov 09 04:33:44.152225 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1dc92ca9-a0ef-4a6e-bab3-1735e551ec7a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:44.161301 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-425b6920-0d97-4bd5-a619-aba859bd0ec4 None None] Publish callbacks [] for port, precommit_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:44.186956 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-48513d7c-b72a-4377-ae87-dd74993e3e20 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:44.188690 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-48513d7c-b72a-4377-ae87-dd74993e3e20 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:44.190258 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-48513d7c-b72a-4377-ae87-dd74993e3e20 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1454 time: 0.1013479 Nov 09 04:33:44.193867 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57310) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:44.253807 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1dc92ca9-a0ef-4a6e-bab3-1735e551ec7a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:44.288099 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1dc92ca9-a0ef-4a6e-bab3-1735e551ec7a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event updated for resources: {'SecurityGroup': ['ID=5ea943f6-8538-4399-89c6-c1935ab85085,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:44.294532 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-425b6920-0d97-4bd5-a619-aba859bd0ec4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:44.298284 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-00e8e112-8db2-4139-ab10-c4deb2d575e8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Deleting subnet 30e8ddad-4c7a-4044-b33c-077c25c81181 {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:33:44.298471 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning for port d3617298-af19-45fb-8ddd-9c228bc66aab completed by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 09 04:33:44.305173 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-00e8e112-8db2-4139-ab10-c4deb2d575e8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:44.408424 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-90f67605-f239-4f8c-8820-89b4b98d0eec None None] Network 239a9c72-6384-4d5a-a69d-f4ac0c580e40 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:33:44.419917 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning complete for port d3617298-af19-45fb-8ddd-9c228bc66aab triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:44.420547 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:44.421595 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1dc92ca9-a0ef-4a6e-bab3-1735e551ec7a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:44.422880 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-1dc92ca9-a0ef-4a6e-bab3-1735e551ec7a tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1759 time: 0.7523072 Nov 09 04:33:44.432711 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57318) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:44.448543 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-637357bb-3493-41b0-92c7-e575ea0db322 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Request body: {'port': {'name': 'tempest-PortsIpV6TestJSON-1833462190', 'security_groups': ['5ea943f6-8538-4399-89c6-c1935ab85085'], 'network_id': '002d27a0-2fb8-4426-9550-42c444556a8e', 'admin_state_up': True, 'fixed_ips': [{'subnet_id': '35a4ba3b-99b7-4b1f-9549-2fc042f492d9'}]}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:44.537550 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-00e8e112-8db2-4139-ab10-c4deb2d575e8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:44.592991 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-bd6b160e-34c5-47f8-93d6-77f1791142b1 req-46687dff-cbfe-475d-a9b2-1edd882241ad service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.2266827 Nov 09 04:33:44.775288 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-615ed528-8160-4659-9b4c-4596f4b9db1e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Router d05416c2-0293-4ef5-a6e3-5968392cc774 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:33:44.858479 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 07d6da7e-6539-4f5d-9797-da4ea907282b up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:33:44.859776 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-00e8e112-8db2-4139-ab10-c4deb2d575e8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:44.865531 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-425b6920-0d97-4bd5-a619-aba859bd0ec4 None None] Pushing event updated for resources: {'Port': ['ID=c315ee21-870f-44c3-b604-c4eb34ea288a,revision_number=6']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:44.897895 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd6b160e-34c5-47f8-93d6-77f1791142b1 req-ddacf86a-1643-4151-af44-d5b802ad0aa5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:44.898076 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-56919fde-d74e-4ee8-a064-65f053d248b4 None None] Provisioning complete for port 0c829017-1d45-4280-bb1e-aecb67547f76 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:44.898076 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56919fde-d74e-4ee8-a064-65f053d248b4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:44.898271 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-bd6b160e-34c5-47f8-93d6-77f1791142b1 req-ddacf86a-1643-4151-af44-d5b802ad0aa5 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=6015befde7f546d881cb247ae5bc81ae&device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 1098 time: 0.2069175 Nov 09 04:33:44.930708 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-228dc7d8-297d-434a-8206-8b7d7e425729 req-fd9efb79-ff45-4748-8cde-ceb19f71a13d tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:44.932670 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-228dc7d8-297d-434a-8206-8b7d7e425729 req-fd9efb79-ff45-4748-8cde-ceb19f71a13d tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 945 time: 0.1518226 Nov 09 04:33:45.022094 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-637357bb-3493-41b0-92c7-e575ea0db322 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Made reservation on behalf of 12e47d8445b5429892cd1b9244512ca8 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:33:45.081416 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-228dc7d8-297d-434a-8206-8b7d7e425729 req-393bed07-546b-4928-87d6-4ec87ae60065 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1051025 Nov 09 04:33:45.096188 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-615ed528-8160-4659-9b4c-4596f4b9db1e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:33:45.106334 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-615ed528-8160-4659-9b4c-4596f4b9db1e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "PUT /v2.0/routers/d05416c2-0293-4ef5-a6e3-5968392cc774/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.1161063 Nov 09 04:33:45.108633 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57330) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:45.110773 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5a37dd05-d2de-4911-aca4-5ba21219b0aa None None] Sync routers for ids ['d05416c2-0293-4ef5-a6e3-5968392cc774'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:33:45.126041 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5a37dd05-d2de-4911-aca4-5ba21219b0aa None None] Routers {'d05416c2-0293-4ef5-a6e3-5968392cc774'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:33:45.133449 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-5a37dd05-d2de-4911-aca4-5ba21219b0aa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:33:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['d05416c2-0293-4ef5-a6e3-5968392cc774'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:45.199489 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-00e8e112-8db2-4139-ab10-c4deb2d575e8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:45.293943 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:45.343477 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00e8e112-8db2-4139-ab10-c4deb2d575e8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event deleted for resources: {'Subnet': ['ID=30e8ddad-4c7a-4044-b33c-077c25c81181,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:45.358142 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56919fde-d74e-4ee8-a064-65f053d248b4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:45.418889 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-00e8e112-8db2-4139-ab10-c4deb2d575e8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:45.427331 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:45.427692 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3528799a-509e-4b82-9a1b-ae0b72b97113 None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:33:45.429517 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-00e8e112-8db2-4139-ab10-c4deb2d575e8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/30e8ddad-4c7a-4044-b33c-077c25c81181 HTTP/1.1" status: 204 len: 168 time: 1.2342834 Nov 09 04:33:45.430901 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd6b160e-34c5-47f8-93d6-77f1791142b1 req-2938461d-eb10-48e1-8bea-179bcdbe4b94 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:45.432274 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-bd6b160e-34c5-47f8-93d6-77f1791142b1 req-2938461d-eb10-48e1-8bea-179bcdbe4b94 service neutron] 10.222.0.26 "GET /v2.0/networks?id=a270b61c-1f4f-4d97-be79-4a24c65fddc2 HTTP/1.1" status: 200 len: 913 time: 0.5064092 Nov 09 04:33:45.439322 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57338) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:45.439745 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57340) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:45.542175 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 07d6da7e-6539-4f5d-9797-da4ea907282b triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:45.551232 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:45.555189 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-7e720dc5-ec6f-4a8f-b072-78ad74257792 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1070735 Nov 09 04:33:45.561365 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57346) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:45.565168 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-56919fde-d74e-4ee8-a064-65f053d248b4 None None] For port 0c829017-1d45-4280-bb1e-aecb67547f76, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=0c829017-1d45-4280-bb1e-aecb67547f76,segment=NetworkSegment(7befff96-69ce-4b76-b9cc-7561279d57a7),segment_id=7befff96-69ce-4b76-b9cc-7561279d57a7)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:33:45.606899 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-b53a7b01-186c-4029-9168-0a5d4898e931 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'subnet': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:45.632920 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e145337f-88ba-4f6d-a894-39631a8dd013', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd3617298-af19-45fb-8ddd-9c228bc66aab'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:33:45.635336 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ef59b591-b8d9-46cc-86ca-65e1ad913271" -d '{"events": [{"server_uuid": "e145337f-88ba-4f6d-a894-39631a8dd013", "name": "network-vif-plugged", "status": "completed", "tag": "d3617298-af19-45fb-8ddd-9c228bc66aab"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:33:45.663766 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56919fde-d74e-4ee8-a064-65f053d248b4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:45.701300 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-5a37dd05-d2de-4911-aca4-5ba21219b0aa None None] Set router d05416c2-0293-4ef5-a6e3-5968392cc774 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:33:45.728016 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port d3617298-af19-45fb-8ddd-9c228bc66aab, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=d3617298-af19-45fb-8ddd-9c228bc66aab,segment=NetworkSegment(63a401e5-97f0-4f3a-b762-8fc66b1b215f),segment_id=63a401e5-97f0-4f3a-b762-8fc66b1b215f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:33:45.741442 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56919fde-d74e-4ee8-a064-65f053d248b4 None None] Pushing event updated for resources: {'Port': ['ID=0c829017-1d45-4280-bb1e-aecb67547f76,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:45.775238 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-bd6b160e-34c5-47f8-93d6-77f1791142b1 req-c7c3c8d8-b687-45f1-abcf-9ea7e2cf5bdd service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=99ad1d96-b35b-4120-b5a9-c95c47bd3ffc HTTP/1.1" status: 200 len: 1001 time: 0.3168993 Nov 09 04:33:45.781336 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-92832658-eae8-4825-82e4-a716c167428a tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Request body: {'router': {'name': 'tempest-RoutersNegativeIpV6Test-router-865210014', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:45.810344 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-637357bb-3493-41b0-92c7-e575ea0db322 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:45.813324 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fda5d19-ba38-4eed-9044-6757128c661b req-12e38c0e-e34a-4a4f-b0d8-d619e0f9c2e5 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:45.821636 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-4fda5d19-ba38-4eed-9044-6757128c661b req-12e38c0e-e34a-4a4f-b0d8-d619e0f9c2e5 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/ports?device_id=e145337f-88ba-4f6d-a894-39631a8dd013 HTTP/1.1" status: 200 len: 944 time: 0.3715365 Nov 09 04:33:45.827443 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:45.830870 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fb92e455-3efb-440f-bfc1-8aafd03a44d1 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:45.831564 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fb92e455-3efb-440f-bfc1-8aafd03a44d1 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:45.832690 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fb92e455-3efb-440f-bfc1-8aafd03a44d1 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:45.833377 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fb92e455-3efb-440f-bfc1-8aafd03a44d1 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:45.833913 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fb92e455-3efb-440f-bfc1-8aafd03a44d1 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:45.834470 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fb92e455-3efb-440f-bfc1-8aafd03a44d1 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:45.835091 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fb92e455-3efb-440f-bfc1-8aafd03a44d1 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:45.835545 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fb92e455-3efb-440f-bfc1-8aafd03a44d1 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:45.836050 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fb92e455-3efb-440f-bfc1-8aafd03a44d1 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:45.841354 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-fb92e455-3efb-440f-bfc1-8aafd03a44d1 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/networks HTTP/1.1" status: 200 len: 6388 time: 0.7317047 Nov 09 04:33:45.843861 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57350) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:45.890613 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-314cdb80-6ac4-4e31-b7a4-bc7bb953b832 req-ed00d009-8123-425d-ab86-7f2c706ea47c tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:45.892702 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-314cdb80-6ac4-4e31-b7a4-bc7bb953b832 req-ed00d009-8123-425d-ab86-7f2c706ea47c tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 945 time: 0.2628348 Nov 09 04:33:45.937302 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [None req-637357bb-3493-41b0-92c7-e575ea0db322 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] device_id is not set on port 4755a8a5-1dbb-40bb-87cc-56df38d0632c yet. {{(pid=102162) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:33:45.951138 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-c1b1922b-f7b9-439c-95e8-09cda1fc7a0f None None] Provisioning complete for port 07d6da7e-6539-4f5d-9797-da4ea907282b triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:45.951500 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c1b1922b-f7b9-439c-95e8-09cda1fc7a0f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:45.997893 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-4fda5d19-ba38-4eed-9044-6757128c661b req-1cb39d10-f46e-41fb-b776-7aafca880469 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/security-groups?id=8fd0adbd-57c5-4583-8e2d-9a55d7973976&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1747029 Nov 09 04:33:46.031768 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd6b160e-34c5-47f8-93d6-77f1791142b1 req-804deb98-6642-4b71-9a69-f5da55376a42 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:46.033285 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-bd6b160e-34c5-47f8-93d6-77f1791142b1 req-804deb98-6642-4b71-9a69-f5da55376a42 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=b2956e71-9b0f-4060-922c-e54ce6cff80a HTTP/1.1" status: 200 len: 851 time: 0.2422957 Nov 09 04:33:46.036145 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=d3617298-af19-45fb-8ddd-9c228bc66aab,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:46.044426 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:46.113414 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 07d6da7e-6539-4f5d-9797-da4ea907282b, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=07d6da7e-6539-4f5d-9797-da4ea907282b,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:33:46.116066 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:33:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1e9155fb-8324-4430-a68e-9320c2079247 x-openstack-request-id: req-1e9155fb-8324-4430-a68e-9320c2079247 {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:33:46.116246 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e145337f-88ba-4f6d-a894-39631a8dd013", "name": "network-vif-plugged", "status": "completed", "tag": "d3617298-af19-45fb-8ddd-9c228bc66aab", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:33:46.116430 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-1e9155fb-8324-4430-a68e-9320c2079247 {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:33:46.116754 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e145337f-88ba-4f6d-a894-39631a8dd013', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd3617298-af19-45fb-8ddd-9c228bc66aab', 'code': 200} Nov 09 04:33:46.135472 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-314cdb80-6ac4-4e31-b7a4-bc7bb953b832 req-2b112121-9475-4fa2-8b70-d456d4e80381 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2317202 Nov 09 04:33:46.137086 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-5a37dd05-d2de-4911-aca4-5ba21219b0aa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'name': 'tempest-TestNetworkBasicOps-router-1967773701', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.204'}], 'enable_snat': True}, 'gw_port_id': '49bff53a-c208-4aa5-8fcc-e7ec9471fae7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:33:32Z', 'updated_at': '2021-11-09T04:33:43Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '49bff53a-c208-4aa5-8fcc-e7ec9471fae7', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:85:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'device_owner': 'network:router_gateway', 'standard_attr_id': 978, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.204', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:33:34Z', 'updated_at': '2021-11-09T04:33:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '9930d582-2262-4f1d-97bf-b02697a70777', 'name': '', 'network_id': '239a9c72-6384-4d5a-a69d-f4ac0c580e40', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:7c:21:60', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'device_owner': 'network:router_interface', 'standard_attr_id': 987, 'fixed_ips': [{'subnet_id': '33b5599d-7ebe-4564-9c72-76f5d540fd80', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:33:41Z', 'updated_at': '2021-11-09T04:33:43Z', 'revision_number': 2, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '33b5599d-7ebe-4564-9c72-76f5d540fd80', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:46.137702 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c1b1922b-f7b9-439c-95e8-09cda1fc7a0f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:46.165363 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-92832658-eae8-4825-82e4-a716c167428a tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:46.166781 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-92832658-eae8-4825-82e4-a716c167428a tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:46.178186 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-01c9dec2-a215-4af0-8246-24b3b9b1e9f7 None None] DHCP port deletion for 988d2354-693c-4d52-af17-25e0643eaa0c request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:33:46.202287 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5a37dd05-d2de-4911-aca4-5ba21219b0aa None None] Checking router: d05416c2-0293-4ef5-a6e3-5968392cc774 for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:33:46.202513 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:46.203026 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5a37dd05-d2de-4911-aca4-5ba21219b0aa None None] Updating router d05416c2-0293-4ef5-a6e3-5968392cc774 port 9930d582-2262-4f1d-97bf-b02697a70777 binding host dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 04:33:46.203153 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 0c829017-1d45-4280-bb1e-aecb67547f76 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:33:46.204893 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-914d9445-47cd-4c6e-aedb-b343b58cbf04 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:46.205351 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-914d9445-47cd-4c6e-aedb-b343b58cbf04 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:46.206918 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-914d9445-47cd-4c6e-aedb-b343b58cbf04 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:46.206918 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-914d9445-47cd-4c6e-aedb-b343b58cbf04 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:46.207866 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-914d9445-47cd-4c6e-aedb-b343b58cbf04 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:46.208363 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-914d9445-47cd-4c6e-aedb-b343b58cbf04 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:46.208814 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-914d9445-47cd-4c6e-aedb-b343b58cbf04 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:46.209253 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-914d9445-47cd-4c6e-aedb-b343b58cbf04 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:46.210293 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-914d9445-47cd-4c6e-aedb-b343b58cbf04 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:46.213157 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-914d9445-47cd-4c6e-aedb-b343b58cbf04 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 5884 time: 0.3682599 Nov 09 04:33:46.216024 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57354) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:46.244090 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-5a37dd05-d2de-4911-aca4-5ba21219b0aa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:46.256932 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b53a7b01-186c-4029-9168-0a5d4898e931 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:33:46.265285 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b53a7b01-186c-4029-9168-0a5d4898e931 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:46.371088 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-92832658-eae8-4825-82e4-a716c167428a tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:46.373957 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd6b160e-34c5-47f8-93d6-77f1791142b1 req-5ef62315-dcbf-41be-b2ea-64d96867bf44 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:46.375910 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-bd6b160e-34c5-47f8-93d6-77f1791142b1 req-5ef62315-dcbf-41be-b2ea-64d96867bf44 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=a270b61c-1f4f-4d97-be79-4a24c65fddc2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.2352748 Nov 09 04:33:46.452086 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.db.api [None req-c1b1922b-f7b9-439c-95e8-09cda1fc7a0f None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=102163) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:33:46.452561 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG oslo_db.api [None req-c1b1922b-f7b9-439c-95e8-09cda1fc7a0f None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:33:46.460129 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=07d6da7e-6539-4f5d-9797-da4ea907282b,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:46.479652 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-01c9dec2-a215-4af0-8246-24b3b9b1e9f7 None None] Deleting port 07d6da7e-6539-4f5d-9797-da4ea907282b {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:33:46.479652 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-01c9dec2-a215-4af0-8246-24b3b9b1e9f7 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:46.501255 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 0c829017-1d45-4280-bb1e-aecb67547f76 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:46.501255 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:46.528603 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-92832658-eae8-4825-82e4-a716c167428a tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:46.597011 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-637357bb-3493-41b0-92c7-e575ea0db322 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Allocated IP 2001:db8::2ca (002d27a0-2fb8-4426-9550-42c444556a8e/35a4ba3b-99b7-4b1f-9549-2fc042f492d9/4755a8a5-1dbb-40bb-87cc-56df38d0632c) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:33:46.599543 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:46.603212 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-5a37dd05-d2de-4911-aca4-5ba21219b0aa None None] Publish callbacks [] for port, precommit_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:46.620836 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-bd6b160e-34c5-47f8-93d6-77f1791142b1 req-fff33cec-26a2-42e5-bef3-bb2ff0648b85 service neutron] 10.222.0.26 "GET /v2.0/networks/a270b61c-1f4f-4d97-be79-4a24c65fddc2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2347436 Nov 09 04:33:46.626033 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-01c9dec2-a215-4af0-8246-24b3b9b1e9f7 None None] For port 07d6da7e-6539-4f5d-9797-da4ea907282b, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=07d6da7e-6539-4f5d-9797-da4ea907282b,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:33:46.626467 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-01c9dec2-a215-4af0-8246-24b3b9b1e9f7 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:46.626955 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-92832658-eae8-4825-82e4-a716c167428a tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:46.630418 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-92832658-eae8-4825-82e4-a716c167428a tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 711 time: 1.1873858 Nov 09 04:33:46.641658 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57358) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:46.642600 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-01c9dec2-a215-4af0-8246-24b3b9b1e9f7 None None] Calling delete_port for 07d6da7e-6539-4f5d-9797-da4ea907282b owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:33:46.661334 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-cc8c2960-48d4-43bd-9cc6-64e583b97745 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Request body: {'network': {'name': 'tempest-RoutersNegativeIpV6Test-test-network-1785310616'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:46.693920 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-5a37dd05-d2de-4911-aca4-5ba21219b0aa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:46.801750 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3757ffc-61a1-4170-8560-62f2d8a58aa1 None None] Pushing event updated for resources: {'Port': ['ID=9930d582-2262-4f1d-97bf-b02697a70777,revision_number=3']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:46.827625 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cc8c2960-48d4-43bd-9cc6-64e583b97745 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Made reservation on behalf of 4b395c2f9c4f482198ab37eb736cc2fe for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:33:46.831580 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cc8c2960-48d4-43bd-9cc6-64e583b97745 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:46.867072 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cc8c2960-48d4-43bd-9cc6-64e583b97745 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:46.920888 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-5a37dd05-d2de-4911-aca4-5ba21219b0aa None None] Attempting to bind port 9930d582-2262-4f1d-97bf-b02697a70777 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:33:46.921260 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-5a37dd05-d2de-4911-aca4-5ba21219b0aa None None] Attempting to bind port 9930d582-2262-4f1d-97bf-b02697a70777 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '7befff96-69ce-4b76-b9cc-7561279d57a7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 313, 'network_id': '239a9c72-6384-4d5a-a69d-f4ac0c580e40'}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:33:46.921660 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5a37dd05-d2de-4911-aca4-5ba21219b0aa None None] Attempting to bind port 9930d582-2262-4f1d-97bf-b02697a70777 on network 239a9c72-6384-4d5a-a69d-f4ac0c580e40 {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:33:46.929266 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-bd6b160e-34c5-47f8-93d6-77f1791142b1 req-d103b868-ddb3-4a06-8127-8f921469a53e service neutron] 10.222.0.26 "GET /v2.0/networks/a270b61c-1f4f-4d97-be79-4a24c65fddc2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2991860 Nov 09 04:33:46.946931 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-01c9dec2-a215-4af0-8246-24b3b9b1e9f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:46.948674 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.objects.ports [None req-b53a7b01-186c-4029-9168-0a5d4898e931 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=102161) get_objects /opt/stack/neutron/neutron/objects/ports.py:444}} Nov 09 04:33:46.949996 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5a37dd05-d2de-4911-aca4-5ba21219b0aa None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 33, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:33:46.950802 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5a37dd05-d2de-4911-aca4-5ba21219b0aa None None] Checking segment: {'id': '7befff96-69ce-4b76-b9cc-7561279d57a7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 313, 'network_id': '239a9c72-6384-4d5a-a69d-f4ac0c580e40'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102164) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:33:46.951628 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-5a37dd05-d2de-4911-aca4-5ba21219b0aa None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:46.952175 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7cdabc0-8fb9-4fcf-a136-df9647eb5b1a req-f686daed-8433-4f2c-a1f6-85f3d034c123 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:46.952408 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5a37dd05-d2de-4911-aca4-5ba21219b0aa None None] Bound using segment: {'id': '7befff96-69ce-4b76-b9cc-7561279d57a7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 313, 'network_id': '239a9c72-6384-4d5a-a69d-f4ac0c580e40'} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:33:46.953135 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-5a37dd05-d2de-4911-aca4-5ba21219b0aa None None] Bound port: 9930d582-2262-4f1d-97bf-b02697a70777, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7befff96-69ce-4b76-b9cc-7561279d57a7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 313, 'network_id': '239a9c72-6384-4d5a-a69d-f4ac0c580e40'}}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:33:46.953717 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-5a37dd05-d2de-4911-aca4-5ba21219b0aa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:46.953981 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-e7cdabc0-8fb9-4fcf-a136-df9647eb5b1a req-f686daed-8433-4f2c-a1f6-85f3d034c123 service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=e145337f-88ba-4f6d-a894-39631a8dd013 HTTP/1.1" status: 200 len: 1098 time: 0.2797396 Nov 09 04:33:46.978103 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-637357bb-3493-41b0-92c7-e575ea0db322 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:47.061117 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device c315ee21-870f-44c3-b604-c4eb34ea288a up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:33:47.069223 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01c9dec2-a215-4af0-8246-24b3b9b1e9f7 None None] Pushing event deleted for resources: {'Port': ['ID=07d6da7e-6539-4f5d-9797-da4ea907282b,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:47.084498 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:47.087373 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-c1b1922b-f7b9-439c-95e8-09cda1fc7a0f None None] Port 07d6da7e-6539-4f5d-9797-da4ea907282b update to ACTIVE by agent not found {{(pid=102163) update_port_statuses /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2167}} Nov 09 04:33:47.089962 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-5a37dd05-d2de-4911-aca4-5ba21219b0aa None None] For port 9930d582-2262-4f1d-97bf-b02697a70777, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102164) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:33:47.095681 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-5a37dd05-d2de-4911-aca4-5ba21219b0aa None None] For port 9930d582-2262-4f1d-97bf-b02697a70777, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=9930d582-2262-4f1d-97bf-b02697a70777,segment=NetworkSegment(7befff96-69ce-4b76-b9cc-7561279d57a7),segment_id=7befff96-69ce-4b76-b9cc-7561279d57a7)] {{(pid=102164) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:33:47.124936 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-01c9dec2-a215-4af0-8246-24b3b9b1e9f7 None None] No DVR routers for this DVR port 07d6da7e-6539-4f5d-9797-da4ea907282b on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:33:47.125842 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-c1b1922b-f7b9-439c-95e8-09cda1fc7a0f None None] Could not find standard attr ID for object 5b9cc4cb-652d-459a-b84b-786da879bd9b. {{(pid=102163) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 09 04:33:47.129925 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-637357bb-3493-41b0-92c7-e575ea0db322 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:47.161369 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port c315ee21-870f-44c3-b604-c4eb34ea288a triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:47.161737 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:47.167614 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-5a37dd05-d2de-4911-aca4-5ba21219b0aa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:47.257047 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5a37dd05-d2de-4911-aca4-5ba21219b0aa None None] Routers {'d05416c2-0293-4ef5-a6e3-5968392cc774'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:33:47.258447 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-5a37dd05-d2de-4911-aca4-5ba21219b0aa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:33:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['d05416c2-0293-4ef5-a6e3-5968392cc774'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:47.272626 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cc8c2960-48d4-43bd-9cc6-64e583b97745 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:47.289040 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-637357bb-3493-41b0-92c7-e575ea0db322 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Network 002d27a0-2fb8-4426-9550-42c444556a8e is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:33:47.292315 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1829db5c-399e-4fe6-b807-37693232dc95 req-18815efc-0ccd-4c26-88e7-0a9e931478e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:47.297258 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1829db5c-399e-4fe6-b807-37693232dc95 req-18815efc-0ccd-4c26-88e7-0a9e931478e1 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=6015befde7f546d881cb247ae5bc81ae&device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 1098 time: 0.2495756 Nov 09 04:33:47.299930 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 0c829017-1d45-4280-bb1e-aecb67547f76 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:33:47.315777 dv-neutron-816802-2-hyperv neutron-server[102161]: WARNING neutron.services.revisions.revision_plugin [None req-b53a7b01-186c-4029-9168-0a5d4898e931 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Could not find related port for resource to bump revision. Nov 09 04:33:47.322657 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-e7cdabc0-8fb9-4fcf-a136-df9647eb5b1a req-e07f33b8-24b2-4c92-bdaa-3488d08051ff service neutron] 10.222.0.26 "GET /v2.0/security-groups?id=8fd0adbd-57c5-4583-8e2d-9a55d7973976&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2888477 Nov 09 04:33:47.327403 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-04bf4506-3de5-4fe3-ae76-07f510e43673 None None] Provisioning complete for port c315ee21-870f-44c3-b604-c4eb34ea288a triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:47.327772 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-04bf4506-3de5-4fe3-ae76-07f510e43673 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:47.342250 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-637357bb-3493-41b0-92c7-e575ea0db322 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:33:47.348233 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3757ffc-61a1-4170-8560-62f2d8a58aa1 None None] Pushing event updated for resources: {'Port': ['ID=9930d582-2262-4f1d-97bf-b02697a70777,revision_number=4']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:47.358832 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d93f59e-d4f6-4633-9ab9-cd5e4758e565 req-cd123eef-bcbe-40dc-bad8-9a76ba2a6647 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:47.360707 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-1d93f59e-d4f6-4633-9ab9-cd5e4758e565 req-cd123eef-bcbe-40dc-bad8-9a76ba2a6647 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/ports?device_id=e145337f-88ba-4f6d-a894-39631a8dd013 HTTP/1.1" status: 200 len: 945 time: 0.2436614 Nov 09 04:33:47.396902 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 0c829017-1d45-4280-bb1e-aecb67547f76 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:47.397212 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:47.402978 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-637357bb-3493-41b0-92c7-e575ea0db322 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:33:47.407289 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.ipam_pluggable_backend [None req-b53a7b01-186c-4029-9168-0a5d4898e931 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Port 07d6da7e-6539-4f5d-9797-da4ea907282b was deleted while updating it with an IPv6 auto-address. Ignoring. {{(pid=102161) add_auto_addrs_on_network_ports /opt/stack/neutron/neutron/db/ipam_pluggable_backend.py:573}} Nov 09 04:33:47.407595 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.ipam_pluggable_backend [None req-b53a7b01-186c-4029-9168-0a5d4898e931 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Reverting IP allocation for 2001:db8::f816:3eff:fe2b:f3f5 {{(pid=102161) add_auto_addrs_on_network_ports /opt/stack/neutron/neutron/db/ipam_pluggable_backend.py:575}} Nov 09 04:33:47.408604 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-637357bb-3493-41b0-92c7-e575ea0db322 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:47.409233 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-637357bb-3493-41b0-92c7-e575ea0db322 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:47.411353 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.ipam_pluggable_backend [None req-b53a7b01-186c-4029-9168-0a5d4898e931 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Reverting IP allocation failed for 2001:db8::f816:3eff:fe2b:f3f5 {{(pid=102161) add_auto_addrs_on_network_ports /opt/stack/neutron/neutron/db/ipam_pluggable_backend.py:581}} Nov 09 04:33:47.412753 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cc8c2960-48d4-43bd-9cc6-64e583b97745 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:47.417946 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b53a7b01-186c-4029-9168-0a5d4898e931 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:47.455781 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b53a7b01-186c-4029-9168-0a5d4898e931 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:33:47.462874 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-b53a7b01-186c-4029-9168-0a5d4898e931 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:33:47.501084 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-5a37dd05-d2de-4911-aca4-5ba21219b0aa None None] Set router d05416c2-0293-4ef5-a6e3-5968392cc774 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:33:47.502792 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e0cd2206-aa95-490c-bbb7-961852fbd5ab None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:33:47.506755 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-04bf4506-3de5-4fe3-ae76-07f510e43673 None None] Provisioning complete for port 77290ebd-f244-4a68-94af-4d033c4a6349 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:47.507120 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-04bf4506-3de5-4fe3-ae76-07f510e43673 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:47.513622 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-637357bb-3493-41b0-92c7-e575ea0db322 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event updated for resources: {'Port': ['ID=4755a8a5-1dbb-40bb-87cc-56df38d0632c,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:47.517954 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-cc8c2960-48d4-43bd-9cc6-64e583b97745 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 344} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:33:47.522703 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b53a7b01-186c-4029-9168-0a5d4898e931 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:47.523301 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b53a7b01-186c-4029-9168-0a5d4898e931 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:47.542587 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-19bcf24e-627e-4eae-8f16-b7afc131530d tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/routers HTTP/1.1" status: 200 len: 2327 time: 1.3253961 Nov 09 04:33:47.569332 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3994bb82-0960-4946-b401-f72fd0ac2dac req-8eb4765e-af79-4c36-9261-ad6a4bec6c25 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:47.571842 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3994bb82-0960-4946-b401-f72fd0ac2dac req-8eb4765e-af79-4c36-9261-ad6a4bec6c25 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 945 time: 0.2743640 Nov 09 04:33:47.611075 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-637357bb-3493-41b0-92c7-e575ea0db322 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 931 time: 3.1732106 Nov 09 04:33:47.617717 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cc8c2960-48d4-43bd-9cc6-64e583b97745 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:47.618203 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-cc8c2960-48d4-43bd-9cc6-64e583b97745 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Added segment 9c8c26ad-778e-46c6-99ba-e8e770604064 of type vlan for network 83b7fb07-746c-4cc1-a582-519bfb1e5896 Nov 09 04:33:47.620339 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57368) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:47.621084 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc8c2960-48d4-43bd-9cc6-64e583b97745 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Pushing event updated for resources: {'SecurityGroup': ['ID=56c8c1bd-4969-470a-9b70-2b8aa84c9ba1,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:47.625993 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-1d93f59e-d4f6-4633-9ab9-cd5e4758e565 req-1f4279cd-516b-475c-a11e-17d8544aeb08 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/security-groups?id=8fd0adbd-57c5-4583-8e2d-9a55d7973976&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2479675 Nov 09 04:33:47.632164 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-dc763e88-1908-42b2-b3c6-c45863d1ba55 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Request body: {'subnet': {'network_id': '002d27a0-2fb8-4426-9550-42c444556a8e', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:47.667871 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b53a7b01-186c-4029-9168-0a5d4898e931 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Subnet': ['ID=f0e6a3fd-b04a-4b95-8ac0-a5861c3c56b9,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:47.727513 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-b53a7b01-186c-4029-9168-0a5d4898e931 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 835 time: 2.1489179 Nov 09 04:33:47.727724 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57370) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:47.732760 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-53805ae0-758e-4e87-918e-6ea30edf2480 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'port': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'mac_address': 'fa:16:3e:8d:ff:e5', 'name': 'tempest-NetworksTestDHCPv6-394969301'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:47.827774 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3994bb82-0960-4946-b401-f72fd0ac2dac req-0b4423b4-5215-4fb6-9466-641716be995e tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2131584 Nov 09 04:33:47.836672 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-04bf4506-3de5-4fe3-ae76-07f510e43673 None None] Port 77290ebd-f244-4a68-94af-4d033c4a6349 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:33:47.839780 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cc8c2960-48d4-43bd-9cc6-64e583b97745 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:47.882566 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-04bf4506-3de5-4fe3-ae76-07f510e43673 None None] Provisioning complete for port 9930d582-2262-4f1d-97bf-b02697a70777 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:47.882939 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-04bf4506-3de5-4fe3-ae76-07f510e43673 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:47.908350 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-5a37dd05-d2de-4911-aca4-5ba21219b0aa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'name': 'tempest-TestNetworkBasicOps-router-1967773701', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.204'}], 'enable_snat': True}, 'gw_port_id': '49bff53a-c208-4aa5-8fcc-e7ec9471fae7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:33:32Z', 'updated_at': '2021-11-09T04:33:43Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '49bff53a-c208-4aa5-8fcc-e7ec9471fae7', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:85:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'device_owner': 'network:router_gateway', 'standard_attr_id': 978, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.204', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:33:34Z', 'updated_at': '2021-11-09T04:33:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '9930d582-2262-4f1d-97bf-b02697a70777', 'name': '', 'network_id': '239a9c72-6384-4d5a-a69d-f4ac0c580e40', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:7c:21:60', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'device_owner': 'network:router_interface', 'standard_attr_id': 987, 'fixed_ips': [{'subnet_id': '33b5599d-7ebe-4564-9c72-76f5d540fd80', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:33:41Z', 'updated_at': '2021-11-09T04:33:47Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '33b5599d-7ebe-4564-9c72-76f5d540fd80', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:33:47.937507 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 07d6da7e-6539-4f5d-9797-da4ea907282b no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:33:47.948774 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1829db5c-399e-4fe6-b807-37693232dc95 req-e1c19579-bd01-43ce-bdc3-9b8f78d48ca7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:47.950691 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1829db5c-399e-4fe6-b807-37693232dc95 req-e1c19579-bd01-43ce-bdc3-9b8f78d48ca7 service neutron] 10.222.0.26 "GET /v2.0/networks?id=a270b61c-1f4f-4d97-be79-4a24c65fddc2 HTTP/1.1" status: 200 len: 913 time: 0.5489030 Nov 09 04:33:47.952792 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5a37dd05-d2de-4911-aca4-5ba21219b0aa None None] The sync data for ids ['d05416c2-0293-4ef5-a6e3-5968392cc774'] in dv-neutron-816802-2-hyperv is: [{'id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'name': 'tempest-TestNetworkBasicOps-router-1967773701', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.204'}], 'enable_snat': True}, 'gw_port_id': '49bff53a-c208-4aa5-8fcc-e7ec9471fae7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:33:32Z', 'updated_at': '2021-11-09T04:33:43Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '49bff53a-c208-4aa5-8fcc-e7ec9471fae7', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:85:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'device_owner': 'network:router_gateway', 'standard_attr_id': 978, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.204', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:33:34Z', 'updated_at': '2021-11-09T04:33:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '9930d582-2262-4f1d-97bf-b02697a70777', 'name': '', 'network_id': '239a9c72-6384-4d5a-a69d-f4ac0c580e40', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:7c:21:60', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'device_owner': 'network:router_interface', 'standard_attr_id': 987, 'fixed_ips': [{'subnet_id': '33b5599d-7ebe-4564-9c72-76f5d540fd80', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:33:41Z', 'updated_at': '2021-11-09T04:33:47Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '33b5599d-7ebe-4564-9c72-76f5d540fd80', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:33:48.013184 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-53805ae0-758e-4e87-918e-6ea30edf2480 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'port': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:33:48.069776 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1829db5c-399e-4fe6-b807-37693232dc95 req-8479dca3-40bf-4e18-8ef3-10565613b6c1 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=99ad1d96-b35b-4120-b5a9-c95c47bd3ffc HTTP/1.1" status: 200 len: 1001 time: 0.1079969 Nov 09 04:33:48.135618 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cc8c2960-48d4-43bd-9cc6-64e583b97745 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:48.143990 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cc8c2960-48d4-43bd-9cc6-64e583b97745 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:48.145365 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cc8c2960-48d4-43bd-9cc6-64e583b97745 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:48.148800 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dc763e88-1908-42b2-b3c6-c45863d1ba55 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Made reservation on behalf of 12e47d8445b5429892cd1b9244512ca8 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:33:48.152785 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-dc763e88-1908-42b2-b3c6-c45863d1ba55 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:48.173907 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57372) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:48.177729 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 07d6da7e-6539-4f5d-9797-da4ea907282b {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:33:48.178072 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 07d6da7e-6539-4f5d-9797-da4ea907282b not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:33:48.183116 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-e962b621-052e-42a1-bfd0-67eb81cfc8ba tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-676125495', 'description': 'tempest-secgroup-smoke-676125495 description', 'project_id': '1d10b4824e524068827e58b55e269af3'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:48.193918 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-53805ae0-758e-4e87-918e-6ea30edf2480 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:48.220202 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1829db5c-399e-4fe6-b807-37693232dc95 req-4535f73f-a54f-4eeb-b6e1-b67a6c6f900e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:48.221674 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1829db5c-399e-4fe6-b807-37693232dc95 req-4535f73f-a54f-4eeb-b6e1-b67a6c6f900e service neutron] 10.222.0.26 "GET /v2.0/subnets?id=b2956e71-9b0f-4060-922c-e54ce6cff80a HTTP/1.1" status: 200 len: 851 time: 0.1410425 Nov 09 04:33:48.231997 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [None req-53805ae0-758e-4e87-918e-6ea30edf2480 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] device_id is not set on port f452b4de-19e9-486c-bfb2-84e410a2350d yet. {{(pid=102161) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:33:48.259793 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6866e5ca-e12d-4c9c-a735-f185755ca388 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-988d2354-693c-4d52-af17-25e0643eaa0c', 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'tenant_id': '8b0758f781884982bf5b94e6609237f6', 'fixed_ips': [{'subnet_id': 'f0e6a3fd-b04a-4b95-8ac0-a5861c3c56b9'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:33:48.260661 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6866e5ca-e12d-4c9c-a735-f185755ca388 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:48.265721 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-04bf4506-3de5-4fe3-ae76-07f510e43673 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:48.321447 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-04bf4506-3de5-4fe3-ae76-07f510e43673 None None] For port 9930d582-2262-4f1d-97bf-b02697a70777, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=9930d582-2262-4f1d-97bf-b02697a70777,segment=NetworkSegment(7befff96-69ce-4b76-b9cc-7561279d57a7),segment_id=7befff96-69ce-4b76-b9cc-7561279d57a7)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:33:48.360889 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e962b621-052e-42a1-bfd0-67eb81cfc8ba tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:48.402738 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc8c2960-48d4-43bd-9cc6-64e583b97745 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Pushing event updated for resources: {'Network': ['ID=83b7fb07-746c-4cc1-a582-519bfb1e5896,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:48.411422 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-53805ae0-758e-4e87-918e-6ea30edf2480 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Allocated IP 2001:db8::f816:3eff:fe8d:ffe5 (988d2354-693c-4d52-af17-25e0643eaa0c/f0e6a3fd-b04a-4b95-8ac0-a5861c3c56b9/f452b4de-19e9-486c-bfb2-84e410a2350d) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:33:48.421610 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1829db5c-399e-4fe6-b807-37693232dc95 req-548e34ee-b226-4998-8487-3d9d72bf5064 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:48.423219 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1829db5c-399e-4fe6-b807-37693232dc95 req-548e34ee-b226-4998-8487-3d9d72bf5064 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=a270b61c-1f4f-4d97-be79-4a24c65fddc2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1848574 Nov 09 04:33:48.445121 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.ipam_backend_mixin [None req-dc763e88-1908-42b2-b3c6-c45863d1ba55 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet 35a4ba3b-99b7-4b1f-9549-2fc042f492d9 (CIDR: 2001:db8::/64) Nov 09 04:33:48.492690 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 83b7fb07-746c-4cc1-a582-519bfb1e5896 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:33:48.500784 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-cc8c2960-48d4-43bd-9cc6-64e583b97745 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 791 time: 1.8574178 Nov 09 04:33:48.503644 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57374) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:48.508491 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-c26ee974-809e-45a4-b420-d36ae1e130d7 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Request body: {'subnet': {'network_id': '83b7fb07-746c-4cc1-a582-519bfb1e5896', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:48.522664 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e962b621-052e-42a1-bfd0-67eb81cfc8ba tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:48.581512 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-dc763e88-1908-42b2-b3c6-c45863d1ba55 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:33:48.581512 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-dc763e88-1908-42b2-b3c6-c45863d1ba55 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:33:48.582835 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-04bf4506-3de5-4fe3-ae76-07f510e43673 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:48.604017 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e962b621-052e-42a1-bfd0-67eb81cfc8ba tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:48.634876 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1829db5c-399e-4fe6-b807-37693232dc95 req-1b459c1b-43f6-41cb-8b07-23dd160fc2bf service neutron] 10.222.0.26 "GET /v2.0/networks/a270b61c-1f4f-4d97-be79-4a24c65fddc2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2023890 Nov 09 04:33:48.661699 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-04bf4506-3de5-4fe3-ae76-07f510e43673 None None] Provisioning complete for port 0c829017-1d45-4280-bb1e-aecb67547f76 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:48.662075 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-04bf4506-3de5-4fe3-ae76-07f510e43673 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:48.681681 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e962b621-052e-42a1-bfd0-67eb81cfc8ba tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroup': ['ID=99157167-0266-49ff-809e-cf8a91af8ae5,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:48.705551 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04bf4506-3de5-4fe3-ae76-07f510e43673 None None] Pushing event updated for resources: {'Port': ['ID=9930d582-2262-4f1d-97bf-b02697a70777,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:48.709871 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-dc763e88-1908-42b2-b3c6-c45863d1ba55 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 1.0843556 Nov 09 04:33:48.712551 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57378) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:48.717486 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-a10ea1ae-ad25-49c3-9297-d07222abd35c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Request body: {'subnet': {'network_id': '002d27a0-2fb8-4426-9550-42c444556a8e', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:48.736968 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e962b621-052e-42a1-bfd0-67eb81cfc8ba tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:48.738335 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-e962b621-052e-42a1-bfd0-67eb81cfc8ba tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.5626917 Nov 09 04:33:48.741182 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57380) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:48.746921 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-c12e081a-898f-4956-8ad6-f146f9c1d5c5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': '99157167-0266-49ff-809e-cf8a91af8ae5', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:48.760319 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-53805ae0-758e-4e87-918e-6ea30edf2480 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:48.863748 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-53805ae0-758e-4e87-918e-6ea30edf2480 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:48.939469 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 9930d582-2262-4f1d-97bf-b02697a70777 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:33:48.973031 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-53805ae0-758e-4e87-918e-6ea30edf2480 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:33:48.981020 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-6866e5ca-e12d-4c9c-a735-f185755ca388 None None] Allocated IP 2001:db8::f816:3eff:fe97:b226 (988d2354-693c-4d52-af17-25e0643eaa0c/f0e6a3fd-b04a-4b95-8ac0-a5861c3c56b9/b1aa2704-ca80-4686-b1f3-af5269a76858) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:33:49.005289 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-846ce7c9-ce9a-43aa-ae3e-f699990eb63f None None] Provisioning complete for port 4755a8a5-1dbb-40bb-87cc-56df38d0632c triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:49.005775 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-846ce7c9-ce9a-43aa-ae3e-f699990eb63f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:49.028191 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-53805ae0-758e-4e87-918e-6ea30edf2480 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:33:49.031196 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53805ae0-758e-4e87-918e-6ea30edf2480 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Port': ['ID=f452b4de-19e9-486c-bfb2-84e410a2350d,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:49.042391 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-53805ae0-758e-4e87-918e-6ea30edf2480 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:33:49.046922 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-846ce7c9-ce9a-43aa-ae3e-f699990eb63f None None] Port 4755a8a5-1dbb-40bb-87cc-56df38d0632c cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:33:49.050327 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-53805ae0-758e-4e87-918e-6ea30edf2480 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:49.051868 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-53805ae0-758e-4e87-918e-6ea30edf2480 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:49.079370 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3700763-9bfa-4392-9fcc-2f4e1090621e req-1d84f49c-c829-44b0-a639-397f4c0de6d5 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:49.088284 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c3700763-9bfa-4392-9fcc-2f4e1090621e req-1d84f49c-c829-44b0-a639-397f4c0de6d5 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 945 time: 0.1417871 Nov 09 04:33:49.112563 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-846ce7c9-ce9a-43aa-ae3e-f699990eb63f None None] Provisioning complete for port 9930d582-2262-4f1d-97bf-b02697a70777 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:49.113578 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-846ce7c9-ce9a-43aa-ae3e-f699990eb63f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:49.149309 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c3700763-9bfa-4392-9fcc-2f4e1090621e req-54d99c5d-f80f-42c4-9144-24571801507f tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0597963 Nov 09 04:33:49.150859 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 9930d582-2262-4f1d-97bf-b02697a70777 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:49.151306 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:49.291501 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1829db5c-399e-4fe6-b807-37693232dc95 req-33bb7678-ea70-47ea-abf3-9288e1782a01 service neutron] 10.222.0.26 "GET /v2.0/networks/a270b61c-1f4f-4d97-be79-4a24c65fddc2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6497028 Nov 09 04:33:49.305674 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16b5f8b7-e87d-41cb-828d-0e7c3fa981ce req-7597551e-e70f-4b13-9c39-59d4daeb9b13 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:49.313118 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-16b5f8b7-e87d-41cb-828d-0e7c3fa981ce req-7597551e-e70f-4b13-9c39-59d4daeb9b13 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/ports?device_id=e145337f-88ba-4f6d-a894-39631a8dd013 HTTP/1.1" status: 200 len: 945 time: 0.5488584 Nov 09 04:33:49.332225 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c26ee974-809e-45a4-b420-d36ae1e130d7 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Made reservation on behalf of 4b395c2f9c4f482198ab37eb736cc2fe for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:33:49.335653 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c26ee974-809e-45a4-b420-d36ae1e130d7 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:49.365721 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6866e5ca-e12d-4c9c-a735-f185755ca388 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:49.417478 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-53805ae0-758e-4e87-918e-6ea30edf2480 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 947 time: 1.6863840 Nov 09 04:33:49.419189 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57384) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:49.455052 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-16b5f8b7-e87d-41cb-828d-0e7c3fa981ce req-a4c88654-2d1e-4294-8512-b2cbd2e5a6b8 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/security-groups?id=8fd0adbd-57c5-4583-8e2d-9a55d7973976&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1409383 Nov 09 04:33:49.459149 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6866e5ca-e12d-4c9c-a735-f185755ca388 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:49.480033 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6d27e971-d8bf-4d00-9c95-8a56e684ea5a tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:49.484072 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-6d27e971-d8bf-4d00-9c95-8a56e684ea5a tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/ports HTTP/1.1" status: 200 len: 945 time: 0.0625594 Nov 09 04:33:49.484547 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57386) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:49.523594 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6866e5ca-e12d-4c9c-a735-f185755ca388 None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:33:49.531479 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-6866e5ca-e12d-4c9c-a735-f185755ca388 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:33:49.535566 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c12e081a-898f-4956-8ad6-f146f9c1d5c5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:49.537949 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6866e5ca-e12d-4c9c-a735-f185755ca388 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:33:49.552363 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6866e5ca-e12d-4c9c-a735-f185755ca388 None None] Pushing event updated for resources: {'Port': ['ID=b1aa2704-ca80-4686-b1f3-af5269a76858,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:49.618021 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-6866e5ca-e12d-4c9c-a735-f185755ca388 None None] Attempting to bind port b1aa2704-ca80-4686-b1f3-af5269a76858 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:33:49.618749 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-6866e5ca-e12d-4c9c-a735-f185755ca388 None None] Attempting to bind port b1aa2704-ca80-4686-b1f3-af5269a76858 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:33:49.619057 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6866e5ca-e12d-4c9c-a735-f185755ca388 None None] Attempting to bind port b1aa2704-ca80-4686-b1f3-af5269a76858 on network 988d2354-693c-4d52-af17-25e0643eaa0c {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:33:49.624135 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6866e5ca-e12d-4c9c-a735-f185755ca388 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 33, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:33:49.624602 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6866e5ca-e12d-4c9c-a735-f185755ca388 None None] Checking segment: {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:33:49.625062 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6866e5ca-e12d-4c9c-a735-f185755ca388 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:49.625526 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6866e5ca-e12d-4c9c-a735-f185755ca388 None None] Bound using segment: {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:33:49.626063 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-6866e5ca-e12d-4c9c-a735-f185755ca388 None None] Bound port: b1aa2704-ca80-4686-b1f3-af5269a76858, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:33:49.626472 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6866e5ca-e12d-4c9c-a735-f185755ca388 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:49.685327 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c12e081a-898f-4956-8ad6-f146f9c1d5c5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:49.687327 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a10ea1ae-ad25-49c3-9297-d07222abd35c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Made reservation on behalf of 12e47d8445b5429892cd1b9244512ca8 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:33:49.692048 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a10ea1ae-ad25-49c3-9297-d07222abd35c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:49.703300 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fc3702e-74df-42fe-9293-a1ab0388d50e req-24c8c97f-b926-4981-8e94-d2662683f5d1 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:49.704983 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-8fc3702e-74df-42fe-9293-a1ab0388d50e req-24c8c97f-b926-4981-8e94-d2662683f5d1 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/ports?device_id=e145337f-88ba-4f6d-a894-39631a8dd013 HTTP/1.1" status: 200 len: 945 time: 0.1302264 Nov 09 04:33:49.711073 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c26ee974-809e-45a4-b420-d36ae1e130d7 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:49.716435 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-6866e5ca-e12d-4c9c-a735-f185755ca388 None None] For port b1aa2704-ca80-4686-b1f3-af5269a76858, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:33:49.719782 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-6866e5ca-e12d-4c9c-a735-f185755ca388 None None] For port b1aa2704-ca80-4686-b1f3-af5269a76858, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=b1aa2704-ca80-4686-b1f3-af5269a76858,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:33:49.734402 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-da672bb8-3754-4fd7-9e05-5da62e1fcece tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Deleting port f452b4de-19e9-486c-bfb2-84e410a2350d {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:33:49.734740 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-da672bb8-3754-4fd7-9e05-5da62e1fcece tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:49.805315 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c12e081a-898f-4956-8ad6-f146f9c1d5c5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:49.837611 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c26ee974-809e-45a4-b420-d36ae1e130d7 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Pushing event updated for resources: {'Subnet': ['ID=e2e8c027-b8d8-4759-88db-fcda9b0dfe5f,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:49.842936 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6866e5ca-e12d-4c9c-a735-f185755ca388 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:49.849480 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-8fc3702e-74df-42fe-9293-a1ab0388d50e req-83d75a8a-6e0e-4578-93e9-bb8765d80c3f tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/security-groups?id=8fd0adbd-57c5-4583-8e2d-9a55d7973976&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1272581 Nov 09 04:33:49.851504 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c12e081a-898f-4956-8ad6-f146f9c1d5c5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1d92f156-411b-4c0c-ae1b-3d0e0b111286,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:49.857600 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c26ee974-809e-45a4-b420-d36ae1e130d7 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Checking segment: {'id': '9c8c26ad-778e-46c6-99ba-e8e770604064', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 344, 'network_id': '83b7fb07-746c-4cc1-a582-519bfb1e5896'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:33:49.857961 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c26ee974-809e-45a4-b420-d36ae1e130d7 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Network hostable DHCP agents. Network: 83b7fb07-746c-4cc1-a582-519bfb1e5896, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:33:49.862281 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.ipam_backend_mixin [None req-a10ea1ae-ad25-49c3-9297-d07222abd35c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Validation for CIDR: 2001:db8:0:1::/64 failed - overlaps with subnet df5c0c2e-73f1-4f11-bae4-c9e63a6467fc (CIDR: 2001:db8:0:1::/64) Nov 09 04:33:49.902011 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-da672bb8-3754-4fd7-9e05-5da62e1fcece tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:49.905285 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-a10ea1ae-ad25-49c3-9297-d07222abd35c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:33:49.905736 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a10ea1ae-ad25-49c3-9297-d07222abd35c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:33:49.922464 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-da672bb8-3754-4fd7-9e05-5da62e1fcece tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Calling delete_port for f452b4de-19e9-486c-bfb2-84e410a2350d owned by {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:33:49.940652 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6866e5ca-e12d-4c9c-a735-f185755ca388 None None] Pushing event updated for resources: {'Port': ['ID=b1aa2704-ca80-4686-b1f3-af5269a76858,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:49.942021 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c12e081a-898f-4956-8ad6-f146f9c1d5c5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:49.946268 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-c12e081a-898f-4956-8ad6-f146f9c1d5c5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 1.2012720 Nov 09 04:33:49.946268 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57392) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:49.950728 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-c3f22c73-eb11-4c8a-9d11-41f02f10ab1f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': '99157167-0266-49ff-809e-cf8a91af8ae5', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:49.974071 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c26ee974-809e-45a4-b420-d36ae1e130d7 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Network 83b7fb07-746c-4cc1-a582-519bfb1e5896 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:33:50.032069 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a10ea1ae-ad25-49c3-9297-d07222abd35c tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 428 time: 1.3182981 Nov 09 04:33:50.038295 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57394) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:50.040559 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-740e7e40-e64a-43a5-9282-cae9d455f8f6 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Request body: {'subnet': {'network_id': '002d27a0-2fb8-4426-9550-42c444556a8e', 'cidr': '2001:db8:0:2::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:2::1'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:50.071819 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-c26ee974-809e-45a4-b420-d36ae1e130d7 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 83b7fb07-746c-4cc1-a582-519bfb1e5896) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:33:50.086241 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c26ee974-809e-45a4-b420-d36ae1e130d7 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:50.086982 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c26ee974-809e-45a4-b420-d36ae1e130d7 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:50.087329 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-70b88863-2156-4147-a201-f42343aebc41 None None] Network 83b7fb07-746c-4cc1-a582-519bfb1e5896 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:33:50.173158 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c3f22c73-eb11-4c8a-9d11-41f02f10ab1f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:50.193445 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-da672bb8-3754-4fd7-9e05-5da62e1fcece tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:50.244970 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da672bb8-3754-4fd7-9e05-5da62e1fcece tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event deleted for resources: {'Port': ['ID=f452b4de-19e9-486c-bfb2-84e410a2350d,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:50.291100 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-c26ee974-809e-45a4-b420-d36ae1e130d7 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.7862835 Nov 09 04:33:50.294488 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57398) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:50.299717 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-52a0a2ea-5118-41e9-9eb5-963dbb2dd856 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Request body: {'network': {'name': 'tempest-router-network01--1606729523'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:50.313340 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-da672bb8-3754-4fd7-9e05-5da62e1fcece tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:50.315820 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f3d12829-2d82-4101-b1f2-3db9789ebcbc None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-83b7fb07-746c-4cc1-a582-519bfb1e5896', 'network_id': '83b7fb07-746c-4cc1-a582-519bfb1e5896', 'tenant_id': '4b395c2f9c4f482198ab37eb736cc2fe', 'fixed_ips': [{'subnet_id': 'e2e8c027-b8d8-4759-88db-fcda9b0dfe5f'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:33:50.319355 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-da672bb8-3754-4fd7-9e05-5da62e1fcece tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/ports/f452b4de-19e9-486c-bfb2-84e410a2350d HTTP/1.1" status: 204 len: 168 time: 0.8316171 Nov 09 04:33:50.319607 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f3d12829-2d82-4101-b1f2-3db9789ebcbc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:50.319834 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57400) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:50.365709 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-740e7e40-e64a-43a5-9282-cae9d455f8f6 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Made reservation on behalf of 12e47d8445b5429892cd1b9244512ca8 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:33:50.366389 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c3f22c73-eb11-4c8a-9d11-41f02f10ab1f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:50.374177 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-740e7e40-e64a-43a5-9282-cae9d455f8f6 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:50.383653 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3424bed3-04e8-42bc-b38f-35c7e15563b1 req-ee25dc87-0546-4a23-b0b5-6def1ec06d93 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:50.385125 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-3424bed3-04e8-42bc-b38f-35c7e15563b1 req-ee25dc87-0546-4a23-b0b5-6def1ec06d93 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 945 time: 0.1380162 Nov 09 04:33:50.424965 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f6fe51c6-b051-44dd-a41a-528b850ccd60 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:50.426878 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f6fe51c6-b051-44dd-a41a-528b850ccd60 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:50.428606 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-f6fe51c6-b051-44dd-a41a-528b850ccd60 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1465 time: 0.1071880 Nov 09 04:33:50.435592 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57404) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:50.467324 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:33:50.491091 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-3424bed3-04e8-42bc-b38f-35c7e15563b1 req-88f61da5-368d-46a3-9946-743db6199763 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0988564 Nov 09 04:33:50.500336 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c3f22c73-eb11-4c8a-9d11-41f02f10ab1f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:50.506769 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-272616db-4c64-4f24-8f9e-5fce7e9ac268 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Deleting subnet f0e6a3fd-b04a-4b95-8ac0-a5861c3c56b9 {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:33:50.511207 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-f3d12829-2d82-4101-b1f2-3db9789ebcbc None None] Allocated IP 2001:db8::2 (83b7fb07-746c-4cc1-a582-519bfb1e5896/e2e8c027-b8d8-4759-88db-fcda9b0dfe5f/3fc210b0-8ace-4199-af3c-2296f979b045) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:33:50.513950 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-272616db-4c64-4f24-8f9e-5fce7e9ac268 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:50.531357 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-52a0a2ea-5118-41e9-9eb5-963dbb2dd856 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Made reservation on behalf of 4b395c2f9c4f482198ab37eb736cc2fe for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:33:50.535049 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-52a0a2ea-5118-41e9-9eb5-963dbb2dd856 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:50.568694 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3f22c73-eb11-4c8a-9d11-41f02f10ab1f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c6721c72-c02e-41b6-8910-bcd178164030,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:50.588048 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-52a0a2ea-5118-41e9-9eb5-963dbb2dd856 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 301} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:33:50.604816 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a964a0f-f8bb-4005-87a9-0d00a8b45ed5 req-895063b2-170b-46bc-9185-eb330db05a77 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:50.606608 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8a964a0f-f8bb-4005-87a9-0d00a8b45ed5 req-895063b2-170b-46bc-9185-eb330db05a77 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/ports?device_id=e145337f-88ba-4f6d-a894-39631a8dd013 HTTP/1.1" status: 200 len: 945 time: 0.1505558 Nov 09 04:33:50.610913 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-272616db-4c64-4f24-8f9e-5fce7e9ac268 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:50.621183 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-52a0a2ea-5118-41e9-9eb5-963dbb2dd856 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:50.621528 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-52a0a2ea-5118-41e9-9eb5-963dbb2dd856 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Added segment addb7209-a504-42b8-926e-099777f05856 of type vlan for network 6d014a7c-bf55-403c-8b12-11032e94df30 Nov 09 04:33:50.688595 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f3d12829-2d82-4101-b1f2-3db9789ebcbc None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:50.692954 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9dcbd28b-459b-43d4-a387-60db545eaf7c req-9f374ec3-e513-4024-9e5a-80f095d3f885 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:50.694713 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-9dcbd28b-459b-43d4-a387-60db545eaf7c req-9f374ec3-e513-4024-9e5a-80f095d3f885 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 945 time: 0.1064193 Nov 09 04:33:50.700192 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c3f22c73-eb11-4c8a-9d11-41f02f10ab1f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:50.701399 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-c3f22c73-eb11-4c8a-9d11-41f02f10ab1f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.7542975 Nov 09 04:33:50.715378 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-52a0a2ea-5118-41e9-9eb5-963dbb2dd856 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:50.718638 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57408) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:50.729636 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-03a4a258-19e1-4f39-9404-ede9228051af tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': '99157167-0266-49ff-809e-cf8a91af8ae5', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:50.772208 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f3d12829-2d82-4101-b1f2-3db9789ebcbc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:50.774871 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8a964a0f-f8bb-4005-87a9-0d00a8b45ed5 req-aaa681b2-c310-4fce-b030-5d88afab8933 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/security-groups?id=8fd0adbd-57c5-4583-8e2d-9a55d7973976&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1516936 Nov 09 04:33:50.785451 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-272616db-4c64-4f24-8f9e-5fce7e9ac268 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:50.820400 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f3d12829-2d82-4101-b1f2-3db9789ebcbc None None] Network 83b7fb07-746c-4cc1-a582-519bfb1e5896 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:33:50.826703 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-f3d12829-2d82-4101-b1f2-3db9789ebcbc None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:33:50.838285 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f3d12829-2d82-4101-b1f2-3db9789ebcbc None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:33:50.846567 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-9dcbd28b-459b-43d4-a387-60db545eaf7c req-a06c9698-0354-4b9d-bb87-a46a295fac9b tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1268599 Nov 09 04:33:50.853215 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3d12829-2d82-4101-b1f2-3db9789ebcbc None None] Pushing event updated for resources: {'Port': ['ID=3fc210b0-8ace-4199-af3c-2296f979b045,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:50.899920 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-52a0a2ea-5118-41e9-9eb5-963dbb2dd856 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:50.906857 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-03a4a258-19e1-4f39-9404-ede9228051af tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:50.918912 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-52a0a2ea-5118-41e9-9eb5-963dbb2dd856 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:50.919556 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-52a0a2ea-5118-41e9-9eb5-963dbb2dd856 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:50.984495 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-03a4a258-19e1-4f39-9404-ede9228051af tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:51.003860 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device b1aa2704-ca80-4686-b1f3-af5269a76858 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:33:51.031824 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-272616db-4c64-4f24-8f9e-5fce7e9ac268 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:51.032815 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-f3d12829-2d82-4101-b1f2-3db9789ebcbc None None] Attempting to bind port 3fc210b0-8ace-4199-af3c-2296f979b045 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:33:51.033180 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-f3d12829-2d82-4101-b1f2-3db9789ebcbc None None] Attempting to bind port 3fc210b0-8ace-4199-af3c-2296f979b045 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '9c8c26ad-778e-46c6-99ba-e8e770604064', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 344, 'network_id': '83b7fb07-746c-4cc1-a582-519bfb1e5896'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:33:51.033774 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f3d12829-2d82-4101-b1f2-3db9789ebcbc None None] Attempting to bind port 3fc210b0-8ace-4199-af3c-2296f979b045 on network 83b7fb07-746c-4cc1-a582-519bfb1e5896 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:33:51.054074 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f3d12829-2d82-4101-b1f2-3db9789ebcbc None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 33, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:33:51.054471 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f3d12829-2d82-4101-b1f2-3db9789ebcbc None None] Checking segment: {'id': '9c8c26ad-778e-46c6-99ba-e8e770604064', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 344, 'network_id': '83b7fb07-746c-4cc1-a582-519bfb1e5896'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:33:51.054929 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f3d12829-2d82-4101-b1f2-3db9789ebcbc None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:51.055264 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f3d12829-2d82-4101-b1f2-3db9789ebcbc None None] Bound using segment: {'id': '9c8c26ad-778e-46c6-99ba-e8e770604064', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 344, 'network_id': '83b7fb07-746c-4cc1-a582-519bfb1e5896'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:33:51.055750 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-f3d12829-2d82-4101-b1f2-3db9789ebcbc None None] Bound port: 3fc210b0-8ace-4199-af3c-2296f979b045, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9c8c26ad-778e-46c6-99ba-e8e770604064', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 344, 'network_id': '83b7fb07-746c-4cc1-a582-519bfb1e5896'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:33:51.056128 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f3d12829-2d82-4101-b1f2-3db9789ebcbc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:51.068260 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52a0a2ea-5118-41e9-9eb5-963dbb2dd856 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Pushing event updated for resources: {'Network': ['ID=6d014a7c-bf55-403c-8b12-11032e94df30,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:51.095573 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c68243d8-d99d-451a-a0e1-ff8788ad8d6b req-c5f5d764-7791-46de-84e1-2a25593ad163 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:51.096813 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-272616db-4c64-4f24-8f9e-5fce7e9ac268 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:51.103817 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-272616db-4c64-4f24-8f9e-5fce7e9ac268 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/f0e6a3fd-b04a-4b95-8ac0-a5861c3c56b9 HTTP/1.1" status: 204 len: 168 time: 0.6709707 Nov 09 04:33:51.104932 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c68243d8-d99d-451a-a0e1-ff8788ad8d6b req-c5f5d764-7791-46de-84e1-2a25593ad163 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 945 time: 0.1102371 Nov 09 04:33:51.106830 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57412) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:51.110083 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-272616db-4c64-4f24-8f9e-5fce7e9ac268 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event deleted for resources: {'Subnet': ['ID=f0e6a3fd-b04a-4b95-8ac0-a5861c3c56b9,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:51.111617 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 6d014a7c-bf55-403c-8b12-11032e94df30 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:33:51.113928 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-03a4a258-19e1-4f39-9404-ede9228051af tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:51.122741 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-740e7e40-e64a-43a5-9282-cae9d455f8f6 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:51.131778 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03a4a258-19e1-4f39-9404-ede9228051af tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9364b219-6397-4976-bdcd-131dfa5e5c4b,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:51.203804 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-aa883b66-f90e-4c13-94b9-635d9d486631 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0947094 Nov 09 04:33:51.206480 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57414) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:51.211902 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-52a0a2ea-5118-41e9-9eb5-963dbb2dd856 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 0.9159114 Nov 09 04:33:51.218080 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57416) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:51.220059 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-740e7e40-e64a-43a5-9282-cae9d455f8f6 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Network 002d27a0-2fb8-4426-9550-42c444556a8e is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:33:51.220954 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-f3d12829-2d82-4101-b1f2-3db9789ebcbc None None] For port 3fc210b0-8ace-4199-af3c-2296f979b045, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:33:51.223716 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port b1aa2704-ca80-4686-b1f3-af5269a76858 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:51.224084 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:51.226401 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-5ce0e572-e187-444e-a4fa-340612a0508d tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Request body: {'network': {'name': 'tempest-router-network02--913097239'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:51.226653 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-f3d12829-2d82-4101-b1f2-3db9789ebcbc None None] For port 3fc210b0-8ace-4199-af3c-2296f979b045, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=3fc210b0-8ace-4199-af3c-2296f979b045,segment=NetworkSegment(9c8c26ad-778e-46c6-99ba-e8e770604064),segment_id=9c8c26ad-778e-46c6-99ba-e8e770604064)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:33:51.236864 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-740e7e40-e64a-43a5-9282-cae9d455f8f6 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:33:51.249949 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4cbc3808-ea75-4e23-ac93-7b1b7fe54bb8 None None] Network 002d27a0-2fb8-4426-9550-42c444556a8e requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:33:51.252275 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-740e7e40-e64a-43a5-9282-cae9d455f8f6 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:51.252885 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-740e7e40-e64a-43a5-9282-cae9d455f8f6 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:51.268984 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-03a4a258-19e1-4f39-9404-ede9228051af tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:51.269865 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bb95d56e-1b88-4b04-bc66-0e00c07eeae8 None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:33:51.274286 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-03a4a258-19e1-4f39-9404-ede9228051af tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.5444586 Nov 09 04:33:51.274286 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57418) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:51.280150 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-1b6ccff8-fcd1-4b76-b9d3-f1ce3536494e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': '99157167-0266-49ff-809e-cf8a91af8ae5', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:51.285927 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-740e7e40-e64a-43a5-9282-cae9d455f8f6 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event updated for resources: {'Subnet': ['ID=61ce5dc1-9280-42d2-b96d-6453d586ce66,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:51.300077 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c68243d8-d99d-451a-a0e1-ff8788ad8d6b req-9cc4b01a-2ecc-4565-a4c9-ef5c5592ccfb tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1929133 Nov 09 04:33:51.305890 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8d14bbf0-74b9-46c3-b084-d6787bc14553 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:51.310333 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-8d14bbf0-74b9-46c3-b084-d6787bc14553 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/ports HTTP/1.1" status: 200 len: 864 time: 0.1017022 Nov 09 04:33:51.310837 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57420) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:51.346312 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f3d12829-2d82-4101-b1f2-3db9789ebcbc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:51.365144 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5ce0e572-e187-444e-a4fa-340612a0508d tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Made reservation on behalf of 4b395c2f9c4f482198ab37eb736cc2fe for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:33:51.368664 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5ce0e572-e187-444e-a4fa-340612a0508d tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:51.373992 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-585905f5-057e-4e25-b02c-89a8fb3e5743 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:51.375502 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-585905f5-057e-4e25-b02c-89a8fb3e5743 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.0636935 Nov 09 04:33:51.378938 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57424) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:51.397916 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5ce0e572-e187-444e-a4fa-340612a0508d tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 310} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:33:51.410679 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5ce0e572-e187-444e-a4fa-340612a0508d tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:51.411078 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-5ce0e572-e187-444e-a4fa-340612a0508d tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Added segment 01c8e428-6cb4-4160-9a48-6a294a0d7cc0 of type vlan for network fc71b887-9046-44cb-986d-dfe03d43967a Nov 09 04:33:51.444537 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-ff7d55fd-4c83-4283-9690-22a2293e2bf3 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0643554 Nov 09 04:33:51.445504 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57426) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:51.451916 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-d5d0ae40-6c78-468c-9dca-ac73e17671c7 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'subnet': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:51.467323 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-740e7e40-e64a-43a5-9282-cae9d455f8f6 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 836 time: 1.4307277 Nov 09 04:33:51.469844 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57428) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:51.474111 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5ce0e572-e187-444e-a4fa-340612a0508d tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:51.479951 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-ff645684-4d2f-481c-8ec8-2bdc1aa2df16 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Request body: {'port': {'name': 'tempest-PortsIpV6TestJSON-1421758323', 'admin_state_up': False, 'fixed_ips': [{'subnet_id': '61ce5dc1-9280-42d2-b96d-6453d586ce66'}], 'security_groups': ['f74c848a-351e-49f1-bf42-2cd07cefe6f9', '0747fda9-7fb9-4f58-9f75-ef05efa51913']}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:51.641592 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-6f9a7334-6d3c-4731-b3bd-64b40facef95 None None] Provisioning complete for port b1aa2704-ca80-4686-b1f3-af5269a76858 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:51.641955 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6f9a7334-6d3c-4731-b3bd-64b40facef95 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:51.655210 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5ce0e572-e187-444e-a4fa-340612a0508d tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:51.671560 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5ce0e572-e187-444e-a4fa-340612a0508d tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:51.673204 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5ce0e572-e187-444e-a4fa-340612a0508d tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:51.706095 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3d12829-2d82-4101-b1f2-3db9789ebcbc None None] Pushing event updated for resources: {'Port': ['ID=3fc210b0-8ace-4199-af3c-2296f979b045,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:51.714934 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1b6ccff8-fcd1-4b76-b9d3-f1ce3536494e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:51.816624 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:51.939910 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port b1aa2704-ca80-4686-b1f3-af5269a76858, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=b1aa2704-ca80-4686-b1f3-af5269a76858,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:33:51.946832 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ce0e572-e187-444e-a4fa-340612a0508d tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Pushing event updated for resources: {'Network': ['ID=fc71b887-9046-44cb-986d-dfe03d43967a,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:51.947499 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1b6ccff8-fcd1-4b76-b9d3-f1ce3536494e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:51.948761 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d5d0ae40-6c78-468c-9dca-ac73e17671c7 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:33:51.951825 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d5d0ae40-6c78-468c-9dca-ac73e17671c7 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:51.962478 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network fc71b887-9046-44cb-986d-dfe03d43967a details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:33:51.977758 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6f9a7334-6d3c-4731-b3bd-64b40facef95 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:51.985447 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ff645684-4d2f-481c-8ec8-2bdc1aa2df16 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:52.023462 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-5ce0e572-e187-444e-a4fa-340612a0508d tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 771 time: 0.8014686 Nov 09 04:33:52.024088 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57434) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:52.031024 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1b6ccff8-fcd1-4b76-b9d3-f1ce3536494e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:52.036229 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-b4db51cd-bacd-41be-bf2f-f41f5e9d3c6f tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Request body: {'subnet': {'network_id': '6d014a7c-bf55-403c-8b12-11032e94df30', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:52.039334 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-72fe4f01-b41a-44c9-aa31-62bcb0c83b96 None None] DHCP port deletion for 988d2354-693c-4d52-af17-25e0643eaa0c request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:33:52.045454 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:52.049130 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d66f77c2-5f26-4923-9e7f-50fe1f4a0930 req-a5fcb39e-e579-438e-9972-0832cef5026a tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:52.051068 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d66f77c2-5f26-4923-9e7f-50fe1f4a0930 req-a5fcb39e-e579-438e-9972-0832cef5026a tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 945 time: 0.2150593 Nov 09 04:33:52.183807 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4273639d-fc3c-4fad-8fb6-fe2dd1c4c921 None None] Update dhcp port {'port': {'network_id': '002d27a0-2fb8-4426-9550-42c444556a8e', 'fixed_ips': [{'subnet_id': 'df5c0c2e-73f1-4f11-bae4-c9e63a6467fc', 'ip_address': '2001:db8:0:1::2'}, {'subnet_id': '35a4ba3b-99b7-4b1f-9549-2fc042f492d9', 'ip_address': '2001:db8::2'}, {'subnet_id': '61ce5dc1-9280-42d2-b96d-6453d586ce66'}], 'binding:host_id': 'dv-neutron-816802-2-hyperv'}, 'id': 'c315ee21-870f-44c3-b604-c4eb34ea288a'} from dv-neutron-816802-2-hyperv. {{(pid=102163) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:328}} Nov 09 04:33:52.219011 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=b1aa2704-ca80-4686-b1f3-af5269a76858,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:52.225275 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.db.api [None req-6f9a7334-6d3c-4731-b3bd-64b40facef95 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=102163) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:33:52.225628 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG oslo_db.api [None req-6f9a7334-6d3c-4731-b3bd-64b40facef95 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:33:52.233257 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4273639d-fc3c-4fad-8fb6-fe2dd1c4c921 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:52.235927 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d66f77c2-5f26-4923-9e7f-50fe1f4a0930 req-e4f9339c-7a72-42f0-842f-16efcc133c04 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1695337 Nov 09 04:33:52.287260 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-72fe4f01-b41a-44c9-aa31-62bcb0c83b96 None None] Deleting port b1aa2704-ca80-4686-b1f3-af5269a76858 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:33:52.287623 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-72fe4f01-b41a-44c9-aa31-62bcb0c83b96 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:52.383577 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b4db51cd-bacd-41be-bf2f-f41f5e9d3c6f tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Made reservation on behalf of 4b395c2f9c4f482198ab37eb736cc2fe for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:33:52.392450 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b4db51cd-bacd-41be-bf2f-f41f5e9d3c6f tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:52.444939 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-72fe4f01-b41a-44c9-aa31-62bcb0c83b96 None None] For port b1aa2704-ca80-4686-b1f3-af5269a76858, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=b1aa2704-ca80-4686-b1f3-af5269a76858,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:33:52.445837 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-72fe4f01-b41a-44c9-aa31-62bcb0c83b96 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:52.489349 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-72fe4f01-b41a-44c9-aa31-62bcb0c83b96 None None] Calling delete_port for b1aa2704-ca80-4686-b1f3-af5269a76858 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:33:52.497831 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b6ccff8-fcd1-4b76-b9d3-f1ce3536494e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=40fb3131-7c21-4d1d-8dce-50f31664c242,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:52.515348 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50d9709c-87fd-47f8-88be-90083943b0b7 req-3a774425-c79c-461c-b712-bac4b66e9d5a tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:52.522873 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-50d9709c-87fd-47f8-88be-90083943b0b7 req-3a774425-c79c-461c-b712-bac4b66e9d5a tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/ports?device_id=e145337f-88ba-4f6d-a894-39631a8dd013 HTTP/1.1" status: 200 len: 945 time: 0.6198871 Nov 09 04:33:52.598085 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-50d9709c-87fd-47f8-88be-90083943b0b7 req-42259cc1-78dd-49e5-83a1-020977f776ce tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/security-groups?id=8fd0adbd-57c5-4583-8e2d-9a55d7973976&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0732365 Nov 09 04:33:52.633491 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1b6ccff8-fcd1-4b76-b9d3-f1ce3536494e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:52.638267 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1b6ccff8-fcd1-4b76-b9d3-f1ce3536494e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 1.3629007 Nov 09 04:33:52.652041 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57438) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:52.670669 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-83734498-6086-4d41-9706-b906dccbd61c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': '99157167-0266-49ff-809e-cf8a91af8ae5', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:52.697631 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-ff645684-4d2f-481c-8ec8-2bdc1aa2df16 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Delete allocated IP 2001:db8::2ca (002d27a0-2fb8-4426-9550-42c444556a8e/35a4ba3b-99b7-4b1f-9549-2fc042f492d9) {{(pid=102162) _delete_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:118}} Nov 09 04:33:52.752575 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-ff645684-4d2f-481c-8ec8-2bdc1aa2df16 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Allocated IP 2001:db8:0:2::ff (002d27a0-2fb8-4426-9550-42c444556a8e/61ce5dc1-9280-42d2-b96d-6453d586ce66/4755a8a5-1dbb-40bb-87cc-56df38d0632c) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:33:52.790102 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-72fe4f01-b41a-44c9-aa31-62bcb0c83b96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:52.822701 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72fe4f01-b41a-44c9-aa31-62bcb0c83b96 None None] Pushing event deleted for resources: {'Port': ['ID=b1aa2704-ca80-4686-b1f3-af5269a76858,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:52.827923 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-72fe4f01-b41a-44c9-aa31-62bcb0c83b96 None None] No DVR routers for this DVR port b1aa2704-ca80-4686-b1f3-af5269a76858 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:33:52.889079 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d5d0ae40-6c78-468c-9dca-ac73e17671c7 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:52.933800 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b4db51cd-bacd-41be-bf2f-f41f5e9d3c6f tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:52.935825 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 3fc210b0-8ace-4199-af3c-2296f979b045 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:33:52.946590 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.securitygroups_db [None req-83734498-6086-4d41-9706-b906dccbd61c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Project 1d10b4824e524068827e58b55e269af3 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 09 04:33:52.963638 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d5d0ae40-6c78-468c-9dca-ac73e17671c7 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:33:52.968303 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-83734498-6086-4d41-9706-b906dccbd61c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:52.972833 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-d5d0ae40-6c78-468c-9dca-ac73e17671c7 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:33:52.976257 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d5d0ae40-6c78-468c-9dca-ac73e17671c7 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:52.977038 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d5d0ae40-6c78-468c-9dca-ac73e17671c7 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:52.987688 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-32b373cb-55c1-44a8-b50f-f268778bbe4e None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:33:52.996428 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5d0ae40-6c78-468c-9dca-ac73e17671c7 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Subnet': ['ID=d1514fe2-2396-4dfd-b620-439bb218cfc3,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:53.064790 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-650650bb-d523-49f1-8c77-edd7bf6d1d28 None None] Network 83b7fb07-746c-4cc1-a582-519bfb1e5896 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:33:53.065220 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-83734498-6086-4d41-9706-b906dccbd61c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:53.079365 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-d5d0ae40-6c78-468c-9dca-ac73e17671c7 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.6323249 Nov 09 04:33:53.080900 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57442) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:53.088722 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-7dc676a4-e507-4956-b680-ca1dd7071351 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'port': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'mac_address': 'fa:16:3e:66:fe:a9', 'name': 'tempest-NetworksTestDHCPv6-902084957'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:53.090958 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4db51cd-bacd-41be-bf2f-f41f5e9d3c6f tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Pushing event updated for resources: {'Subnet': ['ID=bfa23843-d391-4e3a-a6ff-c61b1d3fa13b,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:53.111894 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ff645684-4d2f-481c-8ec8-2bdc1aa2df16 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:53.119670 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b4db51cd-bacd-41be-bf2f-f41f5e9d3c6f tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Checking segment: {'id': 'addb7209-a504-42b8-926e-099777f05856', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 301, 'network_id': '6d014a7c-bf55-403c-8b12-11032e94df30'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:33:53.120014 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b4db51cd-bacd-41be-bf2f-f41f5e9d3c6f tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Network hostable DHCP agents. Network: 6d014a7c-bf55-403c-8b12-11032e94df30, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:33:53.161208 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-83734498-6086-4d41-9706-b906dccbd61c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:53.181794 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 3fc210b0-8ace-4199-af3c-2296f979b045 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:53.182155 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:53.193058 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-c22b074a-fecc-4e57-a6a7-67506be2c5cb None None] Provisioning complete for port 3fc210b0-8ace-4199-af3c-2296f979b045 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:53.193428 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c22b074a-fecc-4e57-a6a7-67506be2c5cb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:53.214326 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ff645684-4d2f-481c-8ec8-2bdc1aa2df16 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:53.227536 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83734498-6086-4d41-9706-b906dccbd61c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d9136216-6f9c-4577-b37d-670e60a819b4,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:53.270749 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f488d492-28bc-4f7a-a17f-30f0d7402a48 req-e6e72aee-0dc0-49b7-8778-732be64485f8 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:53.272611 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f488d492-28bc-4f7a-a17f-30f0d7402a48 req-e6e72aee-0dc0-49b7-8778-732be64485f8 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/ports?device_id=e145337f-88ba-4f6d-a894-39631a8dd013 HTTP/1.1" status: 200 len: 945 time: 0.1135030 Nov 09 04:33:53.338377 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-ff645684-4d2f-481c-8ec8-2bdc1aa2df16 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] In _notify_port_updated(), no bound segment for port 4755a8a5-1dbb-40bb-87cc-56df38d0632c on network 002d27a0-2fb8-4426-9550-42c444556a8e {{(pid=102162) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 09 04:33:53.344106 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ff645684-4d2f-481c-8ec8-2bdc1aa2df16 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:53.344821 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ff645684-4d2f-481c-8ec8-2bdc1aa2df16 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:53.349342 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-ff645684-4d2f-481c-8ec8-2bdc1aa2df16 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "PUT /v2.0/ports/4755a8a5-1dbb-40bb-87cc-56df38d0632c HTTP/1.1" status: 200 len: 969 time: 1.8753757 Nov 09 04:33:53.353873 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-83734498-6086-4d41-9706-b906dccbd61c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:53.354291 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b4db51cd-bacd-41be-bf2f-f41f5e9d3c6f tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Network 6d014a7c-bf55-403c-8b12-11032e94df30 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:33:53.358650 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-83734498-6086-4d41-9706-b906dccbd61c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.7000585 Nov 09 04:33:53.364290 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57448) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:53.364470 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57450) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:53.381165 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-a0458a32-6457-4787-99b5-15af8fce4da6 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': '99157167-0266-49ff-809e-cf8a91af8ae5', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:53.397120 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f488d492-28bc-4f7a-a17f-30f0d7402a48 req-65004ff8-7c3f-454d-baee-678f8a8fe212 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/security-groups?id=8fd0adbd-57c5-4583-8e2d-9a55d7973976&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1146746 Nov 09 04:33:53.421645 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff645684-4d2f-481c-8ec8-2bdc1aa2df16 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event updated for resources: {'Port': ['ID=4755a8a5-1dbb-40bb-87cc-56df38d0632c,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:53.429988 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-b4db51cd-bacd-41be-bf2f-f41f5e9d3c6f tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 6d014a7c-bf55-403c-8b12-11032e94df30) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:33:53.440789 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b4db51cd-bacd-41be-bf2f-f41f5e9d3c6f tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:53.441495 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b4db51cd-bacd-41be-bf2f-f41f5e9d3c6f tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:53.465658 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2aa23e2f-6e4d-47f0-b203-5cf63b5ea089 req-18b2300e-0a06-4a3a-b2da-d38b3530d8fd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:53.467518 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2aa23e2f-6e4d-47f0-b203-5cf63b5ea089 req-18b2300e-0a06-4a3a-b2da-d38b3530d8fd service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=a7dd369fc9b947d2b50f9f75551d326d&device_id=e145337f-88ba-4f6d-a894-39631a8dd013 HTTP/1.1" status: 200 len: 1098 time: 0.2382541 Nov 09 04:33:53.470982 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9ecdd538-b060-4afc-b43a-724b678226ed None None] Network 6d014a7c-bf55-403c-8b12-11032e94df30 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:33:53.477812 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74575728-8a8d-4299-b010-03eed7acb2e5 req-c4bba474-5ac5-43f6-8f6c-a076509c7bb6 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:53.486495 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-74575728-8a8d-4299-b010-03eed7acb2e5 req-c4bba474-5ac5-43f6-8f6c-a076509c7bb6 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 945 time: 0.1513326 Nov 09 04:33:53.492468 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7dc676a4-e507-4956-b680-ca1dd7071351 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'port': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:33:53.494909 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-4273639d-fc3c-4fad-8fb6-fe2dd1c4c921 None None] Allocated IP 2001:db8:0:2::2 (002d27a0-2fb8-4426-9550-42c444556a8e/61ce5dc1-9280-42d2-b96d-6453d586ce66/c315ee21-870f-44c3-b604-c4eb34ea288a) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:33:53.524309 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f5d4bcdb-6504-4104-8b45-f664e09d0411 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-988d2354-693c-4d52-af17-25e0643eaa0c', 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'tenant_id': '8b0758f781884982bf5b94e6609237f6', 'fixed_ips': [{'subnet_id': 'd1514fe2-2396-4dfd-b620-439bb218cfc3'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:33:53.525185 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f5d4bcdb-6504-4104-8b45-f664e09d0411 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:53.585813 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-1abd7f35-95d9-406a-be85-98ae9ab4cdf1 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Deleting port 4755a8a5-1dbb-40bb-87cc-56df38d0632c {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:33:53.586469 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1abd7f35-95d9-406a-be85-98ae9ab4cdf1 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:53.591339 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-74575728-8a8d-4299-b010-03eed7acb2e5 req-f760e400-f6b2-4671-bbbb-3f0de0838cdd tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1038322 Nov 09 04:33:53.591596 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:53.611800 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-b4db51cd-bacd-41be-bf2f-f41f5e9d3c6f tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.5831943 Nov 09 04:33:53.616459 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57452) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:53.628553 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-a2bcecb2-7699-41cd-8868-d5de42aff1c0 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Request body: {'subnet': {'network_id': 'fc71b887-9046-44cb-986d-dfe03d43967a', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:53.649145 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2aa23e2f-6e4d-47f0-b203-5cf63b5ea089 req-178ca1cd-8833-45dc-94c7-f0e255319a8c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:53.651309 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2aa23e2f-6e4d-47f0-b203-5cf63b5ea089 req-178ca1cd-8833-45dc-94c7-f0e255319a8c service neutron] 10.222.0.26 "GET /v2.0/networks?id=10e5206a-1d3b-409b-a3ee-0f6a311d6819 HTTP/1.1" status: 200 len: 912 time: 0.1554983 Nov 09 04:33:53.688424 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7dc676a4-e507-4956-b680-ca1dd7071351 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:53.716448 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c22b074a-fecc-4e57-a6a7-67506be2c5cb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:53.727024 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [None req-7dc676a4-e507-4956-b680-ca1dd7071351 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] device_id is not set on port 31f29d7e-df13-461e-9f11-16ddd39418b7 yet. {{(pid=102161) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:33:53.737856 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2aa23e2f-6e4d-47f0-b203-5cf63b5ea089 req-c7a99e8f-b66a-450d-bca7-68ee49b037c6 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=d3617298-af19-45fb-8ddd-9c228bc66aab HTTP/1.1" status: 200 len: 217 time: 0.0765231 Nov 09 04:33:53.748255 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1abd7f35-95d9-406a-be85-98ae9ab4cdf1 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:53.753110 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.securitygroups_db [None req-a0458a32-6457-4787-99b5-15af8fce4da6 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Project 1d10b4824e524068827e58b55e269af3 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 09 04:33:53.799241 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a0458a32-6457-4787-99b5-15af8fce4da6 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:53.805399 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-1abd7f35-95d9-406a-be85-98ae9ab4cdf1 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Calling delete_port for 4755a8a5-1dbb-40bb-87cc-56df38d0632c owned by {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:33:53.823679 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2aa23e2f-6e4d-47f0-b203-5cf63b5ea089 req-418e1d14-6991-4b76-99e4-01fdddeb8262 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:53.825280 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2aa23e2f-6e4d-47f0-b203-5cf63b5ea089 req-418e1d14-6991-4b76-99e4-01fdddeb8262 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=73ee2bd1-c2b2-478f-96c9-301b99515bfe HTTP/1.1" status: 200 len: 851 time: 0.0812628 Nov 09 04:33:53.859988 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2aa23e2f-6e4d-47f0-b203-5cf63b5ea089 req-ad7ef786-2d64-4779-b5f2-b6c353c7da8c service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=10e5206a-1d3b-409b-a3ee-0f6a311d6819&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0269020 Nov 09 04:33:53.972412 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a2bcecb2-7699-41cd-8868-d5de42aff1c0 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Made reservation on behalf of 4b395c2f9c4f482198ab37eb736cc2fe for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:33:53.976064 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a2bcecb2-7699-41cd-8868-d5de42aff1c0 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:53.983733 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-7dc676a4-e507-4956-b680-ca1dd7071351 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Allocated IP 2001:db8::1d0 (988d2354-693c-4d52-af17-25e0643eaa0c/d1514fe2-2396-4dfd-b620-439bb218cfc3/31f29d7e-df13-461e-9f11-16ddd39418b7) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:33:54.017436 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 3fc210b0-8ace-4199-af3c-2296f979b045, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=3fc210b0-8ace-4199-af3c-2296f979b045,segment=NetworkSegment(9c8c26ad-778e-46c6-99ba-e8e770604064),segment_id=9c8c26ad-778e-46c6-99ba-e8e770604064)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:33:54.115500 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2aa23e2f-6e4d-47f0-b203-5cf63b5ea089 req-0aa8fb7b-8dfe-4c74-a619-cca9ddd66787 service neutron] 10.222.0.26 "GET /v2.0/networks/10e5206a-1d3b-409b-a3ee-0f6a311d6819?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2480414 Nov 09 04:33:54.126023 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:54.129668 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2eac2ad7-2338-4eaa-8988-d4d388cf1579 req-9dbf0cc5-4a03-41a3-a70b-b10fa87422f4 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:54.137509 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-4273639d-fc3c-4fad-8fb6-fe2dd1c4c921 None None] For port c315ee21-870f-44c3-b604-c4eb34ea288a, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=c315ee21-870f-44c3-b604-c4eb34ea288a,segment=NetworkSegment(53b7b761-0c0a-4377-98bf-58d99642533b),segment_id=53b7b761-0c0a-4377-98bf-58d99642533b)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:33:54.139267 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2eac2ad7-2338-4eaa-8988-d4d388cf1579 req-9dbf0cc5-4a03-41a3-a70b-b10fa87422f4 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 945 time: 0.1706891 Nov 09 04:33:54.139545 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d432f769-c51d-41f6-9214-f206a5e54587 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-6d014a7c-bf55-403c-8b12-11032e94df30', 'network_id': '6d014a7c-bf55-403c-8b12-11032e94df30', 'tenant_id': '4b395c2f9c4f482198ab37eb736cc2fe', 'fixed_ips': [{'subnet_id': 'bfa23843-d391-4e3a-a6ff-c61b1d3fa13b'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:33:54.140380 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d432f769-c51d-41f6-9214-f206a5e54587 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:54.164188 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a0458a32-6457-4787-99b5-15af8fce4da6 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:54.225118 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device b1aa2704-ca80-4686-b1f3-af5269a76858 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:33:54.251117 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: b1aa2704-ca80-4686-b1f3-af5269a76858 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:33:54.251461 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device b1aa2704-ca80-4686-b1f3-af5269a76858 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:33:54.289687 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1abd7f35-95d9-406a-be85-98ae9ab4cdf1 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:54.298967 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a0458a32-6457-4787-99b5-15af8fce4da6 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:54.308556 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.db.api [None req-c22b074a-fecc-4e57-a6a7-67506be2c5cb None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=102163) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:33:54.308756 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG oslo_db.api [None req-c22b074a-fecc-4e57-a6a7-67506be2c5cb None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:33:54.314008 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4273639d-fc3c-4fad-8fb6-fe2dd1c4c921 None None] Publish callbacks [] for port, precommit_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:54.334235 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2eac2ad7-2338-4eaa-8988-d4d388cf1579 req-9e53b412-c985-4e8e-a110-0733fa23d7d8 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1867490 Nov 09 04:33:54.357628 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2aa23e2f-6e4d-47f0-b203-5cf63b5ea089 req-f7edd195-4a4c-4e78-ba29-689de5d3b5d7 service neutron] 10.222.0.26 "GET /v2.0/networks/10e5206a-1d3b-409b-a3ee-0f6a311d6819?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2160625 Nov 09 04:33:54.365170 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=3fc210b0-8ace-4199-af3c-2296f979b045,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:54.379936 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0458a32-6457-4787-99b5-15af8fce4da6 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=34ac1402-5f89-4674-8ec1-2f90e0be863e,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:54.385680 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4273639d-fc3c-4fad-8fb6-fe2dd1c4c921 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:54.414348 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1abd7f35-95d9-406a-be85-98ae9ab4cdf1 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event deleted for resources: {'Port': ['ID=4755a8a5-1dbb-40bb-87cc-56df38d0632c,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:54.442279 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f738d845-c379-41ed-b3fa-c03b71d26f7d req-aa94abc1-141e-44eb-9bb9-f28d1aea8e60 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:54.444229 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f738d845-c379-41ed-b3fa-c03b71d26f7d req-aa94abc1-141e-44eb-9bb9-f28d1aea8e60 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=6015befde7f546d881cb247ae5bc81ae&device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 1098 time: 0.2785141 Nov 09 04:33:54.450604 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1abd7f35-95d9-406a-be85-98ae9ab4cdf1 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:54.456689 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1abd7f35-95d9-406a-be85-98ae9ab4cdf1 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "DELETE /v2.0/ports/4755a8a5-1dbb-40bb-87cc-56df38d0632c HTTP/1.1" status: 204 len: 168 time: 1.0870018 Nov 09 04:33:54.457349 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57460) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:54.486069 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-17743622-de66-4f95-b1c4-d7b35a3fbcff tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] GET failed (client error): The resource could not be found. Nov 09 04:33:54.488600 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-17743622-de66-4f95-b1c4-d7b35a3fbcff tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "GET /v2.0/ports/4755a8a5-1dbb-40bb-87cc-56df38d0632c HTTP/1.1" status: 404 len: 333 time: 0.0295622 Nov 09 04:33:54.494730 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57462) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:54.550673 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a2bcecb2-7699-41cd-8868-d5de42aff1c0 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:54.555975 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-d432f769-c51d-41f6-9214-f206a5e54587 None None] Allocated IP 2001:db8::2 (6d014a7c-bf55-403c-8b12-11032e94df30/bfa23843-d391-4e3a-a6ff-c61b1d3fa13b/534ec346-6b5d-44cb-9cb1-654cb2217ed5) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:33:54.562556 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4273639d-fc3c-4fad-8fb6-fe2dd1c4c921 None None] Pushing event updated for resources: {'Port': ['ID=c315ee21-870f-44c3-b604-c4eb34ea288a,revision_number=7']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:54.562705 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ebf5f06c-f69e-4932-8895-122a33fc1def tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:54.579624 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a0458a32-6457-4787-99b5-15af8fce4da6 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:54.580927 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a0458a32-6457-4787-99b5-15af8fce4da6 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 1.2121849 Nov 09 04:33:54.634645 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ebf5f06c-f69e-4932-8895-122a33fc1def tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:54.645679 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2bcecb2-7699-41cd-8868-d5de42aff1c0 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Pushing event updated for resources: {'Subnet': ['ID=208f4c7d-90b6-44e7-97a6-2058bc750a4e,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:54.681476 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a2bcecb2-7699-41cd-8868-d5de42aff1c0 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Checking segment: {'id': '01c8e428-6cb4-4160-9a48-6a294a0d7cc0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': 'fc71b887-9046-44cb-986d-dfe03d43967a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:33:54.681838 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a2bcecb2-7699-41cd-8868-d5de42aff1c0 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Network hostable DHCP agents. Network: fc71b887-9046-44cb-986d-dfe03d43967a, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:33:54.741958 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ee3b9cf-10d9-42f4-8fc0-e0621ed449c0 req-d19ae141-91f5-4aff-8ebb-ca6386e4d715 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:54.749119 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-5ee3b9cf-10d9-42f4-8fc0-e0621ed449c0 req-d19ae141-91f5-4aff-8ebb-ca6386e4d715 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/ports?device_id=e145337f-88ba-4f6d-a894-39631a8dd013 HTTP/1.1" status: 200 len: 945 time: 0.2459855 Nov 09 04:33:54.760354 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7dc676a4-e507-4956-b680-ca1dd7071351 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:54.767098 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a2bcecb2-7699-41cd-8868-d5de42aff1c0 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Network fc71b887-9046-44cb-986d-dfe03d43967a is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:33:54.774249 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d432f769-c51d-41f6-9214-f206a5e54587 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:54.790067 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ebf5f06c-f69e-4932-8895-122a33fc1def tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:54.793014 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ebf5f06c-f69e-4932-8895-122a33fc1def tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:54.796801 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f738d845-c379-41ed-b3fa-c03b71d26f7d req-51d7fae3-cf6a-4dbb-b63f-9dfa831cdc70 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:54.801381 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-ebf5f06c-f69e-4932-8895-122a33fc1def tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "DELETE /v2.0/security-groups/5ea943f6-8538-4399-89c6-c1935ab85085 HTTP/1.1" status: 204 len: 168 time: 0.2985768 Nov 09 04:33:54.801789 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f738d845-c379-41ed-b3fa-c03b71d26f7d req-51d7fae3-cf6a-4dbb-b63f-9dfa831cdc70 service neutron] 10.222.0.26 "GET /v2.0/networks?id=a270b61c-1f4f-4d97-be79-4a24c65fddc2 HTTP/1.1" status: 200 len: 913 time: 0.3402057 Nov 09 04:33:54.801877 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57472) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:54.854739 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebf5f06c-f69e-4932-8895-122a33fc1def tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=5ea943f6-8538-4399-89c6-c1935ab85085,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:54.916242 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d432f769-c51d-41f6-9214-f206a5e54587 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:54.919057 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-a2bcecb2-7699-41cd-8868-d5de42aff1c0 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, fc71b887-9046-44cb-986d-dfe03d43967a) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:33:54.928453 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a2bcecb2-7699-41cd-8868-d5de42aff1c0 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:54.930494 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a2bcecb2-7699-41cd-8868-d5de42aff1c0 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:54.973272 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-5ee3b9cf-10d9-42f4-8fc0-e0621ed449c0 req-0c5d0a04-5813-4df8-8153-f1544ff978e3 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/security-groups?id=8fd0adbd-57c5-4583-8e2d-9a55d7973976&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2231796 Nov 09 04:33:54.983717 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d432f769-c51d-41f6-9214-f206a5e54587 None None] Pushing event updated for resources: {'Port': ['ID=534ec346-6b5d-44cb-9cb1-654cb2217ed5,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:54.986608 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f2b82236-0b93-43f3-88cb-0985dd587af9 None None] Network fc71b887-9046-44cb-986d-dfe03d43967a requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:33:54.989419 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 3fc210b0-8ace-4199-af3c-2296f979b045 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:33:55.015426 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c3bd49ca-63f3-47ac-bc3d-0c3ac0027ad6 req-7bd39922-2fd5-4b6c-ab47-d97f59972e60 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-676125495&fields=id&tenant_id=1d10b4824e524068827e58b55e269af3 HTTP/1.1" status: 200 len: 267 time: 0.1691308 Nov 09 04:33:55.022018 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f738d845-c379-41ed-b3fa-c03b71d26f7d req-8e9601dd-2ac5-444e-8acc-c358aed955df service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=99ad1d96-b35b-4120-b5a9-c95c47bd3ffc HTTP/1.1" status: 200 len: 1001 time: 0.2167139 Nov 09 04:33:55.022250 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b365af27-a03b-4dc9-b733-71dbf7a16c1e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:55.066489 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a2bcecb2-7699-41cd-8868-d5de42aff1c0 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.4471333 Nov 09 04:33:55.078430 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57478) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:55.100454 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7dc676a4-e507-4956-b680-ca1dd7071351 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:55.120166 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b365af27-a03b-4dc9-b733-71dbf7a16c1e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:55.142020 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-f5d4bcdb-6504-4104-8b45-f664e09d0411 None None] Allocated IP 2001:db8::2 (988d2354-693c-4d52-af17-25e0643eaa0c/d1514fe2-2396-4dfd-b620-439bb218cfc3/9cdeb819-d907-4b68-82ca-b57f5a3ba0e8) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:33:55.153453 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d432f769-c51d-41f6-9214-f206a5e54587 None None] Network 6d014a7c-bf55-403c-8b12-11032e94df30 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:33:55.180229 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7dc676a4-e507-4956-b680-ca1dd7071351 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Port': ['ID=31f29d7e-df13-461e-9f11-16ddd39418b7,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:55.196644 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f738d845-c379-41ed-b3fa-c03b71d26f7d req-75b43adb-fbdd-4b09-81a0-4071a341c4e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:55.199898 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-d432f769-c51d-41f6-9214-f206a5e54587 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:33:55.202090 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d432f769-c51d-41f6-9214-f206a5e54587 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:33:55.209371 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f738d845-c379-41ed-b3fa-c03b71d26f7d req-75b43adb-fbdd-4b09-81a0-4071a341c4e0 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=b2956e71-9b0f-4060-922c-e54ce6cff80a HTTP/1.1" status: 200 len: 851 time: 0.1595347 Nov 09 04:33:55.229153 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 3fc210b0-8ace-4199-af3c-2296f979b045 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:55.229592 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:55.261652 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-d8161c21-f2d2-4ed8-8ed4-77673ef4d4e1 None None] Provisioning complete for port 3fc210b0-8ace-4199-af3c-2296f979b045 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:55.262024 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d8161c21-f2d2-4ed8-8ed4-77673ef4d4e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:55.299826 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7dc676a4-e507-4956-b680-ca1dd7071351 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:33:55.307353 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-7dc676a4-e507-4956-b680-ca1dd7071351 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:33:55.320002 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7dc676a4-e507-4956-b680-ca1dd7071351 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:33:55.326970 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7dc676a4-e507-4956-b680-ca1dd7071351 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:55.327840 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7dc676a4-e507-4956-b680-ca1dd7071351 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:55.356687 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f738d845-c379-41ed-b3fa-c03b71d26f7d req-1e8524b1-845a-45e1-8b59-7ddbaff161f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:55.358641 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f738d845-c379-41ed-b3fa-c03b71d26f7d req-1e8524b1-845a-45e1-8b59-7ddbaff161f8 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=a270b61c-1f4f-4d97-be79-4a24c65fddc2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1307573 Nov 09 04:33:55.359689 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-d432f769-c51d-41f6-9214-f206a5e54587 None None] Attempting to bind port 534ec346-6b5d-44cb-9cb1-654cb2217ed5 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:33:55.360078 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-d432f769-c51d-41f6-9214-f206a5e54587 None None] Attempting to bind port 534ec346-6b5d-44cb-9cb1-654cb2217ed5 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'addb7209-a504-42b8-926e-099777f05856', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 301, 'network_id': '6d014a7c-bf55-403c-8b12-11032e94df30'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:33:55.360692 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d432f769-c51d-41f6-9214-f206a5e54587 None None] Attempting to bind port 534ec346-6b5d-44cb-9cb1-654cb2217ed5 on network 6d014a7c-bf55-403c-8b12-11032e94df30 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:33:55.430935 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d432f769-c51d-41f6-9214-f206a5e54587 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 33, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:33:55.431312 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d432f769-c51d-41f6-9214-f206a5e54587 None None] Checking segment: {'id': 'addb7209-a504-42b8-926e-099777f05856', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 301, 'network_id': '6d014a7c-bf55-403c-8b12-11032e94df30'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:33:55.431713 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d432f769-c51d-41f6-9214-f206a5e54587 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:55.432109 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d432f769-c51d-41f6-9214-f206a5e54587 None None] Bound using segment: {'id': 'addb7209-a504-42b8-926e-099777f05856', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 301, 'network_id': '6d014a7c-bf55-403c-8b12-11032e94df30'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:33:55.432598 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-d432f769-c51d-41f6-9214-f206a5e54587 None None] Bound port: 534ec346-6b5d-44cb-9cb1-654cb2217ed5, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'addb7209-a504-42b8-926e-099777f05856', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 301, 'network_id': '6d014a7c-bf55-403c-8b12-11032e94df30'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:33:55.433034 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d432f769-c51d-41f6-9214-f206a5e54587 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:55.434309 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3bd49ca-63f3-47ac-bc3d-0c3ac0027ad6 req-eca26f51-b503-4b11-ac18-324475525a0e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:55.443627 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c3bd49ca-63f3-47ac-bc3d-0c3ac0027ad6 req-eca26f51-b503-4b11-ac18-324475525a0e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/networks?id=239a9c72-6384-4d5a-a69d-f4ac0c580e40 HTTP/1.1" status: 200 len: 796 time: 0.4180088 Nov 09 04:33:55.451518 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-7dc676a4-e507-4956-b680-ca1dd7071351 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 931 time: 2.3680422 Nov 09 04:33:55.474107 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57482) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:55.497984 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c3bd49ca-63f3-47ac-bc3d-0c3ac0027ad6 req-848f896e-3ebc-4a3b-8cf1-6a2bb9a7c0b6 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/quotas/1d10b4824e524068827e58b55e269af3 HTTP/1.1" status: 200 len: 375 time: 0.0532906 Nov 09 04:33:55.502328 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b365af27-a03b-4dc9-b733-71dbf7a16c1e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:55.505738 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b365af27-a03b-4dc9-b733-71dbf7a16c1e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:55.509749 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-b365af27-a03b-4dc9-b733-71dbf7a16c1e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "DELETE /v2.0/security-groups/0747fda9-7fb9-4f58-9f75-ef05efa51913 HTTP/1.1" status: 204 len: 168 time: 0.7098315 Nov 09 04:33:55.523849 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57484) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:55.552438 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b365af27-a03b-4dc9-b733-71dbf7a16c1e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=0747fda9-7fb9-4f58-9f75-ef05efa51913,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:55.620689 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f738d845-c379-41ed-b3fa-c03b71d26f7d req-10c06413-5179-43e9-8b5d-52ea1c887c4c service neutron] 10.222.0.26 "GET /v2.0/networks/a270b61c-1f4f-4d97-be79-4a24c65fddc2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2544658 Nov 09 04:33:55.629500 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eff0302d-0a42-441b-a48b-9a015da36a64 req-d04aeb4e-d50e-487a-8438-3013c9857027 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:55.631041 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-eff0302d-0a42-441b-a48b-9a015da36a64 req-d04aeb4e-d50e-487a-8438-3013c9857027 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 945 time: 0.1499434 Nov 09 04:33:55.640558 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c3bd49ca-63f3-47ac-bc3d-0c3ac0027ad6 req-d2c74a81-f4b5-4988-8912-5d50f6d242ca tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1416290 Nov 09 04:33:55.645971 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4a4165a0-45f0-4e31-9443-b7630957cfec tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:55.670813 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a732fc90-5442-45dd-a2ce-2316d8c79519 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:55.725802 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8dfbc98c-207f-4018-9af9-e1234a47ae4c tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:55.727529 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-8dfbc98c-207f-4018-9af9-e1234a47ae4c tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/ports HTTP/1.1" status: 200 len: 929 time: 0.2523844 Nov 09 04:33:55.730411 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57488) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:55.742795 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-d432f769-c51d-41f6-9214-f206a5e54587 None None] For port 534ec346-6b5d-44cb-9cb1-654cb2217ed5, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:33:55.783305 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-d432f769-c51d-41f6-9214-f206a5e54587 None None] For port 534ec346-6b5d-44cb-9cb1-654cb2217ed5, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=534ec346-6b5d-44cb-9cb1-654cb2217ed5,segment=NetworkSegment(addb7209-a504-42b8-926e-099777f05856),segment_id=addb7209-a504-42b8-926e-099777f05856)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:33:55.800857 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f5d4bcdb-6504-4104-8b45-f664e09d0411 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:55.813451 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device c315ee21-870f-44c3-b604-c4eb34ea288a up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:33:55.817923 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a732fc90-5442-45dd-a2ce-2316d8c79519 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:55.820608 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5134e9a1-840f-4f43-a36c-c4c18ba598ea None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-fc71b887-9046-44cb-986d-dfe03d43967a', 'network_id': 'fc71b887-9046-44cb-986d-dfe03d43967a', 'tenant_id': '4b395c2f9c4f482198ab37eb736cc2fe', 'fixed_ips': [{'subnet_id': '208f4c7d-90b6-44e7-97a6-2058bc750a4e'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:33:55.822167 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5134e9a1-840f-4f43-a36c-c4c18ba598ea None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:55.882390 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-eff0302d-0a42-441b-a48b-9a015da36a64 req-1708c6df-99d0-46a2-a330-415b225db03b tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2195005 Nov 09 04:33:55.977563 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f5d4bcdb-6504-4104-8b45-f664e09d0411 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:55.995516 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d432f769-c51d-41f6-9214-f206a5e54587 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:56.027870 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-7b9eb07e-57d0-43c3-a1ec-1097d8c00fc2 None None] Provisioning complete for port c315ee21-870f-44c3-b604-c4eb34ea288a triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:56.028326 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7b9eb07e-57d0-43c3-a1ec-1097d8c00fc2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:56.137728 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f5d4bcdb-6504-4104-8b45-f664e09d0411 None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:33:56.160389 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-f5d4bcdb-6504-4104-8b45-f664e09d0411 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:33:56.171054 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f5d4bcdb-6504-4104-8b45-f664e09d0411 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:33:56.231848 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f738d845-c379-41ed-b3fa-c03b71d26f7d req-acebd0f6-edda-4a01-9aa1-db7d906007c5 service neutron] 10.222.0.26 "GET /v2.0/networks/a270b61c-1f4f-4d97-be79-4a24c65fddc2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5996425 Nov 09 04:33:56.245961 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port c315ee21-870f-44c3-b604-c4eb34ea288a triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:56.246447 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:56.259389 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a7b39d1-bb95-4e28-9ddd-9f9b8ea49ec5 req-d8a2ff89-cf36-4c70-960a-f07d7cf5004c tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:56.261014 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-7a7b39d1-bb95-4e28-9ddd-9f9b8ea49ec5 req-d8a2ff89-cf36-4c70-960a-f07d7cf5004c tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/ports?device_id=e145337f-88ba-4f6d-a894-39631a8dd013 HTTP/1.1" status: 200 len: 945 time: 0.0637090 Nov 09 04:33:56.288393 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5d4bcdb-6504-4104-8b45-f664e09d0411 None None] Pushing event updated for resources: {'Port': ['ID=9cdeb819-d907-4b68-82ca-b57f5a3ba0e8,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:56.317177 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-7a7b39d1-bb95-4e28-9ddd-9f9b8ea49ec5 req-fb43625e-8b09-457b-b7a9-6cffdfbd2bad tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/security-groups?id=8fd0adbd-57c5-4583-8e2d-9a55d7973976&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0494106 Nov 09 04:33:56.321534 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a732fc90-5442-45dd-a2ce-2316d8c79519 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:56.324393 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a732fc90-5442-45dd-a2ce-2316d8c79519 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:56.328610 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a732fc90-5442-45dd-a2ce-2316d8c79519 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "DELETE /v2.0/security-groups/f74c848a-351e-49f1-bf42-2cd07cefe6f9 HTTP/1.1" status: 204 len: 168 time: 0.8029616 Nov 09 04:33:56.329300 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57492) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:56.377961 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a732fc90-5442-45dd-a2ce-2316d8c79519 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=f74c848a-351e-49f1-bf42-2cd07cefe6f9,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:56.430962 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-707515c1-b631-4660-9de8-238a5dcd1841 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Deleting subnet 35a4ba3b-99b7-4b1f-9549-2fc042f492d9 {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:33:56.454730 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-707515c1-b631-4660-9de8-238a5dcd1841 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:56.483314 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-c7a3329c-d18f-45ec-8ae4-bfd034a70c17 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Deleting port 31f29d7e-df13-461e-9f11-16ddd39418b7 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:33:56.483887 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c7a3329c-d18f-45ec-8ae4-bfd034a70c17 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:56.541325 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c3bd49ca-63f3-47ac-bc3d-0c3ac0027ad6 req-ad2bb043-8c51-45fd-97d0-353c79d3a1ec service neutron] 10.222.0.24 "GET /v2.0/networks/239a9c72-6384-4d5a-a69d-f4ac0c580e40?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.8797903 Nov 09 04:33:56.544097 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-707515c1-b631-4660-9de8-238a5dcd1841 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:56.656219 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-707515c1-b631-4660-9de8-238a5dcd1841 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:56.689302 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-f5d4bcdb-6504-4104-8b45-f664e09d0411 None None] Attempting to bind port 9cdeb819-d907-4b68-82ca-b57f5a3ba0e8 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:33:56.689606 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-f5d4bcdb-6504-4104-8b45-f664e09d0411 None None] Attempting to bind port 9cdeb819-d907-4b68-82ca-b57f5a3ba0e8 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:33:56.689974 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f5d4bcdb-6504-4104-8b45-f664e09d0411 None None] Attempting to bind port 9cdeb819-d907-4b68-82ca-b57f5a3ba0e8 on network 988d2354-693c-4d52-af17-25e0643eaa0c {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:33:56.694867 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-5134e9a1-840f-4f43-a36c-c4c18ba598ea None None] Allocated IP 2001:db8::2 (fc71b887-9046-44cb-986d-dfe03d43967a/208f4c7d-90b6-44e7-97a6-2058bc750a4e/3c324982-d7b8-4a65-9614-579eaad5ada7) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:33:56.725234 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f5d4bcdb-6504-4104-8b45-f664e09d0411 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 33, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:33:56.725608 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f5d4bcdb-6504-4104-8b45-f664e09d0411 None None] Checking segment: {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:33:56.726138 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f5d4bcdb-6504-4104-8b45-f664e09d0411 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:56.726473 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f5d4bcdb-6504-4104-8b45-f664e09d0411 None None] Bound using segment: {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:33:56.731530 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-f5d4bcdb-6504-4104-8b45-f664e09d0411 None None] Bound port: 9cdeb819-d907-4b68-82ca-b57f5a3ba0e8, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:33:56.731530 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f5d4bcdb-6504-4104-8b45-f664e09d0411 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:56.751036 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d432f769-c51d-41f6-9214-f206a5e54587 None None] Pushing event updated for resources: {'Port': ['ID=534ec346-6b5d-44cb-9cb1-654cb2217ed5,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:56.794921 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-4a4165a0-45f0-4e31-9443-b7630957cfec tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Allocated IP 2001:db8::1 (6d014a7c-bf55-403c-8b12-11032e94df30/bfa23843-d391-4e3a-a6ff-c61b1d3fa13b/dda09359-42a6-4fca-addb-eb15fb39acf7) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:33:56.801087 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c7a3329c-d18f-45ec-8ae4-bfd034a70c17 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:56.807346 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-707515c1-b631-4660-9de8-238a5dcd1841 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:56.826628 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c3bd49ca-63f3-47ac-bc3d-0c3ac0027ad6 req-6bbf89a7-dd93-410a-bbad-7ee0b3c20ab6 service neutron] 10.222.0.24 "GET /v2.0/networks/239a9c72-6384-4d5a-a69d-f4ac0c580e40?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2490127 Nov 09 04:33:56.828504 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-707515c1-b631-4660-9de8-238a5dcd1841 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:56.836738 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-c7a3329c-d18f-45ec-8ae4-bfd034a70c17 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Calling delete_port for 31f29d7e-df13-461e-9f11-16ddd39418b7 owned by {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:33:56.844834 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-707515c1-b631-4660-9de8-238a5dcd1841 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "DELETE /v2.0/subnets/35a4ba3b-99b7-4b1f-9549-2fc042f492d9 HTTP/1.1" status: 204 len: 168 time: 0.5107145 Nov 09 04:33:56.868884 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57498) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:56.901602 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-7b9eb07e-57d0-43c3-a1ec-1097d8c00fc2 None None] Provisioning complete for port 77290ebd-f244-4a68-94af-4d033c4a6349 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:56.902068 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7b9eb07e-57d0-43c3-a1ec-1097d8c00fc2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:56.904184 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e6fcf6b8-37b1-48c5-a9f5-6f20a8b785c1 None None] Network 002d27a0-2fb8-4426-9550-42c444556a8e requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:33:56.924636 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-707515c1-b631-4660-9de8-238a5dcd1841 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event deleted for resources: {'Subnet': ['ID=35a4ba3b-99b7-4b1f-9549-2fc042f492d9,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:56.977715 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-7e95065f-3670-4711-9caf-3f3f1ef08c4e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Deleting subnet 61ce5dc1-9280-42d2-b96d-6453d586ce66 {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:33:57.001764 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7e95065f-3670-4711-9caf-3f3f1ef08c4e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:57.016959 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed8e4f2d-5bf2-48be-bb50-40bed983db3a req-dcaf770a-15ca-45c4-ba88-3c0f6e315f9d tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:57.026554 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ed8e4f2d-5bf2-48be-bb50-40bed983db3a req-dcaf770a-15ca-45c4-ba88-3c0f6e315f9d tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/ports?device_id=e145337f-88ba-4f6d-a894-39631a8dd013 HTTP/1.1" status: 200 len: 945 time: 0.1115448 Nov 09 04:33:57.091906 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ed8e4f2d-5bf2-48be-bb50-40bed983db3a req-77e20d7d-78d9-4467-9cc8-538cf39a93e8 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/security-groups?id=8fd0adbd-57c5-4583-8e2d-9a55d7973976&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0634322 Nov 09 04:33:57.173827 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7e95065f-3670-4711-9caf-3f3f1ef08c4e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:57.298848 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-f5d4bcdb-6504-4104-8b45-f664e09d0411 None None] For port 9cdeb819-d907-4b68-82ca-b57f5a3ba0e8, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:33:57.303639 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-f5d4bcdb-6504-4104-8b45-f664e09d0411 None None] For port 9cdeb819-d907-4b68-82ca-b57f5a3ba0e8, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=9cdeb819-d907-4b68-82ca-b57f5a3ba0e8,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:33:57.319071 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-929ad15d-a896-44b2-a7ea-7c32a8959b37 req-ff11051a-0bde-4133-bfce-eeeb37278c29 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:57.331109 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-929ad15d-a896-44b2-a7ea-7c32a8959b37 req-ff11051a-0bde-4133-bfce-eeeb37278c29 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 945 time: 0.0875542 Nov 09 04:33:57.448859 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-929ad15d-a896-44b2-a7ea-7c32a8959b37 req-6d3405de-4943-4f2a-b616-c7ad1119cd68 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1153207 Nov 09 04:33:57.496702 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-aaee4eac-2682-418c-95d5-0ab52dfa91c9 req-936c1676-4f55-4ce9-81e4-57bd80516bf0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=8f462374-376b-4c38-b300-528ae5358377 HTTP/1.1" status: 200 len: 210 time: 0.2572901 Nov 09 04:33:57.611572 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f5d4bcdb-6504-4104-8b45-f664e09d0411 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:57.641830 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4a4165a0-45f0-4e31-9443-b7630957cfec tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:57.651342 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4ca5908-d400-40aa-b5b5-2a623599ac6c req-d5da8eef-d830-4589-a1de-66f5ad6a77c2 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:57.663243 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d4ca5908-d400-40aa-b5b5-2a623599ac6c req-d5da8eef-d830-4589-a1de-66f5ad6a77c2 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 945 time: 0.1095357 Nov 09 04:33:57.675039 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7e95065f-3670-4711-9caf-3f3f1ef08c4e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:57.706602 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c7a3329c-d18f-45ec-8ae4-bfd034a70c17 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:57.746554 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d4ca5908-d400-40aa-b5b5-2a623599ac6c req-5c10099a-8d32-4be4-ba17-749e67bc6292 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0652688 Nov 09 04:33:57.746943 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5134e9a1-840f-4f43-a36c-c4c18ba598ea None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:57.746943 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 534ec346-6b5d-44cb-9cb1-654cb2217ed5 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:33:57.748442 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5d4bcdb-6504-4104-8b45-f664e09d0411 None None] Pushing event updated for resources: {'Port': ['ID=9cdeb819-d907-4b68-82ca-b57f5a3ba0e8,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:57.751161 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-7b9eb07e-57d0-43c3-a1ec-1097d8c00fc2 None None] Port 77290ebd-f244-4a68-94af-4d033c4a6349 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:33:57.768792 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-813db4c8-e9b1-4197-a49d-49ba5cb6a584 None None] Network 6d014a7c-bf55-403c-8b12-11032e94df30 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:33:57.789991 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7a3329c-d18f-45ec-8ae4-bfd034a70c17 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event deleted for resources: {'Port': ['ID=31f29d7e-df13-461e-9f11-16ddd39418b7,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:57.800615 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c7a3329c-d18f-45ec-8ae4-bfd034a70c17 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:57.804239 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-c7a3329c-d18f-45ec-8ae4-bfd034a70c17 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/ports/31f29d7e-df13-461e-9f11-16ddd39418b7 HTTP/1.1" status: 204 len: 168 time: 2.0729010 Nov 09 04:33:57.805398 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-7b9eb07e-57d0-43c3-a1ec-1097d8c00fc2 None None] Could not find standard attr ID for object 4755a8a5-1dbb-40bb-87cc-56df38d0632c. {{(pid=102163) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 09 04:33:57.809232 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57516) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:57.875710 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4a4165a0-45f0-4e31-9443-b7630957cfec tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:57.906713 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6475f319-d6ad-4956-abae-4eb6328a1e67 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:57.908729 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6475f319-d6ad-4956-abae-4eb6328a1e67 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:57.911178 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-6475f319-d6ad-4956-abae-4eb6328a1e67 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1451 time: 0.0981650 Nov 09 04:33:57.914517 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57522) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:57.936068 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5134e9a1-840f-4f43-a36c-c4c18ba598ea None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:57.981667 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4a4165a0-45f0-4e31-9443-b7630957cfec tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Network 6d014a7c-bf55-403c-8b12-11032e94df30 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:33:57.986065 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7e95065f-3670-4711-9caf-3f3f1ef08c4e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:57.999050 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-4a4165a0-45f0-4e31-9443-b7630957cfec tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:33:58.006770 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a4165a0-45f0-4e31-9443-b7630957cfec tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:33:58.007538 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4a4165a0-45f0-4e31-9443-b7630957cfec tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:58.021792 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-dc13607f-20ce-4ff0-9868-7d0a73f2a9d4 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Deleting subnet d1514fe2-2396-4dfd-b620-439bb218cfc3 {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:33:58.029662 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dc13607f-20ce-4ff0-9868-7d0a73f2a9d4 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:58.115254 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dc13607f-20ce-4ff0-9868-7d0a73f2a9d4 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:58.227865 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a4165a0-45f0-4e31-9443-b7630957cfec tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Pushing event updated for resources: {'Port': ['ID=dda09359-42a6-4fca-addb-eb15fb39acf7,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:58.261694 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dc13607f-20ce-4ff0-9868-7d0a73f2a9d4 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:58.287440 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e95065f-3670-4711-9caf-3f3f1ef08c4e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event deleted for resources: {'Subnet': ['ID=61ce5dc1-9280-42d2-b96d-6453d586ce66,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:58.293987 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7e95065f-3670-4711-9caf-3f3f1ef08c4e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:58.303102 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-7e95065f-3670-4711-9caf-3f3f1ef08c4e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "DELETE /v2.0/subnets/61ce5dc1-9280-42d2-b96d-6453d586ce66 HTTP/1.1" status: 204 len: 168 time: 1.4328265 Nov 09 04:33:58.303745 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57526) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:58.341840 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5134e9a1-840f-4f43-a36c-c4c18ba598ea None None] Network fc71b887-9046-44cb-986d-dfe03d43967a is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:33:58.385851 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-5134e9a1-840f-4f43-a36c-c4c18ba598ea None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:33:58.389353 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5134e9a1-840f-4f43-a36c-c4c18ba598ea None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:33:58.391709 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-fdc78ba7-f52a-4c3b-935c-6ca3f93a2760 None None] Provisioning complete for port 534ec346-6b5d-44cb-9cb1-654cb2217ed5 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:58.394039 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-fdc78ba7-f52a-4c3b-935c-6ca3f93a2760 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:58.412648 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-87861554-210a-4a95-a5cb-a9c25b7dc545 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] DELETE failed (client error): The resource could not be found. Nov 09 04:33:58.422678 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-87861554-210a-4a95-a5cb-a9c25b7dc545 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:33:58.436684 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-87861554-210a-4a95-a5cb-a9c25b7dc545 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "DELETE /v2.0/subnets/35a4ba3b-99b7-4b1f-9549-2fc042f492d9 HTTP/1.1" status: 404 len: 337 time: 0.1316574 Nov 09 04:33:58.438971 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57530) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:58.475744 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5134e9a1-840f-4f43-a36c-c4c18ba598ea None None] Pushing event updated for resources: {'Port': ['ID=3c324982-d7b8-4a65-9614-579eaad5ada7,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:58.494718 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dc13607f-20ce-4ff0-9868-7d0a73f2a9d4 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:58.530689 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dc13607f-20ce-4ff0-9868-7d0a73f2a9d4 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:58.534170 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-dc13607f-20ce-4ff0-9868-7d0a73f2a9d4 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/d1514fe2-2396-4dfd-b620-439bb218cfc3 HTTP/1.1" status: 204 len: 168 time: 0.6186285 Nov 09 04:33:58.535638 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc13607f-20ce-4ff0-9868-7d0a73f2a9d4 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event deleted for resources: {'Subnet': ['ID=d1514fe2-2396-4dfd-b620-439bb218cfc3,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:58.538298 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57534) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:58.585850 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 534ec346-6b5d-44cb-9cb1-654cb2217ed5 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:58.586540 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:58.615038 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db3b485c-f44c-4c88-9b3e-ce653f6875af req-1a36b271-64f9-407f-babc-1c562c97a306 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:58.620947 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-385ab2e3-b748-45a6-9a58-b57082cefea7 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Deleting subnet df5c0c2e-73f1-4f11-bae4-c9e63a6467fc {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:33:58.626711 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-db3b485c-f44c-4c88-9b3e-ce653f6875af req-1a36b271-64f9-407f-babc-1c562c97a306 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/ports?device_id=e145337f-88ba-4f6d-a894-39631a8dd013 HTTP/1.1" status: 200 len: 945 time: 0.2287781 Nov 09 04:33:58.637030 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a18252e0-0418-4837-aaec-92517115d555 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0954485 Nov 09 04:33:58.637872 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57538) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:58.645986 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-385ab2e3-b748-45a6-9a58-b57082cefea7 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:58.711519 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-5134e9a1-840f-4f43-a36c-c4c18ba598ea None None] Attempting to bind port 3c324982-d7b8-4a65-9614-579eaad5ada7 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:33:58.711959 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-5134e9a1-840f-4f43-a36c-c4c18ba598ea None None] Attempting to bind port 3c324982-d7b8-4a65-9614-579eaad5ada7 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '01c8e428-6cb4-4160-9a48-6a294a0d7cc0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': 'fc71b887-9046-44cb-986d-dfe03d43967a'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:33:58.712437 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5134e9a1-840f-4f43-a36c-c4c18ba598ea None None] Attempting to bind port 3c324982-d7b8-4a65-9614-579eaad5ada7 on network fc71b887-9046-44cb-986d-dfe03d43967a {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:33:58.727021 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-385ab2e3-b748-45a6-9a58-b57082cefea7 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:58.729697 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5134e9a1-840f-4f43-a36c-c4c18ba598ea None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 33, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:33:58.730209 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5134e9a1-840f-4f43-a36c-c4c18ba598ea None None] Checking segment: {'id': '01c8e428-6cb4-4160-9a48-6a294a0d7cc0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': 'fc71b887-9046-44cb-986d-dfe03d43967a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:33:58.730776 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5134e9a1-840f-4f43-a36c-c4c18ba598ea None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:58.731264 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5134e9a1-840f-4f43-a36c-c4c18ba598ea None None] Bound using segment: {'id': '01c8e428-6cb4-4160-9a48-6a294a0d7cc0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': 'fc71b887-9046-44cb-986d-dfe03d43967a'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:33:58.731846 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-5134e9a1-840f-4f43-a36c-c4c18ba598ea None None] Bound port: 3c324982-d7b8-4a65-9614-579eaad5ada7, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '01c8e428-6cb4-4160-9a48-6a294a0d7cc0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': 'fc71b887-9046-44cb-986d-dfe03d43967a'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:33:58.733203 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5134e9a1-840f-4f43-a36c-c4c18ba598ea None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:58.789717 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-db3b485c-f44c-4c88-9b3e-ce653f6875af req-eed82601-50f9-42c5-a4ed-6b78be6788b7 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/security-groups?id=8fd0adbd-57c5-4583-8e2d-9a55d7973976&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1619945 Nov 09 04:33:58.810630 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:58.814610 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ede60826-42fe-4b8f-8243-518ec7b88bc8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:58.819390 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-ede60826-42fe-4b8f-8243-518ec7b88bc8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/ports HTTP/1.1" status: 200 len: 864 time: 0.1669202 Nov 09 04:33:58.822611 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57542) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:58.896569 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 534ec346-6b5d-44cb-9cb1-654cb2217ed5, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=534ec346-6b5d-44cb-9cb1-654cb2217ed5,segment=NetworkSegment(addb7209-a504-42b8-926e-099777f05856),segment_id=addb7209-a504-42b8-926e-099777f05856)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:33:58.907789 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-385ab2e3-b748-45a6-9a58-b57082cefea7 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:59.006048 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-fdc78ba7-f52a-4c3b-935c-6ca3f93a2760 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:59.008753 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-81f88300-6cab-4557-87c3-7d3aec81dc24 None None] Network 002d27a0-2fb8-4426-9550-42c444556a8e requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:33:59.019385 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-7b7051af-366c-4dcb-a737-4a71d5ef1211 req-a69c690c-e57b-42c8-b30a-62f1b7a8c773 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=8f462374-376b-4c38-b300-528ae5358377 HTTP/1.1" status: 200 len: 210 time: 0.0746465 Nov 09 04:33:59.020020 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4a4165a0-45f0-4e31-9443-b7630957cfec tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:59.028778 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-016e805d-8730-4c56-a3e6-b9fbc6f827ab tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:59.033490 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-016e805d-8730-4c56-a3e6-b9fbc6f827ab tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.2097454 Nov 09 04:33:59.037358 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57544) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:59.090281 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d42321c-1dde-42cb-b625-7eb4b1c01a46 req-0cc49c46-792f-47ad-9533-28abcbf7ffcf tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:59.100199 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6d42321c-1dde-42cb-b625-7eb4b1c01a46 req-0cc49c46-792f-47ad-9533-28abcbf7ffcf tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 945 time: 0.5797861 Nov 09 04:33:59.105475 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-385ab2e3-b748-45a6-9a58-b57082cefea7 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:59.126754 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-aa277c64-87c9-4929-a7b0-40417fd2fb8c tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0801265 Nov 09 04:33:59.127468 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57546) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:59.129024 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:59.138493 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-09cb3c5b-b977-4928-9a1f-8a840fdc055b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'subnet': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:33:59.149521 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-5134e9a1-840f-4f43-a36c-c4c18ba598ea None None] For port 3c324982-d7b8-4a65-9614-579eaad5ada7, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:33:59.154262 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-5134e9a1-840f-4f43-a36c-c4c18ba598ea None None] For port 3c324982-d7b8-4a65-9614-579eaad5ada7, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=3c324982-d7b8-4a65-9614-579eaad5ada7,segment=NetworkSegment(01c8e428-6cb4-4160-9a48-6a294a0d7cc0),segment_id=01c8e428-6cb4-4160-9a48-6a294a0d7cc0)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:33:59.204735 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-385ab2e3-b748-45a6-9a58-b57082cefea7 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:59.212129 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-385ab2e3-b748-45a6-9a58-b57082cefea7 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "DELETE /v2.0/subnets/df5c0c2e-73f1-4f11-bae4-c9e63a6467fc HTTP/1.1" status: 204 len: 168 time: 0.7624447 Nov 09 04:33:59.212338 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57548) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:59.218589 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-385ab2e3-b748-45a6-9a58-b57082cefea7 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event deleted for resources: {'Subnet': ['ID=df5c0c2e-73f1-4f11-bae4-c9e63a6467fc,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:59.246467 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5134e9a1-840f-4f43-a36c-c4c18ba598ea None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:59.325450 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-af26be07-ab7f-44dc-8548-379642228064 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] DELETE failed (client error): The resource could not be found. Nov 09 04:33:59.328348 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-af26be07-ab7f-44dc-8548-379642228064 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:33:59.335884 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-af26be07-ab7f-44dc-8548-379642228064 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "DELETE /v2.0/subnets/315097f5-620a-4aee-bad3-44a6cf15bd6d HTTP/1.1" status: 404 len: 337 time: 0.1225741 Nov 09 04:33:59.340579 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57550) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:59.456279 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=534ec346-6b5d-44cb-9cb1-654cb2217ed5,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:59.521106 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6d42321c-1dde-42cb-b625-7eb4b1c01a46 req-b2418c38-7fbc-4d8b-a0d7-5babac2ad382 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4199181 Nov 09 04:33:59.554708 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4c964c8-ec22-47d6-a0ef-148b0ebbfdc4 req-a95833d6-da5a-4bd1-9c59-35a99e08fac8 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:59.563151 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c4c964c8-ec22-47d6-a0ef-148b0ebbfdc4 req-a95833d6-da5a-4bd1-9c59-35a99e08fac8 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/ports?device_id=e145337f-88ba-4f6d-a894-39631a8dd013 HTTP/1.1" status: 200 len: 945 time: 0.0821540 Nov 09 04:33:59.567611 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-09cb3c5b-b977-4928-9a1f-8a840fdc055b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:33:59.572342 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-09cb3c5b-b977-4928-9a1f-8a840fdc055b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:59.574751 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.db.api [None req-fdc78ba7-f52a-4c3b-935c-6ca3f93a2760 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=102163) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:33:59.581957 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG oslo_db.api [None req-fdc78ba7-f52a-4c3b-935c-6ca3f93a2760 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:33:59.581957 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 9cdeb819-d907-4b68-82ca-b57f5a3ba0e8 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:33:59.582201 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-9019fc07-3c0a-4b3b-bd0e-782fbd93a5d7 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "GET /v2.0/ports?device_id=bb7d9014-4e7d-4079-ab37-3a9531a32f7d HTTP/1.1" status: 200 len: 205 time: 0.2259979 Nov 09 04:33:59.591925 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57554) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:59.666089 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-294ea576-398f-45eb-93a5-b724b50ff534 None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:33:59.682431 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c4c964c8-ec22-47d6-a0ef-148b0ebbfdc4 req-1334fb4f-b8ff-4216-b6ad-201dab1ad751 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/security-groups?id=8fd0adbd-57c5-4583-8e2d-9a55d7973976&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1180720 Nov 09 04:33:59.705371 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5134e9a1-840f-4f43-a36c-c4c18ba598ea None None] Pushing event updated for resources: {'Port': ['ID=3c324982-d7b8-4a65-9614-579eaad5ada7,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:33:59.725479 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.api.v2.resource [None req-ac1fb632-f04b-4715-846b-8ae516500bfa tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] delete failed (client error): The resource could not be found. Nov 09 04:33:59.725479 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-ac1fb632-f04b-4715-846b-8ae516500bfa tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "DELETE /v2.0/routers/bb7d9014-4e7d-4079-ab37-3a9531a32f7d HTTP/1.1" status: 404 len: 336 time: 0.1282418 Nov 09 04:33:59.728882 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57556) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:59.774926 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bf822573-5796-42c3-9e50-3eaae2a6a81e None None] DHCP port deletion for 002d27a0-2fb8-4426-9550-42c444556a8e request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:33:59.837699 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-3b62ac43-3d5e-423e-893c-cb7ba83a48d8 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] DELETE failed (client error): The resource could not be found. Nov 09 04:33:59.838168 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-3b62ac43-3d5e-423e-893c-cb7ba83a48d8 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:33:59.844361 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-3b62ac43-3d5e-423e-893c-cb7ba83a48d8 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "DELETE /v2.0/subnets/aec9d80c-825b-434b-b01c-c5b0a638be76 HTTP/1.1" status: 404 len: 337 time: 0.0993698 Nov 09 04:33:59.849378 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57558) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:59.868511 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 9cdeb819-d907-4b68-82ca-b57f5a3ba0e8 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:33:59.868884 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:33:59.913918 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eafe1457-6e55-4e60-a971-3129b713e04f req-21f9ea12-085e-4693-87f6-284e1f6aebe6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:33:59.915766 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-eafe1457-6e55-4e60-a971-3129b713e04f req-21f9ea12-085e-4693-87f6-284e1f6aebe6 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=a7dd369fc9b947d2b50f9f75551d326d&device_id=e145337f-88ba-4f6d-a894-39631a8dd013 HTTP/1.1" status: 200 len: 1098 time: 0.3378620 Nov 09 04:33:59.916670 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-2a5ea735-d7bc-47db-b208-5b0cd60db8eb tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] DELETE failed (client error): The resource could not be found. Nov 09 04:33:59.917107 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2a5ea735-d7bc-47db-b208-5b0cd60db8eb tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:33:59.922508 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-2a5ea735-d7bc-47db-b208-5b0cd60db8eb tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "DELETE /v2.0/subnets/57a6fd15-e149-473d-85de-d7cbbf8fa903 HTTP/1.1" status: 404 len: 337 time: 0.0627582 Nov 09 04:33:59.926807 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57560) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:33:59.971074 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-16b93f41-a34c-4456-a276-c85dae0f4705 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] DELETE failed (client error): The resource could not be found. Nov 09 04:33:59.971545 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-16b93f41-a34c-4456-a276-c85dae0f4705 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:33:59.977424 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-16b93f41-a34c-4456-a276-c85dae0f4705 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "DELETE /v2.0/subnets/f071c371-6950-43fa-96e1-49e6709f9fc9 HTTP/1.1" status: 404 len: 337 time: 0.0493147 Nov 09 04:33:59.979858 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57562) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:00.018391 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-e751832e-6c95-48c7-b6a0-529edc865cb2 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] DELETE failed (client error): The resource could not be found. Nov 09 04:34:00.019745 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e751832e-6c95-48c7-b6a0-529edc865cb2 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:00.027921 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e751832e-6c95-48c7-b6a0-529edc865cb2 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "DELETE /v2.0/ports/27629a82-8855-48a5-a4c1-c20ca2bea522 HTTP/1.1" status: 404 len: 333 time: 0.0422318 Nov 09 04:34:00.027921 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4a4165a0-45f0-4e31-9443-b7630957cfec tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:00.027921 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57564) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:00.055974 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-cf2fba97-a330-4d29-a4a6-28c4db238cfe tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] DELETE failed (client error): The resource could not be found. Nov 09 04:34:00.056444 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-cf2fba97-a330-4d29-a4a6-28c4db238cfe tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:00.061216 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-cf2fba97-a330-4d29-a4a6-28c4db238cfe tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "DELETE /v2.0/subnets/d4895447-5025-41d7-a1d1-fd578440707f HTTP/1.1" status: 404 len: 337 time: 0.0318441 Nov 09 04:34:00.063243 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57568) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:00.073779 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eafe1457-6e55-4e60-a971-3129b713e04f req-68d19c9f-ab1c-41ca-94e9-0200bf5ca3e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:00.075639 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-eafe1457-6e55-4e60-a971-3129b713e04f req-68d19c9f-ab1c-41ca-94e9-0200bf5ca3e0 service neutron] 10.222.0.26 "GET /v2.0/networks?id=10e5206a-1d3b-409b-a3ee-0f6a311d6819 HTTP/1.1" status: 200 len: 912 time: 0.1492300 Nov 09 04:34:00.093970 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-724feced-01f0-4c2a-bcae-0af3a53cc40e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] DELETE failed (client error): The resource could not be found. Nov 09 04:34:00.094697 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-724feced-01f0-4c2a-bcae-0af3a53cc40e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:00.100734 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-724feced-01f0-4c2a-bcae-0af3a53cc40e tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "DELETE /v2.0/subnets/b197c77c-5641-42b9-8c7b-8025e4dab56c HTTP/1.1" status: 404 len: 337 time: 0.0353110 Nov 09 04:34:00.105718 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57570) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:00.130309 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-406efca8-77de-4842-a8b7-84372250a7ad tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] DELETE failed (client error): The resource could not be found. Nov 09 04:34:00.131519 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-406efca8-77de-4842-a8b7-84372250a7ad tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:00.137970 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-406efca8-77de-4842-a8b7-84372250a7ad tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "DELETE /v2.0/ports/a6125eab-1cdb-4c29-9aa5-fadf6122f492 HTTP/1.1" status: 404 len: 333 time: 0.0309250 Nov 09 04:34:00.138908 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57572) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:00.151182 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4a4165a0-45f0-4e31-9443-b7630957cfec tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:00.152266 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4a4165a0-45f0-4e31-9443-b7630957cfec tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:00.163412 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-eafe1457-6e55-4e60-a971-3129b713e04f req-3a77be3c-548e-4826-8922-de26ffa0d775 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=d3617298-af19-45fb-8ddd-9c228bc66aab HTTP/1.1" status: 200 len: 217 time: 0.0435395 Nov 09 04:34:00.203643 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-bf822573-5796-42c3-9e50-3eaae2a6a81e None None] Deleting port c315ee21-870f-44c3-b604-c4eb34ea288a {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:34:00.204011 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-bf822573-5796-42c3-9e50-3eaae2a6a81e None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:00.216865 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-90c6a725-36cc-4c0a-a1a0-bbab77f80b00 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] DELETE failed (client error): The resource could not be found. Nov 09 04:34:00.217313 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-90c6a725-36cc-4c0a-a1a0-bbab77f80b00 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:00.223515 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-90c6a725-36cc-4c0a-a1a0-bbab77f80b00 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "DELETE /v2.0/subnets/2daa3dbc-869c-4c7e-a5ab-08b0680089b6 HTTP/1.1" status: 404 len: 337 time: 0.0785816 Nov 09 04:34:00.235751 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57574) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:00.253805 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5f35e92d-1517-488b-ab30-1d0ef3af2ef9 req-4889b064-d2dd-415e-84f4-8a94facfe0ed tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=8f462374-376b-4c38-b300-528ae5358377 HTTP/1.1" status: 200 len: 210 time: 0.1131427 Nov 09 04:34:00.289101 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-1ed17cf5-f8c9-477c-ab6f-5d8f3eac7d37 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] DELETE failed (client error): The resource could not be found. Nov 09 04:34:00.289706 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-1ed17cf5-f8c9-477c-ab6f-5d8f3eac7d37 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:00.292987 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1ed17cf5-f8c9-477c-ab6f-5d8f3eac7d37 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "DELETE /v2.0/subnets/64bf7731-477c-4c79-a0da-552481e8a442 HTTP/1.1" status: 404 len: 337 time: 0.0561156 Nov 09 04:34:00.296572 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a4165a0-45f0-4e31-9443-b7630957cfec tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Pushing event updated for resources: {'Port': ['ID=dda09359-42a6-4fca-addb-eb15fb39acf7,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:00.307886 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57576) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:00.308066 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-bf822573-5796-42c3-9e50-3eaae2a6a81e None None] For port c315ee21-870f-44c3-b604-c4eb34ea288a, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=c315ee21-870f-44c3-b604-c4eb34ea288a,segment=NetworkSegment(53b7b761-0c0a-4377-98bf-58d99642533b),segment_id=53b7b761-0c0a-4377-98bf-58d99642533b)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:34:00.308316 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-bf822573-5796-42c3-9e50-3eaae2a6a81e None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:00.326544 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-bf822573-5796-42c3-9e50-3eaae2a6a81e None None] Calling delete_port for c315ee21-870f-44c3-b604-c4eb34ea288a owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:34:00.328150 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:00.342540 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eafe1457-6e55-4e60-a971-3129b713e04f req-42c96f2b-9906-4f61-bef2-581728d70580 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:00.344146 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-eafe1457-6e55-4e60-a971-3129b713e04f req-42c96f2b-9906-4f61-bef2-581728d70580 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=73ee2bd1-c2b2-478f-96c9-301b99515bfe HTTP/1.1" status: 200 len: 851 time: 0.1713820 Nov 09 04:34:00.346121 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-06a683c8-1e5a-46f6-a20d-22ed4feca6ff None None] DHCP port deletion for 988d2354-693c-4d52-af17-25e0643eaa0c request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:34:00.387984 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-eafe1457-6e55-4e60-a971-3129b713e04f req-765dd211-579f-46be-8fc6-5e68fec9f364 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=10e5206a-1d3b-409b-a3ee-0f6a311d6819&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0343978 Nov 09 04:34:00.427218 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4a4165a0-45f0-4e31-9443-b7630957cfec tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Network 6d014a7c-bf55-403c-8b12-11032e94df30 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:34:00.428901 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-4a4165a0-45f0-4e31-9443-b7630957cfec tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:00.448208 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 9cdeb819-d907-4b68-82ca-b57f5a3ba0e8, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=9cdeb819-d907-4b68-82ca-b57f5a3ba0e8,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:34:00.465759 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-8ff7b0ac-c942-43d2-95f7-e6f80897db2c None None] Provisioning complete for port 9cdeb819-d907-4b68-82ca-b57f5a3ba0e8 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:00.466460 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8ff7b0ac-c942-43d2-95f7-e6f80897db2c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:00.528298 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-06a683c8-1e5a-46f6-a20d-22ed4feca6ff None None] Deleting port 9cdeb819-d907-4b68-82ca-b57f5a3ba0e8 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:34:00.528659 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-06a683c8-1e5a-46f6-a20d-22ed4feca6ff None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:00.531224 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:00.564547 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-eafe1457-6e55-4e60-a971-3129b713e04f req-a3d66fc0-e65e-45fe-9405-14de65f97f50 service neutron] 10.222.0.26 "GET /v2.0/networks/10e5206a-1d3b-409b-a3ee-0f6a311d6819?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1503372 Nov 09 04:34:00.631735 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-bf822573-5796-42c3-9e50-3eaae2a6a81e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:00.661049 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.26', 56274) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:00.736396 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-06a683c8-1e5a-46f6-a20d-22ed4feca6ff None None] For port 9cdeb819-d907-4b68-82ca-b57f5a3ba0e8, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=9cdeb819-d907-4b68-82ca-b57f5a3ba0e8,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:34:00.738948 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-06a683c8-1e5a-46f6-a20d-22ed4feca6ff None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:00.755322 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-06a683c8-1e5a-46f6-a20d-22ed4feca6ff None None] Calling delete_port for 9cdeb819-d907-4b68-82ca-b57f5a3ba0e8 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:34:00.802559 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3bd49ca-63f3-47ac-bc3d-0c3ac0027ad6 req-ac8f4155-c02c-49da-8b57-26fda8126bf6 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:00.804093 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c3bd49ca-63f3-47ac-bc3d-0c3ac0027ad6 req-ac8f4155-c02c-49da-8b57-26fda8126bf6 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "GET /v2.0/networks?id=239a9c72-6384-4d5a-a69d-f4ac0c580e40 HTTP/1.1" status: 200 len: 796 time: 0.2855272 Nov 09 04:34:00.871636 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-616c6b10-2128-4ead-a020-1af08a70f026 req-3b5809d8-b3a2-496c-b570-13e07ff16a24 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:00.874312 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-616c6b10-2128-4ead-a020-1af08a70f026 req-3b5809d8-b3a2-496c-b570-13e07ff16a24 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.26 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 945 time: 0.2108178 Nov 09 04:34:00.899301 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bf822573-5796-42c3-9e50-3eaae2a6a81e None None] No DVR routers for this DVR port c315ee21-870f-44c3-b604-c4eb34ea288a on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:34:00.912368 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1d069d1-30a6-4316-a97b-b00eb269f4a3 req-bb99373e-9961-46e5-bec7-095d4034c845 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:00.914170 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d1d069d1-30a6-4316-a97b-b00eb269f4a3 req-bb99373e-9961-46e5-bec7-095d4034c845 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 945 time: 0.2784040 Nov 09 04:34:00.916617 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=9cdeb819-d907-4b68-82ca-b57f5a3ba0e8,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:00.947541 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-74bd1fad-f869-4c63-8a3d-3c9426b38d54 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Deleting port 77290ebd-f244-4a68-94af-4d033c4a6349 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:34:00.948024 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-74bd1fad-f869-4c63-8a3d-3c9426b38d54 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:00.965179 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-06a683c8-1e5a-46f6-a20d-22ed4feca6ff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:00.975657 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf822573-5796-42c3-9e50-3eaae2a6a81e None None] Pushing event deleted for resources: {'Port': ['ID=c315ee21-870f-44c3-b604-c4eb34ea288a,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:01.012990 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c3bd49ca-63f3-47ac-bc3d-0c3ac0027ad6 req-167f9a3b-af1f-464d-be91-d1a43b9972e6 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=1d10b4824e524068827e58b55e269af3 HTTP/1.1" status: 200 len: 379 time: 0.1837277 Nov 09 04:34:01.025622 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4a4165a0-45f0-4e31-9443-b7630957cfec tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Router 8cbd7ad3-04d4-4ab0-b79f-a9a391f624b1 is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102162) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:34:01.032289 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-74bd1fad-f869-4c63-8a3d-3c9426b38d54 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:01.036876 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06a683c8-1e5a-46f6-a20d-22ed4feca6ff None None] Pushing event deleted for resources: {'Port': ['ID=9cdeb819-d907-4b68-82ca-b57f5a3ba0e8,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:01.039695 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-c3bd49ca-63f3-47ac-bc3d-0c3ac0027ad6 req-78472fe0-a4fe-4fb9-b9d3-ac7203e0a174 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'port': {'device_id': '8f462374-376b-4c38-b300-528ae5358377', 'network_id': '239a9c72-6384-4d5a-a69d-f4ac0c580e40', 'admin_state_up': True, 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'security_groups': ['99157167-0266-49ff-809e-cf8a91af8ae5']}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:01.046328 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-06a683c8-1e5a-46f6-a20d-22ed4feca6ff None None] No DVR routers for this DVR port 9cdeb819-d907-4b68-82ca-b57f5a3ba0e8 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:34:01.048669 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-74bd1fad-f869-4c63-8a3d-3c9426b38d54 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Calling delete_port for 77290ebd-f244-4a68-94af-4d033c4a6349 owned by {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:34:01.068508 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-8ff7b0ac-c942-43d2-95f7-e6f80897db2c None None] Could not find standard attr ID for object c315ee21-870f-44c3-b604-c4eb34ea288a. {{(pid=102163) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 09 04:34:01.093710 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-8ff7b0ac-c942-43d2-95f7-e6f80897db2c None None] Provisioning complete for port 534ec346-6b5d-44cb-9cb1-654cb2217ed5 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:01.094085 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8ff7b0ac-c942-43d2-95f7-e6f80897db2c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:01.160975 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.objects.ports [None req-09cb3c5b-b977-4928-9a1f-8a840fdc055b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=102161) get_objects /opt/stack/neutron/neutron/objects/ports.py:444}} Nov 09 04:34:01.177780 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-eafe1457-6e55-4e60-a971-3129b713e04f req-942ffb91-e7d7-47a9-8137-723016ae879c service neutron] 10.222.0.26 "GET /v2.0/networks/10e5206a-1d3b-409b-a3ee-0f6a311d6819?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5978255 Nov 09 04:34:01.232455 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f766b2a3-a23a-4f27-9c9f-87e220274bb8 req-9d0150cf-1649-4faf-b188-868299c18c58 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:01.233894 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-efe03f03-32aa-4a0e-975d-626877d48a61 None None] Network fc71b887-9046-44cb-986d-dfe03d43967a requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:34:01.234024 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f766b2a3-a23a-4f27-9c9f-87e220274bb8 req-9d0150cf-1649-4faf-b188-868299c18c58 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/ports?device_id=e145337f-88ba-4f6d-a894-39631a8dd013 HTTP/1.1" status: 200 len: 945 time: 0.4237897 Nov 09 04:34:01.275470 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d1d069d1-30a6-4316-a97b-b00eb269f4a3 req-623a330f-6242-42fa-bba6-ac3c34a37d25 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3437126 Nov 09 04:34:01.292948 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-8ff7b0ac-c942-43d2-95f7-e6f80897db2c None None] Provisioning complete for port dda09359-42a6-4fca-addb-eb15fb39acf7 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:01.293427 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8ff7b0ac-c942-43d2-95f7-e6f80897db2c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:01.312675 dv-neutron-816802-2-hyperv neutron-server[102161]: WARNING neutron.services.revisions.revision_plugin [None req-09cb3c5b-b977-4928-9a1f-8a840fdc055b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Could not find related port for resource to bump revision. Nov 09 04:34:01.334407 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-74bd1fad-f869-4c63-8a3d-3c9426b38d54 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:01.360514 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4a4165a0-45f0-4e31-9443-b7630957cfec tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:34:01.367344 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-616c6b10-2128-4ead-a020-1af08a70f026 req-0eaf588d-59cc-4f3d-a746-2a126a0598be tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Deleting port 99ad1d96-b35b-4120-b5a9-c95c47bd3ffc {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:34:01.367689 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-616c6b10-2128-4ead-a020-1af08a70f026 req-0eaf588d-59cc-4f3d-a746-2a126a0598be tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:01.369719 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-8ff7b0ac-c942-43d2-95f7-e6f80897db2c None None] Port dda09359-42a6-4fca-addb-eb15fb39acf7 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:34:01.373572 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-4a4165a0-45f0-4e31-9443-b7630957cfec tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] 10.222.0.24 "PUT /v2.0/routers/8cbd7ad3-04d4-4ab0-b79f-a9a391f624b1/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.2935882 Nov 09 04:34:01.378914 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-8ff7b0ac-c942-43d2-95f7-e6f80897db2c None None] Could not find standard attr ID for object 77290ebd-f244-4a68-94af-4d033c4a6349. {{(pid=102163) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 09 04:34:01.379308 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57588) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:01.381421 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a2e82b63-80b7-43bb-89e9-5ea77fd3626f None None] Sync routers for ids ['8cbd7ad3-04d4-4ab0-b79f-a9a391f624b1'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:34:01.400648 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f766b2a3-a23a-4f27-9c9f-87e220274bb8 req-0e58e778-fe7a-40e1-9809-72fae5ee2df8 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/security-groups?id=8fd0adbd-57c5-4583-8e2d-9a55d7973976&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1650612 Nov 09 04:34:01.404381 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-74bd1fad-f869-4c63-8a3d-3c9426b38d54 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:01.423014 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-74bd1fad-f869-4c63-8a3d-3c9426b38d54 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "DELETE /v2.0/ports/77290ebd-f244-4a68-94af-4d033c4a6349 HTTP/1.1" status: 204 len: 168 time: 1.1129408 Nov 09 04:34:01.424698 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.ipam_pluggable_backend [None req-09cb3c5b-b977-4928-9a1f-8a840fdc055b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Port 9cdeb819-d907-4b68-82ca-b57f5a3ba0e8 was deleted while updating it with an IPv6 auto-address. Ignoring. {{(pid=102161) add_auto_addrs_on_network_ports /opt/stack/neutron/neutron/db/ipam_pluggable_backend.py:573}} Nov 09 04:34:01.425095 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.ipam_pluggable_backend [None req-09cb3c5b-b977-4928-9a1f-8a840fdc055b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Reverting IP allocation for 2001:db8::f816:3eff:fe2e:be6a {{(pid=102161) add_auto_addrs_on_network_ports /opt/stack/neutron/neutron/db/ipam_pluggable_backend.py:575}} Nov 09 04:34:01.425477 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a2e82b63-80b7-43bb-89e9-5ea77fd3626f None None] Routers {'8cbd7ad3-04d4-4ab0-b79f-a9a391f624b1'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:34:01.426182 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-a2e82b63-80b7-43bb-89e9-5ea77fd3626f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:33:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8cbd7ad3-04d4-4ab0-b79f-a9a391f624b1'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:01.427394 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57590) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:01.432446 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.ipam_pluggable_backend [None req-09cb3c5b-b977-4928-9a1f-8a840fdc055b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Reverting IP allocation failed for 2001:db8::f816:3eff:fe2e:be6a {{(pid=102161) add_auto_addrs_on_network_ports /opt/stack/neutron/neutron/db/ipam_pluggable_backend.py:581}} Nov 09 04:34:01.442696 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74bd1fad-f869-4c63-8a3d-3c9426b38d54 tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event deleted for resources: {'Port': ['ID=77290ebd-f244-4a68-94af-4d033c4a6349,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:01.456940 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c3bd49ca-63f3-47ac-bc3d-0c3ac0027ad6 req-78472fe0-a4fe-4fb9-b9d3-ac7203e0a174 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Made reservation on behalf of 1d10b4824e524068827e58b55e269af3 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:34:01.460646 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-c3bd49ca-63f3-47ac-bc3d-0c3ac0027ad6 req-78472fe0-a4fe-4fb9-b9d3-ac7203e0a174 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:01.470489 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-09cb3c5b-b977-4928-9a1f-8a840fdc055b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:01.474101 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-a2e82b63-80b7-43bb-89e9-5ea77fd3626f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:01.488652 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a2e82b63-80b7-43bb-89e9-5ea77fd3626f None None] Routers {'8cbd7ad3-04d4-4ab0-b79f-a9a391f624b1'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:34:01.489420 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-a2e82b63-80b7-43bb-89e9-5ea77fd3626f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:33:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8cbd7ad3-04d4-4ab0-b79f-a9a391f624b1'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:01.505704 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-2d88f33a-a743-4ebe-b497-bb8c70343342 req-d17ff92a-b208-412c-9e61-6e3843d7c8af tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=8f462374-376b-4c38-b300-528ae5358377 HTTP/1.1" status: 200 len: 210 time: 0.0762172 Nov 09 04:34:01.558196 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-a2e82b63-80b7-43bb-89e9-5ea77fd3626f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:01.558617 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a2e82b63-80b7-43bb-89e9-5ea77fd3626f None None] The sync data for ids ['8cbd7ad3-04d4-4ab0-b79f-a9a391f624b1'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:34:01.573192 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-94649ee2-0ca3-4f3c-aef9-bee228279672 None None] Provisioning complete for port 3c324982-d7b8-4a65-9614-579eaad5ada7 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:01.573714 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-94649ee2-0ca3-4f3c-aef9-bee228279672 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:01.591430 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-09cb3c5b-b977-4928-9a1f-8a840fdc055b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:34:01.598630 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-09cb3c5b-b977-4928-9a1f-8a840fdc055b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:01.608429 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-09cb3c5b-b977-4928-9a1f-8a840fdc055b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:01.609334 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-09cb3c5b-b977-4928-9a1f-8a840fdc055b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:01.633057 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7a0b454c-1ae7-4d68-be28-331e24ecc9a9 None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:34:01.656227 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-199b215e-008f-42fd-a3c3-7150e46136bf tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:01.662989 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cb3c5b-b977-4928-9a1f-8a840fdc055b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Subnet': ['ID=6cd48768-2b89-4629-808b-21cb29364842,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:01.697805 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 534ec346-6b5d-44cb-9cb1-654cb2217ed5 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:34:01.793945 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-199b215e-008f-42fd-a3c3-7150e46136bf tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:01.820203 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-199b215e-008f-42fd-a3c3-7150e46136bf tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['002d27a0-2fb8-4426-9550-42c444556a8e']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:01.832857 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-199b215e-008f-42fd-a3c3-7150e46136bf tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '53b7b761-0c0a-4377-98bf-58d99642533b') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:01.833152 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-199b215e-008f-42fd-a3c3-7150e46136bf tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '53b7b761-0c0a-4377-98bf-58d99642533b') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:01.853468 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-199b215e-008f-42fd-a3c3-7150e46136bf tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:01.869148 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-199b215e-008f-42fd-a3c3-7150e46136bf tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:01.875668 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-199b215e-008f-42fd-a3c3-7150e46136bf tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Releasing vlan 324 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:34:01.876068 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-199b215e-008f-42fd-a3c3-7150e46136bf tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:01.883923 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:34:01.883923 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:34:01.883923 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:34:01.883923 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:34:01.883923 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:34:01.883923 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:34:01.883923 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:34:01.883923 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:34:01.883923 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:34:01.883923 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:34:01.883923 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:34:01.883923 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:34:01.883923 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:34:01.883923 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:34:01.883923 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:34:01.883923 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:34:01.883923 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:34:01.883923 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:34:01.883923 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:34:01.883923 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:34:01.883923 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:34:01.883923 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:34:01.883923 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:34:01.883923 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:34:01.883923 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:34:01.883923 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:34:01.883923 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:34:01.883923 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:34:01.883923 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:34:01.883923 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:34:01.883923 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:34:01.883923 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:34:01.890237 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-09cb3c5b-b977-4928-9a1f-8a840fdc055b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 827 time: 2.7592871 Nov 09 04:34:01.890978 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57592) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:01.908065 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-d52fb058-8a72-46ac-b401-b10e172de0d4 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'subnet': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:01.910015 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-94649ee2-0ca3-4f3c-aef9-bee228279672 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:01.953338 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 534ec346-6b5d-44cb-9cb1-654cb2217ed5 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:01.953675 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:02.017712 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-94649ee2-0ca3-4f3c-aef9-bee228279672 None None] For port 3c324982-d7b8-4a65-9614-579eaad5ada7, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=3c324982-d7b8-4a65-9614-579eaad5ada7,segment=NetworkSegment(01c8e428-6cb4-4160-9a48-6a294a0d7cc0),segment_id=01c8e428-6cb4-4160-9a48-6a294a0d7cc0)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:34:02.064005 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-199b215e-008f-42fd-a3c3-7150e46136bf tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:02.064681 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1cddf9e9-cd5e-4d12-bb48-c361258dbd43 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-988d2354-693c-4d52-af17-25e0643eaa0c', 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'tenant_id': '8b0758f781884982bf5b94e6609237f6', 'fixed_ips': [{'subnet_id': '6cd48768-2b89-4629-808b-21cb29364842'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:34:02.065538 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1cddf9e9-cd5e-4d12-bb48-c361258dbd43 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:02.071969 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-199b215e-008f-42fd-a3c3-7150e46136bf tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:02.077287 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-199b215e-008f-42fd-a3c3-7150e46136bf tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] 10.222.0.24 "DELETE /v2.0/networks/002d27a0-2fb8-4426-9550-42c444556a8e HTTP/1.1" status: 204 len: 168 time: 0.6444941 Nov 09 04:34:02.087517 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-199b215e-008f-42fd-a3c3-7150e46136bf tempest-PortsIpV6TestJSON-358248317 tempest-PortsIpV6TestJSON-358248317-project] Pushing event deleted for resources: {'Network': ['ID=002d27a0-2fb8-4426-9550-42c444556a8e,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:02.087684 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-94649ee2-0ca3-4f3c-aef9-bee228279672 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:02.109268 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d52fb058-8a72-46ac-b401-b10e172de0d4 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:34:02.113923 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d52fb058-8a72-46ac-b401-b10e172de0d4 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:02.162185 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-616c6b10-2128-4ead-a020-1af08a70f026 req-0eaf588d-59cc-4f3d-a746-2a126a0598be tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] For port 99ad1d96-b35b-4120-b5a9-c95c47bd3ffc, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=99ad1d96-b35b-4120-b5a9-c95c47bd3ffc,segment=NetworkSegment(e211d893-ee7a-48e3-bc29-b8824167e15b),segment_id=e211d893-ee7a-48e3-bc29-b8824167e15b)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:34:02.162814 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-616c6b10-2128-4ead-a020-1af08a70f026 req-0eaf588d-59cc-4f3d-a746-2a126a0598be tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:02.238954 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.ipam_backend_mixin [None req-d52fb058-8a72-46ac-b401-b10e172de0d4 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet 6cd48768-2b89-4629-808b-21cb29364842 (CIDR: 2001:db8::/64) Nov 09 04:34:02.251669 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 3c324982-d7b8-4a65-9614-579eaad5ada7 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:34:02.258843 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-94649ee2-0ca3-4f3c-aef9-bee228279672 None None] Provisioning complete for port dda09359-42a6-4fca-addb-eb15fb39acf7 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:02.259210 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-94649ee2-0ca3-4f3c-aef9-bee228279672 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:02.287078 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-d52fb058-8a72-46ac-b401-b10e172de0d4 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:34:02.287716 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d52fb058-8a72-46ac-b401-b10e172de0d4 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:02.325951 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94649ee2-0ca3-4f3c-aef9-bee228279672 None None] Pushing event updated for resources: {'Port': ['ID=3c324982-d7b8-4a65-9614-579eaad5ada7,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:02.380868 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-94649ee2-0ca3-4f3c-aef9-bee228279672 None None] Port dda09359-42a6-4fca-addb-eb15fb39acf7 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:34:02.389073 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [req-c3bd49ca-63f3-47ac-bc3d-0c3ac0027ad6 req-78472fe0-a4fe-4fb9-b9d3-ac7203e0a174 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Allocated IP 172.20.0.7 (239a9c72-6384-4d5a-a69d-f4ac0c580e40/33b5599d-7ebe-4564-9c72-76f5d540fd80/09cbfb91-4118-43af-8b70-41d8d4265574) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:34:02.391704 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-d52fb058-8a72-46ac-b401-b10e172de0d4 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.4872775 Nov 09 04:34:02.392610 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57598) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:02.398811 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-58b27f53-4f45-4d0a-8b6d-514ca7fc2df4 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'subnet': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:02.411029 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-1cddf9e9-cd5e-4d12-bb48-c361258dbd43 None None] Allocated IP 2001:db8::f816:3eff:feb2:3603 (988d2354-693c-4d52-af17-25e0643eaa0c/6cd48768-2b89-4629-808b-21cb29364842/581d0ca4-fbed-467b-b830-9a22a5876d15) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:34:02.427976 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 3c324982-d7b8-4a65-9614-579eaad5ada7 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:02.428344 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:02.540818 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-819d92d3-7f10-44f1-ac29-e20b78c87a08 None None] Provisioning complete for port 3c324982-d7b8-4a65-9614-579eaad5ada7 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:02.541542 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-819d92d3-7f10-44f1-ac29-e20b78c87a08 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:02.607272 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8b80a4c-a102-4eb6-a3e3-22a8e6c1a3ca req-c9b6d97a-11ae-4331-b40f-953ab4fe1c2e tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:02.608808 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e8b80a4c-a102-4eb6-a3e3-22a8e6c1a3ca req-c9b6d97a-11ae-4331-b40f-953ab4fe1c2e tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 945 time: 0.2373333 Nov 09 04:34:02.615604 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9346d4c1-72dc-403d-9f54-8097315557be req-90de63c8-c702-468d-95c3-5118f221b284 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:02.624956 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-9346d4c1-72dc-403d-9f54-8097315557be req-90de63c8-c702-468d-95c3-5118f221b284 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/ports?device_id=e145337f-88ba-4f6d-a894-39631a8dd013 HTTP/1.1" status: 200 len: 945 time: 0.1308970 Nov 09 04:34:02.703446 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-9346d4c1-72dc-403d-9f54-8097315557be req-3c8d8a1b-660e-4708-af4f-964731fa459f tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/security-groups?id=8fd0adbd-57c5-4583-8e2d-9a55d7973976&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0641065 Nov 09 04:34:02.765818 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-616c6b10-2128-4ead-a020-1af08a70f026 req-0eaf588d-59cc-4f3d-a746-2a126a0598be tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:02.766557 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-616c6b10-2128-4ead-a020-1af08a70f026 req-0eaf588d-59cc-4f3d-a746-2a126a0598be tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:02.767079 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.l3_db [req-616c6b10-2128-4ead-a020-1af08a70f026 req-0eaf588d-59cc-4f3d-a746-2a126a0598be tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Floating IP a95b836b-fec6-4af9-8970-923ef2700539 disassociated. External IP: 172.26.0.108, port: 99ad1d96-b35b-4120-b5a9-c95c47bd3ffc. Nov 09 04:34:02.767428 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-616c6b10-2128-4ead-a020-1af08a70f026 req-0eaf588d-59cc-4f3d-a746-2a126a0598be tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Calling delete_port for 99ad1d96-b35b-4120-b5a9-c95c47bd3ffc owned by compute:nova {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:34:02.789935 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57608) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:02.790739 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-58b27f53-4f45-4d0a-8b6d-514ca7fc2df4 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:34:02.795168 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-58b27f53-4f45-4d0a-8b6d-514ca7fc2df4 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:02.871645 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e8b80a4c-a102-4eb6-a3e3-22a8e6c1a3ca req-c5ba4ac5-d0ce-4d96-9075-513412ec2436 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups?id=e441bd2c-e53d-45df-ab4c-85115d8b53a7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2330210 Nov 09 04:34:02.881038 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.api.v2.resource [None req-ace9d078-7a90-4d3c-b780-78a5b04ad904 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] add_router_interface failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:34:02.881038 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-ace9d078-7a90-4d3c-b780-78a5b04ad904 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] 10.222.0.24 "PUT /v2.0/routers/8cbd7ad3-04d4-4ab0-b79f-a9a391f624b1/add_router_interface HTTP/1.1" status: 400 len: 438 time: 1.4988608 Nov 09 04:34:02.881038 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-c3bd49ca-63f3-47ac-bc3d-0c3ac0027ad6 req-78472fe0-a4fe-4fb9-b9d3-ac7203e0a174 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:02.893934 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57612) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:02.917879 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 9cdeb819-d907-4b68-82ca-b57f5a3ba0e8 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:34:02.922995 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1cddf9e9-cd5e-4d12-bb48-c361258dbd43 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:02.947393 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 9cdeb819-d907-4b68-82ca-b57f5a3ba0e8 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:34:02.948130 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 9cdeb819-d907-4b68-82ca-b57f5a3ba0e8 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:34:02.948551 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device c315ee21-870f-44c3-b604-c4eb34ea288a no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:34:02.979196 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: c315ee21-870f-44c3-b604-c4eb34ea288a {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:34:02.980037 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device c315ee21-870f-44c3-b604-c4eb34ea288a not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:34:02.992266 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-e7f17793-f068-4e5a-b807-8d82b16d36a9 req-4427b8d8-3bea-4c0e-87ad-504af7ee4068 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=8f462374-376b-4c38-b300-528ae5358377 HTTP/1.1" status: 200 len: 210 time: 0.0591531 Nov 09 04:34:03.019783 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1cddf9e9-cd5e-4d12-bb48-c361258dbd43 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:03.070982 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1cddf9e9-cd5e-4d12-bb48-c361258dbd43 None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:34:03.080182 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-64e178eb-5177-46f7-9c0e-80e120898818 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=12e47d8445b5429892cd1b9244512ca8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2784896 Nov 09 04:34:03.081681 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-1cddf9e9-cd5e-4d12-bb48-c361258dbd43 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:03.083740 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cddf9e9-cd5e-4d12-bb48-c361258dbd43 None None] Pushing event updated for resources: {'Port': ['ID=581d0ca4-fbed-467b-b830-9a22a5876d15,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:03.083875 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57614) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:03.085739 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1cddf9e9-cd5e-4d12-bb48-c361258dbd43 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:34:03.142959 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-c3bd49ca-63f3-47ac-bc3d-0c3ac0027ad6 req-78472fe0-a4fe-4fb9-b9d3-ac7203e0a174 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:03.151658 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-1cddf9e9-cd5e-4d12-bb48-c361258dbd43 None None] Attempting to bind port 581d0ca4-fbed-467b-b830-9a22a5876d15 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:34:03.152037 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-1cddf9e9-cd5e-4d12-bb48-c361258dbd43 None None] Attempting to bind port 581d0ca4-fbed-467b-b830-9a22a5876d15 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:34:03.152410 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1cddf9e9-cd5e-4d12-bb48-c361258dbd43 None None] Attempting to bind port 581d0ca4-fbed-467b-b830-9a22a5876d15 on network 988d2354-693c-4d52-af17-25e0643eaa0c {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:34:03.152758 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d5f67dae-0f5d-4dca-a6d3-f983ffaab834 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:03.157873 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1cddf9e9-cd5e-4d12-bb48-c361258dbd43 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 33, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:34:03.158407 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1cddf9e9-cd5e-4d12-bb48-c361258dbd43 None None] Checking segment: {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:34:03.158885 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1cddf9e9-cd5e-4d12-bb48-c361258dbd43 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:03.159344 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1cddf9e9-cd5e-4d12-bb48-c361258dbd43 None None] Bound using segment: {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:34:03.159821 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-1cddf9e9-cd5e-4d12-bb48-c361258dbd43 None None] Bound port: 581d0ca4-fbed-467b-b830-9a22a5876d15, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:34:03.160218 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1cddf9e9-cd5e-4d12-bb48-c361258dbd43 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:03.215685 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d5f67dae-0f5d-4dca-a6d3-f983ffaab834 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:03.229366 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c3bd49ca-63f3-47ac-bc3d-0c3ac0027ad6 req-78472fe0-a4fe-4fb9-b9d3-ac7203e0a174 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network 239a9c72-6384-4d5a-a69d-f4ac0c580e40 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:34:03.234034 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-1cddf9e9-cd5e-4d12-bb48-c361258dbd43 None None] For port 581d0ca4-fbed-467b-b830-9a22a5876d15, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:34:03.237281 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78472fe0-a4fe-4fb9-b9d3-ac7203e0a174 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Port': ['ID=09cbfb91-4118-43af-8b70-41d8d4265574,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:03.237500 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-1cddf9e9-cd5e-4d12-bb48-c361258dbd43 None None] For port 581d0ca4-fbed-467b-b830-9a22a5876d15, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=581d0ca4-fbed-467b-b830-9a22a5876d15,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:34:03.239917 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [req-c3bd49ca-63f3-47ac-bc3d-0c3ac0027ad6 req-78472fe0-a4fe-4fb9-b9d3-ac7203e0a174 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:03.261161 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-c3bd49ca-63f3-47ac-bc3d-0c3ac0027ad6 req-78472fe0-a4fe-4fb9-b9d3-ac7203e0a174 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:34:03.316947 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1cddf9e9-cd5e-4d12-bb48-c361258dbd43 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:03.325293 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-616c6b10-2128-4ead-a020-1af08a70f026 req-0eaf588d-59cc-4f3d-a746-2a126a0598be tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:03.376349 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cddf9e9-cd5e-4d12-bb48-c361258dbd43 None None] Pushing event updated for resources: {'Port': ['ID=581d0ca4-fbed-467b-b830-9a22a5876d15,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:03.381011 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3bd49ca-63f3-47ac-bc3d-0c3ac0027ad6 req-78472fe0-a4fe-4fb9-b9d3-ac7203e0a174 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:03.383817 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d5f67dae-0f5d-4dca-a6d3-f983ffaab834 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:03.386939 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d5f67dae-0f5d-4dca-a6d3-f983ffaab834 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:03.387240 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-c3bd49ca-63f3-47ac-bc3d-0c3ac0027ad6 req-78472fe0-a4fe-4fb9-b9d3-ac7203e0a174 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:03.392423 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-d5f67dae-0f5d-4dca-a6d3-f983ffaab834 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/72e76adb-375a-4051-bf58-72b97c5a3a12 HTTP/1.1" status: 204 len: 168 time: 0.3036261 Nov 09 04:34:03.412628 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5f67dae-0f5d-4dca-a6d3-f983ffaab834 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=72e76adb-375a-4051-bf58-72b97c5a3a12,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:03.464110 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 3c324982-d7b8-4a65-9614-579eaad5ada7 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:34:03.469046 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-58b27f53-4f45-4d0a-8b6d-514ca7fc2df4 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:03.496035 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0eaf588d-59cc-4f3d-a746-2a126a0598be tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Pushing event deleted for resources: {'Port': ['ID=99ad1d96-b35b-4120-b5a9-c95c47bd3ffc,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:03.553169 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c3bd49ca-63f3-47ac-bc3d-0c3ac0027ad6 req-78472fe0-a4fe-4fb9-b9d3-ac7203e0a174 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.5298538 Nov 09 04:34:03.588395 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-c3bd49ca-63f3-47ac-bc3d-0c3ac0027ad6 req-e7cecc63-dd9d-4018-b542-b51580cd5bf6 service neutron] Request body: {'port': {'device_id': '8f462374-376b-4c38-b300-528ae5358377', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:03.588849 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-58b27f53-4f45-4d0a-8b6d-514ca7fc2df4 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:34:03.595727 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 3c324982-d7b8-4a65-9614-579eaad5ada7 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:03.596347 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:03.623890 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-58b27f53-4f45-4d0a-8b6d-514ca7fc2df4 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:03.629270 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-58b27f53-4f45-4d0a-8b6d-514ca7fc2df4 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:03.629859 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-58b27f53-4f45-4d0a-8b6d-514ca7fc2df4 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:03.647953 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58b27f53-4f45-4d0a-8b6d-514ca7fc2df4 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Subnet': ['ID=bac6b1bf-6999-4b76-a454-5b191f2e547e,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:03.682004 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbf8ebb5-1fed-43ff-919f-02f7ab276626 req-fd1ee62d-b634-4b0c-b1e9-91a5ab6e2c8e tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:03.684497 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-dbf8ebb5-1fed-43ff-919f-02f7ab276626 req-fd1ee62d-b634-4b0c-b1e9-91a5ab6e2c8e tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/ports?device_id=e145337f-88ba-4f6d-a894-39631a8dd013 HTTP/1.1" status: 200 len: 945 time: 0.2671070 Nov 09 04:34:03.763410 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-58b27f53-4f45-4d0a-8b6d-514ca7fc2df4 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 1.3688128 Nov 09 04:34:03.766792 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57622) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:03.781683 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-71145347-ab01-4310-8b6d-749944a178d6 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'port': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'mac_address': 'fa:16:3e:00:96:f2', 'name': 'tempest-NetworksTestDHCPv6-1588796434'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:03.822848 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [req-616c6b10-2128-4ead-a020-1af08a70f026 req-0eaf588d-59cc-4f3d-a746-2a126a0598be tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Router 5023cfbb-afb2-4e33-bdc1-c1173218f6bf has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:34:03.823564 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-c3bd49ca-63f3-47ac-bc3d-0c3ac0027ad6 req-e7cecc63-dd9d-4018-b542-b51580cd5bf6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:03.837951 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-bb2e21e5-19b4-4c2e-bfca-42324ebca958 None None] Provisioning complete for port 09cbfb91-4118-43af-8b70-41d8d4265574 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:03.837951 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-bb2e21e5-19b4-4c2e-bfca-42324ebca958 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:03.848799 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-dbf8ebb5-1fed-43ff-919f-02f7ab276626 req-4026d558-2c1d-494a-9d87-fd72beb0ef1d tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/security-groups?id=8fd0adbd-57c5-4583-8e2d-9a55d7973976&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1543128 Nov 09 04:34:03.923886 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-929afc71-cce6-4981-8767-ab47df30a53d tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:03.934983 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-bb2e21e5-19b4-4c2e-bfca-42324ebca958 None None] Port 09cbfb91-4118-43af-8b70-41d8d4265574 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:34:04.129378 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99079d23-e052-447b-a360-5163e08104bb req-d5b3db6e-ae74-4966-936a-590fdfe3d04f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:04.131202 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-169891d9-7dd3-4431-85ac-f961d0c217dc req-44c8fe21-7893-424f-ba8f-b8c9b0d37c35 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 210 time: 0.0574367 Nov 09 04:34:04.131425 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-99079d23-e052-447b-a360-5163e08104bb req-d5b3db6e-ae74-4966-936a-590fdfe3d04f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=8f462374-376b-4c38-b300-528ae5358377 HTTP/1.1" status: 200 len: 931 time: 0.0572879 Nov 09 04:34:04.143219 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 99ad1d96-b35b-4120-b5a9-c95c47bd3ffc no longer exists at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:34:04.165121 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] No Port match for: 99ad1d96-b35b-4120-b5a9-c95c47bd3ffc {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:34:04.165385 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 99ad1d96-b35b-4120-b5a9-c95c47bd3ffc not bound to the agent host hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:34:04.195712 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-99079d23-e052-447b-a360-5163e08104bb req-84a744ff-804d-464d-9bca-d9452b28e1dd tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=99157167-0266-49ff-809e-cf8a91af8ae5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0502033 Nov 09 04:34:04.319663 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-616c6b10-2128-4ead-a020-1af08a70f026 req-0eaf588d-59cc-4f3d-a746-2a126a0598be tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:34:04.333634 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a72bce0-a20b-451d-a5b9-6264aa35d692 None None] Sync routers for ids ['5023cfbb-afb2-4e33-bdc1-c1173218f6bf'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:34:04.344018 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a72bce0-a20b-451d-a5b9-6264aa35d692 None None] Routers {'5023cfbb-afb2-4e33-bdc1-c1173218f6bf'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:34:04.345062 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-4a72bce0-a20b-451d-a5b9-6264aa35d692 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:33:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['5023cfbb-afb2-4e33-bdc1-c1173218f6bf'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:04.356332 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-71145347-ab01-4310-8b6d-749944a178d6 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'port': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:34:04.395804 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-616c6b10-2128-4ead-a020-1af08a70f026 req-0eaf588d-59cc-4f3d-a746-2a126a0598be tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] No DVR routers for this DVR port 99ad1d96-b35b-4120-b5a9-c95c47bd3ffc on host hv-neutron-8168 {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:34:04.402049 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-616c6b10-2128-4ead-a020-1af08a70f026 req-0eaf588d-59cc-4f3d-a746-2a126a0598be tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:04.421106 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-616c6b10-2128-4ead-a020-1af08a70f026 req-0eaf588d-59cc-4f3d-a746-2a126a0598be tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.26 "DELETE /v2.0/ports/99ad1d96-b35b-4120-b5a9-c95c47bd3ffc HTTP/1.1" status: 204 len: 173 time: 3.5316920 Nov 09 04:34:04.421533 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '433dca8f-3e84-4693-93ed-4f8fcd69553a', 'name': 'network-vif-deleted', 'tag': '99ad1d96-b35b-4120-b5a9-c95c47bd3ffc'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:34:04.423950 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-384f47d0-420b-4004-9a0c-765020eff431" -d '{"events": [{"server_uuid": "433dca8f-3e84-4693-93ed-4f8fcd69553a", "name": "network-vif-deleted", "tag": "99ad1d96-b35b-4120-b5a9-c95c47bd3ffc"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:34:04.464769 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-4a72bce0-a20b-451d-a5b9-6264aa35d692 None None] Set router 5023cfbb-afb2-4e33-bdc1-c1173218f6bf gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:34:04.532185 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-71145347-ab01-4310-8b6d-749944a178d6 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:04.590376 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [None req-71145347-ab01-4310-8b6d-749944a178d6 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] device_id is not set on port a208cfce-6881-4bb5-8c15-38aa3d67c127 yet. {{(pid=102161) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:34:04.821645 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-4a72bce0-a20b-451d-a5b9-6264aa35d692 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5023cfbb-afb2-4e33-bdc1-c1173218f6bf', 'name': 'tempest-ServerActionsTestJSON-1211051012-router', 'tenant_id': '6015befde7f546d881cb247ae5bc81ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.95'}], 'enable_snat': True}, 'gw_port_id': 'a4e20770-3342-4c9b-a9bf-d4dab52b7d8d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:30:28Z', 'updated_at': '2021-11-09T04:30:43Z', 'revision_number': 4, 'project_id': '6015befde7f546d881cb247ae5bc81ae', 'gw_port': {'id': 'a4e20770-3342-4c9b-a9bf-d4dab52b7d8d', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:03:2b:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5023cfbb-afb2-4e33-bdc1-c1173218f6bf', 'device_owner': 'network:router_gateway', 'standard_attr_id': 499, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:30:29Z', 'updated_at': '2021-11-09T04:30:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'e025929c-44cc-4832-b4a4-0216288df212', 'name': '', 'network_id': 'a270b61c-1f4f-4d97-be79-4a24c65fddc2', 'tenant_id': '6015befde7f546d881cb247ae5bc81ae', 'mac_address': 'fa:16:3e:7a:69:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5023cfbb-afb2-4e33-bdc1-c1173218f6bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 539, 'fixed_ips': [{'subnet_id': 'b2956e71-9b0f-4060-922c-e54ce6cff80a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:30:40Z', 'updated_at': '2021-11-09T04:30:50Z', 'revision_number': 5, 'project_id': '6015befde7f546d881cb247ae5bc81ae', 'subnets': [{'id': 'b2956e71-9b0f-4060-922c-e54ce6cff80a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:04.867671 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a72bce0-a20b-451d-a5b9-6264aa35d692 None None] Checking router: 5023cfbb-afb2-4e33-bdc1-c1173218f6bf for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:34:04.886527 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a72bce0-a20b-451d-a5b9-6264aa35d692 None None] Routers {'5023cfbb-afb2-4e33-bdc1-c1173218f6bf'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:34:04.887397 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-4a72bce0-a20b-451d-a5b9-6264aa35d692 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:33:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['5023cfbb-afb2-4e33-bdc1-c1173218f6bf'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:04.995424 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-71145347-ab01-4310-8b6d-749944a178d6 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Allocated IP 2001:db8:0:1::2a8 (988d2354-693c-4d52-af17-25e0643eaa0c/bac6b1bf-6999-4b76-a454-5b191f2e547e/a208cfce-6881-4bb5-8c15-38aa3d67c127) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:34:05.007383 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c205ac6e-0655-4873-9812-da6772004689 None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:34:05.023195 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:34:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-775225a3-f202-4386-b813-b0b27998398c x-openstack-request-id: req-775225a3-f202-4386-b813-b0b27998398c {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:34:05.023559 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "433dca8f-3e84-4693-93ed-4f8fcd69553a", "name": "network-vif-deleted", "tag": "99ad1d96-b35b-4120-b5a9-c95c47bd3ffc", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:34:05.023876 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-775225a3-f202-4386-b813-b0b27998398c {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:34:05.024342 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '433dca8f-3e84-4693-93ed-4f8fcd69553a', 'name': 'network-vif-deleted', 'tag': '99ad1d96-b35b-4120-b5a9-c95c47bd3ffc', 'status': 'completed', 'code': 200} Nov 09 04:34:05.045519 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-71145347-ab01-4310-8b6d-749944a178d6 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Allocated IP 2001:db8::f816:3eff:fe00:96f2 (988d2354-693c-4d52-af17-25e0643eaa0c/6cd48768-2b89-4629-808b-21cb29364842/a208cfce-6881-4bb5-8c15-38aa3d67c127) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:34:05.085309 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-4a72bce0-a20b-451d-a5b9-6264aa35d692 None None] Set router 5023cfbb-afb2-4e33-bdc1-c1173218f6bf gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:34:05.141535 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [req-c3bd49ca-63f3-47ac-bc3d-0c3ac0027ad6 req-e7cecc63-dd9d-4018-b542-b51580cd5bf6 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 09cbfb91-4118-43af-8b70-41d8d4265574 {{(pid=102162) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:34:05.153066 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-c3bd49ca-63f3-47ac-bc3d-0c3ac0027ad6 req-e7cecc63-dd9d-4018-b542-b51580cd5bf6 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:05.157468 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-ab42e401-4dc3-4a04-ba26-ae70a36f295e None None] Provisioning complete for port 581d0ca4-fbed-467b-b830-9a22a5876d15 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:05.157468 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ab42e401-4dc3-4a04-ba26-ae70a36f295e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:05.167626 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57652) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:05.231363 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.provisioning_blocks [req-c3bd49ca-63f3-47ac-bc3d-0c3ac0027ad6 req-e7cecc63-dd9d-4018-b542-b51580cd5bf6 service neutron] Transition to ACTIVE for port object 09cbfb91-4118-43af-8b70-41d8d4265574 will not be triggered until provisioned by entity L2. {{(pid=102162) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 09 04:34:05.242008 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-929afc71-cce6-4981-8767-ab47df30a53d tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Deleting port dda09359-42a6-4fca-addb-eb15fb39acf7 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:34:05.243303 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-929afc71-cce6-4981-8767-ab47df30a53d tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:05.370618 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-929afc71-cce6-4981-8767-ab47df30a53d tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:05.396376 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-929afc71-cce6-4981-8767-ab47df30a53d tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Calling delete_port for dda09359-42a6-4fca-addb-eb15fb39acf7 owned by network:router_interface {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:34:05.427288 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ab42e401-4dc3-4a04-ba26-ae70a36f295e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:05.521479 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-ab42e401-4dc3-4a04-ba26-ae70a36f295e None None] For port 581d0ca4-fbed-467b-b830-9a22a5876d15, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=581d0ca4-fbed-467b-b830-9a22a5876d15,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:34:05.528168 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 581d0ca4-fbed-467b-b830-9a22a5876d15 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:34:05.537657 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-4f0db671-64d4-475f-9fed-318f139dc2d8 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Request body: {'network': {'name': 'tempest-TagsExtTest-test-network-1393312597'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:05.557637 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-c3bd49ca-63f3-47ac-bc3d-0c3ac0027ad6 req-e7cecc63-dd9d-4018-b542-b51580cd5bf6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:05.559029 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5bc268cb-64a5-42a6-837f-deedc88e9813 None None] Update dhcp port {'port': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'fixed_ips': [{'subnet_id': '6cd48768-2b89-4629-808b-21cb29364842', 'ip_address': '2001:db8::f816:3eff:feb2:3603'}, {'subnet_id': 'bac6b1bf-6999-4b76-a454-5b191f2e547e'}], 'binding:host_id': 'dv-neutron-816802-2-hyperv'}, 'id': '581d0ca4-fbed-467b-b830-9a22a5876d15'} from dv-neutron-816802-2-hyperv. {{(pid=102163) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:328}} Nov 09 04:34:05.598635 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5bc268cb-64a5-42a6-837f-deedc88e9813 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:05.603357 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ab42e401-4dc3-4a04-ba26-ae70a36f295e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:05.624163 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5d48a959-5416-4be4-93db-11ca7b7273b0 req-0bd7ccd3-0702-49f1-82c3-9af6de249277 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/ports?device_id=433dca8f-3e84-4693-93ed-4f8fcd69553a HTTP/1.1" status: 200 len: 210 time: 0.0906811 Nov 09 04:34:05.684447 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24762c2b-fafb-4065-a7a3-fb1048dab7ee req-8cf84eb2-2892-4007-b862-f0dc1a90a8f1 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:05.685985 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-24762c2b-fafb-4065-a7a3-fb1048dab7ee req-8cf84eb2-2892-4007-b862-f0dc1a90a8f1 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/ports?device_id=e145337f-88ba-4f6d-a894-39631a8dd013 HTTP/1.1" status: 200 len: 945 time: 0.7104290 Nov 09 04:34:05.695214 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-4a72bce0-a20b-451d-a5b9-6264aa35d692 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5023cfbb-afb2-4e33-bdc1-c1173218f6bf', 'name': 'tempest-ServerActionsTestJSON-1211051012-router', 'tenant_id': '6015befde7f546d881cb247ae5bc81ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.95'}], 'enable_snat': True}, 'gw_port_id': 'a4e20770-3342-4c9b-a9bf-d4dab52b7d8d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:30:28Z', 'updated_at': '2021-11-09T04:30:43Z', 'revision_number': 4, 'project_id': '6015befde7f546d881cb247ae5bc81ae', 'gw_port': {'id': 'a4e20770-3342-4c9b-a9bf-d4dab52b7d8d', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:03:2b:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5023cfbb-afb2-4e33-bdc1-c1173218f6bf', 'device_owner': 'network:router_gateway', 'standard_attr_id': 499, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:30:29Z', 'updated_at': '2021-11-09T04:30:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'e025929c-44cc-4832-b4a4-0216288df212', 'name': '', 'network_id': 'a270b61c-1f4f-4d97-be79-4a24c65fddc2', 'tenant_id': '6015befde7f546d881cb247ae5bc81ae', 'mac_address': 'fa:16:3e:7a:69:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5023cfbb-afb2-4e33-bdc1-c1173218f6bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 539, 'fixed_ips': [{'subnet_id': 'b2956e71-9b0f-4060-922c-e54ce6cff80a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:30:40Z', 'updated_at': '2021-11-09T04:30:50Z', 'revision_number': 5, 'project_id': '6015befde7f546d881cb247ae5bc81ae', 'subnets': [{'id': 'b2956e71-9b0f-4060-922c-e54ce6cff80a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:05.707974 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 581d0ca4-fbed-467b-b830-9a22a5876d15 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:05.710261 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:05.748127 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab42e401-4dc3-4a04-ba26-ae70a36f295e None None] Pushing event updated for resources: {'Port': ['ID=581d0ca4-fbed-467b-b830-9a22a5876d15,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:05.756771 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a72bce0-a20b-451d-a5b9-6264aa35d692 None None] The sync data for ids ['5023cfbb-afb2-4e33-bdc1-c1173218f6bf'] in dv-neutron-816802-2-hyperv is: [{'id': '5023cfbb-afb2-4e33-bdc1-c1173218f6bf', 'name': 'tempest-ServerActionsTestJSON-1211051012-router', 'tenant_id': '6015befde7f546d881cb247ae5bc81ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.95'}], 'enable_snat': True}, 'gw_port_id': 'a4e20770-3342-4c9b-a9bf-d4dab52b7d8d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:30:28Z', 'updated_at': '2021-11-09T04:30:43Z', 'revision_number': 4, 'project_id': '6015befde7f546d881cb247ae5bc81ae', 'gw_port': {'id': 'a4e20770-3342-4c9b-a9bf-d4dab52b7d8d', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:03:2b:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5023cfbb-afb2-4e33-bdc1-c1173218f6bf', 'device_owner': 'network:router_gateway', 'standard_attr_id': 499, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:30:29Z', 'updated_at': '2021-11-09T04:30:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'e025929c-44cc-4832-b4a4-0216288df212', 'name': '', 'network_id': 'a270b61c-1f4f-4d97-be79-4a24c65fddc2', 'tenant_id': '6015befde7f546d881cb247ae5bc81ae', 'mac_address': 'fa:16:3e:7a:69:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5023cfbb-afb2-4e33-bdc1-c1173218f6bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 539, 'fixed_ips': [{'subnet_id': 'b2956e71-9b0f-4060-922c-e54ce6cff80a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:30:40Z', 'updated_at': '2021-11-09T04:30:50Z', 'revision_number': 5, 'project_id': '6015befde7f546d881cb247ae5bc81ae', 'subnets': [{'id': 'b2956e71-9b0f-4060-922c-e54ce6cff80a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:34:05.777091 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7cecc63-dd9d-4018-b542-b51580cd5bf6 service neutron] Pushing event updated for resources: {'Port': ['ID=09cbfb91-4118-43af-8b70-41d8d4265574,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:05.820004 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4f0db671-64d4-475f-9fed-318f139dc2d8 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Made reservation on behalf of 55a3a2a687314dd0b62b3503ab15218e for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:34:05.824016 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4f0db671-64d4-475f-9fed-318f139dc2d8 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:05.843043 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73d122fb-559e-4466-b80f-d97d2d97711e req-2da7ffdb-da85-4db1-8793-46141a741898 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:05.844868 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-73d122fb-559e-4466-b80f-d97d2d97711e req-2da7ffdb-da85-4db1-8793-46141a741898 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.26 "GET /v2.0/ports?device_id=e145337f-88ba-4f6d-a894-39631a8dd013 HTTP/1.1" status: 200 len: 945 time: 0.6622345 Nov 09 04:34:05.884149 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4f0db671-64d4-475f-9fed-318f139dc2d8 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:05.903668 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-24762c2b-fafb-4065-a7a3-fb1048dab7ee req-a04c656f-a8c1-466b-bf42-2edc25ac6754 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/security-groups?id=8fd0adbd-57c5-4583-8e2d-9a55d7973976&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1977127 Nov 09 04:34:05.940511 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-71145347-ab01-4310-8b6d-749944a178d6 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:05.951790 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-929afc71-cce6-4981-8767-ab47df30a53d tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:06.041583 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-929afc71-cce6-4981-8767-ab47df30a53d tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Pushing event deleted for resources: {'Port': ['ID=dda09359-42a6-4fca-addb-eb15fb39acf7,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:06.044838 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-71145347-ab01-4310-8b6d-749944a178d6 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:06.119175 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-71145347-ab01-4310-8b6d-749944a178d6 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:34:06.124908 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-71145347-ab01-4310-8b6d-749944a178d6 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:06.125095 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-5bc268cb-64a5-42a6-837f-deedc88e9813 None None] Allocated IP 2001:db8:0:1::2 (988d2354-693c-4d52-af17-25e0643eaa0c/bac6b1bf-6999-4b76-a454-5b191f2e547e/581d0ca4-fbed-467b-b830-9a22a5876d15) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:34:06.129697 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17a0f10d-8091-444d-b1cd-291b9ce0279c req-d120d3ba-c14c-448c-b6d6-a6beb1eed550 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:06.131501 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-17a0f10d-8091-444d-b1cd-291b9ce0279c req-d120d3ba-c14c-448c-b6d6-a6beb1eed550 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=8f462374-376b-4c38-b300-528ae5358377 HTTP/1.1" status: 200 len: 943 time: 0.3461235 Nov 09 04:34:06.132629 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-71145347-ab01-4310-8b6d-749944a178d6 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:34:06.138563 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-71145347-ab01-4310-8b6d-749944a178d6 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:06.139200 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-71145347-ab01-4310-8b6d-749944a178d6 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:06.159185 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71145347-ab01-4310-8b6d-749944a178d6 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Port': ['ID=a208cfce-6881-4bb5-8c15-38aa3d67c127,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:06.215885 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cbca31c3-a5ba-4272-83ab-873895cd5a1a None None] New status for floating IP a95b836b-fec6-4af9-8970-923ef2700539: DOWN {{(pid=102163) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 04:34:06.237524 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-c3bd49ca-63f3-47ac-bc3d-0c3ac0027ad6 req-e7cecc63-dd9d-4018-b542-b51580cd5bf6 service neutron] Attempting to bind port 09cbfb91-4118-43af-8b70-41d8d4265574 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:34:06.237847 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-c3bd49ca-63f3-47ac-bc3d-0c3ac0027ad6 req-e7cecc63-dd9d-4018-b542-b51580cd5bf6 service neutron] Attempting to bind port 09cbfb91-4118-43af-8b70-41d8d4265574 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '7befff96-69ce-4b76-b9cc-7561279d57a7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 313, 'network_id': '239a9c72-6384-4d5a-a69d-f4ac0c580e40'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:34:06.238170 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c3bd49ca-63f3-47ac-bc3d-0c3ac0027ad6 req-e7cecc63-dd9d-4018-b542-b51580cd5bf6 service neutron] Attempting to bind port 09cbfb91-4118-43af-8b70-41d8d4265574 on network 239a9c72-6384-4d5a-a69d-f4ac0c580e40 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:34:06.250569 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-71145347-ab01-4310-8b6d-749944a178d6 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1034 time: 2.4827676 Nov 09 04:34:06.251531 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57658) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:06.255232 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-929afc71-cce6-4981-8767-ab47df30a53d tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:06.274861 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c3bd49ca-63f3-47ac-bc3d-0c3ac0027ad6 req-e7cecc63-dd9d-4018-b542-b51580cd5bf6 service neutron] Port 09cbfb91-4118-43af-8b70-41d8d4265574 on network 239a9c72-6384-4d5a-a69d-f4ac0c580e40 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:34:06.276770 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c3bd49ca-63f3-47ac-bc3d-0c3ac0027ad6 req-e7cecc63-dd9d-4018-b542-b51580cd5bf6 service neutron] Attempting to bind port 09cbfb91-4118-43af-8b70-41d8d4265574 on network 239a9c72-6384-4d5a-a69d-f4ac0c580e40 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:34:06.306946 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c3bd49ca-63f3-47ac-bc3d-0c3ac0027ad6 req-e7cecc63-dd9d-4018-b542-b51580cd5bf6 service neutron] Checking agent: {'id': '7d36b884-4ad2-4878-9464-bf647030b544', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'started_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 33, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:34:06.307290 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c3bd49ca-63f3-47ac-bc3d-0c3ac0027ad6 req-e7cecc63-dd9d-4018-b542-b51580cd5bf6 service neutron] Checking segment: {'id': '7befff96-69ce-4b76-b9cc-7561279d57a7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 313, 'network_id': '239a9c72-6384-4d5a-a69d-f4ac0c580e40'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:34:06.307659 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c3bd49ca-63f3-47ac-bc3d-0c3ac0027ad6 req-e7cecc63-dd9d-4018-b542-b51580cd5bf6 service neutron] Bound using segment: {'id': '7befff96-69ce-4b76-b9cc-7561279d57a7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 313, 'network_id': '239a9c72-6384-4d5a-a69d-f4ac0c580e40'} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:34:06.308123 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-c3bd49ca-63f3-47ac-bc3d-0c3ac0027ad6 req-e7cecc63-dd9d-4018-b542-b51580cd5bf6 service neutron] Bound port: 09cbfb91-4118-43af-8b70-41d8d4265574, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '7befff96-69ce-4b76-b9cc-7561279d57a7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 313, 'network_id': '239a9c72-6384-4d5a-a69d-f4ac0c580e40'}}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:34:06.308478 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-c3bd49ca-63f3-47ac-bc3d-0c3ac0027ad6 req-e7cecc63-dd9d-4018-b542-b51580cd5bf6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:06.352839 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-5bc268cb-64a5-42a6-837f-deedc88e9813 None None] For port 581d0ca4-fbed-467b-b830-9a22a5876d15, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=581d0ca4-fbed-467b-b830-9a22a5876d15,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:34:06.379025 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-17a0f10d-8091-444d-b1cd-291b9ce0279c req-b5013bd7-367e-40c9-8cf9-7fc7e2af1cf9 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=99157167-0266-49ff-809e-cf8a91af8ae5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2010038 Nov 09 04:34:06.385045 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-b6becbe2-7c8b-49da-b201-df7475d861c8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Deleting port a208cfce-6881-4bb5-8c15-38aa3d67c127 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:34:06.385454 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b6becbe2-7c8b-49da-b201-df7475d861c8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:06.395973 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4f0db671-64d4-475f-9fed-318f139dc2d8 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:06.396164 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5bc268cb-64a5-42a6-837f-deedc88e9813 None None] Publish callbacks [] for port, precommit_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:06.422845 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-73d122fb-559e-4466-b80f-d97d2d97711e req-cb4fcb11-418f-4a11-96d2-70a9019eb6d3 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] Deleting port d3617298-af19-45fb-8ddd-9c228bc66aab {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:34:06.423181 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-73d122fb-559e-4466-b80f-d97d2d97711e req-cb4fcb11-418f-4a11-96d2-70a9019eb6d3 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:06.477934 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b6becbe2-7c8b-49da-b201-df7475d861c8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:06.490630 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-b6becbe2-7c8b-49da-b201-df7475d861c8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Calling delete_port for a208cfce-6881-4bb5-8c15-38aa3d67c127 owned by {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:34:06.497552 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5bc268cb-64a5-42a6-837f-deedc88e9813 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:06.508003 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4f0db671-64d4-475f-9fed-318f139dc2d8 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:06.591617 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bc268cb-64a5-42a6-837f-deedc88e9813 None None] Pushing event updated for resources: {'Port': ['ID=581d0ca4-fbed-467b-b830-9a22a5876d15,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:06.634407 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4f0db671-64d4-475f-9fed-318f139dc2d8 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 346} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:34:06.661831 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-c3bd49ca-63f3-47ac-bc3d-0c3ac0027ad6 req-e7cecc63-dd9d-4018-b542-b51580cd5bf6 service neutron] For port 09cbfb91-4118-43af-8b70-41d8d4265574, host hv-neutron-8168, cleared binding levels {{(pid=102162) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:34:06.669863 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-c3bd49ca-63f3-47ac-bc3d-0c3ac0027ad6 req-e7cecc63-dd9d-4018-b542-b51580cd5bf6 service neutron] For port 09cbfb91-4118-43af-8b70-41d8d4265574, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=09cbfb91-4118-43af-8b70-41d8d4265574,segment=NetworkSegment(7befff96-69ce-4b76-b9cc-7561279d57a7),segment_id=7befff96-69ce-4b76-b9cc-7561279d57a7)] {{(pid=102162) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:34:06.693174 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f0db671-64d4-475f-9fed-318f139dc2d8 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Pushing event updated for resources: {'SecurityGroup': ['ID=9c0e1413-b89d-45f4-a23d-fc5da36a098f,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:06.695882 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-929afc71-cce6-4981-8767-ab47df30a53d tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Router 8cbd7ad3-04d4-4ab0-b79f-a9a391f624b1 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:34:06.701287 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-73d122fb-559e-4466-b80f-d97d2d97711e req-cb4fcb11-418f-4a11-96d2-70a9019eb6d3 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] For port d3617298-af19-45fb-8ddd-9c228bc66aab, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=d3617298-af19-45fb-8ddd-9c228bc66aab,segment=NetworkSegment(63a401e5-97f0-4f3a-b762-8fc66b1b215f),segment_id=63a401e5-97f0-4f3a-b762-8fc66b1b215f)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:34:06.701653 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-73d122fb-559e-4466-b80f-d97d2d97711e req-cb4fcb11-418f-4a11-96d2-70a9019eb6d3 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:06.722837 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-73d122fb-559e-4466-b80f-d97d2d97711e req-cb4fcb11-418f-4a11-96d2-70a9019eb6d3 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] Calling delete_port for d3617298-af19-45fb-8ddd-9c228bc66aab owned by compute:nova {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:34:06.760941 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b6becbe2-7c8b-49da-b201-df7475d861c8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:06.770823 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-c3bd49ca-63f3-47ac-bc3d-0c3ac0027ad6 req-e7cecc63-dd9d-4018-b542-b51580cd5bf6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:06.775156 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4f0db671-64d4-475f-9fed-318f139dc2d8 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:06.781913 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-4f0db671-64d4-475f-9fed-318f139dc2d8 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Added segment c52f7e89-4315-41f9-9d5a-5046f4cc1460 of type vlan for network 3d535493-472d-4bfc-8052-c7d4e02f89c4 Nov 09 04:34:06.793790 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6becbe2-7c8b-49da-b201-df7475d861c8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event deleted for resources: {'Port': ['ID=a208cfce-6881-4bb5-8c15-38aa3d67c127,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:06.816446 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57664) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:06.841468 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b6becbe2-7c8b-49da-b201-df7475d861c8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:06.845741 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-b6becbe2-7c8b-49da-b201-df7475d861c8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/ports/a208cfce-6881-4bb5-8c15-38aa3d67c127 HTTP/1.1" status: 204 len: 168 time: 0.5933819 Nov 09 04:34:06.848947 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57666) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:06.905308 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3bd49ca-63f3-47ac-bc3d-0c3ac0027ad6 req-e7cecc63-dd9d-4018-b542-b51580cd5bf6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:06.906046 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-c3bd49ca-63f3-47ac-bc3d-0c3ac0027ad6 req-e7cecc63-dd9d-4018-b542-b51580cd5bf6 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:06.907780 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c3bd49ca-63f3-47ac-bc3d-0c3ac0027ad6 req-e7cecc63-dd9d-4018-b542-b51580cd5bf6 service neutron] 10.222.0.26 "PUT /v2.0/ports/09cbfb91-4118-43af-8b70-41d8d4265574 HTTP/1.1" status: 200 len: 1093 time: 3.3315623 Nov 09 04:34:06.917319 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-64d502a3-2b6c-4fd1-8362-a950cff19aa2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:06.923332 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-64d502a3-2b6c-4fd1-8362-a950cff19aa2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1047 time: 0.0718031 Nov 09 04:34:06.924111 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57668) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:06.936643 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-929afc71-cce6-4981-8767-ab47df30a53d tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:34:06.956232 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-96c831e6-d203-4e1d-9084-d7e7850674e2 None None] Sync routers for ids ['8cbd7ad3-04d4-4ab0-b79f-a9a391f624b1'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:34:06.959186 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-929afc71-cce6-4981-8767-ab47df30a53d tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] 10.222.0.24 "PUT /v2.0/routers/8cbd7ad3-04d4-4ab0-b79f-a9a391f624b1/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 4.0628922 Nov 09 04:34:06.982583 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57672) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:06.990520 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-96c831e6-d203-4e1d-9084-d7e7850674e2 None None] Routers {'8cbd7ad3-04d4-4ab0-b79f-a9a391f624b1'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:34:06.992855 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-96c831e6-d203-4e1d-9084-d7e7850674e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:33:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8cbd7ad3-04d4-4ab0-b79f-a9a391f624b1'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:07.007137 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4f0db671-64d4-475f-9fed-318f139dc2d8 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:07.043855 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-35c053df-9f22-4827-876e-79db56b37e30 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:07.047830 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-35c053df-9f22-4827-876e-79db56b37e30 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1047 time: 0.1193354 Nov 09 04:34:07.053968 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-96c831e6-d203-4e1d-9084-d7e7850674e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:07.055410 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57674) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:07.064458 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-96c831e6-d203-4e1d-9084-d7e7850674e2 None None] Routers {'8cbd7ad3-04d4-4ab0-b79f-a9a391f624b1'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:34:07.065686 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-96c831e6-d203-4e1d-9084-d7e7850674e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:33:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8cbd7ad3-04d4-4ab0-b79f-a9a391f624b1'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:07.066796 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8f462374-376b-4c38-b300-528ae5358377', 'tag': '09cbfb91-4118-43af-8b70-41d8d4265574'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:34:07.070349 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f003ec09-c755-456d-ae4a-75612960856c" -d '{"events": [{"name": "network-changed", "server_uuid": "8f462374-376b-4c38-b300-528ae5358377", "tag": "09cbfb91-4118-43af-8b70-41d8d4265574"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:34:07.091616 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.api.v2.resource [None req-2e6578a9-c4b5-4f1a-8881-c33059547a02 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] delete failed (client error): The resource could not be found. Nov 09 04:34:07.096266 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-2e6578a9-c4b5-4f1a-8881-c33059547a02 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] 10.222.0.24 "DELETE /v2.0/routers/tempest-non_exist_router-38582418 HTTP/1.1" status: 404 len: 333 time: 0.1075974 Nov 09 04:34:07.099755 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7cecc63-dd9d-4018-b542-b51580cd5bf6 service neutron] Pushing event updated for resources: {'Port': ['ID=09cbfb91-4118-43af-8b70-41d8d4265574,revision_number=3']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:07.104879 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57678) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:07.160906 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-96c831e6-d203-4e1d-9084-d7e7850674e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:07.161811 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-96c831e6-d203-4e1d-9084-d7e7850674e2 None None] The sync data for ids ['8cbd7ad3-04d4-4ab0-b79f-a9a391f624b1'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:34:07.162389 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-589a7e12-ff04-4b21-a695-b2195dc47d72 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Request body: {'router': {'external_gateway_info': {'network_id': '8cbd7ad3-04d4-4ab0-b79f-a9a391f624b1'}}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:07.170979 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6358a2df-b8ba-4145-83c8-40071f8a155b req-16cd84b6-1a5a-4fb8-9a76-9e2ba706d171 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:07.172533 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-6358a2df-b8ba-4145-83c8-40071f8a155b req-16cd84b6-1a5a-4fb8-9a76-9e2ba706d171 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/ports?device_id=e145337f-88ba-4f6d-a894-39631a8dd013 HTTP/1.1" status: 200 len: 945 time: 0.1389668 Nov 09 04:34:07.176081 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-47080231-4432-417b-b9cf-d40308cfa9b6 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:07.177626 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-47080231-4432-417b-b9cf-d40308cfa9b6 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:07.179515 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:34:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-95db7e95-9f4c-47d0-9ee1-506b062c59b2 x-openstack-request-id: req-95db7e95-9f4c-47d0-9ee1-506b062c59b2 {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:34:07.179806 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8f462374-376b-4c38-b300-528ae5358377", "tag": "09cbfb91-4118-43af-8b70-41d8d4265574", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:34:07.180055 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-95db7e95-9f4c-47d0-9ee1-506b062c59b2 {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:34:07.180446 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8f462374-376b-4c38-b300-528ae5358377', 'tag': '09cbfb91-4118-43af-8b70-41d8d4265574', 'status': 'completed', 'code': 200} Nov 09 04:34:07.183554 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-47080231-4432-417b-b9cf-d40308cfa9b6 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:07.187797 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-47080231-4432-417b-b9cf-d40308cfa9b6 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2097 time: 0.1289487 Nov 09 04:34:07.188356 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57680) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:07.276260 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-6358a2df-b8ba-4145-83c8-40071f8a155b req-3cb5266c-bdc2-477f-9bd2-9444d462be3b tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/security-groups?id=8fd0adbd-57c5-4583-8e2d-9a55d7973976&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0896347 Nov 09 04:34:07.279958 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4c0f6c12-f181-4627-bde4-3d9f8f21ec42 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:07.289993 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-4c94bddf-53a9-401b-b020-466cf8097e5e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Deleting subnet 6cd48768-2b89-4629-808b-21cb29364842 {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:34:07.293869 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4c94bddf-53a9-401b-b020-466cf8097e5e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:07.340305 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4c94bddf-53a9-401b-b020-466cf8097e5e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:07.361668 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4f0db671-64d4-475f-9fed-318f139dc2d8 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:07.367396 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4f0db671-64d4-475f-9fed-318f139dc2d8 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:07.368198 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4f0db671-64d4-475f-9fed-318f139dc2d8 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:07.379099 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-7f3427cc-fd2f-4ec0-aeb8-3d545da351aa None None] Provisioning complete for port 581d0ca4-fbed-467b-b830-9a22a5876d15 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:07.380984 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7f3427cc-fd2f-4ec0-aeb8-3d545da351aa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:07.424910 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3bd49ca-63f3-47ac-bc3d-0c3ac0027ad6 req-85cf5197-8951-4cd7-a891-b514f49af111 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:07.426466 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c3bd49ca-63f3-47ac-bc3d-0c3ac0027ad6 req-85cf5197-8951-4cd7-a891-b514f49af111 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&device_id=8f462374-376b-4c38-b300-528ae5358377 HTTP/1.1" status: 200 len: 1096 time: 0.3481154 Nov 09 04:34:07.452727 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 581d0ca4-fbed-467b-b830-9a22a5876d15 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:34:07.458763 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4c0f6c12-f181-4627-bde4-3d9f8f21ec42 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:07.515914 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4c94bddf-53a9-401b-b020-466cf8097e5e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:07.526296 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c3bd49ca-63f3-47ac-bc3d-0c3ac0027ad6 req-6d555ccb-57ec-491a-924c-53df5e239768 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=09cbfb91-4118-43af-8b70-41d8d4265574 HTTP/1.1" status: 200 len: 217 time: 0.0614984 Nov 09 04:34:07.555221 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 581d0ca4-fbed-467b-b830-9a22a5876d15 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:07.555603 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:07.624363 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4c94bddf-53a9-401b-b020-466cf8097e5e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:07.664970 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c94bddf-53a9-401b-b020-466cf8097e5e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event deleted for resources: {'Subnet': ['ID=6cd48768-2b89-4629-808b-21cb29364842,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:07.667021 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4c94bddf-53a9-401b-b020-466cf8097e5e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:07.672587 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-4c94bddf-53a9-401b-b020-466cf8097e5e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/6cd48768-2b89-4629-808b-21cb29364842 HTTP/1.1" status: 204 len: 168 time: 0.4630613 Nov 09 04:34:07.674181 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57684) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:07.682858 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-4f0db671-64d4-475f-9fed-318f139dc2d8 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 779 time: 2.5137947 Nov 09 04:34:07.689386 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57686) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:07.697240 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-a3ba929d-957e-48e4-b3af-ed8431fbb36f tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Request body: {'subnet': {'network_id': '3d535493-472d-4bfc-8052-c7d4e02f89c4', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:07.704446 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c407897d-6369-45f8-8c40-bdd8dc359cbb None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:34:07.712900 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-73d122fb-559e-4466-b80f-d97d2d97711e req-cb4fcb11-418f-4a11-96d2-70a9019eb6d3 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:07.718245 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-589a7e12-ff04-4b21-a695-b2195dc47d72 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:07.736477 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['d3617298-af19-45fb-8ddd-9c228bc66aab'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 04:34:07.742516 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-6a48da60-d22f-47a0-927e-42abab2801f6 None None] Could not find standard attr ID for object a208cfce-6881-4bb5-8c15-38aa3d67c127. {{(pid=102163) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 09 04:34:07.748866 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f0db671-64d4-475f-9fed-318f139dc2d8 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Pushing event updated for resources: {'Network': ['ID=3d535493-472d-4bfc-8052-c7d4e02f89c4,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:07.788217 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb4fcb11-418f-4a11-96d2-70a9019eb6d3 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] Pushing event deleted for resources: {'Port': ['ID=d3617298-af19-45fb-8ddd-9c228bc66aab,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:07.795012 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 3d535493-472d-4bfc-8052-c7d4e02f89c4 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:34:07.804180 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3bd49ca-63f3-47ac-bc3d-0c3ac0027ad6 req-06ad0152-b4a7-44b2-82a9-4fe1849145e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:07.805748 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c3bd49ca-63f3-47ac-bc3d-0c3ac0027ad6 req-06ad0152-b4a7-44b2-82a9-4fe1849145e1 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=33b5599d-7ebe-4564-9c72-76f5d540fd80 HTTP/1.1" status: 200 len: 834 time: 0.2298045 Nov 09 04:34:07.818320 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-d569d772-ee13-44a7-984e-c87d782e154c tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Deleting subnet bac6b1bf-6999-4b76-a454-5b191f2e547e {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:34:07.822404 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d569d772-ee13-44a7-984e-c87d782e154c tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:07.848455 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6aa0713-02cb-4a13-a3b5-6cea47de9248 req-4fe80dd8-7d89-4921-8aae-a991814f7f18 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:07.849766 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e6aa0713-02cb-4a13-a3b5-6cea47de9248 req-4fe80dd8-7d89-4921-8aae-a991814f7f18 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=8f462374-376b-4c38-b300-528ae5358377 HTTP/1.1" status: 200 len: 943 time: 0.3153951 Nov 09 04:34:07.875917 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.api.v2.resource [None req-589a7e12-ff04-4b21-a695-b2195dc47d72 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] update failed (client error): The resource could not be found. Nov 09 04:34:07.876994 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-589a7e12-ff04-4b21-a695-b2195dc47d72 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] 10.222.0.24 "PUT /v2.0/routers/8cbd7ad3-04d4-4ab0-b79f-a9a391f624b1 HTTP/1.1" status: 404 len: 339 time: 0.7245362 Nov 09 04:34:07.878464 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-73d122fb-559e-4466-b80f-d97d2d97711e req-cb4fcb11-418f-4a11-96d2-70a9019eb6d3 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] No DVR routers for this DVR port d3617298-af19-45fb-8ddd-9c228bc66aab on host hv-neutron-8168 {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:34:07.884281 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-73d122fb-559e-4466-b80f-d97d2d97711e req-cb4fcb11-418f-4a11-96d2-70a9019eb6d3 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:07.884420 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d569d772-ee13-44a7-984e-c87d782e154c tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:07.886770 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57688) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:07.886933 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-73d122fb-559e-4466-b80f-d97d2d97711e req-cb4fcb11-418f-4a11-96d2-70a9019eb6d3 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.26 "DELETE /v2.0/ports/d3617298-af19-45fb-8ddd-9c228bc66aab HTTP/1.1" status: 204 len: 173 time: 2.0330591 Nov 09 04:34:07.892403 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-19313e9d-6fab-4b52-8bbe-47b0264096e5 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Request body: {'network': {'name': 'tempest-RoutersNegativeIpV6Test-test-network-6128653'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:07.953752 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3bd49ca-63f3-47ac-bc3d-0c3ac0027ad6 req-daf8081d-2be2-44ea-8a66-7f16c1a118b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:07.955324 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c3bd49ca-63f3-47ac-bc3d-0c3ac0027ad6 req-daf8081d-2be2-44ea-8a66-7f16c1a118b6 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=239a9c72-6384-4d5a-a69d-f4ac0c580e40&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1303768 Nov 09 04:34:07.965263 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e6aa0713-02cb-4a13-a3b5-6cea47de9248 req-56f0a85f-5008-4972-bfd6-3309e7045363 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=99157167-0266-49ff-809e-cf8a91af8ae5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0904298 Nov 09 04:34:07.974983 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4c0f6c12-f181-4627-bde4-3d9f8f21ec42 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:07.981063 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4c0f6c12-f181-4627-bde4-3d9f8f21ec42 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:07.981063 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-4c0f6c12-f181-4627-bde4-3d9f8f21ec42 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "DELETE /v2.0/security-groups/e441bd2c-e53d-45df-ab4c-85115d8b53a7 HTTP/1.1" status: 204 len: 168 time: 1.1546295 Nov 09 04:34:07.982738 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57690) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:08.014342 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a3ba929d-957e-48e4-b3af-ed8431fbb36f tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Made reservation on behalf of 55a3a2a687314dd0b62b3503ab15218e for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:34:08.021117 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c0f6c12-f181-4627-bde4-3d9f8f21ec42 tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=e441bd2c-e53d-45df-ab4c-85115d8b53a7,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:08.021264 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a3ba929d-957e-48e4-b3af-ed8431fbb36f tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:08.021264 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-ae169f94-b37b-48ef-a7d0-03e8639511ee tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] show failed (client error): The resource could not be found. Nov 09 04:34:08.025032 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-ae169f94-b37b-48ef-a7d0-03e8639511ee tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "GET /v2.0/security-groups/e441bd2c-e53d-45df-ab4c-85115d8b53a7 HTTP/1.1" status: 404 len: 347 time: 0.0412402 Nov 09 04:34:08.025625 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57692) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:08.092049 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c3bd49ca-63f3-47ac-bc3d-0c3ac0027ad6 req-fcbaf2b8-ccfa-402e-9fbf-2d05bb6d6998 service neutron] 10.222.0.26 "GET /v2.0/networks/239a9c72-6384-4d5a-a69d-f4ac0c580e40?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1253154 Nov 09 04:34:08.107453 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d569d772-ee13-44a7-984e-c87d782e154c tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:08.204391 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-19313e9d-6fab-4b52-8bbe-47b0264096e5 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Made reservation on behalf of 4b395c2f9c4f482198ab37eb736cc2fe for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:34:08.207958 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-19313e9d-6fab-4b52-8bbe-47b0264096e5 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:08.208988 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c3bd49ca-63f3-47ac-bc3d-0c3ac0027ad6 req-ae95bd3d-03b5-45fd-b04e-ef928347b29e service neutron] 10.222.0.26 "GET /v2.0/networks/239a9c72-6384-4d5a-a69d-f4ac0c580e40?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1094878 Nov 09 04:34:08.300416 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-19313e9d-6fab-4b52-8bbe-47b0264096e5 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 318} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:34:08.325386 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-19313e9d-6fab-4b52-8bbe-47b0264096e5 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:08.325735 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-19313e9d-6fab-4b52-8bbe-47b0264096e5 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Added segment 79435fa1-8c80-4d01-8972-9d589024c286 of type vlan for network f7f6f298-5e2f-43a9-abfe-13a440ef4798 Nov 09 04:34:08.466484 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-a41c55ea-9c0f-46e1-9ee7-5dab2805930d tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Deleting port 45120212-510c-49f0-aaf0-a0b92dab5b54 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:34:08.466997 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a41c55ea-9c0f-46e1-9ee7-5dab2805930d tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:08.474512 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-19313e9d-6fab-4b52-8bbe-47b0264096e5 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:08.480093 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-88d20f81-1462-40b4-9054-e31fcb301143 req-8fa7180d-d86d-47bf-aa74-f3802a101043 tempest-TestServerAdvancedOps-1801587708 tempest-TestServerAdvancedOps-1801587708-project] 10.222.0.24 "GET /v2.0/ports?device_id=e145337f-88ba-4f6d-a894-39631a8dd013 HTTP/1.1" status: 200 len: 210 time: 0.0821681 Nov 09 04:34:08.481716 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d569d772-ee13-44a7-984e-c87d782e154c tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:08.611377 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d569d772-ee13-44a7-984e-c87d782e154c tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event deleted for resources: {'Subnet': ['ID=bac6b1bf-6999-4b76-a454-5b191f2e547e,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:08.613645 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d569d772-ee13-44a7-984e-c87d782e154c tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:08.617016 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-d569d772-ee13-44a7-984e-c87d782e154c tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/bac6b1bf-6999-4b76-a454-5b191f2e547e HTTP/1.1" status: 204 len: 168 time: 0.9417808 Nov 09 04:34:08.633630 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57696) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:08.700464 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-07656bbb-03da-47c4-b1fd-6456b42b3bb1 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0588839 Nov 09 04:34:08.703329 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57698) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:08.708897 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-81d2af60-5cb6-40d6-8681-0233b26d2259 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'subnet': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:08.735976 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1582636b-3d4a-43d7-8b3d-b8aa7419e73e None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:34:08.752291 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-19313e9d-6fab-4b52-8bbe-47b0264096e5 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:08.761006 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-19313e9d-6fab-4b52-8bbe-47b0264096e5 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:08.762021 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-19313e9d-6fab-4b52-8bbe-47b0264096e5 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:08.788945 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f003ec09-c755-456d-ae4a-75612960856c req-9cce3586-ea66-46a1-a028-0ecba5c9bdbb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:08.791700 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f003ec09-c755-456d-ae4a-75612960856c req-9cce3586-ea66-46a1-a028-0ecba5c9bdbb service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&device_id=8f462374-376b-4c38-b300-528ae5358377 HTTP/1.1" status: 200 len: 1096 time: 0.4342232 Nov 09 04:34:08.813669 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a41c55ea-9c0f-46e1-9ee7-5dab2805930d tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:08.813991 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a41c55ea-9c0f-46e1-9ee7-5dab2805930d tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:08.818227 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-df6ac4a7-94a5-4cc8-bd0b-eb7f4d33c54e None None] Provisioning complete for port 581d0ca4-fbed-467b-b830-9a22a5876d15 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:08.818686 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-df6ac4a7-94a5-4cc8-bd0b-eb7f4d33c54e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:08.827386 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a3ba929d-957e-48e4-b3af-ed8431fbb36f tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:08.883566 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-a41c55ea-9c0f-46e1-9ee7-5dab2805930d tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Calling delete_port for 45120212-510c-49f0-aaf0-a0b92dab5b54 owned by network:floatingip {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:34:08.917113 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f003ec09-c755-456d-ae4a-75612960856c req-cd06ec55-b208-4adb-b60c-78593bfd0529 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:08.919702 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f003ec09-c755-456d-ae4a-75612960856c req-cd06ec55-b208-4adb-b60c-78593bfd0529 service neutron] 10.222.0.26 "GET /v2.0/networks?id=239a9c72-6384-4d5a-a69d-f4ac0c580e40 HTTP/1.1" status: 200 len: 897 time: 0.1201091 Nov 09 04:34:08.959901 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-19313e9d-6fab-4b52-8bbe-47b0264096e5 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 788 time: 1.0723629 Nov 09 04:34:08.975141 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57700) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:09.012174 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f003ec09-c755-456d-ae4a-75612960856c req-8c74fa19-87d5-4f29-b462-0bd12699b4e9 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=09cbfb91-4118-43af-8b70-41d8d4265574 HTTP/1.1" status: 200 len: 217 time: 0.0840414 Nov 09 04:34:09.013581 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-ceaee6d2-1c2c-459f-90e2-f6333d9540ac tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Request body: {'subnet': {'network_id': 'f7f6f298-5e2f-43a9-abfe-13a440ef4798', 'cidr': '2001:db8:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:1::1'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:09.016983 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19313e9d-6fab-4b52-8bbe-47b0264096e5 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Pushing event updated for resources: {'Network': ['ID=f7f6f298-5e2f-43a9-abfe-13a440ef4798,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:09.023578 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7385d011-5c29-40be-b62c-62e439e148f0 None None] DHCP port deletion for 988d2354-693c-4d52-af17-25e0643eaa0c request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:34:09.065947 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3ba929d-957e-48e4-b3af-ed8431fbb36f tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Pushing event updated for resources: {'Subnet': ['ID=66cc5117-4268-433d-acab-66834cdb6f85,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:09.075427 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network f7f6f298-5e2f-43a9-abfe-13a440ef4798 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:34:09.118132 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f003ec09-c755-456d-ae4a-75612960856c req-74d7ddd1-6f70-4292-9df5-8496579efbe5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:09.119534 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f003ec09-c755-456d-ae4a-75612960856c req-74d7ddd1-6f70-4292-9df5-8496579efbe5 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=33b5599d-7ebe-4564-9c72-76f5d540fd80 HTTP/1.1" status: 200 len: 834 time: 0.0905504 Nov 09 04:34:09.144525 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3405ea1d-148b-4aa4-9994-aaed70d0d6eb req-50568ac9-1872-4e9b-b20e-e0e6f5e633dc tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:09.146135 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3405ea1d-148b-4aa4-9994-aaed70d0d6eb req-50568ac9-1872-4e9b-b20e-e0e6f5e633dc tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=8f462374-376b-4c38-b300-528ae5358377 HTTP/1.1" status: 200 len: 943 time: 0.0744281 Nov 09 04:34:09.152831 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a3ba929d-957e-48e4-b3af-ed8431fbb36f tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Checking segment: {'id': 'c52f7e89-4315-41f9-9d5a-5046f4cc1460', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 346, 'network_id': '3d535493-472d-4bfc-8052-c7d4e02f89c4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:34:09.153206 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a3ba929d-957e-48e4-b3af-ed8431fbb36f tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Network hostable DHCP agents. Network: 3d535493-472d-4bfc-8052-c7d4e02f89c4, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:34:09.161057 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-81d2af60-5cb6-40d6-8681-0233b26d2259 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:34:09.164663 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-81d2af60-5cb6-40d6-8681-0233b26d2259 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:09.174195 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-7385d011-5c29-40be-b62c-62e439e148f0 None None] Deleting port 581d0ca4-fbed-467b-b830-9a22a5876d15 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:34:09.174691 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7385d011-5c29-40be-b62c-62e439e148f0 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:09.181387 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e145337f-88ba-4f6d-a894-39631a8dd013', 'name': 'network-vif-deleted', 'tag': 'd3617298-af19-45fb-8ddd-9c228bc66aab'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:34:09.183696 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4fd49ac5-7ca0-422f-a589-a6a83dc2d203" -d '{"events": [{"server_uuid": "e145337f-88ba-4f6d-a894-39631a8dd013", "name": "network-vif-deleted", "tag": "d3617298-af19-45fb-8ddd-9c228bc66aab"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:34:09.212550 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f003ec09-c755-456d-ae4a-75612960856c req-d7b972ac-be1c-41c1-8f47-596c2da967b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:09.214076 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f003ec09-c755-456d-ae4a-75612960856c req-d7b972ac-be1c-41c1-8f47-596c2da967b2 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=239a9c72-6384-4d5a-a69d-f4ac0c580e40&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0873032 Nov 09 04:34:09.233266 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:34:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-34016681-e4e6-4d00-9ad4-caea55cb8a94 x-openstack-request-id: req-34016681-e4e6-4d00-9ad4-caea55cb8a94 {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:34:09.233561 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e145337f-88ba-4f6d-a894-39631a8dd013", "name": "network-vif-deleted", "tag": "d3617298-af19-45fb-8ddd-9c228bc66aab", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:34:09.233808 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-34016681-e4e6-4d00-9ad4-caea55cb8a94 {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:34:09.234190 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e145337f-88ba-4f6d-a894-39631a8dd013', 'name': 'network-vif-deleted', 'tag': 'd3617298-af19-45fb-8ddd-9c228bc66aab', 'status': 'completed', 'code': 200} Nov 09 04:34:09.239077 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3405ea1d-148b-4aa4-9994-aaed70d0d6eb req-086a6451-8b4e-429e-9965-3802aa3a6a65 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=99157167-0266-49ff-809e-cf8a91af8ae5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0753348 Nov 09 04:34:09.287104 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-7385d011-5c29-40be-b62c-62e439e148f0 None None] For port 581d0ca4-fbed-467b-b830-9a22a5876d15, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=581d0ca4-fbed-467b-b830-9a22a5876d15,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:34:09.287891 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7385d011-5c29-40be-b62c-62e439e148f0 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:09.303003 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-7385d011-5c29-40be-b62c-62e439e148f0 None None] Calling delete_port for 581d0ca4-fbed-467b-b830-9a22a5876d15 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:34:09.319668 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f003ec09-c755-456d-ae4a-75612960856c req-f7c1694f-f935-456a-8ad3-ba66e35f956c service neutron] 10.222.0.26 "GET /v2.0/networks/239a9c72-6384-4d5a-a69d-f4ac0c580e40?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0957394 Nov 09 04:34:09.344798 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a3ba929d-957e-48e4-b3af-ed8431fbb36f tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Network 3d535493-472d-4bfc-8052-c7d4e02f89c4 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:34:09.412518 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 581d0ca4-fbed-467b-b830-9a22a5876d15 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:34:09.432984 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ceaee6d2-1c2c-459f-90e2-f6333d9540ac tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Made reservation on behalf of 4b395c2f9c4f482198ab37eb736cc2fe for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:34:09.436923 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ceaee6d2-1c2c-459f-90e2-f6333d9540ac tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:09.437607 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f003ec09-c755-456d-ae4a-75612960856c req-fbb57f62-c4b9-4afd-83ee-98fdf771ba26 service neutron] 10.222.0.26 "GET /v2.0/networks/239a9c72-6384-4d5a-a69d-f4ac0c580e40?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1101711 Nov 09 04:34:09.453800 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a41c55ea-9c0f-46e1-9ee7-5dab2805930d tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:09.489717 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7385d011-5c29-40be-b62c-62e439e148f0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:09.505283 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-a3ba929d-957e-48e4-b3af-ed8431fbb36f tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 3d535493-472d-4bfc-8052-c7d4e02f89c4) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:09.506931 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a41c55ea-9c0f-46e1-9ee7-5dab2805930d tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Pushing event deleted for resources: {'Port': ['ID=45120212-510c-49f0-aaf0-a0b92dab5b54,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:09.525048 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:09.531120 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-39b8564d-5d53-4367-b6f0-d06a2ad7b950 None None] Network 3d535493-472d-4bfc-8052-c7d4e02f89c4 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:34:09.537487 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a3ba929d-957e-48e4-b3af-ed8431fbb36f tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:09.538082 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a3ba929d-957e-48e4-b3af-ed8431fbb36f tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:09.541424 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7385d011-5c29-40be-b62c-62e439e148f0 None None] Pushing event deleted for resources: {'Port': ['ID=581d0ca4-fbed-467b-b830-9a22a5876d15,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:09.561828 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57708) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:09.563443 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7385d011-5c29-40be-b62c-62e439e148f0 None None] No DVR routers for this DVR port 581d0ca4-fbed-467b-b830-9a22a5876d15 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:34:09.615593 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-3779268c-5efb-446b-bc19-4b6a3bee8d08 admin admin] Deleting subnet 73ee2bd1-c2b2-478f-96c9-301b99515bfe {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:34:09.618896 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3779268c-5efb-446b-bc19-4b6a3bee8d08 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:09.666528 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3779268c-5efb-446b-bc19-4b6a3bee8d08 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:09.666939 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a41c55ea-9c0f-46e1-9ee7-5dab2805930d tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Publish callbacks [] for floatingip, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:09.669524 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a41c55ea-9c0f-46e1-9ee7-5dab2805930d tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:09.670849 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a41c55ea-9c0f-46e1-9ee7-5dab2805930d tempest-ServerActionsTestJSON-1422014059 tempest-ServerActionsTestJSON-1422014059-project] 10.222.0.24 "DELETE /v2.0/floatingips/a95b836b-fec6-4af9-8970-923ef2700539 HTTP/1.1" status: 204 len: 168 time: 1.6361120 Nov 09 04:34:09.676641 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57710) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:09.712570 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3779268c-5efb-446b-bc19-4b6a3bee8d08 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:09.729575 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a3ba929d-957e-48e4-b3af-ed8431fbb36f tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.0375178 Nov 09 04:34:09.731675 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57712) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:09.738815 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-4b37c5e9-8324-4382-84f4-29da95b1309b tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Request body: {'port': {'network_id': '3d535493-472d-4bfc-8052-c7d4e02f89c4', 'name': 'tempest-TagsExtTest-1978418229'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:09.744130 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-654ad523-98d3-4918-b61f-c8af760c55bd None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-3d535493-472d-4bfc-8052-c7d4e02f89c4', 'network_id': '3d535493-472d-4bfc-8052-c7d4e02f89c4', 'tenant_id': '55a3a2a687314dd0b62b3503ab15218e', 'fixed_ips': [{'subnet_id': '66cc5117-4268-433d-acab-66834cdb6f85'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:34:09.745830 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-654ad523-98d3-4918-b61f-c8af760c55bd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:09.772205 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.objects.ports [None req-81d2af60-5cb6-40d6-8681-0233b26d2259 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=102161) get_objects /opt/stack/neutron/neutron/objects/ports.py:444}} Nov 09 04:34:09.781324 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-81d2af60-5cb6-40d6-8681-0233b26d2259 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:09.892032 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-654ad523-98d3-4918-b61f-c8af760c55bd None None] Allocated IP 172.20.0.2 (3d535493-472d-4bfc-8052-c7d4e02f89c4/66cc5117-4268-433d-acab-66834cdb6f85/c66388ff-7389-4791-9f4a-dc83e0728f21) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:34:09.915629 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3779268c-5efb-446b-bc19-4b6a3bee8d08 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:09.945770 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4b37c5e9-8324-4382-84f4-29da95b1309b tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Made reservation on behalf of 55a3a2a687314dd0b62b3503ab15218e for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:34:09.949786 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4b37c5e9-8324-4382-84f4-29da95b1309b tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:09.952470 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3779268c-5efb-446b-bc19-4b6a3bee8d08 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=73ee2bd1-c2b2-478f-96c9-301b99515bfe,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:09.958456 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3779268c-5efb-446b-bc19-4b6a3bee8d08 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:09.964495 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-3779268c-5efb-446b-bc19-4b6a3bee8d08 admin admin] 10.222.0.24 "DELETE /v2.0/subnets/73ee2bd1-c2b2-478f-96c9-301b99515bfe HTTP/1.1" status: 204 len: 168 time: 0.3981376 Nov 09 04:34:09.968895 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57714) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:10.003606 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [None req-4b37c5e9-8324-4382-84f4-29da95b1309b tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] device_id is not set on port 595ae407-7cb5-4c2b-a4fa-9cb5b8c81a58 yet. {{(pid=102162) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:34:10.079644 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-654ad523-98d3-4918-b61f-c8af760c55bd None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:10.099985 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-34399278-a6e7-43d1-a6a5-2af811323b7d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:10.156033 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 09cbfb91-4118-43af-8b70-41d8d4265574 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=102163) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 09 04:34:10.158264 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device d3617298-af19-45fb-8ddd-9c228bc66aab no longer exists at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:34:10.175436 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-81d2af60-5cb6-40d6-8681-0233b26d2259 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:34:10.181985 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-654ad523-98d3-4918-b61f-c8af760c55bd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:10.194866 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] No Port match for: d3617298-af19-45fb-8ddd-9c228bc66aab {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:34:10.195370 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device d3617298-af19-45fb-8ddd-9c228bc66aab not bound to the agent host hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:34:10.210759 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-81d2af60-5cb6-40d6-8681-0233b26d2259 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:10.212476 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-34399278-a6e7-43d1-a6a5-2af811323b7d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:10.235822 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5f06f107-f842-4c36-b0da-890dad3864c5 None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:34:10.245064 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-34399278-a6e7-43d1-a6a5-2af811323b7d admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['10e5206a-1d3b-409b-a3ee-0f6a311d6819']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:10.248503 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-81d2af60-5cb6-40d6-8681-0233b26d2259 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:10.249087 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-81d2af60-5cb6-40d6-8681-0233b26d2259 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:10.249652 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-654ad523-98d3-4918-b61f-c8af760c55bd None None] Network 3d535493-472d-4bfc-8052-c7d4e02f89c4 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:34:10.251847 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81d2af60-5cb6-40d6-8681-0233b26d2259 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Subnet': ['ID=e9f0be11-da61-45ff-99f6-6f139e39eb72,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:10.262006 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-34399278-a6e7-43d1-a6a5-2af811323b7d admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '63a401e5-97f0-4f3a-b762-8fc66b1b215f') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:10.262006 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-34399278-a6e7-43d1-a6a5-2af811323b7d admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '63a401e5-97f0-4f3a-b762-8fc66b1b215f') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:10.264090 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-4b37c5e9-8324-4382-84f4-29da95b1309b tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Allocated IP 172.20.0.5 (3d535493-472d-4bfc-8052-c7d4e02f89c4/66cc5117-4268-433d-acab-66834cdb6f85/595ae407-7cb5-4c2b-a4fa-9cb5b8c81a58) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:34:10.277661 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-34399278-a6e7-43d1-a6a5-2af811323b7d admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:10.295904 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-654ad523-98d3-4918-b61f-c8af760c55bd None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:10.298803 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-654ad523-98d3-4918-b61f-c8af760c55bd None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:34:10.300141 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-34399278-a6e7-43d1-a6a5-2af811323b7d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:10.317956 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-34399278-a6e7-43d1-a6a5-2af811323b7d admin admin] Releasing vlan 333 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:34:10.321188 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-34399278-a6e7-43d1-a6a5-2af811323b7d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:10.321188 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:34:10.321188 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:34:10.321188 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:34:10.321188 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:34:10.321188 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:34:10.321188 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:34:10.321188 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:34:10.321188 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:34:10.321188 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:34:10.321188 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:34:10.321188 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:34:10.321188 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:34:10.321188 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:34:10.321188 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:34:10.321188 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:34:10.321188 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:34:10.321188 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:34:10.321188 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:34:10.321188 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:34:10.321188 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:34:10.321188 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:34:10.321188 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:34:10.321188 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:34:10.321188 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:34:10.321188 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:34:10.321188 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:34:10.321188 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:34:10.321188 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:34:10.321188 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:34:10.321188 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:34:10.321188 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:34:10.321188 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:34:10.361569 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-654ad523-98d3-4918-b61f-c8af760c55bd None None] Pushing event updated for resources: {'Port': ['ID=c66388ff-7389-4791-9f4a-dc83e0728f21,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:10.402968 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ceaee6d2-1c2c-459f-90e2-f6333d9540ac tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:10.439446 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-81d2af60-5cb6-40d6-8681-0233b26d2259 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 1.7348223 Nov 09 04:34:10.447676 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57718) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:10.455105 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-c254bb2c-5898-4860-bf41-ebeef59d0e41 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'subnet': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:10.480814 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-654ad523-98d3-4918-b61f-c8af760c55bd None None] Attempting to bind port c66388ff-7389-4791-9f4a-dc83e0728f21 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:34:10.481285 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-654ad523-98d3-4918-b61f-c8af760c55bd None None] Attempting to bind port c66388ff-7389-4791-9f4a-dc83e0728f21 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'c52f7e89-4315-41f9-9d5a-5046f4cc1460', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 346, 'network_id': '3d535493-472d-4bfc-8052-c7d4e02f89c4'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:34:10.481719 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-654ad523-98d3-4918-b61f-c8af760c55bd None None] Attempting to bind port c66388ff-7389-4791-9f4a-dc83e0728f21 on network 3d535493-472d-4bfc-8052-c7d4e02f89c4 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:34:10.489355 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceaee6d2-1c2c-459f-90e2-f6333d9540ac tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Pushing event updated for resources: {'Subnet': ['ID=a177571b-ddcb-47e3-a5b1-049189b20956,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:10.496233 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 09cbfb91-4118-43af-8b70-41d8d4265574, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=09cbfb91-4118-43af-8b70-41d8d4265574,segment=NetworkSegment(7befff96-69ce-4b76-b9cc-7561279d57a7),segment_id=7befff96-69ce-4b76-b9cc-7561279d57a7)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:34:10.506619 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-654ad523-98d3-4918-b61f-c8af760c55bd None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 33, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:34:10.507102 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-654ad523-98d3-4918-b61f-c8af760c55bd None None] Checking segment: {'id': 'c52f7e89-4315-41f9-9d5a-5046f4cc1460', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 346, 'network_id': '3d535493-472d-4bfc-8052-c7d4e02f89c4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:34:10.507449 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-34399278-a6e7-43d1-a6a5-2af811323b7d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:10.507689 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-654ad523-98d3-4918-b61f-c8af760c55bd None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:10.508161 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-654ad523-98d3-4918-b61f-c8af760c55bd None None] Bound using segment: {'id': 'c52f7e89-4315-41f9-9d5a-5046f4cc1460', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 346, 'network_id': '3d535493-472d-4bfc-8052-c7d4e02f89c4'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:34:10.509787 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-654ad523-98d3-4918-b61f-c8af760c55bd None None] Bound port: c66388ff-7389-4791-9f4a-dc83e0728f21, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c52f7e89-4315-41f9-9d5a-5046f4cc1460', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 346, 'network_id': '3d535493-472d-4bfc-8052-c7d4e02f89c4'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:34:10.510260 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-654ad523-98d3-4918-b61f-c8af760c55bd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:10.525855 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ceaee6d2-1c2c-459f-90e2-f6333d9540ac tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Checking segment: {'id': '79435fa1-8c80-4d01-8972-9d589024c286', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 318, 'network_id': 'f7f6f298-5e2f-43a9-abfe-13a440ef4798'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:34:10.526220 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ceaee6d2-1c2c-459f-90e2-f6333d9540ac tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Network hostable DHCP agents. Network: f7f6f298-5e2f-43a9-abfe-13a440ef4798, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:34:10.529772 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-34399278-a6e7-43d1-a6a5-2af811323b7d admin admin] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:10.533057 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-34399278-a6e7-43d1-a6a5-2af811323b7d admin admin] 10.222.0.24 "DELETE /v2.0/networks/10e5206a-1d3b-409b-a3ee-0f6a311d6819 HTTP/1.1" status: 204 len: 168 time: 0.5633652 Nov 09 04:34:10.537419 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57720) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:10.544181 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91f0254d-15dd-4e48-abbf-fab92d9b7a46 req-a5b333aa-bf8b-4db2-aea5-9c9e86b045b4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:10.545722 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-91f0254d-15dd-4e48-abbf-fab92d9b7a46 req-a5b333aa-bf8b-4db2-aea5-9c9e86b045b4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=8f462374-376b-4c38-b300-528ae5358377 HTTP/1.1" status: 200 len: 943 time: 0.2071183 Nov 09 04:34:10.550064 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Returning: {'device': '09cbfb91-4118-43af-8b70-41d8d4265574', 'network_id': '239a9c72-6384-4d5a-a69d-f4ac0c580e40', 'port_id': '09cbfb91-4118-43af-8b70-41d8d4265574', 'mac_address': 'fa:16:3e:27:22:c9', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 313, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '33b5599d-7ebe-4564-9c72-76f5d540fd80', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102163) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 09 04:34:10.598943 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34399278-a6e7-43d1-a6a5-2af811323b7d admin admin] Pushing event deleted for resources: {'Network': ['ID=10e5206a-1d3b-409b-a3ee-0f6a311d6819,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:10.615631 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-c3133705-101b-4618-93de-f0878bded510 admin admin] Deleting subnet 0b9d2143-9a73-40b5-993e-e0be24c95bc4 {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:34:10.622407 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c3133705-101b-4618-93de-f0878bded510 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:10.630987 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a4bf4e45-a5b2-4e85-85d6-a5554340e656 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-988d2354-693c-4d52-af17-25e0643eaa0c', 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'tenant_id': '8b0758f781884982bf5b94e6609237f6', 'fixed_ips': [{'subnet_id': 'e9f0be11-da61-45ff-99f6-6f139e39eb72'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:34:10.631827 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a4bf4e45-a5b2-4e85-85d6-a5554340e656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:10.672825 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4b37c5e9-8324-4382-84f4-29da95b1309b tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:10.680599 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-654ad523-98d3-4918-b61f-c8af760c55bd None None] For port c66388ff-7389-4791-9f4a-dc83e0728f21, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:34:10.683247 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c3133705-101b-4618-93de-f0878bded510 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:10.698135 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:10.701658 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-91f0254d-15dd-4e48-abbf-fab92d9b7a46 req-05f91263-5894-44a7-971e-876ee1592efc tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=99157167-0266-49ff-809e-cf8a91af8ae5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1187136 Nov 09 04:34:10.704330 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ceaee6d2-1c2c-459f-90e2-f6333d9540ac tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Network f7f6f298-5e2f-43a9-abfe-13a440ef4798 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:34:10.739936 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c3133705-101b-4618-93de-f0878bded510 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:10.755185 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-654ad523-98d3-4918-b61f-c8af760c55bd None None] For port c66388ff-7389-4791-9f4a-dc83e0728f21, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=c66388ff-7389-4791-9f4a-dc83e0728f21,segment=NetworkSegment(c52f7e89-4315-41f9-9d5a-5046f4cc1460),segment_id=c52f7e89-4315-41f9-9d5a-5046f4cc1460)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:34:10.765367 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 09cbfb91-4118-43af-8b70-41d8d4265574 {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:34:10.784214 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9226bd12-ab63-4bd3-a5d7-24510c96df03 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:10.800769 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 09cbfb91-4118-43af-8b70-41d8d4265574, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=09cbfb91-4118-43af-8b70-41d8d4265574,segment=NetworkSegment(7befff96-69ce-4b76-b9cc-7561279d57a7),segment_id=7befff96-69ce-4b76-b9cc-7561279d57a7)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:34:10.812712 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c254bb2c-5898-4860-bf41-ebeef59d0e41 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:34:10.818045 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c254bb2c-5898-4860-bf41-ebeef59d0e41 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:10.821098 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-654ad523-98d3-4918-b61f-c8af760c55bd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:10.823908 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-ceaee6d2-1c2c-459f-90e2-f6333d9540ac tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, f7f6f298-5e2f-43a9-abfe-13a440ef4798) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:10.824065 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4b37c5e9-8324-4382-84f4-29da95b1309b tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:10.829714 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ceaee6d2-1c2c-459f-90e2-f6333d9540ac tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:10.830319 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ceaee6d2-1c2c-459f-90e2-f6333d9540ac tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:10.858800 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6ab10d93-00d7-4f20-a048-9f2b5650f70c None None] Network f7f6f298-5e2f-43a9-abfe-13a440ef4798 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:34:10.912209 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:10.921751 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-a4bf4e45-a5b2-4e85-85d6-a5554340e656 None None] Allocated IP 2001:db8::f816:3eff:fe73:ac68 (988d2354-693c-4d52-af17-25e0643eaa0c/e9f0be11-da61-45ff-99f6-6f139e39eb72/453bd95e-9a2c-476e-8e72-48e39cc947d1) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:34:10.943668 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4b37c5e9-8324-4382-84f4-29da95b1309b tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Network 3d535493-472d-4bfc-8052-c7d4e02f89c4 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:34:10.946944 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b37c5e9-8324-4382-84f4-29da95b1309b tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Pushing event updated for resources: {'Port': ['ID=595ae407-7cb5-4c2b-a4fa-9cb5b8c81a58,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:10.951370 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-4b37c5e9-8324-4382-84f4-29da95b1309b tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:10.953753 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4b37c5e9-8324-4382-84f4-29da95b1309b tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:34:10.954681 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-ceaee6d2-1c2c-459f-90e2-f6333d9540ac tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 830 time: 1.9782522 Nov 09 04:34:10.959120 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57722) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:10.963052 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-77a2744b-b362-4d9e-9aae-d24cf0c8dcd8 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Request body: {'router': {'external_gateway_info': {'network_id': 'f7f6f298-5e2f-43a9-abfe-13a440ef4798'}}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:10.985547 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-654ad523-98d3-4918-b61f-c8af760c55bd None None] Pushing event updated for resources: {'Port': ['ID=c66388ff-7389-4791-9f4a-dc83e0728f21,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:11.023377 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c3133705-101b-4618-93de-f0878bded510 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:11.024289 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4b37c5e9-8324-4382-84f4-29da95b1309b tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:11.024911 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4b37c5e9-8324-4382-84f4-29da95b1309b tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:11.032217 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.ipam_backend_mixin [None req-c254bb2c-5898-4860-bf41-ebeef59d0e41 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet e9f0be11-da61-45ff-99f6-6f139e39eb72 (CIDR: 2001:db8::/64) Nov 09 04:34:11.084295 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3133705-101b-4618-93de-f0878bded510 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=0b9d2143-9a73-40b5-993e-e0be24c95bc4,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:11.087467 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-c254bb2c-5898-4860-bf41-ebeef59d0e41 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:34:11.088627 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c3133705-101b-4618-93de-f0878bded510 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:11.089186 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c254bb2c-5898-4860-bf41-ebeef59d0e41 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:11.093217 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-c3133705-101b-4618-93de-f0878bded510 admin admin] 10.222.0.24 "DELETE /v2.0/subnets/0b9d2143-9a73-40b5-993e-e0be24c95bc4 HTTP/1.1" status: 204 len: 168 time: 0.5537577 Nov 09 04:34:11.109827 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57724) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:11.117728 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['09cbfb91-4118-43af-8b70-41d8d4265574'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 04:34:11.151336 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=09cbfb91-4118-43af-8b70-41d8d4265574,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:11.209917 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d0ff87f5-4bf7-43fd-9afd-a8e5334a3af3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:11.215379 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-4b37c5e9-8324-4382-84f4-29da95b1309b tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 922 time: 1.4824531 Nov 09 04:34:11.227210 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-c254bb2c-5898-4860-bf41-ebeef59d0e41 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.7702134 Nov 09 04:34:11.227210 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57726) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:11.227210 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57728) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:11.233577 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-d089cbfc-1328-479d-b1aa-1a12780d8038 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Request body: {'router': {'name': 'tempest-TagsExtTest-router-658871835', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:11.266774 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-75a3869f-3ab6-44e8-b10f-e32293cc3f7a tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'subnet': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:11.315719 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-77a2744b-b362-4d9e-9aae-d24cf0c8dcd8 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:11.369951 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d089cbfc-1328-479d-b1aa-1a12780d8038 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:11.370478 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d089cbfc-1328-479d-b1aa-1a12780d8038 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:11.444189 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-9226bd12-ab63-4bd3-a5d7-24510c96df03 admin admin] Deleting port e025929c-44cc-4832-b4a4-0216288df212 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:34:11.444536 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9226bd12-ab63-4bd3-a5d7-24510c96df03 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:11.503606 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device c66388ff-7389-4791-9f4a-dc83e0728f21 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:34:11.525988 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d0ff87f5-4bf7-43fd-9afd-a8e5334a3af3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:11.569772 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d089cbfc-1328-479d-b1aa-1a12780d8038 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:11.577235 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-9226bd12-ab63-4bd3-a5d7-24510c96df03 admin admin] For port e025929c-44cc-4832-b4a4-0216288df212, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=e025929c-44cc-4832-b4a4-0216288df212,segment=NetworkSegment(e211d893-ee7a-48e3-bc29-b8824167e15b),segment_id=e211d893-ee7a-48e3-bc29-b8824167e15b)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:34:11.577855 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9226bd12-ab63-4bd3-a5d7-24510c96df03 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:11.591343 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-d0ff87f5-4bf7-43fd-9afd-a8e5334a3af3 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a7a2b30d-fd9d-4c33-a20f-568e8a85bd27']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:11.594957 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-9226bd12-ab63-4bd3-a5d7-24510c96df03 admin admin] Calling delete_port for e025929c-44cc-4832-b4a4-0216288df212 owned by network:router_interface {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:34:11.602167 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a4bf4e45-a5b2-4e85-85d6-a5554340e656 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:11.605550 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-d0ff87f5-4bf7-43fd-9afd-a8e5334a3af3 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '73e05a91-1d5e-42b3-bfd6-ebbbd224075d') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:11.605847 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-d0ff87f5-4bf7-43fd-9afd-a8e5334a3af3 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '73e05a91-1d5e-42b3-bfd6-ebbbd224075d') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:11.619638 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d0ff87f5-4bf7-43fd-9afd-a8e5334a3af3 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:11.628817 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-89bd73a3-ad60-4c1b-9451-54573d30bba6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:11.631627 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0abdb25f-ca16-4910-9e2c-5ad9d6831584 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-f7f6f298-5e2f-43a9-abfe-13a440ef4798', 'network_id': 'f7f6f298-5e2f-43a9-abfe-13a440ef4798', 'tenant_id': '4b395c2f9c4f482198ab37eb736cc2fe', 'fixed_ips': [{'subnet_id': 'a177571b-ddcb-47e3-a5b1-049189b20956'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:34:11.632480 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0abdb25f-ca16-4910-9e2c-5ad9d6831584 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:11.634244 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d0ff87f5-4bf7-43fd-9afd-a8e5334a3af3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:11.637371 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d089cbfc-1328-479d-b1aa-1a12780d8038 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:11.652690 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d0ff87f5-4bf7-43fd-9afd-a8e5334a3af3 admin admin] Releasing vlan 312 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:34:11.663272 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d0ff87f5-4bf7-43fd-9afd-a8e5334a3af3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:11.663272 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:34:11.663272 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:34:11.663272 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:34:11.663272 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:34:11.663272 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:34:11.663272 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:34:11.663272 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:34:11.663272 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:34:11.663272 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:34:11.663272 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:34:11.663272 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:34:11.663272 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:34:11.663272 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:34:11.663272 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:34:11.663272 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:34:11.663272 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:34:11.663272 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:34:11.663272 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:34:11.663272 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:34:11.663272 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:34:11.663272 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:34:11.663272 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:34:11.663272 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:34:11.663272 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:34:11.663272 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:34:11.663272 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:34:11.663272 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:34:11.663272 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:34:11.663272 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:34:11.663272 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:34:11.663272 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:34:11.663272 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:34:11.665934 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-77a2744b-b362-4d9e-9aae-d24cf0c8dcd8 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] update failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:34:11.665934 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-77a2744b-b362-4d9e-9aae-d24cf0c8dcd8 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] 10.222.0.24 "PUT /v2.0/routers/8cbd7ad3-04d4-4ab0-b79f-a9a391f624b1 HTTP/1.1" status: 400 len: 364 time: 0.7060616 Nov 09 04:34:11.665934 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57730) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:11.726535 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-75a3869f-3ab6-44e8-b10f-e32293cc3f7a tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:34:11.730168 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-75a3869f-3ab6-44e8-b10f-e32293cc3f7a tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:11.757837 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a4bf4e45-a5b2-4e85-85d6-a5554340e656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:11.769020 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port c66388ff-7389-4791-9f4a-dc83e0728f21 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:11.769395 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:11.845496 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d089cbfc-1328-479d-b1aa-1a12780d8038 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:11.850419 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-d089cbfc-1328-479d-b1aa-1a12780d8038 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 699 time: 0.6202533 Nov 09 04:34:11.850419 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d0ff87f5-4bf7-43fd-9afd-a8e5334a3af3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:11.852490 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57734) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:11.862538 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-fab03712-fa7e-4bfd-8890-42e2c644d642 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Request body: {'subnetpool': {'name': 'tempest-TagsExtTest-Subnetpool-853894313', 'prefixes': ['172.20.0.0/16']}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:11.875151 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d0ff87f5-4bf7-43fd-9afd-a8e5334a3af3 admin admin] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:11.878667 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-d0ff87f5-4bf7-43fd-9afd-a8e5334a3af3 admin admin] 10.222.0.24 "DELETE /v2.0/networks/a7a2b30d-fd9d-4c33-a20f-568e8a85bd27 HTTP/1.1" status: 204 len: 168 time: 0.7680960 Nov 09 04:34:11.896718 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a4bf4e45-a5b2-4e85-85d6-a5554340e656 None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:34:11.896973 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0ff87f5-4bf7-43fd-9afd-a8e5334a3af3 admin admin] Pushing event deleted for resources: {'Network': ['ID=a7a2b30d-fd9d-4c33-a20f-568e8a85bd27,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:11.938192 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-a4bf4e45-a5b2-4e85-85d6-a5554340e656 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:11.951574 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4bf4e45-a5b2-4e85-85d6-a5554340e656 None None] Pushing event updated for resources: {'Port': ['ID=453bd95e-9a2c-476e-8e72-48e39cc947d1,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:11.954002 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a4bf4e45-a5b2-4e85-85d6-a5554340e656 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:34:12.046718 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-0abdb25f-ca16-4910-9e2c-5ad9d6831584 None None] Allocated IP 2001:db8:1::2 (f7f6f298-5e2f-43a9-abfe-13a440ef4798/a177571b-ddcb-47e3-a5b1-049189b20956/88ea1e96-420b-4cd6-8d44-c8c72705e096) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:34:12.134954 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8a96c03-a847-4325-9087-5e985a8d58bb req-0053729a-b2bb-4191-9b8e-b6887e90c0a2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:12.136513 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f8a96c03-a847-4325-9087-5e985a8d58bb req-0053729a-b2bb-4191-9b8e-b6887e90c0a2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=8f462374-376b-4c38-b300-528ae5358377 HTTP/1.1" status: 200 len: 944 time: 0.3085103 Nov 09 04:34:12.176954 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-a4bf4e45-a5b2-4e85-85d6-a5554340e656 None None] Attempting to bind port 453bd95e-9a2c-476e-8e72-48e39cc947d1 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:34:12.177436 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-a4bf4e45-a5b2-4e85-85d6-a5554340e656 None None] Attempting to bind port 453bd95e-9a2c-476e-8e72-48e39cc947d1 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:34:12.177885 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a4bf4e45-a5b2-4e85-85d6-a5554340e656 None None] Attempting to bind port 453bd95e-9a2c-476e-8e72-48e39cc947d1 on network 988d2354-693c-4d52-af17-25e0643eaa0c {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:34:12.199632 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-05da13b0-9168-422e-89ab-2856c254edc6 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:12.218667 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a4bf4e45-a5b2-4e85-85d6-a5554340e656 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 33, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:34:12.219047 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a4bf4e45-a5b2-4e85-85d6-a5554340e656 None None] Checking segment: {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:34:12.219444 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a4bf4e45-a5b2-4e85-85d6-a5554340e656 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:12.219837 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a4bf4e45-a5b2-4e85-85d6-a5554340e656 None None] Bound using segment: {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:34:12.220320 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-a4bf4e45-a5b2-4e85-85d6-a5554340e656 None None] Bound port: 453bd95e-9a2c-476e-8e72-48e39cc947d1, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:34:12.220706 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a4bf4e45-a5b2-4e85-85d6-a5554340e656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:12.229453 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9226bd12-ab63-4bd3-a5d7-24510c96df03 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:12.256338 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fab03712-fa7e-4bfd-8890-42e2c644d642 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Publish callbacks [] for subnetpool, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:12.261341 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-fab03712-fa7e-4bfd-8890-42e2c644d642 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 747 time: 0.4051802 Nov 09 04:34:12.261341 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-75a3869f-3ab6-44e8-b10f-e32293cc3f7a tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:12.266665 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57738) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:12.271217 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:12.273041 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:12.276505 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f8a96c03-a847-4325-9087-5e985a8d58bb req-df588892-3b29-4a1a-b279-fca1e176816c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=99157167-0266-49ff-809e-cf8a91af8ae5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1311100 Nov 09 04:34:12.304353 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.tag.tag_plugin [None req-3f2c8f70-083e-4086-8821-b7a755633437 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'subnets', '66cc5117-4268-433d-acab-66834cdb6f85', 'tempest-TagsExtTest-Tag-1822623855') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:12.425364 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port c66388ff-7389-4791-9f4a-dc83e0728f21, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=c66388ff-7389-4791-9f4a-dc83e0728f21,segment=NetworkSegment(c52f7e89-4315-41f9-9d5a-5046f4cc1460),segment_id=c52f7e89-4315-41f9-9d5a-5046f4cc1460)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:34:12.442339 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57740) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:12.489236 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75a3869f-3ab6-44e8-b10f-e32293cc3f7a tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Subnet': ['ID=598c6d18-7032-48f5-afe4-e8ba1122edd2,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:12.494797 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-75a3869f-3ab6-44e8-b10f-e32293cc3f7a tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:34:12.498883 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-a4bf4e45-a5b2-4e85-85d6-a5554340e656 None None] For port 453bd95e-9a2c-476e-8e72-48e39cc947d1, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:34:12.515419 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-75a3869f-3ab6-44e8-b10f-e32293cc3f7a tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:12.533140 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-75a3869f-3ab6-44e8-b10f-e32293cc3f7a tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:12.534203 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-75a3869f-3ab6-44e8-b10f-e32293cc3f7a tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:12.541264 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-a4bf4e45-a5b2-4e85-85d6-a5554340e656 None None] For port 453bd95e-9a2c-476e-8e72-48e39cc947d1, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=453bd95e-9a2c-476e-8e72-48e39cc947d1,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:34:12.545943 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:12.548457 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0abdb25f-ca16-4910-9e2c-5ad9d6831584 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:12.593506 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-960f1a73-abad-470a-a7aa-19d85511a6e2 None None] Network 3d535493-472d-4bfc-8052-c7d4e02f89c4 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:34:12.629324 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-dff6eb1f-e5b9-46e2-97b9-4ad06873727a admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=a7dd369fc9b947d2b50f9f75551d326d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1390460 Nov 09 04:34:12.629974 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57742) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:12.632789 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=c66388ff-7389-4791-9f4a-dc83e0728f21,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:12.638614 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a4bf4e45-a5b2-4e85-85d6-a5554340e656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:12.694771 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-75a3869f-3ab6-44e8-b10f-e32293cc3f7a tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 1.4331284 Nov 09 04:34:12.699533 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57744) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:12.708451 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-94d11991-eca4-440f-b873-5ab9f8196e91 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'port': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'mac_address': 'fa:16:3e:a0:e6:89', 'name': 'tempest-NetworksTestDHCPv6-953825046'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:12.709225 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0abdb25f-ca16-4910-9e2c-5ad9d6831584 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:12.716666 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9226bd12-ab63-4bd3-a5d7-24510c96df03 admin admin] Pushing event deleted for resources: {'Port': ['ID=e025929c-44cc-4832-b4a4-0216288df212,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:12.760957 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-2444d26e-ffbc-4777-8707-22909bc920ee None None] Provisioning complete for port c66388ff-7389-4791-9f4a-dc83e0728f21 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:12.761530 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-2444d26e-ffbc-4777-8707-22909bc920ee None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:12.778430 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0abdb25f-ca16-4910-9e2c-5ad9d6831584 None None] Network f7f6f298-5e2f-43a9-abfe-13a440ef4798 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:34:12.797655 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-3f2c8f70-083e-4086-8821-b7a755633437 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "PUT /v2.0/subnets/66cc5117-4268-433d-acab-66834cdb6f85/tags/tempest-TagsExtTest-Tag-1822623855 HTTP/1.1" status: 201 len: 201 time: 0.5219169 Nov 09 04:34:12.799294 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57746) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:12.809446 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-0abdb25f-ca16-4910-9e2c-5ad9d6831584 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:12.813139 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.tag.tag_plugin [None req-d3a3fad9-a188-4317-8cf0-cd12ef68a03a tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'ports', '595ae407-7cb5-4c2b-a4fa-9cb5b8c81a58', 'tempest-TagsExtTest-Tag-401796809') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:12.815027 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0abdb25f-ca16-4910-9e2c-5ad9d6831584 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:34:12.818648 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4bf4e45-a5b2-4e85-85d6-a5554340e656 None None] Pushing event updated for resources: {'Port': ['ID=453bd95e-9a2c-476e-8e72-48e39cc947d1,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:12.875838 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fe491dbe-47c6-42e4-8ac8-78fce10bdc61 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:12.910630 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fe491dbe-47c6-42e4-8ac8-78fce10bdc61 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:12.975831 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-0abdb25f-ca16-4910-9e2c-5ad9d6831584 None None] Attempting to bind port 88ea1e96-420b-4cd6-8d44-c8c72705e096 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:34:12.976206 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-0abdb25f-ca16-4910-9e2c-5ad9d6831584 None None] Attempting to bind port 88ea1e96-420b-4cd6-8d44-c8c72705e096 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '79435fa1-8c80-4d01-8972-9d589024c286', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 318, 'network_id': 'f7f6f298-5e2f-43a9-abfe-13a440ef4798'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:34:12.976574 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0abdb25f-ca16-4910-9e2c-5ad9d6831584 None None] Attempting to bind port 88ea1e96-420b-4cd6-8d44-c8c72705e096 on network f7f6f298-5e2f-43a9-abfe-13a440ef4798 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:34:12.994245 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0abdb25f-ca16-4910-9e2c-5ad9d6831584 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 33, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:34:12.994930 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0abdb25f-ca16-4910-9e2c-5ad9d6831584 None None] Checking segment: {'id': '79435fa1-8c80-4d01-8972-9d589024c286', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 318, 'network_id': 'f7f6f298-5e2f-43a9-abfe-13a440ef4798'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:34:12.995345 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0abdb25f-ca16-4910-9e2c-5ad9d6831584 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:12.995738 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0abdb25f-ca16-4910-9e2c-5ad9d6831584 None None] Bound using segment: {'id': '79435fa1-8c80-4d01-8972-9d589024c286', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 318, 'network_id': 'f7f6f298-5e2f-43a9-abfe-13a440ef4798'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:34:12.996371 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-0abdb25f-ca16-4910-9e2c-5ad9d6831584 None None] Bound port: 88ea1e96-420b-4cd6-8d44-c8c72705e096, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '79435fa1-8c80-4d01-8972-9d589024c286', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 318, 'network_id': 'f7f6f298-5e2f-43a9-abfe-13a440ef4798'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:34:12.996585 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0abdb25f-ca16-4910-9e2c-5ad9d6831584 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:13.053171 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9226bd12-ab63-4bd3-a5d7-24510c96df03 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:13.065572 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-05da13b0-9168-422e-89ab-2856c254edc6 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Allocated IP 2001:db8::1 (83b7fb07-746c-4cc1-a582-519bfb1e5896/e2e8c027-b8d8-4759-88db-fcda9b0dfe5f/a720b803-6d6f-4d58-8ba1-5d290fe68b58) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:34:13.099119 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-94d11991-eca4-440f-b873-5ab9f8196e91 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:34:13.102681 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0abdb25f-ca16-4910-9e2c-5ad9d6831584 None None] Pushing event updated for resources: {'Port': ['ID=88ea1e96-420b-4cd6-8d44-c8c72705e096,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:13.189486 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-0abdb25f-ca16-4910-9e2c-5ad9d6831584 None None] For port 88ea1e96-420b-4cd6-8d44-c8c72705e096, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:34:13.191915 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fe491dbe-47c6-42e4-8ac8-78fce10bdc61 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:13.195029 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fe491dbe-47c6-42e4-8ac8-78fce10bdc61 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:13.196560 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-fe491dbe-47c6-42e4-8ac8-78fce10bdc61 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/8fd0adbd-57c5-4583-8e2d-9a55d7973976 HTTP/1.1" status: 204 len: 168 time: 0.5608304 Nov 09 04:34:13.202024 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-d3a3fad9-a188-4317-8cf0-cd12ef68a03a tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "PUT /v2.0/ports/595ae407-7cb5-4c2b-a4fa-9cb5b8c81a58/tags/tempest-TagsExtTest-Tag-401796809 HTTP/1.1" status: 201 len: 201 time: 0.3999972 Nov 09 04:34:13.206949 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57750) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:13.208278 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-0abdb25f-ca16-4910-9e2c-5ad9d6831584 None None] For port 88ea1e96-420b-4cd6-8d44-c8c72705e096, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=88ea1e96-420b-4cd6-8d44-c8c72705e096,segment=NetworkSegment(79435fa1-8c80-4d01-8972-9d589024c286),segment_id=79435fa1-8c80-4d01-8972-9d589024c286)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:34:13.212680 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.tag.tag_plugin [None req-2c66f42a-274e-4dfd-83c1-d646b236057e tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'routers', '186c5198-7801-42c9-b497-8bb92f57d406', 'tempest-TagsExtTest-Tag-141358850') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:13.262469 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe491dbe-47c6-42e4-8ac8-78fce10bdc61 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8fd0adbd-57c5-4583-8e2d-9a55d7973976,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:13.300543 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0abdb25f-ca16-4910-9e2c-5ad9d6831584 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:13.379361 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-05da13b0-9168-422e-89ab-2856c254edc6 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:13.406607 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-94d11991-eca4-440f-b873-5ab9f8196e91 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:13.470164 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-2c66f42a-274e-4dfd-83c1-d646b236057e tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "PUT /v2.0/routers/186c5198-7801-42c9-b497-8bb92f57d406/tags/tempest-TagsExtTest-Tag-141358850 HTTP/1.1" status: 201 len: 201 time: 0.2620349 Nov 09 04:34:13.472844 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [None req-94d11991-eca4-440f-b873-5ab9f8196e91 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] device_id is not set on port 4df64fdc-92cf-498c-91b6-2b5f8b1a4b1c yet. {{(pid=102162) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:34:13.478019 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57754) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:13.481786 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0abdb25f-ca16-4910-9e2c-5ad9d6831584 None None] Pushing event updated for resources: {'Port': ['ID=88ea1e96-420b-4cd6-8d44-c8c72705e096,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:13.482716 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.tag.tag_plugin [None req-f4991892-d152-4164-814c-50159af7ecaa tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'subnetpools', 'f6fd139d-5736-40ad-a449-f302767d5f1c', 'tempest-TagsExtTest-Tag-1616795519') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:13.524501 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-05da13b0-9168-422e-89ab-2856c254edc6 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:13.547777 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-05da13b0-9168-422e-89ab-2856c254edc6 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Network 83b7fb07-746c-4cc1-a582-519bfb1e5896 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:34:13.579325 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-05da13b0-9168-422e-89ab-2856c254edc6 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:13.600291 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-05da13b0-9168-422e-89ab-2856c254edc6 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:34:13.601953 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-05da13b0-9168-422e-89ab-2856c254edc6 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:13.691546 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5760c387-a8a4-4e37-935a-12cba25a2014 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:13.727334 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device c66388ff-7389-4791-9f4a-dc83e0728f21 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:34:13.741017 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05da13b0-9168-422e-89ab-2856c254edc6 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Pushing event updated for resources: {'Port': ['ID=a720b803-6d6f-4d58-8ba1-5d290fe68b58,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:13.821157 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9226bd12-ab63-4bd3-a5d7-24510c96df03 admin admin] Router 5023cfbb-afb2-4e33-bdc1-c1173218f6bf has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:34:13.886621 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2246ba9a-293d-4d50-8951-1ba99ed67070 req-66f1a593-47d2-4012-aec2-011960be59b8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:13.892066 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2246ba9a-293d-4d50-8951-1ba99ed67070 req-66f1a593-47d2-4012-aec2-011960be59b8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=8f462374-376b-4c38-b300-528ae5358377 HTTP/1.1" status: 200 len: 944 time: 0.3886061 Nov 09 04:34:13.935502 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e454196a-a29e-401d-832c-9f2a3cad2aa2 None None] Provisioning complete for port c66388ff-7389-4791-9f4a-dc83e0728f21 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:13.936070 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e454196a-a29e-401d-832c-9f2a3cad2aa2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:14.019960 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-f4991892-d152-4164-814c-50159af7ecaa tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "PUT /v2.0/subnetpools/f6fd139d-5736-40ad-a449-f302767d5f1c/tags/tempest-TagsExtTest-Tag-1616795519 HTTP/1.1" status: 201 len: 201 time: 0.5408394 Nov 09 04:34:14.030854 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57758) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:14.035206 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port c66388ff-7389-4791-9f4a-dc83e0728f21 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:14.035862 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:14.045543 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.tag.tag_plugin [None req-ec23ed49-ddae-46c9-9743-47c8191f4733 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'subnets', '66cc5117-4268-433d-acab-66834cdb6f85') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:14.097162 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-94d11991-eca4-440f-b873-5ab9f8196e91 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Allocated IP 2001:db8:0:1::325 (988d2354-693c-4d52-af17-25e0643eaa0c/598c6d18-7032-48f5-afe4-e8ba1122edd2/4df64fdc-92cf-498c-91b6-2b5f8b1a4b1c) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:34:14.113255 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-94d11991-eca4-440f-b873-5ab9f8196e91 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Allocated IP 2001:db8::f816:3eff:fea0:e689 (988d2354-693c-4d52-af17-25e0643eaa0c/e9f0be11-da61-45ff-99f6-6f139e39eb72/4df64fdc-92cf-498c-91b6-2b5f8b1a4b1c) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:34:14.144932 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2246ba9a-293d-4d50-8951-1ba99ed67070 req-519c042e-e7ce-42f7-99e1-51609569f1d5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=99157167-0266-49ff-809e-cf8a91af8ae5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2285056 Nov 09 04:34:14.180978 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 09cbfb91-4118-43af-8b70-41d8d4265574 up at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:34:14.263115 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-05da13b0-9168-422e-89ab-2856c254edc6 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:14.318191 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9226bd12-ab63-4bd3-a5d7-24510c96df03 admin admin] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:34:14.333131 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-9226bd12-ab63-4bd3-a5d7-24510c96df03 admin admin] 10.222.0.24 "PUT /v2.0/routers/5023cfbb-afb2-4e33-bdc1-c1173218f6bf/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 4.6553817 Nov 09 04:34:14.334434 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9f80faeb-6b75-44bd-8dd6-42fa98313cd4 None None] Sync routers for ids ['5023cfbb-afb2-4e33-bdc1-c1173218f6bf'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:34:14.346344 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e454196a-a29e-401d-832c-9f2a3cad2aa2 None None] Provisioning complete for port 595ae407-7cb5-4c2b-a4fa-9cb5b8c81a58 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:14.350099 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e454196a-a29e-401d-832c-9f2a3cad2aa2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:14.367901 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57760) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:14.379481 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-ec23ed49-ddae-46c9-9743-47c8191f4733 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "GET /v2.0/subnets/66cc5117-4268-433d-acab-66834cdb6f85/tags HTTP/1.1" status: 200 len: 241 time: 0.3449755 Nov 09 04:34:14.387092 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-94d11991-eca4-440f-b873-5ab9f8196e91 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:14.405327 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57762) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:14.405585 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9f80faeb-6b75-44bd-8dd6-42fa98313cd4 None None] Routers {'5023cfbb-afb2-4e33-bdc1-c1173218f6bf'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:34:14.406039 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-9f80faeb-6b75-44bd-8dd6-42fa98313cd4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:34:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['5023cfbb-afb2-4e33-bdc1-c1173218f6bf'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:14.411411 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 453bd95e-9a2c-476e-8e72-48e39cc947d1 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:34:14.420790 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.tag.tag_plugin [None req-8f7e652c-ca20-45e3-9fd3-4594517dfa76 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnets', '66cc5117-4268-433d-acab-66834cdb6f85', 'tempest-TagsExtTest-Tag-1822623855') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:14.458473 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57764) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:14.518783 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-f48fc21e-5931-468c-8f32-38c889a3a351 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=446490ea609e4e4788a45d2b3796f6b4&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0563619 Nov 09 04:34:14.526552 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57766) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:14.603414 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-57f8cd03-f490-4f72-8fbe-8e151bf12dec admin admin] Publish callbacks [] for router, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:14.631044 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c17ba414-3668-42c1-80df-dd010310b030 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:14.640452 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-8f7e652c-ca20-45e3-9fd3-4594517dfa76 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "GET /v2.0/subnets/66cc5117-4268-433d-acab-66834cdb6f85/tags/tempest-TagsExtTest-Tag-1822623855 HTTP/1.1" status: 204 len: 168 time: 0.2316637 Nov 09 04:34:14.644276 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57768) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:14.649716 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.tag.tag_plugin [None req-8f50ace8-8883-45d1-94d0-08b5303517fc tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tag called with arguments (, 'subnets', '66cc5117-4268-433d-acab-66834cdb6f85', 'tempest-TagsExtTest-Tag-1822623855') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:14.672953 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-89ee7a42-2c02-47dc-b668-23c83f44efc9 None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:34:14.692532 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c17ba414-3668-42c1-80df-dd010310b030 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:14.695930 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-94d11991-eca4-440f-b873-5ab9f8196e91 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:14.743511 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning for port 09cbfb91-4118-43af-8b70-41d8d4265574 completed by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 09 04:34:14.766050 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning complete for port 09cbfb91-4118-43af-8b70-41d8d4265574 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:14.766436 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:14.777451 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e454196a-a29e-401d-832c-9f2a3cad2aa2 None None] Port 595ae407-7cb5-4c2b-a4fa-9cb5b8c81a58 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:34:14.796231 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-57f8cd03-f490-4f72-8fbe-8e151bf12dec admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:14.797743 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94d11991-eca4-440f-b873-5ab9f8196e91 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Port': ['ID=4df64fdc-92cf-498c-91b6-2b5f8b1a4b1c,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:14.820430 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-05da13b0-9168-422e-89ab-2856c254edc6 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:14.838031 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-94d11991-eca4-440f-b873-5ab9f8196e91 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:34:14.844477 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-94d11991-eca4-440f-b873-5ab9f8196e91 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:14.850600 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-94d11991-eca4-440f-b873-5ab9f8196e91 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:34:14.856240 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-94d11991-eca4-440f-b873-5ab9f8196e91 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:14.856865 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-94d11991-eca4-440f-b873-5ab9f8196e91 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:14.926279 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-05da13b0-9168-422e-89ab-2856c254edc6 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:14.927063 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-05da13b0-9168-422e-89ab-2856c254edc6 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:14.954278 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-9f80faeb-6b75-44bd-8dd6-42fa98313cd4 None None] Set router 5023cfbb-afb2-4e33-bdc1-c1173218f6bf gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:34:14.989076 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-94d11991-eca4-440f-b873-5ab9f8196e91 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1033 time: 2.2848930 Nov 09 04:34:14.992785 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-8f50ace8-8883-45d1-94d0-08b5303517fc tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "DELETE /v2.0/subnets/66cc5117-4268-433d-acab-66834cdb6f85/tags/tempest-TagsExtTest-Tag-1822623855 HTTP/1.1" status: 204 len: 168 time: 0.3475049 Nov 09 04:34:14.993406 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57770) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:14.993739 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57772) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:15.001781 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-57f8cd03-f490-4f72-8fbe-8e151bf12dec admin admin] Deleting port a4e20770-3342-4c9b-a9bf-d4dab52b7d8d {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:34:15.002686 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-57f8cd03-f490-4f72-8fbe-8e151bf12dec admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:15.002889 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.tag.tag_plugin [None req-b2609139-790f-4274-b75c-8a9c5c5a441f tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'subnets', '66cc5117-4268-433d-acab-66834cdb6f85') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:15.007123 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05da13b0-9168-422e-89ab-2856c254edc6 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Pushing event updated for resources: {'Port': ['ID=a720b803-6d6f-4d58-8ba1-5d290fe68b58,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:15.015827 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c17ba414-3668-42c1-80df-dd010310b030 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:15.020349 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c17ba414-3668-42c1-80df-dd010310b030 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:15.023920 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-c17ba414-3668-42c1-80df-dd010310b030 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/a8f3bb12-bbbd-4259-bd64-05bf9032be92 HTTP/1.1" status: 204 len: 168 time: 0.4899185 Nov 09 04:34:15.028262 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 453bd95e-9a2c-476e-8e72-48e39cc947d1 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:15.028562 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:15.030860 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-540d8060-6c34-4889-b734-642ae33e4704 None None] Provisioning complete for port 453bd95e-9a2c-476e-8e72-48e39cc947d1 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:15.031817 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-540d8060-6c34-4889-b734-642ae33e4704 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:15.079180 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c17ba414-3668-42c1-80df-dd010310b030 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a8f3bb12-bbbd-4259-bd64-05bf9032be92,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:15.112617 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b4324500-4e1c-486f-9b33-22cddd1b533e None None] Network f7f6f298-5e2f-43a9-abfe-13a440ef4798 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:34:15.186434 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-b2609139-790f-4274-b75c-8a9c5c5a441f tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "GET /v2.0/subnets/66cc5117-4268-433d-acab-66834cdb6f85/tags HTTP/1.1" status: 200 len: 205 time: 0.1798532 Nov 09 04:34:15.191690 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57776) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:15.210699 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.tag.tag_plugin [None req-2b345c47-cab3-4010-ab9d-64ff30f1b47e tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'ports', '595ae407-7cb5-4c2b-a4fa-9cb5b8c81a58') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:15.236645 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:15.249909 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-a51b0ac2-ed10-44df-b658-92b030421166 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Deleting port 4df64fdc-92cf-498c-91b6-2b5f8b1a4b1c {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:34:15.250980 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a51b0ac2-ed10-44df-b658-92b030421166 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:15.335591 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:15.375968 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8f462374-376b-4c38-b300-528ae5358377', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '09cbfb91-4118-43af-8b70-41d8d4265574'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:34:15.381328 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5ca3c217-0666-4a2e-81c4-8b0958000d2a" -d '{"events": [{"server_uuid": "8f462374-376b-4c38-b300-528ae5358377", "name": "network-vif-plugged", "status": "completed", "tag": "09cbfb91-4118-43af-8b70-41d8d4265574"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:34:15.383731 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-2b345c47-cab3-4010-ab9d-64ff30f1b47e tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "GET /v2.0/ports/595ae407-7cb5-4c2b-a4fa-9cb5b8c81a58/tags HTTP/1.1" status: 200 len: 240 time: 0.1847322 Nov 09 04:34:15.385490 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57782) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:15.398534 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.tag.tag_plugin [None req-386c10f6-34d4-47f6-ad33-27c110473981 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'ports', '595ae407-7cb5-4c2b-a4fa-9cb5b8c81a58', 'tempest-TagsExtTest-Tag-401796809') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:15.406510 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 09cbfb91-4118-43af-8b70-41d8d4265574, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=09cbfb91-4118-43af-8b70-41d8d4265574,segment=NetworkSegment(7befff96-69ce-4b76-b9cc-7561279d57a7),segment_id=7befff96-69ce-4b76-b9cc-7561279d57a7)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:34:15.435115 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a51b0ac2-ed10-44df-b658-92b030421166 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:15.451041 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-a51b0ac2-ed10-44df-b658-92b030421166 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Calling delete_port for 4df64fdc-92cf-498c-91b6-2b5f8b1a4b1c owned by {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:34:15.503951 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:15.509717 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-57f8cd03-f490-4f72-8fbe-8e151bf12dec admin admin] For port a4e20770-3342-4c9b-a9bf-d4dab52b7d8d, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=a4e20770-3342-4c9b-a9bf-d4dab52b7d8d,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:34:15.511720 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-57f8cd03-f490-4f72-8fbe-8e151bf12dec admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:15.545555 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-05da13b0-9168-422e-89ab-2856c254edc6 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Network 83b7fb07-746c-4cc1-a582-519bfb1e5896 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:34:15.566424 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-05da13b0-9168-422e-89ab-2856c254edc6 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:15.589314 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-57f8cd03-f490-4f72-8fbe-8e151bf12dec admin admin] Calling delete_port for a4e20770-3342-4c9b-a9bf-d4dab52b7d8d owned by network:router_gateway {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:34:15.589963 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:15.637189 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=09cbfb91-4118-43af-8b70-41d8d4265574,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:15.652668 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbc9bcac-cc30-496d-97e0-09480ea5b54a req-593ba512-e428-4279-8b63-d30a617a1988 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:15.657532 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-dbc9bcac-cc30-496d-97e0-09480ea5b54a req-593ba512-e428-4279-8b63-d30a617a1988 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=8f462374-376b-4c38-b300-528ae5358377 HTTP/1.1" status: 200 len: 944 time: 0.2813482 Nov 09 04:34:15.727062 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ae615cd5-ab31-442a-9700-47f1b6e55b2d None None] Update dhcp port {'port': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'fixed_ips': [{'subnet_id': 'e9f0be11-da61-45ff-99f6-6f139e39eb72', 'ip_address': '2001:db8::f816:3eff:fe73:ac68'}, {'subnet_id': '598c6d18-7032-48f5-afe4-e8ba1122edd2'}], 'binding:host_id': 'dv-neutron-816802-2-hyperv'}, 'id': '453bd95e-9a2c-476e-8e72-48e39cc947d1'} from dv-neutron-816802-2-hyperv. {{(pid=102163) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:328}} Nov 09 04:34:15.761522 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-540d8060-6c34-4889-b734-642ae33e4704 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:15.833483 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ae615cd5-ab31-442a-9700-47f1b6e55b2d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:15.844625 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:34:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5b569242-e5ac-4a4e-beee-bfaf3b883a88 x-openstack-request-id: req-5b569242-e5ac-4a4e-beee-bfaf3b883a88 {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:34:15.845381 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8f462374-376b-4c38-b300-528ae5358377", "name": "network-vif-plugged", "status": "completed", "tag": "09cbfb91-4118-43af-8b70-41d8d4265574", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:34:15.846385 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-5b569242-e5ac-4a4e-beee-bfaf3b883a88 {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:34:15.847222 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8f462374-376b-4c38-b300-528ae5358377', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '09cbfb91-4118-43af-8b70-41d8d4265574', 'code': 200} Nov 09 04:34:15.895393 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 453bd95e-9a2c-476e-8e72-48e39cc947d1, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=453bd95e-9a2c-476e-8e72-48e39cc947d1,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:34:15.966108 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-9f80faeb-6b75-44bd-8dd6-42fa98313cd4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5023cfbb-afb2-4e33-bdc1-c1173218f6bf', 'name': 'tempest-ServerActionsTestJSON-1211051012-router', 'tenant_id': '6015befde7f546d881cb247ae5bc81ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.95'}], 'enable_snat': True}, 'gw_port_id': 'a4e20770-3342-4c9b-a9bf-d4dab52b7d8d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:30:28Z', 'updated_at': '2021-11-09T04:34:12Z', 'revision_number': 5, 'project_id': '6015befde7f546d881cb247ae5bc81ae', 'gw_port': {'id': 'a4e20770-3342-4c9b-a9bf-d4dab52b7d8d', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:03:2b:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5023cfbb-afb2-4e33-bdc1-c1173218f6bf', 'device_owner': 'network:router_gateway', 'standard_attr_id': 499, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:30:29Z', 'updated_at': '2021-11-09T04:30:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:16.023947 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-dbc9bcac-cc30-496d-97e0-09480ea5b54a req-cefcb08d-dca6-4f34-b3b3-b985e1189b3b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=99157167-0266-49ff-809e-cf8a91af8ae5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3424199 Nov 09 04:34:16.029666 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-05da13b0-9168-422e-89ab-2856c254edc6 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Router 8cbd7ad3-04d4-4ab0-b79f-a9a391f624b1 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:34:16.052521 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:16.088382 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-386c10f6-34d4-47f6-ad33-27c110473981 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "GET /v2.0/ports/595ae407-7cb5-4c2b-a4fa-9cb5b8c81a58/tags/tempest-TagsExtTest-Tag-401796809 HTTP/1.1" status: 204 len: 168 time: 0.7017612 Nov 09 04:34:16.093563 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57786) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:16.096559 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9f80faeb-6b75-44bd-8dd6-42fa98313cd4 None None] Checking router: 5023cfbb-afb2-4e33-bdc1-c1173218f6bf for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:34:16.099378 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.db.api [None req-540d8060-6c34-4889-b734-642ae33e4704 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=102163) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:34:16.099685 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG oslo_db.api [None req-540d8060-6c34-4889-b734-642ae33e4704 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:34:16.113733 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.tag.tag_plugin [None req-626ef59a-70bf-4fba-aff7-03010023c740 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tag called with arguments (, 'ports', '595ae407-7cb5-4c2b-a4fa-9cb5b8c81a58', 'tempest-TagsExtTest-Tag-401796809') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:16.154244 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9f80faeb-6b75-44bd-8dd6-42fa98313cd4 None None] Routers {'5023cfbb-afb2-4e33-bdc1-c1173218f6bf'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:34:16.155052 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-9f80faeb-6b75-44bd-8dd6-42fa98313cd4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:34:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['5023cfbb-afb2-4e33-bdc1-c1173218f6bf'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:16.275144 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-9f80faeb-6b75-44bd-8dd6-42fa98313cd4 None None] Set router 5023cfbb-afb2-4e33-bdc1-c1173218f6bf gateway port host: None {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:34:16.287256 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-05da13b0-9168-422e-89ab-2856c254edc6 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:34:16.296187 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-05da13b0-9168-422e-89ab-2856c254edc6 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] 10.222.0.24 "PUT /v2.0/routers/8cbd7ad3-04d4-4ab0-b79f-a9a391f624b1/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.6282251 Nov 09 04:34:16.297680 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fa334781-8bf1-49dc-b6d5-8538c659cd19 None None] Sync routers for ids ['8cbd7ad3-04d4-4ab0-b79f-a9a391f624b1'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:34:16.305190 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57788) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:16.309621 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fa334781-8bf1-49dc-b6d5-8538c659cd19 None None] Routers {'8cbd7ad3-04d4-4ab0-b79f-a9a391f624b1'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:34:16.310530 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-fa334781-8bf1-49dc-b6d5-8538c659cd19 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:34:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8cbd7ad3-04d4-4ab0-b79f-a9a391f624b1'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:16.318075 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-829d909f-0665-4530-98fd-8f9c3e643996 req-4b4d7065-88ec-47f0-a72d-be5166d150af service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:16.324459 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-829d909f-0665-4530-98fd-8f9c3e643996 req-4b4d7065-88ec-47f0-a72d-be5166d150af service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=8f462374-376b-4c38-b300-528ae5358377 HTTP/1.1" status: 200 len: 1098 time: 0.1922090 Nov 09 04:34:16.360647 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-fa334781-8bf1-49dc-b6d5-8538c659cd19 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:16.382869 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fa334781-8bf1-49dc-b6d5-8538c659cd19 None None] Routers {'8cbd7ad3-04d4-4ab0-b79f-a9a391f624b1'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:34:16.384007 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a51b0ac2-ed10-44df-b658-92b030421166 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:16.386403 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-fa334781-8bf1-49dc-b6d5-8538c659cd19 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:34:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8cbd7ad3-04d4-4ab0-b79f-a9a391f624b1'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:16.395758 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-57f8cd03-f490-4f72-8fbe-8e151bf12dec admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:16.403282 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 88ea1e96-420b-4cd6-8d44-c8c72705e096 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:34:16.414132 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-9f80faeb-6b75-44bd-8dd6-42fa98313cd4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5023cfbb-afb2-4e33-bdc1-c1173218f6bf', 'name': 'tempest-ServerActionsTestJSON-1211051012-router', 'tenant_id': '6015befde7f546d881cb247ae5bc81ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:30:28Z', 'updated_at': '2021-11-09T04:34:14Z', 'revision_number': 6, 'project_id': '6015befde7f546d881cb247ae5bc81ae', 'gw_port_host': None}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:16.434215 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57f8cd03-f490-4f72-8fbe-8e151bf12dec admin admin] Pushing event deleted for resources: {'Port': ['ID=a4e20770-3342-4c9b-a9bf-d4dab52b7d8d,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:16.446119 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-fa334781-8bf1-49dc-b6d5-8538c659cd19 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:16.447117 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fa334781-8bf1-49dc-b6d5-8538c659cd19 None None] The sync data for ids ['8cbd7ad3-04d4-4ab0-b79f-a9a391f624b1'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:34:16.447407 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a51b0ac2-ed10-44df-b658-92b030421166 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event deleted for resources: {'Port': ['ID=4df64fdc-92cf-498c-91b6-2b5f8b1a4b1c,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:16.499035 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-656c7b0d-6bea-486b-bc3f-ee47c4bdff15 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks [] for router, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:16.513436 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-829d909f-0665-4530-98fd-8f9c3e643996 req-5cd06801-7553-443a-88c9-d873e7e42278 service neutron] 10.222.0.26 "GET /v2.0/security-groups?id=99157167-0266-49ff-809e-cf8a91af8ae5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1812239 Nov 09 04:34:16.516636 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a51b0ac2-ed10-44df-b658-92b030421166 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:16.520844 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a51b0ac2-ed10-44df-b658-92b030421166 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/ports/4df64fdc-92cf-498c-91b6-2b5f8b1a4b1c HTTP/1.1" status: 204 len: 168 time: 1.5256255 Nov 09 04:34:16.523435 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57790) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:16.539383 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-626ef59a-70bf-4fba-aff7-03010023c740 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "DELETE /v2.0/ports/595ae407-7cb5-4c2b-a4fa-9cb5b8c81a58/tags/tempest-TagsExtTest-Tag-401796809 HTTP/1.1" status: 204 len: 168 time: 0.4415505 Nov 09 04:34:16.555610 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57792) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:16.560727 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.tag.tag_plugin [None req-81b071bf-99e0-4c0e-9179-6ece5cd5deab tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'ports', '595ae407-7cb5-4c2b-a4fa-9cb5b8c81a58') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:16.609211 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-57f8cd03-f490-4f72-8fbe-8e151bf12dec admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-466373'] for router_gateway, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:16.616837 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b3d5f26d-f714-4f6f-bc2a-f4f847740859 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:16.621099 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-b3d5f26d-f714-4f6f-bc2a-f4f847740859 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/ports HTTP/1.1" status: 200 len: 963 time: 0.0941105 Nov 09 04:34:16.621484 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57794) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:16.662351 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9f80faeb-6b75-44bd-8dd6-42fa98313cd4 None None] The sync data for ids ['5023cfbb-afb2-4e33-bdc1-c1173218f6bf'] in dv-neutron-816802-2-hyperv is: [{'id': '5023cfbb-afb2-4e33-bdc1-c1173218f6bf', 'name': 'tempest-ServerActionsTestJSON-1211051012-router', 'tenant_id': '6015befde7f546d881cb247ae5bc81ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:30:28Z', 'updated_at': '2021-11-09T04:34:14Z', 'revision_number': 6, 'project_id': '6015befde7f546d881cb247ae5bc81ae', 'gw_port_host': None}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:34:16.681802 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-81b071bf-99e0-4c0e-9179-6ece5cd5deab tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "GET /v2.0/ports/595ae407-7cb5-4c2b-a4fa-9cb5b8c81a58/tags HTTP/1.1" status: 200 len: 205 time: 0.1249247 Nov 09 04:34:16.691238 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f80fd844-1101-47d5-976b-034b46f673fa tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:16.692935 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-f80fd844-1101-47d5-976b-034b46f673fa tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/ports HTTP/1.1" status: 200 len: 963 time: 0.0705376 Nov 09 04:34:16.693624 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57796) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:16.698898 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.tag.tag_plugin [None req-4e6d8c63-0ae5-4632-9dda-5883f621ca46 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'routers', '186c5198-7801-42c9-b497-8bb92f57d406') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:16.702609 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57798) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:16.707050 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=453bd95e-9a2c-476e-8e72-48e39cc947d1,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:16.715967 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-656c7b0d-6bea-486b-bc3f-ee47c4bdff15 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] delete failed (client error): There was a conflict when trying to complete your request. Nov 09 04:34:16.723320 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-656c7b0d-6bea-486b-bc3f-ee47c4bdff15 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] 10.222.0.24 "DELETE /v2.0/routers/8cbd7ad3-04d4-4ab0-b79f-a9a391f624b1 HTTP/1.1" status: 409 len: 329 time: 0.4107013 Nov 09 04:34:16.725245 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57800) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:16.735992 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-57f8cd03-f490-4f72-8fbe-8e151bf12dec admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:16.759713 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-ae615cd5-ab31-442a-9700-47f1b6e55b2d None None] Allocated IP 2001:db8:0:1::2 (988d2354-693c-4d52-af17-25e0643eaa0c/598c6d18-7032-48f5-afe4-e8ba1122edd2/453bd95e-9a2c-476e-8e72-48e39cc947d1) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:34:16.769231 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-57f8cd03-f490-4f72-8fbe-8e151bf12dec admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:16.770397 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:16.811642 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-540d8060-6c34-4889-b734-642ae33e4704 None None] Provisioning complete for port a720b803-6d6f-4d58-8ba1-5d290fe68b58 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:16.811642 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-540d8060-6c34-4889-b734-642ae33e4704 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:16.815307 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 88ea1e96-420b-4cd6-8d44-c8c72705e096 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:16.815711 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:16.833484 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-4e6d8c63-0ae5-4632-9dda-5883f621ca46 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "GET /v2.0/routers/186c5198-7801-42c9-b497-8bb92f57d406/tags HTTP/1.1" status: 200 len: 240 time: 0.1361008 Nov 09 04:34:16.834842 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ce0510cb-a9b2-4e3e-a2c4-d3fdfab13da6 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:16.836582 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ce0510cb-a9b2-4e3e-a2c4-d3fdfab13da6 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:16.838172 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ce0510cb-a9b2-4e3e-a2c4-d3fdfab13da6 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:16.842327 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-ce0510cb-a9b2-4e3e-a2c4-d3fdfab13da6 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2119 time: 0.1361363 Nov 09 04:34:16.842327 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57802) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:16.843834 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57804) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:16.844877 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.tag.tag_plugin [None req-de6771b5-aab9-4640-9dbf-8872e2b75c43 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'routers', '186c5198-7801-42c9-b497-8bb92f57d406', 'tempest-TagsExtTest-Tag-141358850') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:16.935148 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-540d8060-6c34-4889-b734-642ae33e4704 None None] Port a720b803-6d6f-4d58-8ba1-5d290fe68b58 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:34:16.935374 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-de6771b5-aab9-4640-9dbf-8872e2b75c43 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "GET /v2.0/routers/186c5198-7801-42c9-b497-8bb92f57d406/tags/tempest-TagsExtTest-Tag-141358850 HTTP/1.1" status: 204 len: 168 time: 0.0912724 Nov 09 04:34:16.935374 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57806) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:16.940194 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.tag.tag_plugin [None req-df91ac34-297e-4758-a6c3-3e919dd0ff9e tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tag called with arguments (, 'routers', '186c5198-7801-42c9-b497-8bb92f57d406', 'tempest-TagsExtTest-Tag-141358850') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:16.968418 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-ae615cd5-ab31-442a-9700-47f1b6e55b2d None None] For port 453bd95e-9a2c-476e-8e72-48e39cc947d1, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=453bd95e-9a2c-476e-8e72-48e39cc947d1,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:34:16.978558 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-d5956350-bb78-405e-bd03-23bc7f7e7e85 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Deleting subnet 598c6d18-7032-48f5-afe4-e8ba1122edd2 {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:34:16.983275 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-540d8060-6c34-4889-b734-642ae33e4704 None None] Provisioning complete for port 595ae407-7cb5-4c2b-a4fa-9cb5b8c81a58 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:16.983499 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-57f8cd03-f490-4f72-8fbe-8e151bf12dec admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:16.983618 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-540d8060-6c34-4889-b734-642ae33e4704 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:16.984052 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-57f8cd03-f490-4f72-8fbe-8e151bf12dec admin admin] Fanout notify agent at l3_agent the message router_deleted on router 5023cfbb-afb2-4e33-bdc1-c1173218f6bf {{(pid=102161) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:34:16.989547 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-57f8cd03-f490-4f72-8fbe-8e151bf12dec admin admin] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:16.993409 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-57f8cd03-f490-4f72-8fbe-8e151bf12dec admin admin] 10.222.0.24 "DELETE /v2.0/routers/5023cfbb-afb2-4e33-bdc1-c1173218f6bf HTTP/1.1" status: 204 len: 168 time: 2.6231492 Nov 09 04:34:16.995795 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57808) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:17.034844 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:17.058750 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:17.081650 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-540d8060-6c34-4889-b734-642ae33e4704 None None] Port 595ae407-7cb5-4c2b-a4fa-9cb5b8c81a58 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:34:17.086101 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ae615cd5-ab31-442a-9700-47f1b6e55b2d None None] Publish callbacks [] for port, precommit_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:17.086416 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-6195be41-20b9-4ac9-a5f4-e2ddb015d0de admin admin] Deleting subnet b2956e71-9b0f-4060-922c-e54ce6cff80a {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:34:17.091640 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6195be41-20b9-4ac9-a5f4-e2ddb015d0de admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:17.101060 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-df91ac34-297e-4758-a6c3-3e919dd0ff9e tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "DELETE /v2.0/routers/186c5198-7801-42c9-b497-8bb92f57d406/tags/tempest-TagsExtTest-Tag-141358850 HTTP/1.1" status: 204 len: 168 time: 0.1622097 Nov 09 04:34:17.101293 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57812) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:17.105627 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.tag.tag_plugin [None req-ba3ac007-9020-4504-b279-d2c4c642898a tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'routers', '186c5198-7801-42c9-b497-8bb92f57d406') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:17.135240 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 88ea1e96-420b-4cd6-8d44-c8c72705e096, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=88ea1e96-420b-4cd6-8d44-c8c72705e096,segment=NetworkSegment(79435fa1-8c80-4d01-8972-9d589024c286),segment_id=79435fa1-8c80-4d01-8972-9d589024c286)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:34:17.157900 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6195be41-20b9-4ac9-a5f4-e2ddb015d0de admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:17.183822 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ae615cd5-ab31-442a-9700-47f1b6e55b2d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:17.184073 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d5956350-bb78-405e-bd03-23bc7f7e7e85 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:17.236623 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:17.245980 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed149571-532f-452c-92e5-2fc766dcedf8 req-bd7efc73-7b4f-499a-b617-cf55b516ac70 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:17.247614 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ed149571-532f-452c-92e5-2fc766dcedf8 req-bd7efc73-7b4f-499a-b617-cf55b516ac70 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=8f462374-376b-4c38-b300-528ae5358377 HTTP/1.1" status: 200 len: 945 time: 0.0900033 Nov 09 04:34:17.260730 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-ba3ac007-9020-4504-b279-d2c4c642898a tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "GET /v2.0/routers/186c5198-7801-42c9-b497-8bb92f57d406/tags HTTP/1.1" status: 200 len: 205 time: 0.1553195 Nov 09 04:34:17.260964 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57814) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:17.281286 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d5956350-bb78-405e-bd03-23bc7f7e7e85 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:17.287537 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.tag.tag_plugin [None req-0ba9e8a6-7674-456e-a175-06ed5d248f72 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'subnetpools', 'f6fd139d-5736-40ad-a449-f302767d5f1c') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:17.313598 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-3729ede9-b110-48dd-be77-48a0b5536ef5 None None] Provisioning complete for port 88ea1e96-420b-4cd6-8d44-c8c72705e096 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:17.313975 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3729ede9-b110-48dd-be77-48a0b5536ef5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:17.315299 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ed149571-532f-452c-92e5-2fc766dcedf8 req-f565414d-682c-4496-b051-5550b9f72ddb tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=99157167-0266-49ff-809e-cf8a91af8ae5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0600088 Nov 09 04:34:17.319616 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae615cd5-ab31-442a-9700-47f1b6e55b2d None None] Pushing event updated for resources: {'Port': ['ID=453bd95e-9a2c-476e-8e72-48e39cc947d1,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:17.396243 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6195be41-20b9-4ac9-a5f4-e2ddb015d0de admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:17.411042 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=88ea1e96-420b-4cd6-8d44-c8c72705e096,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:17.438135 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-0ba9e8a6-7674-456e-a175-06ed5d248f72 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "GET /v2.0/subnetpools/f6fd139d-5736-40ad-a449-f302767d5f1c/tags HTTP/1.1" status: 200 len: 241 time: 0.1768360 Nov 09 04:34:17.440834 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57816) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:17.445352 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.tag.tag_plugin [None req-28a72da7-ebd0-4a32-9cf4-c4f669030e79 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnetpools', 'f6fd139d-5736-40ad-a449-f302767d5f1c', 'tempest-TagsExtTest-Tag-1616795519') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:17.475680 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-3729ede9-b110-48dd-be77-48a0b5536ef5 None None] Provisioning complete for port a720b803-6d6f-4d58-8ba1-5d290fe68b58 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:17.476065 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3729ede9-b110-48dd-be77-48a0b5536ef5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:17.498040 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-28a72da7-ebd0-4a32-9cf4-c4f669030e79 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "GET /v2.0/subnetpools/f6fd139d-5736-40ad-a449-f302767d5f1c/tags/tempest-TagsExtTest-Tag-1616795519 HTTP/1.1" status: 204 len: 168 time: 0.0537941 Nov 09 04:34:17.498799 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57818) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:17.501283 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d5956350-bb78-405e-bd03-23bc7f7e7e85 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:17.514046 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.tag.tag_plugin [None req-e0d9d004-0517-4d9b-bb86-bdabb5163ee7 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tag called with arguments (, 'subnetpools', 'f6fd139d-5736-40ad-a449-f302767d5f1c', 'tempest-TagsExtTest-Tag-1616795519') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:17.535922 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-3729ede9-b110-48dd-be77-48a0b5536ef5 None None] Port a720b803-6d6f-4d58-8ba1-5d290fe68b58 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:34:17.565600 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2163a7ad-4db3-45c7-9791-c855460b97dd tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:17.641288 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e0d9d004-0517-4d9b-bb86-bdabb5163ee7 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "DELETE /v2.0/subnetpools/f6fd139d-5736-40ad-a449-f302767d5f1c/tags/tempest-TagsExtTest-Tag-1616795519 HTTP/1.1" status: 204 len: 168 time: 0.1414235 Nov 09 04:34:17.644356 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57820) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:17.650004 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.tag.tag_plugin [None req-ab5a6ffe-b450-4b2d-8540-a2da0297e07e tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'subnetpools', 'f6fd139d-5736-40ad-a449-f302767d5f1c') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:17.685092 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-ab5a6ffe-b450-4b2d-8540-a2da0297e07e tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "GET /v2.0/subnetpools/f6fd139d-5736-40ad-a449-f302767d5f1c/tags HTTP/1.1" status: 200 len: 205 time: 0.0391355 Nov 09 04:34:17.686850 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57822) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:17.692682 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.tag.tag_plugin [None req-77f4a7cd-d330-42ef-8506-d52fc725451a tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'subnetpools', 'f6fd139d-5736-40ad-a449-f302767d5f1c') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:17.734487 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-77f4a7cd-d330-42ef-8506-d52fc725451a tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "DELETE /v2.0/subnetpools/f6fd139d-5736-40ad-a449-f302767d5f1c/tags HTTP/1.1" status: 204 len: 168 time: 0.0450504 Nov 09 04:34:17.735687 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57824) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:17.741187 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.tag.tag_plugin [None req-931cfb8d-2364-4e0a-bd7e-8e603f44153e tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'routers', '186c5198-7801-42c9-b497-8bb92f57d406') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:17.850632 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-931cfb8d-2364-4e0a-bd7e-8e603f44153e tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "DELETE /v2.0/routers/186c5198-7801-42c9-b497-8bb92f57d406/tags HTTP/1.1" status: 204 len: 168 time: 0.1039071 Nov 09 04:34:17.850632 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57826) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:17.850632 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.tag.tag_plugin [None req-4cc7a7ba-f580-461d-a6ed-bdb93aeb8dd9 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'ports', '595ae407-7cb5-4c2b-a4fa-9cb5b8c81a58') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:17.929767 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6195be41-20b9-4ac9-a5f4-e2ddb015d0de admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:17.933854 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-4cc7a7ba-f580-461d-a6ed-bdb93aeb8dd9 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "DELETE /v2.0/ports/595ae407-7cb5-4c2b-a4fa-9cb5b8c81a58/tags HTTP/1.1" status: 204 len: 168 time: 0.0869610 Nov 09 04:34:17.936987 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57828) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:17.945213 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.tag.tag_plugin [None req-da10a7ac-74c4-4665-b18f-fdf6415a6bc2 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'subnets', '66cc5117-4268-433d-acab-66834cdb6f85') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:17.998490 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6195be41-20b9-4ac9-a5f4-e2ddb015d0de admin admin] Pushing event deleted for resources: {'Subnet': ['ID=b2956e71-9b0f-4060-922c-e54ce6cff80a,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:18.005818 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6195be41-20b9-4ac9-a5f4-e2ddb015d0de admin admin] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:18.008964 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-6195be41-20b9-4ac9-a5f4-e2ddb015d0de admin admin] 10.222.0.24 "DELETE /v2.0/subnets/b2956e71-9b0f-4060-922c-e54ce6cff80a HTTP/1.1" status: 204 len: 168 time: 1.0124011 Nov 09 04:34:18.010598 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-db20c150-553a-4ad8-acc1-bb9f9d17134a None None] Network a270b61c-1f4f-4d97-be79-4a24c65fddc2 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:34:18.011070 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57830) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:18.088966 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-86744137-b63c-4be3-84f1-cc692cbd73a4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:18.094976 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-b3708fd7-719b-4361-b493-6e742551accd None None] Provisioning complete for port 453bd95e-9a2c-476e-8e72-48e39cc947d1 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:18.095082 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b3708fd7-719b-4361-b493-6e742551accd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:18.099278 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d5956350-bb78-405e-bd03-23bc7f7e7e85 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:18.104928 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-da10a7ac-74c4-4665-b18f-fdf6415a6bc2 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "DELETE /v2.0/subnets/66cc5117-4268-433d-acab-66834cdb6f85/tags HTTP/1.1" status: 204 len: 168 time: 0.1633193 Nov 09 04:34:18.104928 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57832) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:18.112833 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.tag.tag_plugin [None req-67efea8c-9340-44a2-9841-4cb53f780a68 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'subnets', '66cc5117-4268-433d-acab-66834cdb6f85', 'tempest-TagsExtTest-Tag-399010101') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:18.143348 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d5956350-bb78-405e-bd03-23bc7f7e7e85 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:18.146651 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-d5956350-bb78-405e-bd03-23bc7f7e7e85 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/598c6d18-7032-48f5-afe4-e8ba1122edd2 HTTP/1.1" status: 204 len: 168 time: 1.2992461 Nov 09 04:34:18.149184 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5956350-bb78-405e-bd03-23bc7f7e7e85 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event deleted for resources: {'Subnet': ['ID=598c6d18-7032-48f5-afe4-e8ba1122edd2,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:18.149359 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57834) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:18.243682 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 453bd95e-9a2c-476e-8e72-48e39cc947d1 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:34:18.273144 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-520f98d3-a001-44dd-b6a7-6f084cb7c21e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Deleting subnet e9f0be11-da61-45ff-99f6-6f139e39eb72 {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:34:18.286673 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-520f98d3-a001-44dd-b6a7-6f084cb7c21e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:18.305911 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-2163a7ad-4db3-45c7-9791-c855460b97dd tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Deleting port a720b803-6d6f-4d58-8ba1-5d290fe68b58 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:34:18.306642 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2163a7ad-4db3-45c7-9791-c855460b97dd tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:18.316419 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-b3708fd7-719b-4361-b493-6e742551accd None None] Could not find standard attr ID for object 4df64fdc-92cf-498c-91b6-2b5f8b1a4b1c. {{(pid=102163) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 09 04:34:18.333160 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 453bd95e-9a2c-476e-8e72-48e39cc947d1 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:18.333536 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:18.390993 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-520f98d3-a001-44dd-b6a7-6f084cb7c21e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:18.401098 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-55e471c3-2868-483f-a201-523a5908ed38 None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:34:18.435122 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-86744137-b63c-4be3-84f1-cc692cbd73a4 admin admin] Deleting port 5a469f60-d369-4f42-8796-f6357a453930 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:34:18.435439 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-86744137-b63c-4be3-84f1-cc692cbd73a4 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:18.448017 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-56f3a600-fb3b-4e9d-b2e7-cd2c890d8cdf None None] DHCP port deletion for a270b61c-1f4f-4d97-be79-4a24c65fddc2 request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:34:18.467942 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-67efea8c-9340-44a2-9841-4cb53f780a68 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "PUT /v2.0/subnets/66cc5117-4268-433d-acab-66834cdb6f85/tags/tempest-TagsExtTest-Tag-399010101 HTTP/1.1" status: 201 len: 201 time: 0.3615975 Nov 09 04:34:18.468320 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57838) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:18.473754 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.tag.tag_plugin [None req-4324c57e-d7e6-4a52-8006-b81a1b14a514 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'ports', '595ae407-7cb5-4c2b-a4fa-9cb5b8c81a58', 'tempest-TagsExtTest-Tag-168189490') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:18.498751 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-88377e5d-507d-448a-aef4-def01c3d59b4 None None] Could not find standard attr ID for object 4df64fdc-92cf-498c-91b6-2b5f8b1a4b1c. {{(pid=102163) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 09 04:34:18.516320 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2163a7ad-4db3-45c7-9791-c855460b97dd tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:18.532166 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 88ea1e96-420b-4cd6-8d44-c8c72705e096 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:34:18.536922 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-2163a7ad-4db3-45c7-9791-c855460b97dd tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Calling delete_port for a720b803-6d6f-4d58-8ba1-5d290fe68b58 owned by network:router_interface {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:34:18.544993 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-86744137-b63c-4be3-84f1-cc692cbd73a4 admin admin] For port 5a469f60-d369-4f42-8796-f6357a453930, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=5a469f60-d369-4f42-8796-f6357a453930,segment=NetworkSegment(e211d893-ee7a-48e3-bc29-b8824167e15b),segment_id=e211d893-ee7a-48e3-bc29-b8824167e15b)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:34:18.545557 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-86744137-b63c-4be3-84f1-cc692cbd73a4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:18.545806 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f56957f-9cbe-4a95-adf6-a864a5b10118 req-732aa293-371b-412c-a1db-f65084fdabc2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:18.547682 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-5f56957f-9cbe-4a95-adf6-a864a5b10118 req-732aa293-371b-412c-a1db-f65084fdabc2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=8f462374-376b-4c38-b300-528ae5358377 HTTP/1.1" status: 200 len: 945 time: 0.1247973 Nov 09 04:34:18.569360 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-86744137-b63c-4be3-84f1-cc692cbd73a4 admin admin] Calling delete_port for 5a469f60-d369-4f42-8796-f6357a453930 owned by network:dhcp {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:34:18.584156 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-520f98d3-a001-44dd-b6a7-6f084cb7c21e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:18.684911 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-5f56957f-9cbe-4a95-adf6-a864a5b10118 req-cd60424d-c4aa-4ead-bbb5-f00740e33166 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=99157167-0266-49ff-809e-cf8a91af8ae5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1306956 Nov 09 04:34:18.715682 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-56f3a600-fb3b-4e9d-b2e7-cd2c890d8cdf None None] Deleting port 5a469f60-d369-4f42-8796-f6357a453930 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:34:18.716055 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56f3a600-fb3b-4e9d-b2e7-cd2c890d8cdf None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:18.717798 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 88ea1e96-420b-4cd6-8d44-c8c72705e096 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:18.718187 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:18.788845 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-520f98d3-a001-44dd-b6a7-6f084cb7c21e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:18.824107 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-520f98d3-a001-44dd-b6a7-6f084cb7c21e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event deleted for resources: {'Subnet': ['ID=e9f0be11-da61-45ff-99f6-6f139e39eb72,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:18.824479 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-56f3a600-fb3b-4e9d-b2e7-cd2c890d8cdf None None] For port 5a469f60-d369-4f42-8796-f6357a453930, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=5a469f60-d369-4f42-8796-f6357a453930,segment=NetworkSegment(e211d893-ee7a-48e3-bc29-b8824167e15b),segment_id=e211d893-ee7a-48e3-bc29-b8824167e15b)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:34:18.825392 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56f3a600-fb3b-4e9d-b2e7-cd2c890d8cdf None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:18.825928 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-520f98d3-a001-44dd-b6a7-6f084cb7c21e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:18.835043 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57842) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:18.835275 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-520f98d3-a001-44dd-b6a7-6f084cb7c21e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/e9f0be11-da61-45ff-99f6-6f139e39eb72 HTTP/1.1" status: 204 len: 168 time: 0.6844623 Nov 09 04:34:18.837815 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-86744137-b63c-4be3-84f1-cc692cbd73a4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:18.848499 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-56f3a600-fb3b-4e9d-b2e7-cd2c890d8cdf None None] Calling delete_port for 5a469f60-d369-4f42-8796-f6357a453930 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:34:18.873772 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86744137-b63c-4be3-84f1-cc692cbd73a4 admin admin] Pushing event deleted for resources: {'Port': ['ID=5a469f60-d369-4f42-8796-f6357a453930,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:18.877511 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-86744137-b63c-4be3-84f1-cc692cbd73a4 admin admin] No DVR routers for this DVR port 5a469f60-d369-4f42-8796-f6357a453930 on host dv-neutron-816802-2-hyperv {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:34:18.880585 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-3044c0f5-91a7-4efd-9ff8-1cc2049ca867 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0442889 Nov 09 04:34:18.887642 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57844) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:18.889645 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-9c18beb3-89b7-458c-a9b1-a6da05de937e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'subnet': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:18.898052 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7699ab6c-f150-4004-b484-ddd0e260876f req-f4d9c463-2d84-4bf4-8590-c28ef14e0982 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:18.900458 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7699ab6c-f150-4004-b484-ddd0e260876f req-f4d9c463-2d84-4bf4-8590-c28ef14e0982 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=8f462374-376b-4c38-b300-528ae5358377 HTTP/1.1" status: 200 len: 945 time: 0.1401584 Nov 09 04:34:18.988656 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2163a7ad-4db3-45c7-9791-c855460b97dd tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:18.993432 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0d4f4d4b-4bf7-46c6-a4be-c8ff1e4d9b37 None None] Update dhcp port {'port': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'fixed_ips': [{'subnet_id': 'e9f0be11-da61-45ff-99f6-6f139e39eb72'}], 'binding:host_id': 'dv-neutron-816802-2-hyperv'}, 'id': '453bd95e-9a2c-476e-8e72-48e39cc947d1'} from dv-neutron-816802-2-hyperv. {{(pid=102163) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:328}} Nov 09 04:34:19.021176 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7699ab6c-f150-4004-b484-ddd0e260876f req-38a05842-5203-4543-9f26-f01bd221cc19 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=99157167-0266-49ff-809e-cf8a91af8ae5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0758653 Nov 09 04:34:19.042591 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0d4f4d4b-4bf7-46c6-a4be-c8ff1e4d9b37 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:19.060430 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device e025929c-44cc-4832-b4a4-0216288df212 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:34:19.062562 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56f3a600-fb3b-4e9d-b2e7-cd2c890d8cdf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:19.064644 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57846) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:19.084630 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2163a7ad-4db3-45c7-9791-c855460b97dd tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Pushing event deleted for resources: {'Port': ['ID=a720b803-6d6f-4d58-8ba1-5d290fe68b58,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:19.098007 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-56f3a600-fb3b-4e9d-b2e7-cd2c890d8cdf None None] No DVR routers for this DVR port 5a469f60-d369-4f42-8796-f6357a453930 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:34:19.102255 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-86744137-b63c-4be3-84f1-cc692cbd73a4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:19.116863 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56f3a600-fb3b-4e9d-b2e7-cd2c890d8cdf None None] Pushing event deleted for resources: {'Port': ['ID=5a469f60-d369-4f42-8796-f6357a453930,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:19.120627 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: e025929c-44cc-4832-b4a4-0216288df212 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:34:19.121121 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device e025929c-44cc-4832-b4a4-0216288df212 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:34:19.121543 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device a4e20770-3342-4c9b-a9bf-d4dab52b7d8d no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:34:19.139952 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-86744137-b63c-4be3-84f1-cc692cbd73a4 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a270b61c-1f4f-4d97-be79-4a24c65fddc2']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:19.159169 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-86744137-b63c-4be3-84f1-cc692cbd73a4 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e211d893-ee7a-48e3-bc29-b8824167e15b') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:19.159465 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-86744137-b63c-4be3-84f1-cc692cbd73a4 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e211d893-ee7a-48e3-bc29-b8824167e15b') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:19.166636 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-4324c57e-d7e6-4a52-8006-b81a1b14a514 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "PUT /v2.0/ports/595ae407-7cb5-4c2b-a4fa-9cb5b8c81a58/tags/tempest-TagsExtTest-Tag-168189490 HTTP/1.1" status: 201 len: 201 time: 0.6947174 Nov 09 04:34:19.168259 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57848) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:19.172300 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: a4e20770-3342-4c9b-a9bf-d4dab52b7d8d {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:34:19.172646 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device a4e20770-3342-4c9b-a9bf-d4dab52b7d8d not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:34:19.175618 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.tag.tag_plugin [None req-af9976b1-da07-4f15-b4a7-7b5ebdc8c6d4 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'routers', '186c5198-7801-42c9-b497-8bb92f57d406', 'tempest-TagsExtTest-Tag-1084296881') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:19.181265 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fe8129b2-4f63-4702-ade8-1b2f927184c8 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:19.182938 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-fe8129b2-4f63-4702-ade8-1b2f927184c8 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/ports?device_id=8f462374-376b-4c38-b300-528ae5358377 HTTP/1.1" status: 200 len: 1093 time: 0.1173446 Nov 09 04:34:19.200453 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57850) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:19.213952 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-cd533152-3b2a-4364-b572-2cbb416f46af tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'floatingip': {'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'port_id': '09cbfb91-4118-43af-8b70-41d8d4265574', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ip_address': '172.20.0.7'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:19.214736 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-86744137-b63c-4be3-84f1-cc692cbd73a4 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:19.234393 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2163a7ad-4db3-45c7-9791-c855460b97dd tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:19.247014 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.db.api [None req-9c18beb3-89b7-458c-a9b1-a6da05de937e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Nov 09 04:34:19.247014 dv-neutron-816802-2-hyperv neutron-server[102161]: [SQL: INSERT INTO reservations (project_id, id, expiration) VALUES (%(project_id)s, %(id)s, %(expiration)s)] Nov 09 04:34:19.247014 dv-neutron-816802-2-hyperv neutron-server[102161]: [parameters: {'project_id': '8b0758f781884982bf5b94e6609237f6', 'id': 'f695479b-a63e-4e3e-a1dc-4910dd309a61', 'expiration': datetime.datetime(2021, 11, 9, 4, 36, 19, 239816)}] Nov 09 04:34:19.247014 dv-neutron-816802-2-hyperv neutron-server[102161]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=102161) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:34:19.247680 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG oslo_db.api [None req-9c18beb3-89b7-458c-a9b1-a6da05de937e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Performing DB retry for function neutron.db.quota.driver_nolock.DbQuotaNoLockDriver.make_reservation {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:34:19.262568 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-86744137-b63c-4be3-84f1-cc692cbd73a4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:19.272105 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-86744137-b63c-4be3-84f1-cc692cbd73a4 admin admin] Releasing vlan 325 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:34:19.272500 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-86744137-b63c-4be3-84f1-cc692cbd73a4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:19.274508 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:34:19.274508 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:34:19.274508 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:34:19.274508 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:34:19.274508 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:34:19.274508 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:34:19.274508 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:34:19.274508 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:34:19.274508 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:34:19.274508 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:34:19.274508 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:34:19.274508 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:34:19.274508 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:34:19.274508 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:34:19.274508 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:34:19.274508 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:34:19.274508 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:34:19.274508 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:34:19.274508 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:34:19.274508 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:34:19.274508 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:34:19.274508 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:34:19.274508 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:34:19.274508 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:34:19.274508 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:34:19.274508 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:34:19.274508 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:34:19.274508 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:34:19.274508 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:34:19.274508 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:34:19.274508 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:34:19.274508 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:34:19.340810 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cd533152-3b2a-4364-b572-2cbb416f46af tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for floatingip, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:19.381275 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-809c5826-bac4-4106-a037-17960ee41f49 None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:34:19.476095 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-8165a52e-4a18-4868-9bdd-6901d1b7f4c0 None None] Provisioning complete for port 453bd95e-9a2c-476e-8e72-48e39cc947d1 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:19.476555 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8165a52e-4a18-4868-9bdd-6901d1b7f4c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:19.487702 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2163a7ad-4db3-45c7-9791-c855460b97dd tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Router 8cbd7ad3-04d4-4ab0-b79f-a9a391f624b1 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:34:19.581218 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2163a7ad-4db3-45c7-9791-c855460b97dd tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:34:19.588848 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-2163a7ad-4db3-45c7-9791-c855460b97dd tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] 10.222.0.24 "PUT /v2.0/routers/8cbd7ad3-04d4-4ab0-b79f-a9a391f624b1/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.8623848 Nov 09 04:34:19.592850 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57852) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:19.593382 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ee85d426-ab28-434d-be89-d95259d5241b None None] Sync routers for ids ['8cbd7ad3-04d4-4ab0-b79f-a9a391f624b1'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:34:19.597705 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a9a7ec33-e564-4ea4-bf31-6a9f0bd0a335 None None] DHCP port deletion for 988d2354-693c-4d52-af17-25e0643eaa0c request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:34:19.603961 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cd533152-3b2a-4364-b572-2cbb416f46af tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:19.627286 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ee85d426-ab28-434d-be89-d95259d5241b None None] Routers {'8cbd7ad3-04d4-4ab0-b79f-a9a391f624b1'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:34:19.627921 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-ee85d426-ab28-434d-be89-d95259d5241b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:34:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8cbd7ad3-04d4-4ab0-b79f-a9a391f624b1'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:19.633515 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.api.v2.resource [None req-8dd00ac5-4494-4abd-a572-93abd59b93b7 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] show failed (client error): The resource could not be found. Nov 09 04:34:19.634655 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-8dd00ac5-4494-4abd-a572-93abd59b93b7 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] 10.222.0.24 "GET /v2.0/routers/tempest-non_exist_router-1266601152 HTTP/1.1" status: 404 len: 335 time: 0.0403857 Nov 09 04:34:19.638340 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57854) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:19.649714 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-57de5496-5c51-40b7-b520-b81b49623aac tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Request body: {'router': {'name': 'new_name'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:19.666651 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-ee85d426-ab28-434d-be89-d95259d5241b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:19.680345 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ee85d426-ab28-434d-be89-d95259d5241b None None] Routers {'8cbd7ad3-04d4-4ab0-b79f-a9a391f624b1'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:34:19.680956 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-ee85d426-ab28-434d-be89-d95259d5241b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:34:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8cbd7ad3-04d4-4ab0-b79f-a9a391f624b1'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:19.688388 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-af9976b1-da07-4f15-b4a7-7b5ebdc8c6d4 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "PUT /v2.0/routers/186c5198-7801-42c9-b497-8bb92f57d406/tags/tempest-TagsExtTest-Tag-1084296881 HTTP/1.1" status: 201 len: 201 time: 0.5193918 Nov 09 04:34:19.689841 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57856) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:19.690545 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-86744137-b63c-4be3-84f1-cc692cbd73a4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:19.695514 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-86744137-b63c-4be3-84f1-cc692cbd73a4 admin admin] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:19.699422 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-86744137-b63c-4be3-84f1-cc692cbd73a4 admin admin] 10.222.0.24 "DELETE /v2.0/networks/a270b61c-1f4f-4d97-be79-4a24c65fddc2 HTTP/1.1" status: 204 len: 168 time: 1.6861372 Nov 09 04:34:19.700328 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.api.v2.resource [None req-57de5496-5c51-40b7-b520-b81b49623aac tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] update failed (client error): The resource could not be found. Nov 09 04:34:19.701287 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-57de5496-5c51-40b7-b520-b81b49623aac tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] 10.222.0.24 "PUT /v2.0/routers/tempest-non_exist_router-1345626879 HTTP/1.1" status: 404 len: 335 time: 0.0617435 Nov 09 04:34:19.706583 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.tag.tag_plugin [None req-1e0b6885-cc83-443b-abb4-9ca7e6522ce8 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'subnetpools', 'f6fd139d-5736-40ad-a449-f302767d5f1c', 'tempest-TagsExtTest-Tag-1060328457') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:19.707422 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57860) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:19.721981 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-ee85d426-ab28-434d-be89-d95259d5241b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:19.722680 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ee85d426-ab28-434d-be89-d95259d5241b None None] The sync data for ids ['8cbd7ad3-04d4-4ab0-b79f-a9a391f624b1'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:34:19.730953 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-a9a7ec33-e564-4ea4-bf31-6a9f0bd0a335 None None] Deleting port 453bd95e-9a2c-476e-8e72-48e39cc947d1 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:34:19.731328 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a9a7ec33-e564-4ea4-bf31-6a9f0bd0a335 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:19.740356 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86744137-b63c-4be3-84f1-cc692cbd73a4 admin admin] Pushing event deleted for resources: {'Network': ['ID=a270b61c-1f4f-4d97-be79-4a24c65fddc2,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:19.787192 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-cd533152-3b2a-4364-b572-2cbb416f46af tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Allocated IP 172.26.0.195 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/1b39fe1f-a321-431c-bf9f-55139afcf0ad) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:34:19.803597 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-1e0b6885-cc83-443b-abb4-9ca7e6522ce8 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "PUT /v2.0/subnetpools/f6fd139d-5736-40ad-a449-f302767d5f1c/tags/tempest-TagsExtTest-Tag-1060328457 HTTP/1.1" status: 201 len: 201 time: 0.1009731 Nov 09 04:34:19.803888 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-cddfa2ef-bbf6-4241-ace0-7f4c3cee025d tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Deleting subnet a177571b-ddcb-47e3-a5b1-049189b20956 {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:34:19.804224 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57862) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:19.807791 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-a9a7ec33-e564-4ea4-bf31-6a9f0bd0a335 None None] For port 453bd95e-9a2c-476e-8e72-48e39cc947d1, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=453bd95e-9a2c-476e-8e72-48e39cc947d1,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:34:19.808189 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a9a7ec33-e564-4ea4-bf31-6a9f0bd0a335 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:19.809038 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.tag.tag_plugin [None req-78f85d37-c877-4a41-b206-927812a31444 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] neutron.services.tag.tag_plugin.TagPlugin method update_tags called with arguments (, 'subnets', '66cc5117-4268-433d-acab-66834cdb6f85', {'tags': ['tempest-TagsExtTest-Tag-2001485841', 'tempest-TagsExtTest-Tag-2084777378', 'tempest-TagsExtTest-Tag-1796457073']}) {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:19.811747 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cddfa2ef-bbf6-4241-ace0-7f4c3cee025d tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:19.828351 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-a9a7ec33-e564-4ea4-bf31-6a9f0bd0a335 None None] Calling delete_port for 453bd95e-9a2c-476e-8e72-48e39cc947d1 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:34:19.869831 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9c18beb3-89b7-458c-a9b1-a6da05de937e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:34:19.873487 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9c18beb3-89b7-458c-a9b1-a6da05de937e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:19.910177 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cddfa2ef-bbf6-4241-ace0-7f4c3cee025d tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:19.988893 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a9a7ec33-e564-4ea4-bf31-6a9f0bd0a335 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:19.992392 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-78f85d37-c877-4a41-b206-927812a31444 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "PUT /v2.0/subnets/66cc5117-4268-433d-acab-66834cdb6f85/tags HTTP/1.1" status: 200 len: 318 time: 0.1844447 Nov 09 04:34:19.994397 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57864) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:20.001233 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.tag.tag_plugin [None req-13cd25be-ab30-4a74-ba8f-c434640995d9 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'subnets', '66cc5117-4268-433d-acab-66834cdb6f85') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:20.019321 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9a7ec33-e564-4ea4-bf31-6a9f0bd0a335 None None] Pushing event deleted for resources: {'Port': ['ID=453bd95e-9a2c-476e-8e72-48e39cc947d1,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:20.023865 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a9a7ec33-e564-4ea4-bf31-6a9f0bd0a335 None None] No DVR routers for this DVR port 453bd95e-9a2c-476e-8e72-48e39cc947d1 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:34:20.030754 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9a7ec33-e564-4ea4-bf31-6a9f0bd0a335 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:20.031071 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9a7ec33-e564-4ea4-bf31-6a9f0bd0a335 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:20.031410 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9a7ec33-e564-4ea4-bf31-6a9f0bd0a335 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:20.031746 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9a7ec33-e564-4ea4-bf31-6a9f0bd0a335 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:20.032074 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9a7ec33-e564-4ea4-bf31-6a9f0bd0a335 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:20.036522 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9a7ec33-e564-4ea4-bf31-6a9f0bd0a335 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:20.036522 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9a7ec33-e564-4ea4-bf31-6a9f0bd0a335 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:20.036522 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9a7ec33-e564-4ea4-bf31-6a9f0bd0a335 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:20.036522 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9a7ec33-e564-4ea4-bf31-6a9f0bd0a335 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:20.036522 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9a7ec33-e564-4ea4-bf31-6a9f0bd0a335 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:20.036522 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9a7ec33-e564-4ea4-bf31-6a9f0bd0a335 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:20.036522 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9a7ec33-e564-4ea4-bf31-6a9f0bd0a335 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:20.088702 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cd533152-3b2a-4364-b572-2cbb416f46af tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:20.107711 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cddfa2ef-bbf6-4241-ace0-7f4c3cee025d tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:20.140900 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 5a469f60-d369-4f42-8796-f6357a453930 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:34:20.161656 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 5a469f60-d369-4f42-8796-f6357a453930 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:34:20.162000 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 5a469f60-d369-4f42-8796-f6357a453930 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:34:20.162444 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 453bd95e-9a2c-476e-8e72-48e39cc947d1 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:34:20.173212 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-13cd25be-ab30-4a74-ba8f-c434640995d9 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "DELETE /v2.0/subnets/66cc5117-4268-433d-acab-66834cdb6f85/tags HTTP/1.1" status: 204 len: 168 time: 0.1767340 Nov 09 04:34:20.175837 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57866) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:20.180847 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.tag.tag_plugin [None req-a683e18f-107d-4a5f-8748-a1c45b44257a tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnets', '66cc5117-4268-433d-acab-66834cdb6f85', 'tempest-TagsExtTest-Tag-2001485841') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:20.190486 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 453bd95e-9a2c-476e-8e72-48e39cc947d1 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:34:20.192795 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 453bd95e-9a2c-476e-8e72-48e39cc947d1 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:34:20.207453 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57868) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:20.276518 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-ecf9c181-1b73-4450-a16d-eb2e8a21cc7c admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=6015befde7f546d881cb247ae5bc81ae&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0678017 Nov 09 04:34:20.279382 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57870) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:20.288497 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.api.v2.resource [None req-a683e18f-107d-4a5f-8748-a1c45b44257a tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] show failed (client error): The resource could not be found. Nov 09 04:34:20.289868 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a683e18f-107d-4a5f-8748-a1c45b44257a tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "GET /v2.0/subnets/66cc5117-4268-433d-acab-66834cdb6f85/tags/tempest-TagsExtTest-Tag-2001485841 HTTP/1.1" status: 404 len: 329 time: 0.1126506 Nov 09 04:34:20.290102 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cd533152-3b2a-4364-b572-2cbb416f46af tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:20.292623 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57872) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:20.297041 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.tag.tag_plugin [None req-3d14b744-9bb2-4a01-969f-59dff4f7ed23 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnets', '66cc5117-4268-433d-acab-66834cdb6f85', 'tempest-TagsExtTest-Tag-2084777378') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:20.350279 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.api.v2.resource [None req-3d14b744-9bb2-4a01-969f-59dff4f7ed23 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] show failed (client error): The resource could not be found. Nov 09 04:34:20.354084 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-3d14b744-9bb2-4a01-969f-59dff4f7ed23 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "GET /v2.0/subnets/66cc5117-4268-433d-acab-66834cdb6f85/tags/tempest-TagsExtTest-Tag-2084777378 HTTP/1.1" status: 404 len: 329 time: 0.0577009 Nov 09 04:34:20.354299 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57874) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:20.358211 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cd533152-3b2a-4364-b572-2cbb416f46af tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:34:20.358775 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.tag.tag_plugin [None req-982d5edc-ca2e-4892-9b63-4097e43f4fd7 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnets', '66cc5117-4268-433d-acab-66834cdb6f85', 'tempest-TagsExtTest-Tag-1796457073') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:20.362125 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cddfa2ef-bbf6-4241-ace0-7f4c3cee025d tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:20.370094 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-cd533152-3b2a-4364-b572-2cbb416f46af tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:20.390740 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cd533152-3b2a-4364-b572-2cbb416f46af tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:34:20.398388 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd533152-3b2a-4364-b572-2cbb416f46af tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Port': ['ID=1b39fe1f-a321-431c-bf9f-55139afcf0ad,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:20.417147 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.api.v2.resource [None req-982d5edc-ca2e-4892-9b63-4097e43f4fd7 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] show failed (client error): The resource could not be found. Nov 09 04:34:20.418397 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-982d5edc-ca2e-4892-9b63-4097e43f4fd7 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "GET /v2.0/subnets/66cc5117-4268-433d-acab-66834cdb6f85/tags/tempest-TagsExtTest-Tag-1796457073 HTTP/1.1" status: 404 len: 329 time: 0.0631557 Nov 09 04:34:20.421490 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57876) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:20.425779 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9c18beb3-89b7-458c-a9b1-a6da05de937e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:20.426512 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.tag.tag_plugin [None req-a732e315-cb98-4b87-89dd-57d6a9bb20d3 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] neutron.services.tag.tag_plugin.TagPlugin method update_tags called with arguments (, 'ports', '595ae407-7cb5-4c2b-a4fa-9cb5b8c81a58', {'tags': ['tempest-TagsExtTest-Tag-1830715009', 'tempest-TagsExtTest-Tag-1415870526', 'tempest-TagsExtTest-Tag-386422940']}) {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:20.427558 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cddfa2ef-bbf6-4241-ace0-7f4c3cee025d tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Pushing event deleted for resources: {'Subnet': ['ID=a177571b-ddcb-47e3-a5b1-049189b20956,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:20.460266 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cddfa2ef-bbf6-4241-ace0-7f4c3cee025d tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:20.460415 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6a8e52b6-c885-4f9b-8fc6-74c7cefc24fb None None] Network f7f6f298-5e2f-43a9-abfe-13a440ef4798 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:34:20.461419 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-cddfa2ef-bbf6-4241-ace0-7f4c3cee025d tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] 10.222.0.24 "DELETE /v2.0/subnets/a177571b-ddcb-47e3-a5b1-049189b20956 HTTP/1.1" status: 204 len: 168 time: 0.7530236 Nov 09 04:34:20.462960 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd533152-3b2a-4364-b572-2cbb416f46af tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:20.463306 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd533152-3b2a-4364-b572-2cbb416f46af tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:20.463639 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd533152-3b2a-4364-b572-2cbb416f46af tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:20.463967 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd533152-3b2a-4364-b572-2cbb416f46af tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:20.464297 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd533152-3b2a-4364-b572-2cbb416f46af tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:20.464621 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd533152-3b2a-4364-b572-2cbb416f46af tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:20.464942 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd533152-3b2a-4364-b572-2cbb416f46af tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:20.465260 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd533152-3b2a-4364-b572-2cbb416f46af tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:20.465584 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd533152-3b2a-4364-b572-2cbb416f46af tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:20.465902 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd533152-3b2a-4364-b572-2cbb416f46af tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:20.466033 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57878) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:20.466215 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd533152-3b2a-4364-b572-2cbb416f46af tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:20.466557 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd533152-3b2a-4364-b572-2cbb416f46af tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:20.470144 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cddfa2ef-bbf6-4241-ace0-7f4c3cee025d tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:20.471045 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cddfa2ef-bbf6-4241-ace0-7f4c3cee025d tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:20.471381 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cddfa2ef-bbf6-4241-ace0-7f4c3cee025d tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:20.471980 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cddfa2ef-bbf6-4241-ace0-7f4c3cee025d tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:20.472287 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cddfa2ef-bbf6-4241-ace0-7f4c3cee025d tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:20.472610 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cddfa2ef-bbf6-4241-ace0-7f4c3cee025d tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:20.472931 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cddfa2ef-bbf6-4241-ace0-7f4c3cee025d tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:20.473331 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cddfa2ef-bbf6-4241-ace0-7f4c3cee025d tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:20.473569 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cddfa2ef-bbf6-4241-ace0-7f4c3cee025d tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:20.473886 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cddfa2ef-bbf6-4241-ace0-7f4c3cee025d tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:20.474203 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cddfa2ef-bbf6-4241-ace0-7f4c3cee025d tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:20.474703 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cddfa2ef-bbf6-4241-ace0-7f4c3cee025d tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:20.481143 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f0a1f98d-f627-46e0-a425-5e362027a685 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:20.524608 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9c18beb3-89b7-458c-a9b1-a6da05de937e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:34:20.539530 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-9c18beb3-89b7-458c-a9b1-a6da05de937e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:20.561076 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-60a56bc5-018b-40b7-aed7-ceb33c012fc6 None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:34:20.563073 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f0a1f98d-f627-46e0-a425-5e362027a685 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:20.567828 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9c18beb3-89b7-458c-a9b1-a6da05de937e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:20.567828 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9c18beb3-89b7-458c-a9b1-a6da05de937e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:20.568144 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0d24c3c2-3ee1-4271-9c1f-0b0e33d06804 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:20.626017 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c18beb3-89b7-458c-a9b1-a6da05de937e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Subnet': ['ID=130970a8-ae23-4805-a6d6-fd396bb5daaa,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:20.630285 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a732e315-cb98-4b87-89dd-57d6a9bb20d3 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "PUT /v2.0/ports/595ae407-7cb5-4c2b-a4fa-9cb5b8c81a58/tags HTTP/1.1" status: 200 len: 317 time: 0.2046728 Nov 09 04:34:20.630285 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57880) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:20.643060 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.tag.tag_plugin [None req-610ee099-3aae-4177-b7a9-d4b00cfcb2ad tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'ports', '595ae407-7cb5-4c2b-a4fa-9cb5b8c81a58') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:20.650797 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-0d24c3c2-3ee1-4271-9c1f-0b0e33d06804 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Deleting port 88ea1e96-420b-4cd6-8d44-c8c72705e096 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:34:20.651317 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0d24c3c2-3ee1-4271-9c1f-0b0e33d06804 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:20.655454 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-9c18beb3-89b7-458c-a9b1-a6da05de937e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 1.7696922 Nov 09 04:34:20.663619 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57882) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:20.676770 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-2803ed72-f789-4721-9677-151c15a9afe4 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'subnet': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:20.758557 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-0d24c3c2-3ee1-4271-9c1f-0b0e33d06804 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] For port 88ea1e96-420b-4cd6-8d44-c8c72705e096, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=88ea1e96-420b-4cd6-8d44-c8c72705e096,segment=NetworkSegment(79435fa1-8c80-4d01-8972-9d589024c286),segment_id=79435fa1-8c80-4d01-8972-9d589024c286)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:34:20.758953 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0d24c3c2-3ee1-4271-9c1f-0b0e33d06804 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:20.779751 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-0d24c3c2-3ee1-4271-9c1f-0b0e33d06804 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Calling delete_port for 88ea1e96-420b-4cd6-8d44-c8c72705e096 owned by network:dhcp {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:34:20.884115 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f0a1f98d-f627-46e0-a425-5e362027a685 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:20.886831 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f0a1f98d-f627-46e0-a425-5e362027a685 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:20.888213 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-f0a1f98d-f627-46e0-a425-5e362027a685 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/166c208c-5f61-4202-822a-ffd40396dd80 HTTP/1.1" status: 204 len: 168 time: 0.6065764 Nov 09 04:34:20.889134 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-58b46d64-4247-4f95-a48b-c87e9b1e741d None None] DHCP port deletion for f7f6f298-5e2f-43a9-abfe-13a440ef4798 request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:34:20.915510 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0a1f98d-f627-46e0-a425-5e362027a685 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=166c208c-5f61-4202-822a-ffd40396dd80,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:20.972965 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-610ee099-3aae-4177-b7a9-d4b00cfcb2ad tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "DELETE /v2.0/ports/595ae407-7cb5-4c2b-a4fa-9cb5b8c81a58/tags HTTP/1.1" status: 204 len: 168 time: 0.3341019 Nov 09 04:34:20.975573 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57886) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:20.979882 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.tag.tag_plugin [None req-437cc1f4-a363-460d-811a-42bbea39bc6e tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'ports', '595ae407-7cb5-4c2b-a4fa-9cb5b8c81a58', 'tempest-TagsExtTest-Tag-1830715009') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:20.981395 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4137a032-2a5c-45dc-9e16-858c53bd9280 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-988d2354-693c-4d52-af17-25e0643eaa0c', 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'tenant_id': '8b0758f781884982bf5b94e6609237f6', 'fixed_ips': [{'subnet_id': '130970a8-ae23-4805-a6d6-fd396bb5daaa'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:34:20.982326 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4137a032-2a5c-45dc-9e16-858c53bd9280 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:21.003608 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-58b46d64-4247-4f95-a48b-c87e9b1e741d None None] Deleting port 88ea1e96-420b-4cd6-8d44-c8c72705e096 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:34:21.003972 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-58b46d64-4247-4f95-a48b-c87e9b1e741d None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:21.005214 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0d24c3c2-3ee1-4271-9c1f-0b0e33d06804 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:21.022746 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2803ed72-f789-4721-9677-151c15a9afe4 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:34:21.026922 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2803ed72-f789-4721-9677-151c15a9afe4 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:21.036993 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d24c3c2-3ee1-4271-9c1f-0b0e33d06804 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Pushing event deleted for resources: {'Port': ['ID=88ea1e96-420b-4cd6-8d44-c8c72705e096,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:21.044514 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0d24c3c2-3ee1-4271-9c1f-0b0e33d06804 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] No DVR routers for this DVR port 88ea1e96-420b-4cd6-8d44-c8c72705e096 on host dv-neutron-816802-2-hyperv {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:34:21.061803 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d24c3c2-3ee1-4271-9c1f-0b0e33d06804 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:21.062455 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d24c3c2-3ee1-4271-9c1f-0b0e33d06804 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:21.062952 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d24c3c2-3ee1-4271-9c1f-0b0e33d06804 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:21.063443 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d24c3c2-3ee1-4271-9c1f-0b0e33d06804 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:21.064455 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d24c3c2-3ee1-4271-9c1f-0b0e33d06804 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:21.064944 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d24c3c2-3ee1-4271-9c1f-0b0e33d06804 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:21.065446 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d24c3c2-3ee1-4271-9c1f-0b0e33d06804 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:21.065927 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d24c3c2-3ee1-4271-9c1f-0b0e33d06804 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:21.066472 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d24c3c2-3ee1-4271-9c1f-0b0e33d06804 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:21.066959 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d24c3c2-3ee1-4271-9c1f-0b0e33d06804 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:21.067453 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d24c3c2-3ee1-4271-9c1f-0b0e33d06804 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:21.067921 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d24c3c2-3ee1-4271-9c1f-0b0e33d06804 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:21.138172 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-58b46d64-4247-4f95-a48b-c87e9b1e741d None None] For port 88ea1e96-420b-4cd6-8d44-c8c72705e096, host dv-neutron-816802-2-hyperv, got binding levels [] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:34:21.138672 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-58b46d64-4247-4f95-a48b-c87e9b1e741d None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:21.165162 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.api.v2.resource [None req-437cc1f4-a363-460d-811a-42bbea39bc6e tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] show failed (client error): The resource could not be found. Nov 09 04:34:21.166505 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-437cc1f4-a363-460d-811a-42bbea39bc6e tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "GET /v2.0/ports/595ae407-7cb5-4c2b-a4fa-9cb5b8c81a58/tags/tempest-TagsExtTest-Tag-1830715009 HTTP/1.1" status: 404 len: 329 time: 0.1899817 Nov 09 04:34:21.168581 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0d24c3c2-3ee1-4271-9c1f-0b0e33d06804 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:21.172507 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57888) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:21.177629 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.tag.tag_plugin [None req-d1cf4755-f109-4fd8-b24e-6ff8ea7ae8a7 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'ports', '595ae407-7cb5-4c2b-a4fa-9cb5b8c81a58', 'tempest-TagsExtTest-Tag-1415870526') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:21.183654 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-58b46d64-4247-4f95-a48b-c87e9b1e741d None None] Calling delete_port for 88ea1e96-420b-4cd6-8d44-c8c72705e096 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:34:21.187593 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.ipam_backend_mixin [None req-58b46d64-4247-4f95-a48b-c87e9b1e741d None None] Port 88ea1e96-420b-4cd6-8d44-c8c72705e096 was not found and therefore no delete operation was performed {{(pid=102163) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Nov 09 04:34:21.192373 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-58b46d64-4247-4f95-a48b-c87e9b1e741d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:21.197279 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-0d24c3c2-3ee1-4271-9c1f-0b0e33d06804 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f7f6f298-5e2f-43a9-abfe-13a440ef4798']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:21.208302 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-0d24c3c2-3ee1-4271-9c1f-0b0e33d06804 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '79435fa1-8c80-4d01-8972-9d589024c286') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:21.208817 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-0d24c3c2-3ee1-4271-9c1f-0b0e33d06804 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '79435fa1-8c80-4d01-8972-9d589024c286') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:21.220087 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0d24c3c2-3ee1-4271-9c1f-0b0e33d06804 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:21.233441 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58b46d64-4247-4f95-a48b-c87e9b1e741d None None] Pushing event deleted for resources: {'Port': ['ID=88ea1e96-420b-4cd6-8d44-c8c72705e096,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:21.237283 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-4137a032-2a5c-45dc-9e16-858c53bd9280 None None] Allocated IP 2001:db8::2 (988d2354-693c-4d52-af17-25e0643eaa0c/130970a8-ae23-4805-a6d6-fd396bb5daaa/81841961-1f66-4bbf-ab3a-2646a1326e8d) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:34:21.241634 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-58b46d64-4247-4f95-a48b-c87e9b1e741d None None] No DVR routers for this DVR port 88ea1e96-420b-4cd6-8d44-c8c72705e096 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:34:21.241818 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0d24c3c2-3ee1-4271-9c1f-0b0e33d06804 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:21.250800 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-0d24c3c2-3ee1-4271-9c1f-0b0e33d06804 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Releasing vlan 318 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:34:21.251342 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0d24c3c2-3ee1-4271-9c1f-0b0e33d06804 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:21.263076 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:34:21.263076 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:34:21.263076 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:34:21.263076 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:34:21.263076 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:34:21.263076 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:34:21.263076 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:34:21.263076 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:34:21.263076 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:34:21.263076 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:34:21.263076 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:34:21.263076 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:34:21.263076 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:34:21.263076 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:34:21.263076 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:34:21.263076 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:34:21.263076 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:34:21.263076 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:34:21.263076 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:34:21.263076 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:34:21.263076 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:34:21.263076 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:34:21.263076 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:34:21.263076 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:34:21.263076 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:34:21.263076 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:34:21.263076 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:34:21.263076 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:34:21.263076 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:34:21.263076 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:34:21.263076 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:34:21.263076 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:34:21.418933 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0d24c3c2-3ee1-4271-9c1f-0b0e33d06804 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:21.427848 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0d24c3c2-3ee1-4271-9c1f-0b0e33d06804 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:21.433015 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-0d24c3c2-3ee1-4271-9c1f-0b0e33d06804 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] 10.222.0.24 "DELETE /v2.0/networks/f7f6f298-5e2f-43a9-abfe-13a440ef4798 HTTP/1.1" status: 204 len: 168 time: 0.9660256 Nov 09 04:34:21.435959 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57894) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:21.451139 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4137a032-2a5c-45dc-9e16-858c53bd9280 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:21.485338 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d24c3c2-3ee1-4271-9c1f-0b0e33d06804 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Pushing event deleted for resources: {'Network': ['ID=f7f6f298-5e2f-43a9-abfe-13a440ef4798,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:21.516683 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-4ef90ce2-f648-4cd9-b6f5-e4c6e3ef9d48 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Deleting subnet 208f4c7d-90b6-44e7-97a6-2058bc750a4e {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:34:21.520534 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4ef90ce2-f648-4cd9-b6f5-e4c6e3ef9d48 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:21.520710 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4137a032-2a5c-45dc-9e16-858c53bd9280 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:21.559002 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4137a032-2a5c-45dc-9e16-858c53bd9280 None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:34:21.564909 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-4137a032-2a5c-45dc-9e16-858c53bd9280 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:21.568656 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4137a032-2a5c-45dc-9e16-858c53bd9280 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:34:21.569771 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4ef90ce2-f648-4cd9-b6f5-e4c6e3ef9d48 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:21.575863 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4137a032-2a5c-45dc-9e16-858c53bd9280 None None] Pushing event updated for resources: {'Port': ['ID=81841961-1f66-4bbf-ab3a-2646a1326e8d,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:21.633218 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-4137a032-2a5c-45dc-9e16-858c53bd9280 None None] Attempting to bind port 81841961-1f66-4bbf-ab3a-2646a1326e8d on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:34:21.633647 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-4137a032-2a5c-45dc-9e16-858c53bd9280 None None] Attempting to bind port 81841961-1f66-4bbf-ab3a-2646a1326e8d by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:34:21.634110 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4137a032-2a5c-45dc-9e16-858c53bd9280 None None] Attempting to bind port 81841961-1f66-4bbf-ab3a-2646a1326e8d on network 988d2354-693c-4d52-af17-25e0643eaa0c {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:34:21.645231 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4137a032-2a5c-45dc-9e16-858c53bd9280 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 34, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:34:21.645939 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4137a032-2a5c-45dc-9e16-858c53bd9280 None None] Checking segment: {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:34:21.646583 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4137a032-2a5c-45dc-9e16-858c53bd9280 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:21.647157 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4137a032-2a5c-45dc-9e16-858c53bd9280 None None] Bound using segment: {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:34:21.647853 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-4137a032-2a5c-45dc-9e16-858c53bd9280 None None] Bound port: 81841961-1f66-4bbf-ab3a-2646a1326e8d, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'af4cde93-bd96-45fc-bfc1-9d70f48450dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:34:21.648421 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4137a032-2a5c-45dc-9e16-858c53bd9280 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:21.671873 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.ipam_backend_mixin [None req-2803ed72-f789-4721-9677-151c15a9afe4 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet 130970a8-ae23-4805-a6d6-fd396bb5daaa (CIDR: 2001:db8::/64) Nov 09 04:34:21.693185 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-d1cf4755-f109-4fd8-b24e-6ff8ea7ae8a7 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] show failed (client error): The resource could not be found. Nov 09 04:34:21.694182 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-d1cf4755-f109-4fd8-b24e-6ff8ea7ae8a7 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "GET /v2.0/ports/595ae407-7cb5-4c2b-a4fa-9cb5b8c81a58/tags/tempest-TagsExtTest-Tag-1415870526 HTTP/1.1" status: 404 len: 329 time: 0.5199721 Nov 09 04:34:21.697232 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57902) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:21.700963 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4ef90ce2-f648-4cd9-b6f5-e4c6e3ef9d48 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:21.701490 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.tag.tag_plugin [None req-9c01c4af-6776-4d16-83fa-783978e6e7e1 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'ports', '595ae407-7cb5-4c2b-a4fa-9cb5b8c81a58', 'tempest-TagsExtTest-Tag-386422940') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:21.706415 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cd533152-3b2a-4364-b572-2cbb416f46af tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:21.722977 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-4137a032-2a5c-45dc-9e16-858c53bd9280 None None] For port 81841961-1f66-4bbf-ab3a-2646a1326e8d, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:34:21.726376 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-4137a032-2a5c-45dc-9e16-858c53bd9280 None None] For port 81841961-1f66-4bbf-ab3a-2646a1326e8d, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=81841961-1f66-4bbf-ab3a-2646a1326e8d,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:34:21.765746 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-2803ed72-f789-4721-9677-151c15a9afe4 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:34:21.766230 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2803ed72-f789-4721-9677-151c15a9afe4 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:21.806046 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4137a032-2a5c-45dc-9e16-858c53bd9280 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:21.832716 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-9c01c4af-6776-4d16-83fa-783978e6e7e1 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] show failed (client error): The resource could not be found. Nov 09 04:34:21.834133 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-9c01c4af-6776-4d16-83fa-783978e6e7e1 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "GET /v2.0/ports/595ae407-7cb5-4c2b-a4fa-9cb5b8c81a58/tags/tempest-TagsExtTest-Tag-386422940 HTTP/1.1" status: 404 len: 328 time: 0.1356428 Nov 09 04:34:21.836757 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57904) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:21.842302 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.tag.tag_plugin [None req-697733d7-dbec-43be-97d7-227dde5f0c10 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] neutron.services.tag.tag_plugin.TagPlugin method update_tags called with arguments (, 'routers', '186c5198-7801-42c9-b497-8bb92f57d406', {'tags': ['tempest-TagsExtTest-Tag-1218121559', 'tempest-TagsExtTest-Tag-1325489937', 'tempest-TagsExtTest-Tag-1771700146']}) {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:21.858466 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4ef90ce2-f648-4cd9-b6f5-e4c6e3ef9d48 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:21.875422 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4137a032-2a5c-45dc-9e16-858c53bd9280 None None] Pushing event updated for resources: {'Port': ['ID=81841961-1f66-4bbf-ab3a-2646a1326e8d,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:21.902077 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4ef90ce2-f648-4cd9-b6f5-e4c6e3ef9d48 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:21.907202 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d57a1d12-e86c-44dc-bdbe-f5a083e70cb3 None None] Network fc71b887-9046-44cb-986d-dfe03d43967a requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:34:21.912842 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-4ef90ce2-f648-4cd9-b6f5-e4c6e3ef9d48 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] 10.222.0.24 "DELETE /v2.0/subnets/208f4c7d-90b6-44e7-97a6-2058bc750a4e HTTP/1.1" status: 204 len: 168 time: 0.4738019 Nov 09 04:34:21.912842 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57908) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:21.921561 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ef90ce2-f648-4cd9-b6f5-e4c6e3ef9d48 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Pushing event deleted for resources: {'Subnet': ['ID=208f4c7d-90b6-44e7-97a6-2058bc750a4e,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:21.941347 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-2803ed72-f789-4721-9677-151c15a9afe4 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 1.2740645 Nov 09 04:34:21.944012 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57910) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:21.954212 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-81409bbe-e6a2-430d-80f6-c5b632bee6f2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'subnet': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:21.988546 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-a1eb70f7-6265-44c0-81e6-f199f8e31287 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Deleting subnet bfa23843-d391-4e3a-a6ff-c61b1d3fa13b {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:34:21.992743 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a1eb70f7-6265-44c0-81e6-f199f8e31287 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:22.038006 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cd533152-3b2a-4364-b572-2cbb416f46af tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:22.047095 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a1eb70f7-6265-44c0-81e6-f199f8e31287 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:22.110148 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-697733d7-dbec-43be-97d7-227dde5f0c10 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "PUT /v2.0/routers/186c5198-7801-42c9-b497-8bb92f57d406/tags HTTP/1.1" status: 200 len: 318 time: 0.2721243 Nov 09 04:34:22.120620 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57916) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:22.125243 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.tag.tag_plugin [None req-5154c3ac-35f7-421b-84b3-23980487e3ff tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'routers', '186c5198-7801-42c9-b497-8bb92f57d406') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:22.245132 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a1eb70f7-6265-44c0-81e6-f199f8e31287 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:22.264607 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 88ea1e96-420b-4cd6-8d44-c8c72705e096 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:34:22.307824 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 88ea1e96-420b-4cd6-8d44-c8c72705e096 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:34:22.308408 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 88ea1e96-420b-4cd6-8d44-c8c72705e096 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:34:22.347812 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8efe4247-52cc-425e-b5ca-c1ff4c3ad223 None None] DHCP port deletion for fc71b887-9046-44cb-986d-dfe03d43967a request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:34:22.373935 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-81409bbe-e6a2-430d-80f6-c5b632bee6f2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:34:22.377420 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-81409bbe-e6a2-430d-80f6-c5b632bee6f2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:22.421634 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-8efe4247-52cc-425e-b5ca-c1ff4c3ad223 None None] Deleting port 3c324982-d7b8-4a65-9614-579eaad5ada7 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:34:22.422028 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8efe4247-52cc-425e-b5ca-c1ff4c3ad223 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:22.426750 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cd533152-3b2a-4364-b572-2cbb416f46af tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:22.434615 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-5154c3ac-35f7-421b-84b3-23980487e3ff tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "DELETE /v2.0/routers/186c5198-7801-42c9-b497-8bb92f57d406/tags HTTP/1.1" status: 204 len: 168 time: 0.3103507 Nov 09 04:34:22.436371 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57920) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:22.436523 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a1eb70f7-6265-44c0-81e6-f199f8e31287 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:22.440013 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.tag.tag_plugin [None req-4df4f21c-80d1-40c6-94eb-7b667c18d1fe tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'routers', '186c5198-7801-42c9-b497-8bb92f57d406', 'tempest-TagsExtTest-Tag-1218121559') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:22.486807 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a1eb70f7-6265-44c0-81e6-f199f8e31287 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:22.492784 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a1eb70f7-6265-44c0-81e6-f199f8e31287 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] 10.222.0.24 "DELETE /v2.0/subnets/bfa23843-d391-4e3a-a6ff-c61b1d3fa13b HTTP/1.1" status: 204 len: 168 time: 0.5791900 Nov 09 04:34:22.493587 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fbeef4ac-27ae-437c-9574-3dcb7dc556c3 None None] Network 6d014a7c-bf55-403c-8b12-11032e94df30 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:34:22.495595 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57922) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:22.496297 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57924) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:22.497449 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1eb70f7-6265-44c0-81e6-f199f8e31287 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Pushing event deleted for resources: {'Subnet': ['ID=bfa23843-d391-4e3a-a6ff-c61b1d3fa13b,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:22.531272 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-8efe4247-52cc-425e-b5ca-c1ff4c3ad223 None None] For port 3c324982-d7b8-4a65-9614-579eaad5ada7, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=3c324982-d7b8-4a65-9614-579eaad5ada7,segment=NetworkSegment(01c8e428-6cb4-4160-9a48-6a294a0d7cc0),segment_id=01c8e428-6cb4-4160-9a48-6a294a0d7cc0)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:34:22.531737 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8efe4247-52cc-425e-b5ca-c1ff4c3ad223 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:22.547957 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cd533152-3b2a-4364-b572-2cbb416f46af tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:22.617519 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-4df4f21c-80d1-40c6-94eb-7b667c18d1fe tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] show failed (client error): The resource could not be found. Nov 09 04:34:22.619320 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-4df4f21c-80d1-40c6-94eb-7b667c18d1fe tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "GET /v2.0/routers/186c5198-7801-42c9-b497-8bb92f57d406/tags/tempest-TagsExtTest-Tag-1218121559 HTTP/1.1" status: 404 len: 329 time: 0.1834788 Nov 09 04:34:22.622681 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57928) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:22.629099 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.tag.tag_plugin [None req-9feb6f3f-92e4-4727-a713-a24042d50fcc tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'routers', '186c5198-7801-42c9-b497-8bb92f57d406', 'tempest-TagsExtTest-Tag-1325489937') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:22.631353 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-8efe4247-52cc-425e-b5ca-c1ff4c3ad223 None None] Calling delete_port for 3c324982-d7b8-4a65-9614-579eaad5ada7 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:34:22.676235 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd533152-3b2a-4364-b572-2cbb416f46af tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Port': ['ID=1b39fe1f-a321-431c-bf9f-55139afcf0ad,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:22.692122 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a92676f3-1e66-4e39-8afc-9c0be6518cdb tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:22.696857 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cd533152-3b2a-4364-b572-2cbb416f46af tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:22.699604 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-a271035c-8df1-4822-8e1b-d1053d760fc8 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Request body: {'network': {'name': 'tempest-ExtraDHCPOptionsIpV6TestJSON-test-network-1361384705'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:22.803125 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.api.v2.resource [None req-9feb6f3f-92e4-4727-a713-a24042d50fcc tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] show failed (client error): The resource could not be found. Nov 09 04:34:22.807424 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-9feb6f3f-92e4-4727-a713-a24042d50fcc tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "GET /v2.0/routers/186c5198-7801-42c9-b497-8bb92f57d406/tags/tempest-TagsExtTest-Tag-1325489937 HTTP/1.1" status: 404 len: 329 time: 0.1803312 Nov 09 04:34:22.808518 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57930) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:22.813868 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.tag.tag_plugin [None req-88c78b3d-9db3-4113-9f1d-0dc37efcef56 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'routers', '186c5198-7801-42c9-b497-8bb92f57d406', 'tempest-TagsExtTest-Tag-1771700146') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:22.835029 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8efe4247-52cc-425e-b5ca-c1ff4c3ad223 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:22.842597 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5210c3bf-c669-487a-9c6d-f8e8c654c6c7 None None] DHCP port deletion for 6d014a7c-bf55-403c-8b12-11032e94df30 request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:34:22.859112 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a271035c-8df1-4822-8e1b-d1053d760fc8 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Made reservation on behalf of 429a0ccbae244e9e9e6fbb93c166fa74 for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:34:22.863474 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a271035c-8df1-4822-8e1b-d1053d760fc8 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:22.873140 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8efe4247-52cc-425e-b5ca-c1ff4c3ad223 None None] Pushing event deleted for resources: {'Port': ['ID=3c324982-d7b8-4a65-9614-579eaad5ada7,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:22.881212 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.l3_db [None req-cd533152-3b2a-4364-b572-2cbb416f46af tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Floating IP 071d456d-45c8-43d6-9154-8dc9c2df29f2 associated. External IP: 172.26.0.195, port: 09cbfb91-4118-43af-8b70-41d8d4265574. Nov 09 04:34:22.903925 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a271035c-8df1-4822-8e1b-d1053d760fc8 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:22.924746 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8efe4247-52cc-425e-b5ca-c1ff4c3ad223 None None] No DVR routers for this DVR port 3c324982-d7b8-4a65-9614-579eaad5ada7 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:34:22.931294 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-a92676f3-1e66-4e39-8afc-9c0be6518cdb tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Deleting port 3c324982-d7b8-4a65-9614-579eaad5ada7 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:34:22.931798 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a92676f3-1e66-4e39-8afc-9c0be6518cdb tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:22.951469 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.api.v2.resource [None req-88c78b3d-9db3-4113-9f1d-0dc37efcef56 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] show failed (client error): The resource could not be found. Nov 09 04:34:22.952668 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-88c78b3d-9db3-4113-9f1d-0dc37efcef56 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "GET /v2.0/routers/186c5198-7801-42c9-b497-8bb92f57d406/tags/tempest-TagsExtTest-Tag-1771700146 HTTP/1.1" status: 404 len: 329 time: 0.1424220 Nov 09 04:34:22.961473 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57932) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:22.968195 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.tag.tag_plugin [None req-71b456f2-b8fa-4c14-bb37-eb6b96e38077 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] neutron.services.tag.tag_plugin.TagPlugin method update_tags called with arguments (, 'subnetpools', 'f6fd139d-5736-40ad-a449-f302767d5f1c', {'tags': ['tempest-TagsExtTest-Tag-876879100', 'tempest-TagsExtTest-Tag-1385604483', 'tempest-TagsExtTest-Tag-971114219']}) {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:22.971910 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-5210c3bf-c669-487a-9c6d-f8e8c654c6c7 None None] Deleting port 534ec346-6b5d-44cb-9cb1-654cb2217ed5 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:34:22.972465 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5210c3bf-c669-487a-9c6d-f8e8c654c6c7 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:23.057209 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-a92676f3-1e66-4e39-8afc-9c0be6518cdb tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] For port 3c324982-d7b8-4a65-9614-579eaad5ada7, host dv-neutron-816802-2-hyperv, got binding levels [] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:34:23.057209 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a92676f3-1e66-4e39-8afc-9c0be6518cdb tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:23.059634 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-5210c3bf-c669-487a-9c6d-f8e8c654c6c7 None None] For port 534ec346-6b5d-44cb-9cb1-654cb2217ed5, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=534ec346-6b5d-44cb-9cb1-654cb2217ed5,segment=NetworkSegment(addb7209-a504-42b8-926e-099777f05856),segment_id=addb7209-a504-42b8-926e-099777f05856)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:34:23.059634 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5210c3bf-c669-487a-9c6d-f8e8c654c6c7 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:23.074443 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-5210c3bf-c669-487a-9c6d-f8e8c654c6c7 None None] Calling delete_port for 534ec346-6b5d-44cb-9cb1-654cb2217ed5 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:34:23.089977 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-a92676f3-1e66-4e39-8afc-9c0be6518cdb tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Calling delete_port for 3c324982-d7b8-4a65-9614-579eaad5ada7 owned by network:dhcp {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:34:23.098342 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.ipam_backend_mixin [None req-a92676f3-1e66-4e39-8afc-9c0be6518cdb tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Port 3c324982-d7b8-4a65-9614-579eaad5ada7 was not found and therefore no delete operation was performed {{(pid=102162) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Nov 09 04:34:23.103667 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a92676f3-1e66-4e39-8afc-9c0be6518cdb tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:23.138185 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a92676f3-1e66-4e39-8afc-9c0be6518cdb tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Pushing event deleted for resources: {'Port': ['ID=3c324982-d7b8-4a65-9614-579eaad5ada7,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:23.159326 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a92676f3-1e66-4e39-8afc-9c0be6518cdb tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] No DVR routers for this DVR port 3c324982-d7b8-4a65-9614-579eaad5ada7 on host dv-neutron-816802-2-hyperv {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:34:23.165681 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-71b456f2-b8fa-4c14-bb37-eb6b96e38077 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "PUT /v2.0/subnetpools/f6fd139d-5736-40ad-a449-f302767d5f1c/tags HTTP/1.1" status: 200 len: 316 time: 0.2030380 Nov 09 04:34:23.169019 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57934) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:23.195023 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.tag.tag_plugin [None req-f77db06e-351c-491a-a062-ef47f7d46c30 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'subnetpools', 'f6fd139d-5736-40ad-a449-f302767d5f1c') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:23.199067 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.objects.ports [None req-81409bbe-e6a2-430d-80f6-c5b632bee6f2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=102161) get_objects /opt/stack/neutron/neutron/objects/ports.py:444}} Nov 09 04:34:23.216216 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a271035c-8df1-4822-8e1b-d1053d760fc8 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:23.257326 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5210c3bf-c669-487a-9c6d-f8e8c654c6c7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:23.284679 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cd533152-3b2a-4364-b572-2cbb416f46af tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Router d05416c2-0293-4ef5-a6e3-5968392cc774 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:34:23.285925 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a92676f3-1e66-4e39-8afc-9c0be6518cdb tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:23.290076 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a271035c-8df1-4822-8e1b-d1053d760fc8 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:23.297046 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5210c3bf-c669-487a-9c6d-f8e8c654c6c7 None None] Pushing event deleted for resources: {'Port': ['ID=534ec346-6b5d-44cb-9cb1-654cb2217ed5,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:23.316415 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5210c3bf-c669-487a-9c6d-f8e8c654c6c7 None None] No DVR routers for this DVR port 534ec346-6b5d-44cb-9cb1-654cb2217ed5 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:34:23.338166 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a271035c-8df1-4822-8e1b-d1053d760fc8 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 307} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:34:23.344732 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-a92676f3-1e66-4e39-8afc-9c0be6518cdb tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['fc71b887-9046-44cb-986d-dfe03d43967a']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:23.366527 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-a92676f3-1e66-4e39-8afc-9c0be6518cdb tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '01c8e428-6cb4-4160-9a48-6a294a0d7cc0') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:23.366823 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-a92676f3-1e66-4e39-8afc-9c0be6518cdb tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '01c8e428-6cb4-4160-9a48-6a294a0d7cc0') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:23.372770 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a271035c-8df1-4822-8e1b-d1053d760fc8 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:23.373107 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-a271035c-8df1-4822-8e1b-d1053d760fc8 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Added segment 71d738f6-3812-4ad6-9cb8-aaf5a45f2bed of type vlan for network f3dca0a2-23fd-4413-908c-1d1ce4534d2d Nov 09 04:34:23.390118 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a92676f3-1e66-4e39-8afc-9c0be6518cdb tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:23.391858 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a271035c-8df1-4822-8e1b-d1053d760fc8 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Pushing event updated for resources: {'SecurityGroup': ['ID=13c59785-4472-47c7-b5dc-01d925b85b05,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:23.435918 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-f77db06e-351c-491a-a062-ef47f7d46c30 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "DELETE /v2.0/subnetpools/f6fd139d-5736-40ad-a449-f302767d5f1c/tags HTTP/1.1" status: 204 len: 168 time: 0.2658889 Nov 09 04:34:23.439419 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57936) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:23.440195 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a92676f3-1e66-4e39-8afc-9c0be6518cdb tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:23.443866 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a271035c-8df1-4822-8e1b-d1053d760fc8 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:23.446837 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.tag.tag_plugin [None req-a0e210c6-2f3d-402c-a256-df859d311242 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnetpools', 'f6fd139d-5736-40ad-a449-f302767d5f1c', 'tempest-TagsExtTest-Tag-876879100') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:23.452237 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a92676f3-1e66-4e39-8afc-9c0be6518cdb tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Releasing vlan 310 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:34:23.452643 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a92676f3-1e66-4e39-8afc-9c0be6518cdb tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:23.456338 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:34:23.456338 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:34:23.456338 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:34:23.456338 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:34:23.456338 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:34:23.456338 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:34:23.456338 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:34:23.456338 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:34:23.456338 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:34:23.456338 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:34:23.456338 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:34:23.456338 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:34:23.456338 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:34:23.456338 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:34:23.456338 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:34:23.456338 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:34:23.456338 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:34:23.456338 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:34:23.456338 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:34:23.456338 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:34:23.456338 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:34:23.456338 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:34:23.456338 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:34:23.456338 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:34:23.456338 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:34:23.456338 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:34:23.456338 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:34:23.456338 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:34:23.456338 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:34:23.456338 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:34:23.456338 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:34:23.456338 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:34:23.475439 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-fcbdb876-b0d7-49a8-9a1c-3a9ab258974b None None] Provisioning complete for port 81841961-1f66-4bbf-ab3a-2646a1326e8d triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:23.476637 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-fcbdb876-b0d7-49a8-9a1c-3a9ab258974b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:23.566789 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-fcbdb876-b0d7-49a8-9a1c-3a9ab258974b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:23.583224 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a271035c-8df1-4822-8e1b-d1053d760fc8 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:23.589219 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a271035c-8df1-4822-8e1b-d1053d760fc8 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:23.595891 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a271035c-8df1-4822-8e1b-d1053d760fc8 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:23.601142 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-fcbdb876-b0d7-49a8-9a1c-3a9ab258974b None None] For port 81841961-1f66-4bbf-ab3a-2646a1326e8d, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=81841961-1f66-4bbf-ab3a-2646a1326e8d,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:34:23.620172 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a92676f3-1e66-4e39-8afc-9c0be6518cdb tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:23.628971 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a92676f3-1e66-4e39-8afc-9c0be6518cdb tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:23.634810 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a92676f3-1e66-4e39-8afc-9c0be6518cdb tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] 10.222.0.24 "DELETE /v2.0/networks/fc71b887-9046-44cb-986d-dfe03d43967a HTTP/1.1" status: 204 len: 168 time: 1.1067598 Nov 09 04:34:23.657207 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57938) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:23.663668 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-fcbdb876-b0d7-49a8-9a1c-3a9ab258974b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:23.699109 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a271035c-8df1-4822-8e1b-d1053d760fc8 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 796 time: 1.1796041 Nov 09 04:34:23.702096 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57940) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:23.704412 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a271035c-8df1-4822-8e1b-d1053d760fc8 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Pushing event updated for resources: {'Network': ['ID=f3dca0a2-23fd-4413-908c-1d1ce4534d2d,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:23.715165 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network f3dca0a2-23fd-4413-908c-1d1ce4534d2d details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:34:23.715688 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-8b075cd2-da37-4e30-baa1-20adec202905 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Request body: {'subnet': {'network_id': 'f3dca0a2-23fd-4413-908c-1d1ce4534d2d', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:23.752155 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fcbdb876-b0d7-49a8-9a1c-3a9ab258974b None None] Pushing event updated for resources: {'Port': ['ID=81841961-1f66-4bbf-ab3a-2646a1326e8d,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:23.807930 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cd533152-3b2a-4364-b572-2cbb416f46af tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:34:23.815707 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-81409bbe-e6a2-430d-80f6-c5b632bee6f2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:23.824269 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a92676f3-1e66-4e39-8afc-9c0be6518cdb tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Pushing event deleted for resources: {'Network': ['ID=fc71b887-9046-44cb-986d-dfe03d43967a,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:23.824969 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b967e23-e054-45dd-99dd-e9e904a77539 None None] Sync routers for ids ['d05416c2-0293-4ef5-a6e3-5968392cc774'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:34:23.836093 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6b967e23-e054-45dd-99dd-e9e904a77539 None None] Routers {'d05416c2-0293-4ef5-a6e3-5968392cc774'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:34:23.836858 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-6b967e23-e054-45dd-99dd-e9e904a77539 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:34:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['d05416c2-0293-4ef5-a6e3-5968392cc774'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:23.837017 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-a0e210c6-2f3d-402c-a256-df859d311242 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] show failed (client error): The resource could not be found. Nov 09 04:34:23.841146 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a0e210c6-2f3d-402c-a256-df859d311242 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "GET /v2.0/subnetpools/f6fd139d-5736-40ad-a449-f302767d5f1c/tags/tempest-TagsExtTest-Tag-876879100 HTTP/1.1" status: 404 len: 328 time: 0.3959489 Nov 09 04:34:23.843050 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57942) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:23.848964 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.tag.tag_plugin [None req-7fcf94f9-298b-4aab-9377-fef97afaa6c0 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnetpools', 'f6fd139d-5736-40ad-a449-f302767d5f1c', 'tempest-TagsExtTest-Tag-1385604483') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:23.856894 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fdd40ea9-818c-43e3-a8ca-63f3bde7b704 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:23.890078 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.api.v2.resource [None req-7fcf94f9-298b-4aab-9377-fef97afaa6c0 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] show failed (client error): The resource could not be found. Nov 09 04:34:23.893802 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-7fcf94f9-298b-4aab-9377-fef97afaa6c0 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "GET /v2.0/subnetpools/f6fd139d-5736-40ad-a449-f302767d5f1c/tags/tempest-TagsExtTest-Tag-1385604483 HTTP/1.1" status: 404 len: 329 time: 0.0472529 Nov 09 04:34:23.898886 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57944) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:23.905740 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.tag.tag_plugin [None req-dd339793-0604-45c3-a71d-945a3c44b577 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnetpools', 'f6fd139d-5736-40ad-a449-f302767d5f1c', 'tempest-TagsExtTest-Tag-971114219') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:23.965029 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-6b967e23-e054-45dd-99dd-e9e904a77539 None None] Set router d05416c2-0293-4ef5-a6e3-5968392cc774 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:34:23.965854 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fdd40ea9-818c-43e3-a8ca-63f3bde7b704 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:23.983073 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-dd339793-0604-45c3-a71d-945a3c44b577 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] show failed (client error): The resource could not be found. Nov 09 04:34:23.987247 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-dd339793-0604-45c3-a71d-945a3c44b577 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "GET /v2.0/subnetpools/f6fd139d-5736-40ad-a449-f302767d5f1c/tags/tempest-TagsExtTest-Tag-971114219 HTTP/1.1" status: 404 len: 328 time: 0.0841048 Nov 09 04:34:23.988245 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57946) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:23.994769 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-fdd40ea9-818c-43e3-a8ca-63f3bde7b704 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6d014a7c-bf55-403c-8b12-11032e94df30']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:23.996087 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.tag.tag_plugin [None req-8d95f6ae-1da3-420a-9856-f0c205741de3 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'subnetpools', 'f6fd139d-5736-40ad-a449-f302767d5f1c') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:24.004613 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cd533152-3b2a-4364-b572-2cbb416f46af tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:24.009235 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-fdd40ea9-818c-43e3-a8ca-63f3bde7b704 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'addb7209-a504-42b8-926e-099777f05856') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:24.009550 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-fdd40ea9-818c-43e3-a8ca-63f3bde7b704 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'addb7209-a504-42b8-926e-099777f05856') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:24.026158 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fdd40ea9-818c-43e3-a8ca-63f3bde7b704 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:24.040595 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fdd40ea9-818c-43e3-a8ca-63f3bde7b704 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:24.046844 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-fdd40ea9-818c-43e3-a8ca-63f3bde7b704 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Releasing vlan 301 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:34:24.047278 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fdd40ea9-818c-43e3-a8ca-63f3bde7b704 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:24.051281 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:34:24.051281 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:34:24.051281 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:34:24.051281 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:34:24.051281 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:34:24.051281 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:34:24.051281 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:34:24.051281 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:34:24.051281 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:34:24.051281 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:34:24.051281 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:34:24.051281 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:34:24.051281 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:34:24.051281 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:34:24.051281 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:34:24.051281 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:34:24.051281 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:34:24.051281 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:34:24.051281 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:34:24.051281 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:34:24.051281 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:34:24.051281 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:34:24.051281 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:34:24.051281 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:34:24.051281 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:34:24.051281 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:34:24.051281 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:34:24.051281 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:34:24.051281 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:34:24.051281 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:34:24.051281 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:34:24.051281 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:34:24.056690 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-cd533152-3b2a-4364-b572-2cbb416f46af tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 4.8525445 Nov 09 04:34:24.061249 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8f462374-376b-4c38-b300-528ae5358377', 'tag': '09cbfb91-4118-43af-8b70-41d8d4265574'}] {{(pid=102161) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:34:24.061249 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}99dfdda0def497b4372884ef2eb87f06b1e425c8eba5ceda5f64bbab037a07d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-be180194-de34-430f-8ba1-34a04d04f7cf" -d '{"events": [{"name": "network-changed", "server_uuid": "8f462374-376b-4c38-b300-528ae5358377", "tag": "09cbfb91-4118-43af-8b70-41d8d4265574"}]}' {{(pid=102161) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:34:24.061796 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57948) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:24.077857 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-81409bbe-e6a2-430d-80f6-c5b632bee6f2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] For port 81841961-1f66-4bbf-ab3a-2646a1326e8d, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=81841961-1f66-4bbf-ab3a-2646a1326e8d,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:34:24.083745 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-8d95f6ae-1da3-420a-9856-f0c205741de3 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "DELETE /v2.0/subnetpools/f6fd139d-5736-40ad-a449-f302767d5f1c/tags HTTP/1.1" status: 204 len: 168 time: 0.0929317 Nov 09 04:34:24.087397 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57954) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:24.093614 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.tag.tag_plugin [None req-fc92e0c1-b43c-4ea5-b649-76594c204cb7 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'routers', '186c5198-7801-42c9-b497-8bb92f57d406') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:24.135926 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8b075cd2-da37-4e30-baa1-20adec202905 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Made reservation on behalf of 429a0ccbae244e9e9e6fbb93c166fa74 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:34:24.138196 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8b075cd2-da37-4e30-baa1-20adec202905 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:24.187796 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-81409bbe-e6a2-430d-80f6-c5b632bee6f2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:24.213115 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-fc92e0c1-b43c-4ea5-b649-76594c204cb7 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "DELETE /v2.0/routers/186c5198-7801-42c9-b497-8bb92f57d406/tags HTTP/1.1" status: 204 len: 168 time: 0.1224921 Nov 09 04:34:24.213938 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57956) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:24.222379 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.tag.tag_plugin [None req-bf69297c-b619-4185-9cbc-637d2daa85d3 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'ports', '595ae407-7cb5-4c2b-a4fa-9cb5b8c81a58') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:24.237454 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-7f79c5a8-3cf9-4742-ab84-ce6ea9e01c9e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/floatingips/071d456d-45c8-43d6-9154-8dc9c2df29f2 HTTP/1.1" status: 200 len: 991 time: 0.1734269 Nov 09 04:34:24.254076 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fdd40ea9-818c-43e3-a8ca-63f3bde7b704 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:24.276571 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fdd40ea9-818c-43e3-a8ca-63f3bde7b704 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:24.277740 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 81841961-1f66-4bbf-ab3a-2646a1326e8d up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:34:24.280895 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-fdd40ea9-818c-43e3-a8ca-63f3bde7b704 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] 10.222.0.24 "DELETE /v2.0/networks/6d014a7c-bf55-403c-8b12-11032e94df30 HTTP/1.1" status: 204 len: 168 time: 0.6226430 Nov 09 04:34:24.281796 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdd40ea9-818c-43e3-a8ca-63f3bde7b704 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Pushing event deleted for resources: {'Network': ['ID=6d014a7c-bf55-403c-8b12-11032e94df30,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:24.283536 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57958) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:24.290071 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-81409bbe-e6a2-430d-80f6-c5b632bee6f2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:24.293101 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-81409bbe-e6a2-430d-80f6-c5b632bee6f2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:24.374758 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-6b967e23-e054-45dd-99dd-e9e904a77539 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'name': 'tempest-TestNetworkBasicOps-router-1967773701', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.204'}], 'enable_snat': True}, 'gw_port_id': '49bff53a-c208-4aa5-8fcc-e7ec9471fae7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:33:32Z', 'updated_at': '2021-11-09T04:33:43Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '49bff53a-c208-4aa5-8fcc-e7ec9471fae7', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:85:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'device_owner': 'network:router_gateway', 'standard_attr_id': 978, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.204', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:33:34Z', 'updated_at': '2021-11-09T04:33:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '071d456d-45c8-43d6-9154-8dc9c2df29f2', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'floating_ip_address': '172.26.0.195', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'port_id': '09cbfb91-4118-43af-8b70-41d8d4265574', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 1062, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '239a9c72-6384-4d5a-a69d-f4ac0c580e40', 'mac_address': 'fa:16:3e:27:22:c9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f462374-376b-4c38-b300-528ae5358377', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:34:20Z', 'updated_at': '2021-11-09T04:34:20Z', 'revision_number': 0, 'project_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '9930d582-2262-4f1d-97bf-b02697a70777', 'name': '', 'network_id': '239a9c72-6384-4d5a-a69d-f4ac0c580e40', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:7c:21:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'device_owner': 'network:router_interface', 'standard_attr_id': 987, 'fixed_ips': [{'subnet_id': '33b5599d-7ebe-4564-9c72-76f5d540fd80', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:33:41Z', 'updated_at': '2021-11-09T04:33:48Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '33b5599d-7ebe-4564-9c72-76f5d540fd80', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:24.378997 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 81841961-1f66-4bbf-ab3a-2646a1326e8d triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:24.379487 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:24.412786 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:34:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e706ab7a-5fb7-4b8c-a537-eb41d67f0439 x-openstack-request-id: req-e706ab7a-5fb7-4b8c-a537-eb41d67f0439 {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:34:24.413230 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8f462374-376b-4c38-b300-528ae5358377", "tag": "09cbfb91-4118-43af-8b70-41d8d4265574", "status": "completed", "code": 200}]} {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:34:24.413578 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-e706ab7a-5fb7-4b8c-a537-eb41d67f0439 {{(pid=102161) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:34:24.414105 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8f462374-376b-4c38-b300-528ae5358377', 'tag': '09cbfb91-4118-43af-8b70-41d8d4265574', 'status': 'completed', 'code': 200} Nov 09 04:34:24.416713 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-91b40900-6c2d-44a9-9976-aa7683cb7658 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Deleting subnet e2e8c027-b8d8-4759-88db-fcda9b0dfe5f {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:34:24.418143 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b967e23-e054-45dd-99dd-e9e904a77539 None None] Checking router: d05416c2-0293-4ef5-a6e3-5968392cc774 for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:34:24.427245 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6b967e23-e054-45dd-99dd-e9e904a77539 None None] Routers {'d05416c2-0293-4ef5-a6e3-5968392cc774'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:34:24.427859 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-6b967e23-e054-45dd-99dd-e9e904a77539 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:34:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['d05416c2-0293-4ef5-a6e3-5968392cc774'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:24.429508 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-91b40900-6c2d-44a9-9976-aa7683cb7658 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:24.447117 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-bf69297c-b619-4185-9cbc-637d2daa85d3 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "DELETE /v2.0/ports/595ae407-7cb5-4c2b-a4fa-9cb5b8c81a58/tags HTTP/1.1" status: 204 len: 168 time: 0.2315109 Nov 09 04:34:24.452120 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57960) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:24.458200 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81409bbe-e6a2-430d-80f6-c5b632bee6f2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Port': ['ID=81841961-1f66-4bbf-ab3a-2646a1326e8d,revision_number=5']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:24.463912 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-81409bbe-e6a2-430d-80f6-c5b632bee6f2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:34:24.469407 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.tag.tag_plugin [None req-8f64eed1-a8f2-48a4-977f-78d13cba983f tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'subnets', '66cc5117-4268-433d-acab-66834cdb6f85') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:24.478207 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-81409bbe-e6a2-430d-80f6-c5b632bee6f2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:24.499441 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-af61d93b-d3c8-4be7-8f62-68bd150922c6 None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:34:24.501945 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-81409bbe-e6a2-430d-80f6-c5b632bee6f2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:24.502684 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-81409bbe-e6a2-430d-80f6-c5b632bee6f2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:24.514301 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81409bbe-e6a2-430d-80f6-c5b632bee6f2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Subnet': ['ID=50ce8657-2443-4724-ac81-7f3884a6c040,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:24.527318 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be180194-de34-430f-8ba1-34a04d04f7cf req-95271ab7-b0f5-441f-98f1-ba2c3172bd1a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:24.528848 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-be180194-de34-430f-8ba1-34a04d04f7cf req-95271ab7-b0f5-441f-98f1-ba2c3172bd1a service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&device_id=8f462374-376b-4c38-b300-528ae5358377 HTTP/1.1" status: 200 len: 1098 time: 0.1484730 Nov 09 04:34:24.530604 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-91b40900-6c2d-44a9-9976-aa7683cb7658 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:24.575565 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-81409bbe-e6a2-430d-80f6-c5b632bee6f2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 842 time: 2.6265550 Nov 09 04:34:24.582120 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57962) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:24.582754 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-6b967e23-e054-45dd-99dd-e9e904a77539 None None] Set router d05416c2-0293-4ef5-a6e3-5968392cc774 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:34:24.594047 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8b075cd2-da37-4e30-baa1-20adec202905 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:24.594881 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-55bff4d9-12f8-4647-b5c9-5d8eb1498d6f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'port': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'mac_address': 'fa:16:3e:ab:ba:bd', 'name': 'tempest-NetworksTestDHCPv6-1676597343'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:24.647287 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-8f64eed1-a8f2-48a4-977f-78d13cba983f tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "DELETE /v2.0/subnets/66cc5117-4268-433d-acab-66834cdb6f85/tags HTTP/1.1" status: 204 len: 168 time: 0.1900537 Nov 09 04:34:24.655258 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57964) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:24.714321 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 534ec346-6b5d-44cb-9cb1-654cb2217ed5 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:34:24.739030 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 534ec346-6b5d-44cb-9cb1-654cb2217ed5 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:34:24.739717 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 534ec346-6b5d-44cb-9cb1-654cb2217ed5 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:34:24.740349 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 3c324982-d7b8-4a65-9614-579eaad5ada7 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:34:24.763468 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 3c324982-d7b8-4a65-9614-579eaad5ada7 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:34:24.764229 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 3c324982-d7b8-4a65-9614-579eaad5ada7 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:34:24.861517 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8fb5e34f-54e5-4d09-a145-7c751b1d1cd6 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Publish callbacks [] for subnetpool, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:24.862943 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-8fb5e34f-54e5-4d09-a145-7c751b1d1cd6 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "DELETE /v2.0/subnetpools/f6fd139d-5736-40ad-a449-f302767d5f1c HTTP/1.1" status: 204 len: 168 time: 0.2064362 Nov 09 04:34:24.865592 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57966) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:24.910674 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-9e1aa522-f64d-4918-bfe2-1b3d1c102e08 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "GET /v2.0/ports?device_id=186c5198-7801-42c9-b497-8bb92f57d406 HTTP/1.1" status: 200 len: 205 time: 0.0433984 Nov 09 04:34:24.912903 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57968) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:24.948702 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-6b967e23-e054-45dd-99dd-e9e904a77539 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'name': 'tempest-TestNetworkBasicOps-router-1967773701', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.204'}], 'enable_snat': True}, 'gw_port_id': '49bff53a-c208-4aa5-8fcc-e7ec9471fae7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:33:32Z', 'updated_at': '2021-11-09T04:33:43Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '49bff53a-c208-4aa5-8fcc-e7ec9471fae7', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:85:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'device_owner': 'network:router_gateway', 'standard_attr_id': 978, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.204', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:33:34Z', 'updated_at': '2021-11-09T04:33:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '071d456d-45c8-43d6-9154-8dc9c2df29f2', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'floating_ip_address': '172.26.0.195', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'port_id': '09cbfb91-4118-43af-8b70-41d8d4265574', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 1062, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '239a9c72-6384-4d5a-a69d-f4ac0c580e40', 'mac_address': 'fa:16:3e:27:22:c9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f462374-376b-4c38-b300-528ae5358377', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:34:20Z', 'updated_at': '2021-11-09T04:34:20Z', 'revision_number': 0, 'project_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '9930d582-2262-4f1d-97bf-b02697a70777', 'name': '', 'network_id': '239a9c72-6384-4d5a-a69d-f4ac0c580e40', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:7c:21:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'device_owner': 'network:router_interface', 'standard_attr_id': 987, 'fixed_ips': [{'subnet_id': '33b5599d-7ebe-4564-9c72-76f5d540fd80', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:33:41Z', 'updated_at': '2021-11-09T04:33:48Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '33b5599d-7ebe-4564-9c72-76f5d540fd80', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:24.985048 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b967e23-e054-45dd-99dd-e9e904a77539 None None] The sync data for ids ['d05416c2-0293-4ef5-a6e3-5968392cc774'] in dv-neutron-816802-2-hyperv is: [{'id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'name': 'tempest-TestNetworkBasicOps-router-1967773701', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.204'}], 'enable_snat': True}, 'gw_port_id': '49bff53a-c208-4aa5-8fcc-e7ec9471fae7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:33:32Z', 'updated_at': '2021-11-09T04:33:43Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '49bff53a-c208-4aa5-8fcc-e7ec9471fae7', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:85:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'device_owner': 'network:router_gateway', 'standard_attr_id': 978, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.204', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:33:34Z', 'updated_at': '2021-11-09T04:33:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '071d456d-45c8-43d6-9154-8dc9c2df29f2', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'floating_ip_address': '172.26.0.195', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'port_id': '09cbfb91-4118-43af-8b70-41d8d4265574', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 1062, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '239a9c72-6384-4d5a-a69d-f4ac0c580e40', 'mac_address': 'fa:16:3e:27:22:c9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f462374-376b-4c38-b300-528ae5358377', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:34:20Z', 'updated_at': '2021-11-09T04:34:20Z', 'revision_number': 0, 'project_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '9930d582-2262-4f1d-97bf-b02697a70777', 'name': '', 'network_id': '239a9c72-6384-4d5a-a69d-f4ac0c580e40', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:7c:21:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'device_owner': 'network:router_interface', 'standard_attr_id': 987, 'fixed_ips': [{'subnet_id': '33b5599d-7ebe-4564-9c72-76f5d540fd80', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:33:41Z', 'updated_at': '2021-11-09T04:33:48Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '33b5599d-7ebe-4564-9c72-76f5d540fd80', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:34:24.991079 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b075cd2-da37-4e30-baa1-20adec202905 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Pushing event updated for resources: {'Subnet': ['ID=c3333d58-7e3b-4a31-9afb-cafbfe8b7e0e,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:25.010396 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-55bff4d9-12f8-4647-b5c9-5d8eb1498d6f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'port': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:34:25.021530 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9f122696-d04b-4f9e-84dd-2d14e64dcc2a tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Publish callbacks [] for router, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:25.027038 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-91b40900-6c2d-44a9-9976-aa7683cb7658 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:25.096366 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8b075cd2-da37-4e30-baa1-20adec202905 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Checking segment: {'id': '71d738f6-3812-4ad6-9cb8-aaf5a45f2bed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 307, 'network_id': 'f3dca0a2-23fd-4413-908c-1d1ce4534d2d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:34:25.097046 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8b075cd2-da37-4e30-baa1-20adec202905 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Network hostable DHCP agents. Network: f3dca0a2-23fd-4413-908c-1d1ce4534d2d, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:34:25.101647 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be180194-de34-430f-8ba1-34a04d04f7cf req-8e795adc-2e73-4c81-9ba5-938fb7c601fa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:25.109946 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-be180194-de34-430f-8ba1-34a04d04f7cf req-8e795adc-2e73-4c81-9ba5-938fb7c601fa service neutron] 10.222.0.26 "GET /v2.0/networks?id=239a9c72-6384-4d5a-a69d-f4ac0c580e40 HTTP/1.1" status: 200 len: 897 time: 0.5452540 Nov 09 04:34:25.179762 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-be180194-de34-430f-8ba1-34a04d04f7cf req-e01d9032-b4cf-4006-97af-c8f0d4cfbdf6 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=09cbfb91-4118-43af-8b70-41d8d4265574 HTTP/1.1" status: 200 len: 999 time: 0.0674286 Nov 09 04:34:25.223897 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-91b40900-6c2d-44a9-9976-aa7683cb7658 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:25.257204 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57970) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:25.257736 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8b075cd2-da37-4e30-baa1-20adec202905 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Network f3dca0a2-23fd-4413-908c-1d1ce4534d2d is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:34:25.270352 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91b40900-6c2d-44a9-9976-aa7683cb7658 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Pushing event deleted for resources: {'Subnet': ['ID=e2e8c027-b8d8-4759-88db-fcda9b0dfe5f,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:25.274128 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7727f8cd-7d64-405a-b707-4be0332f679e None None] New status for floating IP 071d456d-45c8-43d6-9154-8dc9c2df29f2: ACTIVE {{(pid=102163) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 04:34:25.278955 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-91b40900-6c2d-44a9-9976-aa7683cb7658 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:25.279833 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-91b40900-6c2d-44a9-9976-aa7683cb7658 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] 10.222.0.24 "DELETE /v2.0/subnets/e2e8c027-b8d8-4759-88db-fcda9b0dfe5f HTTP/1.1" status: 204 len: 168 time: 0.9937036 Nov 09 04:34:25.283238 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57972) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:25.286076 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ca48461a-653f-4ac5-9c88-aef575de77bd None None] Network 83b7fb07-746c-4cc1-a582-519bfb1e5896 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:34:25.292706 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be180194-de34-430f-8ba1-34a04d04f7cf req-a3b9d198-fe03-448a-852b-6f242641f38e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:25.294177 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-be180194-de34-430f-8ba1-34a04d04f7cf req-a3b9d198-fe03-448a-852b-6f242641f38e service neutron] 10.222.0.26 "GET /v2.0/subnets?id=33b5599d-7ebe-4564-9c72-76f5d540fd80 HTTP/1.1" status: 200 len: 834 time: 0.1080389 Nov 09 04:34:25.330893 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9f122696-d04b-4f9e-84dd-2d14e64dcc2a tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:25.337578 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9f122696-d04b-4f9e-84dd-2d14e64dcc2a tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:25.344754 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-55bff4d9-12f8-4647-b5c9-5d8eb1498d6f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:25.351418 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-8b075cd2-da37-4e30-baa1-20adec202905 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, f3dca0a2-23fd-4413-908c-1d1ce4534d2d) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:25.374698 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7cb4cc87-ba15-4891-898c-9e01f67b6ffc None None] Network f3dca0a2-23fd-4413-908c-1d1ce4534d2d requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:34:25.387383 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8b075cd2-da37-4e30-baa1-20adec202905 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:25.388079 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8b075cd2-da37-4e30-baa1-20adec202905 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:25.420186 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-d18a15c5-52f7-48a7-8cb4-98422517240e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/floatingips/071d456d-45c8-43d6-9154-8dc9c2df29f2 HTTP/1.1" status: 200 len: 991 time: 0.1600633 Nov 09 04:34:25.422925 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0f60161e-7360-4944-a848-96230c8e0699 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:25.428585 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [None req-55bff4d9-12f8-4647-b5c9-5d8eb1498d6f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] device_id is not set on port a6ff87c0-50a6-432e-8c6b-b24c7ebb8e2f yet. {{(pid=102161) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:34:25.429116 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be180194-de34-430f-8ba1-34a04d04f7cf req-20070620-6aab-449c-b9ab-79b8948ee4fa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:25.430757 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-be180194-de34-430f-8ba1-34a04d04f7cf req-20070620-6aab-449c-b9ab-79b8948ee4fa service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=239a9c72-6384-4d5a-a69d-f4ac0c580e40&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1214883 Nov 09 04:34:25.528367 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-8b075cd2-da37-4e30-baa1-20adec202905 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.8253005 Nov 09 04:34:25.531328 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57974) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:25.537561 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-1bca1c18-7fcb-45e3-bd33-034b1efbef6f tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Request body: {'port': {'network_id': 'f3dca0a2-23fd-4413-908c-1d1ce4534d2d', 'name': 'tempest-ExtraDHCPOptionsIpV6TestJSON-940240976'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:25.540675 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9f122696-d04b-4f9e-84dd-2d14e64dcc2a tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:25.541376 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9f122696-d04b-4f9e-84dd-2d14e64dcc2a tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Fanout notify agent at l3_agent the message router_deleted on router 186c5198-7801-42c9-b497-8bb92f57d406 {{(pid=102161) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:34:25.551460 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9f122696-d04b-4f9e-84dd-2d14e64dcc2a tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:25.555642 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-9f122696-d04b-4f9e-84dd-2d14e64dcc2a tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "DELETE /v2.0/routers/186c5198-7801-42c9-b497-8bb92f57d406 HTTP/1.1" status: 204 len: 168 time: 0.6412957 Nov 09 04:34:25.556345 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57976) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:25.655280 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-be180194-de34-430f-8ba1-34a04d04f7cf req-65fb01a5-ffe9-4cbc-b488-a85756b6cbc0 service neutron] 10.222.0.26 "GET /v2.0/networks/239a9c72-6384-4d5a-a69d-f4ac0c580e40?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2132607 Nov 09 04:34:25.659601 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-0f60161e-7360-4944-a848-96230c8e0699 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Deleting port 3fc210b0-8ace-4199-af3c-2296f979b045 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:34:25.659941 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0f60161e-7360-4944-a848-96230c8e0699 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:25.719201 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-55bff4d9-12f8-4647-b5c9-5d8eb1498d6f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Allocated IP 2001:db8::20b (988d2354-693c-4d52-af17-25e0643eaa0c/130970a8-ae23-4805-a6d6-fd396bb5daaa/a6ff87c0-50a6-432e-8c6b-b24c7ebb8e2f) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:34:25.731218 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-55bff4d9-12f8-4647-b5c9-5d8eb1498d6f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Allocated IP 2001:db8:0:1:f816:3eff:feab:babd (988d2354-693c-4d52-af17-25e0643eaa0c/50ce8657-2443-4724-ac81-7f3884a6c040/a6ff87c0-50a6-432e-8c6b-b24c7ebb8e2f) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:34:25.739233 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-77614332-6a15-47ae-a2fb-f87c6dfda60d tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Deleting port 595ae407-7cb5-4c2b-a4fa-9cb5b8c81a58 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:34:25.739655 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-77614332-6a15-47ae-a2fb-f87c6dfda60d tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:25.793278 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-edf5f21b-f02f-4ace-8eea-19793751b5e8 None None] Provisioning complete for port 81841961-1f66-4bbf-ab3a-2646a1326e8d triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:25.793278 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-edf5f21b-f02f-4ace-8eea-19793751b5e8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:25.813018 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-0f60161e-7360-4944-a848-96230c8e0699 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] For port 3fc210b0-8ace-4199-af3c-2296f979b045, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=3fc210b0-8ace-4199-af3c-2296f979b045,segment=NetworkSegment(9c8c26ad-778e-46c6-99ba-e8e770604064),segment_id=9c8c26ad-778e-46c6-99ba-e8e770604064)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:34:25.813380 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0f60161e-7360-4944-a848-96230c8e0699 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:25.832743 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-0f60161e-7360-4944-a848-96230c8e0699 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Calling delete_port for 3fc210b0-8ace-4199-af3c-2296f979b045 owned by network:dhcp {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:34:25.851357 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-be180194-de34-430f-8ba1-34a04d04f7cf req-8baace8f-4bec-4f83-bf4e-0af89d18c0fe service neutron] 10.222.0.26 "GET /v2.0/networks/239a9c72-6384-4d5a-a69d-f4ac0c580e40?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1862788 Nov 09 04:34:25.885688 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-77614332-6a15-47ae-a2fb-f87c6dfda60d tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:25.909184 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1bca1c18-7fcb-45e3-bd33-034b1efbef6f tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Made reservation on behalf of 429a0ccbae244e9e9e6fbb93c166fa74 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:34:25.913043 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1bca1c18-7fcb-45e3-bd33-034b1efbef6f tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:25.934696 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-77614332-6a15-47ae-a2fb-f87c6dfda60d tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Calling delete_port for 595ae407-7cb5-4c2b-a4fa-9cb5b8c81a58 owned by {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:34:25.937288 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [None req-1bca1c18-7fcb-45e3-bd33-034b1efbef6f tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] device_id is not set on port bc4c2b89-b97b-4327-a3db-c381c85b495b yet. {{(pid=102162) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:34:26.021429 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-846fb484-8ff6-4dc4-9e3a-f0c40ef323de None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-f3dca0a2-23fd-4413-908c-1d1ce4534d2d', 'network_id': 'f3dca0a2-23fd-4413-908c-1d1ce4534d2d', 'tenant_id': '429a0ccbae244e9e9e6fbb93c166fa74', 'fixed_ips': [{'subnet_id': 'c3333d58-7e3b-4a31-9afb-cafbfe8b7e0e'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:34:26.023544 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-846fb484-8ff6-4dc4-9e3a-f0c40ef323de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:26.049282 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-55bff4d9-12f8-4647-b5c9-5d8eb1498d6f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:26.099803 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-1bca1c18-7fcb-45e3-bd33-034b1efbef6f tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Allocated IP 2001:db8::3b0 (f3dca0a2-23fd-4413-908c-1d1ce4534d2d/c3333d58-7e3b-4a31-9afb-cafbfe8b7e0e/bc4c2b89-b97b-4327-a3db-c381c85b495b) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:34:26.103756 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-65964254-f27a-43c4-8085-74fc6adfa678 None None] DHCP port deletion for 83b7fb07-746c-4cc1-a582-519bfb1e5896 request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:34:26.143310 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0f60161e-7360-4944-a848-96230c8e0699 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:26.163636 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 3fc210b0-8ace-4199-af3c-2296f979b045 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:34:26.180794 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f60161e-7360-4944-a848-96230c8e0699 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Pushing event deleted for resources: {'Port': ['ID=3fc210b0-8ace-4199-af3c-2296f979b045,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:26.183912 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 3fc210b0-8ace-4199-af3c-2296f979b045 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:34:26.184257 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 3fc210b0-8ace-4199-af3c-2296f979b045 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:34:26.185770 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0f60161e-7360-4944-a848-96230c8e0699 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] No DVR routers for this DVR port 3fc210b0-8ace-4199-af3c-2296f979b045 on host dv-neutron-816802-2-hyperv {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:34:26.200596 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-55bff4d9-12f8-4647-b5c9-5d8eb1498d6f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:26.243551 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-77614332-6a15-47ae-a2fb-f87c6dfda60d tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:26.246472 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-55bff4d9-12f8-4647-b5c9-5d8eb1498d6f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:34:26.257460 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-55bff4d9-12f8-4647-b5c9-5d8eb1498d6f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:26.270129 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-55bff4d9-12f8-4647-b5c9-5d8eb1498d6f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:34:26.270933 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-55bff4d9-12f8-4647-b5c9-5d8eb1498d6f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:26.271585 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-55bff4d9-12f8-4647-b5c9-5d8eb1498d6f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:26.277340 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55bff4d9-12f8-4647-b5c9-5d8eb1498d6f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Port': ['ID=a6ff87c0-50a6-432e-8c6b-b24c7ebb8e2f,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:26.327574 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0f60161e-7360-4944-a848-96230c8e0699 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:26.331968 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77614332-6a15-47ae-a2fb-f87c6dfda60d tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Pushing event deleted for resources: {'Port': ['ID=595ae407-7cb5-4c2b-a4fa-9cb5b8c81a58,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:26.362218 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-0f60161e-7360-4944-a848-96230c8e0699 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['83b7fb07-746c-4cc1-a582-519bfb1e5896']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:26.390227 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-0f60161e-7360-4944-a848-96230c8e0699 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9c8c26ad-778e-46c6-99ba-e8e770604064') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:26.390550 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-0f60161e-7360-4944-a848-96230c8e0699 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9c8c26ad-778e-46c6-99ba-e8e770604064') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:26.397820 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-77614332-6a15-47ae-a2fb-f87c6dfda60d tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:26.402546 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-77614332-6a15-47ae-a2fb-f87c6dfda60d tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "DELETE /v2.0/ports/595ae407-7cb5-4c2b-a4fa-9cb5b8c81a58 HTTP/1.1" status: 204 len: 168 time: 0.8424137 Nov 09 04:34:26.405392 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57978) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:26.410910 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0f60161e-7360-4944-a848-96230c8e0699 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:26.414666 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1bca1c18-7fcb-45e3-bd33-034b1efbef6f tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:26.422187 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57980) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:26.451175 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-55bff4d9-12f8-4647-b5c9-5d8eb1498d6f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1033 time: 1.8663833 Nov 09 04:34:26.455433 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57982) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:26.466150 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0f60161e-7360-4944-a848-96230c8e0699 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:26.481922 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-0f60161e-7360-4944-a848-96230c8e0699 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Releasing vlan 344 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:34:26.482327 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0f60161e-7360-4944-a848-96230c8e0699 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:26.487345 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:34:26.487345 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:34:26.487345 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:34:26.487345 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:34:26.487345 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:34:26.487345 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:34:26.487345 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:34:26.487345 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:34:26.487345 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:34:26.487345 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:34:26.487345 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:34:26.487345 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:34:26.487345 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:34:26.487345 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:34:26.487345 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:34:26.487345 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:34:26.487345 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:34:26.487345 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:34:26.487345 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:34:26.487345 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:34:26.487345 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:34:26.487345 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:34:26.487345 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:34:26.487345 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:34:26.487345 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:34:26.487345 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:34:26.487345 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:34:26.487345 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:34:26.487345 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:34:26.487345 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:34:26.487345 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:34:26.487345 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:34:26.510810 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-31bf7264-db12-471f-aa4e-fa329a0ebaf7 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Deleting subnet 66cc5117-4268-433d-acab-66834cdb6f85 {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:34:26.518313 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-31bf7264-db12-471f-aa4e-fa329a0ebaf7 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:26.568003 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-3d62d32f-0797-4dbb-b228-7a1b3b9a08b7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/floatingips/071d456d-45c8-43d6-9154-8dc9c2df29f2 HTTP/1.1" status: 200 len: 993 time: 0.1447358 Nov 09 04:34:26.594886 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-31bf7264-db12-471f-aa4e-fa329a0ebaf7 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:26.623031 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0f60161e-7360-4944-a848-96230c8e0699 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:26.632249 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0f60161e-7360-4944-a848-96230c8e0699 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:26.635463 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-0f60161e-7360-4944-a848-96230c8e0699 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] 10.222.0.24 "DELETE /v2.0/networks/83b7fb07-746c-4cc1-a582-519bfb1e5896 HTTP/1.1" status: 204 len: 168 time: 1.3510668 Nov 09 04:34:26.639087 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57984) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:26.648169 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f60161e-7360-4944-a848-96230c8e0699 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Pushing event deleted for resources: {'Network': ['ID=83b7fb07-746c-4cc1-a582-519bfb1e5896,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:26.650675 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1bca1c18-7fcb-45e3-bd33-034b1efbef6f tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:26.674117 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-8a268216-c901-416b-ad64-8fba53155359 tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] 10.222.0.24 "GET /v2.0/ports?device_id=8cbd7ad3-04d4-4ab0-b79f-a9a391f624b1 HTTP/1.1" status: 200 len: 205 time: 0.0331175 Nov 09 04:34:26.680535 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57986) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:26.697590 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1bca1c18-7fcb-45e3-bd33-034b1efbef6f tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Network f3dca0a2-23fd-4413-908c-1d1ce4534d2d is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:34:26.702967 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-1bca1c18-7fcb-45e3-bd33-034b1efbef6f tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:26.703800 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-cb678881-1e8b-431f-9ecb-b27f014d3b1a None None] Provisioning complete for port a6ff87c0-50a6-432e-8c6b-b24c7ebb8e2f triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:26.704218 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-cb678881-1e8b-431f-9ecb-b27f014d3b1a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:26.707057 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1bca1c18-7fcb-45e3-bd33-034b1efbef6f tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:34:26.712881 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1bca1c18-7fcb-45e3-bd33-034b1efbef6f tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:26.713379 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1bca1c18-7fcb-45e3-bd33-034b1efbef6f tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:26.721228 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bca1c18-7fcb-45e3-bd33-034b1efbef6f tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Pushing event updated for resources: {'Port': ['ID=bc4c2b89-b97b-4327-a3db-c381c85b495b,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:26.741808 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-846fb484-8ff6-4dc4-9e3a-f0c40ef323de None None] Allocated IP 2001:db8::2 (f3dca0a2-23fd-4413-908c-1d1ce4534d2d/c3333d58-7e3b-4a31-9afb-cafbfe8b7e0e/34b780e2-66dd-47ef-905a-81a9e32fdc2d) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:34:26.747741 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-a2a675be-386b-41e9-9959-0fb5a383b45f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Deleting port a6ff87c0-50a6-432e-8c6b-b24c7ebb8e2f {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:34:26.748082 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a2a675be-386b-41e9-9959-0fb5a383b45f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:26.775517 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-cb678881-1e8b-431f-9ecb-b27f014d3b1a None None] Port a6ff87c0-50a6-432e-8c6b-b24c7ebb8e2f cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:34:26.815332 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-1bca1c18-7fcb-45e3-bd33-034b1efbef6f tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 941 time: 1.2815452 Nov 09 04:34:26.822712 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57988) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:26.823348 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-34a82e2d-4e3b-43cd-a63e-8ed666974258 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Request body: {'port': {'network_id': 'f3dca0a2-23fd-4413-908c-1d1ce4534d2d', 'name': 'tempest-ExtraDHCPOptionsIpV6TestJSON-1333320925', 'extra_dhcp_opts': [{'opt_value': 'pxelinux.0', 'opt_name': 'bootfile-name'}, {'opt_value': '2015::dead', 'opt_name': 'tftp-server'}, {'opt_value': '2015::badd', 'opt_name': 'server-ip-address'}]}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:26.823826 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.api.validators [None req-34a82e2d-4e3b-43cd-a63e-8ed666974258 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] bootfile-name is not in valid_values {{(pid=102162) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Nov 09 04:34:26.824159 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.api.validators [None req-34a82e2d-4e3b-43cd-a63e-8ed666974258 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] tftp-server is not in valid_values {{(pid=102162) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Nov 09 04:34:26.824483 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.api.validators [None req-34a82e2d-4e3b-43cd-a63e-8ed666974258 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] server-ip-address is not in valid_values {{(pid=102162) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Nov 09 04:34:26.841943 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-00a64e1b-5591-4fe1-ad2f-64f8d0fd681d tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks [] for router, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:26.891872 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-31bf7264-db12-471f-aa4e-fa329a0ebaf7 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:26.916889 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-846fb484-8ff6-4dc4-9e3a-f0c40ef323de None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:26.975161 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a2a675be-386b-41e9-9959-0fb5a383b45f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:26.994453 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-846fb484-8ff6-4dc4-9e3a-f0c40ef323de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:27.016985 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-34a82e2d-4e3b-43cd-a63e-8ed666974258 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Made reservation on behalf of 429a0ccbae244e9e9e6fbb93c166fa74 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:34:27.020588 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-34a82e2d-4e3b-43cd-a63e-8ed666974258 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:27.039477 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-846fb484-8ff6-4dc4-9e3a-f0c40ef323de None None] Network f3dca0a2-23fd-4413-908c-1d1ce4534d2d is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:34:27.039721 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [None req-34a82e2d-4e3b-43cd-a63e-8ed666974258 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] device_id is not set on port 064214d4-3958-4c1f-a454-5106eacc5956 yet. {{(pid=102162) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:34:27.046813 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-846fb484-8ff6-4dc4-9e3a-f0c40ef323de None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:27.051596 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-a2a675be-386b-41e9-9959-0fb5a383b45f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Calling delete_port for a6ff87c0-50a6-432e-8c6b-b24c7ebb8e2f owned by {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:34:27.054297 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-846fb484-8ff6-4dc4-9e3a-f0c40ef323de None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:34:27.057190 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-846fb484-8ff6-4dc4-9e3a-f0c40ef323de None None] Pushing event updated for resources: {'Port': ['ID=34b780e2-66dd-47ef-905a-81a9e32fdc2d,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:27.090717 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-00a64e1b-5591-4fe1-ad2f-64f8d0fd681d tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:27.098549 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-00a64e1b-5591-4fe1-ad2f-64f8d0fd681d tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:27.122108 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-846fb484-8ff6-4dc4-9e3a-f0c40ef323de None None] Attempting to bind port 34b780e2-66dd-47ef-905a-81a9e32fdc2d on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:34:27.122513 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-846fb484-8ff6-4dc4-9e3a-f0c40ef323de None None] Attempting to bind port 34b780e2-66dd-47ef-905a-81a9e32fdc2d by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '71d738f6-3812-4ad6-9cb8-aaf5a45f2bed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 307, 'network_id': 'f3dca0a2-23fd-4413-908c-1d1ce4534d2d'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:34:27.122871 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-846fb484-8ff6-4dc4-9e3a-f0c40ef323de None None] Attempting to bind port 34b780e2-66dd-47ef-905a-81a9e32fdc2d on network f3dca0a2-23fd-4413-908c-1d1ce4534d2d {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:34:27.128292 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-846fb484-8ff6-4dc4-9e3a-f0c40ef323de None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 34, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:34:27.128658 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-846fb484-8ff6-4dc4-9e3a-f0c40ef323de None None] Checking segment: {'id': '71d738f6-3812-4ad6-9cb8-aaf5a45f2bed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 307, 'network_id': 'f3dca0a2-23fd-4413-908c-1d1ce4534d2d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:34:27.129047 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-846fb484-8ff6-4dc4-9e3a-f0c40ef323de None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:27.129471 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-846fb484-8ff6-4dc4-9e3a-f0c40ef323de None None] Bound using segment: {'id': '71d738f6-3812-4ad6-9cb8-aaf5a45f2bed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 307, 'network_id': 'f3dca0a2-23fd-4413-908c-1d1ce4534d2d'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:34:27.129887 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-846fb484-8ff6-4dc4-9e3a-f0c40ef323de None None] Bound port: 34b780e2-66dd-47ef-905a-81a9e32fdc2d, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '71d738f6-3812-4ad6-9cb8-aaf5a45f2bed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 307, 'network_id': 'f3dca0a2-23fd-4413-908c-1d1ce4534d2d'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:34:27.130254 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-846fb484-8ff6-4dc4-9e3a-f0c40ef323de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:27.172600 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-34a82e2d-4e3b-43cd-a63e-8ed666974258 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Allocated IP 2001:db8::cc (f3dca0a2-23fd-4413-908c-1d1ce4534d2d/c3333d58-7e3b-4a31-9afb-cafbfe8b7e0e/064214d4-3958-4c1f-a454-5106eacc5956) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:34:27.175255 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-31bf7264-db12-471f-aa4e-fa329a0ebaf7 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:27.199097 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-846fb484-8ff6-4dc4-9e3a-f0c40ef323de None None] For port 34b780e2-66dd-47ef-905a-81a9e32fdc2d, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:34:27.202471 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-846fb484-8ff6-4dc4-9e3a-f0c40ef323de None None] For port 34b780e2-66dd-47ef-905a-81a9e32fdc2d, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=34b780e2-66dd-47ef-905a-81a9e32fdc2d,segment=NetworkSegment(71d738f6-3812-4ad6-9cb8-aaf5a45f2bed),segment_id=71d738f6-3812-4ad6-9cb8-aaf5a45f2bed)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:34:27.215109 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31bf7264-db12-471f-aa4e-fa329a0ebaf7 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Pushing event deleted for resources: {'Subnet': ['ID=66cc5117-4268-433d-acab-66834cdb6f85,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:27.226813 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c6476c3d-6469-42d7-8459-be7d7751c40c None None] Network 3d535493-472d-4bfc-8052-c7d4e02f89c4 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:34:27.227433 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-31bf7264-db12-471f-aa4e-fa329a0ebaf7 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:27.232919 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-31bf7264-db12-471f-aa4e-fa329a0ebaf7 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "DELETE /v2.0/subnets/66cc5117-4268-433d-acab-66834cdb6f85 HTTP/1.1" status: 204 len: 168 time: 0.8242128 Nov 09 04:34:27.233691 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 57990) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:27.243754 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-00a64e1b-5591-4fe1-ad2f-64f8d0fd681d tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:27.244250 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-00a64e1b-5591-4fe1-ad2f-64f8d0fd681d tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Fanout notify agent at l3_agent the message router_deleted on router 8cbd7ad3-04d4-4ab0-b79f-a9a391f624b1 {{(pid=102161) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:34:27.258901 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-846fb484-8ff6-4dc4-9e3a-f0c40ef323de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:27.268418 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-00a64e1b-5591-4fe1-ad2f-64f8d0fd681d tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:27.271839 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-00a64e1b-5591-4fe1-ad2f-64f8d0fd681d tempest-RoutersNegativeIpV6Test-269379679 tempest-RoutersNegativeIpV6Test-269379679-project] 10.222.0.24 "DELETE /v2.0/routers/8cbd7ad3-04d4-4ab0-b79f-a9a391f624b1 HTTP/1.1" status: 204 len: 168 time: 0.5887084 Nov 09 04:34:27.455088 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-846fb484-8ff6-4dc4-9e3a-f0c40ef323de None None] Pushing event updated for resources: {'Port': ['ID=34b780e2-66dd-47ef-905a-81a9e32fdc2d,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:27.468805 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:34:27.537426 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-52d57c9d-58ea-4c21-a5d8-592280d773e3 None None] DHCP port deletion for 3d535493-472d-4bfc-8052-c7d4e02f89c4 request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:34:27.595139 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-52d57c9d-58ea-4c21-a5d8-592280d773e3 None None] Deleting port c66388ff-7389-4791-9f4a-dc83e0728f21 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:34:27.595480 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-52d57c9d-58ea-4c21-a5d8-592280d773e3 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:27.705213 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-52d57c9d-58ea-4c21-a5d8-592280d773e3 None None] For port c66388ff-7389-4791-9f4a-dc83e0728f21, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=c66388ff-7389-4791-9f4a-dc83e0728f21,segment=NetworkSegment(c52f7e89-4315-41f9-9d5a-5046f4cc1460),segment_id=c52f7e89-4315-41f9-9d5a-5046f4cc1460)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:34:27.706153 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-52d57c9d-58ea-4c21-a5d8-592280d773e3 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:27.717093 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8f763625-9d53-406f-9f05-2a657c6339b7 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:27.727233 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-52d57c9d-58ea-4c21-a5d8-592280d773e3 None None] Calling delete_port for c66388ff-7389-4791-9f4a-dc83e0728f21 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:34:27.804558 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 57996) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:27.844914 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-8f763625-9d53-406f-9f05-2a657c6339b7 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Deleting port c66388ff-7389-4791-9f4a-dc83e0728f21 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:34:27.845368 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8f763625-9d53-406f-9f05-2a657c6339b7 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:27.908152 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-8f763625-9d53-406f-9f05-2a657c6339b7 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] For port c66388ff-7389-4791-9f4a-dc83e0728f21, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=c66388ff-7389-4791-9f4a-dc83e0728f21,segment=NetworkSegment(c52f7e89-4315-41f9-9d5a-5046f4cc1460),segment_id=c52f7e89-4315-41f9-9d5a-5046f4cc1460)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:34:27.908805 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8f763625-9d53-406f-9f05-2a657c6339b7 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:27.921285 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-8f763625-9d53-406f-9f05-2a657c6339b7 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Calling delete_port for c66388ff-7389-4791-9f4a-dc83e0728f21 owned by network:dhcp {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:34:27.952253 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-667f8acb-58c5-4aed-9eca-90630babc437 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=4b395c2f9c4f482198ab37eb736cc2fe&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1463199 Nov 09 04:34:27.955321 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58000) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:27.960526 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-52d57c9d-58ea-4c21-a5d8-592280d773e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:27.972924 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a2a675be-386b-41e9-9959-0fb5a383b45f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:27.988564 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-34a82e2d-4e3b-43cd-a63e-8ed666974258 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:27.993032 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52d57c9d-58ea-4c21-a5d8-592280d773e3 None None] Pushing event deleted for resources: {'Port': ['ID=c66388ff-7389-4791-9f4a-dc83e0728f21,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:27.998405 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-52d57c9d-58ea-4c21-a5d8-592280d773e3 None None] No DVR routers for this DVR port c66388ff-7389-4791-9f4a-dc83e0728f21 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:34:28.014001 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2a675be-386b-41e9-9959-0fb5a383b45f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event deleted for resources: {'Port': ['ID=a6ff87c0-50a6-432e-8c6b-b24c7ebb8e2f,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:28.042630 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fa9a341c-8bff-413f-a658-5f6bbb089c84 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:28.067959 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a2a675be-386b-41e9-9959-0fb5a383b45f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:28.071409 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a2a675be-386b-41e9-9959-0fb5a383b45f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/ports/a6ff87c0-50a6-432e-8c6b-b24c7ebb8e2f HTTP/1.1" status: 204 len: 168 time: 1.6149404 Nov 09 04:34:28.071839 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fa9a341c-8bff-413f-a658-5f6bbb089c84 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:28.073922 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58002) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:28.078107 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8f763625-9d53-406f-9f05-2a657c6339b7 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:28.115140 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f763625-9d53-406f-9f05-2a657c6339b7 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Pushing event deleted for resources: {'Port': ['ID=c66388ff-7389-4791-9f4a-dc83e0728f21,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:28.133319 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8f763625-9d53-406f-9f05-2a657c6339b7 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] No DVR routers for this DVR port c66388ff-7389-4791-9f4a-dc83e0728f21 on host dv-neutron-816802-2-hyperv {{(pid=102161) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:34:28.157897 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-34a82e2d-4e3b-43cd-a63e-8ed666974258 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:28.226537 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4ab4724c-e12c-439b-bb76-d7f3eb13843b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:28.228121 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-4ab4724c-e12c-439b-bb76-d7f3eb13843b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1046 time: 0.1532338 Nov 09 04:34:28.234029 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-34a82e2d-4e3b-43cd-a63e-8ed666974258 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Network f3dca0a2-23fd-4413-908c-1d1ce4534d2d is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:34:28.236050 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58004) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:28.249218 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-34a82e2d-4e3b-43cd-a63e-8ed666974258 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:28.255759 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-34a82e2d-4e3b-43cd-a63e-8ed666974258 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:34:28.256329 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8f763625-9d53-406f-9f05-2a657c6339b7 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:28.261581 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-34a82e2d-4e3b-43cd-a63e-8ed666974258 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:28.262186 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-34a82e2d-4e3b-43cd-a63e-8ed666974258 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:28.262300 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 34b780e2-66dd-47ef-905a-81a9e32fdc2d up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:34:28.304013 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-8f763625-9d53-406f-9f05-2a657c6339b7 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3d535493-472d-4bfc-8052-c7d4e02f89c4']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:28.319622 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-8f763625-9d53-406f-9f05-2a657c6339b7 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c52f7e89-4315-41f9-9d5a-5046f4cc1460') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:28.319986 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-8f763625-9d53-406f-9f05-2a657c6339b7 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c52f7e89-4315-41f9-9d5a-5046f4cc1460') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:28.328461 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34a82e2d-4e3b-43cd-a63e-8ed666974258 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Pushing event updated for resources: {'Port': ['ID=064214d4-3958-4c1f-a454-5106eacc5956,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:28.345523 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8f763625-9d53-406f-9f05-2a657c6339b7 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:28.355352 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 34b780e2-66dd-47ef-905a-81a9e32fdc2d triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:28.355961 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:28.356780 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-22830eea-2d07-43fc-be1b-2b1d6a1db1d7 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:28.361014 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-22830eea-2d07-43fc-be1b-2b1d6a1db1d7 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1046 time: 0.1198199 Nov 09 04:34:28.361271 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8f763625-9d53-406f-9f05-2a657c6339b7 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:28.363583 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58006) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:28.368710 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8f763625-9d53-406f-9f05-2a657c6339b7 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Releasing vlan 346 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:34:28.369226 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8f763625-9d53-406f-9f05-2a657c6339b7 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:28.373488 dv-neutron-816802-2-hyperv neutron-server[102161]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:34:28.373488 dv-neutron-816802-2-hyperv neutron-server[102161]: self.session.flush() Nov 09 04:34:28.373488 dv-neutron-816802-2-hyperv neutron-server[102161]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:34:28.373488 dv-neutron-816802-2-hyperv neutron-server[102161]: self.session.flush() Nov 09 04:34:28.373488 dv-neutron-816802-2-hyperv neutron-server[102161]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:34:28.373488 dv-neutron-816802-2-hyperv neutron-server[102161]: self.session.flush() Nov 09 04:34:28.373488 dv-neutron-816802-2-hyperv neutron-server[102161]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:34:28.373488 dv-neutron-816802-2-hyperv neutron-server[102161]: self.session.flush() Nov 09 04:34:28.373488 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:34:28.373488 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:34:28.373488 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:34:28.373488 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:34:28.373488 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:34:28.373488 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:34:28.373488 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:34:28.373488 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:34:28.373488 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:34:28.373488 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:34:28.373488 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:34:28.373488 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:34:28.373488 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:34:28.373488 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:34:28.373488 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:34:28.373488 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:34:28.373488 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:34:28.373488 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:34:28.373488 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:34:28.373488 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:34:28.373488 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:34:28.373488 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:34:28.373488 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:34:28.373488 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:34:28.373488 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:34:28.373488 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:34:28.373488 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:34:28.373488 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:34:28.373488 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:34:28.373488 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:34:28.373488 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:34:28.373488 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:34:28.397949 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-34a82e2d-4e3b-43cd-a63e-8ed666974258 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1149 time: 1.5785491 Nov 09 04:34:28.398949 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58008) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:28.402186 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fa9a341c-8bff-413f-a658-5f6bbb089c84 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:28.405447 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fa9a341c-8bff-413f-a658-5f6bbb089c84 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:28.406602 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-fa9a341c-8bff-413f-a658-5f6bbb089c84 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/56c8c1bd-4969-470a-9b70-2b8aa84c9ba1 HTTP/1.1" status: 204 len: 168 time: 0.4501877 Nov 09 04:34:28.451317 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa9a341c-8bff-413f-a658-5f6bbb089c84 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=56c8c1bd-4969-470a-9b70-2b8aa84c9ba1,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:28.470473 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7f159f8d-b38b-4264-8205-df7b5cc14886 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:28.472530 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7f159f8d-b38b-4264-8205-df7b5cc14886 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:28.474645 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7f159f8d-b38b-4264-8205-df7b5cc14886 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:28.476420 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-7f159f8d-b38b-4264-8205-df7b5cc14886 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2097 time: 0.1140792 Nov 09 04:34:28.481246 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58012) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:28.496324 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:28.500106 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-24e6edc9-55d3-4ff4-87f7-258cac6971c1 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:28.506634 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-24e6edc9-55d3-4ff4-87f7-258cac6971c1 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:28.512896 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-24e6edc9-55d3-4ff4-87f7-258cac6971c1 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:28.518137 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-24e6edc9-55d3-4ff4-87f7-258cac6971c1 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] 10.222.0.24 "GET /v2.0/ports HTTP/1.1" status: 200 len: 2620 time: 0.1101084 Nov 09 04:34:28.518794 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58014) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:28.542164 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 34b780e2-66dd-47ef-905a-81a9e32fdc2d, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=34b780e2-66dd-47ef-905a-81a9e32fdc2d,segment=NetworkSegment(71d738f6-3812-4ad6-9cb8-aaf5a45f2bed),segment_id=71d738f6-3812-4ad6-9cb8-aaf5a45f2bed)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:34:28.552075 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8f763625-9d53-406f-9f05-2a657c6339b7 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:28.556895 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8f763625-9d53-406f-9f05-2a657c6339b7 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:28.560516 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-8f763625-9d53-406f-9f05-2a657c6339b7 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] 10.222.0.24 "DELETE /v2.0/networks/3d535493-472d-4bfc-8052-c7d4e02f89c4 HTTP/1.1" status: 204 len: 168 time: 1.3263519 Nov 09 04:34:28.588720 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:28.588877 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-0882202b-6b18-45df-b32b-ab72a6b73cb8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Deleting subnet 130970a8-ae23-4805-a6d6-fd396bb5daaa {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:34:28.601534 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f763625-9d53-406f-9f05-2a657c6339b7 tempest-TagsExtTest-109032836 tempest-TagsExtTest-109032836-project] Pushing event deleted for resources: {'Network': ['ID=3d535493-472d-4bfc-8052-c7d4e02f89c4,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:28.609782 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0882202b-6b18-45df-b32b-ab72a6b73cb8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:28.671127 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0882202b-6b18-45df-b32b-ab72a6b73cb8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:28.678122 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-3ae72611-b9d7-46fc-ab0d-41e84347d173 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Deleting port 064214d4-3958-4c1f-a454-5106eacc5956 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:34:28.678122 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3ae72611-b9d7-46fc-ab0d-41e84347d173 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:28.683229 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device c66388ff-7389-4791-9f4a-dc83e0728f21 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:34:28.729679 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d563aa07-0527-4650-aae9-86353f02eeb2 None None] Network f3dca0a2-23fd-4413-908c-1d1ce4534d2d requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:34:28.733432 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: c66388ff-7389-4791-9f4a-dc83e0728f21 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:34:28.733776 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device c66388ff-7389-4791-9f4a-dc83e0728f21 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:34:28.754192 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=34b780e2-66dd-47ef-905a-81a9e32fdc2d,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:28.785457 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0882202b-6b18-45df-b32b-ab72a6b73cb8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:28.807411 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3ae72611-b9d7-46fc-ab0d-41e84347d173 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:28.827062 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-3ae72611-b9d7-46fc-ab0d-41e84347d173 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Calling delete_port for 064214d4-3958-4c1f-a454-5106eacc5956 owned by {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:34:28.832093 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-7d963e86-8b0d-4614-abcb-801337c942e4 None None] Provisioning complete for port 34b780e2-66dd-47ef-905a-81a9e32fdc2d triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:28.832985 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7d963e86-8b0d-4614-abcb-801337c942e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:28.959835 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0882202b-6b18-45df-b32b-ab72a6b73cb8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:28.995863 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0882202b-6b18-45df-b32b-ab72a6b73cb8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event deleted for resources: {'Subnet': ['ID=130970a8-ae23-4805-a6d6-fd396bb5daaa,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:28.998080 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0882202b-6b18-45df-b32b-ab72a6b73cb8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:29.004467 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-0882202b-6b18-45df-b32b-ab72a6b73cb8 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/130970a8-ae23-4805-a6d6-fd396bb5daaa HTTP/1.1" status: 204 len: 168 time: 0.5106683 Nov 09 04:34:29.010577 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58026) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:29.010899 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9e8ba898-60a0-4691-874f-d3f1da86501f None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:34:29.051543 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3ae72611-b9d7-46fc-ab0d-41e84347d173 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:29.075528 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-1c79c458-83e3-4ba9-87c6-254ae66bfe76 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Deleting subnet 50ce8657-2443-4724-ac81-7f3884a6c040 {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:34:29.082724 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1c79c458-83e3-4ba9-87c6-254ae66bfe76 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:29.102383 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ae72611-b9d7-46fc-ab0d-41e84347d173 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Pushing event deleted for resources: {'Port': ['ID=064214d4-3958-4c1f-a454-5106eacc5956,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:29.170414 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1c79c458-83e3-4ba9-87c6-254ae66bfe76 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:29.176343 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3ae72611-b9d7-46fc-ab0d-41e84347d173 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:29.179660 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-3ae72611-b9d7-46fc-ab0d-41e84347d173 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] 10.222.0.24 "DELETE /v2.0/ports/064214d4-3958-4c1f-a454-5106eacc5956 HTTP/1.1" status: 204 len: 168 time: 0.6599233 Nov 09 04:34:29.184745 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58032) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:29.189774 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-a81300a6-7902-4e74-8eb9-2b8da2ae162f tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Request body: {'port': {'name': 'tempest-new-port-name-1550731705', 'extra_dhcp_opts': [{'opt_value': 'pxelinux.0', 'opt_name': 'bootfile-name'}, {'opt_value': '2015::dead', 'opt_name': 'tftp-server'}, {'opt_value': '2015::badd', 'opt_name': 'server-ip-address'}]}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:29.199689 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.api.validators [None req-a81300a6-7902-4e74-8eb9-2b8da2ae162f tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] bootfile-name is not in valid_values {{(pid=102162) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Nov 09 04:34:29.200035 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.api.validators [None req-a81300a6-7902-4e74-8eb9-2b8da2ae162f tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] tftp-server is not in valid_values {{(pid=102162) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Nov 09 04:34:29.200361 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.api.validators [None req-a81300a6-7902-4e74-8eb9-2b8da2ae162f tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] server-ip-address is not in valid_values {{(pid=102162) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Nov 09 04:34:29.265080 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58034) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:29.335312 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a81300a6-7902-4e74-8eb9-2b8da2ae162f tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:29.373734 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1c79c458-83e3-4ba9-87c6-254ae66bfe76 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:29.535570 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-feadfcae-febd-46bf-ba75-5c8f2ddb28d9 None None] Provisioning complete for port bc4c2b89-b97b-4327-a3db-c381c85b495b triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:29.537715 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-feadfcae-febd-46bf-ba75-5c8f2ddb28d9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:29.567031 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1c79c458-83e3-4ba9-87c6-254ae66bfe76 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:29.603297 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-637c92b0-4746-449d-b6b2-2f7472a71aa0 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=55a3a2a687314dd0b62b3503ab15218e&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3286340 Nov 09 04:34:29.604360 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58042) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:29.606040 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1c79c458-83e3-4ba9-87c6-254ae66bfe76 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:29.616525 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1c79c458-83e3-4ba9-87c6-254ae66bfe76 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/50ce8657-2443-4724-ac81-7f3884a6c040 HTTP/1.1" status: 204 len: 168 time: 0.6070201 Nov 09 04:34:29.618220 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58044) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:29.696868 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-feadfcae-febd-46bf-ba75-5c8f2ddb28d9 None None] Port bc4c2b89-b97b-4327-a3db-c381c85b495b cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:34:29.702091 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2408f8ad-57fd-4a5e-aefa-e9d064412879 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:29.714246 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-feadfcae-febd-46bf-ba75-5c8f2ddb28d9 None None] Provisioning complete for port 34b780e2-66dd-47ef-905a-81a9e32fdc2d triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:29.714825 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-feadfcae-febd-46bf-ba75-5c8f2ddb28d9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:29.742235 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a81300a6-7902-4e74-8eb9-2b8da2ae162f tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:29.747594 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2408f8ad-57fd-4a5e-aefa-e9d064412879 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:29.756721 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-f573e505-f10a-4f34-8688-bb965b54919b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1322978 Nov 09 04:34:29.758634 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c79c458-83e3-4ba9-87c6-254ae66bfe76 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event deleted for resources: {'Subnet': ['ID=50ce8657-2443-4724-ac81-7f3884a6c040,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:29.775409 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58048) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:29.775409 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-254c7999-50a4-4cfb-a9f2-f9fe58f413b2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'subnet': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:29.826580 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a81300a6-7902-4e74-8eb9-2b8da2ae162f tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:29.843440 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-feadfcae-febd-46bf-ba75-5c8f2ddb28d9 None None] Could not find standard attr ID for object 064214d4-3958-4c1f-a454-5106eacc5956. {{(pid=102163) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 09 04:34:29.868303 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-a81300a6-7902-4e74-8eb9-2b8da2ae162f tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] In _notify_port_updated(), no bound segment for port bc4c2b89-b97b-4327-a3db-c381c85b495b on network f3dca0a2-23fd-4413-908c-1d1ce4534d2d {{(pid=102162) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 09 04:34:29.875557 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a81300a6-7902-4e74-8eb9-2b8da2ae162f tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:29.876360 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a81300a6-7902-4e74-8eb9-2b8da2ae162f tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:29.880193 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a81300a6-7902-4e74-8eb9-2b8da2ae162f tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] 10.222.0.24 "PUT /v2.0/ports/bc4c2b89-b97b-4327-a3db-c381c85b495b HTTP/1.1" status: 200 len: 1130 time: 0.6928716 Nov 09 04:34:29.881497 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58052) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:29.950020 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a81300a6-7902-4e74-8eb9-2b8da2ae162f tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Pushing event updated for resources: {'Port': ['ID=bc4c2b89-b97b-4327-a3db-c381c85b495b,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:29.959552 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-842f29f8-66d1-456a-90f4-ed638bdce0e4 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:29.961241 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-842f29f8-66d1-456a-90f4-ed638bdce0e4 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] 10.222.0.24 "GET /v2.0/ports/bc4c2b89-b97b-4327-a3db-c381c85b495b HTTP/1.1" status: 200 len: 1130 time: 0.0786960 Nov 09 04:34:29.964893 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58054) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:29.974976 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-f37b0cba-138d-49b5-b290-f30409046b9f None None] Provisioning complete for port bc4c2b89-b97b-4327-a3db-c381c85b495b triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:29.978796 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f37b0cba-138d-49b5-b290-f30409046b9f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:29.994225 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-254c7999-50a4-4cfb-a9f2-f9fe58f413b2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:34:29.998115 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-254c7999-50a4-4cfb-a9f2-f9fe58f413b2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:30.014177 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2408f8ad-57fd-4a5e-aefa-e9d064412879 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:30.017561 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2408f8ad-57fd-4a5e-aefa-e9d064412879 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:30.019141 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-2408f8ad-57fd-4a5e-aefa-e9d064412879 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/9c0e1413-b89d-45f4-a23d-fc5da36a098f HTTP/1.1" status: 204 len: 168 time: 0.4139612 Nov 09 04:34:30.023105 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58056) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:30.045933 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2408f8ad-57fd-4a5e-aefa-e9d064412879 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9c0e1413-b89d-45f4-a23d-fc5da36a098f,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:30.092821 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-f37b0cba-138d-49b5-b290-f30409046b9f None None] Port bc4c2b89-b97b-4327-a3db-c381c85b495b cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:34:30.199555 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-09566016-74d3-4ae3-97cf-4f6af4616120 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Deleting port bc4c2b89-b97b-4327-a3db-c381c85b495b {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:34:30.203395 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-09566016-74d3-4ae3-97cf-4f6af4616120 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:30.207674 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 34b780e2-66dd-47ef-905a-81a9e32fdc2d up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:34:30.258803 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-ec21e149-b1ea-45e9-bc60-dc3ede94227c tempest-TagsTest-125930264 tempest-TagsTest-125930264-project] Request body: {'network': {'name': 'tempest-TagsTest-test-network-1159549160'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:30.303384 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 34b780e2-66dd-47ef-905a-81a9e32fdc2d triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:30.304015 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:30.342257 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-a667d576-33b8-45d2-90bb-3b040e5b7893 None None] Could not find standard attr ID for object 064214d4-3958-4c1f-a454-5106eacc5956. {{(pid=102163) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 09 04:34:30.385997 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-09566016-74d3-4ae3-97cf-4f6af4616120 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:30.411139 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-09566016-74d3-4ae3-97cf-4f6af4616120 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Calling delete_port for bc4c2b89-b97b-4327-a3db-c381c85b495b owned by {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:34:30.411993 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-254c7999-50a4-4cfb-a9f2-f9fe58f413b2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:30.424345 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ec21e149-b1ea-45e9-bc60-dc3ede94227c tempest-TagsTest-125930264 tempest-TagsTest-125930264-project] Made reservation on behalf of 5fa3cf1d322d465cbbd0158aeb973a08 for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:34:30.429570 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6a9708a6-5b72-440a-8ed4-18b1233e113e None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:34:30.430436 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ec21e149-b1ea-45e9-bc60-dc3ede94227c tempest-TagsTest-125930264 tempest-TagsTest-125930264-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:30.444363 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ec21e149-b1ea-45e9-bc60-dc3ede94227c tempest-TagsTest-125930264 tempest-TagsTest-125930264-project] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:30.470817 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-254c7999-50a4-4cfb-a9f2-f9fe58f413b2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:34:30.475909 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-254c7999-50a4-4cfb-a9f2-f9fe58f413b2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:30.480370 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-254c7999-50a4-4cfb-a9f2-f9fe58f413b2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:30.480965 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-254c7999-50a4-4cfb-a9f2-f9fe58f413b2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:30.512535 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-2022c532-55cc-4e0d-87dc-71f4432caa32 None None] Provisioning complete for port 81841961-1f66-4bbf-ab3a-2646a1326e8d triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:30.512901 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-2022c532-55cc-4e0d-87dc-71f4432caa32 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:30.521984 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-254c7999-50a4-4cfb-a9f2-f9fe58f413b2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Subnet': ['ID=c75722ae-79c1-4a08-89c6-49b2fbc88741,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:30.605492 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-254c7999-50a4-4cfb-a9f2-f9fe58f413b2 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 0.8366997 Nov 09 04:34:30.605661 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58064) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:30.611657 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-7a28a8b6-07b2-42c9-88cf-eecdad878064 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'subnet': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:30.789927 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-afcd1c0c-53b4-41f7-aa48-73179827ad0c None None] Update dhcp port {'port': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'fixed_ips': [{'subnet_id': 'c75722ae-79c1-4a08-89c6-49b2fbc88741'}], 'binding:host_id': 'dv-neutron-816802-2-hyperv'}, 'id': '81841961-1f66-4bbf-ab3a-2646a1326e8d'} from dv-neutron-816802-2-hyperv. {{(pid=102163) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:328}} Nov 09 04:34:30.818507 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-afcd1c0c-53b4-41f7-aa48-73179827ad0c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:30.956838 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-529c3fc4-a285-40f2-a4ce-910c3c52844e None None] Provisioning complete for port bc4c2b89-b97b-4327-a3db-c381c85b495b triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:30.957124 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-529c3fc4-a285-40f2-a4ce-910c3c52844e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:31.011104 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ec21e149-b1ea-45e9-bc60-dc3ede94227c tempest-TagsTest-125930264 tempest-TagsTest-125930264-project] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:31.023030 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-529c3fc4-a285-40f2-a4ce-910c3c52844e None None] Port bc4c2b89-b97b-4327-a3db-c381c85b495b cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:34:31.029546 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-afcd1c0c-53b4-41f7-aa48-73179827ad0c None None] Allocated IP 2001:db8::2 (988d2354-693c-4d52-af17-25e0643eaa0c/c75722ae-79c1-4a08-89c6-49b2fbc88741/81841961-1f66-4bbf-ab3a-2646a1326e8d) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:34:31.125400 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-afcd1c0c-53b4-41f7-aa48-73179827ad0c None None] For port 81841961-1f66-4bbf-ab3a-2646a1326e8d, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=81841961-1f66-4bbf-ab3a-2646a1326e8d,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:34:31.131608 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ec21e149-b1ea-45e9-bc60-dc3ede94227c tempest-TagsTest-125930264 tempest-TagsTest-125930264-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:31.141801 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-09566016-74d3-4ae3-97cf-4f6af4616120 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:31.158165 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-afcd1c0c-53b4-41f7-aa48-73179827ad0c None None] Publish callbacks [] for port, precommit_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:31.183460 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7a28a8b6-07b2-42c9-88cf-eecdad878064 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:34:31.186957 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7a28a8b6-07b2-42c9-88cf-eecdad878064 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:31.192385 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ec21e149-b1ea-45e9-bc60-dc3ede94227c tempest-TagsTest-125930264 tempest-TagsTest-125930264-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 345} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:34:31.212217 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09566016-74d3-4ae3-97cf-4f6af4616120 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Pushing event deleted for resources: {'Port': ['ID=bc4c2b89-b97b-4327-a3db-c381c85b495b,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:31.239697 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-afcd1c0c-53b4-41f7-aa48-73179827ad0c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:31.251742 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec21e149-b1ea-45e9-bc60-dc3ede94227c tempest-TagsTest-125930264 tempest-TagsTest-125930264-project] Pushing event updated for resources: {'SecurityGroup': ['ID=a8bbdd68-2c37-4ad7-ae8e-69612e7c8cf1,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:31.255866 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ec21e149-b1ea-45e9-bc60-dc3ede94227c tempest-TagsTest-125930264 tempest-TagsTest-125930264-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:31.256211 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-ec21e149-b1ea-45e9-bc60-dc3ede94227c tempest-TagsTest-125930264 tempest-TagsTest-125930264-project] Added segment 3d288f36-c63f-425d-ac99-8b68151af06d of type vlan for network 01e67f61-46db-45bb-b406-0d70365edaf8 Nov 09 04:34:31.300560 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-09566016-74d3-4ae3-97cf-4f6af4616120 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:31.303867 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-09566016-74d3-4ae3-97cf-4f6af4616120 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] 10.222.0.24 "DELETE /v2.0/ports/bc4c2b89-b97b-4327-a3db-c381c85b495b HTTP/1.1" status: 204 len: 168 time: 1.3377576 Nov 09 04:34:31.306387 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58082) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:31.332756 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afcd1c0c-53b4-41f7-aa48-73179827ad0c None None] Pushing event updated for resources: {'Port': ['ID=81841961-1f66-4bbf-ab3a-2646a1326e8d,revision_number=8']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:31.391883 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-ab82a281-3649-45f1-82c9-7ded23d5b3d4 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Deleting subnet c3333d58-7e3b-4a31-9afb-cafbfe8b7e0e {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:34:31.395598 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ab82a281-3649-45f1-82c9-7ded23d5b3d4 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:31.410105 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58084) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:31.440857 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ec21e149-b1ea-45e9-bc60-dc3ede94227c tempest-TagsTest-125930264 tempest-TagsTest-125930264-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:31.457318 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.ipam_backend_mixin [None req-7a28a8b6-07b2-42c9-88cf-eecdad878064 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet c75722ae-79c1-4a08-89c6-49b2fbc88741 (CIDR: 2001:db8::/64) Nov 09 04:34:31.457522 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ab82a281-3649-45f1-82c9-7ded23d5b3d4 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:31.503954 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-7a28a8b6-07b2-42c9-88cf-eecdad878064 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:34:31.504337 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-7a28a8b6-07b2-42c9-88cf-eecdad878064 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:31.542775 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ec21e149-b1ea-45e9-bc60-dc3ede94227c tempest-TagsTest-125930264 tempest-TagsTest-125930264-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:31.549632 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ec21e149-b1ea-45e9-bc60-dc3ede94227c tempest-TagsTest-125930264 tempest-TagsTest-125930264-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:31.552895 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ec21e149-b1ea-45e9-bc60-dc3ede94227c tempest-TagsTest-125930264 tempest-TagsTest-125930264-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:31.564094 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ab82a281-3649-45f1-82c9-7ded23d5b3d4 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:31.589342 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-367ea6d3-0e65-4a04-b1da-a65b957a8b20 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-1675179943-network', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:31.605751 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-7a28a8b6-07b2-42c9-88cf-eecdad878064 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.9960880 Nov 09 04:34:31.606281 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58088) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:31.614997 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-0ea675c5-4125-41b5-8856-1dfc85b7bc74 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'subnet': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:31.640259 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec21e149-b1ea-45e9-bc60-dc3ede94227c tempest-TagsTest-125930264 tempest-TagsTest-125930264-project] Pushing event updated for resources: {'Network': ['ID=01e67f61-46db-45bb-b406-0d70365edaf8,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:31.651010 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 01e67f61-46db-45bb-b406-0d70365edaf8 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:34:31.698735 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-ec21e149-b1ea-45e9-bc60-dc3ede94227c tempest-TagsTest-125930264 tempest-TagsTest-125930264-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 776 time: 1.6712341 Nov 09 04:34:31.701949 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58090) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:31.709412 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.tag.tag_plugin [None req-3afb2aa6-2349-41e9-9b60-16a3b75b0d8f tempest-TagsTest-125930264 tempest-TagsTest-125930264-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'networks', '01e67f61-46db-45bb-b406-0d70365edaf8', 'tempest-TagsTest-Tag-2104813122') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:31.753961 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-367ea6d3-0e65-4a04-b1da-a65b957a8b20 admin admin] Made reservation on behalf of f636e5f4c9f64f69ba3b2ab8816b6096 for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:34:31.759476 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-367ea6d3-0e65-4a04-b1da-a65b957a8b20 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:31.767510 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-367ea6d3-0e65-4a04-b1da-a65b957a8b20 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:31.827932 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ab82a281-3649-45f1-82c9-7ded23d5b3d4 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:31.864910 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ab82a281-3649-45f1-82c9-7ded23d5b3d4 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:31.868921 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-ab82a281-3649-45f1-82c9-7ded23d5b3d4 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] 10.222.0.24 "DELETE /v2.0/subnets/c3333d58-7e3b-4a31-9afb-cafbfe8b7e0e HTTP/1.1" status: 204 len: 168 time: 0.5608644 Nov 09 04:34:31.870318 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab82a281-3649-45f1-82c9-7ded23d5b3d4 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Pushing event deleted for resources: {'Subnet': ['ID=c3333d58-7e3b-4a31-9afb-cafbfe8b7e0e,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:31.873617 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58092) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:31.876561 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0ea675c5-4125-41b5-8856-1dfc85b7bc74 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:34:31.880639 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0ea675c5-4125-41b5-8856-1dfc85b7bc74 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:31.893093 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ce23b538-883a-4e9e-b10c-272b1fc96e61 None None] Network f3dca0a2-23fd-4413-908c-1d1ce4534d2d requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:34:31.991285 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-147b1a36-9cd1-42f6-849f-47c461a9fbac tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:32.004757 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-3afb2aa6-2349-41e9-9b60-16a3b75b0d8f tempest-TagsTest-125930264 tempest-TagsTest-125930264-project] 10.222.0.24 "PUT /v2.0/networks/01e67f61-46db-45bb-b406-0d70365edaf8/tags/tempest-TagsTest-Tag-2104813122 HTTP/1.1" status: 201 len: 201 time: 0.2992752 Nov 09 04:34:32.008841 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58094) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:32.018496 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.tag.tag_plugin [None req-94011597-4587-49f7-adea-7e08349ed80d tempest-TagsTest-125930264 tempest-TagsTest-125930264-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'networks', '01e67f61-46db-45bb-b406-0d70365edaf8', 'tempest-TagsTest-Tag-2104813122') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:32.039029 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-367ea6d3-0e65-4a04-b1da-a65b957a8b20 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:32.115479 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-367ea6d3-0e65-4a04-b1da-a65b957a8b20 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:32.136449 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9d05c107-77cd-432a-af00-d01aab450057 None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:34:32.155526 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-367ea6d3-0e65-4a04-b1da-a65b957a8b20 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 310} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:34:32.175440 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-94011597-4587-49f7-adea-7e08349ed80d tempest-TagsTest-125930264 tempest-TagsTest-125930264-project] 10.222.0.24 "GET /v2.0/networks/01e67f61-46db-45bb-b406-0d70365edaf8/tags/tempest-TagsTest-Tag-2104813122 HTTP/1.1" status: 204 len: 168 time: 0.1624770 Nov 09 04:34:32.176354 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-367ea6d3-0e65-4a04-b1da-a65b957a8b20 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=311e8aaf-5444-4ebd-be1d-d97abb7a470e,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:32.177293 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-95ab56f1-faf4-4af8-b8c6-91bed57d3af6 None None] DHCP port deletion for f3dca0a2-23fd-4413-908c-1d1ce4534d2d request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:34:32.179662 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58096) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:32.187624 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.tag.tag_plugin [None req-9a74e066-c91c-46a3-a1e2-599d9c92b666 tempest-TagsTest-125930264 tempest-TagsTest-125930264-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'networks', '01e67f61-46db-45bb-b406-0d70365edaf8') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:32.190947 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-367ea6d3-0e65-4a04-b1da-a65b957a8b20 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:32.191293 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-367ea6d3-0e65-4a04-b1da-a65b957a8b20 admin admin] Added segment bc4577c9-06a5-450a-9c80-879827986f04 of type vlan for network 999b1b20-f8fc-4caf-84cc-3feda426a0bf Nov 09 04:34:32.224259 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 81841961-1f66-4bbf-ab3a-2646a1326e8d up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:34:32.236571 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-367ea6d3-0e65-4a04-b1da-a65b957a8b20 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:32.269060 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-3d630bf5-e218-44e2-b6d2-7d83abeb7a88 None None] Provisioning complete for port 81841961-1f66-4bbf-ab3a-2646a1326e8d triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:32.269444 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3d630bf5-e218-44e2-b6d2-7d83abeb7a88 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:32.274086 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-147b1a36-9cd1-42f6-849f-47c461a9fbac tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Deleting port 34b780e2-66dd-47ef-905a-81a9e32fdc2d {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:34:32.274086 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-147b1a36-9cd1-42f6-849f-47c461a9fbac tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:32.296138 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-9a74e066-c91c-46a3-a1e2-599d9c92b666 tempest-TagsTest-125930264 tempest-TagsTest-125930264-project] 10.222.0.24 "GET /v2.0/networks/01e67f61-46db-45bb-b406-0d70365edaf8/tags HTTP/1.1" status: 200 len: 238 time: 0.1142206 Nov 09 04:34:32.296741 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58098) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:32.303840 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.tag.tag_plugin [None req-1e45fd71-c7df-465e-a4c5-e1a4516420b9 tempest-TagsTest-125930264 tempest-TagsTest-125930264-project] neutron.services.tag.tag_plugin.TagPlugin method update_tags called with arguments (, 'networks', '01e67f61-46db-45bb-b406-0d70365edaf8', {'tags': ['tempest-TagsTest-Tag-1459910825', 'tempest-TagsTest-Tag-756318724', 'tempest-TagsTest-Tag-553478168']}) {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:32.337923 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-367ea6d3-0e65-4a04-b1da-a65b957a8b20 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:32.339778 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-367ea6d3-0e65-4a04-b1da-a65b957a8b20 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:32.340714 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-367ea6d3-0e65-4a04-b1da-a65b957a8b20 admin admin] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:32.414346 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-95ab56f1-faf4-4af8-b8c6-91bed57d3af6 None None] Deleting port 34b780e2-66dd-47ef-905a-81a9e32fdc2d {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:34:32.415728 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-95ab56f1-faf4-4af8-b8c6-91bed57d3af6 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:32.417187 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-147b1a36-9cd1-42f6-849f-47c461a9fbac tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] For port 34b780e2-66dd-47ef-905a-81a9e32fdc2d, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=34b780e2-66dd-47ef-905a-81a9e32fdc2d,segment=NetworkSegment(71d738f6-3812-4ad6-9cb8-aaf5a45f2bed),segment_id=71d738f6-3812-4ad6-9cb8-aaf5a45f2bed)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:34:32.417750 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-147b1a36-9cd1-42f6-849f-47c461a9fbac tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:32.432795 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.objects.ports [None req-0ea675c5-4125-41b5-8856-1dfc85b7bc74 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=102161) get_objects /opt/stack/neutron/neutron/objects/ports.py:444}} Nov 09 04:34:32.435774 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 81841961-1f66-4bbf-ab3a-2646a1326e8d triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:32.436138 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:32.466144 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-367ea6d3-0e65-4a04-b1da-a65b957a8b20 admin admin] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 1.0520418 Nov 09 04:34:32.472880 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-147b1a36-9cd1-42f6-849f-47c461a9fbac tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Calling delete_port for 34b780e2-66dd-47ef-905a-81a9e32fdc2d owned by network:dhcp {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:34:32.474392 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58100) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:32.479133 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-0bf0ff81-a6e9-4e02-8f3c-c7eb4d428a48 admin admin] Request body: {'subnet': {'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-1675179943-subnet', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'ip_version': 4}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:32.488955 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-367ea6d3-0e65-4a04-b1da-a65b957a8b20 admin admin] Pushing event updated for resources: {'Network': ['ID=999b1b20-f8fc-4caf-84cc-3feda426a0bf,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:32.532965 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 999b1b20-f8fc-4caf-84cc-3feda426a0bf details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:34:32.564242 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1e45fd71-c7df-465e-a4c5-e1a4516420b9 tempest-TagsTest-125930264 tempest-TagsTest-125930264-project] 10.222.0.24 "PUT /v2.0/networks/01e67f61-46db-45bb-b406-0d70365edaf8/tags HTTP/1.1" status: 200 len: 307 time: 0.2602086 Nov 09 04:34:32.564413 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58102) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:32.573562 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.tag.tag_plugin [None req-cf2e5852-1c7a-47ef-b04b-d38eef10f3c3 tempest-TagsTest-125930264 tempest-TagsTest-125930264-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tag called with arguments (, 'networks', '01e67f61-46db-45bb-b406-0d70365edaf8', 'tempest-TagsTest-Tag-1459910825') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:32.589997 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-95ab56f1-faf4-4af8-b8c6-91bed57d3af6 None None] For port 34b780e2-66dd-47ef-905a-81a9e32fdc2d, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=34b780e2-66dd-47ef-905a-81a9e32fdc2d,segment=NetworkSegment(71d738f6-3812-4ad6-9cb8-aaf5a45f2bed),segment_id=71d738f6-3812-4ad6-9cb8-aaf5a45f2bed)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:34:32.590410 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-95ab56f1-faf4-4af8-b8c6-91bed57d3af6 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:32.632897 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-95ab56f1-faf4-4af8-b8c6-91bed57d3af6 None None] Calling delete_port for 34b780e2-66dd-47ef-905a-81a9e32fdc2d owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:34:32.652685 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0bf0ff81-a6e9-4e02-8f3c-c7eb4d428a48 admin admin] Made reservation on behalf of f636e5f4c9f64f69ba3b2ab8816b6096 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:34:32.655084 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0bf0ff81-a6e9-4e02-8f3c-c7eb4d428a48 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:32.722418 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0ea675c5-4125-41b5-8856-1dfc85b7bc74 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:32.749388 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-147b1a36-9cd1-42f6-849f-47c461a9fbac tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:32.789009 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-147b1a36-9cd1-42f6-849f-47c461a9fbac tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Pushing event deleted for resources: {'Port': ['ID=34b780e2-66dd-47ef-905a-81a9e32fdc2d,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:32.789278 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9bbc7442-007c-49d8-ab0b-664038dab171 None None] Update dhcp port {'port': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'fixed_ips': [{'subnet_id': 'c75722ae-79c1-4a08-89c6-49b2fbc88741', 'ip_address': '2001:db8::2'}, {'subnet_id': 'a7dd38a8-a6e2-475e-a43c-746ce6a4f555'}], 'binding:host_id': 'dv-neutron-816802-2-hyperv'}, 'id': '81841961-1f66-4bbf-ab3a-2646a1326e8d'} from dv-neutron-816802-2-hyperv. {{(pid=102163) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:328}} Nov 09 04:34:32.791240 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-147b1a36-9cd1-42f6-849f-47c461a9fbac tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] No DVR routers for this DVR port 34b780e2-66dd-47ef-905a-81a9e32fdc2d on host dv-neutron-816802-2-hyperv {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:34:32.825910 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-95ab56f1-faf4-4af8-b8c6-91bed57d3af6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:32.827686 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9bbc7442-007c-49d8-ab0b-664038dab171 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:32.840215 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-cf2e5852-1c7a-47ef-b04b-d38eef10f3c3 tempest-TagsTest-125930264 tempest-TagsTest-125930264-project] 10.222.0.24 "DELETE /v2.0/networks/01e67f61-46db-45bb-b406-0d70365edaf8/tags/tempest-TagsTest-Tag-1459910825 HTTP/1.1" status: 204 len: 168 time: 0.2752385 Nov 09 04:34:32.846084 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58104) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:32.852173 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.tag.tag_plugin [None req-8900e88d-0b79-4317-87f1-d114cd39fd8a tempest-TagsTest-125930264 tempest-TagsTest-125930264-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'networks', '01e67f61-46db-45bb-b406-0d70365edaf8', 'tempest-TagsTest-Tag-1459910825') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:32.867355 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-95ab56f1-faf4-4af8-b8c6-91bed57d3af6 None None] No DVR routers for this DVR port 34b780e2-66dd-47ef-905a-81a9e32fdc2d on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:34:32.871375 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95ab56f1-faf4-4af8-b8c6-91bed57d3af6 None None] Pushing event deleted for resources: {'Port': ['ID=34b780e2-66dd-47ef-905a-81a9e32fdc2d,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:32.926431 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-0ea675c5-4125-41b5-8856-1dfc85b7bc74 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] For port 81841961-1f66-4bbf-ab3a-2646a1326e8d, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=81841961-1f66-4bbf-ab3a-2646a1326e8d,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:34:32.962701 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0ea675c5-4125-41b5-8856-1dfc85b7bc74 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:32.980425 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-147b1a36-9cd1-42f6-849f-47c461a9fbac tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:33.015286 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-147b1a36-9cd1-42f6-849f-47c461a9fbac tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f3dca0a2-23fd-4413-908c-1d1ce4534d2d']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:33.051621 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-147b1a36-9cd1-42f6-849f-47c461a9fbac tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '71d738f6-3812-4ad6-9cb8-aaf5a45f2bed') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:33.051836 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-147b1a36-9cd1-42f6-849f-47c461a9fbac tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '71d738f6-3812-4ad6-9cb8-aaf5a45f2bed') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:33.057209 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0ea675c5-4125-41b5-8856-1dfc85b7bc74 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:33.058070 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0ea675c5-4125-41b5-8856-1dfc85b7bc74 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:33.063529 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-147b1a36-9cd1-42f6-849f-47c461a9fbac tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:33.078162 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.api.v2.resource [None req-8900e88d-0b79-4317-87f1-d114cd39fd8a tempest-TagsTest-125930264 tempest-TagsTest-125930264-project] show failed (client error): The resource could not be found. Nov 09 04:34:33.079252 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-8900e88d-0b79-4317-87f1-d114cd39fd8a tempest-TagsTest-125930264 tempest-TagsTest-125930264-project] 10.222.0.24 "GET /v2.0/networks/01e67f61-46db-45bb-b406-0d70365edaf8/tags/tempest-TagsTest-Tag-1459910825 HTTP/1.1" status: 404 len: 326 time: 0.2305212 Nov 09 04:34:33.082878 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-147b1a36-9cd1-42f6-849f-47c461a9fbac tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:33.084834 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58106) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:33.089288 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.tag.tag_plugin [None req-6a098f90-98c9-4e7a-a1dc-ef0bcd92c461 tempest-TagsTest-125930264 tempest-TagsTest-125930264-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'networks', '01e67f61-46db-45bb-b406-0d70365edaf8', 'tempest-TagsTest-Tag-756318724') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:33.094185 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0bf0ff81-a6e9-4e02-8f3c-c7eb4d428a48 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:33.109459 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-147b1a36-9cd1-42f6-849f-47c461a9fbac tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Releasing vlan 307 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:34:33.109854 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-147b1a36-9cd1-42f6-849f-47c461a9fbac tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:33.115422 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.db.api [None req-9bbc7442-007c-49d8-ab0b-664038dab171 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=102163) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:34:33.115782 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG oslo_db.api [None req-9bbc7442-007c-49d8-ab0b-664038dab171 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:34:33.116551 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:34:33.116551 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:34:33.116551 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:34:33.116551 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:34:33.116551 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:34:33.116551 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:34:33.116551 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:34:33.116551 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:34:33.116551 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:34:33.116551 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:34:33.116551 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:34:33.116551 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:34:33.116551 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:34:33.116551 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:34:33.116551 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:34:33.116551 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:34:33.116551 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:34:33.116551 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:34:33.116551 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:34:33.116551 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:34:33.116551 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:34:33.116551 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:34:33.116551 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:34:33.116551 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:34:33.116551 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:34:33.116551 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:34:33.116551 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:34:33.116551 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:34:33.116551 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:34:33.116551 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:34:33.116551 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:34:33.116551 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:34:33.127006 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0ea675c5-4125-41b5-8856-1dfc85b7bc74 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:34:33.137023 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-0ea675c5-4125-41b5-8856-1dfc85b7bc74 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:33.143498 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0ea675c5-4125-41b5-8856-1dfc85b7bc74 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:33.144091 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0ea675c5-4125-41b5-8856-1dfc85b7bc74 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:33.160217 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ea675c5-4125-41b5-8856-1dfc85b7bc74 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Subnet': ['ID=a7dd38a8-a6e2-475e-a43c-746ce6a4f555,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:33.167524 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ea675c5-4125-41b5-8856-1dfc85b7bc74 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Port': ['ID=81841961-1f66-4bbf-ab3a-2646a1326e8d,revision_number=10']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:33.228505 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bf0ff81-a6e9-4e02-8f3c-c7eb4d428a48 admin admin] Pushing event updated for resources: {'Subnet': ['ID=f6a08667-654b-4e0c-9f85-c6e6712cc239,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:33.236750 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-0ea675c5-4125-41b5-8856-1dfc85b7bc74 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 864 time: 1.6292629 Nov 09 04:34:33.239181 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58108) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:33.244210 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-39220c88-b72e-46f9-bee1-9eac8426cd9f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Request body: {'port': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'mac_address': 'fa:16:3e:d8:13:d1', 'name': 'tempest-NetworksTestDHCPv6-1652624733'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:33.275583 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0bf0ff81-a6e9-4e02-8f3c-c7eb4d428a48 admin admin] Checking segment: {'id': 'bc4577c9-06a5-450a-9c80-879827986f04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:34:33.275938 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0bf0ff81-a6e9-4e02-8f3c-c7eb4d428a48 admin admin] Network hostable DHCP agents. Network: 999b1b20-f8fc-4caf-84cc-3feda426a0bf, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:34:33.290854 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-6a098f90-98c9-4e7a-a1dc-ef0bcd92c461 tempest-TagsTest-125930264 tempest-TagsTest-125930264-project] 10.222.0.24 "GET /v2.0/networks/01e67f61-46db-45bb-b406-0d70365edaf8/tags/tempest-TagsTest-Tag-756318724 HTTP/1.1" status: 204 len: 168 time: 0.2047305 Nov 09 04:34:33.293270 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58110) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:33.297464 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.tag.tag_plugin [None req-50d27abb-2df0-4db7-953a-412cf62e2474 tempest-TagsTest-125930264 tempest-TagsTest-125930264-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'networks', '01e67f61-46db-45bb-b406-0d70365edaf8', 'tempest-TagsTest-Tag-553478168') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:33.318521 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-147b1a36-9cd1-42f6-849f-47c461a9fbac tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:33.323074 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-147b1a36-9cd1-42f6-849f-47c461a9fbac tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:33.326675 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-147b1a36-9cd1-42f6-849f-47c461a9fbac tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] 10.222.0.24 "DELETE /v2.0/networks/f3dca0a2-23fd-4413-908c-1d1ce4534d2d HTTP/1.1" status: 204 len: 168 time: 1.4518867 Nov 09 04:34:33.349747 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-147b1a36-9cd1-42f6-849f-47c461a9fbac tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849 tempest-ExtraDHCPOptionsIpV6TestJSON-1602558849-project] Pushing event deleted for resources: {'Network': ['ID=f3dca0a2-23fd-4413-908c-1d1ce4534d2d,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:33.388137 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0bf0ff81-a6e9-4e02-8f3c-c7eb4d428a48 admin admin] Network 999b1b20-f8fc-4caf-84cc-3feda426a0bf is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:34:33.405309 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-50d27abb-2df0-4db7-953a-412cf62e2474 tempest-TagsTest-125930264 tempest-TagsTest-125930264-project] 10.222.0.24 "GET /v2.0/networks/01e67f61-46db-45bb-b406-0d70365edaf8/tags/tempest-TagsTest-Tag-553478168 HTTP/1.1" status: 204 len: 168 time: 0.1110678 Nov 09 04:34:33.408354 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58114) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:33.412576 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.tag.tag_plugin [None req-abdab80c-479d-4b65-b358-8ba8899ac775 tempest-TagsTest-125930264 tempest-TagsTest-125930264-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'networks', '01e67f61-46db-45bb-b406-0d70365edaf8') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:33.450880 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-39220c88-b72e-46f9-bee1-9eac8426cd9f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Made reservation on behalf of 8b0758f781884982bf5b94e6609237f6 for: {'port': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:34:33.481032 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-0bf0ff81-a6e9-4e02-8f3c-c7eb4d428a48 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 999b1b20-f8fc-4caf-84cc-3feda426a0bf) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:33.486258 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0bf0ff81-a6e9-4e02-8f3c-c7eb4d428a48 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:33.486886 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0bf0ff81-a6e9-4e02-8f3c-c7eb4d428a48 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:33.491086 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-35b37b69-7400-4da5-a132-71b1c57bda1c None None] Network 999b1b20-f8fc-4caf-84cc-3feda426a0bf requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:34:33.540316 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-39220c88-b72e-46f9-bee1-9eac8426cd9f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:33.559666 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [None req-39220c88-b72e-46f9-bee1-9eac8426cd9f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] device_id is not set on port 43af8cfc-38b9-4298-9ae7-b04b63b6c9ae yet. {{(pid=102161) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:34:33.605796 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58116) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:33.605898 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-0bf0ff81-a6e9-4e02-8f3c-c7eb4d428a48 admin admin] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 1.1298747 Nov 09 04:34:33.610724 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-5a30a5e9-1bd4-4bf2-ab43-faf1eb371b5c admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-1675179943-router', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:33.611187 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-abdab80c-479d-4b65-b358-8ba8899ac775 tempest-TagsTest-125930264 tempest-TagsTest-125930264-project] 10.222.0.24 "DELETE /v2.0/networks/01e67f61-46db-45bb-b406-0d70365edaf8/tags HTTP/1.1" status: 204 len: 168 time: 0.2015145 Nov 09 04:34:33.612052 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58118) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:33.616929 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.tag.tag_plugin [None req-92f2d6bd-a9ae-4374-97b7-2c700fcbe4aa tempest-TagsTest-125930264 tempest-TagsTest-125930264-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'networks', '01e67f61-46db-45bb-b406-0d70365edaf8', 'tempest-TagsTest-Tag-756318724') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:33.655190 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9bbc7442-007c-49d8-ab0b-664038dab171 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:33.659028 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ce954dc3-677e-488d-ab6d-4c4068cb3375 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-999b1b20-f8fc-4caf-84cc-3feda426a0bf', 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'fixed_ips': [{'subnet_id': 'f6a08667-654b-4e0c-9f85-c6e6712cc239'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:34:33.659839 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ce954dc3-677e-488d-ab6d-4c4068cb3375 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:33.701696 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.api.v2.resource [None req-92f2d6bd-a9ae-4374-97b7-2c700fcbe4aa tempest-TagsTest-125930264 tempest-TagsTest-125930264-project] show failed (client error): The resource could not be found. Nov 09 04:34:33.702961 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-92f2d6bd-a9ae-4374-97b7-2c700fcbe4aa tempest-TagsTest-125930264 tempest-TagsTest-125930264-project] 10.222.0.24 "GET /v2.0/networks/01e67f61-46db-45bb-b406-0d70365edaf8/tags/tempest-TagsTest-Tag-756318724 HTTP/1.1" status: 404 len: 325 time: 0.0897200 Nov 09 04:34:33.706277 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58122) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:33.711517 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.tag.tag_plugin [None req-f85a2724-34fb-4cbf-9c22-9f8ebe2ebc75 tempest-TagsTest-125930264 tempest-TagsTest-125930264-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'networks', '01e67f61-46db-45bb-b406-0d70365edaf8', 'tempest-TagsTest-Tag-553478168') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:33.749299 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5a30a5e9-1bd4-4bf2-ab43-faf1eb371b5c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:33.750256 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5a30a5e9-1bd4-4bf2-ab43-faf1eb371b5c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:33.786310 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-39220c88-b72e-46f9-bee1-9eac8426cd9f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Allocated IP 2001:db8::237 (988d2354-693c-4d52-af17-25e0643eaa0c/c75722ae-79c1-4a08-89c6-49b2fbc88741/43af8cfc-38b9-4298-9ae7-b04b63b6c9ae) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:34:33.796749 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-39220c88-b72e-46f9-bee1-9eac8426cd9f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Allocated IP 2001:db8:0:1:f816:3eff:fed8:13d1 (988d2354-693c-4d52-af17-25e0643eaa0c/a7dd38a8-a6e2-475e-a43c-746ce6a4f555/43af8cfc-38b9-4298-9ae7-b04b63b6c9ae) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:34:33.814718 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.api.v2.resource [None req-f85a2724-34fb-4cbf-9c22-9f8ebe2ebc75 tempest-TagsTest-125930264 tempest-TagsTest-125930264-project] show failed (client error): The resource could not be found. Nov 09 04:34:33.818661 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-f85a2724-34fb-4cbf-9c22-9f8ebe2ebc75 tempest-TagsTest-125930264 tempest-TagsTest-125930264-project] 10.222.0.24 "GET /v2.0/networks/01e67f61-46db-45bb-b406-0d70365edaf8/tags/tempest-TagsTest-Tag-553478168 HTTP/1.1" status: 404 len: 325 time: 0.1085198 Nov 09 04:34:33.820079 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58124) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:33.829944 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.tag.tag_plugin [None req-01c9dbb0-1978-4193-a134-96d6088cf662 tempest-TagsTest-125930264 tempest-TagsTest-125930264-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'networks', '01e67f61-46db-45bb-b406-0d70365edaf8') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:33.834389 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58126) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:33.928053 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-01c9dbb0-1978-4193-a134-96d6088cf662 tempest-TagsTest-125930264 tempest-TagsTest-125930264-project] 10.222.0.24 "DELETE /v2.0/networks/01e67f61-46db-45bb-b406-0d70365edaf8/tags HTTP/1.1" status: 204 len: 168 time: 0.1060183 Nov 09 04:34:33.934833 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58130) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:33.950972 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-ce954dc3-677e-488d-ab6d-4c4068cb3375 None None] Allocated IP 172.20.0.2 (999b1b20-f8fc-4caf-84cc-3feda426a0bf/f6a08667-654b-4e0c-9f85-c6e6712cc239/b5d07ee2-c2b6-490e-8334-ac606dd5ca2d) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:34:33.960877 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5a30a5e9-1bd4-4bf2-ab43-faf1eb371b5c admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:34.013076 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-39220c88-b72e-46f9-bee1-9eac8426cd9f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:34.050331 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d4576057-2b81-4f4b-820a-92e5493a6e64 tempest-TagsTest-125930264 tempest-TagsTest-125930264-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:34.060026 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-2b8f6be3-a66a-4e94-97c6-1d6397006ea0 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=429a0ccbae244e9e9e6fbb93c166fa74&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2221739 Nov 09 04:34:34.060397 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58132) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:34.114770 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ce954dc3-677e-488d-ab6d-4c4068cb3375 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:34.169599 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 81841961-1f66-4bbf-ab3a-2646a1326e8d up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:34:34.193710 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d4576057-2b81-4f4b-820a-92e5493a6e64 tempest-TagsTest-125930264 tempest-TagsTest-125930264-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:34.202988 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e86e94c7-2872-4b60-a9d3-103af0944d96 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:34.206628 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ce954dc3-677e-488d-ab6d-4c4068cb3375 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:34.209703 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5a30a5e9-1bd4-4bf2-ab43-faf1eb371b5c admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:34.228120 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-d4576057-2b81-4f4b-820a-92e5493a6e64 tempest-TagsTest-125930264 tempest-TagsTest-125930264-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['01e67f61-46db-45bb-b406-0d70365edaf8']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:34.229083 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-39220c88-b72e-46f9-bee1-9eac8426cd9f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:34.246267 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e86e94c7-2872-4b60-a9d3-103af0944d96 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:34.248927 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-d4576057-2b81-4f4b-820a-92e5493a6e64 tempest-TagsTest-125930264 tempest-TagsTest-125930264-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3d288f36-c63f-425d-ac99-8b68151af06d') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:34.249243 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-d4576057-2b81-4f4b-820a-92e5493a6e64 tempest-TagsTest-125930264 tempest-TagsTest-125930264-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3d288f36-c63f-425d-ac99-8b68151af06d') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:34.264315 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ce954dc3-677e-488d-ab6d-4c4068cb3375 None None] Network 999b1b20-f8fc-4caf-84cc-3feda426a0bf is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:34:34.270470 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d4576057-2b81-4f4b-820a-92e5493a6e64 tempest-TagsTest-125930264 tempest-TagsTest-125930264-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:34.275422 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-ce954dc3-677e-488d-ab6d-4c4068cb3375 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:34.288080 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-39220c88-b72e-46f9-bee1-9eac8426cd9f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Network 988d2354-693c-4d52-af17-25e0643eaa0c is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:34:34.288761 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ce954dc3-677e-488d-ab6d-4c4068cb3375 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:34:34.290926 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-39220c88-b72e-46f9-bee1-9eac8426cd9f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:34.294429 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-39220c88-b72e-46f9-bee1-9eac8426cd9f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:34:34.299123 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce954dc3-677e-488d-ab6d-4c4068cb3375 None None] Pushing event updated for resources: {'Port': ['ID=b5d07ee2-c2b6-490e-8334-ac606dd5ca2d,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:34.300690 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-39220c88-b72e-46f9-bee1-9eac8426cd9f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:34.301539 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-39220c88-b72e-46f9-bee1-9eac8426cd9f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:34.307510 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d4576057-2b81-4f4b-820a-92e5493a6e64 tempest-TagsTest-125930264 tempest-TagsTest-125930264-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:34.312654 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39220c88-b72e-46f9-bee1-9eac8426cd9f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event updated for resources: {'Port': ['ID=43af8cfc-38b9-4298-9ae7-b04b63b6c9ae,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:34.326122 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d4576057-2b81-4f4b-820a-92e5493a6e64 tempest-TagsTest-125930264 tempest-TagsTest-125930264-project] Releasing vlan 345 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:34:34.326781 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d4576057-2b81-4f4b-820a-92e5493a6e64 tempest-TagsTest-125930264 tempest-TagsTest-125930264-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:34.331900 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:34:34.331900 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:34:34.331900 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:34:34.331900 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:34:34.331900 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:34:34.331900 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:34:34.331900 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:34:34.331900 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:34:34.331900 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:34:34.331900 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:34:34.331900 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:34:34.331900 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:34:34.331900 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:34:34.331900 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:34:34.331900 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:34:34.331900 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:34:34.331900 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:34:34.331900 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:34:34.331900 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:34:34.331900 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:34:34.331900 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:34:34.331900 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:34:34.331900 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:34:34.331900 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:34:34.331900 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:34:34.331900 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:34:34.331900 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:34:34.331900 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:34:34.331900 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:34:34.331900 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:34:34.331900 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:34:34.331900 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:34:34.340843 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 81841961-1f66-4bbf-ab3a-2646a1326e8d triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:34.341133 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:34.391760 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-39220c88-b72e-46f9-bee1-9eac8426cd9f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1033 time: 1.1515424 Nov 09 04:34:34.398078 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58134) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:34.441769 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e86e94c7-2872-4b60-a9d3-103af0944d96 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:34.444874 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e86e94c7-2872-4b60-a9d3-103af0944d96 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:34.448919 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e86e94c7-2872-4b60-a9d3-103af0944d96 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/13c59785-4472-47c7-b5dc-01d925b85b05 HTTP/1.1" status: 204 len: 168 time: 0.3849082 Nov 09 04:34:34.461875 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d4576057-2b81-4f4b-820a-92e5493a6e64 tempest-TagsTest-125930264 tempest-TagsTest-125930264-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:34.480271 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d4576057-2b81-4f4b-820a-92e5493a6e64 tempest-TagsTest-125930264 tempest-TagsTest-125930264-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:34.484427 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-d4576057-2b81-4f4b-820a-92e5493a6e64 tempest-TagsTest-125930264 tempest-TagsTest-125930264-project] 10.222.0.24 "DELETE /v2.0/networks/01e67f61-46db-45bb-b406-0d70365edaf8 HTTP/1.1" status: 204 len: 168 time: 0.5481756 Nov 09 04:34:34.485883 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86e94c7-2872-4b60-a9d3-103af0944d96 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=13c59785-4472-47c7-b5dc-01d925b85b05,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:34.547417 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5a30a5e9-1bd4-4bf2-ab43-faf1eb371b5c admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:34.567328 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4576057-2b81-4f4b-820a-92e5493a6e64 tempest-TagsTest-125930264 tempest-TagsTest-125930264-project] Pushing event deleted for resources: {'Network': ['ID=01e67f61-46db-45bb-b406-0d70365edaf8,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:34.584442 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5a30a5e9-1bd4-4bf2-ab43-faf1eb371b5c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:34.606421 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-ee36537e-faaa-4db4-9c93-2a599f1d353a tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Deleting port 43af8cfc-38b9-4298-9ae7-b04b63b6c9ae {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:34:34.606421 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ee36537e-faaa-4db4-9c93-2a599f1d353a tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:34.625032 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-ce954dc3-677e-488d-ab6d-4c4068cb3375 None None] Attempting to bind port b5d07ee2-c2b6-490e-8334-ac606dd5ca2d on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:34:34.625877 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-ce954dc3-677e-488d-ab6d-4c4068cb3375 None None] Attempting to bind port b5d07ee2-c2b6-490e-8334-ac606dd5ca2d by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'bc4577c9-06a5-450a-9c80-879827986f04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:34:34.625877 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ce954dc3-677e-488d-ab6d-4c4068cb3375 None None] Attempting to bind port b5d07ee2-c2b6-490e-8334-ac606dd5ca2d on network 999b1b20-f8fc-4caf-84cc-3feda426a0bf {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:34:34.638111 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-9bbc7442-007c-49d8-ab0b-664038dab171 None None] For port 81841961-1f66-4bbf-ab3a-2646a1326e8d, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=81841961-1f66-4bbf-ab3a-2646a1326e8d,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:34:34.641014 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ce954dc3-677e-488d-ab6d-4c4068cb3375 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 34, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:34:34.641844 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ce954dc3-677e-488d-ab6d-4c4068cb3375 None None] Checking segment: {'id': 'bc4577c9-06a5-450a-9c80-879827986f04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:34:34.641844 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ce954dc3-677e-488d-ab6d-4c4068cb3375 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:34.642163 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ce954dc3-677e-488d-ab6d-4c4068cb3375 None None] Bound using segment: {'id': 'bc4577c9-06a5-450a-9c80-879827986f04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:34:34.642655 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-ce954dc3-677e-488d-ab6d-4c4068cb3375 None None] Bound port: b5d07ee2-c2b6-490e-8334-ac606dd5ca2d, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bc4577c9-06a5-450a-9c80-879827986f04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:34:34.643022 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ce954dc3-677e-488d-ab6d-4c4068cb3375 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:34.716161 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ee36537e-faaa-4db4-9c93-2a599f1d353a tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:34.716808 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-5a30a5e9-1bd4-4bf2-ab43-faf1eb371b5c admin admin] Allocated IP 172.26.0.164 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/873960f9-e8b5-48a6-a119-47c32f5b7968) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:34:34.729396 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9bbc7442-007c-49d8-ab0b-664038dab171 None None] Publish callbacks [] for port, precommit_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:34.730613 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-ee36537e-faaa-4db4-9c93-2a599f1d353a tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Calling delete_port for 43af8cfc-38b9-4298-9ae7-b04b63b6c9ae owned by {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:34:34.775406 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-ce954dc3-677e-488d-ab6d-4c4068cb3375 None None] For port b5d07ee2-c2b6-490e-8334-ac606dd5ca2d, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:34:34.792544 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-ce954dc3-677e-488d-ab6d-4c4068cb3375 None None] For port b5d07ee2-c2b6-490e-8334-ac606dd5ca2d, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=b5d07ee2-c2b6-490e-8334-ac606dd5ca2d,segment=NetworkSegment(bc4577c9-06a5-450a-9c80-879827986f04),segment_id=bc4577c9-06a5-450a-9c80-879827986f04)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:34:34.823532 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 34b780e2-66dd-47ef-905a-81a9e32fdc2d no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:34:34.852027 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 34b780e2-66dd-47ef-905a-81a9e32fdc2d {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:34:34.852535 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 34b780e2-66dd-47ef-905a-81a9e32fdc2d not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:34:34.855391 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9bbc7442-007c-49d8-ab0b-664038dab171 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:34.869256 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5a30a5e9-1bd4-4bf2-ab43-faf1eb371b5c admin admin] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:34.904345 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ce954dc3-677e-488d-ab6d-4c4068cb3375 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:34.976459 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bbc7442-007c-49d8-ab0b-664038dab171 None None] Pushing event updated for resources: {'Port': ['ID=81841961-1f66-4bbf-ab3a-2646a1326e8d,revision_number=11']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:35.076450 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce954dc3-677e-488d-ab6d-4c4068cb3375 None None] Pushing event updated for resources: {'Port': ['ID=b5d07ee2-c2b6-490e-8334-ac606dd5ca2d,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:35.280055 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ee36537e-faaa-4db4-9c93-2a599f1d353a tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:35.282335 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5a30a5e9-1bd4-4bf2-ab43-faf1eb371b5c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:35.324172 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5a30a5e9-1bd4-4bf2-ab43-faf1eb371b5c admin admin] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:34:35.327152 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-5a30a5e9-1bd4-4bf2-ab43-faf1eb371b5c admin admin] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:35.337504 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5a30a5e9-1bd4-4bf2-ab43-faf1eb371b5c admin admin] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:34:35.337904 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee36537e-faaa-4db4-9c93-2a599f1d353a tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event deleted for resources: {'Port': ['ID=43af8cfc-38b9-4298-9ae7-b04b63b6c9ae,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:35.374684 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a30a5e9-1bd4-4bf2-ab43-faf1eb371b5c admin admin] Pushing event updated for resources: {'Port': ['ID=873960f9-e8b5-48a6-a119-47c32f5b7968,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:35.381677 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58152) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:35.396343 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ee36537e-faaa-4db4-9c93-2a599f1d353a tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:35.401048 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-ee36537e-faaa-4db4-9c93-2a599f1d353a tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/ports/43af8cfc-38b9-4298-9ae7-b04b63b6c9ae HTTP/1.1" status: 204 len: 168 time: 1.0001709 Nov 09 04:34:35.402224 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58156) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:35.468642 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-52311b68-0a9a-497a-a8ee-5ddf77e5d0d0 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:35.482054 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-52311b68-0a9a-497a-a8ee-5ddf77e5d0d0 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1047 time: 0.0784411 Nov 09 04:34:35.482818 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58158) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:35.548692 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7ef55f91-6bb2-4b24-8b50-fa5abdc3e60a tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:35.553133 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-7ef55f91-6bb2-4b24-8b50-fa5abdc3e60a tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1047 time: 0.0692062 Nov 09 04:34:35.553945 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58160) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:35.660268 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-7d9b573d-c51f-4f01-a66a-3bd5e376d7ae admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=5fa3cf1d322d465cbbd0158aeb973a08&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2768960 Nov 09 04:34:35.673608 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0bdeee42-6d96-4807-8777-21a289560a94 None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:34:35.736288 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58168) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:35.760926 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-cc27a445-054d-43af-a823-def2c13b91de None None] Provisioning complete for port 81841961-1f66-4bbf-ab3a-2646a1326e8d triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:35.761596 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-cc27a445-054d-43af-a823-def2c13b91de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:35.947721 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2100c9ff-c133-4a5a-944a-60e44331b582 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:35.949258 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2100c9ff-c133-4a5a-944a-60e44331b582 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:35.950997 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2100c9ff-c133-4a5a-944a-60e44331b582 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:35.952776 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-2100c9ff-c133-4a5a-944a-60e44331b582 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2119 time: 0.3976383 Nov 09 04:34:35.956041 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58172) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:36.024137 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58174) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:36.042576 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-d5c4e4a5-05ca-4fd6-a02d-0087ad6b8fda tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Deleting subnet a7dd38a8-a6e2-475e-a43c-746ce6a4f555 {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:34:36.046265 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d5c4e4a5-05ca-4fd6-a02d-0087ad6b8fda tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:36.119206 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d5c4e4a5-05ca-4fd6-a02d-0087ad6b8fda tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:36.198687 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-b40393d3-c56a-4d12-8eb0-96c0a7890d8e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-1892556049'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:36.270013 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d5c4e4a5-05ca-4fd6-a02d-0087ad6b8fda tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:36.275372 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device b5d07ee2-c2b6-490e-8334-ac606dd5ca2d up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:34:36.311591 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5a30a5e9-1bd4-4bf2-ab43-faf1eb371b5c admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:36.313014 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1b19357e-5cf3-411e-9a59-1e3f9b804e1a None None] Network 999b1b20-f8fc-4caf-84cc-3feda426a0bf requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:34:36.352996 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-24dba5fd-21ea-4969-b9b7-1d7a6c8e8526 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:36.360414 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b40393d3-c56a-4d12-8eb0-96c0a7890d8e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Made reservation on behalf of d11b025703b24d109deef7bfe57a45f6 for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:34:36.364120 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b40393d3-c56a-4d12-8eb0-96c0a7890d8e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:36.381764 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b40393d3-c56a-4d12-8eb0-96c0a7890d8e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:36.419812 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-24dba5fd-21ea-4969-b9b7-1d7a6c8e8526 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:36.430316 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e06eb07f-d114-4f67-851b-6e77dcb1486e None None] Provisioning complete for port b5d07ee2-c2b6-490e-8334-ac606dd5ca2d triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:36.432129 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d5c4e4a5-05ca-4fd6-a02d-0087ad6b8fda tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:36.432282 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e06eb07f-d114-4f67-851b-6e77dcb1486e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:36.455831 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port b5d07ee2-c2b6-490e-8334-ac606dd5ca2d triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:36.456200 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:36.470740 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5c4e4a5-05ca-4fd6-a02d-0087ad6b8fda tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event deleted for resources: {'Subnet': ['ID=a7dd38a8-a6e2-475e-a43c-746ce6a4f555,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:36.477360 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d5c4e4a5-05ca-4fd6-a02d-0087ad6b8fda tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:36.483504 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-d5c4e4a5-05ca-4fd6-a02d-0087ad6b8fda tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/a7dd38a8-a6e2-475e-a43c-746ce6a4f555 HTTP/1.1" status: 204 len: 168 time: 0.5240853 Nov 09 04:34:36.484452 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58178) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:36.562424 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-b5c86012-17ed-46cd-ab76-986b0d9d530f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Deleting subnet c75722ae-79c1-4a08-89c6-49b2fbc88741 {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:34:36.570510 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b5c86012-17ed-46cd-ab76-986b0d9d530f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:36.589150 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5a30a5e9-1bd4-4bf2-ab43-faf1eb371b5c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:36.617777 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b40393d3-c56a-4d12-8eb0-96c0a7890d8e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:36.630639 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b5c86012-17ed-46cd-ab76-986b0d9d530f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:36.640481 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-24dba5fd-21ea-4969-b9b7-1d7a6c8e8526 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:36.644932 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-24dba5fd-21ea-4969-b9b7-1d7a6c8e8526 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:36.646227 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-24dba5fd-21ea-4969-b9b7-1d7a6c8e8526 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/a8bbdd68-2c37-4ad7-ae8e-69612e7c8cf1 HTTP/1.1" status: 204 len: 168 time: 0.9086034 Nov 09 04:34:36.657087 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:36.662741 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e06eb07f-d114-4f67-851b-6e77dcb1486e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:36.692781 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b40393d3-c56a-4d12-8eb0-96c0a7890d8e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:36.725381 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24dba5fd-21ea-4969-b9b7-1d7a6c8e8526 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a8bbdd68-2c37-4ad7-ae8e-69612e7c8cf1,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:36.727436 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port b5d07ee2-c2b6-490e-8334-ac606dd5ca2d, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=b5d07ee2-c2b6-490e-8334-ac606dd5ca2d,segment=NetworkSegment(bc4577c9-06a5-450a-9c80-879827986f04),segment_id=bc4577c9-06a5-450a-9c80-879827986f04)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:34:36.768886 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b2e4c998-d71b-43da-80ef-c5dc500ad42c None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:34:36.769231 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b40393d3-c56a-4d12-8eb0-96c0a7890d8e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 309} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:34:36.795939 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b40393d3-c56a-4d12-8eb0-96c0a7890d8e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event updated for resources: {'SecurityGroup': ['ID=80d3f5ff-0c4d-4add-a510-4dc33e5ec4f4,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:36.817522 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b40393d3-c56a-4d12-8eb0-96c0a7890d8e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:36.822039 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-b40393d3-c56a-4d12-8eb0-96c0a7890d8e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Added segment e8c00fc8-7e86-4d0c-be0e-3497a4a17cb5 of type vlan for network 0762b9da-b197-4e44-a8c9-f5b19a0206b2 Nov 09 04:34:36.843076 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:36.858288 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b5c86012-17ed-46cd-ab76-986b0d9d530f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:36.895280 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5a30a5e9-1bd4-4bf2-ab43-faf1eb371b5c admin admin] Router 203a01a6-369d-4e73-a6d0-b0605f8d5a6a is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102161) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:34:36.914781 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b40393d3-c56a-4d12-8eb0-96c0a7890d8e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:36.954644 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.db.api [None req-e06eb07f-d114-4f67-851b-6e77dcb1486e None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=102163) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:34:36.955311 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG oslo_db.api [None req-e06eb07f-d114-4f67-851b-6e77dcb1486e None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:34:36.964398 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=b5d07ee2-c2b6-490e-8334-ac606dd5ca2d,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:37.014938 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b40393d3-c56a-4d12-8eb0-96c0a7890d8e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:37.021166 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b40393d3-c56a-4d12-8eb0-96c0a7890d8e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:37.021769 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b40393d3-c56a-4d12-8eb0-96c0a7890d8e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:37.048006 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5a30a5e9-1bd4-4bf2-ab43-faf1eb371b5c admin admin] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:34:37.054215 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b5c86012-17ed-46cd-ab76-986b0d9d530f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:37.061706 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-207c2f7e-68ed-45fa-8cf4-cb8a9c8a3bb4 None None] Sync routers for ids ['203a01a6-369d-4e73-a6d0-b0605f8d5a6a'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:34:37.079240 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-207c2f7e-68ed-45fa-8cf4-cb8a9c8a3bb4 None None] Routers {'203a01a6-369d-4e73-a6d0-b0605f8d5a6a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:34:37.080158 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-207c2f7e-68ed-45fa-8cf4-cb8a9c8a3bb4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:34:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['203a01a6-369d-4e73-a6d0-b0605f8d5a6a'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:37.122043 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5c86012-17ed-46cd-ab76-986b0d9d530f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event deleted for resources: {'Subnet': ['ID=c75722ae-79c1-4a08-89c6-49b2fbc88741,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:37.134223 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5a30a5e9-1bd4-4bf2-ab43-faf1eb371b5c admin admin] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:37.137366 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-5a30a5e9-1bd4-4bf2-ab43-faf1eb371b5c admin admin] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 924 time: 3.5317783 Nov 09 04:34:37.140164 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58182) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:37.143344 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ccd5b42a-4259-44f4-a2a9-de5f9ae59b7c None None] Update dhcp port {'port': {'network_id': '988d2354-693c-4d52-af17-25e0643eaa0c', 'fixed_ips': [{'subnet_id': 'c75722ae-79c1-4a08-89c6-49b2fbc88741'}], 'binding:host_id': 'dv-neutron-816802-2-hyperv'}, 'id': '81841961-1f66-4bbf-ab3a-2646a1326e8d'} from dv-neutron-816802-2-hyperv. {{(pid=102163) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:328}} Nov 09 04:34:37.166843 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-b40393d3-c56a-4d12-8eb0-96c0a7890d8e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 770 time: 1.1378608 Nov 09 04:34:37.168328 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58184) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:37.182860 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ccd5b42a-4259-44f4-a2a9-de5f9ae59b7c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:37.185173 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b5c86012-17ed-46cd-ab76-986b0d9d530f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:37.191577 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-b5c86012-17ed-46cd-ab76-986b0d9d530f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/c75722ae-79c1-4a08-89c6-49b2fbc88741 HTTP/1.1" status: 204 len: 168 time: 0.7052484 Nov 09 04:34:37.205857 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-6a4a88e7-65c2-40a9-9979-0d77eb06f304 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-143869161'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:37.217033 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b40393d3-c56a-4d12-8eb0-96c0a7890d8e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event updated for resources: {'Network': ['ID=0762b9da-b197-4e44-a8c9-f5b19a0206b2,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:37.225263 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-207c2f7e-68ed-45fa-8cf4-cb8a9c8a3bb4 None None] Set router 203a01a6-369d-4e73-a6d0-b0605f8d5a6a gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:34:37.233437 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58186) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:37.303907 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-0ba1de85-d1a0-4ab7-97df-10c07e73cae3 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0660844 Nov 09 04:34:37.306606 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58188) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:37.320763 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 0762b9da-b197-4e44-a8c9-f5b19a0206b2 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:34:37.386602 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c9f8732c-83d2-4c39-b26d-784479387815 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:37.388176 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-c9f8732c-83d2-4c39-b26d-784479387815 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/ports HTTP/1.1" status: 200 len: 867 time: 0.0807686 Nov 09 04:34:37.390814 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58190) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:37.402891 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6a4a88e7-65c2-40a9-9979-0d77eb06f304 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Made reservation on behalf of d11b025703b24d109deef7bfe57a45f6 for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:34:37.406647 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6a4a88e7-65c2-40a9-9979-0d77eb06f304 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:37.425587 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6fd95dc4-3c59-4e99-b9ce-8112f8896168 None None] Network 988d2354-693c-4d52-af17-25e0643eaa0c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:34:37.485768 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-509c5156-404d-4828-91e6-a5ff22d88b7a tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:37.488016 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-509c5156-404d-4828-91e6-a5ff22d88b7a tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.0953636 Nov 09 04:34:37.488954 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6a4a88e7-65c2-40a9-9979-0d77eb06f304 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 312} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:34:37.491600 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58192) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:37.548993 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-76439db1-235c-4095-a535-67bca1186d4a tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0556877 Nov 09 04:34:37.554234 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58194) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:37.557510 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6a4a88e7-65c2-40a9-9979-0d77eb06f304 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:37.558003 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-6a4a88e7-65c2-40a9-9979-0d77eb06f304 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Added segment 324e2708-5459-4f84-8758-baac25e2c4a2 of type vlan for network 308a67ee-d876-44e1-8a9d-b23323a6a50c Nov 09 04:34:37.585850 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-207c2f7e-68ed-45fa-8cf4-cb8a9c8a3bb4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'name': 'tempest-TestVolumeBootPattern-1675179943-router', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.164'}], 'enable_snat': True}, 'gw_port_id': '873960f9-e8b5-48a6-a119-47c32f5b7968', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:34:33Z', 'updated_at': '2021-11-09T04:34:35Z', 'revision_number': 3, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'gw_port': {'id': '873960f9-e8b5-48a6-a119-47c32f5b7968', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:95:01', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1097, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.164', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:34:34Z', 'updated_at': '2021-11-09T04:34:34Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:37.592679 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-fb870abf-53ea-499f-9ab1-116a0ac5ec4d tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] DELETE failed (client error): The resource could not be found. Nov 09 04:34:37.593209 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-fb870abf-53ea-499f-9ab1-116a0ac5ec4d tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:37.595968 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e06eb07f-d114-4f67-851b-6e77dcb1486e None None] Provisioning complete for port 81841961-1f66-4bbf-ab3a-2646a1326e8d triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:37.596671 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e06eb07f-d114-4f67-851b-6e77dcb1486e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:37.596806 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-fb870abf-53ea-499f-9ab1-116a0ac5ec4d tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/ports/43af8cfc-38b9-4298-9ae7-b04b63b6c9ae HTTP/1.1" status: 404 len: 333 time: 0.0414002 Nov 09 04:34:37.604427 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58196) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:37.621265 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-207c2f7e-68ed-45fa-8cf4-cb8a9c8a3bb4 None None] Checking router: 203a01a6-369d-4e73-a6d0-b0605f8d5a6a for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:34:37.621882 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-207c2f7e-68ed-45fa-8cf4-cb8a9c8a3bb4 None None] Updating router 203a01a6-369d-4e73-a6d0-b0605f8d5a6a port 873960f9-e8b5-48a6-a119-47c32f5b7968 binding host dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 04:34:37.635198 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-459eb14a-f03c-45f6-a680-a93a4ef83efe tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] DELETE failed (client error): The resource could not be found. Nov 09 04:34:37.635661 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-459eb14a-f03c-45f6-a680-a93a4ef83efe tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:37.639147 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-459eb14a-f03c-45f6-a680-a93a4ef83efe tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/a7dd38a8-a6e2-475e-a43c-746ce6a4f555 HTTP/1.1" status: 404 len: 337 time: 0.0336924 Nov 09 04:34:37.654308 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58198) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:37.661502 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-207c2f7e-68ed-45fa-8cf4-cb8a9c8a3bb4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:37.676275 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6a4a88e7-65c2-40a9-9979-0d77eb06f304 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:37.697069 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-9e2bd3f2-a19c-4067-8dd7-844516edc62c tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] DELETE failed (client error): The resource could not be found. Nov 09 04:34:37.697533 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9e2bd3f2-a19c-4067-8dd7-844516edc62c tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:37.700756 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-9e2bd3f2-a19c-4067-8dd7-844516edc62c tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/c75722ae-79c1-4a08-89c6-49b2fbc88741 HTTP/1.1" status: 404 len: 337 time: 0.0418262 Nov 09 04:34:37.703399 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58200) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:37.710974 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-931843f2-fb11-4708-a11f-51269adba514 None None] DHCP port deletion for 988d2354-693c-4d52-af17-25e0643eaa0c request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:34:37.731122 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-e57af40d-3cae-4243-bb44-7a8495f4b476 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] DELETE failed (client error): The resource could not be found. Nov 09 04:34:37.731927 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e57af40d-3cae-4243-bb44-7a8495f4b476 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:37.737274 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-e57af40d-3cae-4243-bb44-7a8495f4b476 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/ports/a6ff87c0-50a6-432e-8c6b-b24c7ebb8e2f HTTP/1.1" status: 404 len: 333 time: 0.0304451 Nov 09 04:34:37.737598 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58202) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:37.766004 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-dba77856-1da0-4997-a246-3dcab1fd737f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] DELETE failed (client error): The resource could not be found. Nov 09 04:34:37.766492 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-dba77856-1da0-4997-a246-3dcab1fd737f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:37.769605 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-dba77856-1da0-4997-a246-3dcab1fd737f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/50ce8657-2443-4724-ac81-7f3884a6c040 HTTP/1.1" status: 404 len: 337 time: 0.0310106 Nov 09 04:34:37.770398 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6a4a88e7-65c2-40a9-9979-0d77eb06f304 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:37.774958 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58204) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:37.776126 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6a4a88e7-65c2-40a9-9979-0d77eb06f304 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:37.776569 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-931843f2-fb11-4708-a11f-51269adba514 None None] Deleting port 81841961-1f66-4bbf-ab3a-2646a1326e8d {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:34:37.777061 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6a4a88e7-65c2-40a9-9979-0d77eb06f304 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:37.777153 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-931843f2-fb11-4708-a11f-51269adba514 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:37.831633 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-87317821-a885-4089-9ab0-9d1e4b346798 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] DELETE failed (client error): The resource could not be found. Nov 09 04:34:37.832083 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-87317821-a885-4089-9ab0-9d1e4b346798 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:37.837461 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-87317821-a885-4089-9ab0-9d1e4b346798 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/130970a8-ae23-4805-a6d6-fd396bb5daaa HTTP/1.1" status: 404 len: 337 time: 0.0592926 Nov 09 04:34:37.838486 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58206) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:37.851085 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-73c73d9d-153f-4ed3-b249-77e64ba16027 None None] Could not find standard attr ID for object 43af8cfc-38b9-4298-9ae7-b04b63b6c9ae. {{(pid=102163) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 09 04:34:37.853786 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a4a88e7-65c2-40a9-9979-0d77eb06f304 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event updated for resources: {'Network': ['ID=308a67ee-d876-44e1-8a9d-b23323a6a50c,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:37.860760 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-931843f2-fb11-4708-a11f-51269adba514 None None] For port 81841961-1f66-4bbf-ab3a-2646a1326e8d, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=81841961-1f66-4bbf-ab3a-2646a1326e8d,segment=NetworkSegment(af4cde93-bd96-45fc-bfc1-9d70f48450dd),segment_id=af4cde93-bd96-45fc-bfc1-9d70f48450dd)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:34:37.860991 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-931843f2-fb11-4708-a11f-51269adba514 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:37.871997 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 308a67ee-d876-44e1-8a9d-b23323a6a50c details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:34:37.882961 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-68809a9a-641e-4ce2-a36a-79732ee3c860 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] DELETE failed (client error): The resource could not be found. Nov 09 04:34:37.882961 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-68809a9a-641e-4ce2-a36a-79732ee3c860 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:37.882961 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-68809a9a-641e-4ce2-a36a-79732ee3c860 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/ports/4df64fdc-92cf-498c-91b6-2b5f8b1a4b1c HTTP/1.1" status: 404 len: 333 time: 0.0404215 Nov 09 04:34:37.883297 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58208) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:37.898131 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-931843f2-fb11-4708-a11f-51269adba514 None None] Calling delete_port for 81841961-1f66-4bbf-ab3a-2646a1326e8d owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:34:37.912057 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-f7f660ea-8a20-41bb-946d-11b0b7f6aab6 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] DELETE failed (client error): The resource could not be found. Nov 09 04:34:37.912514 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-f7f660ea-8a20-41bb-946d-11b0b7f6aab6 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:37.915629 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-f7f660ea-8a20-41bb-946d-11b0b7f6aab6 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/598c6d18-7032-48f5-afe4-e8ba1122edd2 HTTP/1.1" status: 404 len: 337 time: 0.0328236 Nov 09 04:34:37.919201 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-6a4a88e7-65c2-40a9-9979-0d77eb06f304 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.7392321 Nov 09 04:34:37.919798 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58210) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:37.922726 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58212) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:37.945890 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e03b6c88-3f45-40d0-9cfe-362847422bd3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:37.946792 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-73c73d9d-153f-4ed3-b249-77e64ba16027 None None] Provisioning complete for port 81841961-1f66-4bbf-ab3a-2646a1326e8d triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:37.947158 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-73c73d9d-153f-4ed3-b249-77e64ba16027 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:37.950400 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-43488264-3acc-4c64-b235-bef9eaaecc39 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] DELETE failed (client error): The resource could not be found. Nov 09 04:34:37.950668 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-43488264-3acc-4c64-b235-bef9eaaecc39 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:37.954327 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-43488264-3acc-4c64-b235-bef9eaaecc39 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/e9f0be11-da61-45ff-99f6-6f139e39eb72 HTTP/1.1" status: 404 len: 337 time: 0.0329969 Nov 09 04:34:37.959685 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-1e2723f3-c364-42e0-9644-37d8d7743205 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Request body: {'subnet': {'network_id': '0762b9da-b197-4e44-a8c9-f5b19a0206b2', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:37.962935 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58214) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:38.012292 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-43ed8848-870a-4d7a-927d-716513f1d35f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] DELETE failed (client error): The resource could not be found. Nov 09 04:34:38.012882 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-43ed8848-870a-4d7a-927d-716513f1d35f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:38.016556 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-43ed8848-870a-4d7a-927d-716513f1d35f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/ports/a208cfce-6881-4bb5-8c15-38aa3d67c127 HTTP/1.1" status: 404 len: 333 time: 0.0509670 Nov 09 04:34:38.042183 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58216) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:38.046449 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-207c2f7e-68ed-45fa-8cf4-cb8a9c8a3bb4 None None] Publish callbacks [] for port, precommit_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:38.080632 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-5566427d-8390-4371-9898-5f11b68959aa tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] DELETE failed (client error): The resource could not be found. Nov 09 04:34:38.081089 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5566427d-8390-4371-9898-5f11b68959aa tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:38.086516 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-5566427d-8390-4371-9898-5f11b68959aa tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/bac6b1bf-6999-4b76-a454-5b191f2e547e HTTP/1.1" status: 404 len: 337 time: 0.0410318 Nov 09 04:34:38.087269 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58218) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:38.113657 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-73c73d9d-153f-4ed3-b249-77e64ba16027 None None] Provisioning complete for port b5d07ee2-c2b6-490e-8334-ac606dd5ca2d triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:38.114031 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-73c73d9d-153f-4ed3-b249-77e64ba16027 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:38.119181 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-7973f62d-3d70-4b53-905e-526cd458489f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] DELETE failed (client error): The resource could not be found. Nov 09 04:34:38.119640 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-7973f62d-3d70-4b53-905e-526cd458489f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:38.125083 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-7973f62d-3d70-4b53-905e-526cd458489f tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/6cd48768-2b89-4629-808b-21cb29364842 HTTP/1.1" status: 404 len: 337 time: 0.0351658 Nov 09 04:34:38.126155 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58220) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:38.130381 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-207c2f7e-68ed-45fa-8cf4-cb8a9c8a3bb4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:38.161024 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-6a326579-5489-4a18-908a-c0ede286c2df tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] DELETE failed (client error): The resource could not be found. Nov 09 04:34:38.167505 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-6a326579-5489-4a18-908a-c0ede286c2df tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:38.167505 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-6a326579-5489-4a18-908a-c0ede286c2df tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/ports/31f29d7e-df13-461e-9f11-16ddd39418b7 HTTP/1.1" status: 404 len: 333 time: 0.0377533 Nov 09 04:34:38.167505 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58222) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:38.175904 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-931843f2-fb11-4708-a11f-51269adba514 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:38.195435 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-783bf4a9-1e51-4df1-889b-134826541532 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] DELETE failed (client error): The resource could not be found. Nov 09 04:34:38.196486 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-783bf4a9-1e51-4df1-889b-134826541532 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:38.199033 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-783bf4a9-1e51-4df1-889b-134826541532 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/d1514fe2-2396-4dfd-b620-439bb218cfc3 HTTP/1.1" status: 404 len: 337 time: 0.0308347 Nov 09 04:34:38.201519 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58224) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:38.224046 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-207c2f7e-68ed-45fa-8cf4-cb8a9c8a3bb4 None None] Attempting to bind port 873960f9-e8b5-48a6-a119-47c32f5b7968 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:34:38.224046 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-207c2f7e-68ed-45fa-8cf4-cb8a9c8a3bb4 None None] Attempting to bind port 873960f9-e8b5-48a6-a119-47c32f5b7968 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:34:38.224046 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-207c2f7e-68ed-45fa-8cf4-cb8a9c8a3bb4 None None] Attempting to bind port 873960f9-e8b5-48a6-a119-47c32f5b7968 on network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:34:38.228191 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-8dbd301f-21be-4886-bd9f-f4614b773c34 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] DELETE failed (client error): The resource could not be found. Nov 09 04:34:38.228872 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-8dbd301f-21be-4886-bd9f-f4614b773c34 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:38.229169 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0175ed2b-38b8-42d6-b982-66779c0ad298 None None] Pushing event updated for resources: {'Port': ['ID=873960f9-e8b5-48a6-a119-47c32f5b7968,revision_number=2']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:38.231955 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-207c2f7e-68ed-45fa-8cf4-cb8a9c8a3bb4 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 34, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:34:38.232160 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-8dbd301f-21be-4886-bd9f-f4614b773c34 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/ports/f452b4de-19e9-486c-bfb2-84e410a2350d HTTP/1.1" status: 404 len: 333 time: 0.0296555 Nov 09 04:34:38.232321 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-207c2f7e-68ed-45fa-8cf4-cb8a9c8a3bb4 None None] Checking segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102164) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:34:38.232714 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-207c2f7e-68ed-45fa-8cf4-cb8a9c8a3bb4 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:38.233150 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-207c2f7e-68ed-45fa-8cf4-cb8a9c8a3bb4 None None] Bound using segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:34:38.233618 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-207c2f7e-68ed-45fa-8cf4-cb8a9c8a3bb4 None None] Bound port: 873960f9-e8b5-48a6-a119-47c32f5b7968, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:34:38.234018 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-207c2f7e-68ed-45fa-8cf4-cb8a9c8a3bb4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:38.234687 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58226) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:38.252433 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-e03b6c88-3f45-40d0-9cfe-362847422bd3 admin admin] Allocated IP 172.20.0.1 (999b1b20-f8fc-4caf-84cc-3feda426a0bf/f6a08667-654b-4e0c-9f85-c6e6712cc239/a5f1e54d-1d98-4741-a1ce-59f4cfb5b332) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:34:38.264145 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-3c4c4a76-e55b-4de7-af5e-337aeda20b3b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] DELETE failed (client error): The resource could not be found. Nov 09 04:34:38.264878 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-3c4c4a76-e55b-4de7-af5e-337aeda20b3b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:38.268329 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-3c4c4a76-e55b-4de7-af5e-337aeda20b3b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/f0e6a3fd-b04a-4b95-8ac0-a5861c3c56b9 HTTP/1.1" status: 404 len: 337 time: 0.0320101 Nov 09 04:34:38.271271 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58228) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:38.288051 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-207c2f7e-68ed-45fa-8cf4-cb8a9c8a3bb4 None None] For port 873960f9-e8b5-48a6-a119-47c32f5b7968, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102164) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:34:38.291482 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-207c2f7e-68ed-45fa-8cf4-cb8a9c8a3bb4 None None] For port 873960f9-e8b5-48a6-a119-47c32f5b7968, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=873960f9-e8b5-48a6-a119-47c32f5b7968,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102164) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:34:38.299224 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-5e9eb683-970d-4b55-be7d-5b221a6c1696 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] DELETE failed (client error): The resource could not be found. Nov 09 04:34:38.300060 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5e9eb683-970d-4b55-be7d-5b221a6c1696 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:38.303165 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-5e9eb683-970d-4b55-be7d-5b221a6c1696 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/ports/5b9cc4cb-652d-459a-b84b-786da879bd9b HTTP/1.1" status: 404 len: 333 time: 0.0308027 Nov 09 04:34:38.305872 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58230) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:38.334560 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1e2723f3-c364-42e0-9644-37d8d7743205 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Made reservation on behalf of d11b025703b24d109deef7bfe57a45f6 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:34:38.338100 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1e2723f3-c364-42e0-9644-37d8d7743205 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:38.341725 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-24b0447c-b6b6-4b50-9635-7d77ad9bc06e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] DELETE failed (client error): The resource could not be found. Nov 09 04:34:38.342184 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-24b0447c-b6b6-4b50-9635-7d77ad9bc06e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:38.348009 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-24b0447c-b6b6-4b50-9635-7d77ad9bc06e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/30e8ddad-4c7a-4044-b33c-077c25c81181 HTTP/1.1" status: 404 len: 337 time: 0.0383625 Nov 09 04:34:38.348212 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58232) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:38.382392 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-207c2f7e-68ed-45fa-8cf4-cb8a9c8a3bb4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:38.404606 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device b5d07ee2-c2b6-490e-8334-ac606dd5ca2d up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:34:38.408462 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-d98b3e6e-ce88-4a85-99c9-9476dce152f3 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] DELETE failed (client error): The resource could not be found. Nov 09 04:34:38.408642 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-931843f2-fb11-4708-a11f-51269adba514 None None] Pushing event deleted for resources: {'Port': ['ID=81841961-1f66-4bbf-ab3a-2646a1326e8d,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:38.409145 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d98b3e6e-ce88-4a85-99c9-9476dce152f3 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:38.418769 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-d98b3e6e-ce88-4a85-99c9-9476dce152f3 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/ports/f8a4f9ac-0d31-44f6-a037-c56638319eb9 HTTP/1.1" status: 404 len: 333 time: 0.0695498 Nov 09 04:34:38.430811 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e03b6c88-3f45-40d0-9cfe-362847422bd3 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:38.433040 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-931843f2-fb11-4708-a11f-51269adba514 None None] No DVR routers for this DVR port 81841961-1f66-4bbf-ab3a-2646a1326e8d on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:34:38.453030 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-207c2f7e-68ed-45fa-8cf4-cb8a9c8a3bb4 None None] Routers {'203a01a6-369d-4e73-a6d0-b0605f8d5a6a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:34:38.453869 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-207c2f7e-68ed-45fa-8cf4-cb8a9c8a3bb4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:34:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['203a01a6-369d-4e73-a6d0-b0605f8d5a6a'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:38.456942 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58234) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:38.493213 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0175ed2b-38b8-42d6-b982-66779c0ad298 None None] Pushing event updated for resources: {'Port': ['ID=873960f9-e8b5-48a6-a119-47c32f5b7968,revision_number=3']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:38.498230 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-0f59ed4f-f1d1-4cf3-aa63-a74a2be9511b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] DELETE failed (client error): The resource could not be found. Nov 09 04:34:38.498636 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-0f59ed4f-f1d1-4cf3-aa63-a74a2be9511b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:38.504390 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-0f59ed4f-f1d1-4cf3-aa63-a74a2be9511b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/9929229d-3c0c-42fe-be75-aa3c073412f6 HTTP/1.1" status: 404 len: 337 time: 0.0439155 Nov 09 04:34:38.505860 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58236) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:38.508700 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port b5d07ee2-c2b6-490e-8334-ac606dd5ca2d triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:38.509082 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0175ed2b-38b8-42d6-b982-66779c0ad298 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:38.509226 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:38.509776 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0175ed2b-38b8-42d6-b982-66779c0ad298 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:38.509982 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0175ed2b-38b8-42d6-b982-66779c0ad298 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:38.510555 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0175ed2b-38b8-42d6-b982-66779c0ad298 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:38.510956 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0175ed2b-38b8-42d6-b982-66779c0ad298 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:38.512403 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0175ed2b-38b8-42d6-b982-66779c0ad298 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:38.512816 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0175ed2b-38b8-42d6-b982-66779c0ad298 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:38.513232 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0175ed2b-38b8-42d6-b982-66779c0ad298 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:38.513644 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0175ed2b-38b8-42d6-b982-66779c0ad298 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:38.514037 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0175ed2b-38b8-42d6-b982-66779c0ad298 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:38.514645 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0175ed2b-38b8-42d6-b982-66779c0ad298 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:38.514842 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0175ed2b-38b8-42d6-b982-66779c0ad298 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:34:38.540143 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-3f6b3093-e34d-40f1-be5b-2377ab3d5758 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] DELETE failed (client error): The resource could not be found. Nov 09 04:34:38.540921 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-3f6b3093-e34d-40f1-be5b-2377ab3d5758 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:38.544139 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-3f6b3093-e34d-40f1-be5b-2377ab3d5758 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/ports/53e983bc-c23d-44eb-813f-6843807e95b8 HTTP/1.1" status: 404 len: 333 time: 0.0372758 Nov 09 04:34:38.549010 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58238) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:38.586033 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e03b6c88-3f45-40d0-9cfe-362847422bd3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:38.600014 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-207c2f7e-68ed-45fa-8cf4-cb8a9c8a3bb4 None None] Set router 203a01a6-369d-4e73-a6d0-b0605f8d5a6a gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:34:38.619478 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-d8d2ac19-77af-4678-bf10-c2563515075a tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] DELETE failed (client error): The resource could not be found. Nov 09 04:34:38.619917 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d8d2ac19-77af-4678-bf10-c2563515075a tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:38.626291 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-d8d2ac19-77af-4678-bf10-c2563515075a tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/23dc2386-fb53-4305-a616-d5e868e5db20 HTTP/1.1" status: 404 len: 337 time: 0.0756309 Nov 09 04:34:38.629966 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58240) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:38.649162 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e03b6c88-3f45-40d0-9cfe-362847422bd3 admin admin] Network 999b1b20-f8fc-4caf-84cc-3feda426a0bf is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:34:38.653741 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-e03b6c88-3f45-40d0-9cfe-362847422bd3 admin admin] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:38.655946 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-1e846a4c-8d29-482e-9865-efe4a34a9e6b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] DELETE failed (client error): The resource could not be found. Nov 09 04:34:38.656188 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e03b6c88-3f45-40d0-9cfe-362847422bd3 admin admin] Pushing event updated for resources: {'Port': ['ID=a5f1e54d-1d98-4741-a1ce-59f4cfb5b332,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:38.656820 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-1e846a4c-8d29-482e-9865-efe4a34a9e6b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:38.661330 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-1e846a4c-8d29-482e-9865-efe4a34a9e6b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/ports/695fbdef-2a5a-46bf-93c9-95c121ee6ece HTTP/1.1" status: 404 len: 333 time: 0.0302780 Nov 09 04:34:38.665718 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e03b6c88-3f45-40d0-9cfe-362847422bd3 admin admin] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:34:38.668179 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58242) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:38.683393 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 81841961-1f66-4bbf-ab3a-2646a1326e8d no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:34:38.709931 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 81841961-1f66-4bbf-ab3a-2646a1326e8d {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:34:38.710184 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 81841961-1f66-4bbf-ab3a-2646a1326e8d not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:34:38.742566 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-6063a231-5ec0-4878-907d-58243e232122 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] DELETE failed (client error): The resource could not be found. Nov 09 04:34:38.743520 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-6063a231-5ec0-4878-907d-58243e232122 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:38.746643 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-6063a231-5ec0-4878-907d-58243e232122 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/6e776c80-24f7-4cd9-bb19-6bb8a2dcb279 HTTP/1.1" status: 404 len: 337 time: 0.0771556 Nov 09 04:34:38.749264 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58244) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:38.764946 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e03b6c88-3f45-40d0-9cfe-362847422bd3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:38.778352 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1e2723f3-c364-42e0-9644-37d8d7743205 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:38.780811 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-5afd29e2-303d-4be0-8cb8-9aa144f10d8c tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] DELETE failed (client error): The resource could not be found. Nov 09 04:34:38.781266 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5afd29e2-303d-4be0-8cb8-9aa144f10d8c tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:38.787413 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-5afd29e2-303d-4be0-8cb8-9aa144f10d8c tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/5d327042-2b73-4cd6-9415-7970deef9f1f HTTP/1.1" status: 404 len: 337 time: 0.0348461 Nov 09 04:34:38.793376 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58246) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:38.852511 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-9f17dfa9-5389-4c26-8d80-c50ae69dfa3e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] DELETE failed (client error): The resource could not be found. Nov 09 04:34:38.867458 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9f17dfa9-5389-4c26-8d80-c50ae69dfa3e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:38.867635 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-207c2f7e-68ed-45fa-8cf4-cb8a9c8a3bb4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'name': 'tempest-TestVolumeBootPattern-1675179943-router', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.164'}], 'enable_snat': True}, 'gw_port_id': '873960f9-e8b5-48a6-a119-47c32f5b7968', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:34:33Z', 'updated_at': '2021-11-09T04:34:35Z', 'revision_number': 3, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'gw_port': {'id': '873960f9-e8b5-48a6-a119-47c32f5b7968', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:95:01', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1097, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.164', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:34:34Z', 'updated_at': '2021-11-09T04:34:38Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:38.867842 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-9f17dfa9-5389-4c26-8d80-c50ae69dfa3e tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/ports/de609b86-479b-4346-af49-b48a6472918a HTTP/1.1" status: 404 len: 333 time: 0.0621343 Nov 09 04:34:38.867842 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58248) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:38.900050 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-207c2f7e-68ed-45fa-8cf4-cb8a9c8a3bb4 None None] The sync data for ids ['203a01a6-369d-4e73-a6d0-b0605f8d5a6a'] in dv-neutron-816802-2-hyperv is: [{'id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'name': 'tempest-TestVolumeBootPattern-1675179943-router', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.164'}], 'enable_snat': True}, 'gw_port_id': '873960f9-e8b5-48a6-a119-47c32f5b7968', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:34:33Z', 'updated_at': '2021-11-09T04:34:35Z', 'revision_number': 3, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'gw_port': {'id': '873960f9-e8b5-48a6-a119-47c32f5b7968', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:95:01', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1097, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.164', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:34:34Z', 'updated_at': '2021-11-09T04:34:38Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:34:38.911785 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-813a3106-8048-401e-a790-19192ebf0f22 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] DELETE failed (client error): The resource could not be found. Nov 09 04:34:38.912292 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-813a3106-8048-401e-a790-19192ebf0f22 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:38.915497 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-813a3106-8048-401e-a790-19192ebf0f22 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/f6183641-d788-4054-bf47-99f434449c17 HTTP/1.1" status: 404 len: 337 time: 0.0547578 Nov 09 04:34:38.918122 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58250) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:38.924760 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e2723f3-c364-42e0-9644-37d8d7743205 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event updated for resources: {'Subnet': ['ID=938711af-2733-44e7-981e-9b7f96c032d6,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:38.931511 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1e2723f3-c364-42e0-9644-37d8d7743205 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Checking segment: {'id': 'e8c00fc8-7e86-4d0c-be0e-3497a4a17cb5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 309, 'network_id': '0762b9da-b197-4e44-a8c9-f5b19a0206b2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:34:38.931987 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1e2723f3-c364-42e0-9644-37d8d7743205 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Network hostable DHCP agents. Network: 0762b9da-b197-4e44-a8c9-f5b19a0206b2, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:34:38.951723 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-c278c041-5c60-43d2-b24d-8f2bd7acd3c1 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] DELETE failed (client error): The resource could not be found. Nov 09 04:34:38.952178 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c278c041-5c60-43d2-b24d-8f2bd7acd3c1 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:38.955350 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-c278c041-5c60-43d2-b24d-8f2bd7acd3c1 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/cb7a4f2f-e10f-465c-a22b-b22e65acbf38 HTTP/1.1" status: 404 len: 337 time: 0.0358663 Nov 09 04:34:38.957964 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58252) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:38.983576 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-4746ddd9-1fef-4774-a8ad-90e855dafa32 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] DELETE failed (client error): The resource could not be found. Nov 09 04:34:38.984246 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-4746ddd9-1fef-4774-a8ad-90e855dafa32 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:38.987938 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-4746ddd9-1fef-4774-a8ad-90e855dafa32 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/ports/72a65b9f-24dc-4ee2-a165-b8c907953cbf HTTP/1.1" status: 404 len: 333 time: 0.0290132 Nov 09 04:34:38.990646 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58254) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:39.010076 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e03b6c88-3f45-40d0-9cfe-362847422bd3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:39.019491 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1e2723f3-c364-42e0-9644-37d8d7743205 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Network 0762b9da-b197-4e44-a8c9-f5b19a0206b2 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:34:39.023114 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-5f26de4f-613b-4f3c-b5b7-0e00084e8565 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] DELETE failed (client error): The resource could not be found. Nov 09 04:34:39.023732 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5f26de4f-613b-4f3c-b5b7-0e00084e8565 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:39.026921 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-5f26de4f-613b-4f3c-b5b7-0e00084e8565 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/0443928b-d719-43d8-9ea7-e1f06c3fe17d HTTP/1.1" status: 404 len: 337 time: 0.0352824 Nov 09 04:34:39.029545 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58256) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:39.035532 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-8ae5119a-0983-41dc-8d4a-ec6e670dfb82 None None] Provisioning complete for port a5f1e54d-1d98-4741-a1ce-59f4cfb5b332 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:39.037619 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8ae5119a-0983-41dc-8d4a-ec6e670dfb82 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:39.058097 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-74097b8f-5b12-432b-ad81-1cb5f35dec03 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] DELETE failed (client error): The resource could not be found. Nov 09 04:34:39.058600 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-74097b8f-5b12-432b-ad81-1cb5f35dec03 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:39.061754 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-74097b8f-5b12-432b-ad81-1cb5f35dec03 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/4d70f328-6f2a-4019-a3c5-3a110db5d988 HTTP/1.1" status: 404 len: 337 time: 0.0312209 Nov 09 04:34:39.064256 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58258) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:39.085114 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-8ae5119a-0983-41dc-8d4a-ec6e670dfb82 None None] Port a5f1e54d-1d98-4741-a1ce-59f4cfb5b332 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:34:39.095226 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-e4696e30-5a32-4103-afe0-dbda476936aa tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] DELETE failed (client error): The resource could not be found. Nov 09 04:34:39.102447 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e4696e30-5a32-4103-afe0-dbda476936aa tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:39.102447 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e4696e30-5a32-4103-afe0-dbda476936aa tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/ports/996d0c64-fb2e-4dd3-84a6-1d4ca6cc05c9 HTTP/1.1" status: 404 len: 333 time: 0.0341654 Nov 09 04:34:39.102835 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58260) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:39.103179 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-1e2723f3-c364-42e0-9644-37d8d7743205 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 0762b9da-b197-4e44-a8c9-f5b19a0206b2) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:39.108175 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1e2723f3-c364-42e0-9644-37d8d7743205 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:39.108808 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1e2723f3-c364-42e0-9644-37d8d7743205 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:39.116566 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5a721b97-1f6c-4408-84ab-f5bc9256dfb9 None None] Network 0762b9da-b197-4e44-a8c9-f5b19a0206b2 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:34:39.176594 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-0b561f5d-c564-49f0-a95a-312d17f90cfd tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] DELETE failed (client error): The resource could not be found. Nov 09 04:34:39.177741 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-0b561f5d-c564-49f0-a95a-312d17f90cfd tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:39.184146 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-0b561f5d-c564-49f0-a95a-312d17f90cfd tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/5601d7cd-bce5-40c4-a86c-ee5755339edb HTTP/1.1" status: 404 len: 337 time: 0.0804677 Nov 09 04:34:39.186697 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58262) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:39.208428 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-1e2723f3-c364-42e0-9644-37d8d7743205 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.2841699 Nov 09 04:34:39.210677 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58264) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:39.215658 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-bce3921e-8345-4348-954c-f9ce668e419c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Request body: {'subnet': {'network_id': '308a67ee-d876-44e1-8a9d-b23323a6a50c', 'cidr': '2001:db8:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:1::1'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:39.224261 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-c28a7586-511d-4b59-a754-e7cf22bbd5ae tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] DELETE failed (client error): The resource could not be found. Nov 09 04:34:39.224719 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c28a7586-511d-4b59-a754-e7cf22bbd5ae tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:39.227817 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-c28a7586-511d-4b59-a754-e7cf22bbd5ae tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/499c6d67-335c-447c-a852-480d77db57cd HTTP/1.1" status: 404 len: 337 time: 0.0401399 Nov 09 04:34:39.230336 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58266) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:39.263222 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-d99deda2-8f50-4d4d-8d55-dd5e754f3f58 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/ports?device_id=12f1801e-1293-4cba-b48b-b9becf0da441 HTTP/1.1" status: 200 len: 205 time: 0.0317082 Nov 09 04:34:39.265993 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58268) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:39.316762 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-7df149ae-be14-4c05-b8eb-c48f0a0adf08 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] delete failed (client error): The resource could not be found. Nov 09 04:34:39.318372 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-7df149ae-be14-4c05-b8eb-c48f0a0adf08 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/routers/12f1801e-1293-4cba-b48b-b9becf0da441 HTTP/1.1" status: 404 len: 336 time: 0.0514367 Nov 09 04:34:39.322389 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58270) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:39.325668 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6085e617-8834-4ac4-8a89-05b90758d6aa None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-0762b9da-b197-4e44-a8c9-f5b19a0206b2', 'network_id': '0762b9da-b197-4e44-a8c9-f5b19a0206b2', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'fixed_ips': [{'subnet_id': '938711af-2733-44e7-981e-9b7f96c032d6'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:34:39.326618 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6085e617-8834-4ac4-8a89-05b90758d6aa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:39.367799 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-5729c353-88c1-4a22-8e98-27a784b6ff63 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] DELETE failed (client error): The resource could not be found. Nov 09 04:34:39.368262 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5729c353-88c1-4a22-8e98-27a784b6ff63 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:39.373675 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-5729c353-88c1-4a22-8e98-27a784b6ff63 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/f01a9e64-acbf-4c7c-800c-5ec2adc6fdff HTTP/1.1" status: 404 len: 337 time: 0.0487406 Nov 09 04:34:39.373900 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58272) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:39.406568 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-b1d652a1-ee90-4017-b049-c3ea78cf9bb5 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "GET /v2.0/ports?device_id=e32c32b3-649c-4478-b86a-b410c5d84442 HTTP/1.1" status: 200 len: 205 time: 0.0293112 Nov 09 04:34:39.407638 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58274) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:39.421298 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e03b6c88-3f45-40d0-9cfe-362847422bd3 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:39.452422 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bce3921e-8345-4348-954c-f9ce668e419c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Made reservation on behalf of d11b025703b24d109deef7bfe57a45f6 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:34:39.456508 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bce3921e-8345-4348-954c-f9ce668e419c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:39.461301 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.api.v2.resource [None req-97719af3-41a2-42e0-926b-7d9f9cfb2506 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] delete failed (client error): The resource could not be found. Nov 09 04:34:39.462333 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-97719af3-41a2-42e0-926b-7d9f9cfb2506 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/routers/e32c32b3-649c-4478-b86a-b410c5d84442 HTTP/1.1" status: 404 len: 336 time: 0.0543995 Nov 09 04:34:39.465775 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58276) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:39.488673 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-6085e617-8834-4ac4-8a89-05b90758d6aa None None] Allocated IP 2001:db8::2 (0762b9da-b197-4e44-a8c9-f5b19a0206b2/938711af-2733-44e7-981e-9b7f96c032d6/87659551-9a17-4b8c-8b54-3343b9b4d7d1) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:34:39.504316 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-95eeeb98-fa73-4cd1-ad17-5dbe994e4380 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] DELETE failed (client error): The resource could not be found. Nov 09 04:34:39.504780 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-95eeeb98-fa73-4cd1-ad17-5dbe994e4380 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:39.507888 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-95eeeb98-fa73-4cd1-ad17-5dbe994e4380 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/98e87e5b-5029-4179-8c5e-5a54cfdbc402 HTTP/1.1" status: 404 len: 337 time: 0.0406222 Nov 09 04:34:39.510374 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58278) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:39.541291 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e03b6c88-3f45-40d0-9cfe-362847422bd3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:39.604742 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e03b6c88-3f45-40d0-9cfe-362847422bd3 admin admin] Pushing event updated for resources: {'Port': ['ID=a5f1e54d-1d98-4741-a1ce-59f4cfb5b332,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:39.607345 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-00b58fe8-d53a-4b0d-aa5c-08cefbbed724 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] DELETE failed (client error): The resource could not be found. Nov 09 04:34:39.607820 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-00b58fe8-d53a-4b0d-aa5c-08cefbbed724 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:39.611045 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-00b58fe8-d53a-4b0d-aa5c-08cefbbed724 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/e58f2a23-3422-4da7-b1e2-ec6064e2517b HTTP/1.1" status: 404 len: 337 time: 0.0996044 Nov 09 04:34:39.614971 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58280) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:39.645696 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-925bf335-4ed5-4d8a-8e22-6a16ba2ac9d4 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] DELETE failed (client error): The resource could not be found. Nov 09 04:34:39.646443 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-925bf335-4ed5-4d8a-8e22-6a16ba2ac9d4 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:39.649477 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-925bf335-4ed5-4d8a-8e22-6a16ba2ac9d4 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/ports/296fa527-86e8-4695-a10c-f0465f5343cd HTTP/1.1" status: 404 len: 333 time: 0.0334384 Nov 09 04:34:39.652106 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58282) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:39.661422 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e03b6c88-3f45-40d0-9cfe-362847422bd3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:39.682885 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6085e617-8834-4ac4-8a89-05b90758d6aa None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:39.688715 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-c5bfebb0-c963-4cb2-b2d6-c14a3e67a5a9 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] DELETE failed (client error): The resource could not be found. Nov 09 04:34:39.694622 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c5bfebb0-c963-4cb2-b2d6-c14a3e67a5a9 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:39.694622 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-c5bfebb0-c963-4cb2-b2d6-c14a3e67a5a9 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/e1e90599-9e6d-4f55-825b-7f5eee66d7b4 HTTP/1.1" status: 404 len: 337 time: 0.0394647 Nov 09 04:34:39.695346 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58284) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:39.728963 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-dc15855f-ce94-475c-a604-d419ce036d9c tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] DELETE failed (client error): The resource could not be found. Nov 09 04:34:39.729689 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-dc15855f-ce94-475c-a604-d419ce036d9c tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:39.732822 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-dc15855f-ce94-475c-a604-d419ce036d9c tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/ports/01784344-5ca6-436b-acf7-fe0e2b04265f HTTP/1.1" status: 404 len: 333 time: 0.0364735 Nov 09 04:34:39.735620 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58286) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:39.762806 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-b146a34f-9048-4467-8d88-050dcc68f038 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] DELETE failed (client error): The resource could not be found. Nov 09 04:34:39.763278 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b146a34f-9048-4467-8d88-050dcc68f038 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:39.767183 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-b146a34f-9048-4467-8d88-050dcc68f038 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/9bad9202-55ee-47a4-8bff-0df555101d70 HTTP/1.1" status: 404 len: 337 time: 0.0302453 Nov 09 04:34:39.769724 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58288) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:39.772193 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6085e617-8834-4ac4-8a89-05b90758d6aa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:39.793557 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-02594ab0-dfa3-46a6-bd07-d3568125d1a1 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] DELETE failed (client error): The resource could not be found. Nov 09 04:34:39.794404 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-02594ab0-dfa3-46a6-bd07-d3568125d1a1 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:39.797928 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-02594ab0-dfa3-46a6-bd07-d3568125d1a1 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/ports/bee544d4-6429-4229-89e5-f084b5b13d62 HTTP/1.1" status: 404 len: 333 time: 0.0270362 Nov 09 04:34:39.800169 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58290) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:39.823016 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e03b6c88-3f45-40d0-9cfe-362847422bd3 admin admin] Network 999b1b20-f8fc-4caf-84cc-3feda426a0bf is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:34:39.824383 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6085e617-8834-4ac4-8a89-05b90758d6aa None None] Network 0762b9da-b197-4e44-a8c9-f5b19a0206b2 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:34:39.825175 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-e03b6c88-3f45-40d0-9cfe-362847422bd3 admin admin] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:39.827042 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-6085e617-8834-4ac4-8a89-05b90758d6aa None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:39.830580 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-1de89d95-8724-4f31-94f8-31c42fb1d2b3 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] DELETE failed (client error): The resource could not be found. Nov 09 04:34:39.831200 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-1de89d95-8724-4f31-94f8-31c42fb1d2b3 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:39.832740 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6085e617-8834-4ac4-8a89-05b90758d6aa None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:34:39.835531 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-1de89d95-8724-4f31-94f8-31c42fb1d2b3 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/c0f38e80-422e-45b9-9f12-68df700bab47 HTTP/1.1" status: 404 len: 337 time: 0.0343544 Nov 09 04:34:39.838156 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58292) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:39.839279 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6085e617-8834-4ac4-8a89-05b90758d6aa None None] Pushing event updated for resources: {'Port': ['ID=87659551-9a17-4b8c-8b54-3343b9b4d7d1,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:39.840436 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bce3921e-8345-4348-954c-f9ce668e419c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:39.930102 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-6085e617-8834-4ac4-8a89-05b90758d6aa None None] Attempting to bind port 87659551-9a17-4b8c-8b54-3343b9b4d7d1 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:34:39.930525 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-6085e617-8834-4ac4-8a89-05b90758d6aa None None] Attempting to bind port 87659551-9a17-4b8c-8b54-3343b9b4d7d1 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'e8c00fc8-7e86-4d0c-be0e-3497a4a17cb5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 309, 'network_id': '0762b9da-b197-4e44-a8c9-f5b19a0206b2'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:34:39.930898 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6085e617-8834-4ac4-8a89-05b90758d6aa None None] Attempting to bind port 87659551-9a17-4b8c-8b54-3343b9b4d7d1 on network 0762b9da-b197-4e44-a8c9-f5b19a0206b2 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:34:39.932517 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-dc221fff-9efc-41ae-96fb-bd14a074ff87 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] DELETE failed (client error): The resource could not be found. Nov 09 04:34:39.933243 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-dc221fff-9efc-41ae-96fb-bd14a074ff87 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:39.939829 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-dc221fff-9efc-41ae-96fb-bd14a074ff87 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/ports/aed3591a-5327-45ab-8bfc-73eccafb40bf HTTP/1.1" status: 404 len: 333 time: 0.0975254 Nov 09 04:34:39.940281 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58294) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:39.941408 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bce3921e-8345-4348-954c-f9ce668e419c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event updated for resources: {'Subnet': ['ID=962fe5dd-cac2-4c2e-9a96-da92da0b202f,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:39.947880 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6085e617-8834-4ac4-8a89-05b90758d6aa None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 34, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:34:39.949190 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6085e617-8834-4ac4-8a89-05b90758d6aa None None] Checking segment: {'id': 'e8c00fc8-7e86-4d0c-be0e-3497a4a17cb5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 309, 'network_id': '0762b9da-b197-4e44-a8c9-f5b19a0206b2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:34:39.949848 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6085e617-8834-4ac4-8a89-05b90758d6aa None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:39.950495 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6085e617-8834-4ac4-8a89-05b90758d6aa None None] Bound using segment: {'id': 'e8c00fc8-7e86-4d0c-be0e-3497a4a17cb5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 309, 'network_id': '0762b9da-b197-4e44-a8c9-f5b19a0206b2'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:34:39.951771 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-6085e617-8834-4ac4-8a89-05b90758d6aa None None] Bound port: 87659551-9a17-4b8c-8b54-3343b9b4d7d1, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e8c00fc8-7e86-4d0c-be0e-3497a4a17cb5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 309, 'network_id': '0762b9da-b197-4e44-a8c9-f5b19a0206b2'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:34:39.952498 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6085e617-8834-4ac4-8a89-05b90758d6aa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:39.965129 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bce3921e-8345-4348-954c-f9ce668e419c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Checking segment: {'id': '324e2708-5459-4f84-8758-baac25e2c4a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 312, 'network_id': '308a67ee-d876-44e1-8a9d-b23323a6a50c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:34:39.965129 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bce3921e-8345-4348-954c-f9ce668e419c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Network hostable DHCP agents. Network: 308a67ee-d876-44e1-8a9d-b23323a6a50c, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:34:40.026898 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-6085e617-8834-4ac4-8a89-05b90758d6aa None None] For port 87659551-9a17-4b8c-8b54-3343b9b4d7d1, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:34:40.030574 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-6085e617-8834-4ac4-8a89-05b90758d6aa None None] For port 87659551-9a17-4b8c-8b54-3343b9b4d7d1, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=87659551-9a17-4b8c-8b54-3343b9b4d7d1,segment=NetworkSegment(e8c00fc8-7e86-4d0c-be0e-3497a4a17cb5),segment_id=e8c00fc8-7e86-4d0c-be0e-3497a4a17cb5)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:34:40.050846 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bce3921e-8345-4348-954c-f9ce668e419c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Network 308a67ee-d876-44e1-8a9d-b23323a6a50c is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:34:40.116169 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6085e617-8834-4ac4-8a89-05b90758d6aa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:40.142716 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-bce3921e-8345-4348-954c-f9ce668e419c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 308a67ee-d876-44e1-8a9d-b23323a6a50c) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:40.147315 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bce3921e-8345-4348-954c-f9ce668e419c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:40.149945 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bce3921e-8345-4348-954c-f9ce668e419c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:40.166199 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-565ca3f8-41cd-42a5-8198-f0ab489b7dad None None] Provisioning complete for port a5f1e54d-1d98-4741-a1ce-59f4cfb5b332 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:40.166621 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-565ca3f8-41cd-42a5-8198-f0ab489b7dad None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:40.172086 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-116f05e8-7f61-4e91-9a00-11ebacd566a7 None None] Network 308a67ee-d876-44e1-8a9d-b23323a6a50c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:34:40.230951 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-bce3921e-8345-4348-954c-f9ce668e419c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 830 time: 1.0180786 Nov 09 04:34:40.231795 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58296) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:40.231926 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 873960f9-e8b5-48a6-a119-47c32f5b7968 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:34:40.236994 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-55262b44-c56a-4033-a252-7f7b049ec116 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-350558996', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:40.301615 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-4284ed8e-bc96-4397-8c10-5e20b9ceae54 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] DELETE failed (client error): The resource could not be found. Nov 09 04:34:40.301993 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-4284ed8e-bc96-4397-8c10-5e20b9ceae54 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:40.305209 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-4284ed8e-bc96-4397-8c10-5e20b9ceae54 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/6c3c1072-37d8-461c-8a31-3789e3e5eaf7 HTTP/1.1" status: 404 len: 337 time: 0.3636954 Nov 09 04:34:40.308933 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58298) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:40.330037 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6085e617-8834-4ac4-8a89-05b90758d6aa None None] Pushing event updated for resources: {'Port': ['ID=87659551-9a17-4b8c-8b54-3343b9b4d7d1,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:40.339235 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-565ca3f8-41cd-42a5-8198-f0ab489b7dad None None] Port a5f1e54d-1d98-4741-a1ce-59f4cfb5b332 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:34:40.360927 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 873960f9-e8b5-48a6-a119-47c32f5b7968 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:40.361171 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-ea04f98f-9499-4509-a557-cba782cc5a00 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] DELETE failed (client error): The resource could not be found. Nov 09 04:34:40.361286 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:40.361761 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ea04f98f-9499-4509-a557-cba782cc5a00 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:40.363914 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-55262b44-c56a-4033-a252-7f7b049ec116 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:40.367179 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-ea04f98f-9499-4509-a557-cba782cc5a00 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/ports/03891abd-b2fb-4d81-b80b-a9984a414409 HTTP/1.1" status: 404 len: 333 time: 0.0557578 Nov 09 04:34:40.367354 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-55262b44-c56a-4033-a252-7f7b049ec116 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:40.367866 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58300) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:40.406945 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-1c0fc8f5-c0ec-42e7-a87b-a42bc4e6afac tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] DELETE failed (client error): The resource could not be found. Nov 09 04:34:40.407407 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-1c0fc8f5-c0ec-42e7-a87b-a42bc4e6afac tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:40.412966 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1c0fc8f5-c0ec-42e7-a87b-a42bc4e6afac tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/67140727-f9f7-4047-9fd5-43683f7c06a7 HTTP/1.1" status: 404 len: 337 time: 0.0410616 Nov 09 04:34:40.413857 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58302) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:40.446996 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-96d6f589-732b-4089-a6ba-246327706b35 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] DELETE failed (client error): The resource could not be found. Nov 09 04:34:40.447487 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-96d6f589-732b-4089-a6ba-246327706b35 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:40.453095 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-96d6f589-732b-4089-a6ba-246327706b35 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/ports/2c47b2ed-7da9-4d5e-b302-869d6b6e0fb5 HTTP/1.1" status: 404 len: 333 time: 0.0364978 Nov 09 04:34:40.454917 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58304) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:40.478628 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-55262b44-c56a-4033-a252-7f7b049ec116 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:40.487674 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e03b6c88-3f45-40d0-9cfe-362847422bd3 admin admin] Router 203a01a6-369d-4e73-a6d0-b0605f8d5a6a has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:34:40.511061 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-f74c7233-f307-4e9c-ab48-2f3e217316e0 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] DELETE failed (client error): The resource could not be found. Nov 09 04:34:40.511528 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-f74c7233-f307-4e9c-ab48-2f3e217316e0 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:40.514664 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-f74c7233-f307-4e9c-ab48-2f3e217316e0 tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/f87f05fc-e7ae-49d9-a997-c37a6526719b HTTP/1.1" status: 404 len: 337 time: 0.0595801 Nov 09 04:34:40.518534 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58306) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:40.519848 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-491c7f51-ebaa-458c-a27d-7cf977403428 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-308a67ee-d876-44e1-8a9d-b23323a6a50c', 'network_id': '308a67ee-d876-44e1-8a9d-b23323a6a50c', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'fixed_ips': [{'subnet_id': '962fe5dd-cac2-4c2e-9a96-da92da0b202f'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:34:40.520880 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-491c7f51-ebaa-458c-a27d-7cf977403428 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:40.560286 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-a05fe8b1-31cb-4a98-a600-94279d89c89b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] DELETE failed (client error): The resource could not be found. Nov 09 04:34:40.562138 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a05fe8b1-31cb-4a98-a600-94279d89c89b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:40.566659 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a05fe8b1-31cb-4a98-a600-94279d89c89b tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/ports/ee6eccfd-1357-4b13-bf25-4d1cef0fd60e HTTP/1.1" status: 404 len: 333 time: 0.0466383 Nov 09 04:34:40.567929 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-55262b44-c56a-4033-a252-7f7b049ec116 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:40.569317 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58308) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:40.582402 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:40.617827 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-fb1d8a36-8992-4322-b7c3-7a29eb809f0c tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] DELETE failed (client error): The resource could not be found. Nov 09 04:34:40.618432 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-fb1d8a36-8992-4322-b7c3-7a29eb809f0c tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:34:40.622417 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-fb1d8a36-8992-4322-b7c3-7a29eb809f0c tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/subnets/1bcc611a-d3c8-4019-aae7-12b401d69e2f HTTP/1.1" status: 404 len: 337 time: 0.0514832 Nov 09 04:34:40.624975 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58310) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:40.675496 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 873960f9-e8b5-48a6-a119-47c32f5b7968, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=873960f9-e8b5-48a6-a119-47c32f5b7968,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:34:40.675766 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-55262b44-c56a-4033-a252-7f7b049ec116 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:40.681045 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-55262b44-c56a-4033-a252-7f7b049ec116 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 703 time: 0.4474304 Nov 09 04:34:40.681248 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58312) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:40.733426 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-491c7f51-ebaa-458c-a27d-7cf977403428 None None] Allocated IP 2001:db8:1::2 (308a67ee-d876-44e1-8a9d-b23323a6a50c/962fe5dd-cac2-4c2e-9a96-da92da0b202f/68c2c79c-2236-4dc6-9aef-7301099cbbca) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:34:40.736838 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e03b6c88-3f45-40d0-9cfe-362847422bd3 admin admin] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:34:40.749665 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:40.772397 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-811f60a9-84cd-457c-8e20-86a07a4129be tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:40.775336 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-e03b6c88-3f45-40d0-9cfe-362847422bd3 admin admin] 10.222.0.24 "PUT /v2.0/routers/203a01a6-369d-4e73-a6d0-b0605f8d5a6a/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.6332452 Nov 09 04:34:40.859145 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=873960f9-e8b5-48a6-a119-47c32f5b7968,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:40.912662 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-811f60a9-84cd-457c-8e20-86a07a4129be tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:40.941217 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-811f60a9-84cd-457c-8e20-86a07a4129be tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['988d2354-693c-4d52-af17-25e0643eaa0c']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:40.953072 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-811f60a9-84cd-457c-8e20-86a07a4129be tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'af4cde93-bd96-45fc-bfc1-9d70f48450dd') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:40.953072 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-811f60a9-84cd-457c-8e20-86a07a4129be tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'af4cde93-bd96-45fc-bfc1-9d70f48450dd') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:40.970424 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-811f60a9-84cd-457c-8e20-86a07a4129be tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:40.986631 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-491c7f51-ebaa-458c-a27d-7cf977403428 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:40.986851 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-811f60a9-84cd-457c-8e20-86a07a4129be tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:40.995406 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-811f60a9-84cd-457c-8e20-86a07a4129be tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Releasing vlan 349 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:34:40.995406 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-811f60a9-84cd-457c-8e20-86a07a4129be tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:40.998599 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:34:40.998599 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:34:40.998599 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:34:40.998599 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:34:40.998599 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:34:40.998599 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:34:40.998599 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:34:40.998599 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:34:40.998599 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:34:40.998599 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:34:40.998599 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:34:40.998599 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:34:40.998599 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:34:40.998599 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:34:40.998599 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:34:40.998599 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:34:40.998599 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:34:40.998599 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:34:40.998599 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:34:40.998599 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:34:40.998599 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:34:40.998599 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:34:40.998599 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:34:40.998599 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:34:40.998599 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:34:40.998599 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:34:40.998599 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:34:40.998599 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:34:40.998599 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:34:40.998599 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:34:40.998599 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:34:40.998599 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:34:41.048498 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f7bbe5c8-eed9-4972-8a6d-5d110a1fb86e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:41.062480 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-491c7f51-ebaa-458c-a27d-7cf977403428 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:41.105108 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-491c7f51-ebaa-458c-a27d-7cf977403428 None None] Network 308a67ee-d876-44e1-8a9d-b23323a6a50c is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:34:41.113107 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-491c7f51-ebaa-458c-a27d-7cf977403428 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:41.117823 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-491c7f51-ebaa-458c-a27d-7cf977403428 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:34:41.121622 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-491c7f51-ebaa-458c-a27d-7cf977403428 None None] Pushing event updated for resources: {'Port': ['ID=68c2c79c-2236-4dc6-9aef-7301099cbbca,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:41.158088 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-811f60a9-84cd-457c-8e20-86a07a4129be tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:41.163476 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-811f60a9-84cd-457c-8e20-86a07a4129be tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:41.170385 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-811f60a9-84cd-457c-8e20-86a07a4129be tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] 10.222.0.24 "DELETE /v2.0/networks/988d2354-693c-4d52-af17-25e0643eaa0c HTTP/1.1" status: 204 len: 168 time: 0.5442102 Nov 09 04:34:41.191781 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-811f60a9-84cd-457c-8e20-86a07a4129be tempest-NetworksTestDHCPv6-1363260239 tempest-NetworksTestDHCPv6-1363260239-project] Pushing event deleted for resources: {'Network': ['ID=988d2354-693c-4d52-af17-25e0643eaa0c,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:41.228828 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-491c7f51-ebaa-458c-a27d-7cf977403428 None None] Attempting to bind port 68c2c79c-2236-4dc6-9aef-7301099cbbca on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:34:41.230793 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-491c7f51-ebaa-458c-a27d-7cf977403428 None None] Attempting to bind port 68c2c79c-2236-4dc6-9aef-7301099cbbca by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '324e2708-5459-4f84-8758-baac25e2c4a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 312, 'network_id': '308a67ee-d876-44e1-8a9d-b23323a6a50c'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:34:41.231158 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-491c7f51-ebaa-458c-a27d-7cf977403428 None None] Attempting to bind port 68c2c79c-2236-4dc6-9aef-7301099cbbca on network 308a67ee-d876-44e1-8a9d-b23323a6a50c {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:34:41.241263 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-491c7f51-ebaa-458c-a27d-7cf977403428 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 34, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:34:41.241263 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-491c7f51-ebaa-458c-a27d-7cf977403428 None None] Checking segment: {'id': '324e2708-5459-4f84-8758-baac25e2c4a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 312, 'network_id': '308a67ee-d876-44e1-8a9d-b23323a6a50c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:34:41.241639 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-491c7f51-ebaa-458c-a27d-7cf977403428 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:41.241987 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-491c7f51-ebaa-458c-a27d-7cf977403428 None None] Bound using segment: {'id': '324e2708-5459-4f84-8758-baac25e2c4a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 312, 'network_id': '308a67ee-d876-44e1-8a9d-b23323a6a50c'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:34:41.242485 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-491c7f51-ebaa-458c-a27d-7cf977403428 None None] Bound port: 68c2c79c-2236-4dc6-9aef-7301099cbbca, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '324e2708-5459-4f84-8758-baac25e2c4a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 312, 'network_id': '308a67ee-d876-44e1-8a9d-b23323a6a50c'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:34:41.242959 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-491c7f51-ebaa-458c-a27d-7cf977403428 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:41.352347 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-491c7f51-ebaa-458c-a27d-7cf977403428 None None] For port 68c2c79c-2236-4dc6-9aef-7301099cbbca, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:34:41.357792 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-491c7f51-ebaa-458c-a27d-7cf977403428 None None] For port 68c2c79c-2236-4dc6-9aef-7301099cbbca, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=68c2c79c-2236-4dc6-9aef-7301099cbbca,segment=NetworkSegment(324e2708-5459-4f84-8758-baac25e2c4a2),segment_id=324e2708-5459-4f84-8758-baac25e2c4a2)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:34:41.371815 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-18752229-0bcf-4b7c-ab8b-0fa39b7e352c None None] Sync routers for ids ['203a01a6-369d-4e73-a6d0-b0605f8d5a6a'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:34:41.383461 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-18752229-0bcf-4b7c-ab8b-0fa39b7e352c None None] Routers {'203a01a6-369d-4e73-a6d0-b0605f8d5a6a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:34:41.384168 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-18752229-0bcf-4b7c-ab8b-0fa39b7e352c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:34:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['203a01a6-369d-4e73-a6d0-b0605f8d5a6a'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:41.390964 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-f7bbe5c8-eed9-4972-8a6d-5d110a1fb86e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Allocated IP 2001:db8::1 (0762b9da-b197-4e44-a8c9-f5b19a0206b2/938711af-2733-44e7-981e-9b7f96c032d6/082d3ede-c135-4f54-baa7-48183d21134c) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:34:41.429004 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d8b5efbb-3605-43d4-a2b0-84589f5c0bcf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:41.438014 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-491c7f51-ebaa-458c-a27d-7cf977403428 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:41.543423 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f7bbe5c8-eed9-4972-8a6d-5d110a1fb86e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:41.549192 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-491c7f51-ebaa-458c-a27d-7cf977403428 None None] Pushing event updated for resources: {'Port': ['ID=68c2c79c-2236-4dc6-9aef-7301099cbbca,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:41.577625 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-18752229-0bcf-4b7c-ab8b-0fa39b7e352c None None] Set router 203a01a6-369d-4e73-a6d0-b0605f8d5a6a gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:34:41.606167 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d6dde3ba-f85a-462f-a5f3-8fcc3e2d9dc7 None None] Network 0762b9da-b197-4e44-a8c9-f5b19a0206b2 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:34:41.675159 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f7bbe5c8-eed9-4972-8a6d-5d110a1fb86e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:41.719084 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-0cd202b5-7455-40b2-b6bc-0d41020b3af9 None None] Provisioning complete for port 87659551-9a17-4b8c-8b54-3343b9b4d7d1 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:41.719084 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0cd202b5-7455-40b2-b6bc-0d41020b3af9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:41.750020 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f7bbe5c8-eed9-4972-8a6d-5d110a1fb86e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Network 0762b9da-b197-4e44-a8c9-f5b19a0206b2 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:34:41.756872 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-f7bbe5c8-eed9-4972-8a6d-5d110a1fb86e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:41.761285 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f7bbe5c8-eed9-4972-8a6d-5d110a1fb86e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:34:41.761778 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f7bbe5c8-eed9-4972-8a6d-5d110a1fb86e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:41.830394 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7bbe5c8-eed9-4972-8a6d-5d110a1fb86e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event updated for resources: {'Port': ['ID=082d3ede-c135-4f54-baa7-48183d21134c,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:41.854674 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58330) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:41.998427 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58336) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:42.004243 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-a0385106-6d10-4b0a-8c2f-d4ee739c8500 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-1317559415-network', 'tenant_id': '18fad88e828540cf998206d16279d5fb'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:42.021412 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f7bbe5c8-eed9-4972-8a6d-5d110a1fb86e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:42.080003 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a39220dd-271b-435e-95db-a83f600ecc61 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=8b0758f781884982bf5b94e6609237f6&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2227566 Nov 09 04:34:42.082591 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58338) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:42.118150 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a0385106-6d10-4b0a-8c2f-d4ee739c8500 admin admin] Made reservation on behalf of 18fad88e828540cf998206d16279d5fb for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:34:42.121081 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a0385106-6d10-4b0a-8c2f-d4ee739c8500 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:42.151300 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a0385106-6d10-4b0a-8c2f-d4ee739c8500 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:42.153435 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:42.205802 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0cd202b5-7455-40b2-b6bc-0d41020b3af9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:42.205938 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a91d14e5-1f27-4d83-bbdb-a6da3d47440e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:42.245836 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a91d14e5-1f27-4d83-bbdb-a6da3d47440e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:42.306672 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-0cd202b5-7455-40b2-b6bc-0d41020b3af9 None None] For port 87659551-9a17-4b8c-8b54-3343b9b4d7d1, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=87659551-9a17-4b8c-8b54-3343b9b4d7d1,segment=NetworkSegment(e8c00fc8-7e86-4d0c-be0e-3497a4a17cb5),segment_id=e8c00fc8-7e86-4d0c-be0e-3497a4a17cb5)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:34:42.317886 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a0385106-6d10-4b0a-8c2f-d4ee739c8500 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:42.321062 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-18752229-0bcf-4b7c-ab8b-0fa39b7e352c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'name': 'tempest-TestVolumeBootPattern-1675179943-router', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.164'}], 'enable_snat': True}, 'gw_port_id': '873960f9-e8b5-48a6-a119-47c32f5b7968', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:34:33Z', 'updated_at': '2021-11-09T04:34:38Z', 'revision_number': 4, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'gw_port': {'id': '873960f9-e8b5-48a6-a119-47c32f5b7968', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:95:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1097, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.164', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:34:34Z', 'updated_at': '2021-11-09T04:34:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'a5f1e54d-1d98-4741-a1ce-59f4cfb5b332', 'name': '', 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'mac_address': 'fa:16:3e:de:ab:2f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1107, 'fixed_ips': [{'subnet_id': 'f6a08667-654b-4e0c-9f85-c6e6712cc239', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:34:37Z', 'updated_at': '2021-11-09T04:34:39Z', 'revision_number': 2, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'subnets': [{'id': 'f6a08667-654b-4e0c-9f85-c6e6712cc239', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:42.355936 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-18752229-0bcf-4b7c-ab8b-0fa39b7e352c None None] Checking router: 203a01a6-369d-4e73-a6d0-b0605f8d5a6a for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:34:42.356406 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-18752229-0bcf-4b7c-ab8b-0fa39b7e352c None None] Updating router 203a01a6-369d-4e73-a6d0-b0605f8d5a6a port a5f1e54d-1d98-4741-a1ce-59f4cfb5b332 binding host dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 04:34:42.361002 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0cd202b5-7455-40b2-b6bc-0d41020b3af9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:42.380349 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 873960f9-e8b5-48a6-a119-47c32f5b7968 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:34:42.382391 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a91d14e5-1f27-4d83-bbdb-a6da3d47440e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:42.385893 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a91d14e5-1f27-4d83-bbdb-a6da3d47440e admin admin] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:42.390307 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f7bbe5c8-eed9-4972-8a6d-5d110a1fb86e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:42.394523 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a91d14e5-1f27-4d83-bbdb-a6da3d47440e admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/e26e25e3-915d-43f3-9d9d-1901466269b2 HTTP/1.1" status: 204 len: 168 time: 0.3085318 Nov 09 04:34:42.395915 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a0385106-6d10-4b0a-8c2f-d4ee739c8500 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:42.409754 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a91d14e5-1f27-4d83-bbdb-a6da3d47440e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e26e25e3-915d-43f3-9d9d-1901466269b2,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:42.423815 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a0385106-6d10-4b0a-8c2f-d4ee739c8500 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 303} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:34:42.450336 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-18752229-0bcf-4b7c-ab8b-0fa39b7e352c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:42.455537 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a0385106-6d10-4b0a-8c2f-d4ee739c8500 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:42.455815 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-a0385106-6d10-4b0a-8c2f-d4ee739c8500 admin admin] Added segment 2e3ecb82-bb37-4300-a753-caff02939e84 of type vlan for network 081edca3-e165-4289-b2f5-202ccc9cf76d Nov 09 04:34:42.467054 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0385106-6d10-4b0a-8c2f-d4ee739c8500 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=aa20aa92-41a6-4711-858b-8dd2743c6e61,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:42.472609 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f7bbe5c8-eed9-4972-8a6d-5d110a1fb86e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:42.473863 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f7bbe5c8-eed9-4972-8a6d-5d110a1fb86e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:42.508681 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a0385106-6d10-4b0a-8c2f-d4ee739c8500 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:42.572443 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cd202b5-7455-40b2-b6bc-0d41020b3af9 None None] Pushing event updated for resources: {'Port': ['ID=87659551-9a17-4b8c-8b54-3343b9b4d7d1,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:42.611587 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a0385106-6d10-4b0a-8c2f-d4ee739c8500 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:42.612637 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a0385106-6d10-4b0a-8c2f-d4ee739c8500 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:42.613269 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a0385106-6d10-4b0a-8c2f-d4ee739c8500 admin admin] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:42.660350 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7bbe5c8-eed9-4972-8a6d-5d110a1fb86e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event updated for resources: {'Port': ['ID=082d3ede-c135-4f54-baa7-48183d21134c,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:42.692273 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 873960f9-e8b5-48a6-a119-47c32f5b7968 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:42.694972 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:42.727777 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0385106-6d10-4b0a-8c2f-d4ee739c8500 admin admin] Pushing event updated for resources: {'Network': ['ID=081edca3-e165-4289-b2f5-202ccc9cf76d,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:42.742849 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a0385106-6d10-4b0a-8c2f-d4ee739c8500 admin admin] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.7408147 Nov 09 04:34:42.743434 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58344) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:42.748616 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-a282514c-3699-4af7-a210-e3f1620f0c53 admin admin] Request body: {'subnet': {'network_id': '081edca3-e165-4289-b2f5-202ccc9cf76d', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-1317559415-subnet', 'tenant_id': '18fad88e828540cf998206d16279d5fb', 'ip_version': 4}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:42.768693 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f7bbe5c8-eed9-4972-8a6d-5d110a1fb86e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Network 0762b9da-b197-4e44-a8c9-f5b19a0206b2 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:34:42.769633 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-f7bbe5c8-eed9-4972-8a6d-5d110a1fb86e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:42.789456 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 081edca3-e165-4289-b2f5-202ccc9cf76d details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:34:42.874116 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a282514c-3699-4af7-a210-e3f1620f0c53 admin admin] Made reservation on behalf of 18fad88e828540cf998206d16279d5fb for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:34:42.899036 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a282514c-3699-4af7-a210-e3f1620f0c53 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:43.002842 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-be5bda6c-a7dd-480e-bf98-f95550ae63c6 None None] Provisioning complete for port 87659551-9a17-4b8c-8b54-3343b9b4d7d1 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:43.003206 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-be5bda6c-a7dd-480e-bf98-f95550ae63c6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:43.010812 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f7bbe5c8-eed9-4972-8a6d-5d110a1fb86e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Router 9ecfd3d4-c0aa-4aca-be16-36fe6637a109 is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102161) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:34:43.139494 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-18752229-0bcf-4b7c-ab8b-0fa39b7e352c None None] Publish callbacks [] for port, precommit_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:43.149926 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-574d1067-b6aa-4c94-ab9f-5d3311a5eb5f None None] Network 308a67ee-d876-44e1-8a9d-b23323a6a50c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:34:43.207708 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f7bbe5c8-eed9-4972-8a6d-5d110a1fb86e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:34:43.218551 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de446a24-b324-4c26-a4e1-5d7cb37a1f1d None None] Sync routers for ids ['9ecfd3d4-c0aa-4aca-be16-36fe6637a109'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:34:43.229934 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-f7bbe5c8-eed9-4972-8a6d-5d110a1fb86e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "PUT /v2.0/routers/9ecfd3d4-c0aa-4aca-be16-36fe6637a109/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.5465956 Nov 09 04:34:43.233370 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de446a24-b324-4c26-a4e1-5d7cb37a1f1d None None] Routers {'9ecfd3d4-c0aa-4aca-be16-36fe6637a109'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:34:43.240412 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 68c2c79c-2236-4dc6-9aef-7301099cbbca up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:34:43.241293 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58356) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:43.242038 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-de446a24-b324-4c26-a4e1-5d7cb37a1f1d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:34:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['9ecfd3d4-c0aa-4aca-be16-36fe6637a109'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:43.277105 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-de446a24-b324-4c26-a4e1-5d7cb37a1f1d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:43.287028 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de446a24-b324-4c26-a4e1-5d7cb37a1f1d None None] Routers {'9ecfd3d4-c0aa-4aca-be16-36fe6637a109'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:34:43.287939 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-de446a24-b324-4c26-a4e1-5d7cb37a1f1d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:34:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['9ecfd3d4-c0aa-4aca-be16-36fe6637a109'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:43.302536 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a282514c-3699-4af7-a210-e3f1620f0c53 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:43.334979 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-de446a24-b324-4c26-a4e1-5d7cb37a1f1d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:43.335311 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de446a24-b324-4c26-a4e1-5d7cb37a1f1d None None] The sync data for ids ['9ecfd3d4-c0aa-4aca-be16-36fe6637a109'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:34:43.348339 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e327b878-a265-444b-aedd-a2772ce91a74 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:43.352794 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e327b878-a265-444b-aedd-a2772ce91a74 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "GET /v2.0/ports/082d3ede-c135-4f54-baa7-48183d21134c HTTP/1.1" status: 200 len: 911 time: 0.1110840 Nov 09 04:34:43.353082 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58358) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:43.362177 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-18752229-0bcf-4b7c-ab8b-0fa39b7e352c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:43.393540 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a282514c-3699-4af7-a210-e3f1620f0c53 admin admin] Pushing event updated for resources: {'Subnet': ['ID=e227662b-cae0-423b-8216-3677cff71c09,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:43.402890 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a282514c-3699-4af7-a210-e3f1620f0c53 admin admin] Checking segment: {'id': '2e3ecb82-bb37-4300-a753-caff02939e84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 303, 'network_id': '081edca3-e165-4289-b2f5-202ccc9cf76d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:34:43.403274 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a282514c-3699-4af7-a210-e3f1620f0c53 admin admin] Network hostable DHCP agents. Network: 081edca3-e165-4289-b2f5-202ccc9cf76d, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:34:43.456595 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 68c2c79c-2236-4dc6-9aef-7301099cbbca triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:43.456595 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:43.478671 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a282514c-3699-4af7-a210-e3f1620f0c53 admin admin] Network 081edca3-e165-4289-b2f5-202ccc9cf76d is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:34:43.518402 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65c0ac7a-5329-4a05-86a6-8f1ba3f8008e None None] Pushing event updated for resources: {'Port': ['ID=a5f1e54d-1d98-4741-a1ce-59f4cfb5b332,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:43.553856 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-a282514c-3699-4af7-a210-e3f1620f0c53 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 081edca3-e165-4289-b2f5-202ccc9cf76d) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:43.558010 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a282514c-3699-4af7-a210-e3f1620f0c53 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:43.558652 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a282514c-3699-4af7-a210-e3f1620f0c53 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:43.574415 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-691e7d99-c629-4a1d-8903-a2b87f2f55f0 None None] Network 081edca3-e165-4289-b2f5-202ccc9cf76d requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:34:43.637537 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a282514c-3699-4af7-a210-e3f1620f0c53 admin admin] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.8919685 Nov 09 04:34:43.648736 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-18752229-0bcf-4b7c-ab8b-0fa39b7e352c None None] Attempting to bind port a5f1e54d-1d98-4741-a1ce-59f4cfb5b332 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:34:43.648865 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58364) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:43.653898 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-266fb248-27ea-4d3c-a010-9d75bbf5f7de admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-1317559415-router', 'tenant_id': '18fad88e828540cf998206d16279d5fb', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:43.657980 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-18752229-0bcf-4b7c-ab8b-0fa39b7e352c None None] Attempting to bind port a5f1e54d-1d98-4741-a1ce-59f4cfb5b332 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'bc4577c9-06a5-450a-9c80-879827986f04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:34:43.658444 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-18752229-0bcf-4b7c-ab8b-0fa39b7e352c None None] Attempting to bind port a5f1e54d-1d98-4741-a1ce-59f4cfb5b332 on network 999b1b20-f8fc-4caf-84cc-3feda426a0bf {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:34:43.685107 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-be5bda6c-a7dd-480e-bf98-f95550ae63c6 None None] Provisioning complete for port 082d3ede-c135-4f54-baa7-48183d21134c triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:43.685620 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-be5bda6c-a7dd-480e-bf98-f95550ae63c6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:43.746043 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-18752229-0bcf-4b7c-ab8b-0fa39b7e352c None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 34, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:34:43.746540 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-18752229-0bcf-4b7c-ab8b-0fa39b7e352c None None] Checking segment: {'id': 'bc4577c9-06a5-450a-9c80-879827986f04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:34:43.746948 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-18752229-0bcf-4b7c-ab8b-0fa39b7e352c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:43.747342 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-18752229-0bcf-4b7c-ab8b-0fa39b7e352c None None] Bound using segment: {'id': 'bc4577c9-06a5-450a-9c80-879827986f04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:34:43.747826 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-18752229-0bcf-4b7c-ab8b-0fa39b7e352c None None] Bound port: a5f1e54d-1d98-4741-a1ce-59f4cfb5b332, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bc4577c9-06a5-450a-9c80-879827986f04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:34:43.748209 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-18752229-0bcf-4b7c-ab8b-0fa39b7e352c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:43.782877 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c6aa55b5-76a1-4c3c-a340-8f8285d86a23 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:43.787836 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-266fb248-27ea-4d3c-a010-9d75bbf5f7de admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:43.788575 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-266fb248-27ea-4d3c-a010-9d75bbf5f7de admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:43.817302 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:43.830710 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2b22c844-2bf8-4dd2-9dad-e1048537f183 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:43.849867 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-be5bda6c-a7dd-480e-bf98-f95550ae63c6 None None] Port 082d3ede-c135-4f54-baa7-48183d21134c cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:34:43.873902 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-266fb248-27ea-4d3c-a010-9d75bbf5f7de admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:43.938453 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 68c2c79c-2236-4dc6-9aef-7301099cbbca, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=68c2c79c-2236-4dc6-9aef-7301099cbbca,segment=NetworkSegment(324e2708-5459-4f84-8758-baac25e2c4a2),segment_id=324e2708-5459-4f84-8758-baac25e2c4a2)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:34:43.952431 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-18752229-0bcf-4b7c-ab8b-0fa39b7e352c None None] For port a5f1e54d-1d98-4741-a1ce-59f4cfb5b332, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:34:43.958439 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-18752229-0bcf-4b7c-ab8b-0fa39b7e352c None None] For port a5f1e54d-1d98-4741-a1ce-59f4cfb5b332, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=a5f1e54d-1d98-4741-a1ce-59f4cfb5b332,segment=NetworkSegment(bc4577c9-06a5-450a-9c80-879827986f04),segment_id=bc4577c9-06a5-450a-9c80-879827986f04)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:34:44.009865 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-8d729ed6-637d-4ea6-adc6-98e441d616af None None] Provisioning complete for port a5f1e54d-1d98-4741-a1ce-59f4cfb5b332 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:44.010497 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8d729ed6-637d-4ea6-adc6-98e441d616af None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:44.018787 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0f7e0c2a-66da-4b18-b429-a1ff003383d3 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-081edca3-e165-4289-b2f5-202ccc9cf76d', 'network_id': '081edca3-e165-4289-b2f5-202ccc9cf76d', 'tenant_id': '18fad88e828540cf998206d16279d5fb', 'fixed_ips': [{'subnet_id': 'e227662b-cae0-423b-8216-3677cff71c09'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:34:44.022269 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0f7e0c2a-66da-4b18-b429-a1ff003383d3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:44.040292 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58372) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:44.056161 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:44.057042 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 87659551-9a17-4b8c-8b54-3343b9b4d7d1 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:34:44.089245 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-18752229-0bcf-4b7c-ab8b-0fa39b7e352c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:44.135713 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-266fb248-27ea-4d3c-a010-9d75bbf5f7de admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:44.168623 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-2b22c844-2bf8-4dd2-9dad-e1048537f183 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Allocated IP 2001:db8:1::1 (308a67ee-d876-44e1-8a9d-b23323a6a50c/962fe5dd-cac2-4c2e-9a96-da92da0b202f/9c9dca1f-731c-4920-bc58-3eaea9738804) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:34:44.201426 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-c6e35c39-35f7-4700-a255-ca5f28982024 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Request body: {'network': {'name': 'tempest-FloatingIPTestJSON-test-network-227314701'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:44.302125 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-8d729ed6-637d-4ea6-adc6-98e441d616af None None] Port a5f1e54d-1d98-4741-a1ce-59f4cfb5b332 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:34:44.307498 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2b22c844-2bf8-4dd2-9dad-e1048537f183 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:44.371149 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c6e35c39-35f7-4700-a255-ca5f28982024 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Made reservation on behalf of 459651e5af964f8c805d518a6dc3b464 for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:34:44.375718 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c6e35c39-35f7-4700-a255-ca5f28982024 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:44.387797 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c6e35c39-35f7-4700-a255-ca5f28982024 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:44.425682 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2b22c844-2bf8-4dd2-9dad-e1048537f183 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:44.477176 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-18752229-0bcf-4b7c-ab8b-0fa39b7e352c None None] Routers {'203a01a6-369d-4e73-a6d0-b0605f8d5a6a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:34:44.478071 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-18752229-0bcf-4b7c-ab8b-0fa39b7e352c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:34:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['203a01a6-369d-4e73-a6d0-b0605f8d5a6a'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:44.480085 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=68c2c79c-2236-4dc6-9aef-7301099cbbca,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:44.545663 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-8d729ed6-637d-4ea6-adc6-98e441d616af None None] Provisioning complete for port 082d3ede-c135-4f54-baa7-48183d21134c triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:44.546174 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8d729ed6-637d-4ea6-adc6-98e441d616af None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:44.548997 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-0f7e0c2a-66da-4b18-b429-a1ff003383d3 None None] Allocated IP 172.20.0.2 (081edca3-e165-4289-b2f5-202ccc9cf76d/e227662b-cae0-423b-8216-3677cff71c09/02e84f22-2290-4e49-8ae8-eeb78740236c) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:34:44.612449 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 87659551-9a17-4b8c-8b54-3343b9b4d7d1 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:44.612890 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:44.739190 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-266fb248-27ea-4d3c-a010-9d75bbf5f7de admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:44.752666 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-8d729ed6-637d-4ea6-adc6-98e441d616af None None] Port 082d3ede-c135-4f54-baa7-48183d21134c cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:34:44.760190 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65c0ac7a-5329-4a05-86a6-8f1ba3f8008e None None] Pushing event updated for resources: {'Port': ['ID=a5f1e54d-1d98-4741-a1ce-59f4cfb5b332,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:44.763472 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-266fb248-27ea-4d3c-a010-9d75bbf5f7de admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:44.809920 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-8d729ed6-637d-4ea6-adc6-98e441d616af None None] Provisioning complete for port 68c2c79c-2236-4dc6-9aef-7301099cbbca triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:44.810444 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8d729ed6-637d-4ea6-adc6-98e441d616af None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:44.814271 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-18752229-0bcf-4b7c-ab8b-0fa39b7e352c None None] Set router 203a01a6-369d-4e73-a6d0-b0605f8d5a6a gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:34:44.826702 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2b22c844-2bf8-4dd2-9dad-e1048537f183 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Network 308a67ee-d876-44e1-8a9d-b23323a6a50c is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:34:44.830126 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b22c844-2bf8-4dd2-9dad-e1048537f183 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event updated for resources: {'Port': ['ID=9c9dca1f-731c-4920-bc58-3eaea9738804,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:44.836687 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-2b22c844-2bf8-4dd2-9dad-e1048537f183 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:44.840091 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2b22c844-2bf8-4dd2-9dad-e1048537f183 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:34:44.840091 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2b22c844-2bf8-4dd2-9dad-e1048537f183 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:44.943256 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-266fb248-27ea-4d3c-a010-9d75bbf5f7de admin admin] Allocated IP 172.26.0.51 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/bb58b49c-f042-43b8-8916-dfb5f218a0cb) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:34:44.958516 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c6e35c39-35f7-4700-a255-ca5f28982024 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:45.050999 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c6e35c39-35f7-4700-a255-ca5f28982024 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:45.063291 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-266fb248-27ea-4d3c-a010-9d75bbf5f7de admin admin] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:45.079999 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c6e35c39-35f7-4700-a255-ca5f28982024 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 308} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:34:45.125000 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6e35c39-35f7-4700-a255-ca5f28982024 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c8e52f3a-af25-496a-a874-97ea6dc74593,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:45.139376 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0f7e0c2a-66da-4b18-b429-a1ff003383d3 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:45.147673 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c6e35c39-35f7-4700-a255-ca5f28982024 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:45.148130 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-c6e35c39-35f7-4700-a255-ca5f28982024 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Added segment 96c18096-17d2-496d-a53c-09ea4b2aa359 of type vlan for network 7b6ec8a7-3152-4a6b-88b2-1b5105cc3943 Nov 09 04:34:45.160825 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2b22c844-2bf8-4dd2-9dad-e1048537f183 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:45.175164 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:45.194461 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 68c2c79c-2236-4dc6-9aef-7301099cbbca up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:34:45.205395 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c6e35c39-35f7-4700-a255-ca5f28982024 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:45.227798 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-266fb248-27ea-4d3c-a010-9d75bbf5f7de admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:45.271228 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-266fb248-27ea-4d3c-a010-9d75bbf5f7de admin admin] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:34:45.275980 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-266fb248-27ea-4d3c-a010-9d75bbf5f7de admin admin] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:45.278652 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-266fb248-27ea-4d3c-a010-9d75bbf5f7de admin admin] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:34:45.286517 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 68c2c79c-2236-4dc6-9aef-7301099cbbca triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:45.286895 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:45.313615 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-266fb248-27ea-4d3c-a010-9d75bbf5f7de admin admin] Pushing event updated for resources: {'Port': ['ID=bb58b49c-f042-43b8-8916-dfb5f218a0cb,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:45.316521 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0f7e0c2a-66da-4b18-b429-a1ff003383d3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:45.354251 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-18752229-0bcf-4b7c-ab8b-0fa39b7e352c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'name': 'tempest-TestVolumeBootPattern-1675179943-router', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.164'}], 'enable_snat': True}, 'gw_port_id': '873960f9-e8b5-48a6-a119-47c32f5b7968', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:34:33Z', 'updated_at': '2021-11-09T04:34:38Z', 'revision_number': 4, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'gw_port': {'id': '873960f9-e8b5-48a6-a119-47c32f5b7968', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:95:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1097, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.164', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:34:34Z', 'updated_at': '2021-11-09T04:34:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'a5f1e54d-1d98-4741-a1ce-59f4cfb5b332', 'name': '', 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'mac_address': 'fa:16:3e:de:ab:2f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1107, 'fixed_ips': [{'subnet_id': 'f6a08667-654b-4e0c-9f85-c6e6712cc239', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:34:37Z', 'updated_at': '2021-11-09T04:34:43Z', 'revision_number': 4, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'subnets': [{'id': 'f6a08667-654b-4e0c-9f85-c6e6712cc239', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:45.355978 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c6e35c39-35f7-4700-a255-ca5f28982024 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:45.361898 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c6e35c39-35f7-4700-a255-ca5f28982024 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:45.362156 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c6e35c39-35f7-4700-a255-ca5f28982024 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:45.400961 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-18752229-0bcf-4b7c-ab8b-0fa39b7e352c None None] The sync data for ids ['203a01a6-369d-4e73-a6d0-b0605f8d5a6a'] in dv-neutron-816802-2-hyperv is: [{'id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'name': 'tempest-TestVolumeBootPattern-1675179943-router', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.164'}], 'enable_snat': True}, 'gw_port_id': '873960f9-e8b5-48a6-a119-47c32f5b7968', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:34:33Z', 'updated_at': '2021-11-09T04:34:38Z', 'revision_number': 4, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'gw_port': {'id': '873960f9-e8b5-48a6-a119-47c32f5b7968', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:95:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1097, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.164', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:34:34Z', 'updated_at': '2021-11-09T04:34:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'a5f1e54d-1d98-4741-a1ce-59f4cfb5b332', 'name': '', 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'mac_address': 'fa:16:3e:de:ab:2f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1107, 'fixed_ips': [{'subnet_id': 'f6a08667-654b-4e0c-9f85-c6e6712cc239', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:34:37Z', 'updated_at': '2021-11-09T04:34:43Z', 'revision_number': 4, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'subnets': [{'id': 'f6a08667-654b-4e0c-9f85-c6e6712cc239', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:34:45.409789 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0f7e0c2a-66da-4b18-b429-a1ff003383d3 None None] Network 081edca3-e165-4289-b2f5-202ccc9cf76d is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:34:45.415878 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-b27fc5de-621e-4f06-996f-f1fb2398e9e8 None None] Provisioning complete for port 9c9dca1f-731c-4920-bc58-3eaea9738804 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:45.415878 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b27fc5de-621e-4f06-996f-f1fb2398e9e8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:45.422176 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-0f7e0c2a-66da-4b18-b429-a1ff003383d3 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:45.458992 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0f7e0c2a-66da-4b18-b429-a1ff003383d3 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:34:45.467034 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f7e0c2a-66da-4b18-b429-a1ff003383d3 None None] Pushing event updated for resources: {'Port': ['ID=02e84f22-2290-4e49-8ae8-eeb78740236c,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:45.508071 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-c6e35c39-35f7-4700-a255-ca5f28982024 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 785 time: 1.4637694 Nov 09 04:34:45.510766 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58378) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:45.520361 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6e35c39-35f7-4700-a255-ca5f28982024 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Pushing event updated for resources: {'Network': ['ID=7b6ec8a7-3152-4a6b-88b2-1b5105cc3943,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:45.529934 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-54d6e986-7049-40e4-9191-cb65e1a03660 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Request body: {'subnet': {'network_id': '7b6ec8a7-3152-4a6b-88b2-1b5105cc3943', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'enable_dhcp': False}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:45.572896 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-b27fc5de-621e-4f06-996f-f1fb2398e9e8 None None] Port 9c9dca1f-731c-4920-bc58-3eaea9738804 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:34:45.618820 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2b22c844-2bf8-4dd2-9dad-e1048537f183 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:45.649329 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-0f7e0c2a-66da-4b18-b429-a1ff003383d3 None None] Attempting to bind port 02e84f22-2290-4e49-8ae8-eeb78740236c on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:34:45.650730 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-0f7e0c2a-66da-4b18-b429-a1ff003383d3 None None] Attempting to bind port 02e84f22-2290-4e49-8ae8-eeb78740236c by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '2e3ecb82-bb37-4300-a753-caff02939e84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 303, 'network_id': '081edca3-e165-4289-b2f5-202ccc9cf76d'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:34:45.651300 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0f7e0c2a-66da-4b18-b429-a1ff003383d3 None None] Attempting to bind port 02e84f22-2290-4e49-8ae8-eeb78740236c on network 081edca3-e165-4289-b2f5-202ccc9cf76d {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:34:45.658540 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 87659551-9a17-4b8c-8b54-3343b9b4d7d1 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:34:45.691528 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0f7e0c2a-66da-4b18-b429-a1ff003383d3 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 34, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:34:45.691959 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0f7e0c2a-66da-4b18-b429-a1ff003383d3 None None] Checking segment: {'id': '2e3ecb82-bb37-4300-a753-caff02939e84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 303, 'network_id': '081edca3-e165-4289-b2f5-202ccc9cf76d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:34:45.692839 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0f7e0c2a-66da-4b18-b429-a1ff003383d3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:45.692839 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0f7e0c2a-66da-4b18-b429-a1ff003383d3 None None] Bound using segment: {'id': '2e3ecb82-bb37-4300-a753-caff02939e84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 303, 'network_id': '081edca3-e165-4289-b2f5-202ccc9cf76d'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:34:45.693225 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-0f7e0c2a-66da-4b18-b429-a1ff003383d3 None None] Bound port: 02e84f22-2290-4e49-8ae8-eeb78740236c, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2e3ecb82-bb37-4300-a753-caff02939e84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 303, 'network_id': '081edca3-e165-4289-b2f5-202ccc9cf76d'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:34:45.693528 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0f7e0c2a-66da-4b18-b429-a1ff003383d3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:45.696018 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2b22c844-2bf8-4dd2-9dad-e1048537f183 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:45.696807 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2b22c844-2bf8-4dd2-9dad-e1048537f183 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:45.734525 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 7b6ec8a7-3152-4a6b-88b2-1b5105cc3943 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:34:45.737248 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-266fb248-27ea-4d3c-a010-9d75bbf5f7de admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:45.741848 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-b27fc5de-621e-4f06-996f-f1fb2398e9e8 None None] Provisioning complete for port 68c2c79c-2236-4dc6-9aef-7301099cbbca triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:45.742385 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b27fc5de-621e-4f06-996f-f1fb2398e9e8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:45.800047 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-54d6e986-7049-40e4-9191-cb65e1a03660 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Made reservation on behalf of 459651e5af964f8c805d518a6dc3b464 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:34:45.803999 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-54d6e986-7049-40e4-9191-cb65e1a03660 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:45.826467 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b22c844-2bf8-4dd2-9dad-e1048537f183 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event updated for resources: {'Port': ['ID=9c9dca1f-731c-4920-bc58-3eaea9738804,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:45.898239 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2b22c844-2bf8-4dd2-9dad-e1048537f183 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Network 308a67ee-d876-44e1-8a9d-b23323a6a50c is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:34:45.904659 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-2b22c844-2bf8-4dd2-9dad-e1048537f183 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:45.968128 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-0f7e0c2a-66da-4b18-b429-a1ff003383d3 None None] For port 02e84f22-2290-4e49-8ae8-eeb78740236c, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:34:45.973341 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-0f7e0c2a-66da-4b18-b429-a1ff003383d3 None None] For port 02e84f22-2290-4e49-8ae8-eeb78740236c, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=02e84f22-2290-4e49-8ae8-eeb78740236c,segment=NetworkSegment(2e3ecb82-bb37-4300-a753-caff02939e84),segment_id=2e3ecb82-bb37-4300-a753-caff02939e84)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:34:45.982096 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 87659551-9a17-4b8c-8b54-3343b9b4d7d1 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:45.982446 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:46.049797 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0f7e0c2a-66da-4b18-b429-a1ff003383d3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:46.060250 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2b22c844-2bf8-4dd2-9dad-e1048537f183 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Router 9ecfd3d4-c0aa-4aca-be16-36fe6637a109 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:34:46.167458 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-b27fc5de-621e-4f06-996f-f1fb2398e9e8 None None] Provisioning complete for port a5f1e54d-1d98-4741-a1ce-59f4cfb5b332 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:46.167458 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b27fc5de-621e-4f06-996f-f1fb2398e9e8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:46.222616 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f7e0c2a-66da-4b18-b429-a1ff003383d3 None None] Pushing event updated for resources: {'Port': ['ID=02e84f22-2290-4e49-8ae8-eeb78740236c,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:46.247690 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2b22c844-2bf8-4dd2-9dad-e1048537f183 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:34:46.254087 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-2b22c844-2bf8-4dd2-9dad-e1048537f183 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "PUT /v2.0/routers/9ecfd3d4-c0aa-4aca-be16-36fe6637a109/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.8995235 Nov 09 04:34:46.256643 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58380) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:46.263295 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0d5874dd-4ab7-47e6-8acb-b4533c4ed31e None None] Sync routers for ids ['9ecfd3d4-c0aa-4aca-be16-36fe6637a109'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:34:46.284353 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-266fb248-27ea-4d3c-a010-9d75bbf5f7de admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:46.316794 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0d5874dd-4ab7-47e6-8acb-b4533c4ed31e None None] Routers {'9ecfd3d4-c0aa-4aca-be16-36fe6637a109'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:34:46.318827 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-0d5874dd-4ab7-47e6-8acb-b4533c4ed31e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:34:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['9ecfd3d4-c0aa-4aca-be16-36fe6637a109'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:46.342542 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f82d6501-3372-412a-b5b6-09476ad9fdb5 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:46.344895 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-f82d6501-3372-412a-b5b6-09476ad9fdb5 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "GET /v2.0/ports/9c9dca1f-731c-4920-bc58-3eaea9738804 HTTP/1.1" status: 200 len: 913 time: 0.0872071 Nov 09 04:34:46.347948 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58382) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:46.372661 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-0d5874dd-4ab7-47e6-8acb-b4533c4ed31e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:46.476837 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-51f5bfb4-6fc9-4f4e-a097-914d5dcb4085 req-328eba39-4e16-4860-adfc-7dddefcfcd6f service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=8f462374-376b-4c38-b300-528ae5358377&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1436260 Nov 09 04:34:46.519745 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-54d6e986-7049-40e4-9191-cb65e1a03660 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:46.667325 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54d6e986-7049-40e4-9191-cb65e1a03660 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Pushing event updated for resources: {'Subnet': ['ID=55684bb6-5188-4ce7-a4cb-155a73eeeeeb,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:46.681106 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0d5874dd-4ab7-47e6-8acb-b4533c4ed31e None None] Routers {'9ecfd3d4-c0aa-4aca-be16-36fe6637a109'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:34:46.681786 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-0d5874dd-4ab7-47e6-8acb-b4533c4ed31e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:34:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['9ecfd3d4-c0aa-4aca-be16-36fe6637a109'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:46.692879 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51f5bfb4-6fc9-4f4e-a097-914d5dcb4085 req-f5746342-8837-4c31-9065-e5bd72033712 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:46.694744 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-51f5bfb4-6fc9-4f4e-a097-914d5dcb4085 req-f5746342-8837-4c31-9065-e5bd72033712 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&device_id=8f462374-376b-4c38-b300-528ae5358377 HTTP/1.1" status: 200 len: 1098 time: 0.1578040 Nov 09 04:34:46.698095 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-54d6e986-7049-40e4-9191-cb65e1a03660 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Checking segment: {'id': '96c18096-17d2-496d-a53c-09ea4b2aa359', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 308, 'network_id': '7b6ec8a7-3152-4a6b-88b2-1b5105cc3943'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:34:46.698670 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-54d6e986-7049-40e4-9191-cb65e1a03660 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Network hostable DHCP agents. Network: 7b6ec8a7-3152-4a6b-88b2-1b5105cc3943, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:34:46.735811 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-0d5874dd-4ab7-47e6-8acb-b4533c4ed31e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:46.736475 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0d5874dd-4ab7-47e6-8acb-b4533c4ed31e None None] The sync data for ids ['9ecfd3d4-c0aa-4aca-be16-36fe6637a109'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:34:46.737868 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:46.739034 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b27fc5de-621e-4f06-996f-f1fb2398e9e8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:46.779578 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-b27fc5de-621e-4f06-996f-f1fb2398e9e8 None None] For port a5f1e54d-1d98-4741-a1ce-59f4cfb5b332, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=a5f1e54d-1d98-4741-a1ce-59f4cfb5b332,segment=NetworkSegment(bc4577c9-06a5-450a-9c80-879827986f04),segment_id=bc4577c9-06a5-450a-9c80-879827986f04)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:34:46.825654 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5c06a8f3-18cd-4275-ae34-76fe81499c4d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:46.831083 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51f5bfb4-6fc9-4f4e-a097-914d5dcb4085 req-8400ab0a-da8c-4468-9e14-01841343f4c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:46.832541 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-51f5bfb4-6fc9-4f4e-a097-914d5dcb4085 req-8400ab0a-da8c-4468-9e14-01841343f4c0 service neutron] 10.222.0.26 "GET /v2.0/networks?id=239a9c72-6384-4d5a-a69d-f4ac0c580e40 HTTP/1.1" status: 200 len: 897 time: 0.1142066 Nov 09 04:34:46.833670 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-54d6e986-7049-40e4-9191-cb65e1a03660 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Network 7b6ec8a7-3152-4a6b-88b2-1b5105cc3943 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:34:46.895696 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-266fb248-27ea-4d3c-a010-9d75bbf5f7de admin admin] Router 30ce26b1-f32a-4d74-9af5-e8a0c131f03e is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102162) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:34:46.898637 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b27fc5de-621e-4f06-996f-f1fb2398e9e8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:46.961201 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-54d6e986-7049-40e4-9191-cb65e1a03660 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 7b6ec8a7-3152-4a6b-88b2-1b5105cc3943) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:46.966943 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b27fc5de-621e-4f06-996f-f1fb2398e9e8 None None] Pushing event updated for resources: {'Port': ['ID=a5f1e54d-1d98-4741-a1ce-59f4cfb5b332,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:46.974735 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-54d6e986-7049-40e4-9191-cb65e1a03660 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:46.975318 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-54d6e986-7049-40e4-9191-cb65e1a03660 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:46.975709 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f0037b0f-dabc-416a-8cc9-edc2576c5a14 None None] Network 7b6ec8a7-3152-4a6b-88b2-1b5105cc3943 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:34:46.982116 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-51f5bfb4-6fc9-4f4e-a097-914d5dcb4085 req-09813425-9ad9-4ede-a88b-6d30f4ff4885 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=09cbfb91-4118-43af-8b70-41d8d4265574 HTTP/1.1" status: 200 len: 1001 time: 0.1416135 Nov 09 04:34:47.039430 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:47.098747 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-f32fbb9e-a6ea-46d7-b1ae-f1555310dd87 None None] Provisioning complete for port 9c9dca1f-731c-4920-bc58-3eaea9738804 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:47.098747 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f32fbb9e-a6ea-46d7-b1ae-f1555310dd87 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:47.185191 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-f32fbb9e-a6ea-46d7-b1ae-f1555310dd87 None None] Port 9c9dca1f-731c-4920-bc58-3eaea9738804 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:34:47.223906 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-5c06a8f3-18cd-4275-ae34-76fe81499c4d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Deleting port 9c9dca1f-731c-4920-bc58-3eaea9738804 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:34:47.224864 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5c06a8f3-18cd-4275-ae34-76fe81499c4d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:47.228059 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-93614371-6e89-47d0-ba5f-20730bff165a None None] Network 7b6ec8a7-3152-4a6b-88b2-1b5105cc3943 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:34:47.294703 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 02e84f22-2290-4e49-8ae8-eeb78740236c up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:34:47.340034 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5c06a8f3-18cd-4275-ae34-76fe81499c4d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:47.365620 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-5c06a8f3-18cd-4275-ae34-76fe81499c4d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Calling delete_port for 9c9dca1f-731c-4920-bc58-3eaea9738804 owned by network:router_interface {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:34:47.421334 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 02e84f22-2290-4e49-8ae8-eeb78740236c triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:47.422176 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:47.432594 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-54d6e986-7049-40e4-9191-cb65e1a03660 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 802 time: 1.9197068 Nov 09 04:34:47.438192 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58384) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:47.447880 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-2b647947-ae8b-4464-9def-b9a2720064dd tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Request body: {'router': {'name': 'tempest-FloatingIPTestJSON-router-147483725', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}, 'admin_state_up': False}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:47.487552 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51f5bfb4-6fc9-4f4e-a097-914d5dcb4085 req-36e6a111-fa82-416c-b1bd-975d01f7f1ad service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:47.489025 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-51f5bfb4-6fc9-4f4e-a097-914d5dcb4085 req-36e6a111-fa82-416c-b1bd-975d01f7f1ad service neutron] 10.222.0.26 "GET /v2.0/subnets?id=33b5599d-7ebe-4564-9c72-76f5d540fd80 HTTP/1.1" status: 200 len: 834 time: 0.4952333 Nov 09 04:34:47.491819 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-266fb248-27ea-4d3c-a010-9d75bbf5f7de admin admin] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:34:47.502186 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7e93bdf3-4061-4cc8-90ee-17efeff2526f None None] Sync routers for ids ['30ce26b1-f32a-4d74-9af5-e8a0c131f03e'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:34:47.518192 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7e93bdf3-4061-4cc8-90ee-17efeff2526f None None] Routers {'30ce26b1-f32a-4d74-9af5-e8a0c131f03e'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:34:47.521021 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-7e93bdf3-4061-4cc8-90ee-17efeff2526f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:34:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['30ce26b1-f32a-4d74-9af5-e8a0c131f03e'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:47.563881 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51f5bfb4-6fc9-4f4e-a097-914d5dcb4085 req-4e310346-35c5-4e67-af4b-b6c0210438bb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:47.565453 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-51f5bfb4-6fc9-4f4e-a097-914d5dcb4085 req-4e310346-35c5-4e67-af4b-b6c0210438bb service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=239a9c72-6384-4d5a-a69d-f4ac0c580e40&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0591180 Nov 09 04:34:47.568128 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:47.611336 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2b647947-ae8b-4464-9def-b9a2720064dd tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:47.612346 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2b647947-ae8b-4464-9def-b9a2720064dd tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:47.613899 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 02e84f22-2290-4e49-8ae8-eeb78740236c, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=02e84f22-2290-4e49-8ae8-eeb78740236c,segment=NetworkSegment(2e3ecb82-bb37-4300-a753-caff02939e84),segment_id=2e3ecb82-bb37-4300-a753-caff02939e84)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:34:47.662114 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5c06a8f3-18cd-4275-ae34-76fe81499c4d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:47.663580 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3aacef17-8a83-4a27-8d62-914c50e7ffca None None] Network 081edca3-e165-4289-b2f5-202ccc9cf76d requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:34:47.669065 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-7e93bdf3-4061-4cc8-90ee-17efeff2526f None None] Set router 30ce26b1-f32a-4d74-9af5-e8a0c131f03e gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:34:47.693171 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-266fb248-27ea-4d3c-a010-9d75bbf5f7de admin admin] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:47.697725 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-266fb248-27ea-4d3c-a010-9d75bbf5f7de admin admin] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 4.0446823 Nov 09 04:34:47.698148 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58386) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:47.700426 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c06a8f3-18cd-4275-ae34-76fe81499c4d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event deleted for resources: {'Port': ['ID=9c9dca1f-731c-4920-bc58-3eaea9738804,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:47.731455 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2b647947-ae8b-4464-9def-b9a2720064dd tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:47.768493 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-51f5bfb4-6fc9-4f4e-a097-914d5dcb4085 req-0bd0290f-a4cc-402c-a536-d24219ca964d service neutron] 10.222.0.26 "GET /v2.0/networks/239a9c72-6384-4d5a-a69d-f4ac0c580e40?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1943889 Nov 09 04:34:47.773287 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:47.774009 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device a5f1e54d-1d98-4741-a1ce-59f4cfb5b332 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:34:47.857787 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5c06a8f3-18cd-4275-ae34-76fe81499c4d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:47.939694 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-34ce56d7-d52e-41c2-8514-87f6b940ab17 None None] Provisioning complete for port 02e84f22-2290-4e49-8ae8-eeb78740236c triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:47.940069 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-34ce56d7-d52e-41c2-8514-87f6b940ab17 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:47.998982 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-7e93bdf3-4061-4cc8-90ee-17efeff2526f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '30ce26b1-f32a-4d74-9af5-e8a0c131f03e', 'name': 'tempest-TestVolumeBootPattern-1317559415-router', 'tenant_id': '18fad88e828540cf998206d16279d5fb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.51'}], 'enable_snat': True}, 'gw_port_id': 'bb58b49c-f042-43b8-8916-dfb5f218a0cb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:34:43Z', 'updated_at': '2021-11-09T04:34:45Z', 'revision_number': 3, 'project_id': '18fad88e828540cf998206d16279d5fb', 'gw_port': {'id': 'bb58b49c-f042-43b8-8916-dfb5f218a0cb', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:33:56:58', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '30ce26b1-f32a-4d74-9af5-e8a0c131f03e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1126, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.51', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:34:44Z', 'updated_at': '2021-11-09T04:34:44Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:48.004114 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port a5f1e54d-1d98-4741-a1ce-59f4cfb5b332 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:48.004480 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:48.008965 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=02e84f22-2290-4e49-8ae8-eeb78740236c,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:48.055019 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7e93bdf3-4061-4cc8-90ee-17efeff2526f None None] Checking router: 30ce26b1-f32a-4d74-9af5-e8a0c131f03e for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:34:48.055371 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7e93bdf3-4061-4cc8-90ee-17efeff2526f None None] Updating router 30ce26b1-f32a-4d74-9af5-e8a0c131f03e port bb58b49c-f042-43b8-8916-dfb5f218a0cb binding host dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 04:34:48.098045 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-7e93bdf3-4061-4cc8-90ee-17efeff2526f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:48.138886 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5c06a8f3-18cd-4275-ae34-76fe81499c4d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Router 9ecfd3d4-c0aa-4aca-be16-36fe6637a109 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:34:48.170404 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2b647947-ae8b-4464-9def-b9a2720064dd tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:48.233994 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-51f5bfb4-6fc9-4f4e-a097-914d5dcb4085 req-12f2c869-92c5-4643-bd21-f37212478dc5 service neutron] 10.222.0.26 "GET /v2.0/networks/239a9c72-6384-4d5a-a69d-f4ac0c580e40?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4564712 Nov 09 04:34:48.254627 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5c06a8f3-18cd-4275-ae34-76fe81499c4d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:34:48.267597 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aedd604c-a8a3-49f4-82cd-6e94bf7a19f0 None None] Sync routers for ids ['9ecfd3d4-c0aa-4aca-be16-36fe6637a109'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:34:48.273499 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-5c06a8f3-18cd-4275-ae34-76fe81499c4d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "PUT /v2.0/routers/9ecfd3d4-c0aa-4aca-be16-36fe6637a109/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.9243824 Nov 09 04:34:48.274344 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58388) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:48.287374 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aedd604c-a8a3-49f4-82cd-6e94bf7a19f0 None None] Routers {'9ecfd3d4-c0aa-4aca-be16-36fe6637a109'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:34:48.288038 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-aedd604c-a8a3-49f4-82cd-6e94bf7a19f0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:34:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['9ecfd3d4-c0aa-4aca-be16-36fe6637a109'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:48.363456 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-aedd604c-a8a3-49f4-82cd-6e94bf7a19f0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:48.374008 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aedd604c-a8a3-49f4-82cd-6e94bf7a19f0 None None] Routers {'9ecfd3d4-c0aa-4aca-be16-36fe6637a109'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:34:48.375410 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-aedd604c-a8a3-49f4-82cd-6e94bf7a19f0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:34:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['9ecfd3d4-c0aa-4aca-be16-36fe6637a109'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:48.442799 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-aedd604c-a8a3-49f4-82cd-6e94bf7a19f0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:48.443493 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aedd604c-a8a3-49f4-82cd-6e94bf7a19f0 None None] The sync data for ids ['9ecfd3d4-c0aa-4aca-be16-36fe6637a109'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:34:48.505324 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-7e93bdf3-4061-4cc8-90ee-17efeff2526f None None] Publish callbacks [] for port, precommit_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:48.586054 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-7e93bdf3-4061-4cc8-90ee-17efeff2526f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:48.601915 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-15385908-df7e-4c4d-86c3-aefd135c0427 None None] Provisioning complete for port 02e84f22-2290-4e49-8ae8-eeb78740236c triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:48.602283 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-15385908-df7e-4c4d-86c3-aefd135c0427 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:48.636979 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fcb97304-dd75-47cd-a236-092f2dee8666 None None] Pushing event updated for resources: {'Port': ['ID=bb58b49c-f042-43b8-8916-dfb5f218a0cb,revision_number=2']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:48.638305 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-676af1cb-ae65-438a-9113-763f490cc01c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:48.668562 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-7e93bdf3-4061-4cc8-90ee-17efeff2526f None None] Attempting to bind port bb58b49c-f042-43b8-8916-dfb5f218a0cb on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:34:48.668935 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-7e93bdf3-4061-4cc8-90ee-17efeff2526f None None] Attempting to bind port bb58b49c-f042-43b8-8916-dfb5f218a0cb by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:34:48.669296 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7e93bdf3-4061-4cc8-90ee-17efeff2526f None None] Attempting to bind port bb58b49c-f042-43b8-8916-dfb5f218a0cb on network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:34:48.673650 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2b647947-ae8b-4464-9def-b9a2720064dd tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for router_gateway, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:48.675403 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7e93bdf3-4061-4cc8-90ee-17efeff2526f None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 34, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:34:48.676130 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7e93bdf3-4061-4cc8-90ee-17efeff2526f None None] Checking segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102164) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:34:48.676315 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-7e93bdf3-4061-4cc8-90ee-17efeff2526f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:48.676828 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7e93bdf3-4061-4cc8-90ee-17efeff2526f None None] Bound using segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:34:48.677296 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-7e93bdf3-4061-4cc8-90ee-17efeff2526f None None] Bound port: bb58b49c-f042-43b8-8916-dfb5f218a0cb, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:34:48.677687 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-7e93bdf3-4061-4cc8-90ee-17efeff2526f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:48.717707 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2b647947-ae8b-4464-9def-b9a2720064dd tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:48.774319 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a6e1640d-ee87-4581-9618-b29a68ab04bb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:48.910898 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-7e93bdf3-4061-4cc8-90ee-17efeff2526f None None] For port bb58b49c-f042-43b8-8916-dfb5f218a0cb, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102164) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:34:48.914512 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-7e93bdf3-4061-4cc8-90ee-17efeff2526f None None] For port bb58b49c-f042-43b8-8916-dfb5f218a0cb, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=bb58b49c-f042-43b8-8916-dfb5f218a0cb,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102164) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:34:48.917559 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-676af1cb-ae65-438a-9113-763f490cc01c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Deleting port 082d3ede-c135-4f54-baa7-48183d21134c {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:34:48.917903 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-676af1cb-ae65-438a-9113-763f490cc01c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:48.941584 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-2b647947-ae8b-4464-9def-b9a2720064dd tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Allocated IP 172.26.0.111 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/5d1d8f8c-5025-4978-9518-9a8c1d221281) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:34:49.009558 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-7e93bdf3-4061-4cc8-90ee-17efeff2526f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:49.010272 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-676af1cb-ae65-438a-9113-763f490cc01c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:49.030522 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-676af1cb-ae65-438a-9113-763f490cc01c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Calling delete_port for 082d3ede-c135-4f54-baa7-48183d21134c owned by network:router_interface {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:34:49.068475 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fcb97304-dd75-47cd-a236-092f2dee8666 None None] Pushing event updated for resources: {'Port': ['ID=bb58b49c-f042-43b8-8916-dfb5f218a0cb,revision_number=3']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:49.070716 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7e93bdf3-4061-4cc8-90ee-17efeff2526f None None] Routers {'30ce26b1-f32a-4d74-9af5-e8a0c131f03e'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:34:49.071532 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-7e93bdf3-4061-4cc8-90ee-17efeff2526f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:34:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['30ce26b1-f32a-4d74-9af5-e8a0c131f03e'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:49.089649 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-a6e1640d-ee87-4581-9618-b29a68ab04bb admin admin] Allocated IP 172.20.0.1 (081edca3-e165-4289-b2f5-202ccc9cf76d/e227662b-cae0-423b-8216-3677cff71c09/ead597e3-bb6f-442e-b51f-2fef1e982ee1) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:34:49.139141 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2b647947-ae8b-4464-9def-b9a2720064dd tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:49.183660 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58392) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:49.192313 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-7e93bdf3-4061-4cc8-90ee-17efeff2526f None None] Set router 30ce26b1-f32a-4d74-9af5-e8a0c131f03e gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:34:49.199448 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 02e84f22-2290-4e49-8ae8-eeb78740236c up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:34:49.245989 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a6e1640d-ee87-4581-9618-b29a68ab04bb admin admin] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:49.265260 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 02e84f22-2290-4e49-8ae8-eeb78740236c triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:49.265630 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:49.308161 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2b647947-ae8b-4464-9def-b9a2720064dd tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:49.309205 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-23a444a7-023a-4782-a180-37801b7915e4 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:49.310696 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-23a444a7-023a-4782-a180-37801b7915e4 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:49.311222 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-23a444a7-023a-4782-a180-37801b7915e4 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:49.320940 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-23a444a7-023a-4782-a180-37801b7915e4 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/ports?project_id=1d10b4824e524068827e58b55e269af3&network_id=239a9c72-6384-4d5a-a69d-f4ac0c580e40 HTTP/1.1" status: 200 len: 2999 time: 0.1327517 Nov 09 04:34:49.346343 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a6e1640d-ee87-4581-9618-b29a68ab04bb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:49.367397 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-676af1cb-ae65-438a-9113-763f490cc01c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:49.368348 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2b647947-ae8b-4464-9def-b9a2720064dd tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:34:49.377821 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-2b647947-ae8b-4464-9def-b9a2720064dd tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:49.380156 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2b647947-ae8b-4464-9def-b9a2720064dd tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:34:49.382284 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b647947-ae8b-4464-9def-b9a2720064dd tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Pushing event updated for resources: {'Port': ['ID=5d1d8f8c-5025-4978-9518-9a8c1d221281,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:49.388037 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a6e1640d-ee87-4581-9618-b29a68ab04bb admin admin] Network 081edca3-e165-4289-b2f5-202ccc9cf76d is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:34:49.407612 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-676af1cb-ae65-438a-9113-763f490cc01c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event deleted for resources: {'Port': ['ID=082d3ede-c135-4f54-baa7-48183d21134c,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:49.415285 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-a6e1640d-ee87-4581-9618-b29a68ab04bb admin admin] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:49.422967 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-7e93bdf3-4061-4cc8-90ee-17efeff2526f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '30ce26b1-f32a-4d74-9af5-e8a0c131f03e', 'name': 'tempest-TestVolumeBootPattern-1317559415-router', 'tenant_id': '18fad88e828540cf998206d16279d5fb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.51'}], 'enable_snat': True}, 'gw_port_id': 'bb58b49c-f042-43b8-8916-dfb5f218a0cb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:34:43Z', 'updated_at': '2021-11-09T04:34:45Z', 'revision_number': 3, 'project_id': '18fad88e828540cf998206d16279d5fb', 'gw_port': {'id': 'bb58b49c-f042-43b8-8916-dfb5f218a0cb', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:33:56:58', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '30ce26b1-f32a-4d74-9af5-e8a0c131f03e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1126, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.51', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:34:44Z', 'updated_at': '2021-11-09T04:34:48Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:49.439267 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a6e1640d-ee87-4581-9618-b29a68ab04bb admin admin] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:34:49.456524 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7e93bdf3-4061-4cc8-90ee-17efeff2526f None None] The sync data for ids ['30ce26b1-f32a-4d74-9af5-e8a0c131f03e'] in dv-neutron-816802-2-hyperv is: [{'id': '30ce26b1-f32a-4d74-9af5-e8a0c131f03e', 'name': 'tempest-TestVolumeBootPattern-1317559415-router', 'tenant_id': '18fad88e828540cf998206d16279d5fb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.51'}], 'enable_snat': True}, 'gw_port_id': 'bb58b49c-f042-43b8-8916-dfb5f218a0cb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:34:43Z', 'updated_at': '2021-11-09T04:34:45Z', 'revision_number': 3, 'project_id': '18fad88e828540cf998206d16279d5fb', 'gw_port': {'id': 'bb58b49c-f042-43b8-8916-dfb5f218a0cb', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:33:56:58', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '30ce26b1-f32a-4d74-9af5-e8a0c131f03e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1126, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.51', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:34:44Z', 'updated_at': '2021-11-09T04:34:48Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:34:49.499693 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a6e1640d-ee87-4581-9618-b29a68ab04bb admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:49.523896 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-676af1cb-ae65-438a-9113-763f490cc01c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:49.595222 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6e1640d-ee87-4581-9618-b29a68ab04bb admin admin] Pushing event updated for resources: {'Port': ['ID=ead597e3-bb6f-442e-b51f-2fef1e982ee1,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:49.826561 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-b593f80a-4e9a-49f0-adc8-bf95193e2e61 None None] Provisioning complete for port ead597e3-bb6f-442e-b51f-2fef1e982ee1 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:49.827142 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b593f80a-4e9a-49f0-adc8-bf95193e2e61 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:49.875223 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-b593f80a-4e9a-49f0-adc8-bf95193e2e61 None None] Port ead597e3-bb6f-442e-b51f-2fef1e982ee1 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:34:50.064629 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-676af1cb-ae65-438a-9113-763f490cc01c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Router 9ecfd3d4-c0aa-4aca-be16-36fe6637a109 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:34:50.156441 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-676af1cb-ae65-438a-9113-763f490cc01c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:34:50.161609 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-676af1cb-ae65-438a-9113-763f490cc01c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "PUT /v2.0/routers/9ecfd3d4-c0aa-4aca-be16-36fe6637a109/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8858445 Nov 09 04:34:50.164485 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58398) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:50.166999 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d1e47dfd-f74d-4363-be7a-71ccfd162d44 None None] Sync routers for ids ['9ecfd3d4-c0aa-4aca-be16-36fe6637a109'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:34:50.177637 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d1e47dfd-f74d-4363-be7a-71ccfd162d44 None None] Routers {'9ecfd3d4-c0aa-4aca-be16-36fe6637a109'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:34:50.179648 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-d1e47dfd-f74d-4363-be7a-71ccfd162d44 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:34:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['9ecfd3d4-c0aa-4aca-be16-36fe6637a109'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:50.195161 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-07464650-4868-4d0e-90f0-46559dd9d2d8 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "GET /v2.0/ports?device_id=9ecfd3d4-c0aa-4aca-be16-36fe6637a109 HTTP/1.1" status: 200 len: 205 time: 0.0271757 Nov 09 04:34:50.195506 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58400) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:50.225879 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-d1e47dfd-f74d-4363-be7a-71ccfd162d44 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:50.231128 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d1e47dfd-f74d-4363-be7a-71ccfd162d44 None None] Routers {'9ecfd3d4-c0aa-4aca-be16-36fe6637a109'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:34:50.231997 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-d1e47dfd-f74d-4363-be7a-71ccfd162d44 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:34:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['9ecfd3d4-c0aa-4aca-be16-36fe6637a109'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:50.276027 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0b251d4c-7867-47f9-8c93-e3b90dc34d45 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for router, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:50.286624 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-d1e47dfd-f74d-4363-be7a-71ccfd162d44 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:50.287292 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d1e47dfd-f74d-4363-be7a-71ccfd162d44 None None] The sync data for ids ['9ecfd3d4-c0aa-4aca-be16-36fe6637a109'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:34:50.315385 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a6e1640d-ee87-4581-9618-b29a68ab04bb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:50.399929 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2b647947-ae8b-4464-9def-b9a2720064dd tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for router_gateway, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:50.453252 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0b251d4c-7867-47f9-8c93-e3b90dc34d45 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:50.455702 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0b251d4c-7867-47f9-8c93-e3b90dc34d45 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:50.575512 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0b251d4c-7867-47f9-8c93-e3b90dc34d45 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:50.576198 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0b251d4c-7867-47f9-8c93-e3b90dc34d45 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Fanout notify agent at l3_agent the message router_deleted on router 9ecfd3d4-c0aa-4aca-be16-36fe6637a109 {{(pid=102161) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:34:50.583477 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0b251d4c-7867-47f9-8c93-e3b90dc34d45 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:50.587347 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-0b251d4c-7867-47f9-8c93-e3b90dc34d45 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "DELETE /v2.0/routers/9ecfd3d4-c0aa-4aca-be16-36fe6637a109 HTTP/1.1" status: 204 len: 168 time: 0.3880794 Nov 09 04:34:50.587347 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58402) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:50.639646 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-cf311781-d5bc-4903-8636-e084440e7296 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Deleting subnet 962fe5dd-cac2-4c2e-9a96-da92da0b202f {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:34:50.642816 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cf311781-d5bc-4903-8636-e084440e7296 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:50.670925 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a6e1640d-ee87-4581-9618-b29a68ab04bb admin admin] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:50.682949 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cf311781-d5bc-4903-8636-e084440e7296 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:50.692832 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2b647947-ae8b-4464-9def-b9a2720064dd tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:50.748510 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a6e1640d-ee87-4581-9618-b29a68ab04bb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:50.770869 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cf311781-d5bc-4903-8636-e084440e7296 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:50.856020 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a6e1640d-ee87-4581-9618-b29a68ab04bb admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:50.859794 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6e1640d-ee87-4581-9618-b29a68ab04bb admin admin] Pushing event updated for resources: {'Port': ['ID=ead597e3-bb6f-442e-b51f-2fef1e982ee1,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:50.923982 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cf311781-d5bc-4903-8636-e084440e7296 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:50.960130 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf311781-d5bc-4903-8636-e084440e7296 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event deleted for resources: {'Subnet': ['ID=962fe5dd-cac2-4c2e-9a96-da92da0b202f,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:50.962572 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-97327550-765f-49b3-9c16-dd21a7cc3543 None None] Network 308a67ee-d876-44e1-8a9d-b23323a6a50c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:34:50.963225 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cf311781-d5bc-4903-8636-e084440e7296 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:50.967962 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-cf311781-d5bc-4903-8636-e084440e7296 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "DELETE /v2.0/subnets/962fe5dd-cac2-4c2e-9a96-da92da0b202f HTTP/1.1" status: 204 len: 168 time: 0.3782442 Nov 09 04:34:50.969704 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58404) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:50.980679 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a6e1640d-ee87-4581-9618-b29a68ab04bb admin admin] Network 081edca3-e165-4289-b2f5-202ccc9cf76d is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:34:50.982047 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-a6e1640d-ee87-4581-9618-b29a68ab04bb admin admin] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:51.051489 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-bbae61e8-ef0e-4a67-b4f6-dfada5bb3345 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Deleting subnet 938711af-2733-44e7-981e-9b7f96c032d6 {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:34:51.057408 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2b647947-ae8b-4464-9def-b9a2720064dd tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Router 8ac82b1e-1b89-49c2-850a-e69a6d1163e6 is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102162) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:34:51.059299 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bbae61e8-ef0e-4a67-b4f6-dfada5bb3345 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:51.186217 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bbae61e8-ef0e-4a67-b4f6-dfada5bb3345 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:51.217969 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aa5d6808-83b0-430c-b856-be11d445c9dc None None] DHCP port deletion for 308a67ee-d876-44e1-8a9d-b23323a6a50c request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:34:51.225064 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a6e1640d-ee87-4581-9618-b29a68ab04bb admin admin] Router 30ce26b1-f32a-4d74-9af5-e8a0c131f03e has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:34:51.251684 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2b647947-ae8b-4464-9def-b9a2720064dd tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:34:51.308340 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device bb58b49c-f042-43b8-8916-dfb5f218a0cb up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:34:51.311962 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cf626596-c44c-4aec-9e9b-3b16579124be None None] Sync routers for ids ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:34:51.355185 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bbae61e8-ef0e-4a67-b4f6-dfada5bb3345 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:51.366335 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cf626596-c44c-4aec-9e9b-3b16579124be None None] Routers {'8ac82b1e-1b89-49c2-850a-e69a6d1163e6'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:34:51.367129 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-cf626596-c44c-4aec-9e9b-3b16579124be None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:34:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:51.379616 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a6e1640d-ee87-4581-9618-b29a68ab04bb admin admin] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:34:51.385748 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a6e1640d-ee87-4581-9618-b29a68ab04bb admin admin] 10.222.0.24 "PUT /v2.0/routers/30ce26b1-f32a-4d74-9af5-e8a0c131f03e/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.6634543 Nov 09 04:34:51.390834 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2b647947-ae8b-4464-9def-b9a2720064dd tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:51.397250 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-2b647947-ae8b-4464-9def-b9a2720064dd tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 886 time: 3.9518023 Nov 09 04:34:51.402078 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58408) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:51.407850 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-9caa4a1e-9432-4bcc-948d-8e052ee3cde6 None None] Provisioning complete for port ead597e3-bb6f-442e-b51f-2fef1e982ee1 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:51.408220 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9caa4a1e-9432-4bcc-948d-8e052ee3cde6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:51.410099 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8e775b79-aa66-4c1f-884c-32e4f8dae679 None None] Sync routers for ids ['30ce26b1-f32a-4d74-9af5-e8a0c131f03e'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:34:51.412640 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-cf626596-c44c-4aec-9e9b-3b16579124be None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:51.425462 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8e775b79-aa66-4c1f-884c-32e4f8dae679 None None] Routers {'30ce26b1-f32a-4d74-9af5-e8a0c131f03e'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:34:51.426238 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-8e775b79-aa66-4c1f-884c-32e4f8dae679 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:34:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['30ce26b1-f32a-4d74-9af5-e8a0c131f03e'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:51.467619 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-9caa4a1e-9432-4bcc-948d-8e052ee3cde6 None None] Port ead597e3-bb6f-442e-b51f-2fef1e982ee1 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:34:51.471722 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-aa5d6808-83b0-430c-b856-be11d445c9dc None None] Deleting port 68c2c79c-2236-4dc6-9aef-7301099cbbca {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:34:51.471722 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-aa5d6808-83b0-430c-b856-be11d445c9dc None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:51.484573 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cf626596-c44c-4aec-9e9b-3b16579124be None None] Routers {'8ac82b1e-1b89-49c2-850a-e69a6d1163e6'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:34:51.485214 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-cf626596-c44c-4aec-9e9b-3b16579124be None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:34:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:51.550281 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-8e775b79-aa66-4c1f-884c-32e4f8dae679 None None] Set router 30ce26b1-f32a-4d74-9af5-e8a0c131f03e gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:34:51.579668 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-cf626596-c44c-4aec-9e9b-3b16579124be None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:51.580406 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cf626596-c44c-4aec-9e9b-3b16579124be None None] The sync data for ids ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:34:51.590702 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port bb58b49c-f042-43b8-8916-dfb5f218a0cb triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:51.591078 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:51.649367 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-aa5d6808-83b0-430c-b856-be11d445c9dc None None] For port 68c2c79c-2236-4dc6-9aef-7301099cbbca, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=68c2c79c-2236-4dc6-9aef-7301099cbbca,segment=NetworkSegment(324e2708-5459-4f84-8758-baac25e2c4a2),segment_id=324e2708-5459-4f84-8758-baac25e2c4a2)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:34:51.649367 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-aa5d6808-83b0-430c-b856-be11d445c9dc None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:51.669066 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-aa5d6808-83b0-430c-b856-be11d445c9dc None None] Calling delete_port for 68c2c79c-2236-4dc6-9aef-7301099cbbca owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:34:51.774493 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:51.804528 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port bb58b49c-f042-43b8-8916-dfb5f218a0cb, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=bb58b49c-f042-43b8-8916-dfb5f218a0cb,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:34:51.807054 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bbae61e8-ef0e-4a67-b4f6-dfada5bb3345 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:51.832415 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-8e775b79-aa66-4c1f-884c-32e4f8dae679 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '30ce26b1-f32a-4d74-9af5-e8a0c131f03e', 'name': 'tempest-TestVolumeBootPattern-1317559415-router', 'tenant_id': '18fad88e828540cf998206d16279d5fb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.51'}], 'enable_snat': True}, 'gw_port_id': 'bb58b49c-f042-43b8-8916-dfb5f218a0cb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:34:43Z', 'updated_at': '2021-11-09T04:34:50Z', 'revision_number': 4, 'project_id': '18fad88e828540cf998206d16279d5fb', 'gw_port': {'id': 'bb58b49c-f042-43b8-8916-dfb5f218a0cb', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:33:56:58', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '30ce26b1-f32a-4d74-9af5-e8a0c131f03e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1126, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.51', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:34:44Z', 'updated_at': '2021-11-09T04:34:48Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'ead597e3-bb6f-442e-b51f-2fef1e982ee1', 'name': '', 'network_id': '081edca3-e165-4289-b2f5-202ccc9cf76d', 'tenant_id': '18fad88e828540cf998206d16279d5fb', 'mac_address': 'fa:16:3e:b7:8e:e3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '30ce26b1-f32a-4d74-9af5-e8a0c131f03e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1136, 'fixed_ips': [{'subnet_id': 'e227662b-cae0-423b-8216-3677cff71c09', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:34:48Z', 'updated_at': '2021-11-09T04:34:50Z', 'revision_number': 2, 'project_id': '18fad88e828540cf998206d16279d5fb', 'subnets': [{'id': 'e227662b-cae0-423b-8216-3677cff71c09', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:51.850195 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbae61e8-ef0e-4a67-b4f6-dfada5bb3345 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event deleted for resources: {'Subnet': ['ID=938711af-2733-44e7-981e-9b7f96c032d6,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:51.857726 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bbae61e8-ef0e-4a67-b4f6-dfada5bb3345 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:51.862858 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-bbae61e8-ef0e-4a67-b4f6-dfada5bb3345 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "DELETE /v2.0/subnets/938711af-2733-44e7-981e-9b7f96c032d6 HTTP/1.1" status: 204 len: 168 time: 0.8918657 Nov 09 04:34:51.863416 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8e775b79-aa66-4c1f-884c-32e4f8dae679 None None] Checking router: 30ce26b1-f32a-4d74-9af5-e8a0c131f03e for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:34:51.863766 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8e775b79-aa66-4c1f-884c-32e4f8dae679 None None] Updating router 30ce26b1-f32a-4d74-9af5-e8a0c131f03e port ead597e3-bb6f-442e-b51f-2fef1e982ee1 binding host dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 04:34:51.865514 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58416) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:51.872136 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bbc8db88-9524-4f5f-af11-25c0b9e6ef63 None None] Network 0762b9da-b197-4e44-a8c9-f5b19a0206b2 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:34:51.875119 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:51.903973 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-8e775b79-aa66-4c1f-884c-32e4f8dae679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:51.935802 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-aa5d6808-83b0-430c-b856-be11d445c9dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:52.017404 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aa5d6808-83b0-430c-b856-be11d445c9dc None None] No DVR routers for this DVR port 68c2c79c-2236-4dc6-9aef-7301099cbbca on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:34:52.034427 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-02b0e23c-b2a6-4171-8155-6e73d69fddaf tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:52.059057 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=bb58b49c-f042-43b8-8916-dfb5f218a0cb,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:52.178166 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-932f3284-d849-4aaa-b155-cb1d7121b84a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:52.227890 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-02b0e23c-b2a6-4171-8155-6e73d69fddaf tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:52.253053 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-02b0e23c-b2a6-4171-8155-6e73d69fddaf tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['308a67ee-d876-44e1-8a9d-b23323a6a50c']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:52.268910 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-02b0e23c-b2a6-4171-8155-6e73d69fddaf tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '324e2708-5459-4f84-8758-baac25e2c4a2') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:52.269214 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-02b0e23c-b2a6-4171-8155-6e73d69fddaf tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '324e2708-5459-4f84-8758-baac25e2c4a2') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:52.293661 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-02b0e23c-b2a6-4171-8155-6e73d69fddaf tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:52.326933 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-02b0e23c-b2a6-4171-8155-6e73d69fddaf tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:52.341188 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-02b0e23c-b2a6-4171-8155-6e73d69fddaf tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Releasing vlan 312 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:34:52.341593 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-02b0e23c-b2a6-4171-8155-6e73d69fddaf tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:52.342992 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-8e775b79-aa66-4c1f-884c-32e4f8dae679 None None] Publish callbacks [] for port, precommit_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:52.347276 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:34:52.347276 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:34:52.347276 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:34:52.347276 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:34:52.347276 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:34:52.347276 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:34:52.347276 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:34:52.347276 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:34:52.347276 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:34:52.347276 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:34:52.347276 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:34:52.347276 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:34:52.347276 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:34:52.347276 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:34:52.347276 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:34:52.347276 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:34:52.347276 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:34:52.347276 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:34:52.347276 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:34:52.347276 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:34:52.347276 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:34:52.347276 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:34:52.347276 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:34:52.347276 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:34:52.347276 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:34:52.347276 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:34:52.347276 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:34:52.347276 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:34:52.347276 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:34:52.347276 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:34:52.347276 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:34:52.347276 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:34:52.381479 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa5d6808-83b0-430c-b856-be11d445c9dc None None] Pushing event deleted for resources: {'Port': ['ID=68c2c79c-2236-4dc6-9aef-7301099cbbca,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:52.426934 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-8e775b79-aa66-4c1f-884c-32e4f8dae679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:52.491175 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-550ba634-9cac-4679-bb6a-68904d0469e0 None None] DHCP port deletion for 0762b9da-b197-4e44-a8c9-f5b19a0206b2 request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:34:52.495869 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-019ebf8c-3a9d-4063-a81c-f6278c223835 None None] Pushing event updated for resources: {'Port': ['ID=ead597e3-bb6f-442e-b51f-2fef1e982ee1,revision_number=3']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:52.507103 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-02b0e23c-b2a6-4171-8155-6e73d69fddaf tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:52.523187 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-02b0e23c-b2a6-4171-8155-6e73d69fddaf tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:52.523187 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-02b0e23c-b2a6-4171-8155-6e73d69fddaf tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "DELETE /v2.0/networks/308a67ee-d876-44e1-8a9d-b23323a6a50c HTTP/1.1" status: 204 len: 168 time: 0.6537716 Nov 09 04:34:52.523903 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58418) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:52.561123 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-550ba634-9cac-4679-bb6a-68904d0469e0 None None] Deleting port 87659551-9a17-4b8c-8b54-3343b9b4d7d1 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:34:52.562653 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-550ba634-9cac-4679-bb6a-68904d0469e0 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:52.565564 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-8e775b79-aa66-4c1f-884c-32e4f8dae679 None None] Attempting to bind port ead597e3-bb6f-442e-b51f-2fef1e982ee1 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:34:52.565922 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-8e775b79-aa66-4c1f-884c-32e4f8dae679 None None] Attempting to bind port ead597e3-bb6f-442e-b51f-2fef1e982ee1 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '2e3ecb82-bb37-4300-a753-caff02939e84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 303, 'network_id': '081edca3-e165-4289-b2f5-202ccc9cf76d'}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:34:52.566279 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8e775b79-aa66-4c1f-884c-32e4f8dae679 None None] Attempting to bind port ead597e3-bb6f-442e-b51f-2fef1e982ee1 on network 081edca3-e165-4289-b2f5-202ccc9cf76d {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:34:52.571354 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02b0e23c-b2a6-4171-8155-6e73d69fddaf tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event deleted for resources: {'Network': ['ID=308a67ee-d876-44e1-8a9d-b23323a6a50c,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:52.574737 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8e775b79-aa66-4c1f-884c-32e4f8dae679 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 34, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:34:52.575161 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8e775b79-aa66-4c1f-884c-32e4f8dae679 None None] Checking segment: {'id': '2e3ecb82-bb37-4300-a753-caff02939e84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 303, 'network_id': '081edca3-e165-4289-b2f5-202ccc9cf76d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102164) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:34:52.575619 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-8e775b79-aa66-4c1f-884c-32e4f8dae679 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:52.576000 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8e775b79-aa66-4c1f-884c-32e4f8dae679 None None] Bound using segment: {'id': '2e3ecb82-bb37-4300-a753-caff02939e84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 303, 'network_id': '081edca3-e165-4289-b2f5-202ccc9cf76d'} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:34:52.576461 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-8e775b79-aa66-4c1f-884c-32e4f8dae679 None None] Bound port: ead597e3-bb6f-442e-b51f-2fef1e982ee1, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2e3ecb82-bb37-4300-a753-caff02939e84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 303, 'network_id': '081edca3-e165-4289-b2f5-202ccc9cf76d'}}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:34:52.576838 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-8e775b79-aa66-4c1f-884c-32e4f8dae679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:52.598042 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-932f3284-d849-4aaa-b155-cb1d7121b84a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Allocated IP 172.20.0.1 (7b6ec8a7-3152-4a6b-88b2-1b5105cc3943/55684bb6-5188-4ce7-a4cb-155a73eeeeeb/486ad8d0-0c29-4b59-9a61-d61a75d63b9a) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:34:52.657200 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-550ba634-9cac-4679-bb6a-68904d0469e0 None None] For port 87659551-9a17-4b8c-8b54-3343b9b4d7d1, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=87659551-9a17-4b8c-8b54-3343b9b4d7d1,segment=NetworkSegment(e8c00fc8-7e86-4d0c-be0e-3497a4a17cb5),segment_id=e8c00fc8-7e86-4d0c-be0e-3497a4a17cb5)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:34:52.657601 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-550ba634-9cac-4679-bb6a-68904d0469e0 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:52.667011 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58422) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:52.674107 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-3ea2cce6-74cb-4e6f-a8d0-f3e41b3c592e tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1777462302', 'description': 'tempest-secgroup-smoke-1777462302 description', 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:52.674803 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-8e775b79-aa66-4c1f-884c-32e4f8dae679 None None] For port ead597e3-bb6f-442e-b51f-2fef1e982ee1, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102164) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:34:52.679341 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-8e775b79-aa66-4c1f-884c-32e4f8dae679 None None] For port ead597e3-bb6f-442e-b51f-2fef1e982ee1, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=ead597e3-bb6f-442e-b51f-2fef1e982ee1,segment=NetworkSegment(2e3ecb82-bb37-4300-a753-caff02939e84),segment_id=2e3ecb82-bb37-4300-a753-caff02939e84)] {{(pid=102164) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:34:52.680235 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-550ba634-9cac-4679-bb6a-68904d0469e0 None None] Calling delete_port for 87659551-9a17-4b8c-8b54-3343b9b4d7d1 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:34:52.687551 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3eca9d6a-102c-4b7c-bc5c-524ded6a2f26 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:52.740479 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-8e775b79-aa66-4c1f-884c-32e4f8dae679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:52.804314 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8e775b79-aa66-4c1f-884c-32e4f8dae679 None None] Routers {'30ce26b1-f32a-4d74-9af5-e8a0c131f03e'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:34:52.805081 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-8e775b79-aa66-4c1f-884c-32e4f8dae679 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:34:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['30ce26b1-f32a-4d74-9af5-e8a0c131f03e'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:52.806195 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-3eca9d6a-102c-4b7c-bc5c-524ded6a2f26 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Deleting port 87659551-9a17-4b8c-8b54-3343b9b4d7d1 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:34:52.812747 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3eca9d6a-102c-4b7c-bc5c-524ded6a2f26 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:52.812747 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3ea2cce6-74cb-4e6f-a8d0-f3e41b3c592e tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:52.819310 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-932f3284-d849-4aaa-b155-cb1d7121b84a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:52.819859 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-99a12d98-7a3b-4183-ba9f-99ddaa714107 None None] Provisioning complete for port ead597e3-bb6f-442e-b51f-2fef1e982ee1 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:52.820058 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-99a12d98-7a3b-4183-ba9f-99ddaa714107 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:52.857609 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-019ebf8c-3a9d-4063-a81c-f6278c223835 None None] Pushing event updated for resources: {'Port': ['ID=ead597e3-bb6f-442e-b51f-2fef1e982ee1,revision_number=4']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:52.892022 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-550ba634-9cac-4679-bb6a-68904d0469e0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:52.918637 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-3eca9d6a-102c-4b7c-bc5c-524ded6a2f26 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] For port 87659551-9a17-4b8c-8b54-3343b9b4d7d1, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=87659551-9a17-4b8c-8b54-3343b9b4d7d1,segment=NetworkSegment(e8c00fc8-7e86-4d0c-be0e-3497a4a17cb5),segment_id=e8c00fc8-7e86-4d0c-be0e-3497a4a17cb5)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:34:52.919196 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3eca9d6a-102c-4b7c-bc5c-524ded6a2f26 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:52.938034 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-932f3284-d849-4aaa-b155-cb1d7121b84a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:52.941585 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-3eca9d6a-102c-4b7c-bc5c-524ded6a2f26 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Calling delete_port for 87659551-9a17-4b8c-8b54-3343b9b4d7d1 owned by network:dhcp {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:34:52.951084 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-8e775b79-aa66-4c1f-884c-32e4f8dae679 None None] Set router 30ce26b1-f32a-4d74-9af5-e8a0c131f03e gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:34:52.954448 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-550ba634-9cac-4679-bb6a-68904d0469e0 None None] Pushing event deleted for resources: {'Port': ['ID=87659551-9a17-4b8c-8b54-3343b9b4d7d1,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:52.972635 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-550ba634-9cac-4679-bb6a-68904d0469e0 None None] No DVR routers for this DVR port 87659551-9a17-4b8c-8b54-3343b9b4d7d1 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:34:53.020505 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-932f3284-d849-4aaa-b155-cb1d7121b84a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Pushing event updated for resources: {'Port': ['ID=486ad8d0-0c29-4b59-9a61-d61a75d63b9a,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:53.036387 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-99a12d98-7a3b-4183-ba9f-99ddaa714107 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:53.051545 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-932f3284-d849-4aaa-b155-cb1d7121b84a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Network 7b6ec8a7-3152-4a6b-88b2-1b5105cc3943 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:34:53.053783 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-932f3284-d849-4aaa-b155-cb1d7121b84a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:53.063212 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-932f3284-d849-4aaa-b155-cb1d7121b84a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:34:53.064250 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3ea2cce6-74cb-4e6f-a8d0-f3e41b3c592e tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:53.115831 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3eca9d6a-102c-4b7c-bc5c-524ded6a2f26 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:53.122567 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-99a12d98-7a3b-4183-ba9f-99ddaa714107 None None] For port ead597e3-bb6f-442e-b51f-2fef1e982ee1, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=ead597e3-bb6f-442e-b51f-2fef1e982ee1,segment=NetworkSegment(2e3ecb82-bb37-4300-a753-caff02939e84),segment_id=2e3ecb82-bb37-4300-a753-caff02939e84)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:34:53.127522 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3ea2cce6-74cb-4e6f-a8d0-f3e41b3c592e tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:53.149727 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-932f3284-d849-4aaa-b155-cb1d7121b84a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:53.166659 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3eca9d6a-102c-4b7c-bc5c-524ded6a2f26 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event deleted for resources: {'Port': ['ID=87659551-9a17-4b8c-8b54-3343b9b4d7d1,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:53.175238 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3eca9d6a-102c-4b7c-bc5c-524ded6a2f26 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] No DVR routers for this DVR port 87659551-9a17-4b8c-8b54-3343b9b4d7d1 on host dv-neutron-816802-2-hyperv {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:34:53.192896 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-99a12d98-7a3b-4183-ba9f-99ddaa714107 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:53.201193 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device bb58b49c-f042-43b8-8916-dfb5f218a0cb up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:34:53.265253 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ea2cce6-74cb-4e6f-a8d0-f3e41b3c592e tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Pushing event updated for resources: {'SecurityGroup': ['ID=3fac99c0-db5e-4deb-ae03-d7c28ceb1106,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:53.274843 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3ea2cce6-74cb-4e6f-a8d0-f3e41b3c592e tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:53.276634 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-3ea2cce6-74cb-4e6f-a8d0-f3e41b3c592e tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.6067796 Nov 09 04:34:53.279898 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3eca9d6a-102c-4b7c-bc5c-524ded6a2f26 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:53.283988 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58424) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:53.288862 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-57142956-e426-4762-aca3-77d8db3b90d5 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Request body: {'security_group_rule': {'security_group_id': '3fac99c0-db5e-4deb-ae03-d7c28ceb1106', 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:53.327136 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-3eca9d6a-102c-4b7c-bc5c-524ded6a2f26 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0762b9da-b197-4e44-a8c9-f5b19a0206b2']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:53.327661 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99a12d98-7a3b-4183-ba9f-99ddaa714107 None None] Pushing event updated for resources: {'Port': ['ID=ead597e3-bb6f-442e-b51f-2fef1e982ee1,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:53.347145 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-3eca9d6a-102c-4b7c-bc5c-524ded6a2f26 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e8c00fc8-7e86-4d0c-be0e-3497a4a17cb5') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:53.347468 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-3eca9d6a-102c-4b7c-bc5c-524ded6a2f26 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e8c00fc8-7e86-4d0c-be0e-3497a4a17cb5') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:53.351458 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-155f17e1-a2bc-48f5-a3e1-8541e984766b None None] Provisioning complete for port ead597e3-bb6f-442e-b51f-2fef1e982ee1 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:53.351852 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-155f17e1-a2bc-48f5-a3e1-8541e984766b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:53.358699 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3eca9d6a-102c-4b7c-bc5c-524ded6a2f26 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:53.375733 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3eca9d6a-102c-4b7c-bc5c-524ded6a2f26 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:53.380899 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port bb58b49c-f042-43b8-8916-dfb5f218a0cb triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:53.381298 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:53.387365 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3eca9d6a-102c-4b7c-bc5c-524ded6a2f26 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Releasing vlan 309 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:34:53.388579 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3eca9d6a-102c-4b7c-bc5c-524ded6a2f26 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:53.390724 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-8e775b79-aa66-4c1f-884c-32e4f8dae679 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '30ce26b1-f32a-4d74-9af5-e8a0c131f03e', 'name': 'tempest-TestVolumeBootPattern-1317559415-router', 'tenant_id': '18fad88e828540cf998206d16279d5fb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.51'}], 'enable_snat': True}, 'gw_port_id': 'bb58b49c-f042-43b8-8916-dfb5f218a0cb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:34:43Z', 'updated_at': '2021-11-09T04:34:50Z', 'revision_number': 4, 'project_id': '18fad88e828540cf998206d16279d5fb', 'gw_port': {'id': 'bb58b49c-f042-43b8-8916-dfb5f218a0cb', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:33:56:58', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '30ce26b1-f32a-4d74-9af5-e8a0c131f03e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1126, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.51', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:34:44Z', 'updated_at': '2021-11-09T04:34:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'ead597e3-bb6f-442e-b51f-2fef1e982ee1', 'name': '', 'network_id': '081edca3-e165-4289-b2f5-202ccc9cf76d', 'tenant_id': '18fad88e828540cf998206d16279d5fb', 'mac_address': 'fa:16:3e:b7:8e:e3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '30ce26b1-f32a-4d74-9af5-e8a0c131f03e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1136, 'fixed_ips': [{'subnet_id': 'e227662b-cae0-423b-8216-3677cff71c09', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:34:48Z', 'updated_at': '2021-11-09T04:34:52Z', 'revision_number': 4, 'project_id': '18fad88e828540cf998206d16279d5fb', 'subnets': [{'id': 'e227662b-cae0-423b-8216-3677cff71c09', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:53.395243 dv-neutron-816802-2-hyperv neutron-server[102162]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:34:53.395243 dv-neutron-816802-2-hyperv neutron-server[102162]: self.session.flush() Nov 09 04:34:53.395243 dv-neutron-816802-2-hyperv neutron-server[102162]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:34:53.395243 dv-neutron-816802-2-hyperv neutron-server[102162]: self.session.flush() Nov 09 04:34:53.395243 dv-neutron-816802-2-hyperv neutron-server[102162]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:34:53.395243 dv-neutron-816802-2-hyperv neutron-server[102162]: self.session.flush() Nov 09 04:34:53.395243 dv-neutron-816802-2-hyperv neutron-server[102162]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:34:53.395243 dv-neutron-816802-2-hyperv neutron-server[102162]: self.session.flush() Nov 09 04:34:53.395243 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:34:53.395243 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:34:53.395243 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:34:53.395243 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:34:53.395243 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:34:53.395243 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:34:53.395243 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:34:53.395243 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:34:53.395243 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:34:53.395243 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:34:53.395243 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:34:53.395243 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:34:53.395243 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:34:53.395243 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:34:53.395243 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:34:53.395243 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:34:53.395243 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:34:53.395243 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:34:53.395243 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:34:53.395243 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:34:53.395243 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:34:53.395243 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:34:53.395243 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:34:53.395243 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:34:53.395243 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:34:53.395243 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:34:53.395243 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:34:53.395243 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:34:53.395243 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:34:53.395243 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:34:53.395243 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:34:53.395243 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:34:53.398632 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-932f3284-d849-4aaa-b155-cb1d7121b84a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:53.426396 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8e775b79-aa66-4c1f-884c-32e4f8dae679 None None] The sync data for ids ['30ce26b1-f32a-4d74-9af5-e8a0c131f03e'] in dv-neutron-816802-2-hyperv is: [{'id': '30ce26b1-f32a-4d74-9af5-e8a0c131f03e', 'name': 'tempest-TestVolumeBootPattern-1317559415-router', 'tenant_id': '18fad88e828540cf998206d16279d5fb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.51'}], 'enable_snat': True}, 'gw_port_id': 'bb58b49c-f042-43b8-8916-dfb5f218a0cb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:34:43Z', 'updated_at': '2021-11-09T04:34:50Z', 'revision_number': 4, 'project_id': '18fad88e828540cf998206d16279d5fb', 'gw_port': {'id': 'bb58b49c-f042-43b8-8916-dfb5f218a0cb', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:33:56:58', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '30ce26b1-f32a-4d74-9af5-e8a0c131f03e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1126, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.51', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:34:44Z', 'updated_at': '2021-11-09T04:34:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'ead597e3-bb6f-442e-b51f-2fef1e982ee1', 'name': '', 'network_id': '081edca3-e165-4289-b2f5-202ccc9cf76d', 'tenant_id': '18fad88e828540cf998206d16279d5fb', 'mac_address': 'fa:16:3e:b7:8e:e3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '30ce26b1-f32a-4d74-9af5-e8a0c131f03e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1136, 'fixed_ips': [{'subnet_id': 'e227662b-cae0-423b-8216-3677cff71c09', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:34:48Z', 'updated_at': '2021-11-09T04:34:52Z', 'revision_number': 4, 'project_id': '18fad88e828540cf998206d16279d5fb', 'subnets': [{'id': 'e227662b-cae0-423b-8216-3677cff71c09', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:34:53.466739 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-57142956-e426-4762-aca3-77d8db3b90d5 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:53.483801 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58426) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:53.587755 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e3668eb3-fbbe-4a2a-9257-68cafcd9e5ad tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:53.589266 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e3668eb3-fbbe-4a2a-9257-68cafcd9e5ad tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/subnets?network_id=2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 HTTP/1.1" status: 200 len: 814 time: 0.1003938 Nov 09 04:34:53.630141 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3eca9d6a-102c-4b7c-bc5c-524ded6a2f26 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:53.647565 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 68c2c79c-2236-4dc6-9aef-7301099cbbca no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:34:53.647852 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3eca9d6a-102c-4b7c-bc5c-524ded6a2f26 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:53.651663 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-3eca9d6a-102c-4b7c-bc5c-524ded6a2f26 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "DELETE /v2.0/networks/0762b9da-b197-4e44-a8c9-f5b19a0206b2 HTTP/1.1" status: 204 len: 168 time: 1.1268158 Nov 09 04:34:53.665338 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58430) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:53.674197 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 68c2c79c-2236-4dc6-9aef-7301099cbbca {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:34:53.674582 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 68c2c79c-2236-4dc6-9aef-7301099cbbca not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:34:53.675098 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 87659551-9a17-4b8c-8b54-3343b9b4d7d1 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:34:53.677875 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-0d2b40ea-4fa0-4021-af1f-dd944d217292 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-2072055776'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:53.683071 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-57142956-e426-4762-aca3-77d8db3b90d5 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:53.685042 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3eca9d6a-102c-4b7c-bc5c-524ded6a2f26 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event deleted for resources: {'Network': ['ID=0762b9da-b197-4e44-a8c9-f5b19a0206b2,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:53.706469 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 87659551-9a17-4b8c-8b54-3343b9b4d7d1 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:34:53.706812 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 87659551-9a17-4b8c-8b54-3343b9b4d7d1 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:34:53.753170 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-57142956-e426-4762-aca3-77d8db3b90d5 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:53.771841 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57142956-e426-4762-aca3-77d8db3b90d5 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=434c7c6b-7401-44cc-aca4-d07ff7d8717d,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:53.781618 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0d2b40ea-4fa0-4021-af1f-dd944d217292 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Made reservation on behalf of d11b025703b24d109deef7bfe57a45f6 for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:34:53.781768 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-932f3284-d849-4aaa-b155-cb1d7121b84a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:53.785533 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0d2b40ea-4fa0-4021-af1f-dd944d217292 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:53.811022 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0d2b40ea-4fa0-4021-af1f-dd944d217292 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 326} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:34:53.820680 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0d2b40ea-4fa0-4021-af1f-dd944d217292 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:53.821024 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-0d2b40ea-4fa0-4021-af1f-dd944d217292 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Added segment 36295eec-b89c-46db-872c-cb9c859d70eb of type vlan for network 476ac3d6-2d30-4c78-aba0-3bceef46d86d Nov 09 04:34:53.868498 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0d2b40ea-4fa0-4021-af1f-dd944d217292 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:53.890827 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-932f3284-d849-4aaa-b155-cb1d7121b84a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:53.915831 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-57142956-e426-4762-aca3-77d8db3b90d5 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:53.917514 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-57142956-e426-4762-aca3-77d8db3b90d5 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.6322124 Nov 09 04:34:53.920157 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58434) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:53.925717 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-7a9d6b29-1ede-4155-973f-02686eb8ff35 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Request body: {'security_group_rule': {'security_group_id': '3fac99c0-db5e-4deb-ae03-d7c28ceb1106', 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:53.977410 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-932f3284-d849-4aaa-b155-cb1d7121b84a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:53.980141 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-932f3284-d849-4aaa-b155-cb1d7121b84a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Pushing event updated for resources: {'Port': ['ID=486ad8d0-0c29-4b59-9a61-d61a75d63b9a,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:53.998891 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0d2b40ea-4fa0-4021-af1f-dd944d217292 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:54.005242 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0d2b40ea-4fa0-4021-af1f-dd944d217292 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:54.008310 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0d2b40ea-4fa0-4021-af1f-dd944d217292 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:54.071523 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7a9d6b29-1ede-4155-973f-02686eb8ff35 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:54.080306 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-932f3284-d849-4aaa-b155-cb1d7121b84a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Network 7b6ec8a7-3152-4a6b-88b2-1b5105cc3943 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:34:54.081994 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-932f3284-d849-4aaa-b155-cb1d7121b84a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:54.090008 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d2b40ea-4fa0-4021-af1f-dd944d217292 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event updated for resources: {'Network': ['ID=476ac3d6-2d30-4c78-aba0-3bceef46d86d,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:54.104913 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 476ac3d6-2d30-4c78-aba0-3bceef46d86d details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:34:54.106975 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-0d2b40ea-4fa0-4021-af1f-dd944d217292 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 770 time: 0.4333155 Nov 09 04:34:54.114083 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58436) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:54.119551 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-1a0d9d1b-a710-41e7-8aef-5c4ba9e5a04c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Request body: {'subnet': {'network_id': '476ac3d6-2d30-4c78-aba0-3bceef46d86d', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:54.213001 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-932f3284-d849-4aaa-b155-cb1d7121b84a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Router 8ac82b1e-1b89-49c2-850a-e69a6d1163e6 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:34:54.215029 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7a9d6b29-1ede-4155-973f-02686eb8ff35 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:54.278988 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7a9d6b29-1ede-4155-973f-02686eb8ff35 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:54.300224 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a9d6b29-1ede-4155-973f-02686eb8ff35 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=714c28f6-280a-4c82-8b1f-5161bc8e17e8,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:54.309722 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1a0d9d1b-a710-41e7-8aef-5c4ba9e5a04c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Made reservation on behalf of d11b025703b24d109deef7bfe57a45f6 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:34:54.314278 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1a0d9d1b-a710-41e7-8aef-5c4ba9e5a04c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:54.330905 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-932f3284-d849-4aaa-b155-cb1d7121b84a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:34:54.336541 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-932f3284-d849-4aaa-b155-cb1d7121b84a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] 10.222.0.24 "PUT /v2.0/routers/8ac82b1e-1b89-49c2-850a-e69a6d1163e6/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.9329057 Nov 09 04:34:54.338706 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58438) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:54.342735 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4dfbd564-1765-4e8c-a093-af8216f8a05a None None] Sync routers for ids ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:34:54.347195 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-2b7acb37-5331-4bc6-b94d-f3015412da32 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Request body: {'port': {'network_id': '7b6ec8a7-3152-4a6b-88b2-1b5105cc3943', 'name': 'tempest-FloatingIPTestJSON-376169526'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:54.355209 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4dfbd564-1765-4e8c-a093-af8216f8a05a None None] Routers {'8ac82b1e-1b89-49c2-850a-e69a6d1163e6'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:34:54.355828 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-4dfbd564-1765-4e8c-a093-af8216f8a05a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:34:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:54.400559 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-4dfbd564-1765-4e8c-a093-af8216f8a05a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:54.408264 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7a9d6b29-1ede-4155-973f-02686eb8ff35 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:54.410469 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-7a9d6b29-1ede-4155-973f-02686eb8ff35 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.4886487 Nov 09 04:34:54.413357 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58440) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:54.418291 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4dfbd564-1765-4e8c-a093-af8216f8a05a None None] Routers {'8ac82b1e-1b89-49c2-850a-e69a6d1163e6'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:34:54.418947 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-4dfbd564-1765-4e8c-a093-af8216f8a05a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:34:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:54.421466 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-a67a32f5-228e-40c4-a5b4-3b5d97a31202 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Request body: {'security_group_rule': {'security_group_id': '3fac99c0-db5e-4deb-ae03-d7c28ceb1106', 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:54.475479 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-4dfbd564-1765-4e8c-a093-af8216f8a05a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:34:54.476292 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4dfbd564-1765-4e8c-a093-af8216f8a05a None None] The sync data for ids ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:34:54.542735 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a67a32f5-228e-40c4-a5b4-3b5d97a31202 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:54.764080 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58442) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:54.769581 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-051e5c43-af09-49b6-b238-56f2358e7520 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'network': {'name': 'tempest-network-smoke--694727720', 'project_id': '1d10b4824e524068827e58b55e269af3', 'port_security_enabled': True}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:54.901257 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a67a32f5-228e-40c4-a5b4-3b5d97a31202 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:54.907498 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1a0d9d1b-a710-41e7-8aef-5c4ba9e5a04c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:54.962677 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2b7acb37-5331-4bc6-b94d-f3015412da32 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Made reservation on behalf of 459651e5af964f8c805d518a6dc3b464 for: {'port': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:34:54.966232 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2b7acb37-5331-4bc6-b94d-f3015412da32 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:54.971141 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a0d9d1b-a710-41e7-8aef-5c4ba9e5a04c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event updated for resources: {'Subnet': ['ID=23289141-7ad7-4e5f-90f0-c9511e33517d,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:54.983828 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [None req-2b7acb37-5331-4bc6-b94d-f3015412da32 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] device_id is not set on port 0641253a-a234-4a6d-8e89-7a72a04af2ac yet. {{(pid=102161) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:34:54.988340 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a0d9d1b-a710-41e7-8aef-5c4ba9e5a04c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Checking segment: {'id': '36295eec-b89c-46db-872c-cb9c859d70eb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 326, 'network_id': '476ac3d6-2d30-4c78-aba0-3bceef46d86d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:34:54.988949 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1a0d9d1b-a710-41e7-8aef-5c4ba9e5a04c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Network hostable DHCP agents. Network: 476ac3d6-2d30-4c78-aba0-3bceef46d86d, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:34:55.034688 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a67a32f5-228e-40c4-a5b4-3b5d97a31202 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:55.063638 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a67a32f5-228e-40c4-a5b4-3b5d97a31202 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=99a092b4-9bbd-494d-ae20-ef1974fac9e1,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:55.067221 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-051e5c43-af09-49b6-b238-56f2358e7520 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Made reservation on behalf of 1d10b4824e524068827e58b55e269af3 for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:34:55.071046 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-051e5c43-af09-49b6-b238-56f2358e7520 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:55.095285 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-051e5c43-af09-49b6-b238-56f2358e7520 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 339} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:34:55.102961 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1a0d9d1b-a710-41e7-8aef-5c4ba9e5a04c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Network 476ac3d6-2d30-4c78-aba0-3bceef46d86d is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:34:55.111141 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-051e5c43-af09-49b6-b238-56f2358e7520 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:55.111481 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-051e5c43-af09-49b6-b238-56f2358e7520 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Added segment 142b6494-b2b1-4cea-9b90-321c4a2a4cae of type vlan for network 994f9071-b760-4d74-b91b-28777ec6b4e7 Nov 09 04:34:55.122831 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-2b7acb37-5331-4bc6-b94d-f3015412da32 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Allocated IP 172.20.0.9 (7b6ec8a7-3152-4a6b-88b2-1b5105cc3943/55684bb6-5188-4ce7-a4cb-155a73eeeeeb/0641253a-a234-4a6d-8e89-7a72a04af2ac) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:34:55.158406 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-051e5c43-af09-49b6-b238-56f2358e7520 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:55.165587 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a67a32f5-228e-40c4-a5b4-3b5d97a31202 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:55.169559 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a67a32f5-228e-40c4-a5b4-3b5d97a31202 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.7526882 Nov 09 04:34:55.184469 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58444) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:55.184469 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-937ebc9e-0d1a-44bf-ab63-d2323e26dd7c tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Request body: {'security_group_rule': {'security_group_id': '3fac99c0-db5e-4deb-ae03-d7c28ceb1106', 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:55.191536 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device ead597e3-bb6f-442e-b51f-2fef1e982ee1 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:34:55.204365 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-1a0d9d1b-a710-41e7-8aef-5c4ba9e5a04c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 476ac3d6-2d30-4c78-aba0-3bceef46d86d) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:55.209058 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1a0d9d1b-a710-41e7-8aef-5c4ba9e5a04c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:55.209815 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1a0d9d1b-a710-41e7-8aef-5c4ba9e5a04c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:55.219671 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-72d93942-b30b-4ebc-a256-e698f0c98c48 None None] Network 476ac3d6-2d30-4c78-aba0-3bceef46d86d requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:34:55.279023 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-051e5c43-af09-49b6-b238-56f2358e7520 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:55.286280 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-051e5c43-af09-49b6-b238-56f2358e7520 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:55.287319 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-051e5c43-af09-49b6-b238-56f2358e7520 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:55.301555 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2b7acb37-5331-4bc6-b94d-f3015412da32 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:55.304141 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port ead597e3-bb6f-442e-b51f-2fef1e982ee1 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:55.304515 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:55.324468 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-937ebc9e-0d1a-44bf-ab63-d2323e26dd7c tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:55.355207 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-051e5c43-af09-49b6-b238-56f2358e7520 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Network': ['ID=994f9071-b760-4d74-b91b-28777ec6b4e7,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:55.369772 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 994f9071-b760-4d74-b91b-28777ec6b4e7 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:34:55.388055 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-937ebc9e-0d1a-44bf-ab63-d2323e26dd7c tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:55.390889 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-1a0d9d1b-a710-41e7-8aef-5c4ba9e5a04c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.2753816 Nov 09 04:34:55.391413 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58446) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:55.395935 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-bcde0f16-3ae9-40b8-94f2-c0d81edd5f59 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-218225096', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:55.416997 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-051e5c43-af09-49b6-b238-56f2358e7520 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.6517677 Nov 09 04:34:55.420023 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58448) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:55.443502 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2b7acb37-5331-4bc6-b94d-f3015412da32 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:55.489955 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-076d9f91-60ef-42fa-903a-42e5158b5b5e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-476ac3d6-2d30-4c78-aba0-3bceef46d86d', 'network_id': '476ac3d6-2d30-4c78-aba0-3bceef46d86d', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'fixed_ips': [{'subnet_id': '23289141-7ad7-4e5f-90f0-c9511e33517d'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:34:55.491388 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-076d9f91-60ef-42fa-903a-42e5158b5b5e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:55.494275 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2b7acb37-5331-4bc6-b94d-f3015412da32 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Network 7b6ec8a7-3152-4a6b-88b2-1b5105cc3943 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:34:55.497488 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-2b7acb37-5331-4bc6-b94d-f3015412da32 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:55.500212 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2b7acb37-5331-4bc6-b94d-f3015412da32 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:34:55.505742 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fb09f505-8aeb-42f5-823c-48755ec716bc tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:55.510222 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-fb09f505-8aeb-42f5-823c-48755ec716bc tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/subnets?project_id=1d10b4824e524068827e58b55e269af3&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 829 time: 0.0866625 Nov 09 04:34:55.511321 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58450) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:55.531681 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-937ebc9e-0d1a-44bf-ab63-d2323e26dd7c tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:55.554767 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b7acb37-5331-4bc6-b94d-f3015412da32 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Pushing event updated for resources: {'Port': ['ID=0641253a-a234-4a6d-8e89-7a72a04af2ac,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:55.569344 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bcde0f16-3ae9-40b8-94f2-c0d81edd5f59 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:55.570396 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bcde0f16-3ae9-40b8-94f2-c0d81edd5f59 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:55.580288 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-937ebc9e-0d1a-44bf-ab63-d2323e26dd7c tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e4f17e4c-aad0-44c5-a35b-f43f490dd09b,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:55.595513 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2b7acb37-5331-4bc6-b94d-f3015412da32 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:55.595513 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2b7acb37-5331-4bc6-b94d-f3015412da32 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:55.651101 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bcde0f16-3ae9-40b8-94f2-c0d81edd5f59 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:55.663104 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-076d9f91-60ef-42fa-903a-42e5158b5b5e None None] Allocated IP 2001:db8::2 (476ac3d6-2d30-4c78-aba0-3bceef46d86d/23289141-7ad7-4e5f-90f0-c9511e33517d/f93fa75c-1834-4647-8354-1e6232a8d036) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:34:55.669267 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-937ebc9e-0d1a-44bf-ab63-d2323e26dd7c tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:55.670443 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-937ebc9e-0d1a-44bf-ab63-d2323e26dd7c tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.4994409 Nov 09 04:34:55.679613 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58452) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:55.684210 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-8419827c-132a-4d4b-b741-30779fe88f83 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Request body: {'security_group_rule': {'security_group_id': '3fac99c0-db5e-4deb-ae03-d7c28ceb1106', 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:55.692195 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4113f3e7-5ae9-4f4d-9192-bf29bf1c82bb tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:55.694396 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-4113f3e7-5ae9-4f4d-9192-bf29bf1c82bb tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.1820626 Nov 09 04:34:55.696686 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58454) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:55.727216 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-2b7acb37-5331-4bc6-b94d-f3015412da32 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 928 time: 1.3874729 Nov 09 04:34:55.730276 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58456) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:55.734510 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-3dcf4d39-846a-4ca1-92ba-51449caa5e9d tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/subnets?network_id=2b6725f5-ebfe-485a-8f42-ccb5a241ddb5&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0360427 Nov 09 04:34:55.737087 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58458) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:55.738592 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-e96d5038-0a50-4122-bd17-b4010df8cb53 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Request body: {'port': {'network_id': '7b6ec8a7-3152-4a6b-88b2-1b5105cc3943', 'name': 'tempest-FloatingIPTestJSON-291043453'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:55.770398 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-490ec276-844a-4bdf-bb7c-25b26434cdd4 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/subnets?project_id=1d10b4824e524068827e58b55e269af3&cidr=172.20.0.16%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0298088 Nov 09 04:34:55.770612 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58460) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:55.807876 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bcde0f16-3ae9-40b8-94f2-c0d81edd5f59 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:55.812104 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-076d9f91-60ef-42fa-903a-42e5158b5b5e None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:55.868671 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.securitygroups_db [None req-8419827c-132a-4d4b-b741-30779fe88f83 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Project f636e5f4c9f64f69ba3b2ab8816b6096 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 09 04:34:55.887331 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8419827c-132a-4d4b-b741-30779fe88f83 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:55.953810 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-076d9f91-60ef-42fa-903a-42e5158b5b5e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:55.954033 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e96d5038-0a50-4122-bd17-b4010df8cb53 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Made reservation on behalf of 459651e5af964f8c805d518a6dc3b464 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:34:55.957959 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e96d5038-0a50-4122-bd17-b4010df8cb53 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:55.964926 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-23c033a9-99a7-4c25-8593-75c36d5944d3 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:55.966565 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-23c033a9-99a7-4c25-8593-75c36d5944d3 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.1950397 Nov 09 04:34:55.970158 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58462) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:55.980710 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [None req-e96d5038-0a50-4122-bd17-b4010df8cb53 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] device_id is not set on port 57f5ba4c-bda3-4726-a6dd-7358e44971c0 yet. {{(pid=102162) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:34:55.995971 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-076d9f91-60ef-42fa-903a-42e5158b5b5e None None] Network 476ac3d6-2d30-4c78-aba0-3bceef46d86d is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:34:56.001071 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-076d9f91-60ef-42fa-903a-42e5158b5b5e None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:56.004614 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-076d9f91-60ef-42fa-903a-42e5158b5b5e None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:34:56.010072 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-076d9f91-60ef-42fa-903a-42e5158b5b5e None None] Pushing event updated for resources: {'Port': ['ID=f93fa75c-1834-4647-8354-1e6232a8d036,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:56.015501 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-76573493-1805-4ee0-95b4-0af50d945839 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/subnets?network_id=2b6725f5-ebfe-485a-8f42-ccb5a241ddb5&cidr=172.20.0.16%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0434289 Nov 09 04:34:56.017560 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8419827c-132a-4d4b-b741-30779fe88f83 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:56.018266 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58464) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:56.025676 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-cbcfaebe-7bf5-457d-a02a-7c76a629d97f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-1746838111', 'network_id': '994f9071-b760-4d74-b91b-28777ec6b4e7', 'project_id': '1d10b4824e524068827e58b55e269af3', 'ip_version': 4, 'cidr': '172.20.0.16/28'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:56.073103 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-076d9f91-60ef-42fa-903a-42e5158b5b5e None None] Attempting to bind port f93fa75c-1834-4647-8354-1e6232a8d036 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:34:56.073557 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-076d9f91-60ef-42fa-903a-42e5158b5b5e None None] Attempting to bind port f93fa75c-1834-4647-8354-1e6232a8d036 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '36295eec-b89c-46db-872c-cb9c859d70eb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 326, 'network_id': '476ac3d6-2d30-4c78-aba0-3bceef46d86d'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:34:56.073921 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-076d9f91-60ef-42fa-903a-42e5158b5b5e None None] Attempting to bind port f93fa75c-1834-4647-8354-1e6232a8d036 on network 476ac3d6-2d30-4c78-aba0-3bceef46d86d {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:34:56.079451 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-076d9f91-60ef-42fa-903a-42e5158b5b5e None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 34, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:34:56.079819 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-076d9f91-60ef-42fa-903a-42e5158b5b5e None None] Checking segment: {'id': '36295eec-b89c-46db-872c-cb9c859d70eb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 326, 'network_id': '476ac3d6-2d30-4c78-aba0-3bceef46d86d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:34:56.081362 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-076d9f91-60ef-42fa-903a-42e5158b5b5e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:56.081362 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-076d9f91-60ef-42fa-903a-42e5158b5b5e None None] Bound using segment: {'id': '36295eec-b89c-46db-872c-cb9c859d70eb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 326, 'network_id': '476ac3d6-2d30-4c78-aba0-3bceef46d86d'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:34:56.081691 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-076d9f91-60ef-42fa-903a-42e5158b5b5e None None] Bound port: f93fa75c-1834-4647-8354-1e6232a8d036, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '36295eec-b89c-46db-872c-cb9c859d70eb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 326, 'network_id': '476ac3d6-2d30-4c78-aba0-3bceef46d86d'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:34:56.082074 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-076d9f91-60ef-42fa-903a-42e5158b5b5e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:56.100306 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-e96d5038-0a50-4122-bd17-b4010df8cb53 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Allocated IP 172.20.0.14 (7b6ec8a7-3152-4a6b-88b2-1b5105cc3943/55684bb6-5188-4ce7-a4cb-155a73eeeeeb/57f5ba4c-bda3-4726-a6dd-7358e44971c0) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:34:56.101345 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bcde0f16-3ae9-40b8-94f2-c0d81edd5f59 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:56.105316 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-bcde0f16-3ae9-40b8-94f2-c0d81edd5f59 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 703 time: 0.7129214 Nov 09 04:34:56.105569 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58466) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:56.113716 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-cae77466-e4db-4a2b-9679-9d2dcaa7d4bf tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Request body: {'port': {'network_id': '476ac3d6-2d30-4c78-aba0-3bceef46d86d', 'name': 'tempest-RoutersIpV6Test-1756596917'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:56.128931 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8419827c-132a-4d4b-b741-30779fe88f83 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:56.152249 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8419827c-132a-4d4b-b741-30779fe88f83 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b034fa25-1d9b-43ac-bfb8-d62a852b1721,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:56.153116 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-076d9f91-60ef-42fa-903a-42e5158b5b5e None None] For port f93fa75c-1834-4647-8354-1e6232a8d036, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:34:56.161859 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-076d9f91-60ef-42fa-903a-42e5158b5b5e None None] For port f93fa75c-1834-4647-8354-1e6232a8d036, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=f93fa75c-1834-4647-8354-1e6232a8d036,segment=NetworkSegment(36295eec-b89c-46db-872c-cb9c859d70eb),segment_id=36295eec-b89c-46db-872c-cb9c859d70eb)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:34:56.205153 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cbcfaebe-7bf5-457d-a02a-7c76a629d97f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Made reservation on behalf of 1d10b4824e524068827e58b55e269af3 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:34:56.208682 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cbcfaebe-7bf5-457d-a02a-7c76a629d97f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:56.238250 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-076d9f91-60ef-42fa-903a-42e5158b5b5e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:56.306595 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-076d9f91-60ef-42fa-903a-42e5158b5b5e None None] Pushing event updated for resources: {'Port': ['ID=f93fa75c-1834-4647-8354-1e6232a8d036,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:56.320258 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8419827c-132a-4d4b-b741-30779fe88f83 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:56.326112 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-8419827c-132a-4d4b-b741-30779fe88f83 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.6416230 Nov 09 04:34:56.326112 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58468) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:56.331200 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-2902a879-3518-42b8-9319-11f6848cd79f tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Request body: {'security_group_rule': {'security_group_id': '3fac99c0-db5e-4deb-ae03-d7c28ceb1106', 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:56.361719 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e96d5038-0a50-4122-bd17-b4010df8cb53 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:56.419863 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cae77466-e4db-4a2b-9679-9d2dcaa7d4bf tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Made reservation on behalf of d11b025703b24d109deef7bfe57a45f6 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:34:56.423504 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cae77466-e4db-4a2b-9679-9d2dcaa7d4bf tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:56.441382 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [None req-cae77466-e4db-4a2b-9679-9d2dcaa7d4bf tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] device_id is not set on port 04ade6b6-b89d-4411-9371-7dbbfee7f5ba yet. {{(pid=102162) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:34:56.485350 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e96d5038-0a50-4122-bd17-b4010df8cb53 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:56.519118 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.securitygroups_db [None req-2902a879-3518-42b8-9319-11f6848cd79f tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Project f636e5f4c9f64f69ba3b2ab8816b6096 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 09 04:34:56.522249 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cbcfaebe-7bf5-457d-a02a-7c76a629d97f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:56.560647 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2902a879-3518-42b8-9319-11f6848cd79f tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:56.589546 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e96d5038-0a50-4122-bd17-b4010df8cb53 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Network 7b6ec8a7-3152-4a6b-88b2-1b5105cc3943 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:34:56.590494 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e96d5038-0a50-4122-bd17-b4010df8cb53 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Pushing event updated for resources: {'Port': ['ID=57f5ba4c-bda3-4726-a6dd-7358e44971c0,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:56.596338 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-e96d5038-0a50-4122-bd17-b4010df8cb53 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:56.600189 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e96d5038-0a50-4122-bd17-b4010df8cb53 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:34:56.630618 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbcfaebe-7bf5-457d-a02a-7c76a629d97f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Subnet': ['ID=c1f5ce70-ebae-4e4d-9de5-04a34e845fdb,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:56.651357 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cbcfaebe-7bf5-457d-a02a-7c76a629d97f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Checking segment: {'id': '142b6494-b2b1-4cea-9b90-321c4a2a4cae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 339, 'network_id': '994f9071-b760-4d74-b91b-28777ec6b4e7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:34:56.651720 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cbcfaebe-7bf5-457d-a02a-7c76a629d97f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network hostable DHCP agents. Network: 994f9071-b760-4d74-b91b-28777ec6b4e7, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:34:56.666092 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2902a879-3518-42b8-9319-11f6848cd79f tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:56.667470 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-cae77466-e4db-4a2b-9679-9d2dcaa7d4bf tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Allocated IP 2001:db8::2e5 (476ac3d6-2d30-4c78-aba0-3bceef46d86d/23289141-7ad7-4e5f-90f0-c9511e33517d/04ade6b6-b89d-4411-9371-7dbbfee7f5ba) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:34:56.675665 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e96d5038-0a50-4122-bd17-b4010df8cb53 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:56.676264 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e96d5038-0a50-4122-bd17-b4010df8cb53 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:56.739689 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2902a879-3518-42b8-9319-11f6848cd79f tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:56.760039 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2902a879-3518-42b8-9319-11f6848cd79f tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ad5aed66-426e-4e5a-bf2f-c77d34d347f2,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:56.769652 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cbcfaebe-7bf5-457d-a02a-7c76a629d97f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network 994f9071-b760-4d74-b91b-28777ec6b4e7 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:34:56.798611 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e96d5038-0a50-4122-bd17-b4010df8cb53 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 929 time: 1.0652912 Nov 09 04:34:56.800338 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58470) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:56.809541 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-7f61c275-9999-4830-9aad-11bf2d158088 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Request body: {'floatingip': {'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'port_id': '57f5ba4c-bda3-4726-a6dd-7358e44971c0', 'fixed_ip_address': '172.20.0.14'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:56.829713 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2902a879-3518-42b8-9319-11f6848cd79f tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:56.838485 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-2902a879-3518-42b8-9319-11f6848cd79f tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.5055165 Nov 09 04:34:56.876979 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-cbcfaebe-7bf5-457d-a02a-7c76a629d97f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 994f9071-b760-4d74-b91b-28777ec6b4e7) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:56.882914 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cbcfaebe-7bf5-457d-a02a-7c76a629d97f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:56.884491 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cbcfaebe-7bf5-457d-a02a-7c76a629d97f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:56.887004 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-149ddedf-7da6-43e0-8499-296acc0b5b34 None None] Network 994f9071-b760-4d74-b91b-28777ec6b4e7 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:34:56.907727 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cae77466-e4db-4a2b-9679-9d2dcaa7d4bf tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:56.961751 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7f61c275-9999-4830-9aad-11bf2d158088 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for floatingip, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:57.006688 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-cbcfaebe-7bf5-457d-a02a-7c76a629d97f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 835 time: 0.9873080 Nov 09 04:34:57.058154 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cae77466-e4db-4a2b-9679-9d2dcaa7d4bf tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:57.101084 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ea6c7ed2-0e8d-4236-8c8d-79f209d36d3e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-994f9071-b760-4d74-b91b-28777ec6b4e7', 'network_id': '994f9071-b760-4d74-b91b-28777ec6b4e7', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ips': [{'subnet_id': 'c1f5ce70-ebae-4e4d-9de5-04a34e845fdb'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:34:57.101339 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ea6c7ed2-0e8d-4236-8c8d-79f209d36d3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:57.132052 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cae77466-e4db-4a2b-9679-9d2dcaa7d4bf tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Network 476ac3d6-2d30-4c78-aba0-3bceef46d86d is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:34:57.144265 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-cae77466-e4db-4a2b-9679-9d2dcaa7d4bf tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:57.146938 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cae77466-e4db-4a2b-9679-9d2dcaa7d4bf tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:34:57.159322 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cae77466-e4db-4a2b-9679-9d2dcaa7d4bf tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:34:57.159963 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cae77466-e4db-4a2b-9679-9d2dcaa7d4bf tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:57.176268 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cae77466-e4db-4a2b-9679-9d2dcaa7d4bf tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event updated for resources: {'Port': ['ID=04ade6b6-b89d-4411-9371-7dbbfee7f5ba,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:57.217568 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7f61c275-9999-4830-9aad-11bf2d158088 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:57.306717 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58518) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:57.320341 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-cae77466-e4db-4a2b-9679-9d2dcaa7d4bf tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 929 time: 1.2137368 Nov 09 04:34:57.340185 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device f93fa75c-1834-4647-8354-1e6232a8d036 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:34:57.502834 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-ea6c7ed2-0e8d-4236-8c8d-79f209d36d3e None None] Allocated IP 172.20.0.18 (994f9071-b760-4d74-b91b-28777ec6b4e7/c1f5ce70-ebae-4e4d-9de5-04a34e845fdb/f41cb886-7a06-4aad-b458-67b53554e3e3) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:34:57.519571 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port f93fa75c-1834-4647-8354-1e6232a8d036 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:57.519942 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:57.529580 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-7f61c275-9999-4830-9aad-11bf2d158088 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Allocated IP 172.26.0.143 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/c7def8c1-5f0b-450b-bc0a-10bc616db585) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:34:57.749616 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7f61c275-9999-4830-9aad-11bf2d158088 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:57.757764 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:57.780842 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58520) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:57.790071 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-ff95d4f9-e082-41c5-822a-54df22d0bf59 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1109285894', 'description': 'tempest-secgroup-smoke-1109285894 description', 'project_id': '1d10b4824e524068827e58b55e269af3'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:57.873358 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ea6c7ed2-0e8d-4236-8c8d-79f209d36d3e None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:57.898559 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-48e0f189-4e00-4fe2-834e-8f7eed05599f None None] Network 476ac3d6-2d30-4c78-aba0-3bceef46d86d requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:34:57.899223 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7f61c275-9999-4830-9aad-11bf2d158088 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:57.935456 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-673f2050-de84-4dde-b5bb-967caa16faf4 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:57.941187 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port f93fa75c-1834-4647-8354-1e6232a8d036, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=f93fa75c-1834-4647-8354-1e6232a8d036,segment=NetworkSegment(36295eec-b89c-46db-872c-cb9c859d70eb),segment_id=36295eec-b89c-46db-872c-cb9c859d70eb)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:34:57.950007 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7f61c275-9999-4830-9aad-11bf2d158088 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:34:57.965870 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-7f61c275-9999-4830-9aad-11bf2d158088 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:57.971093 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ff95d4f9-e082-41c5-822a-54df22d0bf59 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:57.977467 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7f61c275-9999-4830-9aad-11bf2d158088 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:34:58.000807 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ea6c7ed2-0e8d-4236-8c8d-79f209d36d3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:58.074120 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f61c275-9999-4830-9aad-11bf2d158088 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Pushing event updated for resources: {'Port': ['ID=c7def8c1-5f0b-450b-bc0a-10bc616db585,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:58.075325 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ea6c7ed2-0e8d-4236-8c8d-79f209d36d3e None None] Network 994f9071-b760-4d74-b91b-28777ec6b4e7 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:34:58.088776 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-ea6c7ed2-0e8d-4236-8c8d-79f209d36d3e None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:58.092899 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ea6c7ed2-0e8d-4236-8c8d-79f209d36d3e None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:34:58.103514 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:58.123462 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-5000fe24-791c-4bce-b100-bf99fc0e6ec0 None None] Provisioning complete for port f93fa75c-1834-4647-8354-1e6232a8d036 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:58.127398 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5000fe24-791c-4bce-b100-bf99fc0e6ec0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:58.213554 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ff95d4f9-e082-41c5-822a-54df22d0bf59 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:58.216014 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-673f2050-de84-4dde-b5bb-967caa16faf4 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:58.259343 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea6c7ed2-0e8d-4236-8c8d-79f209d36d3e None None] Pushing event updated for resources: {'Port': ['ID=f41cb886-7a06-4aad-b458-67b53554e3e3,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:58.291748 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ff95d4f9-e082-41c5-822a-54df22d0bf59 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:58.312065 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-673f2050-de84-4dde-b5bb-967caa16faf4 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:58.396145 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff95d4f9-e082-41c5-822a-54df22d0bf59 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroup': ['ID=eb8d9d39-2315-42c2-bde9-38a01ea1afed,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:58.434973 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-673f2050-de84-4dde-b5bb-967caa16faf4 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event updated for resources: {'Port': ['ID=04ade6b6-b89d-4411-9371-7dbbfee7f5ba,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:58.440407 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ff95d4f9-e082-41c5-822a-54df22d0bf59 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:58.444236 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-ff95d4f9-e082-41c5-822a-54df22d0bf59 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.6554410 Nov 09 04:34:58.463957 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58528) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:58.469822 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-fd1ca417-8d28-4063-9fb6-a9515decb29b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': 'eb8d9d39-2315-42c2-bde9-38a01ea1afed', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:58.565780 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-ea6c7ed2-0e8d-4236-8c8d-79f209d36d3e None None] Attempting to bind port f41cb886-7a06-4aad-b458-67b53554e3e3 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:34:58.566391 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-ea6c7ed2-0e8d-4236-8c8d-79f209d36d3e None None] Attempting to bind port f41cb886-7a06-4aad-b458-67b53554e3e3 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '142b6494-b2b1-4cea-9b90-321c4a2a4cae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 339, 'network_id': '994f9071-b760-4d74-b91b-28777ec6b4e7'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:34:58.566509 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ea6c7ed2-0e8d-4236-8c8d-79f209d36d3e None None] Attempting to bind port f41cb886-7a06-4aad-b458-67b53554e3e3 on network 994f9071-b760-4d74-b91b-28777ec6b4e7 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:34:58.576910 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-673f2050-de84-4dde-b5bb-967caa16faf4 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:58.590661 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ea6c7ed2-0e8d-4236-8c8d-79f209d36d3e None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 34, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:34:58.591046 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ea6c7ed2-0e8d-4236-8c8d-79f209d36d3e None None] Checking segment: {'id': '142b6494-b2b1-4cea-9b90-321c4a2a4cae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 339, 'network_id': '994f9071-b760-4d74-b91b-28777ec6b4e7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:34:58.591449 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ea6c7ed2-0e8d-4236-8c8d-79f209d36d3e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:58.591845 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ea6c7ed2-0e8d-4236-8c8d-79f209d36d3e None None] Bound using segment: {'id': '142b6494-b2b1-4cea-9b90-321c4a2a4cae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 339, 'network_id': '994f9071-b760-4d74-b91b-28777ec6b4e7'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:34:58.592433 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-ea6c7ed2-0e8d-4236-8c8d-79f209d36d3e None None] Bound port: f41cb886-7a06-4aad-b458-67b53554e3e3, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '142b6494-b2b1-4cea-9b90-321c4a2a4cae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 339, 'network_id': '994f9071-b760-4d74-b91b-28777ec6b4e7'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:34:58.593358 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ea6c7ed2-0e8d-4236-8c8d-79f209d36d3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:58.610154 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=f93fa75c-1834-4647-8354-1e6232a8d036,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:58.630674 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-fd1ca417-8d28-4063-9fb6-a9515decb29b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:58.729146 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-fd1ca417-8d28-4063-9fb6-a9515decb29b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:58.792665 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-ea6c7ed2-0e8d-4236-8c8d-79f209d36d3e None None] For port f41cb886-7a06-4aad-b458-67b53554e3e3, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:34:58.796906 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-ea6c7ed2-0e8d-4236-8c8d-79f209d36d3e None None] For port f41cb886-7a06-4aad-b458-67b53554e3e3, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=f41cb886-7a06-4aad-b458-67b53554e3e3,segment=NetworkSegment(142b6494-b2b1-4cea-9b90-321c4a2a4cae),segment_id=142b6494-b2b1-4cea-9b90-321c4a2a4cae)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:34:58.804535 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7f61c275-9999-4830-9aad-11bf2d158088 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:58.823773 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-fd1ca417-8d28-4063-9fb6-a9515decb29b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:58.849463 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-673f2050-de84-4dde-b5bb-967caa16faf4 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:58.862493 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd1ca417-8d28-4063-9fb6-a9515decb29b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e0ee47da-f6c8-4316-94d7-3ce631ba8921,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:58.885688 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ea6c7ed2-0e8d-4236-8c8d-79f209d36d3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:58.985262 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea6c7ed2-0e8d-4236-8c8d-79f209d36d3e None None] Pushing event updated for resources: {'Port': ['ID=f41cb886-7a06-4aad-b458-67b53554e3e3,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:59.036266 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-947b1971-14da-45ac-8132-5bb248f267cb None None] Provisioning complete for port 04ade6b6-b89d-4411-9371-7dbbfee7f5ba triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:59.036689 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-947b1971-14da-45ac-8132-5bb248f267cb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:59.043792 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-fd1ca417-8d28-4063-9fb6-a9515decb29b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:59.050987 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-fd1ca417-8d28-4063-9fb6-a9515decb29b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.5850821 Nov 09 04:34:59.053963 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58540) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:59.058664 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-a616a728-b013-4319-b98e-f923db186d41 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': 'eb8d9d39-2315-42c2-bde9-38a01ea1afed', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:59.134831 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-947b1971-14da-45ac-8132-5bb248f267cb None None] Port 04ade6b6-b89d-4411-9371-7dbbfee7f5ba cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:34:59.167242 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-947b1971-14da-45ac-8132-5bb248f267cb None None] Provisioning complete for port f93fa75c-1834-4647-8354-1e6232a8d036 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:59.167973 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-947b1971-14da-45ac-8132-5bb248f267cb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:59.248934 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device f93fa75c-1834-4647-8354-1e6232a8d036 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:34:59.285315 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a616a728-b013-4319-b98e-f923db186d41 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:59.436428 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-673f2050-de84-4dde-b5bb-967caa16faf4 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:59.444981 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a616a728-b013-4319-b98e-f923db186d41 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:59.474444 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port f93fa75c-1834-4647-8354-1e6232a8d036 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:59.474444 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:59.542730 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a616a728-b013-4319-b98e-f923db186d41 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:59.545191 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-673f2050-de84-4dde-b5bb-967caa16faf4 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:59.546105 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-673f2050-de84-4dde-b5bb-967caa16faf4 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:59.606548 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-409afa0b-3060-44da-a539-f99ac4c04f09 None None] Provisioning complete for port 04ade6b6-b89d-4411-9371-7dbbfee7f5ba triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:59.607247 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-409afa0b-3060-44da-a539-f99ac4c04f09 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:59.617869 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7f61c275-9999-4830-9aad-11bf2d158088 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:59.627529 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a616a728-b013-4319-b98e-f923db186d41 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f37306ad-375f-4834-a427-6826e68ec69a,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:59.660938 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-409afa0b-3060-44da-a539-f99ac4c04f09 None None] Port 04ade6b6-b89d-4411-9371-7dbbfee7f5ba cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:34:59.682973 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a616a728-b013-4319-b98e-f923db186d41 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:59.684814 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a616a728-b013-4319-b98e-f923db186d41 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.6297450 Nov 09 04:34:59.688375 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58570) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:34:59.694893 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-8998e9c7-7a91-4ffe-910c-fdc676fdc828 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': 'eb8d9d39-2315-42c2-bde9-38a01ea1afed', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:34:59.695743 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-673f2050-de84-4dde-b5bb-967caa16faf4 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event updated for resources: {'Port': ['ID=04ade6b6-b89d-4411-9371-7dbbfee7f5ba,revision_number=3']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:34:59.785239 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e724ac81-3e8e-472e-8f6f-11a199bf487e None None] Provisioning complete for port 04ade6b6-b89d-4411-9371-7dbbfee7f5ba triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:34:59.786040 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e724ac81-3e8e-472e-8f6f-11a199bf487e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:59.811973 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-673f2050-de84-4dde-b5bb-967caa16faf4 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Network 476ac3d6-2d30-4c78-aba0-3bceef46d86d is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:34:59.814728 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-673f2050-de84-4dde-b5bb-967caa16faf4 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:34:59.827498 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e724ac81-3e8e-472e-8f6f-11a199bf487e None None] Port 04ade6b6-b89d-4411-9371-7dbbfee7f5ba cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:34:59.869085 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7f61c275-9999-4830-9aad-11bf2d158088 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:59.901013 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8998e9c7-7a91-4ffe-910c-fdc676fdc828 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:34:59.953937 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7f61c275-9999-4830-9aad-11bf2d158088 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:00.049857 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-673f2050-de84-4dde-b5bb-967caa16faf4 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Router b3a8212d-bd63-42e4-9023-f5d2609ea202 is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102161) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:35:00.066586 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7f61c275-9999-4830-9aad-11bf2d158088 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:00.180600 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.l3_db [None req-7f61c275-9999-4830-9aad-11bf2d158088 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Floating IP 030ad7f4-df6f-4f0c-acdf-7323aefb1ee6 associated. External IP: 172.26.0.143, port: 57f5ba4c-bda3-4726-a6dd-7358e44971c0. Nov 09 04:35:00.221537 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-673f2050-de84-4dde-b5bb-967caa16faf4 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:35:00.227294 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-673f2050-de84-4dde-b5bb-967caa16faf4 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "PUT /v2.0/routers/b3a8212d-bd63-42e4-9023-f5d2609ea202/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.9193904 Nov 09 04:35:00.230837 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58572) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:00.237710 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c193b8a8-859b-4802-9e09-1ea628c3ab16 None None] Sync routers for ids ['b3a8212d-bd63-42e4-9023-f5d2609ea202'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:35:00.258789 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c193b8a8-859b-4802-9e09-1ea628c3ab16 None None] Routers {'b3a8212d-bd63-42e4-9023-f5d2609ea202'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:00.259605 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-c193b8a8-859b-4802-9e09-1ea628c3ab16 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:34:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['b3a8212d-bd63-42e4-9023-f5d2609ea202'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:00.280245 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-571e88bf-3a04-451c-8810-ca44dfbd3b75 None None] Provisioning complete for port 04ade6b6-b89d-4411-9371-7dbbfee7f5ba triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:00.281000 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-571e88bf-3a04-451c-8810-ca44dfbd3b75 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:00.288466 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fcaea75f-4a58-4ea9-b377-edb577888f72 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:00.289941 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-fcaea75f-4a58-4ea9-b377-edb577888f72 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "GET /v2.0/ports/04ade6b6-b89d-4411-9371-7dbbfee7f5ba HTTP/1.1" status: 200 len: 984 time: 0.0581121 Nov 09 04:35:00.293205 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58574) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:00.341011 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-571e88bf-3a04-451c-8810-ca44dfbd3b75 None None] Port 04ade6b6-b89d-4411-9371-7dbbfee7f5ba cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:35:00.349210 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-c193b8a8-859b-4802-9e09-1ea628c3ab16 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:00.362096 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f61c275-9999-4830-9aad-11bf2d158088 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Pushing event updated for resources: {'Port': ['ID=c7def8c1-5f0b-450b-bc0a-10bc616db585,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:00.370169 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c193b8a8-859b-4802-9e09-1ea628c3ab16 None None] Routers {'b3a8212d-bd63-42e4-9023-f5d2609ea202'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:00.373248 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-c193b8a8-859b-4802-9e09-1ea628c3ab16 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:34:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['b3a8212d-bd63-42e4-9023-f5d2609ea202'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:00.375234 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8998e9c7-7a91-4ffe-910c-fdc676fdc828 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:00.410409 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-c193b8a8-859b-4802-9e09-1ea628c3ab16 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:00.411665 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c193b8a8-859b-4802-9e09-1ea628c3ab16 None None] The sync data for ids ['b3a8212d-bd63-42e4-9023-f5d2609ea202'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:35:00.429392 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-47e8326e-b9ef-4840-b41e-9e1d5646c79b None None] Network 994f9071-b760-4d74-b91b-28777ec6b4e7 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:35:00.456075 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8998e9c7-7a91-4ffe-910c-fdc676fdc828 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:00.503438 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-53961b6d-2b3f-4155-a72e-878608a616b1 None None] Provisioning complete for port f41cb886-7a06-4aad-b458-67b53554e3e3 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:00.503811 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-53961b6d-2b3f-4155-a72e-878608a616b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:00.513345 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8998e9c7-7a91-4ffe-910c-fdc676fdc828 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a9848d57-71be-47b8-b8cc-ed1daa7f4677,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:00.555777 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7f61c275-9999-4830-9aad-11bf2d158088 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Router 8ac82b1e-1b89-49c2-850a-e69a6d1163e6 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:35:00.622439 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8998e9c7-7a91-4ffe-910c-fdc676fdc828 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:00.627662 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-8998e9c7-7a91-4ffe-910c-fdc676fdc828 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.9382765 Nov 09 04:35:00.630117 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58578) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:00.635160 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-3360f3d3-066b-4b79-8323-6cd6e01b1b7f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': 'eb8d9d39-2315-42c2-bde9-38a01ea1afed', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:35:00.635359 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-53961b6d-2b3f-4155-a72e-878608a616b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:00.689594 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-53961b6d-2b3f-4155-a72e-878608a616b1 None None] For port f41cb886-7a06-4aad-b458-67b53554e3e3, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=f41cb886-7a06-4aad-b458-67b53554e3e3,segment=NetworkSegment(142b6494-b2b1-4cea-9b90-321c4a2a4cae),segment_id=142b6494-b2b1-4cea-9b90-321c4a2a4cae)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:35:00.724782 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7f61c275-9999-4830-9aad-11bf2d158088 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:35:00.735086 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a5513cbc-deed-47ac-8978-6d0c98489dd8 None None] Sync routers for ids ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:35:00.749754 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a5513cbc-deed-47ac-8978-6d0c98489dd8 None None] Routers {'8ac82b1e-1b89-49c2-850a-e69a6d1163e6'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:00.750772 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-a5513cbc-deed-47ac-8978-6d0c98489dd8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:34:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:00.793177 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-53961b6d-2b3f-4155-a72e-878608a616b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:00.823199 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-a5513cbc-deed-47ac-8978-6d0c98489dd8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:00.842548 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a5513cbc-deed-47ac-8978-6d0c98489dd8 None None] Routers {'8ac82b1e-1b89-49c2-850a-e69a6d1163e6'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:00.843158 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-a5513cbc-deed-47ac-8978-6d0c98489dd8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:34:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:00.886806 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-a5513cbc-deed-47ac-8978-6d0c98489dd8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:00.887516 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a5513cbc-deed-47ac-8978-6d0c98489dd8 None None] The sync data for ids ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:35:00.894097 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53961b6d-2b3f-4155-a72e-878608a616b1 None None] Pushing event updated for resources: {'Port': ['ID=f41cb886-7a06-4aad-b458-67b53554e3e3,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:00.924181 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3360f3d3-066b-4b79-8323-6cd6e01b1b7f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:01.019196 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-48410e7e-14b3-475f-bda6-42ef8773f30f None None] Provisioning complete for port f41cb886-7a06-4aad-b458-67b53554e3e3 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:01.019756 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-48410e7e-14b3-475f-bda6-42ef8773f30f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:01.023440 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3360f3d3-066b-4b79-8323-6cd6e01b1b7f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:01.152660 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-664de966-ad18-4899-a991-8e3e43bc77a4 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:01.196109 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device f41cb886-7a06-4aad-b458-67b53554e3e3 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:35:01.248732 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port f41cb886-7a06-4aad-b458-67b53554e3e3 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:01.249030 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:01.378776 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-664de966-ad18-4899-a991-8e3e43bc77a4 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Deleting port 04ade6b6-b89d-4411-9371-7dbbfee7f5ba {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:35:01.379420 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-664de966-ad18-4899-a991-8e3e43bc77a4 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:01.474578 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-664de966-ad18-4899-a991-8e3e43bc77a4 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:01.487130 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-664de966-ad18-4899-a991-8e3e43bc77a4 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Calling delete_port for 04ade6b6-b89d-4411-9371-7dbbfee7f5ba owned by network:router_interface {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:35:01.593020 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3360f3d3-066b-4b79-8323-6cd6e01b1b7f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:01.602886 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7f61c275-9999-4830-9aad-11bf2d158088 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:01.652345 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3360f3d3-066b-4b79-8323-6cd6e01b1b7f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e2a7472b-9954-4352-a48d-c251b38af809,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:01.665420 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-7f61c275-9999-4830-9aad-11bf2d158088 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] 10.222.0.24 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 983 time: 4.8608177 Nov 09 04:35:01.665816 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58582) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:01.682635 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-e8b46bba-9ba1-44d5-b285-6e0df79cc88a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Request body: {'floatingip': {'port_id': None}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:35:01.739661 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3360f3d3-066b-4b79-8323-6cd6e01b1b7f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:01.743399 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-3360f3d3-066b-4b79-8323-6cd6e01b1b7f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 1.1096010 Nov 09 04:35:01.743653 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58584) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:01.748390 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-5302af4b-a458-4016-bc19-85631bfcdaa8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': 'eb8d9d39-2315-42c2-bde9-38a01ea1afed', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:35:01.760054 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e8b46bba-9ba1-44d5-b285-6e0df79cc88a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for floatingip, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:01.770411 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-664de966-ad18-4899-a991-8e3e43bc77a4 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:01.800104 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-664de966-ad18-4899-a991-8e3e43bc77a4 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event deleted for resources: {'Port': ['ID=04ade6b6-b89d-4411-9371-7dbbfee7f5ba,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:01.897796 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-664de966-ad18-4899-a991-8e3e43bc77a4 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:01.907543 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.securitygroups_db [None req-5302af4b-a458-4016-bc19-85631bfcdaa8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Project 1d10b4824e524068827e58b55e269af3 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 09 04:35:01.949741 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5302af4b-a458-4016-bc19-85631bfcdaa8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:01.958452 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e8b46bba-9ba1-44d5-b285-6e0df79cc88a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:02.032031 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e8b46bba-9ba1-44d5-b285-6e0df79cc88a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:02.032377 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.l3_db [None req-e8b46bba-9ba1-44d5-b285-6e0df79cc88a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Floating IP 030ad7f4-df6f-4f0c-acdf-7323aefb1ee6 disassociated. External IP: 172.26.0.143, port: 57f5ba4c-bda3-4726-a6dd-7358e44971c0. Nov 09 04:35:02.045001 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5302af4b-a458-4016-bc19-85631bfcdaa8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:02.115752 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-664de966-ad18-4899-a991-8e3e43bc77a4 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Router b3a8212d-bd63-42e4-9023-f5d2609ea202 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:35:02.128385 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5302af4b-a458-4016-bc19-85631bfcdaa8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:02.157042 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5302af4b-a458-4016-bc19-85631bfcdaa8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=35d67c98-4824-4453-ba1d-e0a44c7918c4,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:02.204092 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-664de966-ad18-4899-a991-8e3e43bc77a4 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:35:02.209231 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-664de966-ad18-4899-a991-8e3e43bc77a4 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "PUT /v2.0/routers/b3a8212d-bd63-42e4-9023-f5d2609ea202/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.9147782 Nov 09 04:35:02.211982 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58586) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:02.214395 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b33c657a-93df-4feb-bb0b-c5bf565cc82d None None] Sync routers for ids ['b3a8212d-bd63-42e4-9023-f5d2609ea202'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:35:02.227599 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b33c657a-93df-4feb-bb0b-c5bf565cc82d None None] Routers {'b3a8212d-bd63-42e4-9023-f5d2609ea202'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:02.228481 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-b33c657a-93df-4feb-bb0b-c5bf565cc82d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:34:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['b3a8212d-bd63-42e4-9023-f5d2609ea202'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:02.240123 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5302af4b-a458-4016-bc19-85631bfcdaa8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:02.244055 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-5302af4b-a458-4016-bc19-85631bfcdaa8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.4967320 Nov 09 04:35:02.266976 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-b33c657a-93df-4feb-bb0b-c5bf565cc82d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:02.277149 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58588) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:02.277149 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-74183bda-000d-4072-9c80-156097f870ae tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': 'eb8d9d39-2315-42c2-bde9-38a01ea1afed', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:35:02.277457 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b33c657a-93df-4feb-bb0b-c5bf565cc82d None None] Routers {'b3a8212d-bd63-42e4-9023-f5d2609ea202'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:02.277457 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-b33c657a-93df-4feb-bb0b-c5bf565cc82d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:34:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['b3a8212d-bd63-42e4-9023-f5d2609ea202'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:02.310709 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-b33c657a-93df-4feb-bb0b-c5bf565cc82d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:02.311402 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b33c657a-93df-4feb-bb0b-c5bf565cc82d None None] The sync data for ids ['b3a8212d-bd63-42e4-9023-f5d2609ea202'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:35:02.324193 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e8b46bba-9ba1-44d5-b285-6e0df79cc88a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Router 8ac82b1e-1b89-49c2-850a-e69a6d1163e6 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:35:02.375637 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.securitygroups_db [None req-74183bda-000d-4072-9c80-156097f870ae tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Project 1d10b4824e524068827e58b55e269af3 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 09 04:35:02.384978 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-74183bda-000d-4072-9c80-156097f870ae tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:02.456596 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-6f2fcfbe-075b-46d2-aecf-02b22dae1c66 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] remove_router_interface failed (client error): The resource could not be found. Nov 09 04:35:02.457672 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-6f2fcfbe-075b-46d2-aecf-02b22dae1c66 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "PUT /v2.0/routers/b3a8212d-bd63-42e4-9023-f5d2609ea202/remove_router_interface HTTP/1.1" status: 404 len: 398 time: 0.2422845 Nov 09 04:35:02.460587 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58590) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:02.502602 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-97ea61d5-00e3-4790-8872-6d9e90f4b7e0 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "GET /v2.0/ports?device_id=b3a8212d-bd63-42e4-9023-f5d2609ea202 HTTP/1.1" status: 200 len: 205 time: 0.0408924 Nov 09 04:35:02.505389 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58592) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:02.505920 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e8b46bba-9ba1-44d5-b285-6e0df79cc88a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:35:02.511014 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e8b46bba-9ba1-44d5-b285-6e0df79cc88a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:02.520714 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6f5fc8a1-951c-4b26-9d59-82df4ef6c3a1 None None] Sync routers for ids ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:35:02.536231 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6f5fc8a1-951c-4b26-9d59-82df4ef6c3a1 None None] Routers {'8ac82b1e-1b89-49c2-850a-e69a6d1163e6'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:02.536603 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-74183bda-000d-4072-9c80-156097f870ae tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:02.536990 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-6f5fc8a1-951c-4b26-9d59-82df4ef6c3a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:34:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:02.548948 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e8b46bba-9ba1-44d5-b285-6e0df79cc88a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] 10.222.0.24 "PUT /v2.0/floatingips/030ad7f4-df6f-4f0c-acdf-7323aefb1ee6 HTTP/1.1" status: 200 len: 688 time: 0.8797400 Nov 09 04:35:02.549204 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58594) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:02.580724 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-6f5fc8a1-951c-4b26-9d59-82df4ef6c3a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:02.589877 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6f5fc8a1-951c-4b26-9d59-82df4ef6c3a1 None None] Routers {'8ac82b1e-1b89-49c2-850a-e69a6d1163e6'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:02.590825 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-6f5fc8a1-951c-4b26-9d59-82df4ef6c3a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:34:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:02.604541 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-00aced76-ac5b-4aac-805d-69aa8e5a2a96 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for router, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:02.623855 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-74183bda-000d-4072-9c80-156097f870ae tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:02.627420 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-6f5fc8a1-951c-4b26-9d59-82df4ef6c3a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:02.627420 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6f5fc8a1-951c-4b26-9d59-82df4ef6c3a1 None None] The sync data for ids ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:35:02.656525 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74183bda-000d-4072-9c80-156097f870ae tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4f814f2e-679f-49da-81de-192a850b37d8,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:02.698786 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-ec10fd84-e8d0-4df2-a8aa-7fadde0d507b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Deleting port c7def8c1-5f0b-450b-bc0a-10bc616db585 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:35:02.699119 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ec10fd84-e8d0-4df2-a8aa-7fadde0d507b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:02.749711 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-74183bda-000d-4072-9c80-156097f870ae tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:02.750930 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-74183bda-000d-4072-9c80-156097f870ae tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.4819441 Nov 09 04:35:02.787564 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ec10fd84-e8d0-4df2-a8aa-7fadde0d507b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:02.787883 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ec10fd84-e8d0-4df2-a8aa-7fadde0d507b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:02.800454 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-ec10fd84-e8d0-4df2-a8aa-7fadde0d507b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Calling delete_port for c7def8c1-5f0b-450b-bc0a-10bc616db585 owned by network:floatingip {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:35:02.808412 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-00aced76-ac5b-4aac-805d-69aa8e5a2a96 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:02.814450 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-00aced76-ac5b-4aac-805d-69aa8e5a2a96 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:02.947782 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-00aced76-ac5b-4aac-805d-69aa8e5a2a96 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:02.948264 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-00aced76-ac5b-4aac-805d-69aa8e5a2a96 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Fanout notify agent at l3_agent the message router_deleted on router b3a8212d-bd63-42e4-9023-f5d2609ea202 {{(pid=102161) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:35:02.965608 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-00aced76-ac5b-4aac-805d-69aa8e5a2a96 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:02.966952 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-00aced76-ac5b-4aac-805d-69aa8e5a2a96 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "DELETE /v2.0/routers/b3a8212d-bd63-42e4-9023-f5d2609ea202 HTTP/1.1" status: 204 len: 168 time: 0.4607587 Nov 09 04:35:02.969750 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58610) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:03.033168 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-41072ddd-63da-4d9d-86ad-5e7924ee34af tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Deleting subnet 23289141-7ad7-4e5f-90f0-c9511e33517d {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:35:03.037162 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-50c8ae8b-0aa7-4557-b439-6ea90d82baf0 req-852a29ac-66f8-40b3-8528-de4cd1f5f446 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1109285894&fields=id&tenant_id=1d10b4824e524068827e58b55e269af3 HTTP/1.1" status: 200 len: 267 time: 0.0617247 Nov 09 04:35:03.041963 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-41072ddd-63da-4d9d-86ad-5e7924ee34af tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:03.041963 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ec10fd84-e8d0-4df2-a8aa-7fadde0d507b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:03.104858 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec10fd84-e8d0-4df2-a8aa-7fadde0d507b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Pushing event deleted for resources: {'Port': ['ID=c7def8c1-5f0b-450b-bc0a-10bc616db585,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:03.119186 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-41072ddd-63da-4d9d-86ad-5e7924ee34af tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:03.212883 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ec10fd84-e8d0-4df2-a8aa-7fadde0d507b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for floatingip, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:03.215842 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ec10fd84-e8d0-4df2-a8aa-7fadde0d507b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:03.217001 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-ec10fd84-e8d0-4df2-a8aa-7fadde0d507b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] 10.222.0.24 "DELETE /v2.0/floatingips/030ad7f4-df6f-4f0c-acdf-7323aefb1ee6 HTTP/1.1" status: 204 len: 168 time: 0.6668985 Nov 09 04:35:03.223535 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58612) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:03.229061 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-66766037-a0f6-4914-a5a3-241a23850139 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Request body: {'floatingip': {'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'port_id': '0641253a-a234-4a6d-8e89-7a72a04af2ac'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:35:03.260272 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50c8ae8b-0aa7-4557-b439-6ea90d82baf0 req-23beeb9d-e1d9-4152-91d1-5c512ef3010e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:03.261045 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-41072ddd-63da-4d9d-86ad-5e7924ee34af tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:03.261923 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-50c8ae8b-0aa7-4557-b439-6ea90d82baf0 req-23beeb9d-e1d9-4152-91d1-5c512ef3010e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/networks?id=994f9071-b760-4d74-b91b-28777ec6b4e7 HTTP/1.1" status: 200 len: 796 time: 0.2174437 Nov 09 04:35:03.277535 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-50c8ae8b-0aa7-4557-b439-6ea90d82baf0 req-53b37ce8-383b-4c79-96c6-6fe87a77a9c0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/quotas/1d10b4824e524068827e58b55e269af3 HTTP/1.1" status: 200 len: 375 time: 0.0090714 Nov 09 04:35:03.346626 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-66766037-a0f6-4914-a5a3-241a23850139 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for floatingip, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:03.390017 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-50c8ae8b-0aa7-4557-b439-6ea90d82baf0 req-3cbe0c29-3357-456a-aea0-85382515d646 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&fields=id HTTP/1.1" status: 200 len: 440 time: 0.1067703 Nov 09 04:35:03.398973 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-41072ddd-63da-4d9d-86ad-5e7924ee34af tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:03.432862 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-41072ddd-63da-4d9d-86ad-5e7924ee34af tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:03.437231 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-41072ddd-63da-4d9d-86ad-5e7924ee34af tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "DELETE /v2.0/subnets/23289141-7ad7-4e5f-90f0-c9511e33517d HTTP/1.1" status: 204 len: 168 time: 0.4647923 Nov 09 04:35:03.438472 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41072ddd-63da-4d9d-86ad-5e7924ee34af tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event deleted for resources: {'Subnet': ['ID=23289141-7ad7-4e5f-90f0-c9511e33517d,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:03.439969 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58616) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:03.442856 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e072903f-a753-4edd-a8ba-c27cb7f8ed0b None None] Network 476ac3d6-2d30-4c78-aba0-3bceef46d86d requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:35:03.589355 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a8158aad-ec5c-4885-b408-1ad65d0da33f tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:03.650423 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-50c8ae8b-0aa7-4557-b439-6ea90d82baf0 req-2846b62e-d40a-4dc6-979c-3d9f9ab81987 service neutron] 10.222.0.24 "GET /v2.0/networks/994f9071-b760-4d74-b91b-28777ec6b4e7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2239871 Nov 09 04:35:03.663013 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5ec90ceb-a3e4-48ef-bc55-deb60e8b633b None None] DHCP port deletion for 476ac3d6-2d30-4c78-aba0-3bceef46d86d request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:35:03.689588 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-66766037-a0f6-4914-a5a3-241a23850139 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:03.730306 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-5ec90ceb-a3e4-48ef-bc55-deb60e8b633b None None] Deleting port f93fa75c-1834-4647-8354-1e6232a8d036 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:35:03.730813 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5ec90ceb-a3e4-48ef-bc55-deb60e8b633b None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:03.801736 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-a8158aad-ec5c-4885-b408-1ad65d0da33f tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Deleting port f93fa75c-1834-4647-8354-1e6232a8d036 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:35:03.802071 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a8158aad-ec5c-4885-b408-1ad65d0da33f tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:03.804644 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-5ec90ceb-a3e4-48ef-bc55-deb60e8b633b None None] For port f93fa75c-1834-4647-8354-1e6232a8d036, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=f93fa75c-1834-4647-8354-1e6232a8d036,segment=NetworkSegment(36295eec-b89c-46db-872c-cb9c859d70eb),segment_id=36295eec-b89c-46db-872c-cb9c859d70eb)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:35:03.805042 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5ec90ceb-a3e4-48ef-bc55-deb60e8b633b None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:03.818756 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-5ec90ceb-a3e4-48ef-bc55-deb60e8b633b None None] Calling delete_port for f93fa75c-1834-4647-8354-1e6232a8d036 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:35:03.889124 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-50c8ae8b-0aa7-4557-b439-6ea90d82baf0 req-83a32713-a357-4c2c-bc74-63d3ffe89808 service neutron] 10.222.0.24 "GET /v2.0/networks/994f9071-b760-4d74-b91b-28777ec6b4e7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2300503 Nov 09 04:35:03.924421 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-66766037-a0f6-4914-a5a3-241a23850139 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Allocated IP 172.26.0.64 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/97a94da4-bebb-4a7e-b40b-d81e3e6c6217) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:35:03.927768 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-a8158aad-ec5c-4885-b408-1ad65d0da33f tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] For port f93fa75c-1834-4647-8354-1e6232a8d036, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=f93fa75c-1834-4647-8354-1e6232a8d036,segment=NetworkSegment(36295eec-b89c-46db-872c-cb9c859d70eb),segment_id=36295eec-b89c-46db-872c-cb9c859d70eb)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:35:03.927768 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a8158aad-ec5c-4885-b408-1ad65d0da33f tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:03.946381 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-a8158aad-ec5c-4885-b408-1ad65d0da33f tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Calling delete_port for f93fa75c-1834-4647-8354-1e6232a8d036 owned by network:dhcp {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:35:04.004161 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5ec90ceb-a3e4-48ef-bc55-deb60e8b633b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:04.031847 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ec90ceb-a3e4-48ef-bc55-deb60e8b633b None None] Pushing event deleted for resources: {'Port': ['ID=f93fa75c-1834-4647-8354-1e6232a8d036,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:04.037107 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5ec90ceb-a3e4-48ef-bc55-deb60e8b633b None None] No DVR routers for this DVR port f93fa75c-1834-4647-8354-1e6232a8d036 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:35:04.109687 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-66766037-a0f6-4914-a5a3-241a23850139 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:04.114722 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a8158aad-ec5c-4885-b408-1ad65d0da33f tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:04.159079 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8158aad-ec5c-4885-b408-1ad65d0da33f tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event deleted for resources: {'Port': ['ID=f93fa75c-1834-4647-8354-1e6232a8d036,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:04.181477 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a8158aad-ec5c-4885-b408-1ad65d0da33f tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] No DVR routers for this DVR port f93fa75c-1834-4647-8354-1e6232a8d036 on host dv-neutron-816802-2-hyperv {{(pid=102161) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:35:04.187352 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4172310d-ac2d-4c89-9cab-abfc32875fb7 req-cd9ae8f0-b758-49e9-a353-695f21aaa3d2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=f9a57fa6-0a62-475f-af77-8f608003b5e1 HTTP/1.1" status: 200 len: 210 time: 0.0314169 Nov 09 04:35:04.291558 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a8158aad-ec5c-4885-b408-1ad65d0da33f tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:04.315940 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-66766037-a0f6-4914-a5a3-241a23850139 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:04.316889 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-a8158aad-ec5c-4885-b408-1ad65d0da33f tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['476ac3d6-2d30-4c78-aba0-3bceef46d86d']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:04.347849 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-a8158aad-ec5c-4885-b408-1ad65d0da33f tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '36295eec-b89c-46db-872c-cb9c859d70eb') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:04.348180 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-a8158aad-ec5c-4885-b408-1ad65d0da33f tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '36295eec-b89c-46db-872c-cb9c859d70eb') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:04.365630 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a8158aad-ec5c-4885-b408-1ad65d0da33f tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:04.378237 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-66766037-a0f6-4914-a5a3-241a23850139 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:35:04.386059 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-66766037-a0f6-4914-a5a3-241a23850139 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:35:04.390719 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-66766037-a0f6-4914-a5a3-241a23850139 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:35:04.393792 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a8158aad-ec5c-4885-b408-1ad65d0da33f tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:04.420119 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66766037-a0f6-4914-a5a3-241a23850139 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Pushing event updated for resources: {'Port': ['ID=97a94da4-bebb-4a7e-b40b-d81e3e6c6217,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:04.424134 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a8158aad-ec5c-4885-b408-1ad65d0da33f tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Releasing vlan 326 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:35:04.424134 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a8158aad-ec5c-4885-b408-1ad65d0da33f tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:04.428446 dv-neutron-816802-2-hyperv neutron-server[102161]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:35:04.428446 dv-neutron-816802-2-hyperv neutron-server[102161]: self.session.flush() Nov 09 04:35:04.428446 dv-neutron-816802-2-hyperv neutron-server[102161]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:35:04.428446 dv-neutron-816802-2-hyperv neutron-server[102161]: self.session.flush() Nov 09 04:35:04.428446 dv-neutron-816802-2-hyperv neutron-server[102161]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:35:04.428446 dv-neutron-816802-2-hyperv neutron-server[102161]: self.session.flush() Nov 09 04:35:04.428446 dv-neutron-816802-2-hyperv neutron-server[102161]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:35:04.428446 dv-neutron-816802-2-hyperv neutron-server[102161]: self.session.flush() Nov 09 04:35:04.428446 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:35:04.428446 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:35:04.428446 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:35:04.428446 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:35:04.428446 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:35:04.428446 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:35:04.428446 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:35:04.428446 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:35:04.428446 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:35:04.428446 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:35:04.428446 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:35:04.428446 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:35:04.428446 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:35:04.428446 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:35:04.428446 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:35:04.428446 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:35:04.428446 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:35:04.428446 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:35:04.428446 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:35:04.428446 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:35:04.428446 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:35:04.428446 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:35:04.428446 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:35:04.428446 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:35:04.428446 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:35:04.428446 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:35:04.428446 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:35:04.428446 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:35:04.428446 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:35:04.428446 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:35:04.428446 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:35:04.428446 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:35:04.472713 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:35:04.927203 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a8158aad-ec5c-4885-b408-1ad65d0da33f tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:04.936664 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a8158aad-ec5c-4885-b408-1ad65d0da33f tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:04.939972 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a8158aad-ec5c-4885-b408-1ad65d0da33f tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "DELETE /v2.0/networks/476ac3d6-2d30-4c78-aba0-3bceef46d86d HTTP/1.1" status: 204 len: 168 time: 1.4986959 Nov 09 04:35:04.945167 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58632) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:04.951112 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-eb54d111-289e-415c-b590-1ab355a6057f tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-1725738816'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:35:04.957704 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8158aad-ec5c-4885-b408-1ad65d0da33f tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event deleted for resources: {'Network': ['ID=476ac3d6-2d30-4c78-aba0-3bceef46d86d,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:05.179909 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device f93fa75c-1834-4647-8354-1e6232a8d036 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:35:05.193952 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-66766037-a0f6-4914-a5a3-241a23850139 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:05.200867 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: f93fa75c-1834-4647-8354-1e6232a8d036 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:35:05.201223 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device f93fa75c-1834-4647-8354-1e6232a8d036 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:35:05.292581 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c38bbe4a-f04e-4816-98ba-d5313770349d req-49771656-dfc0-48bd-bede-f286b4355d07 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=f9a57fa6-0a62-475f-af77-8f608003b5e1 HTTP/1.1" status: 200 len: 210 time: 0.0343528 Nov 09 04:35:05.473760 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-eb54d111-289e-415c-b590-1ab355a6057f tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Made reservation on behalf of d11b025703b24d109deef7bfe57a45f6 for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:35:05.478388 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-eb54d111-289e-415c-b590-1ab355a6057f tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:05.507878 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-eb54d111-289e-415c-b590-1ab355a6057f tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 307} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:35:05.511037 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-66766037-a0f6-4914-a5a3-241a23850139 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:05.518339 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-eb54d111-289e-415c-b590-1ab355a6057f tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:05.522574 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-eb54d111-289e-415c-b590-1ab355a6057f tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Added segment 0fcde28f-716d-48eb-a871-a5cce56962d8 of type vlan for network ba62edfc-a421-4d9e-81b0-336d1f13df93 Nov 09 04:35:05.567915 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-eb54d111-289e-415c-b590-1ab355a6057f tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:05.665301 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-eb54d111-289e-415c-b590-1ab355a6057f tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:05.665568 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-66766037-a0f6-4914-a5a3-241a23850139 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:05.671036 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb54d111-289e-415c-b590-1ab355a6057f tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:05.677470 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-eb54d111-289e-415c-b590-1ab355a6057f tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:05.724196 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-66766037-a0f6-4914-a5a3-241a23850139 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:05.739617 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb54d111-289e-415c-b590-1ab355a6057f tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event updated for resources: {'Network': ['ID=ba62edfc-a421-4d9e-81b0-336d1f13df93,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:05.754621 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network ba62edfc-a421-4d9e-81b0-336d1f13df93 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:35:05.784807 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-eb54d111-289e-415c-b590-1ab355a6057f tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 770 time: 0.8382790 Nov 09 04:35:05.787854 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58636) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:05.792835 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-76448939-7acd-4f00-8519-fce58db7d189 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Request body: {'subnet': {'network_id': 'ba62edfc-a421-4d9e-81b0-336d1f13df93', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:35:05.844858 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66766037-a0f6-4914-a5a3-241a23850139 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Pushing event updated for resources: {'Port': ['ID=97a94da4-bebb-4a7e-b40b-d81e3e6c6217,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:05.855768 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-66766037-a0f6-4914-a5a3-241a23850139 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:06.008426 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.l3_db [None req-66766037-a0f6-4914-a5a3-241a23850139 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Floating IP c4ba145b-572c-418d-9126-f6a0921d8b3b associated. External IP: 172.26.0.64, port: 0641253a-a234-4a6d-8e89-7a72a04af2ac. Nov 09 04:35:06.093902 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-76448939-7acd-4f00-8519-fce58db7d189 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Made reservation on behalf of d11b025703b24d109deef7bfe57a45f6 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:35:06.097892 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-76448939-7acd-4f00-8519-fce58db7d189 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:06.372139 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-66766037-a0f6-4914-a5a3-241a23850139 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Router 8ac82b1e-1b89-49c2-850a-e69a6d1163e6 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:35:06.424018 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-37ebe1dd-99eb-46a7-abed-acfc3e774ce7 req-634391a7-0bbb-4f83-a7cc-bc275defa819 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=f9a57fa6-0a62-475f-af77-8f608003b5e1 HTTP/1.1" status: 200 len: 210 time: 0.0546842 Nov 09 04:35:06.468899 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-76448939-7acd-4f00-8519-fce58db7d189 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:06.551999 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-66766037-a0f6-4914-a5a3-241a23850139 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:35:06.554097 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76448939-7acd-4f00-8519-fce58db7d189 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event updated for resources: {'Subnet': ['ID=6c138018-b731-4582-94d4-e9fdf47a1e29,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:06.570526 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-76448939-7acd-4f00-8519-fce58db7d189 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Checking segment: {'id': '0fcde28f-716d-48eb-a871-a5cce56962d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 307, 'network_id': 'ba62edfc-a421-4d9e-81b0-336d1f13df93'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:35:06.570962 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-76448939-7acd-4f00-8519-fce58db7d189 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Network hostable DHCP agents. Network: ba62edfc-a421-4d9e-81b0-336d1f13df93, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:35:06.578720 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a323b76a-7032-4b9f-b9a4-c557e4eb0ce9 None None] Sync routers for ids ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:35:06.589414 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a323b76a-7032-4b9f-b9a4-c557e4eb0ce9 None None] Routers {'8ac82b1e-1b89-49c2-850a-e69a6d1163e6'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:06.591905 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-a323b76a-7032-4b9f-b9a4-c557e4eb0ce9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:34:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:06.628903 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-a323b76a-7032-4b9f-b9a4-c557e4eb0ce9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:06.638662 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a323b76a-7032-4b9f-b9a4-c557e4eb0ce9 None None] Routers {'8ac82b1e-1b89-49c2-850a-e69a6d1163e6'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:06.639296 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-a323b76a-7032-4b9f-b9a4-c557e4eb0ce9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:34:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:06.664632 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50c8ae8b-0aa7-4557-b439-6ea90d82baf0 req-f579753f-037e-452a-895d-ee6d3a055bbf tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:06.666535 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-50c8ae8b-0aa7-4557-b439-6ea90d82baf0 req-f579753f-037e-452a-895d-ee6d3a055bbf tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "GET /v2.0/networks?id=994f9071-b760-4d74-b91b-28777ec6b4e7 HTTP/1.1" status: 200 len: 796 time: 0.1232915 Nov 09 04:35:06.674481 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-66766037-a0f6-4914-a5a3-241a23850139 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:06.687563 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-a323b76a-7032-4b9f-b9a4-c557e4eb0ce9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:06.688393 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a323b76a-7032-4b9f-b9a4-c557e4eb0ce9 None None] The sync data for ids ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:35:06.703004 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-76448939-7acd-4f00-8519-fce58db7d189 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Network ba62edfc-a421-4d9e-81b0-336d1f13df93 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:35:06.712023 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-66766037-a0f6-4914-a5a3-241a23850139 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] 10.222.0.24 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 981 time: 3.4852169 Nov 09 04:35:06.713532 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58642) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:06.780155 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-76448939-7acd-4f00-8519-fce58db7d189 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, ba62edfc-a421-4d9e-81b0-336d1f13df93) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:35:06.784572 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-76448939-7acd-4f00-8519-fce58db7d189 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:06.785386 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-76448939-7acd-4f00-8519-fce58db7d189 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:06.792667 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4e9f10b0-fe78-4cf8-b5ab-490803592d92 None None] Network ba62edfc-a421-4d9e-81b0-336d1f13df93 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:35:06.793333 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-50c8ae8b-0aa7-4557-b439-6ea90d82baf0 req-3013b583-e4b4-4efc-baa0-706b7682ed57 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=1d10b4824e524068827e58b55e269af3 HTTP/1.1" status: 200 len: 472 time: 0.1173310 Nov 09 04:35:06.806245 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-50c8ae8b-0aa7-4557-b439-6ea90d82baf0 req-e4bcd954-99d7-4ed9-8a1a-bb2c2b24f648 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'port': {'device_id': 'f9a57fa6-0a62-475f-af77-8f608003b5e1', 'network_id': '994f9071-b760-4d74-b91b-28777ec6b4e7', 'admin_state_up': True, 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'security_groups': ['eb8d9d39-2315-42c2-bde9-38a01ea1afed']}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:35:06.823252 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-9b166693-b0e8-4ce9-a5c8-cb0b607102ca tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] 10.222.0.24 "GET /v2.0/floatingips/c4ba145b-572c-418d-9126-f6a0921d8b3b HTTP/1.1" status: 200 len: 976 time: 0.1085880 Nov 09 04:35:06.825819 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58644) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:06.917511 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-76448939-7acd-4f00-8519-fce58db7d189 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.1286008 Nov 09 04:35:06.922987 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58648) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:06.928060 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-3b423d81-d2f2-4868-8d71-6e71fea28b8c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-734021159', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:35:06.971921 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.db.api [req-50c8ae8b-0aa7-4557-b439-6ea90d82baf0 req-e4bcd954-99d7-4ed9-8a1a-bb2c2b24f648 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Nov 09 04:35:06.971921 dv-neutron-816802-2-hyperv neutron-server[102162]: [SQL: DELETE FROM reservations WHERE reservations.project_id = %(project_id_1)s AND reservations.expiration < %(expiration_1)s] Nov 09 04:35:06.971921 dv-neutron-816802-2-hyperv neutron-server[102162]: [parameters: {'project_id_1': '1d10b4824e524068827e58b55e269af3', 'expiration_1': datetime.datetime(2021, 11, 9, 4, 34, 46, 958771)}] Nov 09 04:35:06.971921 dv-neutron-816802-2-hyperv neutron-server[102162]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=102162) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:35:06.972476 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG oslo_db.api [req-50c8ae8b-0aa7-4557-b439-6ea90d82baf0 req-e4bcd954-99d7-4ed9-8a1a-bb2c2b24f648 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Performing DB retry for function neutron.db.quota.driver_nolock.DbQuotaNoLockDriver.make_reservation {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:35:06.990172 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-2f0fc439-ebad-4070-aec6-6ba51f834501 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] 10.222.0.24 "GET /v2.0/floatingips HTTP/1.1" status: 200 len: 979 time: 0.1628225 Nov 09 04:35:07.006486 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58650) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:07.010389 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-61d99e47-a7a5-4528-8d4c-9fef0ea32cee None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-ba62edfc-a421-4d9e-81b0-336d1f13df93', 'network_id': 'ba62edfc-a421-4d9e-81b0-336d1f13df93', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'fixed_ips': [{'subnet_id': '6c138018-b731-4582-94d4-e9fdf47a1e29'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:35:07.010957 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-c92741b8-6d1e-4f3a-8a25-fdbf1f980c18 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Request body: {'floatingip': {'port_id': '57f5ba4c-bda3-4726-a6dd-7358e44971c0'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:35:07.011416 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-61d99e47-a7a5-4528-8d4c-9fef0ea32cee None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:07.080619 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c92741b8-6d1e-4f3a-8a25-fdbf1f980c18 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for floatingip, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:07.101302 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3b423d81-d2f2-4868-8d71-6e71fea28b8c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:07.102221 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3b423d81-d2f2-4868-8d71-6e71fea28b8c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:07.168730 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3b423d81-d2f2-4868-8d71-6e71fea28b8c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:07.185631 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-61d99e47-a7a5-4528-8d4c-9fef0ea32cee None None] Allocated IP 2001:db8::2 (ba62edfc-a421-4d9e-81b0-336d1f13df93/6c138018-b731-4582-94d4-e9fdf47a1e29/f3c1c9eb-0af6-4531-a859-1d34d94e2118) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:35:07.299880 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3b423d81-d2f2-4868-8d71-6e71fea28b8c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:07.347838 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-61d99e47-a7a5-4528-8d4c-9fef0ea32cee None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:07.381361 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3b423d81-d2f2-4868-8d71-6e71fea28b8c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:07.383241 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-3b423d81-d2f2-4868-8d71-6e71fea28b8c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 703 time: 0.4591656 Nov 09 04:35:07.386254 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58656) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:07.462328 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-61d99e47-a7a5-4528-8d4c-9fef0ea32cee None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:07.569265 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-6bf70a0b-4614-4307-b1d4-f7a685555a0c req-a3c5f03b-800e-4008-8651-8a3e5ca3bd49 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=f9a57fa6-0a62-475f-af77-8f608003b5e1 HTTP/1.1" status: 200 len: 210 time: 0.0341997 Nov 09 04:35:07.576838 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-61d99e47-a7a5-4528-8d4c-9fef0ea32cee None None] Network ba62edfc-a421-4d9e-81b0-336d1f13df93 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:35:07.593509 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-61d99e47-a7a5-4528-8d4c-9fef0ea32cee None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:35:07.619947 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-61d99e47-a7a5-4528-8d4c-9fef0ea32cee None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:35:07.619947 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61d99e47-a7a5-4528-8d4c-9fef0ea32cee None None] Pushing event updated for resources: {'Port': ['ID=f3c1c9eb-0af6-4531-a859-1d34d94e2118,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:07.649915 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-50c8ae8b-0aa7-4557-b439-6ea90d82baf0 req-e4bcd954-99d7-4ed9-8a1a-bb2c2b24f648 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Made reservation on behalf of 1d10b4824e524068827e58b55e269af3 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:35:07.653449 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-50c8ae8b-0aa7-4557-b439-6ea90d82baf0 req-e4bcd954-99d7-4ed9-8a1a-bb2c2b24f648 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:07.666722 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-61d99e47-a7a5-4528-8d4c-9fef0ea32cee None None] Attempting to bind port f3c1c9eb-0af6-4531-a859-1d34d94e2118 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:35:07.667063 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-61d99e47-a7a5-4528-8d4c-9fef0ea32cee None None] Attempting to bind port f3c1c9eb-0af6-4531-a859-1d34d94e2118 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '0fcde28f-716d-48eb-a871-a5cce56962d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 307, 'network_id': 'ba62edfc-a421-4d9e-81b0-336d1f13df93'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:35:07.667425 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61d99e47-a7a5-4528-8d4c-9fef0ea32cee None None] Attempting to bind port f3c1c9eb-0af6-4531-a859-1d34d94e2118 on network ba62edfc-a421-4d9e-81b0-336d1f13df93 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:35:07.673415 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61d99e47-a7a5-4528-8d4c-9fef0ea32cee None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 34, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:35:07.673783 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61d99e47-a7a5-4528-8d4c-9fef0ea32cee None None] Checking segment: {'id': '0fcde28f-716d-48eb-a871-a5cce56962d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 307, 'network_id': 'ba62edfc-a421-4d9e-81b0-336d1f13df93'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:35:07.674181 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-61d99e47-a7a5-4528-8d4c-9fef0ea32cee None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:07.674597 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61d99e47-a7a5-4528-8d4c-9fef0ea32cee None None] Bound using segment: {'id': '0fcde28f-716d-48eb-a871-a5cce56962d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 307, 'network_id': 'ba62edfc-a421-4d9e-81b0-336d1f13df93'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:35:07.675068 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-61d99e47-a7a5-4528-8d4c-9fef0ea32cee None None] Bound port: f3c1c9eb-0af6-4531-a859-1d34d94e2118, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0fcde28f-716d-48eb-a871-a5cce56962d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 307, 'network_id': 'ba62edfc-a421-4d9e-81b0-336d1f13df93'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:35:07.675449 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-61d99e47-a7a5-4528-8d4c-9fef0ea32cee None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:07.687800 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c92741b8-6d1e-4f3a-8a25-fdbf1f980c18 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:07.714763 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6b557339-b371-47a5-a898-4aed6f9a1726 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:07.749210 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-61d99e47-a7a5-4528-8d4c-9fef0ea32cee None None] For port f3c1c9eb-0af6-4531-a859-1d34d94e2118, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:35:07.754318 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-61d99e47-a7a5-4528-8d4c-9fef0ea32cee None None] For port f3c1c9eb-0af6-4531-a859-1d34d94e2118, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=f3c1c9eb-0af6-4531-a859-1d34d94e2118,segment=NetworkSegment(0fcde28f-716d-48eb-a871-a5cce56962d8),segment_id=0fcde28f-716d-48eb-a871-a5cce56962d8)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:35:07.771427 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c92741b8-6d1e-4f3a-8a25-fdbf1f980c18 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:07.831895 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-61d99e47-a7a5-4528-8d4c-9fef0ea32cee None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:07.912604 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61d99e47-a7a5-4528-8d4c-9fef0ea32cee None None] Pushing event updated for resources: {'Port': ['ID=f3c1c9eb-0af6-4531-a859-1d34d94e2118,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:08.019528 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-6b557339-b371-47a5-a898-4aed6f9a1726 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Allocated IP 2001:db8::1 (ba62edfc-a421-4d9e-81b0-336d1f13df93/6c138018-b731-4582-94d4-e9fdf47a1e29/c5d1904b-06aa-4065-9225-927fc79eda00) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:35:08.199049 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6b557339-b371-47a5-a898-4aed6f9a1726 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:08.217313 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [req-50c8ae8b-0aa7-4557-b439-6ea90d82baf0 req-e4bcd954-99d7-4ed9-8a1a-bb2c2b24f648 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Allocated IP 172.20.0.27 (994f9071-b760-4d74-b91b-28777ec6b4e7/c1f5ce70-ebae-4e4d-9de5-04a34e845fdb/e2d06464-eb31-4d6f-b9a6-209564b03294) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:35:08.251374 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.l3_db [None req-c92741b8-6d1e-4f3a-8a25-fdbf1f980c18 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Floating IP c4ba145b-572c-418d-9126-f6a0921d8b3b associated. External IP: 172.26.0.64, port: 0641253a-a234-4a6d-8e89-7a72a04af2ac. Nov 09 04:35:08.353285 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6b557339-b371-47a5-a898-4aed6f9a1726 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:08.397145 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6b557339-b371-47a5-a898-4aed6f9a1726 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Network ba62edfc-a421-4d9e-81b0-336d1f13df93 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:35:08.403039 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-6b557339-b371-47a5-a898-4aed6f9a1726 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:35:08.406959 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6b557339-b371-47a5-a898-4aed6f9a1726 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:35:08.407509 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6b557339-b371-47a5-a898-4aed6f9a1726 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:08.482626 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b557339-b371-47a5-a898-4aed6f9a1726 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event updated for resources: {'Port': ['ID=c5d1904b-06aa-4065-9225-927fc79eda00,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:08.495155 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-50c8ae8b-0aa7-4557-b439-6ea90d82baf0 req-e4bcd954-99d7-4ed9-8a1a-bb2c2b24f648 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:08.588563 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c92741b8-6d1e-4f3a-8a25-fdbf1f980c18 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Router 8ac82b1e-1b89-49c2-850a-e69a6d1163e6 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:35:08.622395 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6b557339-b371-47a5-a898-4aed6f9a1726 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:08.672639 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-50c8ae8b-0aa7-4557-b439-6ea90d82baf0 req-e4bcd954-99d7-4ed9-8a1a-bb2c2b24f648 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:08.816565 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-50c8ae8b-0aa7-4557-b439-6ea90d82baf0 req-e4bcd954-99d7-4ed9-8a1a-bb2c2b24f648 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network 994f9071-b760-4d74-b91b-28777ec6b4e7 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:35:08.830192 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4bcd954-99d7-4ed9-8a1a-bb2c2b24f648 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Port': ['ID=e2d06464-eb31-4d6f-b9a6-209564b03294,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:08.835872 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [req-50c8ae8b-0aa7-4557-b439-6ea90d82baf0 req-e4bcd954-99d7-4ed9-8a1a-bb2c2b24f648 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:35:08.837724 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-50c8ae8b-0aa7-4557-b439-6ea90d82baf0 req-e4bcd954-99d7-4ed9-8a1a-bb2c2b24f648 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:35:08.844360 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c92741b8-6d1e-4f3a-8a25-fdbf1f980c18 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:35:08.856624 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5eb4459d-1655-4254-a117-ce7a48d66c4a None None] Sync routers for ids ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:35:08.877388 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5eb4459d-1655-4254-a117-ce7a48d66c4a None None] Routers {'8ac82b1e-1b89-49c2-850a-e69a6d1163e6'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:08.878019 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-5eb4459d-1655-4254-a117-ce7a48d66c4a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:34:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:08.922928 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-5eb4459d-1655-4254-a117-ce7a48d66c4a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:08.934279 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5eb4459d-1655-4254-a117-ce7a48d66c4a None None] Routers {'8ac82b1e-1b89-49c2-850a-e69a6d1163e6'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:08.935365 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-5eb4459d-1655-4254-a117-ce7a48d66c4a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:34:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:08.941428 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50c8ae8b-0aa7-4557-b439-6ea90d82baf0 req-e4bcd954-99d7-4ed9-8a1a-bb2c2b24f648 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:08.941671 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-50c8ae8b-0aa7-4557-b439-6ea90d82baf0 req-e4bcd954-99d7-4ed9-8a1a-bb2c2b24f648 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:08.961970 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb85bc96-ab62-4cc5-8025-32051ea38992 req-170b21ac-9f84-4bc5-8813-2034f99cdde6 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:08.963472 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-bb85bc96-ab62-4cc5-8025-32051ea38992 req-170b21ac-9f84-4bc5-8813-2034f99cdde6 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=f9a57fa6-0a62-475f-af77-8f608003b5e1 HTTP/1.1" status: 200 len: 932 time: 0.2479103 Nov 09 04:35:08.995446 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-5eb4459d-1655-4254-a117-ce7a48d66c4a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:08.996327 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5eb4459d-1655-4254-a117-ce7a48d66c4a None None] The sync data for ids ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:35:09.032302 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6b557339-b371-47a5-a898-4aed6f9a1726 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:09.106278 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6b557339-b371-47a5-a898-4aed6f9a1726 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:09.107345 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6b557339-b371-47a5-a898-4aed6f9a1726 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:09.173754 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-bb85bc96-ab62-4cc5-8025-32051ea38992 req-3d5b6502-3f69-471f-8e80-8c404b0237b3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=eb8d9d39-2315-42c2-bde9-38a01ea1afed&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1982400 Nov 09 04:35:09.197878 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-50c8ae8b-0aa7-4557-b439-6ea90d82baf0 req-e4bcd954-99d7-4ed9-8a1a-bb2c2b24f648 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.3972983 Nov 09 04:35:09.238619 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b557339-b371-47a5-a898-4aed6f9a1726 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event updated for resources: {'Port': ['ID=c5d1904b-06aa-4065-9225-927fc79eda00,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:09.239142 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-f5fcce9f-fd3b-4980-8adf-bd470c718759 None None] Provisioning complete for port e2d06464-eb31-4d6f-b9a6-209564b03294 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:09.239142 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f5fcce9f-fd3b-4980-8adf-bd470c718759 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:09.262032 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-50c8ae8b-0aa7-4557-b439-6ea90d82baf0 req-328239ff-455b-4330-8707-d8ade52497fe service neutron] Request body: {'port': {'device_id': 'f9a57fa6-0a62-475f-af77-8f608003b5e1', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:35:09.275012 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b718262a-ab7c-4cc1-95f3-28f65a5691fb None None] Network ba62edfc-a421-4d9e-81b0-336d1f13df93 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:35:09.287571 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6b557339-b371-47a5-a898-4aed6f9a1726 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Network ba62edfc-a421-4d9e-81b0-336d1f13df93 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:35:09.289197 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-6b557339-b371-47a5-a898-4aed6f9a1726 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:35:09.305394 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device f3c1c9eb-0af6-4531-a859-1d34d94e2118 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:35:09.329663 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-50c8ae8b-0aa7-4557-b439-6ea90d82baf0 req-328239ff-455b-4330-8707-d8ade52497fe service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:09.512689 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c92741b8-6d1e-4f3a-8a25-fdbf1f980c18 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Router 8ac82b1e-1b89-49c2-850a-e69a6d1163e6 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:35:09.532426 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-f5fcce9f-fd3b-4980-8adf-bd470c718759 None None] Port e2d06464-eb31-4d6f-b9a6-209564b03294 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:35:09.582498 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port f3c1c9eb-0af6-4531-a859-1d34d94e2118 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:09.583270 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:09.717385 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-6f7ce019-a273-4e38-b341-a862eaf3e928 None None] Provisioning complete for port f3c1c9eb-0af6-4531-a859-1d34d94e2118 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:09.717768 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6f7ce019-a273-4e38-b341-a862eaf3e928 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:09.793028 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:09.833671 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [req-50c8ae8b-0aa7-4557-b439-6ea90d82baf0 req-328239ff-455b-4330-8707-d8ade52497fe service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e2d06464-eb31-4d6f-b9a6-209564b03294 {{(pid=102162) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:35:09.842674 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c92741b8-6d1e-4f3a-8a25-fdbf1f980c18 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:35:09.843636 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port f3c1c9eb-0af6-4531-a859-1d34d94e2118, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=f3c1c9eb-0af6-4531-a859-1d34d94e2118,segment=NetworkSegment(0fcde28f-716d-48eb-a871-a5cce56962d8),segment_id=0fcde28f-716d-48eb-a871-a5cce56962d8)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:35:09.846131 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-50c8ae8b-0aa7-4557-b439-6ea90d82baf0 req-328239ff-455b-4330-8707-d8ade52497fe service neutron] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:09.851246 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c92741b8-6d1e-4f3a-8a25-fdbf1f980c18 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:09.858447 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a8805a2c-d558-48ea-8415-a317bfbbf25f None None] Sync routers for ids ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:35:09.878272 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a8805a2c-d558-48ea-8415-a317bfbbf25f None None] Routers {'8ac82b1e-1b89-49c2-850a-e69a6d1163e6'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:09.879176 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-a8805a2c-d558-48ea-8415-a317bfbbf25f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:34:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:09.892617 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6f7ce019-a273-4e38-b341-a862eaf3e928 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:09.895667 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.provisioning_blocks [req-50c8ae8b-0aa7-4557-b439-6ea90d82baf0 req-328239ff-455b-4330-8707-d8ade52497fe service neutron] Transition to ACTIVE for port object e2d06464-eb31-4d6f-b9a6-209564b03294 will not be triggered until provisioned by entity L2. {{(pid=102162) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 09 04:35:09.928918 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-a8805a2c-d558-48ea-8415-a317bfbbf25f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:09.945577 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-c92741b8-6d1e-4f3a-8a25-fdbf1f980c18 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] 10.222.0.24 "PUT /v2.0/floatingips/c4ba145b-572c-418d-9126-f6a0921d8b3b HTTP/1.1" status: 200 len: 977 time: 2.9357202 Nov 09 04:35:09.945802 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a8805a2c-d558-48ea-8415-a317bfbbf25f None None] Routers {'8ac82b1e-1b89-49c2-850a-e69a6d1163e6'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:09.945802 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-a8805a2c-d558-48ea-8415-a317bfbbf25f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:34:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:09.946005 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58666) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:09.948761 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:09.952319 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-7d868030-e064-497d-a60a-d746029b235b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Request body: {'floatingip': {'port_id': None}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:35:09.981147 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-50c8ae8b-0aa7-4557-b439-6ea90d82baf0 req-328239ff-455b-4330-8707-d8ade52497fe service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:09.991519 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6b557339-b371-47a5-a898-4aed6f9a1726 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Router 8dde0e4e-8b22-40d7-af9a-beffb259303b is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102161) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:35:10.056166 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-a8805a2c-d558-48ea-8415-a317bfbbf25f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:10.058803 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a8805a2c-d558-48ea-8415-a317bfbbf25f None None] The sync data for ids ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:35:10.094777 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.db.api [None req-6f7ce019-a273-4e38-b341-a862eaf3e928 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=102163) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:35:10.095138 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG oslo_db.api [None req-6f7ce019-a273-4e38-b341-a862eaf3e928 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:35:10.104227 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=f3c1c9eb-0af6-4531-a859-1d34d94e2118,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:10.115664 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7d868030-e064-497d-a60a-d746029b235b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for floatingip, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:10.166822 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-328239ff-455b-4330-8707-d8ade52497fe service neutron] Pushing event updated for resources: {'Port': ['ID=e2d06464-eb31-4d6f-b9a6-209564b03294,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:10.211858 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-50c8ae8b-0aa7-4557-b439-6ea90d82baf0 req-328239ff-455b-4330-8707-d8ade52497fe service neutron] Attempting to bind port e2d06464-eb31-4d6f-b9a6-209564b03294 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:35:10.213296 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-50c8ae8b-0aa7-4557-b439-6ea90d82baf0 req-328239ff-455b-4330-8707-d8ade52497fe service neutron] Attempting to bind port e2d06464-eb31-4d6f-b9a6-209564b03294 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '142b6494-b2b1-4cea-9b90-321c4a2a4cae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 339, 'network_id': '994f9071-b760-4d74-b91b-28777ec6b4e7'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:35:10.213992 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-50c8ae8b-0aa7-4557-b439-6ea90d82baf0 req-328239ff-455b-4330-8707-d8ade52497fe service neutron] Attempting to bind port e2d06464-eb31-4d6f-b9a6-209564b03294 on network 994f9071-b760-4d74-b91b-28777ec6b4e7 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:35:10.218951 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-50c8ae8b-0aa7-4557-b439-6ea90d82baf0 req-328239ff-455b-4330-8707-d8ade52497fe service neutron] Port e2d06464-eb31-4d6f-b9a6-209564b03294 on network 994f9071-b760-4d74-b91b-28777ec6b4e7 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:35:10.219395 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-50c8ae8b-0aa7-4557-b439-6ea90d82baf0 req-328239ff-455b-4330-8707-d8ade52497fe service neutron] Attempting to bind port e2d06464-eb31-4d6f-b9a6-209564b03294 on network 994f9071-b760-4d74-b91b-28777ec6b4e7 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:35:10.233262 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6b557339-b371-47a5-a898-4aed6f9a1726 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:35:10.239085 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-50c8ae8b-0aa7-4557-b439-6ea90d82baf0 req-328239ff-455b-4330-8707-d8ade52497fe service neutron] Checking agent: {'id': '7d36b884-4ad2-4878-9464-bf647030b544', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'started_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 34, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:35:10.239624 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-50c8ae8b-0aa7-4557-b439-6ea90d82baf0 req-328239ff-455b-4330-8707-d8ade52497fe service neutron] Checking segment: {'id': '142b6494-b2b1-4cea-9b90-321c4a2a4cae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 339, 'network_id': '994f9071-b760-4d74-b91b-28777ec6b4e7'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:35:10.240060 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-50c8ae8b-0aa7-4557-b439-6ea90d82baf0 req-328239ff-455b-4330-8707-d8ade52497fe service neutron] Bound using segment: {'id': '142b6494-b2b1-4cea-9b90-321c4a2a4cae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 339, 'network_id': '994f9071-b760-4d74-b91b-28777ec6b4e7'} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:35:10.240902 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-50c8ae8b-0aa7-4557-b439-6ea90d82baf0 req-328239ff-455b-4330-8707-d8ade52497fe service neutron] Bound port: e2d06464-eb31-4d6f-b9a6-209564b03294, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '142b6494-b2b1-4cea-9b90-321c4a2a4cae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 339, 'network_id': '994f9071-b760-4d74-b91b-28777ec6b4e7'}}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:35:10.241346 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-50c8ae8b-0aa7-4557-b439-6ea90d82baf0 req-328239ff-455b-4330-8707-d8ade52497fe service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:10.247161 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1cf8b3af-c25e-423b-ad29-df79d0e6a4d1 None None] Sync routers for ids ['8dde0e4e-8b22-40d7-af9a-beffb259303b'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:35:10.248915 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-6b557339-b371-47a5-a898-4aed6f9a1726 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "PUT /v2.0/routers/8dde0e4e-8b22-40d7-af9a-beffb259303b/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.8543735 Nov 09 04:35:10.254490 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58672) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:10.271692 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1cf8b3af-c25e-423b-ad29-df79d0e6a4d1 None None] Routers {'8dde0e4e-8b22-40d7-af9a-beffb259303b'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:10.272347 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-1cf8b3af-c25e-423b-ad29-df79d0e6a4d1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:34:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8dde0e4e-8b22-40d7-af9a-beffb259303b'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:10.321593 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-1cf8b3af-c25e-423b-ad29-df79d0e6a4d1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:10.333258 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1cf8b3af-c25e-423b-ad29-df79d0e6a4d1 None None] Routers {'8dde0e4e-8b22-40d7-af9a-beffb259303b'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:10.334152 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-1cf8b3af-c25e-423b-ad29-df79d0e6a4d1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:34:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8dde0e4e-8b22-40d7-af9a-beffb259303b'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:10.344480 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-50c8ae8b-0aa7-4557-b439-6ea90d82baf0 req-328239ff-455b-4330-8707-d8ade52497fe service neutron] For port e2d06464-eb31-4d6f-b9a6-209564b03294, host hv-neutron-8168, cleared binding levels {{(pid=102162) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:35:10.348584 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-50c8ae8b-0aa7-4557-b439-6ea90d82baf0 req-328239ff-455b-4330-8707-d8ade52497fe service neutron] For port e2d06464-eb31-4d6f-b9a6-209564b03294, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=e2d06464-eb31-4d6f-b9a6-209564b03294,segment=NetworkSegment(142b6494-b2b1-4cea-9b90-321c4a2a4cae),segment_id=142b6494-b2b1-4cea-9b90-321c4a2a4cae)] {{(pid=102162) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:35:10.386657 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-1cf8b3af-c25e-423b-ad29-df79d0e6a4d1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:10.387318 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1cf8b3af-c25e-423b-ad29-df79d0e6a4d1 None None] The sync data for ids ['8dde0e4e-8b22-40d7-af9a-beffb259303b'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:35:10.427442 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-50c8ae8b-0aa7-4557-b439-6ea90d82baf0 req-328239ff-455b-4330-8707-d8ade52497fe service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:10.473090 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7d868030-e064-497d-a60a-d746029b235b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:10.473205 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50c8ae8b-0aa7-4557-b439-6ea90d82baf0 req-328239ff-455b-4330-8707-d8ade52497fe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:10.473205 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-50c8ae8b-0aa7-4557-b439-6ea90d82baf0 req-328239ff-455b-4330-8707-d8ade52497fe service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:10.473751 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-50c8ae8b-0aa7-4557-b439-6ea90d82baf0 req-328239ff-455b-4330-8707-d8ade52497fe service neutron] 10.222.0.26 "PUT /v2.0/ports/e2d06464-eb31-4d6f-b9a6-209564b03294 HTTP/1.1" status: 200 len: 1094 time: 1.2175617 Nov 09 04:35:10.476450 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f9a57fa6-0a62-475f-af77-8f608003b5e1', 'tag': 'e2d06464-eb31-4d6f-b9a6-209564b03294'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:35:10.488186 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ccf9fd93-f6e1-483a-800d-e9e50d41222d" -d '{"events": [{"name": "network-changed", "server_uuid": "f9a57fa6-0a62-475f-af77-8f608003b5e1", "tag": "e2d06464-eb31-4d6f-b9a6-209564b03294"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:35:10.488434 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-60511b3f-1ab4-4dc1-9c6f-85e59c52f753 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:10.488434 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-60511b3f-1ab4-4dc1-9c6f-85e59c52f753 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "GET /v2.0/ports/c5d1904b-06aa-4065-9225-927fc79eda00 HTTP/1.1" status: 200 len: 911 time: 0.2307944 Nov 09 04:35:10.489573 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58676) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:10.546502 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-328239ff-455b-4330-8707-d8ade52497fe service neutron] Pushing event updated for resources: {'Port': ['ID=e2d06464-eb31-4d6f-b9a6-209564b03294,revision_number=3']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:10.562657 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:35:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-eceac250-cbcc-4744-afdd-7f48c6720f6c x-openstack-request-id: req-eceac250-cbcc-4744-afdd-7f48c6720f6c {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:35:10.563020 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f9a57fa6-0a62-475f-af77-8f608003b5e1", "tag": "e2d06464-eb31-4d6f-b9a6-209564b03294", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:35:10.563245 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-eceac250-cbcc-4744-afdd-7f48c6720f6c {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:35:10.563653 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f9a57fa6-0a62-475f-af77-8f608003b5e1', 'tag': 'e2d06464-eb31-4d6f-b9a6-209564b03294', 'status': 'completed', 'code': 200} Nov 09 04:35:10.575924 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7d868030-e064-497d-a60a-d746029b235b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:10.576508 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.l3_db [None req-7d868030-e064-497d-a60a-d746029b235b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Floating IP c4ba145b-572c-418d-9126-f6a0921d8b3b disassociated. External IP: 172.26.0.64, port: 57f5ba4c-bda3-4726-a6dd-7358e44971c0. Nov 09 04:35:10.587426 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4573bff-402a-45a5-842c-7ebb61030a8c req-98d4213b-211a-4731-92df-f4286be1ab27 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:10.589303 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c4573bff-402a-45a5-842c-7ebb61030a8c req-98d4213b-211a-4731-92df-f4286be1ab27 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=f9a57fa6-0a62-475f-af77-8f608003b5e1 HTTP/1.1" status: 200 len: 944 time: 0.2414844 Nov 09 04:35:10.638699 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccf9fd93-f6e1-483a-800d-e9e50d41222d req-6f8206e8-0154-42f7-8771-530a1491113b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:10.640459 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ccf9fd93-f6e1-483a-800d-e9e50d41222d req-6f8206e8-0154-42f7-8771-530a1491113b service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&device_id=f9a57fa6-0a62-475f-af77-8f608003b5e1 HTTP/1.1" status: 200 len: 1097 time: 0.0725899 Nov 09 04:35:10.803038 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-c81c713d-a691-4ab0-a824-887f1716bb55 None None] Provisioning complete for port c5d1904b-06aa-4065-9225-927fc79eda00 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:10.803702 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c81c713d-a691-4ab0-a824-887f1716bb55 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:10.874815 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-c81c713d-a691-4ab0-a824-887f1716bb55 None None] Port c5d1904b-06aa-4065-9225-927fc79eda00 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:35:10.902618 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccf9fd93-f6e1-483a-800d-e9e50d41222d req-22e28512-fcde-4676-bbe9-0c62e47057fd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:10.903215 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccf9fd93-f6e1-483a-800d-e9e50d41222d req-22e28512-fcde-4676-bbe9-0c62e47057fd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:10.906056 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ccf9fd93-f6e1-483a-800d-e9e50d41222d req-22e28512-fcde-4676-bbe9-0c62e47057fd service neutron] 10.222.0.26 "GET /v2.0/networks?tenant_id=1d10b4824e524068827e58b55e269af3&shared=False HTTP/1.1" status: 200 len: 1582 time: 0.2566142 Nov 09 04:35:10.925868 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-c81c713d-a691-4ab0-a824-887f1716bb55 None None] Provisioning complete for port f3c1c9eb-0af6-4531-a859-1d34d94e2118 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:10.926396 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c81c713d-a691-4ab0-a824-887f1716bb55 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:11.035006 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c4573bff-402a-45a5-842c-7ebb61030a8c req-6cb98828-d757-42f4-83fa-cc729e0a7a53 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=eb8d9d39-2315-42c2-bde9-38a01ea1afed&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3958547 Nov 09 04:35:11.118244 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccf9fd93-f6e1-483a-800d-e9e50d41222d req-02558035-34ff-45da-aaea-fa0beb0b36c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:11.119742 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ccf9fd93-f6e1-483a-800d-e9e50d41222d req-02558035-34ff-45da-aaea-fa0beb0b36c3 service neutron] 10.222.0.26 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2066803 Nov 09 04:35:11.141992 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7d868030-e064-497d-a60a-d746029b235b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Router 8ac82b1e-1b89-49c2-850a-e69a6d1163e6 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:35:11.175619 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-3f9d3129-f1e8-40a5-bbcb-1e578f901ddd None None] Provisioning complete for port c5d1904b-06aa-4065-9225-927fc79eda00 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:11.175998 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3f9d3129-f1e8-40a5-bbcb-1e578f901ddd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:11.211437 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device f3c1c9eb-0af6-4531-a859-1d34d94e2118 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:35:11.218978 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50c8ae8b-0aa7-4557-b439-6ea90d82baf0 req-3cd3e0b3-d0a6-47e6-af5d-388f9fe594ba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:11.224349 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-50c8ae8b-0aa7-4557-b439-6ea90d82baf0 req-3cd3e0b3-d0a6-47e6-af5d-388f9fe594ba service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&device_id=f9a57fa6-0a62-475f-af77-8f608003b5e1 HTTP/1.1" status: 200 len: 1097 time: 0.0597010 Nov 09 04:35:11.282679 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-3f9d3129-f1e8-40a5-bbcb-1e578f901ddd None None] Port c5d1904b-06aa-4065-9225-927fc79eda00 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:35:11.310429 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port f3c1c9eb-0af6-4531-a859-1d34d94e2118 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:11.311449 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:11.352281 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7d868030-e064-497d-a60a-d746029b235b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:35:11.360668 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7d868030-e064-497d-a60a-d746029b235b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:11.362782 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5e92b96a-72b2-44b7-b95e-ee85dd17f5cd None None] Sync routers for ids ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:35:11.380141 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5e92b96a-72b2-44b7-b95e-ee85dd17f5cd None None] Routers {'8ac82b1e-1b89-49c2-850a-e69a6d1163e6'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:11.380691 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-5e92b96a-72b2-44b7-b95e-ee85dd17f5cd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:34:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:11.396175 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-60db0900-2293-4e31-ae7c-089ceafd1aac tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:11.398953 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-7d868030-e064-497d-a60a-d746029b235b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] 10.222.0.24 "PUT /v2.0/floatingips/c4ba145b-572c-418d-9126-f6a0921d8b3b HTTP/1.1" status: 200 len: 687 time: 1.4520228 Nov 09 04:35:11.399094 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b2c4988f-84e1-4400-a69a-076ccdd6f48b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:11.434464 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58680) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:11.438350 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-5e92b96a-72b2-44b7-b95e-ee85dd17f5cd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:11.448680 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5e92b96a-72b2-44b7-b95e-ee85dd17f5cd None None] Routers {'8ac82b1e-1b89-49c2-850a-e69a6d1163e6'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:11.452237 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-5e92b96a-72b2-44b7-b95e-ee85dd17f5cd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:34:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:11.492218 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-5e92b96a-72b2-44b7-b95e-ee85dd17f5cd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:11.493388 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5e92b96a-72b2-44b7-b95e-ee85dd17f5cd None None] The sync data for ids ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:35:11.669307 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-50c8ae8b-0aa7-4557-b439-6ea90d82baf0 req-f16b3fef-024c-4b0d-a982-efb973f5622a service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.27&port_id=e2d06464-eb31-4d6f-b9a6-209564b03294 HTTP/1.1" status: 200 len: 217 time: 0.4368415 Nov 09 04:35:11.688737 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-5fd5b389-c372-4598-8126-05587c9cf489 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Deleting port 97a94da4-bebb-4a7e-b40b-d81e3e6c6217 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:35:11.689383 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5fd5b389-c372-4598-8126-05587c9cf489 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:11.726307 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50c8ae8b-0aa7-4557-b439-6ea90d82baf0 req-5444625d-b5ed-4c8c-9368-a3594ecd23d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:11.727860 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-50c8ae8b-0aa7-4557-b439-6ea90d82baf0 req-5444625d-b5ed-4c8c-9368-a3594ecd23d5 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=c1f5ce70-ebae-4e4d-9de5-04a34e845fdb HTTP/1.1" status: 200 len: 838 time: 0.0516982 Nov 09 04:35:11.778949 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50c8ae8b-0aa7-4557-b439-6ea90d82baf0 req-10733e4d-4d12-4537-a65c-37d3badbb5e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:11.781019 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-50c8ae8b-0aa7-4557-b439-6ea90d82baf0 req-10733e4d-4d12-4537-a65c-37d3badbb5e1 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=994f9071-b760-4d74-b91b-28777ec6b4e7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.0466328 Nov 09 04:35:11.823928 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5fd5b389-c372-4598-8126-05587c9cf489 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:11.824250 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5fd5b389-c372-4598-8126-05587c9cf489 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:11.839038 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-5fd5b389-c372-4598-8126-05587c9cf489 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Calling delete_port for 97a94da4-bebb-4a7e-b40b-d81e3e6c6217 owned by network:floatingip {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:35:11.887324 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-50c8ae8b-0aa7-4557-b439-6ea90d82baf0 req-a80445d5-da37-44ff-a955-c2c60229999c service neutron] 10.222.0.26 "GET /v2.0/networks/994f9071-b760-4d74-b91b-28777ec6b4e7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0978742 Nov 09 04:35:11.915113 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-60db0900-2293-4e31-ae7c-089ceafd1aac tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Deleting port c5d1904b-06aa-4065-9225-927fc79eda00 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:35:11.915456 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-60db0900-2293-4e31-ae7c-089ceafd1aac tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:11.987323 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-50c8ae8b-0aa7-4557-b439-6ea90d82baf0 req-1b371414-ca58-4e20-8978-df933e742e58 service neutron] 10.222.0.26 "GET /v2.0/networks/994f9071-b760-4d74-b91b-28777ec6b4e7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0919497 Nov 09 04:35:12.022721 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-60db0900-2293-4e31-ae7c-089ceafd1aac tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:12.061778 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-60db0900-2293-4e31-ae7c-089ceafd1aac tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Calling delete_port for c5d1904b-06aa-4065-9225-927fc79eda00 owned by network:router_interface {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:35:12.095272 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:12.188044 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34522807-0c77-41eb-bacd-7f673ebb4440 req-b60f5ef6-fbea-4371-83e3-a7e6582b425e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:12.190117 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-34522807-0c77-41eb-bacd-7f673ebb4440 req-b60f5ef6-fbea-4371-83e3-a7e6582b425e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=f9a57fa6-0a62-475f-af77-8f608003b5e1 HTTP/1.1" status: 200 len: 944 time: 0.0724633 Nov 09 04:35:12.252920 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-34522807-0c77-41eb-bacd-7f673ebb4440 req-946e55c5-3c95-438b-8bcb-9623c1812633 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=eb8d9d39-2315-42c2-bde9-38a01ea1afed&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0547848 Nov 09 04:35:12.255408 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5fd5b389-c372-4598-8126-05587c9cf489 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:12.294016 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fd5b389-c372-4598-8126-05587c9cf489 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Pushing event deleted for resources: {'Port': ['ID=97a94da4-bebb-4a7e-b40b-d81e3e6c6217,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:12.365131 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5fd5b389-c372-4598-8126-05587c9cf489 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for floatingip, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:12.367908 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5fd5b389-c372-4598-8126-05587c9cf489 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:12.370396 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-5fd5b389-c372-4598-8126-05587c9cf489 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] 10.222.0.24 "DELETE /v2.0/floatingips/c4ba145b-572c-418d-9126-f6a0921d8b3b HTTP/1.1" status: 204 len: 168 time: 0.9336982 Nov 09 04:35:12.371882 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58686) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:12.417125 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-ded09d16-9323-4181-bd82-17cc8b531c6e tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] delete failed (client error): The resource could not be found. Nov 09 04:35:12.418316 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-ded09d16-9323-4181-bd82-17cc8b531c6e tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] 10.222.0.24 "DELETE /v2.0/floatingips/c4ba145b-572c-418d-9126-f6a0921d8b3b HTTP/1.1" status: 404 len: 345 time: 0.0454519 Nov 09 04:35:12.422791 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58688) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:12.514742 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-36e38058-5904-4240-9488-bcdf461e2eb7 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:12.522102 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-36e38058-5904-4240-9488-bcdf461e2eb7 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:12.528094 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-36e38058-5904-4240-9488-bcdf461e2eb7 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:12.532408 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-36e38058-5904-4240-9488-bcdf461e2eb7 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] 10.222.0.24 "GET /v2.0/ports?network_id=7b6ec8a7-3152-4a6b-88b2-1b5105cc3943 HTTP/1.1" status: 200 len: 2357 time: 0.1061394 Nov 09 04:35:12.532640 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58690) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:12.595285 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-13ee8070-a83a-4ff2-b46c-cef08dc2c2e3 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:12.597176 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-13ee8070-a83a-4ff2-b46c-cef08dc2c2e3 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] 10.222.0.24 "GET /v2.0/subnets/55684bb6-5188-4ce7-a4cb-155a73eeeeeb HTTP/1.1" status: 200 len: 797 time: 0.0635312 Nov 09 04:35:12.601811 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58692) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:12.606816 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-28bbdf4d-9c07-4ccd-bb3b-92b500140555 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Request body: {'port': {'network_id': '7b6ec8a7-3152-4a6b-88b2-1b5105cc3943', 'name': 'tempest-FloatingIPTestJSON-1401563262', 'fixed_ips': [{'ip_address': '172.20.0.13'}, {'ip_address': '172.20.0.12'}]}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:35:13.064750 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-60db0900-2293-4e31-ae7c-089ceafd1aac tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:13.092925 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60db0900-2293-4e31-ae7c-089ceafd1aac tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event deleted for resources: {'Port': ['ID=c5d1904b-06aa-4065-9225-927fc79eda00,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:13.128099 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-28bbdf4d-9c07-4ccd-bb3b-92b500140555 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Made reservation on behalf of 459651e5af964f8c805d518a6dc3b464 for: {'port': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:35:13.242121 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-60db0900-2293-4e31-ae7c-089ceafd1aac tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:13.694801 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-157fab46-ee32-410f-9807-3975376bea9f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:13.711065 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-28bbdf4d-9c07-4ccd-bb3b-92b500140555 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:13.795393 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [None req-28bbdf4d-9c07-4ccd-bb3b-92b500140555 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] device_id is not set on port 693e1e58-7710-45a7-b884-6c6cbd4bb88f yet. {{(pid=102161) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:35:13.813201 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba0985b7-2338-49d8-872a-1021f0bf7180 req-194df994-4ddb-4cd5-8c59-fa0bd8d20ae4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:13.814741 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ba0985b7-2338-49d8-872a-1021f0bf7180 req-194df994-4ddb-4cd5-8c59-fa0bd8d20ae4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=f9a57fa6-0a62-475f-af77-8f608003b5e1 HTTP/1.1" status: 200 len: 944 time: 0.1497476 Nov 09 04:35:13.868050 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-60db0900-2293-4e31-ae7c-089ceafd1aac tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Router 8dde0e4e-8b22-40d7-af9a-beffb259303b has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:35:14.023041 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ba0985b7-2338-49d8-872a-1021f0bf7180 req-3a06c2d4-3da2-4a20-9412-8dc88e6de7b7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=eb8d9d39-2315-42c2-bde9-38a01ea1afed&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1886632 Nov 09 04:35:14.065158 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-60db0900-2293-4e31-ae7c-089ceafd1aac tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:35:14.071594 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-60db0900-2293-4e31-ae7c-089ceafd1aac tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "PUT /v2.0/routers/8dde0e4e-8b22-40d7-af9a-beffb259303b/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.5809774 Nov 09 04:35:14.074369 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58706) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:14.077844 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dbd6b219-1292-49cb-b63a-6096b1e53950 None None] Sync routers for ids ['8dde0e4e-8b22-40d7-af9a-beffb259303b'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:35:14.088072 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dbd6b219-1292-49cb-b63a-6096b1e53950 None None] Routers {'8dde0e4e-8b22-40d7-af9a-beffb259303b'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:14.088676 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-dbd6b219-1292-49cb-b63a-6096b1e53950 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8dde0e4e-8b22-40d7-af9a-beffb259303b'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:14.121266 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-dbd6b219-1292-49cb-b63a-6096b1e53950 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:14.125569 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-74fa5a34-147b-42c5-a316-b233817a7bfb tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "GET /v2.0/ports?device_id=8dde0e4e-8b22-40d7-af9a-beffb259303b HTTP/1.1" status: 200 len: 205 time: 0.0500717 Nov 09 04:35:14.128277 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58708) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:14.134253 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dbd6b219-1292-49cb-b63a-6096b1e53950 None None] Routers {'8dde0e4e-8b22-40d7-af9a-beffb259303b'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:14.134905 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-dbd6b219-1292-49cb-b63a-6096b1e53950 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8dde0e4e-8b22-40d7-af9a-beffb259303b'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:14.170680 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-dbd6b219-1292-49cb-b63a-6096b1e53950 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:14.171346 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dbd6b219-1292-49cb-b63a-6096b1e53950 None None] The sync data for ids ['8dde0e4e-8b22-40d7-af9a-beffb259303b'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:35:14.204848 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d0776d40-456a-4777-bb3f-49c7901ddcfc tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for router, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:14.253915 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-28bbdf4d-9c07-4ccd-bb3b-92b500140555 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Allocated IP 172.20.0.13 (7b6ec8a7-3152-4a6b-88b2-1b5105cc3943/55684bb6-5188-4ce7-a4cb-155a73eeeeeb/693e1e58-7710-45a7-b884-6c6cbd4bb88f) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:35:14.260951 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-28bbdf4d-9c07-4ccd-bb3b-92b500140555 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Allocated IP 172.20.0.12 (7b6ec8a7-3152-4a6b-88b2-1b5105cc3943/55684bb6-5188-4ce7-a4cb-155a73eeeeeb/693e1e58-7710-45a7-b884-6c6cbd4bb88f) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:35:14.385219 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d0776d40-456a-4777-bb3f-49c7901ddcfc tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:14.387467 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d0776d40-456a-4777-bb3f-49c7901ddcfc tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:14.420855 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-28bbdf4d-9c07-4ccd-bb3b-92b500140555 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:14.448666 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device e2d06464-eb31-4d6f-b9a6-209564b03294 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=102163) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 09 04:35:14.524327 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d0776d40-456a-4777-bb3f-49c7901ddcfc tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:14.524847 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d0776d40-456a-4777-bb3f-49c7901ddcfc tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Fanout notify agent at l3_agent the message router_deleted on router 8dde0e4e-8b22-40d7-af9a-beffb259303b {{(pid=102162) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:35:14.536443 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d0776d40-456a-4777-bb3f-49c7901ddcfc tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:14.537394 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58720) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:14.537752 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-d0776d40-456a-4777-bb3f-49c7901ddcfc tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "DELETE /v2.0/routers/8dde0e4e-8b22-40d7-af9a-beffb259303b HTTP/1.1" status: 204 len: 168 time: 0.4084275 Nov 09 04:35:14.584119 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port e2d06464-eb31-4d6f-b9a6-209564b03294, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=e2d06464-eb31-4d6f-b9a6-209564b03294,segment=NetworkSegment(142b6494-b2b1-4cea-9b90-321c4a2a4cae),segment_id=142b6494-b2b1-4cea-9b90-321c4a2a4cae)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:35:14.587893 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-28bbdf4d-9c07-4ccd-bb3b-92b500140555 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:14.598673 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Returning: {'device': 'e2d06464-eb31-4d6f-b9a6-209564b03294', 'network_id': '994f9071-b760-4d74-b91b-28777ec6b4e7', 'port_id': 'e2d06464-eb31-4d6f-b9a6-209564b03294', 'mac_address': 'fa:16:3e:cc:15:d3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 339, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c1f5ce70-ebae-4e4d-9de5-04a34e845fdb', 'ip_address': '172.20.0.27'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102163) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 09 04:35:14.627295 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-859c4ba6-3b51-4bb2-a49b-b0523d0c75f7 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Deleting subnet 6c138018-b731-4582-94d4-e9fdf47a1e29 {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:35:14.635666 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-859c4ba6-3b51-4bb2-a49b-b0523d0c75f7 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:14.644407 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:14.659311 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e2d06464-eb31-4d6f-b9a6-209564b03294 {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:35:14.679685 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-28bbdf4d-9c07-4ccd-bb3b-92b500140555 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Network 7b6ec8a7-3152-4a6b-88b2-1b5105cc3943 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:35:14.680606 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port e2d06464-eb31-4d6f-b9a6-209564b03294, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=e2d06464-eb31-4d6f-b9a6-209564b03294,segment=NetworkSegment(142b6494-b2b1-4cea-9b90-321c4a2a4cae),segment_id=142b6494-b2b1-4cea-9b90-321c4a2a4cae)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:35:14.683048 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28bbdf4d-9c07-4ccd-bb3b-92b500140555 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Pushing event updated for resources: {'Port': ['ID=693e1e58-7710-45a7-b884-6c6cbd4bb88f,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:14.690941 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-28bbdf4d-9c07-4ccd-bb3b-92b500140555 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:35:14.693436 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-28bbdf4d-9c07-4ccd-bb3b-92b500140555 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:35:14.725843 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-859c4ba6-3b51-4bb2-a49b-b0523d0c75f7 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:14.746705 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:14.787919 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-28bbdf4d-9c07-4ccd-bb3b-92b500140555 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:14.788531 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-28bbdf4d-9c07-4ccd-bb3b-92b500140555 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:14.803140 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=e2d06464-eb31-4d6f-b9a6-209564b03294,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:14.842763 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-859c4ba6-3b51-4bb2-a49b-b0523d0c75f7 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:14.878926 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-28bbdf4d-9c07-4ccd-bb3b-92b500140555 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1010 time: 2.2757764 Nov 09 04:35:14.881728 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58722) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:14.903305 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-11e90d5e-724b-498c-ba5f-1fb9ee3f7e2f tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Request body: {'floatingip': {'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'port_id': '693e1e58-7710-45a7-b884-6c6cbd4bb88f', 'fixed_ip_address': '172.20.0.13'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:35:14.967014 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['e2d06464-eb31-4d6f-b9a6-209564b03294'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 04:35:15.008037 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-859c4ba6-3b51-4bb2-a49b-b0523d0c75f7 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:15.049002 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-11e90d5e-724b-498c-ba5f-1fb9ee3f7e2f tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for floatingip, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:15.056069 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-859c4ba6-3b51-4bb2-a49b-b0523d0c75f7 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event deleted for resources: {'Subnet': ['ID=6c138018-b731-4582-94d4-e9fdf47a1e29,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:15.062621 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-859c4ba6-3b51-4bb2-a49b-b0523d0c75f7 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:15.066266 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-859c4ba6-3b51-4bb2-a49b-b0523d0c75f7 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "DELETE /v2.0/subnets/6c138018-b731-4582-94d4-e9fdf47a1e29 HTTP/1.1" status: 204 len: 168 time: 0.5248027 Nov 09 04:35:15.066548 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58726) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:15.094427 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-365d3442-5fcd-47e4-91a2-b7ed6ef55d1a None None] Network ba62edfc-a421-4d9e-81b0-336d1f13df93 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:35:15.169253 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-96742808-486a-4360-b0ec-a6d990c95447 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:15.176332 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:15.242231 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-96742808-486a-4360-b0ec-a6d990c95447 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Deleting port f3c1c9eb-0af6-4531-a859-1d34d94e2118 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:35:15.242817 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-96742808-486a-4360-b0ec-a6d990c95447 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:15.274242 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6216cd30-4c42-42e8-a28c-9d5934a51d8c req-093392d3-33ff-4631-8b14-d0577076c575 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:15.282837 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6216cd30-4c42-42e8-a28c-9d5934a51d8c req-093392d3-33ff-4631-8b14-d0577076c575 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=f9a57fa6-0a62-475f-af77-8f608003b5e1 HTTP/1.1" status: 200 len: 945 time: 0.1267452 Nov 09 04:35:15.340663 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-96742808-486a-4360-b0ec-a6d990c95447 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] For port f3c1c9eb-0af6-4531-a859-1d34d94e2118, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=f3c1c9eb-0af6-4531-a859-1d34d94e2118,segment=NetworkSegment(0fcde28f-716d-48eb-a871-a5cce56962d8),segment_id=0fcde28f-716d-48eb-a871-a5cce56962d8)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:35:15.341415 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-96742808-486a-4360-b0ec-a6d990c95447 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:15.378516 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6216cd30-4c42-42e8-a28c-9d5934a51d8c req-5c5700d3-9212-436f-b4e5-abd73c0919a3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=eb8d9d39-2315-42c2-bde9-38a01ea1afed&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0830944 Nov 09 04:35:15.383533 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-96742808-486a-4360-b0ec-a6d990c95447 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Calling delete_port for f3c1c9eb-0af6-4531-a859-1d34d94e2118 owned by network:dhcp {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:35:15.386260 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-11e90d5e-724b-498c-ba5f-1fb9ee3f7e2f tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:15.398450 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-71b82547-f4d4-4fcf-8025-7272441b2ba7 None None] DHCP port deletion for ba62edfc-a421-4d9e-81b0-336d1f13df93 request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:35:15.458414 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-71b82547-f4d4-4fcf-8025-7272441b2ba7 None None] Deleting port f3c1c9eb-0af6-4531-a859-1d34d94e2118 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:35:15.458799 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-71b82547-f4d4-4fcf-8025-7272441b2ba7 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:15.507237 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-11e90d5e-724b-498c-ba5f-1fb9ee3f7e2f tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Allocated IP 172.26.0.187 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/af43d489-3eac-4a5f-8095-255d2ef24a6d) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:35:15.557630 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-71b82547-f4d4-4fcf-8025-7272441b2ba7 None None] For port f3c1c9eb-0af6-4531-a859-1d34d94e2118, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=f3c1c9eb-0af6-4531-a859-1d34d94e2118,segment=NetworkSegment(0fcde28f-716d-48eb-a871-a5cce56962d8),segment_id=0fcde28f-716d-48eb-a871-a5cce56962d8)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:35:15.558032 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-71b82547-f4d4-4fcf-8025-7272441b2ba7 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:15.569965 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-96742808-486a-4360-b0ec-a6d990c95447 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:15.573420 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-71b82547-f4d4-4fcf-8025-7272441b2ba7 None None] Calling delete_port for f3c1c9eb-0af6-4531-a859-1d34d94e2118 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:35:15.606065 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96742808-486a-4360-b0ec-a6d990c95447 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event deleted for resources: {'Port': ['ID=f3c1c9eb-0af6-4531-a859-1d34d94e2118,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:15.611677 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-96742808-486a-4360-b0ec-a6d990c95447 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] No DVR routers for this DVR port f3c1c9eb-0af6-4531-a859-1d34d94e2118 on host dv-neutron-816802-2-hyperv {{(pid=102161) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:35:15.638730 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-11e90d5e-724b-498c-ba5f-1fb9ee3f7e2f tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:15.648976 dv-neutron-816802-2-hyperv neutron-server[102163]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 09 04:35:15.648976 dv-neutron-816802-2-hyperv neutron-server[102163]: from cryptography.utils import int_from_bytes Nov 09 04:35:15.648976 dv-neutron-816802-2-hyperv neutron-server[102163]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 09 04:35:15.648976 dv-neutron-816802-2-hyperv neutron-server[102163]: from cryptography.utils import int_from_bytes Nov 09 04:35:15.648976 dv-neutron-816802-2-hyperv neutron-server[102163]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:35:15.648976 dv-neutron-816802-2-hyperv neutron-server[102163]: self.session.flush() Nov 09 04:35:15.648976 dv-neutron-816802-2-hyperv neutron-server[102163]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:35:15.648976 dv-neutron-816802-2-hyperv neutron-server[102163]: self.session.flush() Nov 09 04:35:15.648976 dv-neutron-816802-2-hyperv neutron-server[102163]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:35:15.648976 dv-neutron-816802-2-hyperv neutron-server[102163]: self.session.flush() Nov 09 04:35:15.648976 dv-neutron-816802-2-hyperv neutron-server[102163]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:35:15.648976 dv-neutron-816802-2-hyperv neutron-server[102163]: self.session.flush() Nov 09 04:35:15.648976 dv-neutron-816802-2-hyperv neutron-server[102163]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:35:15.648976 dv-neutron-816802-2-hyperv neutron-server[102163]: self.session.flush() Nov 09 04:35:15.648976 dv-neutron-816802-2-hyperv neutron-server[102163]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:35:15.648976 dv-neutron-816802-2-hyperv neutron-server[102163]: self.session.flush() Nov 09 04:35:15.648976 dv-neutron-816802-2-hyperv neutron-server[102163]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:35:15.648976 dv-neutron-816802-2-hyperv neutron-server[102163]: self.session.flush() Nov 09 04:35:15.648976 dv-neutron-816802-2-hyperv neutron-server[102163]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:35:15.648976 dv-neutron-816802-2-hyperv neutron-server[102163]: self.session.flush() Nov 09 04:35:15.648976 dv-neutron-816802-2-hyperv neutron-server[102163]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:35:15.648976 dv-neutron-816802-2-hyperv neutron-server[102163]: self.session.flush() Nov 09 04:35:15.648976 dv-neutron-816802-2-hyperv neutron-server[102163]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:35:15.648976 dv-neutron-816802-2-hyperv neutron-server[102163]: self.session.flush() Nov 09 04:35:15.648976 dv-neutron-816802-2-hyperv neutron-server[102163]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:35:15.648976 dv-neutron-816802-2-hyperv neutron-server[102163]: self.session.flush() Nov 09 04:35:15.648976 dv-neutron-816802-2-hyperv neutron-server[102163]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:35:15.648976 dv-neutron-816802-2-hyperv neutron-server[102163]: self.session.flush() Nov 09 04:35:15.648976 dv-neutron-816802-2-hyperv neutron-server[102163]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:35:15.648976 dv-neutron-816802-2-hyperv neutron-server[102163]: self.session.flush() Nov 09 04:35:15.648976 dv-neutron-816802-2-hyperv neutron-server[102163]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:35:15.648976 dv-neutron-816802-2-hyperv neutron-server[102163]: self.session.flush() Nov 09 04:35:15.648976 dv-neutron-816802-2-hyperv neutron-server[102163]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:35:15.648976 dv-neutron-816802-2-hyperv neutron-server[102163]: self.session.flush() Nov 09 04:35:15.648976 dv-neutron-816802-2-hyperv neutron-server[102163]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:35:15.648976 dv-neutron-816802-2-hyperv neutron-server[102163]: self.session.flush() Nov 09 04:35:15.648976 dv-neutron-816802-2-hyperv neutron-server[102163]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:35:15.648976 dv-neutron-816802-2-hyperv neutron-server[102163]: self.session.flush() Nov 09 04:35:15.648976 dv-neutron-816802-2-hyperv neutron-server[102163]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:35:15.648976 dv-neutron-816802-2-hyperv neutron-server[102163]: self.session.flush() Nov 09 04:35:15.648976 dv-neutron-816802-2-hyperv neutron-server[102163]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:35:15.648976 dv-neutron-816802-2-hyperv neutron-server[102163]: self.session.flush() Nov 09 04:35:15.648976 dv-neutron-816802-2-hyperv neutron-server[102163]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:35:15.648976 dv-neutron-816802-2-hyperv neutron-server[102163]: self.session.flush() Nov 09 04:35:15.648976 dv-neutron-816802-2-hyperv neutron-server[102163]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:35:15.648976 dv-neutron-816802-2-hyperv neutron-server[102163]: self.session.flush() Nov 09 04:35:15.648976 dv-neutron-816802-2-hyperv neutron-server[102163]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:35:15.648976 dv-neutron-816802-2-hyperv neutron-server[102163]: self.session.flush() Nov 09 04:35:15.648976 dv-neutron-816802-2-hyperv neutron-server[102163]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:35:15.648976 dv-neutron-816802-2-hyperv neutron-server[102163]: self.session.flush() Nov 09 04:35:15.648976 dv-neutron-816802-2-hyperv neutron-server[102163]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:35:15.648976 dv-neutron-816802-2-hyperv neutron-server[102163]: self.session.flush() Nov 09 04:35:15.648976 dv-neutron-816802-2-hyperv neutron-server[102163]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:35:15.648976 dv-neutron-816802-2-hyperv neutron-server[102163]: self.session.flush() Nov 09 04:35:15.648976 dv-neutron-816802-2-hyperv neutron-server[102163]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:35:15.648976 dv-neutron-816802-2-hyperv neutron-server[102163]: self.session.flush() Nov 09 04:35:15.655056 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-71b82547-f4d4-4fcf-8025-7272441b2ba7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:15.685690 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71b82547-f4d4-4fcf-8025-7272441b2ba7 None None] Pushing event deleted for resources: {'Port': ['ID=f3c1c9eb-0af6-4531-a859-1d34d94e2118,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:15.688457 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-71b82547-f4d4-4fcf-8025-7272441b2ba7 None None] No DVR routers for this DVR port f3c1c9eb-0af6-4531-a859-1d34d94e2118 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:35:15.709216 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-96742808-486a-4360-b0ec-a6d990c95447 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:15.729984 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-96742808-486a-4360-b0ec-a6d990c95447 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ba62edfc-a421-4d9e-81b0-336d1f13df93']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:15.735109 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-11e90d5e-724b-498c-ba5f-1fb9ee3f7e2f tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:15.740138 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-96742808-486a-4360-b0ec-a6d990c95447 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '0fcde28f-716d-48eb-a871-a5cce56962d8') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:15.740441 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-96742808-486a-4360-b0ec-a6d990c95447 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '0fcde28f-716d-48eb-a871-a5cce56962d8') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:15.749912 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-96742808-486a-4360-b0ec-a6d990c95447 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:15.763248 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-96742808-486a-4360-b0ec-a6d990c95447 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:15.769422 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-96742808-486a-4360-b0ec-a6d990c95447 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Releasing vlan 307 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:35:15.769828 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-96742808-486a-4360-b0ec-a6d990c95447 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:15.770386 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-11e90d5e-724b-498c-ba5f-1fb9ee3f7e2f tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:35:15.773169 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-11e90d5e-724b-498c-ba5f-1fb9ee3f7e2f tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:35:15.773313 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:35:15.773313 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:35:15.773313 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:35:15.773313 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:35:15.773313 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:35:15.773313 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:35:15.773313 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:35:15.773313 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:35:15.773313 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:35:15.773313 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:35:15.773313 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:35:15.773313 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:35:15.773313 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:35:15.773313 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:35:15.773313 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:35:15.773313 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:35:15.773313 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:35:15.773313 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:35:15.773313 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:35:15.773313 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:35:15.773313 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:35:15.773313 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:35:15.773313 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:35:15.773313 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:35:15.773313 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:35:15.773313 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:35:15.773313 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:35:15.773313 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:35:15.773313 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:35:15.773313 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:35:15.773313 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:35:15.773313 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:35:15.778833 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-11e90d5e-724b-498c-ba5f-1fb9ee3f7e2f tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:35:15.803133 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11e90d5e-724b-498c-ba5f-1fb9ee3f7e2f tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Pushing event updated for resources: {'Port': ['ID=af43d489-3eac-4a5f-8095-255d2ef24a6d,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:15.939845 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-96742808-486a-4360-b0ec-a6d990c95447 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:15.952421 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-96742808-486a-4360-b0ec-a6d990c95447 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:15.955709 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-96742808-486a-4360-b0ec-a6d990c95447 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "DELETE /v2.0/networks/ba62edfc-a421-4d9e-81b0-336d1f13df93 HTTP/1.1" status: 204 len: 168 time: 0.8880074 Nov 09 04:35:15.964901 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58730) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:15.970066 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-1de40be5-ac1d-48bd-92b3-faadb65dfa8f tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-1117295850', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}, 'admin_state_up': False}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:35:15.975889 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96742808-486a-4360-b0ec-a6d990c95447 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event deleted for resources: {'Network': ['ID=ba62edfc-a421-4d9e-81b0-336d1f13df93,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:16.081735 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1de40be5-ac1d-48bd-92b3-faadb65dfa8f tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:16.082939 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1de40be5-ac1d-48bd-92b3-faadb65dfa8f tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:16.135848 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1de40be5-ac1d-48bd-92b3-faadb65dfa8f tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:16.155866 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-11e90d5e-724b-498c-ba5f-1fb9ee3f7e2f tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:16.274395 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-11e90d5e-724b-498c-ba5f-1fb9ee3f7e2f tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:16.364547 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1de40be5-ac1d-48bd-92b3-faadb65dfa8f tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:16.442391 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-11e90d5e-724b-498c-ba5f-1fb9ee3f7e2f tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:16.444907 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:16.455120 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device e2d06464-eb31-4d6f-b9a6-209564b03294 up at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:35:16.483315 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-432590ad-d1b2-4110-a4c3-d55d9eecdf95 req-81d11151-e1c9-4b22-950e-c5af53e8109c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:16.487868 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-432590ad-d1b2-4110-a4c3-d55d9eecdf95 req-81d11151-e1c9-4b22-950e-c5af53e8109c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=f9a57fa6-0a62-475f-af77-8f608003b5e1 HTTP/1.1" status: 200 len: 945 time: 0.0529206 Nov 09 04:35:16.507506 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-11e90d5e-724b-498c-ba5f-1fb9ee3f7e2f tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:16.563560 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning for port e2d06464-eb31-4d6f-b9a6-209564b03294 completed by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 09 04:35:16.570199 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning complete for port e2d06464-eb31-4d6f-b9a6-209564b03294 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:16.570755 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:16.588896 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11e90d5e-724b-498c-ba5f-1fb9ee3f7e2f tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Pushing event updated for resources: {'Port': ['ID=af43d489-3eac-4a5f-8095-255d2ef24a6d,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:16.596242 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-432590ad-d1b2-4110-a4c3-d55d9eecdf95 req-92c47ceb-694d-434b-90c7-923054279596 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=eb8d9d39-2315-42c2-bde9-38a01ea1afed&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0940197 Nov 09 04:35:16.601876 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-11e90d5e-724b-498c-ba5f-1fb9ee3f7e2f tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:16.704522 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:16.727351 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.l3_db [None req-11e90d5e-724b-498c-ba5f-1fb9ee3f7e2f tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Floating IP 518f2e54-ba22-40fd-b58f-3cc03db16b10 associated. External IP: 172.26.0.187, port: 693e1e58-7710-45a7-b884-6c6cbd4bb88f. Nov 09 04:35:16.732182 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f9a57fa6-0a62-475f-af77-8f608003b5e1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e2d06464-eb31-4d6f-b9a6-209564b03294'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:35:16.734556 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0361da43-22ba-4f18-b493-2a5dcd2a899e" -d '{"events": [{"server_uuid": "f9a57fa6-0a62-475f-af77-8f608003b5e1", "name": "network-vif-plugged", "status": "completed", "tag": "e2d06464-eb31-4d6f-b9a6-209564b03294"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:35:16.772617 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port e2d06464-eb31-4d6f-b9a6-209564b03294, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=e2d06464-eb31-4d6f-b9a6-209564b03294,segment=NetworkSegment(142b6494-b2b1-4cea-9b90-321c4a2a4cae),segment_id=142b6494-b2b1-4cea-9b90-321c4a2a4cae)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:35:16.784883 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:35:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fb0330d0-57a6-4619-9492-544417199070 x-openstack-request-id: req-fb0330d0-57a6-4619-9492-544417199070 {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:35:16.785130 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f9a57fa6-0a62-475f-af77-8f608003b5e1", "name": "network-vif-plugged", "status": "completed", "tag": "e2d06464-eb31-4d6f-b9a6-209564b03294", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:35:16.785356 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-fb0330d0-57a6-4619-9492-544417199070 {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:35:16.785756 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f9a57fa6-0a62-475f-af77-8f608003b5e1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e2d06464-eb31-4d6f-b9a6-209564b03294', 'code': 200} Nov 09 04:35:16.820201 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1de40be5-ac1d-48bd-92b3-faadb65dfa8f tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for router_gateway, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:16.843909 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1de40be5-ac1d-48bd-92b3-faadb65dfa8f tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:16.888330 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:16.954074 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=e2d06464-eb31-4d6f-b9a6-209564b03294,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:16.963772 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:16.983781 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-1de40be5-ac1d-48bd-92b3-faadb65dfa8f tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Allocated IP 172.26.0.247 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/11993ecf-d21a-48f1-82fa-2541175e40ca) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:35:17.006126 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-11e90d5e-724b-498c-ba5f-1fb9ee3f7e2f tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Router 8ac82b1e-1b89-49c2-850a-e69a6d1163e6 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:35:17.086860 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1de40be5-ac1d-48bd-92b3-faadb65dfa8f tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:17.150379 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-11e90d5e-724b-498c-ba5f-1fb9ee3f7e2f tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:35:17.150379 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c2202ba-2f42-4757-b8a3-9b06d611a23b req-5322f461-0317-4b94-bcf6-9d2c2ab7365f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:17.151812 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2c2202ba-2f42-4757-b8a3-9b06d611a23b req-5322f461-0317-4b94-bcf6-9d2c2ab7365f service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=f9a57fa6-0a62-475f-af77-8f608003b5e1 HTTP/1.1" status: 200 len: 1099 time: 0.0838225 Nov 09 04:35:17.167588 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-001efdb6-1a49-4ecb-8574-e5f64fb9c3fa None None] Sync routers for ids ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:35:17.172261 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1de40be5-ac1d-48bd-92b3-faadb65dfa8f tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:17.193361 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-001efdb6-1a49-4ecb-8574-e5f64fb9c3fa None None] Routers {'8ac82b1e-1b89-49c2-850a-e69a6d1163e6'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:17.193836 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-001efdb6-1a49-4ecb-8574-e5f64fb9c3fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:17.198853 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device f3c1c9eb-0af6-4531-a859-1d34d94e2118 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:35:17.232391 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2c2202ba-2f42-4757-b8a3-9b06d611a23b req-cf895c4e-0f3d-4dfa-985c-3d08a4af4b3b service neutron] 10.222.0.26 "GET /v2.0/security-groups?id=eb8d9d39-2315-42c2-bde9-38a01ea1afed&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0700929 Nov 09 04:35:17.237796 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-001efdb6-1a49-4ecb-8574-e5f64fb9c3fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:17.244966 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: f3c1c9eb-0af6-4531-a859-1d34d94e2118 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:35:17.245308 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device f3c1c9eb-0af6-4531-a859-1d34d94e2118 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:35:17.248215 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-001efdb6-1a49-4ecb-8574-e5f64fb9c3fa None None] Routers {'8ac82b1e-1b89-49c2-850a-e69a6d1163e6'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:17.249522 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-001efdb6-1a49-4ecb-8574-e5f64fb9c3fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:17.266751 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1de40be5-ac1d-48bd-92b3-faadb65dfa8f tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:35:17.269841 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-1de40be5-ac1d-48bd-92b3-faadb65dfa8f tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:35:17.274308 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1de40be5-ac1d-48bd-92b3-faadb65dfa8f tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:35:17.277432 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1de40be5-ac1d-48bd-92b3-faadb65dfa8f tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event updated for resources: {'Port': ['ID=11993ecf-d21a-48f1-82fa-2541175e40ca,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:17.284033 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-11e90d5e-724b-498c-ba5f-1fb9ee3f7e2f tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:17.291999 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-001efdb6-1a49-4ecb-8574-e5f64fb9c3fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:17.292868 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-001efdb6-1a49-4ecb-8574-e5f64fb9c3fa None None] The sync data for ids ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:35:17.320615 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-11e90d5e-724b-498c-ba5f-1fb9ee3f7e2f tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] 10.222.0.24 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 984 time: 2.4335463 Nov 09 04:35:17.320845 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58746) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:17.325961 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-e7c47baa-be35-419f-bc82-1442d1a4e077 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Request body: {'floatingip': {'port_id': '693e1e58-7710-45a7-b884-6c6cbd4bb88f', 'fixed_ip_address': '172.20.0.12'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:35:17.461707 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e7c47baa-be35-419f-bc82-1442d1a4e077 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for floatingip, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:17.797747 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1de40be5-ac1d-48bd-92b3-faadb65dfa8f tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for router_gateway, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:17.854752 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87f8e8ea-c1b4-4835-815b-5398d6a0221e req-0dfef2fe-498d-48bd-862e-af7857fe366b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:17.859709 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-87f8e8ea-c1b4-4835-815b-5398d6a0221e req-0dfef2fe-498d-48bd-862e-af7857fe366b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=f9a57fa6-0a62-475f-af77-8f608003b5e1 HTTP/1.1" status: 200 len: 946 time: 0.1505775 Nov 09 04:35:18.028066 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-87f8e8ea-c1b4-4835-815b-5398d6a0221e req-41ab7584-6fdb-4643-b371-29bebeed04a5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=eb8d9d39-2315-42c2-bde9-38a01ea1afed&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1655533 Nov 09 04:35:18.562300 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1de40be5-ac1d-48bd-92b3-faadb65dfa8f tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:18.653301 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e7c47baa-be35-419f-bc82-1442d1a4e077 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:18.729222 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e7c47baa-be35-419f-bc82-1442d1a4e077 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:18.808120 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1de40be5-ac1d-48bd-92b3-faadb65dfa8f tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Router a65669cd-451a-43da-ade7-853f7fe458c0 is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102161) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:35:19.011535 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1de40be5-ac1d-48bd-92b3-faadb65dfa8f tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:35:19.021436 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-77ae9c9d-6546-4606-9fb7-0b368aa8fbdc None None] Sync routers for ids ['a65669cd-451a-43da-ade7-853f7fe458c0'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:35:19.032542 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-77ae9c9d-6546-4606-9fb7-0b368aa8fbdc None None] Routers {'a65669cd-451a-43da-ade7-853f7fe458c0'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:19.033159 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-77ae9c9d-6546-4606-9fb7-0b368aa8fbdc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['a65669cd-451a-43da-ade7-853f7fe458c0'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:19.049403 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e7c47baa-be35-419f-bc82-1442d1a4e077 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Router 8ac82b1e-1b89-49c2-850a-e69a6d1163e6 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:35:19.068540 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-77ae9c9d-6546-4606-9fb7-0b368aa8fbdc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:19.078371 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-77ae9c9d-6546-4606-9fb7-0b368aa8fbdc None None] Routers {'a65669cd-451a-43da-ade7-853f7fe458c0'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:19.079158 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-77ae9c9d-6546-4606-9fb7-0b368aa8fbdc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['a65669cd-451a-43da-ade7-853f7fe458c0'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:19.103678 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1de40be5-ac1d-48bd-92b3-faadb65dfa8f tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:19.108329 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58756) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:19.115262 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1de40be5-ac1d-48bd-92b3-faadb65dfa8f tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 884 time: 3.1426930 Nov 09 04:35:19.130081 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-77ae9c9d-6546-4606-9fb7-0b368aa8fbdc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:19.131025 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-77ae9c9d-6546-4606-9fb7-0b368aa8fbdc None None] The sync data for ids ['a65669cd-451a-43da-ade7-853f7fe458c0'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:35:19.186797 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e7c47baa-be35-419f-bc82-1442d1a4e077 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:35:19.191529 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e7c47baa-be35-419f-bc82-1442d1a4e077 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:19.198959 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6db5c0c2-98ca-4526-8aef-217b7aac3e99 None None] Sync routers for ids ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:35:19.215110 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6db5c0c2-98ca-4526-8aef-217b7aac3e99 None None] Routers {'8ac82b1e-1b89-49c2-850a-e69a6d1163e6'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:19.216040 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-6db5c0c2-98ca-4526-8aef-217b7aac3e99 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:19.255936 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-e7c47baa-be35-419f-bc82-1442d1a4e077 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] 10.222.0.24 "PUT /v2.0/floatingips/518f2e54-ba22-40fd-b58f-3cc03db16b10 HTTP/1.1" status: 200 len: 979 time: 1.9311554 Nov 09 04:35:19.256159 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58758) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:19.263722 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-6db5c0c2-98ca-4526-8aef-217b7aac3e99 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:19.275323 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6db5c0c2-98ca-4526-8aef-217b7aac3e99 None None] Routers {'8ac82b1e-1b89-49c2-850a-e69a6d1163e6'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:19.276201 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-6db5c0c2-98ca-4526-8aef-217b7aac3e99 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:19.286744 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-515bca4f-0cc6-47be-8e29-29c7b8f5aece req-fde5b33e-be39-412d-8072-f97955b5afda tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:19.288443 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-515bca4f-0cc6-47be-8e29-29c7b8f5aece req-fde5b33e-be39-412d-8072-f97955b5afda tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=f9a57fa6-0a62-475f-af77-8f608003b5e1 HTTP/1.1" status: 200 len: 946 time: 0.1259546 Nov 09 04:35:19.321826 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-6db5c0c2-98ca-4526-8aef-217b7aac3e99 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:19.322756 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6db5c0c2-98ca-4526-8aef-217b7aac3e99 None None] The sync data for ids ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:35:19.327547 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-28e96726-7591-496b-859b-2b99e8637dd7 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "GET /v2.0/routers/a65669cd-451a-43da-ade7-853f7fe458c0 HTTP/1.1" status: 200 len: 885 time: 0.2153292 Nov 09 04:35:19.328157 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58760) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:19.411165 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-515bca4f-0cc6-47be-8e29-29c7b8f5aece req-7893df78-9a7c-4de6-9f80-43f7c92623af tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=eb8d9d39-2315-42c2-bde9-38a01ea1afed&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1156893 Nov 09 04:35:19.443022 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-17c04d3d-fe8a-41cf-8927-686b83cd31d3 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Deleting port af43d489-3eac-4a5f-8095-255d2ef24a6d {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:35:19.443614 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-17c04d3d-fe8a-41cf-8927-686b83cd31d3 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:19.574025 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c879b44-a20f-4a31-89ad-957bce3c17df req-cb642f78-e272-42cd-9808-bba5ed3c7b82 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:19.575574 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-8c879b44-a20f-4a31-89ad-957bce3c17df req-cb642f78-e272-42cd-9808-bba5ed3c7b82 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=f9a57fa6-0a62-475f-af77-8f608003b5e1 HTTP/1.1" status: 200 len: 946 time: 0.0717735 Nov 09 04:35:19.577433 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-17c04d3d-fe8a-41cf-8927-686b83cd31d3 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:19.577755 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-17c04d3d-fe8a-41cf-8927-686b83cd31d3 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:19.597686 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-17c04d3d-fe8a-41cf-8927-686b83cd31d3 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Calling delete_port for af43d489-3eac-4a5f-8095-255d2ef24a6d owned by network:floatingip {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:35:19.611788 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-fee96037-f8f5-4db1-b899-096c87279f1e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "GET /v2.0/routers HTTP/1.1" status: 200 len: 888 time: 0.2825069 Nov 09 04:35:19.615090 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58764) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:19.620855 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-c1c98de7-f1b8-419f-b8bb-246f18205138 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Request body: {'router': {'name': 'updatedtempest-RoutersIpV6Test-router-1117295850'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:35:19.688244 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-8c879b44-a20f-4a31-89ad-957bce3c17df req-10dd02ef-4a05-4d33-9334-1b0c1e7b47ba tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=eb8d9d39-2315-42c2-bde9-38a01ea1afed&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1024582 Nov 09 04:35:19.917860 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-17c04d3d-fe8a-41cf-8927-686b83cd31d3 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:19.944089 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c04d3d-fe8a-41cf-8927-686b83cd31d3 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Pushing event deleted for resources: {'Port': ['ID=af43d489-3eac-4a5f-8095-255d2ef24a6d,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:20.014625 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-17c04d3d-fe8a-41cf-8927-686b83cd31d3 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for floatingip, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:20.015368 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.l3_db [None req-17c04d3d-fe8a-41cf-8927-686b83cd31d3 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Floating IP 518f2e54-ba22-40fd-b58f-3cc03db16b10 disassociated (deleted). External IP: 172.26.0.187, port: 693e1e58-7710-45a7-b884-6c6cbd4bb88f. Nov 09 04:35:20.223178 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-17c04d3d-fe8a-41cf-8927-686b83cd31d3 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Router 8ac82b1e-1b89-49c2-850a-e69a6d1163e6 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:35:20.240655 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c1c98de7-f1b8-419f-b8bb-246f18205138 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-466202', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-464271', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-936'] for router, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:20.324044 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c1c98de7-f1b8-419f-b8bb-246f18205138 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-466195', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-466408', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-464260'] for router, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:20.334166 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-17c04d3d-fe8a-41cf-8927-686b83cd31d3 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:35:20.343182 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-17c04d3d-fe8a-41cf-8927-686b83cd31d3 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:20.346711 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cc2a8579-5163-4b2e-b7d8-af35b1adb5d8 None None] Sync routers for ids ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:35:20.359671 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cc2a8579-5163-4b2e-b7d8-af35b1adb5d8 None None] Routers {'8ac82b1e-1b89-49c2-850a-e69a6d1163e6'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:20.360450 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-cc2a8579-5163-4b2e-b7d8-af35b1adb5d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:20.368504 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-17c04d3d-fe8a-41cf-8927-686b83cd31d3 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] 10.222.0.24 "DELETE /v2.0/floatingips/518f2e54-ba22-40fd-b58f-3cc03db16b10 HTTP/1.1" status: 204 len: 168 time: 1.1111615 Nov 09 04:35:20.371102 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58772) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:20.395800 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-cc2a8579-5163-4b2e-b7d8-af35b1adb5d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:20.404585 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cc2a8579-5163-4b2e-b7d8-af35b1adb5d8 None None] Routers {'8ac82b1e-1b89-49c2-850a-e69a6d1163e6'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:20.405171 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-cc2a8579-5163-4b2e-b7d8-af35b1adb5d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:20.440117 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-cc2a8579-5163-4b2e-b7d8-af35b1adb5d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:20.440752 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cc2a8579-5163-4b2e-b7d8-af35b1adb5d8 None None] The sync data for ids ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:35:20.495733 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c1c98de7-f1b8-419f-b8bb-246f18205138 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Router a65669cd-451a-43da-ade7-853f7fe458c0 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:35:20.558310 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-4b74af8e-262e-427c-9c74-075ad8b1c40b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Deleting port 693e1e58-7710-45a7-b884-6c6cbd4bb88f {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:35:20.558673 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4b74af8e-262e-427c-9c74-075ad8b1c40b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:20.687556 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c1c98de7-f1b8-419f-b8bb-246f18205138 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:35:20.696266 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c1c98de7-f1b8-419f-b8bb-246f18205138 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:20.696867 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f5955f6-0361-4c4d-a340-a040c8787e51 None None] Sync routers for ids ['a65669cd-451a-43da-ade7-853f7fe458c0'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:35:20.697438 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-c1c98de7-f1b8-419f-b8bb-246f18205138 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "PUT /v2.0/routers/a65669cd-451a-43da-ade7-853f7fe458c0 HTTP/1.1" status: 200 len: 892 time: 1.0809593 Nov 09 04:35:20.700229 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58774) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:20.706149 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4b74af8e-262e-427c-9c74-075ad8b1c40b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:20.709022 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5f5955f6-0361-4c4d-a340-a040c8787e51 None None] Routers {'a65669cd-451a-43da-ade7-853f7fe458c0'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:20.709961 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-5f5955f6-0361-4c4d-a340-a040c8787e51 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['a65669cd-451a-43da-ade7-853f7fe458c0'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:20.719204 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-4b74af8e-262e-427c-9c74-075ad8b1c40b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Calling delete_port for 693e1e58-7710-45a7-b884-6c6cbd4bb88f owned by {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:35:20.749792 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-5f5955f6-0361-4c4d-a340-a040c8787e51 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:20.758258 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5f5955f6-0361-4c4d-a340-a040c8787e51 None None] Routers {'a65669cd-451a-43da-ade7-853f7fe458c0'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:20.759130 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-5f5955f6-0361-4c4d-a340-a040c8787e51 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['a65669cd-451a-43da-ade7-853f7fe458c0'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:20.793943 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-5f5955f6-0361-4c4d-a340-a040c8787e51 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:20.795113 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f5955f6-0361-4c4d-a340-a040c8787e51 None None] The sync data for ids ['a65669cd-451a-43da-ade7-853f7fe458c0'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:35:20.816761 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-9a3d6e0f-f9a2-410a-b1fa-b96bf721fc4f tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "GET /v2.0/routers/a65669cd-451a-43da-ade7-853f7fe458c0 HTTP/1.1" status: 200 len: 892 time: 0.1129899 Nov 09 04:35:20.817013 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58778) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:20.848359 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-7e4d4f56-ede5-43fd-aa17-b42bc0384f0e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "GET /v2.0/ports?device_id=a65669cd-451a-43da-ade7-853f7fe458c0 HTTP/1.1" status: 200 len: 205 time: 0.0302598 Nov 09 04:35:20.851035 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58780) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:20.999899 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-927b2c35-cb42-46c4-a0fa-dd85f49ea75d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for router, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:21.078059 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4b74af8e-262e-427c-9c74-075ad8b1c40b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:21.111588 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b74af8e-262e-427c-9c74-075ad8b1c40b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Pushing event deleted for resources: {'Port': ['ID=693e1e58-7710-45a7-b884-6c6cbd4bb88f,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:21.144178 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b74af8e-262e-427c-9c74-075ad8b1c40b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:35:21.144526 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b74af8e-262e-427c-9c74-075ad8b1c40b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:35:21.144874 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b74af8e-262e-427c-9c74-075ad8b1c40b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:35:21.145210 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b74af8e-262e-427c-9c74-075ad8b1c40b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:35:21.145539 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b74af8e-262e-427c-9c74-075ad8b1c40b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:35:21.145866 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b74af8e-262e-427c-9c74-075ad8b1c40b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:35:21.146193 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b74af8e-262e-427c-9c74-075ad8b1c40b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:35:21.146546 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b74af8e-262e-427c-9c74-075ad8b1c40b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:35:21.146872 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b74af8e-262e-427c-9c74-075ad8b1c40b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:35:21.147194 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b74af8e-262e-427c-9c74-075ad8b1c40b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:35:21.147603 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b74af8e-262e-427c-9c74-075ad8b1c40b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:35:21.148168 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b74af8e-262e-427c-9c74-075ad8b1c40b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:35:21.185837 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-927b2c35-cb42-46c4-a0fa-dd85f49ea75d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for router_gateway, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:21.229085 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58782) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:21.270247 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4b74af8e-262e-427c-9c74-075ad8b1c40b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:21.273515 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-4b74af8e-262e-427c-9c74-075ad8b1c40b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] 10.222.0.24 "DELETE /v2.0/ports/693e1e58-7710-45a7-b884-6c6cbd4bb88f HTTP/1.1" status: 204 len: 168 time: 0.9014707 Nov 09 04:35:21.277630 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58784) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:21.282586 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-9dc0b35b-157e-42ec-8ea8-29b1d50e4351 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Request body: {'floatingip': {'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:35:21.445578 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-927b2c35-cb42-46c4-a0fa-dd85f49ea75d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Deleting port 11993ecf-d21a-48f1-82fa-2541175e40ca {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:35:21.445921 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-927b2c35-cb42-46c4-a0fa-dd85f49ea75d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:21.492602 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9dc0b35b-157e-42ec-8ea8-29b1d50e4351 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for floatingip, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:21.655017 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-927b2c35-cb42-46c4-a0fa-dd85f49ea75d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:21.677246 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-927b2c35-cb42-46c4-a0fa-dd85f49ea75d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Calling delete_port for 11993ecf-d21a-48f1-82fa-2541175e40ca owned by network:router_gateway {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:35:21.884430 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9dc0b35b-157e-42ec-8ea8-29b1d50e4351 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:22.402684 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9023d6dc-3387-4826-a52e-b38020624a4c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:22.416724 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-9dc0b35b-157e-42ec-8ea8-29b1d50e4351 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Allocated IP 172.26.0.76 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/99e84b14-3ac7-493c-9075-86adce5cc933) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:35:22.493544 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-927b2c35-cb42-46c4-a0fa-dd85f49ea75d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:22.578409 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-927b2c35-cb42-46c4-a0fa-dd85f49ea75d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event deleted for resources: {'Port': ['ID=11993ecf-d21a-48f1-82fa-2541175e40ca,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:22.697733 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9dc0b35b-157e-42ec-8ea8-29b1d50e4351 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:22.725076 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-927b2c35-cb42-46c4-a0fa-dd85f49ea75d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-466373'] for router_gateway, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:22.868783 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-927b2c35-cb42-46c4-a0fa-dd85f49ea75d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:22.873131 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-927b2c35-cb42-46c4-a0fa-dd85f49ea75d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:22.989704 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-9023d6dc-3387-4826-a52e-b38020624a4c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Allocated IP 172.20.0.17 (994f9071-b760-4d74-b91b-28777ec6b4e7/c1f5ce70-ebae-4e4d-9de5-04a34e845fdb/1a74b864-c68d-4f11-bce5-6e04e0afa480) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:35:23.056301 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9dc0b35b-157e-42ec-8ea8-29b1d50e4351 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:23.088993 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-927b2c35-cb42-46c4-a0fa-dd85f49ea75d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:23.089411 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-927b2c35-cb42-46c4-a0fa-dd85f49ea75d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Fanout notify agent at l3_agent the message router_deleted on router a65669cd-451a-43da-ade7-853f7fe458c0 {{(pid=102162) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:35:23.099541 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-927b2c35-cb42-46c4-a0fa-dd85f49ea75d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:23.100659 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-927b2c35-cb42-46c4-a0fa-dd85f49ea75d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "DELETE /v2.0/routers/a65669cd-451a-43da-ade7-853f7fe458c0 HTTP/1.1" status: 204 len: 168 time: 2.2486823 Nov 09 04:35:23.104740 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58790) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:23.110284 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-8e688d3e-2149-4be2-a095-0112e6891a24 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-1234228957'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:35:23.126580 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9dc0b35b-157e-42ec-8ea8-29b1d50e4351 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:35:23.134665 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-9dc0b35b-157e-42ec-8ea8-29b1d50e4351 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:35:23.139864 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9dc0b35b-157e-42ec-8ea8-29b1d50e4351 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:35:23.141694 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dc0b35b-157e-42ec-8ea8-29b1d50e4351 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Pushing event updated for resources: {'Port': ['ID=99e84b14-3ac7-493c-9075-86adce5cc933,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:23.203008 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9023d6dc-3387-4826-a52e-b38020624a4c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:23.253010 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8e688d3e-2149-4be2-a095-0112e6891a24 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Made reservation on behalf of d11b025703b24d109deef7bfe57a45f6 for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:35:23.256572 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8e688d3e-2149-4be2-a095-0112e6891a24 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:23.275670 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9dc0b35b-157e-42ec-8ea8-29b1d50e4351 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:23.281312 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8e688d3e-2149-4be2-a095-0112e6891a24 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 301} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:35:23.289802 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8e688d3e-2149-4be2-a095-0112e6891a24 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:23.290166 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-8e688d3e-2149-4be2-a095-0112e6891a24 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Added segment 5009d787-03ba-44e2-873a-2de2a67aefaa of type vlan for network 14a51706-8086-4f7f-a920-416a3cf925d6 Nov 09 04:35:23.331402 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8e688d3e-2149-4be2-a095-0112e6891a24 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:23.380702 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9023d6dc-3387-4826-a52e-b38020624a4c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:23.424266 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9023d6dc-3387-4826-a52e-b38020624a4c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network 994f9071-b760-4d74-b91b-28777ec6b4e7 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:35:23.427415 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-9023d6dc-3387-4826-a52e-b38020624a4c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:35:23.433201 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9023d6dc-3387-4826-a52e-b38020624a4c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:35:23.460382 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9023d6dc-3387-4826-a52e-b38020624a4c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Port': ['ID=1a74b864-c68d-4f11-bce5-6e04e0afa480,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:23.500494 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8e688d3e-2149-4be2-a095-0112e6891a24 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:23.503301 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9023d6dc-3387-4826-a52e-b38020624a4c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:23.507298 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8e688d3e-2149-4be2-a095-0112e6891a24 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:23.507905 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8e688d3e-2149-4be2-a095-0112e6891a24 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:23.544700 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9dc0b35b-157e-42ec-8ea8-29b1d50e4351 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:23.577985 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e688d3e-2149-4be2-a095-0112e6891a24 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event updated for resources: {'Network': ['ID=14a51706-8086-4f7f-a920-416a3cf925d6,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:23.586780 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e688d3e-2149-4be2-a095-0112e6891a24 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:35:23.629959 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e688d3e-2149-4be2-a095-0112e6891a24 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:35:23.629959 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e688d3e-2149-4be2-a095-0112e6891a24 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:35:23.629959 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e688d3e-2149-4be2-a095-0112e6891a24 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:35:23.629959 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e688d3e-2149-4be2-a095-0112e6891a24 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:35:23.629959 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e688d3e-2149-4be2-a095-0112e6891a24 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:35:23.629959 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e688d3e-2149-4be2-a095-0112e6891a24 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:35:23.629959 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e688d3e-2149-4be2-a095-0112e6891a24 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:35:23.629959 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e688d3e-2149-4be2-a095-0112e6891a24 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:35:23.629959 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e688d3e-2149-4be2-a095-0112e6891a24 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:35:23.629959 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e688d3e-2149-4be2-a095-0112e6891a24 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:35:23.629959 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e688d3e-2149-4be2-a095-0112e6891a24 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:35:23.633102 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 14a51706-8086-4f7f-a920-416a3cf925d6 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:35:23.710934 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-8e688d3e-2149-4be2-a095-0112e6891a24 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 770 time: 0.5961595 Nov 09 04:35:23.710934 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58792) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:23.711254 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-77a939b6-6362-4361-b3aa-bd969d2f88e2 None None] Provisioning complete for port 1a74b864-c68d-4f11-bce5-6e04e0afa480 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:23.711254 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-77a939b6-6362-4361-b3aa-bd969d2f88e2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:23.711426 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-8173ccf8-d4d8-4bd5-bc77-e12707ca7ff9 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Request body: {'subnet': {'network_id': '14a51706-8086-4f7f-a920-416a3cf925d6', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:35:23.746331 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-77a939b6-6362-4361-b3aa-bd969d2f88e2 None None] Port 1a74b864-c68d-4f11-bce5-6e04e0afa480 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:35:23.751879 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9dc0b35b-157e-42ec-8ea8-29b1d50e4351 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:23.805946 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9023d6dc-3387-4826-a52e-b38020624a4c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:23.893131 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9dc0b35b-157e-42ec-8ea8-29b1d50e4351 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:23.916953 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8173ccf8-d4d8-4bd5-bc77-e12707ca7ff9 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Made reservation on behalf of d11b025703b24d109deef7bfe57a45f6 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:35:23.920766 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8173ccf8-d4d8-4bd5-bc77-e12707ca7ff9 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:24.005211 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dc0b35b-157e-42ec-8ea8-29b1d50e4351 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Pushing event updated for resources: {'Port': ['ID=99e84b14-3ac7-493c-9075-86adce5cc933,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:24.035068 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9dc0b35b-157e-42ec-8ea8-29b1d50e4351 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:24.162907 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9023d6dc-3387-4826-a52e-b38020624a4c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:24.168968 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9dc0b35b-157e-42ec-8ea8-29b1d50e4351 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:24.170175 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-9dc0b35b-157e-42ec-8ea8-29b1d50e4351 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] 10.222.0.24 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 2.8916416 Nov 09 04:35:24.172864 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58796) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:24.177546 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-20660439-b125-4763-bc71-dca169c6e21b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Request body: {'port': {'network_id': '7b6ec8a7-3152-4a6b-88b2-1b5105cc3943', 'name': 'tempest-FloatingIPTestJSON-1651182962'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:35:24.248249 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8173ccf8-d4d8-4bd5-bc77-e12707ca7ff9 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:24.266013 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9023d6dc-3387-4826-a52e-b38020624a4c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:24.315608 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8173ccf8-d4d8-4bd5-bc77-e12707ca7ff9 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event updated for resources: {'Subnet': ['ID=8936c507-26b2-4943-9afe-a4f4bc6627ec,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:24.317879 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8173ccf8-d4d8-4bd5-bc77-e12707ca7ff9 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Checking segment: {'id': '5009d787-03ba-44e2-873a-2de2a67aefaa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 301, 'network_id': '14a51706-8086-4f7f-a920-416a3cf925d6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:35:24.318249 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8173ccf8-d4d8-4bd5-bc77-e12707ca7ff9 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Network hostable DHCP agents. Network: 14a51706-8086-4f7f-a920-416a3cf925d6, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:35:24.353581 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9023d6dc-3387-4826-a52e-b38020624a4c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:24.355258 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9023d6dc-3387-4826-a52e-b38020624a4c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Port': ['ID=1a74b864-c68d-4f11-bce5-6e04e0afa480,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:24.431574 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8173ccf8-d4d8-4bd5-bc77-e12707ca7ff9 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Network 14a51706-8086-4f7f-a920-416a3cf925d6 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:35:24.445221 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-20660439-b125-4763-bc71-dca169c6e21b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Made reservation on behalf of 459651e5af964f8c805d518a6dc3b464 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:35:24.452018 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-20660439-b125-4763-bc71-dca169c6e21b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:24.467199 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9023d6dc-3387-4826-a52e-b38020624a4c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network 994f9071-b760-4d74-b91b-28777ec6b4e7 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:35:24.471363 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-9023d6dc-3387-4826-a52e-b38020624a4c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:35:24.479104 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [None req-20660439-b125-4763-bc71-dca169c6e21b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] device_id is not set on port f3b070b7-662c-4247-8169-355f44d64fa8 yet. {{(pid=102162) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:35:24.534955 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-8173ccf8-d4d8-4bd5-bc77-e12707ca7ff9 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 14a51706-8086-4f7f-a920-416a3cf925d6) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:35:24.539956 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8173ccf8-d4d8-4bd5-bc77-e12707ca7ff9 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:24.540642 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8173ccf8-d4d8-4bd5-bc77-e12707ca7ff9 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:24.546092 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1ba5c2c4-35d3-4a01-8a9a-0f6b16d10b9b None None] Network 14a51706-8086-4f7f-a920-416a3cf925d6 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:35:24.673049 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58798) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:24.673340 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-8173ccf8-d4d8-4bd5-bc77-e12707ca7ff9 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.9629083 Nov 09 04:35:24.681678 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-05cf4ef0-1bc9-4126-bd74-1b488e78fd94 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-1071576256', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:35:24.688609 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9023d6dc-3387-4826-a52e-b38020624a4c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Router d05416c2-0293-4ef5-a6e3-5968392cc774 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:35:24.695357 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-20660439-b125-4763-bc71-dca169c6e21b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Allocated IP 172.20.0.13 (7b6ec8a7-3152-4a6b-88b2-1b5105cc3943/55684bb6-5188-4ce7-a4cb-155a73eeeeeb/f3b070b7-662c-4247-8169-355f44d64fa8) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:35:24.717517 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c9b3cb48-d7db-455b-a1c7-c77a9bfadffd None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-14a51706-8086-4f7f-a920-416a3cf925d6', 'network_id': '14a51706-8086-4f7f-a920-416a3cf925d6', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'fixed_ips': [{'subnet_id': '8936c507-26b2-4943-9afe-a4f4bc6627ec'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:35:24.718504 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c9b3cb48-d7db-455b-a1c7-c77a9bfadffd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:24.797782 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-05cf4ef0-1bc9-4126-bd74-1b488e78fd94 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:24.798070 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-05cf4ef0-1bc9-4126-bd74-1b488e78fd94 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:24.813421 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-24e516c8-a6bc-465a-be34-92ab4e1583ab None None] Provisioning complete for port 1a74b864-c68d-4f11-bce5-6e04e0afa480 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:24.813789 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-24e516c8-a6bc-465a-be34-92ab4e1583ab None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:24.878833 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-24e516c8-a6bc-465a-be34-92ab4e1583ab None None] Port 1a74b864-c68d-4f11-bce5-6e04e0afa480 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:35:24.899943 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-c9b3cb48-d7db-455b-a1c7-c77a9bfadffd None None] Allocated IP 2001:db8::2 (14a51706-8086-4f7f-a920-416a3cf925d6/8936c507-26b2-4943-9afe-a4f4bc6627ec/16798627-ff6a-406f-9704-23d7e0ca012e) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:35:24.950786 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9023d6dc-3387-4826-a52e-b38020624a4c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:35:24.954729 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-05cf4ef0-1bc9-4126-bd74-1b488e78fd94 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:24.962282 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-9023d6dc-3387-4826-a52e-b38020624a4c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "PUT /v2.0/routers/d05416c2-0293-4ef5-a6e3-5968392cc774/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.7323909 Nov 09 04:35:24.975767 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1387e5ca-869b-4987-ba94-fb281b62822f None None] Sync routers for ids ['d05416c2-0293-4ef5-a6e3-5968392cc774'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:35:24.998923 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-20660439-b125-4763-bc71-dca169c6e21b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:24.999436 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1387e5ca-869b-4987-ba94-fb281b62822f None None] Routers {'d05416c2-0293-4ef5-a6e3-5968392cc774'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:25.000056 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-1387e5ca-869b-4987-ba94-fb281b62822f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['d05416c2-0293-4ef5-a6e3-5968392cc774'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:25.026637 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-05cf4ef0-1bc9-4126-bd74-1b488e78fd94 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:25.140940 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-20660439-b125-4763-bc71-dca169c6e21b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:25.178347 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-05cf4ef0-1bc9-4126-bd74-1b488e78fd94 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:25.179738 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-05cf4ef0-1bc9-4126-bd74-1b488e78fd94 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 704 time: 0.5056198 Nov 09 04:35:25.182763 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58806) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:25.194015 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-20660439-b125-4763-bc71-dca169c6e21b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Network 7b6ec8a7-3152-4a6b-88b2-1b5105cc3943 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:35:25.199848 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-20660439-b125-4763-bc71-dca169c6e21b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:35:25.204627 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-20660439-b125-4763-bc71-dca169c6e21b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:35:25.230523 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20660439-b125-4763-bc71-dca169c6e21b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Pushing event updated for resources: {'Port': ['ID=f3b070b7-662c-4247-8169-355f44d64fa8,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:25.269324 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-20660439-b125-4763-bc71-dca169c6e21b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:25.270047 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-20660439-b125-4763-bc71-dca169c6e21b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:25.300999 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c9b3cb48-d7db-455b-a1c7-c77a9bfadffd None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:25.318755 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-1387e5ca-869b-4987-ba94-fb281b62822f None None] Set router d05416c2-0293-4ef5-a6e3-5968392cc774 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:35:25.367296 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-20660439-b125-4763-bc71-dca169c6e21b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 930 time: 1.1932580 Nov 09 04:35:25.375860 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58808) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:25.381440 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-47389bcd-f0b3-4652-86a3-645229ebb060 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Request body: {'floatingip': {'port_id': 'f3b070b7-662c-4247-8169-355f44d64fa8'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:35:25.401353 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c9b3cb48-d7db-455b-a1c7-c77a9bfadffd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:25.434387 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-47389bcd-f0b3-4652-86a3-645229ebb060 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for floatingip, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:25.460895 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c9b3cb48-d7db-455b-a1c7-c77a9bfadffd None None] Network 14a51706-8086-4f7f-a920-416a3cf925d6 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:35:25.475451 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-c9b3cb48-d7db-455b-a1c7-c77a9bfadffd None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:35:25.485558 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c9b3cb48-d7db-455b-a1c7-c77a9bfadffd None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:35:25.489703 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9b3cb48-d7db-455b-a1c7-c77a9bfadffd None None] Pushing event updated for resources: {'Port': ['ID=16798627-ff6a-406f-9704-23d7e0ca012e,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:25.504341 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-04bec9d7-70b1-43df-8815-1582e1418cbb tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:25.533983 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9b3cb48-d7db-455b-a1c7-c77a9bfadffd None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:35:25.533983 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9b3cb48-d7db-455b-a1c7-c77a9bfadffd None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:35:25.534404 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9b3cb48-d7db-455b-a1c7-c77a9bfadffd None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:35:25.534514 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9b3cb48-d7db-455b-a1c7-c77a9bfadffd None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:35:25.535344 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9b3cb48-d7db-455b-a1c7-c77a9bfadffd None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:35:25.535344 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9b3cb48-d7db-455b-a1c7-c77a9bfadffd None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:35:25.535713 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9b3cb48-d7db-455b-a1c7-c77a9bfadffd None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:35:25.536213 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9b3cb48-d7db-455b-a1c7-c77a9bfadffd None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:35:25.536615 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9b3cb48-d7db-455b-a1c7-c77a9bfadffd None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:35:25.536860 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9b3cb48-d7db-455b-a1c7-c77a9bfadffd None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:35:25.537188 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9b3cb48-d7db-455b-a1c7-c77a9bfadffd None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:35:25.537524 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9b3cb48-d7db-455b-a1c7-c77a9bfadffd None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:35:25.600290 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-c9b3cb48-d7db-455b-a1c7-c77a9bfadffd None None] Attempting to bind port 16798627-ff6a-406f-9704-23d7e0ca012e on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:35:25.600555 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-c9b3cb48-d7db-455b-a1c7-c77a9bfadffd None None] Attempting to bind port 16798627-ff6a-406f-9704-23d7e0ca012e by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '5009d787-03ba-44e2-873a-2de2a67aefaa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 301, 'network_id': '14a51706-8086-4f7f-a920-416a3cf925d6'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:35:25.600949 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c9b3cb48-d7db-455b-a1c7-c77a9bfadffd None None] Attempting to bind port 16798627-ff6a-406f-9704-23d7e0ca012e on network 14a51706-8086-4f7f-a920-416a3cf925d6 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:35:25.613053 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c9b3cb48-d7db-455b-a1c7-c77a9bfadffd None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 35, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:35:25.613423 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c9b3cb48-d7db-455b-a1c7-c77a9bfadffd None None] Checking segment: {'id': '5009d787-03ba-44e2-873a-2de2a67aefaa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 301, 'network_id': '14a51706-8086-4f7f-a920-416a3cf925d6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:35:25.613818 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c9b3cb48-d7db-455b-a1c7-c77a9bfadffd None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:25.614210 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c9b3cb48-d7db-455b-a1c7-c77a9bfadffd None None] Bound using segment: {'id': '5009d787-03ba-44e2-873a-2de2a67aefaa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 301, 'network_id': '14a51706-8086-4f7f-a920-416a3cf925d6'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:35:25.614719 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-c9b3cb48-d7db-455b-a1c7-c77a9bfadffd None None] Bound port: 16798627-ff6a-406f-9704-23d7e0ca012e, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5009d787-03ba-44e2-873a-2de2a67aefaa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 301, 'network_id': '14a51706-8086-4f7f-a920-416a3cf925d6'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:35:25.615101 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c9b3cb48-d7db-455b-a1c7-c77a9bfadffd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:25.717271 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-c9b3cb48-d7db-455b-a1c7-c77a9bfadffd None None] For port 16798627-ff6a-406f-9704-23d7e0ca012e, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:35:25.731804 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-c9b3cb48-d7db-455b-a1c7-c77a9bfadffd None None] For port 16798627-ff6a-406f-9704-23d7e0ca012e, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=16798627-ff6a-406f-9704-23d7e0ca012e,segment=NetworkSegment(5009d787-03ba-44e2-873a-2de2a67aefaa),segment_id=5009d787-03ba-44e2-873a-2de2a67aefaa)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:35:25.737295 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-1387e5ca-869b-4987-ba94-fb281b62822f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'name': 'tempest-TestNetworkBasicOps-router-1967773701', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.204'}], 'enable_snat': True}, 'gw_port_id': '49bff53a-c208-4aa5-8fcc-e7ec9471fae7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:33:32Z', 'updated_at': '2021-11-09T04:35:23Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '49bff53a-c208-4aa5-8fcc-e7ec9471fae7', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:85:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'device_owner': 'network:router_gateway', 'standard_attr_id': 978, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.204', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:33:34Z', 'updated_at': '2021-11-09T04:33:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '071d456d-45c8-43d6-9154-8dc9c2df29f2', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'floating_ip_address': '172.26.0.195', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'port_id': '09cbfb91-4118-43af-8b70-41d8d4265574', 'fixed_ip_address': '172.20.0.7', 'status': 'ACTIVE', 'standard_attr_id': 1062, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '239a9c72-6384-4d5a-a69d-f4ac0c580e40', 'mac_address': 'fa:16:3e:27:22:c9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f462374-376b-4c38-b300-528ae5358377', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:34:20Z', 'updated_at': '2021-11-09T04:34:25Z', 'revision_number': 1, 'project_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1a74b864-c68d-4f11-bce5-6e04e0afa480', 'name': '', 'network_id': '994f9071-b760-4d74-b91b-28777ec6b4e7', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:a5:16:b0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'device_owner': 'network:router_interface', 'standard_attr_id': 1185, 'fixed_ips': [{'subnet_id': 'c1f5ce70-ebae-4e4d-9de5-04a34e845fdb', 'ip_address': '172.20.0.17', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:22Z', 'updated_at': '2021-11-09T04:35:24Z', 'revision_number': 2, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': 'c1f5ce70-ebae-4e4d-9de5-04a34e845fdb', 'cidr': '172.20.0.16/28', 'gateway_ip': '172.20.0.17', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '9930d582-2262-4f1d-97bf-b02697a70777', 'name': '', 'network_id': '239a9c72-6384-4d5a-a69d-f4ac0c580e40', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:7c:21:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'device_owner': 'network:router_interface', 'standard_attr_id': 987, 'fixed_ips': [{'subnet_id': '33b5599d-7ebe-4564-9c72-76f5d540fd80', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:33:41Z', 'updated_at': '2021-11-09T04:33:48Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '33b5599d-7ebe-4564-9c72-76f5d540fd80', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:25.768837 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1387e5ca-869b-4987-ba94-fb281b62822f None None] Checking router: d05416c2-0293-4ef5-a6e3-5968392cc774 for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:35:25.769191 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1387e5ca-869b-4987-ba94-fb281b62822f None None] Updating router d05416c2-0293-4ef5-a6e3-5968392cc774 port 1a74b864-c68d-4f11-bce5-6e04e0afa480 binding host dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 04:35:25.774821 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-04bec9d7-70b1-43df-8815-1582e1418cbb tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Allocated IP 2001:db8::1 (14a51706-8086-4f7f-a920-416a3cf925d6/8936c507-26b2-4943-9afe-a4f4bc6627ec/75ed34b7-564a-463e-a78c-2f0581be0830) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:35:25.799317 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1387e5ca-869b-4987-ba94-fb281b62822f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:25.899218 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c9b3cb48-d7db-455b-a1c7-c77a9bfadffd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:25.926662 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-04bec9d7-70b1-43df-8815-1582e1418cbb tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:26.031033 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9b3cb48-d7db-455b-a1c7-c77a9bfadffd None None] Pushing event updated for resources: {'Port': ['ID=16798627-ff6a-406f-9704-23d7e0ca012e,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:26.066084 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-04bec9d7-70b1-43df-8815-1582e1418cbb tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:26.125596 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-04bec9d7-70b1-43df-8815-1582e1418cbb tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Network 14a51706-8086-4f7f-a920-416a3cf925d6 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:35:26.131228 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-04bec9d7-70b1-43df-8815-1582e1418cbb tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:35:26.141753 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-04bec9d7-70b1-43df-8815-1582e1418cbb tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:35:26.142333 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-04bec9d7-70b1-43df-8815-1582e1418cbb tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:26.186271 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04bec9d7-70b1-43df-8815-1582e1418cbb tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event updated for resources: {'Port': ['ID=75ed34b7-564a-463e-a78c-2f0581be0830,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:26.214840 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1387e5ca-869b-4987-ba94-fb281b62822f None None] Publish callbacks [] for port, precommit_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:26.304592 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1387e5ca-869b-4987-ba94-fb281b62822f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:26.335144 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-47389bcd-f0b3-4652-86a3-645229ebb060 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:26.358539 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0da86de7-318a-4fd3-923b-5378cb45051d None None] Pushing event updated for resources: {'Port': ['ID=1a74b864-c68d-4f11-bce5-6e04e0afa480,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:26.390065 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-04bec9d7-70b1-43df-8815-1582e1418cbb tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:26.425082 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-1387e5ca-869b-4987-ba94-fb281b62822f None None] Attempting to bind port 1a74b864-c68d-4f11-bce5-6e04e0afa480 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:35:26.425545 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-1387e5ca-869b-4987-ba94-fb281b62822f None None] Attempting to bind port 1a74b864-c68d-4f11-bce5-6e04e0afa480 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '142b6494-b2b1-4cea-9b90-321c4a2a4cae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 339, 'network_id': '994f9071-b760-4d74-b91b-28777ec6b4e7'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:35:26.426405 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1387e5ca-869b-4987-ba94-fb281b62822f None None] Attempting to bind port 1a74b864-c68d-4f11-bce5-6e04e0afa480 on network 994f9071-b760-4d74-b91b-28777ec6b4e7 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:35:26.431529 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1387e5ca-869b-4987-ba94-fb281b62822f None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 35, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:35:26.433417 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1387e5ca-869b-4987-ba94-fb281b62822f None None] Checking segment: {'id': '142b6494-b2b1-4cea-9b90-321c4a2a4cae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 339, 'network_id': '994f9071-b760-4d74-b91b-28777ec6b4e7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:35:26.433417 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1387e5ca-869b-4987-ba94-fb281b62822f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:26.433417 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1387e5ca-869b-4987-ba94-fb281b62822f None None] Bound using segment: {'id': '142b6494-b2b1-4cea-9b90-321c4a2a4cae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 339, 'network_id': '994f9071-b760-4d74-b91b-28777ec6b4e7'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:35:26.433777 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-1387e5ca-869b-4987-ba94-fb281b62822f None None] Bound port: 1a74b864-c68d-4f11-bce5-6e04e0afa480, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '142b6494-b2b1-4cea-9b90-321c4a2a4cae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 339, 'network_id': '994f9071-b760-4d74-b91b-28777ec6b4e7'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:35:26.434326 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1387e5ca-869b-4987-ba94-fb281b62822f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:26.460039 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-47389bcd-f0b3-4652-86a3-645229ebb060 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:26.519344 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-1387e5ca-869b-4987-ba94-fb281b62822f None None] For port 1a74b864-c68d-4f11-bce5-6e04e0afa480, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:35:26.519344 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-1387e5ca-869b-4987-ba94-fb281b62822f None None] For port 1a74b864-c68d-4f11-bce5-6e04e0afa480, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=1a74b864-c68d-4f11-bce5-6e04e0afa480,segment=NetworkSegment(142b6494-b2b1-4cea-9b90-321c4a2a4cae),segment_id=142b6494-b2b1-4cea-9b90-321c4a2a4cae)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:35:26.581457 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.l3_db [None req-47389bcd-f0b3-4652-86a3-645229ebb060 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Floating IP 2bfa24c4-303f-42f5-95e8-b507145375bb associated. External IP: 172.26.0.76, port: f3b070b7-662c-4247-8169-355f44d64fa8. Nov 09 04:35:26.640190 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-7e36f6cb-d845-4eb1-85ef-d071ced53f01 None None] Provisioning complete for port 1a74b864-c68d-4f11-bce5-6e04e0afa480 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:26.640554 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7e36f6cb-d845-4eb1-85ef-d071ced53f01 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:26.678603 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-04bec9d7-70b1-43df-8815-1582e1418cbb tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:26.682384 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-7e36f6cb-d845-4eb1-85ef-d071ced53f01 None None] Port 1a74b864-c68d-4f11-bce5-6e04e0afa480 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:35:26.698708 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1387e5ca-869b-4987-ba94-fb281b62822f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:26.758458 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1387e5ca-869b-4987-ba94-fb281b62822f None None] Routers {'d05416c2-0293-4ef5-a6e3-5968392cc774'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:26.759108 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-1387e5ca-869b-4987-ba94-fb281b62822f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['d05416c2-0293-4ef5-a6e3-5968392cc774'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:26.786006 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-04bec9d7-70b1-43df-8815-1582e1418cbb tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:26.787379 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-04bec9d7-70b1-43df-8815-1582e1418cbb tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:26.815097 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0da86de7-318a-4fd3-923b-5378cb45051d None None] Pushing event updated for resources: {'Port': ['ID=1a74b864-c68d-4f11-bce5-6e04e0afa480,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:26.825984 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-47389bcd-f0b3-4652-86a3-645229ebb060 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Router 8ac82b1e-1b89-49c2-850a-e69a6d1163e6 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:35:26.920322 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-1387e5ca-869b-4987-ba94-fb281b62822f None None] Set router d05416c2-0293-4ef5-a6e3-5968392cc774 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:35:26.949693 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04bec9d7-70b1-43df-8815-1582e1418cbb tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event updated for resources: {'Port': ['ID=75ed34b7-564a-463e-a78c-2f0581be0830,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:26.994898 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-47389bcd-f0b3-4652-86a3-645229ebb060 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:35:27.001709 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-47389bcd-f0b3-4652-86a3-645229ebb060 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:27.004482 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9a048cc1-1255-4f79-a02d-d1158360e6c9 None None] Sync routers for ids ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:35:27.011546 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-04bec9d7-70b1-43df-8815-1582e1418cbb tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Network 14a51706-8086-4f7f-a920-416a3cf925d6 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:35:27.013028 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-04bec9d7-70b1-43df-8815-1582e1418cbb tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:35:27.021801 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9a048cc1-1255-4f79-a02d-d1158360e6c9 None None] Routers {'8ac82b1e-1b89-49c2-850a-e69a6d1163e6'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:27.026410 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-9a048cc1-1255-4f79-a02d-d1158360e6c9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:27.047167 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-47389bcd-f0b3-4652-86a3-645229ebb060 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] 10.222.0.24 "PUT /v2.0/floatingips/2bfa24c4-303f-42f5-95e8-b507145375bb HTTP/1.1" status: 200 len: 978 time: 1.6699681 Nov 09 04:35:27.047836 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58812) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:27.104025 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-9a048cc1-1255-4f79-a02d-d1158360e6c9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:27.146625 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9a048cc1-1255-4f79-a02d-d1158360e6c9 None None] Routers {'8ac82b1e-1b89-49c2-850a-e69a6d1163e6'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:27.149274 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-9a048cc1-1255-4f79-a02d-d1158360e6c9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:27.214218 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-5d02d6b9-2698-4e01-932e-d9538b6944ec tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Deleting port f3b070b7-662c-4247-8169-355f44d64fa8 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:35:27.220657 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-9a048cc1-1255-4f79-a02d-d1158360e6c9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:27.221651 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9a048cc1-1255-4f79-a02d-d1158360e6c9 None None] The sync data for ids ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:35:27.223165 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5d02d6b9-2698-4e01-932e-d9538b6944ec tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:27.270080 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-a68a512f-49d8-4691-b958-84e6fbb8e492 None None] Provisioning complete for port 1a74b864-c68d-4f11-bce5-6e04e0afa480 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:27.270474 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a68a512f-49d8-4691-b958-84e6fbb8e492 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:27.323965 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 16798627-ff6a-406f-9704-23d7e0ca012e up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:35:27.327688 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fbc16b6e-8b3f-4514-98e7-16cb8bc5bf8b None None] Network 14a51706-8086-4f7f-a920-416a3cf925d6 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:35:27.354017 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5d02d6b9-2698-4e01-932e-d9538b6944ec tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:27.379881 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-04bec9d7-70b1-43df-8815-1582e1418cbb tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Router c91b226a-420f-415f-839f-32317dea7a42 is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102161) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:35:27.530740 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 16798627-ff6a-406f-9704-23d7e0ca012e triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:27.531125 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:27.534552 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-1387e5ca-869b-4987-ba94-fb281b62822f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'name': 'tempest-TestNetworkBasicOps-router-1967773701', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.204'}], 'enable_snat': True}, 'gw_port_id': '49bff53a-c208-4aa5-8fcc-e7ec9471fae7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:33:32Z', 'updated_at': '2021-11-09T04:35:23Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '49bff53a-c208-4aa5-8fcc-e7ec9471fae7', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:85:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'device_owner': 'network:router_gateway', 'standard_attr_id': 978, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.204', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:33:34Z', 'updated_at': '2021-11-09T04:33:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '071d456d-45c8-43d6-9154-8dc9c2df29f2', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'floating_ip_address': '172.26.0.195', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'port_id': '09cbfb91-4118-43af-8b70-41d8d4265574', 'fixed_ip_address': '172.20.0.7', 'status': 'ACTIVE', 'standard_attr_id': 1062, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '239a9c72-6384-4d5a-a69d-f4ac0c580e40', 'mac_address': 'fa:16:3e:27:22:c9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f462374-376b-4c38-b300-528ae5358377', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:34:20Z', 'updated_at': '2021-11-09T04:34:25Z', 'revision_number': 1, 'project_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1a74b864-c68d-4f11-bce5-6e04e0afa480', 'name': '', 'network_id': '994f9071-b760-4d74-b91b-28777ec6b4e7', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:a5:16:b0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'device_owner': 'network:router_interface', 'standard_attr_id': 1185, 'fixed_ips': [{'subnet_id': 'c1f5ce70-ebae-4e4d-9de5-04a34e845fdb', 'ip_address': '172.20.0.17', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:22Z', 'updated_at': '2021-11-09T04:35:26Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': 'c1f5ce70-ebae-4e4d-9de5-04a34e845fdb', 'cidr': '172.20.0.16/28', 'gateway_ip': '172.20.0.17', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '9930d582-2262-4f1d-97bf-b02697a70777', 'name': '', 'network_id': '239a9c72-6384-4d5a-a69d-f4ac0c580e40', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:7c:21:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'device_owner': 'network:router_interface', 'standard_attr_id': 987, 'fixed_ips': [{'subnet_id': '33b5599d-7ebe-4564-9c72-76f5d540fd80', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:33:41Z', 'updated_at': '2021-11-09T04:33:48Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '33b5599d-7ebe-4564-9c72-76f5d540fd80', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:27.548394 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5d02d6b9-2698-4e01-932e-d9538b6944ec tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:27.548763 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5d02d6b9-2698-4e01-932e-d9538b6944ec tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:27.549523 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.l3_db [None req-5d02d6b9-2698-4e01-932e-d9538b6944ec tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Floating IP 2bfa24c4-303f-42f5-95e8-b507145375bb disassociated. External IP: 172.26.0.76, port: f3b070b7-662c-4247-8169-355f44d64fa8. Nov 09 04:35:27.549829 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-5d02d6b9-2698-4e01-932e-d9538b6944ec tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Calling delete_port for f3b070b7-662c-4247-8169-355f44d64fa8 owned by {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:35:27.610781 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1387e5ca-869b-4987-ba94-fb281b62822f None None] The sync data for ids ['d05416c2-0293-4ef5-a6e3-5968392cc774'] in dv-neutron-816802-2-hyperv is: [{'id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'name': 'tempest-TestNetworkBasicOps-router-1967773701', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.204'}], 'enable_snat': True}, 'gw_port_id': '49bff53a-c208-4aa5-8fcc-e7ec9471fae7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:33:32Z', 'updated_at': '2021-11-09T04:35:23Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '49bff53a-c208-4aa5-8fcc-e7ec9471fae7', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:85:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'device_owner': 'network:router_gateway', 'standard_attr_id': 978, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.204', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:33:34Z', 'updated_at': '2021-11-09T04:33:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '071d456d-45c8-43d6-9154-8dc9c2df29f2', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'floating_ip_address': '172.26.0.195', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'port_id': '09cbfb91-4118-43af-8b70-41d8d4265574', 'fixed_ip_address': '172.20.0.7', 'status': 'ACTIVE', 'standard_attr_id': 1062, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '239a9c72-6384-4d5a-a69d-f4ac0c580e40', 'mac_address': 'fa:16:3e:27:22:c9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f462374-376b-4c38-b300-528ae5358377', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:34:20Z', 'updated_at': '2021-11-09T04:34:25Z', 'revision_number': 1, 'project_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1a74b864-c68d-4f11-bce5-6e04e0afa480', 'name': '', 'network_id': '994f9071-b760-4d74-b91b-28777ec6b4e7', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:a5:16:b0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'device_owner': 'network:router_interface', 'standard_attr_id': 1185, 'fixed_ips': [{'subnet_id': 'c1f5ce70-ebae-4e4d-9de5-04a34e845fdb', 'ip_address': '172.20.0.17', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:22Z', 'updated_at': '2021-11-09T04:35:26Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': 'c1f5ce70-ebae-4e4d-9de5-04a34e845fdb', 'cidr': '172.20.0.16/28', 'gateway_ip': '172.20.0.17', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '9930d582-2262-4f1d-97bf-b02697a70777', 'name': '', 'network_id': '239a9c72-6384-4d5a-a69d-f4ac0c580e40', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:7c:21:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'device_owner': 'network:router_interface', 'standard_attr_id': 987, 'fixed_ips': [{'subnet_id': '33b5599d-7ebe-4564-9c72-76f5d540fd80', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:33:41Z', 'updated_at': '2021-11-09T04:33:48Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '33b5599d-7ebe-4564-9c72-76f5d540fd80', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:35:27.615820 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a68a512f-49d8-4691-b958-84e6fbb8e492 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:27.751409 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-a68a512f-49d8-4691-b958-84e6fbb8e492 None None] For port 1a74b864-c68d-4f11-bce5-6e04e0afa480, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=1a74b864-c68d-4f11-bce5-6e04e0afa480,segment=NetworkSegment(142b6494-b2b1-4cea-9b90-321c4a2a4cae),segment_id=142b6494-b2b1-4cea-9b90-321c4a2a4cae)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:35:27.802737 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:27.843131 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 16798627-ff6a-406f-9704-23d7e0ca012e, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=16798627-ff6a-406f-9704-23d7e0ca012e,segment=NetworkSegment(5009d787-03ba-44e2-873a-2de2a67aefaa),segment_id=5009d787-03ba-44e2-873a-2de2a67aefaa)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:35:27.847048 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a68a512f-49d8-4691-b958-84e6fbb8e492 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:27.847217 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5d02d6b9-2698-4e01-932e-d9538b6944ec tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:27.884605 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-04bec9d7-70b1-43df-8815-1582e1418cbb tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:35:27.900853 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-04bec9d7-70b1-43df-8815-1582e1418cbb tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "PUT /v2.0/routers/c91b226a-420f-415f-839f-32317dea7a42/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.7121952 Nov 09 04:35:27.901131 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c1995531-da1b-4436-8b8d-e458bac9a0bc None None] Sync routers for ids ['c91b226a-420f-415f-839f-32317dea7a42'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:35:27.901475 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58818) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:27.919009 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d02d6b9-2698-4e01-932e-d9538b6944ec tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Pushing event deleted for resources: {'Port': ['ID=f3b070b7-662c-4247-8169-355f44d64fa8,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:27.950951 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c1995531-da1b-4436-8b8d-e458bac9a0bc None None] Routers {'c91b226a-420f-415f-839f-32317dea7a42'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:27.951590 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-c1995531-da1b-4436-8b8d-e458bac9a0bc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['c91b226a-420f-415f-839f-32317dea7a42'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:27.953514 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a68a512f-49d8-4691-b958-84e6fbb8e492 None None] Pushing event updated for resources: {'Port': ['ID=1a74b864-c68d-4f11-bce5-6e04e0afa480,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:27.960402 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2a438bea-4ce9-487e-8ec2-9d84e4cb19ca tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:27.962021 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-2a438bea-4ce9-487e-8ec2-9d84e4cb19ca tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "GET /v2.0/ports/75ed34b7-564a-463e-a78c-2f0581be0830 HTTP/1.1" status: 200 len: 911 time: 0.0595524 Nov 09 04:35:27.964721 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58820) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:27.978220 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-c217609d-f87a-4e08-9274-e9b2decd66a6 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Request body: {'port': {'fixed_ips': [{'subnet_id': '8936c507-26b2-4943-9afe-a4f4bc6627ec'}]}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:35:28.002973 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:28.007613 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-c1995531-da1b-4436-8b8d-e458bac9a0bc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:28.072571 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-19d70dd8-2081-4a2e-9cf7-c5ba05336913 None None] Provisioning complete for port 16798627-ff6a-406f-9704-23d7e0ca012e triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:28.072910 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-19d70dd8-2081-4a2e-9cf7-c5ba05336913 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:28.079343 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c1995531-da1b-4436-8b8d-e458bac9a0bc None None] Routers {'c91b226a-420f-415f-839f-32317dea7a42'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:28.079999 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-c1995531-da1b-4436-8b8d-e458bac9a0bc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['c91b226a-420f-415f-839f-32317dea7a42'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:28.151979 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5d02d6b9-2698-4e01-932e-d9538b6944ec tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Router 8ac82b1e-1b89-49c2-850a-e69a6d1163e6 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:35:28.152348 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-c1995531-da1b-4436-8b8d-e458bac9a0bc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:28.154626 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c1995531-da1b-4436-8b8d-e458bac9a0bc None None] The sync data for ids ['c91b226a-420f-415f-839f-32317dea7a42'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:35:28.161433 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=16798627-ff6a-406f-9704-23d7e0ca012e,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:28.179880 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c217609d-f87a-4e08-9274-e9b2decd66a6 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:28.349070 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5d02d6b9-2698-4e01-932e-d9538b6944ec tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:35:28.368012 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-489d3228-7ba5-414a-8caa-b17298768a30 None None] Provisioning complete for port 75ed34b7-564a-463e-a78c-2f0581be0830 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:28.373530 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-489d3228-7ba5-414a-8caa-b17298768a30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:28.376013 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c77b6646-9865-454b-98db-19730c2edf67 None None] Sync routers for ids ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:35:28.392210 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c77b6646-9865-454b-98db-19730c2edf67 None None] Routers {'8ac82b1e-1b89-49c2-850a-e69a6d1163e6'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:28.392838 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-c77b6646-9865-454b-98db-19730c2edf67 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:28.448893 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-c77b6646-9865-454b-98db-19730c2edf67 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:28.453748 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-489d3228-7ba5-414a-8caa-b17298768a30 None None] Port 75ed34b7-564a-463e-a78c-2f0581be0830 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:35:28.467502 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c77b6646-9865-454b-98db-19730c2edf67 None None] Routers {'8ac82b1e-1b89-49c2-850a-e69a6d1163e6'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:28.468188 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-c77b6646-9865-454b-98db-19730c2edf67 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:28.480680 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-489d3228-7ba5-414a-8caa-b17298768a30 None None] Provisioning complete for port 16798627-ff6a-406f-9704-23d7e0ca012e triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:28.482170 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-489d3228-7ba5-414a-8caa-b17298768a30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:28.493344 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5d02d6b9-2698-4e01-932e-d9538b6944ec tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:28.499205 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-5d02d6b9-2698-4e01-932e-d9538b6944ec tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] 10.222.0.24 "DELETE /v2.0/ports/f3b070b7-662c-4247-8169-355f44d64fa8 HTTP/1.1" status: 204 len: 168 time: 1.4480059 Nov 09 04:35:28.500462 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58824) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:28.568375 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-781c3891-afef-4cf9-9934-8246f9762312 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] 10.222.0.24 "GET /v2.0/floatingips/2bfa24c4-303f-42f5-95e8-b507145375bb HTTP/1.1" status: 200 len: 687 time: 0.0644455 Nov 09 04:35:28.568643 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58826) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:28.675246 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-c77b6646-9865-454b-98db-19730c2edf67 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:28.676435 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c77b6646-9865-454b-98db-19730c2edf67 None None] The sync data for ids ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:35:28.694564 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c217609d-f87a-4e08-9274-e9b2decd66a6 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:28.741270 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-09f1e06f-6817-4bfc-a8a2-207ef4aaa05e None None] Provisioning complete for port 75ed34b7-564a-463e-a78c-2f0581be0830 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:28.741667 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-09f1e06f-6817-4bfc-a8a2-207ef4aaa05e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:28.744739 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-662c5d94-2e31-46f6-a148-1df46917386c tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Deleting port 99e84b14-3ac7-493c-9075-86adce5cc933 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:35:28.745082 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-662c5d94-2e31-46f6-a148-1df46917386c tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:28.781921 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-09f1e06f-6817-4bfc-a8a2-207ef4aaa05e None None] Port 75ed34b7-564a-463e-a78c-2f0581be0830 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:35:28.829142 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-662c5d94-2e31-46f6-a148-1df46917386c tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:28.829474 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-662c5d94-2e31-46f6-a148-1df46917386c tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:28.831375 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c217609d-f87a-4e08-9274-e9b2decd66a6 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:28.839527 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c217609d-f87a-4e08-9274-e9b2decd66a6 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:28.839527 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c217609d-f87a-4e08-9274-e9b2decd66a6 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:28.842571 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-662c5d94-2e31-46f6-a148-1df46917386c tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Calling delete_port for 99e84b14-3ac7-493c-9075-86adce5cc933 owned by network:floatingip {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:35:28.844119 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58828) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:28.844232 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-c217609d-f87a-4e08-9274-e9b2decd66a6 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "PUT /v2.0/ports/75ed34b7-564a-463e-a78c-2f0581be0830 HTTP/1.1" status: 200 len: 911 time: 0.8784094 Nov 09 04:35:28.893375 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c217609d-f87a-4e08-9274-e9b2decd66a6 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event updated for resources: {'Port': ['ID=75ed34b7-564a-463e-a78c-2f0581be0830,revision_number=3']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:28.912404 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e8f824a5-7121-449c-b4e4-38c7e53752fe None None] Provisioning complete for port 75ed34b7-564a-463e-a78c-2f0581be0830 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:28.912905 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e8f824a5-7121-449c-b4e4-38c7e53752fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:28.950443 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e8f824a5-7121-449c-b4e4-38c7e53752fe None None] Port 75ed34b7-564a-463e-a78c-2f0581be0830 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:35:29.256347 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6d9270e0-7373-458c-9d72-83fc7cb6de7e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:29.283077 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 16798627-ff6a-406f-9704-23d7e0ca012e up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:35:29.326167 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-662c5d94-2e31-46f6-a148-1df46917386c tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:29.338101 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 16798627-ff6a-406f-9704-23d7e0ca012e triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:29.338101 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:29.363316 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-662c5d94-2e31-46f6-a148-1df46917386c tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Pushing event deleted for resources: {'Port': ['ID=99e84b14-3ac7-493c-9075-86adce5cc933,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:29.480552 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-662c5d94-2e31-46f6-a148-1df46917386c tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for floatingip, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:29.483258 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-662c5d94-2e31-46f6-a148-1df46917386c tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:29.484465 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-662c5d94-2e31-46f6-a148-1df46917386c tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] 10.222.0.24 "DELETE /v2.0/floatingips/2bfa24c4-303f-42f5-95e8-b507145375bb HTTP/1.1" status: 204 len: 168 time: 0.9110432 Nov 09 04:35:29.488564 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58832) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:29.492691 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-fe6ebf52-6048-45b8-b04b-dd0884db6a28 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Request body: {'floatingip': {'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'port_id': '57f5ba4c-bda3-4726-a6dd-7358e44971c0'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:35:29.585304 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 1a74b864-c68d-4f11-bce5-6e04e0afa480 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:35:29.615523 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-6d9270e0-7373-458c-9d72-83fc7cb6de7e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Deleting port 75ed34b7-564a-463e-a78c-2f0581be0830 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:35:29.616171 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6d9270e0-7373-458c-9d72-83fc7cb6de7e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:29.637560 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 1a74b864-c68d-4f11-bce5-6e04e0afa480 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:29.638118 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:29.650707 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fe6ebf52-6048-45b8-b04b-dd0884db6a28 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for floatingip, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:29.772938 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6d9270e0-7373-458c-9d72-83fc7cb6de7e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:29.795914 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-6d9270e0-7373-458c-9d72-83fc7cb6de7e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Calling delete_port for 75ed34b7-564a-463e-a78c-2f0581be0830 owned by network:router_interface {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:35:29.878308 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fe6ebf52-6048-45b8-b04b-dd0884db6a28 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:30.075885 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-fe6ebf52-6048-45b8-b04b-dd0884db6a28 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Allocated IP 172.26.0.198 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/07bb452c-08af-4808-90fa-241606e190f1) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:35:30.170762 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6d9270e0-7373-458c-9d72-83fc7cb6de7e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:30.184614 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fe6ebf52-6048-45b8-b04b-dd0884db6a28 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:30.206110 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d9270e0-7373-458c-9d72-83fc7cb6de7e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event deleted for resources: {'Port': ['ID=75ed34b7-564a-463e-a78c-2f0581be0830,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:30.317895 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6d9270e0-7373-458c-9d72-83fc7cb6de7e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:30.404780 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fe6ebf52-6048-45b8-b04b-dd0884db6a28 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:30.455713 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fe6ebf52-6048-45b8-b04b-dd0884db6a28 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:35:30.489605 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-fe6ebf52-6048-45b8-b04b-dd0884db6a28 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:35:30.492066 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fe6ebf52-6048-45b8-b04b-dd0884db6a28 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:35:30.872504 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe6ebf52-6048-45b8-b04b-dd0884db6a28 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Pushing event updated for resources: {'Port': ['ID=07bb452c-08af-4808-90fa-241606e190f1,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:30.886160 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6d9270e0-7373-458c-9d72-83fc7cb6de7e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Router c91b226a-420f-415f-839f-32317dea7a42 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:35:31.014318 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6d9270e0-7373-458c-9d72-83fc7cb6de7e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:35:31.023475 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-6d9270e0-7373-458c-9d72-83fc7cb6de7e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "PUT /v2.0/routers/c91b226a-420f-415f-839f-32317dea7a42/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.1757777 Nov 09 04:35:31.023946 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58840) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:31.025957 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f2556351-6c6b-4b26-b0fc-2e93ebb6bb89 None None] Sync routers for ids ['c91b226a-420f-415f-839f-32317dea7a42'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:35:31.039476 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f2556351-6c6b-4b26-b0fc-2e93ebb6bb89 None None] Routers {'c91b226a-420f-415f-839f-32317dea7a42'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:31.040220 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-f2556351-6c6b-4b26-b0fc-2e93ebb6bb89 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['c91b226a-420f-415f-839f-32317dea7a42'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:31.061597 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-8a2a12a7-6c58-4329-844c-48399b7ce202 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "GET /v2.0/ports?device_id=c91b226a-420f-415f-839f-32317dea7a42 HTTP/1.1" status: 200 len: 205 time: 0.0324981 Nov 09 04:35:31.061970 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58842) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:31.077000 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-f2556351-6c6b-4b26-b0fc-2e93ebb6bb89 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:31.085144 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f2556351-6c6b-4b26-b0fc-2e93ebb6bb89 None None] Routers {'c91b226a-420f-415f-839f-32317dea7a42'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:31.085740 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-f2556351-6c6b-4b26-b0fc-2e93ebb6bb89 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['c91b226a-420f-415f-839f-32317dea7a42'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:31.117670 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-f2556351-6c6b-4b26-b0fc-2e93ebb6bb89 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:31.118318 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f2556351-6c6b-4b26-b0fc-2e93ebb6bb89 None None] The sync data for ids ['c91b226a-420f-415f-839f-32317dea7a42'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:35:31.138187 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c6a5697e-dc58-43c8-aa4b-ea51e255fe83 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for router, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:31.281491 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fe6ebf52-6048-45b8-b04b-dd0884db6a28 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:31.303854 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c6a5697e-dc58-43c8-aa4b-ea51e255fe83 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:31.305980 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c6a5697e-dc58-43c8-aa4b-ea51e255fe83 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:31.426839 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fe6ebf52-6048-45b8-b04b-dd0884db6a28 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:31.431218 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c6a5697e-dc58-43c8-aa4b-ea51e255fe83 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:31.431764 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c6a5697e-dc58-43c8-aa4b-ea51e255fe83 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Fanout notify agent at l3_agent the message router_deleted on router c91b226a-420f-415f-839f-32317dea7a42 {{(pid=102161) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:35:31.439994 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c6a5697e-dc58-43c8-aa4b-ea51e255fe83 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:31.439994 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-c6a5697e-dc58-43c8-aa4b-ea51e255fe83 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "DELETE /v2.0/routers/c91b226a-420f-415f-839f-32317dea7a42 HTTP/1.1" status: 204 len: 168 time: 0.3767710 Nov 09 04:35:31.442481 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58844) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:31.497169 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-d709f63c-e214-4520-8562-3e9e98b249a9 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Deleting subnet 8936c507-26b2-4943-9afe-a4f4bc6627ec {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:35:31.501032 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d709f63c-e214-4520-8562-3e9e98b249a9 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:31.546619 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d709f63c-e214-4520-8562-3e9e98b249a9 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:31.600142 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fe6ebf52-6048-45b8-b04b-dd0884db6a28 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:31.640235 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d709f63c-e214-4520-8562-3e9e98b249a9 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:31.659760 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fe6ebf52-6048-45b8-b04b-dd0884db6a28 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:31.761575 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe6ebf52-6048-45b8-b04b-dd0884db6a28 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Pushing event updated for resources: {'Port': ['ID=07bb452c-08af-4808-90fa-241606e190f1,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:31.774654 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fe6ebf52-6048-45b8-b04b-dd0884db6a28 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:31.779992 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d709f63c-e214-4520-8562-3e9e98b249a9 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:31.807584 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d709f63c-e214-4520-8562-3e9e98b249a9 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event deleted for resources: {'Subnet': ['ID=8936c507-26b2-4943-9afe-a4f4bc6627ec,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:31.811896 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d709f63c-e214-4520-8562-3e9e98b249a9 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:31.820547 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-d709f63c-e214-4520-8562-3e9e98b249a9 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "DELETE /v2.0/subnets/8936c507-26b2-4943-9afe-a4f4bc6627ec HTTP/1.1" status: 204 len: 168 time: 0.3742120 Nov 09 04:35:31.820547 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58856) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:31.820757 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b93cf3f5-9c7b-4a6c-82e7-2eb55ad46e3d None None] Network 14a51706-8086-4f7f-a920-416a3cf925d6 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:35:31.834845 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b3f2e4fb-b6cc-40bd-8c7b-c2d2918c873d req-67c2910b-1a30-4b92-8fc7-f1d7a1ba72e9 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1777462302&fields=id&tenant_id=f636e5f4c9f64f69ba3b2ab8816b6096 HTTP/1.1" status: 200 len: 267 time: 0.1419072 Nov 09 04:35:31.901137 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8f5d8bac-d42a-4257-8c67-8086540de065 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:31.955804 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-8f5d8bac-d42a-4257-8c67-8086540de065 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Deleting port 16798627-ff6a-406f-9704-23d7e0ca012e {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:35:31.956151 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8f5d8bac-d42a-4257-8c67-8086540de065 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:31.977015 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.l3_db [None req-fe6ebf52-6048-45b8-b04b-dd0884db6a28 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Floating IP 11262097-8bb4-43b3-9390-692ba9c4e353 associated. External IP: 172.26.0.198, port: 57f5ba4c-bda3-4726-a6dd-7358e44971c0. Nov 09 04:35:32.021432 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-8f5d8bac-d42a-4257-8c67-8086540de065 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] For port 16798627-ff6a-406f-9704-23d7e0ca012e, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=16798627-ff6a-406f-9704-23d7e0ca012e,segment=NetworkSegment(5009d787-03ba-44e2-873a-2de2a67aefaa),segment_id=5009d787-03ba-44e2-873a-2de2a67aefaa)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:35:32.021799 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8f5d8bac-d42a-4257-8c67-8086540de065 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:32.024882 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3f2e4fb-b6cc-40bd-8c7b-c2d2918c873d req-bb9a2ab5-60af-453e-8c19-0f91b10f1102 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:32.026329 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b3f2e4fb-b6cc-40bd-8c7b-c2d2918c873d req-bb9a2ab5-60af-453e-8c19-0f91b10f1102 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/networks?id=999b1b20-f8fc-4caf-84cc-3feda426a0bf HTTP/1.1" status: 200 len: 812 time: 0.1907210 Nov 09 04:35:32.038019 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b359f46b-5eb3-41ab-ac29-b04e3b733852 None None] DHCP port deletion for 14a51706-8086-4f7f-a920-416a3cf925d6 request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:35:32.041603 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-8f5d8bac-d42a-4257-8c67-8086540de065 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Calling delete_port for 16798627-ff6a-406f-9704-23d7e0ca012e owned by network:dhcp {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:35:32.053372 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b3f2e4fb-b6cc-40bd-8c7b-c2d2918c873d req-38619803-b47e-4f2d-abc4-f351fa3de20d tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/quotas/f636e5f4c9f64f69ba3b2ab8816b6096 HTTP/1.1" status: 200 len: 375 time: 0.0177393 Nov 09 04:35:32.085506 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-b359f46b-5eb3-41ab-ac29-b04e3b733852 None None] Deleting port 16798627-ff6a-406f-9704-23d7e0ca012e {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:35:32.086087 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b359f46b-5eb3-41ab-ac29-b04e3b733852 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:32.147099 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b3f2e4fb-b6cc-40bd-8c7b-c2d2918c873d req-3cbce161-9d65-4b3e-98f0-30685342183f tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?tenant_id=f636e5f4c9f64f69ba3b2ab8816b6096&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0605111 Nov 09 04:35:32.156936 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-b359f46b-5eb3-41ab-ac29-b04e3b733852 None None] For port 16798627-ff6a-406f-9704-23d7e0ca012e, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=16798627-ff6a-406f-9704-23d7e0ca012e,segment=NetworkSegment(5009d787-03ba-44e2-873a-2de2a67aefaa),segment_id=5009d787-03ba-44e2-873a-2de2a67aefaa)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:35:32.157337 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b359f46b-5eb3-41ab-ac29-b04e3b733852 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:32.171069 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-b359f46b-5eb3-41ab-ac29-b04e3b733852 None None] Calling delete_port for 16798627-ff6a-406f-9704-23d7e0ca012e owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:35:32.185681 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8f5d8bac-d42a-4257-8c67-8086540de065 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:32.213772 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f5d8bac-d42a-4257-8c67-8086540de065 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event deleted for resources: {'Port': ['ID=16798627-ff6a-406f-9704-23d7e0ca012e,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:32.216439 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8f5d8bac-d42a-4257-8c67-8086540de065 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] No DVR routers for this DVR port 16798627-ff6a-406f-9704-23d7e0ca012e on host dv-neutron-816802-2-hyperv {{(pid=102161) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:35:32.258967 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b359f46b-5eb3-41ab-ac29-b04e3b733852 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:32.289938 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b359f46b-5eb3-41ab-ac29-b04e3b733852 None None] Pushing event deleted for resources: {'Port': ['ID=16798627-ff6a-406f-9704-23d7e0ca012e,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:32.292793 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b359f46b-5eb3-41ab-ac29-b04e3b733852 None None] No DVR routers for this DVR port 16798627-ff6a-406f-9704-23d7e0ca012e on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:35:32.300275 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8f5d8bac-d42a-4257-8c67-8086540de065 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:32.327207 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-8f5d8bac-d42a-4257-8c67-8086540de065 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['14a51706-8086-4f7f-a920-416a3cf925d6']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:32.332623 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b3f2e4fb-b6cc-40bd-8c7b-c2d2918c873d req-b9644c96-cc7a-4056-a636-82ed7e15aa7b service neutron] 10.222.0.24 "GET /v2.0/networks/999b1b20-f8fc-4caf-84cc-3feda426a0bf?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1429334 Nov 09 04:35:32.336401 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fe6ebf52-6048-45b8-b04b-dd0884db6a28 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Router 8ac82b1e-1b89-49c2-850a-e69a6d1163e6 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:35:32.337296 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-8f5d8bac-d42a-4257-8c67-8086540de065 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5009d787-03ba-44e2-873a-2de2a67aefaa') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:32.337595 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-8f5d8bac-d42a-4257-8c67-8086540de065 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5009d787-03ba-44e2-873a-2de2a67aefaa') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:32.347529 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8f5d8bac-d42a-4257-8c67-8086540de065 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:32.360927 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8f5d8bac-d42a-4257-8c67-8086540de065 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:32.366737 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8f5d8bac-d42a-4257-8c67-8086540de065 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Releasing vlan 301 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:35:32.367119 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8f5d8bac-d42a-4257-8c67-8086540de065 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:32.370133 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:35:32.370133 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:35:32.370133 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:35:32.370133 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:35:32.370133 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:35:32.370133 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:35:32.370133 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:35:32.370133 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:35:32.370133 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:35:32.370133 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:35:32.370133 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:35:32.370133 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:35:32.370133 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:35:32.370133 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:35:32.370133 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:35:32.370133 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:35:32.370133 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:35:32.370133 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:35:32.370133 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:35:32.370133 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:35:32.370133 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:35:32.370133 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:35:32.370133 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:35:32.370133 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:35:32.370133 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:35:32.370133 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:35:32.370133 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:35:32.370133 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:35:32.370133 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:35:32.370133 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:35:32.370133 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:35:32.370133 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:35:32.497531 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b3f2e4fb-b6cc-40bd-8c7b-c2d2918c873d req-09ab5a11-5562-49e5-91ab-d55fba03c101 service neutron] 10.222.0.24 "GET /v2.0/networks/999b1b20-f8fc-4caf-84cc-3feda426a0bf?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1582737 Nov 09 04:35:32.513139 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fe6ebf52-6048-45b8-b04b-dd0884db6a28 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:35:32.522701 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-780266ed-1c34-41dc-8f77-8feffa596389 None None] Sync routers for ids ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:35:32.532903 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-780266ed-1c34-41dc-8f77-8feffa596389 None None] Routers {'8ac82b1e-1b89-49c2-850a-e69a6d1163e6'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:32.533654 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-780266ed-1c34-41dc-8f77-8feffa596389 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:32.549995 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8f5d8bac-d42a-4257-8c67-8086540de065 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:32.549995 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8f5d8bac-d42a-4257-8c67-8086540de065 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:32.552576 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-8f5d8bac-d42a-4257-8c67-8086540de065 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "DELETE /v2.0/networks/14a51706-8086-4f7f-a920-416a3cf925d6 HTTP/1.1" status: 204 len: 168 time: 0.7331710 Nov 09 04:35:32.557340 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58860) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:32.562982 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-7800a90d-7df1-4149-b04a-0d8acc516ebb tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-1491329762', 'external_gateway_info': {}, 'admin_state_up': True}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:35:32.569899 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f5d8bac-d42a-4257-8c67-8086540de065 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event deleted for resources: {'Network': ['ID=14a51706-8086-4f7f-a920-416a3cf925d6,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:32.587196 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-780266ed-1c34-41dc-8f77-8feffa596389 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:32.597259 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-780266ed-1c34-41dc-8f77-8feffa596389 None None] Routers {'8ac82b1e-1b89-49c2-850a-e69a6d1163e6'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:32.597856 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-780266ed-1c34-41dc-8f77-8feffa596389 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:32.624991 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fe6ebf52-6048-45b8-b04b-dd0884db6a28 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:32.635564 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-780266ed-1c34-41dc-8f77-8feffa596389 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:32.636299 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-780266ed-1c34-41dc-8f77-8feffa596389 None None] The sync data for ids ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:35:32.658594 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-fe6ebf52-6048-45b8-b04b-dd0884db6a28 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] 10.222.0.24 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 983 time: 3.1694310 Nov 09 04:35:32.663253 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58868) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:32.665877 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-6cd01c44-8f8e-4e6f-b295-ecb1d4c12550 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Request body: {'network': {'name': 'tempest-FloatingIPTestJSON-320996846'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:35:32.741096 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7800a90d-7df1-4149-b04a-0d8acc516ebb tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:32.742147 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7800a90d-7df1-4149-b04a-0d8acc516ebb tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:32.801958 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7800a90d-7df1-4149-b04a-0d8acc516ebb tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:32.911296 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6cd01c44-8f8e-4e6f-b295-ecb1d4c12550 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Made reservation on behalf of 459651e5af964f8c805d518a6dc3b464 for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:35:32.914854 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6cd01c44-8f8e-4e6f-b295-ecb1d4c12550 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:32.936353 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7800a90d-7df1-4149-b04a-0d8acc516ebb tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:32.944439 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6cd01c44-8f8e-4e6f-b295-ecb1d4c12550 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 344} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:35:32.957515 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6cd01c44-8f8e-4e6f-b295-ecb1d4c12550 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:32.961547 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-6cd01c44-8f8e-4e6f-b295-ecb1d4c12550 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Added segment d62aa6a0-ae2f-452d-83ae-e84d4bd37c6b of type vlan for network 18eae61d-c3c0-43a4-8106-007586adddc4 Nov 09 04:35:32.996663 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6cd01c44-8f8e-4e6f-b295-ecb1d4c12550 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:33.048441 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7800a90d-7df1-4149-b04a-0d8acc516ebb tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:33.049637 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-7800a90d-7df1-4149-b04a-0d8acc516ebb tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 703 time: 0.4911199 Nov 09 04:35:33.053991 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58870) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:33.057025 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-8bb82278-8fa4-44c1-922a-d2fd8d326442 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-1435222381'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:35:33.115188 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6cd01c44-8f8e-4e6f-b295-ecb1d4c12550 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:33.120855 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6cd01c44-8f8e-4e6f-b295-ecb1d4c12550 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:33.123103 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6cd01c44-8f8e-4e6f-b295-ecb1d4c12550 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:33.180762 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 16798627-ff6a-406f-9704-23d7e0ca012e no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:35:33.187365 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8bb82278-8fa4-44c1-922a-d2fd8d326442 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Made reservation on behalf of d11b025703b24d109deef7bfe57a45f6 for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:35:33.190824 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8bb82278-8fa4-44c1-922a-d2fd8d326442 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:33.206673 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 16798627-ff6a-406f-9704-23d7e0ca012e {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:35:33.207025 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 16798627-ff6a-406f-9704-23d7e0ca012e not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:35:33.210282 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cd01c44-8f8e-4e6f-b295-ecb1d4c12550 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Pushing event updated for resources: {'Network': ['ID=18eae61d-c3c0-43a4-8106-007586adddc4,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:33.225823 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8bb82278-8fa4-44c1-922a-d2fd8d326442 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 311} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:35:33.240411 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 18eae61d-c3c0-43a4-8106-007586adddc4 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:35:33.241585 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8bb82278-8fa4-44c1-922a-d2fd8d326442 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:33.245401 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-8bb82278-8fa4-44c1-922a-d2fd8d326442 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Added segment 38eba3d4-dbea-4df0-8bb8-d6738ea5872c of type vlan for network 0c466943-3298-4130-be72-d7c24549bd5d Nov 09 04:35:33.280179 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-6cd01c44-8f8e-4e6f-b295-ecb1d4c12550 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 0.6180687 Nov 09 04:35:33.284445 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58876) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:33.289413 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-90140292-c5b0-43a3-a2d7-ded2618ac1a9 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Request body: {'subnet': {'network_id': '18eae61d-c3c0-43a4-8106-007586adddc4', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:35:33.308759 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f6805a5d-14f3-4eb9-8ea2-d5fb4771994c req-6a4fa6dc-c58e-4500-9979-b54541f03d69 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=f0ae9486-80b5-43bd-acec-49f871c00e67 HTTP/1.1" status: 200 len: 210 time: 0.0513344 Nov 09 04:35:33.320333 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8bb82278-8fa4-44c1-922a-d2fd8d326442 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:33.486821 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8bb82278-8fa4-44c1-922a-d2fd8d326442 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:33.492460 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8bb82278-8fa4-44c1-922a-d2fd8d326442 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:33.493040 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8bb82278-8fa4-44c1-922a-d2fd8d326442 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:33.499120 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-90140292-c5b0-43a3-a2d7-ded2618ac1a9 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Made reservation on behalf of 459651e5af964f8c805d518a6dc3b464 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:35:33.502275 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-90140292-c5b0-43a3-a2d7-ded2618ac1a9 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:33.612880 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bb82278-8fa4-44c1-922a-d2fd8d326442 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event updated for resources: {'Network': ['ID=0c466943-3298-4130-be72-d7c24549bd5d,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:33.622753 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 0c466943-3298-4130-be72-d7c24549bd5d details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:35:33.676602 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-8bb82278-8fa4-44c1-922a-d2fd8d326442 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 770 time: 0.6232204 Nov 09 04:35:33.679422 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58882) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:33.684901 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-d8e08c9e-916d-4486-8a15-4472776af669 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Request body: {'subnet': {'network_id': '0c466943-3298-4130-be72-d7c24549bd5d', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:35:33.802799 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-90140292-c5b0-43a3-a2d7-ded2618ac1a9 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:33.831139 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d8e08c9e-916d-4486-8a15-4472776af669 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Made reservation on behalf of d11b025703b24d109deef7bfe57a45f6 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:35:33.834757 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d8e08c9e-916d-4486-8a15-4472776af669 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:33.861251 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90140292-c5b0-43a3-a2d7-ded2618ac1a9 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Pushing event updated for resources: {'Subnet': ['ID=3ad33066-d288-4e2f-b144-02102acb9c51,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:33.872012 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-90140292-c5b0-43a3-a2d7-ded2618ac1a9 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Checking segment: {'id': 'd62aa6a0-ae2f-452d-83ae-e84d4bd37c6b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 344, 'network_id': '18eae61d-c3c0-43a4-8106-007586adddc4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:35:33.872374 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-90140292-c5b0-43a3-a2d7-ded2618ac1a9 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Network hostable DHCP agents. Network: 18eae61d-c3c0-43a4-8106-007586adddc4, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:35:34.013065 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-90140292-c5b0-43a3-a2d7-ded2618ac1a9 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Network 18eae61d-c3c0-43a4-8106-007586adddc4 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:35:34.075478 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d8e08c9e-916d-4486-8a15-4472776af669 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:34.128313 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-90140292-c5b0-43a3-a2d7-ded2618ac1a9 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 18eae61d-c3c0-43a4-8106-007586adddc4) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:35:34.133293 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-90140292-c5b0-43a3-a2d7-ded2618ac1a9 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:34.133731 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-90140292-c5b0-43a3-a2d7-ded2618ac1a9 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:34.136959 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8e08c9e-916d-4486-8a15-4472776af669 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event updated for resources: {'Subnet': ['ID=0cd8bdb8-1377-46f0-ba25-14251b97253b,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:34.138173 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-25ebac75-081d-4f7b-9cfc-a4cb66abfb10 None None] Network 18eae61d-c3c0-43a4-8106-007586adddc4 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:35:34.149319 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d8e08c9e-916d-4486-8a15-4472776af669 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Checking segment: {'id': '38eba3d4-dbea-4df0-8bb8-d6738ea5872c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 311, 'network_id': '0c466943-3298-4130-be72-d7c24549bd5d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:35:34.149679 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d8e08c9e-916d-4486-8a15-4472776af669 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Network hostable DHCP agents. Network: 0c466943-3298-4130-be72-d7c24549bd5d, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:35:34.216880 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-90140292-c5b0-43a3-a2d7-ded2618ac1a9 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.9311988 Nov 09 04:35:34.219637 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58888) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:34.224559 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-8b8456dd-586b-42d7-8b13-e9fff278f0bb tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Request body: {'router': {'name': 'tempest-FloatingIPTestJSON-router-1704811634', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}, 'admin_state_up': False}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:35:34.245332 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d8e08c9e-916d-4486-8a15-4472776af669 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Network 0c466943-3298-4130-be72-d7c24549bd5d is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:35:34.256840 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-d8e08c9e-916d-4486-8a15-4472776af669 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 0c466943-3298-4130-be72-d7c24549bd5d) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:35:34.261750 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d8e08c9e-916d-4486-8a15-4472776af669 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:34.262409 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d8e08c9e-916d-4486-8a15-4472776af669 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:34.280441 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-45c8404c-5080-4c3b-8051-0eeb6d6290c5 None None] Network 0c466943-3298-4130-be72-d7c24549bd5d requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:35:34.300189 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5a4620ca-da5e-49dd-9691-0b6787a074f0 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-18eae61d-c3c0-43a4-8106-007586adddc4', 'network_id': '18eae61d-c3c0-43a4-8106-007586adddc4', 'tenant_id': '459651e5af964f8c805d518a6dc3b464', 'fixed_ips': [{'subnet_id': '3ad33066-d288-4e2f-b144-02102acb9c51'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:35:34.301019 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5a4620ca-da5e-49dd-9691-0b6787a074f0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:34.329490 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8b8456dd-586b-42d7-8b13-e9fff278f0bb tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:34.330574 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8b8456dd-586b-42d7-8b13-e9fff278f0bb tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:34.391108 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8b8456dd-586b-42d7-8b13-e9fff278f0bb tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:34.392036 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6b8ef8ba-b5a8-4b13-bd6c-af01a9918b6a req-e0435f67-8fe4-42ce-9dba-f61e45657bbd tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=f0ae9486-80b5-43bd-acec-49f871c00e67 HTTP/1.1" status: 200 len: 210 time: 0.0360966 Nov 09 04:35:34.395466 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-d8e08c9e-916d-4486-8a15-4472776af669 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.7149231 Nov 09 04:35:34.402326 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58892) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:34.533684 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-5a4620ca-da5e-49dd-9691-0b6787a074f0 None None] Allocated IP 172.20.0.2 (18eae61d-c3c0-43a4-8106-007586adddc4/3ad33066-d288-4e2f-b144-02102acb9c51/d50019d6-22fd-4b25-a545-4133e1f62709) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:35:34.548345 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cae4719b-4cbe-482c-ade4-62c4ed6232ad None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-0c466943-3298-4130-be72-d7c24549bd5d', 'network_id': '0c466943-3298-4130-be72-d7c24549bd5d', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'fixed_ips': [{'subnet_id': '0cd8bdb8-1377-46f0-ba25-14251b97253b'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:35:34.549237 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-cae4719b-4cbe-482c-ade4-62c4ed6232ad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:34.713619 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8b8456dd-586b-42d7-8b13-e9fff278f0bb tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:34.779265 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-cae4719b-4cbe-482c-ade4-62c4ed6232ad None None] Allocated IP 2001:db8::2 (0c466943-3298-4130-be72-d7c24549bd5d/0cd8bdb8-1377-46f0-ba25-14251b97253b/1ac1d36b-a9ad-4497-aa5a-facfbb4ab1d6) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:35:34.797412 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5a4620ca-da5e-49dd-9691-0b6787a074f0 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:34.868698 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-167ab792-40b8-48f5-9827-e2a13da3869d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:34.891383 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5a4620ca-da5e-49dd-9691-0b6787a074f0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:34.974221 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5a4620ca-da5e-49dd-9691-0b6787a074f0 None None] Network 18eae61d-c3c0-43a4-8106-007586adddc4 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:35:34.985876 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-5a4620ca-da5e-49dd-9691-0b6787a074f0 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:35:34.995990 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5a4620ca-da5e-49dd-9691-0b6787a074f0 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:35:35.005880 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a4620ca-da5e-49dd-9691-0b6787a074f0 None None] Pushing event updated for resources: {'Port': ['ID=d50019d6-22fd-4b25-a545-4133e1f62709,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:35.017415 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-cae4719b-4cbe-482c-ade4-62c4ed6232ad None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:35.063534 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-5a4620ca-da5e-49dd-9691-0b6787a074f0 None None] Attempting to bind port d50019d6-22fd-4b25-a545-4133e1f62709 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:35:35.063993 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-5a4620ca-da5e-49dd-9691-0b6787a074f0 None None] Attempting to bind port d50019d6-22fd-4b25-a545-4133e1f62709 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'd62aa6a0-ae2f-452d-83ae-e84d4bd37c6b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 344, 'network_id': '18eae61d-c3c0-43a4-8106-007586adddc4'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:35:35.064402 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5a4620ca-da5e-49dd-9691-0b6787a074f0 None None] Attempting to bind port d50019d6-22fd-4b25-a545-4133e1f62709 on network 18eae61d-c3c0-43a4-8106-007586adddc4 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:35:35.069771 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5a4620ca-da5e-49dd-9691-0b6787a074f0 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 35, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:35:35.070133 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5a4620ca-da5e-49dd-9691-0b6787a074f0 None None] Checking segment: {'id': 'd62aa6a0-ae2f-452d-83ae-e84d4bd37c6b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 344, 'network_id': '18eae61d-c3c0-43a4-8106-007586adddc4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:35:35.070547 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5a4620ca-da5e-49dd-9691-0b6787a074f0 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:35.070926 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5a4620ca-da5e-49dd-9691-0b6787a074f0 None None] Bound using segment: {'id': 'd62aa6a0-ae2f-452d-83ae-e84d4bd37c6b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 344, 'network_id': '18eae61d-c3c0-43a4-8106-007586adddc4'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:35:35.071569 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-5a4620ca-da5e-49dd-9691-0b6787a074f0 None None] Bound port: d50019d6-22fd-4b25-a545-4133e1f62709, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd62aa6a0-ae2f-452d-83ae-e84d4bd37c6b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 344, 'network_id': '18eae61d-c3c0-43a4-8106-007586adddc4'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:35:35.071886 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5a4620ca-da5e-49dd-9691-0b6787a074f0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:35.076278 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-cae4719b-4cbe-482c-ade4-62c4ed6232ad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:35.143031 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cae4719b-4cbe-482c-ade4-62c4ed6232ad None None] Network 0c466943-3298-4130-be72-d7c24549bd5d is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:35:35.155915 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-cae4719b-4cbe-482c-ade4-62c4ed6232ad None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:35:35.158578 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cae4719b-4cbe-482c-ade4-62c4ed6232ad None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:35:35.176058 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cae4719b-4cbe-482c-ade4-62c4ed6232ad None None] Pushing event updated for resources: {'Port': ['ID=1ac1d36b-a9ad-4497-aa5a-facfbb4ab1d6,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:35.223967 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-5a4620ca-da5e-49dd-9691-0b6787a074f0 None None] For port d50019d6-22fd-4b25-a545-4133e1f62709, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:35:35.242762 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-5a4620ca-da5e-49dd-9691-0b6787a074f0 None None] For port d50019d6-22fd-4b25-a545-4133e1f62709, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=d50019d6-22fd-4b25-a545-4133e1f62709,segment=NetworkSegment(d62aa6a0-ae2f-452d-83ae-e84d4bd37c6b),segment_id=d62aa6a0-ae2f-452d-83ae-e84d4bd37c6b)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:35:35.243830 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-cae4719b-4cbe-482c-ade4-62c4ed6232ad None None] Attempting to bind port 1ac1d36b-a9ad-4497-aa5a-facfbb4ab1d6 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:35:35.244191 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-cae4719b-4cbe-482c-ade4-62c4ed6232ad None None] Attempting to bind port 1ac1d36b-a9ad-4497-aa5a-facfbb4ab1d6 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '38eba3d4-dbea-4df0-8bb8-d6738ea5872c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 311, 'network_id': '0c466943-3298-4130-be72-d7c24549bd5d'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:35:35.244546 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cae4719b-4cbe-482c-ade4-62c4ed6232ad None None] Attempting to bind port 1ac1d36b-a9ad-4497-aa5a-facfbb4ab1d6 on network 0c466943-3298-4130-be72-d7c24549bd5d {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:35:35.250042 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cae4719b-4cbe-482c-ade4-62c4ed6232ad None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 35, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:35:35.250439 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cae4719b-4cbe-482c-ade4-62c4ed6232ad None None] Checking segment: {'id': '38eba3d4-dbea-4df0-8bb8-d6738ea5872c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 311, 'network_id': '0c466943-3298-4130-be72-d7c24549bd5d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:35:35.250829 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-cae4719b-4cbe-482c-ade4-62c4ed6232ad None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:35.251215 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cae4719b-4cbe-482c-ade4-62c4ed6232ad None None] Bound using segment: {'id': '38eba3d4-dbea-4df0-8bb8-d6738ea5872c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 311, 'network_id': '0c466943-3298-4130-be72-d7c24549bd5d'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:35:35.251671 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-cae4719b-4cbe-482c-ade4-62c4ed6232ad None None] Bound port: 1ac1d36b-a9ad-4497-aa5a-facfbb4ab1d6, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '38eba3d4-dbea-4df0-8bb8-d6738ea5872c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 311, 'network_id': '0c466943-3298-4130-be72-d7c24549bd5d'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:35:35.252045 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-cae4719b-4cbe-482c-ade4-62c4ed6232ad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:35.256566 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8b8456dd-586b-42d7-8b13-e9fff278f0bb tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for router_gateway, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:35.281190 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-167ab792-40b8-48f5-9827-e2a13da3869d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Allocated IP 2001:db8::1 (0c466943-3298-4130-be72-d7c24549bd5d/0cd8bdb8-1377-46f0-ba25-14251b97253b/5a28daa1-7cdd-49a3-aad4-ecd643914dfd) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:35:35.284166 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8b8456dd-586b-42d7-8b13-e9fff278f0bb tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:35.311308 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5a4620ca-da5e-49dd-9691-0b6787a074f0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:35.352880 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-cae4719b-4cbe-482c-ade4-62c4ed6232ad None None] For port 1ac1d36b-a9ad-4497-aa5a-facfbb4ab1d6, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:35:35.379155 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-cae4719b-4cbe-482c-ade4-62c4ed6232ad None None] For port 1ac1d36b-a9ad-4497-aa5a-facfbb4ab1d6, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=1ac1d36b-a9ad-4497-aa5a-facfbb4ab1d6,segment=NetworkSegment(38eba3d4-dbea-4df0-8bb8-d6738ea5872c),segment_id=38eba3d4-dbea-4df0-8bb8-d6738ea5872c)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:35:35.393038 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a4620ca-da5e-49dd-9691-0b6787a074f0 None None] Pushing event updated for resources: {'Port': ['ID=d50019d6-22fd-4b25-a545-4133e1f62709,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:35.443769 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-cae4719b-4cbe-482c-ade4-62c4ed6232ad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:35.488475 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-8b8456dd-586b-42d7-8b13-e9fff278f0bb tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Allocated IP 172.26.0.55 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/a99ea6c5-e4c1-42bf-a957-2bc0083dd72b) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:35:35.499252 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-167ab792-40b8-48f5-9827-e2a13da3869d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:35.537325 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cae4719b-4cbe-482c-ade4-62c4ed6232ad None None] Pushing event updated for resources: {'Port': ['ID=1ac1d36b-a9ad-4497-aa5a-facfbb4ab1d6,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:35.566733 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b35ea4b2-da50-4083-9256-2e5c86bde433 req-be6b12bd-1be9-4324-b298-e6c40154bb58 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=f0ae9486-80b5-43bd-acec-49f871c00e67 HTTP/1.1" status: 200 len: 210 time: 0.0671799 Nov 09 04:35:35.666659 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3f2e4fb-b6cc-40bd-8c7b-c2d2918c873d req-c34b1222-e0bd-42bf-999b-9691a11e59d3 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:35.671362 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b3f2e4fb-b6cc-40bd-8c7b-c2d2918c873d req-c34b1222-e0bd-42bf-999b-9691a11e59d3 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.26 "GET /v2.0/networks?id=999b1b20-f8fc-4caf-84cc-3feda426a0bf HTTP/1.1" status: 200 len: 812 time: 0.2369156 Nov 09 04:35:35.711979 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8b8456dd-586b-42d7-8b13-e9fff278f0bb tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:35.774824 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-167ab792-40b8-48f5-9827-e2a13da3869d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:35.793983 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b3f2e4fb-b6cc-40bd-8c7b-c2d2918c873d req-434ec930-d50c-489d-b97a-c55a5e71c159 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.26 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=f636e5f4c9f64f69ba3b2ab8816b6096 HTTP/1.1" status: 200 len: 380 time: 0.1056559 Nov 09 04:35:35.819835 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-b3f2e4fb-b6cc-40bd-8c7b-c2d2918c873d req-c267ba81-7a48-47bf-a963-7e3468dee1d1 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Request body: {'port': {'device_id': 'f0ae9486-80b5-43bd-acec-49f871c00e67', 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf', 'admin_state_up': True, 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'security_groups': ['3fac99c0-db5e-4deb-ae03-d7c28ceb1106']}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:35:35.831795 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-167ab792-40b8-48f5-9827-e2a13da3869d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Network 0c466943-3298-4130-be72-d7c24549bd5d is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:35:35.839182 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8b8456dd-586b-42d7-8b13-e9fff278f0bb tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:35.841284 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-167ab792-40b8-48f5-9827-e2a13da3869d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:35:35.844509 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-167ab792-40b8-48f5-9827-e2a13da3869d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:35:35.845374 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-167ab792-40b8-48f5-9827-e2a13da3869d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:35.898011 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-167ab792-40b8-48f5-9827-e2a13da3869d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event updated for resources: {'Port': ['ID=5a28daa1-7cdd-49a3-aad4-ecd643914dfd,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:35.966928 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8b8456dd-586b-42d7-8b13-e9fff278f0bb tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:35:35.976445 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-8b8456dd-586b-42d7-8b13-e9fff278f0bb tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:35:35.981735 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8b8456dd-586b-42d7-8b13-e9fff278f0bb tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:35:36.010127 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b8456dd-586b-42d7-8b13-e9fff278f0bb tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Pushing event updated for resources: {'Port': ['ID=a99ea6c5-e4c1-42bf-a957-2bc0083dd72b,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:36.053923 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b3f2e4fb-b6cc-40bd-8c7b-c2d2918c873d req-c267ba81-7a48-47bf-a963-7e3468dee1d1 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Made reservation on behalf of f636e5f4c9f64f69ba3b2ab8816b6096 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:35:36.057475 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-b3f2e4fb-b6cc-40bd-8c7b-c2d2918c873d req-c267ba81-7a48-47bf-a963-7e3468dee1d1 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:36.165953 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-167ab792-40b8-48f5-9827-e2a13da3869d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:36.212884 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [req-b3f2e4fb-b6cc-40bd-8c7b-c2d2918c873d req-c267ba81-7a48-47bf-a963-7e3468dee1d1 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Allocated IP 172.20.0.7 (999b1b20-f8fc-4caf-84cc-3feda426a0bf/f6a08667-654b-4e0c-9f85-c6e6712cc239/d4753771-ff46-428e-9ad0-3dce1a15a45f) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:35:36.411987 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-b3f2e4fb-b6cc-40bd-8c7b-c2d2918c873d req-c267ba81-7a48-47bf-a963-7e3468dee1d1 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:36.506503 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-b3f2e4fb-b6cc-40bd-8c7b-c2d2918c873d req-c267ba81-7a48-47bf-a963-7e3468dee1d1 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:36.567609 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b3f2e4fb-b6cc-40bd-8c7b-c2d2918c873d req-c267ba81-7a48-47bf-a963-7e3468dee1d1 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Network 999b1b20-f8fc-4caf-84cc-3feda426a0bf is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:35:36.572150 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [req-b3f2e4fb-b6cc-40bd-8c7b-c2d2918c873d req-c267ba81-7a48-47bf-a963-7e3468dee1d1 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:35:36.577863 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-b3f2e4fb-b6cc-40bd-8c7b-c2d2918c873d req-c267ba81-7a48-47bf-a963-7e3468dee1d1 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:35:36.628567 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c267ba81-7a48-47bf-a963-7e3468dee1d1 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Pushing event updated for resources: {'Port': ['ID=d4753771-ff46-428e-9ad0-3dce1a15a45f,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:36.668405 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3f2e4fb-b6cc-40bd-8c7b-c2d2918c873d req-c267ba81-7a48-47bf-a963-7e3468dee1d1 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:36.669178 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-b3f2e4fb-b6cc-40bd-8c7b-c2d2918c873d req-c267ba81-7a48-47bf-a963-7e3468dee1d1 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:36.752290 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c7bf6f58-8014-447d-8bd6-551ab4ae9ef0 None None] Network 18eae61d-c3c0-43a4-8106-007586adddc4 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:35:36.777507 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b3f2e4fb-b6cc-40bd-8c7b-c2d2918c873d req-c267ba81-7a48-47bf-a963-7e3468dee1d1 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.26 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.9615686 Nov 09 04:35:36.812270 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0aaf8e2-8d91-495c-9b17-cc1a1b6033f0 req-02227199-780c-48ca-a080-0a39fce924ae tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:36.826682 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d0aaf8e2-8d91-495c-9b17-cc1a1b6033f0 req-02227199-780c-48ca-a080-0a39fce924ae tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=f0ae9486-80b5-43bd-acec-49f871c00e67 HTTP/1.1" status: 200 len: 931 time: 0.1052654 Nov 09 04:35:36.840919 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-b3f2e4fb-b6cc-40bd-8c7b-c2d2918c873d req-066b5ef1-04f8-495c-a15d-b6c8fc277024 service neutron] Request body: {'port': {'device_id': 'f0ae9486-80b5-43bd-acec-49f871c00e67', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:35:36.988408 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-d882e176-c9b0-4827-a2a2-8aadc0825061 None None] Provisioning complete for port d50019d6-22fd-4b25-a545-4133e1f62709 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:36.988847 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d882e176-c9b0-4827-a2a2-8aadc0825061 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:36.996142 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8b8456dd-586b-42d7-8b13-e9fff278f0bb tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for router_gateway, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:37.000541 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d0aaf8e2-8d91-495c-9b17-cc1a1b6033f0 req-5268c642-5351-41c8-8ae8-8ffe5d61954a tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1726391 Nov 09 04:35:37.014404 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-b3f2e4fb-b6cc-40bd-8c7b-c2d2918c873d req-066b5ef1-04f8-495c-a15d-b6c8fc277024 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:37.097868 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d882e176-c9b0-4827-a2a2-8aadc0825061 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:37.102643 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-167ab792-40b8-48f5-9827-e2a13da3869d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:37.221386 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-167ab792-40b8-48f5-9827-e2a13da3869d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:37.222488 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-167ab792-40b8-48f5-9827-e2a13da3869d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:37.398174 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-167ab792-40b8-48f5-9827-e2a13da3869d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event updated for resources: {'Port': ['ID=5a28daa1-7cdd-49a3-aad4-ecd643914dfd,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:37.434305 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-d882e176-c9b0-4827-a2a2-8aadc0825061 None None] For port d50019d6-22fd-4b25-a545-4133e1f62709, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=d50019d6-22fd-4b25-a545-4133e1f62709,segment=NetworkSegment(d62aa6a0-ae2f-452d-83ae-e84d4bd37c6b),segment_id=d62aa6a0-ae2f-452d-83ae-e84d4bd37c6b)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:35:37.437788 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-926bebe5-d871-444e-b065-fe3002d2084f None None] Network 0c466943-3298-4130-be72-d7c24549bd5d requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:35:37.439479 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 1ac1d36b-a9ad-4497-aa5a-facfbb4ab1d6 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:35:37.559666 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [req-b3f2e4fb-b6cc-40bd-8c7b-c2d2918c873d req-066b5ef1-04f8-495c-a15d-b6c8fc277024 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d4753771-ff46-428e-9ad0-3dce1a15a45f {{(pid=102162) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:35:37.568732 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-b3f2e4fb-b6cc-40bd-8c7b-c2d2918c873d req-066b5ef1-04f8-495c-a15d-b6c8fc277024 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:37.580996 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d882e176-c9b0-4827-a2a2-8aadc0825061 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:37.602808 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8b8456dd-586b-42d7-8b13-e9fff278f0bb tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:37.610858 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.provisioning_blocks [req-b3f2e4fb-b6cc-40bd-8c7b-c2d2918c873d req-066b5ef1-04f8-495c-a15d-b6c8fc277024 service neutron] Transition to ACTIVE for port object d4753771-ff46-428e-9ad0-3dce1a15a45f will not be triggered until provisioned by entity L2. {{(pid=102162) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 09 04:35:37.653600 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-167ab792-40b8-48f5-9827-e2a13da3869d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Network 0c466943-3298-4130-be72-d7c24549bd5d is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:35:37.658063 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-167ab792-40b8-48f5-9827-e2a13da3869d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:35:37.686953 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d882e176-c9b0-4827-a2a2-8aadc0825061 None None] Pushing event updated for resources: {'Port': ['ID=d50019d6-22fd-4b25-a545-4133e1f62709,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:37.698558 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-b3f2e4fb-b6cc-40bd-8c7b-c2d2918c873d req-066b5ef1-04f8-495c-a15d-b6c8fc277024 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:37.729222 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 1ac1d36b-a9ad-4497-aa5a-facfbb4ab1d6 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:37.729588 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:37.774889 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-64a47dfd-bdc0-41c2-b855-3a043f2f3945 None None] Provisioning complete for port d50019d6-22fd-4b25-a545-4133e1f62709 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:37.775550 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-64a47dfd-bdc0-41c2-b855-3a043f2f3945 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:37.796949 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-066b5ef1-04f8-495c-a15d-b6c8fc277024 service neutron] Pushing event updated for resources: {'Port': ['ID=d4753771-ff46-428e-9ad0-3dce1a15a45f,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:37.922388 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8b8456dd-586b-42d7-8b13-e9fff278f0bb tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Router f961f4f5-6f17-45e1-91f0-ed3a6c4e8ad7 is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102161) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:35:37.991984 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-b3f2e4fb-b6cc-40bd-8c7b-c2d2918c873d req-066b5ef1-04f8-495c-a15d-b6c8fc277024 service neutron] Attempting to bind port d4753771-ff46-428e-9ad0-3dce1a15a45f on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:35:37.992352 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-b3f2e4fb-b6cc-40bd-8c7b-c2d2918c873d req-066b5ef1-04f8-495c-a15d-b6c8fc277024 service neutron] Attempting to bind port d4753771-ff46-428e-9ad0-3dce1a15a45f by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'bc4577c9-06a5-450a-9c80-879827986f04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:35:37.992647 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b3f2e4fb-b6cc-40bd-8c7b-c2d2918c873d req-066b5ef1-04f8-495c-a15d-b6c8fc277024 service neutron] Attempting to bind port d4753771-ff46-428e-9ad0-3dce1a15a45f on network 999b1b20-f8fc-4caf-84cc-3feda426a0bf {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:35:38.002229 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b3f2e4fb-b6cc-40bd-8c7b-c2d2918c873d req-066b5ef1-04f8-495c-a15d-b6c8fc277024 service neutron] Port d4753771-ff46-428e-9ad0-3dce1a15a45f on network 999b1b20-f8fc-4caf-84cc-3feda426a0bf not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:35:38.002600 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b3f2e4fb-b6cc-40bd-8c7b-c2d2918c873d req-066b5ef1-04f8-495c-a15d-b6c8fc277024 service neutron] Attempting to bind port d4753771-ff46-428e-9ad0-3dce1a15a45f on network 999b1b20-f8fc-4caf-84cc-3feda426a0bf {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:35:38.011367 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-167ab792-40b8-48f5-9827-e2a13da3869d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Router 7b9a51f0-889c-418d-bc8a-fcfd303c5053 is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102161) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:35:38.012650 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b3f2e4fb-b6cc-40bd-8c7b-c2d2918c873d req-066b5ef1-04f8-495c-a15d-b6c8fc277024 service neutron] Checking agent: {'id': '7d36b884-4ad2-4878-9464-bf647030b544', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'started_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 35, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:35:38.012993 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b3f2e4fb-b6cc-40bd-8c7b-c2d2918c873d req-066b5ef1-04f8-495c-a15d-b6c8fc277024 service neutron] Checking segment: {'id': 'bc4577c9-06a5-450a-9c80-879827986f04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:35:38.013382 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b3f2e4fb-b6cc-40bd-8c7b-c2d2918c873d req-066b5ef1-04f8-495c-a15d-b6c8fc277024 service neutron] Bound using segment: {'id': 'bc4577c9-06a5-450a-9c80-879827986f04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf'} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:35:38.013816 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-b3f2e4fb-b6cc-40bd-8c7b-c2d2918c873d req-066b5ef1-04f8-495c-a15d-b6c8fc277024 service neutron] Bound port: d4753771-ff46-428e-9ad0-3dce1a15a45f, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'bc4577c9-06a5-450a-9c80-879827986f04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf'}}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:35:38.014172 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-b3f2e4fb-b6cc-40bd-8c7b-c2d2918c873d req-066b5ef1-04f8-495c-a15d-b6c8fc277024 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:38.031959 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:38.126118 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-64a47dfd-bdc0-41c2-b855-3a043f2f3945 None None] Provisioning complete for port 1ac1d36b-a9ad-4497-aa5a-facfbb4ab1d6 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:38.126760 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-64a47dfd-bdc0-41c2-b855-3a043f2f3945 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:38.129698 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 1ac1d36b-a9ad-4497-aa5a-facfbb4ab1d6, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=1ac1d36b-a9ad-4497-aa5a-facfbb4ab1d6,segment=NetworkSegment(38eba3d4-dbea-4df0-8bb8-d6738ea5872c),segment_id=38eba3d4-dbea-4df0-8bb8-d6738ea5872c)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:35:38.135422 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-b3f2e4fb-b6cc-40bd-8c7b-c2d2918c873d req-066b5ef1-04f8-495c-a15d-b6c8fc277024 service neutron] For port d4753771-ff46-428e-9ad0-3dce1a15a45f, host hv-neutron-8168, cleared binding levels {{(pid=102162) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:35:38.139941 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-b3f2e4fb-b6cc-40bd-8c7b-c2d2918c873d req-066b5ef1-04f8-495c-a15d-b6c8fc277024 service neutron] For port d4753771-ff46-428e-9ad0-3dce1a15a45f, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=d4753771-ff46-428e-9ad0-3dce1a15a45f,segment=NetworkSegment(bc4577c9-06a5-450a-9c80-879827986f04),segment_id=bc4577c9-06a5-450a-9c80-879827986f04)] {{(pid=102162) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:35:38.231293 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-64a47dfd-bdc0-41c2-b855-3a043f2f3945 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:38.234275 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:38.235431 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device d50019d6-22fd-4b25-a545-4133e1f62709 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:35:38.249377 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-b3f2e4fb-b6cc-40bd-8c7b-c2d2918c873d req-066b5ef1-04f8-495c-a15d-b6c8fc277024 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:38.269561 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-167ab792-40b8-48f5-9827-e2a13da3869d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:35:38.284668 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-167ab792-40b8-48f5-9827-e2a13da3869d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "PUT /v2.0/routers/7b9a51f0-889c-418d-bc8a-fcfd303c5053/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.8827534 Nov 09 04:35:38.286059 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58904) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:38.291177 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-a05b5903-a811-4cfb-b303-1b96d7303e11 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-1086882869'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:35:38.297459 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c5633e0c-c479-4e5a-a127-5d5260b5e282 None None] Sync routers for ids ['7b9a51f0-889c-418d-bc8a-fcfd303c5053'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:35:38.297838 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8b8456dd-586b-42d7-8b13-e9fff278f0bb tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:35:38.330104 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5fe779a3-75bc-4401-9e6d-f4f6b283a407 None None] Sync routers for ids ['f961f4f5-6f17-45e1-91f0-ed3a6c4e8ad7'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:35:38.342835 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3f2e4fb-b6cc-40bd-8c7b-c2d2918c873d req-066b5ef1-04f8-495c-a15d-b6c8fc277024 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:38.342835 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-b3f2e4fb-b6cc-40bd-8c7b-c2d2918c873d req-066b5ef1-04f8-495c-a15d-b6c8fc277024 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:38.344226 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b3f2e4fb-b6cc-40bd-8c7b-c2d2918c873d req-066b5ef1-04f8-495c-a15d-b6c8fc277024 service neutron] 10.222.0.26 "PUT /v2.0/ports/d4753771-ff46-428e-9ad0-3dce1a15a45f HTTP/1.1" status: 200 len: 1093 time: 1.5086954 Nov 09 04:35:38.344705 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f0ae9486-80b5-43bd-acec-49f871c00e67', 'tag': 'd4753771-ff46-428e-9ad0-3dce1a15a45f'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:35:38.346034 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5fe779a3-75bc-4401-9e6d-f4f6b283a407 None None] Routers {'f961f4f5-6f17-45e1-91f0-ed3a6c4e8ad7'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:38.348615 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c406fd35-4220-4a33-8486-470b322bfdb9" -d '{"events": [{"name": "network-changed", "server_uuid": "f0ae9486-80b5-43bd-acec-49f871c00e67", "tag": "d4753771-ff46-428e-9ad0-3dce1a15a45f"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:35:38.349585 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-5fe779a3-75bc-4401-9e6d-f4f6b283a407 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['f961f4f5-6f17-45e1-91f0-ed3a6c4e8ad7'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:38.355455 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a812117c-ba75-4384-baa7-4329c2d4277d req-e868c843-62b2-455a-b7d5-db7dfffb8bc2 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:38.363333 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-a812117c-ba75-4384-baa7-4329c2d4277d req-e868c843-62b2-455a-b7d5-db7dfffb8bc2 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=f0ae9486-80b5-43bd-acec-49f871c00e67 HTTP/1.1" status: 200 len: 943 time: 0.1917264 Nov 09 04:35:38.408552 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c5633e0c-c479-4e5a-a127-5d5260b5e282 None None] Routers {'7b9a51f0-889c-418d-bc8a-fcfd303c5053'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:38.409206 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-c5633e0c-c479-4e5a-a127-5d5260b5e282 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['7b9a51f0-889c-418d-bc8a-fcfd303c5053'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:38.417916 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-066b5ef1-04f8-495c-a15d-b6c8fc277024 service neutron] Pushing event updated for resources: {'Port': ['ID=d4753771-ff46-428e-9ad0-3dce1a15a45f,revision_number=3']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:38.472193 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-a812117c-ba75-4384-baa7-4329c2d4277d req-0ac30134-e96f-4854-8fdc-472101e1dc32 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1080577 Nov 09 04:35:38.484596 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a05b5903-a811-4cfb-b303-1b96d7303e11 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Made reservation on behalf of d11b025703b24d109deef7bfe57a45f6 for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:35:38.489720 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a05b5903-a811-4cfb-b303-1b96d7303e11 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:38.502582 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-5fe779a3-75bc-4401-9e6d-f4f6b283a407 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:38.524268 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a05b5903-a811-4cfb-b303-1b96d7303e11 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 320} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:35:38.526826 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5fe779a3-75bc-4401-9e6d-f4f6b283a407 None None] Routers {'f961f4f5-6f17-45e1-91f0-ed3a6c4e8ad7'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:38.527680 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-5fe779a3-75bc-4401-9e6d-f4f6b283a407 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['f961f4f5-6f17-45e1-91f0-ed3a6c4e8ad7'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:38.539644 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a05b5903-a811-4cfb-b303-1b96d7303e11 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:38.540164 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-a05b5903-a811-4cfb-b303-1b96d7303e11 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Added segment 3924cc51-1cb6-447f-9de3-d105512d807f of type vlan for network 035bc5dd-3c1d-4ced-893c-487b4c0eff40 Nov 09 04:35:38.543960 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=1ac1d36b-a9ad-4497-aa5a-facfbb4ab1d6,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:38.549111 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:35:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4fc67d89-c50c-4c76-bf61-3f4d0bcea4fc x-openstack-request-id: req-4fc67d89-c50c-4c76-bf61-3f4d0bcea4fc {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:35:38.553392 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f0ae9486-80b5-43bd-acec-49f871c00e67", "tag": "d4753771-ff46-428e-9ad0-3dce1a15a45f", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:35:38.553392 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-4fc67d89-c50c-4c76-bf61-3f4d0bcea4fc {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:35:38.553392 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f0ae9486-80b5-43bd-acec-49f871c00e67', 'tag': 'd4753771-ff46-428e-9ad0-3dce1a15a45f', 'status': 'completed', 'code': 200} Nov 09 04:35:38.568117 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8b8456dd-586b-42d7-8b13-e9fff278f0bb tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:38.572777 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-8b8456dd-586b-42d7-8b13-e9fff278f0bb tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 886 time: 4.3493385 Nov 09 04:35:38.573692 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58908) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:38.577083 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3f2e4fb-b6cc-40bd-8c7b-c2d2918c873d req-a6fa1c04-f49d-4a3a-a19b-d5f8fc5132be service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:38.578644 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b3f2e4fb-b6cc-40bd-8c7b-c2d2918c873d req-a6fa1c04-f49d-4a3a-a19b-d5f8fc5132be service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=f636e5f4c9f64f69ba3b2ab8816b6096&device_id=f0ae9486-80b5-43bd-acec-49f871c00e67 HTTP/1.1" status: 200 len: 1096 time: 0.1342313 Nov 09 04:35:38.616762 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.db.api [None req-64a47dfd-bdc0-41c2-b855-3a043f2f3945 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=102163) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:35:38.617383 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG oslo_db.api [None req-64a47dfd-bdc0-41c2-b855-3a043f2f3945 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:35:38.642466 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-5fe779a3-75bc-4401-9e6d-f4f6b283a407 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:38.642689 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port d50019d6-22fd-4b25-a545-4133e1f62709 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:38.643034 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:38.645820 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5fe779a3-75bc-4401-9e6d-f4f6b283a407 None None] The sync data for ids ['f961f4f5-6f17-45e1-91f0-ed3a6c4e8ad7'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:35:38.666599 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-c5633e0c-c479-4e5a-a127-5d5260b5e282 None None] Set router 7b9a51f0-889c-418d-bc8a-fcfd303c5053 gateway port host: None {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:35:38.691735 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b3f2e4fb-b6cc-40bd-8c7b-c2d2918c873d req-6171398d-2091-4881-88e3-42dc2a48be7f service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=d4753771-ff46-428e-9ad0-3dce1a15a45f HTTP/1.1" status: 200 len: 217 time: 0.1001806 Nov 09 04:35:38.775198 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3f2e4fb-b6cc-40bd-8c7b-c2d2918c873d req-d132e3bd-7440-495b-9c17-4cf4ac0fe05a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:38.776685 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b3f2e4fb-b6cc-40bd-8c7b-c2d2918c873d req-d132e3bd-7440-495b-9c17-4cf4ac0fe05a service neutron] 10.222.0.26 "GET /v2.0/subnets?id=f6a08667-654b-4e0c-9f85-c6e6712cc239 HTTP/1.1" status: 200 len: 851 time: 0.0680380 Nov 09 04:35:38.803853 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a05b5903-a811-4cfb-b303-1b96d7303e11 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:38.835737 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3f2e4fb-b6cc-40bd-8c7b-c2d2918c873d req-6d344a9c-d09c-4a77-a0c4-02e077080ce7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:38.837496 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b3f2e4fb-b6cc-40bd-8c7b-c2d2918c873d req-6d344a9c-d09c-4a77-a0c4-02e077080ce7 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=999b1b20-f8fc-4caf-84cc-3feda426a0bf&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0522039 Nov 09 04:35:38.923219 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a05b5903-a811-4cfb-b303-1b96d7303e11 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:38.929749 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a05b5903-a811-4cfb-b303-1b96d7303e11 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:38.930656 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a05b5903-a811-4cfb-b303-1b96d7303e11 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:39.004952 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b3f2e4fb-b6cc-40bd-8c7b-c2d2918c873d req-67c21b84-a9c7-4cc7-aad5-f05176972f65 service neutron] 10.222.0.26 "GET /v2.0/networks/999b1b20-f8fc-4caf-84cc-3feda426a0bf?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1559031 Nov 09 04:35:39.057321 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a05b5903-a811-4cfb-b303-1b96d7303e11 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 770 time: 0.7701902 Nov 09 04:35:39.062937 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58912) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:39.070021 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-7d80fd80-a89b-4e1c-bba7-899fb82b0caa tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Request body: {'subnet': {'network_id': '035bc5dd-3c1d-4ced-893c-487b4c0eff40', 'cidr': '2001:db8:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:1::1'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:35:39.076157 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a05b5903-a811-4cfb-b303-1b96d7303e11 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event updated for resources: {'Network': ['ID=035bc5dd-3c1d-4ced-893c-487b4c0eff40,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:39.097547 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 035bc5dd-3c1d-4ced-893c-487b4c0eff40 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:35:39.235401 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-c5633e0c-c479-4e5a-a127-5d5260b5e282 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'name': 'tempest-RoutersIpV6Test-router-1491329762', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:35:32Z', 'updated_at': '2021-11-09T04:35:36Z', 'revision_number': 2, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'gw_port_host': None, '_interfaces': [{'id': '5a28daa1-7cdd-49a3-aad4-ecd643914dfd', 'name': '', 'network_id': '0c466943-3298-4130-be72-d7c24549bd5d', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:9e:e7:c4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1206, 'fixed_ips': [{'subnet_id': '0cd8bdb8-1377-46f0-ba25-14251b97253b', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:35Z', 'updated_at': '2021-11-09T04:35:36Z', 'revision_number': 2, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': '0cd8bdb8-1377-46f0-ba25-14251b97253b', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:39.269535 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 1ac1d36b-a9ad-4497-aa5a-facfbb4ab1d6 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:35:39.272917 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c5633e0c-c479-4e5a-a127-5d5260b5e282 None None] Checking router: 7b9a51f0-889c-418d-bc8a-fcfd303c5053 for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:35:39.273290 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c5633e0c-c479-4e5a-a127-5d5260b5e282 None None] Updating router 7b9a51f0-889c-418d-bc8a-fcfd303c5053 port 5a28daa1-7cdd-49a3-aad4-ecd643914dfd binding host dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 04:35:39.337929 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c5633e0c-c479-4e5a-a127-5d5260b5e282 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:39.392366 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7d80fd80-a89b-4e1c-bba7-899fb82b0caa tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Made reservation on behalf of d11b025703b24d109deef7bfe57a45f6 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:35:39.396863 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7d80fd80-a89b-4e1c-bba7-899fb82b0caa tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:39.464677 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 1ac1d36b-a9ad-4497-aa5a-facfbb4ab1d6 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:39.465612 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:39.676285 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-4fd2eed5-9d5b-4953-bfd4-047afb13938e None None] Provisioning complete for port 5a28daa1-7cdd-49a3-aad4-ecd643914dfd triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:39.676642 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4fd2eed5-9d5b-4953-bfd4-047afb13938e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:39.708568 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-555f2377-90ce-4c5b-bac5-ca02e594071c tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:39.712822 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7d80fd80-a89b-4e1c-bba7-899fb82b0caa tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:39.718275 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e09e28b3-92dd-4642-b241-7fd2bd225be6 req-877a26d2-f10b-48a5-b91e-7f3b97b5a6d6 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:39.719174 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e09e28b3-92dd-4642-b241-7fd2bd225be6 req-877a26d2-f10b-48a5-b91e-7f3b97b5a6d6 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=f0ae9486-80b5-43bd-acec-49f871c00e67 HTTP/1.1" status: 200 len: 943 time: 0.0782175 Nov 09 04:35:39.755679 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b3f2e4fb-b6cc-40bd-8c7b-c2d2918c873d req-1fbe15a6-1967-4404-963f-9868865520ac service neutron] 10.222.0.26 "GET /v2.0/networks/999b1b20-f8fc-4caf-84cc-3feda426a0bf?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7420559 Nov 09 04:35:39.779145 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-4fd2eed5-9d5b-4953-bfd4-047afb13938e None None] Port 5a28daa1-7cdd-49a3-aad4-ecd643914dfd cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:35:39.793318 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e09e28b3-92dd-4642-b241-7fd2bd225be6 req-0d6391e5-450d-442b-9d8f-e8beb22e087e tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0644491 Nov 09 04:35:39.835350 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-4fd2eed5-9d5b-4953-bfd4-047afb13938e None None] Provisioning complete for port 1ac1d36b-a9ad-4497-aa5a-facfbb4ab1d6 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:39.835731 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4fd2eed5-9d5b-4953-bfd4-047afb13938e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:39.868551 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d80fd80-a89b-4e1c-bba7-899fb82b0caa tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event updated for resources: {'Subnet': ['ID=b46b8bfd-f2f3-4413-b04c-231ee75f8c2c,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:39.883450 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7d80fd80-a89b-4e1c-bba7-899fb82b0caa tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Checking segment: {'id': '3924cc51-1cb6-447f-9de3-d105512d807f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 320, 'network_id': '035bc5dd-3c1d-4ced-893c-487b4c0eff40'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:35:39.883645 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7d80fd80-a89b-4e1c-bba7-899fb82b0caa tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Network hostable DHCP agents. Network: 035bc5dd-3c1d-4ced-893c-487b4c0eff40, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:35:39.890086 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device d50019d6-22fd-4b25-a545-4133e1f62709 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:35:39.930928 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c406fd35-4220-4a33-8486-470b322bfdb9 req-1b309308-9e71-4c9a-83b1-2278d34a1108 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:39.933236 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c406fd35-4220-4a33-8486-470b322bfdb9 req-1b309308-9e71-4c9a-83b1-2278d34a1108 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=f636e5f4c9f64f69ba3b2ab8816b6096&device_id=f0ae9486-80b5-43bd-acec-49f871c00e67 HTTP/1.1" status: 200 len: 1096 time: 0.0448987 Nov 09 04:35:40.020405 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c5633e0c-c479-4e5a-a127-5d5260b5e282 None None] Publish callbacks [] for port, precommit_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:40.047575 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port d50019d6-22fd-4b25-a545-4133e1f62709 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:40.047874 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:40.064414 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c406fd35-4220-4a33-8486-470b322bfdb9 req-6ce1f1c4-bb5d-4c33-9573-c8a37a62be97 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:40.065959 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c406fd35-4220-4a33-8486-470b322bfdb9 req-6ce1f1c4-bb5d-4c33-9573-c8a37a62be97 service neutron] 10.222.0.26 "GET /v2.0/networks?id=999b1b20-f8fc-4caf-84cc-3feda426a0bf HTTP/1.1" status: 200 len: 913 time: 0.1257763 Nov 09 04:35:40.071301 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7d80fd80-a89b-4e1c-bba7-899fb82b0caa tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Network 035bc5dd-3c1d-4ced-893c-487b4c0eff40 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:35:40.119704 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c5633e0c-c479-4e5a-a127-5d5260b5e282 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:40.136229 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c406fd35-4220-4a33-8486-470b322bfdb9 req-702e17dd-e9bc-4c32-9dae-b9f016741a03 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=d4753771-ff46-428e-9ad0-3dce1a15a45f HTTP/1.1" status: 200 len: 217 time: 0.0608106 Nov 09 04:35:40.140223 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-7d80fd80-a89b-4e1c-bba7-899fb82b0caa tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 035bc5dd-3c1d-4ced-893c-487b4c0eff40) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:35:40.146074 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7d80fd80-a89b-4e1c-bba7-899fb82b0caa tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:40.146674 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7d80fd80-a89b-4e1c-bba7-899fb82b0caa tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:40.158530 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-724b5ab2-c1c1-4465-a68b-e39528d4719a None None] Network 035bc5dd-3c1d-4ced-893c-487b4c0eff40 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:35:40.190061 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-555f2377-90ce-4c5b-bac5-ca02e594071c tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Allocated IP 172.20.0.1 (18eae61d-c3c0-43a4-8106-007586adddc4/3ad33066-d288-4e2f-b144-02102acb9c51/bc45379d-83a9-42ad-a371-897a2b8024f1) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:35:40.248396 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b150d71-47a0-4634-8abe-e3d610f87295 None None] Pushing event updated for resources: {'Port': ['ID=5a28daa1-7cdd-49a3-aad4-ecd643914dfd,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:40.251470 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c406fd35-4220-4a33-8486-470b322bfdb9 req-a867893b-e7c3-442b-ae01-a242487a28a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:40.254507 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c406fd35-4220-4a33-8486-470b322bfdb9 req-a867893b-e7c3-442b-ae01-a242487a28a8 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=f6a08667-654b-4e0c-9f85-c6e6712cc239 HTTP/1.1" status: 200 len: 851 time: 0.1016490 Nov 09 04:35:40.294918 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-7d80fd80-a89b-4e1c-bba7-899fb82b0caa tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 830 time: 1.2261903 Nov 09 04:35:40.295296 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58916) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:40.336506 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c406fd35-4220-4a33-8486-470b322bfdb9 req-51e7257d-8323-474c-94cc-126b8f2a86ce service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:40.338432 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c406fd35-4220-4a33-8486-470b322bfdb9 req-51e7257d-8323-474c-94cc-126b8f2a86ce service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=999b1b20-f8fc-4caf-84cc-3feda426a0bf&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0683565 Nov 09 04:35:40.395907 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-c5633e0c-c479-4e5a-a127-5d5260b5e282 None None] Attempting to bind port 5a28daa1-7cdd-49a3-aad4-ecd643914dfd on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:35:40.396351 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-c5633e0c-c479-4e5a-a127-5d5260b5e282 None None] Attempting to bind port 5a28daa1-7cdd-49a3-aad4-ecd643914dfd by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '38eba3d4-dbea-4df0-8bb8-d6738ea5872c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 311, 'network_id': '0c466943-3298-4130-be72-d7c24549bd5d'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:35:40.397316 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c5633e0c-c479-4e5a-a127-5d5260b5e282 None None] Attempting to bind port 5a28daa1-7cdd-49a3-aad4-ecd643914dfd on network 0c466943-3298-4130-be72-d7c24549bd5d {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:35:40.417651 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c5633e0c-c479-4e5a-a127-5d5260b5e282 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 35, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:35:40.418713 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c5633e0c-c479-4e5a-a127-5d5260b5e282 None None] Checking segment: {'id': '38eba3d4-dbea-4df0-8bb8-d6738ea5872c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 311, 'network_id': '0c466943-3298-4130-be72-d7c24549bd5d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:35:40.419308 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c5633e0c-c479-4e5a-a127-5d5260b5e282 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:40.419518 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c5633e0c-c479-4e5a-a127-5d5260b5e282 None None] Bound using segment: {'id': '38eba3d4-dbea-4df0-8bb8-d6738ea5872c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 311, 'network_id': '0c466943-3298-4130-be72-d7c24549bd5d'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:35:40.420029 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-c5633e0c-c479-4e5a-a127-5d5260b5e282 None None] Bound port: 5a28daa1-7cdd-49a3-aad4-ecd643914dfd, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '38eba3d4-dbea-4df0-8bb8-d6738ea5872c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 311, 'network_id': '0c466943-3298-4130-be72-d7c24549bd5d'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:35:40.427900 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c5633e0c-c479-4e5a-a127-5d5260b5e282 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:40.476894 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c406fd35-4220-4a33-8486-470b322bfdb9 req-413bc93a-f902-4221-b24f-138e59cbe568 service neutron] 10.222.0.26 "GET /v2.0/networks/999b1b20-f8fc-4caf-84cc-3feda426a0bf?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1294854 Nov 09 04:35:40.518290 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6f1b7e56-99fd-42a8-aecd-49f2100331fc None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-035bc5dd-3c1d-4ced-893c-487b4c0eff40', 'network_id': '035bc5dd-3c1d-4ced-893c-487b4c0eff40', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'fixed_ips': [{'subnet_id': 'b46b8bfd-f2f3-4413-b04c-231ee75f8c2c'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:35:40.519196 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6f1b7e56-99fd-42a8-aecd-49f2100331fc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:40.536085 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-555f2377-90ce-4c5b-bac5-ca02e594071c tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:40.587328 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-c5633e0c-c479-4e5a-a127-5d5260b5e282 None None] For port 5a28daa1-7cdd-49a3-aad4-ecd643914dfd, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:35:40.588095 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c406fd35-4220-4a33-8486-470b322bfdb9 req-eac7e322-8d4d-4a0c-a19c-640649e966b2 service neutron] 10.222.0.26 "GET /v2.0/networks/999b1b20-f8fc-4caf-84cc-3feda426a0bf?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1000979 Nov 09 04:35:40.656274 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-c5633e0c-c479-4e5a-a127-5d5260b5e282 None None] For port 5a28daa1-7cdd-49a3-aad4-ecd643914dfd, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=5a28daa1-7cdd-49a3-aad4-ecd643914dfd,segment=NetworkSegment(38eba3d4-dbea-4df0-8bb8-d6738ea5872c),segment_id=38eba3d4-dbea-4df0-8bb8-d6738ea5872c)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:35:40.681968 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-698f544d-5de8-458c-8969-2f4b00a09639 None None] Provisioning complete for port 5a28daa1-7cdd-49a3-aad4-ecd643914dfd triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:40.682652 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-698f544d-5de8-458c-8969-2f4b00a09639 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:40.717854 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-555f2377-90ce-4c5b-bac5-ca02e594071c tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:40.747928 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-698f544d-5de8-458c-8969-2f4b00a09639 None None] Port 5a28daa1-7cdd-49a3-aad4-ecd643914dfd cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:35:40.751177 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c5633e0c-c479-4e5a-a127-5d5260b5e282 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:40.792183 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-555f2377-90ce-4c5b-bac5-ca02e594071c tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Network 18eae61d-c3c0-43a4-8106-007586adddc4 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:35:40.796751 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f4b0a507-bef4-43c7-aecf-26a05a015943 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:40.806332 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-555f2377-90ce-4c5b-bac5-ca02e594071c tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:35:40.814173 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-6f1b7e56-99fd-42a8-aecd-49f2100331fc None None] Allocated IP 2001:db8:1::2 (035bc5dd-3c1d-4ced-893c-487b4c0eff40/b46b8bfd-f2f3-4413-b04c-231ee75f8c2c/30ff8933-6aad-4f21-a11e-23a4dd69e54e) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:35:40.817548 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-555f2377-90ce-4c5b-bac5-ca02e594071c tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:35:40.824485 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-555f2377-90ce-4c5b-bac5-ca02e594071c tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Pushing event updated for resources: {'Port': ['ID=bc45379d-83a9-42ad-a371-897a2b8024f1,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:40.847958 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c5633e0c-c479-4e5a-a127-5d5260b5e282 None None] Routers {'7b9a51f0-889c-418d-bc8a-fcfd303c5053'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:40.849525 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-c5633e0c-c479-4e5a-a127-5d5260b5e282 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['7b9a51f0-889c-418d-bc8a-fcfd303c5053'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:40.854046 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b150d71-47a0-4634-8abe-e3d610f87295 None None] Pushing event updated for resources: {'Port': ['ID=5a28daa1-7cdd-49a3-aad4-ecd643914dfd,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:41.029284 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-c5633e0c-c479-4e5a-a127-5d5260b5e282 None None] Set router 7b9a51f0-889c-418d-bc8a-fcfd303c5053 gateway port host: None {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:35:41.242234 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6f1b7e56-99fd-42a8-aecd-49f2100331fc None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:41.345303 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6f1b7e56-99fd-42a8-aecd-49f2100331fc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:41.561908 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-a877d821-23c6-4449-8f03-9a6cf8203991 None None] Provisioning complete for port 5a28daa1-7cdd-49a3-aad4-ecd643914dfd triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:41.561908 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a877d821-23c6-4449-8f03-9a6cf8203991 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:41.561908 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f69188b1-0db3-4d6b-a96d-c8ff700cca56 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:41.563203 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-555f2377-90ce-4c5b-bac5-ca02e594071c tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:41.563619 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6f1b7e56-99fd-42a8-aecd-49f2100331fc None None] Network 035bc5dd-3c1d-4ced-893c-487b4c0eff40 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:35:41.563619 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-6f1b7e56-99fd-42a8-aecd-49f2100331fc None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:35:41.563619 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6f1b7e56-99fd-42a8-aecd-49f2100331fc None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:35:41.563619 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f1b7e56-99fd-42a8-aecd-49f2100331fc None None] Pushing event updated for resources: {'Port': ['ID=30ff8933-6aad-4f21-a11e-23a4dd69e54e,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:41.564735 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:35:41.565195 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-c5633e0c-c479-4e5a-a127-5d5260b5e282 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'name': 'tempest-RoutersIpV6Test-router-1491329762', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:35:32Z', 'updated_at': '2021-11-09T04:35:36Z', 'revision_number': 2, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'gw_port_host': None, '_interfaces': [{'id': '5a28daa1-7cdd-49a3-aad4-ecd643914dfd', 'name': '', 'network_id': '0c466943-3298-4130-be72-d7c24549bd5d', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:9e:e7:c4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1206, 'fixed_ips': [{'subnet_id': '0cd8bdb8-1377-46f0-ba25-14251b97253b', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:35Z', 'updated_at': '2021-11-09T04:35:40Z', 'revision_number': 4, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': '0cd8bdb8-1377-46f0-ba25-14251b97253b', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:41.565339 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3676b5b8-fa2f-458a-8a1e-2428837a328f req-0364cbae-6839-44df-be3b-9f2d08f2167a tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:41.565339 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-3676b5b8-fa2f-458a-8a1e-2428837a328f req-0364cbae-6839-44df-be3b-9f2d08f2167a tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=f0ae9486-80b5-43bd-acec-49f871c00e67 HTTP/1.1" status: 200 len: 943 time: 0.6413040 Nov 09 04:35:41.682946 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-3676b5b8-fa2f-458a-8a1e-2428837a328f req-6a144501-ee66-481d-9a9a-a26b167c4f24 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1420467 Nov 09 04:35:41.732603 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-6f1b7e56-99fd-42a8-aecd-49f2100331fc None None] Attempting to bind port 30ff8933-6aad-4f21-a11e-23a4dd69e54e on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:35:41.732965 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-6f1b7e56-99fd-42a8-aecd-49f2100331fc None None] Attempting to bind port 30ff8933-6aad-4f21-a11e-23a4dd69e54e by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '3924cc51-1cb6-447f-9de3-d105512d807f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 320, 'network_id': '035bc5dd-3c1d-4ced-893c-487b4c0eff40'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:35:41.733320 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6f1b7e56-99fd-42a8-aecd-49f2100331fc None None] Attempting to bind port 30ff8933-6aad-4f21-a11e-23a4dd69e54e on network 035bc5dd-3c1d-4ced-893c-487b4c0eff40 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:35:41.733542 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-f4b0a507-bef4-43c7-aecf-26a05a015943 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Allocated IP 2001:db8:1::1 (035bc5dd-3c1d-4ced-893c-487b4c0eff40/b46b8bfd-f2f3-4413-b04c-231ee75f8c2c/858eaebe-fdb6-4c5b-ab0f-4d6bd86995d4) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:35:41.736878 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c5633e0c-c479-4e5a-a127-5d5260b5e282 None None] The sync data for ids ['7b9a51f0-889c-418d-bc8a-fcfd303c5053'] in dv-neutron-816802-2-hyperv is: [{'id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'name': 'tempest-RoutersIpV6Test-router-1491329762', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:35:32Z', 'updated_at': '2021-11-09T04:35:36Z', 'revision_number': 2, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'gw_port_host': None, '_interfaces': [{'id': '5a28daa1-7cdd-49a3-aad4-ecd643914dfd', 'name': '', 'network_id': '0c466943-3298-4130-be72-d7c24549bd5d', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:9e:e7:c4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1206, 'fixed_ips': [{'subnet_id': '0cd8bdb8-1377-46f0-ba25-14251b97253b', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:35Z', 'updated_at': '2021-11-09T04:35:40Z', 'revision_number': 4, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': '0cd8bdb8-1377-46f0-ba25-14251b97253b', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:35:41.749789 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6f1b7e56-99fd-42a8-aecd-49f2100331fc None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 35, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:35:41.750046 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6f1b7e56-99fd-42a8-aecd-49f2100331fc None None] Checking segment: {'id': '3924cc51-1cb6-447f-9de3-d105512d807f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 320, 'network_id': '035bc5dd-3c1d-4ced-893c-487b4c0eff40'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:35:41.750438 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6f1b7e56-99fd-42a8-aecd-49f2100331fc None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:41.750850 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6f1b7e56-99fd-42a8-aecd-49f2100331fc None None] Bound using segment: {'id': '3924cc51-1cb6-447f-9de3-d105512d807f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 320, 'network_id': '035bc5dd-3c1d-4ced-893c-487b4c0eff40'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:35:41.751315 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-6f1b7e56-99fd-42a8-aecd-49f2100331fc None None] Bound port: 30ff8933-6aad-4f21-a11e-23a4dd69e54e, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3924cc51-1cb6-447f-9de3-d105512d807f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 320, 'network_id': '035bc5dd-3c1d-4ced-893c-487b4c0eff40'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:35:41.751702 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6f1b7e56-99fd-42a8-aecd-49f2100331fc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:41.773273 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a877d821-23c6-4449-8f03-9a6cf8203991 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:41.842350 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-a877d821-23c6-4449-8f03-9a6cf8203991 None None] For port 5a28daa1-7cdd-49a3-aad4-ecd643914dfd, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=5a28daa1-7cdd-49a3-aad4-ecd643914dfd,segment=NetworkSegment(38eba3d4-dbea-4df0-8bb8-d6738ea5872c),segment_id=38eba3d4-dbea-4df0-8bb8-d6738ea5872c)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:35:41.853507 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-6f1b7e56-99fd-42a8-aecd-49f2100331fc None None] For port 30ff8933-6aad-4f21-a11e-23a4dd69e54e, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:35:41.856256 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-555f2377-90ce-4c5b-bac5-ca02e594071c tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:41.857980 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-6f1b7e56-99fd-42a8-aecd-49f2100331fc None None] For port 30ff8933-6aad-4f21-a11e-23a4dd69e54e, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=30ff8933-6aad-4f21-a11e-23a4dd69e54e,segment=NetworkSegment(3924cc51-1cb6-447f-9de3-d105512d807f),segment_id=3924cc51-1cb6-447f-9de3-d105512d807f)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:35:41.915202 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a877d821-23c6-4449-8f03-9a6cf8203991 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:41.947791 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6f1b7e56-99fd-42a8-aecd-49f2100331fc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:41.959428 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f4b0a507-bef4-43c7-aecf-26a05a015943 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:41.979356 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-a877d821-23c6-4449-8f03-9a6cf8203991 None None] Provisioning complete for port bc45379d-83a9-42ad-a371-897a2b8024f1 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:41.979728 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a877d821-23c6-4449-8f03-9a6cf8203991 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:42.013241 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a877d821-23c6-4449-8f03-9a6cf8203991 None None] Pushing event updated for resources: {'Port': ['ID=5a28daa1-7cdd-49a3-aad4-ecd643914dfd,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:42.111330 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-a877d821-23c6-4449-8f03-9a6cf8203991 None None] Port bc45379d-83a9-42ad-a371-897a2b8024f1 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:35:42.146628 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f1b7e56-99fd-42a8-aecd-49f2100331fc None None] Pushing event updated for resources: {'Port': ['ID=30ff8933-6aad-4f21-a11e-23a4dd69e54e,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:42.189442 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:42.243873 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f4b0a507-bef4-43c7-aecf-26a05a015943 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:42.335380 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f4b0a507-bef4-43c7-aecf-26a05a015943 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Network 035bc5dd-3c1d-4ced-893c-487b4c0eff40 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:35:42.345956 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-f4b0a507-bef4-43c7-aecf-26a05a015943 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:35:42.353655 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f4b0a507-bef4-43c7-aecf-26a05a015943 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:35:42.354161 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f4b0a507-bef4-43c7-aecf-26a05a015943 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:42.362153 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4b0a507-bef4-43c7-aecf-26a05a015943 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event updated for resources: {'Port': ['ID=858eaebe-fdb6-4c5b-ab0f-4d6bd86995d4,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:42.494907 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-555f2377-90ce-4c5b-bac5-ca02e594071c tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:42.580645 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-555f2377-90ce-4c5b-bac5-ca02e594071c tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:42.662699 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f4b0a507-bef4-43c7-aecf-26a05a015943 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:42.695413 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-555f2377-90ce-4c5b-bac5-ca02e594071c tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Pushing event updated for resources: {'Port': ['ID=bc45379d-83a9-42ad-a371-897a2b8024f1,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:42.707947 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-555f2377-90ce-4c5b-bac5-ca02e594071c tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:42.817792 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b44c349-3731-4ed4-87f7-d47358c6a063 req-c5172c5d-2da4-454a-b34c-963f68f66127 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:42.820201 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5b44c349-3731-4ed4-87f7-d47358c6a063 req-c5172c5d-2da4-454a-b34c-963f68f66127 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=f0ae9486-80b5-43bd-acec-49f871c00e67 HTTP/1.1" status: 200 len: 943 time: 0.0620019 Nov 09 04:35:42.881038 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5b44c349-3731-4ed4-87f7-d47358c6a063 req-ae446c0b-3074-4616-a925-55b08f96aa89 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0542586 Nov 09 04:35:42.954595 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-555f2377-90ce-4c5b-bac5-ca02e594071c tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Network 18eae61d-c3c0-43a4-8106-007586adddc4 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:35:42.958027 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-555f2377-90ce-4c5b-bac5-ca02e594071c tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:35:43.184697 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-555f2377-90ce-4c5b-bac5-ca02e594071c tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Router f961f4f5-6f17-45e1-91f0-ed3a6c4e8ad7 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:35:43.187596 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f4b0a507-bef4-43c7-aecf-26a05a015943 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:43.264091 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f4b0a507-bef4-43c7-aecf-26a05a015943 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:43.264091 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f4b0a507-bef4-43c7-aecf-26a05a015943 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:43.347344 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-f691d413-9ed7-4788-ac0e-92c81c26b8a7 None None] Provisioning complete for port bc45379d-83a9-42ad-a371-897a2b8024f1 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:43.347968 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f691d413-9ed7-4788-ac0e-92c81c26b8a7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:43.382526 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 5a28daa1-7cdd-49a3-aad4-ecd643914dfd up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:35:43.388723 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9ae5e167-d762-4c2d-82cb-020055c81000 None None] Network 035bc5dd-3c1d-4ced-893c-487b4c0eff40 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:35:43.400767 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58926) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:43.427240 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4b0a507-bef4-43c7-aecf-26a05a015943 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event updated for resources: {'Port': ['ID=858eaebe-fdb6-4c5b-ab0f-4d6bd86995d4,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:43.466269 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-555f2377-90ce-4c5b-bac5-ca02e594071c tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:35:43.476251 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-555f2377-90ce-4c5b-bac5-ca02e594071c tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] 10.222.0.24 "PUT /v2.0/routers/f961f4f5-6f17-45e1-91f0-ed3a6c4e8ad7/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.8985000 Nov 09 04:35:43.476761 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-f691d413-9ed7-4788-ac0e-92c81c26b8a7 None None] Port bc45379d-83a9-42ad-a371-897a2b8024f1 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:35:43.476872 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58928) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:43.489956 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-be771ef5-78b5-4d2b-935c-2ed51432a1cb None None] Sync routers for ids ['f961f4f5-6f17-45e1-91f0-ed3a6c4e8ad7'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:35:43.492461 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-a278ae29-034d-47d1-9ec5-58cc151db4e4 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Request body: {'port': {'network_id': '18eae61d-c3c0-43a4-8106-007586adddc4', 'name': 'tempest-FloatingIPTestJSON-615348260'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:35:43.504709 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f4b0a507-bef4-43c7-aecf-26a05a015943 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Network 035bc5dd-3c1d-4ced-893c-487b4c0eff40 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:35:43.506857 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-f4b0a507-bef4-43c7-aecf-26a05a015943 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:35:43.510746 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-be771ef5-78b5-4d2b-935c-2ed51432a1cb None None] Routers {'f961f4f5-6f17-45e1-91f0-ed3a6c4e8ad7'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:43.511395 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-be771ef5-78b5-4d2b-935c-2ed51432a1cb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['f961f4f5-6f17-45e1-91f0-ed3a6c4e8ad7'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:43.563371 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-be771ef5-78b5-4d2b-935c-2ed51432a1cb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:43.603790 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 5a28daa1-7cdd-49a3-aad4-ecd643914dfd triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:43.604250 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:43.616672 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-be771ef5-78b5-4d2b-935c-2ed51432a1cb None None] Routers {'f961f4f5-6f17-45e1-91f0-ed3a6c4e8ad7'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:43.617121 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-be771ef5-78b5-4d2b-935c-2ed51432a1cb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['f961f4f5-6f17-45e1-91f0-ed3a6c4e8ad7'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:43.647506 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f4b0a507-bef4-43c7-aecf-26a05a015943 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Router 7b9a51f0-889c-418d-bc8a-fcfd303c5053 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:35:43.694504 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-be771ef5-78b5-4d2b-935c-2ed51432a1cb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:43.695151 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-be771ef5-78b5-4d2b-935c-2ed51432a1cb None None] The sync data for ids ['f961f4f5-6f17-45e1-91f0-ed3a6c4e8ad7'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:35:43.717947 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-65d8d013-a521-4a1c-b02f-8ec28738e4a2 None None] Provisioning complete for port 30ff8933-6aad-4f21-a11e-23a4dd69e54e triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:43.717947 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-65d8d013-a521-4a1c-b02f-8ec28738e4a2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:43.776465 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f4b0a507-bef4-43c7-aecf-26a05a015943 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:35:43.782831 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-f4b0a507-bef4-43c7-aecf-26a05a015943 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "PUT /v2.0/routers/7b9a51f0-889c-418d-bc8a-fcfd303c5053/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.4864249 Nov 09 04:35:43.785495 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58930) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:43.790825 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-e53cb85e-76d7-4e78-a4d0-fce32987ea65 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-1990807678'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:35:43.806285 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cbd8f1d7-d00c-4c52-af55-2357701d60fc None None] Sync routers for ids ['7b9a51f0-889c-418d-bc8a-fcfd303c5053'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:35:43.819755 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cbd8f1d7-d00c-4c52-af55-2357701d60fc None None] Routers {'7b9a51f0-889c-418d-bc8a-fcfd303c5053'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:43.820209 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d1d53f3d-96f6-49f7-a537-67e1296ec4a8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:43.820519 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-cbd8f1d7-d00c-4c52-af55-2357701d60fc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['7b9a51f0-889c-418d-bc8a-fcfd303c5053'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:43.843583 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 30ff8933-6aad-4f21-a11e-23a4dd69e54e up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:35:43.874770 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a278ae29-034d-47d1-9ec5-58cc151db4e4 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Made reservation on behalf of 459651e5af964f8c805d518a6dc3b464 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:35:43.886913 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a278ae29-034d-47d1-9ec5-58cc151db4e4 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:43.905812 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-65d8d013-a521-4a1c-b02f-8ec28738e4a2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:43.907856 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [None req-a278ae29-034d-47d1-9ec5-58cc151db4e4 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] device_id is not set on port 8355442d-8835-49e1-b7e9-e76868b288ea yet. {{(pid=102162) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:35:43.945188 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e53cb85e-76d7-4e78-a4d0-fce32987ea65 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Made reservation on behalf of d11b025703b24d109deef7bfe57a45f6 for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:35:43.955784 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e53cb85e-76d7-4e78-a4d0-fce32987ea65 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:43.966883 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-cbd8f1d7-d00c-4c52-af55-2357701d60fc None None] Set router 7b9a51f0-889c-418d-bc8a-fcfd303c5053 gateway port host: None {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:35:43.977885 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-65d8d013-a521-4a1c-b02f-8ec28738e4a2 None None] For port 30ff8933-6aad-4f21-a11e-23a4dd69e54e, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=30ff8933-6aad-4f21-a11e-23a4dd69e54e,segment=NetworkSegment(3924cc51-1cb6-447f-9de3-d105512d807f),segment_id=3924cc51-1cb6-447f-9de3-d105512d807f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:35:43.988252 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 30ff8933-6aad-4f21-a11e-23a4dd69e54e triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:43.990178 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e53cb85e-76d7-4e78-a4d0-fce32987ea65 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 309} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:35:43.990806 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:44.000545 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e53cb85e-76d7-4e78-a4d0-fce32987ea65 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:44.000888 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-e53cb85e-76d7-4e78-a4d0-fce32987ea65 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Added segment ffb67bcc-90c4-4cb0-9cae-d89cd9a71c38 of type vlan for network b93b0577-d21b-4089-8251-c3aac06bdb77 Nov 09 04:35:44.089430 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-65d8d013-a521-4a1c-b02f-8ec28738e4a2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:44.110216 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e53cb85e-76d7-4e78-a4d0-fce32987ea65 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:44.139625 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-a278ae29-034d-47d1-9ec5-58cc151db4e4 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Allocated IP 172.20.0.13 (18eae61d-c3c0-43a4-8106-007586adddc4/3ad33066-d288-4e2f-b144-02102acb9c51/8355442d-8835-49e1-b7e9-e76868b288ea) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:35:44.184006 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aaf29058-1e05-4a5e-8bcb-f2ee37f5ce54 req-571052a0-1d91-4219-b341-c8f82358784e tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:44.186512 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-aaf29058-1e05-4a5e-8bcb-f2ee37f5ce54 req-571052a0-1d91-4219-b341-c8f82358784e tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=f0ae9486-80b5-43bd-acec-49f871c00e67 HTTP/1.1" status: 200 len: 943 time: 0.1440234 Nov 09 04:35:44.226183 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65d8d013-a521-4a1c-b02f-8ec28738e4a2 None None] Pushing event updated for resources: {'Port': ['ID=30ff8933-6aad-4f21-a11e-23a4dd69e54e,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:44.260377 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e53cb85e-76d7-4e78-a4d0-fce32987ea65 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:44.268645 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e53cb85e-76d7-4e78-a4d0-fce32987ea65 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:44.269960 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e53cb85e-76d7-4e78-a4d0-fce32987ea65 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:44.273231 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ec2452da-5356-4383-8719-fa9998d2e19b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:44.288120 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-cbd8f1d7-d00c-4c52-af55-2357701d60fc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'name': 'tempest-RoutersIpV6Test-router-1491329762', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:35:32Z', 'updated_at': '2021-11-09T04:35:42Z', 'revision_number': 3, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'gw_port_host': None, '_interfaces': [{'id': '5a28daa1-7cdd-49a3-aad4-ecd643914dfd', 'name': '', 'network_id': '0c466943-3298-4130-be72-d7c24549bd5d', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:9e:e7:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1206, 'fixed_ips': [{'subnet_id': '0cd8bdb8-1377-46f0-ba25-14251b97253b', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:35Z', 'updated_at': '2021-11-09T04:35:41Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': '0cd8bdb8-1377-46f0-ba25-14251b97253b', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '858eaebe-fdb6-4c5b-ab0f-4d6bd86995d4', 'name': '', 'network_id': '035bc5dd-3c1d-4ced-893c-487b4c0eff40', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:82:b5:88', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1214, 'fixed_ips': [{'subnet_id': 'b46b8bfd-f2f3-4413-b04c-231ee75f8c2c', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:41Z', 'updated_at': '2021-11-09T04:35:42Z', 'revision_number': 2, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': 'b46b8bfd-f2f3-4413-b04c-231ee75f8c2c', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:44.290424 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-aaf29058-1e05-4a5e-8bcb-f2ee37f5ce54 req-e3039bde-3c5d-4828-982e-a2d63d3275a3 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0948784 Nov 09 04:35:44.320590 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-cb7496fc-a949-4390-adc6-17da8a31d68b None None] Provisioning complete for port 858eaebe-fdb6-4c5b-ab0f-4d6bd86995d4 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:44.320959 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-cb7496fc-a949-4390-adc6-17da8a31d68b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:44.336486 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cbd8f1d7-d00c-4c52-af55-2357701d60fc None None] Checking router: 7b9a51f0-889c-418d-bc8a-fcfd303c5053 for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:35:44.355872 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cbd8f1d7-d00c-4c52-af55-2357701d60fc None None] Updating router 7b9a51f0-889c-418d-bc8a-fcfd303c5053 port 858eaebe-fdb6-4c5b-ab0f-4d6bd86995d4 binding host dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 04:35:44.368465 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-cbd8f1d7-d00c-4c52-af55-2357701d60fc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:44.385313 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e53cb85e-76d7-4e78-a4d0-fce32987ea65 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event updated for resources: {'Network': ['ID=b93b0577-d21b-4089-8251-c3aac06bdb77,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:44.402110 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network b93b0577-d21b-4089-8251-c3aac06bdb77 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:35:44.411723 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-cb7496fc-a949-4390-adc6-17da8a31d68b None None] Port 858eaebe-fdb6-4c5b-ab0f-4d6bd86995d4 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:35:44.431636 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-e53cb85e-76d7-4e78-a4d0-fce32987ea65 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 770 time: 0.6449764 Nov 09 04:35:44.432393 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58934) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:44.439273 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-eb8be844-211f-4c91-944a-c0ed27ccf2c9 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Request body: {'subnet': {'network_id': 'b93b0577-d21b-4089-8251-c3aac06bdb77', 'cidr': '2001:db8:2::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:2::1'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:35:44.484222 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-cb7496fc-a949-4390-adc6-17da8a31d68b None None] Provisioning complete for port 30ff8933-6aad-4f21-a11e-23a4dd69e54e triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:44.484651 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-cb7496fc-a949-4390-adc6-17da8a31d68b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:44.627388 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a278ae29-034d-47d1-9ec5-58cc151db4e4 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:44.676263 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-eb8be844-211f-4c91-944a-c0ed27ccf2c9 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Made reservation on behalf of d11b025703b24d109deef7bfe57a45f6 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:35:44.680766 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-eb8be844-211f-4c91-944a-c0ed27ccf2c9 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:44.735006 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-4c1d0c5a-96cb-425d-9ecf-858e10123016 None None] Provisioning complete for port 858eaebe-fdb6-4c5b-ab0f-4d6bd86995d4 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:44.735704 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4c1d0c5a-96cb-425d-9ecf-858e10123016 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:44.746613 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-cbd8f1d7-d00c-4c52-af55-2357701d60fc None None] Publish callbacks [] for port, precommit_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:44.762786 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a278ae29-034d-47d1-9ec5-58cc151db4e4 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:44.786512 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-4c1d0c5a-96cb-425d-9ecf-858e10123016 None None] Port 858eaebe-fdb6-4c5b-ab0f-4d6bd86995d4 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:35:44.826716 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-cbd8f1d7-d00c-4c52-af55-2357701d60fc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:44.832341 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a278ae29-034d-47d1-9ec5-58cc151db4e4 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Network 18eae61d-c3c0-43a4-8106-007586adddc4 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:35:44.840364 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-a278ae29-034d-47d1-9ec5-58cc151db4e4 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:35:44.843100 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a278ae29-034d-47d1-9ec5-58cc151db4e4 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:35:44.895781 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a278ae29-034d-47d1-9ec5-58cc151db4e4 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Pushing event updated for resources: {'Port': ['ID=8355442d-8835-49e1-b7e9-e76868b288ea,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:44.930818 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a278ae29-034d-47d1-9ec5-58cc151db4e4 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:44.931485 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a278ae29-034d-47d1-9ec5-58cc151db4e4 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:44.951685 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7157d5d8-2eef-4f08-9e0b-818ddda05a7a None None] Pushing event updated for resources: {'Port': ['ID=858eaebe-fdb6-4c5b-ab0f-4d6bd86995d4,revision_number=3']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:44.956914 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-ec2452da-5356-4383-8719-fa9998d2e19b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Deleting port 1a74b864-c68d-4f11-bce5-6e04e0afa480 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:35:44.957342 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ec2452da-5356-4383-8719-fa9998d2e19b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:44.983528 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7157d5d8-2eef-4f08-9e0b-818ddda05a7a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:35:44.983832 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7157d5d8-2eef-4f08-9e0b-818ddda05a7a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:35:44.984177 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7157d5d8-2eef-4f08-9e0b-818ddda05a7a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:35:44.984511 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7157d5d8-2eef-4f08-9e0b-818ddda05a7a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:35:44.984846 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7157d5d8-2eef-4f08-9e0b-818ddda05a7a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:35:44.985170 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7157d5d8-2eef-4f08-9e0b-818ddda05a7a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:35:44.985492 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7157d5d8-2eef-4f08-9e0b-818ddda05a7a None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:35:44.985822 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7157d5d8-2eef-4f08-9e0b-818ddda05a7a None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:35:44.986148 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7157d5d8-2eef-4f08-9e0b-818ddda05a7a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:35:44.986493 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7157d5d8-2eef-4f08-9e0b-818ddda05a7a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:35:44.986811 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7157d5d8-2eef-4f08-9e0b-818ddda05a7a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:35:44.987618 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7157d5d8-2eef-4f08-9e0b-818ddda05a7a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:35:45.002982 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-eb8be844-211f-4c91-944a-c0ed27ccf2c9 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:45.004873 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-cbd8f1d7-d00c-4c52-af55-2357701d60fc None None] Attempting to bind port 858eaebe-fdb6-4c5b-ab0f-4d6bd86995d4 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:35:45.005248 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-cbd8f1d7-d00c-4c52-af55-2357701d60fc None None] Attempting to bind port 858eaebe-fdb6-4c5b-ab0f-4d6bd86995d4 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '3924cc51-1cb6-447f-9de3-d105512d807f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 320, 'network_id': '035bc5dd-3c1d-4ced-893c-487b4c0eff40'}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:35:45.005610 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cbd8f1d7-d00c-4c52-af55-2357701d60fc None None] Attempting to bind port 858eaebe-fdb6-4c5b-ab0f-4d6bd86995d4 on network 035bc5dd-3c1d-4ced-893c-487b4c0eff40 {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:35:45.011561 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cbd8f1d7-d00c-4c52-af55-2357701d60fc None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 35, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:35:45.015565 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cbd8f1d7-d00c-4c52-af55-2357701d60fc None None] Checking segment: {'id': '3924cc51-1cb6-447f-9de3-d105512d807f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 320, 'network_id': '035bc5dd-3c1d-4ced-893c-487b4c0eff40'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102164) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:35:45.015565 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-cbd8f1d7-d00c-4c52-af55-2357701d60fc None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:45.015565 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cbd8f1d7-d00c-4c52-af55-2357701d60fc None None] Bound using segment: {'id': '3924cc51-1cb6-447f-9de3-d105512d807f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 320, 'network_id': '035bc5dd-3c1d-4ced-893c-487b4c0eff40'} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:35:45.015565 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-cbd8f1d7-d00c-4c52-af55-2357701d60fc None None] Bound port: 858eaebe-fdb6-4c5b-ab0f-4d6bd86995d4, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3924cc51-1cb6-447f-9de3-d105512d807f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 320, 'network_id': '035bc5dd-3c1d-4ced-893c-487b4c0eff40'}}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:35:45.015565 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-cbd8f1d7-d00c-4c52-af55-2357701d60fc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:45.038280 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-bc37cd79-5f92-461e-876d-bc53d4e3fc17 None None] Provisioning complete for port 858eaebe-fdb6-4c5b-ab0f-4d6bd86995d4 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:45.038280 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-bc37cd79-5f92-461e-876d-bc53d4e3fc17 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:45.062894 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a278ae29-034d-47d1-9ec5-58cc151db4e4 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 929 time: 1.5778625 Nov 09 04:35:45.065530 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58936) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:45.073297 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-ea6ce6b2-e6d0-45d9-ba0d-294635a9a57f tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Request body: {'floatingip': {'port_id': '8355442d-8835-49e1-b7e9-e76868b288ea'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:35:45.091259 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb8be844-211f-4c91-944a-c0ed27ccf2c9 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event updated for resources: {'Subnet': ['ID=75b6b6c5-0313-4754-bcde-7b2b14023f56,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:45.104928 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:45.122656 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-cbd8f1d7-d00c-4c52-af55-2357701d60fc None None] For port 858eaebe-fdb6-4c5b-ab0f-4d6bd86995d4, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102164) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:35:45.127249 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-cbd8f1d7-d00c-4c52-af55-2357701d60fc None None] For port 858eaebe-fdb6-4c5b-ab0f-4d6bd86995d4, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=858eaebe-fdb6-4c5b-ab0f-4d6bd86995d4,segment=NetworkSegment(3924cc51-1cb6-447f-9de3-d105512d807f),segment_id=3924cc51-1cb6-447f-9de3-d105512d807f)] {{(pid=102164) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:35:45.136923 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-bc37cd79-5f92-461e-876d-bc53d4e3fc17 None None] Port 858eaebe-fdb6-4c5b-ab0f-4d6bd86995d4 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:35:45.139070 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eb8be844-211f-4c91-944a-c0ed27ccf2c9 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Checking segment: {'id': 'ffb67bcc-90c4-4cb0-9cae-d89cd9a71c38', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 309, 'network_id': 'b93b0577-d21b-4089-8251-c3aac06bdb77'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:35:45.139536 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eb8be844-211f-4c91-944a-c0ed27ccf2c9 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Network hostable DHCP agents. Network: b93b0577-d21b-4089-8251-c3aac06bdb77, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:35:45.195107 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-cbd8f1d7-d00c-4c52-af55-2357701d60fc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:45.200142 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-ec2452da-5356-4383-8719-fa9998d2e19b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] For port 1a74b864-c68d-4f11-bce5-6e04e0afa480, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=1a74b864-c68d-4f11-bce5-6e04e0afa480,segment=NetworkSegment(142b6494-b2b1-4cea-9b90-321c4a2a4cae),segment_id=142b6494-b2b1-4cea-9b90-321c4a2a4cae)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:35:45.200516 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ec2452da-5356-4383-8719-fa9998d2e19b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:45.217032 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ea6ce6b2-e6d0-45d9-ba0d-294635a9a57f tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for floatingip, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:45.224975 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eb8be844-211f-4c91-944a-c0ed27ccf2c9 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Network b93b0577-d21b-4089-8251-c3aac06bdb77 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:35:45.239463 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-ec2452da-5356-4383-8719-fa9998d2e19b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Calling delete_port for 1a74b864-c68d-4f11-bce5-6e04e0afa480 owned by network:router_interface {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:35:45.241147 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 30ff8933-6aad-4f21-a11e-23a4dd69e54e up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:35:45.297255 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 30ff8933-6aad-4f21-a11e-23a4dd69e54e triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:45.297541 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:45.309001 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7157d5d8-2eef-4f08-9e0b-818ddda05a7a None None] Pushing event updated for resources: {'Port': ['ID=858eaebe-fdb6-4c5b-ab0f-4d6bd86995d4,revision_number=4']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:45.311748 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-eb8be844-211f-4c91-944a-c0ed27ccf2c9 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, b93b0577-d21b-4089-8251-c3aac06bdb77) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:35:45.312794 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cbd8f1d7-d00c-4c52-af55-2357701d60fc None None] Routers {'7b9a51f0-889c-418d-bc8a-fcfd303c5053'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:45.313655 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-cbd8f1d7-d00c-4c52-af55-2357701d60fc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['7b9a51f0-889c-418d-bc8a-fcfd303c5053'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:45.329993 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb8be844-211f-4c91-944a-c0ed27ccf2c9 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:45.332570 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-eb8be844-211f-4c91-944a-c0ed27ccf2c9 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:45.371981 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b77b066f-f8ea-4575-acbf-e24379d660ac None None] Network b93b0577-d21b-4089-8251-c3aac06bdb77 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:35:45.426652 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-eb8be844-211f-4c91-944a-c0ed27ccf2c9 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 830 time: 0.9928536 Nov 09 04:35:45.430154 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58940) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:45.446508 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-cbd8f1d7-d00c-4c52-af55-2357701d60fc None None] Set router 7b9a51f0-889c-418d-bc8a-fcfd303c5053 gateway port host: None {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:35:45.503144 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-039e0e6e-a99a-49ba-bd1d-e12e03f75bbf None None] Provisioning complete for port 8355442d-8835-49e1-b7e9-e76868b288ea triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:45.503144 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-039e0e6e-a99a-49ba-bd1d-e12e03f75bbf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:45.537642 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-039e0e6e-a99a-49ba-bd1d-e12e03f75bbf None None] Port 8355442d-8835-49e1-b7e9-e76868b288ea cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:35:45.637314 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eab427fb-6d8c-410f-aa5d-f9d79e1bceda None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-b93b0577-d21b-4089-8251-c3aac06bdb77', 'network_id': 'b93b0577-d21b-4089-8251-c3aac06bdb77', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'fixed_ips': [{'subnet_id': '75b6b6c5-0313-4754-bcde-7b2b14023f56'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:35:45.638178 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-eab427fb-6d8c-410f-aa5d-f9d79e1bceda None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:45.657303 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72ac3533-0a32-4abb-88a5-2180d7c8c9b3 req-b543d810-50ba-4870-9d38-c54d85d9ef1d tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:45.659016 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-72ac3533-0a32-4abb-88a5-2180d7c8c9b3 req-b543d810-50ba-4870-9d38-c54d85d9ef1d tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=f0ae9486-80b5-43bd-acec-49f871c00e67 HTTP/1.1" status: 200 len: 943 time: 0.2335191 Nov 09 04:35:45.689838 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-6472b829-5618-4c5d-ba15-5b70af9c1a91 None None] Provisioning complete for port 858eaebe-fdb6-4c5b-ab0f-4d6bd86995d4 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:45.690241 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6472b829-5618-4c5d-ba15-5b70af9c1a91 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:45.812510 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-72ac3533-0a32-4abb-88a5-2180d7c8c9b3 req-36774b9d-7682-40e5-bff9-86259a321b98 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1456654 Nov 09 04:35:45.819481 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-cbd8f1d7-d00c-4c52-af55-2357701d60fc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'name': 'tempest-RoutersIpV6Test-router-1491329762', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:35:32Z', 'updated_at': '2021-11-09T04:35:42Z', 'revision_number': 3, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'gw_port_host': None, '_interfaces': [{'id': '5a28daa1-7cdd-49a3-aad4-ecd643914dfd', 'name': '', 'network_id': '0c466943-3298-4130-be72-d7c24549bd5d', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:9e:e7:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1206, 'fixed_ips': [{'subnet_id': '0cd8bdb8-1377-46f0-ba25-14251b97253b', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:35Z', 'updated_at': '2021-11-09T04:35:41Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': '0cd8bdb8-1377-46f0-ba25-14251b97253b', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '858eaebe-fdb6-4c5b-ab0f-4d6bd86995d4', 'name': '', 'network_id': '035bc5dd-3c1d-4ced-893c-487b4c0eff40', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:82:b5:88', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1214, 'fixed_ips': [{'subnet_id': 'b46b8bfd-f2f3-4413-b04c-231ee75f8c2c', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:41Z', 'updated_at': '2021-11-09T04:35:45Z', 'revision_number': 4, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': 'b46b8bfd-f2f3-4413-b04c-231ee75f8c2c', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:45.867087 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cbd8f1d7-d00c-4c52-af55-2357701d60fc None None] The sync data for ids ['7b9a51f0-889c-418d-bc8a-fcfd303c5053'] in dv-neutron-816802-2-hyperv is: [{'id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'name': 'tempest-RoutersIpV6Test-router-1491329762', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:35:32Z', 'updated_at': '2021-11-09T04:35:42Z', 'revision_number': 3, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'gw_port_host': None, '_interfaces': [{'id': '5a28daa1-7cdd-49a3-aad4-ecd643914dfd', 'name': '', 'network_id': '0c466943-3298-4130-be72-d7c24549bd5d', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:9e:e7:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1206, 'fixed_ips': [{'subnet_id': '0cd8bdb8-1377-46f0-ba25-14251b97253b', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:35Z', 'updated_at': '2021-11-09T04:35:41Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': '0cd8bdb8-1377-46f0-ba25-14251b97253b', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '858eaebe-fdb6-4c5b-ab0f-4d6bd86995d4', 'name': '', 'network_id': '035bc5dd-3c1d-4ced-893c-487b4c0eff40', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:82:b5:88', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1214, 'fixed_ips': [{'subnet_id': 'b46b8bfd-f2f3-4413-b04c-231ee75f8c2c', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:41Z', 'updated_at': '2021-11-09T04:35:45Z', 'revision_number': 4, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': 'b46b8bfd-f2f3-4413-b04c-231ee75f8c2c', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:35:45.872256 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-eab427fb-6d8c-410f-aa5d-f9d79e1bceda None None] Allocated IP 2001:db8:2::2 (b93b0577-d21b-4089-8251-c3aac06bdb77/75b6b6c5-0313-4754-bcde-7b2b14023f56/dd1347f5-81e6-4a8a-9c52-5ab6d8716c4c) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:35:45.933853 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6472b829-5618-4c5d-ba15-5b70af9c1a91 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:46.020621 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-6472b829-5618-4c5d-ba15-5b70af9c1a91 None None] For port 858eaebe-fdb6-4c5b-ab0f-4d6bd86995d4, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=858eaebe-fdb6-4c5b-ab0f-4d6bd86995d4,segment=NetworkSegment(3924cc51-1cb6-447f-9de3-d105512d807f),segment_id=3924cc51-1cb6-447f-9de3-d105512d807f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:35:46.023838 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3c3f0df3-75c4-442f-a96e-ffd5aff8daa2 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:46.122445 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6472b829-5618-4c5d-ba15-5b70af9c1a91 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:46.124787 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-eab427fb-6d8c-410f-aa5d-f9d79e1bceda None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:46.188802 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6472b829-5618-4c5d-ba15-5b70af9c1a91 None None] Pushing event updated for resources: {'Port': ['ID=858eaebe-fdb6-4c5b-ab0f-4d6bd86995d4,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:46.208504 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-eab427fb-6d8c-410f-aa5d-f9d79e1bceda None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:46.251871 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eab427fb-6d8c-410f-aa5d-f9d79e1bceda None None] Network b93b0577-d21b-4089-8251-c3aac06bdb77 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:35:46.258352 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-eab427fb-6d8c-410f-aa5d-f9d79e1bceda None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:35:46.270389 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eab427fb-6d8c-410f-aa5d-f9d79e1bceda None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:35:46.291561 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-07b6a62c-bd77-4e04-8f93-1fd7d46e490b None None] Provisioning complete for port 858eaebe-fdb6-4c5b-ab0f-4d6bd86995d4 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:46.291946 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-07b6a62c-bd77-4e04-8f93-1fd7d46e490b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:46.395649 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ec2452da-5356-4383-8719-fa9998d2e19b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:46.433018 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec2452da-5356-4383-8719-fa9998d2e19b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'Port': ['ID=1a74b864-c68d-4f11-bce5-6e04e0afa480,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:46.575120 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eab427fb-6d8c-410f-aa5d-f9d79e1bceda None None] Pushing event updated for resources: {'Port': ['ID=dd1347f5-81e6-4a8a-9c52-5ab6d8716c4c,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:46.638108 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-eab427fb-6d8c-410f-aa5d-f9d79e1bceda None None] Attempting to bind port dd1347f5-81e6-4a8a-9c52-5ab6d8716c4c on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:35:46.638581 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-eab427fb-6d8c-410f-aa5d-f9d79e1bceda None None] Attempting to bind port dd1347f5-81e6-4a8a-9c52-5ab6d8716c4c by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'ffb67bcc-90c4-4cb0-9cae-d89cd9a71c38', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 309, 'network_id': 'b93b0577-d21b-4089-8251-c3aac06bdb77'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:35:46.639018 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eab427fb-6d8c-410f-aa5d-f9d79e1bceda None None] Attempting to bind port dd1347f5-81e6-4a8a-9c52-5ab6d8716c4c on network b93b0577-d21b-4089-8251-c3aac06bdb77 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:35:46.661702 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eab427fb-6d8c-410f-aa5d-f9d79e1bceda None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 35, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:35:46.662292 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eab427fb-6d8c-410f-aa5d-f9d79e1bceda None None] Checking segment: {'id': 'ffb67bcc-90c4-4cb0-9cae-d89cd9a71c38', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 309, 'network_id': 'b93b0577-d21b-4089-8251-c3aac06bdb77'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:35:46.662800 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-eab427fb-6d8c-410f-aa5d-f9d79e1bceda None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:46.663431 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eab427fb-6d8c-410f-aa5d-f9d79e1bceda None None] Bound using segment: {'id': 'ffb67bcc-90c4-4cb0-9cae-d89cd9a71c38', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 309, 'network_id': 'b93b0577-d21b-4089-8251-c3aac06bdb77'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:35:46.664005 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-eab427fb-6d8c-410f-aa5d-f9d79e1bceda None None] Bound port: dd1347f5-81e6-4a8a-9c52-5ab6d8716c4c, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ffb67bcc-90c4-4cb0-9cae-d89cd9a71c38', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 309, 'network_id': 'b93b0577-d21b-4089-8251-c3aac06bdb77'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:35:46.664464 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-eab427fb-6d8c-410f-aa5d-f9d79e1bceda None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:46.733311 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ea6ce6b2-e6d0-45d9-ba0d-294635a9a57f tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:46.739512 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-eab427fb-6d8c-410f-aa5d-f9d79e1bceda None None] For port dd1347f5-81e6-4a8a-9c52-5ab6d8716c4c, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:35:46.745998 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-eab427fb-6d8c-410f-aa5d-f9d79e1bceda None None] For port dd1347f5-81e6-4a8a-9c52-5ab6d8716c4c, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=dd1347f5-81e6-4a8a-9c52-5ab6d8716c4c,segment=NetworkSegment(ffb67bcc-90c4-4cb0-9cae-d89cd9a71c38),segment_id=ffb67bcc-90c4-4cb0-9cae-d89cd9a71c38)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:35:46.747496 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:46.757063 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ec2452da-5356-4383-8719-fa9998d2e19b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:46.796671 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-eab427fb-6d8c-410f-aa5d-f9d79e1bceda None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:46.811034 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ea6ce6b2-e6d0-45d9-ba0d-294635a9a57f tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:46.829072 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-3c3f0df3-75c4-442f-a96e-ffd5aff8daa2 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Allocated IP 2001:db8:2::1 (b93b0577-d21b-4089-8251-c3aac06bdb77/75b6b6c5-0313-4754-bcde-7b2b14023f56/96c020fa-1590-4db4-85e8-09e998526562) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:35:46.915976 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eab427fb-6d8c-410f-aa5d-f9d79e1bceda None None] Pushing event updated for resources: {'Port': ['ID=dd1347f5-81e6-4a8a-9c52-5ab6d8716c4c,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:46.962716 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:46.994315 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.l3_db [None req-ea6ce6b2-e6d0-45d9-ba0d-294635a9a57f tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Floating IP 11262097-8bb4-43b3-9390-692ba9c4e353 associated. External IP: 172.26.0.198, port: 57f5ba4c-bda3-4726-a6dd-7358e44971c0. Nov 09 04:35:47.016429 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0e1bb7f-947e-40e2-b686-909f97d6736b req-3b22cc48-8502-4e3b-bd2c-30ce4ba3f0bf tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:47.018123 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-a0e1bb7f-947e-40e2-b686-909f97d6736b req-3b22cc48-8502-4e3b-bd2c-30ce4ba3f0bf tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=f0ae9486-80b5-43bd-acec-49f871c00e67 HTTP/1.1" status: 200 len: 943 time: 0.0863695 Nov 09 04:35:47.041368 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3c3f0df3-75c4-442f-a96e-ffd5aff8daa2 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:47.098020 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-a0e1bb7f-947e-40e2-b686-909f97d6736b req-9ec08830-d6cf-46ab-aee7-82b351baba27 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0731251 Nov 09 04:35:47.174623 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3c3f0df3-75c4-442f-a96e-ffd5aff8daa2 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:47.222730 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ec2452da-5356-4383-8719-fa9998d2e19b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Router d05416c2-0293-4ef5-a6e3-5968392cc774 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:35:47.227573 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3c3f0df3-75c4-442f-a96e-ffd5aff8daa2 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Network b93b0577-d21b-4089-8251-c3aac06bdb77 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:35:47.229176 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-3c3f0df3-75c4-442f-a96e-ffd5aff8daa2 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:35:47.234292 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3c3f0df3-75c4-442f-a96e-ffd5aff8daa2 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:35:47.235040 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3c3f0df3-75c4-442f-a96e-ffd5aff8daa2 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:47.300435 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c3f0df3-75c4-442f-a96e-ffd5aff8daa2 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event updated for resources: {'Port': ['ID=96c020fa-1590-4db4-85e8-09e998526562,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:47.425275 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ea6ce6b2-e6d0-45d9-ba0d-294635a9a57f tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Router 8ac82b1e-1b89-49c2-850a-e69a6d1163e6 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:35:47.437562 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device dd1347f5-81e6-4a8a-9c52-5ab6d8716c4c up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:35:47.438006 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ec2452da-5356-4383-8719-fa9998d2e19b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:35:47.449193 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-ec2452da-5356-4383-8719-fa9998d2e19b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "PUT /v2.0/routers/d05416c2-0293-4ef5-a6e3-5968392cc774/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 4.0429776 Nov 09 04:35:47.467801 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-efdae5db-f625-417a-a80d-5a6c8893776e None None] Sync routers for ids ['d05416c2-0293-4ef5-a6e3-5968392cc774'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:35:47.475841 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3c3f0df3-75c4-442f-a96e-ffd5aff8daa2 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:47.494196 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-efdae5db-f625-417a-a80d-5a6c8893776e None None] Routers {'d05416c2-0293-4ef5-a6e3-5968392cc774'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:47.500908 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-efdae5db-f625-417a-a80d-5a6c8893776e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['d05416c2-0293-4ef5-a6e3-5968392cc774'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:47.574315 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port dd1347f5-81e6-4a8a-9c52-5ab6d8716c4c triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:47.574711 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:47.608369 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ea6ce6b2-e6d0-45d9-ba0d-294635a9a57f tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:35:47.620202 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2b9457cf-3fe3-47f3-aeb7-47e2dffc8cca None None] Sync routers for ids ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:35:47.630529 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2b9457cf-3fe3-47f3-aeb7-47e2dffc8cca None None] Routers {'8ac82b1e-1b89-49c2-850a-e69a6d1163e6'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:47.631491 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-2b9457cf-3fe3-47f3-aeb7-47e2dffc8cca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:47.668586 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-2b9457cf-3fe3-47f3-aeb7-47e2dffc8cca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:47.680288 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2b9457cf-3fe3-47f3-aeb7-47e2dffc8cca None None] Routers {'8ac82b1e-1b89-49c2-850a-e69a6d1163e6'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:47.681943 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-2b9457cf-3fe3-47f3-aeb7-47e2dffc8cca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:47.695737 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-efdae5db-f625-417a-a80d-5a6c8893776e None None] Set router d05416c2-0293-4ef5-a6e3-5968392cc774 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:35:47.853611 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:47.899825 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-2b9457cf-3fe3-47f3-aeb7-47e2dffc8cca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:47.900396 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2b9457cf-3fe3-47f3-aeb7-47e2dffc8cca None None] The sync data for ids ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:35:47.923590 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3c3f0df3-75c4-442f-a96e-ffd5aff8daa2 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:47.930601 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ea6ce6b2-e6d0-45d9-ba0d-294635a9a57f tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Router f961f4f5-6f17-45e1-91f0-ed3a6c4e8ad7 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:35:47.955307 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port dd1347f5-81e6-4a8a-9c52-5ab6d8716c4c, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=dd1347f5-81e6-4a8a-9c52-5ab6d8716c4c,segment=NetworkSegment(ffb67bcc-90c4-4cb0-9cae-d89cd9a71c38),segment_id=ffb67bcc-90c4-4cb0-9cae-d89cd9a71c38)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:35:48.003221 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3c3f0df3-75c4-442f-a96e-ffd5aff8daa2 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:48.004323 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3c3f0df3-75c4-442f-a96e-ffd5aff8daa2 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:48.032644 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:48.033475 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 858eaebe-fdb6-4c5b-ab0f-4d6bd86995d4 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:35:48.065014 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c3f0df3-75c4-442f-a96e-ffd5aff8daa2 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event updated for resources: {'Port': ['ID=96c020fa-1590-4db4-85e8-09e998526562,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:48.071545 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ea6ce6b2-e6d0-45d9-ba0d-294635a9a57f tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:35:48.077013 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ea6ce6b2-e6d0-45d9-ba0d-294635a9a57f tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:48.098352 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a0d3423c-3f75-4cc8-a77c-08ae74ac03ae None None] Sync routers for ids ['f961f4f5-6f17-45e1-91f0-ed3a6c4e8ad7'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:35:48.098635 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81d50534-1dbe-4b70-9283-7e8c1a33a213 req-fc0617e3-2246-4b87-830e-f0844c87e9fa tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:48.101481 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-81d50534-1dbe-4b70-9283-7e8c1a33a213 req-fc0617e3-2246-4b87-830e-f0844c87e9fa tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=f9a57fa6-0a62-475f-af77-8f608003b5e1 HTTP/1.1" status: 200 len: 946 time: 0.1425455 Nov 09 04:35:48.147868 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-ea6ce6b2-e6d0-45d9-ba0d-294635a9a57f tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] 10.222.0.24 "PUT /v2.0/floatingips/11262097-8bb4-43b3-9390-692ba9c4e353 HTTP/1.1" status: 200 len: 978 time: 3.0814519 Nov 09 04:35:48.150459 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58950) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:48.197241 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 858eaebe-fdb6-4c5b-ab0f-4d6bd86995d4 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:48.197241 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:48.228058 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-81d50534-1dbe-4b70-9283-7e8c1a33a213 req-a01dc93f-9f59-4d03-9ac9-15fa1a893b4a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=eb8d9d39-2315-42c2-bde9-38a01ea1afed&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1122885 Nov 09 04:35:48.256513 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3c3f0df3-75c4-442f-a96e-ffd5aff8daa2 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Network b93b0577-d21b-4089-8251-c3aac06bdb77 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:35:48.256720 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a0d3423c-3f75-4cc8-a77c-08ae74ac03ae None None] Routers {'f961f4f5-6f17-45e1-91f0-ed3a6c4e8ad7'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:48.257163 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-a0d3423c-3f75-4cc8-a77c-08ae74ac03ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['f961f4f5-6f17-45e1-91f0-ed3a6c4e8ad7'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:48.258731 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-3c3f0df3-75c4-442f-a96e-ffd5aff8daa2 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:35:48.268421 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-48b1223e-b675-43b6-8e86-a3d452f9c5ec None None] Network b93b0577-d21b-4089-8251-c3aac06bdb77 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:35:48.300307 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d03805f-dd4d-474d-8b9b-9f950c88715a req-dd9a63a3-11d4-495e-823f-5e33de70895c tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:48.301807 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1d03805f-dd4d-474d-8b9b-9f950c88715a req-dd9a63a3-11d4-495e-823f-5e33de70895c tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=f0ae9486-80b5-43bd-acec-49f871c00e67 HTTP/1.1" status: 200 len: 943 time: 0.0668402 Nov 09 04:35:48.310142 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-688e5e0a-25b4-4929-bbd5-aba12895dbdf tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Deleting port 8355442d-8835-49e1-b7e9-e76868b288ea {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:35:48.310507 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-688e5e0a-25b4-4929-bbd5-aba12895dbdf tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:48.327406 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-a0d3423c-3f75-4cc8-a77c-08ae74ac03ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:48.349910 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=dd1347f5-81e6-4a8a-9c52-5ab6d8716c4c,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:48.390307 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3c3f0df3-75c4-442f-a96e-ffd5aff8daa2 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Router 7b9a51f0-889c-418d-bc8a-fcfd303c5053 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:35:48.406517 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a0d3423c-3f75-4cc8-a77c-08ae74ac03ae None None] Routers {'f961f4f5-6f17-45e1-91f0-ed3a6c4e8ad7'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:48.407150 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-a0d3423c-3f75-4cc8-a77c-08ae74ac03ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['f961f4f5-6f17-45e1-91f0-ed3a6c4e8ad7'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:48.454204 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-a0d3423c-3f75-4cc8-a77c-08ae74ac03ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:48.454873 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a0d3423c-3f75-4cc8-a77c-08ae74ac03ae None None] The sync data for ids ['f961f4f5-6f17-45e1-91f0-ed3a6c4e8ad7'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:35:48.465175 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1d03805f-dd4d-474d-8b9b-9f950c88715a req-5d35a27d-b0d4-45fa-95c3-58e8e3cbf6e7 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1516197 Nov 09 04:35:48.476913 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4fb14ec3-e16b-4174-a2c8-b4b7814b0da0 req-12d70e87-8638-47db-88fb-11f38840042e service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=8f462374-376b-4c38-b300-528ae5358377&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1250441 Nov 09 04:35:48.478272 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-133f7ceb-0098-4654-877d-831a02b87d02 None None] Provisioning complete for port dd1347f5-81e6-4a8a-9c52-5ab6d8716c4c triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:48.479013 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-688e5e0a-25b4-4929-bbd5-aba12895dbdf tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:48.479162 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-133f7ceb-0098-4654-877d-831a02b87d02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:48.509827 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3c3f0df3-75c4-442f-a96e-ffd5aff8daa2 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:35:48.519399 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ac538a5a-fb81-4497-b77c-f36fe30a1b00 None None] Sync routers for ids ['7b9a51f0-889c-418d-bc8a-fcfd303c5053'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:35:48.528815 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-3c3f0df3-75c4-442f-a96e-ffd5aff8daa2 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "PUT /v2.0/routers/7b9a51f0-889c-418d-bc8a-fcfd303c5053/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.0973182 Nov 09 04:35:48.529587 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58952) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:48.530954 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ac538a5a-fb81-4497-b77c-f36fe30a1b00 None None] Routers {'7b9a51f0-889c-418d-bc8a-fcfd303c5053'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:48.532327 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-ac538a5a-fb81-4497-b77c-f36fe30a1b00 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['7b9a51f0-889c-418d-bc8a-fcfd303c5053'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:48.535927 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-32490081-0d02-433c-82e2-7319e51f3373 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-512823682'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:35:48.539840 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-efdae5db-f625-417a-a80d-5a6c8893776e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'name': 'tempest-TestNetworkBasicOps-router-1967773701', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.204'}], 'enable_snat': True}, 'gw_port_id': '49bff53a-c208-4aa5-8fcc-e7ec9471fae7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:33:32Z', 'updated_at': '2021-11-09T04:35:45Z', 'revision_number': 6, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '49bff53a-c208-4aa5-8fcc-e7ec9471fae7', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:85:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'device_owner': 'network:router_gateway', 'standard_attr_id': 978, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.204', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:33:34Z', 'updated_at': '2021-11-09T04:33:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '071d456d-45c8-43d6-9154-8dc9c2df29f2', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'floating_ip_address': '172.26.0.195', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'port_id': '09cbfb91-4118-43af-8b70-41d8d4265574', 'fixed_ip_address': '172.20.0.7', 'status': 'ACTIVE', 'standard_attr_id': 1062, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '239a9c72-6384-4d5a-a69d-f4ac0c580e40', 'mac_address': 'fa:16:3e:27:22:c9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f462374-376b-4c38-b300-528ae5358377', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:34:20Z', 'updated_at': '2021-11-09T04:34:25Z', 'revision_number': 1, 'project_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '9930d582-2262-4f1d-97bf-b02697a70777', 'name': '', 'network_id': '239a9c72-6384-4d5a-a69d-f4ac0c580e40', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:7c:21:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'device_owner': 'network:router_interface', 'standard_attr_id': 987, 'fixed_ips': [{'subnet_id': '33b5599d-7ebe-4564-9c72-76f5d540fd80', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:33:41Z', 'updated_at': '2021-11-09T04:33:48Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '33b5599d-7ebe-4564-9c72-76f5d540fd80', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:48.593480 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-efdae5db-f625-417a-a80d-5a6c8893776e None None] Checking router: d05416c2-0293-4ef5-a6e3-5968392cc774 for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:35:48.633927 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-efdae5db-f625-417a-a80d-5a6c8893776e None None] Routers {'d05416c2-0293-4ef5-a6e3-5968392cc774'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:48.634746 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-efdae5db-f625-417a-a80d-5a6c8893776e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['d05416c2-0293-4ef5-a6e3-5968392cc774'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:48.638988 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-ac538a5a-fb81-4497-b77c-f36fe30a1b00 None None] Set router 7b9a51f0-889c-418d-bc8a-fcfd303c5053 gateway port host: None {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:35:48.649875 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fb14ec3-e16b-4174-a2c8-b4b7814b0da0 req-3e576d7d-78e1-4378-ae68-6e6fd4f43491 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:48.651502 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4fb14ec3-e16b-4174-a2c8-b4b7814b0da0 req-3e576d7d-78e1-4378-ae68-6e6fd4f43491 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&device_id=8f462374-376b-4c38-b300-528ae5358377 HTTP/1.1" status: 200 len: 1098 time: 0.0991008 Nov 09 04:35:48.669561 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-32490081-0d02-433c-82e2-7319e51f3373 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Made reservation on behalf of d11b025703b24d109deef7bfe57a45f6 for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:35:48.674349 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-32490081-0d02-433c-82e2-7319e51f3373 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:48.710828 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-32490081-0d02-433c-82e2-7319e51f3373 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 332} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:35:48.723434 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-32490081-0d02-433c-82e2-7319e51f3373 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:48.724049 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-32490081-0d02-433c-82e2-7319e51f3373 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Added segment 73188347-497c-4b3d-bfb4-401319c53746 of type vlan for network f1abb35d-0157-4eda-8b7e-6c93030db963 Nov 09 04:35:48.778651 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-32490081-0d02-433c-82e2-7319e51f3373 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:48.810214 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-688e5e0a-25b4-4929-bbd5-aba12895dbdf tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:48.810666 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-688e5e0a-25b4-4929-bbd5-aba12895dbdf tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:48.811044 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.l3_db [None req-688e5e0a-25b4-4929-bbd5-aba12895dbdf tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Floating IP 11262097-8bb4-43b3-9390-692ba9c4e353 disassociated. External IP: 172.26.0.198, port: 8355442d-8835-49e1-b7e9-e76868b288ea. Nov 09 04:35:48.811451 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-688e5e0a-25b4-4929-bbd5-aba12895dbdf tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Calling delete_port for 8355442d-8835-49e1-b7e9-e76868b288ea owned by {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:35:48.817880 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-efdae5db-f625-417a-a80d-5a6c8893776e None None] Set router d05416c2-0293-4ef5-a6e3-5968392cc774 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:35:48.828771 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fb14ec3-e16b-4174-a2c8-b4b7814b0da0 req-87cb4618-e909-4a14-8ab2-2153d0982582 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:48.833400 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4fb14ec3-e16b-4174-a2c8-b4b7814b0da0 req-87cb4618-e909-4a14-8ab2-2153d0982582 service neutron] 10.222.0.26 "GET /v2.0/networks?id=239a9c72-6384-4d5a-a69d-f4ac0c580e40 HTTP/1.1" status: 200 len: 897 time: 0.1223521 Nov 09 04:35:48.883292 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-32490081-0d02-433c-82e2-7319e51f3373 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:48.904574 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-32490081-0d02-433c-82e2-7319e51f3373 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:48.905711 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-32490081-0d02-433c-82e2-7319e51f3373 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:48.914002 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-ac538a5a-fb81-4497-b77c-f36fe30a1b00 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'name': 'tempest-RoutersIpV6Test-router-1491329762', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:35:32Z', 'updated_at': '2021-11-09T04:35:47Z', 'revision_number': 4, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'gw_port_host': None, '_interfaces': [{'id': '5a28daa1-7cdd-49a3-aad4-ecd643914dfd', 'name': '', 'network_id': '0c466943-3298-4130-be72-d7c24549bd5d', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:9e:e7:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1206, 'fixed_ips': [{'subnet_id': '0cd8bdb8-1377-46f0-ba25-14251b97253b', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:35Z', 'updated_at': '2021-11-09T04:35:41Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': '0cd8bdb8-1377-46f0-ba25-14251b97253b', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '858eaebe-fdb6-4c5b-ab0f-4d6bd86995d4', 'name': '', 'network_id': '035bc5dd-3c1d-4ced-893c-487b4c0eff40', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:82:b5:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1214, 'fixed_ips': [{'subnet_id': 'b46b8bfd-f2f3-4413-b04c-231ee75f8c2c', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:41Z', 'updated_at': '2021-11-09T04:35:45Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': 'b46b8bfd-f2f3-4413-b04c-231ee75f8c2c', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '96c020fa-1590-4db4-85e8-09e998526562', 'name': '', 'network_id': 'b93b0577-d21b-4089-8251-c3aac06bdb77', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:02:31:5b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1220, 'fixed_ips': [{'subnet_id': '75b6b6c5-0313-4754-bcde-7b2b14023f56', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:46Z', 'updated_at': '2021-11-09T04:35:47Z', 'revision_number': 2, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': '75b6b6c5-0313-4754-bcde-7b2b14023f56', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:48.957505 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4fb14ec3-e16b-4174-a2c8-b4b7814b0da0 req-6ea41394-ad57-45db-9bb6-bdf4a0fe9ed1 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=09cbfb91-4118-43af-8b70-41d8d4265574 HTTP/1.1" status: 200 len: 1001 time: 0.0872748 Nov 09 04:35:48.978123 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ac538a5a-fb81-4497-b77c-f36fe30a1b00 None None] Checking router: 7b9a51f0-889c-418d-bc8a-fcfd303c5053 for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:35:48.978846 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ac538a5a-fb81-4497-b77c-f36fe30a1b00 None None] Updating router 7b9a51f0-889c-418d-bc8a-fcfd303c5053 port 96c020fa-1590-4db4-85e8-09e998526562 binding host dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 04:35:49.019473 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-ac538a5a-fb81-4497-b77c-f36fe30a1b00 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:49.047345 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32490081-0d02-433c-82e2-7319e51f3373 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event updated for resources: {'Network': ['ID=f1abb35d-0157-4eda-8b7e-6c93030db963,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:49.056203 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-32490081-0d02-433c-82e2-7319e51f3373 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.5254912 Nov 09 04:35:49.059875 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58954) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:49.072635 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-93a806ef-5cb9-44d2-9420-5b0689f42a30 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Request body: {'subnet': {'network_id': 'f1abb35d-0157-4eda-8b7e-6c93030db963', 'cidr': '2001:db8:3::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:3::1'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:35:49.080272 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fb14ec3-e16b-4174-a2c8-b4b7814b0da0 req-f4748dc5-8e78-43b7-b3a7-36e7e048de28 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:49.081787 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4fb14ec3-e16b-4174-a2c8-b4b7814b0da0 req-f4748dc5-8e78-43b7-b3a7-36e7e048de28 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=33b5599d-7ebe-4564-9c72-76f5d540fd80 HTTP/1.1" status: 200 len: 834 time: 0.1155839 Nov 09 04:35:49.154231 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-688e5e0a-25b4-4929-bbd5-aba12895dbdf tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:49.234309 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-688e5e0a-25b4-4929-bbd5-aba12895dbdf tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Pushing event deleted for resources: {'Port': ['ID=8355442d-8835-49e1-b7e9-e76868b288ea,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:49.304045 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network f1abb35d-0157-4eda-8b7e-6c93030db963 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:35:49.305674 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fb14ec3-e16b-4174-a2c8-b4b7814b0da0 req-9766d767-0ca4-447a-b739-a6dfaa618f25 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:49.306801 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device dd1347f5-81e6-4a8a-9c52-5ab6d8716c4c up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:35:49.308999 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4fb14ec3-e16b-4174-a2c8-b4b7814b0da0 req-9766d767-0ca4-447a-b739-a6dfaa618f25 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=239a9c72-6384-4d5a-a69d-f4ac0c580e40&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.2174330 Nov 09 04:35:49.395160 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-93a806ef-5cb9-44d2-9420-5b0689f42a30 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Made reservation on behalf of d11b025703b24d109deef7bfe57a45f6 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:35:49.399060 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-93a806ef-5cb9-44d2-9420-5b0689f42a30 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:49.438329 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-8d716742-ea4e-46a2-b243-75bae9eb2953 None None] Provisioning complete for port 96c020fa-1590-4db4-85e8-09e998526562 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:49.438723 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8d716742-ea4e-46a2-b243-75bae9eb2953 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:49.542268 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-ac538a5a-fb81-4497-b77c-f36fe30a1b00 None None] Publish callbacks [] for port, precommit_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:49.551983 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port dd1347f5-81e6-4a8a-9c52-5ab6d8716c4c triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:49.552363 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:49.560334 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3db43efa-98cb-42c1-8703-e31db4cb88fe req-8a61aac1-40dc-4d4c-a3ae-77eaca6c75fa tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:49.568170 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-3db43efa-98cb-42c1-8703-e31db4cb88fe req-8a61aac1-40dc-4d4c-a3ae-77eaca6c75fa tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=f9a57fa6-0a62-475f-af77-8f608003b5e1 HTTP/1.1" status: 200 len: 946 time: 0.2315047 Nov 09 04:35:49.625436 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-ac538a5a-fb81-4497-b77c-f36fe30a1b00 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:49.660141 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-3db43efa-98cb-42c1-8703-e31db4cb88fe req-250e2a10-18a7-44e2-8465-83d963a233d7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=eb8d9d39-2315-42c2-bde9-38a01ea1afed&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0859568 Nov 09 04:35:49.739008 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff0a38b3-f4b8-47fb-8091-92f8e8f8c4bb None None] Pushing event updated for resources: {'Port': ['ID=96c020fa-1590-4db4-85e8-09e998526562,revision_number=3']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:49.776248 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-8d716742-ea4e-46a2-b243-75bae9eb2953 None None] Port 96c020fa-1590-4db4-85e8-09e998526562 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:35:49.810435 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-ac538a5a-fb81-4497-b77c-f36fe30a1b00 None None] Attempting to bind port 96c020fa-1590-4db4-85e8-09e998526562 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:35:49.810742 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-ac538a5a-fb81-4497-b77c-f36fe30a1b00 None None] Attempting to bind port 96c020fa-1590-4db4-85e8-09e998526562 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'ffb67bcc-90c4-4cb0-9cae-d89cd9a71c38', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 309, 'network_id': 'b93b0577-d21b-4089-8251-c3aac06bdb77'}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:35:49.811099 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ac538a5a-fb81-4497-b77c-f36fe30a1b00 None None] Attempting to bind port 96c020fa-1590-4db4-85e8-09e998526562 on network b93b0577-d21b-4089-8251-c3aac06bdb77 {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:35:49.822110 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-8d716742-ea4e-46a2-b243-75bae9eb2953 None None] Provisioning complete for port dd1347f5-81e6-4a8a-9c52-5ab6d8716c4c triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:49.822684 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8d716742-ea4e-46a2-b243-75bae9eb2953 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:49.827314 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ac538a5a-fb81-4497-b77c-f36fe30a1b00 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 35, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:35:49.827314 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ac538a5a-fb81-4497-b77c-f36fe30a1b00 None None] Checking segment: {'id': 'ffb67bcc-90c4-4cb0-9cae-d89cd9a71c38', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 309, 'network_id': 'b93b0577-d21b-4089-8251-c3aac06bdb77'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102164) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:35:49.832143 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-ac538a5a-fb81-4497-b77c-f36fe30a1b00 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:49.832143 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ac538a5a-fb81-4497-b77c-f36fe30a1b00 None None] Bound using segment: {'id': 'ffb67bcc-90c4-4cb0-9cae-d89cd9a71c38', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 309, 'network_id': 'b93b0577-d21b-4089-8251-c3aac06bdb77'} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:35:49.832143 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-ac538a5a-fb81-4497-b77c-f36fe30a1b00 None None] Bound port: 96c020fa-1590-4db4-85e8-09e998526562, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ffb67bcc-90c4-4cb0-9cae-d89cd9a71c38', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 309, 'network_id': 'b93b0577-d21b-4089-8251-c3aac06bdb77'}}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:35:49.832143 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-ac538a5a-fb81-4497-b77c-f36fe30a1b00 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:49.893723 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-93a806ef-5cb9-44d2-9420-5b0689f42a30 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:49.896503 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-efdae5db-f625-417a-a80d-5a6c8893776e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'name': 'tempest-TestNetworkBasicOps-router-1967773701', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.204'}], 'enable_snat': True}, 'gw_port_id': '49bff53a-c208-4aa5-8fcc-e7ec9471fae7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:33:32Z', 'updated_at': '2021-11-09T04:35:45Z', 'revision_number': 6, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '49bff53a-c208-4aa5-8fcc-e7ec9471fae7', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:85:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'device_owner': 'network:router_gateway', 'standard_attr_id': 978, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.204', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:33:34Z', 'updated_at': '2021-11-09T04:33:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '071d456d-45c8-43d6-9154-8dc9c2df29f2', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'floating_ip_address': '172.26.0.195', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'port_id': '09cbfb91-4118-43af-8b70-41d8d4265574', 'fixed_ip_address': '172.20.0.7', 'status': 'ACTIVE', 'standard_attr_id': 1062, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '239a9c72-6384-4d5a-a69d-f4ac0c580e40', 'mac_address': 'fa:16:3e:27:22:c9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f462374-376b-4c38-b300-528ae5358377', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:34:20Z', 'updated_at': '2021-11-09T04:34:25Z', 'revision_number': 1, 'project_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '9930d582-2262-4f1d-97bf-b02697a70777', 'name': '', 'network_id': '239a9c72-6384-4d5a-a69d-f4ac0c580e40', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:7c:21:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'device_owner': 'network:router_interface', 'standard_attr_id': 987, 'fixed_ips': [{'subnet_id': '33b5599d-7ebe-4564-9c72-76f5d540fd80', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:33:41Z', 'updated_at': '2021-11-09T04:33:48Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '33b5599d-7ebe-4564-9c72-76f5d540fd80', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:49.904737 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-ac538a5a-fb81-4497-b77c-f36fe30a1b00 None None] For port 96c020fa-1590-4db4-85e8-09e998526562, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102164) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:35:49.940751 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-efdae5db-f625-417a-a80d-5a6c8893776e None None] The sync data for ids ['d05416c2-0293-4ef5-a6e3-5968392cc774'] in dv-neutron-816802-2-hyperv is: [{'id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'name': 'tempest-TestNetworkBasicOps-router-1967773701', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.204'}], 'enable_snat': True}, 'gw_port_id': '49bff53a-c208-4aa5-8fcc-e7ec9471fae7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:33:32Z', 'updated_at': '2021-11-09T04:35:45Z', 'revision_number': 6, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '49bff53a-c208-4aa5-8fcc-e7ec9471fae7', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:85:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'device_owner': 'network:router_gateway', 'standard_attr_id': 978, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.204', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:33:34Z', 'updated_at': '2021-11-09T04:33:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '071d456d-45c8-43d6-9154-8dc9c2df29f2', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'floating_ip_address': '172.26.0.195', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'port_id': '09cbfb91-4118-43af-8b70-41d8d4265574', 'fixed_ip_address': '172.20.0.7', 'status': 'ACTIVE', 'standard_attr_id': 1062, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '239a9c72-6384-4d5a-a69d-f4ac0c580e40', 'mac_address': 'fa:16:3e:27:22:c9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f462374-376b-4c38-b300-528ae5358377', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:34:20Z', 'updated_at': '2021-11-09T04:34:25Z', 'revision_number': 1, 'project_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '9930d582-2262-4f1d-97bf-b02697a70777', 'name': '', 'network_id': '239a9c72-6384-4d5a-a69d-f4ac0c580e40', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:7c:21:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'device_owner': 'network:router_interface', 'standard_attr_id': 987, 'fixed_ips': [{'subnet_id': '33b5599d-7ebe-4564-9c72-76f5d540fd80', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:33:41Z', 'updated_at': '2021-11-09T04:33:48Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '33b5599d-7ebe-4564-9c72-76f5d540fd80', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:35:49.987449 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-ac538a5a-fb81-4497-b77c-f36fe30a1b00 None None] For port 96c020fa-1590-4db4-85e8-09e998526562, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=96c020fa-1590-4db4-85e8-09e998526562,segment=NetworkSegment(ffb67bcc-90c4-4cb0-9cae-d89cd9a71c38),segment_id=ffb67bcc-90c4-4cb0-9cae-d89cd9a71c38)] {{(pid=102164) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:35:50.006934 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-93a806ef-5cb9-44d2-9420-5b0689f42a30 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Checking segment: {'id': '73188347-497c-4b3d-bfb4-401319c53746', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 332, 'network_id': 'f1abb35d-0157-4eda-8b7e-6c93030db963'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:35:50.006934 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-93a806ef-5cb9-44d2-9420-5b0689f42a30 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Network hostable DHCP agents. Network: f1abb35d-0157-4eda-8b7e-6c93030db963, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:35:50.007781 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93a806ef-5cb9-44d2-9420-5b0689f42a30 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event updated for resources: {'Subnet': ['ID=07a4cdc6-7f9d-4e6c-98b9-ae041d44d264,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:50.033863 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4fb14ec3-e16b-4174-a2c8-b4b7814b0da0 req-9aa9d79b-62ef-4f56-b8dd-2804ac1a7c10 service neutron] 10.222.0.26 "GET /v2.0/networks/239a9c72-6384-4d5a-a69d-f4ac0c580e40?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7127461 Nov 09 04:35:50.055321 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-688e5e0a-25b4-4929-bbd5-aba12895dbdf tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Router f961f4f5-6f17-45e1-91f0-ed3a6c4e8ad7 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:35:50.075317 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48865eeb-1860-436e-b478-809aba052a01 req-f4fbeb3a-fd04-41c7-9b5f-26baaa204a0a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:50.075317 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-48865eeb-1860-436e-b478-809aba052a01 req-f4fbeb3a-fd04-41c7-9b5f-26baaa204a0a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "GET /v2.0/ports?device_id=f9a57fa6-0a62-475f-af77-8f608003b5e1 HTTP/1.1" status: 200 len: 946 time: 0.6705153 Nov 09 04:35:50.093975 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-ac538a5a-fb81-4497-b77c-f36fe30a1b00 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:50.114012 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1721559e-d923-4388-999f-dce604b1e275 req-5a3a86fb-7798-4c3e-9a3f-1bf8318f55a7 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:50.121350 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-49f5d15c-1c46-4f9a-959a-952e9b5412ad None None] Provisioning complete for port 96c020fa-1590-4db4-85e8-09e998526562 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:50.121988 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-49f5d15c-1c46-4f9a-959a-952e9b5412ad None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:50.122143 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1721559e-d923-4388-999f-dce604b1e275 req-5a3a86fb-7798-4c3e-9a3f-1bf8318f55a7 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=f0ae9486-80b5-43bd-acec-49f871c00e67 HTTP/1.1" status: 200 len: 943 time: 0.2084060 Nov 09 04:35:50.139042 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-93a806ef-5cb9-44d2-9420-5b0689f42a30 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Network f1abb35d-0157-4eda-8b7e-6c93030db963 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:35:50.153428 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff0a38b3-f4b8-47fb-8091-92f8e8f8c4bb None None] Pushing event updated for resources: {'Port': ['ID=96c020fa-1590-4db4-85e8-09e998526562,revision_number=4']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:50.175444 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ac538a5a-fb81-4497-b77c-f36fe30a1b00 None None] Routers {'7b9a51f0-889c-418d-bc8a-fcfd303c5053'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:50.176060 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-ac538a5a-fb81-4497-b77c-f36fe30a1b00 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['7b9a51f0-889c-418d-bc8a-fcfd303c5053'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:50.224313 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-49f5d15c-1c46-4f9a-959a-952e9b5412ad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:50.253224 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-93a806ef-5cb9-44d2-9420-5b0689f42a30 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, f1abb35d-0157-4eda-8b7e-6c93030db963) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:35:50.260504 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-93a806ef-5cb9-44d2-9420-5b0689f42a30 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:50.261165 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-93a806ef-5cb9-44d2-9420-5b0689f42a30 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:50.272281 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-49f5d15c-1c46-4f9a-959a-952e9b5412ad None None] For port 96c020fa-1590-4db4-85e8-09e998526562, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=96c020fa-1590-4db4-85e8-09e998526562,segment=NetworkSegment(ffb67bcc-90c4-4cb0-9cae-d89cd9a71c38),segment_id=ffb67bcc-90c4-4cb0-9cae-d89cd9a71c38)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:35:50.275438 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-34813e22-b56d-4f80-ae78-44f7398e2e49 None None] Network f1abb35d-0157-4eda-8b7e-6c93030db963 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:35:50.308662 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-ac538a5a-fb81-4497-b77c-f36fe30a1b00 None None] Set router 7b9a51f0-889c-418d-bc8a-fcfd303c5053 gateway port host: None {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:35:50.340431 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-49f5d15c-1c46-4f9a-959a-952e9b5412ad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:50.373648 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-93a806ef-5cb9-44d2-9420-5b0689f42a30 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 830 time: 1.3124549 Nov 09 04:35:50.375402 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58960) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:50.409840 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1721559e-d923-4388-999f-dce604b1e275 req-78225421-719f-4f9b-8c1c-6402ec42ce71 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2867262 Nov 09 04:35:50.509348 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49f5d15c-1c46-4f9a-959a-952e9b5412ad None None] Pushing event updated for resources: {'Port': ['ID=96c020fa-1590-4db4-85e8-09e998526562,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:50.531063 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4fb14ec3-e16b-4174-a2c8-b4b7814b0da0 req-eb5da34a-db03-4123-93e0-6715a0664f98 service neutron] 10.222.0.26 "GET /v2.0/networks/239a9c72-6384-4d5a-a69d-f4ac0c580e40?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4812388 Nov 09 04:35:50.569436 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-7ee3304c-439b-4187-abca-9d0a1c3a7e57 None None] Provisioning complete for port 96c020fa-1590-4db4-85e8-09e998526562 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:50.569812 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7ee3304c-439b-4187-abca-9d0a1c3a7e57 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:50.571636 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6628b671-b4b3-4e12-9eda-3b8c8e1cd9c2 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-f1abb35d-0157-4eda-8b7e-6c93030db963', 'network_id': 'f1abb35d-0157-4eda-8b7e-6c93030db963', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'fixed_ips': [{'subnet_id': '07a4cdc6-7f9d-4e6c-98b9-ae041d44d264'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:35:50.572457 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6628b671-b4b3-4e12-9eda-3b8c8e1cd9c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:50.597620 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-688e5e0a-25b4-4929-bbd5-aba12895dbdf tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:35:50.617852 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c5bb8310-8f68-4d94-a7c2-9301c573de48 None None] Sync routers for ids ['f961f4f5-6f17-45e1-91f0-ed3a6c4e8ad7'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:35:50.630266 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-48865eeb-1860-436e-b478-809aba052a01 req-1cd15c38-4465-45d2-bda3-5cf4675b5ad5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Deleting port e2d06464-eb31-4d6f-b9a6-209564b03294 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:35:50.631088 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-48865eeb-1860-436e-b478-809aba052a01 req-1cd15c38-4465-45d2-bda3-5cf4675b5ad5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:50.724490 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c5bb8310-8f68-4d94-a7c2-9301c573de48 None None] Routers {'f961f4f5-6f17-45e1-91f0-ed3a6c4e8ad7'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:50.725232 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-c5bb8310-8f68-4d94-a7c2-9301c573de48 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['f961f4f5-6f17-45e1-91f0-ed3a6c4e8ad7'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:50.752346 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-ac538a5a-fb81-4497-b77c-f36fe30a1b00 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'name': 'tempest-RoutersIpV6Test-router-1491329762', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:35:32Z', 'updated_at': '2021-11-09T04:35:47Z', 'revision_number': 4, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'gw_port_host': None, '_interfaces': [{'id': '5a28daa1-7cdd-49a3-aad4-ecd643914dfd', 'name': '', 'network_id': '0c466943-3298-4130-be72-d7c24549bd5d', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:9e:e7:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1206, 'fixed_ips': [{'subnet_id': '0cd8bdb8-1377-46f0-ba25-14251b97253b', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:35Z', 'updated_at': '2021-11-09T04:35:41Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': '0cd8bdb8-1377-46f0-ba25-14251b97253b', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '858eaebe-fdb6-4c5b-ab0f-4d6bd86995d4', 'name': '', 'network_id': '035bc5dd-3c1d-4ced-893c-487b4c0eff40', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:82:b5:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1214, 'fixed_ips': [{'subnet_id': 'b46b8bfd-f2f3-4413-b04c-231ee75f8c2c', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:41Z', 'updated_at': '2021-11-09T04:35:45Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': 'b46b8bfd-f2f3-4413-b04c-231ee75f8c2c', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '96c020fa-1590-4db4-85e8-09e998526562', 'name': '', 'network_id': 'b93b0577-d21b-4089-8251-c3aac06bdb77', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:02:31:5b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1220, 'fixed_ips': [{'subnet_id': '75b6b6c5-0313-4754-bcde-7b2b14023f56', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:46Z', 'updated_at': '2021-11-09T04:35:49Z', 'revision_number': 4, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': '75b6b6c5-0313-4754-bcde-7b2b14023f56', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:50.785034 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-c5bb8310-8f68-4d94-a7c2-9301c573de48 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:50.797126 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ac538a5a-fb81-4497-b77c-f36fe30a1b00 None None] The sync data for ids ['7b9a51f0-889c-418d-bc8a-fcfd303c5053'] in dv-neutron-816802-2-hyperv is: [{'id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'name': 'tempest-RoutersIpV6Test-router-1491329762', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:35:32Z', 'updated_at': '2021-11-09T04:35:47Z', 'revision_number': 4, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'gw_port_host': None, '_interfaces': [{'id': '5a28daa1-7cdd-49a3-aad4-ecd643914dfd', 'name': '', 'network_id': '0c466943-3298-4130-be72-d7c24549bd5d', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:9e:e7:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1206, 'fixed_ips': [{'subnet_id': '0cd8bdb8-1377-46f0-ba25-14251b97253b', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:35Z', 'updated_at': '2021-11-09T04:35:41Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': '0cd8bdb8-1377-46f0-ba25-14251b97253b', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '858eaebe-fdb6-4c5b-ab0f-4d6bd86995d4', 'name': '', 'network_id': '035bc5dd-3c1d-4ced-893c-487b4c0eff40', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:82:b5:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1214, 'fixed_ips': [{'subnet_id': 'b46b8bfd-f2f3-4413-b04c-231ee75f8c2c', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:41Z', 'updated_at': '2021-11-09T04:35:45Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': 'b46b8bfd-f2f3-4413-b04c-231ee75f8c2c', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '96c020fa-1590-4db4-85e8-09e998526562', 'name': '', 'network_id': 'b93b0577-d21b-4089-8251-c3aac06bdb77', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:02:31:5b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1220, 'fixed_ips': [{'subnet_id': '75b6b6c5-0313-4754-bcde-7b2b14023f56', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:46Z', 'updated_at': '2021-11-09T04:35:49Z', 'revision_number': 4, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': '75b6b6c5-0313-4754-bcde-7b2b14023f56', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:35:50.814594 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-688e5e0a-25b4-4929-bbd5-aba12895dbdf tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:50.823477 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-688e5e0a-25b4-4929-bbd5-aba12895dbdf tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] 10.222.0.24 "DELETE /v2.0/ports/8355442d-8835-49e1-b7e9-e76868b288ea HTTP/1.1" status: 204 len: 168 time: 2.6710980 Nov 09 04:35:50.824147 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58964) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:50.881000 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c5bb8310-8f68-4d94-a7c2-9301c573de48 None None] Routers {'f961f4f5-6f17-45e1-91f0-ed3a6c4e8ad7'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:50.881626 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-c5bb8310-8f68-4d94-a7c2-9301c573de48 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['f961f4f5-6f17-45e1-91f0-ed3a6c4e8ad7'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:50.911905 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e94fa411-4776-48a4-b2c7-35d9aeba9e53 req-8eab2ba7-853e-4c97-8446-5733bc7d7525 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:50.913754 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-e94fa411-4776-48a4-b2c7-35d9aeba9e53 req-8eab2ba7-853e-4c97-8446-5733bc7d7525 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=f9a57fa6-0a62-475f-af77-8f608003b5e1 HTTP/1.1" status: 200 len: 946 time: 0.1379340 Nov 09 04:35:50.938074 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-48865eeb-1860-436e-b478-809aba052a01 req-1cd15c38-4465-45d2-bda3-5cf4675b5ad5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] For port e2d06464-eb31-4d6f-b9a6-209564b03294, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=e2d06464-eb31-4d6f-b9a6-209564b03294,segment=NetworkSegment(142b6494-b2b1-4cea-9b90-321c4a2a4cae),segment_id=142b6494-b2b1-4cea-9b90-321c4a2a4cae)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:35:50.938495 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-48865eeb-1860-436e-b478-809aba052a01 req-1cd15c38-4465-45d2-bda3-5cf4675b5ad5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:50.950063 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-c5bb8310-8f68-4d94-a7c2-9301c573de48 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:50.950063 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c5bb8310-8f68-4d94-a7c2-9301c573de48 None None] The sync data for ids ['f961f4f5-6f17-45e1-91f0-ed3a6c4e8ad7'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:35:50.959974 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-6628b671-b4b3-4e12-9eda-3b8c8e1cd9c2 None None] Allocated IP 2001:db8:3::2 (f1abb35d-0157-4eda-8b7e-6c93030db963/07a4cdc6-7f9d-4e6c-98b9-ae041d44d264/42c63ae2-c868-4395-8d1a-b91fb2d91d24) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:35:50.962397 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-48865eeb-1860-436e-b478-809aba052a01 req-1cd15c38-4465-45d2-bda3-5cf4675b5ad5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Calling delete_port for e2d06464-eb31-4d6f-b9a6-209564b03294 owned by compute:nova {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:35:51.033574 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-e94fa411-4776-48a4-b2c7-35d9aeba9e53 req-2ff63838-00ca-4c6c-a97b-3706126f202f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=eb8d9d39-2315-42c2-bde9-38a01ea1afed&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1078775 Nov 09 04:35:51.063770 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4edea27b-e948-4ffb-b77a-be998cfc026c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:51.095970 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-0064f7e2-95d0-462d-8447-49f92639d25b None None] Provisioning complete for port 96c020fa-1590-4db4-85e8-09e998526562 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:51.096330 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0064f7e2-95d0-462d-8447-49f92639d25b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:51.267374 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6628b671-b4b3-4e12-9eda-3b8c8e1cd9c2 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:51.310052 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 96c020fa-1590-4db4-85e8-09e998526562 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:35:51.379826 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6628b671-b4b3-4e12-9eda-3b8c8e1cd9c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:51.403617 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-48865eeb-1860-436e-b478-809aba052a01 req-1cd15c38-4465-45d2-bda3-5cf4675b5ad5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:51.431048 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6628b671-b4b3-4e12-9eda-3b8c8e1cd9c2 None None] Network f1abb35d-0157-4eda-8b7e-6c93030db963 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:35:51.437861 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-6628b671-b4b3-4e12-9eda-3b8c8e1cd9c2 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:35:51.443058 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6628b671-b4b3-4e12-9eda-3b8c8e1cd9c2 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:35:51.443278 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-4edea27b-e948-4ffb-b77a-be998cfc026c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Allocated IP 2001:db8:3::1 (f1abb35d-0157-4eda-8b7e-6c93030db963/07a4cdc6-7f9d-4e6c-98b9-ae041d44d264/0ce278c9-884c-454c-91e4-5240df031ec3) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:35:51.447948 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cd15c38-4465-45d2-bda3-5cf4675b5ad5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'Port': ['ID=e2d06464-eb31-4d6f-b9a6-209564b03294,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:51.484877 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6628b671-b4b3-4e12-9eda-3b8c8e1cd9c2 None None] Pushing event updated for resources: {'Port': ['ID=42c63ae2-c868-4395-8d1a-b91fb2d91d24,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:51.507618 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 96c020fa-1590-4db4-85e8-09e998526562 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:51.507991 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:51.535616 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-48865eeb-1860-436e-b478-809aba052a01 req-1cd15c38-4465-45d2-bda3-5cf4675b5ad5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] No DVR routers for this DVR port e2d06464-eb31-4d6f-b9a6-209564b03294 on host hv-neutron-8168 {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:35:51.539203 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-48865eeb-1860-436e-b478-809aba052a01 req-1cd15c38-4465-45d2-bda3-5cf4675b5ad5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:51.543125 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-48865eeb-1860-436e-b478-809aba052a01 req-1cd15c38-4465-45d2-bda3-5cf4675b5ad5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "DELETE /v2.0/ports/e2d06464-eb31-4d6f-b9a6-209564b03294 HTTP/1.1" status: 204 len: 173 time: 1.4558489 Nov 09 04:35:51.543584 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f9a57fa6-0a62-475f-af77-8f608003b5e1', 'name': 'network-vif-deleted', 'tag': 'e2d06464-eb31-4d6f-b9a6-209564b03294'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:35:51.545997 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-68131b9b-e8d9-46eb-8030-bec9b29de16a" -d '{"events": [{"server_uuid": "f9a57fa6-0a62-475f-af77-8f608003b5e1", "name": "network-vif-deleted", "tag": "e2d06464-eb31-4d6f-b9a6-209564b03294"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:35:51.570685 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-6628b671-b4b3-4e12-9eda-3b8c8e1cd9c2 None None] Attempting to bind port 42c63ae2-c868-4395-8d1a-b91fb2d91d24 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:35:51.571050 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-6628b671-b4b3-4e12-9eda-3b8c8e1cd9c2 None None] Attempting to bind port 42c63ae2-c868-4395-8d1a-b91fb2d91d24 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '73188347-497c-4b3d-bfb4-401319c53746', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 332, 'network_id': 'f1abb35d-0157-4eda-8b7e-6c93030db963'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:35:51.571432 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6628b671-b4b3-4e12-9eda-3b8c8e1cd9c2 None None] Attempting to bind port 42c63ae2-c868-4395-8d1a-b91fb2d91d24 on network f1abb35d-0157-4eda-8b7e-6c93030db963 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:35:51.586195 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6628b671-b4b3-4e12-9eda-3b8c8e1cd9c2 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 35, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:35:51.586609 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6628b671-b4b3-4e12-9eda-3b8c8e1cd9c2 None None] Checking segment: {'id': '73188347-497c-4b3d-bfb4-401319c53746', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 332, 'network_id': 'f1abb35d-0157-4eda-8b7e-6c93030db963'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:35:51.587000 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6628b671-b4b3-4e12-9eda-3b8c8e1cd9c2 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:51.587385 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6628b671-b4b3-4e12-9eda-3b8c8e1cd9c2 None None] Bound using segment: {'id': '73188347-497c-4b3d-bfb4-401319c53746', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 332, 'network_id': 'f1abb35d-0157-4eda-8b7e-6c93030db963'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:35:51.588014 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-6628b671-b4b3-4e12-9eda-3b8c8e1cd9c2 None None] Bound port: 42c63ae2-c868-4395-8d1a-b91fb2d91d24, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '73188347-497c-4b3d-bfb4-401319c53746', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 332, 'network_id': 'f1abb35d-0157-4eda-8b7e-6c93030db963'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:35:51.588411 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6628b671-b4b3-4e12-9eda-3b8c8e1cd9c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:51.621057 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:35:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-43edbcb2-6995-4b82-822e-5e5d46e1298b x-openstack-request-id: req-43edbcb2-6995-4b82-822e-5e5d46e1298b {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:35:51.621593 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f9a57fa6-0a62-475f-af77-8f608003b5e1", "name": "network-vif-deleted", "tag": "e2d06464-eb31-4d6f-b9a6-209564b03294", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:35:51.622016 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-43edbcb2-6995-4b82-822e-5e5d46e1298b {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:35:51.622484 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f9a57fa6-0a62-475f-af77-8f608003b5e1', 'name': 'network-vif-deleted', 'tag': 'e2d06464-eb31-4d6f-b9a6-209564b03294', 'status': 'completed', 'code': 200} Nov 09 04:35:51.651024 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4edea27b-e948-4ffb-b77a-be998cfc026c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:51.674405 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ffc240c-3cc6-4f25-b32b-ff51364edc76 req-e9c5ed6c-5ebf-42d9-8faf-8c5fa3c05eb9 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:51.675956 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7ffc240c-3cc6-4f25-b32b-ff51364edc76 req-e9c5ed6c-5ebf-42d9-8faf-8c5fa3c05eb9 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=f0ae9486-80b5-43bd-acec-49f871c00e67 HTTP/1.1" status: 200 len: 943 time: 0.1150978 Nov 09 04:35:51.702748 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7a7d78ea-c46c-4c47-9206-7bd36bfec81a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:51.717901 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 1a74b864-c68d-4f11-bce5-6e04e0afa480 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:35:51.722931 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-6628b671-b4b3-4e12-9eda-3b8c8e1cd9c2 None None] For port 42c63ae2-c868-4395-8d1a-b91fb2d91d24, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:35:51.728201 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-6628b671-b4b3-4e12-9eda-3b8c8e1cd9c2 None None] For port 42c63ae2-c868-4395-8d1a-b91fb2d91d24, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=42c63ae2-c868-4395-8d1a-b91fb2d91d24,segment=NetworkSegment(73188347-497c-4b3d-bfb4-401319c53746),segment_id=73188347-497c-4b3d-bfb4-401319c53746)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:35:51.750020 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 1a74b864-c68d-4f11-bce5-6e04e0afa480 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:35:51.750312 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 1a74b864-c68d-4f11-bce5-6e04e0afa480 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:35:51.775351 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7ffc240c-3cc6-4f25-b32b-ff51364edc76 req-d4983247-31f0-422a-a27e-a730bed798ce tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0931768 Nov 09 04:35:51.779224 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4edea27b-e948-4ffb-b77a-be998cfc026c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:51.808904 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6628b671-b4b3-4e12-9eda-3b8c8e1cd9c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:51.826070 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4edea27b-e948-4ffb-b77a-be998cfc026c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Network f1abb35d-0157-4eda-8b7e-6c93030db963 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:35:51.829538 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-4edea27b-e948-4ffb-b77a-be998cfc026c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:35:51.836365 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4edea27b-e948-4ffb-b77a-be998cfc026c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:35:51.841990 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4edea27b-e948-4ffb-b77a-be998cfc026c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:51.883480 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4edea27b-e948-4ffb-b77a-be998cfc026c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event updated for resources: {'Port': ['ID=0ce278c9-884c-454c-91e4-5240df031ec3,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:51.905359 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6628b671-b4b3-4e12-9eda-3b8c8e1cd9c2 None None] Pushing event updated for resources: {'Port': ['ID=42c63ae2-c868-4395-8d1a-b91fb2d91d24,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:52.065276 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-7a7d78ea-c46c-4c47-9206-7bd36bfec81a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Deleting port bc45379d-83a9-42ad-a371-897a2b8024f1 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:35:52.065711 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7a7d78ea-c46c-4c47-9206-7bd36bfec81a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:52.095535 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4edea27b-e948-4ffb-b77a-be998cfc026c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:52.187516 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7a7d78ea-c46c-4c47-9206-7bd36bfec81a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:52.212863 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-7a7d78ea-c46c-4c47-9206-7bd36bfec81a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Calling delete_port for bc45379d-83a9-42ad-a371-897a2b8024f1 owned by network:router_interface {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:35:52.222236 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-0719a41d-e813-4dc1-8127-6b09e2b2aef2 req-d231e287-5819-4813-b633-8e56e4d81040 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=f9a57fa6-0a62-475f-af77-8f608003b5e1 HTTP/1.1" status: 200 len: 210 time: 0.0508184 Nov 09 04:35:52.434991 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4edea27b-e948-4ffb-b77a-be998cfc026c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:52.510454 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4edea27b-e948-4ffb-b77a-be998cfc026c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:52.511107 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7a7d78ea-c46c-4c47-9206-7bd36bfec81a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:52.511526 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4edea27b-e948-4ffb-b77a-be998cfc026c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:52.539894 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a7d78ea-c46c-4c47-9206-7bd36bfec81a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Pushing event deleted for resources: {'Port': ['ID=bc45379d-83a9-42ad-a371-897a2b8024f1,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:52.602893 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4edea27b-e948-4ffb-b77a-be998cfc026c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event updated for resources: {'Port': ['ID=0ce278c9-884c-454c-91e4-5240df031ec3,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:52.627883 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device d4753771-ff46-428e-9ad0-3dce1a15a45f details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=102163) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 09 04:35:52.631954 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device e2d06464-eb31-4d6f-b9a6-209564b03294 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:35:52.658847 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4edea27b-e948-4ffb-b77a-be998cfc026c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Network f1abb35d-0157-4eda-8b7e-6c93030db963 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:35:52.660367 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-4edea27b-e948-4ffb-b77a-be998cfc026c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:35:52.698310 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] No Port match for: e2d06464-eb31-4d6f-b9a6-209564b03294 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:35:52.700912 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device e2d06464-eb31-4d6f-b9a6-209564b03294 not bound to the agent host hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:35:52.793322 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4edea27b-e948-4ffb-b77a-be998cfc026c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Router 7b9a51f0-889c-418d-bc8a-fcfd303c5053 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:35:52.813928 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7a7d78ea-c46c-4c47-9206-7bd36bfec81a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:52.906039 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port d4753771-ff46-428e-9ad0-3dce1a15a45f, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=d4753771-ff46-428e-9ad0-3dce1a15a45f,segment=NetworkSegment(bc4577c9-06a5-450a-9c80-879827986f04),segment_id=bc4577c9-06a5-450a-9c80-879827986f04)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:35:52.924473 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Returning: {'device': 'd4753771-ff46-428e-9ad0-3dce1a15a45f', 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf', 'port_id': 'd4753771-ff46-428e-9ad0-3dce1a15a45f', 'mac_address': 'fa:16:3e:91:66:c7', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 310, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f6a08667-654b-4e0c-9f85-c6e6712cc239', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102163) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 09 04:35:52.927182 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4edea27b-e948-4ffb-b77a-be998cfc026c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:35:52.940607 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ec2b83d8-49f4-421b-8c22-6ac033a35d26 None None] Sync routers for ids ['7b9a51f0-889c-418d-bc8a-fcfd303c5053'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:35:52.944134 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-4edea27b-e948-4ffb-b77a-be998cfc026c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "PUT /v2.0/routers/7b9a51f0-889c-418d-bc8a-fcfd303c5053/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.5684345 Nov 09 04:35:52.946688 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58974) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:52.952418 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-4b3046e0-5dc0-4409-967e-c4b3b0b21791 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Request body: {'router': {'routes': [{'nexthop': '2001:db8:1::2', 'destination': '2001:db8:1::/64'}, {'nexthop': '2001:db8:2::2', 'destination': '2001:db8:2::/64'}, {'nexthop': '2001:db8:3::2', 'destination': '2001:db8:3::/64'}, {'nexthop': '2001:db8::2', 'destination': '2001:db8::/64'}]}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:35:52.960730 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ec2b83d8-49f4-421b-8c22-6ac033a35d26 None None] Routers {'7b9a51f0-889c-418d-bc8a-fcfd303c5053'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:52.964939 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-ec2b83d8-49f4-421b-8c22-6ac033a35d26 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['7b9a51f0-889c-418d-bc8a-fcfd303c5053'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:52.977202 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:52.992847 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d4753771-ff46-428e-9ad0-3dce1a15a45f {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:35:53.015413 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port d4753771-ff46-428e-9ad0-3dce1a15a45f, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=d4753771-ff46-428e-9ad0-3dce1a15a45f,segment=NetworkSegment(bc4577c9-06a5-450a-9c80-879827986f04),segment_id=bc4577c9-06a5-450a-9c80-879827986f04)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:35:53.095861 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-ec2b83d8-49f4-421b-8c22-6ac033a35d26 None None] Set router 7b9a51f0-889c-418d-bc8a-fcfd303c5053 gateway port host: None {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:35:53.098940 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:53.139239 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-633144d1-bcbe-4d6a-8474-d1d8d3568b3b None None] Network f1abb35d-0157-4eda-8b7e-6c93030db963 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:35:53.213307 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7a7d78ea-c46c-4c47-9206-7bd36bfec81a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Router f961f4f5-6f17-45e1-91f0-ed3a6c4e8ad7 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:35:53.232260 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1415ed9-8b8b-40af-a3dd-ccc5b58da624 req-170413e7-0aa8-4c3e-997e-be363075ac4f tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:53.234665 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d1415ed9-8b8b-40af-a3dd-ccc5b58da624 req-170413e7-0aa8-4c3e-997e-be363075ac4f tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=f0ae9486-80b5-43bd-acec-49f871c00e67 HTTP/1.1" status: 200 len: 943 time: 0.2625906 Nov 09 04:35:53.281717 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-7ee5cdde-fcfe-4d4e-88b0-454ab644bcac None None] Provisioning complete for port 42c63ae2-c868-4395-8d1a-b91fb2d91d24 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:53.282080 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7ee5cdde-fcfe-4d4e-88b0-454ab644bcac None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:53.298047 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=d4753771-ff46-428e-9ad0-3dce1a15a45f,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:53.331402 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['d4753771-ff46-428e-9ad0-3dce1a15a45f'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 04:35:53.342972 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58978) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:53.362097 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 42c63ae2-c868-4395-8d1a-b91fb2d91d24 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:35:53.426582 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-ec2b83d8-49f4-421b-8c22-6ac033a35d26 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'name': 'tempest-RoutersIpV6Test-router-1491329762', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:35:32Z', 'updated_at': '2021-11-09T04:35:51Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'gw_port_host': None, '_interfaces': [{'id': '0ce278c9-884c-454c-91e4-5240df031ec3', 'name': '', 'network_id': 'f1abb35d-0157-4eda-8b7e-6c93030db963', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:73:ee:15', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1225, 'fixed_ips': [{'subnet_id': '07a4cdc6-7f9d-4e6c-98b9-ae041d44d264', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:51Z', 'updated_at': '2021-11-09T04:35:52Z', 'revision_number': 2, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': '07a4cdc6-7f9d-4e6c-98b9-ae041d44d264', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '5a28daa1-7cdd-49a3-aad4-ecd643914dfd', 'name': '', 'network_id': '0c466943-3298-4130-be72-d7c24549bd5d', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:9e:e7:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1206, 'fixed_ips': [{'subnet_id': '0cd8bdb8-1377-46f0-ba25-14251b97253b', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:35Z', 'updated_at': '2021-11-09T04:35:41Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': '0cd8bdb8-1377-46f0-ba25-14251b97253b', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '858eaebe-fdb6-4c5b-ab0f-4d6bd86995d4', 'name': '', 'network_id': '035bc5dd-3c1d-4ced-893c-487b4c0eff40', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:82:b5:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1214, 'fixed_ips': [{'subnet_id': 'b46b8bfd-f2f3-4413-b04c-231ee75f8c2c', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:41Z', 'updated_at': '2021-11-09T04:35:45Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': 'b46b8bfd-f2f3-4413-b04c-231ee75f8c2c', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '96c020fa-1590-4db4-85e8-09e998526562', 'name': '', 'network_id': 'b93b0577-d21b-4089-8251-c3aac06bdb77', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:02:31:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1220, 'fixed_ips': [{'subnet_id': '75b6b6c5-0313-4754-bcde-7b2b14023f56', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:46Z', 'updated_at': '2021-11-09T04:35:50Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': '75b6b6c5-0313-4754-bcde-7b2b14023f56', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:53.443551 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0f858acc-cd4d-4228-8c97-cff37b696b63 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:53.451514 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.extraroute_db [None req-4b3046e0-5dc0-4409-967e-c4b3b0b21791 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Added routes are [{'destination': '2001:db8:3::/64', 'nexthop': '2001:db8:3::2'}, {'destination': '2001:db8:1::/64', 'nexthop': '2001:db8:1::2'}, {'destination': '2001:db8::/64', 'nexthop': '2001:db8::2'}, {'destination': '2001:db8:2::/64', 'nexthop': '2001:db8:2::2'}] {{(pid=102161) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:126}} Nov 09 04:35:53.471265 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.extraroute_db [None req-4b3046e0-5dc0-4409-967e-c4b3b0b21791 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Removed routes are [] {{(pid=102161) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:134}} Nov 09 04:35:53.484706 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4b3046e0-5dc0-4409-967e-c4b3b0b21791 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-466202', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-464271', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-936'] for router, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:53.485112 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0f858acc-cd4d-4228-8c97-cff37b696b63 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:53.527332 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d1415ed9-8b8b-40af-a3dd-ccc5b58da624 req-1edba021-c103-49b3-9122-c5ccf0a92ef8 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2845995 Nov 09 04:35:53.580730 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7a7d78ea-c46c-4c47-9206-7bd36bfec81a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:35:53.584981 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ec2b83d8-49f4-421b-8c22-6ac033a35d26 None None] Checking router: 7b9a51f0-889c-418d-bc8a-fcfd303c5053 for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:35:53.585365 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ec2b83d8-49f4-421b-8c22-6ac033a35d26 None None] Updating router 7b9a51f0-889c-418d-bc8a-fcfd303c5053 port 0ce278c9-884c-454c-91e4-5240df031ec3 binding host dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 04:35:53.591790 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-7a7d78ea-c46c-4c47-9206-7bd36bfec81a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] 10.222.0.24 "PUT /v2.0/routers/f961f4f5-6f17-45e1-91f0-ed3a6c4e8ad7/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.7628286 Nov 09 04:35:53.593529 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58980) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:53.608516 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c7a00c38-7e5c-4cd9-8dff-fda17fb762c9 None None] Sync routers for ids ['f961f4f5-6f17-45e1-91f0-ed3a6c4e8ad7'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:35:53.620055 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-ec2b83d8-49f4-421b-8c22-6ac033a35d26 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:53.686677 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7ee5cdde-fcfe-4d4e-88b0-454ab644bcac None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:53.686677 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c7a00c38-7e5c-4cd9-8dff-fda17fb762c9 None None] Routers {'f961f4f5-6f17-45e1-91f0-ed3a6c4e8ad7'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:53.687208 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-c7a00c38-7e5c-4cd9-8dff-fda17fb762c9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['f961f4f5-6f17-45e1-91f0-ed3a6c4e8ad7'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:53.725973 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-656f4d47-4993-4add-9150-f2c7e5184125 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for router, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:53.765014 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-c7a00c38-7e5c-4cd9-8dff-fda17fb762c9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:53.790944 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-7ee5cdde-fcfe-4d4e-88b0-454ab644bcac None None] For port 42c63ae2-c868-4395-8d1a-b91fb2d91d24, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=42c63ae2-c868-4395-8d1a-b91fb2d91d24,segment=NetworkSegment(73188347-497c-4b3d-bfb4-401319c53746),segment_id=73188347-497c-4b3d-bfb4-401319c53746)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:35:53.804629 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 42c63ae2-c868-4395-8d1a-b91fb2d91d24 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:53.805000 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:53.850918 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0f858acc-cd4d-4228-8c97-cff37b696b63 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:53.854304 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7ee5cdde-fcfe-4d4e-88b0-454ab644bcac None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:53.854620 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0f858acc-cd4d-4228-8c97-cff37b696b63 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:53.860796 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-0f858acc-cd4d-4228-8c97-cff37b696b63 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "DELETE /v2.0/security-groups/eb8d9d39-2315-42c2-bde9-38a01ea1afed HTTP/1.1" status: 204 len: 168 time: 0.5166013 Nov 09 04:35:53.873971 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f858acc-cd4d-4228-8c97-cff37b696b63 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=eb8d9d39-2315-42c2-bde9-38a01ea1afed,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:53.887435 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-656f4d47-4993-4add-9150-f2c7e5184125 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for router_gateway, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:53.917921 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c7a00c38-7e5c-4cd9-8dff-fda17fb762c9 None None] Routers {'f961f4f5-6f17-45e1-91f0-ed3a6c4e8ad7'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:53.919347 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-c7a00c38-7e5c-4cd9-8dff-fda17fb762c9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['f961f4f5-6f17-45e1-91f0-ed3a6c4e8ad7'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:53.984329 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-c7a00c38-7e5c-4cd9-8dff-fda17fb762c9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:53.984965 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c7a00c38-7e5c-4cd9-8dff-fda17fb762c9 None None] The sync data for ids ['f961f4f5-6f17-45e1-91f0-ed3a6c4e8ad7'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:35:53.989118 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ee5cdde-fcfe-4d4e-88b0-454ab644bcac None None] Pushing event updated for resources: {'Port': ['ID=42c63ae2-c868-4395-8d1a-b91fb2d91d24,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:54.020866 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-ec2b83d8-49f4-421b-8c22-6ac033a35d26 None None] Publish callbacks [] for port, precommit_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:54.056909 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58984) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:54.091876 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-ec2b83d8-49f4-421b-8c22-6ac033a35d26 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:54.163829 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26008cdb-366f-455b-b1bb-e9a848fc8405 None None] Pushing event updated for resources: {'Port': ['ID=0ce278c9-884c-454c-91e4-5240df031ec3,revision_number=3']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:54.174743 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-670afd1d-a004-476a-a32b-82b9701b522c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Deleting subnet c1f5ce70-ebae-4e4d-9de5-04a34e845fdb {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:35:54.180125 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-670afd1d-a004-476a-a32b-82b9701b522c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:54.187871 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-656f4d47-4993-4add-9150-f2c7e5184125 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Deleting port a99ea6c5-e4c1-42bf-a957-2bc0083dd72b {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:35:54.188245 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-656f4d47-4993-4add-9150-f2c7e5184125 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:54.257852 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-ec2b83d8-49f4-421b-8c22-6ac033a35d26 None None] Attempting to bind port 0ce278c9-884c-454c-91e4-5240df031ec3 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:35:54.258208 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-ec2b83d8-49f4-421b-8c22-6ac033a35d26 None None] Attempting to bind port 0ce278c9-884c-454c-91e4-5240df031ec3 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '73188347-497c-4b3d-bfb4-401319c53746', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 332, 'network_id': 'f1abb35d-0157-4eda-8b7e-6c93030db963'}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:35:54.259201 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ec2b83d8-49f4-421b-8c22-6ac033a35d26 None None] Attempting to bind port 0ce278c9-884c-454c-91e4-5240df031ec3 on network f1abb35d-0157-4eda-8b7e-6c93030db963 {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:35:54.263867 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-670afd1d-a004-476a-a32b-82b9701b522c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:54.272282 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ec2b83d8-49f4-421b-8c22-6ac033a35d26 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 35, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:35:54.272694 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ec2b83d8-49f4-421b-8c22-6ac033a35d26 None None] Checking segment: {'id': '73188347-497c-4b3d-bfb4-401319c53746', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 332, 'network_id': 'f1abb35d-0157-4eda-8b7e-6c93030db963'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102164) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:35:54.273044 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-ec2b83d8-49f4-421b-8c22-6ac033a35d26 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:54.275853 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ec2b83d8-49f4-421b-8c22-6ac033a35d26 None None] Bound using segment: {'id': '73188347-497c-4b3d-bfb4-401319c53746', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 332, 'network_id': 'f1abb35d-0157-4eda-8b7e-6c93030db963'} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:35:54.278616 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-ec2b83d8-49f4-421b-8c22-6ac033a35d26 None None] Bound port: 0ce278c9-884c-454c-91e4-5240df031ec3, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '73188347-497c-4b3d-bfb4-401319c53746', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 332, 'network_id': 'f1abb35d-0157-4eda-8b7e-6c93030db963'}}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:35:54.279035 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-ec2b83d8-49f4-421b-8c22-6ac033a35d26 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:54.368358 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-ec2b83d8-49f4-421b-8c22-6ac033a35d26 None None] For port 0ce278c9-884c-454c-91e4-5240df031ec3, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102164) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:35:54.371836 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-ec2b83d8-49f4-421b-8c22-6ac033a35d26 None None] For port 0ce278c9-884c-454c-91e4-5240df031ec3, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=0ce278c9-884c-454c-91e4-5240df031ec3,segment=NetworkSegment(73188347-497c-4b3d-bfb4-401319c53746),segment_id=73188347-497c-4b3d-bfb4-401319c53746)] {{(pid=102164) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:35:54.390389 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-01d8f316-fcb2-452b-8d5f-98ab689ab4de None None] Provisioning complete for port 0ce278c9-884c-454c-91e4-5240df031ec3 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:54.390785 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-01d8f316-fcb2-452b-8d5f-98ab689ab4de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:54.395302 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4b3046e0-5dc0-4409-967e-c4b3b0b21791 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-466202', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-464271', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-936'] for router, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:54.400957 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4b3046e0-5dc0-4409-967e-c4b3b0b21791 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-466195', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-466408', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-464260'] for router, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:54.432385 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-01d8f316-fcb2-452b-8d5f-98ab689ab4de None None] Port 0ce278c9-884c-454c-91e4-5240df031ec3 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:35:54.445682 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-01d8f316-fcb2-452b-8d5f-98ab689ab4de None None] Provisioning complete for port 42c63ae2-c868-4395-8d1a-b91fb2d91d24 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:54.446057 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-01d8f316-fcb2-452b-8d5f-98ab689ab4de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:54.481051 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-ec2b83d8-49f4-421b-8c22-6ac033a35d26 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:54.551424 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4b3046e0-5dc0-4409-967e-c4b3b0b21791 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Router 7b9a51f0-889c-418d-bc8a-fcfd303c5053 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:35:54.582856 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ec2b83d8-49f4-421b-8c22-6ac033a35d26 None None] Routers {'7b9a51f0-889c-418d-bc8a-fcfd303c5053'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:54.582856 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-ec2b83d8-49f4-421b-8c22-6ac033a35d26 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['7b9a51f0-889c-418d-bc8a-fcfd303c5053'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:54.654755 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26008cdb-366f-455b-b1bb-e9a848fc8405 None None] Pushing event updated for resources: {'Port': ['ID=0ce278c9-884c-454c-91e4-5240df031ec3,revision_number=4']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:54.684759 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4b3046e0-5dc0-4409-967e-c4b3b0b21791 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:35:54.693973 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4b3046e0-5dc0-4409-967e-c4b3b0b21791 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:54.698220 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-4b3046e0-5dc0-4409-967e-c4b3b0b21791 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "PUT /v2.0/routers/7b9a51f0-889c-418d-bc8a-fcfd303c5053 HTTP/1.1" status: 200 len: 954 time: 1.7495608 Nov 09 04:35:54.698970 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58988) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:54.718584 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-ec2b83d8-49f4-421b-8c22-6ac033a35d26 None None] Set router 7b9a51f0-889c-418d-bc8a-fcfd303c5053 gateway port host: None {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:35:54.745985 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-39531e8d-1160-4118-a17b-180e6ce59fde None None] Provisioning complete for port 0ce278c9-884c-454c-91e4-5240df031ec3 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:54.746482 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-39531e8d-1160-4118-a17b-180e6ce59fde None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:54.841920 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-29d29046-8a24-4faf-a32d-0e0d139947a8 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "GET /v2.0/routers/7b9a51f0-889c-418d-bc8a-fcfd303c5053 HTTP/1.1" status: 200 len: 954 time: 0.1416621 Nov 09 04:35:54.842797 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58990) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:54.849142 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-d008ae3f-ca2d-49b6-9ddf-9c7d4329dccd tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Request body: {'router': {'routes': None}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:35:54.867821 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-656f4d47-4993-4add-9150-f2c7e5184125 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:54.869326 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-39531e8d-1160-4118-a17b-180e6ce59fde None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:54.926215 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf9e77f5-71bf-4f52-8116-c1c0d7a462f5 req-4eaa298c-7666-40e9-80a3-e34d3e53d06f tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:54.927895 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-cf9e77f5-71bf-4f52-8116-c1c0d7a462f5 req-4eaa298c-7666-40e9-80a3-e34d3e53d06f tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=f0ae9486-80b5-43bd-acec-49f871c00e67 HTTP/1.1" status: 200 len: 944 time: 0.2142050 Nov 09 04:35:54.931049 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-656f4d47-4993-4add-9150-f2c7e5184125 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Calling delete_port for a99ea6c5-e4c1-42bf-a957-2bc0083dd72b owned by network:router_gateway {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:35:54.941866 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-39531e8d-1160-4118-a17b-180e6ce59fde None None] For port 0ce278c9-884c-454c-91e4-5240df031ec3, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=0ce278c9-884c-454c-91e4-5240df031ec3,segment=NetworkSegment(73188347-497c-4b3d-bfb4-401319c53746),segment_id=73188347-497c-4b3d-bfb4-401319c53746)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:35:54.957910 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-670afd1d-a004-476a-a32b-82b9701b522c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:55.017801 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-ec2b83d8-49f4-421b-8c22-6ac033a35d26 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'name': 'tempest-RoutersIpV6Test-router-1491329762', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [{'destination': '2001:db8:1::/64', 'nexthop': '2001:db8:1::2'}, {'destination': '2001:db8:2::/64', 'nexthop': '2001:db8:2::2'}, {'destination': '2001:db8:3::/64', 'nexthop': '2001:db8:3::2'}, {'destination': '2001:db8::/64', 'nexthop': '2001:db8::2'}], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:35:32Z', 'updated_at': '2021-11-09T04:35:53Z', 'revision_number': 6, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'gw_port_host': None, '_interfaces': [{'id': '0ce278c9-884c-454c-91e4-5240df031ec3', 'name': '', 'network_id': 'f1abb35d-0157-4eda-8b7e-6c93030db963', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:73:ee:15', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1225, 'fixed_ips': [{'subnet_id': '07a4cdc6-7f9d-4e6c-98b9-ae041d44d264', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:51Z', 'updated_at': '2021-11-09T04:35:54Z', 'revision_number': 4, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': '07a4cdc6-7f9d-4e6c-98b9-ae041d44d264', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '5a28daa1-7cdd-49a3-aad4-ecd643914dfd', 'name': '', 'network_id': '0c466943-3298-4130-be72-d7c24549bd5d', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:9e:e7:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1206, 'fixed_ips': [{'subnet_id': '0cd8bdb8-1377-46f0-ba25-14251b97253b', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:35Z', 'updated_at': '2021-11-09T04:35:41Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': '0cd8bdb8-1377-46f0-ba25-14251b97253b', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '858eaebe-fdb6-4c5b-ab0f-4d6bd86995d4', 'name': '', 'network_id': '035bc5dd-3c1d-4ced-893c-487b4c0eff40', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:82:b5:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1214, 'fixed_ips': [{'subnet_id': 'b46b8bfd-f2f3-4413-b04c-231ee75f8c2c', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:41Z', 'updated_at': '2021-11-09T04:35:45Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': 'b46b8bfd-f2f3-4413-b04c-231ee75f8c2c', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '96c020fa-1590-4db4-85e8-09e998526562', 'name': '', 'network_id': 'b93b0577-d21b-4089-8251-c3aac06bdb77', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:02:31:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1220, 'fixed_ips': [{'subnet_id': '75b6b6c5-0313-4754-bcde-7b2b14023f56', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:46Z', 'updated_at': '2021-11-09T04:35:50Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': '75b6b6c5-0313-4754-bcde-7b2b14023f56', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:55.024816 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-39531e8d-1160-4118-a17b-180e6ce59fde None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:55.074313 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ec2b83d8-49f4-421b-8c22-6ac033a35d26 None None] The sync data for ids ['7b9a51f0-889c-418d-bc8a-fcfd303c5053'] in dv-neutron-816802-2-hyperv is: [{'id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'name': 'tempest-RoutersIpV6Test-router-1491329762', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [{'destination': '2001:db8:1::/64', 'nexthop': '2001:db8:1::2'}, {'destination': '2001:db8:2::/64', 'nexthop': '2001:db8:2::2'}, {'destination': '2001:db8:3::/64', 'nexthop': '2001:db8:3::2'}, {'destination': '2001:db8::/64', 'nexthop': '2001:db8::2'}], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:35:32Z', 'updated_at': '2021-11-09T04:35:53Z', 'revision_number': 6, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'gw_port_host': None, '_interfaces': [{'id': '0ce278c9-884c-454c-91e4-5240df031ec3', 'name': '', 'network_id': 'f1abb35d-0157-4eda-8b7e-6c93030db963', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:73:ee:15', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1225, 'fixed_ips': [{'subnet_id': '07a4cdc6-7f9d-4e6c-98b9-ae041d44d264', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:51Z', 'updated_at': '2021-11-09T04:35:54Z', 'revision_number': 4, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': '07a4cdc6-7f9d-4e6c-98b9-ae041d44d264', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '5a28daa1-7cdd-49a3-aad4-ecd643914dfd', 'name': '', 'network_id': '0c466943-3298-4130-be72-d7c24549bd5d', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:9e:e7:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1206, 'fixed_ips': [{'subnet_id': '0cd8bdb8-1377-46f0-ba25-14251b97253b', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:35Z', 'updated_at': '2021-11-09T04:35:41Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': '0cd8bdb8-1377-46f0-ba25-14251b97253b', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '858eaebe-fdb6-4c5b-ab0f-4d6bd86995d4', 'name': '', 'network_id': '035bc5dd-3c1d-4ced-893c-487b4c0eff40', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:82:b5:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1214, 'fixed_ips': [{'subnet_id': 'b46b8bfd-f2f3-4413-b04c-231ee75f8c2c', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:41Z', 'updated_at': '2021-11-09T04:35:45Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': 'b46b8bfd-f2f3-4413-b04c-231ee75f8c2c', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '96c020fa-1590-4db4-85e8-09e998526562', 'name': '', 'network_id': 'b93b0577-d21b-4089-8251-c3aac06bdb77', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:02:31:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1220, 'fixed_ips': [{'subnet_id': '75b6b6c5-0313-4754-bcde-7b2b14023f56', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:46Z', 'updated_at': '2021-11-09T04:35:50Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': '75b6b6c5-0313-4754-bcde-7b2b14023f56', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:35:55.107017 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39531e8d-1160-4118-a17b-180e6ce59fde None None] Pushing event updated for resources: {'Port': ['ID=0ce278c9-884c-454c-91e4-5240df031ec3,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:55.114689 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-cf9e77f5-71bf-4f52-8116-c1c0d7a462f5 req-a646ba96-e0ac-4722-a2cc-0d02cf36d624 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1772029 Nov 09 04:35:55.167689 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-b636d487-95e8-4bca-810e-1b848dee58fc None None] Provisioning complete for port 0ce278c9-884c-454c-91e4-5240df031ec3 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:55.168310 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b636d487-95e8-4bca-810e-1b848dee58fc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:55.287511 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-670afd1d-a004-476a-a32b-82b9701b522c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:55.331549 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-670afd1d-a004-476a-a32b-82b9701b522c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:55.339711 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 58992) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:55.340837 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-670afd1d-a004-476a-a32b-82b9701b522c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "DELETE /v2.0/subnets/c1f5ce70-ebae-4e4d-9de5-04a34e845fdb HTTP/1.1" status: 204 len: 168 time: 1.2815318 Nov 09 04:35:55.342435 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-670afd1d-a004-476a-a32b-82b9701b522c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'Subnet': ['ID=c1f5ce70-ebae-4e4d-9de5-04a34e845fdb,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:55.352695 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-709046b4-782e-4852-b203-233db6bed379 None None] Network 994f9071-b760-4d74-b91b-28777ec6b4e7 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:35:55.362086 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-656f4d47-4993-4add-9150-f2c7e5184125 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:55.420541 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-656f4d47-4993-4add-9150-f2c7e5184125 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Pushing event deleted for resources: {'Port': ['ID=a99ea6c5-e4c1-42bf-a957-2bc0083dd72b,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:55.499144 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-656f4d47-4993-4add-9150-f2c7e5184125 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-466373'] for router_gateway, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:55.533421 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.extraroute_db [None req-d008ae3f-ca2d-49b6-9ddf-9c7d4329dccd tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Added routes are [] {{(pid=102161) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:126}} Nov 09 04:35:55.533931 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.extraroute_db [None req-d008ae3f-ca2d-49b6-9ddf-9c7d4329dccd tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Removed routes are [{'destination': '2001:db8:3::/64', 'nexthop': '2001:db8:3::2'}, {'destination': '2001:db8:1::/64', 'nexthop': '2001:db8:1::2'}, {'destination': '2001:db8::/64', 'nexthop': '2001:db8::2'}, {'destination': '2001:db8:2::/64', 'nexthop': '2001:db8:2::2'}] {{(pid=102161) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:134}} Nov 09 04:35:55.540493 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0f36ea86-86ad-40c0-a792-f7f6fe52dd61 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:55.553527 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 0ce278c9-884c-454c-91e4-5240df031ec3 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:35:55.602578 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-cbd4e486-ba0b-47c4-a9a3-a88efeb4a9ac None None] Provisioning complete for port 0ce278c9-884c-454c-91e4-5240df031ec3 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:55.602955 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-cbd4e486-ba0b-47c4-a9a3-a88efeb4a9ac None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:55.630902 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d008ae3f-ca2d-49b6-9ddf-9c7d4329dccd tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-466202', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-464271', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-936'] for router, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:55.631147 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-656f4d47-4993-4add-9150-f2c7e5184125 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:55.635245 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-656f4d47-4993-4add-9150-f2c7e5184125 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:55.661864 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-0f36ea86-86ad-40c0-a792-f7f6fe52dd61 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Deleting port f41cb886-7a06-4aad-b458-67b53554e3e3 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:35:55.662566 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0f36ea86-86ad-40c0-a792-f7f6fe52dd61 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:55.721533 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 0ce278c9-884c-454c-91e4-5240df031ec3 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:55.722494 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:55.804036 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-040e6bc4-b588-445d-950a-3c4c4a48ae00 None None] DHCP port deletion for 994f9071-b760-4d74-b91b-28777ec6b4e7 request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:35:55.805819 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-656f4d47-4993-4add-9150-f2c7e5184125 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:55.806461 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-656f4d47-4993-4add-9150-f2c7e5184125 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Fanout notify agent at l3_agent the message router_deleted on router f961f4f5-6f17-45e1-91f0-ed3a6c4e8ad7 {{(pid=102162) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:35:55.817897 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-0f36ea86-86ad-40c0-a792-f7f6fe52dd61 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] For port f41cb886-7a06-4aad-b458-67b53554e3e3, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=f41cb886-7a06-4aad-b458-67b53554e3e3,segment=NetworkSegment(142b6494-b2b1-4cea-9b90-321c4a2a4cae),segment_id=142b6494-b2b1-4cea-9b90-321c4a2a4cae)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:35:55.817897 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0f36ea86-86ad-40c0-a792-f7f6fe52dd61 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:55.823303 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-656f4d47-4993-4add-9150-f2c7e5184125 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:55.828363 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-656f4d47-4993-4add-9150-f2c7e5184125 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] 10.222.0.24 "DELETE /v2.0/routers/f961f4f5-6f17-45e1-91f0-ed3a6c4e8ad7 HTTP/1.1" status: 204 len: 168 time: 2.2323325 Nov 09 04:35:55.829252 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58994) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:55.847502 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-0f36ea86-86ad-40c0-a792-f7f6fe52dd61 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Calling delete_port for f41cb886-7a06-4aad-b458-67b53554e3e3 owned by network:dhcp {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:35:55.912173 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-8a66a7e6-43cd-48f6-ae8e-46ad42067262 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Deleting subnet 3ad33066-d288-4e2f-b144-02102acb9c51 {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:35:55.917327 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8a66a7e6-43cd-48f6-ae8e-46ad42067262 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:55.917616 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 42c63ae2-c868-4395-8d1a-b91fb2d91d24 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:35:55.964016 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8a66a7e6-43cd-48f6-ae8e-46ad42067262 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:55.985010 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-040e6bc4-b588-445d-950a-3c4c4a48ae00 None None] Deleting port f41cb886-7a06-4aad-b458-67b53554e3e3 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:35:55.985555 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-040e6bc4-b588-445d-950a-3c4c4a48ae00 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:56.004995 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d008ae3f-ca2d-49b6-9ddf-9c7d4329dccd tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-466202', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-464271', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-936'] for router, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:56.010636 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d008ae3f-ca2d-49b6-9ddf-9c7d4329dccd tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-466195', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-466408', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-464260'] for router, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:56.069492 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 42c63ae2-c868-4395-8d1a-b91fb2d91d24 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:56.069950 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:56.078563 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8a66a7e6-43cd-48f6-ae8e-46ad42067262 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:56.112696 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-040e6bc4-b588-445d-950a-3c4c4a48ae00 None None] For port f41cb886-7a06-4aad-b458-67b53554e3e3, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=f41cb886-7a06-4aad-b458-67b53554e3e3,segment=NetworkSegment(142b6494-b2b1-4cea-9b90-321c4a2a4cae),segment_id=142b6494-b2b1-4cea-9b90-321c4a2a4cae)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:35:56.113694 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-040e6bc4-b588-445d-950a-3c4c4a48ae00 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:56.116374 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-d1cf00ce-7e47-4242-9c52-d7e4179fef7a None None] Provisioning complete for port 0ce278c9-884c-454c-91e4-5240df031ec3 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:56.116374 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d1cf00ce-7e47-4242-9c52-d7e4179fef7a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:56.125490 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d008ae3f-ca2d-49b6-9ddf-9c7d4329dccd tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Router 7b9a51f0-889c-418d-bc8a-fcfd303c5053 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:35:56.150805 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-040e6bc4-b588-445d-950a-3c4c4a48ae00 None None] Calling delete_port for f41cb886-7a06-4aad-b458-67b53554e3e3 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:35:56.204814 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0f36ea86-86ad-40c0-a792-f7f6fe52dd61 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:56.238470 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0f36ea86-86ad-40c0-a792-f7f6fe52dd61 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] No DVR routers for this DVR port f41cb886-7a06-4aad-b458-67b53554e3e3 on host dv-neutron-816802-2-hyperv {{(pid=102161) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:35:56.253515 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8a66a7e6-43cd-48f6-ae8e-46ad42067262 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:56.263012 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f36ea86-86ad-40c0-a792-f7f6fe52dd61 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'Port': ['ID=f41cb886-7a06-4aad-b458-67b53554e3e3,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:56.275910 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-628cc927-477d-4e86-9309-51da9507195a None None] Sync routers for ids ['7b9a51f0-889c-418d-bc8a-fcfd303c5053'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:35:56.293260 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-628cc927-477d-4e86-9309-51da9507195a None None] Routers {'7b9a51f0-889c-418d-bc8a-fcfd303c5053'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:56.295311 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-628cc927-477d-4e86-9309-51da9507195a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['7b9a51f0-889c-418d-bc8a-fcfd303c5053'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:56.308625 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8a66a7e6-43cd-48f6-ae8e-46ad42067262 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:56.313980 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-8a66a7e6-43cd-48f6-ae8e-46ad42067262 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] 10.222.0.24 "DELETE /v2.0/subnets/3ad33066-d288-4e2f-b144-02102acb9c51 HTTP/1.1" status: 204 len: 168 time: 0.4833002 Nov 09 04:35:56.315122 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a66a7e6-43cd-48f6-ae8e-46ad42067262 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Pushing event deleted for resources: {'Subnet': ['ID=3ad33066-d288-4e2f-b144-02102acb9c51,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:56.322541 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 58998) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:56.327719 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0f36ea86-86ad-40c0-a792-f7f6fe52dd61 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:56.339827 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-040e6bc4-b588-445d-950a-3c4c4a48ae00 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:56.348819 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-0f36ea86-86ad-40c0-a792-f7f6fe52dd61 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['994f9071-b760-4d74-b91b-28777ec6b4e7']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:56.349943 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9bfb26d0-c794-4862-8868-455daf74f8ca None None] Network 18eae61d-c3c0-43a4-8106-007586adddc4 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:35:56.358654 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-0f36ea86-86ad-40c0-a792-f7f6fe52dd61 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '142b6494-b2b1-4cea-9b90-321c4a2a4cae') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:56.358959 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-0f36ea86-86ad-40c0-a792-f7f6fe52dd61 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '142b6494-b2b1-4cea-9b90-321c4a2a4cae') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:56.368811 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0f36ea86-86ad-40c0-a792-f7f6fe52dd61 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:56.382307 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0f36ea86-86ad-40c0-a792-f7f6fe52dd61 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:56.389010 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-0f36ea86-86ad-40c0-a792-f7f6fe52dd61 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Releasing vlan 339 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:35:56.389413 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0f36ea86-86ad-40c0-a792-f7f6fe52dd61 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:56.390667 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-628cc927-477d-4e86-9309-51da9507195a None None] Set router 7b9a51f0-889c-418d-bc8a-fcfd303c5053 gateway port host: None {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:35:56.421372 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9a20d146-1ba4-4171-a58f-c089e5286e7a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:56.451491 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-040e6bc4-b588-445d-950a-3c4c4a48ae00 None None] No DVR routers for this DVR port f41cb886-7a06-4aad-b458-67b53554e3e3 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:35:56.459012 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-040e6bc4-b588-445d-950a-3c4c4a48ae00 None None] Pushing event deleted for resources: {'Port': ['ID=f41cb886-7a06-4aad-b458-67b53554e3e3,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:56.471472 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:35:56.471472 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:35:56.471472 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:35:56.471472 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:35:56.471472 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:35:56.471472 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:35:56.471472 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:35:56.471472 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:35:56.471472 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:35:56.471472 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:35:56.471472 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:35:56.471472 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:35:56.471472 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:35:56.471472 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:35:56.471472 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:35:56.471472 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:35:56.471472 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:35:56.471472 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:35:56.471472 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:35:56.471472 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:35:56.471472 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:35:56.471472 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:35:56.471472 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:35:56.471472 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:35:56.471472 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:35:56.471472 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:35:56.471472 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:35:56.471472 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:35:56.471472 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:35:56.471472 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:35:56.471472 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:35:56.471472 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:35:56.522968 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d008ae3f-ca2d-49b6-9ddf-9c7d4329dccd tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:35:56.532738 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d008ae3f-ca2d-49b6-9ddf-9c7d4329dccd tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:56.537162 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59000) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:56.538201 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-d008ae3f-ca2d-49b6-9ddf-9c7d4329dccd tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "PUT /v2.0/routers/7b9a51f0-889c-418d-bc8a-fcfd303c5053 HTTP/1.1" status: 200 len: 704 time: 1.6904790 Nov 09 04:35:56.544030 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0f36ea86-86ad-40c0-a792-f7f6fe52dd61 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:56.555286 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0f36ea86-86ad-40c0-a792-f7f6fe52dd61 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:56.559160 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-0f36ea86-86ad-40c0-a792-f7f6fe52dd61 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "DELETE /v2.0/networks/994f9071-b760-4d74-b91b-28777ec6b4e7 HTTP/1.1" status: 204 len: 168 time: 1.2184706 Nov 09 04:35:56.564261 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59002) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:56.577369 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-253d6b20-9d34-43c6-be0d-388b2ba661a4 req-f948914f-65d2-4bff-bc1c-c7e793a099c3 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:56.578963 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-253d6b20-9d34-43c6-be0d-388b2ba661a4 req-f948914f-65d2-4bff-bc1c-c7e793a099c3 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=f0ae9486-80b5-43bd-acec-49f871c00e67 HTTP/1.1" status: 200 len: 944 time: 0.1274967 Nov 09 04:35:56.579954 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f36ea86-86ad-40c0-a792-f7f6fe52dd61 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'Network': ['ID=994f9071-b760-4d74-b91b-28777ec6b4e7,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:56.619513 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-9a20d146-1ba4-4171-a58f-c089e5286e7a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Deleting port d50019d6-22fd-4b25-a545-4133e1f62709 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:35:56.620764 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9a20d146-1ba4-4171-a58f-c089e5286e7a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:56.636733 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device d4753771-ff46-428e-9ad0-3dce1a15a45f up at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:35:56.656623 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-253d6b20-9d34-43c6-be0d-388b2ba661a4 req-8037f3ea-9376-4305-8280-742546f069c1 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0703771 Nov 09 04:35:56.675337 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-54323ba2-2c1d-4809-97d9-62946517587b None None] DHCP port deletion for 18eae61d-c3c0-43a4-8106-007586adddc4 request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:35:56.680761 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-628cc927-477d-4e86-9309-51da9507195a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'name': 'tempest-RoutersIpV6Test-router-1491329762', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:35:32Z', 'updated_at': '2021-11-09T04:35:55Z', 'revision_number': 7, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'gw_port_host': None, '_interfaces': [{'id': '0ce278c9-884c-454c-91e4-5240df031ec3', 'name': '', 'network_id': 'f1abb35d-0157-4eda-8b7e-6c93030db963', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:73:ee:15', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1225, 'fixed_ips': [{'subnet_id': '07a4cdc6-7f9d-4e6c-98b9-ae041d44d264', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:51Z', 'updated_at': '2021-11-09T04:35:54Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': '07a4cdc6-7f9d-4e6c-98b9-ae041d44d264', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '5a28daa1-7cdd-49a3-aad4-ecd643914dfd', 'name': '', 'network_id': '0c466943-3298-4130-be72-d7c24549bd5d', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:9e:e7:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1206, 'fixed_ips': [{'subnet_id': '0cd8bdb8-1377-46f0-ba25-14251b97253b', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:35Z', 'updated_at': '2021-11-09T04:35:41Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': '0cd8bdb8-1377-46f0-ba25-14251b97253b', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '858eaebe-fdb6-4c5b-ab0f-4d6bd86995d4', 'name': '', 'network_id': '035bc5dd-3c1d-4ced-893c-487b4c0eff40', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:82:b5:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1214, 'fixed_ips': [{'subnet_id': 'b46b8bfd-f2f3-4413-b04c-231ee75f8c2c', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:41Z', 'updated_at': '2021-11-09T04:35:45Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': 'b46b8bfd-f2f3-4413-b04c-231ee75f8c2c', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '96c020fa-1590-4db4-85e8-09e998526562', 'name': '', 'network_id': 'b93b0577-d21b-4089-8251-c3aac06bdb77', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:02:31:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1220, 'fixed_ips': [{'subnet_id': '75b6b6c5-0313-4754-bcde-7b2b14023f56', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:46Z', 'updated_at': '2021-11-09T04:35:50Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': '75b6b6c5-0313-4754-bcde-7b2b14023f56', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:56.708571 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-628cc927-477d-4e86-9309-51da9507195a None None] Checking router: 7b9a51f0-889c-418d-bc8a-fcfd303c5053 for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:35:56.717542 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-628cc927-477d-4e86-9309-51da9507195a None None] Routers {'7b9a51f0-889c-418d-bc8a-fcfd303c5053'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:56.718383 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-628cc927-477d-4e86-9309-51da9507195a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['7b9a51f0-889c-418d-bc8a-fcfd303c5053'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:56.740833 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-54323ba2-2c1d-4809-97d9-62946517587b None None] Deleting port d50019d6-22fd-4b25-a545-4133e1f62709 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:35:56.741267 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-54323ba2-2c1d-4809-97d9-62946517587b None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:56.777391 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-9a20d146-1ba4-4171-a58f-c089e5286e7a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] For port d50019d6-22fd-4b25-a545-4133e1f62709, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=d50019d6-22fd-4b25-a545-4133e1f62709,segment=NetworkSegment(d62aa6a0-ae2f-452d-83ae-e84d4bd37c6b),segment_id=d62aa6a0-ae2f-452d-83ae-e84d4bd37c6b)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:35:56.777749 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9a20d146-1ba4-4171-a58f-c089e5286e7a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:56.792371 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning for port d4753771-ff46-428e-9ad0-3dce1a15a45f completed by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 09 04:35:56.805194 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning complete for port d4753771-ff46-428e-9ad0-3dce1a15a45f triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:35:56.805511 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:56.817865 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-628cc927-477d-4e86-9309-51da9507195a None None] Set router 7b9a51f0-889c-418d-bc8a-fcfd303c5053 gateway port host: None {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:35:56.828696 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-9a20d146-1ba4-4171-a58f-c089e5286e7a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Calling delete_port for d50019d6-22fd-4b25-a545-4133e1f62709 owned by network:dhcp {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:35:56.840096 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-671b8ff3-763f-4e90-ae14-f5b3cf632806 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "GET /v2.0/routers/7b9a51f0-889c-418d-bc8a-fcfd303c5053 HTTP/1.1" status: 200 len: 704 time: 0.2997603 Nov 09 04:35:56.840326 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59004) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:56.873846 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-54323ba2-2c1d-4809-97d9-62946517587b None None] For port d50019d6-22fd-4b25-a545-4133e1f62709, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=d50019d6-22fd-4b25-a545-4133e1f62709,segment=NetworkSegment(d62aa6a0-ae2f-452d-83ae-e84d4bd37c6b),segment_id=d62aa6a0-ae2f-452d-83ae-e84d4bd37c6b)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:35:56.874171 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-54323ba2-2c1d-4809-97d9-62946517587b None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:56.922677 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-54323ba2-2c1d-4809-97d9-62946517587b None None] Calling delete_port for d50019d6-22fd-4b25-a545-4133e1f62709 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:35:56.967639 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-7e865dbf-cd4d-4609-a445-167db6f0090e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Deleting port 1b39fe1f-a321-431c-bf9f-55139afcf0ad {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:35:56.968767 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7e865dbf-cd4d-4609-a445-167db6f0090e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:57.067471 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:57.083094 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9a20d146-1ba4-4171-a58f-c089e5286e7a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:57.096369 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f0ae9486-80b5-43bd-acec-49f871c00e67', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd4753771-ff46-428e-9ad0-3dce1a15a45f'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:35:57.099118 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-beba1fef-1ae8-491a-9af1-ef9a7310d3ae" -d '{"events": [{"server_uuid": "f0ae9486-80b5-43bd-acec-49f871c00e67", "name": "network-vif-plugged", "status": "completed", "tag": "d4753771-ff46-428e-9ad0-3dce1a15a45f"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:35:57.111266 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7e865dbf-cd4d-4609-a445-167db6f0090e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:57.111554 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7e865dbf-cd4d-4609-a445-167db6f0090e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:57.121111 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-54323ba2-2c1d-4809-97d9-62946517587b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:57.140405 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a20d146-1ba4-4171-a58f-c089e5286e7a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Pushing event deleted for resources: {'Port': ['ID=d50019d6-22fd-4b25-a545-4133e1f62709,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:57.148010 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9a20d146-1ba4-4171-a58f-c089e5286e7a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] No DVR routers for this DVR port d50019d6-22fd-4b25-a545-4133e1f62709 on host dv-neutron-816802-2-hyperv {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:35:57.205746 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port d4753771-ff46-428e-9ad0-3dce1a15a45f, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=d4753771-ff46-428e-9ad0-3dce1a15a45f,segment=NetworkSegment(bc4577c9-06a5-450a-9c80-879827986f04),segment_id=bc4577c9-06a5-450a-9c80-879827986f04)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:35:57.212049 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:35:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8c500d7a-4c8a-435f-af5b-84d00031888f x-openstack-request-id: req-8c500d7a-4c8a-435f-af5b-84d00031888f {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:35:57.212368 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f0ae9486-80b5-43bd-acec-49f871c00e67", "name": "network-vif-plugged", "status": "completed", "tag": "d4753771-ff46-428e-9ad0-3dce1a15a45f", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:35:57.219182 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-8c500d7a-4c8a-435f-af5b-84d00031888f {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:35:57.219182 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f0ae9486-80b5-43bd-acec-49f871c00e67', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd4753771-ff46-428e-9ad0-3dce1a15a45f', 'code': 200} Nov 09 04:35:57.219182 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54323ba2-2c1d-4809-97d9-62946517587b None None] Pushing event deleted for resources: {'Port': ['ID=d50019d6-22fd-4b25-a545-4133e1f62709,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:57.221639 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-54323ba2-2c1d-4809-97d9-62946517587b None None] No DVR routers for this DVR port d50019d6-22fd-4b25-a545-4133e1f62709 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:35:57.257017 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-7e865dbf-cd4d-4609-a445-167db6f0090e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Calling delete_port for 1b39fe1f-a321-431c-bf9f-55139afcf0ad owned by network:floatingip {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:35:57.287620 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:57.310754 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-628cc927-477d-4e86-9309-51da9507195a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'name': 'tempest-RoutersIpV6Test-router-1491329762', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:35:32Z', 'updated_at': '2021-11-09T04:35:55Z', 'revision_number': 7, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'gw_port_host': None, '_interfaces': [{'id': '0ce278c9-884c-454c-91e4-5240df031ec3', 'name': '', 'network_id': 'f1abb35d-0157-4eda-8b7e-6c93030db963', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:73:ee:15', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1225, 'fixed_ips': [{'subnet_id': '07a4cdc6-7f9d-4e6c-98b9-ae041d44d264', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:51Z', 'updated_at': '2021-11-09T04:35:54Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': '07a4cdc6-7f9d-4e6c-98b9-ae041d44d264', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '5a28daa1-7cdd-49a3-aad4-ecd643914dfd', 'name': '', 'network_id': '0c466943-3298-4130-be72-d7c24549bd5d', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:9e:e7:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1206, 'fixed_ips': [{'subnet_id': '0cd8bdb8-1377-46f0-ba25-14251b97253b', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:35Z', 'updated_at': '2021-11-09T04:35:41Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': '0cd8bdb8-1377-46f0-ba25-14251b97253b', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '858eaebe-fdb6-4c5b-ab0f-4d6bd86995d4', 'name': '', 'network_id': '035bc5dd-3c1d-4ced-893c-487b4c0eff40', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:82:b5:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1214, 'fixed_ips': [{'subnet_id': 'b46b8bfd-f2f3-4413-b04c-231ee75f8c2c', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:41Z', 'updated_at': '2021-11-09T04:35:45Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': 'b46b8bfd-f2f3-4413-b04c-231ee75f8c2c', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '96c020fa-1590-4db4-85e8-09e998526562', 'name': '', 'network_id': 'b93b0577-d21b-4089-8251-c3aac06bdb77', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:02:31:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1220, 'fixed_ips': [{'subnet_id': '75b6b6c5-0313-4754-bcde-7b2b14023f56', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:46Z', 'updated_at': '2021-11-09T04:35:50Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': '75b6b6c5-0313-4754-bcde-7b2b14023f56', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:57.328461 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9a20d146-1ba4-4171-a58f-c089e5286e7a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:57.343653 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-628cc927-477d-4e86-9309-51da9507195a None None] The sync data for ids ['7b9a51f0-889c-418d-bc8a-fcfd303c5053'] in dv-neutron-816802-2-hyperv is: [{'id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'name': 'tempest-RoutersIpV6Test-router-1491329762', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:35:32Z', 'updated_at': '2021-11-09T04:35:55Z', 'revision_number': 7, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'gw_port_host': None, '_interfaces': [{'id': '0ce278c9-884c-454c-91e4-5240df031ec3', 'name': '', 'network_id': 'f1abb35d-0157-4eda-8b7e-6c93030db963', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:73:ee:15', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1225, 'fixed_ips': [{'subnet_id': '07a4cdc6-7f9d-4e6c-98b9-ae041d44d264', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:51Z', 'updated_at': '2021-11-09T04:35:54Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': '07a4cdc6-7f9d-4e6c-98b9-ae041d44d264', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '5a28daa1-7cdd-49a3-aad4-ecd643914dfd', 'name': '', 'network_id': '0c466943-3298-4130-be72-d7c24549bd5d', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:9e:e7:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1206, 'fixed_ips': [{'subnet_id': '0cd8bdb8-1377-46f0-ba25-14251b97253b', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:35Z', 'updated_at': '2021-11-09T04:35:41Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': '0cd8bdb8-1377-46f0-ba25-14251b97253b', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '858eaebe-fdb6-4c5b-ab0f-4d6bd86995d4', 'name': '', 'network_id': '035bc5dd-3c1d-4ced-893c-487b4c0eff40', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:82:b5:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1214, 'fixed_ips': [{'subnet_id': 'b46b8bfd-f2f3-4413-b04c-231ee75f8c2c', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:41Z', 'updated_at': '2021-11-09T04:35:45Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': 'b46b8bfd-f2f3-4413-b04c-231ee75f8c2c', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '96c020fa-1590-4db4-85e8-09e998526562', 'name': '', 'network_id': 'b93b0577-d21b-4089-8251-c3aac06bdb77', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:02:31:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1220, 'fixed_ips': [{'subnet_id': '75b6b6c5-0313-4754-bcde-7b2b14023f56', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:46Z', 'updated_at': '2021-11-09T04:35:50Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': '75b6b6c5-0313-4754-bcde-7b2b14023f56', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:35:57.345422 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device f41cb886-7a06-4aad-b458-67b53554e3e3 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:35:57.399606 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: f41cb886-7a06-4aad-b458-67b53554e3e3 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:35:57.399925 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device f41cb886-7a06-4aad-b458-67b53554e3e3 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:35:57.401077 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device d50019d6-22fd-4b25-a545-4133e1f62709 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:35:57.419960 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-9a20d146-1ba4-4171-a58f-c089e5286e7a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['18eae61d-c3c0-43a4-8106-007586adddc4']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:57.450932 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-9a20d146-1ba4-4171-a58f-c089e5286e7a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd62aa6a0-ae2f-452d-83ae-e84d4bd37c6b') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:57.451226 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-9a20d146-1ba4-4171-a58f-c089e5286e7a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd62aa6a0-ae2f-452d-83ae-e84d4bd37c6b') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:57.467982 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: d50019d6-22fd-4b25-a545-4133e1f62709 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:35:57.468536 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device d50019d6-22fd-4b25-a545-4133e1f62709 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:35:57.482939 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=d4753771-ff46-428e-9ad0-3dce1a15a45f,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:57.504866 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9a20d146-1ba4-4171-a58f-c089e5286e7a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:57.516961 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9a20d146-1ba4-4171-a58f-c089e5286e7a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:57.529031 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5a77ddaa-4f79-4f9a-a007-51da3bff7f2e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:57.549206 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9a20d146-1ba4-4171-a58f-c089e5286e7a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Releasing vlan 344 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:35:57.549613 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9a20d146-1ba4-4171-a58f-c089e5286e7a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:57.555239 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:35:57.555239 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:35:57.555239 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:35:57.555239 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:35:57.555239 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:35:57.555239 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:35:57.555239 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:35:57.555239 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:35:57.555239 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:35:57.555239 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:35:57.555239 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:35:57.555239 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:35:57.555239 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:35:57.555239 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:35:57.555239 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:35:57.555239 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:35:57.555239 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:35:57.555239 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:35:57.555239 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:35:57.555239 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:35:57.555239 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:35:57.555239 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:35:57.555239 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:35:57.555239 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:35:57.555239 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:35:57.555239 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:35:57.555239 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:35:57.555239 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:35:57.555239 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:35:57.555239 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:35:57.555239 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:35:57.555239 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:35:57.638725 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98f63c75-2ac5-46ac-9229-e60c5d43bd8c req-357a34a6-ecd4-40a4-960d-63fa6fed8fe6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:57.640338 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-98f63c75-2ac5-46ac-9229-e60c5d43bd8c req-357a34a6-ecd4-40a4-960d-63fa6fed8fe6 service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=f0ae9486-80b5-43bd-acec-49f871c00e67 HTTP/1.1" status: 200 len: 1098 time: 0.1843607 Nov 09 04:35:57.744125 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9a20d146-1ba4-4171-a58f-c089e5286e7a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:57.751782 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cbf3a055-56a1-405e-8236-b81c33435296 None None] Sync routers for ids ['7b9a51f0-889c-418d-bc8a-fcfd303c5053'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:35:57.772995 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9a20d146-1ba4-4171-a58f-c089e5286e7a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:57.775994 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-9a20d146-1ba4-4171-a58f-c089e5286e7a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] 10.222.0.24 "DELETE /v2.0/networks/18eae61d-c3c0-43a4-8106-007586adddc4 HTTP/1.1" status: 204 len: 168 time: 1.4516003 Nov 09 04:35:57.777841 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cbf3a055-56a1-405e-8236-b81c33435296 None None] Routers {'7b9a51f0-889c-418d-bc8a-fcfd303c5053'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:57.778908 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-cbf3a055-56a1-405e-8236-b81c33435296 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['7b9a51f0-889c-418d-bc8a-fcfd303c5053'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:57.782453 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59010) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:57.801760 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-98f63c75-2ac5-46ac-9229-e60c5d43bd8c req-b382d8e1-99b0-48d5-a2bd-315c8325f035 service neutron] 10.222.0.26 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1540027 Nov 09 04:35:57.806224 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a20d146-1ba4-4171-a58f-c089e5286e7a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Pushing event deleted for resources: {'Network': ['ID=18eae61d-c3c0-43a4-8106-007586adddc4,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:57.867755 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca53b914-138e-4485-85c2-4cdf414e56fa req-60ff8431-1a9f-4e4f-b3d8-2350fba7ffe5 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:57.869317 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ca53b914-138e-4485-85c2-4cdf414e56fa req-60ff8431-1a9f-4e4f-b3d8-2350fba7ffe5 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=f0ae9486-80b5-43bd-acec-49f871c00e67 HTTP/1.1" status: 200 len: 945 time: 0.0997510 Nov 09 04:35:57.873282 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-5a77ddaa-4f79-4f9a-a007-51da3bff7f2e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Deleting port 0ce278c9-884c-454c-91e4-5240df031ec3 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:35:57.873635 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5a77ddaa-4f79-4f9a-a007-51da3bff7f2e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:57.924439 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-cbf3a055-56a1-405e-8236-b81c33435296 None None] Set router 7b9a51f0-889c-418d-bc8a-fcfd303c5053 gateway port host: None {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:35:57.959345 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7e865dbf-cd4d-4609-a445-167db6f0090e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:57.979522 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ca53b914-138e-4485-85c2-4cdf414e56fa req-b09bab08-c454-4b55-997f-6a96d8042bb2 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1025159 Nov 09 04:35:57.993599 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e865dbf-cd4d-4609-a445-167db6f0090e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'Port': ['ID=1b39fe1f-a321-431c-bf9f-55139afcf0ad,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:58.006911 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-5a77ddaa-4f79-4f9a-a007-51da3bff7f2e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] For port 0ce278c9-884c-454c-91e4-5240df031ec3, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=0ce278c9-884c-454c-91e4-5240df031ec3,segment=NetworkSegment(73188347-497c-4b3d-bfb4-401319c53746),segment_id=73188347-497c-4b3d-bfb4-401319c53746)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:35:58.007327 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5a77ddaa-4f79-4f9a-a007-51da3bff7f2e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:58.029866 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-5a77ddaa-4f79-4f9a-a007-51da3bff7f2e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Calling delete_port for 0ce278c9-884c-454c-91e4-5240df031ec3 owned by network:router_interface {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:35:58.059269 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-f85451df-017f-4e25-a0ab-1afa223de92a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Deleting port 07bb452c-08af-4808-90fa-241606e190f1 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:35:58.060092 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f85451df-017f-4e25-a0ab-1afa223de92a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:58.155865 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f85451df-017f-4e25-a0ab-1afa223de92a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:58.156630 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f85451df-017f-4e25-a0ab-1afa223de92a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:58.211717 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-f85451df-017f-4e25-a0ab-1afa223de92a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Calling delete_port for 07bb452c-08af-4808-90fa-241606e190f1 owned by network:floatingip {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:35:58.223195 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7e865dbf-cd4d-4609-a445-167db6f0090e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for floatingip, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:58.224197 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.l3_db [None req-7e865dbf-cd4d-4609-a445-167db6f0090e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Floating IP 071d456d-45c8-43d6-9154-8dc9c2df29f2 disassociated (deleted). External IP: 172.26.0.195, port: 09cbfb91-4118-43af-8b70-41d8d4265574. Nov 09 04:35:58.275872 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5a77ddaa-4f79-4f9a-a007-51da3bff7f2e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:58.307325 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a77ddaa-4f79-4f9a-a007-51da3bff7f2e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event deleted for resources: {'Port': ['ID=0ce278c9-884c-454c-91e4-5240df031ec3,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:58.376906 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-cbf3a055-56a1-405e-8236-b81c33435296 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'name': 'tempest-RoutersIpV6Test-router-1491329762', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:35:32Z', 'updated_at': '2021-11-09T04:35:55Z', 'revision_number': 7, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'gw_port_host': None, '_interfaces': [{'id': '0ce278c9-884c-454c-91e4-5240df031ec3', 'name': '', 'network_id': 'f1abb35d-0157-4eda-8b7e-6c93030db963', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:73:ee:15', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1225, 'fixed_ips': [{'subnet_id': '07a4cdc6-7f9d-4e6c-98b9-ae041d44d264', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:51Z', 'updated_at': '2021-11-09T04:35:54Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': '07a4cdc6-7f9d-4e6c-98b9-ae041d44d264', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '5a28daa1-7cdd-49a3-aad4-ecd643914dfd', 'name': '', 'network_id': '0c466943-3298-4130-be72-d7c24549bd5d', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:9e:e7:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1206, 'fixed_ips': [{'subnet_id': '0cd8bdb8-1377-46f0-ba25-14251b97253b', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:35Z', 'updated_at': '2021-11-09T04:35:41Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': '0cd8bdb8-1377-46f0-ba25-14251b97253b', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '858eaebe-fdb6-4c5b-ab0f-4d6bd86995d4', 'name': '', 'network_id': '035bc5dd-3c1d-4ced-893c-487b4c0eff40', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:82:b5:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1214, 'fixed_ips': [{'subnet_id': 'b46b8bfd-f2f3-4413-b04c-231ee75f8c2c', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:41Z', 'updated_at': '2021-11-09T04:35:45Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': 'b46b8bfd-f2f3-4413-b04c-231ee75f8c2c', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '96c020fa-1590-4db4-85e8-09e998526562', 'name': '', 'network_id': 'b93b0577-d21b-4089-8251-c3aac06bdb77', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:02:31:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1220, 'fixed_ips': [{'subnet_id': '75b6b6c5-0313-4754-bcde-7b2b14023f56', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:46Z', 'updated_at': '2021-11-09T04:35:50Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': '75b6b6c5-0313-4754-bcde-7b2b14023f56', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:58.433435 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cbf3a055-56a1-405e-8236-b81c33435296 None None] Checking router: 7b9a51f0-889c-418d-bc8a-fcfd303c5053 for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:35:58.456125 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cbf3a055-56a1-405e-8236-b81c33435296 None None] Routers {'7b9a51f0-889c-418d-bc8a-fcfd303c5053'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:58.469877 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-cbf3a055-56a1-405e-8236-b81c33435296 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['7b9a51f0-889c-418d-bc8a-fcfd303c5053'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:58.573860 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7e865dbf-cd4d-4609-a445-167db6f0090e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Router d05416c2-0293-4ef5-a6e3-5968392cc774 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:35:58.575292 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-cbf3a055-56a1-405e-8236-b81c33435296 None None] Set router 7b9a51f0-889c-418d-bc8a-fcfd303c5053 gateway port host: None {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:35:58.624641 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f85451df-017f-4e25-a0ab-1afa223de92a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:58.661123 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f85451df-017f-4e25-a0ab-1afa223de92a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Pushing event deleted for resources: {'Port': ['ID=07bb452c-08af-4808-90fa-241606e190f1,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:35:58.768365 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7e865dbf-cd4d-4609-a445-167db6f0090e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:35:58.774236 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7e865dbf-cd4d-4609-a445-167db6f0090e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:58.780408 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-340657d9-e3ff-497e-8176-856377fc2360 None None] Sync routers for ids ['d05416c2-0293-4ef5-a6e3-5968392cc774'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:35:58.799240 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-340657d9-e3ff-497e-8176-856377fc2360 None None] Routers {'d05416c2-0293-4ef5-a6e3-5968392cc774'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:58.800198 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-340657d9-e3ff-497e-8176-856377fc2360 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['d05416c2-0293-4ef5-a6e3-5968392cc774'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:58.829124 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f85451df-017f-4e25-a0ab-1afa223de92a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for floatingip, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:58.832051 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f85451df-017f-4e25-a0ab-1afa223de92a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:58.837141 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-f85451df-017f-4e25-a0ab-1afa223de92a tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] 10.222.0.24 "DELETE /v2.0/floatingips/11262097-8bb4-43b3-9390-692ba9c4e353 HTTP/1.1" status: 204 len: 168 time: 1.0431795 Nov 09 04:35:58.838124 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59012) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:58.865521 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-7e865dbf-cd4d-4609-a445-167db6f0090e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "DELETE /v2.0/floatingips/071d456d-45c8-43d6-9154-8dc9c2df29f2 HTTP/1.1" status: 204 len: 168 time: 2.2970612 Nov 09 04:35:58.866542 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-af2d2208-0523-4335-be77-973f2fa158ab tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] DELETE failed (client error): The resource could not be found. Nov 09 04:35:58.867790 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-af2d2208-0523-4335-be77-973f2fa158ab tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:35:58.871470 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-af2d2208-0523-4335-be77-973f2fa158ab tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] 10.222.0.24 "DELETE /v2.0/ports/8355442d-8835-49e1-b7e9-e76868b288ea HTTP/1.1" status: 404 len: 333 time: 0.0321760 Nov 09 04:35:58.872052 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8f462374-376b-4c38-b300-528ae5358377', 'tag': '09cbfb91-4118-43af-8b70-41d8d4265574'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:35:58.874784 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-276f1b1c-97b5-429f-a7f7-677ad90e9ee8" -d '{"events": [{"name": "network-changed", "server_uuid": "8f462374-376b-4c38-b300-528ae5358377", "tag": "09cbfb91-4118-43af-8b70-41d8d4265574"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:35:58.876291 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5a77ddaa-4f79-4f9a-a007-51da3bff7f2e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:58.876975 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59016) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:58.953886 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-cbf3a055-56a1-405e-8236-b81c33435296 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'name': 'tempest-RoutersIpV6Test-router-1491329762', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:35:32Z', 'updated_at': '2021-11-09T04:35:58Z', 'revision_number': 8, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'gw_port_host': None, '_interfaces': [{'id': '5a28daa1-7cdd-49a3-aad4-ecd643914dfd', 'name': '', 'network_id': '0c466943-3298-4130-be72-d7c24549bd5d', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:9e:e7:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1206, 'fixed_ips': [{'subnet_id': '0cd8bdb8-1377-46f0-ba25-14251b97253b', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:35Z', 'updated_at': '2021-11-09T04:35:41Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': '0cd8bdb8-1377-46f0-ba25-14251b97253b', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '858eaebe-fdb6-4c5b-ab0f-4d6bd86995d4', 'name': '', 'network_id': '035bc5dd-3c1d-4ced-893c-487b4c0eff40', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:82:b5:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1214, 'fixed_ips': [{'subnet_id': 'b46b8bfd-f2f3-4413-b04c-231ee75f8c2c', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:41Z', 'updated_at': '2021-11-09T04:35:45Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': 'b46b8bfd-f2f3-4413-b04c-231ee75f8c2c', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '96c020fa-1590-4db4-85e8-09e998526562', 'name': '', 'network_id': 'b93b0577-d21b-4089-8251-c3aac06bdb77', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:02:31:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1220, 'fixed_ips': [{'subnet_id': '75b6b6c5-0313-4754-bcde-7b2b14023f56', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:46Z', 'updated_at': '2021-11-09T04:35:50Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': '75b6b6c5-0313-4754-bcde-7b2b14023f56', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:59.030065 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cbf3a055-56a1-405e-8236-b81c33435296 None None] The sync data for ids ['7b9a51f0-889c-418d-bc8a-fcfd303c5053'] in dv-neutron-816802-2-hyperv is: [{'id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'name': 'tempest-RoutersIpV6Test-router-1491329762', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:35:32Z', 'updated_at': '2021-11-09T04:35:58Z', 'revision_number': 8, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'gw_port_host': None, '_interfaces': [{'id': '5a28daa1-7cdd-49a3-aad4-ecd643914dfd', 'name': '', 'network_id': '0c466943-3298-4130-be72-d7c24549bd5d', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:9e:e7:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1206, 'fixed_ips': [{'subnet_id': '0cd8bdb8-1377-46f0-ba25-14251b97253b', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:35Z', 'updated_at': '2021-11-09T04:35:41Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': '0cd8bdb8-1377-46f0-ba25-14251b97253b', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '858eaebe-fdb6-4c5b-ab0f-4d6bd86995d4', 'name': '', 'network_id': '035bc5dd-3c1d-4ced-893c-487b4c0eff40', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:82:b5:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1214, 'fixed_ips': [{'subnet_id': 'b46b8bfd-f2f3-4413-b04c-231ee75f8c2c', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:41Z', 'updated_at': '2021-11-09T04:35:45Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': 'b46b8bfd-f2f3-4413-b04c-231ee75f8c2c', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '96c020fa-1590-4db4-85e8-09e998526562', 'name': '', 'network_id': 'b93b0577-d21b-4089-8251-c3aac06bdb77', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:02:31:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1220, 'fixed_ips': [{'subnet_id': '75b6b6c5-0313-4754-bcde-7b2b14023f56', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:46Z', 'updated_at': '2021-11-09T04:35:50Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': '75b6b6c5-0313-4754-bcde-7b2b14023f56', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:35:59.093937 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-340657d9-e3ff-497e-8176-856377fc2360 None None] Set router d05416c2-0293-4ef5-a6e3-5968392cc774 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:35:59.209320 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ab1d06e-5ad4-48a9-afe2-40d87df5aa84 req-4fbb7fde-bb7f-43d6-af6a-5641ec336181 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:59.217355 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-9ab1d06e-5ad4-48a9-afe2-40d87df5aa84 req-4fbb7fde-bb7f-43d6-af6a-5641ec336181 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=f0ae9486-80b5-43bd-acec-49f871c00e67 HTTP/1.1" status: 200 len: 945 time: 0.1282811 Nov 09 04:35:59.266824 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5a77ddaa-4f79-4f9a-a007-51da3bff7f2e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Router 7b9a51f0-889c-418d-bc8a-fcfd303c5053 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:35:59.271938 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:35:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c5e8ba45-d839-4688-937e-bef33d1869e2 x-openstack-request-id: req-c5e8ba45-d839-4688-937e-bef33d1869e2 {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:35:59.272495 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8f462374-376b-4c38-b300-528ae5358377", "tag": "09cbfb91-4118-43af-8b70-41d8d4265574", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:35:59.272495 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-c5e8ba45-d839-4688-937e-bef33d1869e2 {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:35:59.272835 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8f462374-376b-4c38-b300-528ae5358377', 'tag': '09cbfb91-4118-43af-8b70-41d8d4265574', 'status': 'completed', 'code': 200} Nov 09 04:35:59.275121 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-011bbad6-70a3-4eb6-a061-78baea72bf0d tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] 10.222.0.24 "GET /v2.0/ports?device_id=f961f4f5-6f17-45e1-91f0-ed3a6c4e8ad7 HTTP/1.1" status: 200 len: 205 time: 0.3971665 Nov 09 04:35:59.279712 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59022) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:59.295690 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-9ab1d06e-5ad4-48a9-afe2-40d87df5aa84 req-0c8ad2fe-fad6-4805-a474-9f3e4e82b882 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0774207 Nov 09 04:35:59.327598 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.api.v2.resource [None req-714e7490-8cea-446d-8d2c-1274e714121c tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] delete failed (client error): The resource could not be found. Nov 09 04:35:59.328679 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-714e7490-8cea-446d-8d2c-1274e714121c tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] 10.222.0.24 "DELETE /v2.0/routers/f961f4f5-6f17-45e1-91f0-ed3a6c4e8ad7 HTTP/1.1" status: 404 len: 336 time: 0.0496886 Nov 09 04:35:59.331200 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59024) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:59.360882 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-340657d9-e3ff-497e-8176-856377fc2360 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'name': 'tempest-TestNetworkBasicOps-router-1967773701', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.204'}], 'enable_snat': True}, 'gw_port_id': '49bff53a-c208-4aa5-8fcc-e7ec9471fae7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:33:32Z', 'updated_at': '2021-11-09T04:35:45Z', 'revision_number': 6, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '49bff53a-c208-4aa5-8fcc-e7ec9471fae7', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:85:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'device_owner': 'network:router_gateway', 'standard_attr_id': 978, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.204', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:33:34Z', 'updated_at': '2021-11-09T04:33:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '9930d582-2262-4f1d-97bf-b02697a70777', 'name': '', 'network_id': '239a9c72-6384-4d5a-a69d-f4ac0c580e40', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:7c:21:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'device_owner': 'network:router_interface', 'standard_attr_id': 987, 'fixed_ips': [{'subnet_id': '33b5599d-7ebe-4564-9c72-76f5d540fd80', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:33:41Z', 'updated_at': '2021-11-09T04:33:48Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '33b5599d-7ebe-4564-9c72-76f5d540fd80', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:59.366302 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-e3a7805a-c42f-4213-b6ab-6312e7b27882 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] DELETE failed (client error): The resource could not be found. Nov 09 04:35:59.367166 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e3a7805a-c42f-4213-b6ab-6312e7b27882 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:35:59.370255 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e3a7805a-c42f-4213-b6ab-6312e7b27882 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] 10.222.0.24 "DELETE /v2.0/subnets/3ad33066-d288-4e2f-b144-02102acb9c51 HTTP/1.1" status: 404 len: 337 time: 0.0381653 Nov 09 04:35:59.373164 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59026) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:59.381061 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-276f1b1c-97b5-429f-a7f7-677ad90e9ee8 req-91c64cc9-54b3-4355-a156-5f473406c1b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:59.384171 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-276f1b1c-97b5-429f-a7f7-677ad90e9ee8 req-91c64cc9-54b3-4355-a156-5f473406c1b9 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&device_id=8f462374-376b-4c38-b300-528ae5358377 HTTP/1.1" status: 200 len: 1098 time: 0.1191311 Nov 09 04:35:59.395706 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-340657d9-e3ff-497e-8176-856377fc2360 None None] Checking router: d05416c2-0293-4ef5-a6e3-5968392cc774 for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:35:59.407959 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-340657d9-e3ff-497e-8176-856377fc2360 None None] Routers {'d05416c2-0293-4ef5-a6e3-5968392cc774'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:59.408668 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-340657d9-e3ff-497e-8176-856377fc2360 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['d05416c2-0293-4ef5-a6e3-5968392cc774'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:59.434800 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5a77ddaa-4f79-4f9a-a007-51da3bff7f2e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:35:59.448803 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-5a77ddaa-4f79-4f9a-a007-51da3bff7f2e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "PUT /v2.0/routers/7b9a51f0-889c-418d-bc8a-fcfd303c5053/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.6041253 Nov 09 04:35:59.472340 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59030) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:35:59.492208 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 0ce278c9-884c-454c-91e4-5240df031ec3 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:35:59.530026 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 0ce278c9-884c-454c-91e4-5240df031ec3 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:35:59.530026 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 0ce278c9-884c-454c-91e4-5240df031ec3 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:35:59.563815 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-fc3e0662-4670-4129-ab24-87ca9ba302b3 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Deleting subnet 07a4cdc6-7f9d-4e6c-98b9-ae041d44d264 {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:35:59.573480 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fc3e0662-4670-4129-ab24-87ca9ba302b3 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:59.575185 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0d26478-43fd-497b-95c1-76d7406b770d req-5310803d-872b-4c64-92c3-deca5bce30cb tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:59.576746 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b0d26478-43fd-497b-95c1-76d7406b770d req-5310803d-872b-4c64-92c3-deca5bce30cb tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=8f462374-376b-4c38-b300-528ae5358377 HTTP/1.1" status: 200 len: 945 time: 0.0941222 Nov 09 04:35:59.580344 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-340657d9-e3ff-497e-8176-856377fc2360 None None] Set router d05416c2-0293-4ef5-a6e3-5968392cc774 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:35:59.609323 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-276f1b1c-97b5-429f-a7f7-677ad90e9ee8 req-2bda515f-9ffc-4f19-9a51-ba3ee2d5d463 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:59.611037 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-276f1b1c-97b5-429f-a7f7-677ad90e9ee8 req-2bda515f-9ffc-4f19-9a51-ba3ee2d5d463 service neutron] 10.222.0.26 "GET /v2.0/networks?id=239a9c72-6384-4d5a-a69d-f4ac0c580e40 HTTP/1.1" status: 200 len: 897 time: 0.2193661 Nov 09 04:35:59.640011 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-6a77931d-ebfc-4e12-9059-25e0f7d80829 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Deleting port 57f5ba4c-bda3-4726-a6dd-7358e44971c0 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:35:59.640353 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6a77931d-ebfc-4e12-9059-25e0f7d80829 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:59.663360 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-276f1b1c-97b5-429f-a7f7-677ad90e9ee8 req-8818f1a9-90bd-4f04-a0fd-1238d6f6866c service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=09cbfb91-4118-43af-8b70-41d8d4265574 HTTP/1.1" status: 200 len: 217 time: 0.0393078 Nov 09 04:35:59.665771 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fc3e0662-4670-4129-ab24-87ca9ba302b3 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:59.707442 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b0d26478-43fd-497b-95c1-76d7406b770d req-48880024-543b-42b8-886e-a7af40ce78de tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=99157167-0266-49ff-809e-cf8a91af8ae5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1212285 Nov 09 04:35:59.756353 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6a77931d-ebfc-4e12-9059-25e0f7d80829 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:59.770141 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-276f1b1c-97b5-429f-a7f7-677ad90e9ee8 req-babf862f-bd54-4af7-880a-c2bfb3f8c1d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:59.770884 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-6a77931d-ebfc-4e12-9059-25e0f7d80829 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Calling delete_port for 57f5ba4c-bda3-4726-a6dd-7358e44971c0 owned by {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:35:59.771773 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-276f1b1c-97b5-429f-a7f7-677ad90e9ee8 req-babf862f-bd54-4af7-880a-c2bfb3f8c1d8 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=33b5599d-7ebe-4564-9c72-76f5d540fd80 HTTP/1.1" status: 200 len: 834 time: 0.0803573 Nov 09 04:35:59.804604 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-340657d9-e3ff-497e-8176-856377fc2360 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'name': 'tempest-TestNetworkBasicOps-router-1967773701', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.204'}], 'enable_snat': True}, 'gw_port_id': '49bff53a-c208-4aa5-8fcc-e7ec9471fae7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:33:32Z', 'updated_at': '2021-11-09T04:35:45Z', 'revision_number': 6, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '49bff53a-c208-4aa5-8fcc-e7ec9471fae7', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:85:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'device_owner': 'network:router_gateway', 'standard_attr_id': 978, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.204', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:33:34Z', 'updated_at': '2021-11-09T04:33:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '9930d582-2262-4f1d-97bf-b02697a70777', 'name': '', 'network_id': '239a9c72-6384-4d5a-a69d-f4ac0c580e40', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:7c:21:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'device_owner': 'network:router_interface', 'standard_attr_id': 987, 'fixed_ips': [{'subnet_id': '33b5599d-7ebe-4564-9c72-76f5d540fd80', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:33:41Z', 'updated_at': '2021-11-09T04:33:48Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '33b5599d-7ebe-4564-9c72-76f5d540fd80', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:59.826488 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b7c7545f-e459-419e-baf9-02b5321bd2e5 None None] Sync routers for ids ['7b9a51f0-889c-418d-bc8a-fcfd303c5053'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:35:59.831094 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fc3e0662-4670-4129-ab24-87ca9ba302b3 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:35:59.839703 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b7c7545f-e459-419e-baf9-02b5321bd2e5 None None] Routers {'7b9a51f0-889c-418d-bc8a-fcfd303c5053'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:35:59.846347 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-b7c7545f-e459-419e-baf9-02b5321bd2e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['7b9a51f0-889c-418d-bc8a-fcfd303c5053'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:35:59.847019 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-340657d9-e3ff-497e-8176-856377fc2360 None None] The sync data for ids ['d05416c2-0293-4ef5-a6e3-5968392cc774'] in dv-neutron-816802-2-hyperv is: [{'id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'name': 'tempest-TestNetworkBasicOps-router-1967773701', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.204'}], 'enable_snat': True}, 'gw_port_id': '49bff53a-c208-4aa5-8fcc-e7ec9471fae7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:33:32Z', 'updated_at': '2021-11-09T04:35:45Z', 'revision_number': 6, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '49bff53a-c208-4aa5-8fcc-e7ec9471fae7', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:85:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'device_owner': 'network:router_gateway', 'standard_attr_id': 978, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.204', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:33:34Z', 'updated_at': '2021-11-09T04:33:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '9930d582-2262-4f1d-97bf-b02697a70777', 'name': '', 'network_id': '239a9c72-6384-4d5a-a69d-f4ac0c580e40', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:7c:21:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'device_owner': 'network:router_interface', 'standard_attr_id': 987, 'fixed_ips': [{'subnet_id': '33b5599d-7ebe-4564-9c72-76f5d540fd80', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:33:41Z', 'updated_at': '2021-11-09T04:33:48Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '33b5599d-7ebe-4564-9c72-76f5d540fd80', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:35:59.878267 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-276f1b1c-97b5-429f-a7f7-677ad90e9ee8 req-b7828bb6-8f9d-4203-b20f-783f1a325b1b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:35:59.879793 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-276f1b1c-97b5-429f-a7f7-677ad90e9ee8 req-b7828bb6-8f9d-4203-b20f-783f1a325b1b service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=239a9c72-6384-4d5a-a69d-f4ac0c580e40&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0912268 Nov 09 04:35:59.964744 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-b7c7545f-e459-419e-baf9-02b5321bd2e5 None None] Set router 7b9a51f0-889c-418d-bc8a-fcfd303c5053 gateway port host: None {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:35:59.992504 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-276f1b1c-97b5-429f-a7f7-677ad90e9ee8 req-c4ee8e7b-7bb5-4a8b-b9b2-66071ffe849c service neutron] 10.222.0.26 "GET /v2.0/networks/239a9c72-6384-4d5a-a69d-f4ac0c580e40?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0924492 Nov 09 04:36:00.060721 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fc3e0662-4670-4129-ab24-87ca9ba302b3 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:00.075739 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6a77931d-ebfc-4e12-9059-25e0f7d80829 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:00.096210 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc3e0662-4670-4129-ab24-87ca9ba302b3 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event deleted for resources: {'Subnet': ['ID=07a4cdc6-7f9d-4e6c-98b9-ae041d44d264,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:00.103783 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fc3e0662-4670-4129-ab24-87ca9ba302b3 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:00.110653 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-fc3e0662-4670-4129-ab24-87ca9ba302b3 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "DELETE /v2.0/subnets/07a4cdc6-7f9d-4e6c-98b9-ae041d44d264 HTTP/1.1" status: 204 len: 168 time: 0.6327741 Nov 09 04:36:00.113039 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59032) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:00.121002 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a77931d-ebfc-4e12-9059-25e0f7d80829 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Pushing event deleted for resources: {'Port': ['ID=57f5ba4c-bda3-4726-a6dd-7358e44971c0,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:00.132919 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9009134e-3299-4628-b178-6b7171286b19 None None] Network f1abb35d-0157-4eda-8b7e-6c93030db963 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:36:00.190436 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-276f1b1c-97b5-429f-a7f7-677ad90e9ee8 req-3a83fd88-721a-45d8-b014-313b50fece3a service neutron] 10.222.0.26 "GET /v2.0/networks/239a9c72-6384-4d5a-a69d-f4ac0c580e40?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1903231 Nov 09 04:36:00.191658 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eead115c-0114-4dd1-8ec0-fd0a4379d13f None None] New status for floating IP 071d456d-45c8-43d6-9154-8dc9c2df29f2: DOWN {{(pid=102164) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 04:36:00.210692 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-634676f3-bc47-4606-afc4-ee3b5a4b6c3e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:00.221559 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6a77931d-ebfc-4e12-9059-25e0f7d80829 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:00.226897 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-6a77931d-ebfc-4e12-9059-25e0f7d80829 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] 10.222.0.24 "DELETE /v2.0/ports/57f5ba4c-bda3-4726-a6dd-7358e44971c0 HTTP/1.1" status: 204 len: 168 time: 0.8515790 Nov 09 04:36:00.231598 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59034) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:00.281263 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-634676f3-bc47-4606-afc4-ee3b5a4b6c3e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Deleting port 42c63ae2-c868-4395-8d1a-b91fb2d91d24 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:36:00.282410 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-634676f3-bc47-4606-afc4-ee3b5a4b6c3e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:00.343540 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-b7c7545f-e459-419e-baf9-02b5321bd2e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'name': 'tempest-RoutersIpV6Test-router-1491329762', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:35:32Z', 'updated_at': '2021-11-09T04:35:58Z', 'revision_number': 8, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'gw_port_host': None, '_interfaces': [{'id': '5a28daa1-7cdd-49a3-aad4-ecd643914dfd', 'name': '', 'network_id': '0c466943-3298-4130-be72-d7c24549bd5d', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:9e:e7:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1206, 'fixed_ips': [{'subnet_id': '0cd8bdb8-1377-46f0-ba25-14251b97253b', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:35Z', 'updated_at': '2021-11-09T04:35:41Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': '0cd8bdb8-1377-46f0-ba25-14251b97253b', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '858eaebe-fdb6-4c5b-ab0f-4d6bd86995d4', 'name': '', 'network_id': '035bc5dd-3c1d-4ced-893c-487b4c0eff40', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:82:b5:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1214, 'fixed_ips': [{'subnet_id': 'b46b8bfd-f2f3-4413-b04c-231ee75f8c2c', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:41Z', 'updated_at': '2021-11-09T04:35:45Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': 'b46b8bfd-f2f3-4413-b04c-231ee75f8c2c', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '96c020fa-1590-4db4-85e8-09e998526562', 'name': '', 'network_id': 'b93b0577-d21b-4089-8251-c3aac06bdb77', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:02:31:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1220, 'fixed_ips': [{'subnet_id': '75b6b6c5-0313-4754-bcde-7b2b14023f56', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:46Z', 'updated_at': '2021-11-09T04:35:50Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': '75b6b6c5-0313-4754-bcde-7b2b14023f56', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:00.360467 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-634676f3-bc47-4606-afc4-ee3b5a4b6c3e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] For port 42c63ae2-c868-4395-8d1a-b91fb2d91d24, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=42c63ae2-c868-4395-8d1a-b91fb2d91d24,segment=NetworkSegment(73188347-497c-4b3d-bfb4-401319c53746),segment_id=73188347-497c-4b3d-bfb4-401319c53746)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:36:00.360467 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-634676f3-bc47-4606-afc4-ee3b5a4b6c3e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:00.362992 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-69b0eb7c-d26a-4509-858a-31e367736bf3 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Deleting port 0641253a-a234-4a6d-8e89-7a72a04af2ac {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:36:00.363521 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-69b0eb7c-d26a-4509-858a-31e367736bf3 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:00.381309 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b7c7545f-e459-419e-baf9-02b5321bd2e5 None None] Checking router: 7b9a51f0-889c-418d-bc8a-fcfd303c5053 for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:36:00.389547 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-634676f3-bc47-4606-afc4-ee3b5a4b6c3e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Calling delete_port for 42c63ae2-c868-4395-8d1a-b91fb2d91d24 owned by network:dhcp {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:36:00.396370 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b7c7545f-e459-419e-baf9-02b5321bd2e5 None None] Routers {'7b9a51f0-889c-418d-bc8a-fcfd303c5053'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:36:00.397566 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-b7c7545f-e459-419e-baf9-02b5321bd2e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['7b9a51f0-889c-418d-bc8a-fcfd303c5053'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:00.469071 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ca614655-e73f-464f-a7a9-d71445f70ca0 None None] DHCP port deletion for f1abb35d-0157-4eda-8b7e-6c93030db963 request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:36:00.469306 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-69b0eb7c-d26a-4509-858a-31e367736bf3 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:00.482530 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-69b0eb7c-d26a-4509-858a-31e367736bf3 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Calling delete_port for 0641253a-a234-4a6d-8e89-7a72a04af2ac owned by {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:36:00.493498 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92f46366-4094-48a7-b006-48a808191154 req-141517fe-d348-4fe9-acd3-797a980e5c4c tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:36:00.495306 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-92f46366-4094-48a7-b006-48a808191154 req-141517fe-d348-4fe9-acd3-797a980e5c4c tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=f0ae9486-80b5-43bd-acec-49f871c00e67 HTTP/1.1" status: 200 len: 945 time: 0.1016569 Nov 09 04:36:00.519746 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-b7c7545f-e459-419e-baf9-02b5321bd2e5 None None] Set router 7b9a51f0-889c-418d-bc8a-fcfd303c5053 gateway port host: None {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:36:00.560080 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-92f46366-4094-48a7-b006-48a808191154 req-6a42f08a-f55a-4fd5-8406-0e77354aebb7 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0554574 Nov 09 04:36:00.618815 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-634676f3-bc47-4606-afc4-ee3b5a4b6c3e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:00.633719 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-ca614655-e73f-464f-a7a9-d71445f70ca0 None None] Deleting port 42c63ae2-c868-4395-8d1a-b91fb2d91d24 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:36:00.634136 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ca614655-e73f-464f-a7a9-d71445f70ca0 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:00.648495 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-634676f3-bc47-4606-afc4-ee3b5a4b6c3e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event deleted for resources: {'Port': ['ID=42c63ae2-c868-4395-8d1a-b91fb2d91d24,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:00.650219 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-634676f3-bc47-4606-afc4-ee3b5a4b6c3e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] No DVR routers for this DVR port 42c63ae2-c868-4395-8d1a-b91fb2d91d24 on host dv-neutron-816802-2-hyperv {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:36:00.693662 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-69b0eb7c-d26a-4509-858a-31e367736bf3 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:00.727766 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69b0eb7c-d26a-4509-858a-31e367736bf3 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Pushing event deleted for resources: {'Port': ['ID=0641253a-a234-4a6d-8e89-7a72a04af2ac,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:00.754937 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-ca614655-e73f-464f-a7a9-d71445f70ca0 None None] For port 42c63ae2-c868-4395-8d1a-b91fb2d91d24, host dv-neutron-816802-2-hyperv, got binding levels [] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:36:00.755329 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ca614655-e73f-464f-a7a9-d71445f70ca0 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:00.763108 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-634676f3-bc47-4606-afc4-ee3b5a4b6c3e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:00.768715 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-ca614655-e73f-464f-a7a9-d71445f70ca0 None None] Calling delete_port for 42c63ae2-c868-4395-8d1a-b91fb2d91d24 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:36:00.771493 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.ipam_backend_mixin [None req-ca614655-e73f-464f-a7a9-d71445f70ca0 None None] Port 42c63ae2-c868-4395-8d1a-b91fb2d91d24 was not found and therefore no delete operation was performed {{(pid=102163) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Nov 09 04:36:00.774935 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ca614655-e73f-464f-a7a9-d71445f70ca0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:00.784909 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0dcec3ce-b572-4831-8ef3-e91a7979ac03 req-495b0587-3fa9-44ef-b7aa-7eb5c6d75e57 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:36:00.787185 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-0dcec3ce-b572-4831-8ef3-e91a7979ac03 req-495b0587-3fa9-44ef-b7aa-7eb5c6d75e57 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=f0ae9486-80b5-43bd-acec-49f871c00e67 HTTP/1.1" status: 200 len: 945 time: 0.1347373 Nov 09 04:36:00.801372 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-634676f3-bc47-4606-afc4-ee3b5a4b6c3e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f1abb35d-0157-4eda-8b7e-6c93030db963']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:00.831508 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-634676f3-bc47-4606-afc4-ee3b5a4b6c3e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '73188347-497c-4b3d-bfb4-401319c53746') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:00.831751 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-634676f3-bc47-4606-afc4-ee3b5a4b6c3e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '73188347-497c-4b3d-bfb4-401319c53746') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:00.832952 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca614655-e73f-464f-a7a9-d71445f70ca0 None None] Pushing event deleted for resources: {'Port': ['ID=42c63ae2-c868-4395-8d1a-b91fb2d91d24,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:00.834989 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ca614655-e73f-464f-a7a9-d71445f70ca0 None None] No DVR routers for this DVR port 42c63ae2-c868-4395-8d1a-b91fb2d91d24 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:36:00.854751 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2d68228-6822-46d6-b3ef-c43887ef59c2 req-0b573e80-9b81-4f4c-af88-ad9d21a9aae3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:36:00.856187 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c2d68228-6822-46d6-b3ef-c43887ef59c2 req-0b573e80-9b81-4f4c-af88-ad9d21a9aae3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "GET /v2.0/ports?device_id=8f462374-376b-4c38-b300-528ae5358377 HTTP/1.1" status: 200 len: 945 time: 0.1285346 Nov 09 04:36:00.858778 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-634676f3-bc47-4606-afc4-ee3b5a4b6c3e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:00.866671 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-69b0eb7c-d26a-4509-858a-31e367736bf3 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:00.873814 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-69b0eb7c-d26a-4509-858a-31e367736bf3 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] 10.222.0.24 "DELETE /v2.0/ports/0641253a-a234-4a6d-8e89-7a72a04af2ac HTTP/1.1" status: 204 len: 168 time: 0.6391277 Nov 09 04:36:00.874693 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-b7c7545f-e459-419e-baf9-02b5321bd2e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'name': 'tempest-RoutersIpV6Test-router-1491329762', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:35:32Z', 'updated_at': '2021-11-09T04:35:58Z', 'revision_number': 8, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'gw_port_host': None, '_interfaces': [{'id': '5a28daa1-7cdd-49a3-aad4-ecd643914dfd', 'name': '', 'network_id': '0c466943-3298-4130-be72-d7c24549bd5d', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:9e:e7:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1206, 'fixed_ips': [{'subnet_id': '0cd8bdb8-1377-46f0-ba25-14251b97253b', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:35Z', 'updated_at': '2021-11-09T04:35:41Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': '0cd8bdb8-1377-46f0-ba25-14251b97253b', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '858eaebe-fdb6-4c5b-ab0f-4d6bd86995d4', 'name': '', 'network_id': '035bc5dd-3c1d-4ced-893c-487b4c0eff40', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:82:b5:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1214, 'fixed_ips': [{'subnet_id': 'b46b8bfd-f2f3-4413-b04c-231ee75f8c2c', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:41Z', 'updated_at': '2021-11-09T04:35:45Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': 'b46b8bfd-f2f3-4413-b04c-231ee75f8c2c', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '96c020fa-1590-4db4-85e8-09e998526562', 'name': '', 'network_id': 'b93b0577-d21b-4089-8251-c3aac06bdb77', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:02:31:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1220, 'fixed_ips': [{'subnet_id': '75b6b6c5-0313-4754-bcde-7b2b14023f56', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:46Z', 'updated_at': '2021-11-09T04:35:50Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': '75b6b6c5-0313-4754-bcde-7b2b14023f56', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:00.878451 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59042) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:00.902440 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-0dcec3ce-b572-4831-8ef3-e91a7979ac03 req-e6ba8884-f963-4af7-b44a-a384922aecd1 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1090012 Nov 09 04:36:00.905359 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-634676f3-bc47-4606-afc4-ee3b5a4b6c3e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:00.914193 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b7c7545f-e459-419e-baf9-02b5321bd2e5 None None] The sync data for ids ['7b9a51f0-889c-418d-bc8a-fcfd303c5053'] in dv-neutron-816802-2-hyperv is: [{'id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'name': 'tempest-RoutersIpV6Test-router-1491329762', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:35:32Z', 'updated_at': '2021-11-09T04:35:58Z', 'revision_number': 8, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'gw_port_host': None, '_interfaces': [{'id': '5a28daa1-7cdd-49a3-aad4-ecd643914dfd', 'name': '', 'network_id': '0c466943-3298-4130-be72-d7c24549bd5d', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:9e:e7:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1206, 'fixed_ips': [{'subnet_id': '0cd8bdb8-1377-46f0-ba25-14251b97253b', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:35Z', 'updated_at': '2021-11-09T04:35:41Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': '0cd8bdb8-1377-46f0-ba25-14251b97253b', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '858eaebe-fdb6-4c5b-ab0f-4d6bd86995d4', 'name': '', 'network_id': '035bc5dd-3c1d-4ced-893c-487b4c0eff40', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:82:b5:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1214, 'fixed_ips': [{'subnet_id': 'b46b8bfd-f2f3-4413-b04c-231ee75f8c2c', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:41Z', 'updated_at': '2021-11-09T04:35:45Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': 'b46b8bfd-f2f3-4413-b04c-231ee75f8c2c', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '96c020fa-1590-4db4-85e8-09e998526562', 'name': '', 'network_id': 'b93b0577-d21b-4089-8251-c3aac06bdb77', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:02:31:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1220, 'fixed_ips': [{'subnet_id': '75b6b6c5-0313-4754-bcde-7b2b14023f56', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:46Z', 'updated_at': '2021-11-09T04:35:50Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': '75b6b6c5-0313-4754-bcde-7b2b14023f56', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:36:00.923461 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d507c51-65ee-4f8c-a592-67bb6de81331 req-641f8e9e-a0a5-4b91-8c37-dca8555b5f9b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:36:00.925000 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5d507c51-65ee-4f8c-a592-67bb6de81331 req-641f8e9e-a0a5-4b91-8c37-dca8555b5f9b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=8f462374-376b-4c38-b300-528ae5358377 HTTP/1.1" status: 200 len: 945 time: 0.1400261 Nov 09 04:36:00.926180 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-634676f3-bc47-4606-afc4-ee3b5a4b6c3e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Releasing vlan 332 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:36:00.926599 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-634676f3-bc47-4606-afc4-ee3b5a4b6c3e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:00.930030 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:36:00.930030 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:36:00.930030 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:36:00.930030 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:36:00.930030 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:36:00.930030 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:36:00.930030 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:36:00.930030 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:36:00.930030 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:36:00.930030 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:36:00.930030 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:36:00.930030 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:36:00.930030 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:36:00.930030 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:36:00.930030 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:36:00.930030 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:36:00.930030 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:36:00.930030 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:36:00.930030 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:36:00.930030 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:36:00.930030 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:36:00.930030 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:36:00.930030 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:36:00.930030 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:36:00.930030 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:36:00.930030 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:36:00.930030 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:36:00.930030 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:36:00.930030 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:36:00.930030 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:36:00.930030 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:36:00.930030 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:36:00.934783 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59044) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:00.973848 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6938b33c-d72f-43ae-a082-a0e70fd472a2 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:36:00.984410 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-6938b33c-d72f-43ae-a082-a0e70fd472a2 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ac82b1e-1b89-49c2-850a-e69a6d1163e6 HTTP/1.1" status: 200 len: 913 time: 0.0983920 Nov 09 04:36:00.986955 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59048) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:01.070905 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5d507c51-65ee-4f8c-a592-67bb6de81331 req-ed127630-e1fd-4cca-b59c-680a04581441 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=99157167-0266-49ff-809e-cf8a91af8ae5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1239712 Nov 09 04:36:01.086533 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-c2d68228-6822-46d6-b3ef-c43887ef59c2 req-d13b66e0-5b39-415f-b508-2a9471b28b30 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Deleting port 09cbfb91-4118-43af-8b70-41d8d4265574 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:36:01.086533 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-c2d68228-6822-46d6-b3ef-c43887ef59c2 req-d13b66e0-5b39-415f-b508-2a9471b28b30 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:01.118612 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0bb429e4-2aaf-45c3-a548-4d1ad77f2373 tempest-TestVolumeBootPattern-1884748564 tempest-TestVolumeBootPattern-1884748564-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:36:01.120708 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-0bb429e4-2aaf-45c3-a548-4d1ad77f2373 tempest-TestVolumeBootPattern-1884748564 tempest-TestVolumeBootPattern-1884748564-project-admin] 10.222.0.24 "GET /v2.0/ports?device_id=f0ae9486-80b5-43bd-acec-49f871c00e67 HTTP/1.1" status: 200 len: 1093 time: 0.1849322 Nov 09 04:36:01.128746 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59050) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:01.133254 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-955b4808-41f1-4b5f-84bc-95ccc1f232c9 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Request body: {'floatingip': {'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'port_id': 'd4753771-ff46-428e-9ad0-3dce1a15a45f', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'fixed_ip_address': '172.20.0.7'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:01.139803 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-634676f3-bc47-4606-afc4-ee3b5a4b6c3e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:01.147750 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-634676f3-bc47-4606-afc4-ee3b5a4b6c3e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:01.150663 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-634676f3-bc47-4606-afc4-ee3b5a4b6c3e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "DELETE /v2.0/networks/f1abb35d-0157-4eda-8b7e-6c93030db963 HTTP/1.1" status: 204 len: 168 time: 1.0365088 Nov 09 04:36:01.154235 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59052) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:01.176400 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-634676f3-bc47-4606-afc4-ee3b5a4b6c3e tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event deleted for resources: {'Network': ['ID=f1abb35d-0157-4eda-8b7e-6c93030db963,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:01.254626 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 42c63ae2-c868-4395-8d1a-b91fb2d91d24 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:36:01.258618 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-955b4808-41f1-4b5f-84bc-95ccc1f232c9 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks [] for floatingip, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:01.273769 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-c2d68228-6822-46d6-b3ef-c43887ef59c2 req-d13b66e0-5b39-415f-b508-2a9471b28b30 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] For port 09cbfb91-4118-43af-8b70-41d8d4265574, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=09cbfb91-4118-43af-8b70-41d8d4265574,segment=NetworkSegment(7befff96-69ce-4b76-b9cc-7561279d57a7),segment_id=7befff96-69ce-4b76-b9cc-7561279d57a7)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:36:01.274738 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-c2d68228-6822-46d6-b3ef-c43887ef59c2 req-d13b66e0-5b39-415f-b508-2a9471b28b30 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:01.279329 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 42c63ae2-c868-4395-8d1a-b91fb2d91d24 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:36:01.279682 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 42c63ae2-c868-4395-8d1a-b91fb2d91d24 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:36:01.290448 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-c2d68228-6822-46d6-b3ef-c43887ef59c2 req-d13b66e0-5b39-415f-b508-2a9471b28b30 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Calling delete_port for 09cbfb91-4118-43af-8b70-41d8d4265574 owned by compute:nova {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:36:01.451824 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-955b4808-41f1-4b5f-84bc-95ccc1f232c9 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:01.521879 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ed0ad01b-b9bf-4f28-b293-a70ca8a6f53b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:01.631466 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e5447335-4df2-4d3b-8df4-a3f25acdf8d9 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:01.634522 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-c2d68228-6822-46d6-b3ef-c43887ef59c2 req-d13b66e0-5b39-415f-b508-2a9471b28b30 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:01.643042 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-955b4808-41f1-4b5f-84bc-95ccc1f232c9 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Allocated IP 172.26.0.190 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/cc2ee892-a7b2-4a88-8885-ead772c3089b) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:36:01.720126 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d13b66e0-5b39-415f-b508-2a9471b28b30 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'Port': ['ID=09cbfb91-4118-43af-8b70-41d8d4265574,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:01.768760 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-c2d68228-6822-46d6-b3ef-c43887ef59c2 req-d13b66e0-5b39-415f-b508-2a9471b28b30 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] No DVR routers for this DVR port 09cbfb91-4118-43af-8b70-41d8d4265574 on host hv-neutron-8168 {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:36:01.772636 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-c2d68228-6822-46d6-b3ef-c43887ef59c2 req-d13b66e0-5b39-415f-b508-2a9471b28b30 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:01.777511 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c2d68228-6822-46d6-b3ef-c43887ef59c2 req-d13b66e0-5b39-415f-b508-2a9471b28b30 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "DELETE /v2.0/ports/09cbfb91-4118-43af-8b70-41d8d4265574 HTTP/1.1" status: 204 len: 173 time: 0.9082267 Nov 09 04:36:01.777511 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8f462374-376b-4c38-b300-528ae5358377', 'name': 'network-vif-deleted', 'tag': '09cbfb91-4118-43af-8b70-41d8d4265574'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:36:01.779234 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9f74a3d3-15c8-4297-a09e-a04b7af15b35" -d '{"events": [{"server_uuid": "8f462374-376b-4c38-b300-528ae5358377", "name": "network-vif-deleted", "tag": "09cbfb91-4118-43af-8b70-41d8d4265574"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:36:01.823896 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-955b4808-41f1-4b5f-84bc-95ccc1f232c9 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:01.839272 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:36:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1714e781-3879-4a93-b175-4749de99d518 x-openstack-request-id: req-1714e781-3879-4a93-b175-4749de99d518 {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:36:01.839558 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8f462374-376b-4c38-b300-528ae5358377", "name": "network-vif-deleted", "tag": "09cbfb91-4118-43af-8b70-41d8d4265574", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:36:01.839804 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-1714e781-3879-4a93-b175-4749de99d518 {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:36:01.840619 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8f462374-376b-4c38-b300-528ae5358377', 'name': 'network-vif-deleted', 'tag': '09cbfb91-4118-43af-8b70-41d8d4265574', 'status': 'completed', 'code': 200} Nov 09 04:36:01.937243 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-ed0ad01b-b9bf-4f28-b293-a70ca8a6f53b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Deleting port 486ad8d0-0c29-4b59-9a61-d61a75d63b9a {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:36:01.937588 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ed0ad01b-b9bf-4f28-b293-a70ca8a6f53b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:01.963362 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-e5447335-4df2-4d3b-8df4-a3f25acdf8d9 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Deleting port 96c020fa-1590-4db4-85e8-09e998526562 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:36:01.964211 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e5447335-4df2-4d3b-8df4-a3f25acdf8d9 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:02.004585 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-955b4808-41f1-4b5f-84bc-95ccc1f232c9 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:02.057774 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-955b4808-41f1-4b5f-84bc-95ccc1f232c9 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:36:02.058913 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-e5447335-4df2-4d3b-8df4-a3f25acdf8d9 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] For port 96c020fa-1590-4db4-85e8-09e998526562, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=96c020fa-1590-4db4-85e8-09e998526562,segment=NetworkSegment(ffb67bcc-90c4-4cb0-9cae-d89cd9a71c38),segment_id=ffb67bcc-90c4-4cb0-9cae-d89cd9a71c38)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:36:02.059356 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e5447335-4df2-4d3b-8df4-a3f25acdf8d9 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:02.069853 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-955b4808-41f1-4b5f-84bc-95ccc1f232c9 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:36:02.073225 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ed0ad01b-b9bf-4f28-b293-a70ca8a6f53b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:02.076427 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-955b4808-41f1-4b5f-84bc-95ccc1f232c9 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:36:02.077167 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-e5447335-4df2-4d3b-8df4-a3f25acdf8d9 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Calling delete_port for 96c020fa-1590-4db4-85e8-09e998526562 owned by network:router_interface {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:36:02.078240 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-955b4808-41f1-4b5f-84bc-95ccc1f232c9 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Pushing event updated for resources: {'Port': ['ID=cc2ee892-a7b2-4a88-8885-ead772c3089b,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:02.111372 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-ed0ad01b-b9bf-4f28-b293-a70ca8a6f53b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Calling delete_port for 486ad8d0-0c29-4b59-9a61-d61a75d63b9a owned by network:router_interface {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:36:02.245970 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c33f5a4e-d1c1-413c-92e4-0a652711e23b req-ead0c1b4-ec8c-41aa-9d40-bfeca16cb022 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=8f462374-376b-4c38-b300-528ae5358377 HTTP/1.1" status: 200 len: 210 time: 0.0385704 Nov 09 04:36:02.350245 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e5447335-4df2-4d3b-8df4-a3f25acdf8d9 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:02.377994 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5447335-4df2-4d3b-8df4-a3f25acdf8d9 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event deleted for resources: {'Port': ['ID=96c020fa-1590-4db4-85e8-09e998526562,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:02.502391 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e5447335-4df2-4d3b-8df4-a3f25acdf8d9 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:02.523103 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ed0ad01b-b9bf-4f28-b293-a70ca8a6f53b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:02.608342 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed0ad01b-b9bf-4f28-b293-a70ca8a6f53b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Pushing event deleted for resources: {'Port': ['ID=486ad8d0-0c29-4b59-9a61-d61a75d63b9a,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:02.732320 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e5447335-4df2-4d3b-8df4-a3f25acdf8d9 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Router 7b9a51f0-889c-418d-bc8a-fcfd303c5053 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:36:02.829344 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e5447335-4df2-4d3b-8df4-a3f25acdf8d9 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:36:02.837224 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e5447335-4df2-4d3b-8df4-a3f25acdf8d9 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "PUT /v2.0/routers/7b9a51f0-889c-418d-bc8a-fcfd303c5053/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6804593 Nov 09 04:36:02.837883 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59058) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:02.839931 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-554e169c-8808-4e07-af97-e911db900842 None None] Sync routers for ids ['7b9a51f0-889c-418d-bc8a-fcfd303c5053'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:36:02.851633 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-554e169c-8808-4e07-af97-e911db900842 None None] Routers {'7b9a51f0-889c-418d-bc8a-fcfd303c5053'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:36:02.852660 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-554e169c-8808-4e07-af97-e911db900842 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['7b9a51f0-889c-418d-bc8a-fcfd303c5053'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:02.897049 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-16408829-2d38-485c-8787-2f739f20d3b1 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Deleting subnet 75b6b6c5-0313-4754-bcde-7b2b14023f56 {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:36:02.902696 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-16408829-2d38-485c-8787-2f739f20d3b1 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:02.956413 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-16408829-2d38-485c-8787-2f739f20d3b1 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:03.045911 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-16408829-2d38-485c-8787-2f739f20d3b1 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:03.108609 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-554e169c-8808-4e07-af97-e911db900842 None None] Set router 7b9a51f0-889c-418d-bc8a-fcfd303c5053 gateway port host: None {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:36:03.181725 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-955b4808-41f1-4b5f-84bc-95ccc1f232c9 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:03.184681 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-16408829-2d38-485c-8787-2f739f20d3b1 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:03.222259 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16408829-2d38-485c-8787-2f739f20d3b1 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event deleted for resources: {'Subnet': ['ID=75b6b6c5-0313-4754-bcde-7b2b14023f56,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:03.252980 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-16408829-2d38-485c-8787-2f739f20d3b1 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:03.254429 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e5ffcc9e-2c25-4c4d-a252-a11f51be6f7a None None] Network b93b0577-d21b-4089-8251-c3aac06bdb77 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:36:03.257123 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-16408829-2d38-485c-8787-2f739f20d3b1 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "DELETE /v2.0/subnets/75b6b6c5-0313-4754-bcde-7b2b14023f56 HTTP/1.1" status: 204 len: 168 time: 0.4181662 Nov 09 04:36:03.260019 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59060) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:03.292261 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ed0ad01b-b9bf-4f28-b293-a70ca8a6f53b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:03.316617 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59064) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:03.392216 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5edc9f50-3a1d-41b6-9259-71ca41e6ff38 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:03.407230 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-955b4808-41f1-4b5f-84bc-95ccc1f232c9 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:03.441678 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b208c2e9-759a-4bf3-8235-1444d5ee03c5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:03.468095 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-554e169c-8808-4e07-af97-e911db900842 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'name': 'tempest-RoutersIpV6Test-router-1491329762', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:35:32Z', 'updated_at': '2021-11-09T04:36:02Z', 'revision_number': 9, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'gw_port_host': None, '_interfaces': [{'id': '5a28daa1-7cdd-49a3-aad4-ecd643914dfd', 'name': '', 'network_id': '0c466943-3298-4130-be72-d7c24549bd5d', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:9e:e7:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1206, 'fixed_ips': [{'subnet_id': '0cd8bdb8-1377-46f0-ba25-14251b97253b', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:35Z', 'updated_at': '2021-11-09T04:35:41Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': '0cd8bdb8-1377-46f0-ba25-14251b97253b', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '858eaebe-fdb6-4c5b-ab0f-4d6bd86995d4', 'name': '', 'network_id': '035bc5dd-3c1d-4ced-893c-487b4c0eff40', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:82:b5:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1214, 'fixed_ips': [{'subnet_id': 'b46b8bfd-f2f3-4413-b04c-231ee75f8c2c', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:41Z', 'updated_at': '2021-11-09T04:35:45Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': 'b46b8bfd-f2f3-4413-b04c-231ee75f8c2c', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:03.480203 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b208c2e9-759a-4bf3-8235-1444d5ee03c5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:03.503632 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-554e169c-8808-4e07-af97-e911db900842 None None] Checking router: 7b9a51f0-889c-418d-bc8a-fcfd303c5053 for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:36:03.514958 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-554e169c-8808-4e07-af97-e911db900842 None None] Routers {'7b9a51f0-889c-418d-bc8a-fcfd303c5053'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:36:03.515264 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-554e169c-8808-4e07-af97-e911db900842 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['7b9a51f0-889c-418d-bc8a-fcfd303c5053'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:03.531264 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-5edc9f50-3a1d-41b6-9259-71ca41e6ff38 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Deleting port dd1347f5-81e6-4a8a-9c52-5ab6d8716c4c {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:36:03.531675 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5edc9f50-3a1d-41b6-9259-71ca41e6ff38 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:03.555193 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0e566668-312d-4491-9dea-a8e17c53813a None None] DHCP port deletion for b93b0577-d21b-4089-8251-c3aac06bdb77 request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:36:03.603468 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-5edc9f50-3a1d-41b6-9259-71ca41e6ff38 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] For port dd1347f5-81e6-4a8a-9c52-5ab6d8716c4c, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=dd1347f5-81e6-4a8a-9c52-5ab6d8716c4c,segment=NetworkSegment(ffb67bcc-90c4-4cb0-9cae-d89cd9a71c38),segment_id=ffb67bcc-90c4-4cb0-9cae-d89cd9a71c38)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:36:03.604100 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5edc9f50-3a1d-41b6-9259-71ca41e6ff38 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:03.621098 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-5edc9f50-3a1d-41b6-9259-71ca41e6ff38 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Calling delete_port for dd1347f5-81e6-4a8a-9c52-5ab6d8716c4c owned by network:dhcp {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:36:03.649950 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-554e169c-8808-4e07-af97-e911db900842 None None] Set router 7b9a51f0-889c-418d-bc8a-fcfd303c5053 gateway port host: None {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:36:03.679042 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ed0ad01b-b9bf-4f28-b293-a70ca8a6f53b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Router 8ac82b1e-1b89-49c2-850a-e69a6d1163e6 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:36:03.694838 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-955b4808-41f1-4b5f-84bc-95ccc1f232c9 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:03.750245 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-955b4808-41f1-4b5f-84bc-95ccc1f232c9 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:03.763236 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-0e566668-312d-4491-9dea-a8e17c53813a None None] Deleting port dd1347f5-81e6-4a8a-9c52-5ab6d8716c4c {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:36:03.763720 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0e566668-312d-4491-9dea-a8e17c53813a None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:03.860556 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-955b4808-41f1-4b5f-84bc-95ccc1f232c9 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Pushing event updated for resources: {'Port': ['ID=cc2ee892-a7b2-4a88-8885-ead772c3089b,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:03.876645 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-0e566668-312d-4491-9dea-a8e17c53813a None None] For port dd1347f5-81e6-4a8a-9c52-5ab6d8716c4c, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=dd1347f5-81e6-4a8a-9c52-5ab6d8716c4c,segment=NetworkSegment(ffb67bcc-90c4-4cb0-9cae-d89cd9a71c38),segment_id=ffb67bcc-90c4-4cb0-9cae-d89cd9a71c38)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:36:03.877250 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0e566668-312d-4491-9dea-a8e17c53813a None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:03.888461 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ed0ad01b-b9bf-4f28-b293-a70ca8a6f53b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:36:03.895826 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-ed0ad01b-b9bf-4f28-b293-a70ca8a6f53b tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] 10.222.0.24 "PUT /v2.0/routers/8ac82b1e-1b89-49c2-850a-e69a6d1163e6/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.9078479 Nov 09 04:36:03.898432 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59066) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:03.902897 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0bd27084-65b5-4ded-8ace-a9a55227add1 None None] Sync routers for ids ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:36:03.906113 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-955b4808-41f1-4b5f-84bc-95ccc1f232c9 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:03.921316 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-0e566668-312d-4491-9dea-a8e17c53813a None None] Calling delete_port for dd1347f5-81e6-4a8a-9c52-5ab6d8716c4c owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:36:03.922142 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0bd27084-65b5-4ded-8ace-a9a55227add1 None None] Routers {'8ac82b1e-1b89-49c2-850a-e69a6d1163e6'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:36:03.923667 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-0bd27084-65b5-4ded-8ace-a9a55227add1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:03.984728 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-0bd27084-65b5-4ded-8ace-a9a55227add1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:04.007009 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0bd27084-65b5-4ded-8ace-a9a55227add1 None None] Routers {'8ac82b1e-1b89-49c2-850a-e69a6d1163e6'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:36:04.009648 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-0bd27084-65b5-4ded-8ace-a9a55227add1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:04.011508 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-554e169c-8808-4e07-af97-e911db900842 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'name': 'tempest-RoutersIpV6Test-router-1491329762', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:35:32Z', 'updated_at': '2021-11-09T04:36:02Z', 'revision_number': 9, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'gw_port_host': None, '_interfaces': [{'id': '5a28daa1-7cdd-49a3-aad4-ecd643914dfd', 'name': '', 'network_id': '0c466943-3298-4130-be72-d7c24549bd5d', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:9e:e7:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1206, 'fixed_ips': [{'subnet_id': '0cd8bdb8-1377-46f0-ba25-14251b97253b', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:35Z', 'updated_at': '2021-11-09T04:35:41Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': '0cd8bdb8-1377-46f0-ba25-14251b97253b', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '858eaebe-fdb6-4c5b-ab0f-4d6bd86995d4', 'name': '', 'network_id': '035bc5dd-3c1d-4ced-893c-487b4c0eff40', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:82:b5:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1214, 'fixed_ips': [{'subnet_id': 'b46b8bfd-f2f3-4413-b04c-231ee75f8c2c', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:41Z', 'updated_at': '2021-11-09T04:35:45Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': 'b46b8bfd-f2f3-4413-b04c-231ee75f8c2c', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:04.044133 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-554e169c-8808-4e07-af97-e911db900842 None None] The sync data for ids ['7b9a51f0-889c-418d-bc8a-fcfd303c5053'] in dv-neutron-816802-2-hyperv is: [{'id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'name': 'tempest-RoutersIpV6Test-router-1491329762', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:35:32Z', 'updated_at': '2021-11-09T04:36:02Z', 'revision_number': 9, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'gw_port_host': None, '_interfaces': [{'id': '5a28daa1-7cdd-49a3-aad4-ecd643914dfd', 'name': '', 'network_id': '0c466943-3298-4130-be72-d7c24549bd5d', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:9e:e7:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1206, 'fixed_ips': [{'subnet_id': '0cd8bdb8-1377-46f0-ba25-14251b97253b', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:35Z', 'updated_at': '2021-11-09T04:35:41Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': '0cd8bdb8-1377-46f0-ba25-14251b97253b', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '858eaebe-fdb6-4c5b-ab0f-4d6bd86995d4', 'name': '', 'network_id': '035bc5dd-3c1d-4ced-893c-487b4c0eff40', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:82:b5:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1214, 'fixed_ips': [{'subnet_id': 'b46b8bfd-f2f3-4413-b04c-231ee75f8c2c', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:41Z', 'updated_at': '2021-11-09T04:35:45Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': 'b46b8bfd-f2f3-4413-b04c-231ee75f8c2c', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:36:04.050539 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b208c2e9-759a-4bf3-8235-1444d5ee03c5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:04.057665 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b208c2e9-759a-4bf3-8235-1444d5ee03c5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:04.058836 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-b208c2e9-759a-4bf3-8235-1444d5ee03c5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "DELETE /v2.0/security-groups/99157167-0266-49ff-809e-cf8a91af8ae5 HTTP/1.1" status: 204 len: 168 time: 0.7414126 Nov 09 04:36:04.073587 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-0bd27084-65b5-4ded-8ace-a9a55227add1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:04.074400 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0bd27084-65b5-4ded-8ace-a9a55227add1 None None] The sync data for ids ['8ac82b1e-1b89-49c2-850a-e69a6d1163e6'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:36:04.078617 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b208c2e9-759a-4bf3-8235-1444d5ee03c5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=99157167-0266-49ff-809e-cf8a91af8ae5,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:04.098529 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cd9cb789-af9e-4b1d-8942-877fae0e9ef0 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for router, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:04.121171 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0e566668-312d-4491-9dea-a8e17c53813a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:04.128058 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5edc9f50-3a1d-41b6-9259-71ca41e6ff38 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:04.150483 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e566668-312d-4491-9dea-a8e17c53813a None None] Pushing event deleted for resources: {'Port': ['ID=dd1347f5-81e6-4a8a-9c52-5ab6d8716c4c,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:04.153289 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0e566668-312d-4491-9dea-a8e17c53813a None None] No DVR routers for this DVR port dd1347f5-81e6-4a8a-9c52-5ab6d8716c4c on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:36:04.160864 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.l3_db [None req-955b4808-41f1-4b5f-84bc-95ccc1f232c9 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Floating IP cb72ed5d-dc68-4e13-9938-c58a0418642e associated. External IP: 172.26.0.190, port: d4753771-ff46-428e-9ad0-3dce1a15a45f. Nov 09 04:36:04.167187 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5edc9f50-3a1d-41b6-9259-71ca41e6ff38 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event deleted for resources: {'Port': ['ID=dd1347f5-81e6-4a8a-9c52-5ab6d8716c4c,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:04.168960 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5edc9f50-3a1d-41b6-9259-71ca41e6ff38 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] No DVR routers for this DVR port dd1347f5-81e6-4a8a-9c52-5ab6d8716c4c on host dv-neutron-816802-2-hyperv {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:36:04.192193 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59070) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:04.292965 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5edc9f50-3a1d-41b6-9259-71ca41e6ff38 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:04.298789 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cd9cb789-af9e-4b1d-8942-877fae0e9ef0 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for router_gateway, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:04.345936 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-5edc9f50-3a1d-41b6-9259-71ca41e6ff38 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b93b0577-d21b-4089-8251-c3aac06bdb77']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:04.362255 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-5edc9f50-3a1d-41b6-9259-71ca41e6ff38 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ffb67bcc-90c4-4cb0-9cae-d89cd9a71c38') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:04.362525 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-5edc9f50-3a1d-41b6-9259-71ca41e6ff38 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ffb67bcc-90c4-4cb0-9cae-d89cd9a71c38') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:04.375196 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5edc9f50-3a1d-41b6-9259-71ca41e6ff38 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:04.428487 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5edc9f50-3a1d-41b6-9259-71ca41e6ff38 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:04.445724 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5edc9f50-3a1d-41b6-9259-71ca41e6ff38 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Releasing vlan 309 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:36:04.445724 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5edc9f50-3a1d-41b6-9259-71ca41e6ff38 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:04.445724 dv-neutron-816802-2-hyperv neutron-server[102162]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:36:04.445724 dv-neutron-816802-2-hyperv neutron-server[102162]: self.session.flush() Nov 09 04:36:04.445724 dv-neutron-816802-2-hyperv neutron-server[102162]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:36:04.445724 dv-neutron-816802-2-hyperv neutron-server[102162]: self.session.flush() Nov 09 04:36:04.445724 dv-neutron-816802-2-hyperv neutron-server[102162]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:36:04.445724 dv-neutron-816802-2-hyperv neutron-server[102162]: self.session.flush() Nov 09 04:36:04.445724 dv-neutron-816802-2-hyperv neutron-server[102162]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 04:36:04.445724 dv-neutron-816802-2-hyperv neutron-server[102162]: self.session.flush() Nov 09 04:36:04.445724 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:36:04.445724 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:36:04.445724 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:36:04.445724 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:36:04.445724 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:36:04.445724 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:36:04.445724 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:36:04.445724 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:36:04.445724 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:36:04.445724 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:36:04.445724 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:36:04.445724 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:36:04.445724 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:36:04.445724 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:36:04.445724 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:36:04.445724 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:36:04.445724 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:36:04.445724 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:36:04.445724 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:36:04.445724 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:36:04.445724 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:36:04.445724 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:36:04.445724 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:36:04.445724 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:36:04.445724 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:36:04.445724 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:36:04.445724 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:36:04.445724 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:36:04.445724 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:36:04.445724 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:36:04.445724 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:36:04.445724 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:36:04.456417 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-955b4808-41f1-4b5f-84bc-95ccc1f232c9 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Router 203a01a6-369d-4e73-a6d0-b0605f8d5a6a has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:36:04.470644 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-cd9cb789-af9e-4b1d-8942-877fae0e9ef0 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Deleting port 5d1d8f8c-5025-4978-9518-9a8c1d221281 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:36:04.471083 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cd9cb789-af9e-4b1d-8942-877fae0e9ef0 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:04.629705 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cd9cb789-af9e-4b1d-8942-877fae0e9ef0 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:04.636382 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5edc9f50-3a1d-41b6-9259-71ca41e6ff38 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:04.643877 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5edc9f50-3a1d-41b6-9259-71ca41e6ff38 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:04.647126 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-5edc9f50-3a1d-41b6-9259-71ca41e6ff38 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "DELETE /v2.0/networks/b93b0577-d21b-4089-8251-c3aac06bdb77 HTTP/1.1" status: 204 len: 168 time: 1.3855493 Nov 09 04:36:04.650943 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59072) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:04.653102 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 09cbfb91-4118-43af-8b70-41d8d4265574 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:36:04.659451 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-cd9cb789-af9e-4b1d-8942-877fae0e9ef0 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Calling delete_port for 5d1d8f8c-5025-4978-9518-9a8c1d221281 owned by network:router_gateway {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:36:04.666924 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-955b4808-41f1-4b5f-84bc-95ccc1f232c9 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:36:04.668125 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5edc9f50-3a1d-41b6-9259-71ca41e6ff38 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event deleted for resources: {'Network': ['ID=b93b0577-d21b-4089-8251-c3aac06bdb77,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:04.695213 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c808ac12-a64e-4ff8-aff6-da7090564670 None None] Sync routers for ids ['203a01a6-369d-4e73-a6d0-b0605f8d5a6a'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:36:04.699995 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] No Port match for: 09cbfb91-4118-43af-8b70-41d8d4265574 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:36:04.700438 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 09cbfb91-4118-43af-8b70-41d8d4265574 not bound to the agent host hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:36:04.714938 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c808ac12-a64e-4ff8-aff6-da7090564670 None None] Routers {'203a01a6-369d-4e73-a6d0-b0605f8d5a6a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:36:04.715588 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-c808ac12-a64e-4ff8-aff6-da7090564670 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['203a01a6-369d-4e73-a6d0-b0605f8d5a6a'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:04.792507 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-955b4808-41f1-4b5f-84bc-95ccc1f232c9 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:04.828113 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-c808ac12-a64e-4ff8-aff6-da7090564670 None None] Set router 203a01a6-369d-4e73-a6d0-b0605f8d5a6a gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:36:04.845901 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-955b4808-41f1-4b5f-84bc-95ccc1f232c9 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 3.7037463 Nov 09 04:36:04.850712 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f0ae9486-80b5-43bd-acec-49f871c00e67', 'tag': 'd4753771-ff46-428e-9ad0-3dce1a15a45f'}] {{(pid=102161) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:36:04.854516 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}99dfdda0def497b4372884ef2eb87f06b1e425c8eba5ceda5f64bbab037a07d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9808acff-e373-49b5-8501-e59ced9df804" -d '{"events": [{"name": "network-changed", "server_uuid": "f0ae9486-80b5-43bd-acec-49f871c00e67", "tag": "d4753771-ff46-428e-9ad0-3dce1a15a45f"}]}' {{(pid=102161) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:36:04.896630 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-820cca9f-19cc-46c3-80fa-6b69229cbd9c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:04.901990 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:36:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3bef19ef-b1d8-4948-8e6b-604cc45d9a70 x-openstack-request-id: req-3bef19ef-b1d8-4948-8e6b-604cc45d9a70 {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:36:04.902283 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f0ae9486-80b5-43bd-acec-49f871c00e67", "tag": "d4753771-ff46-428e-9ad0-3dce1a15a45f", "status": "completed", "code": 200}]} {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:36:04.902607 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-3bef19ef-b1d8-4948-8e6b-604cc45d9a70 {{(pid=102161) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:36:04.903175 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f0ae9486-80b5-43bd-acec-49f871c00e67', 'tag': 'd4753771-ff46-428e-9ad0-3dce1a15a45f', 'status': 'completed', 'code': 200} Nov 09 04:36:04.990111 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cd9cb789-af9e-4b1d-8942-877fae0e9ef0 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:05.021728 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd9cb789-af9e-4b1d-8942-877fae0e9ef0 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Pushing event deleted for resources: {'Port': ['ID=5d1d8f8c-5025-4978-9518-9a8c1d221281,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:05.083817 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9808acff-e373-49b5-8501-e59ced9df804 req-e3c286ec-d13b-4ca3-bb77-5f782e0e06e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:36:05.085389 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9808acff-e373-49b5-8501-e59ced9df804 req-e3c286ec-d13b-4ca3-bb77-5f782e0e06e4 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=f636e5f4c9f64f69ba3b2ab8816b6096&device_id=f0ae9486-80b5-43bd-acec-49f871c00e67 HTTP/1.1" status: 200 len: 1098 time: 0.1515331 Nov 09 04:36:05.092624 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-c808ac12-a64e-4ff8-aff6-da7090564670 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'name': 'tempest-TestVolumeBootPattern-1675179943-router', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.164'}], 'enable_snat': True}, 'gw_port_id': '873960f9-e8b5-48a6-a119-47c32f5b7968', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:34:33Z', 'updated_at': '2021-11-09T04:34:38Z', 'revision_number': 4, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'gw_port': {'id': '873960f9-e8b5-48a6-a119-47c32f5b7968', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:95:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1097, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.164', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:34:34Z', 'updated_at': '2021-11-09T04:34:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': 'cb72ed5d-dc68-4e13-9938-c58a0418642e', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'floating_ip_address': '172.26.0.190', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'port_id': 'd4753771-ff46-428e-9ad0-3dce1a15a45f', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 1227, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf', 'mac_address': 'fa:16:3e:91:66:c7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0ae9486-80b5-43bd-acec-49f871c00e67', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:36:02Z', 'updated_at': '2021-11-09T04:36:02Z', 'revision_number': 0, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a5f1e54d-1d98-4741-a1ce-59f4cfb5b332', 'name': '', 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'mac_address': 'fa:16:3e:de:ab:2f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1107, 'fixed_ips': [{'subnet_id': 'f6a08667-654b-4e0c-9f85-c6e6712cc239', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:34:37Z', 'updated_at': '2021-11-09T04:34:46Z', 'revision_number': 5, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'subnets': [{'id': 'f6a08667-654b-4e0c-9f85-c6e6712cc239', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:05.096160 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cd9cb789-af9e-4b1d-8942-877fae0e9ef0 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-466373'] for router_gateway, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:05.124022 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c808ac12-a64e-4ff8-aff6-da7090564670 None None] Checking router: 203a01a6-369d-4e73-a6d0-b0605f8d5a6a for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:36:05.132579 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c808ac12-a64e-4ff8-aff6-da7090564670 None None] Routers {'203a01a6-369d-4e73-a6d0-b0605f8d5a6a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:36:05.133182 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-c808ac12-a64e-4ff8-aff6-da7090564670 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['203a01a6-369d-4e73-a6d0-b0605f8d5a6a'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:05.196148 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cd9cb789-af9e-4b1d-8942-877fae0e9ef0 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:05.199422 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cd9cb789-af9e-4b1d-8942-877fae0e9ef0 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:05.265223 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9808acff-e373-49b5-8501-e59ced9df804 req-f42cb437-407d-435a-81fe-ef5f2536c2f5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:36:05.266781 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9808acff-e373-49b5-8501-e59ced9df804 req-f42cb437-407d-435a-81fe-ef5f2536c2f5 service neutron] 10.222.0.26 "GET /v2.0/networks?id=999b1b20-f8fc-4caf-84cc-3feda426a0bf HTTP/1.1" status: 200 len: 913 time: 0.1733861 Nov 09 04:36:05.315399 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cd9cb789-af9e-4b1d-8942-877fae0e9ef0 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:05.316627 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cd9cb789-af9e-4b1d-8942-877fae0e9ef0 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Fanout notify agent at l3_agent the message router_deleted on router 8ac82b1e-1b89-49c2-850a-e69a6d1163e6 {{(pid=102161) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:36:05.324554 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cd9cb789-af9e-4b1d-8942-877fae0e9ef0 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:05.325786 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-cd9cb789-af9e-4b1d-8942-877fae0e9ef0 tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] 10.222.0.24 "DELETE /v2.0/routers/8ac82b1e-1b89-49c2-850a-e69a6d1163e6 HTTP/1.1" status: 204 len: 168 time: 1.4262497 Nov 09 04:36:05.328302 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59078) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:05.382421 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-b2f54ec0-8e7c-4a2b-be81-76fcb6d2d80e tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Deleting subnet 55684bb6-5188-4ce7-a4cb-155a73eeeeeb {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:36:05.386029 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b2f54ec0-8e7c-4a2b-be81-76fcb6d2d80e tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:05.394285 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9808acff-e373-49b5-8501-e59ced9df804 req-79f96fbc-18d8-409e-87a6-ce7480e8cf91 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=d4753771-ff46-428e-9ad0-3dce1a15a45f HTTP/1.1" status: 200 len: 999 time: 0.1018851 Nov 09 04:36:05.394556 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device dd1347f5-81e6-4a8a-9c52-5ab6d8716c4c no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:36:05.420763 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: dd1347f5-81e6-4a8a-9c52-5ab6d8716c4c {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:36:05.421653 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device dd1347f5-81e6-4a8a-9c52-5ab6d8716c4c not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:36:05.421653 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 96c020fa-1590-4db4-85e8-09e998526562 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:36:05.426471 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b2f54ec0-8e7c-4a2b-be81-76fcb6d2d80e tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:05.449705 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 96c020fa-1590-4db4-85e8-09e998526562 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:36:05.449953 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 96c020fa-1590-4db4-85e8-09e998526562 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:36:05.455921 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-664e2dec-51ab-4048-a6af-ef24166b0bf5 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:05.461032 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-c808ac12-a64e-4ff8-aff6-da7090564670 None None] Set router 203a01a6-369d-4e73-a6d0-b0605f8d5a6a gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:36:05.481573 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b2f54ec0-8e7c-4a2b-be81-76fcb6d2d80e tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:05.547629 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9808acff-e373-49b5-8501-e59ced9df804 req-cf2e5c2a-d787-471d-87f5-fe2d95998a7c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:36:05.549147 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9808acff-e373-49b5-8501-e59ced9df804 req-cf2e5c2a-d787-471d-87f5-fe2d95998a7c service neutron] 10.222.0.26 "GET /v2.0/subnets?id=f6a08667-654b-4e0c-9f85-c6e6712cc239 HTTP/1.1" status: 200 len: 851 time: 0.1290877 Nov 09 04:36:05.595059 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-820cca9f-19cc-46c3-80fa-6b69229cbd9c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Deleting port 9930d582-2262-4f1d-97bf-b02697a70777 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:36:05.595388 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-820cca9f-19cc-46c3-80fa-6b69229cbd9c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:05.613882 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b2f54ec0-8e7c-4a2b-be81-76fcb6d2d80e tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:05.642793 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2f54ec0-8e7c-4a2b-be81-76fcb6d2d80e tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Pushing event deleted for resources: {'Subnet': ['ID=55684bb6-5188-4ce7-a4cb-155a73eeeeeb,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:05.649202 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b2f54ec0-8e7c-4a2b-be81-76fcb6d2d80e tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:05.656676 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59080) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:05.657917 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-b2f54ec0-8e7c-4a2b-be81-76fcb6d2d80e tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] 10.222.0.24 "DELETE /v2.0/subnets/55684bb6-5188-4ce7-a4cb-155a73eeeeeb HTTP/1.1" status: 204 len: 168 time: 0.3282869 Nov 09 04:36:05.697043 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-c808ac12-a64e-4ff8-aff6-da7090564670 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'name': 'tempest-TestVolumeBootPattern-1675179943-router', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.164'}], 'enable_snat': True}, 'gw_port_id': '873960f9-e8b5-48a6-a119-47c32f5b7968', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:34:33Z', 'updated_at': '2021-11-09T04:34:38Z', 'revision_number': 4, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'gw_port': {'id': '873960f9-e8b5-48a6-a119-47c32f5b7968', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:95:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1097, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.164', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:34:34Z', 'updated_at': '2021-11-09T04:34:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': 'cb72ed5d-dc68-4e13-9938-c58a0418642e', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'floating_ip_address': '172.26.0.190', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'port_id': 'd4753771-ff46-428e-9ad0-3dce1a15a45f', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 1227, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf', 'mac_address': 'fa:16:3e:91:66:c7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0ae9486-80b5-43bd-acec-49f871c00e67', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:36:02Z', 'updated_at': '2021-11-09T04:36:02Z', 'revision_number': 0, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a5f1e54d-1d98-4741-a1ce-59f4cfb5b332', 'name': '', 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'mac_address': 'fa:16:3e:de:ab:2f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1107, 'fixed_ips': [{'subnet_id': 'f6a08667-654b-4e0c-9f85-c6e6712cc239', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:34:37Z', 'updated_at': '2021-11-09T04:34:46Z', 'revision_number': 5, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'subnets': [{'id': 'f6a08667-654b-4e0c-9f85-c6e6712cc239', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:05.724415 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c808ac12-a64e-4ff8-aff6-da7090564670 None None] The sync data for ids ['203a01a6-369d-4e73-a6d0-b0605f8d5a6a'] in dv-neutron-816802-2-hyperv is: [{'id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'name': 'tempest-TestVolumeBootPattern-1675179943-router', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.164'}], 'enable_snat': True}, 'gw_port_id': '873960f9-e8b5-48a6-a119-47c32f5b7968', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:34:33Z', 'updated_at': '2021-11-09T04:34:38Z', 'revision_number': 4, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'gw_port': {'id': '873960f9-e8b5-48a6-a119-47c32f5b7968', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:95:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1097, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.164', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:34:34Z', 'updated_at': '2021-11-09T04:34:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': 'cb72ed5d-dc68-4e13-9938-c58a0418642e', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'floating_ip_address': '172.26.0.190', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'port_id': 'd4753771-ff46-428e-9ad0-3dce1a15a45f', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 1227, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf', 'mac_address': 'fa:16:3e:91:66:c7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0ae9486-80b5-43bd-acec-49f871c00e67', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:36:02Z', 'updated_at': '2021-11-09T04:36:02Z', 'revision_number': 0, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a5f1e54d-1d98-4741-a1ce-59f4cfb5b332', 'name': '', 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'mac_address': 'fa:16:3e:de:ab:2f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1107, 'fixed_ips': [{'subnet_id': 'f6a08667-654b-4e0c-9f85-c6e6712cc239', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:34:37Z', 'updated_at': '2021-11-09T04:34:46Z', 'revision_number': 5, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'subnets': [{'id': 'f6a08667-654b-4e0c-9f85-c6e6712cc239', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:36:05.781724 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9808acff-e373-49b5-8501-e59ced9df804 req-8496c5ec-cb0d-4bf6-8d2a-9ef3e2cbbd49 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:36:05.783311 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9808acff-e373-49b5-8501-e59ced9df804 req-8496c5ec-cb0d-4bf6-8d2a-9ef3e2cbbd49 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=999b1b20-f8fc-4caf-84cc-3feda426a0bf&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.2266314 Nov 09 04:36:05.844758 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9c667426-b07e-4ef8-b9ce-1cd48cf4a8fb tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:05.854544 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-820cca9f-19cc-46c3-80fa-6b69229cbd9c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] For port 9930d582-2262-4f1d-97bf-b02697a70777, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=9930d582-2262-4f1d-97bf-b02697a70777,segment=NetworkSegment(7befff96-69ce-4b76-b9cc-7561279d57a7),segment_id=7befff96-69ce-4b76-b9cc-7561279d57a7)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:36:05.854907 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-820cca9f-19cc-46c3-80fa-6b69229cbd9c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:05.909016 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-820cca9f-19cc-46c3-80fa-6b69229cbd9c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Calling delete_port for 9930d582-2262-4f1d-97bf-b02697a70777 owned by network:router_interface {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:36:05.956992 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-427649bc-8b8b-4624-9a64-48b6a8af3c8d None None] New status for floating IP cb72ed5d-dc68-4e13-9938-c58a0418642e: ACTIVE {{(pid=102164) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 04:36:06.031238 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9808acff-e373-49b5-8501-e59ced9df804 req-a642fcd7-94c0-4399-acef-7d3f4d8c9d63 service neutron] 10.222.0.26 "GET /v2.0/networks/999b1b20-f8fc-4caf-84cc-3feda426a0bf?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2378786 Nov 09 04:36:06.111610 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9c667426-b07e-4ef8-b9ce-1cd48cf4a8fb tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:06.209487 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-9c667426-b07e-4ef8-b9ce-1cd48cf4a8fb tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7b6ec8a7-3152-4a6b-88b2-1b5105cc3943']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:06.242282 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-9c667426-b07e-4ef8-b9ce-1cd48cf4a8fb tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '96c18096-17d2-496d-a53c-09ea4b2aa359') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:06.242615 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-9c667426-b07e-4ef8-b9ce-1cd48cf4a8fb tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '96c18096-17d2-496d-a53c-09ea4b2aa359') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:06.263726 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9c667426-b07e-4ef8-b9ce-1cd48cf4a8fb tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:06.285627 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9c667426-b07e-4ef8-b9ce-1cd48cf4a8fb tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:06.312978 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9c667426-b07e-4ef8-b9ce-1cd48cf4a8fb tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Releasing vlan 308 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:36:06.313373 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9c667426-b07e-4ef8-b9ce-1cd48cf4a8fb tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:06.318275 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:36:06.318275 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:36:06.318275 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:36:06.318275 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:36:06.318275 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:36:06.318275 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:36:06.318275 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:36:06.318275 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:36:06.318275 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:36:06.318275 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:36:06.318275 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:36:06.318275 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:36:06.318275 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:36:06.318275 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:36:06.318275 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:36:06.318275 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:36:06.318275 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:36:06.318275 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:36:06.318275 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:36:06.318275 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:36:06.318275 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:36:06.318275 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:36:06.318275 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:36:06.318275 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:36:06.318275 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:36:06.318275 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:36:06.318275 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:36:06.318275 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:36:06.318275 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:36:06.318275 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:36:06.318275 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:36:06.318275 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:36:06.331332 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9808acff-e373-49b5-8501-e59ced9df804 req-824481f6-da02-44ad-b7c3-6914ac2e3c20 service neutron] 10.222.0.26 "GET /v2.0/networks/999b1b20-f8fc-4caf-84cc-3feda426a0bf?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2913024 Nov 09 04:36:06.706941 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-664e2dec-51ab-4048-a6af-ef24166b0bf5 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Deleting port 858eaebe-fdb6-4c5b-ab0f-4d6bd86995d4 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:36:06.707651 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-664e2dec-51ab-4048-a6af-ef24166b0bf5 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:06.787177 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9c667426-b07e-4ef8-b9ce-1cd48cf4a8fb tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:06.800514 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9c667426-b07e-4ef8-b9ce-1cd48cf4a8fb tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:06.803638 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-9c667426-b07e-4ef8-b9ce-1cd48cf4a8fb tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] 10.222.0.24 "DELETE /v2.0/networks/7b6ec8a7-3152-4a6b-88b2-1b5105cc3943 HTTP/1.1" status: 204 len: 168 time: 1.1453378 Nov 09 04:36:06.824983 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c667426-b07e-4ef8-b9ce-1cd48cf4a8fb tempest-FloatingIPTestJSON-1786808648 tempest-FloatingIPTestJSON-1786808648-project] Pushing event deleted for resources: {'Network': ['ID=7b6ec8a7-3152-4a6b-88b2-1b5105cc3943,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:06.851244 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-664e2dec-51ab-4048-a6af-ef24166b0bf5 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] For port 858eaebe-fdb6-4c5b-ab0f-4d6bd86995d4, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=858eaebe-fdb6-4c5b-ab0f-4d6bd86995d4,segment=NetworkSegment(3924cc51-1cb6-447f-9de3-d105512d807f),segment_id=3924cc51-1cb6-447f-9de3-d105512d807f)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:36:06.851618 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-664e2dec-51ab-4048-a6af-ef24166b0bf5 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:06.866156 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-664e2dec-51ab-4048-a6af-ef24166b0bf5 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Calling delete_port for 858eaebe-fdb6-4c5b-ab0f-4d6bd86995d4 owned by network:router_interface {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:36:06.877090 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-820cca9f-19cc-46c3-80fa-6b69229cbd9c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:06.930729 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-820cca9f-19cc-46c3-80fa-6b69229cbd9c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'Port': ['ID=9930d582-2262-4f1d-97bf-b02697a70777,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:07.210265 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-820cca9f-19cc-46c3-80fa-6b69229cbd9c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:07.262722 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59086) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:07.271250 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-664e2dec-51ab-4048-a6af-ef24166b0bf5 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:07.343680 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-664e2dec-51ab-4048-a6af-ef24166b0bf5 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event deleted for resources: {'Port': ['ID=858eaebe-fdb6-4c5b-ab0f-4d6bd86995d4,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:07.398899 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-41c58168-9239-4014-ac42-2819e4b1fd27 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=459651e5af964f8c805d518a6dc3b464&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1338253 Nov 09 04:36:07.400247 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59090) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:07.452165 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-10bb89a1-b59c-452c-b8da-3fbf2dc1991a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:07.479708 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-10bb89a1-b59c-452c-b8da-3fbf2dc1991a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:07.502973 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-664e2dec-51ab-4048-a6af-ef24166b0bf5 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:07.613114 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-10bb89a1-b59c-452c-b8da-3fbf2dc1991a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:07.615840 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-10bb89a1-b59c-452c-b8da-3fbf2dc1991a admin admin] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:07.620076 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-10bb89a1-b59c-452c-b8da-3fbf2dc1991a admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/c8e52f3a-af25-496a-a874-97ea6dc74593 HTTP/1.1" status: 204 len: 168 time: 0.2154667 Nov 09 04:36:07.629251 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10bb89a1-b59c-452c-b8da-3fbf2dc1991a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c8e52f3a-af25-496a-a874-97ea6dc74593,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:07.696952 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-820cca9f-19cc-46c3-80fa-6b69229cbd9c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Router d05416c2-0293-4ef5-a6e3-5968392cc774 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:36:07.804376 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-664e2dec-51ab-4048-a6af-ef24166b0bf5 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Router 7b9a51f0-889c-418d-bc8a-fcfd303c5053 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:36:07.858234 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-820cca9f-19cc-46c3-80fa-6b69229cbd9c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:36:07.868979 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-79937169-00ba-4558-b6d8-ad6aa9915ecb None None] Sync routers for ids ['d05416c2-0293-4ef5-a6e3-5968392cc774'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:36:07.879185 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-79937169-00ba-4558-b6d8-ad6aa9915ecb None None] Routers {'d05416c2-0293-4ef5-a6e3-5968392cc774'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:36:07.879814 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-79937169-00ba-4558-b6d8-ad6aa9915ecb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['d05416c2-0293-4ef5-a6e3-5968392cc774'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:07.895113 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-820cca9f-19cc-46c3-80fa-6b69229cbd9c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "PUT /v2.0/routers/d05416c2-0293-4ef5-a6e3-5968392cc774/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.7018926 Nov 09 04:36:07.897968 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59096) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:07.955886 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-f362c18d-cc4c-45e0-85b3-17e1a361efe4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Deleting subnet 33b5599d-7ebe-4564-9c72-76f5d540fd80 {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:36:07.959141 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f362c18d-cc4c-45e0-85b3-17e1a361efe4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:07.959723 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-664e2dec-51ab-4048-a6af-ef24166b0bf5 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:36:07.970880 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-664e2dec-51ab-4048-a6af-ef24166b0bf5 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "PUT /v2.0/routers/7b9a51f0-889c-418d-bc8a-fcfd303c5053/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.3098547 Nov 09 04:36:07.971656 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59098) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:07.973993 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cde33512-34a3-4a44-9d7c-4c0ff251aac0 None None] Sync routers for ids ['7b9a51f0-889c-418d-bc8a-fcfd303c5053'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:36:07.989891 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cde33512-34a3-4a44-9d7c-4c0ff251aac0 None None] Routers {'7b9a51f0-889c-418d-bc8a-fcfd303c5053'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:36:07.990780 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-cde33512-34a3-4a44-9d7c-4c0ff251aac0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['7b9a51f0-889c-418d-bc8a-fcfd303c5053'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:08.009666 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-79937169-00ba-4558-b6d8-ad6aa9915ecb None None] Set router d05416c2-0293-4ef5-a6e3-5968392cc774 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:36:08.041918 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-081eceb4-0a9e-49ee-8a36-6dd068b6c591 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Deleting subnet b46b8bfd-f2f3-4413-b04c-231ee75f8c2c {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:36:08.046053 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-081eceb4-0a9e-49ee-8a36-6dd068b6c591 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:08.062968 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f362c18d-cc4c-45e0-85b3-17e1a361efe4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:08.096926 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-cde33512-34a3-4a44-9d7c-4c0ff251aac0 None None] Set router 7b9a51f0-889c-418d-bc8a-fcfd303c5053 gateway port host: None {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:36:08.101989 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-081eceb4-0a9e-49ee-8a36-6dd068b6c591 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:08.223028 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f362c18d-cc4c-45e0-85b3-17e1a361efe4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:08.265715 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-79937169-00ba-4558-b6d8-ad6aa9915ecb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'name': 'tempest-TestNetworkBasicOps-router-1967773701', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.204'}], 'enable_snat': True}, 'gw_port_id': '49bff53a-c208-4aa5-8fcc-e7ec9471fae7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:33:32Z', 'updated_at': '2021-11-09T04:36:06Z', 'revision_number': 7, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '49bff53a-c208-4aa5-8fcc-e7ec9471fae7', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:85:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'device_owner': 'network:router_gateway', 'standard_attr_id': 978, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.204', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:33:34Z', 'updated_at': '2021-11-09T04:33:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:08.273635 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-081eceb4-0a9e-49ee-8a36-6dd068b6c591 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:08.303206 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-79937169-00ba-4558-b6d8-ad6aa9915ecb None None] Checking router: d05416c2-0293-4ef5-a6e3-5968392cc774 for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:36:08.314091 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-79937169-00ba-4558-b6d8-ad6aa9915ecb None None] Routers {'d05416c2-0293-4ef5-a6e3-5968392cc774'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:36:08.314925 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-79937169-00ba-4558-b6d8-ad6aa9915ecb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['d05416c2-0293-4ef5-a6e3-5968392cc774'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:08.390318 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f362c18d-cc4c-45e0-85b3-17e1a361efe4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:08.419376 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f362c18d-cc4c-45e0-85b3-17e1a361efe4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'Subnet': ['ID=33b5599d-7ebe-4564-9c72-76f5d540fd80,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:08.423122 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f362c18d-cc4c-45e0-85b3-17e1a361efe4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:08.426468 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-f362c18d-cc4c-45e0-85b3-17e1a361efe4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "DELETE /v2.0/subnets/33b5599d-7ebe-4564-9c72-76f5d540fd80 HTTP/1.1" status: 204 len: 168 time: 0.5274403 Nov 09 04:36:08.429324 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59108) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:08.435488 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-79937169-00ba-4558-b6d8-ad6aa9915ecb None None] Set router d05416c2-0293-4ef5-a6e3-5968392cc774 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:36:08.438588 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-081eceb4-0a9e-49ee-8a36-6dd068b6c591 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:08.442718 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b90e35fb-2ca4-4623-8c82-4e7a25f3f294 None None] Network 239a9c72-6384-4d5a-a69d-f4ac0c580e40 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:36:08.442877 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-cde33512-34a3-4a44-9d7c-4c0ff251aac0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'name': 'tempest-RoutersIpV6Test-router-1491329762', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:35:32Z', 'updated_at': '2021-11-09T04:36:07Z', 'revision_number': 10, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'gw_port_host': None, '_interfaces': [{'id': '5a28daa1-7cdd-49a3-aad4-ecd643914dfd', 'name': '', 'network_id': '0c466943-3298-4130-be72-d7c24549bd5d', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:9e:e7:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1206, 'fixed_ips': [{'subnet_id': '0cd8bdb8-1377-46f0-ba25-14251b97253b', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:35Z', 'updated_at': '2021-11-09T04:35:41Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': '0cd8bdb8-1377-46f0-ba25-14251b97253b', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:08.475469 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cde33512-34a3-4a44-9d7c-4c0ff251aac0 None None] Checking router: 7b9a51f0-889c-418d-bc8a-fcfd303c5053 for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:36:08.487318 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cde33512-34a3-4a44-9d7c-4c0ff251aac0 None None] Routers {'7b9a51f0-889c-418d-bc8a-fcfd303c5053'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:36:08.488199 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-cde33512-34a3-4a44-9d7c-4c0ff251aac0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['7b9a51f0-889c-418d-bc8a-fcfd303c5053'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:08.493303 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-081eceb4-0a9e-49ee-8a36-6dd068b6c591 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:08.499193 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-081eceb4-0a9e-49ee-8a36-6dd068b6c591 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "DELETE /v2.0/subnets/b46b8bfd-f2f3-4413-b04c-231ee75f8c2c HTTP/1.1" status: 204 len: 168 time: 0.5254867 Nov 09 04:36:08.500513 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-081eceb4-0a9e-49ee-8a36-6dd068b6c591 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event deleted for resources: {'Subnet': ['ID=b46b8bfd-f2f3-4413-b04c-231ee75f8c2c,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:08.502976 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59112) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:08.541940 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2e0fb21e-bf22-4f11-9e2a-4782fb907980 None None] Network 035bc5dd-3c1d-4ced-893c-487b4c0eff40 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:36:08.597871 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2d168f04-8e0d-4079-ae76-ed079f0fb71c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:08.604935 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7acecef2-9d85-4a52-8c6c-cac3c72a6103 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:08.668702 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-2d168f04-8e0d-4079-ae76-ed079f0fb71c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Deleting port 30ff8933-6aad-4f21-a11e-23a4dd69e54e {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:36:08.669040 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2d168f04-8e0d-4079-ae76-ed079f0fb71c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:08.672514 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-cde33512-34a3-4a44-9d7c-4c0ff251aac0 None None] Set router 7b9a51f0-889c-418d-bc8a-fcfd303c5053 gateway port host: None {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:36:08.750399 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-2d168f04-8e0d-4079-ae76-ed079f0fb71c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] For port 30ff8933-6aad-4f21-a11e-23a4dd69e54e, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=30ff8933-6aad-4f21-a11e-23a4dd69e54e,segment=NetworkSegment(3924cc51-1cb6-447f-9de3-d105512d807f),segment_id=3924cc51-1cb6-447f-9de3-d105512d807f)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:36:08.750978 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2d168f04-8e0d-4079-ae76-ed079f0fb71c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:08.783688 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-2d168f04-8e0d-4079-ae76-ed079f0fb71c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Calling delete_port for 30ff8933-6aad-4f21-a11e-23a4dd69e54e owned by network:dhcp {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:36:08.891559 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-cde33512-34a3-4a44-9d7c-4c0ff251aac0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'name': 'tempest-RoutersIpV6Test-router-1491329762', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:35:32Z', 'updated_at': '2021-11-09T04:36:07Z', 'revision_number': 10, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'gw_port_host': None, '_interfaces': [{'id': '5a28daa1-7cdd-49a3-aad4-ecd643914dfd', 'name': '', 'network_id': '0c466943-3298-4130-be72-d7c24549bd5d', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:9e:e7:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1206, 'fixed_ips': [{'subnet_id': '0cd8bdb8-1377-46f0-ba25-14251b97253b', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:35Z', 'updated_at': '2021-11-09T04:35:41Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': '0cd8bdb8-1377-46f0-ba25-14251b97253b', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:08.921377 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cde33512-34a3-4a44-9d7c-4c0ff251aac0 None None] The sync data for ids ['7b9a51f0-889c-418d-bc8a-fcfd303c5053'] in dv-neutron-816802-2-hyperv is: [{'id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'name': 'tempest-RoutersIpV6Test-router-1491329762', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:35:32Z', 'updated_at': '2021-11-09T04:36:07Z', 'revision_number': 10, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'gw_port_host': None, '_interfaces': [{'id': '5a28daa1-7cdd-49a3-aad4-ecd643914dfd', 'name': '', 'network_id': '0c466943-3298-4130-be72-d7c24549bd5d', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'mac_address': 'fa:16:3e:9e:e7:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'device_owner': 'network:router_interface', 'standard_attr_id': 1206, 'fixed_ips': [{'subnet_id': '0cd8bdb8-1377-46f0-ba25-14251b97253b', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:35:35Z', 'updated_at': '2021-11-09T04:35:41Z', 'revision_number': 5, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'subnets': [{'id': '0cd8bdb8-1377-46f0-ba25-14251b97253b', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:36:08.976880 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2d168f04-8e0d-4079-ae76-ed079f0fb71c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:08.986687 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59120) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:08.992931 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-79937169-00ba-4558-b6d8-ad6aa9915ecb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'name': 'tempest-TestNetworkBasicOps-router-1967773701', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.204'}], 'enable_snat': True}, 'gw_port_id': '49bff53a-c208-4aa5-8fcc-e7ec9471fae7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:33:32Z', 'updated_at': '2021-11-09T04:36:06Z', 'revision_number': 7, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '49bff53a-c208-4aa5-8fcc-e7ec9471fae7', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:85:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'device_owner': 'network:router_gateway', 'standard_attr_id': 978, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.204', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:33:34Z', 'updated_at': '2021-11-09T04:33:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:09.023178 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2d168f04-8e0d-4079-ae76-ed079f0fb71c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] No DVR routers for this DVR port 30ff8933-6aad-4f21-a11e-23a4dd69e54e on host dv-neutron-816802-2-hyperv {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:36:09.028679 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d168f04-8e0d-4079-ae76-ed079f0fb71c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event deleted for resources: {'Port': ['ID=30ff8933-6aad-4f21-a11e-23a4dd69e54e,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:09.038803 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-79937169-00ba-4558-b6d8-ad6aa9915ecb None None] The sync data for ids ['d05416c2-0293-4ef5-a6e3-5968392cc774'] in dv-neutron-816802-2-hyperv is: [{'id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'name': 'tempest-TestNetworkBasicOps-router-1967773701', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.204'}], 'enable_snat': True}, 'gw_port_id': '49bff53a-c208-4aa5-8fcc-e7ec9471fae7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:33:32Z', 'updated_at': '2021-11-09T04:36:06Z', 'revision_number': 7, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '49bff53a-c208-4aa5-8fcc-e7ec9471fae7', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:85:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd05416c2-0293-4ef5-a6e3-5968392cc774', 'device_owner': 'network:router_gateway', 'standard_attr_id': 978, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.204', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:33:34Z', 'updated_at': '2021-11-09T04:33:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:36:09.136456 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-7c118159-2062-48b6-95b4-74dfc8d73dec tempest-NetworksNegativeTestJSON-121195582 tempest-NetworksNegativeTestJSON-121195582-project] Request body: {'port': {'network_id': '1fa521e6-1a22-424b-ae85-d7877ec5df70', 'name': 'tempest-NetworksNegativeTestJSON-131602339'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:09.143694 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2d168f04-8e0d-4079-ae76-ed079f0fb71c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:09.160023 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-7c118159-2062-48b6-95b4-74dfc8d73dec tempest-NetworksNegativeTestJSON-121195582 tempest-NetworksNegativeTestJSON-121195582-project] POST failed (client error): The resource could not be found. Nov 09 04:36:09.160584 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-7c118159-2062-48b6-95b4-74dfc8d73dec tempest-NetworksNegativeTestJSON-121195582 tempest-NetworksNegativeTestJSON-121195582-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:36:09.161723 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-7c118159-2062-48b6-95b4-74dfc8d73dec tempest-NetworksNegativeTestJSON-121195582 tempest-NetworksNegativeTestJSON-121195582-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 404 len: 339 time: 0.1740811 Nov 09 04:36:09.165968 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59124) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:09.166538 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7acecef2-9d85-4a52-8c6c-cac3c72a6103 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router_gateway, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:09.194065 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-2d168f04-8e0d-4079-ae76-ed079f0fb71c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['035bc5dd-3c1d-4ced-893c-487b4c0eff40']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:09.201727 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-7b50dc0a-ed6d-4aec-b1f6-d6d6278f463b tempest-NetworksNegativeTestJSON-121195582 tempest-NetworksNegativeTestJSON-121195582-project] DELETE failed (client error): The resource could not be found. Nov 09 04:36:09.202272 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-7b50dc0a-ed6d-4aec-b1f6-d6d6278f463b tempest-NetworksNegativeTestJSON-121195582 tempest-NetworksNegativeTestJSON-121195582-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:36:09.205326 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-7b50dc0a-ed6d-4aec-b1f6-d6d6278f463b tempest-NetworksNegativeTestJSON-121195582 tempest-NetworksNegativeTestJSON-121195582-project] 10.222.0.24 "DELETE /v2.0/networks/64ca988f-2548-4b94-aa3d-3a7abd59a0a6 HTTP/1.1" status: 404 len: 339 time: 0.0384102 Nov 09 04:36:09.208701 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-2d168f04-8e0d-4079-ae76-ed079f0fb71c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3924cc51-1cb6-447f-9de3-d105512d807f') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:09.209002 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-2d168f04-8e0d-4079-ae76-ed079f0fb71c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3924cc51-1cb6-447f-9de3-d105512d807f') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:09.209319 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59126) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:09.218370 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2d168f04-8e0d-4079-ae76-ed079f0fb71c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:09.232220 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2d168f04-8e0d-4079-ae76-ed079f0fb71c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:09.233066 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-11bb9dac-6d0f-4a81-bb73-efb217097aad tempest-NetworksNegativeTestJSON-121195582 tempest-NetworksNegativeTestJSON-121195582-project] DELETE failed (client error): The resource could not be found. Nov 09 04:36:09.233684 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-11bb9dac-6d0f-4a81-bb73-efb217097aad tempest-NetworksNegativeTestJSON-121195582 tempest-NetworksNegativeTestJSON-121195582-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:36:09.236672 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-11bb9dac-6d0f-4a81-bb73-efb217097aad tempest-NetworksNegativeTestJSON-121195582 tempest-NetworksNegativeTestJSON-121195582-project] 10.222.0.24 "DELETE /v2.0/ports/f098087e-b146-4589-9131-22836226bfa7 HTTP/1.1" status: 404 len: 333 time: 0.0263817 Nov 09 04:36:09.238034 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2d168f04-8e0d-4079-ae76-ed079f0fb71c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Releasing vlan 320 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:36:09.238450 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2d168f04-8e0d-4079-ae76-ed079f0fb71c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:09.240411 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59128) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:09.241420 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:36:09.241420 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:36:09.241420 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:36:09.241420 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:36:09.241420 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:36:09.241420 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:36:09.241420 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:36:09.241420 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:36:09.241420 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:36:09.241420 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:36:09.241420 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:36:09.241420 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:36:09.241420 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:36:09.241420 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:36:09.241420 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:36:09.241420 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:36:09.241420 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:36:09.241420 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:36:09.241420 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:36:09.241420 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:36:09.241420 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:36:09.241420 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:36:09.241420 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:36:09.241420 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:36:09.241420 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:36:09.241420 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:36:09.241420 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:36:09.241420 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:36:09.241420 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:36:09.241420 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:36:09.241420 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:36:09.241420 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:36:09.276331 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-c3d16915-50a2-4146-afd9-acfcc9ab376a tempest-NetworksNegativeTestJSON-121195582 tempest-NetworksNegativeTestJSON-121195582-project] DELETE failed (client error): The resource could not be found. Nov 09 04:36:09.276786 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c3d16915-50a2-4146-afd9-acfcc9ab376a tempest-NetworksNegativeTestJSON-121195582 tempest-NetworksNegativeTestJSON-121195582-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:36:09.280117 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-c3d16915-50a2-4146-afd9-acfcc9ab376a tempest-NetworksNegativeTestJSON-121195582 tempest-NetworksNegativeTestJSON-121195582-project] 10.222.0.24 "DELETE /v2.0/subnets/76aa32ad-6f5f-4bf5-9b03-73d0897b4012 HTTP/1.1" status: 404 len: 337 time: 0.0386629 Nov 09 04:36:09.284682 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59130) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:09.296590 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-745d103d-c3df-4a30-9aa2-f111cc58e5d5 None None] DHCP port deletion for 035bc5dd-3c1d-4ced-893c-487b4c0eff40 request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:36:09.308775 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-09886654-f7bc-4367-86cb-ceadcd79ff3e tempest-NetworksNegativeTestJSON-121195582 tempest-NetworksNegativeTestJSON-121195582-project] GET failed (client error): The resource could not be found. Nov 09 04:36:09.310260 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-09886654-f7bc-4367-86cb-ceadcd79ff3e tempest-NetworksNegativeTestJSON-121195582 tempest-NetworksNegativeTestJSON-121195582-project] 10.222.0.24 "GET /v2.0/networks/a5b14946-beb7-4019-88f7-28f22d9cc21b HTTP/1.1" status: 404 len: 339 time: 0.0246453 Nov 09 04:36:09.318042 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59132) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:09.336385 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-7acecef2-9d85-4a52-8c6c-cac3c72a6103 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Deleting port 49bff53a-c208-4aa5-8fcc-e7ec9471fae7 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:36:09.336722 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7acecef2-9d85-4a52-8c6c-cac3c72a6103 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:09.343656 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-c58888dc-bfff-4980-a0e9-7186493ec57f tempest-NetworksNegativeTestJSON-121195582 tempest-NetworksNegativeTestJSON-121195582-project] GET failed (client error): The resource could not be found. Nov 09 04:36:09.346297 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-c58888dc-bfff-4980-a0e9-7186493ec57f tempest-NetworksNegativeTestJSON-121195582 tempest-NetworksNegativeTestJSON-121195582-project] 10.222.0.24 "GET /v2.0/ports/48acef9f-a4ff-4975-bbc2-fb84cc4dff41 HTTP/1.1" status: 404 len: 333 time: 0.0300188 Nov 09 04:36:09.352880 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59134) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:09.389571 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-94965e8f-9e38-44ed-b18e-4ccdf5210873 tempest-NetworksNegativeTestJSON-121195582 tempest-NetworksNegativeTestJSON-121195582-project] GET failed (client error): The resource could not be found. Nov 09 04:36:09.391902 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-94965e8f-9e38-44ed-b18e-4ccdf5210873 tempest-NetworksNegativeTestJSON-121195582 tempest-NetworksNegativeTestJSON-121195582-project] 10.222.0.24 "GET /v2.0/subnets/060f2f40-f79d-4c37-be31-7bca8deb374d HTTP/1.1" status: 404 len: 337 time: 0.0366032 Nov 09 04:36:09.395499 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59136) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:09.401053 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-a620c50d-eb8f-497f-999f-09b3fbdccfc5 tempest-NetworksNegativeTestJSON-121195582 tempest-NetworksNegativeTestJSON-121195582-project] Request body: {'network': {'name': 'new_name'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:09.414501 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-a620c50d-eb8f-497f-999f-09b3fbdccfc5 tempest-NetworksNegativeTestJSON-121195582 tempest-NetworksNegativeTestJSON-121195582-project] PUT failed (client error): The resource could not be found. Nov 09 04:36:09.415275 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a620c50d-eb8f-497f-999f-09b3fbdccfc5 tempest-NetworksNegativeTestJSON-121195582 tempest-NetworksNegativeTestJSON-121195582-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:36:09.420746 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a620c50d-eb8f-497f-999f-09b3fbdccfc5 tempest-NetworksNegativeTestJSON-121195582 tempest-NetworksNegativeTestJSON-121195582-project] 10.222.0.24 "PUT /v2.0/networks/484d231d-d6e7-4802-96ca-e317b4a871d1 HTTP/1.1" status: 404 len: 339 time: 0.0197043 Nov 09 04:36:09.420746 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2d168f04-8e0d-4079-ae76-ed079f0fb71c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:09.421075 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59138) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:09.424822 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2d168f04-8e0d-4079-ae76-ed079f0fb71c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:09.428025 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-2d168f04-8e0d-4079-ae76-ed079f0fb71c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "DELETE /v2.0/networks/035bc5dd-3c1d-4ced-893c-487b4c0eff40 HTTP/1.1" status: 204 len: 168 time: 0.9198978 Nov 09 04:36:09.428172 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-6edc8ec2-5993-4479-9e3a-52d24a2e937d tempest-NetworksNegativeTestJSON-121195582 tempest-NetworksNegativeTestJSON-121195582-project] Request body: {'port': {'name': 'new_name'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:09.430935 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59140) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:09.447984 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d168f04-8e0d-4079-ae76-ed079f0fb71c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event deleted for resources: {'Network': ['ID=035bc5dd-3c1d-4ced-893c-487b4c0eff40,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:09.456023 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-6edc8ec2-5993-4479-9e3a-52d24a2e937d tempest-NetworksNegativeTestJSON-121195582 tempest-NetworksNegativeTestJSON-121195582-project] PUT failed (client error): The resource could not be found. Nov 09 04:36:09.456689 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-6edc8ec2-5993-4479-9e3a-52d24a2e937d tempest-NetworksNegativeTestJSON-121195582 tempest-NetworksNegativeTestJSON-121195582-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:36:09.461422 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-6edc8ec2-5993-4479-9e3a-52d24a2e937d tempest-NetworksNegativeTestJSON-121195582 tempest-NetworksNegativeTestJSON-121195582-project] 10.222.0.24 "PUT /v2.0/ports/1c2582c1-521e-4706-8f95-672ea0b2dcfc HTTP/1.1" status: 404 len: 333 time: 0.0362742 Nov 09 04:36:09.461713 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59142) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:09.466622 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-a104780e-89e0-4375-8c8a-6dddf0c81a5f tempest-NetworksNegativeTestJSON-121195582 tempest-NetworksNegativeTestJSON-121195582-project] Request body: {'subnet': {'name': 'new_name'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:09.470974 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-7acecef2-9d85-4a52-8c6c-cac3c72a6103 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] For port 49bff53a-c208-4aa5-8fcc-e7ec9471fae7, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=49bff53a-c208-4aa5-8fcc-e7ec9471fae7,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:36:09.471328 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7acecef2-9d85-4a52-8c6c-cac3c72a6103 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:09.501531 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-a104780e-89e0-4375-8c8a-6dddf0c81a5f tempest-NetworksNegativeTestJSON-121195582 tempest-NetworksNegativeTestJSON-121195582-project] PUT failed (client error): The resource could not be found. Nov 09 04:36:09.501979 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a104780e-89e0-4375-8c8a-6dddf0c81a5f tempest-NetworksNegativeTestJSON-121195582 tempest-NetworksNegativeTestJSON-121195582-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:36:09.503860 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a104780e-89e0-4375-8c8a-6dddf0c81a5f tempest-NetworksNegativeTestJSON-121195582 tempest-NetworksNegativeTestJSON-121195582-project] 10.222.0.24 "PUT /v2.0/subnets/78a5025e-94cb-4fae-920c-6fba68108d23 HTTP/1.1" status: 404 len: 337 time: 0.0406163 Nov 09 04:36:09.507659 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-7acecef2-9d85-4a52-8c6c-cac3c72a6103 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Calling delete_port for 49bff53a-c208-4aa5-8fcc-e7ec9471fae7 owned by network:router_gateway {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:36:09.687209 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1cb01ffd-76c6-4ef8-be54-6f8d9d6ef04b None None] DHCP port deletion for 239a9c72-6384-4d5a-a69d-f4ac0c580e40 request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:36:09.732684 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 858eaebe-fdb6-4c5b-ab0f-4d6bd86995d4 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:36:09.764113 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 858eaebe-fdb6-4c5b-ab0f-4d6bd86995d4 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:36:09.764572 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 858eaebe-fdb6-4c5b-ab0f-4d6bd86995d4 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:36:09.765079 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 30ff8933-6aad-4f21-a11e-23a4dd69e54e no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:36:09.792258 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 30ff8933-6aad-4f21-a11e-23a4dd69e54e {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:36:09.793427 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 30ff8933-6aad-4f21-a11e-23a4dd69e54e not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:36:09.813200 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7acecef2-9d85-4a52-8c6c-cac3c72a6103 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:09.816694 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-1cb01ffd-76c6-4ef8-be54-6f8d9d6ef04b None None] Deleting port 0c829017-1d45-4280-bb1e-aecb67547f76 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:36:09.817335 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1cb01ffd-76c6-4ef8-be54-6f8d9d6ef04b None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:09.820560 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-927e832a-5eb2-4477-850a-b6ff2d87483d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:09.890898 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7acecef2-9d85-4a52-8c6c-cac3c72a6103 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'Port': ['ID=49bff53a-c208-4aa5-8fcc-e7ec9471fae7,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:09.905334 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-1cb01ffd-76c6-4ef8-be54-6f8d9d6ef04b None None] For port 0c829017-1d45-4280-bb1e-aecb67547f76, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=0c829017-1d45-4280-bb1e-aecb67547f76,segment=NetworkSegment(7befff96-69ce-4b76-b9cc-7561279d57a7),segment_id=7befff96-69ce-4b76-b9cc-7561279d57a7)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:36:09.906409 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1cb01ffd-76c6-4ef8-be54-6f8d9d6ef04b None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:09.931111 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-1cb01ffd-76c6-4ef8-be54-6f8d9d6ef04b None None] Calling delete_port for 0c829017-1d45-4280-bb1e-aecb67547f76 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:36:09.943763 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7acecef2-9d85-4a52-8c6c-cac3c72a6103 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-466373'] for router_gateway, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:10.052830 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7acecef2-9d85-4a52-8c6c-cac3c72a6103 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:10.056641 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7acecef2-9d85-4a52-8c6c-cac3c72a6103 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:10.097209 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-927e832a-5eb2-4477-850a-b6ff2d87483d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Deleting port 5a28daa1-7cdd-49a3-aad4-ecd643914dfd {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:36:10.097915 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-927e832a-5eb2-4477-850a-b6ff2d87483d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:10.107710 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59148) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:10.125112 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1cb01ffd-76c6-4ef8-be54-6f8d9d6ef04b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:10.157249 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1cb01ffd-76c6-4ef8-be54-6f8d9d6ef04b None None] No DVR routers for this DVR port 0c829017-1d45-4280-bb1e-aecb67547f76 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:36:10.162417 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cb01ffd-76c6-4ef8-be54-6f8d9d6ef04b None None] Pushing event deleted for resources: {'Port': ['ID=0c829017-1d45-4280-bb1e-aecb67547f76,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:10.182597 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7acecef2-9d85-4a52-8c6c-cac3c72a6103 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:10.183252 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7acecef2-9d85-4a52-8c6c-cac3c72a6103 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Fanout notify agent at l3_agent the message router_deleted on router d05416c2-0293-4ef5-a6e3-5968392cc774 {{(pid=102161) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:36:10.196559 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7acecef2-9d85-4a52-8c6c-cac3c72a6103 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:10.200005 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-7acecef2-9d85-4a52-8c6c-cac3c72a6103 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "DELETE /v2.0/routers/d05416c2-0293-4ef5-a6e3-5968392cc774 HTTP/1.1" status: 204 len: 168 time: 1.7698808 Nov 09 04:36:10.202661 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59152) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:10.204912 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-927e832a-5eb2-4477-850a-b6ff2d87483d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] For port 5a28daa1-7cdd-49a3-aad4-ecd643914dfd, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=5a28daa1-7cdd-49a3-aad4-ecd643914dfd,segment=NetworkSegment(38eba3d4-dbea-4df0-8bb8-d6738ea5872c),segment_id=38eba3d4-dbea-4df0-8bb8-d6738ea5872c)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:36:10.205334 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-927e832a-5eb2-4477-850a-b6ff2d87483d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:10.224683 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-927e832a-5eb2-4477-850a-b6ff2d87483d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Calling delete_port for 5a28daa1-7cdd-49a3-aad4-ecd643914dfd owned by network:router_interface {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:36:10.297663 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6ae60f6a-103b-4820-abb9-8151e80f7cd0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:10.317607 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6b731fb5-4afd-41b0-a7d6-2c765f8dc598 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:10.426558 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6b731fb5-4afd-41b0-a7d6-2c765f8dc598 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:10.449399 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-6b731fb5-4afd-41b0-a7d6-2c765f8dc598 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['239a9c72-6384-4d5a-a69d-f4ac0c580e40']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:10.459422 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-6b731fb5-4afd-41b0-a7d6-2c765f8dc598 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '7befff96-69ce-4b76-b9cc-7561279d57a7') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:10.459695 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-6b731fb5-4afd-41b0-a7d6-2c765f8dc598 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '7befff96-69ce-4b76-b9cc-7561279d57a7') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:10.469827 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-927e832a-5eb2-4477-850a-b6ff2d87483d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:10.470737 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6b731fb5-4afd-41b0-a7d6-2c765f8dc598 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:10.493817 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6b731fb5-4afd-41b0-a7d6-2c765f8dc598 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:10.500356 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-927e832a-5eb2-4477-850a-b6ff2d87483d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event deleted for resources: {'Port': ['ID=5a28daa1-7cdd-49a3-aad4-ecd643914dfd,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:10.505644 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6b731fb5-4afd-41b0-a7d6-2c765f8dc598 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Releasing vlan 313 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:36:10.505768 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6b731fb5-4afd-41b0-a7d6-2c765f8dc598 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:10.509307 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:36:10.509307 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:36:10.509307 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:36:10.509307 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:36:10.509307 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:36:10.509307 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:36:10.509307 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:36:10.509307 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:36:10.509307 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:36:10.509307 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:36:10.509307 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:36:10.509307 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:36:10.509307 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:36:10.509307 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:36:10.509307 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:36:10.509307 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:36:10.509307 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:36:10.509307 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:36:10.509307 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:36:10.509307 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:36:10.509307 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:36:10.509307 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:36:10.509307 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:36:10.509307 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:36:10.509307 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:36:10.509307 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:36:10.509307 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:36:10.509307 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:36:10.509307 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:36:10.509307 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:36:10.509307 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:36:10.509307 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:36:10.589387 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6ae60f6a-103b-4820-abb9-8151e80f7cd0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:10.652670 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6ae60f6a-103b-4820-abb9-8151e80f7cd0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:10.688810 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6b731fb5-4afd-41b0-a7d6-2c765f8dc598 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:10.709760 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6b731fb5-4afd-41b0-a7d6-2c765f8dc598 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:10.713368 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-6b731fb5-4afd-41b0-a7d6-2c765f8dc598 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "DELETE /v2.0/networks/239a9c72-6384-4d5a-a69d-f4ac0c580e40 HTTP/1.1" status: 204 len: 168 time: 0.5091250 Nov 09 04:36:10.725868 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ae60f6a-103b-4820-abb9-8151e80f7cd0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d506fa47-2054-4b17-90a8-487b327d81fc,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:10.733285 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-6ae60f6a-103b-4820-abb9-8151e80f7cd0 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=b066371042f3454fadaf3a62feac0e37&name=default HTTP/1.1" status: 200 len: 3000 time: 0.6216474 Nov 09 04:36:10.733285 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b731fb5-4afd-41b0-a7d6-2c765f8dc598 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'Network': ['ID=239a9c72-6384-4d5a-a69d-f4ac0c580e40,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:10.733758 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59154) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:10.761596 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59156) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:10.770538 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-62499fd6-442d-4bf9-8582-77ad8cbd2820 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'network': {'name': 'tempest-network-smoke--2007617618', 'project_id': '1d10b4824e524068827e58b55e269af3', 'port_security_enabled': True}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:10.810512 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-61ae8b5f-61c5-46b3-892d-4678a707b436 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:10.834046 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-61ae8b5f-61c5-46b3-892d-4678a707b436 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:10.891029 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-62499fd6-442d-4bf9-8582-77ad8cbd2820 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Made reservation on behalf of 1d10b4824e524068827e58b55e269af3 for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:36:10.894823 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-62499fd6-442d-4bf9-8582-77ad8cbd2820 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:10.958272 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-61ae8b5f-61c5-46b3-892d-4678a707b436 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:10.961083 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-61ae8b5f-61c5-46b3-892d-4678a707b436 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:10.962416 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-61ae8b5f-61c5-46b3-892d-4678a707b436 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/d506fa47-2054-4b17-90a8-487b327d81fc HTTP/1.1" status: 204 len: 168 time: 0.2276537 Nov 09 04:36:10.967444 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-62499fd6-442d-4bf9-8582-77ad8cbd2820 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 330} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:36:10.980264 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61ae8b5f-61c5-46b3-892d-4678a707b436 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d506fa47-2054-4b17-90a8-487b327d81fc,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:10.984829 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-62499fd6-442d-4bf9-8582-77ad8cbd2820 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:10.985192 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-62499fd6-442d-4bf9-8582-77ad8cbd2820 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Added segment 978d57a9-319d-4116-8893-ffe00140f45e of type vlan for network 0f070182-4996-4fd0-8617-1172b3c4ac5e Nov 09 04:36:11.005087 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-927e832a-5eb2-4477-850a-b6ff2d87483d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:11.051899 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-62499fd6-442d-4bf9-8582-77ad8cbd2820 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:11.144160 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-62499fd6-442d-4bf9-8582-77ad8cbd2820 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:11.150102 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-62499fd6-442d-4bf9-8582-77ad8cbd2820 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:36:11.151394 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-62499fd6-442d-4bf9-8582-77ad8cbd2820 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:11.178520 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-927e832a-5eb2-4477-850a-b6ff2d87483d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Router 7b9a51f0-889c-418d-bc8a-fcfd303c5053 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:36:11.227110 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62499fd6-442d-4bf9-8582-77ad8cbd2820 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Network': ['ID=0f070182-4996-4fd0-8617-1172b3c4ac5e,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:11.234661 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-62499fd6-442d-4bf9-8582-77ad8cbd2820 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.4719651 Nov 09 04:36:11.238056 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59162) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:11.251145 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-995b1640-cfc0-4be8-a3f1-51bc53677b50 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'router': {'name': 'tempest-TestNetworkBasicOps-router-129683286', 'admin_state_up': True, 'project_id': '1d10b4824e524068827e58b55e269af3', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:11.260437 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-927e832a-5eb2-4477-850a-b6ff2d87483d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:36:11.261853 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 0f070182-4996-4fd0-8617-1172b3c4ac5e details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:36:11.268237 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-927e832a-5eb2-4477-850a-b6ff2d87483d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "PUT /v2.0/routers/7b9a51f0-889c-418d-bc8a-fcfd303c5053/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8362758 Nov 09 04:36:11.272579 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59164) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:11.276105 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c5bcf418-9a8d-43cf-a030-762263d0a5fa None None] Sync routers for ids ['7b9a51f0-889c-418d-bc8a-fcfd303c5053'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:36:11.340046 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-72017026-b513-47dd-81e2-9c9549b4ac0a tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Deleting subnet 0cd8bdb8-1377-46f0-ba25-14251b97253b {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:36:11.343674 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-72017026-b513-47dd-81e2-9c9549b4ac0a tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:11.348907 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c5bcf418-9a8d-43cf-a030-762263d0a5fa None None] Routers {'7b9a51f0-889c-418d-bc8a-fcfd303c5053'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:36:11.349544 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-c5bcf418-9a8d-43cf-a030-762263d0a5fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['7b9a51f0-889c-418d-bc8a-fcfd303c5053'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:11.379035 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-995b1640-cfc0-4be8-a3f1-51bc53677b50 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:11.380487 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-995b1640-cfc0-4be8-a3f1-51bc53677b50 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:11.421916 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-72017026-b513-47dd-81e2-9c9549b4ac0a tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:11.458332 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-995b1640-cfc0-4be8-a3f1-51bc53677b50 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:11.524846 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-72017026-b513-47dd-81e2-9c9549b4ac0a tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:11.601175 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 9930d582-2262-4f1d-97bf-b02697a70777 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:36:11.610971 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-db70eb5a-b358-472d-b919-24ee5ad0745b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:11.632390 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-c5bcf418-9a8d-43cf-a030-762263d0a5fa None None] Set router 7b9a51f0-889c-418d-bc8a-fcfd303c5053 gateway port host: None {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:36:11.636544 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 9930d582-2262-4f1d-97bf-b02697a70777 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:36:11.636887 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 9930d582-2262-4f1d-97bf-b02697a70777 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:36:11.637362 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 49bff53a-c208-4aa5-8fcc-e7ec9471fae7 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:36:11.669747 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-995b1640-cfc0-4be8-a3f1-51bc53677b50 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:11.671589 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-72017026-b513-47dd-81e2-9c9549b4ac0a tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:11.710019 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-c5bcf418-9a8d-43cf-a030-762263d0a5fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'name': 'tempest-RoutersIpV6Test-router-1491329762', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:35:32Z', 'updated_at': '2021-11-09T04:36:10Z', 'revision_number': 11, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'gw_port_host': None}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:11.723824 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72017026-b513-47dd-81e2-9c9549b4ac0a tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event deleted for resources: {'Subnet': ['ID=0cd8bdb8-1377-46f0-ba25-14251b97253b,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:11.727410 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-72017026-b513-47dd-81e2-9c9549b4ac0a tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:11.731445 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-72017026-b513-47dd-81e2-9c9549b4ac0a tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "DELETE /v2.0/subnets/0cd8bdb8-1377-46f0-ba25-14251b97253b HTTP/1.1" status: 204 len: 168 time: 0.4575305 Nov 09 04:36:11.734293 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59174) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:11.738805 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 49bff53a-c208-4aa5-8fcc-e7ec9471fae7 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:36:11.739154 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 49bff53a-c208-4aa5-8fcc-e7ec9471fae7 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:36:11.739602 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 0c829017-1d45-4280-bb1e-aecb67547f76 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:36:11.741262 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c5bcf418-9a8d-43cf-a030-762263d0a5fa None None] Checking router: 7b9a51f0-889c-418d-bc8a-fcfd303c5053 for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:36:11.743061 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-771324e9-ad5c-407a-9818-d919a89d4fa7 None None] Network 0c466943-3298-4130-be72-d7c24549bd5d requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:36:11.773298 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 0c829017-1d45-4280-bb1e-aecb67547f76 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:36:11.773634 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 0c829017-1d45-4280-bb1e-aecb67547f76 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:36:11.817308 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c5bcf418-9a8d-43cf-a030-762263d0a5fa None None] Routers {'7b9a51f0-889c-418d-bc8a-fcfd303c5053'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:36:11.817937 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-c5bcf418-9a8d-43cf-a030-762263d0a5fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['7b9a51f0-889c-418d-bc8a-fcfd303c5053'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:11.887270 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7361ab24-896b-4b29-adbb-dd5ebfbf82ad tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:11.903292 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-c5bcf418-9a8d-43cf-a030-762263d0a5fa None None] Set router 7b9a51f0-889c-418d-bc8a-fcfd303c5053 gateway port host: None {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:36:11.970278 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-c5bcf418-9a8d-43cf-a030-762263d0a5fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'name': 'tempest-RoutersIpV6Test-router-1491329762', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:35:32Z', 'updated_at': '2021-11-09T04:36:10Z', 'revision_number': 11, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'gw_port_host': None}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:11.973443 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-7361ab24-896b-4b29-adbb-dd5ebfbf82ad tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Deleting port 1ac1d36b-a9ad-4497-aa5a-facfbb4ab1d6 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:36:11.973710 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7361ab24-896b-4b29-adbb-dd5ebfbf82ad tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:12.015357 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c5bcf418-9a8d-43cf-a030-762263d0a5fa None None] The sync data for ids ['7b9a51f0-889c-418d-bc8a-fcfd303c5053'] in dv-neutron-816802-2-hyperv is: [{'id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'name': 'tempest-RoutersIpV6Test-router-1491329762', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:35:32Z', 'updated_at': '2021-11-09T04:36:10Z', 'revision_number': 11, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'gw_port_host': None}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:36:12.119892 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:12.128638 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59186) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:12.131308 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-995b1640-cfc0-4be8-a3f1-51bc53677b50 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router_gateway, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:12.160280 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-995b1640-cfc0-4be8-a3f1-51bc53677b50 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:12.169454 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-7361ab24-896b-4b29-adbb-dd5ebfbf82ad tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] For port 1ac1d36b-a9ad-4497-aa5a-facfbb4ab1d6, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=1ac1d36b-a9ad-4497-aa5a-facfbb4ab1d6,segment=NetworkSegment(38eba3d4-dbea-4df0-8bb8-d6738ea5872c),segment_id=38eba3d4-dbea-4df0-8bb8-d6738ea5872c)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:36:12.169808 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7361ab24-896b-4b29-adbb-dd5ebfbf82ad tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:12.211813 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-7361ab24-896b-4b29-adbb-dd5ebfbf82ad tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Calling delete_port for 1ac1d36b-a9ad-4497-aa5a-facfbb4ab1d6 owned by network:dhcp {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:36:12.225654 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-0a747f0c-f8d1-4fbe-a181-df7888224e6d tempest-DvrRoutersNegativeTest-1005553740 tempest-DvrRoutersNegativeTest-1005553740-project] Request body: {'router': {'name': 'tempest-DvrRoutersNegativeTest-router-1150555359', 'external_gateway_info': {}, 'admin_state_up': False, 'distributed': True}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:12.228668 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.policy [None req-0a747f0c-f8d1-4fbe-a181-df7888224e6d tempest-DvrRoutersNegativeTest-1005553740 tempest-DvrRoutersNegativeTest-1005553740-project] Enforcing rules: ['create_router', 'create_router:external_gateway_info', 'create_router:distributed'] {{(pid=102162) log_rule_list /opt/stack/neutron/neutron/policy.py:450}} Nov 09 04:36:12.231959 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.policy [None req-0a747f0c-f8d1-4fbe-a181-df7888224e6d tempest-DvrRoutersNegativeTest-1005553740 tempest-DvrRoutersNegativeTest-1005553740-project] Failed policy check for 'create_router' {{(pid=102162) enforce /opt/stack/neutron/neutron/policy.py:524}} Nov 09 04:36:12.231959 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.api.v2.resource [None req-0a747f0c-f8d1-4fbe-a181-df7888224e6d tempest-DvrRoutersNegativeTest-1005553740 tempest-DvrRoutersNegativeTest-1005553740-project] create failed (client error): Access was denied to this resource. Nov 09 04:36:12.231959 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-0a747f0c-f8d1-4fbe-a181-df7888224e6d tempest-DvrRoutersNegativeTest-1005553740 tempest-DvrRoutersNegativeTest-1005553740-project] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 403 len: 414 time: 0.1008224 Nov 09 04:36:12.334239 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-995b1640-cfc0-4be8-a3f1-51bc53677b50 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Allocated IP 172.26.0.26 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/4cd82d33-ba2a-405e-8980-983e2ba630eb) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:36:12.385399 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2b645e18-35e8-4482-8b38-65cc647f2789 None None] DHCP port deletion for 0c466943-3298-4130-be72-d7c24549bd5d request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:36:12.419089 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7361ab24-896b-4b29-adbb-dd5ebfbf82ad tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:12.442759 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-2b645e18-35e8-4482-8b38-65cc647f2789 None None] Deleting port 1ac1d36b-a9ad-4497-aa5a-facfbb4ab1d6 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:36:12.443252 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-2b645e18-35e8-4482-8b38-65cc647f2789 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:12.461010 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7361ab24-896b-4b29-adbb-dd5ebfbf82ad tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event deleted for resources: {'Port': ['ID=1ac1d36b-a9ad-4497-aa5a-facfbb4ab1d6,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:12.465727 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7361ab24-896b-4b29-adbb-dd5ebfbf82ad tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] No DVR routers for this DVR port 1ac1d36b-a9ad-4497-aa5a-facfbb4ab1d6 on host dv-neutron-816802-2-hyperv {{(pid=102161) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:36:12.480518 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-995b1640-cfc0-4be8-a3f1-51bc53677b50 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:12.544569 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-2b645e18-35e8-4482-8b38-65cc647f2789 None None] For port 1ac1d36b-a9ad-4497-aa5a-facfbb4ab1d6, host dv-neutron-816802-2-hyperv, got binding levels [] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:36:12.545057 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-2b645e18-35e8-4482-8b38-65cc647f2789 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:12.561823 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-2b645e18-35e8-4482-8b38-65cc647f2789 None None] Calling delete_port for 1ac1d36b-a9ad-4497-aa5a-facfbb4ab1d6 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:36:12.564750 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.ipam_backend_mixin [None req-2b645e18-35e8-4482-8b38-65cc647f2789 None None] Port 1ac1d36b-a9ad-4497-aa5a-facfbb4ab1d6 was not found and therefore no delete operation was performed {{(pid=102163) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Nov 09 04:36:12.566037 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-2b645e18-35e8-4482-8b38-65cc647f2789 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:12.570491 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7361ab24-896b-4b29-adbb-dd5ebfbf82ad tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:12.590851 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b645e18-35e8-4482-8b38-65cc647f2789 None None] Pushing event deleted for resources: {'Port': ['ID=1ac1d36b-a9ad-4497-aa5a-facfbb4ab1d6,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:12.594745 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2b645e18-35e8-4482-8b38-65cc647f2789 None None] No DVR routers for this DVR port 1ac1d36b-a9ad-4497-aa5a-facfbb4ab1d6 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:36:12.595717 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-7361ab24-896b-4b29-adbb-dd5ebfbf82ad tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0c466943-3298-4130-be72-d7c24549bd5d']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:12.610612 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-7361ab24-896b-4b29-adbb-dd5ebfbf82ad tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '38eba3d4-dbea-4df0-8bb8-d6738ea5872c') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:12.610915 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-7361ab24-896b-4b29-adbb-dd5ebfbf82ad tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '38eba3d4-dbea-4df0-8bb8-d6738ea5872c') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:12.623483 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7361ab24-896b-4b29-adbb-dd5ebfbf82ad tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:12.637511 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7361ab24-896b-4b29-adbb-dd5ebfbf82ad tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:12.644590 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7361ab24-896b-4b29-adbb-dd5ebfbf82ad tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Releasing vlan 311 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:36:12.644977 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7361ab24-896b-4b29-adbb-dd5ebfbf82ad tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:12.648157 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:36:12.648157 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:36:12.648157 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:36:12.648157 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:36:12.648157 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:36:12.648157 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:36:12.648157 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:36:12.648157 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:36:12.648157 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:36:12.648157 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:36:12.648157 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:36:12.648157 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:36:12.648157 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:36:12.648157 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:36:12.648157 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:36:12.648157 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:36:12.648157 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:36:12.648157 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:36:12.648157 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:36:12.648157 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:36:12.648157 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:36:12.648157 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:36:12.648157 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:36:12.648157 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:36:12.648157 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:36:12.648157 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:36:12.648157 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:36:12.648157 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:36:12.648157 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:36:12.648157 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:36:12.648157 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:36:12.648157 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:36:12.697817 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-995b1640-cfc0-4be8-a3f1-51bc53677b50 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:12.701662 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59194) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:12.741682 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-995b1640-cfc0-4be8-a3f1-51bc53677b50 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:36:12.745857 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-995b1640-cfc0-4be8-a3f1-51bc53677b50 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:36:12.751493 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-995b1640-cfc0-4be8-a3f1-51bc53677b50 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:36:12.774667 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-995b1640-cfc0-4be8-a3f1-51bc53677b50 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Port': ['ID=4cd82d33-ba2a-405e-8980-983e2ba630eb,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:12.817181 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-81dc72bf-aae2-4a4c-bf83-49a58c341db8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:12.827929 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7361ab24-896b-4b29-adbb-dd5ebfbf82ad tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:12.865504 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7361ab24-896b-4b29-adbb-dd5ebfbf82ad tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:12.868682 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-7361ab24-896b-4b29-adbb-dd5ebfbf82ad tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "DELETE /v2.0/networks/0c466943-3298-4130-be72-d7c24549bd5d HTTP/1.1" status: 204 len: 168 time: 1.1330516 Nov 09 04:36:12.871943 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59198) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:12.886545 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-249caa0c-26d0-4b1e-af0f-8a459a857074 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Request body: {'router': {'routes': None}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:12.897370 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-81dc72bf-aae2-4a4c-bf83-49a58c341db8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:12.937716 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7361ab24-896b-4b29-adbb-dd5ebfbf82ad tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Pushing event deleted for resources: {'Network': ['ID=0c466943-3298-4130-be72-d7c24549bd5d,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:12.993468 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-81dc72bf-aae2-4a4c-bf83-49a58c341db8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:13.032447 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81dc72bf-aae2-4a4c-bf83-49a58c341db8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2b6dda34-51c7-45ca-b365-c56e9a293af3,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:13.037983 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-81dc72bf-aae2-4a4c-bf83-49a58c341db8 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=6b80a50fc7264207a867e899a056525e&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3351727 Nov 09 04:36:13.040788 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59200) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:13.072449 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.extraroute_db [None req-249caa0c-26d0-4b1e-af0f-8a459a857074 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Added routes are [] {{(pid=102161) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:126}} Nov 09 04:36:13.072766 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.extraroute_db [None req-249caa0c-26d0-4b1e-af0f-8a459a857074 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Removed routes are [] {{(pid=102161) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:134}} Nov 09 04:36:13.073105 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-249caa0c-26d0-4b1e-af0f-8a459a857074 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-466202', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-464271', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-936'] for router, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:13.090958 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-dcc6c1f7-9c8e-4545-a6c0-998e20d70222 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:13.112727 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-dcc6c1f7-9c8e-4545-a6c0-998e20d70222 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:13.229292 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-dcc6c1f7-9c8e-4545-a6c0-998e20d70222 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:13.232665 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-dcc6c1f7-9c8e-4545-a6c0-998e20d70222 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:13.237953 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-dcc6c1f7-9c8e-4545-a6c0-998e20d70222 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/2b6dda34-51c7-45ca-b365-c56e9a293af3 HTTP/1.1" status: 204 len: 168 time: 0.1930950 Nov 09 04:36:13.241910 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 5a28daa1-7cdd-49a3-aad4-ecd643914dfd no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:36:13.245432 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcc6c1f7-9c8e-4545-a6c0-998e20d70222 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2b6dda34-51c7-45ca-b365-c56e9a293af3,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:13.270114 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 5a28daa1-7cdd-49a3-aad4-ecd643914dfd {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:36:13.270544 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 5a28daa1-7cdd-49a3-aad4-ecd643914dfd not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:36:13.271085 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 1ac1d36b-a9ad-4497-aa5a-facfbb4ab1d6 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:36:13.275890 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-249caa0c-26d0-4b1e-af0f-8a459a857074 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-466202', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-464271', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-936'] for router, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:13.281770 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-249caa0c-26d0-4b1e-af0f-8a459a857074 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-466195', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-466408', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-464260'] for router, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:13.299248 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 1ac1d36b-a9ad-4497-aa5a-facfbb4ab1d6 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:36:13.299626 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 1ac1d36b-a9ad-4497-aa5a-facfbb4ab1d6 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:36:13.360088 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-995b1640-cfc0-4be8-a3f1-51bc53677b50 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router_gateway, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:13.405932 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-249caa0c-26d0-4b1e-af0f-8a459a857074 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Router 7b9a51f0-889c-418d-bc8a-fcfd303c5053 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:36:13.527783 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-249caa0c-26d0-4b1e-af0f-8a459a857074 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:36:13.536155 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-249caa0c-26d0-4b1e-af0f-8a459a857074 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:13.537337 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-249caa0c-26d0-4b1e-af0f-8a459a857074 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "PUT /v2.0/routers/7b9a51f0-889c-418d-bc8a-fcfd303c5053 HTTP/1.1" status: 200 len: 705 time: 0.6644244 Nov 09 04:36:13.539271 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-456eafa3-8f69-45be-8d9c-a72902bfca88 None None] Sync routers for ids ['7b9a51f0-889c-418d-bc8a-fcfd303c5053'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:36:13.540404 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59204) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:13.552610 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-456eafa3-8f69-45be-8d9c-a72902bfca88 None None] Routers {'7b9a51f0-889c-418d-bc8a-fcfd303c5053'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:36:13.553265 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-456eafa3-8f69-45be-8d9c-a72902bfca88 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:35:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['7b9a51f0-889c-418d-bc8a-fcfd303c5053'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:13.569203 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a864247d-2015-4f91-98fa-16f06198de4d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "GET /v2.0/ports?device_id=7b9a51f0-889c-418d-bc8a-fcfd303c5053 HTTP/1.1" status: 200 len: 205 time: 0.0270524 Nov 09 04:36:13.572540 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59206) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:13.632204 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-456eafa3-8f69-45be-8d9c-a72902bfca88 None None] Set router 7b9a51f0-889c-418d-bc8a-fcfd303c5053 gateway port host: None {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:36:13.658895 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-50f48df0-b648-404a-921c-b03022de9afe tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for router, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:13.692250 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-819b3946-ccf0-4628-9aa0-60e7fff662ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:13.698552 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-456eafa3-8f69-45be-8d9c-a72902bfca88 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'name': 'tempest-RoutersIpV6Test-router-1491329762', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:35:32Z', 'updated_at': '2021-11-09T04:36:10Z', 'revision_number': 11, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'gw_port_host': None}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:13.733938 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-456eafa3-8f69-45be-8d9c-a72902bfca88 None None] Checking router: 7b9a51f0-889c-418d-bc8a-fcfd303c5053 for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:36:13.744171 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-456eafa3-8f69-45be-8d9c-a72902bfca88 None None] Routers {'7b9a51f0-889c-418d-bc8a-fcfd303c5053'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:36:13.744934 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-456eafa3-8f69-45be-8d9c-a72902bfca88 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:36:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['7b9a51f0-889c-418d-bc8a-fcfd303c5053'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:13.821340 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-456eafa3-8f69-45be-8d9c-a72902bfca88 None None] Set router 7b9a51f0-889c-418d-bc8a-fcfd303c5053 gateway port host: None {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:36:13.832930 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-50f48df0-b648-404a-921c-b03022de9afe tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:13.835531 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-50f48df0-b648-404a-921c-b03022de9afe tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:13.880450 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-456eafa3-8f69-45be-8d9c-a72902bfca88 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'name': 'tempest-RoutersIpV6Test-router-1491329762', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:35:32Z', 'updated_at': '2021-11-09T04:36:10Z', 'revision_number': 11, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'gw_port_host': None}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:13.909077 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-456eafa3-8f69-45be-8d9c-a72902bfca88 None None] The sync data for ids ['7b9a51f0-889c-418d-bc8a-fcfd303c5053'] in dv-neutron-816802-2-hyperv is: [{'id': '7b9a51f0-889c-418d-bc8a-fcfd303c5053', 'name': 'tempest-RoutersIpV6Test-router-1491329762', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:35:32Z', 'updated_at': '2021-11-09T04:36:10Z', 'revision_number': 11, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'gw_port_host': None}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:36:13.943810 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-50f48df0-b648-404a-921c-b03022de9afe tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:13.944371 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-50f48df0-b648-404a-921c-b03022de9afe tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Fanout notify agent at l3_agent the message router_deleted on router 7b9a51f0-889c-418d-bc8a-fcfd303c5053 {{(pid=102162) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:36:13.952682 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-50f48df0-b648-404a-921c-b03022de9afe tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:13.953853 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-50f48df0-b648-404a-921c-b03022de9afe tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "DELETE /v2.0/routers/7b9a51f0-889c-418d-bc8a-fcfd303c5053 HTTP/1.1" status: 204 len: 168 time: 0.3803620 Nov 09 04:36:13.958007 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59208) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:13.962465 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-84f14fc1-e3d8-4d64-a3b5-c4dd6f3a766c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-1958589809', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:14.046642 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-84f14fc1-e3d8-4d64-a3b5-c4dd6f3a766c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:14.048236 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-84f14fc1-e3d8-4d64-a3b5-c4dd6f3a766c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:14.052131 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-995b1640-cfc0-4be8-a3f1-51bc53677b50 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:14.117408 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-84f14fc1-e3d8-4d64-a3b5-c4dd6f3a766c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:14.176494 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-84f14fc1-e3d8-4d64-a3b5-c4dd6f3a766c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:14.475285 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-995b1640-cfc0-4be8-a3f1-51bc53677b50 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Router 73e2c7c1-e8be-4e45-a3ee-acc8be6515c9 is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102161) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:36:14.511899 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-84f14fc1-e3d8-4d64-a3b5-c4dd6f3a766c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:14.513277 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-84f14fc1-e3d8-4d64-a3b5-c4dd6f3a766c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 704 time: 0.5542922 Nov 09 04:36:14.516058 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59210) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:14.520527 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-6622c5a4-2026-4f2e-9ad5-0ae83a9f43ba tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Request body: {'router': {'admin_state_up': True}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:14.582159 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-995b1640-cfc0-4be8-a3f1-51bc53677b50 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:36:14.591263 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ad8c6979-6c3b-46f7-9d9c-2340b682f0f5 None None] Sync routers for ids ['73e2c7c1-e8be-4e45-a3ee-acc8be6515c9'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:36:14.600771 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ad8c6979-6c3b-46f7-9d9c-2340b682f0f5 None None] Routers {'73e2c7c1-e8be-4e45-a3ee-acc8be6515c9'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:36:14.601839 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-ad8c6979-6c3b-46f7-9d9c-2340b682f0f5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:36:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['73e2c7c1-e8be-4e45-a3ee-acc8be6515c9'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:14.688654 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-995b1640-cfc0-4be8-a3f1-51bc53677b50 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:14.692923 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-995b1640-cfc0-4be8-a3f1-51bc53677b50 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 885 time: 3.4511695 Nov 09 04:36:14.693325 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59212) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:14.705228 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-ad8c6979-6c3b-46f7-9d9c-2340b682f0f5 None None] Set router 73e2c7c1-e8be-4e45-a3ee-acc8be6515c9 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:36:14.725598 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-17256322-9ea7-40b3-a506-4fd6882b60d3 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/subnets?project_id=1d10b4824e524068827e58b55e269af3&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0285373 Nov 09 04:36:14.725871 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59214) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:14.733687 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6622c5a4-2026-4f2e-9ad5-0ae83a9f43ba tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-466202', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-464271', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-936'] for router, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:14.795189 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6622c5a4-2026-4f2e-9ad5-0ae83a9f43ba tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-466195', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-466408', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-464260'] for router, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:14.819112 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1ed6119f-1187-4fe0-bfd8-427db3b8bf74 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:36:14.824303 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1ed6119f-1187-4fe0-bfd8-427db3b8bf74 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.0942850 Nov 09 04:36:14.824665 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59216) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:14.865492 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a775f55a-5aac-414c-81db-3e161d0484eb tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/subnets?network_id=2b6725f5-ebfe-485a-8f42-ccb5a241ddb5&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0373743 Nov 09 04:36:14.865733 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59218) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:14.870560 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-7314a71c-18cf-4512-991f-eb69cf4af453 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-35214099', 'network_id': '0f070182-4996-4fd0-8617-1172b3c4ac5e', 'project_id': '1d10b4824e524068827e58b55e269af3', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:14.883335 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-ad8c6979-6c3b-46f7-9d9c-2340b682f0f5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '73e2c7c1-e8be-4e45-a3ee-acc8be6515c9', 'name': 'tempest-TestNetworkBasicOps-router-129683286', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.26'}], 'enable_snat': True}, 'gw_port_id': '4cd82d33-ba2a-405e-8980-983e2ba630eb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:36:11Z', 'updated_at': '2021-11-09T04:36:12Z', 'revision_number': 3, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '4cd82d33-ba2a-405e-8980-983e2ba630eb', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:99:76:3d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '73e2c7c1-e8be-4e45-a3ee-acc8be6515c9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1236, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:36:12Z', 'updated_at': '2021-11-09T04:36:12Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:14.921317 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ad8c6979-6c3b-46f7-9d9c-2340b682f0f5 None None] Checking router: 73e2c7c1-e8be-4e45-a3ee-acc8be6515c9 for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:36:14.921801 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ad8c6979-6c3b-46f7-9d9c-2340b682f0f5 None None] Updating router 73e2c7c1-e8be-4e45-a3ee-acc8be6515c9 port 4cd82d33-ba2a-405e-8980-983e2ba630eb binding host dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 04:36:14.937622 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6622c5a4-2026-4f2e-9ad5-0ae83a9f43ba tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Router 2125d78c-efca-488e-8c6a-cc02f46f5ee3 is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102162) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:36:14.946879 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ad8c6979-6c3b-46f7-9d9c-2340b682f0f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:15.015587 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6622c5a4-2026-4f2e-9ad5-0ae83a9f43ba tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:36:15.022170 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6622c5a4-2026-4f2e-9ad5-0ae83a9f43ba tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:15.026021 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b60cf066-a6e1-4fb9-a4d3-5c1add82cf3d None None] Sync routers for ids ['2125d78c-efca-488e-8c6a-cc02f46f5ee3'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:36:15.026575 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-6622c5a4-2026-4f2e-9ad5-0ae83a9f43ba tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "PUT /v2.0/routers/2125d78c-efca-488e-8c6a-cc02f46f5ee3 HTTP/1.1" status: 200 len: 698 time: 0.5091362 Nov 09 04:36:15.026784 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59220) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:15.039035 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7314a71c-18cf-4512-991f-eb69cf4af453 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Made reservation on behalf of 1d10b4824e524068827e58b55e269af3 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:36:15.042074 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b60cf066-a6e1-4fb9-a4d3-5c1add82cf3d None None] Routers {'2125d78c-efca-488e-8c6a-cc02f46f5ee3'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:36:15.042827 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-b60cf066-a6e1-4fb9-a4d3-5c1add82cf3d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:36:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['2125d78c-efca-488e-8c6a-cc02f46f5ee3'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:15.043063 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7314a71c-18cf-4512-991f-eb69cf4af453 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:15.112361 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-b441f90a-7434-46c2-8e82-d04803b756d2 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "GET /v2.0/routers/2125d78c-efca-488e-8c6a-cc02f46f5ee3 HTTP/1.1" status: 200 len: 704 time: 0.0844653 Nov 09 04:36:15.112988 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59222) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:15.115800 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-b60cf066-a6e1-4fb9-a4d3-5c1add82cf3d None None] Set router 2125d78c-efca-488e-8c6a-cc02f46f5ee3 gateway port host: None {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:36:15.131681 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:15.153326 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59224) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:15.156853 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-5395a09f-43af-4dab-8feb-07241fab7f89 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "GET /v2.0/ports?device_id=2125d78c-efca-488e-8c6a-cc02f46f5ee3 HTTP/1.1" status: 200 len: 205 time: 0.0425847 Nov 09 04:36:15.179500 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-b60cf066-a6e1-4fb9-a4d3-5c1add82cf3d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2125d78c-efca-488e-8c6a-cc02f46f5ee3', 'name': 'tempest-RoutersIpV6Test-router-1958589809', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:36:14Z', 'updated_at': '2021-11-09T04:36:14Z', 'revision_number': 2, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'gw_port_host': None}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:15.206930 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b60cf066-a6e1-4fb9-a4d3-5c1add82cf3d None None] Checking router: 2125d78c-efca-488e-8c6a-cc02f46f5ee3 for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:36:15.216313 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b60cf066-a6e1-4fb9-a4d3-5c1add82cf3d None None] Routers {'2125d78c-efca-488e-8c6a-cc02f46f5ee3'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:36:15.216923 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-b60cf066-a6e1-4fb9-a4d3-5c1add82cf3d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:36:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['2125d78c-efca-488e-8c6a-cc02f46f5ee3'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:15.231817 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ad8c6979-6c3b-46f7-9d9c-2340b682f0f5 None None] Publish callbacks [] for port, precommit_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:15.286248 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-b60cf066-a6e1-4fb9-a4d3-5c1add82cf3d None None] Set router 2125d78c-efca-488e-8c6a-cc02f46f5ee3 gateway port host: None {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:36:15.286505 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6e186a5d-8568-45d4-9d6f-4c07df1995f1 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for router, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:15.313491 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ad8c6979-6c3b-46f7-9d9c-2340b682f0f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:15.338191 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-b60cf066-a6e1-4fb9-a4d3-5c1add82cf3d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2125d78c-efca-488e-8c6a-cc02f46f5ee3', 'name': 'tempest-RoutersIpV6Test-router-1958589809', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:36:14Z', 'updated_at': '2021-11-09T04:36:14Z', 'revision_number': 2, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'gw_port_host': None}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:15.365137 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-ad8c6979-6c3b-46f7-9d9c-2340b682f0f5 None None] Attempting to bind port 4cd82d33-ba2a-405e-8980-983e2ba630eb on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:36:15.365648 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-ad8c6979-6c3b-46f7-9d9c-2340b682f0f5 None None] Attempting to bind port 4cd82d33-ba2a-405e-8980-983e2ba630eb by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:36:15.366114 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ad8c6979-6c3b-46f7-9d9c-2340b682f0f5 None None] Attempting to bind port 4cd82d33-ba2a-405e-8980-983e2ba630eb on network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:36:15.381592 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ad8c6979-6c3b-46f7-9d9c-2340b682f0f5 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 35, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:36:15.382146 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ad8c6979-6c3b-46f7-9d9c-2340b682f0f5 None None] Checking segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:36:15.382836 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ad8c6979-6c3b-46f7-9d9c-2340b682f0f5 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:15.383460 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ad8c6979-6c3b-46f7-9d9c-2340b682f0f5 None None] Bound using segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:36:15.384172 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-ad8c6979-6c3b-46f7-9d9c-2340b682f0f5 None None] Bound port: 4cd82d33-ba2a-405e-8980-983e2ba630eb, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:36:15.384851 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ad8c6979-6c3b-46f7-9d9c-2340b682f0f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:15.387988 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25b40d0b-8b80-43a0-8256-509c97f0ac9d None None] Pushing event updated for resources: {'Port': ['ID=4cd82d33-ba2a-405e-8980-983e2ba630eb,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:15.442074 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-ad8c6979-6c3b-46f7-9d9c-2340b682f0f5 None None] For port 4cd82d33-ba2a-405e-8980-983e2ba630eb, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:36:15.445381 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-ad8c6979-6c3b-46f7-9d9c-2340b682f0f5 None None] For port 4cd82d33-ba2a-405e-8980-983e2ba630eb, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=4cd82d33-ba2a-405e-8980-983e2ba630eb,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:36:15.455324 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b60cf066-a6e1-4fb9-a4d3-5c1add82cf3d None None] The sync data for ids ['2125d78c-efca-488e-8c6a-cc02f46f5ee3'] in dv-neutron-816802-2-hyperv is: [{'id': '2125d78c-efca-488e-8c6a-cc02f46f5ee3', 'name': 'tempest-RoutersIpV6Test-router-1958589809', 'tenant_id': 'd11b025703b24d109deef7bfe57a45f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:36:14Z', 'updated_at': '2021-11-09T04:36:14Z', 'revision_number': 2, 'project_id': 'd11b025703b24d109deef7bfe57a45f6', 'gw_port_host': None}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:36:15.495492 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6e186a5d-8568-45d4-9d6f-4c07df1995f1 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:15.497682 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6e186a5d-8568-45d4-9d6f-4c07df1995f1 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:15.536886 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ad8c6979-6c3b-46f7-9d9c-2340b682f0f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:15.571242 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7314a71c-18cf-4512-991f-eb69cf4af453 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:15.594968 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ad8c6979-6c3b-46f7-9d9c-2340b682f0f5 None None] Routers {'73e2c7c1-e8be-4e45-a3ee-acc8be6515c9'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:36:15.595601 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-ad8c6979-6c3b-46f7-9d9c-2340b682f0f5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:36:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['73e2c7c1-e8be-4e45-a3ee-acc8be6515c9'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:15.600347 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25b40d0b-8b80-43a0-8256-509c97f0ac9d None None] Pushing event updated for resources: {'Port': ['ID=4cd82d33-ba2a-405e-8980-983e2ba630eb,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:15.634293 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7314a71c-18cf-4512-991f-eb69cf4af453 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Subnet': ['ID=3e268933-196a-4376-a711-8b4d4d9e3036,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:15.638023 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6e186a5d-8568-45d4-9d6f-4c07df1995f1 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:15.638603 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6e186a5d-8568-45d4-9d6f-4c07df1995f1 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Fanout notify agent at l3_agent the message router_deleted on router 2125d78c-efca-488e-8c6a-cc02f46f5ee3 {{(pid=102161) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:36:15.645087 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6e186a5d-8568-45d4-9d6f-4c07df1995f1 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:15.650454 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-6e186a5d-8568-45d4-9d6f-4c07df1995f1 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "DELETE /v2.0/routers/2125d78c-efca-488e-8c6a-cc02f46f5ee3 HTTP/1.1" status: 204 len: 168 time: 0.4915934 Nov 09 04:36:15.650903 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59226) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:15.659088 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7314a71c-18cf-4512-991f-eb69cf4af453 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Checking segment: {'id': '978d57a9-319d-4116-8893-ffe00140f45e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 330, 'network_id': '0f070182-4996-4fd0-8617-1172b3c4ac5e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:36:15.659088 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7314a71c-18cf-4512-991f-eb69cf4af453 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network hostable DHCP agents. Network: 0f070182-4996-4fd0-8617-1172b3c4ac5e, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:36:15.682435 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-ffaebb8e-dd06-49a2-af0e-e9c5af9a7c96 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "GET /v2.0/ports?device_id=2125d78c-efca-488e-8c6a-cc02f46f5ee3 HTTP/1.1" status: 200 len: 205 time: 0.0298595 Nov 09 04:36:15.687509 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59228) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:15.716672 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-ad8c6979-6c3b-46f7-9d9c-2340b682f0f5 None None] Set router 73e2c7c1-e8be-4e45-a3ee-acc8be6515c9 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:36:15.731375 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-2dfbff38-e089-45b3-aa0a-3663488ae05a tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] delete failed (client error): The resource could not be found. Nov 09 04:36:15.732443 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-2dfbff38-e089-45b3-aa0a-3663488ae05a tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "DELETE /v2.0/routers/2125d78c-efca-488e-8c6a-cc02f46f5ee3 HTTP/1.1" status: 404 len: 336 time: 0.0431769 Nov 09 04:36:15.735125 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59230) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:15.745687 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7314a71c-18cf-4512-991f-eb69cf4af453 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network 0f070182-4996-4fd0-8617-1172b3c4ac5e is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:36:15.766683 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-dff0a63a-9702-4edd-be00-fcdd235bd521 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] DELETE failed (client error): The resource could not be found. Nov 09 04:36:15.769468 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-dff0a63a-9702-4edd-be00-fcdd235bd521 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:36:15.770170 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-dff0a63a-9702-4edd-be00-fcdd235bd521 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "DELETE /v2.0/subnets/07a4cdc6-7f9d-4e6c-98b9-ae041d44d264 HTTP/1.1" status: 404 len: 337 time: 0.0341532 Nov 09 04:36:15.772685 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59232) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:15.802970 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-be543196-d391-4898-bf9c-0bb9e76d98c3 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] DELETE failed (client error): The resource could not be found. Nov 09 04:36:15.803345 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-be543196-d391-4898-bf9c-0bb9e76d98c3 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:36:15.806664 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-be543196-d391-4898-bf9c-0bb9e76d98c3 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "DELETE /v2.0/subnets/75b6b6c5-0313-4754-bcde-7b2b14023f56 HTTP/1.1" status: 404 len: 337 time: 0.0329823 Nov 09 04:36:15.809245 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59234) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:15.834995 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-fd55c367-560b-44dd-94fe-1caf53041482 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] DELETE failed (client error): The resource could not be found. Nov 09 04:36:15.835452 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-fd55c367-560b-44dd-94fe-1caf53041482 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:36:15.839041 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-fd55c367-560b-44dd-94fe-1caf53041482 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "DELETE /v2.0/subnets/b46b8bfd-f2f3-4413-b04c-231ee75f8c2c HTTP/1.1" status: 404 len: 337 time: 0.0288863 Nov 09 04:36:15.841512 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59236) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:15.872130 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-8ea8450a-429a-496d-96d5-f5f36f322c25 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] DELETE failed (client error): The resource could not be found. Nov 09 04:36:15.872589 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-8ea8450a-429a-496d-96d5-f5f36f322c25 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:36:15.875772 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-8ea8450a-429a-496d-96d5-f5f36f322c25 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "DELETE /v2.0/subnets/0cd8bdb8-1377-46f0-ba25-14251b97253b HTTP/1.1" status: 404 len: 337 time: 0.0333211 Nov 09 04:36:15.879328 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-7314a71c-18cf-4512-991f-eb69cf4af453 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 0f070182-4996-4fd0-8617-1172b3c4ac5e) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:36:15.879328 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59238) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:15.891315 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7314a71c-18cf-4512-991f-eb69cf4af453 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:36:15.891444 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7314a71c-18cf-4512-991f-eb69cf4af453 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:15.900506 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d3a30e74-fd4f-40a4-9e31-320b60924fe4 None None] Network 0f070182-4996-4fd0-8617-1172b3c4ac5e requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:36:15.910212 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-b563062b-ec07-443a-8c10-6a2636975b2a tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "GET /v2.0/ports?device_id=7b9a51f0-889c-418d-bc8a-fcfd303c5053 HTTP/1.1" status: 200 len: 205 time: 0.0301585 Nov 09 04:36:15.912743 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59240) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:15.952252 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.api.v2.resource [None req-11a9f050-8981-4d7b-ba73-bc5013280c13 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] delete failed (client error): The resource could not be found. Nov 09 04:36:15.953734 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-11a9f050-8981-4d7b-ba73-bc5013280c13 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "DELETE /v2.0/routers/7b9a51f0-889c-418d-bc8a-fcfd303c5053 HTTP/1.1" status: 404 len: 336 time: 0.0387888 Nov 09 04:36:15.955998 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59242) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:15.961276 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-ad8c6979-6c3b-46f7-9d9c-2340b682f0f5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '73e2c7c1-e8be-4e45-a3ee-acc8be6515c9', 'name': 'tempest-TestNetworkBasicOps-router-129683286', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.26'}], 'enable_snat': True}, 'gw_port_id': '4cd82d33-ba2a-405e-8980-983e2ba630eb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:36:11Z', 'updated_at': '2021-11-09T04:36:12Z', 'revision_number': 3, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '4cd82d33-ba2a-405e-8980-983e2ba630eb', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:99:76:3d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '73e2c7c1-e8be-4e45-a3ee-acc8be6515c9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1236, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:36:12Z', 'updated_at': '2021-11-09T04:36:15Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:15.983852 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-0256008d-2c18-406d-9817-b4005bf30374 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "GET /v2.0/ports?device_id=c91b226a-420f-415f-839f-32317dea7a42 HTTP/1.1" status: 200 len: 205 time: 0.0267885 Nov 09 04:36:15.986985 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59244) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:15.993743 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ad8c6979-6c3b-46f7-9d9c-2340b682f0f5 None None] The sync data for ids ['73e2c7c1-e8be-4e45-a3ee-acc8be6515c9'] in dv-neutron-816802-2-hyperv is: [{'id': '73e2c7c1-e8be-4e45-a3ee-acc8be6515c9', 'name': 'tempest-TestNetworkBasicOps-router-129683286', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.26'}], 'enable_snat': True}, 'gw_port_id': '4cd82d33-ba2a-405e-8980-983e2ba630eb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:36:11Z', 'updated_at': '2021-11-09T04:36:12Z', 'revision_number': 3, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '4cd82d33-ba2a-405e-8980-983e2ba630eb', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:99:76:3d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '73e2c7c1-e8be-4e45-a3ee-acc8be6515c9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1236, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:36:12Z', 'updated_at': '2021-11-09T04:36:15Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:36:16.028099 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.api.v2.resource [None req-33f4b360-628e-4809-ae6a-9a3b4ce4a23d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] delete failed (client error): The resource could not be found. Nov 09 04:36:16.029461 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-33f4b360-628e-4809-ae6a-9a3b4ce4a23d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "DELETE /v2.0/routers/c91b226a-420f-415f-839f-32317dea7a42 HTTP/1.1" status: 404 len: 336 time: 0.0414097 Nov 09 04:36:16.031404 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59246) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:16.036733 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59248) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:16.037193 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-7314a71c-18cf-4512-991f-eb69cf4af453 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 830 time: 1.1651814 Nov 09 04:36:16.108313 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-c6443f9a-8012-45c4-868b-5cd2c7ae76cc tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] DELETE failed (client error): The resource could not be found. Nov 09 04:36:16.108850 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c6443f9a-8012-45c4-868b-5cd2c7ae76cc tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:36:16.112010 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-c6443f9a-8012-45c4-868b-5cd2c7ae76cc tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "DELETE /v2.0/subnets/8936c507-26b2-4943-9afe-a4f4bc6627ec HTTP/1.1" status: 404 len: 337 time: 0.0758581 Nov 09 04:36:16.114798 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59252) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:16.156785 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-5169476d-36a0-46dc-bbb4-494c569f5781 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "GET /v2.0/ports?device_id=a65669cd-451a-43da-ade7-853f7fe458c0 HTTP/1.1" status: 200 len: 205 time: 0.0365169 Nov 09 04:36:16.158400 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59254) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:16.207152 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-36944587-2719-4eb5-8c95-acdbd3748805 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] delete failed (client error): The resource could not be found. Nov 09 04:36:16.213874 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59256) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:16.220271 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-36944587-2719-4eb5-8c95-acdbd3748805 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "DELETE /v2.0/routers/a65669cd-451a-43da-ade7-853f7fe458c0 HTTP/1.1" status: 404 len: 336 time: 0.0523012 Nov 09 04:36:16.301531 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-32f36026-9fba-464d-8be3-bb5e05061304 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "GET /v2.0/ports?device_id=8dde0e4e-8b22-40d7-af9a-beffb259303b HTTP/1.1" status: 200 len: 205 time: 0.0861721 Nov 09 04:36:16.304290 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59258) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:16.316822 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7c98ca24-0453-41ff-8a23-1956914d00f8 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-0f070182-4996-4fd0-8617-1172b3c4ac5e', 'network_id': '0f070182-4996-4fd0-8617-1172b3c4ac5e', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ips': [{'subnet_id': '3e268933-196a-4376-a711-8b4d4d9e3036'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:36:16.318507 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7c98ca24-0453-41ff-8a23-1956914d00f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:16.354478 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.api.v2.resource [None req-fb6799ad-bca4-4356-b9ef-68990ca52883 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] delete failed (client error): The resource could not be found. Nov 09 04:36:16.355815 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-fb6799ad-bca4-4356-b9ef-68990ca52883 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "DELETE /v2.0/routers/8dde0e4e-8b22-40d7-af9a-beffb259303b HTTP/1.1" status: 404 len: 336 time: 0.0503209 Nov 09 04:36:16.358561 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59260) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:16.425757 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:16.428901 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-92962143-15f9-47f9-b1c0-6b44876757ea tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] DELETE failed (client error): The resource could not be found. Nov 09 04:36:16.429831 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-92962143-15f9-47f9-b1c0-6b44876757ea tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:36:16.438417 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-92962143-15f9-47f9-b1c0-6b44876757ea tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "DELETE /v2.0/subnets/6c138018-b731-4582-94d4-e9fdf47a1e29 HTTP/1.1" status: 404 len: 337 time: 0.0783544 Nov 09 04:36:16.441386 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59262) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:16.498660 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-d9b2c657-763e-4581-8b32-ec2e89cab9bb tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "GET /v2.0/ports?device_id=b3a8212d-bd63-42e4-9023-f5d2609ea202 HTTP/1.1" status: 200 len: 205 time: 0.0559926 Nov 09 04:36:16.499379 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59264) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:16.535544 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-7c98ca24-0453-41ff-8a23-1956914d00f8 None None] Allocated IP 172.20.0.2 (0f070182-4996-4fd0-8617-1172b3c4ac5e/3e268933-196a-4376-a711-8b4d4d9e3036/c53ea4d4-85d1-491e-8c57-6e633e95082b) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:36:16.554021 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-9d9a8071-7b53-491a-b856-db6b9ad7a5ab tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] delete failed (client error): The resource could not be found. Nov 09 04:36:16.558561 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-9d9a8071-7b53-491a-b856-db6b9ad7a5ab tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "DELETE /v2.0/routers/b3a8212d-bd63-42e4-9023-f5d2609ea202 HTTP/1.1" status: 404 len: 336 time: 0.0547504 Nov 09 04:36:16.558699 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59266) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:16.609467 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-23afd4b1-7fac-48a3-9bb7-dbb623d4de25 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] DELETE failed (client error): The resource could not be found. Nov 09 04:36:16.610171 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-23afd4b1-7fac-48a3-9bb7-dbb623d4de25 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:36:16.617760 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59268) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:16.618320 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-23afd4b1-7fac-48a3-9bb7-dbb623d4de25 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "DELETE /v2.0/subnets/23289141-7ad7-4e5f-90f0-c9511e33517d HTTP/1.1" status: 404 len: 337 time: 0.0582085 Nov 09 04:36:16.655749 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-5fa2ffc9-26d6-4218-bd02-8359b5866f44 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "GET /v2.0/ports?device_id=9ecfd3d4-c0aa-4aca-be16-36fe6637a109 HTTP/1.1" status: 200 len: 205 time: 0.0345664 Nov 09 04:36:16.657875 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59270) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:16.726918 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-ae3d5866-410b-4026-a884-b8a5efd8922c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] delete failed (client error): The resource could not be found. Nov 09 04:36:16.730488 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-ae3d5866-410b-4026-a884-b8a5efd8922c tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "DELETE /v2.0/routers/9ecfd3d4-c0aa-4aca-be16-36fe6637a109 HTTP/1.1" status: 404 len: 336 time: 0.0684505 Nov 09 04:36:16.730836 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59272) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:16.750680 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7c98ca24-0453-41ff-8a23-1956914d00f8 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:16.767258 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-91566db2-de21-42c0-a893-a51dc077f52d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] DELETE failed (client error): The resource could not be found. Nov 09 04:36:16.767695 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-91566db2-de21-42c0-a893-a51dc077f52d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:36:16.770825 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-91566db2-de21-42c0-a893-a51dc077f52d tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "DELETE /v2.0/subnets/962fe5dd-cac2-4c2e-9a96-da92da0b202f HTTP/1.1" status: 404 len: 337 time: 0.0389400 Nov 09 04:36:16.773449 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59274) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:16.807711 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.pecan_wsgi.hooks.translation [None req-3447b3df-b2e9-4c48-9ece-f1b6527e7f17 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] DELETE failed (client error): The resource could not be found. Nov 09 04:36:16.808158 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-3447b3df-b2e9-4c48-9ece-f1b6527e7f17 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102162) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:36:16.811343 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-3447b3df-b2e9-4c48-9ece-f1b6527e7f17 tempest-RoutersIpV6Test-1793153684 tempest-RoutersIpV6Test-1793153684-project] 10.222.0.24 "DELETE /v2.0/subnets/938711af-2733-44e7-981e-9b7f96c032d6 HTTP/1.1" status: 404 len: 337 time: 0.0369151 Nov 09 04:36:16.824414 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7c98ca24-0453-41ff-8a23-1956914d00f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:16.860105 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f9d39347-e173-4003-baf6-e437328f3e30 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:16.868232 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7c98ca24-0453-41ff-8a23-1956914d00f8 None None] Network 0f070182-4996-4fd0-8617-1172b3c4ac5e is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:36:16.877883 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-7c98ca24-0453-41ff-8a23-1956914d00f8 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:36:16.886225 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7c98ca24-0453-41ff-8a23-1956914d00f8 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:36:16.936428 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c98ca24-0453-41ff-8a23-1956914d00f8 None None] Pushing event updated for resources: {'Port': ['ID=c53ea4d4-85d1-491e-8c57-6e633e95082b,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:16.976494 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-7c98ca24-0453-41ff-8a23-1956914d00f8 None None] Attempting to bind port c53ea4d4-85d1-491e-8c57-6e633e95082b on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:36:16.977335 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-7c98ca24-0453-41ff-8a23-1956914d00f8 None None] Attempting to bind port c53ea4d4-85d1-491e-8c57-6e633e95082b by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '978d57a9-319d-4116-8893-ffe00140f45e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 330, 'network_id': '0f070182-4996-4fd0-8617-1172b3c4ac5e'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:36:16.977713 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7c98ca24-0453-41ff-8a23-1956914d00f8 None None] Attempting to bind port c53ea4d4-85d1-491e-8c57-6e633e95082b on network 0f070182-4996-4fd0-8617-1172b3c4ac5e {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:36:16.993294 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7c98ca24-0453-41ff-8a23-1956914d00f8 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 35, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:36:16.994470 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7c98ca24-0453-41ff-8a23-1956914d00f8 None None] Checking segment: {'id': '978d57a9-319d-4116-8893-ffe00140f45e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 330, 'network_id': '0f070182-4996-4fd0-8617-1172b3c4ac5e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:36:16.998856 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7c98ca24-0453-41ff-8a23-1956914d00f8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:16.998856 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7c98ca24-0453-41ff-8a23-1956914d00f8 None None] Bound using segment: {'id': '978d57a9-319d-4116-8893-ffe00140f45e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 330, 'network_id': '0f070182-4996-4fd0-8617-1172b3c4ac5e'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:36:16.998856 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-7c98ca24-0453-41ff-8a23-1956914d00f8 None None] Bound port: c53ea4d4-85d1-491e-8c57-6e633e95082b, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '978d57a9-319d-4116-8893-ffe00140f45e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 330, 'network_id': '0f070182-4996-4fd0-8617-1172b3c4ac5e'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:36:16.998856 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7c98ca24-0453-41ff-8a23-1956914d00f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:17.012337 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:17.081512 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-7c98ca24-0453-41ff-8a23-1956914d00f8 None None] For port c53ea4d4-85d1-491e-8c57-6e633e95082b, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:36:17.084855 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-7c98ca24-0453-41ff-8a23-1956914d00f8 None None] For port c53ea4d4-85d1-491e-8c57-6e633e95082b, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=c53ea4d4-85d1-491e-8c57-6e633e95082b,segment=NetworkSegment(978d57a9-319d-4116-8893-ffe00140f45e),segment_id=978d57a9-319d-4116-8893-ffe00140f45e)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:36:17.167655 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7c98ca24-0453-41ff-8a23-1956914d00f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:17.228690 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c98ca24-0453-41ff-8a23-1956914d00f8 None None] Pushing event updated for resources: {'Port': ['ID=c53ea4d4-85d1-491e-8c57-6e633e95082b,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:17.333187 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 4cd82d33-ba2a-405e-8980-983e2ba630eb up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:36:17.400727 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59280) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:17.412238 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 4cd82d33-ba2a-405e-8980-983e2ba630eb triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:36:17.412858 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:17.515892 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:17.543615 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-f9d39347-e173-4003-baf6-e437328f3e30 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Allocated IP 172.20.0.1 (0f070182-4996-4fd0-8617-1172b3c4ac5e/3e268933-196a-4376-a711-8b4d4d9e3036/bbd67963-8b33-4921-a309-ea3952dbf5cf) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:36:17.550016 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 4cd82d33-ba2a-405e-8980-983e2ba630eb, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=4cd82d33-ba2a-405e-8980-983e2ba630eb,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:36:17.620513 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-0799688e-a86e-4011-839a-2fdc7baa89a9 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=d11b025703b24d109deef7bfe57a45f6&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2171040 Nov 09 04:36:17.627389 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59284) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:17.641237 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:17.698808 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-28f595e0-c966-4468-ba8a-07ccfe169b20 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:17.706810 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f9d39347-e173-4003-baf6-e437328f3e30 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:17.722004 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=4cd82d33-ba2a-405e-8980-983e2ba630eb,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:17.742601 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-28f595e0-c966-4468-ba8a-07ccfe169b20 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:17.840000 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f9d39347-e173-4003-baf6-e437328f3e30 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:17.886240 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f9d39347-e173-4003-baf6-e437328f3e30 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network 0f070182-4996-4fd0-8617-1172b3c4ac5e is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:36:17.891135 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-f9d39347-e173-4003-baf6-e437328f3e30 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:36:17.894226 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f9d39347-e173-4003-baf6-e437328f3e30 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:36:17.897752 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-28f595e0-c966-4468-ba8a-07ccfe169b20 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:17.904604 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-28f595e0-c966-4468-ba8a-07ccfe169b20 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:17.904604 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-28f595e0-c966-4468-ba8a-07ccfe169b20 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/80d3f5ff-0c4d-4add-a510-4dc33e5ec4f4 HTTP/1.1" status: 204 len: 168 time: 0.2776260 Nov 09 04:36:17.922709 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28f595e0-c966-4468-ba8a-07ccfe169b20 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=80d3f5ff-0c4d-4add-a510-4dc33e5ec4f4,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:17.928046 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9d39347-e173-4003-baf6-e437328f3e30 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Port': ['ID=bbd67963-8b33-4921-a309-ea3952dbf5cf,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:17.957599 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f9d39347-e173-4003-baf6-e437328f3e30 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:18.172489 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f9d39347-e173-4003-baf6-e437328f3e30 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:18.473581 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:36:18.490520 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f9d39347-e173-4003-baf6-e437328f3e30 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:18.560317 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f9d39347-e173-4003-baf6-e437328f3e30 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:18.615924 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2af925a1-19c4-4bf9-98a6-893e9cb5a0ff None None] Network 0f070182-4996-4fd0-8617-1172b3c4ac5e requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:36:18.640049 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9d39347-e173-4003-baf6-e437328f3e30 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Port': ['ID=bbd67963-8b33-4921-a309-ea3952dbf5cf,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:18.642592 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f9d39347-e173-4003-baf6-e437328f3e30 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:18.707719 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-3e621da9-78ad-4c0f-8d2d-1cd152653f99 None None] Provisioning complete for port c53ea4d4-85d1-491e-8c57-6e633e95082b triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:36:18.708086 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3e621da9-78ad-4c0f-8d2d-1cd152653f99 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:18.751089 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f9d39347-e173-4003-baf6-e437328f3e30 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network 0f070182-4996-4fd0-8617-1172b3c4ac5e is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:36:18.752896 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-f9d39347-e173-4003-baf6-e437328f3e30 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:36:18.847685 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3e621da9-78ad-4c0f-8d2d-1cd152653f99 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:18.885791 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-3e621da9-78ad-4c0f-8d2d-1cd152653f99 None None] For port c53ea4d4-85d1-491e-8c57-6e633e95082b, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=c53ea4d4-85d1-491e-8c57-6e633e95082b,segment=NetworkSegment(978d57a9-319d-4116-8893-ffe00140f45e),segment_id=978d57a9-319d-4116-8893-ffe00140f45e)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:36:18.896478 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f9d39347-e173-4003-baf6-e437328f3e30 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Router 73e2c7c1-e8be-4e45-a3ee-acc8be6515c9 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:36:18.954823 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3e621da9-78ad-4c0f-8d2d-1cd152653f99 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:18.990044 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59308) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:19.019147 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e621da9-78ad-4c0f-8d2d-1cd152653f99 None None] Pushing event updated for resources: {'Port': ['ID=c53ea4d4-85d1-491e-8c57-6e633e95082b,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:19.024281 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f9d39347-e173-4003-baf6-e437328f3e30 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:36:19.034059 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2e80abd0-a084-4cbe-bcf3-d20bd2fde641 None None] Sync routers for ids ['73e2c7c1-e8be-4e45-a3ee-acc8be6515c9'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:36:19.037488 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-f9d39347-e173-4003-baf6-e437328f3e30 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "PUT /v2.0/routers/73e2c7c1-e8be-4e45-a3ee-acc8be6515c9/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.0018251 Nov 09 04:36:19.039404 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59312) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:19.053095 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2e80abd0-a084-4cbe-bcf3-d20bd2fde641 None None] Routers {'73e2c7c1-e8be-4e45-a3ee-acc8be6515c9'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:36:19.053812 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-2e80abd0-a084-4cbe-bcf3-d20bd2fde641 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:36:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['73e2c7c1-e8be-4e45-a3ee-acc8be6515c9'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:19.124483 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-ad58aaa7-2f60-4410-b9d8-198105e18190 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Request body: {'security_group': {'name': 'tempest-secgroup--1585529219'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:19.185611 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-2e80abd0-a084-4cbe-bcf3-d20bd2fde641 None None] Set router 73e2c7c1-e8be-4e45-a3ee-acc8be6515c9 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:36:19.224590 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-b60f6ed4-a255-4203-9a39-fae118b59f79 None None] Provisioning complete for port bbd67963-8b33-4921-a309-ea3952dbf5cf triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:36:19.224960 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b60f6ed4-a255-4203-9a39-fae118b59f79 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:19.236367 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ad58aaa7-2f60-4410-b9d8-198105e18190 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:19.247859 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ad58aaa7-2f60-4410-b9d8-198105e18190 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:19.295927 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-56a13c57-738b-466d-a5c4-64914a46ddbe tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:36:19.296580 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-56a13c57-738b-466d-a5c4-64914a46ddbe tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:36:19.297240 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-56a13c57-738b-466d-a5c4-64914a46ddbe tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:36:19.297940 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-56a13c57-738b-466d-a5c4-64914a46ddbe tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:36:19.298539 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-56a13c57-738b-466d-a5c4-64914a46ddbe tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:36:19.299054 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-56a13c57-738b-466d-a5c4-64914a46ddbe tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:36:19.303696 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-56a13c57-738b-466d-a5c4-64914a46ddbe tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/networks HTTP/1.1" status: 200 len: 4286 time: 0.2599242 Nov 09 04:36:19.306644 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59314) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:19.367684 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-b60f6ed4-a255-4203-9a39-fae118b59f79 None None] Port bbd67963-8b33-4921-a309-ea3952dbf5cf cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:36:19.390794 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 4cd82d33-ba2a-405e-8980-983e2ba630eb up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:36:19.402896 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-b60f6ed4-a255-4203-9a39-fae118b59f79 None None] Provisioning complete for port c53ea4d4-85d1-491e-8c57-6e633e95082b triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:36:19.403268 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b60f6ed4-a255-4203-9a39-fae118b59f79 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:19.406593 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ad58aaa7-2f60-4410-b9d8-198105e18190 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:19.439401 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-92045782-2686-4207-8e29-e8f5b9cc46ad tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:36:19.439957 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-92045782-2686-4207-8e29-e8f5b9cc46ad tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:36:19.440502 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-92045782-2686-4207-8e29-e8f5b9cc46ad tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:36:19.440956 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-92045782-2686-4207-8e29-e8f5b9cc46ad tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:36:19.441455 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-92045782-2686-4207-8e29-e8f5b9cc46ad tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:36:19.441898 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-92045782-2686-4207-8e29-e8f5b9cc46ad tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:36:19.447118 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-92045782-2686-4207-8e29-e8f5b9cc46ad tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 4004 time: 0.1415558 Nov 09 04:36:19.447475 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59316) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:19.495612 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ad58aaa7-2f60-4410-b9d8-198105e18190 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:19.538329 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad58aaa7-2f60-4410-b9d8-198105e18190 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d9284f9b-af3e-40c1-b385-f97d8dc94743,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:19.558563 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 4cd82d33-ba2a-405e-8980-983e2ba630eb triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:36:19.558563 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:19.597098 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ad58aaa7-2f60-4410-b9d8-198105e18190 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:19.615948 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-2e80abd0-a084-4cbe-bcf3-d20bd2fde641 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '73e2c7c1-e8be-4e45-a3ee-acc8be6515c9', 'name': 'tempest-TestNetworkBasicOps-router-129683286', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.26'}], 'enable_snat': True}, 'gw_port_id': '4cd82d33-ba2a-405e-8980-983e2ba630eb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:36:11Z', 'updated_at': '2021-11-09T04:36:18Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '4cd82d33-ba2a-405e-8980-983e2ba630eb', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:99:76:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '73e2c7c1-e8be-4e45-a3ee-acc8be6515c9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1236, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:36:12Z', 'updated_at': '2021-11-09T04:36:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'bbd67963-8b33-4921-a309-ea3952dbf5cf', 'name': '', 'network_id': '0f070182-4996-4fd0-8617-1172b3c4ac5e', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:7b:3e:99', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '73e2c7c1-e8be-4e45-a3ee-acc8be6515c9', 'device_owner': 'network:router_interface', 'standard_attr_id': 1245, 'fixed_ips': [{'subnet_id': '3e268933-196a-4376-a711-8b4d4d9e3036', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:36:17Z', 'updated_at': '2021-11-09T04:36:18Z', 'revision_number': 2, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '3e268933-196a-4376-a711-8b4d4d9e3036', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:19.646387 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2e80abd0-a084-4cbe-bcf3-d20bd2fde641 None None] Checking router: 73e2c7c1-e8be-4e45-a3ee-acc8be6515c9 for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:36:19.646752 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2e80abd0-a084-4cbe-bcf3-d20bd2fde641 None None] Updating router 73e2c7c1-e8be-4e45-a3ee-acc8be6515c9 port bbd67963-8b33-4921-a309-ea3952dbf5cf binding host dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 04:36:19.664107 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ad58aaa7-2f60-4410-b9d8-198105e18190 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:19.681157 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-7b8b2edf-0d45-46d0-b5fb-db5adcd2afa0 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/routers HTTP/1.1" status: 200 len: 3046 time: 0.2298737 Nov 09 04:36:19.698602 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-2e80abd0-a084-4cbe-bcf3-d20bd2fde641 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:19.700151 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad58aaa7-2f60-4410-b9d8-198105e18190 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Pushing event updated for resources: {'SecurityGroup': ['ID=531bfad8-740f-42d4-9dcc-9c22686c0fe4,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:19.733680 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device c53ea4d4-85d1-491e-8c57-6e633e95082b up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:36:19.757649 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ad58aaa7-2f60-4410-b9d8-198105e18190 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:19.762003 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-ad58aaa7-2f60-4410-b9d8-198105e18190 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.7679408 Nov 09 04:36:19.762264 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59320) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:19.788108 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-387b8604-f4c2-49cb-9d84-2ee25363a064 None None] Provisioning complete for port bbd67963-8b33-4921-a309-ea3952dbf5cf triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:36:19.788495 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-387b8604-f4c2-49cb-9d84-2ee25363a064 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:19.820707 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-5f13db97-3226-4d2b-90c1-f749f95b1698 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 4545 time: 0.0547800 Nov 09 04:36:19.820949 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59322) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:19.825906 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-a591c4f4-9d93-4f16-a9f1-9ea1479c72ee tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Request body: {'security_group': {'name': 'tempest-security--1839554899', 'description': 'tempest-security-description-182451885'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:19.859967 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a591c4f4-9d93-4f16-a9f1-9ea1479c72ee tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:19.907545 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-387b8604-f4c2-49cb-9d84-2ee25363a064 None None] Port bbd67963-8b33-4921-a309-ea3952dbf5cf cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:36:19.924342 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59324) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:19.928950 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-7ae84972-853c-4a14-8e21-6a837c2e671d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-515545853', 'description': 'tempest-secgroup-smoke-515545853 description', 'project_id': '1d10b4824e524068827e58b55e269af3'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:19.935277 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a591c4f4-9d93-4f16-a9f1-9ea1479c72ee tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:19.939707 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port c53ea4d4-85d1-491e-8c57-6e633e95082b triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:36:19.940081 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:20.034455 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a591c4f4-9d93-4f16-a9f1-9ea1479c72ee tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:20.037212 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a591c4f4-9d93-4f16-a9f1-9ea1479c72ee tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:20.038605 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a591c4f4-9d93-4f16-a9f1-9ea1479c72ee tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "PUT /v2.0/security-groups/531bfad8-740f-42d4-9dcc-9c22686c0fe4 HTTP/1.1" status: 200 len: 1796 time: 0.2161720 Nov 09 04:36:20.041707 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59326) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:20.050968 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7ae84972-853c-4a14-8e21-6a837c2e671d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:20.082529 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a591c4f4-9d93-4f16-a9f1-9ea1479c72ee tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Pushing event updated for resources: {'SecurityGroup': ['ID=531bfad8-740f-42d4-9dcc-9c22686c0fe4,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:20.082777 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-74e37999-1e5c-4af6-9db5-5322be766c28 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "GET /v2.0/security-groups/531bfad8-740f-42d4-9dcc-9c22686c0fe4 HTTP/1.1" status: 200 len: 1796 time: 0.0385633 Nov 09 04:36:20.084617 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59328) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:20.137836 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7ae84972-853c-4a14-8e21-6a837c2e671d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:20.139442 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-aa4e13bf-e88b-4037-80f0-05b77fc77b04 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:20.140252 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-2e80abd0-a084-4cbe-bcf3-d20bd2fde641 None None] Publish callbacks [] for port, precommit_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:20.162404 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-aa4e13bf-e88b-4037-80f0-05b77fc77b04 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:20.229057 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7ae84972-853c-4a14-8e21-6a837c2e671d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:20.252096 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-2e80abd0-a084-4cbe-bcf3-d20bd2fde641 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:20.260635 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ae84972-853c-4a14-8e21-6a837c2e671d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroup': ['ID=981c1801-295c-44ec-8fb7-4111fb839249,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:20.303663 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-aa4e13bf-e88b-4037-80f0-05b77fc77b04 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:20.304395 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b59f39cf-8d5d-446b-b3e6-436def5fe570 None None] Pushing event updated for resources: {'Port': ['ID=bbd67963-8b33-4921-a309-ea3952dbf5cf,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:20.307834 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-aa4e13bf-e88b-4037-80f0-05b77fc77b04 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:20.313379 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-aa4e13bf-e88b-4037-80f0-05b77fc77b04 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "DELETE /v2.0/security-groups/531bfad8-740f-42d4-9dcc-9c22686c0fe4 HTTP/1.1" status: 204 len: 168 time: 0.2236080 Nov 09 04:36:20.313524 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59330) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:20.326130 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa4e13bf-e88b-4037-80f0-05b77fc77b04 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=531bfad8-740f-42d4-9dcc-9c22686c0fe4,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:20.343297 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7ae84972-853c-4a14-8e21-6a837c2e671d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:20.347684 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59332) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:20.347855 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-7ae84972-853c-4a14-8e21-6a837c2e671d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.4222682 Nov 09 04:36:20.353681 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-639c7826-eabc-48ca-8d35-13af631d010d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': '981c1801-295c-44ec-8fb7-4111fb839249', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:20.367125 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-ec02a72c-cb52-453a-8723-824b2e9f2b59 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0538602 Nov 09 04:36:20.370328 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59334) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:20.376227 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-2e80abd0-a084-4cbe-bcf3-d20bd2fde641 None None] Attempting to bind port bbd67963-8b33-4921-a309-ea3952dbf5cf on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:36:20.376227 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-2e80abd0-a084-4cbe-bcf3-d20bd2fde641 None None] Attempting to bind port bbd67963-8b33-4921-a309-ea3952dbf5cf by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '978d57a9-319d-4116-8893-ffe00140f45e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 330, 'network_id': '0f070182-4996-4fd0-8617-1172b3c4ac5e'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:36:20.376525 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e80abd0-a084-4cbe-bcf3-d20bd2fde641 None None] Attempting to bind port bbd67963-8b33-4921-a309-ea3952dbf5cf on network 0f070182-4996-4fd0-8617-1172b3c4ac5e {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:36:20.392231 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e80abd0-a084-4cbe-bcf3-d20bd2fde641 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 36, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:36:20.392693 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e80abd0-a084-4cbe-bcf3-d20bd2fde641 None None] Checking segment: {'id': '978d57a9-319d-4116-8893-ffe00140f45e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 330, 'network_id': '0f070182-4996-4fd0-8617-1172b3c4ac5e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:36:20.392830 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-7c51bb74-56df-4f3c-bcd3-6226de46477f tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] delete failed (client error): The resource could not be found. Nov 09 04:36:20.393037 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-2e80abd0-a084-4cbe-bcf3-d20bd2fde641 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:20.393426 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e80abd0-a084-4cbe-bcf3-d20bd2fde641 None None] Bound using segment: {'id': '978d57a9-319d-4116-8893-ffe00140f45e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 330, 'network_id': '0f070182-4996-4fd0-8617-1172b3c4ac5e'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:36:20.393908 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-2e80abd0-a084-4cbe-bcf3-d20bd2fde641 None None] Bound port: bbd67963-8b33-4921-a309-ea3952dbf5cf, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '978d57a9-319d-4116-8893-ffe00140f45e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 330, 'network_id': '0f070182-4996-4fd0-8617-1172b3c4ac5e'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:36:20.394269 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-2e80abd0-a084-4cbe-bcf3-d20bd2fde641 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:20.395535 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-7c51bb74-56df-4f3c-bcd3-6226de46477f tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "DELETE /v2.0/security-groups/531bfad8-740f-42d4-9dcc-9c22686c0fe4 HTTP/1.1" status: 404 len: 347 time: 0.0236421 Nov 09 04:36:20.399052 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59336) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:20.404167 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-c1f8caad-b59b-4d70-84da-ec5d18b43947 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Request body: {'security_group': {'name': 'tempest-secgroup--1925232474'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:20.456153 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-639c7826-eabc-48ca-8d35-13af631d010d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:20.468326 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-2e80abd0-a084-4cbe-bcf3-d20bd2fde641 None None] For port bbd67963-8b33-4921-a309-ea3952dbf5cf, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:36:20.471930 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-2e80abd0-a084-4cbe-bcf3-d20bd2fde641 None None] For port bbd67963-8b33-4921-a309-ea3952dbf5cf, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=bbd67963-8b33-4921-a309-ea3952dbf5cf,segment=NetworkSegment(978d57a9-319d-4116-8893-ffe00140f45e),segment_id=978d57a9-319d-4116-8893-ffe00140f45e)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:36:20.511877 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-639c7826-eabc-48ca-8d35-13af631d010d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:20.538876 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-cce27e9a-192e-4ae3-9926-d31d14975aa5 None None] Provisioning complete for port bbd67963-8b33-4921-a309-ea3952dbf5cf triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:36:20.539174 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-cce27e9a-192e-4ae3-9926-d31d14975aa5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:20.605319 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-639c7826-eabc-48ca-8d35-13af631d010d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:20.609969 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c1f8caad-b59b-4d70-84da-ec5d18b43947 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:20.635231 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-639c7826-eabc-48ca-8d35-13af631d010d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0e95429e-b754-4405-85ce-574ae7271f82,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:20.699998 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c1f8caad-b59b-4d70-84da-ec5d18b43947 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:20.709037 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-2e80abd0-a084-4cbe-bcf3-d20bd2fde641 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:20.721258 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-639c7826-eabc-48ca-8d35-13af631d010d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:20.722478 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-639c7826-eabc-48ca-8d35-13af631d010d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3731656 Nov 09 04:36:20.730585 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59338) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:20.735706 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-1817e85a-9f5c-4231-bc3c-37914da4d872 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': '981c1801-295c-44ec-8fb7-4111fb839249', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:20.748849 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-cce27e9a-192e-4ae3-9926-d31d14975aa5 None None] Port bbd67963-8b33-4921-a309-ea3952dbf5cf cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:36:20.777718 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c1f8caad-b59b-4d70-84da-ec5d18b43947 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:20.777903 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b59f39cf-8d5d-446b-b3e6-436def5fe570 None None] Pushing event updated for resources: {'Port': ['ID=bbd67963-8b33-4921-a309-ea3952dbf5cf,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:20.780985 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2e80abd0-a084-4cbe-bcf3-d20bd2fde641 None None] Routers {'73e2c7c1-e8be-4e45-a3ee-acc8be6515c9'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:36:20.781483 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-2e80abd0-a084-4cbe-bcf3-d20bd2fde641 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:36:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['73e2c7c1-e8be-4e45-a3ee-acc8be6515c9'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:20.814157 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1f8caad-b59b-4d70-84da-ec5d18b43947 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Pushing event updated for resources: {'SecurityGroup': ['ID=096cd754-0008-40dd-8ee7-457aa5e9717b,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:20.846073 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1817e85a-9f5c-4231-bc3c-37914da4d872 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:20.895893 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-2e80abd0-a084-4cbe-bcf3-d20bd2fde641 None None] Set router 73e2c7c1-e8be-4e45-a3ee-acc8be6515c9 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:36:20.920475 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1817e85a-9f5c-4231-bc3c-37914da4d872 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:20.963336 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c1f8caad-b59b-4d70-84da-ec5d18b43947 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:20.967619 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-c1f8caad-b59b-4d70-84da-ec5d18b43947 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.5643909 Nov 09 04:36:20.967777 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59340) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:20.972488 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-1be4791f-5918-4708-bb84-f6f7ffbe20c1 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Request body: {'security_group_rule': {'security_group_id': '096cd754-0008-40dd-8ee7-457aa5e9717b', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'tcp', 'port_range_min': 77, 'port_range_max': 77, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:21.030711 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-3f24bbf8-f11b-4346-8df5-11eaaa58c61f None None] Provisioning complete for port bbd67963-8b33-4921-a309-ea3952dbf5cf triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:36:21.031017 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3f24bbf8-f11b-4346-8df5-11eaaa58c61f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:21.055173 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1817e85a-9f5c-4231-bc3c-37914da4d872 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:21.069673 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1817e85a-9f5c-4231-bc3c-37914da4d872 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=486f077b-6309-423d-999f-f04ae580c63f,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:21.084505 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1be4791f-5918-4708-bb84-f6f7ffbe20c1 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:21.130246 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1be4791f-5918-4708-bb84-f6f7ffbe20c1 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:21.161353 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3f24bbf8-f11b-4346-8df5-11eaaa58c61f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:21.189699 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-2e80abd0-a084-4cbe-bcf3-d20bd2fde641 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '73e2c7c1-e8be-4e45-a3ee-acc8be6515c9', 'name': 'tempest-TestNetworkBasicOps-router-129683286', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.26'}], 'enable_snat': True}, 'gw_port_id': '4cd82d33-ba2a-405e-8980-983e2ba630eb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:36:11Z', 'updated_at': '2021-11-09T04:36:18Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '4cd82d33-ba2a-405e-8980-983e2ba630eb', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:99:76:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '73e2c7c1-e8be-4e45-a3ee-acc8be6515c9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1236, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:36:12Z', 'updated_at': '2021-11-09T04:36:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'bbd67963-8b33-4921-a309-ea3952dbf5cf', 'name': '', 'network_id': '0f070182-4996-4fd0-8617-1172b3c4ac5e', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:7b:3e:99', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '73e2c7c1-e8be-4e45-a3ee-acc8be6515c9', 'device_owner': 'network:router_interface', 'standard_attr_id': 1245, 'fixed_ips': [{'subnet_id': '3e268933-196a-4376-a711-8b4d4d9e3036', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:36:17Z', 'updated_at': '2021-11-09T04:36:20Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '3e268933-196a-4376-a711-8b4d4d9e3036', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:21.197861 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1817e85a-9f5c-4231-bc3c-37914da4d872 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:21.199459 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-1817e85a-9f5c-4231-bc3c-37914da4d872 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.4679677 Nov 09 04:36:21.202166 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59342) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:21.206583 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-3f7c4e8a-f5c9-4fba-9de1-7b2ddddf6c17 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': '981c1801-295c-44ec-8fb7-4111fb839249', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:21.225921 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2e80abd0-a084-4cbe-bcf3-d20bd2fde641 None None] The sync data for ids ['73e2c7c1-e8be-4e45-a3ee-acc8be6515c9'] in dv-neutron-816802-2-hyperv is: [{'id': '73e2c7c1-e8be-4e45-a3ee-acc8be6515c9', 'name': 'tempest-TestNetworkBasicOps-router-129683286', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.26'}], 'enable_snat': True}, 'gw_port_id': '4cd82d33-ba2a-405e-8980-983e2ba630eb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:36:11Z', 'updated_at': '2021-11-09T04:36:18Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '4cd82d33-ba2a-405e-8980-983e2ba630eb', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:99:76:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '73e2c7c1-e8be-4e45-a3ee-acc8be6515c9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1236, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:36:12Z', 'updated_at': '2021-11-09T04:36:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'bbd67963-8b33-4921-a309-ea3952dbf5cf', 'name': '', 'network_id': '0f070182-4996-4fd0-8617-1172b3c4ac5e', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:7b:3e:99', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '73e2c7c1-e8be-4e45-a3ee-acc8be6515c9', 'device_owner': 'network:router_interface', 'standard_attr_id': 1245, 'fixed_ips': [{'subnet_id': '3e268933-196a-4376-a711-8b4d4d9e3036', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:36:17Z', 'updated_at': '2021-11-09T04:36:20Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '3e268933-196a-4376-a711-8b4d4d9e3036', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:36:21.229154 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-3f24bbf8-f11b-4346-8df5-11eaaa58c61f None None] For port bbd67963-8b33-4921-a309-ea3952dbf5cf, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=bbd67963-8b33-4921-a309-ea3952dbf5cf,segment=NetworkSegment(978d57a9-319d-4116-8893-ffe00140f45e),segment_id=978d57a9-319d-4116-8893-ffe00140f45e)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:36:21.258063 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1be4791f-5918-4708-bb84-f6f7ffbe20c1 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:21.287637 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1be4791f-5918-4708-bb84-f6f7ffbe20c1 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c40ea969-c934-4443-a8b3-297bab9f4e0a,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:21.302217 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1be4791f-5918-4708-bb84-f6f7ffbe20c1 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:36:21.302217 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1be4791f-5918-4708-bb84-f6f7ffbe20c1 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:36:21.302217 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1be4791f-5918-4708-bb84-f6f7ffbe20c1 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:36:21.302217 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1be4791f-5918-4708-bb84-f6f7ffbe20c1 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:36:21.302217 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1be4791f-5918-4708-bb84-f6f7ffbe20c1 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:36:21.302217 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1be4791f-5918-4708-bb84-f6f7ffbe20c1 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:36:21.302217 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1be4791f-5918-4708-bb84-f6f7ffbe20c1 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:36:21.302217 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1be4791f-5918-4708-bb84-f6f7ffbe20c1 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:36:21.302217 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1be4791f-5918-4708-bb84-f6f7ffbe20c1 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:36:21.302217 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1be4791f-5918-4708-bb84-f6f7ffbe20c1 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:36:21.302217 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1be4791f-5918-4708-bb84-f6f7ffbe20c1 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:36:21.302217 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1be4791f-5918-4708-bb84-f6f7ffbe20c1 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:36:21.331798 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3f7c4e8a-f5c9-4fba-9de1-7b2ddddf6c17 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:21.360948 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3f24bbf8-f11b-4346-8df5-11eaaa58c61f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:21.380453 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1be4791f-5918-4708-bb84-f6f7ffbe20c1 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:21.385017 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-1be4791f-5918-4708-bb84-f6f7ffbe20c1 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.4132047 Nov 09 04:36:21.385434 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59344) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:21.392548 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3f7c4e8a-f5c9-4fba-9de1-7b2ddddf6c17 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:21.418930 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ab129242-2717-4fff-ae65-cae726b7424f tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:21.420776 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f24bbf8-f11b-4346-8df5-11eaaa58c61f None None] Pushing event updated for resources: {'Port': ['ID=bbd67963-8b33-4921-a309-ea3952dbf5cf,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:21.431704 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ab129242-2717-4fff-ae65-cae726b7424f tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:21.447352 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3f7c4e8a-f5c9-4fba-9de1-7b2ddddf6c17 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:21.468715 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f7c4e8a-f5c9-4fba-9de1-7b2ddddf6c17 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d0853b5e-a5db-4725-a6e2-57b011252841,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:21.535873 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ab129242-2717-4fff-ae65-cae726b7424f tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:21.536633 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ab129242-2717-4fff-ae65-cae726b7424f tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:21.537754 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-ab129242-2717-4fff-ae65-cae726b7424f tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "DELETE /v2.0/security-group-rules/c40ea969-c934-4443-a8b3-297bab9f4e0a HTTP/1.1" status: 204 len: 168 time: 0.1512640 Nov 09 04:36:21.542247 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59346) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:21.544752 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab129242-2717-4fff-ae65-cae726b7424f tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=c40ea969-c934-4443-a8b3-297bab9f4e0a,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:21.559713 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3f7c4e8a-f5c9-4fba-9de1-7b2ddddf6c17 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:21.563534 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-3f7c4e8a-f5c9-4fba-9de1-7b2ddddf6c17 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3577456 Nov 09 04:36:21.563776 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59348) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:21.569670 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-3c0bae91-8244-4c69-b52e-79eeb8c24d5d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': '981c1801-295c-44ec-8fb7-4111fb839249', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:21.618005 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-f18185cf-c11c-4423-a0d0-f9da7c024f5c tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.0727224 Nov 09 04:36:21.618964 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59350) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:21.674060 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2550ad7a-83d5-476b-bcf0-37216c435765 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:21.702571 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2550ad7a-83d5-476b-bcf0-37216c435765 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:21.711068 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3c0bae91-8244-4c69-b52e-79eeb8c24d5d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:21.795072 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3c0bae91-8244-4c69-b52e-79eeb8c24d5d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:21.880375 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2550ad7a-83d5-476b-bcf0-37216c435765 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:21.884960 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2550ad7a-83d5-476b-bcf0-37216c435765 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:21.885581 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-2550ad7a-83d5-476b-bcf0-37216c435765 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "DELETE /v2.0/security-groups/096cd754-0008-40dd-8ee7-457aa5e9717b HTTP/1.1" status: 204 len: 168 time: 0.2656336 Nov 09 04:36:21.888426 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59352) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:21.900727 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2550ad7a-83d5-476b-bcf0-37216c435765 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=096cd754-0008-40dd-8ee7-457aa5e9717b,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:21.926309 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3c0bae91-8244-4c69-b52e-79eeb8c24d5d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:21.943005 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a5f6e09c-2ad5-4051-9d68-29028d5474b8 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0532115 Nov 09 04:36:21.948136 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59354) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:21.953991 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c0bae91-8244-4c69-b52e-79eeb8c24d5d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0e67349b-f2b8-4190-a9be-16d6cd3821e6,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:21.954158 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-1e72b638-a783-4d90-b4d1-b7ef8f3db249 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Request body: {'security_group': {'name': 'tempest-secgroup--1497055342'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:22.029420 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3c0bae91-8244-4c69-b52e-79eeb8c24d5d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:22.033236 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-3c0bae91-8244-4c69-b52e-79eeb8c24d5d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.4661369 Nov 09 04:36:22.033630 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59356) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:22.038298 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-bcf529c2-1d36-402d-90ff-4bb377e4400d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': '981c1801-295c-44ec-8fb7-4111fb839249', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:22.109322 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1e72b638-a783-4d90-b4d1-b7ef8f3db249 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:22.188511 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1e72b638-a783-4d90-b4d1-b7ef8f3db249 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:22.191483 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.securitygroups_db [None req-bcf529c2-1d36-402d-90ff-4bb377e4400d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Project 1d10b4824e524068827e58b55e269af3 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 09 04:36:22.196799 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bcf529c2-1d36-402d-90ff-4bb377e4400d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:22.240272 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1e72b638-a783-4d90-b4d1-b7ef8f3db249 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:22.257401 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bcf529c2-1d36-402d-90ff-4bb377e4400d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:22.270385 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e72b638-a783-4d90-b4d1-b7ef8f3db249 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Pushing event updated for resources: {'SecurityGroup': ['ID=567fe68a-c40d-4bb3-bfa2-82eedc6fcda7,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:22.303559 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bcf529c2-1d36-402d-90ff-4bb377e4400d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:22.322786 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bcf529c2-1d36-402d-90ff-4bb377e4400d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e05a8d5d-2fb7-4179-b71d-99acb0c59b57,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:22.323026 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1e72b638-a783-4d90-b4d1-b7ef8f3db249 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:22.327080 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59358) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:22.327420 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1e72b638-a783-4d90-b4d1-b7ef8f3db249 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.3779998 Nov 09 04:36:22.332349 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-02f02210-63c3-49c3-bec0-b5980e7dc2ff tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Request body: {'security_group_rule': {'security_group_id': '567fe68a-c40d-4bb3-bfa2-82eedc6fcda7', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'ipv6-icmp', 'port_range_min': 3, 'port_range_max': 2, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:22.381655 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bcf529c2-1d36-402d-90ff-4bb377e4400d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:22.382957 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-bcf529c2-1d36-402d-90ff-4bb377e4400d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.3481259 Nov 09 04:36:22.386560 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59360) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:22.392853 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-0f5fa0ad-35f8-4193-ab08-f37826b0a15e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': '981c1801-295c-44ec-8fb7-4111fb839249', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:22.462618 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-02f02210-63c3-49c3-bec0-b5980e7dc2ff tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:22.529951 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-02f02210-63c3-49c3-bec0-b5980e7dc2ff tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:22.536256 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.securitygroups_db [None req-0f5fa0ad-35f8-4193-ab08-f37826b0a15e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Project 1d10b4824e524068827e58b55e269af3 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 09 04:36:22.541610 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0f5fa0ad-35f8-4193-ab08-f37826b0a15e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:22.603918 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0f5fa0ad-35f8-4193-ab08-f37826b0a15e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:22.629132 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-02f02210-63c3-49c3-bec0-b5980e7dc2ff tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:22.650190 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02f02210-63c3-49c3-bec0-b5980e7dc2ff tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c66e8cf6-0a1d-4087-abed-1b0b93f81a97,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:22.714369 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0f5fa0ad-35f8-4193-ab08-f37826b0a15e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:22.732612 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f5fa0ad-35f8-4193-ab08-f37826b0a15e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=00f51d4f-2e27-4622-8857-d463f596587f,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:22.743631 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-02f02210-63c3-49c3-bec0-b5980e7dc2ff tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:22.744862 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-02f02210-63c3-49c3-bec0-b5980e7dc2ff tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.4167459 Nov 09 04:36:22.750789 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59362) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:22.752014 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-be7c0791-08ea-4501-97bb-9a0bf108ac83 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Request body: {'security_group_rule': {'security_group_id': '567fe68a-c40d-4bb3-bfa2-82eedc6fcda7', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'ipv6-icmp', 'port_range_min': 3, 'port_range_max': 0, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:22.830884 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0f5fa0ad-35f8-4193-ab08-f37826b0a15e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:22.832129 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-0f5fa0ad-35f8-4193-ab08-f37826b0a15e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.4438732 Nov 09 04:36:22.959879 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-be7c0791-08ea-4501-97bb-9a0bf108ac83 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:23.023362 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-be7c0791-08ea-4501-97bb-9a0bf108ac83 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:23.031528 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-976bd548-9ba6-48b6-b605-18659ec34bcb req-5cd2d60c-94ef-4921-988d-89ed035cb18e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-515545853&fields=id&tenant_id=1d10b4824e524068827e58b55e269af3 HTTP/1.1" status: 200 len: 267 time: 0.0438809 Nov 09 04:36:23.103626 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-be7c0791-08ea-4501-97bb-9a0bf108ac83 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:23.124464 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be7c0791-08ea-4501-97bb-9a0bf108ac83 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=afd22965-83ca-4c5d-a585-598bb1d78448,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:23.144608 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-976bd548-9ba6-48b6-b605-18659ec34bcb req-03aa1558-a90f-46ab-a986-251c22a93c24 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:36:23.146047 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-976bd548-9ba6-48b6-b605-18659ec34bcb req-03aa1558-a90f-46ab-a986-251c22a93c24 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/networks?id=0f070182-4996-4fd0-8617-1172b3c4ac5e HTTP/1.1" status: 200 len: 797 time: 0.1077249 Nov 09 04:36:23.162345 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-976bd548-9ba6-48b6-b605-18659ec34bcb req-887ca61e-9838-4c71-a04c-9a989e281f6b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/quotas/1d10b4824e524068827e58b55e269af3 HTTP/1.1" status: 200 len: 375 time: 0.0099440 Nov 09 04:36:23.210303 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-be7c0791-08ea-4501-97bb-9a0bf108ac83 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:23.212456 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-be7c0791-08ea-4501-97bb-9a0bf108ac83 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.4633155 Nov 09 04:36:23.215124 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59380) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:23.222013 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-111b8a37-36eb-4bbe-ab4f-ac3bc2993806 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Request body: {'security_group_rule': {'security_group_id': '567fe68a-c40d-4bb3-bfa2-82eedc6fcda7', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'ipv6-icmp', 'port_range_min': 8, 'port_range_max': 0, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:23.225886 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-976bd548-9ba6-48b6-b605-18659ec34bcb req-2d9241dc-255b-470e-ae60-d35338bbbb52 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0573995 Nov 09 04:36:23.282154 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device bbd67963-8b33-4921-a309-ea3952dbf5cf up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:36:23.302393 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-111b8a37-36eb-4bbe-ab4f-ac3bc2993806 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:23.332813 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-976bd548-9ba6-48b6-b605-18659ec34bcb req-630ebded-3a90-4b25-996e-d32fcb8c6cc6 service neutron] 10.222.0.24 "GET /v2.0/networks/0f070182-4996-4fd0-8617-1172b3c4ac5e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0892353 Nov 09 04:36:23.345944 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port bbd67963-8b33-4921-a309-ea3952dbf5cf triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:36:23.346484 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:23.366810 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-111b8a37-36eb-4bbe-ab4f-ac3bc2993806 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:23.429040 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-111b8a37-36eb-4bbe-ab4f-ac3bc2993806 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:23.430464 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-976bd548-9ba6-48b6-b605-18659ec34bcb req-179a4d78-cd4d-46b7-8168-3bdfa568bfe6 service neutron] 10.222.0.24 "GET /v2.0/networks/0f070182-4996-4fd0-8617-1172b3c4ac5e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0903039 Nov 09 04:36:23.447486 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111b8a37-36eb-4bbe-ab4f-ac3bc2993806 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c8f964f9-cd21-4a68-a7bb-e46f104a392d,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:23.493670 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-111b8a37-36eb-4bbe-ab4f-ac3bc2993806 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:23.497554 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-111b8a37-36eb-4bbe-ab4f-ac3bc2993806 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.2787824 Nov 09 04:36:23.497735 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59382) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:23.503113 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-1093d70d-c460-43ed-b5a5-d71140c0d0aa tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Request body: {'security_group_rule': {'security_group_id': '567fe68a-c40d-4bb3-bfa2-82eedc6fcda7', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'ipv6-icmp', 'port_range_min': 0, 'port_range_max': 0, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:23.652922 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1093d70d-c460-43ed-b5a5-d71140c0d0aa tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:23.680984 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3981b98d-3b7f-4a39-95c0-edb3d9495de3 req-02035b2f-d6ec-455d-9c32-af84b74c728d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=f5b9180a-61b4-4ed5-a5a7-a05b102af54c HTTP/1.1" status: 200 len: 210 time: 0.0379312 Nov 09 04:36:23.730767 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1093d70d-c460-43ed-b5a5-d71140c0d0aa tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:23.781355 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1093d70d-c460-43ed-b5a5-d71140c0d0aa tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:23.799493 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1093d70d-c460-43ed-b5a5-d71140c0d0aa tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=58c0b2a9-480e-4d13-be75-6f78ddad5b9f,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:23.910592 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1093d70d-c460-43ed-b5a5-d71140c0d0aa tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:23.912921 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-1093d70d-c460-43ed-b5a5-d71140c0d0aa tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.4131536 Nov 09 04:36:23.914567 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59392) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:23.918905 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-c52235ef-8deb-475b-91bb-67ed1d5557b7 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Request body: {'security_group_rule': {'security_group_id': '567fe68a-c40d-4bb3-bfa2-82eedc6fcda7', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'ipv6-icmp', 'port_range_min': 11, 'port_range_max': None, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:24.028407 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c52235ef-8deb-475b-91bb-67ed1d5557b7 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:24.087093 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c52235ef-8deb-475b-91bb-67ed1d5557b7 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:24.175518 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c52235ef-8deb-475b-91bb-67ed1d5557b7 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:24.193729 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c52235ef-8deb-475b-91bb-67ed1d5557b7 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b2e5b91e-3f28-45a5-9eeb-b3a7163191f7,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:24.285945 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c52235ef-8deb-475b-91bb-67ed1d5557b7 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:24.287202 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-c52235ef-8deb-475b-91bb-67ed1d5557b7 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 772 time: 0.3716543 Nov 09 04:36:24.290528 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59396) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:24.318868 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-512571a8-cc96-4434-baa7-9722a696e964 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:24.326666 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-512571a8-cc96-4434-baa7-9722a696e964 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:24.466690 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-512571a8-cc96-4434-baa7-9722a696e964 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:24.471694 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-512571a8-cc96-4434-baa7-9722a696e964 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:24.473053 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-512571a8-cc96-4434-baa7-9722a696e964 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "DELETE /v2.0/security-group-rules/b2e5b91e-3f28-45a5-9eeb-b3a7163191f7 HTTP/1.1" status: 204 len: 168 time: 0.1814787 Nov 09 04:36:24.475759 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59398) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:24.481479 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-512571a8-cc96-4434-baa7-9722a696e964 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=b2e5b91e-3f28-45a5-9eeb-b3a7163191f7,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:24.550827 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a6188384-ee56-497c-89ae-b43ca7a53521 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 5751 time: 0.0727715 Nov 09 04:36:24.552586 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59400) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:24.576311 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a9f72b3b-1456-4942-9d15-2f620ced1f45 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:24.583829 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a9f72b3b-1456-4942-9d15-2f620ced1f45 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:24.747569 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a9f72b3b-1456-4942-9d15-2f620ced1f45 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:24.749745 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a9f72b3b-1456-4942-9d15-2f620ced1f45 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:24.750879 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a9f72b3b-1456-4942-9d15-2f620ced1f45 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "DELETE /v2.0/security-group-rules/58c0b2a9-480e-4d13-be75-6f78ddad5b9f HTTP/1.1" status: 204 len: 168 time: 0.1973901 Nov 09 04:36:24.753658 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59404) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:24.766769 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9f72b3b-1456-4942-9d15-2f620ced1f45 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=58c0b2a9-480e-4d13-be75-6f78ddad5b9f,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:24.784567 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-cf457fd7-deaa-4cdb-a757-fd7fe701d6a3 req-80b4e154-7007-4163-b515-4422181ec696 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=f5b9180a-61b4-4ed5-a5a7-a05b102af54c HTTP/1.1" status: 200 len: 210 time: 0.0314791 Nov 09 04:36:24.789645 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9f72b3b-1456-4942-9d15-2f620ced1f45 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:36:24.790576 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9f72b3b-1456-4942-9d15-2f620ced1f45 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:36:24.790928 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9f72b3b-1456-4942-9d15-2f620ced1f45 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:36:24.791267 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9f72b3b-1456-4942-9d15-2f620ced1f45 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:36:24.791603 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9f72b3b-1456-4942-9d15-2f620ced1f45 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:36:24.791937 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9f72b3b-1456-4942-9d15-2f620ced1f45 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:36:24.792386 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9f72b3b-1456-4942-9d15-2f620ced1f45 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:36:24.792600 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9f72b3b-1456-4942-9d15-2f620ced1f45 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:36:24.792902 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9f72b3b-1456-4942-9d15-2f620ced1f45 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:36:24.793228 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9f72b3b-1456-4942-9d15-2f620ced1f45 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:36:24.793782 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9f72b3b-1456-4942-9d15-2f620ced1f45 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:36:24.794110 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9f72b3b-1456-4942-9d15-2f620ced1f45 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:36:24.803666 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-3d496310-539f-45b2-a879-4a0fe49cef4c tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 5205 time: 0.0463278 Nov 09 04:36:24.804104 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59406) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:24.827631 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-56aeb503-8cc5-40de-93a6-3255a6ae2a76 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:24.835063 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-56aeb503-8cc5-40de-93a6-3255a6ae2a76 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:24.971821 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-56aeb503-8cc5-40de-93a6-3255a6ae2a76 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:24.978604 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-56aeb503-8cc5-40de-93a6-3255a6ae2a76 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:24.979684 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-56aeb503-8cc5-40de-93a6-3255a6ae2a76 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "DELETE /v2.0/security-group-rules/c8f964f9-cd21-4a68-a7bb-e46f104a392d HTTP/1.1" status: 204 len: 168 time: 0.1748996 Nov 09 04:36:24.982691 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59408) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:24.985358 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56aeb503-8cc5-40de-93a6-3255a6ae2a76 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=c8f964f9-cd21-4a68-a7bb-e46f104a392d,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:25.028217 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-b561ec36-b503-4b78-8418-c858a697380b tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4659 time: 0.0442693 Nov 09 04:36:25.030855 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59410) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:25.058285 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8869628d-e0d8-48ad-84d4-08ad5d102c59 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:25.065522 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8869628d-e0d8-48ad-84d4-08ad5d102c59 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:25.149315 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8869628d-e0d8-48ad-84d4-08ad5d102c59 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:25.156355 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8869628d-e0d8-48ad-84d4-08ad5d102c59 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:25.157463 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-8869628d-e0d8-48ad-84d4-08ad5d102c59 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "DELETE /v2.0/security-group-rules/afd22965-83ca-4c5d-a585-598bb1d78448 HTTP/1.1" status: 204 len: 168 time: 0.1257122 Nov 09 04:36:25.160249 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59412) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:25.163047 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8869628d-e0d8-48ad-84d4-08ad5d102c59 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=afd22965-83ca-4c5d-a585-598bb1d78448,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:25.199752 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-d4b30d6b-e127-4803-9fe4-f433a8e52c23 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4113 time: 0.0383351 Nov 09 04:36:25.202637 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59414) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:25.226597 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bacecfee-d087-43f5-b42c-cb470e649438 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:25.233884 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bacecfee-d087-43f5-b42c-cb470e649438 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:25.341615 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bacecfee-d087-43f5-b42c-cb470e649438 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:25.346447 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bacecfee-d087-43f5-b42c-cb470e649438 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:25.348575 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-bacecfee-d087-43f5-b42c-cb470e649438 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "DELETE /v2.0/security-group-rules/c66e8cf6-0a1d-4087-abed-1b0b93f81a97 HTTP/1.1" status: 204 len: 168 time: 0.1439135 Nov 09 04:36:25.350413 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59416) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:25.355464 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bacecfee-d087-43f5-b42c-cb470e649438 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=c66e8cf6-0a1d-4087-abed-1b0b93f81a97,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:25.392170 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-134c4059-9a4d-4260-8c71-639145e0d4ca tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.0403941 Nov 09 04:36:25.394833 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59418) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:25.444962 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a54b9898-6990-40a2-8e2d-c1c16d9d4653 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:25.468044 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a54b9898-6990-40a2-8e2d-c1c16d9d4653 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:25.640425 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a54b9898-6990-40a2-8e2d-c1c16d9d4653 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:25.643233 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a54b9898-6990-40a2-8e2d-c1c16d9d4653 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:25.644384 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a54b9898-6990-40a2-8e2d-c1c16d9d4653 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "DELETE /v2.0/security-groups/567fe68a-c40d-4bb3-bfa2-82eedc6fcda7 HTTP/1.1" status: 204 len: 168 time: 0.2486615 Nov 09 04:36:25.647168 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59420) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:25.653374 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a54b9898-6990-40a2-8e2d-c1c16d9d4653 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=567fe68a-c40d-4bb3-bfa2-82eedc6fcda7,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:25.785734 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-97d304ac-85a0-4f63-bf1d-eb44b1c38917 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.1372817 Nov 09 04:36:25.790149 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59422) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:25.795537 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-63d707e0-5dc9-4ffd-99c8-1dbd5e699ff1 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Request body: {'security_group': {'name': 'tempest-secgroup--154468746'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:25.903582 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-63d707e0-5dc9-4ffd-99c8-1dbd5e699ff1 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:25.913230 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-abb80f63-a876-4d2b-864b-433163038b33 req-36dcbb29-ac24-444a-abde-f120949d5559 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=f5b9180a-61b4-4ed5-a5a7-a05b102af54c HTTP/1.1" status: 200 len: 210 time: 0.0532916 Nov 09 04:36:25.933528 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-976bd548-9ba6-48b6-b605-18659ec34bcb req-77482453-c2e8-4387-8443-d5164a6067c8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:36:25.935007 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-976bd548-9ba6-48b6-b605-18659ec34bcb req-77482453-c2e8-4387-8443-d5164a6067c8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "GET /v2.0/networks?id=0f070182-4996-4fd0-8617-1172b3c4ac5e HTTP/1.1" status: 200 len: 797 time: 0.2283227 Nov 09 04:36:25.982828 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-63d707e0-5dc9-4ffd-99c8-1dbd5e699ff1 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:26.013758 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-976bd548-9ba6-48b6-b605-18659ec34bcb req-73847e15-32a3-4f84-92d6-21a6d95b87c4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=1d10b4824e524068827e58b55e269af3 HTTP/1.1" status: 200 len: 379 time: 0.0695145 Nov 09 04:36:26.023099 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-976bd548-9ba6-48b6-b605-18659ec34bcb req-f31dd6f3-47c1-4125-93b0-1f6245e075f0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'port': {'device_id': 'f5b9180a-61b4-4ed5-a5a7-a05b102af54c', 'network_id': '0f070182-4996-4fd0-8617-1172b3c4ac5e', 'admin_state_up': True, 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'security_groups': ['981c1801-295c-44ec-8fb7-4111fb839249']}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:26.091875 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-63d707e0-5dc9-4ffd-99c8-1dbd5e699ff1 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:26.124363 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63d707e0-5dc9-4ffd-99c8-1dbd5e699ff1 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Pushing event updated for resources: {'SecurityGroup': ['ID=684cce7e-ffcf-41d9-a15e-4b2c66c17d40,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:26.207966 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-63d707e0-5dc9-4ffd-99c8-1dbd5e699ff1 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:26.209330 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-63d707e0-5dc9-4ffd-99c8-1dbd5e699ff1 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.4176180 Nov 09 04:36:26.211977 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59432) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:26.216718 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-82a201e0-b232-4bcc-9831-3006d22f438b tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Request body: {'security_group_rule': {'security_group_id': '684cce7e-ffcf-41d9-a15e-4b2c66c17d40', 'direction': 'ingress', 'protocol': 17}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:26.289868 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-976bd548-9ba6-48b6-b605-18659ec34bcb req-f31dd6f3-47c1-4125-93b0-1f6245e075f0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Made reservation on behalf of 1d10b4824e524068827e58b55e269af3 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:36:26.294415 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-976bd548-9ba6-48b6-b605-18659ec34bcb req-f31dd6f3-47c1-4125-93b0-1f6245e075f0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:26.420857 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-82a201e0-b232-4bcc-9831-3006d22f438b tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:26.421180 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [req-976bd548-9ba6-48b6-b605-18659ec34bcb req-f31dd6f3-47c1-4125-93b0-1f6245e075f0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Allocated IP 172.20.0.3 (0f070182-4996-4fd0-8617-1172b3c4ac5e/3e268933-196a-4376-a711-8b4d4d9e3036/3113c017-8ef8-4edf-b772-4bcc8ee8298e) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:36:26.480083 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-82a201e0-b232-4bcc-9831-3006d22f438b tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:26.543183 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-82a201e0-b232-4bcc-9831-3006d22f438b tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:26.558946 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-976bd548-9ba6-48b6-b605-18659ec34bcb req-f31dd6f3-47c1-4125-93b0-1f6245e075f0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:26.560788 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82a201e0-b232-4bcc-9831-3006d22f438b tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=90fbecb2-b8a8-4db2-adf9-51d894722577,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:26.635084 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-82a201e0-b232-4bcc-9831-3006d22f438b tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:26.636297 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-82a201e0-b232-4bcc-9831-3006d22f438b tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 767 time: 0.4234052 Nov 09 04:36:26.639211 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59434) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:26.684602 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-976bd548-9ba6-48b6-b605-18659ec34bcb req-f31dd6f3-47c1-4125-93b0-1f6245e075f0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:26.689790 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-43ba392d-72eb-4ffe-b27f-b5f706380aa6 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:26.712707 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-43ba392d-72eb-4ffe-b27f-b5f706380aa6 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:26.733843 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-976bd548-9ba6-48b6-b605-18659ec34bcb req-f31dd6f3-47c1-4125-93b0-1f6245e075f0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network 0f070182-4996-4fd0-8617-1172b3c4ac5e is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:36:26.736885 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [req-976bd548-9ba6-48b6-b605-18659ec34bcb req-f31dd6f3-47c1-4125-93b0-1f6245e075f0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:36:26.740690 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-976bd548-9ba6-48b6-b605-18659ec34bcb req-f31dd6f3-47c1-4125-93b0-1f6245e075f0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:36:26.764697 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f31dd6f3-47c1-4125-93b0-1f6245e075f0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Port': ['ID=3113c017-8ef8-4edf-b772-4bcc8ee8298e,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:26.793655 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-976bd548-9ba6-48b6-b605-18659ec34bcb req-f31dd6f3-47c1-4125-93b0-1f6245e075f0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:36:26.794296 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-976bd548-9ba6-48b6-b605-18659ec34bcb req-f31dd6f3-47c1-4125-93b0-1f6245e075f0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:26.840906 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-43ba392d-72eb-4ffe-b27f-b5f706380aa6 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:26.843671 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-43ba392d-72eb-4ffe-b27f-b5f706380aa6 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:26.845121 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-43ba392d-72eb-4ffe-b27f-b5f706380aa6 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "DELETE /v2.0/security-groups/684cce7e-ffcf-41d9-a15e-4b2c66c17d40 HTTP/1.1" status: 204 len: 168 time: 0.2049854 Nov 09 04:36:26.848098 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59436) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:26.859497 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43ba392d-72eb-4ffe-b27f-b5f706380aa6 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=684cce7e-ffcf-41d9-a15e-4b2c66c17d40,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:26.899408 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-976bd548-9ba6-48b6-b605-18659ec34bcb req-f31dd6f3-47c1-4125-93b0-1f6245e075f0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8798549 Nov 09 04:36:26.903687 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-1030e4d1-ad9c-45c2-8f7c-421727ddcbb7 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0544589 Nov 09 04:36:26.907783 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59438) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:26.912306 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-976bd548-9ba6-48b6-b605-18659ec34bcb req-4f20368c-843f-4dc5-8e4c-c29521497a26 service neutron] Request body: {'port': {'device_id': 'f5b9180a-61b4-4ed5-a5a7-a05b102af54c', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:26.912459 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-a6c0c1d7-781f-4f4c-8b3a-2ba6ac91740c tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Request body: {'security_group': {'name': 'tempest-secgroup--2027703291'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:26.968052 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-976bd548-9ba6-48b6-b605-18659ec34bcb req-4f20368c-843f-4dc5-8e4c-c29521497a26 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:27.016661 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-18e4f2a5-de20-4934-9003-db36d7338d2c None None] Provisioning complete for port 3113c017-8ef8-4edf-b772-4bcc8ee8298e triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:36:27.017665 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-18e4f2a5-de20-4934-9003-db36d7338d2c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:27.019490 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a6c0c1d7-781f-4f4c-8b3a-2ba6ac91740c tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:27.050526 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fef100f7-7bde-46c8-bf38-6650c173d9af req-6e233667-af1a-4aff-bbb9-e38b5f25e5fb tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:36:27.052507 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-fef100f7-7bde-46c8-bf38-6650c173d9af req-6e233667-af1a-4aff-bbb9-e38b5f25e5fb tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=f5b9180a-61b4-4ed5-a5a7-a05b102af54c HTTP/1.1" status: 200 len: 931 time: 0.0695477 Nov 09 04:36:27.053007 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-18e4f2a5-de20-4934-9003-db36d7338d2c None None] Port 3113c017-8ef8-4edf-b772-4bcc8ee8298e cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:36:27.140431 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-fef100f7-7bde-46c8-bf38-6650c173d9af req-abc27607-28ec-4f1e-a892-ae05807f20d4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=981c1801-295c-44ec-8fb7-4111fb839249&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0770102 Nov 09 04:36:27.147349 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a6c0c1d7-781f-4f4c-8b3a-2ba6ac91740c tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:27.223367 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a6c0c1d7-781f-4f4c-8b3a-2ba6ac91740c tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:27.254761 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6c0c1d7-781f-4f4c-8b3a-2ba6ac91740c tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b4af228a-52c1-4cca-bed0-2d0448d6607e,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:27.283418 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [req-976bd548-9ba6-48b6-b605-18659ec34bcb req-4f20368c-843f-4dc5-8e4c-c29521497a26 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 3113c017-8ef8-4edf-b772-4bcc8ee8298e {{(pid=102162) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:36:27.291156 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-976bd548-9ba6-48b6-b605-18659ec34bcb req-4f20368c-843f-4dc5-8e4c-c29521497a26 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:27.307962 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.provisioning_blocks [req-976bd548-9ba6-48b6-b605-18659ec34bcb req-4f20368c-843f-4dc5-8e4c-c29521497a26 service neutron] Transition to ACTIVE for port object 3113c017-8ef8-4edf-b772-4bcc8ee8298e will not be triggered until provisioned by entity L2. {{(pid=102162) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 09 04:36:27.311374 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a6c0c1d7-781f-4f4c-8b3a-2ba6ac91740c tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:27.312677 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a6c0c1d7-781f-4f4c-8b3a-2ba6ac91740c tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.4038467 Nov 09 04:36:27.315513 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59442) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:27.319883 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-123e3cd1-383c-4530-86ce-01cd15cf2661 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Request body: {'security_group': {'name': 'tempest-secgroup--1221303033'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:27.348625 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-976bd548-9ba6-48b6-b605-18659ec34bcb req-4f20368c-843f-4dc5-8e4c-c29521497a26 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:27.406050 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-123e3cd1-383c-4530-86ce-01cd15cf2661 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:27.416168 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f20368c-843f-4dc5-8e4c-c29521497a26 service neutron] Pushing event updated for resources: {'Port': ['ID=3113c017-8ef8-4edf-b772-4bcc8ee8298e,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:27.489106 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-123e3cd1-383c-4530-86ce-01cd15cf2661 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:27.489701 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-976bd548-9ba6-48b6-b605-18659ec34bcb req-4f20368c-843f-4dc5-8e4c-c29521497a26 service neutron] Attempting to bind port 3113c017-8ef8-4edf-b772-4bcc8ee8298e on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:36:27.490207 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-976bd548-9ba6-48b6-b605-18659ec34bcb req-4f20368c-843f-4dc5-8e4c-c29521497a26 service neutron] Attempting to bind port 3113c017-8ef8-4edf-b772-4bcc8ee8298e by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '978d57a9-319d-4116-8893-ffe00140f45e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 330, 'network_id': '0f070182-4996-4fd0-8617-1172b3c4ac5e'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:36:27.490387 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-976bd548-9ba6-48b6-b605-18659ec34bcb req-4f20368c-843f-4dc5-8e4c-c29521497a26 service neutron] Attempting to bind port 3113c017-8ef8-4edf-b772-4bcc8ee8298e on network 0f070182-4996-4fd0-8617-1172b3c4ac5e {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:36:27.495515 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-976bd548-9ba6-48b6-b605-18659ec34bcb req-4f20368c-843f-4dc5-8e4c-c29521497a26 service neutron] Port 3113c017-8ef8-4edf-b772-4bcc8ee8298e on network 0f070182-4996-4fd0-8617-1172b3c4ac5e not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:36:27.499565 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-976bd548-9ba6-48b6-b605-18659ec34bcb req-4f20368c-843f-4dc5-8e4c-c29521497a26 service neutron] Attempting to bind port 3113c017-8ef8-4edf-b772-4bcc8ee8298e on network 0f070182-4996-4fd0-8617-1172b3c4ac5e {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:36:27.500801 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-976bd548-9ba6-48b6-b605-18659ec34bcb req-4f20368c-843f-4dc5-8e4c-c29521497a26 service neutron] Checking agent: {'id': '7d36b884-4ad2-4878-9464-bf647030b544', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'started_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 36, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:36:27.501132 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-976bd548-9ba6-48b6-b605-18659ec34bcb req-4f20368c-843f-4dc5-8e4c-c29521497a26 service neutron] Checking segment: {'id': '978d57a9-319d-4116-8893-ffe00140f45e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 330, 'network_id': '0f070182-4996-4fd0-8617-1172b3c4ac5e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:36:27.501605 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-976bd548-9ba6-48b6-b605-18659ec34bcb req-4f20368c-843f-4dc5-8e4c-c29521497a26 service neutron] Bound using segment: {'id': '978d57a9-319d-4116-8893-ffe00140f45e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 330, 'network_id': '0f070182-4996-4fd0-8617-1172b3c4ac5e'} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:36:27.502035 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-976bd548-9ba6-48b6-b605-18659ec34bcb req-4f20368c-843f-4dc5-8e4c-c29521497a26 service neutron] Bound port: 3113c017-8ef8-4edf-b772-4bcc8ee8298e, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '978d57a9-319d-4116-8893-ffe00140f45e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 330, 'network_id': '0f070182-4996-4fd0-8617-1172b3c4ac5e'}}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:36:27.502395 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-976bd548-9ba6-48b6-b605-18659ec34bcb req-4f20368c-843f-4dc5-8e4c-c29521497a26 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:27.564680 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-123e3cd1-383c-4530-86ce-01cd15cf2661 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:27.570288 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-976bd548-9ba6-48b6-b605-18659ec34bcb req-4f20368c-843f-4dc5-8e4c-c29521497a26 service neutron] For port 3113c017-8ef8-4edf-b772-4bcc8ee8298e, host hv-neutron-8168, cleared binding levels {{(pid=102162) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:36:27.574151 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-976bd548-9ba6-48b6-b605-18659ec34bcb req-4f20368c-843f-4dc5-8e4c-c29521497a26 service neutron] For port 3113c017-8ef8-4edf-b772-4bcc8ee8298e, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=3113c017-8ef8-4edf-b772-4bcc8ee8298e,segment=NetworkSegment(978d57a9-319d-4116-8893-ffe00140f45e),segment_id=978d57a9-319d-4116-8893-ffe00140f45e)] {{(pid=102162) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:36:27.595611 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-123e3cd1-383c-4530-86ce-01cd15cf2661 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Pushing event updated for resources: {'SecurityGroup': ['ID=756c8ce1-1a98-4101-860c-b8bc8cc05002,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:27.644382 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-976bd548-9ba6-48b6-b605-18659ec34bcb req-4f20368c-843f-4dc5-8e4c-c29521497a26 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:27.645803 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-123e3cd1-383c-4530-86ce-01cd15cf2661 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:27.647102 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-123e3cd1-383c-4530-86ce-01cd15cf2661 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.3306122 Nov 09 04:36:27.649932 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59444) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:27.655103 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-32d9ea81-52fd-46ef-9b98-3bf0286fffba tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Request body: {'security_group_rule': {'security_group_id': 'b4af228a-52c1-4cca-bed0-2d0448d6607e', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'udp', 'port_range_min': 50, 'port_range_max': 55, 'remote_group_id': '756c8ce1-1a98-4101-860c-b8bc8cc05002', 'remote_ip_prefix': None}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:27.791608 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-32d9ea81-52fd-46ef-9b98-3bf0286fffba tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:27.868019 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-32d9ea81-52fd-46ef-9b98-3bf0286fffba tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:27.966332 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-32d9ea81-52fd-46ef-9b98-3bf0286fffba tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:27.985240 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32d9ea81-52fd-46ef-9b98-3bf0286fffba tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b71e0554-1883-421b-a84f-8d388950670d,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:27.999727 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-976bd548-9ba6-48b6-b605-18659ec34bcb req-4f20368c-843f-4dc5-8e4c-c29521497a26 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:36:28.000508 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-976bd548-9ba6-48b6-b605-18659ec34bcb req-4f20368c-843f-4dc5-8e4c-c29521497a26 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:28.001745 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-976bd548-9ba6-48b6-b605-18659ec34bcb req-4f20368c-843f-4dc5-8e4c-c29521497a26 service neutron] 10.222.0.26 "PUT /v2.0/ports/3113c017-8ef8-4edf-b772-4bcc8ee8298e HTTP/1.1" status: 200 len: 1093 time: 1.0937932 Nov 09 04:36:28.002188 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f5b9180a-61b4-4ed5-a5a7-a05b102af54c', 'tag': '3113c017-8ef8-4edf-b772-4bcc8ee8298e'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:36:28.004564 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-38212807-17d5-46e1-8d8f-742379f80651" -d '{"events": [{"name": "network-changed", "server_uuid": "f5b9180a-61b4-4ed5-a5a7-a05b102af54c", "tag": "3113c017-8ef8-4edf-b772-4bcc8ee8298e"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:36:28.029751 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f20368c-843f-4dc5-8e4c-c29521497a26 service neutron] Pushing event updated for resources: {'Port': ['ID=3113c017-8ef8-4edf-b772-4bcc8ee8298e,revision_number=3']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:28.049834 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:36:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8d43a77a-b635-4389-82ff-5eca928cc971 x-openstack-request-id: req-8d43a77a-b635-4389-82ff-5eca928cc971 {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:36:28.050164 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f5b9180a-61b4-4ed5-a5a7-a05b102af54c", "tag": "3113c017-8ef8-4edf-b772-4bcc8ee8298e", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:36:28.050403 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-8d43a77a-b635-4389-82ff-5eca928cc971 {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:36:28.050860 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f5b9180a-61b4-4ed5-a5a7-a05b102af54c', 'tag': '3113c017-8ef8-4edf-b772-4bcc8ee8298e', 'status': 'completed', 'code': 200} Nov 09 04:36:28.070828 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-32d9ea81-52fd-46ef-9b98-3bf0286fffba tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:28.072643 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-32d9ea81-52fd-46ef-9b98-3bf0286fffba tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 798 time: 0.4206758 Nov 09 04:36:28.075659 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59448) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:28.131843 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c21ba51c-6658-4b25-a31a-17c9611a7447 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:28.141521 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c21ba51c-6658-4b25-a31a-17c9611a7447 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:28.154026 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38212807-17d5-46e1-8d8f-742379f80651 req-26cc9589-0233-402e-91c9-f00113b4954b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:36:28.155601 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-38212807-17d5-46e1-8d8f-742379f80651 req-26cc9589-0233-402e-91c9-f00113b4954b service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&device_id=f5b9180a-61b4-4ed5-a5a7-a05b102af54c HTTP/1.1" status: 200 len: 1096 time: 0.0816858 Nov 09 04:36:28.268395 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51464e35-1a39-47f9-9b2e-eae8ec261b9d req-c2b19691-7c6d-4127-8e0f-e8ea1c77f4ca tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:36:28.269890 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-51464e35-1a39-47f9-9b2e-eae8ec261b9d req-c2b19691-7c6d-4127-8e0f-e8ea1c77f4ca tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=f5b9180a-61b4-4ed5-a5a7-a05b102af54c HTTP/1.1" status: 200 len: 943 time: 0.0529976 Nov 09 04:36:28.305344 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c21ba51c-6658-4b25-a31a-17c9611a7447 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:28.309991 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c21ba51c-6658-4b25-a31a-17c9611a7447 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:28.311393 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-c21ba51c-6658-4b25-a31a-17c9611a7447 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "DELETE /v2.0/security-group-rules/b71e0554-1883-421b-a84f-8d388950670d HTTP/1.1" status: 204 len: 168 time: 0.2348158 Nov 09 04:36:28.316219 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59452) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:28.334826 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-51464e35-1a39-47f9-9b2e-eae8ec261b9d req-26707afc-a0e8-43db-86d7-3583afc39fb1 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=981c1801-295c-44ec-8fb7-4111fb839249&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0576329 Nov 09 04:36:28.349858 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c21ba51c-6658-4b25-a31a-17c9611a7447 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=b71e0554-1883-421b-a84f-8d388950670d,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:28.364571 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-6e98e63d-fcf8-411e-905c-f507d4370a10 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4659 time: 0.0470111 Nov 09 04:36:28.367344 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59454) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:28.373066 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38212807-17d5-46e1-8d8f-742379f80651 req-8882cf4e-833c-40de-8289-ddc36238bbe6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:36:28.374662 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-38212807-17d5-46e1-8d8f-742379f80651 req-8882cf4e-833c-40de-8289-ddc36238bbe6 service neutron] 10.222.0.26 "GET /v2.0/networks?tenant_id=1d10b4824e524068827e58b55e269af3&shared=False HTTP/1.1" status: 200 len: 898 time: 0.2103834 Nov 09 04:36:28.419518 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-46d8672c-c6b1-48ba-8743-9637c86321c1 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:28.442047 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-46d8672c-c6b1-48ba-8743-9637c86321c1 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:28.538142 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38212807-17d5-46e1-8d8f-742379f80651 req-86c019e3-e61d-4d0c-abb9-17a019f0bc68 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:36:28.539629 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-38212807-17d5-46e1-8d8f-742379f80651 req-86c019e3-e61d-4d0c-abb9-17a019f0bc68 service neutron] 10.222.0.26 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1578779 Nov 09 04:36:28.592651 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-46d8672c-c6b1-48ba-8743-9637c86321c1 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:28.595635 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-46d8672c-c6b1-48ba-8743-9637c86321c1 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:28.596858 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-46d8672c-c6b1-48ba-8743-9637c86321c1 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "DELETE /v2.0/security-groups/756c8ce1-1a98-4101-860c-b8bc8cc05002 HTTP/1.1" status: 204 len: 168 time: 0.2285206 Nov 09 04:36:28.600426 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59456) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:28.616554 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-976bd548-9ba6-48b6-b605-18659ec34bcb req-3442e30b-ca88-479b-addf-89177a223b63 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:36:28.619884 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-976bd548-9ba6-48b6-b605-18659ec34bcb req-3442e30b-ca88-479b-addf-89177a223b63 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&device_id=f5b9180a-61b4-4ed5-a5a7-a05b102af54c HTTP/1.1" status: 200 len: 1096 time: 0.0402892 Nov 09 04:36:28.620022 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46d8672c-c6b1-48ba-8743-9637c86321c1 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=756c8ce1-1a98-4101-860c-b8bc8cc05002,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:28.663758 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-4a13c82d-91a0-4ee0-a9ae-5fb32b5208c1 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 4545 time: 0.0622509 Nov 09 04:36:28.666061 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-976bd548-9ba6-48b6-b605-18659ec34bcb req-83222fc1-4ac4-4e7b-9335-aaf106c059d6 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=3113c017-8ef8-4edf-b772-4bcc8ee8298e HTTP/1.1" status: 200 len: 217 time: 0.0386028 Nov 09 04:36:28.666438 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59458) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:28.715661 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-976bd548-9ba6-48b6-b605-18659ec34bcb req-4c191e44-7622-4679-934c-dc2d74190516 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:36:28.717094 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-976bd548-9ba6-48b6-b605-18659ec34bcb req-4c191e44-7622-4679-934c-dc2d74190516 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=3e268933-196a-4376-a711-8b4d4d9e3036 HTTP/1.1" status: 200 len: 833 time: 0.0447323 Nov 09 04:36:28.717816 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-298163b8-d57a-4a74-98b7-57eb514dca51 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:28.739935 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-298163b8-d57a-4a74-98b7-57eb514dca51 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:28.763528 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-976bd548-9ba6-48b6-b605-18659ec34bcb req-dd531d75-3172-410b-bcaa-d5539246197d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:36:28.765213 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-976bd548-9ba6-48b6-b605-18659ec34bcb req-dd531d75-3172-410b-bcaa-d5539246197d service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=0f070182-4996-4fd0-8617-1172b3c4ac5e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0403552 Nov 09 04:36:28.856520 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-976bd548-9ba6-48b6-b605-18659ec34bcb req-727b857f-b750-47b5-9524-b8196bc63b8e service neutron] 10.222.0.26 "GET /v2.0/networks/0f070182-4996-4fd0-8617-1172b3c4ac5e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0844021 Nov 09 04:36:28.878319 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-298163b8-d57a-4a74-98b7-57eb514dca51 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:28.885042 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-298163b8-d57a-4a74-98b7-57eb514dca51 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:28.885042 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-298163b8-d57a-4a74-98b7-57eb514dca51 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "DELETE /v2.0/security-groups/b4af228a-52c1-4cca-bed0-2d0448d6607e HTTP/1.1" status: 204 len: 168 time: 0.2149498 Nov 09 04:36:28.885805 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59460) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:28.892025 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-298163b8-d57a-4a74-98b7-57eb514dca51 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=b4af228a-52c1-4cca-bed0-2d0448d6607e,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:28.968187 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-01bb8e2f-8a6e-4e95-ad97-895fea6d41ea tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0812900 Nov 09 04:36:28.973072 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59462) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:28.977800 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-c3123614-cef9-45c1-8377-a027b830ad01 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Request body: {'security_group': {'name': 'tempest-secgroup--222818036'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:28.983673 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-976bd548-9ba6-48b6-b605-18659ec34bcb req-a54228c8-837c-466a-9a81-2bbdb917865a service neutron] 10.222.0.26 "GET /v2.0/networks/0f070182-4996-4fd0-8617-1172b3c4ac5e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1204212 Nov 09 04:36:29.079852 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c3123614-cef9-45c1-8377-a027b830ad01 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:29.144887 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c3123614-cef9-45c1-8377-a027b830ad01 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:29.216816 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c3123614-cef9-45c1-8377-a027b830ad01 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:29.245534 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3123614-cef9-45c1-8377-a027b830ad01 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Pushing event updated for resources: {'SecurityGroup': ['ID=ad32772a-90ba-4b25-bbf8-43f6e3840214,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:29.368186 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c3123614-cef9-45c1-8377-a027b830ad01 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:29.369382 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-c3123614-cef9-45c1-8377-a027b830ad01 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.3952236 Nov 09 04:36:29.372459 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59466) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:29.377236 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-5817c4e9-bd98-4c67-8694-2082fb056d08 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Request body: {'security_group_rule': {'security_group_id': 'ad32772a-90ba-4b25-bbf8-43f6e3840214', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'tcp', 'port_range_min': 76, 'port_range_max': 77, 'remote_group_id': None, 'remote_ip_prefix': '2001:db8::/48'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:29.460965 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa7f4ffc-7ab3-46ab-9a5e-207676ab833a req-93ffa8d3-858a-422c-b07e-d947888a0b02 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:36:29.463111 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fa7f4ffc-7ab3-46ab-9a5e-207676ab833a req-93ffa8d3-858a-422c-b07e-d947888a0b02 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=f5b9180a-61b4-4ed5-a5a7-a05b102af54c HTTP/1.1" status: 200 len: 943 time: 0.0502086 Nov 09 04:36:29.489804 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5817c4e9-bd98-4c67-8694-2082fb056d08 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:29.535337 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fa7f4ffc-7ab3-46ab-9a5e-207676ab833a req-5b1a12ce-1576-4be0-9733-a778d061b710 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=981c1801-295c-44ec-8fb7-4111fb839249&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0658233 Nov 09 04:36:29.557921 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5817c4e9-bd98-4c67-8694-2082fb056d08 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:29.628237 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5817c4e9-bd98-4c67-8694-2082fb056d08 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:29.646697 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5817c4e9-bd98-4c67-8694-2082fb056d08 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7e96fe66-4d2c-4149-afac-76a33744fee3,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:29.733537 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5817c4e9-bd98-4c67-8694-2082fb056d08 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:29.734682 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-5817c4e9-bd98-4c67-8694-2082fb056d08 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 786 time: 0.3611579 Nov 09 04:36:29.737486 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59468) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:29.761914 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b00836d8-6eee-491c-84e0-f508e22dd068 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:29.770049 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b00836d8-6eee-491c-84e0-f508e22dd068 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:29.936205 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b00836d8-6eee-491c-84e0-f508e22dd068 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:29.942617 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b00836d8-6eee-491c-84e0-f508e22dd068 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:29.943828 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-b00836d8-6eee-491c-84e0-f508e22dd068 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "DELETE /v2.0/security-group-rules/7e96fe66-4d2c-4149-afac-76a33744fee3 HTTP/1.1" status: 204 len: 168 time: 0.2053342 Nov 09 04:36:29.946538 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59470) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:29.950181 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b00836d8-6eee-491c-84e0-f508e22dd068 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=7e96fe66-4d2c-4149-afac-76a33744fee3,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:29.989842 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-842923f7-619f-416c-8495-65391c3147c0 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.0408587 Nov 09 04:36:29.992519 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59472) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:30.050855 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9ca65019-c779-4510-a0e5-f98b52ca98f3 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:30.074335 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9ca65019-c779-4510-a0e5-f98b52ca98f3 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:30.181828 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9ca65019-c779-4510-a0e5-f98b52ca98f3 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:30.184644 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9ca65019-c779-4510-a0e5-f98b52ca98f3 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:30.185950 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-9ca65019-c779-4510-a0e5-f98b52ca98f3 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "DELETE /v2.0/security-groups/ad32772a-90ba-4b25-bbf8-43f6e3840214 HTTP/1.1" status: 204 len: 168 time: 0.1922193 Nov 09 04:36:30.188650 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59474) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:30.195559 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ca65019-c779-4510-a0e5-f98b52ca98f3 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=ad32772a-90ba-4b25-bbf8-43f6e3840214,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:30.235629 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-49b202e1-8fd8-485a-a662-6abe2bf2cba8 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0457683 Nov 09 04:36:30.239316 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59476) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:30.244235 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-b50a928c-8c9b-45fd-91e3-18d642ccdc9d tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Request body: {'security_group': {'name': 'tempest-secgroup--502799594'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:30.346952 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b50a928c-8c9b-45fd-91e3-18d642ccdc9d tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:30.409714 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b50a928c-8c9b-45fd-91e3-18d642ccdc9d tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:30.468097 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b50a928c-8c9b-45fd-91e3-18d642ccdc9d tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:30.496567 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b50a928c-8c9b-45fd-91e3-18d642ccdc9d tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Pushing event updated for resources: {'SecurityGroup': ['ID=1e2217f8-e303-46a4-b3ea-a85141078d5e,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:30.561939 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b50a928c-8c9b-45fd-91e3-18d642ccdc9d tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:30.563418 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-b50a928c-8c9b-45fd-91e3-18d642ccdc9d tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.3229239 Nov 09 04:36:30.565888 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59480) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:30.570283 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-a33a14b7-9352-498e-ba86-a79be0ae43ea tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Request body: {'security_group_rule': {'security_group_id': '1e2217f8-e303-46a4-b3ea-a85141078d5e', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:30.651329 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05277b4f-bbbc-4569-a32e-e6d2f99559a3 req-5450d87a-c7a1-494b-9482-4e2cc70d8e4f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:36:30.652796 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-05277b4f-bbbc-4569-a32e-e6d2f99559a3 req-5450d87a-c7a1-494b-9482-4e2cc70d8e4f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=f5b9180a-61b4-4ed5-a5a7-a05b102af54c HTTP/1.1" status: 200 len: 943 time: 0.0504615 Nov 09 04:36:30.691298 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a33a14b7-9352-498e-ba86-a79be0ae43ea tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:30.701799 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-05277b4f-bbbc-4569-a32e-e6d2f99559a3 req-67420382-58b5-40a4-8765-4bd8335ae189 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=981c1801-295c-44ec-8fb7-4111fb839249&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0426366 Nov 09 04:36:30.747141 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a33a14b7-9352-498e-ba86-a79be0ae43ea tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:30.779548 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 3113c017-8ef8-4edf-b772-4bcc8ee8298e details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=102163) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 09 04:36:30.849837 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a33a14b7-9352-498e-ba86-a79be0ae43ea tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:30.869966 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a33a14b7-9352-498e-ba86-a79be0ae43ea tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5d293e8e-8665-46f5-a656-af692c76f1fb,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:30.874956 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 3113c017-8ef8-4edf-b772-4bcc8ee8298e, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=3113c017-8ef8-4edf-b772-4bcc8ee8298e,segment=NetworkSegment(978d57a9-319d-4116-8893-ffe00140f45e),segment_id=978d57a9-319d-4116-8893-ffe00140f45e)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:36:30.886879 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Returning: {'device': '3113c017-8ef8-4edf-b772-4bcc8ee8298e', 'network_id': '0f070182-4996-4fd0-8617-1172b3c4ac5e', 'port_id': '3113c017-8ef8-4edf-b772-4bcc8ee8298e', 'mac_address': 'fa:16:3e:4d:61:04', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 330, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '3e268933-196a-4376-a711-8b4d4d9e3036', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102163) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 09 04:36:30.924503 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:30.936902 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 3113c017-8ef8-4edf-b772-4bcc8ee8298e {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:36:30.955833 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 3113c017-8ef8-4edf-b772-4bcc8ee8298e, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=3113c017-8ef8-4edf-b772-4bcc8ee8298e,segment=NetworkSegment(978d57a9-319d-4116-8893-ffe00140f45e),segment_id=978d57a9-319d-4116-8893-ffe00140f45e)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:36:30.968221 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a33a14b7-9352-498e-ba86-a79be0ae43ea tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:30.969729 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a33a14b7-9352-498e-ba86-a79be0ae43ea tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.4027946 Nov 09 04:36:30.972431 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59482) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:30.988675 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-ea883549-8e8c-4210-a054-b9768a5324cf tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "GET /v2.0/security-group-rules/5d293e8e-8665-46f5-a656-af692c76f1fb HTTP/1.1" status: 200 len: 763 time: 0.0152168 Nov 09 04:36:30.991098 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59484) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:31.000523 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:31.030830 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-bb72c9e1-8639-462f-8441-0939af317a72 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4113 time: 0.0386863 Nov 09 04:36:31.033396 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59486) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:31.048082 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=3113c017-8ef8-4edf-b772-4bcc8ee8298e,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:31.055110 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:36:31.055468 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:36:31.055810 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:36:31.056148 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:36:31.056263 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6b41fcdb-c469-4217-9a0d-97eb3388ccac tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:31.056480 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:36:31.056812 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:36:31.057187 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:36:31.057522 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:36:31.057850 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:36:31.058191 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:36:31.058520 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:36:31.058848 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:36:31.063999 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6b41fcdb-c469-4217-9a0d-97eb3388ccac tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:31.169496 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6b41fcdb-c469-4217-9a0d-97eb3388ccac tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:31.175563 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6b41fcdb-c469-4217-9a0d-97eb3388ccac tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:31.176663 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-6b41fcdb-c469-4217-9a0d-97eb3388ccac tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "DELETE /v2.0/security-group-rules/5d293e8e-8665-46f5-a656-af692c76f1fb HTTP/1.1" status: 204 len: 168 time: 0.1423755 Nov 09 04:36:31.179327 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59488) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:31.182696 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b41fcdb-c469-4217-9a0d-97eb3388ccac tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=5d293e8e-8665-46f5-a656-af692c76f1fb,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:31.217925 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-66663efe-26f4-4402-984d-f4e98a35c0f6 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.0374184 Nov 09 04:36:31.220849 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59490) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:31.224280 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['3113c017-8ef8-4edf-b772-4bcc8ee8298e'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 04:36:31.226556 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-e5542e0d-c135-4064-a78d-39c4df486ebf tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Request body: {'security_group_rule': {'security_group_id': '1e2217f8-e303-46a4-b3ea-a85141078d5e', 'protocol': 'udp', 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:31.357373 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e5542e0d-c135-4064-a78d-39c4df486ebf tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:31.417405 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e5542e0d-c135-4064-a78d-39c4df486ebf tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:31.548679 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e5542e0d-c135-4064-a78d-39c4df486ebf tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:31.566206 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5542e0d-c135-4064-a78d-39c4df486ebf tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=071a4cf1-7d6a-4818-b37c-e88a8ffcb168,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:31.651996 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e5542e0d-c135-4064-a78d-39c4df486ebf tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:31.653164 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-e5542e0d-c135-4064-a78d-39c4df486ebf tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.4305232 Nov 09 04:36:31.655773 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59492) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:31.672734 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-db5ddcdd-e2f1-4da5-9d52-cc5ab1817714 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "GET /v2.0/security-group-rules/071a4cf1-7d6a-4818-b37c-e88a8ffcb168 HTTP/1.1" status: 200 len: 763 time: 0.0159023 Nov 09 04:36:31.678727 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59494) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:31.717153 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-594205a6-0982-4a4d-abf2-b5f06cc4b49b tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4113 time: 0.0373962 Nov 09 04:36:31.720087 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59496) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:31.744386 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-76ae21d1-5907-45a1-b2be-552af360f600 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:31.751900 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-76ae21d1-5907-45a1-b2be-552af360f600 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:31.817442 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-76ae21d1-5907-45a1-b2be-552af360f600 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:31.824473 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-76ae21d1-5907-45a1-b2be-552af360f600 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:31.824748 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df41b2c3-21a0-4fb0-89d9-183b072c1f07 req-1908cf79-c75e-40ed-b4ad-60e943cb70ad tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:36:31.825594 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-76ae21d1-5907-45a1-b2be-552af360f600 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "DELETE /v2.0/security-group-rules/071a4cf1-7d6a-4818-b37c-e88a8ffcb168 HTTP/1.1" status: 204 len: 168 time: 0.1046221 Nov 09 04:36:31.826274 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-df41b2c3-21a0-4fb0-89d9-183b072c1f07 req-1908cf79-c75e-40ed-b4ad-60e943cb70ad tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=f5b9180a-61b4-4ed5-a5a7-a05b102af54c HTTP/1.1" status: 200 len: 944 time: 0.0521195 Nov 09 04:36:31.828096 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59500) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:31.831304 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76ae21d1-5907-45a1-b2be-552af360f600 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=071a4cf1-7d6a-4818-b37c-e88a8ffcb168,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:31.900803 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-50a692a2-0747-4cb5-896b-9b30b2070197 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.0710196 Nov 09 04:36:31.904040 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59502) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:31.910192 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-99152184-c118-44d5-b952-f2c9c05684b5 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Request body: {'security_group_rule': {'security_group_id': '1e2217f8-e303-46a4-b3ea-a85141078d5e', 'protocol': 'icmp', 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:31.910602 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-df41b2c3-21a0-4fb0-89d9-183b072c1f07 req-170aa105-f825-4194-b9e9-2055a034e5f9 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=981c1801-295c-44ec-8fb7-4111fb839249&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0736556 Nov 09 04:36:32.005860 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.securitygroups_db [None req-99152184-c118-44d5-b952-f2c9c05684b5 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Project a4c1ddfdc9f94c6fa53be9f6f3ffac4e added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 09 04:36:32.011712 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-99152184-c118-44d5-b952-f2c9c05684b5 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:32.056613 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-99152184-c118-44d5-b952-f2c9c05684b5 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:32.106700 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-99152184-c118-44d5-b952-f2c9c05684b5 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:32.125029 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99152184-c118-44d5-b952-f2c9c05684b5 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=92bf6e7c-d7b5-4c8b-925f-863be61127e0,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:32.190876 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-99152184-c118-44d5-b952-f2c9c05684b5 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:32.192039 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-99152184-c118-44d5-b952-f2c9c05684b5 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.2869856 Nov 09 04:36:32.194719 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59504) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:32.211245 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1c14869a-fb0c-4c79-ae60-9ba1602a298e tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "GET /v2.0/security-group-rules/92bf6e7c-d7b5-4c8b-925f-863be61127e0 HTTP/1.1" status: 200 len: 769 time: 0.0155141 Nov 09 04:36:32.216749 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59506) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:32.254959 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-6a37df2c-4db0-4335-a17f-a8e0b65055f9 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4119 time: 0.0372202 Nov 09 04:36:32.262481 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59508) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:32.287620 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ee2ab40d-85f4-4839-96f7-576f43a2b0e6 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:32.294853 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ee2ab40d-85f4-4839-96f7-576f43a2b0e6 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:32.383051 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ee2ab40d-85f4-4839-96f7-576f43a2b0e6 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:32.389531 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ee2ab40d-85f4-4839-96f7-576f43a2b0e6 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:32.390625 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-ee2ab40d-85f4-4839-96f7-576f43a2b0e6 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "DELETE /v2.0/security-group-rules/92bf6e7c-d7b5-4c8b-925f-863be61127e0 HTTP/1.1" status: 204 len: 168 time: 0.1272383 Nov 09 04:36:32.395944 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee2ab40d-85f4-4839-96f7-576f43a2b0e6 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=92bf6e7c-d7b5-4c8b-925f-863be61127e0,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:32.399975 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59510) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:32.437318 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a8a8df02-f10e-43b6-b6ed-16ada0b1be5c tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.0362797 Nov 09 04:36:32.439961 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59512) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:32.489364 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5d8670bb-ff27-44f0-bc4b-ff221e028acd tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:32.512688 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5d8670bb-ff27-44f0-bc4b-ff221e028acd tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:32.651075 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5d8670bb-ff27-44f0-bc4b-ff221e028acd tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:32.653794 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5d8670bb-ff27-44f0-bc4b-ff221e028acd tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:32.654940 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-5d8670bb-ff27-44f0-bc4b-ff221e028acd tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "DELETE /v2.0/security-groups/1e2217f8-e303-46a4-b3ea-a85141078d5e HTTP/1.1" status: 204 len: 168 time: 0.2141113 Nov 09 04:36:32.657679 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59514) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:32.664351 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d8670bb-ff27-44f0-bc4b-ff221e028acd tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=1e2217f8-e303-46a4-b3ea-a85141078d5e,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:32.701191 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a89705ec-7025-4f45-9a92-1ea1d6ca66cc tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0420530 Nov 09 04:36:32.705253 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59516) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:32.745883 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-edcd3542-a681-4948-a4b7-8b6bc01784e0 tempest-SecGroupIPv6Test-602722900 tempest-SecGroupIPv6Test-602722900-project] 10.222.0.24 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0394509 Nov 09 04:36:32.778984 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 3113c017-8ef8-4edf-b772-4bcc8ee8298e up at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:36:32.940735 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning for port 3113c017-8ef8-4edf-b772-4bcc8ee8298e completed by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 09 04:36:32.944923 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning complete for port 3113c017-8ef8-4edf-b772-4bcc8ee8298e triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:36:32.945346 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:33.021790 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:33.029076 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-beebdbfe-5b59-4ee2-9d47-f1c3a9f77603 req-646d6ff6-a96a-4bab-99fa-2f58a20d44cc tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:36:33.030672 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-beebdbfe-5b59-4ee2-9d47-f1c3a9f77603 req-646d6ff6-a96a-4bab-99fa-2f58a20d44cc tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=f5b9180a-61b4-4ed5-a5a7-a05b102af54c HTTP/1.1" status: 200 len: 944 time: 0.0492918 Nov 09 04:36:33.045320 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f5b9180a-61b4-4ed5-a5a7-a05b102af54c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3113c017-8ef8-4edf-b772-4bcc8ee8298e'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:36:33.048365 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4d630599-6215-46d6-a96c-2f4c9f9afa95" -d '{"events": [{"server_uuid": "f5b9180a-61b4-4ed5-a5a7-a05b102af54c", "name": "network-vif-plugged", "status": "completed", "tag": "3113c017-8ef8-4edf-b772-4bcc8ee8298e"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:36:33.060514 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 3113c017-8ef8-4edf-b772-4bcc8ee8298e, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=3113c017-8ef8-4edf-b772-4bcc8ee8298e,segment=NetworkSegment(978d57a9-319d-4116-8893-ffe00140f45e),segment_id=978d57a9-319d-4116-8893-ffe00140f45e)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:36:33.085242 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:36:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-96e9135a-cbdd-4abc-ac84-916b8e8ea494 x-openstack-request-id: req-96e9135a-cbdd-4abc-ac84-916b8e8ea494 {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:36:33.085890 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f5b9180a-61b4-4ed5-a5a7-a05b102af54c", "name": "network-vif-plugged", "status": "completed", "tag": "3113c017-8ef8-4edf-b772-4bcc8ee8298e", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:36:33.086140 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-96e9135a-cbdd-4abc-ac84-916b8e8ea494 {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:36:33.086636 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f5b9180a-61b4-4ed5-a5a7-a05b102af54c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3113c017-8ef8-4edf-b772-4bcc8ee8298e', 'code': 200} Nov 09 04:36:33.093493 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-beebdbfe-5b59-4ee2-9d47-f1c3a9f77603 req-eefe659e-87e8-487e-a592-96f2b1ac0fb2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=981c1801-295c-44ec-8fb7-4111fb839249&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0568206 Nov 09 04:36:33.163642 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:33.216380 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=3113c017-8ef8-4edf-b772-4bcc8ee8298e,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:33.288192 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59526) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:33.421744 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-ba3df5bc-6d27-4923-9d4d-297c5953e53b admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=a4c1ddfdc9f94c6fa53be9f6f3ffac4e&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1322939 Nov 09 04:36:33.424248 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59530) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:33.496796 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15c7f216-8b8d-4fbd-9bb5-412e6c840708 req-c6078fb1-5117-45bf-a1f2-29ee367d72e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:36:33.498244 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-15c7f216-8b8d-4fbd-9bb5-412e6c840708 req-c6078fb1-5117-45bf-a1f2-29ee367d72e7 service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=f5b9180a-61b4-4ed5-a5a7-a05b102af54c HTTP/1.1" status: 200 len: 1098 time: 0.0681705 Nov 09 04:36:33.502821 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f3f52b59-914d-4992-88b0-ad5117bc6c60 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:33.537313 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f3f52b59-914d-4992-88b0-ad5117bc6c60 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:33.583558 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-15c7f216-8b8d-4fbd-9bb5-412e6c840708 req-c820a217-941d-4b5c-a29c-6eb18e7de596 service neutron] 10.222.0.26 "GET /v2.0/security-groups?id=981c1801-295c-44ec-8fb7-4111fb839249&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0764894 Nov 09 04:36:33.674049 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f3f52b59-914d-4992-88b0-ad5117bc6c60 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:33.676727 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f3f52b59-914d-4992-88b0-ad5117bc6c60 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:33.677803 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-f3f52b59-914d-4992-88b0-ad5117bc6c60 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/d9284f9b-af3e-40c1-b385-f97d8dc94743 HTTP/1.1" status: 204 len: 168 time: 0.2526791 Nov 09 04:36:33.686220 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3f52b59-914d-4992-88b0-ad5117bc6c60 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d9284f9b-af3e-40c1-b385-f97d8dc94743,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:34.221068 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07481844-faa5-4117-91bd-d724e6cc90f4 req-83b165ac-0cd6-48ae-b7fe-cc6ddbc98d0f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:36:34.222575 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-07481844-faa5-4117-91bd-d724e6cc90f4 req-83b165ac-0cd6-48ae-b7fe-cc6ddbc98d0f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=f5b9180a-61b4-4ed5-a5a7-a05b102af54c HTTP/1.1" status: 200 len: 945 time: 0.0584238 Nov 09 04:36:34.272930 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-07481844-faa5-4117-91bd-d724e6cc90f4 req-cf4dadd4-49de-4c9a-8cde-a51db5c061db tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=981c1801-295c-44ec-8fb7-4111fb839249&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0442994 Nov 09 04:36:34.783958 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59556) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:34.879976 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-7c49c2d7-2f7d-4a45-80fb-4dba6c3cad6f tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Request body: {'security_group': {'name': 'tempest-secgroup--1104376815'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:34.954185 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7c49c2d7-2f7d-4a45-80fb-4dba6c3cad6f tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:34.962508 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7c49c2d7-2f7d-4a45-80fb-4dba6c3cad6f tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:35.034246 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7c49c2d7-2f7d-4a45-80fb-4dba6c3cad6f tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:35.094987 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7c49c2d7-2f7d-4a45-80fb-4dba6c3cad6f tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:35.130280 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c49c2d7-2f7d-4a45-80fb-4dba6c3cad6f tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f8bf8f9d-1119-4dec-a84e-8494cf263dde,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:35.171637 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7c49c2d7-2f7d-4a45-80fb-4dba6c3cad6f tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:35.243699 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7c49c2d7-2f7d-4a45-80fb-4dba6c3cad6f tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:35.271331 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c49c2d7-2f7d-4a45-80fb-4dba6c3cad6f tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Pushing event updated for resources: {'SecurityGroup': ['ID=a5f0be53-4995-4a2e-b898-40ad20e8436b,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:35.353390 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7c49c2d7-2f7d-4a45-80fb-4dba6c3cad6f tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:35.354703 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-7c49c2d7-2f7d-4a45-80fb-4dba6c3cad6f tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.5693686 Nov 09 04:36:35.357343 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59562) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:35.386147 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52a4d160-bea7-4701-ab47-23ca86e69e94 req-4fe6e402-a674-4aba-b3a5-51a9e5acb87d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:36:35.387683 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-52a4d160-bea7-4701-ab47-23ca86e69e94 req-4fe6e402-a674-4aba-b3a5-51a9e5acb87d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=f5b9180a-61b4-4ed5-a5a7-a05b102af54c HTTP/1.1" status: 200 len: 945 time: 0.0504243 Nov 09 04:36:35.414063 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-2db0dc76-2f9c-4cb7-8188-aa2ec27d107b tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 4545 time: 0.0539765 Nov 09 04:36:35.415301 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59564) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:35.420143 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-975c2acd-94b7-42c8-9b67-5f3710971650 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Request body: {'security_group': {'name': 'tempest-security--1137019191', 'description': 'tempest-security-description-328513962'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:35.440483 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-52a4d160-bea7-4701-ab47-23ca86e69e94 req-a259a3ca-80df-44e4-a945-96415d9903fb tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=981c1801-295c-44ec-8fb7-4111fb839249&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0466514 Nov 09 04:36:35.461679 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-975c2acd-94b7-42c8-9b67-5f3710971650 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:35.500502 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-975c2acd-94b7-42c8-9b67-5f3710971650 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:35.553700 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74cccae6-be25-40e0-a5b8-d38428bb6566 req-78fe8234-330c-48f5-9856-804e29ef81dd tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:36:35.555188 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-74cccae6-be25-40e0-a5b8-d38428bb6566 req-78fe8234-330c-48f5-9856-804e29ef81dd tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=f5b9180a-61b4-4ed5-a5a7-a05b102af54c HTTP/1.1" status: 200 len: 945 time: 0.0479150 Nov 09 04:36:35.606103 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-74cccae6-be25-40e0-a5b8-d38428bb6566 req-472b7b04-0732-4c13-9525-92b93411bc9a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=981c1801-295c-44ec-8fb7-4111fb839249&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0449402 Nov 09 04:36:35.619470 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-975c2acd-94b7-42c8-9b67-5f3710971650 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:35.620041 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-975c2acd-94b7-42c8-9b67-5f3710971650 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:35.621204 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-975c2acd-94b7-42c8-9b67-5f3710971650 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "PUT /v2.0/security-groups/a5f0be53-4995-4a2e-b898-40ad20e8436b HTTP/1.1" status: 200 len: 1796 time: 0.2044573 Nov 09 04:36:35.624079 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59568) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:35.631290 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59570) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:35.664153 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-5c6a7ad4-fa7b-48e1-a5b9-6f23d74ad0c3 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "GET /v2.0/security-groups/a5f0be53-4995-4a2e-b898-40ad20e8436b HTTP/1.1" status: 200 len: 1796 time: 0.0386839 Nov 09 04:36:35.666679 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59572) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:35.670636 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-975c2acd-94b7-42c8-9b67-5f3710971650 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Pushing event updated for resources: {'SecurityGroup': ['ID=a5f0be53-4995-4a2e-b898-40ad20e8436b,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:35.686157 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f314054f-d3dd-46e2-b235-adaf5f42bf78 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:36:35.687732 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-f314054f-d3dd-46e2-b235-adaf5f42bf78 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/ports?device_id=f5b9180a-61b4-4ed5-a5a7-a05b102af54c HTTP/1.1" status: 200 len: 1093 time: 0.0555532 Nov 09 04:36:35.690646 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59574) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:35.699280 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-6819e6e4-0058-4798-914f-a9f1a9634a28 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'floatingip': {'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'port_id': '3113c017-8ef8-4edf-b772-4bcc8ee8298e', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ip_address': '172.20.0.3'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:35.744006 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3534f598-1ac9-40da-9162-3b8a2b2e8a02 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:35.766174 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3534f598-1ac9-40da-9162-3b8a2b2e8a02 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:35.820740 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6819e6e4-0058-4798-914f-a9f1a9634a28 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for floatingip, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:35.880699 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3534f598-1ac9-40da-9162-3b8a2b2e8a02 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:35.883300 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3534f598-1ac9-40da-9162-3b8a2b2e8a02 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:35.885005 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-3534f598-1ac9-40da-9162-3b8a2b2e8a02 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "DELETE /v2.0/security-groups/a5f0be53-4995-4a2e-b898-40ad20e8436b HTTP/1.1" status: 204 len: 168 time: 0.2173383 Nov 09 04:36:35.887673 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59576) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:35.898071 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3534f598-1ac9-40da-9162-3b8a2b2e8a02 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=a5f0be53-4995-4a2e-b898-40ad20e8436b,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:35.938867 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6819e6e4-0058-4798-914f-a9f1a9634a28 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:35.949746 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59578) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:35.950062 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e0b97531-df4f-40b3-a899-28f392402377 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0610986 Nov 09 04:36:35.989190 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-3c0cb302-b4d9-43b8-bd62-950891d92f9b tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] delete failed (client error): The resource could not be found. Nov 09 04:36:35.990204 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-3c0cb302-b4d9-43b8-bd62-950891d92f9b tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "DELETE /v2.0/security-groups/a5f0be53-4995-4a2e-b898-40ad20e8436b HTTP/1.1" status: 404 len: 347 time: 0.0395451 Nov 09 04:36:35.994968 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59580) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:35.999498 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-e302740d-c4bd-4de3-bc7f-412fd12e59d5 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Request body: {'security_group': {'name': 'tempest-secgroup--1327110205'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:36.060233 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-6819e6e4-0058-4798-914f-a9f1a9634a28 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Allocated IP 172.26.0.226 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/ce5b2350-dadb-44f7-bd1c-60ef2fc338b6) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:36:36.085849 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e302740d-c4bd-4de3-bc7f-412fd12e59d5 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:36.150290 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e302740d-c4bd-4de3-bc7f-412fd12e59d5 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:36.160974 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6819e6e4-0058-4798-914f-a9f1a9634a28 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:36.228363 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e302740d-c4bd-4de3-bc7f-412fd12e59d5 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:36.257202 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e302740d-c4bd-4de3-bc7f-412fd12e59d5 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Pushing event updated for resources: {'SecurityGroup': ['ID=ee9c090f-5f3b-4dd5-a462-ee6dc2603e8a,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:36.257495 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6819e6e4-0058-4798-914f-a9f1a9634a28 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:36.295361 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6819e6e4-0058-4798-914f-a9f1a9634a28 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:36:36.300071 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-6819e6e4-0058-4798-914f-a9f1a9634a28 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:36:36.303626 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6819e6e4-0058-4798-914f-a9f1a9634a28 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:36:36.330683 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6819e6e4-0058-4798-914f-a9f1a9634a28 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Port': ['ID=ce5b2350-dadb-44f7-bd1c-60ef2fc338b6,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:36.344875 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e302740d-c4bd-4de3-bc7f-412fd12e59d5 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:36.346222 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e302740d-c4bd-4de3-bc7f-412fd12e59d5 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.3502378 Nov 09 04:36:36.349107 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59582) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:36.353613 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-72b55c86-39c9-4e6b-97c1-778134091f5f tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Request body: {'security_group_rule': {'security_group_id': 'ee9c090f-5f3b-4dd5-a462-ee6dc2603e8a', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'tcp', 'port_range_min': 77, 'port_range_max': 77, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:36.461796 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-72b55c86-39c9-4e6b-97c1-778134091f5f tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:36.516187 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-72b55c86-39c9-4e6b-97c1-778134091f5f tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:36.592201 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-72b55c86-39c9-4e6b-97c1-778134091f5f tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:36.611606 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72b55c86-39c9-4e6b-97c1-778134091f5f tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9b5ba9d3-f75c-45aa-bb68-d70842c9a474,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:36.665497 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6819e6e4-0058-4798-914f-a9f1a9634a28 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:36.685618 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-72b55c86-39c9-4e6b-97c1-778134091f5f tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:36.686945 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-72b55c86-39c9-4e6b-97c1-778134091f5f tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3368831 Nov 09 04:36:36.689890 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59584) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:36.712986 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6bae8c6f-60b1-465b-b484-dffbee65095a tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:36.720498 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6bae8c6f-60b1-465b-b484-dffbee65095a tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:36.801141 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6819e6e4-0058-4798-914f-a9f1a9634a28 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:36.828159 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6bae8c6f-60b1-465b-b484-dffbee65095a tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:36.833530 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6bae8c6f-60b1-465b-b484-dffbee65095a tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:36.835754 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-6bae8c6f-60b1-465b-b484-dffbee65095a tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "DELETE /v2.0/security-group-rules/9b5ba9d3-f75c-45aa-bb68-d70842c9a474 HTTP/1.1" status: 204 len: 168 time: 0.1439419 Nov 09 04:36:36.839468 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59586) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:36.850631 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bae8c6f-60b1-465b-b484-dffbee65095a tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=9b5ba9d3-f75c-45aa-bb68-d70842c9a474,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:36.891281 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a208a03b-7ff9-458f-8e74-46b61c898630 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.0472243 Nov 09 04:36:36.891884 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59588) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:36.944343 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-23d44839-0058-4378-b59d-e4c4d5845618 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:36.953652 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6819e6e4-0058-4798-914f-a9f1a9634a28 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:36.967112 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-23d44839-0058-4378-b59d-e4c4d5845618 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:36.999675 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6819e6e4-0058-4798-914f-a9f1a9634a28 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:37.066484 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-23d44839-0058-4378-b59d-e4c4d5845618 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:37.069404 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-23d44839-0058-4378-b59d-e4c4d5845618 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:37.070571 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-23d44839-0058-4378-b59d-e4c4d5845618 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "DELETE /v2.0/security-groups/ee9c090f-5f3b-4dd5-a462-ee6dc2603e8a HTTP/1.1" status: 204 len: 168 time: 0.1779518 Nov 09 04:36:37.072767 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6819e6e4-0058-4798-914f-a9f1a9634a28 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Port': ['ID=ce5b2350-dadb-44f7-bd1c-60ef2fc338b6,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:37.074437 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59590) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:37.081430 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6819e6e4-0058-4798-914f-a9f1a9634a28 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:37.093989 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23d44839-0058-4378-b59d-e4c4d5845618 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=ee9c090f-5f3b-4dd5-a462-ee6dc2603e8a,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:37.128047 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-8f6584f4-cc31-4a0f-8042-500313642126 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0504427 Nov 09 04:36:37.131746 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59592) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:37.136898 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-176aeadd-803a-4d01-8560-f338c3a60226 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Request body: {'security_group': {'name': 'tempest-secgroup--2090696696'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:37.257438 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-176aeadd-803a-4d01-8560-f338c3a60226 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:37.328492 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-176aeadd-803a-4d01-8560-f338c3a60226 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:37.388344 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-176aeadd-803a-4d01-8560-f338c3a60226 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:37.417319 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-176aeadd-803a-4d01-8560-f338c3a60226 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Pushing event updated for resources: {'SecurityGroup': ['ID=3c9793fb-a1fd-4fbe-a439-989d918562d7,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:37.497345 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-176aeadd-803a-4d01-8560-f338c3a60226 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:37.498636 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-176aeadd-803a-4d01-8560-f338c3a60226 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.3657420 Nov 09 04:36:37.501385 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59594) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:37.505822 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-3c06d8c7-be8d-4bce-957b-e00d623e520f tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Request body: {'security_group_rule': {'security_group_id': '3c9793fb-a1fd-4fbe-a439-989d918562d7', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'icmp', 'port_range_min': 3, 'port_range_max': 2, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:37.527642 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.l3_db [None req-6819e6e4-0058-4798-914f-a9f1a9634a28 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Floating IP 6470cca7-dc81-47c6-bd16-952472f330c2 associated. External IP: 172.26.0.226, port: 3113c017-8ef8-4edf-b772-4bcc8ee8298e. Nov 09 04:36:37.620644 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3c06d8c7-be8d-4bce-957b-e00d623e520f tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:37.679354 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3c06d8c7-be8d-4bce-957b-e00d623e520f tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:37.737965 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6819e6e4-0058-4798-914f-a9f1a9634a28 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Router 73e2c7c1-e8be-4e45-a3ee-acc8be6515c9 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:36:37.765406 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3c06d8c7-be8d-4bce-957b-e00d623e520f tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:37.784371 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c06d8c7-be8d-4bce-957b-e00d623e520f tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0ac574bd-4fcc-4cad-bcb2-82ae95c5aec3,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:37.841131 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6819e6e4-0058-4798-914f-a9f1a9634a28 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:36:37.852333 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e2a268b2-b665-4eaa-b4ff-9397899a78af None None] Sync routers for ids ['73e2c7c1-e8be-4e45-a3ee-acc8be6515c9'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:36:37.863234 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e2a268b2-b665-4eaa-b4ff-9397899a78af None None] Routers {'73e2c7c1-e8be-4e45-a3ee-acc8be6515c9'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:36:37.865248 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-e2a268b2-b665-4eaa-b4ff-9397899a78af None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:36:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['73e2c7c1-e8be-4e45-a3ee-acc8be6515c9'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:37.888725 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3c06d8c7-be8d-4bce-957b-e00d623e520f tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:37.892692 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-3c06d8c7-be8d-4bce-957b-e00d623e520f tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.3877020 Nov 09 04:36:37.893320 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59596) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:37.897691 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-cd937018-08b9-4cfc-a02c-e153f8a5fc01 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Request body: {'security_group_rule': {'security_group_id': '3c9793fb-a1fd-4fbe-a439-989d918562d7', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'icmp', 'port_range_min': 3, 'port_range_max': 0, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:37.927811 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6819e6e4-0058-4798-914f-a9f1a9634a28 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:37.960642 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-6819e6e4-0058-4798-914f-a9f1a9634a28 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.2688787 Nov 09 04:36:37.961223 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f5b9180a-61b4-4ed5-a5a7-a05b102af54c', 'tag': '3113c017-8ef8-4edf-b772-4bcc8ee8298e'}] {{(pid=102161) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:36:37.963515 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59598) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:37.963687 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}99dfdda0def497b4372884ef2eb87f06b1e425c8eba5ceda5f64bbab037a07d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ebc9b703-b416-47d1-b887-7ff1a9e48f63" -d '{"events": [{"name": "network-changed", "server_uuid": "f5b9180a-61b4-4ed5-a5a7-a05b102af54c", "tag": "3113c017-8ef8-4edf-b772-4bcc8ee8298e"}]}' {{(pid=102161) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:36:37.982784 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-e2a268b2-b665-4eaa-b4ff-9397899a78af None None] Set router 73e2c7c1-e8be-4e45-a3ee-acc8be6515c9 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:36:38.006010 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:36:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c1845024-34c6-4ae3-af9d-eb706c862ff2 x-openstack-request-id: req-c1845024-34c6-4ae3-af9d-eb706c862ff2 {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:36:38.006010 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f5b9180a-61b4-4ed5-a5a7-a05b102af54c", "tag": "3113c017-8ef8-4edf-b772-4bcc8ee8298e", "status": "completed", "code": 200}]} {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:36:38.006010 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-c1845024-34c6-4ae3-af9d-eb706c862ff2 {{(pid=102161) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:36:38.006010 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f5b9180a-61b4-4ed5-a5a7-a05b102af54c', 'tag': '3113c017-8ef8-4edf-b772-4bcc8ee8298e', 'status': 'completed', 'code': 200} Nov 09 04:36:38.030436 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-51ea2ce2-42b2-4178-a653-c8e908e10ce0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/floatingips/6470cca7-dc81-47c6-bd16-952472f330c2 HTTP/1.1" status: 200 len: 991 time: 0.0653217 Nov 09 04:36:38.067625 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cd937018-08b9-4cfc-a02c-e153f8a5fc01 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:38.106353 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebc9b703-b416-47d1-b887-7ff1a9e48f63 req-180aa645-3e0d-4da2-a16b-2b8ecb19090b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:36:38.107837 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ebc9b703-b416-47d1-b887-7ff1a9e48f63 req-180aa645-3e0d-4da2-a16b-2b8ecb19090b service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&device_id=f5b9180a-61b4-4ed5-a5a7-a05b102af54c HTTP/1.1" status: 200 len: 1098 time: 0.0763865 Nov 09 04:36:38.185449 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cd937018-08b9-4cfc-a02c-e153f8a5fc01 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:38.215989 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-e2a268b2-b665-4eaa-b4ff-9397899a78af None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '73e2c7c1-e8be-4e45-a3ee-acc8be6515c9', 'name': 'tempest-TestNetworkBasicOps-router-129683286', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.26'}], 'enable_snat': True}, 'gw_port_id': '4cd82d33-ba2a-405e-8980-983e2ba630eb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:36:11Z', 'updated_at': '2021-11-09T04:36:18Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '4cd82d33-ba2a-405e-8980-983e2ba630eb', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:99:76:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '73e2c7c1-e8be-4e45-a3ee-acc8be6515c9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1236, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:36:12Z', 'updated_at': '2021-11-09T04:36:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '6470cca7-dc81-47c6-bd16-952472f330c2', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'floating_ip_address': '172.26.0.226', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '73e2c7c1-e8be-4e45-a3ee-acc8be6515c9', 'port_id': '3113c017-8ef8-4edf-b772-4bcc8ee8298e', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 1310, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '0f070182-4996-4fd0-8617-1172b3c4ac5e', 'mac_address': 'fa:16:3e:4d:61:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f5b9180a-61b4-4ed5-a5a7-a05b102af54c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:36:36Z', 'updated_at': '2021-11-09T04:36:36Z', 'revision_number': 0, 'project_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'bbd67963-8b33-4921-a309-ea3952dbf5cf', 'name': '', 'network_id': '0f070182-4996-4fd0-8617-1172b3c4ac5e', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:7b:3e:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '73e2c7c1-e8be-4e45-a3ee-acc8be6515c9', 'device_owner': 'network:router_interface', 'standard_attr_id': 1245, 'fixed_ips': [{'subnet_id': '3e268933-196a-4376-a711-8b4d4d9e3036', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:36:17Z', 'updated_at': '2021-11-09T04:36:21Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '3e268933-196a-4376-a711-8b4d4d9e3036', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:38.219712 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebc9b703-b416-47d1-b887-7ff1a9e48f63 req-05e09abf-8b41-465d-a2fe-b2ca1c81eb2b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:36:38.221233 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ebc9b703-b416-47d1-b887-7ff1a9e48f63 req-05e09abf-8b41-465d-a2fe-b2ca1c81eb2b service neutron] 10.222.0.26 "GET /v2.0/networks?id=0f070182-4996-4fd0-8617-1172b3c4ac5e HTTP/1.1" status: 200 len: 898 time: 0.1053941 Nov 09 04:36:38.243492 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e2a268b2-b665-4eaa-b4ff-9397899a78af None None] Checking router: 73e2c7c1-e8be-4e45-a3ee-acc8be6515c9 for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:36:38.252267 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e2a268b2-b665-4eaa-b4ff-9397899a78af None None] Routers {'73e2c7c1-e8be-4e45-a3ee-acc8be6515c9'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:36:38.252902 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-e2a268b2-b665-4eaa-b4ff-9397899a78af None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:36:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['73e2c7c1-e8be-4e45-a3ee-acc8be6515c9'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:38.275075 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cd937018-08b9-4cfc-a02c-e153f8a5fc01 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:38.302292 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd937018-08b9-4cfc-a02c-e153f8a5fc01 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=75d2a253-f87b-4538-9e2a-e67ebb124ebd,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:38.311113 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ebc9b703-b416-47d1-b887-7ff1a9e48f63 req-4c15b90d-a2c8-4df5-8774-2bbe27f7dcdc service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=3113c017-8ef8-4edf-b772-4bcc8ee8298e HTTP/1.1" status: 200 len: 999 time: 0.0820279 Nov 09 04:36:38.361742 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebc9b703-b416-47d1-b887-7ff1a9e48f63 req-7e62ecce-245b-4d71-8e01-3ae73c10beb2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:36:38.363300 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ebc9b703-b416-47d1-b887-7ff1a9e48f63 req-7e62ecce-245b-4d71-8e01-3ae73c10beb2 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=3e268933-196a-4376-a711-8b4d4d9e3036 HTTP/1.1" status: 200 len: 833 time: 0.0451975 Nov 09 04:36:38.363822 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-e2a268b2-b665-4eaa-b4ff-9397899a78af None None] Set router 73e2c7c1-e8be-4e45-a3ee-acc8be6515c9 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:36:38.404010 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cd937018-08b9-4cfc-a02c-e153f8a5fc01 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:38.405195 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-cd937018-08b9-4cfc-a02c-e153f8a5fc01 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.5111108 Nov 09 04:36:38.408135 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59602) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:38.413447 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-ef365f49-ff67-4d62-b695-17626ebf6d96 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Request body: {'security_group_rule': {'security_group_id': '3c9793fb-a1fd-4fbe-a439-989d918562d7', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'icmp', 'port_range_min': 8, 'port_range_max': 0, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:38.415910 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebc9b703-b416-47d1-b887-7ff1a9e48f63 req-43d02226-dd0d-48af-8255-361d1ba92059 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:36:38.417484 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ebc9b703-b416-47d1-b887-7ff1a9e48f63 req-43d02226-dd0d-48af-8255-361d1ba92059 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=0f070182-4996-4fd0-8617-1172b3c4ac5e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0458298 Nov 09 04:36:38.512033 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ef365f49-ff67-4d62-b695-17626ebf6d96 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:38.520905 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ebc9b703-b416-47d1-b887-7ff1a9e48f63 req-9817aaf2-727a-40a2-8761-e80cb12550c9 service neutron] 10.222.0.26 "GET /v2.0/networks/0f070182-4996-4fd0-8617-1172b3c4ac5e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0898812 Nov 09 04:36:38.574208 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ef365f49-ff67-4d62-b695-17626ebf6d96 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:38.597489 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-e2a268b2-b665-4eaa-b4ff-9397899a78af None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '73e2c7c1-e8be-4e45-a3ee-acc8be6515c9', 'name': 'tempest-TestNetworkBasicOps-router-129683286', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.26'}], 'enable_snat': True}, 'gw_port_id': '4cd82d33-ba2a-405e-8980-983e2ba630eb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:36:11Z', 'updated_at': '2021-11-09T04:36:18Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '4cd82d33-ba2a-405e-8980-983e2ba630eb', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:99:76:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '73e2c7c1-e8be-4e45-a3ee-acc8be6515c9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1236, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:36:12Z', 'updated_at': '2021-11-09T04:36:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '6470cca7-dc81-47c6-bd16-952472f330c2', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'floating_ip_address': '172.26.0.226', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '73e2c7c1-e8be-4e45-a3ee-acc8be6515c9', 'port_id': '3113c017-8ef8-4edf-b772-4bcc8ee8298e', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 1310, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '0f070182-4996-4fd0-8617-1172b3c4ac5e', 'mac_address': 'fa:16:3e:4d:61:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f5b9180a-61b4-4ed5-a5a7-a05b102af54c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:36:36Z', 'updated_at': '2021-11-09T04:36:36Z', 'revision_number': 0, 'project_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'bbd67963-8b33-4921-a309-ea3952dbf5cf', 'name': '', 'network_id': '0f070182-4996-4fd0-8617-1172b3c4ac5e', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:7b:3e:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '73e2c7c1-e8be-4e45-a3ee-acc8be6515c9', 'device_owner': 'network:router_interface', 'standard_attr_id': 1245, 'fixed_ips': [{'subnet_id': '3e268933-196a-4376-a711-8b4d4d9e3036', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:36:17Z', 'updated_at': '2021-11-09T04:36:21Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '3e268933-196a-4376-a711-8b4d4d9e3036', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:36:38.617990 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ebc9b703-b416-47d1-b887-7ff1a9e48f63 req-08cc2e7d-641d-4d4c-b81e-ba49ec4f0cf6 service neutron] 10.222.0.26 "GET /v2.0/networks/0f070182-4996-4fd0-8617-1172b3c4ac5e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0886333 Nov 09 04:36:38.624577 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e2a268b2-b665-4eaa-b4ff-9397899a78af None None] The sync data for ids ['73e2c7c1-e8be-4e45-a3ee-acc8be6515c9'] in dv-neutron-816802-2-hyperv is: [{'id': '73e2c7c1-e8be-4e45-a3ee-acc8be6515c9', 'name': 'tempest-TestNetworkBasicOps-router-129683286', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.26'}], 'enable_snat': True}, 'gw_port_id': '4cd82d33-ba2a-405e-8980-983e2ba630eb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:36:11Z', 'updated_at': '2021-11-09T04:36:18Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '4cd82d33-ba2a-405e-8980-983e2ba630eb', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:99:76:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '73e2c7c1-e8be-4e45-a3ee-acc8be6515c9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1236, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:36:12Z', 'updated_at': '2021-11-09T04:36:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '6470cca7-dc81-47c6-bd16-952472f330c2', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'floating_ip_address': '172.26.0.226', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '73e2c7c1-e8be-4e45-a3ee-acc8be6515c9', 'port_id': '3113c017-8ef8-4edf-b772-4bcc8ee8298e', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 1310, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '0f070182-4996-4fd0-8617-1172b3c4ac5e', 'mac_address': 'fa:16:3e:4d:61:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f5b9180a-61b4-4ed5-a5a7-a05b102af54c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:36:36Z', 'updated_at': '2021-11-09T04:36:36Z', 'revision_number': 0, 'project_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'bbd67963-8b33-4921-a309-ea3952dbf5cf', 'name': '', 'network_id': '0f070182-4996-4fd0-8617-1172b3c4ac5e', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:7b:3e:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '73e2c7c1-e8be-4e45-a3ee-acc8be6515c9', 'device_owner': 'network:router_interface', 'standard_attr_id': 1245, 'fixed_ips': [{'subnet_id': '3e268933-196a-4376-a711-8b4d4d9e3036', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:36:17Z', 'updated_at': '2021-11-09T04:36:21Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '3e268933-196a-4376-a711-8b4d4d9e3036', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:36:38.651575 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ef365f49-ff67-4d62-b695-17626ebf6d96 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:38.670236 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef365f49-ff67-4d62-b695-17626ebf6d96 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e790e64a-777d-4cb9-a2f5-95e81e33db8b,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:38.771898 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ef365f49-ff67-4d62-b695-17626ebf6d96 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:38.771898 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-ef365f49-ff67-4d62-b695-17626ebf6d96 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.3594778 Nov 09 04:36:38.772664 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59604) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:38.777050 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-9529716d-5775-4a4a-8dee-586d27f65fb8 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Request body: {'security_group_rule': {'security_group_id': '3c9793fb-a1fd-4fbe-a439-989d918562d7', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'icmp', 'port_range_min': 0, 'port_range_max': 0, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:38.809322 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e8699623-b9f9-4f16-945b-86143a2e918a None None] New status for floating IP 6470cca7-dc81-47c6-bd16-952472f330c2: ACTIVE {{(pid=102163) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 04:36:38.866029 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9529716d-5775-4a4a-8dee-586d27f65fb8 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:38.929587 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9529716d-5775-4a4a-8dee-586d27f65fb8 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:39.034288 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59606) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:39.045357 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9529716d-5775-4a4a-8dee-586d27f65fb8 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:39.063566 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9529716d-5775-4a4a-8dee-586d27f65fb8 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5ce69f39-ee3d-4a2d-b6ba-b55cb77c95c1,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:39.096295 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-dc7da74d-c283-443e-a50b-8551df9dd63d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/floatingips/6470cca7-dc81-47c6-bd16-952472f330c2 HTTP/1.1" status: 200 len: 991 time: 0.0609128 Nov 09 04:36:39.150306 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9529716d-5775-4a4a-8dee-586d27f65fb8 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:39.151582 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-9529716d-5775-4a4a-8dee-586d27f65fb8 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.3786914 Nov 09 04:36:39.154261 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59608) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:39.158675 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-82bf2a3b-fffb-4387-93a4-f0b113439a63 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Request body: {'security_group_rule': {'security_group_id': '3c9793fb-a1fd-4fbe-a439-989d918562d7', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'icmp', 'port_range_min': 11, 'port_range_max': None, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:39.249656 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-82bf2a3b-fffb-4387-93a4-f0b113439a63 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:39.309607 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-82bf2a3b-fffb-4387-93a4-f0b113439a63 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:39.404964 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-82bf2a3b-fffb-4387-93a4-f0b113439a63 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:39.423664 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82bf2a3b-fffb-4387-93a4-f0b113439a63 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1e8130d1-c663-4d9d-991f-04048a89d627,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:39.504302 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-82bf2a3b-fffb-4387-93a4-f0b113439a63 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:39.505481 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-82bf2a3b-fffb-4387-93a4-f0b113439a63 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 767 time: 0.3502440 Nov 09 04:36:39.508366 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59610) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:39.531030 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-73aba2f9-5abe-455e-9fc3-dfe3fed6fcb3 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:39.538562 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-73aba2f9-5abe-455e-9fc3-dfe3fed6fcb3 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:39.643529 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-73aba2f9-5abe-455e-9fc3-dfe3fed6fcb3 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:39.648384 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-73aba2f9-5abe-455e-9fc3-dfe3fed6fcb3 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:39.650407 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-73aba2f9-5abe-455e-9fc3-dfe3fed6fcb3 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "DELETE /v2.0/security-group-rules/1e8130d1-c663-4d9d-991f-04048a89d627 HTTP/1.1" status: 204 len: 168 time: 0.1410294 Nov 09 04:36:39.653673 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59612) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:39.657921 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73aba2f9-5abe-455e-9fc3-dfe3fed6fcb3 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=1e8130d1-c663-4d9d-991f-04048a89d627,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:39.697410 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-31923f4f-c2fa-42d4-9f08-e3608934860a tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 5731 time: 0.0425372 Nov 09 04:36:39.700469 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59614) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:39.723557 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-73306505-0d85-4905-9c46-f537a5d6abb0 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:39.731470 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-73306505-0d85-4905-9c46-f537a5d6abb0 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:39.805329 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-73306505-0d85-4905-9c46-f537a5d6abb0 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:39.811238 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-73306505-0d85-4905-9c46-f537a5d6abb0 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:39.812313 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-73306505-0d85-4905-9c46-f537a5d6abb0 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "DELETE /v2.0/security-group-rules/5ce69f39-ee3d-4a2d-b6ba-b55cb77c95c1 HTTP/1.1" status: 204 len: 168 time: 0.1109178 Nov 09 04:36:39.815735 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59616) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:39.817505 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73306505-0d85-4905-9c46-f537a5d6abb0 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=5ce69f39-ee3d-4a2d-b6ba-b55cb77c95c1,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:39.861696 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-bc704419-b01f-4805-bd50-3d3cc5122d0b tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 5190 time: 0.0446892 Nov 09 04:36:39.864872 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59618) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:39.888072 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-98d52fc8-9e56-4c9b-97e5-d62ef29baa83 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:39.895825 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-98d52fc8-9e56-4c9b-97e5-d62ef29baa83 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:40.037689 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-98d52fc8-9e56-4c9b-97e5-d62ef29baa83 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:40.043894 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-98d52fc8-9e56-4c9b-97e5-d62ef29baa83 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:40.045005 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-98d52fc8-9e56-4c9b-97e5-d62ef29baa83 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "DELETE /v2.0/security-group-rules/e790e64a-777d-4cb9-a2f5-95e81e33db8b HTTP/1.1" status: 204 len: 168 time: 0.1792204 Nov 09 04:36:40.048317 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59620) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:40.050515 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98d52fc8-9e56-4c9b-97e5-d62ef29baa83 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=e790e64a-777d-4cb9-a2f5-95e81e33db8b,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:40.091708 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-f9ad490b-0e19-434f-b9b0-e33194290209 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4649 time: 0.0421762 Nov 09 04:36:40.095065 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59622) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:40.099459 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59624) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:40.117797 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e4375649-3bc8-49c0-bad5-c665edca31d0 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:40.125138 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e4375649-3bc8-49c0-bad5-c665edca31d0 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:40.217462 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-6223d750-4b9f-401e-9615-44eec3e38c8e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/floatingips/6470cca7-dc81-47c6-bd16-952472f330c2 HTTP/1.1" status: 200 len: 993 time: 0.1168027 Nov 09 04:36:40.243212 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e4375649-3bc8-49c0-bad5-c665edca31d0 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:40.249511 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e4375649-3bc8-49c0-bad5-c665edca31d0 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:40.250614 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e4375649-3bc8-49c0-bad5-c665edca31d0 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "DELETE /v2.0/security-group-rules/75d2a253-f87b-4538-9e2a-e67ebb124ebd HTTP/1.1" status: 204 len: 168 time: 0.1546142 Nov 09 04:36:40.253907 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59626) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:40.255979 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4375649-3bc8-49c0-bad5-c665edca31d0 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=75d2a253-f87b-4538-9e2a-e67ebb124ebd,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:40.295609 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-df425610-20c2-4686-afcd-b5465b8364a2 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4108 time: 0.0404661 Nov 09 04:36:40.298319 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59628) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:40.320754 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-010d2245-259b-48bb-9864-238a2ad1d1df tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:40.328882 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-010d2245-259b-48bb-9864-238a2ad1d1df tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:40.422276 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-010d2245-259b-48bb-9864-238a2ad1d1df tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:40.428573 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-010d2245-259b-48bb-9864-238a2ad1d1df tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:40.429643 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-010d2245-259b-48bb-9864-238a2ad1d1df tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "DELETE /v2.0/security-group-rules/0ac574bd-4fcc-4cad-bcb2-82ae95c5aec3 HTTP/1.1" status: 204 len: 168 time: 0.1304240 Nov 09 04:36:40.432952 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59630) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:40.435637 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-010d2245-259b-48bb-9864-238a2ad1d1df tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=0ac574bd-4fcc-4cad-bcb2-82ae95c5aec3,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:40.470967 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-067a91ae-688f-4302-863b-be570cdf5781 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.0368001 Nov 09 04:36:40.473624 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59632) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:40.524635 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b0e5033a-719f-4fff-9206-e30d7ffdcbea tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:40.546864 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b0e5033a-719f-4fff-9206-e30d7ffdcbea tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:40.691149 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b0e5033a-719f-4fff-9206-e30d7ffdcbea tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:40.693783 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b0e5033a-719f-4fff-9206-e30d7ffdcbea tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:40.694966 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-b0e5033a-719f-4fff-9206-e30d7ffdcbea tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "DELETE /v2.0/security-groups/3c9793fb-a1fd-4fbe-a439-989d918562d7 HTTP/1.1" status: 204 len: 168 time: 0.2204435 Nov 09 04:36:40.698288 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59634) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:40.704364 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0e5033a-719f-4fff-9206-e30d7ffdcbea tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=3c9793fb-a1fd-4fbe-a439-989d918562d7,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:40.742757 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1896817c-03a2-4cd0-89a7-e511a3aaa545 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0432355 Nov 09 04:36:40.747806 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59636) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:40.752440 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-a80b35de-dd08-45f3-8cd1-71d0127af2c6 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Request body: {'security_group': {'name': 'tempest-secgroup--1139764081'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:40.845227 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a80b35de-dd08-45f3-8cd1-71d0127af2c6 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:40.916289 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a80b35de-dd08-45f3-8cd1-71d0127af2c6 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:41.014660 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a80b35de-dd08-45f3-8cd1-71d0127af2c6 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:41.042086 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a80b35de-dd08-45f3-8cd1-71d0127af2c6 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Pushing event updated for resources: {'SecurityGroup': ['ID=49ded90f-f6c4-454a-80ac-5b3d32cf1134,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:41.087694 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a80b35de-dd08-45f3-8cd1-71d0127af2c6 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:41.088924 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a80b35de-dd08-45f3-8cd1-71d0127af2c6 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.3401313 Nov 09 04:36:41.091705 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59638) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:41.096421 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-6b528c09-458d-48c8-b677-6339ba91bc78 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Request body: {'security_group_rule': {'security_group_id': '49ded90f-f6c4-454a-80ac-5b3d32cf1134', 'direction': 'ingress', 'protocol': 17}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:41.261188 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6b528c09-458d-48c8-b677-6339ba91bc78 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:41.315107 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6b528c09-458d-48c8-b677-6339ba91bc78 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:41.382458 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-30b8e05b-5c47-4326-908a-540deee0d1cd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:41.405209 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6b528c09-458d-48c8-b677-6339ba91bc78 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:41.422352 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b528c09-458d-48c8-b677-6339ba91bc78 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c0ec792b-5862-4862-9ccb-20a4315a0edc,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:41.498182 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6b528c09-458d-48c8-b677-6339ba91bc78 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:41.499411 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-6b528c09-458d-48c8-b677-6339ba91bc78 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 767 time: 0.4067390 Nov 09 04:36:41.502213 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59640) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:41.554429 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-33249820-69eb-4433-aad3-bed9b3bd25a5 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:41.577725 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-33249820-69eb-4433-aad3-bed9b3bd25a5 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:41.684893 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-33249820-69eb-4433-aad3-bed9b3bd25a5 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:41.687525 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-33249820-69eb-4433-aad3-bed9b3bd25a5 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:41.688689 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-33249820-69eb-4433-aad3-bed9b3bd25a5 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "DELETE /v2.0/security-groups/49ded90f-f6c4-454a-80ac-5b3d32cf1134 HTTP/1.1" status: 204 len: 168 time: 0.1855562 Nov 09 04:36:41.691508 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59642) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:41.697928 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33249820-69eb-4433-aad3-bed9b3bd25a5 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=49ded90f-f6c4-454a-80ac-5b3d32cf1134,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:41.735301 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-6d297efc-55d9-4ae7-ad20-2673c8002351 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0426350 Nov 09 04:36:41.739011 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59644) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:41.743498 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-58e6b2b9-1173-4ab9-9671-f02531c0ecfb tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Request body: {'security_group': {'name': 'tempest-secgroup--1746236922'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:41.862307 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-58e6b2b9-1173-4ab9-9671-f02531c0ecfb tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:41.928400 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-58e6b2b9-1173-4ab9-9671-f02531c0ecfb tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:41.999528 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-58e6b2b9-1173-4ab9-9671-f02531c0ecfb tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:42.028780 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58e6b2b9-1173-4ab9-9671-f02531c0ecfb tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Pushing event updated for resources: {'SecurityGroup': ['ID=0a754fbb-f086-482f-9af5-e44a3d72622f,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:42.150638 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-58e6b2b9-1173-4ab9-9671-f02531c0ecfb tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:42.151827 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-58e6b2b9-1173-4ab9-9671-f02531c0ecfb tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.4118850 Nov 09 04:36:42.154638 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59646) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:42.158939 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-b9490a51-06c2-4831-8e20-82ddb4b2e8d5 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Request body: {'security_group': {'name': 'tempest-secgroup--1629870333'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:42.171362 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:42.229055 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b9490a51-06c2-4831-8e20-82ddb4b2e8d5 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:42.298408 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b9490a51-06c2-4831-8e20-82ddb4b2e8d5 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:42.382196 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b9490a51-06c2-4831-8e20-82ddb4b2e8d5 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:42.415212 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9490a51-06c2-4831-8e20-82ddb4b2e8d5 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Pushing event updated for resources: {'SecurityGroup': ['ID=ae4eb5e2-6e81-42a1-a20e-8dad7af627b8,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:42.487160 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b9490a51-06c2-4831-8e20-82ddb4b2e8d5 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:42.488385 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-b9490a51-06c2-4831-8e20-82ddb4b2e8d5 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.3328426 Nov 09 04:36:42.491053 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59648) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:42.495921 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-8ba4e125-0ce9-428b-92d9-3b2771ad0b7b tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Request body: {'security_group_rule': {'security_group_id': '0a754fbb-f086-482f-9af5-e44a3d72622f', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'udp', 'port_range_min': 50, 'port_range_max': 55, 'remote_group_id': 'ae4eb5e2-6e81-42a1-a20e-8dad7af627b8', 'remote_ip_prefix': None}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:42.600892 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8ba4e125-0ce9-428b-92d9-3b2771ad0b7b tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:42.672597 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8ba4e125-0ce9-428b-92d9-3b2771ad0b7b tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:42.742207 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8ba4e125-0ce9-428b-92d9-3b2771ad0b7b tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:42.760364 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ba4e125-0ce9-428b-92d9-3b2771ad0b7b tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9eefd287-bd57-4a22-8d00-ea0d0a52e339,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:42.841159 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8ba4e125-0ce9-428b-92d9-3b2771ad0b7b tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:42.842380 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-8ba4e125-0ce9-428b-92d9-3b2771ad0b7b tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 798 time: 0.3503962 Nov 09 04:36:42.845441 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59650) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:42.869333 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f68e2253-5725-4fbc-9d24-7dd093294fb1 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:42.877424 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f68e2253-5725-4fbc-9d24-7dd093294fb1 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:42.969466 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f68e2253-5725-4fbc-9d24-7dd093294fb1 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:42.974105 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f68e2253-5725-4fbc-9d24-7dd093294fb1 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:42.975347 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-f68e2253-5725-4fbc-9d24-7dd093294fb1 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "DELETE /v2.0/security-group-rules/9eefd287-bd57-4a22-8d00-ea0d0a52e339 HTTP/1.1" status: 204 len: 168 time: 0.1289940 Nov 09 04:36:42.978631 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59652) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:42.983528 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f68e2253-5725-4fbc-9d24-7dd093294fb1 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=9eefd287-bd57-4a22-8d00-ea0d0a52e339,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:43.020555 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-ea8f162e-cd77-4635-9d23-f12df74bcc5b tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4659 time: 0.0405583 Nov 09 04:36:43.023267 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59654) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:43.075862 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6cceed32-f9d9-4fd0-9d0c-22ea69f6743e tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:43.097911 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6cceed32-f9d9-4fd0-9d0c-22ea69f6743e tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:43.291001 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6cceed32-f9d9-4fd0-9d0c-22ea69f6743e tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:43.294648 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6cceed32-f9d9-4fd0-9d0c-22ea69f6743e tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:43.295038 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-6cceed32-f9d9-4fd0-9d0c-22ea69f6743e tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "DELETE /v2.0/security-groups/ae4eb5e2-6e81-42a1-a20e-8dad7af627b8 HTTP/1.1" status: 204 len: 168 time: 0.2708578 Nov 09 04:36:43.297739 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59656) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:43.304187 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cceed32-f9d9-4fd0-9d0c-22ea69f6743e tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=ae4eb5e2-6e81-42a1-a20e-8dad7af627b8,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:43.354640 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-2856e3e8-b24c-44fa-9616-720ee99e4f03 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 4545 time: 0.0556731 Nov 09 04:36:43.357790 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59658) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:43.412404 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c64c03b5-a594-44b1-873e-22c737876b65 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:43.434487 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c64c03b5-a594-44b1-873e-22c737876b65 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:43.565255 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c64c03b5-a594-44b1-873e-22c737876b65 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:43.567876 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c64c03b5-a594-44b1-873e-22c737876b65 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:43.569107 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-c64c03b5-a594-44b1-873e-22c737876b65 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "DELETE /v2.0/security-groups/0a754fbb-f086-482f-9af5-e44a3d72622f HTTP/1.1" status: 204 len: 168 time: 0.2108357 Nov 09 04:36:43.572408 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59660) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:43.578940 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c64c03b5-a594-44b1-873e-22c737876b65 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=0a754fbb-f086-482f-9af5-e44a3d72622f,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:43.616108 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-83f9e800-bf0a-4266-9b3e-edb25c1e3cc5 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0425377 Nov 09 04:36:43.620458 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59662) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:43.624802 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-5349b834-4c9d-4ac6-9385-ade57c933d50 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Request body: {'security_group': {'name': 'tempest-secgroup--1109121681'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:43.751766 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-40de3519-a538-4ec2-97f9-8a682e58aaec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:43.765247 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5349b834-4c9d-4ac6-9385-ade57c933d50 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:43.829210 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5349b834-4c9d-4ac6-9385-ade57c933d50 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:43.888976 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5349b834-4c9d-4ac6-9385-ade57c933d50 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:43.918101 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5349b834-4c9d-4ac6-9385-ade57c933d50 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f5381b70-3cf6-4278-aa75-9400a57ac72d,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:43.994232 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5349b834-4c9d-4ac6-9385-ade57c933d50 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:43.995699 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-5349b834-4c9d-4ac6-9385-ade57c933d50 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.3743410 Nov 09 04:36:43.998375 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59664) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:44.002832 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-9e6838d6-db3b-49b2-8176-5d027ce063c6 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Request body: {'security_group_rule': {'security_group_id': 'f5381b70-3cf6-4278-aa75-9400a57ac72d', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'tcp', 'port_range_min': 76, 'port_range_max': 77, 'remote_group_id': None, 'remote_ip_prefix': '172.20.0.0/16'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:44.099783 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9e6838d6-db3b-49b2-8176-5d027ce063c6 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:44.156836 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9e6838d6-db3b-49b2-8176-5d027ce063c6 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:44.237770 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9e6838d6-db3b-49b2-8176-5d027ce063c6 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:44.255214 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e6838d6-db3b-49b2-8176-5d027ce063c6 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=592c39db-0ae7-47fc-a86d-6b4adff779ae,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:44.344092 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9e6838d6-db3b-49b2-8176-5d027ce063c6 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:44.345320 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-9e6838d6-db3b-49b2-8176-5d027ce063c6 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 786 time: 0.3459611 Nov 09 04:36:44.348277 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59668) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:44.371594 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-018efe71-a2b9-4bbf-95e9-8b0ebaf57c30 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:44.378842 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-018efe71-a2b9-4bbf-95e9-8b0ebaf57c30 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:44.488413 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-018efe71-a2b9-4bbf-95e9-8b0ebaf57c30 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:44.494684 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-018efe71-a2b9-4bbf-95e9-8b0ebaf57c30 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:44.495773 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-018efe71-a2b9-4bbf-95e9-8b0ebaf57c30 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "DELETE /v2.0/security-group-rules/592c39db-0ae7-47fc-a86d-6b4adff779ae HTTP/1.1" status: 204 len: 168 time: 0.1465747 Nov 09 04:36:44.498538 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59670) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:44.501057 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-018efe71-a2b9-4bbf-95e9-8b0ebaf57c30 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=592c39db-0ae7-47fc-a86d-6b4adff779ae,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:44.538488 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-528e8f39-6482-47e1-993e-02aa6ce4cd26 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.0387421 Nov 09 04:36:44.541734 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59672) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:44.591705 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f60db7f4-7f28-4094-b6ef-ccb8f72a0ee9 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:44.613738 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f60db7f4-7f28-4094-b6ef-ccb8f72a0ee9 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:44.753352 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f60db7f4-7f28-4094-b6ef-ccb8f72a0ee9 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:44.755920 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f60db7f4-7f28-4094-b6ef-ccb8f72a0ee9 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:44.757074 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-f60db7f4-7f28-4094-b6ef-ccb8f72a0ee9 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "DELETE /v2.0/security-groups/f5381b70-3cf6-4278-aa75-9400a57ac72d HTTP/1.1" status: 204 len: 168 time: 0.2144496 Nov 09 04:36:44.759877 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59674) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:44.766169 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f60db7f4-7f28-4094-b6ef-ccb8f72a0ee9 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=f5381b70-3cf6-4278-aa75-9400a57ac72d,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:44.802630 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-745c5af8-5b8b-42eb-bbc1-6343b8a4bc9f tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0415661 Nov 09 04:36:44.807064 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59676) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:44.811561 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-aa95b5a2-be18-43ec-b8c0-cc15c9d4b4f9 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Request body: {'security_group': {'name': 'tempest-secgroup--1652418347'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:44.959425 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-aa95b5a2-be18-43ec-b8c0-cc15c9d4b4f9 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:45.027241 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-aa95b5a2-be18-43ec-b8c0-cc15c9d4b4f9 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:45.085282 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:45.131077 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-aa95b5a2-be18-43ec-b8c0-cc15c9d4b4f9 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:45.159625 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa95b5a2-be18-43ec-b8c0-cc15c9d4b4f9 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Pushing event updated for resources: {'SecurityGroup': ['ID=3940f567-a02e-4add-8522-ad134eb54333,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:45.310697 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-aa95b5a2-be18-43ec-b8c0-cc15c9d4b4f9 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:45.311909 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-aa95b5a2-be18-43ec-b8c0-cc15c9d4b4f9 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.5038168 Nov 09 04:36:45.315306 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59678) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:45.319689 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-c67b5748-1dc9-49c6-b056-c102e09aff65 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Request body: {'security_group_rule': {'security_group_id': '3940f567-a02e-4add-8522-ad134eb54333', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:45.739716 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c67b5748-1dc9-49c6-b056-c102e09aff65 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:45.792245 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c67b5748-1dc9-49c6-b056-c102e09aff65 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:45.890964 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c67b5748-1dc9-49c6-b056-c102e09aff65 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:45.908618 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c67b5748-1dc9-49c6-b056-c102e09aff65 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6ad1011a-fc1e-4491-8e8c-6d32fd183afb,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:46.028284 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c67b5748-1dc9-49c6-b056-c102e09aff65 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:46.030658 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-c67b5748-1dc9-49c6-b056-c102e09aff65 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.7132716 Nov 09 04:36:46.032246 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59680) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:46.048868 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-88888876-ce4a-4414-8df4-a0657bf170d9 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "GET /v2.0/security-group-rules/6ad1011a-fc1e-4491-8e8c-6d32fd183afb HTTP/1.1" status: 200 len: 763 time: 0.0155504 Nov 09 04:36:46.056156 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59682) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:46.094451 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-d5f51844-bc76-4934-8147-b54c0d3eb707 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4113 time: 0.0372415 Nov 09 04:36:46.097307 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59684) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:46.120756 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4e6404fa-b3d4-475e-b87f-48fd5ec6329a tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:46.128050 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4e6404fa-b3d4-475e-b87f-48fd5ec6329a tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:46.222145 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4e6404fa-b3d4-475e-b87f-48fd5ec6329a tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:46.226861 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4e6404fa-b3d4-475e-b87f-48fd5ec6329a tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:46.228896 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-4e6404fa-b3d4-475e-b87f-48fd5ec6329a tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "DELETE /v2.0/security-group-rules/6ad1011a-fc1e-4491-8e8c-6d32fd183afb HTTP/1.1" status: 204 len: 168 time: 0.1307094 Nov 09 04:36:46.231624 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59686) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:46.236632 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e6404fa-b3d4-475e-b87f-48fd5ec6329a tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=6ad1011a-fc1e-4491-8e8c-6d32fd183afb,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:46.272966 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-ca7c0f27-4878-4564-8acf-0e84aea995ac tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.0401638 Nov 09 04:36:46.275600 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59688) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:46.279782 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-4c31dd70-7d4f-49c4-8f50-92c6b9ad0290 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Request body: {'security_group_rule': {'security_group_id': '3940f567-a02e-4add-8522-ad134eb54333', 'protocol': 'udp', 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:46.375345 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4c31dd70-7d4f-49c4-8f50-92c6b9ad0290 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:46.420477 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:46.428538 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4c31dd70-7d4f-49c4-8f50-92c6b9ad0290 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:46.531116 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4c31dd70-7d4f-49c4-8f50-92c6b9ad0290 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:46.548411 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c31dd70-7d4f-49c4-8f50-92c6b9ad0290 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7fa12c35-92ce-4e0b-a981-141a6276af3b,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:46.646851 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4c31dd70-7d4f-49c4-8f50-92c6b9ad0290 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:46.648070 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-4c31dd70-7d4f-49c4-8f50-92c6b9ad0290 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3715708 Nov 09 04:36:46.651351 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59690) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:46.667694 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-d8b33a7f-eb55-402b-9568-46c7d09ac7ba tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "GET /v2.0/security-group-rules/7fa12c35-92ce-4e0b-a981-141a6276af3b HTTP/1.1" status: 200 len: 763 time: 0.0152998 Nov 09 04:36:46.673932 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59692) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:46.712197 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-fca0376a-2ca6-47dc-a8e9-b4c1a558f8f3 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4113 time: 0.0372205 Nov 09 04:36:46.714751 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59694) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:46.740078 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f6acb557-4d86-4e82-9474-b3c7fa755ad7 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:46.747187 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f6acb557-4d86-4e82-9474-b3c7fa755ad7 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:46.842745 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f6acb557-4d86-4e82-9474-b3c7fa755ad7 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:46.847853 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f6acb557-4d86-4e82-9474-b3c7fa755ad7 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:46.848943 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-f6acb557-4d86-4e82-9474-b3c7fa755ad7 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "DELETE /v2.0/security-group-rules/7fa12c35-92ce-4e0b-a981-141a6276af3b HTTP/1.1" status: 204 len: 168 time: 0.1333275 Nov 09 04:36:46.851733 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59696) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:46.856563 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6acb557-4d86-4e82-9474-b3c7fa755ad7 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=7fa12c35-92ce-4e0b-a981-141a6276af3b,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:46.890611 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-db4ec611-f081-4545-bbd2-8d93ce8d689f tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.0376923 Nov 09 04:36:46.893593 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59698) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:46.898347 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-b35c8a93-937a-4d09-b1ca-d9f8ddf85320 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Request body: {'security_group_rule': {'security_group_id': '3940f567-a02e-4add-8522-ad134eb54333', 'protocol': 'icmp', 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:46.964823 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:47.009273 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b35c8a93-937a-4d09-b1ca-d9f8ddf85320 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:47.055063 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b35c8a93-937a-4d09-b1ca-d9f8ddf85320 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:47.135013 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b35c8a93-937a-4d09-b1ca-d9f8ddf85320 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:47.153585 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b35c8a93-937a-4d09-b1ca-d9f8ddf85320 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ff8e01c5-3b22-4a54-b1e8-474f638056f7,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:47.262269 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b35c8a93-937a-4d09-b1ca-d9f8ddf85320 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:47.263532 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-b35c8a93-937a-4d09-b1ca-d9f8ddf85320 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3687899 Nov 09 04:36:47.266315 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59700) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:47.281934 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-85372f78-e2cf-4201-b79b-603dec61ee2b tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "GET /v2.0/security-group-rules/ff8e01c5-3b22-4a54-b1e8-474f638056f7 HTTP/1.1" status: 200 len: 764 time: 0.0145240 Nov 09 04:36:47.289306 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59702) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:47.329459 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-eee7b8b5-79d8-427e-85e4-af6412001364 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4114 time: 0.0391188 Nov 09 04:36:47.331991 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59704) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:47.355402 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c97696e2-16a3-458f-9505-b8cd7aa8111c tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:47.362838 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c97696e2-16a3-458f-9505-b8cd7aa8111c tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:47.456090 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c97696e2-16a3-458f-9505-b8cd7aa8111c tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:47.461845 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c97696e2-16a3-458f-9505-b8cd7aa8111c tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:47.462965 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-c97696e2-16a3-458f-9505-b8cd7aa8111c tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "DELETE /v2.0/security-group-rules/ff8e01c5-3b22-4a54-b1e8-474f638056f7 HTTP/1.1" status: 204 len: 168 time: 0.1299822 Nov 09 04:36:47.465605 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59706) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:47.468749 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c97696e2-16a3-458f-9505-b8cd7aa8111c tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=ff8e01c5-3b22-4a54-b1e8-474f638056f7,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:47.504950 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-9fa1f8d3-1bbf-4b10-b947-5ac554c33881 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.0382016 Nov 09 04:36:47.507743 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59708) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:47.561301 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3a3d4f7d-d857-438c-9692-fdedca0c4ca5 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:47.583211 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3a3d4f7d-d857-438c-9692-fdedca0c4ca5 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:47.731200 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3a3d4f7d-d857-438c-9692-fdedca0c4ca5 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:47.734038 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3a3d4f7d-d857-438c-9692-fdedca0c4ca5 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:47.735200 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-3a3d4f7d-d857-438c-9692-fdedca0c4ca5 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "DELETE /v2.0/security-groups/3940f567-a02e-4add-8522-ad134eb54333 HTTP/1.1" status: 204 len: 168 time: 0.2259114 Nov 09 04:36:47.737858 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59710) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:47.745060 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a3d4f7d-d857-438c-9692-fdedca0c4ca5 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=3940f567-a02e-4add-8522-ad134eb54333,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:47.781399 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-f877bede-12ac-48fc-86ee-e8e677e41b58 tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0423892 Nov 09 04:36:47.785411 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59712) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:47.828612 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-06f25666-3c07-4f2f-ae52-9933cc8c0daf tempest-SecGroupTest-125265679 tempest-SecGroupTest-125265679-project] 10.222.0.24 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0421729 Nov 09 04:36:48.272550 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59718) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:48.402858 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-ba73c188-86e6-4da2-af14-87e8da283ad8 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=35ddb4dc1ffa40b89e94d44945c2176e&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1291397 Nov 09 04:36:48.405342 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59722) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:48.451680 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e88cf8b0-b217-4306-b1cd-6572848aad92 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:48.472648 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e88cf8b0-b217-4306-b1cd-6572848aad92 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:48.626063 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e88cf8b0-b217-4306-b1cd-6572848aad92 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:48.628633 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e88cf8b0-b217-4306-b1cd-6572848aad92 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:48.629864 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-e88cf8b0-b217-4306-b1cd-6572848aad92 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/f8bf8f9d-1119-4dec-a84e-8494cf263dde HTTP/1.1" status: 204 len: 168 time: 0.2236161 Nov 09 04:36:48.637511 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e88cf8b0-b217-4306-b1cd-6572848aad92 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f8bf8f9d-1119-4dec-a84e-8494cf263dde,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:49.346047 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-79a35d77-3867-40de-a813-c45defd4da09 req-d019e74a-77ed-4410-b0a6-5b9eeddd5924 service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=f0ae9486-80b5-43bd-acec-49f871c00e67&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0414937 Nov 09 04:36:49.434346 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79a35d77-3867-40de-a813-c45defd4da09 req-12ddcf1b-c0e1-4b69-9a48-b76c0ed74ad1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:36:49.436922 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-79a35d77-3867-40de-a813-c45defd4da09 req-12ddcf1b-c0e1-4b69-9a48-b76c0ed74ad1 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=f636e5f4c9f64f69ba3b2ab8816b6096&device_id=f0ae9486-80b5-43bd-acec-49f871c00e67 HTTP/1.1" status: 200 len: 1098 time: 0.0447488 Nov 09 04:36:49.544038 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79a35d77-3867-40de-a813-c45defd4da09 req-425d9422-ee7e-4c1e-a182-69b874b8a158 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:36:49.545507 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-79a35d77-3867-40de-a813-c45defd4da09 req-425d9422-ee7e-4c1e-a182-69b874b8a158 service neutron] 10.222.0.26 "GET /v2.0/networks?id=999b1b20-f8fc-4caf-84cc-3feda426a0bf HTTP/1.1" status: 200 len: 913 time: 0.0890167 Nov 09 04:36:49.610448 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-79a35d77-3867-40de-a813-c45defd4da09 req-981e7aeb-353c-4e61-96ec-61b9fe0c31eb service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=d4753771-ff46-428e-9ad0-3dce1a15a45f HTTP/1.1" status: 200 len: 1001 time: 0.0579870 Nov 09 04:36:49.651966 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59744) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:49.664912 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79a35d77-3867-40de-a813-c45defd4da09 req-bbc3039c-922a-4bcb-9665-5114d3eda4d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:36:49.667000 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-79a35d77-3867-40de-a813-c45defd4da09 req-bbc3039c-922a-4bcb-9665-5114d3eda4d3 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=f6a08667-654b-4e0c-9f85-c6e6712cc239 HTTP/1.1" status: 200 len: 851 time: 0.0497644 Nov 09 04:36:49.713608 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79a35d77-3867-40de-a813-c45defd4da09 req-e62cbb35-ca90-4159-80ca-76e075f771cf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:36:49.715184 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-79a35d77-3867-40de-a813-c45defd4da09 req-e62cbb35-ca90-4159-80ca-76e075f771cf service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=999b1b20-f8fc-4caf-84cc-3feda426a0bf&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0410945 Nov 09 04:36:49.756227 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-d7398e04-2fda-4945-96e8-bd0151a51fdc tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Request body: {'security_group': {'name': 'default'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:49.756705 dv-neutron-816802-2-hyperv neutron-server[102161]: WARNING neutron.api.v2.base [None req-d7398e04-2fda-4945-96e8-bd0151a51fdc tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] An exception happened while processing the request body. The exception message is [Default security group already exists.].: neutron.extensions.securitygroup.SecurityGroupDefaultAlreadyExists: Default security group already exists. Nov 09 04:36:49.757201 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-d7398e04-2fda-4945-96e8-bd0151a51fdc tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] create failed (client error): There was a conflict when trying to complete your request. Nov 09 04:36:49.758261 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-d7398e04-2fda-4945-96e8-bd0151a51fdc tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 409 len: 330 time: 0.1053734 Nov 09 04:36:49.762317 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59748) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:49.767339 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-889b7547-c13b-41eb-9b3f-94c239021511 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Request body: {'security_group': {'name': 'tempest-secgroup--840780598'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:49.810153 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-79a35d77-3867-40de-a813-c45defd4da09 req-90aaa525-da50-4a69-abde-4658fc041484 service neutron] 10.222.0.26 "GET /v2.0/networks/999b1b20-f8fc-4caf-84cc-3feda426a0bf?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0881526 Nov 09 04:36:49.877627 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-889b7547-c13b-41eb-9b3f-94c239021511 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:49.886724 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-889b7547-c13b-41eb-9b3f-94c239021511 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:49.901871 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-79a35d77-3867-40de-a813-c45defd4da09 req-3eb89513-789b-4978-9878-c92f310de881 service neutron] 10.222.0.26 "GET /v2.0/networks/999b1b20-f8fc-4caf-84cc-3feda426a0bf?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0841208 Nov 09 04:36:49.961942 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-889b7547-c13b-41eb-9b3f-94c239021511 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:50.033490 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-889b7547-c13b-41eb-9b3f-94c239021511 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:50.069286 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-889b7547-c13b-41eb-9b3f-94c239021511 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Pushing event updated for resources: {'SecurityGroup': ['ID=38bd8861-b019-4637-b3d6-aa3db3ade3fe,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:50.111619 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-889b7547-c13b-41eb-9b3f-94c239021511 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:50.192692 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-889b7547-c13b-41eb-9b3f-94c239021511 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:50.229159 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-889b7547-c13b-41eb-9b3f-94c239021511 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b40096e9-aaed-47f1-ac18-096a1b972268,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:50.315344 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-889b7547-c13b-41eb-9b3f-94c239021511 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:50.316596 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-889b7547-c13b-41eb-9b3f-94c239021511 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.5533581 Nov 09 04:36:50.319555 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59750) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:50.324535 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-c035732c-3d39-4a27-9b08-06946d2e74de tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Request body: {'security_group_rule': {'security_group_id': 'b40096e9-aaed-47f1-ac18-096a1b972268', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'tcp', 'port_range_min': 66, 'port_range_max': 67}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:50.436788 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c035732c-3d39-4a27-9b08-06946d2e74de tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:50.491053 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c035732c-3d39-4a27-9b08-06946d2e74de tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:50.547881 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c035732c-3d39-4a27-9b08-06946d2e74de tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:50.565849 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c035732c-3d39-4a27-9b08-06946d2e74de tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=043d8702-c811-4a92-ba81-ef8488170754,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:50.646881 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c035732c-3d39-4a27-9b08-06946d2e74de tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:50.648114 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-c035732c-3d39-4a27-9b08-06946d2e74de tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3275583 Nov 09 04:36:50.650834 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59752) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:50.655134 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-074c5ce9-d705-4760-9959-fade675d83ff tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Request body: {'security_group_rule': {'security_group_id': 'b40096e9-aaed-47f1-ac18-096a1b972268', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'port_range_min': 66, 'port_range_max': 67}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:50.740851 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-074c5ce9-d705-4760-9959-fade675d83ff tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:50.850841 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-074c5ce9-d705-4760-9959-fade675d83ff tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] create failed (client error): There was a conflict when trying to complete your request. Nov 09 04:36:50.851912 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-074c5ce9-d705-4760-9959-fade675d83ff tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 409 len: 366 time: 0.2001681 Nov 09 04:36:50.855374 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59754) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:50.907002 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ee4bda46-3805-4629-96d1-ac5de9a15447 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:50.929718 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ee4bda46-3805-4629-96d1-ac5de9a15447 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:51.083203 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ee4bda46-3805-4629-96d1-ac5de9a15447 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:51.085793 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ee4bda46-3805-4629-96d1-ac5de9a15447 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:51.086952 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-ee4bda46-3805-4629-96d1-ac5de9a15447 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] 10.222.0.24 "DELETE /v2.0/security-groups/b40096e9-aaed-47f1-ac18-096a1b972268 HTTP/1.1" status: 204 len: 168 time: 0.2306585 Nov 09 04:36:51.090199 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59756) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:51.096615 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee4bda46-3805-4629-96d1-ac5de9a15447 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=b40096e9-aaed-47f1-ac18-096a1b972268,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:51.133097 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-89533f4c-2fca-4ea8-afe4-7dbca661240b tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] 10.222.0.24 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0417550 Nov 09 04:36:51.136980 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59758) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:51.141312 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-4543bb6c-7b26-42f6-b047-91221be93054 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Request body: {'security_group': {'name': 'tempest-secgroup--1226814359'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:51.239079 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4543bb6c-7b26-42f6-b047-91221be93054 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:51.305156 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4543bb6c-7b26-42f6-b047-91221be93054 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:51.368134 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4543bb6c-7b26-42f6-b047-91221be93054 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:51.400287 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4543bb6c-7b26-42f6-b047-91221be93054 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Pushing event updated for resources: {'SecurityGroup': ['ID=a6cde137-0222-4748-83a9-3cf2a1b543b9,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:51.490599 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4543bb6c-7b26-42f6-b047-91221be93054 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:51.491841 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-4543bb6c-7b26-42f6-b047-91221be93054 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.3538811 Nov 09 04:36:51.494933 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59760) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:51.499144 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-51bb702c-f759-414b-b76b-6756b8e487b4 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Request body: {'security_group_rule': {'security_group_id': 'a6cde137-0222-4748-83a9-3cf2a1b543b9', 'protocol': 'udp', 'direction': 'ingress', 'ethertype': 'bad_ethertype'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:51.499978 dv-neutron-816802-2-hyperv neutron-server[102162]: WARNING neutron.api.v2.base [None req-51bb702c-f759-414b-b76b-6756b8e487b4 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] An exception happened while processing the request body. The exception message is [Security group rule for ethertype 'bad_ethertype' not supported. Allowed values are ['IPv4', 'IPv6'].].: securitygroup.SecurityGroupRuleInvalidEtherType: Security group rule for ethertype 'bad_ethertype' not supported. Allowed values are ['IPv4', 'IPv6']. Nov 09 04:36:51.500463 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.api.v2.resource [None req-51bb702c-f759-414b-b76b-6756b8e487b4 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:36:51.501360 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-51bb702c-f759-414b-b76b-6756b8e487b4 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 396 time: 0.0055399 Nov 09 04:36:51.503620 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59762) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:51.554061 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b91bae7d-7b22-40ab-9a09-af17cb880145 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:51.576683 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b91bae7d-7b22-40ab-9a09-af17cb880145 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:51.713284 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b91bae7d-7b22-40ab-9a09-af17cb880145 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:51.715837 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b91bae7d-7b22-40ab-9a09-af17cb880145 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:51.716970 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-b91bae7d-7b22-40ab-9a09-af17cb880145 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] 10.222.0.24 "DELETE /v2.0/security-groups/a6cde137-0222-4748-83a9-3cf2a1b543b9 HTTP/1.1" status: 204 len: 168 time: 0.2124510 Nov 09 04:36:51.720074 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59766) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:51.727206 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b91bae7d-7b22-40ab-9a09-af17cb880145 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=a6cde137-0222-4748-83a9-3cf2a1b543b9,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:51.766155 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-d9a03b1c-7b7e-4782-966f-a99a2c62e39e tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] 10.222.0.24 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0443006 Nov 09 04:36:51.769934 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59768) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:51.774487 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-308e8df6-1d37-480f-8d24-7d561f5fd627 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Request body: {'security_group': {'name': 'tempest-secgroup--571038464'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:51.907964 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-308e8df6-1d37-480f-8d24-7d561f5fd627 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:51.972924 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-308e8df6-1d37-480f-8d24-7d561f5fd627 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:52.060475 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-308e8df6-1d37-480f-8d24-7d561f5fd627 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:52.088309 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-308e8df6-1d37-480f-8d24-7d561f5fd627 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Pushing event updated for resources: {'SecurityGroup': ['ID=54fa2bc6-9a8b-46bf-af70-668a61e887b7,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:52.158977 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-308e8df6-1d37-480f-8d24-7d561f5fd627 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:52.160185 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-308e8df6-1d37-480f-8d24-7d561f5fd627 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.3892372 Nov 09 04:36:52.163131 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59770) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:52.167738 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-4797e665-21ec-4da6-8674-1ebc6a7c2057 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Request body: {'security_group_rule': {'security_group_id': '54fa2bc6-9a8b-46bf-af70-668a61e887b7', 'protocol': 'bad_protocol_name', 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:52.169159 dv-neutron-816802-2-hyperv neutron-server[102161]: WARNING neutron.api.v2.base [None req-4797e665-21ec-4da6-8674-1ebc6a7c2057 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] An exception happened while processing the request body. The exception message is [Security group rule protocol bad_protocol_name not supported. Only protocol values [None, 'ah', 'dccp', 'egp', 'esp', 'gre', 'hopopt', 'icmp', 'igmp', 'ip', 'ipip', 'ipv6-encap', 'ipv6-frag', 'ipv6-icmp', 'icmpv6', 'ipv6-nonxt', 'ipv6-opts', 'ipv6-route', 'ospf', 'pgm', 'rsvp', 'sctp', 'tcp', 'udp', 'udplite', 'vrrp'] and integer representations [0 to 255] are supported.].: securitygroup.SecurityGroupRuleInvalidProtocol: Security group rule protocol bad_protocol_name not supported. Only protocol values [None, 'ah', 'dccp', 'egp', 'esp', 'gre', 'hopopt', 'icmp', 'igmp', 'ip', 'ipip', 'ipv6-encap', 'ipv6-frag', 'ipv6-icmp', 'icmpv6', 'ipv6-nonxt', 'ipv6-opts', 'ipv6-route', 'ospf', 'pgm', 'rsvp', 'sctp', 'tcp', 'udp', 'udplite', 'vrrp'] and integer representations [0 to 255] are supported. Nov 09 04:36:52.169695 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-4797e665-21ec-4da6-8674-1ebc6a7c2057 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:36:52.170690 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-4797e665-21ec-4da6-8674-1ebc6a7c2057 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 667 time: 0.0064828 Nov 09 04:36:52.172955 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59772) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:52.224645 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a87ffd45-49b6-412a-aa6c-70c530bdacce tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:52.248095 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a87ffd45-49b6-412a-aa6c-70c530bdacce tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:52.364493 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a87ffd45-49b6-412a-aa6c-70c530bdacce tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:52.367190 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a87ffd45-49b6-412a-aa6c-70c530bdacce tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:52.368341 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a87ffd45-49b6-412a-aa6c-70c530bdacce tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] 10.222.0.24 "DELETE /v2.0/security-groups/54fa2bc6-9a8b-46bf-af70-668a61e887b7 HTTP/1.1" status: 204 len: 168 time: 0.1945198 Nov 09 04:36:52.371110 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59774) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:52.377596 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a87ffd45-49b6-412a-aa6c-70c530bdacce tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=54fa2bc6-9a8b-46bf-af70-668a61e887b7,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:52.412834 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-4595ceaa-01a7-4d12-a068-c04b36c5c658 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] 10.222.0.24 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0404513 Nov 09 04:36:52.416410 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59776) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:52.421130 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-2fc81974-92b1-4949-bda9-b9ccb97060b0 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Request body: {'security_group': {'name': 'tempest-secgroup--1538364722'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:52.501620 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2fc81974-92b1-4949-bda9-b9ccb97060b0 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:52.568431 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2fc81974-92b1-4949-bda9-b9ccb97060b0 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:52.700576 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2fc81974-92b1-4949-bda9-b9ccb97060b0 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:52.728958 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fc81974-92b1-4949-bda9-b9ccb97060b0 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Pushing event updated for resources: {'SecurityGroup': ['ID=542d77bb-5230-4a38-92de-253fd51879f6,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:52.801072 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2fc81974-92b1-4949-bda9-b9ccb97060b0 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:52.802328 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-2fc81974-92b1-4949-bda9-b9ccb97060b0 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.3849812 Nov 09 04:36:52.805135 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59778) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:52.809488 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-0eb4fd61-0e29-4b6a-82d6-f1d2b9da8990 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Request body: {'security_group_rule': {'security_group_id': '542d77bb-5230-4a38-92de-253fd51879f6', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_ip_prefix': '192.168.1./24'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:52.810327 dv-neutron-816802-2-hyperv neutron-server[102162]: WARNING neutron.api.v2.base [None req-0eb4fd61-0e29-4b6a-82d6-f1d2b9da8990 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] An exception happened while processing the request body. The exception message is [Invalid CIDR 192.168.1./24 given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR 192.168.1./24 given as IP prefix. Nov 09 04:36:52.810825 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.api.v2.resource [None req-0eb4fd61-0e29-4b6a-82d6-f1d2b9da8990 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:36:52.811716 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-0eb4fd61-0e29-4b6a-82d6-f1d2b9da8990 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 319 time: 0.0056469 Nov 09 04:36:52.814265 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59780) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:52.817992 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-6ac6c34e-0777-4490-a3b2-5722f5d3636e tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Request body: {'security_group_rule': {'security_group_id': '542d77bb-5230-4a38-92de-253fd51879f6', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_ip_prefix': '192.168.1.1/33'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:52.818617 dv-neutron-816802-2-hyperv neutron-server[102162]: WARNING neutron.api.v2.base [None req-6ac6c34e-0777-4490-a3b2-5722f5d3636e tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] An exception happened while processing the request body. The exception message is [Invalid CIDR 192.168.1.1/33 given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR 192.168.1.1/33 given as IP prefix. Nov 09 04:36:52.819056 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.api.v2.resource [None req-6ac6c34e-0777-4490-a3b2-5722f5d3636e tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:36:52.819928 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-6ac6c34e-0777-4490-a3b2-5722f5d3636e tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 320 time: 0.0048475 Nov 09 04:36:52.827373 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59782) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:52.832459 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-3c1f5899-4095-46ee-be8d-c79517ce7139 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Request body: {'security_group_rule': {'security_group_id': '542d77bb-5230-4a38-92de-253fd51879f6', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_ip_prefix': 'bad_prefix'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:52.833230 dv-neutron-816802-2-hyperv neutron-server[102162]: WARNING neutron.api.v2.base [None req-3c1f5899-4095-46ee-be8d-c79517ce7139 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] An exception happened while processing the request body. The exception message is [Invalid CIDR bad_prefix given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR bad_prefix given as IP prefix. Nov 09 04:36:52.833690 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.api.v2.resource [None req-3c1f5899-4095-46ee-be8d-c79517ce7139 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:36:52.834659 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-3c1f5899-4095-46ee-be8d-c79517ce7139 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 316 time: 0.0063732 Nov 09 04:36:52.836834 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59784) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:52.840717 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-0e4c47bc-d0ee-4faf-b599-a6ddee066966 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Request body: {'security_group_rule': {'security_group_id': '542d77bb-5230-4a38-92de-253fd51879f6', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_ip_prefix': '256'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:52.842022 dv-neutron-816802-2-hyperv neutron-server[102162]: WARNING neutron.api.v2.base [None req-0e4c47bc-d0ee-4faf-b599-a6ddee066966 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] An exception happened while processing the request body. The exception message is [Invalid CIDR 256 given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR 256 given as IP prefix. Nov 09 04:36:52.842498 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.api.v2.resource [None req-0e4c47bc-d0ee-4faf-b599-a6ddee066966 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:36:52.843658 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-0e4c47bc-d0ee-4faf-b599-a6ddee066966 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 309 time: 0.0057456 Nov 09 04:36:52.850547 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59786) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:52.901676 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4b01b569-cba7-45a4-88af-34c4eaa07f2a tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:52.923742 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4b01b569-cba7-45a4-88af-34c4eaa07f2a tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:53.043070 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4b01b569-cba7-45a4-88af-34c4eaa07f2a tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:53.045788 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4b01b569-cba7-45a4-88af-34c4eaa07f2a tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:53.046980 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-4b01b569-cba7-45a4-88af-34c4eaa07f2a tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] 10.222.0.24 "DELETE /v2.0/security-groups/542d77bb-5230-4a38-92de-253fd51879f6 HTTP/1.1" status: 204 len: 168 time: 0.1956236 Nov 09 04:36:53.049695 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59788) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:53.056695 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b01b569-cba7-45a4-88af-34c4eaa07f2a tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=542d77bb-5230-4a38-92de-253fd51879f6,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:53.092781 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-801fb464-87f5-4c6c-a8ec-b4a2e1ab69da tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] 10.222.0.24 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0419478 Nov 09 04:36:53.096738 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59790) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:53.101019 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-f1317a21-42b5-4a9f-a4ea-85b33c42a4d9 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Request body: {'security_group': {'name': 'tempest-secgroup--1305308772'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:53.179739 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f1317a21-42b5-4a9f-a4ea-85b33c42a4d9 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:53.245929 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f1317a21-42b5-4a9f-a4ea-85b33c42a4d9 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:53.330291 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f1317a21-42b5-4a9f-a4ea-85b33c42a4d9 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:53.359135 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1317a21-42b5-4a9f-a4ea-85b33c42a4d9 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Pushing event updated for resources: {'SecurityGroup': ['ID=ba4d9987-ba8c-4398-9e8d-48ea24cca469,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:53.418072 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f1317a21-42b5-4a9f-a4ea-85b33c42a4d9 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:53.419940 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-f1317a21-42b5-4a9f-a4ea-85b33c42a4d9 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.3222973 Nov 09 04:36:53.422942 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59792) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:53.427273 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-5a54e82e-a851-4277-814c-c26c519da882 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Request body: {'security_group_rule': {'security_group_id': 'ba4d9987-ba8c-4398-9e8d-48ea24cca469', 'protocol': 'tcp', 'port_range_min': -16, 'port_range_max': 80, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:53.427739 dv-neutron-816802-2-hyperv neutron-server[102161]: WARNING neutron.api.v2.base [None req-5a54e82e-a851-4277-814c-c26c519da882 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] An exception happened while processing the request body. The exception message is [Invalid value for port -16].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port -16 Nov 09 04:36:53.428224 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-5a54e82e-a851-4277-814c-c26c519da882 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:36:53.429127 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-5a54e82e-a851-4277-814c-c26c519da882 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 317 time: 0.0052903 Nov 09 04:36:53.431438 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59794) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:53.435869 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-1d0d72f6-cabe-4476-a05a-9f3c04a3efaa tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Request body: {'security_group_rule': {'security_group_id': 'ba4d9987-ba8c-4398-9e8d-48ea24cca469', 'protocol': 'tcp', 'port_range_min': 80, 'port_range_max': 79, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:53.621859 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-1d0d72f6-cabe-4476-a05a-9f3c04a3efaa tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:36:53.623452 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1d0d72f6-cabe-4476-a05a-9f3c04a3efaa tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 354 time: 0.1905935 Nov 09 04:36:53.626192 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59796) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:53.630578 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-f714de62-bbb1-41ac-80a3-153a7688b78b tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Request body: {'security_group_rule': {'security_group_id': 'ba4d9987-ba8c-4398-9e8d-48ea24cca469', 'protocol': 'tcp', 'port_range_min': 80, 'port_range_max': 65536, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:53.631053 dv-neutron-816802-2-hyperv neutron-server[102161]: WARNING neutron.api.v2.base [None req-f714de62-bbb1-41ac-80a3-153a7688b78b tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] An exception happened while processing the request body. The exception message is [Invalid value for port 65536].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port 65536 Nov 09 04:36:53.631503 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-f714de62-bbb1-41ac-80a3-153a7688b78b tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:36:53.632390 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-f714de62-bbb1-41ac-80a3-153a7688b78b tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 319 time: 0.0052755 Nov 09 04:36:53.640373 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59798) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:53.644436 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-9a984d5d-6c60-43da-a1e0-9318a7f0995e tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Request body: {'security_group_rule': {'security_group_id': 'ba4d9987-ba8c-4398-9e8d-48ea24cca469', 'protocol': 'tcp', 'port_range_min': None, 'port_range_max': 6, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:53.889013 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-9a984d5d-6c60-43da-a1e0-9318a7f0995e tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:36:53.890720 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-9a984d5d-6c60-43da-a1e0-9318a7f0995e tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 354 time: 0.2488573 Nov 09 04:36:53.892978 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59800) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:53.897583 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-49db898b-c690-44cf-aefc-17f0aaeca298 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Request body: {'security_group_rule': {'security_group_id': 'ba4d9987-ba8c-4398-9e8d-48ea24cca469', 'protocol': 'tcp', 'port_range_min': -16, 'port_range_max': 65536, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:53.898164 dv-neutron-816802-2-hyperv neutron-server[102161]: WARNING neutron.api.v2.base [None req-49db898b-c690-44cf-aefc-17f0aaeca298 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] An exception happened while processing the request body. The exception message is [Invalid value for port -16].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port -16 Nov 09 04:36:53.898655 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-49db898b-c690-44cf-aefc-17f0aaeca298 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:36:53.899563 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-49db898b-c690-44cf-aefc-17f0aaeca298 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 317 time: 0.0056691 Nov 09 04:36:53.901979 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59802) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:53.906704 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-13e16634-c195-4b09-a59a-70f3151ce4c8 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Request body: {'security_group_rule': {'security_group_id': 'ba4d9987-ba8c-4398-9e8d-48ea24cca469', 'protocol': 'icmp', 'port_range_min': 1, 'port_range_max': 256, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:54.065594 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-13e16634-c195-4b09-a59a-70f3151ce4c8 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:36:54.067151 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-13e16634-c195-4b09-a59a-70f3151ce4c8 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 361 time: 0.1640320 Nov 09 04:36:54.069861 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59804) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:54.074317 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-518d23ff-eeae-4e4a-bd21-8941a72e73a6 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Request body: {'security_group_rule': {'security_group_id': 'ba4d9987-ba8c-4398-9e8d-48ea24cca469', 'protocol': 'icmp', 'port_range_min': -1, 'port_range_max': 25, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:54.074813 dv-neutron-816802-2-hyperv neutron-server[102161]: WARNING neutron.api.v2.base [None req-518d23ff-eeae-4e4a-bd21-8941a72e73a6 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] An exception happened while processing the request body. The exception message is [Invalid value for port -1].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port -1 Nov 09 04:36:54.075265 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-518d23ff-eeae-4e4a-bd21-8941a72e73a6 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:36:54.076164 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-518d23ff-eeae-4e4a-bd21-8941a72e73a6 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 316 time: 0.0053470 Nov 09 04:36:54.078461 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59806) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:54.082510 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-0e81bbe7-9ab4-4725-9a13-9b345eb6b775 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Request body: {'security_group_rule': {'security_group_id': 'ba4d9987-ba8c-4398-9e8d-48ea24cca469', 'protocol': 'icmp', 'port_range_min': None, 'port_range_max': 6, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:54.260056 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-0e81bbe7-9ab4-4725-9a13-9b345eb6b775 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:36:54.261050 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-0e81bbe7-9ab4-4725-9a13-9b345eb6b775 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 373 time: 0.1816964 Nov 09 04:36:54.264606 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59808) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:54.269127 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-d7306629-51c5-46e1-bd66-181c37458916 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Request body: {'security_group_rule': {'security_group_id': 'ba4d9987-ba8c-4398-9e8d-48ea24cca469', 'protocol': 'icmp', 'port_range_min': 300, 'port_range_max': 1, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:54.467939 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.api.v2.resource [None req-d7306629-51c5-46e1-bd66-181c37458916 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:36:54.469262 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-d7306629-51c5-46e1-bd66-181c37458916 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 361 time: 0.2036328 Nov 09 04:36:54.472503 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59810) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:54.527171 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-978efe3c-eaa5-4192-95f8-334dc17bd0a6 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:54.551761 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-978efe3c-eaa5-4192-95f8-334dc17bd0a6 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:54.673153 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-978efe3c-eaa5-4192-95f8-334dc17bd0a6 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:54.675817 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-978efe3c-eaa5-4192-95f8-334dc17bd0a6 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:54.677086 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-978efe3c-eaa5-4192-95f8-334dc17bd0a6 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] 10.222.0.24 "DELETE /v2.0/security-groups/ba4d9987-ba8c-4398-9e8d-48ea24cca469 HTTP/1.1" status: 204 len: 168 time: 0.2036943 Nov 09 04:36:54.679828 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59812) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:54.686762 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-978efe3c-eaa5-4192-95f8-334dc17bd0a6 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=ba4d9987-ba8c-4398-9e8d-48ea24cca469,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:54.723841 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-48794afd-ce62-4fcd-861c-6fdb434b4df0 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] 10.222.0.24 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0428553 Nov 09 04:36:54.727659 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59814) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:54.732020 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-34023ed2-4f81-44ed-bee9-fb8d3a933074 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Request body: {'security_group': {'name': 'tempest-secgroup--1441332737'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:54.839027 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-34023ed2-4f81-44ed-bee9-fb8d3a933074 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:54.903491 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-34023ed2-4f81-44ed-bee9-fb8d3a933074 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:54.964212 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-34023ed2-4f81-44ed-bee9-fb8d3a933074 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:54.993310 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34023ed2-4f81-44ed-bee9-fb8d3a933074 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Pushing event updated for resources: {'SecurityGroup': ['ID=ad1e03a1-0caa-40a8-a93c-4afab50ca177,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:55.115618 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-34023ed2-4f81-44ed-bee9-fb8d3a933074 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:55.116773 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-34023ed2-4f81-44ed-bee9-fb8d3a933074 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.3882062 Nov 09 04:36:55.119637 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59816) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:55.124625 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-7992dafe-7cc5-47ca-8fdb-1742de83acae tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Request body: {'security_group_rule': {'security_group_id': 'ad1e03a1-0caa-40a8-a93c-4afab50ca177', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_group_id': 'bad_group_id'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:55.340004 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-7992dafe-7cc5-47ca-8fdb-1742de83acae tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] create failed (client error): The resource could not be found. Nov 09 04:36:55.341133 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-7992dafe-7cc5-47ca-8fdb-1742de83acae tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 404 len: 323 time: 0.2205274 Nov 09 04:36:55.344129 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59818) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:55.353568 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-dbe53ff0-d3eb-47e4-b1ce-a52620bb92cc tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Request body: {'security_group_rule': {'security_group_id': 'ad1e03a1-0caa-40a8-a93c-4afab50ca177', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_group_id': '0459ef0d-ab12-48e0-a461-8a639242447c'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:55.472959 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:36:55.661947 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-dbe53ff0-d3eb-47e4-b1ce-a52620bb92cc tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] create failed (client error): The resource could not be found. Nov 09 04:36:55.663061 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-dbe53ff0-d3eb-47e4-b1ce-a52620bb92cc tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 404 len: 347 time: 0.3139668 Nov 09 04:36:55.665828 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59822) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:55.720040 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c809355a-ab1d-4a5a-9eff-a6d467108c63 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:55.742257 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c809355a-ab1d-4a5a-9eff-a6d467108c63 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:55.901889 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c809355a-ab1d-4a5a-9eff-a6d467108c63 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:55.901889 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c809355a-ab1d-4a5a-9eff-a6d467108c63 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:55.901889 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-c809355a-ab1d-4a5a-9eff-a6d467108c63 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] 10.222.0.24 "DELETE /v2.0/security-groups/ad1e03a1-0caa-40a8-a93c-4afab50ca177 HTTP/1.1" status: 204 len: 168 time: 0.2318897 Nov 09 04:36:55.902267 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59824) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:55.908906 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c809355a-ab1d-4a5a-9eff-a6d467108c63 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=ad1e03a1-0caa-40a8-a93c-4afab50ca177,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:55.948366 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-b93ba02a-365a-46b9-85ff-d5eb76fc3989 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] 10.222.0.24 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0450463 Nov 09 04:36:55.953219 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59826) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:55.958156 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-e4a55cf6-fefa-40e7-8892-744d3decc921 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Request body: {'security_group_rule': {'security_group_id': '4836eebb-636b-4263-aeb2-782a1cbd3bc5', 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:56.175974 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-e4a55cf6-fefa-40e7-8892-744d3decc921 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] create failed (client error): The resource could not be found. Nov 09 04:36:56.177043 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-e4a55cf6-fefa-40e7-8892-744d3decc921 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 404 len: 347 time: 0.2226188 Nov 09 04:36:56.180734 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59828) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:56.185708 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-e21fdee7-3e58-420b-a2cb-17b019036a6f tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Request body: {'security_group': {'name': 'tempest-secgroup--731722647'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:56.277032 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e21fdee7-3e58-420b-a2cb-17b019036a6f tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:56.340163 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e21fdee7-3e58-420b-a2cb-17b019036a6f tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:56.421571 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e21fdee7-3e58-420b-a2cb-17b019036a6f tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:56.448837 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e21fdee7-3e58-420b-a2cb-17b019036a6f tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Pushing event updated for resources: {'SecurityGroup': ['ID=e85b9ea5-5e8b-4f52-8bfe-38647d30de92,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:56.520587 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e21fdee7-3e58-420b-a2cb-17b019036a6f tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:56.521850 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-e21fdee7-3e58-420b-a2cb-17b019036a6f tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.3401918 Nov 09 04:36:56.524613 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59830) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:56.529634 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-26d8f377-e1d3-4242-8a70-5d2190707637 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Request body: {'security_group': {'name': 'tempest-secgroup--50909563'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:56.598604 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-26d8f377-e1d3-4242-8a70-5d2190707637 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:56.663097 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-26d8f377-e1d3-4242-8a70-5d2190707637 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:56.748205 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-26d8f377-e1d3-4242-8a70-5d2190707637 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:56.781064 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26d8f377-e1d3-4242-8a70-5d2190707637 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Pushing event updated for resources: {'SecurityGroup': ['ID=3aa60022-8b3b-4d99-a6ec-6320067e0d8f,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:56.833168 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-26d8f377-e1d3-4242-8a70-5d2190707637 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:56.834466 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-26d8f377-e1d3-4242-8a70-5d2190707637 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.3088598 Nov 09 04:36:56.837330 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59832) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:56.841799 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-4b00c2e7-ea5d-4cd3-bc0f-aa0bfcd3b40f tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Request body: {'security_group_rule': {'security_group_id': 'e85b9ea5-5e8b-4f52-8bfe-38647d30de92', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_ip_prefix': '172.20.0.0/16', 'remote_group_id': '3aa60022-8b3b-4d99-a6ec-6320067e0d8f'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:57.050466 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-4b00c2e7-ea5d-4cd3-bc0f-aa0bfcd3b40f tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:36:57.051664 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-4b00c2e7-ea5d-4cd3-bc0f-aa0bfcd3b40f tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 387 time: 0.2133436 Nov 09 04:36:57.054558 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59834) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:57.106713 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-69e488e2-35d0-4ba8-b962-02ca50658067 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:57.129523 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-69e488e2-35d0-4ba8-b962-02ca50658067 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:57.261472 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-69e488e2-35d0-4ba8-b962-02ca50658067 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:57.264325 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-69e488e2-35d0-4ba8-b962-02ca50658067 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:57.265597 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-69e488e2-35d0-4ba8-b962-02ca50658067 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] 10.222.0.24 "DELETE /v2.0/security-groups/3aa60022-8b3b-4d99-a6ec-6320067e0d8f HTTP/1.1" status: 204 len: 168 time: 0.2100565 Nov 09 04:36:57.268191 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59836) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:57.274823 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69e488e2-35d0-4ba8-b962-02ca50658067 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=3aa60022-8b3b-4d99-a6ec-6320067e0d8f,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:57.324638 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-bf1335a3-ef9d-4842-9ee1-f7d95c3aa510 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] 10.222.0.24 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 4544 time: 0.0546453 Nov 09 04:36:57.327429 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59838) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:57.389576 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c466edb2-0578-425a-be13-0e2ba38a2db4 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:57.420380 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c466edb2-0578-425a-be13-0e2ba38a2db4 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:57.559067 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c466edb2-0578-425a-be13-0e2ba38a2db4 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:57.562230 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c466edb2-0578-425a-be13-0e2ba38a2db4 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:57.563607 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-c466edb2-0578-425a-be13-0e2ba38a2db4 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] 10.222.0.24 "DELETE /v2.0/security-groups/e85b9ea5-5e8b-4f52-8bfe-38647d30de92 HTTP/1.1" status: 204 len: 168 time: 0.2350166 Nov 09 04:36:57.566730 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59840) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:57.576316 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c466edb2-0578-425a-be13-0e2ba38a2db4 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=e85b9ea5-5e8b-4f52-8bfe-38647d30de92,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:57.614871 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-b1467ad8-22c4-4475-9821-e8f0ad7f542a tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] 10.222.0.24 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0441544 Nov 09 04:36:57.616212 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59842) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:57.620847 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-6973eee4-c439-4086-b06b-49f73ba789a9 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Request body: {'security_group': {'name': 'tempest-secgroup--1032343251'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:57.707463 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6973eee4-c439-4086-b06b-49f73ba789a9 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:57.776747 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6973eee4-c439-4086-b06b-49f73ba789a9 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:57.825170 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6973eee4-c439-4086-b06b-49f73ba789a9 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:57.854975 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6973eee4-c439-4086-b06b-49f73ba789a9 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Pushing event updated for resources: {'SecurityGroup': ['ID=4caf603e-3242-444f-98e9-b01938579996,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:57.941728 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6973eee4-c439-4086-b06b-49f73ba789a9 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:57.943051 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-6973eee4-c439-4086-b06b-49f73ba789a9 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.3257973 Nov 09 04:36:57.946310 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59844) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:57.951321 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-edb92216-d2ea-4172-90b5-d1e5f172d387 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Request body: {'security_group': {'name': 'default'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:36:57.951821 dv-neutron-816802-2-hyperv neutron-server[102162]: WARNING neutron.api.v2.base [None req-edb92216-d2ea-4172-90b5-d1e5f172d387 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] An exception happened while processing the request body. The exception message is [Default security group already exists.].: neutron.extensions.securitygroup.SecurityGroupDefaultAlreadyExists: Default security group already exists. Nov 09 04:36:57.952344 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.api.v2.resource [None req-edb92216-d2ea-4172-90b5-d1e5f172d387 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] update failed (client error): There was a conflict when trying to complete your request. Nov 09 04:36:57.953416 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-edb92216-d2ea-4172-90b5-d1e5f172d387 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] 10.222.0.24 "PUT /v2.0/security-groups/4caf603e-3242-444f-98e9-b01938579996 HTTP/1.1" status: 409 len: 330 time: 0.0059192 Nov 09 04:36:57.956424 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59846) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:58.016263 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e7305072-46b1-42c8-9302-f45b1046729b tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:58.037973 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e7305072-46b1-42c8-9302-f45b1046729b tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:58.181896 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e7305072-46b1-42c8-9302-f45b1046729b tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:58.184632 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e7305072-46b1-42c8-9302-f45b1046729b tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:58.186619 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e7305072-46b1-42c8-9302-f45b1046729b tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] 10.222.0.24 "DELETE /v2.0/security-groups/4caf603e-3242-444f-98e9-b01938579996 HTTP/1.1" status: 204 len: 168 time: 0.2292955 Nov 09 04:36:58.189305 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59848) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:58.195992 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7305072-46b1-42c8-9302-f45b1046729b tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=4caf603e-3242-444f-98e9-b01938579996,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:36:58.232623 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1ade38a7-92a0-4d2e-ba17-76c27999d2b4 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] 10.222.0.24 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0416017 Nov 09 04:36:58.236359 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59850) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:58.249368 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-069877b6-d18a-402a-8f77-ea9d4e0f7392 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] delete failed (client error): The resource could not be found. Nov 09 04:36:58.250283 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-069877b6-d18a-402a-8f77-ea9d4e0f7392 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] 10.222.0.24 "DELETE /v2.0/security-groups/7c79f052-fad2-41c0-9c21-28a74af33cbe HTTP/1.1" status: 404 len: 347 time: 0.0129862 Nov 09 04:36:58.253668 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59852) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:58.266124 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-5a641727-4e94-4625-9cd2-e102ab6a7e37 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] show failed (client error): The resource could not be found. Nov 09 04:36:58.267113 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-5a641727-4e94-4625-9cd2-e102ab6a7e37 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] 10.222.0.24 "GET /v2.0/security-groups/faaee1ad-b365-4d7b-a902-5c492b1b981b HTTP/1.1" status: 404 len: 347 time: 0.0125878 Nov 09 04:36:58.270830 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59854) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:58.282202 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-160bf247-f34f-41c3-8b47-702c0a308b40 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] show failed (client error): The resource could not be found. Nov 09 04:36:58.283241 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-160bf247-f34f-41c3-8b47-702c0a308b40 tempest-NegativeSecGroupTest-2082221988 tempest-NegativeSecGroupTest-2082221988-project] 10.222.0.24 "GET /v2.0/security-group-rules/36671af8-aa99-44da-a2e4-79b447d34c21 HTTP/1.1" status: 404 len: 356 time: 0.0115194 Nov 09 04:36:58.786955 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59860) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:59.187584 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-178bb3f1-65e4-4960-9b62-7dfa1b3e8825 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=7e5002128e184470814658c2fb97930c&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3992844 Nov 09 04:36:59.189985 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59864) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:36:59.236854 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dce27ca0-26b3-4766-9536-61c1016d6b5d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:59.258175 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dce27ca0-26b3-4766-9536-61c1016d6b5d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:59.379670 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dce27ca0-26b3-4766-9536-61c1016d6b5d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:59.382351 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dce27ca0-26b3-4766-9536-61c1016d6b5d admin admin] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:36:59.383637 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-dce27ca0-26b3-4766-9536-61c1016d6b5d admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/38bd8861-b019-4637-b3d6-aa3db3ade3fe HTTP/1.1" status: 204 len: 168 time: 0.1925890 Nov 09 04:36:59.391746 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dce27ca0-26b3-4766-9536-61c1016d6b5d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=38bd8861-b019-4637-b3d6-aa3db3ade3fe,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:37:11.324067 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-92e2c9a0-1bf2-46ff-abf9-73a12b98ae5c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:11.358680 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59884) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:37:11.420687 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-bb963704-b5cf-4428-9b47-6d5042cb45b4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/floatingips/6470cca7-dc81-47c6-bd16-952472f330c2 HTTP/1.1" status: 200 len: 993 time: 0.0607920 Nov 09 04:37:11.708503 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59890) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:37:11.864239 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-d9c685d6-4ac3-447e-966a-230ac016ddc3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Deleting port ce5b2350-dadb-44f7-bd1c-60ef2fc338b6 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:37:11.864576 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d9c685d6-4ac3-447e-966a-230ac016ddc3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:11.941497 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d9c685d6-4ac3-447e-966a-230ac016ddc3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:11.941821 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d9c685d6-4ac3-447e-966a-230ac016ddc3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:11.953192 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-d9c685d6-4ac3-447e-966a-230ac016ddc3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Calling delete_port for ce5b2350-dadb-44f7-bd1c-60ef2fc338b6 owned by network:floatingip {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:37:12.152702 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:12.236530 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d9c685d6-4ac3-447e-966a-230ac016ddc3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:12.266932 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9c685d6-4ac3-447e-966a-230ac016ddc3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'Port': ['ID=ce5b2350-dadb-44f7-bd1c-60ef2fc338b6,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:37:12.321110 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d9c685d6-4ac3-447e-966a-230ac016ddc3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for floatingip, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:12.321437 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.l3_db [None req-d9c685d6-4ac3-447e-966a-230ac016ddc3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Floating IP 6470cca7-dc81-47c6-bd16-952472f330c2 disassociated (deleted). External IP: 172.26.0.226, port: 3113c017-8ef8-4edf-b772-4bcc8ee8298e. Nov 09 04:37:12.526158 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d9c685d6-4ac3-447e-966a-230ac016ddc3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Router 73e2c7c1-e8be-4e45-a3ee-acc8be6515c9 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:37:12.633973 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d9c685d6-4ac3-447e-966a-230ac016ddc3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:37:12.638929 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d9c685d6-4ac3-447e-966a-230ac016ddc3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:12.643864 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b42fc56d-8a57-45ce-a4d1-0d94c2135d6a None None] Sync routers for ids ['73e2c7c1-e8be-4e45-a3ee-acc8be6515c9'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:37:12.654216 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b42fc56d-8a57-45ce-a4d1-0d94c2135d6a None None] Routers {'73e2c7c1-e8be-4e45-a3ee-acc8be6515c9'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:37:12.655051 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-b42fc56d-8a57-45ce-a4d1-0d94c2135d6a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:36:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['73e2c7c1-e8be-4e45-a3ee-acc8be6515c9'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:37:12.668759 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-d9c685d6-4ac3-447e-966a-230ac016ddc3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "DELETE /v2.0/floatingips/6470cca7-dc81-47c6-bd16-952472f330c2 HTTP/1.1" status: 204 len: 168 time: 0.9566538 Nov 09 04:37:12.668759 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f5b9180a-61b4-4ed5-a5a7-a05b102af54c', 'tag': '3113c017-8ef8-4edf-b772-4bcc8ee8298e'}] {{(pid=102161) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:37:12.672425 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}99dfdda0def497b4372884ef2eb87f06b1e425c8eba5ceda5f64bbab037a07d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-037b5cc6-23d9-4dc3-88f6-c8cd4c4e9108" -d '{"events": [{"name": "network-changed", "server_uuid": "f5b9180a-61b4-4ed5-a5a7-a05b102af54c", "tag": "3113c017-8ef8-4edf-b772-4bcc8ee8298e"}]}' {{(pid=102161) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:37:12.707359 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:37:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7dd60df4-4ecf-4c82-8a4f-439638343b57 x-openstack-request-id: req-7dd60df4-4ecf-4c82-8a4f-439638343b57 {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:37:12.707718 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f5b9180a-61b4-4ed5-a5a7-a05b102af54c", "tag": "3113c017-8ef8-4edf-b772-4bcc8ee8298e", "status": "completed", "code": 200}]} {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:37:12.708358 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-7dd60df4-4ecf-4c82-8a4f-439638343b57 {{(pid=102161) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:37:12.708773 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f5b9180a-61b4-4ed5-a5a7-a05b102af54c', 'tag': '3113c017-8ef8-4edf-b772-4bcc8ee8298e', 'status': 'completed', 'code': 200} Nov 09 04:37:12.776928 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-037b5cc6-23d9-4dc3-88f6-c8cd4c4e9108 req-ac545c56-1865-4b12-b1be-4f9910540a60 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:37:12.778417 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-037b5cc6-23d9-4dc3-88f6-c8cd4c4e9108 req-ac545c56-1865-4b12-b1be-4f9910540a60 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&device_id=f5b9180a-61b4-4ed5-a5a7-a05b102af54c HTTP/1.1" status: 200 len: 1098 time: 0.0448029 Nov 09 04:37:12.783482 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-b42fc56d-8a57-45ce-a4d1-0d94c2135d6a None None] Set router 73e2c7c1-e8be-4e45-a3ee-acc8be6515c9 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:37:12.873237 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-037b5cc6-23d9-4dc3-88f6-c8cd4c4e9108 req-d3cff5b7-26a3-4c75-b482-9184a1652831 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:37:12.874754 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-037b5cc6-23d9-4dc3-88f6-c8cd4c4e9108 req-d3cff5b7-26a3-4c75-b482-9184a1652831 service neutron] 10.222.0.26 "GET /v2.0/networks?id=0f070182-4996-4fd0-8617-1172b3c4ac5e HTTP/1.1" status: 200 len: 898 time: 0.0879457 Nov 09 04:37:12.918496 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-037b5cc6-23d9-4dc3-88f6-c8cd4c4e9108 req-d43a3c5c-3370-4cd6-b7ec-32ef1d68f41f service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=3113c017-8ef8-4edf-b772-4bcc8ee8298e HTTP/1.1" status: 200 len: 217 time: 0.0362804 Nov 09 04:37:12.967437 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-037b5cc6-23d9-4dc3-88f6-c8cd4c4e9108 req-9bf461cb-a3a7-46b9-905e-1cb599c4f787 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:37:12.969133 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-037b5cc6-23d9-4dc3-88f6-c8cd4c4e9108 req-9bf461cb-a3a7-46b9-905e-1cb599c4f787 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=3e268933-196a-4376-a711-8b4d4d9e3036 HTTP/1.1" status: 200 len: 833 time: 0.0441265 Nov 09 04:37:12.991534 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-b42fc56d-8a57-45ce-a4d1-0d94c2135d6a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '73e2c7c1-e8be-4e45-a3ee-acc8be6515c9', 'name': 'tempest-TestNetworkBasicOps-router-129683286', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.26'}], 'enable_snat': True}, 'gw_port_id': '4cd82d33-ba2a-405e-8980-983e2ba630eb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:36:11Z', 'updated_at': '2021-11-09T04:36:18Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '4cd82d33-ba2a-405e-8980-983e2ba630eb', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:99:76:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '73e2c7c1-e8be-4e45-a3ee-acc8be6515c9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1236, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:36:12Z', 'updated_at': '2021-11-09T04:36:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'bbd67963-8b33-4921-a309-ea3952dbf5cf', 'name': '', 'network_id': '0f070182-4996-4fd0-8617-1172b3c4ac5e', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:7b:3e:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '73e2c7c1-e8be-4e45-a3ee-acc8be6515c9', 'device_owner': 'network:router_interface', 'standard_attr_id': 1245, 'fixed_ips': [{'subnet_id': '3e268933-196a-4376-a711-8b4d4d9e3036', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:36:17Z', 'updated_at': '2021-11-09T04:36:21Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '3e268933-196a-4376-a711-8b4d4d9e3036', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:37:13.017542 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b42fc56d-8a57-45ce-a4d1-0d94c2135d6a None None] Checking router: 73e2c7c1-e8be-4e45-a3ee-acc8be6515c9 for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:37:13.017904 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-037b5cc6-23d9-4dc3-88f6-c8cd4c4e9108 req-ad0a9764-4059-42c2-9aaa-8ba27b458cc6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:37:13.019322 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-037b5cc6-23d9-4dc3-88f6-c8cd4c4e9108 req-ad0a9764-4059-42c2-9aaa-8ba27b458cc6 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=0f070182-4996-4fd0-8617-1172b3c4ac5e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0435431 Nov 09 04:37:13.025849 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b42fc56d-8a57-45ce-a4d1-0d94c2135d6a None None] Routers {'73e2c7c1-e8be-4e45-a3ee-acc8be6515c9'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:37:13.026477 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-b42fc56d-8a57-45ce-a4d1-0d94c2135d6a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:36:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['73e2c7c1-e8be-4e45-a3ee-acc8be6515c9'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:37:13.121585 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-037b5cc6-23d9-4dc3-88f6-c8cd4c4e9108 req-e7a0b8f9-6322-4f58-87ff-d56fc09a2b3a service neutron] 10.222.0.26 "GET /v2.0/networks/0f070182-4996-4fd0-8617-1172b3c4ac5e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0954902 Nov 09 04:37:13.229883 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-b42fc56d-8a57-45ce-a4d1-0d94c2135d6a None None] Set router 73e2c7c1-e8be-4e45-a3ee-acc8be6515c9 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:37:13.230135 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-037b5cc6-23d9-4dc3-88f6-c8cd4c4e9108 req-b4e35037-691b-4eaa-8d6a-9fbbb72d4627 service neutron] 10.222.0.26 "GET /v2.0/networks/0f070182-4996-4fd0-8617-1172b3c4ac5e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1007419 Nov 09 04:37:13.268412 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1416c5c-6f80-4bbd-abed-0a1fff5275f6 req-c387f5ea-9746-4355-8821-846089732cf4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:37:13.270012 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c1416c5c-6f80-4bbd-abed-0a1fff5275f6 req-c387f5ea-9746-4355-8821-846089732cf4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=f5b9180a-61b4-4ed5-a5a7-a05b102af54c HTTP/1.1" status: 200 len: 945 time: 0.0630457 Nov 09 04:37:13.322131 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c1416c5c-6f80-4bbd-abed-0a1fff5275f6 req-6100ea83-fa91-43b7-a3df-f645e2fd27ae tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=981c1801-295c-44ec-8fb7-4111fb839249&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0457559 Nov 09 04:37:13.426814 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-b42fc56d-8a57-45ce-a4d1-0d94c2135d6a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '73e2c7c1-e8be-4e45-a3ee-acc8be6515c9', 'name': 'tempest-TestNetworkBasicOps-router-129683286', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.26'}], 'enable_snat': True}, 'gw_port_id': '4cd82d33-ba2a-405e-8980-983e2ba630eb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:36:11Z', 'updated_at': '2021-11-09T04:36:18Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '4cd82d33-ba2a-405e-8980-983e2ba630eb', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:99:76:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '73e2c7c1-e8be-4e45-a3ee-acc8be6515c9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1236, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:36:12Z', 'updated_at': '2021-11-09T04:36:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'bbd67963-8b33-4921-a309-ea3952dbf5cf', 'name': '', 'network_id': '0f070182-4996-4fd0-8617-1172b3c4ac5e', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:7b:3e:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '73e2c7c1-e8be-4e45-a3ee-acc8be6515c9', 'device_owner': 'network:router_interface', 'standard_attr_id': 1245, 'fixed_ips': [{'subnet_id': '3e268933-196a-4376-a711-8b4d4d9e3036', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:36:17Z', 'updated_at': '2021-11-09T04:36:21Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '3e268933-196a-4376-a711-8b4d4d9e3036', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:37:13.452316 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b42fc56d-8a57-45ce-a4d1-0d94c2135d6a None None] The sync data for ids ['73e2c7c1-e8be-4e45-a3ee-acc8be6515c9'] in dv-neutron-816802-2-hyperv is: [{'id': '73e2c7c1-e8be-4e45-a3ee-acc8be6515c9', 'name': 'tempest-TestNetworkBasicOps-router-129683286', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.26'}], 'enable_snat': True}, 'gw_port_id': '4cd82d33-ba2a-405e-8980-983e2ba630eb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:36:11Z', 'updated_at': '2021-11-09T04:36:18Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '4cd82d33-ba2a-405e-8980-983e2ba630eb', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:99:76:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '73e2c7c1-e8be-4e45-a3ee-acc8be6515c9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1236, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:36:12Z', 'updated_at': '2021-11-09T04:36:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'bbd67963-8b33-4921-a309-ea3952dbf5cf', 'name': '', 'network_id': '0f070182-4996-4fd0-8617-1172b3c4ac5e', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:7b:3e:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '73e2c7c1-e8be-4e45-a3ee-acc8be6515c9', 'device_owner': 'network:router_interface', 'standard_attr_id': 1245, 'fixed_ips': [{'subnet_id': '3e268933-196a-4376-a711-8b4d4d9e3036', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:36:17Z', 'updated_at': '2021-11-09T04:36:21Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '3e268933-196a-4376-a711-8b4d4d9e3036', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:37:13.671532 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9288fe23-fa1a-47f8-a71f-cd88cef1eeef None None] New status for floating IP 6470cca7-dc81-47c6-bd16-952472f330c2: DOWN {{(pid=102163) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 04:37:13.728693 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-cc95c914-9e2a-4e88-b7fe-1d43fc8837c1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:14.444390 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2353737e-1e3f-4058-8bca-870b78f4c6fc req-204e46e9-fd23-4618-bbca-a25ae202aa6f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:37:14.445899 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2353737e-1e3f-4058-8bca-870b78f4c6fc req-204e46e9-fd23-4618-bbca-a25ae202aa6f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=f5b9180a-61b4-4ed5-a5a7-a05b102af54c HTTP/1.1" status: 200 len: 945 time: 0.0512767 Nov 09 04:37:14.494508 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2353737e-1e3f-4058-8bca-870b78f4c6fc req-8123a425-04c7-404f-b080-fb1fd7499a41 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=981c1801-295c-44ec-8fb7-4111fb839249&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0427871 Nov 09 04:37:14.557487 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a4d944e-4b48-4e49-9a6c-368c8acbbea4 req-42ca613a-a6aa-4d02-a111-3f37d9c38673 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:37:14.559004 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3a4d944e-4b48-4e49-9a6c-368c8acbbea4 req-42ca613a-a6aa-4d02-a111-3f37d9c38673 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "GET /v2.0/ports?device_id=f5b9180a-61b4-4ed5-a5a7-a05b102af54c HTTP/1.1" status: 200 len: 945 time: 0.0473733 Nov 09 04:37:14.655545 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-3a4d944e-4b48-4e49-9a6c-368c8acbbea4 req-0d6eb764-48ad-46f0-b06d-2c34c115e27b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Deleting port 3113c017-8ef8-4edf-b772-4bcc8ee8298e {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:37:14.655786 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-3a4d944e-4b48-4e49-9a6c-368c8acbbea4 req-0d6eb764-48ad-46f0-b06d-2c34c115e27b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:14.743776 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-3a4d944e-4b48-4e49-9a6c-368c8acbbea4 req-0d6eb764-48ad-46f0-b06d-2c34c115e27b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] For port 3113c017-8ef8-4edf-b772-4bcc8ee8298e, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=3113c017-8ef8-4edf-b772-4bcc8ee8298e,segment=NetworkSegment(978d57a9-319d-4116-8893-ffe00140f45e),segment_id=978d57a9-319d-4116-8893-ffe00140f45e)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:37:14.744136 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-3a4d944e-4b48-4e49-9a6c-368c8acbbea4 req-0d6eb764-48ad-46f0-b06d-2c34c115e27b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:14.757623 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-3a4d944e-4b48-4e49-9a6c-368c8acbbea4 req-0d6eb764-48ad-46f0-b06d-2c34c115e27b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Calling delete_port for 3113c017-8ef8-4edf-b772-4bcc8ee8298e owned by compute:nova {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:37:14.958230 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-3a4d944e-4b48-4e49-9a6c-368c8acbbea4 req-0d6eb764-48ad-46f0-b06d-2c34c115e27b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:14.989203 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d6eb764-48ad-46f0-b06d-2c34c115e27b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'Port': ['ID=3113c017-8ef8-4edf-b772-4bcc8ee8298e,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:37:15.039338 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-3a4d944e-4b48-4e49-9a6c-368c8acbbea4 req-0d6eb764-48ad-46f0-b06d-2c34c115e27b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] No DVR routers for this DVR port 3113c017-8ef8-4edf-b772-4bcc8ee8298e on host hv-neutron-8168 {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:37:15.042121 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-3a4d944e-4b48-4e49-9a6c-368c8acbbea4 req-0d6eb764-48ad-46f0-b06d-2c34c115e27b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:15.046576 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3a4d944e-4b48-4e49-9a6c-368c8acbbea4 req-0d6eb764-48ad-46f0-b06d-2c34c115e27b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "DELETE /v2.0/ports/3113c017-8ef8-4edf-b772-4bcc8ee8298e HTTP/1.1" status: 204 len: 173 time: 0.4816151 Nov 09 04:37:15.047048 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f5b9180a-61b4-4ed5-a5a7-a05b102af54c', 'name': 'network-vif-deleted', 'tag': '3113c017-8ef8-4edf-b772-4bcc8ee8298e'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:37:15.049361 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-81fa0dbc-ab99-462c-b3ec-29dc7fd3a355" -d '{"events": [{"server_uuid": "f5b9180a-61b4-4ed5-a5a7-a05b102af54c", "name": "network-vif-deleted", "tag": "3113c017-8ef8-4edf-b772-4bcc8ee8298e"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:37:15.084348 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:37:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-24a32304-0504-4cb8-a8c2-0f420dec778b x-openstack-request-id: req-24a32304-0504-4cb8-a8c2-0f420dec778b {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:37:15.084667 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f5b9180a-61b4-4ed5-a5a7-a05b102af54c", "name": "network-vif-deleted", "tag": "3113c017-8ef8-4edf-b772-4bcc8ee8298e", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:37:15.084905 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-24a32304-0504-4cb8-a8c2-0f420dec778b {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:37:15.085300 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f5b9180a-61b4-4ed5-a5a7-a05b102af54c', 'name': 'network-vif-deleted', 'tag': '3113c017-8ef8-4edf-b772-4bcc8ee8298e', 'status': 'completed', 'code': 200} Nov 09 04:37:15.093383 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:15.599976 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4b86999c-2879-48bb-9c8b-05170c4441b0 req-9dfd9b69-7889-41af-97ce-79c2eb1757a9 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=f5b9180a-61b4-4ed5-a5a7-a05b102af54c HTTP/1.1" status: 200 len: 210 time: 0.0286491 Nov 09 04:37:16.441344 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:16.655643 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59906) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:37:16.710944 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2e4fc204-0bdc-42ac-b5d3-43c8dc217709 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:16.736516 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2e4fc204-0bdc-42ac-b5d3-43c8dc217709 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:16.882843 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2e4fc204-0bdc-42ac-b5d3-43c8dc217709 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:16.886170 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2e4fc204-0bdc-42ac-b5d3-43c8dc217709 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:16.886877 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-2e4fc204-0bdc-42ac-b5d3-43c8dc217709 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "DELETE /v2.0/security-groups/981c1801-295c-44ec-8fb7-4111fb839249 HTTP/1.1" status: 204 len: 168 time: 0.2302101 Nov 09 04:37:16.898219 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e4fc204-0bdc-42ac-b5d3-43c8dc217709 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=981c1801-295c-44ec-8fb7-4111fb839249,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:37:16.969423 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:17.021924 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59910) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:37:17.381386 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-aae1c1be-b518-4cc1-b3ef-ff720d2f4362 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:17.635900 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-aae1c1be-b518-4cc1-b3ef-ff720d2f4362 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Deleting port bbd67963-8b33-4921-a309-ea3952dbf5cf {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:37:17.636245 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-aae1c1be-b518-4cc1-b3ef-ff720d2f4362 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:17.725082 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-aae1c1be-b518-4cc1-b3ef-ff720d2f4362 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] For port bbd67963-8b33-4921-a309-ea3952dbf5cf, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=bbd67963-8b33-4921-a309-ea3952dbf5cf,segment=NetworkSegment(978d57a9-319d-4116-8893-ffe00140f45e),segment_id=978d57a9-319d-4116-8893-ffe00140f45e)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:37:17.725815 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-aae1c1be-b518-4cc1-b3ef-ff720d2f4362 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:17.741855 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-aae1c1be-b518-4cc1-b3ef-ff720d2f4362 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Calling delete_port for bbd67963-8b33-4921-a309-ea3952dbf5cf owned by network:router_interface {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:37:17.952590 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-aae1c1be-b518-4cc1-b3ef-ff720d2f4362 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:17.978839 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aae1c1be-b518-4cc1-b3ef-ff720d2f4362 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'Port': ['ID=bbd67963-8b33-4921-a309-ea3952dbf5cf,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:37:18.155080 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-aae1c1be-b518-4cc1-b3ef-ff720d2f4362 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:18.373381 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-aae1c1be-b518-4cc1-b3ef-ff720d2f4362 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Router 73e2c7c1-e8be-4e45-a3ee-acc8be6515c9 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:37:18.491389 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-aae1c1be-b518-4cc1-b3ef-ff720d2f4362 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:37:18.497919 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-aae1c1be-b518-4cc1-b3ef-ff720d2f4362 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "PUT /v2.0/routers/73e2c7c1-e8be-4e45-a3ee-acc8be6515c9/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4748697 Nov 09 04:37:18.500678 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59912) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:37:18.504002 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b6e226c-9902-4182-b1b9-03e3d96d0f38 None None] Sync routers for ids ['73e2c7c1-e8be-4e45-a3ee-acc8be6515c9'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:37:18.514595 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b6e226c-9902-4182-b1b9-03e3d96d0f38 None None] Routers {'73e2c7c1-e8be-4e45-a3ee-acc8be6515c9'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:37:18.515300 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-9b6e226c-9902-4182-b1b9-03e3d96d0f38 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:37:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['73e2c7c1-e8be-4e45-a3ee-acc8be6515c9'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:37:18.556642 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-4772d0ae-336f-43df-9116-8cb8e081fad2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Deleting subnet 3e268933-196a-4376-a711-8b4d4d9e3036 {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:37:18.560084 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4772d0ae-336f-43df-9116-8cb8e081fad2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:18.605203 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4772d0ae-336f-43df-9116-8cb8e081fad2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:18.626948 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-9b6e226c-9902-4182-b1b9-03e3d96d0f38 None None] Set router 73e2c7c1-e8be-4e45-a3ee-acc8be6515c9 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:37:18.701524 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4772d0ae-336f-43df-9116-8cb8e081fad2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:18.824840 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-9b6e226c-9902-4182-b1b9-03e3d96d0f38 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '73e2c7c1-e8be-4e45-a3ee-acc8be6515c9', 'name': 'tempest-TestNetworkBasicOps-router-129683286', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.26'}], 'enable_snat': True}, 'gw_port_id': '4cd82d33-ba2a-405e-8980-983e2ba630eb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:36:11Z', 'updated_at': '2021-11-09T04:37:17Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '4cd82d33-ba2a-405e-8980-983e2ba630eb', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:99:76:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '73e2c7c1-e8be-4e45-a3ee-acc8be6515c9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1236, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:36:12Z', 'updated_at': '2021-11-09T04:36:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:37:18.838537 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4772d0ae-336f-43df-9116-8cb8e081fad2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:18.853718 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b6e226c-9902-4182-b1b9-03e3d96d0f38 None None] Checking router: 73e2c7c1-e8be-4e45-a3ee-acc8be6515c9 for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:37:18.864170 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b6e226c-9902-4182-b1b9-03e3d96d0f38 None None] Routers {'73e2c7c1-e8be-4e45-a3ee-acc8be6515c9'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:37:18.864787 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-9b6e226c-9902-4182-b1b9-03e3d96d0f38 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:37:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['73e2c7c1-e8be-4e45-a3ee-acc8be6515c9'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:37:18.869716 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4772d0ae-336f-43df-9116-8cb8e081fad2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:18.876542 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-4772d0ae-336f-43df-9116-8cb8e081fad2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "DELETE /v2.0/subnets/3e268933-196a-4376-a711-8b4d4d9e3036 HTTP/1.1" status: 204 len: 168 time: 0.3724287 Nov 09 04:37:18.876893 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fabd6309-5b99-4600-92f3-b5654fc33ca9 None None] Network 0f070182-4996-4fd0-8617-1172b3c4ac5e requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:37:18.877417 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4772d0ae-336f-43df-9116-8cb8e081fad2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'Subnet': ['ID=3e268933-196a-4376-a711-8b4d4d9e3036,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:37:18.877525 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59914) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:37:18.946911 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 3113c017-8ef8-4edf-b772-4bcc8ee8298e no longer exists at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:37:18.983925 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-9b6e226c-9902-4182-b1b9-03e3d96d0f38 None None] Set router 73e2c7c1-e8be-4e45-a3ee-acc8be6515c9 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:37:19.002552 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] No Port match for: 3113c017-8ef8-4edf-b772-4bcc8ee8298e {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:37:19.002908 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 3113c017-8ef8-4edf-b772-4bcc8ee8298e not bound to the agent host hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:37:19.011559 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6b647154-2d27-474f-948c-23dd54eed36b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:19.124798 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e12dd660-c969-41de-9af4-039de6e510b4 None None] DHCP port deletion for 0f070182-4996-4fd0-8617-1172b3c4ac5e request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:37:19.187020 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e12dd660-c969-41de-9af4-039de6e510b4 None None] Deleting port c53ea4d4-85d1-491e-8c57-6e633e95082b {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:37:19.187299 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e12dd660-c969-41de-9af4-039de6e510b4 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:19.190193 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-9b6e226c-9902-4182-b1b9-03e3d96d0f38 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '73e2c7c1-e8be-4e45-a3ee-acc8be6515c9', 'name': 'tempest-TestNetworkBasicOps-router-129683286', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.26'}], 'enable_snat': True}, 'gw_port_id': '4cd82d33-ba2a-405e-8980-983e2ba630eb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:36:11Z', 'updated_at': '2021-11-09T04:37:17Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '4cd82d33-ba2a-405e-8980-983e2ba630eb', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:99:76:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '73e2c7c1-e8be-4e45-a3ee-acc8be6515c9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1236, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:36:12Z', 'updated_at': '2021-11-09T04:36:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:37:19.223482 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b6e226c-9902-4182-b1b9-03e3d96d0f38 None None] The sync data for ids ['73e2c7c1-e8be-4e45-a3ee-acc8be6515c9'] in dv-neutron-816802-2-hyperv is: [{'id': '73e2c7c1-e8be-4e45-a3ee-acc8be6515c9', 'name': 'tempest-TestNetworkBasicOps-router-129683286', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.26'}], 'enable_snat': True}, 'gw_port_id': '4cd82d33-ba2a-405e-8980-983e2ba630eb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:36:11Z', 'updated_at': '2021-11-09T04:37:17Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '4cd82d33-ba2a-405e-8980-983e2ba630eb', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:99:76:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '73e2c7c1-e8be-4e45-a3ee-acc8be6515c9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1236, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:36:12Z', 'updated_at': '2021-11-09T04:36:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:37:19.257796 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e12dd660-c969-41de-9af4-039de6e510b4 None None] For port c53ea4d4-85d1-491e-8c57-6e633e95082b, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=c53ea4d4-85d1-491e-8c57-6e633e95082b,segment=NetworkSegment(978d57a9-319d-4116-8893-ffe00140f45e),segment_id=978d57a9-319d-4116-8893-ffe00140f45e)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:37:19.258299 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e12dd660-c969-41de-9af4-039de6e510b4 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:19.273760 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e12dd660-c969-41de-9af4-039de6e510b4 None None] Calling delete_port for c53ea4d4-85d1-491e-8c57-6e633e95082b owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:37:19.399870 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6b647154-2d27-474f-948c-23dd54eed36b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router_gateway, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:19.459006 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e12dd660-c969-41de-9af4-039de6e510b4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:19.483167 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e12dd660-c969-41de-9af4-039de6e510b4 None None] Pushing event deleted for resources: {'Port': ['ID=c53ea4d4-85d1-491e-8c57-6e633e95082b,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:37:19.490034 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e12dd660-c969-41de-9af4-039de6e510b4 None None] No DVR routers for this DVR port c53ea4d4-85d1-491e-8c57-6e633e95082b on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:37:19.532519 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-6b647154-2d27-474f-948c-23dd54eed36b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Deleting port 4cd82d33-ba2a-405e-8980-983e2ba630eb {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:37:19.532853 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6b647154-2d27-474f-948c-23dd54eed36b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:19.619510 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-6b647154-2d27-474f-948c-23dd54eed36b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] For port 4cd82d33-ba2a-405e-8980-983e2ba630eb, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=4cd82d33-ba2a-405e-8980-983e2ba630eb,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:37:19.619510 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6b647154-2d27-474f-948c-23dd54eed36b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:19.628568 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-6b647154-2d27-474f-948c-23dd54eed36b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Calling delete_port for 4cd82d33-ba2a-405e-8980-983e2ba630eb owned by network:router_gateway {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:37:19.687341 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device c53ea4d4-85d1-491e-8c57-6e633e95082b no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:37:19.709860 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: c53ea4d4-85d1-491e-8c57-6e633e95082b {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:37:19.710395 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device c53ea4d4-85d1-491e-8c57-6e633e95082b not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:37:19.883972 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6b647154-2d27-474f-948c-23dd54eed36b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:19.913447 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b647154-2d27-474f-948c-23dd54eed36b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'Port': ['ID=4cd82d33-ba2a-405e-8980-983e2ba630eb,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:37:19.971993 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6b647154-2d27-474f-948c-23dd54eed36b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-466373'] for router_gateway, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:20.059251 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6b647154-2d27-474f-948c-23dd54eed36b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:20.061352 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6b647154-2d27-474f-948c-23dd54eed36b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:20.181244 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6b647154-2d27-474f-948c-23dd54eed36b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:20.181767 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6b647154-2d27-474f-948c-23dd54eed36b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Fanout notify agent at l3_agent the message router_deleted on router 73e2c7c1-e8be-4e45-a3ee-acc8be6515c9 {{(pid=102161) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:37:20.188646 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6b647154-2d27-474f-948c-23dd54eed36b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:20.189752 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-6b647154-2d27-474f-948c-23dd54eed36b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "DELETE /v2.0/routers/73e2c7c1-e8be-4e45-a3ee-acc8be6515c9 HTTP/1.1" status: 204 len: 168 time: 1.3117843 Nov 09 04:37:20.192660 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59916) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:37:20.280012 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-668928e3-fe46-41fc-93d9-38552b71ef96 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:20.366665 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-668928e3-fe46-41fc-93d9-38552b71ef96 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:20.386339 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-668928e3-fe46-41fc-93d9-38552b71ef96 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0f070182-4996-4fd0-8617-1172b3c4ac5e']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:37:20.395968 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-668928e3-fe46-41fc-93d9-38552b71ef96 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '978d57a9-319d-4116-8893-ffe00140f45e') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:37:20.396256 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-668928e3-fe46-41fc-93d9-38552b71ef96 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '978d57a9-319d-4116-8893-ffe00140f45e') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:37:20.405187 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-668928e3-fe46-41fc-93d9-38552b71ef96 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:20.417556 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-668928e3-fe46-41fc-93d9-38552b71ef96 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:20.423141 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-668928e3-fe46-41fc-93d9-38552b71ef96 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Releasing vlan 330 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:37:20.423512 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-668928e3-fe46-41fc-93d9-38552b71ef96 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:20.426552 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:37:20.426552 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:37:20.426552 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:37:20.426552 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:37:20.426552 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:37:20.426552 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:37:20.426552 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:37:20.426552 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:37:20.426552 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:37:20.426552 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:37:20.426552 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:37:20.426552 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:37:20.426552 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:37:20.426552 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:37:20.426552 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:37:20.426552 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:37:20.426552 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:37:20.426552 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:37:20.426552 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:37:20.426552 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:37:20.426552 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:37:20.426552 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:37:20.426552 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:37:20.426552 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:37:20.426552 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:37:20.426552 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:37:20.426552 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:37:20.426552 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:37:20.426552 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:37:20.426552 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:37:20.426552 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:37:20.426552 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:37:20.535360 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-668928e3-fe46-41fc-93d9-38552b71ef96 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:20.543184 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-668928e3-fe46-41fc-93d9-38552b71ef96 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:20.546283 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-668928e3-fe46-41fc-93d9-38552b71ef96 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "DELETE /v2.0/networks/0f070182-4996-4fd0-8617-1172b3c4ac5e HTTP/1.1" status: 204 len: 168 time: 0.3526154 Nov 09 04:37:20.555382 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-668928e3-fe46-41fc-93d9-38552b71ef96 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'Network': ['ID=0f070182-4996-4fd0-8617-1172b3c4ac5e,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:37:20.558345 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59918) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:37:20.562570 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-21c9587b-d526-473f-ad92-c4065a312372 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'network': {'name': 'tempest-network-smoke--785488547', 'project_id': '1d10b4824e524068827e58b55e269af3', 'port_security_enabled': True}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:37:20.620804 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-21c9587b-d526-473f-ad92-c4065a312372 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Made reservation on behalf of 1d10b4824e524068827e58b55e269af3 for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:37:20.624961 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-21c9587b-d526-473f-ad92-c4065a312372 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:20.649220 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-21c9587b-d526-473f-ad92-c4065a312372 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 346} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:37:20.660671 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-21c9587b-d526-473f-ad92-c4065a312372 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:20.660930 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-21c9587b-d526-473f-ad92-c4065a312372 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Added segment 2ebee1f6-c165-461d-bb96-18710a0d5427 of type vlan for network 4ca58d86-8d4d-408b-8308-dfa9f89406f0 Nov 09 04:37:20.703552 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-21c9587b-d526-473f-ad92-c4065a312372 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:20.769159 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-21c9587b-d526-473f-ad92-c4065a312372 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:20.778908 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-21c9587b-d526-473f-ad92-c4065a312372 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:37:20.779973 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-21c9587b-d526-473f-ad92-c4065a312372 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:20.848938 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21c9587b-d526-473f-ad92-c4065a312372 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Network': ['ID=4ca58d86-8d4d-408b-8308-dfa9f89406f0,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:37:20.859130 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-21c9587b-d526-473f-ad92-c4065a312372 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.3009484 Nov 09 04:37:20.859506 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 4ca58d86-8d4d-408b-8308-dfa9f89406f0 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:37:20.862067 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59920) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:37:20.867194 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-354eca19-02b5-4e0b-be01-1590996e5041 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'router': {'name': 'tempest-TestNetworkBasicOps-router-473737147', 'admin_state_up': True, 'project_id': '1d10b4824e524068827e58b55e269af3', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:37:20.936030 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-354eca19-02b5-4e0b-be01-1590996e5041 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:20.937027 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-354eca19-02b5-4e0b-be01-1590996e5041 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:20.994650 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-354eca19-02b5-4e0b-be01-1590996e5041 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:21.209033 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-354eca19-02b5-4e0b-be01-1590996e5041 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:21.272501 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device bbd67963-8b33-4921-a309-ea3952dbf5cf no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:37:21.293090 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: bbd67963-8b33-4921-a309-ea3952dbf5cf {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:37:21.293406 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device bbd67963-8b33-4921-a309-ea3952dbf5cf not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:37:21.294482 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 4cd82d33-ba2a-405e-8980-983e2ba630eb no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:37:21.312452 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 4cd82d33-ba2a-405e-8980-983e2ba630eb {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:37:21.312790 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 4cd82d33-ba2a-405e-8980-983e2ba630eb not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:37:21.462052 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-354eca19-02b5-4e0b-be01-1590996e5041 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router_gateway, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:21.487383 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-354eca19-02b5-4e0b-be01-1590996e5041 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:21.630155 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-354eca19-02b5-4e0b-be01-1590996e5041 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Allocated IP 172.26.0.35 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/965ebc5f-0c00-46a9-aaf1-8ed04be937c6) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:37:21.730167 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-354eca19-02b5-4e0b-be01-1590996e5041 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:22.082135 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-354eca19-02b5-4e0b-be01-1590996e5041 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:22.125853 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-354eca19-02b5-4e0b-be01-1590996e5041 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:37:22.130566 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-354eca19-02b5-4e0b-be01-1590996e5041 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:37:22.133108 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-354eca19-02b5-4e0b-be01-1590996e5041 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:37:22.156670 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-354eca19-02b5-4e0b-be01-1590996e5041 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Port': ['ID=965ebc5f-0c00-46a9-aaf1-8ed04be937c6,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:37:22.167645 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-354eca19-02b5-4e0b-be01-1590996e5041 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:37:22.167976 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-354eca19-02b5-4e0b-be01-1590996e5041 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:37:22.169357 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-354eca19-02b5-4e0b-be01-1590996e5041 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:37:22.169693 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-354eca19-02b5-4e0b-be01-1590996e5041 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:37:22.170015 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-354eca19-02b5-4e0b-be01-1590996e5041 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:37:22.170336 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-354eca19-02b5-4e0b-be01-1590996e5041 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:37:22.170678 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-354eca19-02b5-4e0b-be01-1590996e5041 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:37:22.170996 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-354eca19-02b5-4e0b-be01-1590996e5041 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:37:22.171312 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-354eca19-02b5-4e0b-be01-1590996e5041 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:37:22.171625 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-354eca19-02b5-4e0b-be01-1590996e5041 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:37:22.171956 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-354eca19-02b5-4e0b-be01-1590996e5041 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:37:22.172251 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-354eca19-02b5-4e0b-be01-1590996e5041 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:37:22.445309 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-354eca19-02b5-4e0b-be01-1590996e5041 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router_gateway, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:22.636447 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-354eca19-02b5-4e0b-be01-1590996e5041 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:22.808609 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-354eca19-02b5-4e0b-be01-1590996e5041 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Router b9fe8b76-742f-4072-b1f1-39a9dbe806a5 is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102162) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:37:22.913187 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-354eca19-02b5-4e0b-be01-1590996e5041 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:37:22.922721 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9e1a88b2-f58f-44ce-bc4b-3750eaa76175 None None] Sync routers for ids ['b9fe8b76-742f-4072-b1f1-39a9dbe806a5'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:37:22.931664 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9e1a88b2-f58f-44ce-bc4b-3750eaa76175 None None] Routers {'b9fe8b76-742f-4072-b1f1-39a9dbe806a5'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:37:22.932277 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-9e1a88b2-f58f-44ce-bc4b-3750eaa76175 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:37:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['b9fe8b76-742f-4072-b1f1-39a9dbe806a5'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:37:22.994371 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-354eca19-02b5-4e0b-be01-1590996e5041 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:22.995647 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-354eca19-02b5-4e0b-be01-1590996e5041 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 885 time: 2.1320155 Nov 09 04:37:22.999318 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59922) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:37:23.035647 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-cae7e1a2-2a79-4884-83b2-19122f5d4d03 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/subnets?project_id=1d10b4824e524068827e58b55e269af3&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0351429 Nov 09 04:37:23.038717 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59924) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:37:23.040738 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-9e1a88b2-f58f-44ce-bc4b-3750eaa76175 None None] Set router b9fe8b76-742f-4072-b1f1-39a9dbe806a5 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:37:23.192578 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e8136f08-f34e-45d1-8e4d-cf0978479715 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:37:23.194010 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e8136f08-f34e-45d1-8e4d-cf0978479715 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.1543624 Nov 09 04:37:23.196953 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59926) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:37:23.218724 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-9e1a88b2-f58f-44ce-bc4b-3750eaa76175 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'name': 'tempest-TestNetworkBasicOps-router-473737147', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.35'}], 'enable_snat': True}, 'gw_port_id': '965ebc5f-0c00-46a9-aaf1-8ed04be937c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:37:20Z', 'updated_at': '2021-11-09T04:37:22Z', 'revision_number': 3, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '965ebc5f-0c00-46a9-aaf1-8ed04be937c6', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:d0:85:9c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1376, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:37:21Z', 'updated_at': '2021-11-09T04:37:21Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:37:23.234280 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-fd1e7cb1-1343-416e-84a6-c90743851c34 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/subnets?network_id=2b6725f5-ebfe-485a-8f42-ccb5a241ddb5&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0362766 Nov 09 04:37:23.236805 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59928) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:37:23.241490 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-d946a446-0698-4d98-8d4f-a10da32904e8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-1169045643', 'network_id': '4ca58d86-8d4d-408b-8308-dfa9f89406f0', 'project_id': '1d10b4824e524068827e58b55e269af3', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:37:23.245193 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9e1a88b2-f58f-44ce-bc4b-3750eaa76175 None None] Checking router: b9fe8b76-742f-4072-b1f1-39a9dbe806a5 for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:37:23.245538 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9e1a88b2-f58f-44ce-bc4b-3750eaa76175 None None] Updating router b9fe8b76-742f-4072-b1f1-39a9dbe806a5 port 965ebc5f-0c00-46a9-aaf1-8ed04be937c6 binding host dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 04:37:23.269757 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9e1a88b2-f58f-44ce-bc4b-3750eaa76175 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:23.390062 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d946a446-0698-4d98-8d4f-a10da32904e8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Made reservation on behalf of 1d10b4824e524068827e58b55e269af3 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:37:23.393771 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d946a446-0698-4d98-8d4f-a10da32904e8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:23.521474 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9e1a88b2-f58f-44ce-bc4b-3750eaa76175 None None] Publish callbacks [] for port, precommit_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:23.601123 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9e1a88b2-f58f-44ce-bc4b-3750eaa76175 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:23.649589 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-9e1a88b2-f58f-44ce-bc4b-3750eaa76175 None None] Attempting to bind port 965ebc5f-0c00-46a9-aaf1-8ed04be937c6 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:37:23.649950 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-9e1a88b2-f58f-44ce-bc4b-3750eaa76175 None None] Attempting to bind port 965ebc5f-0c00-46a9-aaf1-8ed04be937c6 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:37:23.650310 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9e1a88b2-f58f-44ce-bc4b-3750eaa76175 None None] Attempting to bind port 965ebc5f-0c00-46a9-aaf1-8ed04be937c6 on network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:37:23.652839 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d946a446-0698-4d98-8d4f-a10da32904e8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:23.657594 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b460741-3198-4212-bd71-e6232dba50a0 None None] Pushing event updated for resources: {'Port': ['ID=965ebc5f-0c00-46a9-aaf1-8ed04be937c6,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:37:23.660262 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9e1a88b2-f58f-44ce-bc4b-3750eaa76175 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 37, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:37:23.662976 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9e1a88b2-f58f-44ce-bc4b-3750eaa76175 None None] Checking segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:37:23.662976 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9e1a88b2-f58f-44ce-bc4b-3750eaa76175 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:23.662976 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9e1a88b2-f58f-44ce-bc4b-3750eaa76175 None None] Bound using segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:37:23.662976 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-9e1a88b2-f58f-44ce-bc4b-3750eaa76175 None None] Bound port: 965ebc5f-0c00-46a9-aaf1-8ed04be937c6, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:37:23.662976 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9e1a88b2-f58f-44ce-bc4b-3750eaa76175 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:23.712343 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-9e1a88b2-f58f-44ce-bc4b-3750eaa76175 None None] For port 965ebc5f-0c00-46a9-aaf1-8ed04be937c6, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:37:23.716148 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-9e1a88b2-f58f-44ce-bc4b-3750eaa76175 None None] For port 965ebc5f-0c00-46a9-aaf1-8ed04be937c6, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=965ebc5f-0c00-46a9-aaf1-8ed04be937c6,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:37:23.716515 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d946a446-0698-4d98-8d4f-a10da32904e8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Subnet': ['ID=555b0d63-4eb8-45a4-a06a-bbcb72506fcd,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:37:23.728033 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d946a446-0698-4d98-8d4f-a10da32904e8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Checking segment: {'id': '2ebee1f6-c165-461d-bb96-18710a0d5427', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 346, 'network_id': '4ca58d86-8d4d-408b-8308-dfa9f89406f0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:37:23.728391 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d946a446-0698-4d98-8d4f-a10da32904e8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network hostable DHCP agents. Network: 4ca58d86-8d4d-408b-8308-dfa9f89406f0, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:37:23.798399 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9e1a88b2-f58f-44ce-bc4b-3750eaa76175 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:23.826784 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d946a446-0698-4d98-8d4f-a10da32904e8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network 4ca58d86-8d4d-408b-8308-dfa9f89406f0 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:37:23.854711 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9e1a88b2-f58f-44ce-bc4b-3750eaa76175 None None] Routers {'b9fe8b76-742f-4072-b1f1-39a9dbe806a5'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:37:23.855349 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-9e1a88b2-f58f-44ce-bc4b-3750eaa76175 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:37:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['b9fe8b76-742f-4072-b1f1-39a9dbe806a5'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:37:23.892694 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b460741-3198-4212-bd71-e6232dba50a0 None None] Pushing event updated for resources: {'Port': ['ID=965ebc5f-0c00-46a9-aaf1-8ed04be937c6,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:37:23.915484 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-d946a446-0698-4d98-8d4f-a10da32904e8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 4ca58d86-8d4d-408b-8308-dfa9f89406f0) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:37:23.919622 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d946a446-0698-4d98-8d4f-a10da32904e8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:37:23.920251 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d946a446-0698-4d98-8d4f-a10da32904e8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:23.937885 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8e055f9b-ce6b-48b2-9f54-5ea09c668df4 None None] Network 4ca58d86-8d4d-408b-8308-dfa9f89406f0 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:37:24.001991 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-d946a446-0698-4d98-8d4f-a10da32904e8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 832 time: 0.7617316 Nov 09 04:37:24.002209 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59930) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:37:24.012110 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-9e1a88b2-f58f-44ce-bc4b-3750eaa76175 None None] Set router b9fe8b76-742f-4072-b1f1-39a9dbe806a5 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:37:24.229504 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c3362dd3-cac5-4765-b724-dc6a668d2c71 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-4ca58d86-8d4d-408b-8308-dfa9f89406f0', 'network_id': '4ca58d86-8d4d-408b-8308-dfa9f89406f0', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ips': [{'subnet_id': '555b0d63-4eb8-45a4-a06a-bbcb72506fcd'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:37:24.230345 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c3362dd3-cac5-4765-b724-dc6a668d2c71 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:24.331425 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-9e1a88b2-f58f-44ce-bc4b-3750eaa76175 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'name': 'tempest-TestNetworkBasicOps-router-473737147', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.35'}], 'enable_snat': True}, 'gw_port_id': '965ebc5f-0c00-46a9-aaf1-8ed04be937c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:37:20Z', 'updated_at': '2021-11-09T04:37:22Z', 'revision_number': 3, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '965ebc5f-0c00-46a9-aaf1-8ed04be937c6', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:d0:85:9c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1376, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:37:21Z', 'updated_at': '2021-11-09T04:37:23Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:37:24.380699 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9e1a88b2-f58f-44ce-bc4b-3750eaa76175 None None] The sync data for ids ['b9fe8b76-742f-4072-b1f1-39a9dbe806a5'] in dv-neutron-816802-2-hyperv is: [{'id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'name': 'tempest-TestNetworkBasicOps-router-473737147', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.35'}], 'enable_snat': True}, 'gw_port_id': '965ebc5f-0c00-46a9-aaf1-8ed04be937c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:37:20Z', 'updated_at': '2021-11-09T04:37:22Z', 'revision_number': 3, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '965ebc5f-0c00-46a9-aaf1-8ed04be937c6', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:d0:85:9c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1376, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:37:21Z', 'updated_at': '2021-11-09T04:37:23Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:37:24.403010 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-c3362dd3-cac5-4765-b724-dc6a668d2c71 None None] Allocated IP 172.20.0.2 (4ca58d86-8d4d-408b-8308-dfa9f89406f0/555b0d63-4eb8-45a4-a06a-bbcb72506fcd/e366ffd3-3215-4be7-af97-99145a729e4b) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:37:24.448976 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a577aab7-b62a-4310-83ab-067c58c20f46 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:24.556158 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c3362dd3-cac5-4765-b724-dc6a668d2c71 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:24.649181 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c3362dd3-cac5-4765-b724-dc6a668d2c71 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:24.693240 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c3362dd3-cac5-4765-b724-dc6a668d2c71 None None] Network 4ca58d86-8d4d-408b-8308-dfa9f89406f0 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:37:24.696558 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-c3362dd3-cac5-4765-b724-dc6a668d2c71 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:37:24.701300 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c3362dd3-cac5-4765-b724-dc6a668d2c71 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:37:24.704515 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3362dd3-cac5-4765-b724-dc6a668d2c71 None None] Pushing event updated for resources: {'Port': ['ID=e366ffd3-3215-4be7-af97-99145a729e4b,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:37:24.760882 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-a577aab7-b62a-4310-83ab-067c58c20f46 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Allocated IP 172.20.0.1 (4ca58d86-8d4d-408b-8308-dfa9f89406f0/555b0d63-4eb8-45a4-a06a-bbcb72506fcd/a294c982-9115-446d-9b80-0b74de52d18d) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:37:24.767209 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-c3362dd3-cac5-4765-b724-dc6a668d2c71 None None] Attempting to bind port e366ffd3-3215-4be7-af97-99145a729e4b on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:37:24.767589 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-c3362dd3-cac5-4765-b724-dc6a668d2c71 None None] Attempting to bind port e366ffd3-3215-4be7-af97-99145a729e4b by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '2ebee1f6-c165-461d-bb96-18710a0d5427', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 346, 'network_id': '4ca58d86-8d4d-408b-8308-dfa9f89406f0'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:37:24.768169 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c3362dd3-cac5-4765-b724-dc6a668d2c71 None None] Attempting to bind port e366ffd3-3215-4be7-af97-99145a729e4b on network 4ca58d86-8d4d-408b-8308-dfa9f89406f0 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:37:24.773820 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c3362dd3-cac5-4765-b724-dc6a668d2c71 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 37, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:37:24.774595 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c3362dd3-cac5-4765-b724-dc6a668d2c71 None None] Checking segment: {'id': '2ebee1f6-c165-461d-bb96-18710a0d5427', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 346, 'network_id': '4ca58d86-8d4d-408b-8308-dfa9f89406f0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:37:24.774749 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c3362dd3-cac5-4765-b724-dc6a668d2c71 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:24.775012 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c3362dd3-cac5-4765-b724-dc6a668d2c71 None None] Bound using segment: {'id': '2ebee1f6-c165-461d-bb96-18710a0d5427', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 346, 'network_id': '4ca58d86-8d4d-408b-8308-dfa9f89406f0'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:37:24.775478 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-c3362dd3-cac5-4765-b724-dc6a668d2c71 None None] Bound port: e366ffd3-3215-4be7-af97-99145a729e4b, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2ebee1f6-c165-461d-bb96-18710a0d5427', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 346, 'network_id': '4ca58d86-8d4d-408b-8308-dfa9f89406f0'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:37:24.775892 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c3362dd3-cac5-4765-b724-dc6a668d2c71 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:24.845598 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-c3362dd3-cac5-4765-b724-dc6a668d2c71 None None] For port e366ffd3-3215-4be7-af97-99145a729e4b, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:37:24.849652 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-c3362dd3-cac5-4765-b724-dc6a668d2c71 None None] For port e366ffd3-3215-4be7-af97-99145a729e4b, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=e366ffd3-3215-4be7-af97-99145a729e4b,segment=NetworkSegment(2ebee1f6-c165-461d-bb96-18710a0d5427),segment_id=2ebee1f6-c165-461d-bb96-18710a0d5427)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:37:24.888644 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a577aab7-b62a-4310-83ab-067c58c20f46 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:24.921877 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c3362dd3-cac5-4765-b724-dc6a668d2c71 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:24.968067 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a577aab7-b62a-4310-83ab-067c58c20f46 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:24.982626 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3362dd3-cac5-4765-b724-dc6a668d2c71 None None] Pushing event updated for resources: {'Port': ['ID=e366ffd3-3215-4be7-af97-99145a729e4b,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:37:25.010996 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a577aab7-b62a-4310-83ab-067c58c20f46 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network 4ca58d86-8d4d-408b-8308-dfa9f89406f0 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:37:25.014702 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-a577aab7-b62a-4310-83ab-067c58c20f46 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:37:25.020914 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a577aab7-b62a-4310-83ab-067c58c20f46 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:37:25.047142 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a577aab7-b62a-4310-83ab-067c58c20f46 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Port': ['ID=a294c982-9115-446d-9b80-0b74de52d18d,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:37:25.070845 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a577aab7-b62a-4310-83ab-067c58c20f46 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:25.305406 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a577aab7-b62a-4310-83ab-067c58c20f46 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:25.361877 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 965ebc5f-0c00-46a9-aaf1-8ed04be937c6 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:37:25.409444 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 965ebc5f-0c00-46a9-aaf1-8ed04be937c6 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:37:25.409726 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:25.490419 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:25.513020 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 965ebc5f-0c00-46a9-aaf1-8ed04be937c6, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=965ebc5f-0c00-46a9-aaf1-8ed04be937c6,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:37:25.569280 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:25.570098 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device e366ffd3-3215-4be7-af97-99145a729e4b up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:37:25.647438 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=965ebc5f-0c00-46a9-aaf1-8ed04be937c6,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:37:25.659077 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port e366ffd3-3215-4be7-af97-99145a729e4b triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:37:25.659452 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:25.745477 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:25.778629 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port e366ffd3-3215-4be7-af97-99145a729e4b, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=e366ffd3-3215-4be7-af97-99145a729e4b,segment=NetworkSegment(2ebee1f6-c165-461d-bb96-18710a0d5427),segment_id=2ebee1f6-c165-461d-bb96-18710a0d5427)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:37:25.865929 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a577aab7-b62a-4310-83ab-067c58c20f46 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:25.875496 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:25.922270 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=e366ffd3-3215-4be7-af97-99145a729e4b,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:37:25.944339 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a577aab7-b62a-4310-83ab-067c58c20f46 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:26.019755 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a577aab7-b62a-4310-83ab-067c58c20f46 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Port': ['ID=a294c982-9115-446d-9b80-0b74de52d18d,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:37:26.022164 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a577aab7-b62a-4310-83ab-067c58c20f46 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:26.126223 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a577aab7-b62a-4310-83ab-067c58c20f46 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network 4ca58d86-8d4d-408b-8308-dfa9f89406f0 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:37:26.127778 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-a577aab7-b62a-4310-83ab-067c58c20f46 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:37:26.249335 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a577aab7-b62a-4310-83ab-067c58c20f46 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Router b9fe8b76-742f-4072-b1f1-39a9dbe806a5 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:37:26.312839 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2e232a38-482c-4dee-96f5-92775a81b3ff None None] Network 4ca58d86-8d4d-408b-8308-dfa9f89406f0 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:37:26.361383 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a577aab7-b62a-4310-83ab-067c58c20f46 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:37:26.367086 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a577aab7-b62a-4310-83ab-067c58c20f46 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "PUT /v2.0/routers/b9fe8b76-742f-4072-b1f1-39a9dbe806a5/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.3638737 Nov 09 04:37:26.369531 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59932) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:37:26.408190 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-cd5cf9c4-f5c1-4724-964c-3a03d2ca68fa None None] Provisioning complete for port e366ffd3-3215-4be7-af97-99145a729e4b triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:37:26.408190 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-cd5cf9c4-f5c1-4724-964c-3a03d2ca68fa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:26.435667 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5e282bb3-53a9-4ba5-bb60-79fa932568d8 None None] Sync routers for ids ['b9fe8b76-742f-4072-b1f1-39a9dbe806a5'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:37:26.446518 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5e282bb3-53a9-4ba5-bb60-79fa932568d8 None None] Routers {'b9fe8b76-742f-4072-b1f1-39a9dbe806a5'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:37:26.450535 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-5e282bb3-53a9-4ba5-bb60-79fa932568d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:37:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['b9fe8b76-742f-4072-b1f1-39a9dbe806a5'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:37:26.481067 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e170c431-b15f-4cf4-b7ff-4aa87b10aa8d tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:37:26.481582 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e170c431-b15f-4cf4-b7ff-4aa87b10aa8d tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:37:26.482044 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e170c431-b15f-4cf4-b7ff-4aa87b10aa8d tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:37:26.482513 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e170c431-b15f-4cf4-b7ff-4aa87b10aa8d tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:37:26.482959 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e170c431-b15f-4cf4-b7ff-4aa87b10aa8d tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:37:26.483400 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e170c431-b15f-4cf4-b7ff-4aa87b10aa8d tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:37:26.487770 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e170c431-b15f-4cf4-b7ff-4aa87b10aa8d tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/networks HTTP/1.1" status: 200 len: 4285 time: 0.1147442 Nov 09 04:37:26.489610 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59934) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:37:26.557594 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-5e282bb3-53a9-4ba5-bb60-79fa932568d8 None None] Set router b9fe8b76-742f-4072-b1f1-39a9dbe806a5 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:37:26.560205 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f585e64f-a87c-4464-9a36-e50d2f17f58e tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:37:26.560666 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f585e64f-a87c-4464-9a36-e50d2f17f58e tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:37:26.561111 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f585e64f-a87c-4464-9a36-e50d2f17f58e tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:37:26.561549 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f585e64f-a87c-4464-9a36-e50d2f17f58e tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:37:26.561988 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f585e64f-a87c-4464-9a36-e50d2f17f58e tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:37:26.562455 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f585e64f-a87c-4464-9a36-e50d2f17f58e tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:37:26.564646 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-f585e64f-a87c-4464-9a36-e50d2f17f58e tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 4006 time: 0.0750110 Nov 09 04:37:26.567399 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59936) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:37:26.764930 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-038d2ae6-f007-4ee4-9359-77021ada863c None None] Provisioning complete for port a294c982-9115-446d-9b80-0b74de52d18d triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:37:26.765560 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-038d2ae6-f007-4ee4-9359-77021ada863c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:26.774507 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-5e282bb3-53a9-4ba5-bb60-79fa932568d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'name': 'tempest-TestNetworkBasicOps-router-473737147', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.35'}], 'enable_snat': True}, 'gw_port_id': '965ebc5f-0c00-46a9-aaf1-8ed04be937c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:37:20Z', 'updated_at': '2021-11-09T04:37:25Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '965ebc5f-0c00-46a9-aaf1-8ed04be937c6', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:d0:85:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1376, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:37:21Z', 'updated_at': '2021-11-09T04:37:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'a294c982-9115-446d-9b80-0b74de52d18d', 'name': '', 'network_id': '4ca58d86-8d4d-408b-8308-dfa9f89406f0', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:6f:5c:f0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1379, 'fixed_ips': [{'subnet_id': '555b0d63-4eb8-45a4-a06a-bbcb72506fcd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:37:24Z', 'updated_at': '2021-11-09T04:37:25Z', 'revision_number': 2, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '555b0d63-4eb8-45a4-a06a-bbcb72506fcd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:37:26.807633 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-038d2ae6-f007-4ee4-9359-77021ada863c None None] Port a294c982-9115-446d-9b80-0b74de52d18d cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:37:26.808118 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5e282bb3-53a9-4ba5-bb60-79fa932568d8 None None] Checking router: b9fe8b76-742f-4072-b1f1-39a9dbe806a5 for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:37:26.809069 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5e282bb3-53a9-4ba5-bb60-79fa932568d8 None None] Updating router b9fe8b76-742f-4072-b1f1-39a9dbe806a5 port a294c982-9115-446d-9b80-0b74de52d18d binding host dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 04:37:26.815316 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-43e52672-1e86-48dd-9826-56ee934a30fd tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/routers HTTP/1.1" status: 200 len: 3046 time: 0.2467659 Nov 09 04:37:26.820754 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-038d2ae6-f007-4ee4-9359-77021ada863c None None] Provisioning complete for port e366ffd3-3215-4be7-af97-99145a729e4b triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:37:26.821242 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-038d2ae6-f007-4ee4-9359-77021ada863c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:26.941394 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-5e282bb3-53a9-4ba5-bb60-79fa932568d8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:27.038642 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-33a89928-d146-41af-a7de-4a78eeab951f None None] Provisioning complete for port a294c982-9115-446d-9b80-0b74de52d18d triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:37:27.038969 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-33a89928-d146-41af-a7de-4a78eeab951f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:27.075982 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-33a89928-d146-41af-a7de-4a78eeab951f None None] Port a294c982-9115-446d-9b80-0b74de52d18d cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:37:27.115328 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59940) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:37:27.120578 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-15e39324-8224-464f-b75a-09e4940ff38d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1825619220', 'description': 'tempest-secgroup-smoke-1825619220 description', 'project_id': '1d10b4824e524068827e58b55e269af3'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:37:27.194136 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-5bfdb909-5ad4-4d56-82a8-ede00a8cd790 None None] Provisioning complete for port a294c982-9115-446d-9b80-0b74de52d18d triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:37:27.194547 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5bfdb909-5ad4-4d56-82a8-ede00a8cd790 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:27.212522 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-15e39324-8224-464f-b75a-09e4940ff38d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:27.213471 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-5e282bb3-53a9-4ba5-bb60-79fa932568d8 None None] Publish callbacks [] for port, precommit_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:27.229302 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-5bfdb909-5ad4-4d56-82a8-ede00a8cd790 None None] Port a294c982-9115-446d-9b80-0b74de52d18d cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:37:27.288329 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 965ebc5f-0c00-46a9-aaf1-8ed04be937c6 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:37:27.296816 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-15e39324-8224-464f-b75a-09e4940ff38d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:27.311611 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-5e282bb3-53a9-4ba5-bb60-79fa932568d8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:27.339197 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 965ebc5f-0c00-46a9-aaf1-8ed04be937c6 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:37:27.339749 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:27.365054 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3cc5bd31-01df-4510-b201-c5cfb025d445 None None] Pushing event updated for resources: {'Port': ['ID=a294c982-9115-446d-9b80-0b74de52d18d,revision_number=3']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:37:27.374992 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3cc5bd31-01df-4510-b201-c5cfb025d445 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:37:27.375340 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3cc5bd31-01df-4510-b201-c5cfb025d445 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:37:27.375679 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3cc5bd31-01df-4510-b201-c5cfb025d445 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:37:27.376030 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3cc5bd31-01df-4510-b201-c5cfb025d445 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:37:27.376345 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3cc5bd31-01df-4510-b201-c5cfb025d445 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:37:27.376935 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3cc5bd31-01df-4510-b201-c5cfb025d445 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:37:27.377151 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3cc5bd31-01df-4510-b201-c5cfb025d445 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:37:27.377488 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3cc5bd31-01df-4510-b201-c5cfb025d445 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:37:27.377816 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3cc5bd31-01df-4510-b201-c5cfb025d445 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:37:27.378137 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3cc5bd31-01df-4510-b201-c5cfb025d445 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:37:27.378505 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3cc5bd31-01df-4510-b201-c5cfb025d445 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:37:27.378819 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3cc5bd31-01df-4510-b201-c5cfb025d445 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:37:27.412807 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-15e39324-8224-464f-b75a-09e4940ff38d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:27.447130 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-5e282bb3-53a9-4ba5-bb60-79fa932568d8 None None] Attempting to bind port a294c982-9115-446d-9b80-0b74de52d18d on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:37:27.447766 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-5e282bb3-53a9-4ba5-bb60-79fa932568d8 None None] Attempting to bind port a294c982-9115-446d-9b80-0b74de52d18d by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '2ebee1f6-c165-461d-bb96-18710a0d5427', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 346, 'network_id': '4ca58d86-8d4d-408b-8308-dfa9f89406f0'}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:37:27.447906 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5e282bb3-53a9-4ba5-bb60-79fa932568d8 None None] Attempting to bind port a294c982-9115-446d-9b80-0b74de52d18d on network 4ca58d86-8d4d-408b-8308-dfa9f89406f0 {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:37:27.449296 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15e39324-8224-464f-b75a-09e4940ff38d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroup': ['ID=7150f69a-1583-405c-a9de-a6e7b0c1a2a4,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:37:27.455615 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5e282bb3-53a9-4ba5-bb60-79fa932568d8 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 37, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:37:27.460417 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5e282bb3-53a9-4ba5-bb60-79fa932568d8 None None] Checking segment: {'id': '2ebee1f6-c165-461d-bb96-18710a0d5427', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 346, 'network_id': '4ca58d86-8d4d-408b-8308-dfa9f89406f0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102164) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:37:27.460417 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-5e282bb3-53a9-4ba5-bb60-79fa932568d8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:27.460417 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5e282bb3-53a9-4ba5-bb60-79fa932568d8 None None] Bound using segment: {'id': '2ebee1f6-c165-461d-bb96-18710a0d5427', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 346, 'network_id': '4ca58d86-8d4d-408b-8308-dfa9f89406f0'} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:37:27.460417 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-5e282bb3-53a9-4ba5-bb60-79fa932568d8 None None] Bound port: a294c982-9115-446d-9b80-0b74de52d18d, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2ebee1f6-c165-461d-bb96-18710a0d5427', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 346, 'network_id': '4ca58d86-8d4d-408b-8308-dfa9f89406f0'}}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:37:27.460417 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-5e282bb3-53a9-4ba5-bb60-79fa932568d8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:27.519259 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-15e39324-8224-464f-b75a-09e4940ff38d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:27.524468 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-15e39324-8224-464f-b75a-09e4940ff38d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.4050009 Nov 09 04:37:27.524807 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 59942) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:37:27.529596 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-baa2d075-b172-4fe0-9b59-5582a430d565 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': '7150f69a-1583-405c-a9de-a6e7b0c1a2a4', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:37:27.542545 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-5e282bb3-53a9-4ba5-bb60-79fa932568d8 None None] For port a294c982-9115-446d-9b80-0b74de52d18d, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102164) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:37:27.547824 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-5e282bb3-53a9-4ba5-bb60-79fa932568d8 None None] For port a294c982-9115-446d-9b80-0b74de52d18d, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=a294c982-9115-446d-9b80-0b74de52d18d,segment=NetworkSegment(2ebee1f6-c165-461d-bb96-18710a0d5427),segment_id=2ebee1f6-c165-461d-bb96-18710a0d5427)] {{(pid=102164) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:37:27.579497 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device e366ffd3-3215-4be7-af97-99145a729e4b up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:37:27.624672 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port e366ffd3-3215-4be7-af97-99145a729e4b triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:37:27.624874 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-5e282bb3-53a9-4ba5-bb60-79fa932568d8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:27.624996 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:27.657508 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-baa2d075-b172-4fe0-9b59-5582a430d565 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:27.676556 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-23f37cf5-018b-4140-9f70-de2f0a8db2e2 None None] Provisioning complete for port a294c982-9115-446d-9b80-0b74de52d18d triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:37:27.676927 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-23f37cf5-018b-4140-9f70-de2f0a8db2e2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:27.696941 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3cc5bd31-01df-4510-b201-c5cfb025d445 None None] Pushing event updated for resources: {'Port': ['ID=a294c982-9115-446d-9b80-0b74de52d18d,revision_number=4']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:37:27.707219 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5e282bb3-53a9-4ba5-bb60-79fa932568d8 None None] Routers {'b9fe8b76-742f-4072-b1f1-39a9dbe806a5'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:37:27.708005 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-5e282bb3-53a9-4ba5-bb60-79fa932568d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:37:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['b9fe8b76-742f-4072-b1f1-39a9dbe806a5'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:37:27.745381 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-baa2d075-b172-4fe0-9b59-5582a430d565 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:27.792506 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-23f37cf5-018b-4140-9f70-de2f0a8db2e2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:27.820683 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-baa2d075-b172-4fe0-9b59-5582a430d565 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:27.830600 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-5e282bb3-53a9-4ba5-bb60-79fa932568d8 None None] Set router b9fe8b76-742f-4072-b1f1-39a9dbe806a5 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:37:27.834120 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-23f37cf5-018b-4140-9f70-de2f0a8db2e2 None None] For port a294c982-9115-446d-9b80-0b74de52d18d, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=a294c982-9115-446d-9b80-0b74de52d18d,segment=NetworkSegment(2ebee1f6-c165-461d-bb96-18710a0d5427),segment_id=2ebee1f6-c165-461d-bb96-18710a0d5427)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:37:27.837368 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-baa2d075-b172-4fe0-9b59-5582a430d565 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a6c35506-739a-48e7-872f-9925cfbd1bd5,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:37:27.877670 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-23f37cf5-018b-4140-9f70-de2f0a8db2e2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:27.908882 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-baa2d075-b172-4fe0-9b59-5582a430d565 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:27.910395 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-baa2d075-b172-4fe0-9b59-5582a430d565 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3845201 Nov 09 04:37:27.913632 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59944) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:37:27.918274 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-ca01597c-1d7e-471d-b673-1fd510dc2458 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': '7150f69a-1583-405c-a9de-a6e7b0c1a2a4', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:37:27.935740 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23f37cf5-018b-4140-9f70-de2f0a8db2e2 None None] Pushing event updated for resources: {'Port': ['ID=a294c982-9115-446d-9b80-0b74de52d18d,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:37:27.986276 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ca01597c-1d7e-471d-b673-1fd510dc2458 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:28.006439 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e956813c-ea3f-49b7-817f-546bcd8aa069 None None] Provisioning complete for port a294c982-9115-446d-9b80-0b74de52d18d triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:37:28.007105 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e956813c-ea3f-49b7-817f-546bcd8aa069 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:28.042810 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ca01597c-1d7e-471d-b673-1fd510dc2458 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:28.069232 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-5e282bb3-53a9-4ba5-bb60-79fa932568d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'name': 'tempest-TestNetworkBasicOps-router-473737147', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.35'}], 'enable_snat': True}, 'gw_port_id': '965ebc5f-0c00-46a9-aaf1-8ed04be937c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:37:20Z', 'updated_at': '2021-11-09T04:37:25Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '965ebc5f-0c00-46a9-aaf1-8ed04be937c6', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:d0:85:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1376, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:37:21Z', 'updated_at': '2021-11-09T04:37:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'a294c982-9115-446d-9b80-0b74de52d18d', 'name': '', 'network_id': '4ca58d86-8d4d-408b-8308-dfa9f89406f0', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:6f:5c:f0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1379, 'fixed_ips': [{'subnet_id': '555b0d63-4eb8-45a4-a06a-bbcb72506fcd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:37:24Z', 'updated_at': '2021-11-09T04:37:27Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '555b0d63-4eb8-45a4-a06a-bbcb72506fcd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:37:28.098241 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5e282bb3-53a9-4ba5-bb60-79fa932568d8 None None] The sync data for ids ['b9fe8b76-742f-4072-b1f1-39a9dbe806a5'] in dv-neutron-816802-2-hyperv is: [{'id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'name': 'tempest-TestNetworkBasicOps-router-473737147', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.35'}], 'enable_snat': True}, 'gw_port_id': '965ebc5f-0c00-46a9-aaf1-8ed04be937c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:37:20Z', 'updated_at': '2021-11-09T04:37:25Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '965ebc5f-0c00-46a9-aaf1-8ed04be937c6', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:d0:85:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1376, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:37:21Z', 'updated_at': '2021-11-09T04:37:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'a294c982-9115-446d-9b80-0b74de52d18d', 'name': '', 'network_id': '4ca58d86-8d4d-408b-8308-dfa9f89406f0', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:6f:5c:f0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1379, 'fixed_ips': [{'subnet_id': '555b0d63-4eb8-45a4-a06a-bbcb72506fcd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:37:24Z', 'updated_at': '2021-11-09T04:37:27Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '555b0d63-4eb8-45a4-a06a-bbcb72506fcd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:37:28.100665 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ca01597c-1d7e-471d-b673-1fd510dc2458 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:28.126383 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca01597c-1d7e-471d-b673-1fd510dc2458 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=949152e9-5558-4153-bc09-b0d2bc338139,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:37:28.143912 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca01597c-1d7e-471d-b673-1fd510dc2458 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:37:28.143912 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca01597c-1d7e-471d-b673-1fd510dc2458 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:37:28.143912 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca01597c-1d7e-471d-b673-1fd510dc2458 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:37:28.143912 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca01597c-1d7e-471d-b673-1fd510dc2458 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:37:28.143912 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca01597c-1d7e-471d-b673-1fd510dc2458 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:37:28.143912 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca01597c-1d7e-471d-b673-1fd510dc2458 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:37:28.143912 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca01597c-1d7e-471d-b673-1fd510dc2458 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:37:28.143912 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca01597c-1d7e-471d-b673-1fd510dc2458 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:37:28.143912 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca01597c-1d7e-471d-b673-1fd510dc2458 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:37:28.143912 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca01597c-1d7e-471d-b673-1fd510dc2458 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:37:28.143912 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca01597c-1d7e-471d-b673-1fd510dc2458 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:37:28.143912 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca01597c-1d7e-471d-b673-1fd510dc2458 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:37:28.191720 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ca01597c-1d7e-471d-b673-1fd510dc2458 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:28.193023 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-ca01597c-1d7e-471d-b673-1fd510dc2458 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.2783558 Nov 09 04:37:28.195828 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59946) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:37:28.201031 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-0d4ecd9e-313f-446d-ac17-f83dda30faac tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': '7150f69a-1583-405c-a9de-a6e7b0c1a2a4', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:37:28.317102 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0d4ecd9e-313f-446d-ac17-f83dda30faac tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:28.377215 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0d4ecd9e-313f-446d-ac17-f83dda30faac tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:28.448961 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0d4ecd9e-313f-446d-ac17-f83dda30faac tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:28.471038 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d4ecd9e-313f-446d-ac17-f83dda30faac tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=122d205f-f604-4f3d-9e24-01483e3d871b,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:37:28.531700 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0d4ecd9e-313f-446d-ac17-f83dda30faac tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:28.535664 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-0d4ecd9e-313f-446d-ac17-f83dda30faac tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3362482 Nov 09 04:37:28.536088 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59948) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:37:28.540698 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-c2cc9e51-7686-49da-83fc-86affd79ea28 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': '7150f69a-1583-405c-a9de-a6e7b0c1a2a4', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:37:28.631303 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c2cc9e51-7686-49da-83fc-86affd79ea28 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:28.690739 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c2cc9e51-7686-49da-83fc-86affd79ea28 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:28.751738 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c2cc9e51-7686-49da-83fc-86affd79ea28 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:28.772762 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2cc9e51-7686-49da-83fc-86affd79ea28 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=971c7071-92ba-4b42-b127-b9482e2e5b34,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:37:28.834047 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c2cc9e51-7686-49da-83fc-86affd79ea28 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:28.835303 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-c2cc9e51-7686-49da-83fc-86affd79ea28 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.2984903 Nov 09 04:37:28.837942 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59950) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:37:28.842449 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-92521320-2e37-4be9-a826-bb561b6356f1 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': '7150f69a-1583-405c-a9de-a6e7b0c1a2a4', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:37:28.915776 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.securitygroups_db [None req-92521320-2e37-4be9-a826-bb561b6356f1 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Project 1d10b4824e524068827e58b55e269af3 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 09 04:37:28.920955 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-92521320-2e37-4be9-a826-bb561b6356f1 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:28.982581 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-92521320-2e37-4be9-a826-bb561b6356f1 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:29.048885 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-92521320-2e37-4be9-a826-bb561b6356f1 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:29.070093 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92521320-2e37-4be9-a826-bb561b6356f1 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e00a4000-f408-47cc-be84-02d608b84606,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:37:29.142504 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-92521320-2e37-4be9-a826-bb561b6356f1 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:29.143744 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-92521320-2e37-4be9-a826-bb561b6356f1 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.3047862 Nov 09 04:37:29.146513 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 59952) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:37:29.150760 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-4fa298be-d12d-4406-8ec0-b9e0c875f303 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': '7150f69a-1583-405c-a9de-a6e7b0c1a2a4', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:37:29.232531 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.securitygroups_db [None req-4fa298be-d12d-4406-8ec0-b9e0c875f303 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Project 1d10b4824e524068827e58b55e269af3 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 09 04:37:29.239401 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4fa298be-d12d-4406-8ec0-b9e0c875f303 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:29.298565 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device a294c982-9115-446d-9b80-0b74de52d18d up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:37:29.302839 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4fa298be-d12d-4406-8ec0-b9e0c875f303 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:29.348447 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port a294c982-9115-446d-9b80-0b74de52d18d triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:37:29.348871 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:29.378542 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4fa298be-d12d-4406-8ec0-b9e0c875f303 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:29.395574 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4fa298be-d12d-4406-8ec0-b9e0c875f303 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=43328b96-0f89-4de3-aa8a-26507c523971,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:37:29.479665 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4fa298be-d12d-4406-8ec0-b9e0c875f303 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:29.481437 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-4fa298be-d12d-4406-8ec0-b9e0c875f303 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.3334348 Nov 09 04:37:29.686721 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b0afdf04-9f34-4d0e-9690-000ae4eb705c req-8b906486-0e84-4a2b-83bf-905ac731a448 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1825619220&fields=id&tenant_id=1d10b4824e524068827e58b55e269af3 HTTP/1.1" status: 200 len: 267 time: 0.0533254 Nov 09 04:37:29.792131 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0afdf04-9f34-4d0e-9690-000ae4eb705c req-f5415e71-cd46-4545-b6f1-1b551b89fc79 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:37:29.793583 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b0afdf04-9f34-4d0e-9690-000ae4eb705c req-f5415e71-cd46-4545-b6f1-1b551b89fc79 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/networks?id=4ca58d86-8d4d-408b-8308-dfa9f89406f0 HTTP/1.1" status: 200 len: 796 time: 0.1002634 Nov 09 04:37:29.807908 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b0afdf04-9f34-4d0e-9690-000ae4eb705c req-efeb7158-38d9-483b-8890-f506242238f0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/quotas/1d10b4824e524068827e58b55e269af3 HTTP/1.1" status: 200 len: 375 time: 0.0085824 Nov 09 04:37:29.885809 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b0afdf04-9f34-4d0e-9690-000ae4eb705c req-d29509fe-fc59-4446-b168-fdb40ba7b8e6 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0728807 Nov 09 04:37:29.981323 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b0afdf04-9f34-4d0e-9690-000ae4eb705c req-f6cdb757-9d80-42f8-b0ca-428e4e4343ed service neutron] 10.222.0.24 "GET /v2.0/networks/4ca58d86-8d4d-408b-8308-dfa9f89406f0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0835464 Nov 09 04:37:30.066786 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b0afdf04-9f34-4d0e-9690-000ae4eb705c req-cd0d53c3-0d6b-4e81-99a0-d0d2772abd85 service neutron] 10.222.0.24 "GET /v2.0/networks/4ca58d86-8d4d-408b-8308-dfa9f89406f0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0792406 Nov 09 04:37:30.328611 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-71dc3382-ec07-4d9c-89a4-7f6089883dbd req-6a0a5502-fb20-40d8-badc-e7ed498c254a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=dd729d7d-d632-48e2-ad4b-7ce1cb65ee60 HTTP/1.1" status: 200 len: 210 time: 0.0277448 Nov 09 04:37:31.426499 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-da78e3d9-74b1-4e7d-b4d2-a45955d7e9ab req-77c24de5-16b0-470e-8c80-7326bf9ebca3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=dd729d7d-d632-48e2-ad4b-7ce1cb65ee60 HTTP/1.1" status: 200 len: 210 time: 0.0303137 Nov 09 04:37:32.151226 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0afdf04-9f34-4d0e-9690-000ae4eb705c req-d75fb67a-4c6e-4eb8-9b6d-1179186c7a5b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:37:32.153162 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b0afdf04-9f34-4d0e-9690-000ae4eb705c req-d75fb67a-4c6e-4eb8-9b6d-1179186c7a5b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "GET /v2.0/networks?id=4ca58d86-8d4d-408b-8308-dfa9f89406f0 HTTP/1.1" status: 200 len: 796 time: 0.1015725 Nov 09 04:37:32.221036 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b0afdf04-9f34-4d0e-9690-000ae4eb705c req-9e566660-9ab0-4121-a7d9-7107f3bc6b66 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=1d10b4824e524068827e58b55e269af3 HTTP/1.1" status: 200 len: 380 time: 0.0548718 Nov 09 04:37:32.237711 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-b0afdf04-9f34-4d0e-9690-000ae4eb705c req-08132579-e03d-4ec1-ab96-f9afd33e536d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'port': {'device_id': 'dd729d7d-d632-48e2-ad4b-7ce1cb65ee60', 'network_id': '4ca58d86-8d4d-408b-8308-dfa9f89406f0', 'admin_state_up': True, 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'security_groups': ['7150f69a-1583-405c-a9de-a6e7b0c1a2a4']}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:37:32.408988 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b0afdf04-9f34-4d0e-9690-000ae4eb705c req-08132579-e03d-4ec1-ab96-f9afd33e536d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Made reservation on behalf of 1d10b4824e524068827e58b55e269af3 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:37:32.412538 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-b0afdf04-9f34-4d0e-9690-000ae4eb705c req-08132579-e03d-4ec1-ab96-f9afd33e536d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:32.472630 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:37:32.520628 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-0ac7bcab-4af2-4fca-a884-dd6817a7798d req-695b7858-8f78-46a5-9047-1bde1973432c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=dd729d7d-d632-48e2-ad4b-7ce1cb65ee60 HTTP/1.1" status: 200 len: 210 time: 0.0263135 Nov 09 04:37:32.541180 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [req-b0afdf04-9f34-4d0e-9690-000ae4eb705c req-08132579-e03d-4ec1-ab96-f9afd33e536d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Allocated IP 172.20.0.10 (4ca58d86-8d4d-408b-8308-dfa9f89406f0/555b0d63-4eb8-45a4-a06a-bbcb72506fcd/1f0f5130-353d-4b95-ab61-f19dec355529) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:37:32.674646 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-b0afdf04-9f34-4d0e-9690-000ae4eb705c req-08132579-e03d-4ec1-ab96-f9afd33e536d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:32.763797 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-b0afdf04-9f34-4d0e-9690-000ae4eb705c req-08132579-e03d-4ec1-ab96-f9afd33e536d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:32.806752 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b0afdf04-9f34-4d0e-9690-000ae4eb705c req-08132579-e03d-4ec1-ab96-f9afd33e536d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network 4ca58d86-8d4d-408b-8308-dfa9f89406f0 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:37:32.810162 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [req-b0afdf04-9f34-4d0e-9690-000ae4eb705c req-08132579-e03d-4ec1-ab96-f9afd33e536d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:37:32.816299 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-b0afdf04-9f34-4d0e-9690-000ae4eb705c req-08132579-e03d-4ec1-ab96-f9afd33e536d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:37:32.841061 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08132579-e03d-4ec1-ab96-f9afd33e536d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Port': ['ID=1f0f5130-353d-4b95-ab61-f19dec355529,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:37:32.870764 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0afdf04-9f34-4d0e-9690-000ae4eb705c req-08132579-e03d-4ec1-ab96-f9afd33e536d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:37:32.871399 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-b0afdf04-9f34-4d0e-9690-000ae4eb705c req-08132579-e03d-4ec1-ab96-f9afd33e536d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:32.941276 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b0afdf04-9f34-4d0e-9690-000ae4eb705c req-08132579-e03d-4ec1-ab96-f9afd33e536d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7071435 Nov 09 04:37:32.954442 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-b0afdf04-9f34-4d0e-9690-000ae4eb705c req-aa8ebf69-98ce-4fbd-97fb-b2dbef8957a7 service neutron] Request body: {'port': {'device_id': 'dd729d7d-d632-48e2-ad4b-7ce1cb65ee60', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:37:33.007033 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-b0afdf04-9f34-4d0e-9690-000ae4eb705c req-aa8ebf69-98ce-4fbd-97fb-b2dbef8957a7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:33.039769 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-9f7fad0b-8ea5-4978-aa4a-26f9c6cd8aac None None] Provisioning complete for port 1f0f5130-353d-4b95-ab61-f19dec355529 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:37:33.040353 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9f7fad0b-8ea5-4978-aa4a-26f9c6cd8aac None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:33.076072 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-9f7fad0b-8ea5-4978-aa4a-26f9c6cd8aac None None] Port 1f0f5130-353d-4b95-ab61-f19dec355529 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:37:33.261485 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [req-b0afdf04-9f34-4d0e-9690-000ae4eb705c req-aa8ebf69-98ce-4fbd-97fb-b2dbef8957a7 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1f0f5130-353d-4b95-ab61-f19dec355529 {{(pid=102162) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:37:33.269199 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-b0afdf04-9f34-4d0e-9690-000ae4eb705c req-aa8ebf69-98ce-4fbd-97fb-b2dbef8957a7 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:33.282318 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.provisioning_blocks [req-b0afdf04-9f34-4d0e-9690-000ae4eb705c req-aa8ebf69-98ce-4fbd-97fb-b2dbef8957a7 service neutron] Transition to ACTIVE for port object 1f0f5130-353d-4b95-ab61-f19dec355529 will not be triggered until provisioned by entity L2. {{(pid=102162) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 09 04:37:33.366337 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-b0afdf04-9f34-4d0e-9690-000ae4eb705c req-aa8ebf69-98ce-4fbd-97fb-b2dbef8957a7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:33.417106 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa8ebf69-98ce-4fbd-97fb-b2dbef8957a7 service neutron] Pushing event updated for resources: {'Port': ['ID=1f0f5130-353d-4b95-ab61-f19dec355529,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:37:33.487014 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-b0afdf04-9f34-4d0e-9690-000ae4eb705c req-aa8ebf69-98ce-4fbd-97fb-b2dbef8957a7 service neutron] Attempting to bind port 1f0f5130-353d-4b95-ab61-f19dec355529 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:37:33.487433 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-b0afdf04-9f34-4d0e-9690-000ae4eb705c req-aa8ebf69-98ce-4fbd-97fb-b2dbef8957a7 service neutron] Attempting to bind port 1f0f5130-353d-4b95-ab61-f19dec355529 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '2ebee1f6-c165-461d-bb96-18710a0d5427', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 346, 'network_id': '4ca58d86-8d4d-408b-8308-dfa9f89406f0'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:37:33.487770 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0afdf04-9f34-4d0e-9690-000ae4eb705c req-aa8ebf69-98ce-4fbd-97fb-b2dbef8957a7 service neutron] Attempting to bind port 1f0f5130-353d-4b95-ab61-f19dec355529 on network 4ca58d86-8d4d-408b-8308-dfa9f89406f0 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:37:33.492469 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0afdf04-9f34-4d0e-9690-000ae4eb705c req-aa8ebf69-98ce-4fbd-97fb-b2dbef8957a7 service neutron] Port 1f0f5130-353d-4b95-ab61-f19dec355529 on network 4ca58d86-8d4d-408b-8308-dfa9f89406f0 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:37:33.492790 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0afdf04-9f34-4d0e-9690-000ae4eb705c req-aa8ebf69-98ce-4fbd-97fb-b2dbef8957a7 service neutron] Attempting to bind port 1f0f5130-353d-4b95-ab61-f19dec355529 on network 4ca58d86-8d4d-408b-8308-dfa9f89406f0 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:37:33.497863 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0afdf04-9f34-4d0e-9690-000ae4eb705c req-aa8ebf69-98ce-4fbd-97fb-b2dbef8957a7 service neutron] Checking agent: {'id': '7d36b884-4ad2-4878-9464-bf647030b544', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'started_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 37, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:37:33.498196 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0afdf04-9f34-4d0e-9690-000ae4eb705c req-aa8ebf69-98ce-4fbd-97fb-b2dbef8957a7 service neutron] Checking segment: {'id': '2ebee1f6-c165-461d-bb96-18710a0d5427', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 346, 'network_id': '4ca58d86-8d4d-408b-8308-dfa9f89406f0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:37:33.498611 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0afdf04-9f34-4d0e-9690-000ae4eb705c req-aa8ebf69-98ce-4fbd-97fb-b2dbef8957a7 service neutron] Bound using segment: {'id': '2ebee1f6-c165-461d-bb96-18710a0d5427', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 346, 'network_id': '4ca58d86-8d4d-408b-8308-dfa9f89406f0'} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:37:33.499036 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-b0afdf04-9f34-4d0e-9690-000ae4eb705c req-aa8ebf69-98ce-4fbd-97fb-b2dbef8957a7 service neutron] Bound port: 1f0f5130-353d-4b95-ab61-f19dec355529, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2ebee1f6-c165-461d-bb96-18710a0d5427', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 346, 'network_id': '4ca58d86-8d4d-408b-8308-dfa9f89406f0'}}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:37:33.499393 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-b0afdf04-9f34-4d0e-9690-000ae4eb705c req-aa8ebf69-98ce-4fbd-97fb-b2dbef8957a7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:33.570524 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-b0afdf04-9f34-4d0e-9690-000ae4eb705c req-aa8ebf69-98ce-4fbd-97fb-b2dbef8957a7 service neutron] For port 1f0f5130-353d-4b95-ab61-f19dec355529, host hv-neutron-8168, cleared binding levels {{(pid=102162) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:37:33.573695 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-b0afdf04-9f34-4d0e-9690-000ae4eb705c req-aa8ebf69-98ce-4fbd-97fb-b2dbef8957a7 service neutron] For port 1f0f5130-353d-4b95-ab61-f19dec355529, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=1f0f5130-353d-4b95-ab61-f19dec355529,segment=NetworkSegment(2ebee1f6-c165-461d-bb96-18710a0d5427),segment_id=2ebee1f6-c165-461d-bb96-18710a0d5427)] {{(pid=102162) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:37:33.639516 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-620a0f64-1b06-4940-beab-0c29a7d54124 req-205a8e06-2f75-417c-acc7-dfeb16ef5499 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:37:33.640978 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-620a0f64-1b06-4940-beab-0c29a7d54124 req-205a8e06-2f75-417c-acc7-dfeb16ef5499 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=dd729d7d-d632-48e2-ad4b-7ce1cb65ee60 HTTP/1.1" status: 200 len: 944 time: 0.0503850 Nov 09 04:37:33.642471 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-b0afdf04-9f34-4d0e-9690-000ae4eb705c req-aa8ebf69-98ce-4fbd-97fb-b2dbef8957a7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:33.689315 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0afdf04-9f34-4d0e-9690-000ae4eb705c req-aa8ebf69-98ce-4fbd-97fb-b2dbef8957a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:37:33.689948 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-b0afdf04-9f34-4d0e-9690-000ae4eb705c req-aa8ebf69-98ce-4fbd-97fb-b2dbef8957a7 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:33.691328 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b0afdf04-9f34-4d0e-9690-000ae4eb705c req-aa8ebf69-98ce-4fbd-97fb-b2dbef8957a7 service neutron] 10.222.0.26 "PUT /v2.0/ports/1f0f5130-353d-4b95-ab61-f19dec355529 HTTP/1.1" status: 200 len: 1094 time: 0.7412221 Nov 09 04:37:33.695547 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'dd729d7d-d632-48e2-ad4b-7ce1cb65ee60', 'tag': '1f0f5130-353d-4b95-ab61-f19dec355529'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:37:33.697787 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f6a4fbc0-b4b4-4f8d-ae4a-d0f6a554f72b" -d '{"events": [{"name": "network-changed", "server_uuid": "dd729d7d-d632-48e2-ad4b-7ce1cb65ee60", "tag": "1f0f5130-353d-4b95-ab61-f19dec355529"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:37:33.729390 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa8ebf69-98ce-4fbd-97fb-b2dbef8957a7 service neutron] Pushing event updated for resources: {'Port': ['ID=1f0f5130-353d-4b95-ab61-f19dec355529,revision_number=3']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:37:33.742078 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:37:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-de5e4718-91c8-4b31-ad5a-aff264132f2b x-openstack-request-id: req-de5e4718-91c8-4b31-ad5a-aff264132f2b {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:37:33.742386 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "dd729d7d-d632-48e2-ad4b-7ce1cb65ee60", "tag": "1f0f5130-353d-4b95-ab61-f19dec355529", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:37:33.742645 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-de5e4718-91c8-4b31-ad5a-aff264132f2b {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:37:33.743041 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'dd729d7d-d632-48e2-ad4b-7ce1cb65ee60', 'tag': '1f0f5130-353d-4b95-ab61-f19dec355529', 'status': 'completed', 'code': 200} Nov 09 04:37:33.753100 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-620a0f64-1b06-4940-beab-0c29a7d54124 req-272b82a3-5589-4c6b-8e9a-02916b89117d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=7150f69a-1583-405c-a9de-a6e7b0c1a2a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0875385 Nov 09 04:37:33.809086 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6a4fbc0-b4b4-4f8d-ae4a-d0f6a554f72b req-116048e0-705c-4b59-8cbf-c43b942624f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:37:33.810600 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f6a4fbc0-b4b4-4f8d-ae4a-d0f6a554f72b req-116048e0-705c-4b59-8cbf-c43b942624f4 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&device_id=dd729d7d-d632-48e2-ad4b-7ce1cb65ee60 HTTP/1.1" status: 200 len: 1097 time: 0.0464182 Nov 09 04:37:33.909705 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6a4fbc0-b4b4-4f8d-ae4a-d0f6a554f72b req-910a051a-733b-46ba-b374-7912c6245409 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:37:33.911198 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f6a4fbc0-b4b4-4f8d-ae4a-d0f6a554f72b req-910a051a-733b-46ba-b374-7912c6245409 service neutron] 10.222.0.26 "GET /v2.0/networks?tenant_id=1d10b4824e524068827e58b55e269af3&shared=False HTTP/1.1" status: 200 len: 897 time: 0.0926297 Nov 09 04:37:34.008192 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6a4fbc0-b4b4-4f8d-ae4a-d0f6a554f72b req-ba9e2f0e-18a8-4070-b30b-93c8bf231fa5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:37:34.009524 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f6a4fbc0-b4b4-4f8d-ae4a-d0f6a554f72b req-ba9e2f0e-18a8-4070-b30b-93c8bf231fa5 service neutron] 10.222.0.26 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0896857 Nov 09 04:37:34.083701 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0afdf04-9f34-4d0e-9690-000ae4eb705c req-90a20e2d-a46f-4a30-98b6-e5eed163e510 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:37:34.085156 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b0afdf04-9f34-4d0e-9690-000ae4eb705c req-90a20e2d-a46f-4a30-98b6-e5eed163e510 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&device_id=dd729d7d-d632-48e2-ad4b-7ce1cb65ee60 HTTP/1.1" status: 200 len: 1097 time: 0.0396917 Nov 09 04:37:34.131025 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b0afdf04-9f34-4d0e-9690-000ae4eb705c req-5996fdf8-476b-4ce1-aca4-bd66dcd91ca4 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=1f0f5130-353d-4b95-ab61-f19dec355529 HTTP/1.1" status: 200 len: 217 time: 0.0368586 Nov 09 04:37:34.180118 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0afdf04-9f34-4d0e-9690-000ae4eb705c req-b73e2a4a-d345-477c-b52a-f08101a9e40c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:37:34.181877 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b0afdf04-9f34-4d0e-9690-000ae4eb705c req-b73e2a4a-d345-477c-b52a-f08101a9e40c service neutron] 10.222.0.26 "GET /v2.0/subnets?id=555b0d63-4eb8-45a4-a06a-bbcb72506fcd HTTP/1.1" status: 200 len: 835 time: 0.0436182 Nov 09 04:37:34.225659 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0afdf04-9f34-4d0e-9690-000ae4eb705c req-4438628e-0dd9-493e-80de-5b83ee89e969 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:37:34.227137 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b0afdf04-9f34-4d0e-9690-000ae4eb705c req-4438628e-0dd9-493e-80de-5b83ee89e969 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=4ca58d86-8d4d-408b-8308-dfa9f89406f0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0385430 Nov 09 04:37:34.316941 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b0afdf04-9f34-4d0e-9690-000ae4eb705c req-57036f8d-48b9-4308-8066-939f55fa6a85 service neutron] 10.222.0.26 "GET /v2.0/networks/4ca58d86-8d4d-408b-8308-dfa9f89406f0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0827775 Nov 09 04:37:34.404781 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b0afdf04-9f34-4d0e-9690-000ae4eb705c req-acce315e-94a7-48ed-90ac-801615eaf55c service neutron] 10.222.0.26 "GET /v2.0/networks/4ca58d86-8d4d-408b-8308-dfa9f89406f0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0801282 Nov 09 04:37:34.868503 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eeb28b1d-1376-4095-bbb2-0f3ae788f366 req-523631dd-29e5-4664-a581-8244ca828697 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:37:34.869942 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-eeb28b1d-1376-4095-bbb2-0f3ae788f366 req-523631dd-29e5-4664-a581-8244ca828697 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=dd729d7d-d632-48e2-ad4b-7ce1cb65ee60 HTTP/1.1" status: 200 len: 944 time: 0.0478871 Nov 09 04:37:34.921076 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-eeb28b1d-1376-4095-bbb2-0f3ae788f366 req-b45f7a7e-f7fd-483b-ae76-541ff9006674 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=7150f69a-1583-405c-a9de-a6e7b0c1a2a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0452337 Nov 09 04:37:36.033313 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-992d07d8-3cfe-4b48-b9a2-4d097bbc23f9 req-1967c104-94e7-4b84-afa7-9f5856c4ac3b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:37:36.034796 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-992d07d8-3cfe-4b48-b9a2-4d097bbc23f9 req-1967c104-94e7-4b84-afa7-9f5856c4ac3b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=dd729d7d-d632-48e2-ad4b-7ce1cb65ee60 HTTP/1.1" status: 200 len: 944 time: 0.0475569 Nov 09 04:37:36.086190 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-992d07d8-3cfe-4b48-b9a2-4d097bbc23f9 req-8f04893a-1fa6-41e5-9337-eec22ba21957 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=7150f69a-1583-405c-a9de-a6e7b0c1a2a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0455360 Nov 09 04:37:37.020471 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 1f0f5130-353d-4b95-ab61-f19dec355529 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=102163) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 09 04:37:37.116714 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 1f0f5130-353d-4b95-ab61-f19dec355529, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=1f0f5130-353d-4b95-ab61-f19dec355529,segment=NetworkSegment(2ebee1f6-c165-461d-bb96-18710a0d5427),segment_id=2ebee1f6-c165-461d-bb96-18710a0d5427)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:37:37.128401 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Returning: {'device': '1f0f5130-353d-4b95-ab61-f19dec355529', 'network_id': '4ca58d86-8d4d-408b-8308-dfa9f89406f0', 'port_id': '1f0f5130-353d-4b95-ab61-f19dec355529', 'mac_address': 'fa:16:3e:11:2a:24', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 346, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '555b0d63-4eb8-45a4-a06a-bbcb72506fcd', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102163) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 09 04:37:37.164891 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:37.178064 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1f0f5130-353d-4b95-ab61-f19dec355529 {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:37:37.198045 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 1f0f5130-353d-4b95-ab61-f19dec355529, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=1f0f5130-353d-4b95-ab61-f19dec355529,segment=NetworkSegment(2ebee1f6-c165-461d-bb96-18710a0d5427),segment_id=2ebee1f6-c165-461d-bb96-18710a0d5427)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:37:37.200558 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a207c72-1c40-4c02-bd71-84637a5aaf70 req-32f136e5-6383-4189-a1b1-fcb3e09305cc tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:37:37.202040 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-4a207c72-1c40-4c02-bd71-84637a5aaf70 req-32f136e5-6383-4189-a1b1-fcb3e09305cc tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=dd729d7d-d632-48e2-ad4b-7ce1cb65ee60 HTTP/1.1" status: 200 len: 944 time: 0.0495620 Nov 09 04:37:37.251104 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-4a207c72-1c40-4c02-bd71-84637a5aaf70 req-bdac9716-6eb5-4be7-a453-ae7cd36529bb tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=7150f69a-1583-405c-a9de-a6e7b0c1a2a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431263 Nov 09 04:37:37.277770 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:37.324715 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=1f0f5130-353d-4b95-ab61-f19dec355529,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:37:37.331771 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:37:37.331896 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:37:37.332226 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:37:37.332577 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:37:37.332887 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:37:37.333216 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:37:37.333543 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:37:37.333872 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:37:37.334195 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:37:37.334544 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:37:37.334865 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:37:37.335182 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:37:37.495442 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['1f0f5130-353d-4b95-ab61-f19dec355529'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 04:37:38.361099 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47d0779b-c8a8-4a04-9c55-c3cda5ab30d5 req-bca9313e-e8dd-4704-93d5-34db364f33a7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:37:38.362646 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-47d0779b-c8a8-4a04-9c55-c3cda5ab30d5 req-bca9313e-e8dd-4704-93d5-34db364f33a7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=dd729d7d-d632-48e2-ad4b-7ce1cb65ee60 HTTP/1.1" status: 200 len: 945 time: 0.0475430 Nov 09 04:37:38.411231 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-47d0779b-c8a8-4a04-9c55-c3cda5ab30d5 req-518a08bf-4558-480b-a5d4-1347338fc6ec tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=7150f69a-1583-405c-a9de-a6e7b0c1a2a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427763 Nov 09 04:37:39.031438 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 1f0f5130-353d-4b95-ab61-f19dec355529 up at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:37:39.157139 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning for port 1f0f5130-353d-4b95-ab61-f19dec355529 completed by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 09 04:37:39.162313 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning complete for port 1f0f5130-353d-4b95-ab61-f19dec355529 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:37:39.165892 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:39.240081 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:39.261172 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'dd729d7d-d632-48e2-ad4b-7ce1cb65ee60', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1f0f5130-353d-4b95-ab61-f19dec355529'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:37:39.265140 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-06f5c74c-d445-464a-a0c4-8dbf8bdd3aff" -d '{"events": [{"server_uuid": "dd729d7d-d632-48e2-ad4b-7ce1cb65ee60", "name": "network-vif-plugged", "status": "completed", "tag": "1f0f5130-353d-4b95-ab61-f19dec355529"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:37:39.280468 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 1f0f5130-353d-4b95-ab61-f19dec355529, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=1f0f5130-353d-4b95-ab61-f19dec355529,segment=NetworkSegment(2ebee1f6-c165-461d-bb96-18710a0d5427),segment_id=2ebee1f6-c165-461d-bb96-18710a0d5427)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:37:39.299083 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:37:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-833be74a-b393-40e3-b027-cb4103386814 x-openstack-request-id: req-833be74a-b393-40e3-b027-cb4103386814 {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:37:39.299880 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "dd729d7d-d632-48e2-ad4b-7ce1cb65ee60", "name": "network-vif-plugged", "status": "completed", "tag": "1f0f5130-353d-4b95-ab61-f19dec355529", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:37:39.299880 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-833be74a-b393-40e3-b027-cb4103386814 {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:37:39.300107 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'dd729d7d-d632-48e2-ad4b-7ce1cb65ee60', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1f0f5130-353d-4b95-ab61-f19dec355529', 'code': 200} Nov 09 04:37:39.329876 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:39.377829 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=1f0f5130-353d-4b95-ab61-f19dec355529,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:37:39.526572 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad2694f2-8c26-4652-84a2-1d4bf5cbf53b req-6871badb-6760-429c-b9d0-23adf9b312e4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:37:39.528663 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ad2694f2-8c26-4652-84a2-1d4bf5cbf53b req-6871badb-6760-429c-b9d0-23adf9b312e4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=dd729d7d-d632-48e2-ad4b-7ce1cb65ee60 HTTP/1.1" status: 200 len: 946 time: 0.0493500 Nov 09 04:37:39.600388 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4097bb97-d954-485c-98ef-7ace9e871904 req-fa83af8b-3544-4abb-a282-6231863b8159 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:37:39.601745 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4097bb97-d954-485c-98ef-7ace9e871904 req-fa83af8b-3544-4abb-a282-6231863b8159 service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=dd729d7d-d632-48e2-ad4b-7ce1cb65ee60 HTTP/1.1" status: 200 len: 1099 time: 0.0722356 Nov 09 04:37:39.605907 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ad2694f2-8c26-4652-84a2-1d4bf5cbf53b req-3d91f87e-a2a6-4891-b4c6-801752308aa3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=7150f69a-1583-405c-a9de-a6e7b0c1a2a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0693491 Nov 09 04:37:39.648794 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4097bb97-d954-485c-98ef-7ace9e871904 req-a8ec01aa-e433-4478-aa1a-2d5f375b4efe service neutron] 10.222.0.26 "GET /v2.0/security-groups?id=7150f69a-1583-405c-a9de-a6e7b0c1a2a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0391333 Nov 09 04:37:40.721880 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-803514a1-ad9b-4a62-981f-2cb7ebfb0026 req-9ebad0c8-0b94-45c7-828b-7849e4572e71 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:37:40.723382 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-803514a1-ad9b-4a62-981f-2cb7ebfb0026 req-9ebad0c8-0b94-45c7-828b-7849e4572e71 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=dd729d7d-d632-48e2-ad4b-7ce1cb65ee60 HTTP/1.1" status: 200 len: 946 time: 0.0488613 Nov 09 04:37:40.772545 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-803514a1-ad9b-4a62-981f-2cb7ebfb0026 req-3f544b6c-eed4-4804-a4d6-f1336b50104a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=7150f69a-1583-405c-a9de-a6e7b0c1a2a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432427 Nov 09 04:37:41.328111 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f565c5c3-27ea-41a5-b89d-fc2c952cfc90 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:41.884106 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca724eaf-73fe-4e35-bf73-574f7540a5fb req-503ea14a-a421-418a-b057-93300bf8608f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:37:41.885590 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ca724eaf-73fe-4e35-bf73-574f7540a5fb req-503ea14a-a421-418a-b057-93300bf8608f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=dd729d7d-d632-48e2-ad4b-7ce1cb65ee60 HTTP/1.1" status: 200 len: 946 time: 0.0476041 Nov 09 04:37:41.934814 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ca724eaf-73fe-4e35-bf73-574f7540a5fb req-7085159d-0f89-4df2-a10f-0159d49fac82 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=7150f69a-1583-405c-a9de-a6e7b0c1a2a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426667 Nov 09 04:37:42.049248 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4a90729-2e39-4c0c-9899-6a7db6c6c047 req-a6735e4c-dddd-4361-80dc-e0d76b830373 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:37:42.050686 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f4a90729-2e39-4c0c-9899-6a7db6c6c047 req-a6735e4c-dddd-4361-80dc-e0d76b830373 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=dd729d7d-d632-48e2-ad4b-7ce1cb65ee60 HTTP/1.1" status: 200 len: 946 time: 0.0516794 Nov 09 04:37:42.099708 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f4a90729-2e39-4c0c-9899-6a7db6c6c047 req-fa376e88-655f-4eca-9f8d-a6dd595fcdfb tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=7150f69a-1583-405c-a9de-a6e7b0c1a2a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432100 Nov 09 04:37:42.121823 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 60010) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:37:42.128166 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:42.163859 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-735933db-6837-4c1d-a189-8b83d6d57abc tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:37:42.165330 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-735933db-6837-4c1d-a189-8b83d6d57abc tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/ports?device_id=dd729d7d-d632-48e2-ad4b-7ce1cb65ee60 HTTP/1.1" status: 200 len: 1094 time: 0.0424857 Nov 09 04:37:42.168712 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 60012) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:37:42.172991 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-4901801c-81e1-4546-84c2-bacf3cd88b97 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'floatingip': {'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'port_id': '1f0f5130-353d-4b95-ab61-f19dec355529', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ip_address': '172.20.0.10'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:37:42.253861 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4901801c-81e1-4546-84c2-bacf3cd88b97 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for floatingip, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:42.346446 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4901801c-81e1-4546-84c2-bacf3cd88b97 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:42.448196 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-4901801c-81e1-4546-84c2-bacf3cd88b97 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Allocated IP 172.26.0.65 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/71852c1d-2c17-4a8d-8cf8-3fca0a63af06) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:37:42.545375 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4901801c-81e1-4546-84c2-bacf3cd88b97 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:42.637235 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4901801c-81e1-4546-84c2-bacf3cd88b97 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:42.677735 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4901801c-81e1-4546-84c2-bacf3cd88b97 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:37:42.682605 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-4901801c-81e1-4546-84c2-bacf3cd88b97 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:37:42.686718 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4901801c-81e1-4546-84c2-bacf3cd88b97 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:37:42.692120 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4901801c-81e1-4546-84c2-bacf3cd88b97 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Port': ['ID=71852c1d-2c17-4a8d-8cf8-3fca0a63af06,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:37:43.064152 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4901801c-81e1-4546-84c2-bacf3cd88b97 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:43.185184 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4901801c-81e1-4546-84c2-bacf3cd88b97 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:43.619929 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4901801c-81e1-4546-84c2-bacf3cd88b97 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:43.674196 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-101e5079-3f2a-492b-b5b6-663054d151ae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:43.702842 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4901801c-81e1-4546-84c2-bacf3cd88b97 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:43.768270 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4901801c-81e1-4546-84c2-bacf3cd88b97 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Port': ['ID=71852c1d-2c17-4a8d-8cf8-3fca0a63af06,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:37:43.780502 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4901801c-81e1-4546-84c2-bacf3cd88b97 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:43.878232 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.l3_db [None req-4901801c-81e1-4546-84c2-bacf3cd88b97 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Floating IP 64273749-584c-4af7-8f7e-224624cdeec2 associated. External IP: 172.26.0.65, port: 1f0f5130-353d-4b95-ab61-f19dec355529. Nov 09 04:37:44.077509 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4901801c-81e1-4546-84c2-bacf3cd88b97 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Router b9fe8b76-742f-4072-b1f1-39a9dbe806a5 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:37:44.182673 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4901801c-81e1-4546-84c2-bacf3cd88b97 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:37:44.197048 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c7eec833-1ecd-4f8f-b7f0-c12266e5a3ef None None] Sync routers for ids ['b9fe8b76-742f-4072-b1f1-39a9dbe806a5'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:37:44.206898 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c7eec833-1ecd-4f8f-b7f0-c12266e5a3ef None None] Routers {'b9fe8b76-742f-4072-b1f1-39a9dbe806a5'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:37:44.207488 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-c7eec833-1ecd-4f8f-b7f0-c12266e5a3ef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:37:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['b9fe8b76-742f-4072-b1f1-39a9dbe806a5'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:37:44.256011 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4901801c-81e1-4546-84c2-bacf3cd88b97 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:44.283194 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-4901801c-81e1-4546-84c2-bacf3cd88b97 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.1134694 Nov 09 04:37:44.283892 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'dd729d7d-d632-48e2-ad4b-7ce1cb65ee60', 'tag': '1f0f5130-353d-4b95-ab61-f19dec355529'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:37:44.286124 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60014) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:37:44.286680 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-75784a61-1b00-43aa-910a-47ca1e60949b" -d '{"events": [{"name": "network-changed", "server_uuid": "dd729d7d-d632-48e2-ad4b-7ce1cb65ee60", "tag": "1f0f5130-353d-4b95-ab61-f19dec355529"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:37:44.313527 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-c7eec833-1ecd-4f8f-b7f0-c12266e5a3ef None None] Set router b9fe8b76-742f-4072-b1f1-39a9dbe806a5 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:37:44.322910 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:37:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-dae045cb-b7ba-4820-95c8-18dbfb8ad8ac x-openstack-request-id: req-dae045cb-b7ba-4820-95c8-18dbfb8ad8ac {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:37:44.323200 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "dd729d7d-d632-48e2-ad4b-7ce1cb65ee60", "tag": "1f0f5130-353d-4b95-ab61-f19dec355529", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:37:44.323589 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-dae045cb-b7ba-4820-95c8-18dbfb8ad8ac {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:37:44.324699 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'dd729d7d-d632-48e2-ad4b-7ce1cb65ee60', 'tag': '1f0f5130-353d-4b95-ab61-f19dec355529', 'status': 'completed', 'code': 200} Nov 09 04:37:44.351555 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-677062d4-c908-458a-b0c6-669c814e5e77 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/floatingips/64273749-584c-4af7-8f7e-224624cdeec2 HTTP/1.1" status: 200 len: 991 time: 0.0636909 Nov 09 04:37:44.388357 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75784a61-1b00-43aa-910a-47ca1e60949b req-dd554409-e448-4e53-b52c-576654b3acf7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:37:44.389952 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-75784a61-1b00-43aa-910a-47ca1e60949b req-dd554409-e448-4e53-b52c-576654b3acf7 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&device_id=dd729d7d-d632-48e2-ad4b-7ce1cb65ee60 HTTP/1.1" status: 200 len: 1099 time: 0.0405440 Nov 09 04:37:44.484498 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75784a61-1b00-43aa-910a-47ca1e60949b req-9424012c-5c42-45e5-b4a8-1c1b5b6d9ad9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:37:44.485897 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-75784a61-1b00-43aa-910a-47ca1e60949b req-9424012c-5c42-45e5-b4a8-1c1b5b6d9ad9 service neutron] 10.222.0.26 "GET /v2.0/networks?id=4ca58d86-8d4d-408b-8308-dfa9f89406f0 HTTP/1.1" status: 200 len: 897 time: 0.0882299 Nov 09 04:37:44.537926 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-c7eec833-1ecd-4f8f-b7f0-c12266e5a3ef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'name': 'tempest-TestNetworkBasicOps-router-473737147', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.35'}], 'enable_snat': True}, 'gw_port_id': '965ebc5f-0c00-46a9-aaf1-8ed04be937c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:37:20Z', 'updated_at': '2021-11-09T04:37:25Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '965ebc5f-0c00-46a9-aaf1-8ed04be937c6', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:d0:85:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1376, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:37:21Z', 'updated_at': '2021-11-09T04:37:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '64273749-584c-4af7-8f7e-224624cdeec2', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'floating_ip_address': '172.26.0.65', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'port_id': '1f0f5130-353d-4b95-ab61-f19dec355529', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 1391, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4ca58d86-8d4d-408b-8308-dfa9f89406f0', 'mac_address': 'fa:16:3e:11:2a:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd729d7d-d632-48e2-ad4b-7ce1cb65ee60', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:37:42Z', 'updated_at': '2021-11-09T04:37:42Z', 'revision_number': 0, 'project_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a294c982-9115-446d-9b80-0b74de52d18d', 'name': '', 'network_id': '4ca58d86-8d4d-408b-8308-dfa9f89406f0', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:6f:5c:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1379, 'fixed_ips': [{'subnet_id': '555b0d63-4eb8-45a4-a06a-bbcb72506fcd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:37:24Z', 'updated_at': '2021-11-09T04:37:27Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '555b0d63-4eb8-45a4-a06a-bbcb72506fcd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:37:44.551892 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-75784a61-1b00-43aa-910a-47ca1e60949b req-f24eb0b1-3365-4d25-8a20-162719c6db70 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=1f0f5130-353d-4b95-ab61-f19dec355529 HTTP/1.1" status: 200 len: 999 time: 0.0586169 Nov 09 04:37:44.564269 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c7eec833-1ecd-4f8f-b7f0-c12266e5a3ef None None] Checking router: b9fe8b76-742f-4072-b1f1-39a9dbe806a5 for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:37:44.572887 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c7eec833-1ecd-4f8f-b7f0-c12266e5a3ef None None] Routers {'b9fe8b76-742f-4072-b1f1-39a9dbe806a5'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:37:44.573491 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-c7eec833-1ecd-4f8f-b7f0-c12266e5a3ef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:37:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['b9fe8b76-742f-4072-b1f1-39a9dbe806a5'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:37:44.605358 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75784a61-1b00-43aa-910a-47ca1e60949b req-8c80552a-a73a-484c-892f-00b752ebe81d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:37:44.606882 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-75784a61-1b00-43aa-910a-47ca1e60949b req-8c80552a-a73a-484c-892f-00b752ebe81d service neutron] 10.222.0.26 "GET /v2.0/subnets?id=555b0d63-4eb8-45a4-a06a-bbcb72506fcd HTTP/1.1" status: 200 len: 835 time: 0.0475090 Nov 09 04:37:44.652286 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75784a61-1b00-43aa-910a-47ca1e60949b req-0c52f726-5a54-47a5-a145-db690bf6017a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:37:44.653795 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-75784a61-1b00-43aa-910a-47ca1e60949b req-0c52f726-5a54-47a5-a145-db690bf6017a service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=4ca58d86-8d4d-408b-8308-dfa9f89406f0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0398846 Nov 09 04:37:44.678970 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-c7eec833-1ecd-4f8f-b7f0-c12266e5a3ef None None] Set router b9fe8b76-742f-4072-b1f1-39a9dbe806a5 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:37:44.746040 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-75784a61-1b00-43aa-910a-47ca1e60949b req-eaea03d1-855b-4610-a8a1-31deab35fb24 service neutron] 10.222.0.26 "GET /v2.0/networks/4ca58d86-8d4d-408b-8308-dfa9f89406f0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0852444 Nov 09 04:37:44.835213 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-75784a61-1b00-43aa-910a-47ca1e60949b req-c92cecd8-ba1e-4019-bc25-5375fdcd88a3 service neutron] 10.222.0.26 "GET /v2.0/networks/4ca58d86-8d4d-408b-8308-dfa9f89406f0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0822566 Nov 09 04:37:44.903835 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-c7eec833-1ecd-4f8f-b7f0-c12266e5a3ef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'name': 'tempest-TestNetworkBasicOps-router-473737147', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.35'}], 'enable_snat': True}, 'gw_port_id': '965ebc5f-0c00-46a9-aaf1-8ed04be937c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:37:20Z', 'updated_at': '2021-11-09T04:37:25Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '965ebc5f-0c00-46a9-aaf1-8ed04be937c6', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:d0:85:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1376, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:37:21Z', 'updated_at': '2021-11-09T04:37:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '64273749-584c-4af7-8f7e-224624cdeec2', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'floating_ip_address': '172.26.0.65', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'port_id': '1f0f5130-353d-4b95-ab61-f19dec355529', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 1391, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4ca58d86-8d4d-408b-8308-dfa9f89406f0', 'mac_address': 'fa:16:3e:11:2a:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd729d7d-d632-48e2-ad4b-7ce1cb65ee60', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:37:42Z', 'updated_at': '2021-11-09T04:37:42Z', 'revision_number': 0, 'project_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a294c982-9115-446d-9b80-0b74de52d18d', 'name': '', 'network_id': '4ca58d86-8d4d-408b-8308-dfa9f89406f0', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:6f:5c:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1379, 'fixed_ips': [{'subnet_id': '555b0d63-4eb8-45a4-a06a-bbcb72506fcd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:37:24Z', 'updated_at': '2021-11-09T04:37:27Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '555b0d63-4eb8-45a4-a06a-bbcb72506fcd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:37:44.929023 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c7eec833-1ecd-4f8f-b7f0-c12266e5a3ef None None] The sync data for ids ['b9fe8b76-742f-4072-b1f1-39a9dbe806a5'] in dv-neutron-816802-2-hyperv is: [{'id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'name': 'tempest-TestNetworkBasicOps-router-473737147', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.35'}], 'enable_snat': True}, 'gw_port_id': '965ebc5f-0c00-46a9-aaf1-8ed04be937c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:37:20Z', 'updated_at': '2021-11-09T04:37:25Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '965ebc5f-0c00-46a9-aaf1-8ed04be937c6', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:d0:85:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1376, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:37:21Z', 'updated_at': '2021-11-09T04:37:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '64273749-584c-4af7-8f7e-224624cdeec2', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'floating_ip_address': '172.26.0.65', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'port_id': '1f0f5130-353d-4b95-ab61-f19dec355529', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 1391, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4ca58d86-8d4d-408b-8308-dfa9f89406f0', 'mac_address': 'fa:16:3e:11:2a:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd729d7d-d632-48e2-ad4b-7ce1cb65ee60', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:37:42Z', 'updated_at': '2021-11-09T04:37:42Z', 'revision_number': 0, 'project_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a294c982-9115-446d-9b80-0b74de52d18d', 'name': '', 'network_id': '4ca58d86-8d4d-408b-8308-dfa9f89406f0', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:6f:5c:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1379, 'fixed_ips': [{'subnet_id': '555b0d63-4eb8-45a4-a06a-bbcb72506fcd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:37:24Z', 'updated_at': '2021-11-09T04:37:27Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '555b0d63-4eb8-45a4-a06a-bbcb72506fcd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:37:45.082863 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:45.125238 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8b394bb2-df6f-4f38-93fe-dc3e07edd76a None None] New status for floating IP 64273749-584c-4af7-8f7e-224624cdeec2: ACTIVE {{(pid=102164) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 04:37:45.355896 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60018) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:37:45.421083 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-e71282ab-e298-42a6-a997-da286612fc17 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/floatingips/64273749-584c-4af7-8f7e-224624cdeec2 HTTP/1.1" status: 200 len: 991 time: 0.0640020 Nov 09 04:37:46.419574 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:37:46.424553 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60020) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:37:46.487576 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-8651bb63-02fb-4afd-adc1-b84fe984c254 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/floatingips/64273749-584c-4af7-8f7e-224624cdeec2 HTTP/1.1" status: 200 len: 993 time: 0.0619004 Nov 09 04:37:47.099358 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:09.471543 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:38:11.327329 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-62abf0af-eadd-4fb7-9d5f-26053b75da27 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:12.138174 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:13.718929 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-76b1437f-efac-488f-87a4-89cf69a31138 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:15.075728 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:15.636964 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 60034) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:38:15.709829 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8e4a3bf0-1f51-4bd5-9a2e-9a2b0f609942 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:15.710295 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8e4a3bf0-1f51-4bd5-9a2e-9a2b0f609942 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:15.710779 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8e4a3bf0-1f51-4bd5-9a2e-9a2b0f609942 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:15.712429 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-8e4a3bf0-1f51-4bd5-9a2e-9a2b0f609942 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/ports?project_id=1d10b4824e524068827e58b55e269af3&network_id=4ca58d86-8d4d-408b-8308-dfa9f89406f0 HTTP/1.1" status: 200 len: 3000 time: 0.0744951 Nov 09 04:38:16.423576 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:16.949840 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:17.871523 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 60044) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:38:17.923350 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9d18c425-f546-4642-9326-cdf395d75a71 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:17.924818 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-9d18c425-f546-4642-9326-cdf395d75a71 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/subnets?network_id=2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 HTTP/1.1" status: 200 len: 814 time: 0.0522132 Nov 09 04:38:18.482096 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60050) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:38:18.486657 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-55aaf6c7-21f0-4386-8a09-a6f9fb925f0a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'floatingip': {'port_id': None}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:38:18.545533 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-55aaf6c7-21f0-4386-8a09-a6f9fb925f0a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for floatingip, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:18.690093 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-55aaf6c7-21f0-4386-8a09-a6f9fb925f0a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:18.749689 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-55aaf6c7-21f0-4386-8a09-a6f9fb925f0a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:18.749958 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.l3_db [None req-55aaf6c7-21f0-4386-8a09-a6f9fb925f0a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Floating IP 64273749-584c-4af7-8f7e-224624cdeec2 disassociated. External IP: 172.26.0.65, port: 1f0f5130-353d-4b95-ab61-f19dec355529. Nov 09 04:38:18.954074 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-55aaf6c7-21f0-4386-8a09-a6f9fb925f0a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Router b9fe8b76-742f-4072-b1f1-39a9dbe806a5 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:38:19.128596 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-55aaf6c7-21f0-4386-8a09-a6f9fb925f0a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:38:19.133020 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-55aaf6c7-21f0-4386-8a09-a6f9fb925f0a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:19.138266 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-12cc502a-cf50-4e37-888b-6e5f551d149d None None] Sync routers for ids ['b9fe8b76-742f-4072-b1f1-39a9dbe806a5'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:38:19.147027 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-12cc502a-cf50-4e37-888b-6e5f551d149d None None] Routers {'b9fe8b76-742f-4072-b1f1-39a9dbe806a5'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:38:19.147626 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-12cc502a-cf50-4e37-888b-6e5f551d149d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:38:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['b9fe8b76-742f-4072-b1f1-39a9dbe806a5'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:38:19.159824 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-55aaf6c7-21f0-4386-8a09-a6f9fb925f0a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "PUT /v2.0/floatingips/64273749-584c-4af7-8f7e-224624cdeec2 HTTP/1.1" status: 200 len: 689 time: 0.6766398 Nov 09 04:38:19.160485 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'dd729d7d-d632-48e2-ad4b-7ce1cb65ee60', 'tag': '1f0f5130-353d-4b95-ab61-f19dec355529'}] {{(pid=102161) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:38:19.162817 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 60052) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:38:19.163349 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}99dfdda0def497b4372884ef2eb87f06b1e425c8eba5ceda5f64bbab037a07d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8695b66e-8a86-40c6-9310-c1b2cd017479" -d '{"events": [{"name": "network-changed", "server_uuid": "dd729d7d-d632-48e2-ad4b-7ce1cb65ee60", "tag": "1f0f5130-353d-4b95-ab61-f19dec355529"}]}' {{(pid=102161) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:38:19.200268 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:38:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4fc0e615-af51-4fb5-8dc2-85276dc16ef6 x-openstack-request-id: req-4fc0e615-af51-4fb5-8dc2-85276dc16ef6 {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:38:19.200549 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "dd729d7d-d632-48e2-ad4b-7ce1cb65ee60", "tag": "1f0f5130-353d-4b95-ab61-f19dec355529", "status": "completed", "code": 200}]} {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:38:19.200806 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-4fc0e615-af51-4fb5-8dc2-85276dc16ef6 {{(pid=102161) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:38:19.201214 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'dd729d7d-d632-48e2-ad4b-7ce1cb65ee60', 'tag': '1f0f5130-353d-4b95-ab61-f19dec355529', 'status': 'completed', 'code': 200} Nov 09 04:38:19.210122 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-5c1be7b7-529d-4951-8ae5-710f959798f2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/floatingips/64273749-584c-4af7-8f7e-224624cdeec2 HTTP/1.1" status: 200 len: 689 time: 0.0459619 Nov 09 04:38:19.271750 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8695b66e-8a86-40c6-9310-c1b2cd017479 req-c4427ec6-f345-4039-a583-9dd35e1218a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:19.273257 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8695b66e-8a86-40c6-9310-c1b2cd017479 req-c4427ec6-f345-4039-a583-9dd35e1218a7 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&device_id=dd729d7d-d632-48e2-ad4b-7ce1cb65ee60 HTTP/1.1" status: 200 len: 1099 time: 0.0489752 Nov 09 04:38:19.367854 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8695b66e-8a86-40c6-9310-c1b2cd017479 req-644f6908-2b06-4acd-a743-e5e1cc7222ed service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:19.369373 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8695b66e-8a86-40c6-9310-c1b2cd017479 req-644f6908-2b06-4acd-a743-e5e1cc7222ed service neutron] 10.222.0.26 "GET /v2.0/networks?id=4ca58d86-8d4d-408b-8308-dfa9f89406f0 HTTP/1.1" status: 200 len: 897 time: 0.0874503 Nov 09 04:38:19.398750 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-12cc502a-cf50-4e37-888b-6e5f551d149d None None] Set router b9fe8b76-742f-4072-b1f1-39a9dbe806a5 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:38:19.419226 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8695b66e-8a86-40c6-9310-c1b2cd017479 req-278bdc52-e1b6-4bb7-ab40-a782c99bdedb service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=1f0f5130-353d-4b95-ab61-f19dec355529 HTTP/1.1" status: 200 len: 217 time: 0.0420668 Nov 09 04:38:19.474149 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8695b66e-8a86-40c6-9310-c1b2cd017479 req-ba92a7e6-837f-4a41-95b6-f6cb7fa5c754 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:19.475659 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8695b66e-8a86-40c6-9310-c1b2cd017479 req-ba92a7e6-837f-4a41-95b6-f6cb7fa5c754 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=555b0d63-4eb8-45a4-a06a-bbcb72506fcd HTTP/1.1" status: 200 len: 835 time: 0.0503674 Nov 09 04:38:19.529725 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8695b66e-8a86-40c6-9310-c1b2cd017479 req-99863de2-9886-4ac9-be9b-632b2e71af88 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:19.531268 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8695b66e-8a86-40c6-9310-c1b2cd017479 req-99863de2-9886-4ac9-be9b-632b2e71af88 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=4ca58d86-8d4d-408b-8308-dfa9f89406f0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0482178 Nov 09 04:38:19.628898 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-12cc502a-cf50-4e37-888b-6e5f551d149d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'name': 'tempest-TestNetworkBasicOps-router-473737147', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.35'}], 'enable_snat': True}, 'gw_port_id': '965ebc5f-0c00-46a9-aaf1-8ed04be937c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:37:20Z', 'updated_at': '2021-11-09T04:37:25Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '965ebc5f-0c00-46a9-aaf1-8ed04be937c6', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:d0:85:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1376, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:37:21Z', 'updated_at': '2021-11-09T04:37:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'a294c982-9115-446d-9b80-0b74de52d18d', 'name': '', 'network_id': '4ca58d86-8d4d-408b-8308-dfa9f89406f0', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:6f:5c:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1379, 'fixed_ips': [{'subnet_id': '555b0d63-4eb8-45a4-a06a-bbcb72506fcd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:37:24Z', 'updated_at': '2021-11-09T04:37:27Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '555b0d63-4eb8-45a4-a06a-bbcb72506fcd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:38:19.631231 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8695b66e-8a86-40c6-9310-c1b2cd017479 req-091aab4c-f2e2-41c7-8909-d2b4eb6ff5cd service neutron] 10.222.0.26 "GET /v2.0/networks/4ca58d86-8d4d-408b-8308-dfa9f89406f0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0927145 Nov 09 04:38:19.660231 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-12cc502a-cf50-4e37-888b-6e5f551d149d None None] Checking router: b9fe8b76-742f-4072-b1f1-39a9dbe806a5 for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:38:19.668868 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-12cc502a-cf50-4e37-888b-6e5f551d149d None None] Routers {'b9fe8b76-742f-4072-b1f1-39a9dbe806a5'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:38:19.669479 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-12cc502a-cf50-4e37-888b-6e5f551d149d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:38:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['b9fe8b76-742f-4072-b1f1-39a9dbe806a5'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:38:19.727989 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8695b66e-8a86-40c6-9310-c1b2cd017479 req-d59b643e-e1c9-456a-abdb-fc00a510c074 service neutron] 10.222.0.26 "GET /v2.0/networks/4ca58d86-8d4d-408b-8308-dfa9f89406f0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0896745 Nov 09 04:38:19.776393 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-12cc502a-cf50-4e37-888b-6e5f551d149d None None] Set router b9fe8b76-742f-4072-b1f1-39a9dbe806a5 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:38:19.974786 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-12cc502a-cf50-4e37-888b-6e5f551d149d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'name': 'tempest-TestNetworkBasicOps-router-473737147', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.35'}], 'enable_snat': True}, 'gw_port_id': '965ebc5f-0c00-46a9-aaf1-8ed04be937c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:37:20Z', 'updated_at': '2021-11-09T04:37:25Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '965ebc5f-0c00-46a9-aaf1-8ed04be937c6', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:d0:85:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1376, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:37:21Z', 'updated_at': '2021-11-09T04:37:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'a294c982-9115-446d-9b80-0b74de52d18d', 'name': '', 'network_id': '4ca58d86-8d4d-408b-8308-dfa9f89406f0', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:6f:5c:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1379, 'fixed_ips': [{'subnet_id': '555b0d63-4eb8-45a4-a06a-bbcb72506fcd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:37:24Z', 'updated_at': '2021-11-09T04:37:27Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '555b0d63-4eb8-45a4-a06a-bbcb72506fcd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:38:20.001598 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-12cc502a-cf50-4e37-888b-6e5f551d149d None None] The sync data for ids ['b9fe8b76-742f-4072-b1f1-39a9dbe806a5'] in dv-neutron-816802-2-hyperv is: [{'id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'name': 'tempest-TestNetworkBasicOps-router-473737147', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.35'}], 'enable_snat': True}, 'gw_port_id': '965ebc5f-0c00-46a9-aaf1-8ed04be937c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:37:20Z', 'updated_at': '2021-11-09T04:37:25Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '965ebc5f-0c00-46a9-aaf1-8ed04be937c6', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:d0:85:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1376, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:37:21Z', 'updated_at': '2021-11-09T04:37:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'a294c982-9115-446d-9b80-0b74de52d18d', 'name': '', 'network_id': '4ca58d86-8d4d-408b-8308-dfa9f89406f0', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:6f:5c:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1379, 'fixed_ips': [{'subnet_id': '555b0d63-4eb8-45a4-a06a-bbcb72506fcd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:37:24Z', 'updated_at': '2021-11-09T04:37:27Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '555b0d63-4eb8-45a4-a06a-bbcb72506fcd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:38:20.214512 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 60056) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:38:20.227726 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e466daad-5c5a-4ac0-9208-fd2e4157f974 None None] New status for floating IP 64273749-584c-4af7-8f7e-224624cdeec2: DOWN {{(pid=102164) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 04:38:20.262870 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-807174be-a632-4cea-9da2-44b2d9dd0746 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/floatingips/64273749-584c-4af7-8f7e-224624cdeec2 HTTP/1.1" status: 200 len: 689 time: 0.0469267 Nov 09 04:38:21.267067 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60058) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:38:21.312998 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-501f94a5-8e2e-46fa-b2fb-686227edc9f2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/floatingips/64273749-584c-4af7-8f7e-224624cdeec2 HTTP/1.1" status: 200 len: 687 time: 0.0447383 Nov 09 04:38:22.581297 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60062) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:38:22.585858 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-3339bec7-934a-4ae0-805e-84fd6987cae4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-354338832', 'description': 'tempest-secgroup-smoke-354338832 description', 'project_id': '1d10b4824e524068827e58b55e269af3'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:38:22.681087 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3339bec7-934a-4ae0-805e-84fd6987cae4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:22.750288 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3339bec7-934a-4ae0-805e-84fd6987cae4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:22.824071 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3339bec7-934a-4ae0-805e-84fd6987cae4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:22.854944 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3339bec7-934a-4ae0-805e-84fd6987cae4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroup': ['ID=bb8c7272-b48f-4a58-8275-a888de0a12b0,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:38:22.937798 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3339bec7-934a-4ae0-805e-84fd6987cae4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:22.939105 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-3339bec7-934a-4ae0-805e-84fd6987cae4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.3568730 Nov 09 04:38:22.942029 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60064) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:38:22.946701 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-ef43f834-df1f-408a-a080-56e076e409f2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': 'bb8c7272-b48f-4a58-8275-a888de0a12b0', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:38:23.060534 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ef43f834-df1f-408a-a080-56e076e409f2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:23.114278 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ef43f834-df1f-408a-a080-56e076e409f2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:23.217958 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ef43f834-df1f-408a-a080-56e076e409f2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:23.236590 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef43f834-df1f-408a-a080-56e076e409f2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0458670f-e060-4f69-8856-574ddd812098,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:38:23.311586 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ef43f834-df1f-408a-a080-56e076e409f2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:23.312807 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-ef43f834-df1f-408a-a080-56e076e409f2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3698144 Nov 09 04:38:23.315709 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60066) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:38:23.320166 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-75215fbc-b407-4bfd-99e0-ad56b5d9ae58 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': 'bb8c7272-b48f-4a58-8275-a888de0a12b0', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:38:23.406219 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-75215fbc-b407-4bfd-99e0-ad56b5d9ae58 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:23.458225 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-75215fbc-b407-4bfd-99e0-ad56b5d9ae58 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:23.515059 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-75215fbc-b407-4bfd-99e0-ad56b5d9ae58 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:23.533214 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75215fbc-b407-4bfd-99e0-ad56b5d9ae58 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3c725931-a037-407a-9183-0e3b789475e5,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:38:23.603859 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-75215fbc-b407-4bfd-99e0-ad56b5d9ae58 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:23.605467 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-75215fbc-b407-4bfd-99e0-ad56b5d9ae58 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.2884007 Nov 09 04:38:23.607751 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60068) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:38:23.612162 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-b7ab85e2-4778-4333-952f-12a0eceefe4e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': 'bb8c7272-b48f-4a58-8275-a888de0a12b0', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:38:23.717686 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b7ab85e2-4778-4333-952f-12a0eceefe4e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:23.774207 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b7ab85e2-4778-4333-952f-12a0eceefe4e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:23.843736 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b7ab85e2-4778-4333-952f-12a0eceefe4e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:23.862228 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7ab85e2-4778-4333-952f-12a0eceefe4e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5d05b698-becc-421a-a173-5a993c37a56f,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:38:23.920261 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b7ab85e2-4778-4333-952f-12a0eceefe4e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:23.921490 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-b7ab85e2-4778-4333-952f-12a0eceefe4e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3126950 Nov 09 04:38:23.924219 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60070) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:38:23.928647 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-f5759cc2-d064-4e48-8a9d-edaac3eec180 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': 'bb8c7272-b48f-4a58-8275-a888de0a12b0', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:38:24.049223 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f5759cc2-d064-4e48-8a9d-edaac3eec180 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:24.107155 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f5759cc2-d064-4e48-8a9d-edaac3eec180 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:24.186936 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f5759cc2-d064-4e48-8a9d-edaac3eec180 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:24.204201 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5759cc2-d064-4e48-8a9d-edaac3eec180 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5e2c8250-ee91-4380-8127-fa96636c2629,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:38:24.252613 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f5759cc2-d064-4e48-8a9d-edaac3eec180 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:24.254099 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-f5759cc2-d064-4e48-8a9d-edaac3eec180 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3286588 Nov 09 04:38:24.256629 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60072) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:38:24.261035 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-5525dffb-f11d-417d-a93c-ecf2762bde92 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': 'bb8c7272-b48f-4a58-8275-a888de0a12b0', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:38:24.358350 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.securitygroups_db [None req-5525dffb-f11d-417d-a93c-ecf2762bde92 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Project 1d10b4824e524068827e58b55e269af3 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 09 04:38:24.363458 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5525dffb-f11d-417d-a93c-ecf2762bde92 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:24.422015 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5525dffb-f11d-417d-a93c-ecf2762bde92 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:24.497741 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5525dffb-f11d-417d-a93c-ecf2762bde92 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:24.514586 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5525dffb-f11d-417d-a93c-ecf2762bde92 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=300b5aab-79c7-41ed-93d1-8e99e6242aec,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:38:24.603082 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5525dffb-f11d-417d-a93c-ecf2762bde92 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:24.605438 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-5525dffb-f11d-417d-a93c-ecf2762bde92 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.3467584 Nov 09 04:38:24.607613 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60074) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:38:24.612048 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-d27b3b6a-4de4-4f58-a0c8-a5d46ec961e7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': 'bb8c7272-b48f-4a58-8275-a888de0a12b0', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:38:24.669510 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.securitygroups_db [None req-d27b3b6a-4de4-4f58-a0c8-a5d46ec961e7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Project 1d10b4824e524068827e58b55e269af3 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 09 04:38:24.674211 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d27b3b6a-4de4-4f58-a0c8-a5d46ec961e7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:24.734592 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d27b3b6a-4de4-4f58-a0c8-a5d46ec961e7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:24.772118 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d27b3b6a-4de4-4f58-a0c8-a5d46ec961e7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:24.789231 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d27b3b6a-4de4-4f58-a0c8-a5d46ec961e7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3fcd50f5-4282-49da-87c8-d48885c0d2e5,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:38:24.848672 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d27b3b6a-4de4-4f58-a0c8-a5d46ec961e7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:24.849935 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-d27b3b6a-4de4-4f58-a0c8-a5d46ec961e7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.2413764 Nov 09 04:38:24.999641 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-008ec477-ab65-4772-ae39-0b5f26f310d6 req-b7431e28-82be-4972-bfef-ae7effbd92dc tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-354338832&fields=id&tenant_id=1d10b4824e524068827e58b55e269af3 HTTP/1.1" status: 200 len: 267 time: 0.0443618 Nov 09 04:38:25.102746 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-008ec477-ab65-4772-ae39-0b5f26f310d6 req-13d3c1dd-a2bf-4121-95db-f4eafd1386cb tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:25.104189 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-008ec477-ab65-4772-ae39-0b5f26f310d6 req-13d3c1dd-a2bf-4121-95db-f4eafd1386cb tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/networks?id=4ca58d86-8d4d-408b-8308-dfa9f89406f0 HTTP/1.1" status: 200 len: 796 time: 0.0978291 Nov 09 04:38:25.120157 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-008ec477-ab65-4772-ae39-0b5f26f310d6 req-ba40d083-033c-4ef4-afb1-b8f0b2b28aa9 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/quotas/1d10b4824e524068827e58b55e269af3 HTTP/1.1" status: 200 len: 375 time: 0.0096278 Nov 09 04:38:25.179328 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-008ec477-ab65-4772-ae39-0b5f26f310d6 req-4f093b11-935f-4366-83b6-11adccade913 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&fields=id HTTP/1.1" status: 200 len: 394 time: 0.0532067 Nov 09 04:38:25.277796 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-008ec477-ab65-4772-ae39-0b5f26f310d6 req-75e52626-9294-46be-a23b-a32d9c5ad9e7 service neutron] 10.222.0.24 "GET /v2.0/networks/4ca58d86-8d4d-408b-8308-dfa9f89406f0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0863745 Nov 09 04:38:25.371488 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-008ec477-ab65-4772-ae39-0b5f26f310d6 req-efca2a2c-e485-4126-ac48-fbc21da12cbb service neutron] 10.222.0.24 "GET /v2.0/networks/4ca58d86-8d4d-408b-8308-dfa9f89406f0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0868816 Nov 09 04:38:25.606383 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-46475980-42ca-4c05-bb70-41632a251069 req-c03f3e21-ce29-4ed8-81c3-d899a1c58295 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=4ce7e684-ab7e-472a-9a8b-5af06f76e48d HTTP/1.1" status: 200 len: 210 time: 0.0275536 Nov 09 04:38:26.698772 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4566ccf0-926f-4eea-97a7-f4c88a2035d8 req-59abbd6b-9e78-4d51-9d7c-a3f56930e4cc tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=4ce7e684-ab7e-472a-9a8b-5af06f76e48d HTTP/1.1" status: 200 len: 210 time: 0.0259936 Nov 09 04:38:27.686311 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-008ec477-ab65-4772-ae39-0b5f26f310d6 req-7cd2c024-79f3-418d-a563-d7e8f331d478 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:27.687787 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-008ec477-ab65-4772-ae39-0b5f26f310d6 req-7cd2c024-79f3-418d-a563-d7e8f331d478 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "GET /v2.0/networks?id=4ca58d86-8d4d-408b-8308-dfa9f89406f0 HTTP/1.1" status: 200 len: 796 time: 0.1060658 Nov 09 04:38:27.769847 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-008ec477-ab65-4772-ae39-0b5f26f310d6 req-4f9580d2-adb1-4661-86bf-fb16c88f8603 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=1d10b4824e524068827e58b55e269af3 HTTP/1.1" status: 200 len: 472 time: 0.0724821 Nov 09 04:38:27.779666 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-008ec477-ab65-4772-ae39-0b5f26f310d6 req-4f9b226a-d154-460c-91fc-258a901114b3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'port': {'device_id': '4ce7e684-ab7e-472a-9a8b-5af06f76e48d', 'network_id': '4ca58d86-8d4d-408b-8308-dfa9f89406f0', 'admin_state_up': True, 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'security_groups': ['bb8c7272-b48f-4a58-8275-a888de0a12b0']}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:38:27.794371 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b92e1632-31f1-4cd7-b061-19199c14fe58 req-f5321578-b19b-426a-85b4-0b81f5333436 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=4ce7e684-ab7e-472a-9a8b-5af06f76e48d HTTP/1.1" status: 200 len: 210 time: 0.0262415 Nov 09 04:38:28.021020 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-008ec477-ab65-4772-ae39-0b5f26f310d6 req-4f9b226a-d154-460c-91fc-258a901114b3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Made reservation on behalf of 1d10b4824e524068827e58b55e269af3 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:38:28.026518 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-008ec477-ab65-4772-ae39-0b5f26f310d6 req-4f9b226a-d154-460c-91fc-258a901114b3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:28.154819 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [req-008ec477-ab65-4772-ae39-0b5f26f310d6 req-4f9b226a-d154-460c-91fc-258a901114b3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Allocated IP 172.20.0.7 (4ca58d86-8d4d-408b-8308-dfa9f89406f0/555b0d63-4eb8-45a4-a06a-bbcb72506fcd/e9035c2a-0c37-4cb2-a2db-bf779b1a4f49) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:38:28.292045 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-008ec477-ab65-4772-ae39-0b5f26f310d6 req-4f9b226a-d154-460c-91fc-258a901114b3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:28.378094 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-008ec477-ab65-4772-ae39-0b5f26f310d6 req-4f9b226a-d154-460c-91fc-258a901114b3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:28.419449 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-008ec477-ab65-4772-ae39-0b5f26f310d6 req-4f9b226a-d154-460c-91fc-258a901114b3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network 4ca58d86-8d4d-408b-8308-dfa9f89406f0 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:38:28.424938 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [req-008ec477-ab65-4772-ae39-0b5f26f310d6 req-4f9b226a-d154-460c-91fc-258a901114b3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:38:28.428615 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-008ec477-ab65-4772-ae39-0b5f26f310d6 req-4f9b226a-d154-460c-91fc-258a901114b3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:38:28.434874 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f9b226a-d154-460c-91fc-258a901114b3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Port': ['ID=e9035c2a-0c37-4cb2-a2db-bf779b1a4f49,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:38:28.462230 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f9b226a-d154-460c-91fc-258a901114b3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:38:28.462603 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f9b226a-d154-460c-91fc-258a901114b3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:38:28.462941 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f9b226a-d154-460c-91fc-258a901114b3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:38:28.463372 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f9b226a-d154-460c-91fc-258a901114b3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:38:28.463605 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f9b226a-d154-460c-91fc-258a901114b3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:38:28.463930 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f9b226a-d154-460c-91fc-258a901114b3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:38:28.464256 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f9b226a-d154-460c-91fc-258a901114b3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:38:28.464582 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f9b226a-d154-460c-91fc-258a901114b3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:38:28.464902 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f9b226a-d154-460c-91fc-258a901114b3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:38:28.465228 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f9b226a-d154-460c-91fc-258a901114b3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:38:28.465545 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f9b226a-d154-460c-91fc-258a901114b3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:38:28.465861 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f9b226a-d154-460c-91fc-258a901114b3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:38:28.491770 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-008ec477-ab65-4772-ae39-0b5f26f310d6 req-4f9b226a-d154-460c-91fc-258a901114b3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:28.492403 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-008ec477-ab65-4772-ae39-0b5f26f310d6 req-4f9b226a-d154-460c-91fc-258a901114b3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:28.563664 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-008ec477-ab65-4772-ae39-0b5f26f310d6 req-4f9b226a-d154-460c-91fc-258a901114b3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7880943 Nov 09 04:38:28.577332 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-008ec477-ab65-4772-ae39-0b5f26f310d6 req-854acfda-550d-40e4-abc9-881895aaed1b service neutron] Request body: {'port': {'device_id': '4ce7e684-ab7e-472a-9a8b-5af06f76e48d', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:38:28.634601 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-008ec477-ab65-4772-ae39-0b5f26f310d6 req-854acfda-550d-40e4-abc9-881895aaed1b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:28.663309 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-6e9454de-f16f-4b3c-bd09-08f9a1bf74c8 None None] Provisioning complete for port e9035c2a-0c37-4cb2-a2db-bf779b1a4f49 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:38:28.663877 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6e9454de-f16f-4b3c-bd09-08f9a1bf74c8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:28.697181 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-6e9454de-f16f-4b3c-bd09-08f9a1bf74c8 None None] Port e9035c2a-0c37-4cb2-a2db-bf779b1a4f49 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:38:28.917887 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [req-008ec477-ab65-4772-ae39-0b5f26f310d6 req-854acfda-550d-40e4-abc9-881895aaed1b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e9035c2a-0c37-4cb2-a2db-bf779b1a4f49 {{(pid=102162) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:38:28.926835 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-008ec477-ab65-4772-ae39-0b5f26f310d6 req-854acfda-550d-40e4-abc9-881895aaed1b service neutron] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:28.950642 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c150753-2d2f-4586-9285-d58263e9afbf req-cba47b2f-bf94-4f41-b402-99a86f77797b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:28.952685 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-0c150753-2d2f-4586-9285-d58263e9afbf req-cba47b2f-bf94-4f41-b402-99a86f77797b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=4ce7e684-ab7e-472a-9a8b-5af06f76e48d HTTP/1.1" status: 200 len: 931 time: 0.0895376 Nov 09 04:38:28.953597 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.provisioning_blocks [req-008ec477-ab65-4772-ae39-0b5f26f310d6 req-854acfda-550d-40e4-abc9-881895aaed1b service neutron] Transition to ACTIVE for port object e9035c2a-0c37-4cb2-a2db-bf779b1a4f49 will not be triggered until provisioned by entity L2. {{(pid=102162) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 09 04:38:29.004485 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-0c150753-2d2f-4586-9285-d58263e9afbf req-f13e0462-1895-4cef-b463-dffe6ec49663 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=bb8c7272-b48f-4a58-8275-a888de0a12b0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0457933 Nov 09 04:38:29.034721 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-008ec477-ab65-4772-ae39-0b5f26f310d6 req-854acfda-550d-40e4-abc9-881895aaed1b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:29.085575 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-854acfda-550d-40e4-abc9-881895aaed1b service neutron] Pushing event updated for resources: {'Port': ['ID=e9035c2a-0c37-4cb2-a2db-bf779b1a4f49,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:38:29.154980 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-008ec477-ab65-4772-ae39-0b5f26f310d6 req-854acfda-550d-40e4-abc9-881895aaed1b service neutron] Attempting to bind port e9035c2a-0c37-4cb2-a2db-bf779b1a4f49 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:38:29.155317 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-008ec477-ab65-4772-ae39-0b5f26f310d6 req-854acfda-550d-40e4-abc9-881895aaed1b service neutron] Attempting to bind port e9035c2a-0c37-4cb2-a2db-bf779b1a4f49 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '2ebee1f6-c165-461d-bb96-18710a0d5427', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 346, 'network_id': '4ca58d86-8d4d-408b-8308-dfa9f89406f0'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:38:29.155653 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-008ec477-ab65-4772-ae39-0b5f26f310d6 req-854acfda-550d-40e4-abc9-881895aaed1b service neutron] Attempting to bind port e9035c2a-0c37-4cb2-a2db-bf779b1a4f49 on network 4ca58d86-8d4d-408b-8308-dfa9f89406f0 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:38:29.160232 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-008ec477-ab65-4772-ae39-0b5f26f310d6 req-854acfda-550d-40e4-abc9-881895aaed1b service neutron] Port e9035c2a-0c37-4cb2-a2db-bf779b1a4f49 on network 4ca58d86-8d4d-408b-8308-dfa9f89406f0 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:38:29.160552 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-008ec477-ab65-4772-ae39-0b5f26f310d6 req-854acfda-550d-40e4-abc9-881895aaed1b service neutron] Attempting to bind port e9035c2a-0c37-4cb2-a2db-bf779b1a4f49 on network 4ca58d86-8d4d-408b-8308-dfa9f89406f0 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:38:29.165670 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-008ec477-ab65-4772-ae39-0b5f26f310d6 req-854acfda-550d-40e4-abc9-881895aaed1b service neutron] Checking agent: {'id': '7d36b884-4ad2-4878-9464-bf647030b544', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'started_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 38, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:38:29.166007 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-008ec477-ab65-4772-ae39-0b5f26f310d6 req-854acfda-550d-40e4-abc9-881895aaed1b service neutron] Checking segment: {'id': '2ebee1f6-c165-461d-bb96-18710a0d5427', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 346, 'network_id': '4ca58d86-8d4d-408b-8308-dfa9f89406f0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:38:29.166419 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-008ec477-ab65-4772-ae39-0b5f26f310d6 req-854acfda-550d-40e4-abc9-881895aaed1b service neutron] Bound using segment: {'id': '2ebee1f6-c165-461d-bb96-18710a0d5427', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 346, 'network_id': '4ca58d86-8d4d-408b-8308-dfa9f89406f0'} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:38:29.166849 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-008ec477-ab65-4772-ae39-0b5f26f310d6 req-854acfda-550d-40e4-abc9-881895aaed1b service neutron] Bound port: e9035c2a-0c37-4cb2-a2db-bf779b1a4f49, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2ebee1f6-c165-461d-bb96-18710a0d5427', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 346, 'network_id': '4ca58d86-8d4d-408b-8308-dfa9f89406f0'}}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:38:29.167207 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-008ec477-ab65-4772-ae39-0b5f26f310d6 req-854acfda-550d-40e4-abc9-881895aaed1b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:29.237150 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-008ec477-ab65-4772-ae39-0b5f26f310d6 req-854acfda-550d-40e4-abc9-881895aaed1b service neutron] For port e9035c2a-0c37-4cb2-a2db-bf779b1a4f49, host hv-neutron-8168, cleared binding levels {{(pid=102162) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:38:29.241150 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-008ec477-ab65-4772-ae39-0b5f26f310d6 req-854acfda-550d-40e4-abc9-881895aaed1b service neutron] For port e9035c2a-0c37-4cb2-a2db-bf779b1a4f49, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=e9035c2a-0c37-4cb2-a2db-bf779b1a4f49,segment=NetworkSegment(2ebee1f6-c165-461d-bb96-18710a0d5427),segment_id=2ebee1f6-c165-461d-bb96-18710a0d5427)] {{(pid=102162) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:38:29.310003 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-008ec477-ab65-4772-ae39-0b5f26f310d6 req-854acfda-550d-40e4-abc9-881895aaed1b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:29.345216 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-008ec477-ab65-4772-ae39-0b5f26f310d6 req-854acfda-550d-40e4-abc9-881895aaed1b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:29.345829 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-008ec477-ab65-4772-ae39-0b5f26f310d6 req-854acfda-550d-40e4-abc9-881895aaed1b service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:29.347238 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-008ec477-ab65-4772-ae39-0b5f26f310d6 req-854acfda-550d-40e4-abc9-881895aaed1b service neutron] 10.222.0.26 "PUT /v2.0/ports/e9035c2a-0c37-4cb2-a2db-bf779b1a4f49 HTTP/1.1" status: 200 len: 1093 time: 0.7750006 Nov 09 04:38:29.347674 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4ce7e684-ab7e-472a-9a8b-5af06f76e48d', 'tag': 'e9035c2a-0c37-4cb2-a2db-bf779b1a4f49'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:38:29.349899 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-85b326c2-b77f-4b41-979d-d23ddedf7b23" -d '{"events": [{"name": "network-changed", "server_uuid": "4ce7e684-ab7e-472a-9a8b-5af06f76e48d", "tag": "e9035c2a-0c37-4cb2-a2db-bf779b1a4f49"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:38:29.378640 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-854acfda-550d-40e4-abc9-881895aaed1b service neutron] Pushing event updated for resources: {'Port': ['ID=e9035c2a-0c37-4cb2-a2db-bf779b1a4f49,revision_number=3']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:38:29.394846 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:38:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-81da3bfa-ca0b-4047-9cd7-d0b49e54e70a x-openstack-request-id: req-81da3bfa-ca0b-4047-9cd7-d0b49e54e70a {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:38:29.395206 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4ce7e684-ab7e-472a-9a8b-5af06f76e48d", "tag": "e9035c2a-0c37-4cb2-a2db-bf779b1a4f49", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:38:29.395541 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-81da3bfa-ca0b-4047-9cd7-d0b49e54e70a {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:38:29.396079 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4ce7e684-ab7e-472a-9a8b-5af06f76e48d', 'tag': 'e9035c2a-0c37-4cb2-a2db-bf779b1a4f49', 'status': 'completed', 'code': 200} Nov 09 04:38:29.456825 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85b326c2-b77f-4b41-979d-d23ddedf7b23 req-6eec7b2d-b697-40e4-b1f0-3db0ed4c60b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:29.459020 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-85b326c2-b77f-4b41-979d-d23ddedf7b23 req-6eec7b2d-b697-40e4-b1f0-3db0ed4c60b5 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&device_id=4ce7e684-ab7e-472a-9a8b-5af06f76e48d HTTP/1.1" status: 200 len: 1096 time: 0.0439274 Nov 09 04:38:29.565710 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85b326c2-b77f-4b41-979d-d23ddedf7b23 req-71e4fbba-0dd9-4340-adb5-e41db220ced4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:29.567300 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-85b326c2-b77f-4b41-979d-d23ddedf7b23 req-71e4fbba-0dd9-4340-adb5-e41db220ced4 service neutron] 10.222.0.26 "GET /v2.0/networks?tenant_id=1d10b4824e524068827e58b55e269af3&shared=False HTTP/1.1" status: 200 len: 897 time: 0.0990472 Nov 09 04:38:29.666049 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85b326c2-b77f-4b41-979d-d23ddedf7b23 req-b823479a-ced5-4555-902d-1b42aab8c8b4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:29.667545 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-85b326c2-b77f-4b41-979d-d23ddedf7b23 req-b823479a-ced5-4555-902d-1b42aab8c8b4 service neutron] 10.222.0.26 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0930901 Nov 09 04:38:29.744440 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-008ec477-ab65-4772-ae39-0b5f26f310d6 req-16184003-cdc5-4886-a1ae-dd2a4768a0ca service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:29.746021 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-008ec477-ab65-4772-ae39-0b5f26f310d6 req-16184003-cdc5-4886-a1ae-dd2a4768a0ca service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&device_id=4ce7e684-ab7e-472a-9a8b-5af06f76e48d HTTP/1.1" status: 200 len: 1096 time: 0.0411675 Nov 09 04:38:29.789718 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-008ec477-ab65-4772-ae39-0b5f26f310d6 req-9e8b92e3-d80c-45ca-81c2-2dfa258d6601 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=e9035c2a-0c37-4cb2-a2db-bf779b1a4f49 HTTP/1.1" status: 200 len: 217 time: 0.0363109 Nov 09 04:38:29.836813 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-008ec477-ab65-4772-ae39-0b5f26f310d6 req-d45cfb9c-8e27-4d48-a65b-f9cce3931e18 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:29.838203 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-008ec477-ab65-4772-ae39-0b5f26f310d6 req-d45cfb9c-8e27-4d48-a65b-f9cce3931e18 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=555b0d63-4eb8-45a4-a06a-bbcb72506fcd HTTP/1.1" status: 200 len: 835 time: 0.0415583 Nov 09 04:38:29.883095 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-008ec477-ab65-4772-ae39-0b5f26f310d6 req-829dc988-3242-441d-adab-f64798f6ffc5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:29.884564 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-008ec477-ab65-4772-ae39-0b5f26f310d6 req-829dc988-3242-441d-adab-f64798f6ffc5 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=4ca58d86-8d4d-408b-8308-dfa9f89406f0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0389719 Nov 09 04:38:29.980401 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-008ec477-ab65-4772-ae39-0b5f26f310d6 req-b4da0731-a2c1-4094-b36e-9f3bbae13248 service neutron] 10.222.0.26 "GET /v2.0/networks/4ca58d86-8d4d-408b-8308-dfa9f89406f0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0872548 Nov 09 04:38:30.069378 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-008ec477-ab65-4772-ae39-0b5f26f310d6 req-921c4841-5324-4dad-9652-83a2adc994f5 service neutron] 10.222.0.26 "GET /v2.0/networks/4ca58d86-8d4d-408b-8308-dfa9f89406f0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0822206 Nov 09 04:38:30.236435 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-857bfca9-ece7-4661-bb08-01656d62ba70 req-96107748-24e4-4d2e-b5a8-0e5446f0df96 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:30.237829 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-857bfca9-ece7-4661-bb08-01656d62ba70 req-96107748-24e4-4d2e-b5a8-0e5446f0df96 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=4ce7e684-ab7e-472a-9a8b-5af06f76e48d HTTP/1.1" status: 200 len: 943 time: 0.0533078 Nov 09 04:38:30.287215 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-857bfca9-ece7-4661-bb08-01656d62ba70 req-35eec392-777b-451c-82dc-d5f00d47b856 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=bb8c7272-b48f-4a58-8275-a888de0a12b0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0434811 Nov 09 04:38:31.400918 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e79ef20-8814-43ed-94a4-b4e267684fe6 req-3eff0462-90e3-46fa-9611-5bfd9d4cdd7c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:31.402383 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-2e79ef20-8814-43ed-94a4-b4e267684fe6 req-3eff0462-90e3-46fa-9611-5bfd9d4cdd7c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=4ce7e684-ab7e-472a-9a8b-5af06f76e48d HTTP/1.1" status: 200 len: 943 time: 0.0482502 Nov 09 04:38:31.452080 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-2e79ef20-8814-43ed-94a4-b4e267684fe6 req-525054f3-1589-48df-8b0c-0837090b358f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=bb8c7272-b48f-4a58-8275-a888de0a12b0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0437789 Nov 09 04:38:32.111620 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07aa2c62-bbbe-434d-a1e6-f73097298be1 req-1e189f37-17c5-43e3-9d05-903b7da68cf1 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:32.113082 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-07aa2c62-bbbe-434d-a1e6-f73097298be1 req-1e189f37-17c5-43e3-9d05-903b7da68cf1 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=f0ae9486-80b5-43bd-acec-49f871c00e67 HTTP/1.1" status: 200 len: 945 time: 0.0533388 Nov 09 04:38:32.161025 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-07aa2c62-bbbe-434d-a1e6-f73097298be1 req-a4384156-5cc8-418f-9118-d6ad45da467f tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412555 Nov 09 04:38:32.565563 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26dcdb83-b150-44ce-928f-dac8eab3274d req-58ca4890-231f-4f0c-b94f-d9fb09f23c13 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:32.567090 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-26dcdb83-b150-44ce-928f-dac8eab3274d req-58ca4890-231f-4f0c-b94f-d9fb09f23c13 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=4ce7e684-ab7e-472a-9a8b-5af06f76e48d HTTP/1.1" status: 200 len: 943 time: 0.0478628 Nov 09 04:38:32.615973 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-26dcdb83-b150-44ce-928f-dac8eab3274d req-aab7b2b9-1b81-4b79-8d47-63f0f718a197 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=bb8c7272-b48f-4a58-8275-a888de0a12b0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0430076 Nov 09 04:38:33.275485 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31f982a3-8502-4b23-bc59-01b21243e21d req-08734b58-29a3-4674-b9a3-de920803cdaf tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:33.276971 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-31f982a3-8502-4b23-bc59-01b21243e21d req-08734b58-29a3-4674-b9a3-de920803cdaf tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=f0ae9486-80b5-43bd-acec-49f871c00e67 HTTP/1.1" status: 200 len: 945 time: 0.0498748 Nov 09 04:38:33.315946 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device e9035c2a-0c37-4cb2-a2db-bf779b1a4f49 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=102163) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 09 04:38:33.325651 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-31f982a3-8502-4b23-bc59-01b21243e21d req-7cf0ba47-b13e-4683-b810-6f3b8619f8e3 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428112 Nov 09 04:38:33.410453 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port e9035c2a-0c37-4cb2-a2db-bf779b1a4f49, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=e9035c2a-0c37-4cb2-a2db-bf779b1a4f49,segment=NetworkSegment(2ebee1f6-c165-461d-bb96-18710a0d5427),segment_id=2ebee1f6-c165-461d-bb96-18710a0d5427)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:38:33.421795 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Returning: {'device': 'e9035c2a-0c37-4cb2-a2db-bf779b1a4f49', 'network_id': '4ca58d86-8d4d-408b-8308-dfa9f89406f0', 'port_id': 'e9035c2a-0c37-4cb2-a2db-bf779b1a4f49', 'mac_address': 'fa:16:3e:33:24:c4', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 346, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '555b0d63-4eb8-45a4-a06a-bbcb72506fcd', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102163) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 09 04:38:33.456504 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:33.472896 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e9035c2a-0c37-4cb2-a2db-bf779b1a4f49 {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:38:33.492000 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port e9035c2a-0c37-4cb2-a2db-bf779b1a4f49, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=e9035c2a-0c37-4cb2-a2db-bf779b1a4f49,segment=NetworkSegment(2ebee1f6-c165-461d-bb96-18710a0d5427),segment_id=2ebee1f6-c165-461d-bb96-18710a0d5427)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:38:33.615056 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:33.628157 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-969eeb8b-ed5d-4481-ab4e-6998c113b558 req-38fb4a7e-4e8c-40e2-9cf2-08a096a5964e tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:33.635247 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-969eeb8b-ed5d-4481-ab4e-6998c113b558 req-38fb4a7e-4e8c-40e2-9cf2-08a096a5964e tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.26 "GET /v2.0/ports?device_id=f0ae9486-80b5-43bd-acec-49f871c00e67 HTTP/1.1" status: 200 len: 945 time: 0.0535877 Nov 09 04:38:33.661500 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=e9035c2a-0c37-4cb2-a2db-bf779b1a4f49,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:38:33.753327 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2da4d468-58d2-4e1d-81b1-12102a72adb7 req-6d479d9e-9321-4afc-8dfa-02f2710baa09 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:33.754726 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2da4d468-58d2-4e1d-81b1-12102a72adb7 req-6d479d9e-9321-4afc-8dfa-02f2710baa09 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=4ce7e684-ab7e-472a-9a8b-5af06f76e48d HTTP/1.1" status: 200 len: 944 time: 0.0604131 Nov 09 04:38:33.762135 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-969eeb8b-ed5d-4481-ab4e-6998c113b558 req-923d184f-5754-458f-a6f7-14848b2492ed tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Deleting port d4753771-ff46-428e-9ad0-3dce1a15a45f {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:38:33.762496 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-969eeb8b-ed5d-4481-ab4e-6998c113b558 req-923d184f-5754-458f-a6f7-14848b2492ed tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:33.819515 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['e9035c2a-0c37-4cb2-a2db-bf779b1a4f49'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 04:38:33.863232 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2da4d468-58d2-4e1d-81b1-12102a72adb7 req-460e5222-f03d-4772-9032-723ce85f33b3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=bb8c7272-b48f-4a58-8275-a888de0a12b0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0977404 Nov 09 04:38:33.892765 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-969eeb8b-ed5d-4481-ab4e-6998c113b558 req-923d184f-5754-458f-a6f7-14848b2492ed tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] For port d4753771-ff46-428e-9ad0-3dce1a15a45f, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=d4753771-ff46-428e-9ad0-3dce1a15a45f,segment=NetworkSegment(bc4577c9-06a5-450a-9c80-879827986f04),segment_id=bc4577c9-06a5-450a-9c80-879827986f04)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:38:33.893212 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-969eeb8b-ed5d-4481-ab4e-6998c113b558 req-923d184f-5754-458f-a6f7-14848b2492ed tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:34.061339 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-969eeb8b-ed5d-4481-ab4e-6998c113b558 req-923d184f-5754-458f-a6f7-14848b2492ed tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:34.061693 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-969eeb8b-ed5d-4481-ab4e-6998c113b558 req-923d184f-5754-458f-a6f7-14848b2492ed tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:34.062006 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.l3_db [req-969eeb8b-ed5d-4481-ab4e-6998c113b558 req-923d184f-5754-458f-a6f7-14848b2492ed tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Floating IP cb72ed5d-dc68-4e13-9938-c58a0418642e disassociated. External IP: 172.26.0.190, port: d4753771-ff46-428e-9ad0-3dce1a15a45f. Nov 09 04:38:34.062342 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-969eeb8b-ed5d-4481-ab4e-6998c113b558 req-923d184f-5754-458f-a6f7-14848b2492ed tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Calling delete_port for d4753771-ff46-428e-9ad0-3dce1a15a45f owned by compute:nova {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:38:34.240319 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-969eeb8b-ed5d-4481-ab4e-6998c113b558 req-923d184f-5754-458f-a6f7-14848b2492ed tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:34.268840 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-923d184f-5754-458f-a6f7-14848b2492ed tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Pushing event deleted for resources: {'Port': ['ID=d4753771-ff46-428e-9ad0-3dce1a15a45f,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:38:34.385918 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [req-969eeb8b-ed5d-4481-ab4e-6998c113b558 req-923d184f-5754-458f-a6f7-14848b2492ed tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Router 203a01a6-369d-4e73-a6d0-b0605f8d5a6a has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:38:34.423583 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-1fa04283-a333-4dbe-b856-8480962c9137 req-8c43c2c9-01dd-4d61-99dd-eda96bce9bd9 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=f0ae9486-80b5-43bd-acec-49f871c00e67 HTTP/1.1" status: 200 len: 210 time: 0.0251439 Nov 09 04:38:34.490939 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-969eeb8b-ed5d-4481-ab4e-6998c113b558 req-923d184f-5754-458f-a6f7-14848b2492ed tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:38:34.500898 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6bb78dcf-72e7-42a9-82bf-6d0ba08aae28 None None] Sync routers for ids ['203a01a6-369d-4e73-a6d0-b0605f8d5a6a'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:38:34.510248 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6bb78dcf-72e7-42a9-82bf-6d0ba08aae28 None None] Routers {'203a01a6-369d-4e73-a6d0-b0605f8d5a6a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:38:34.510896 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-6bb78dcf-72e7-42a9-82bf-6d0ba08aae28 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:38:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['203a01a6-369d-4e73-a6d0-b0605f8d5a6a'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:38:34.529790 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-969eeb8b-ed5d-4481-ab4e-6998c113b558 req-923d184f-5754-458f-a6f7-14848b2492ed tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] No DVR routers for this DVR port d4753771-ff46-428e-9ad0-3dce1a15a45f on host hv-neutron-8168 {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:38:34.532321 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-969eeb8b-ed5d-4481-ab4e-6998c113b558 req-923d184f-5754-458f-a6f7-14848b2492ed tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:34.535632 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-969eeb8b-ed5d-4481-ab4e-6998c113b558 req-923d184f-5754-458f-a6f7-14848b2492ed tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.26 "DELETE /v2.0/ports/d4753771-ff46-428e-9ad0-3dce1a15a45f HTTP/1.1" status: 204 len: 173 time: 0.8998420 Nov 09 04:38:34.536115 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f0ae9486-80b5-43bd-acec-49f871c00e67', 'name': 'network-vif-deleted', 'tag': 'd4753771-ff46-428e-9ad0-3dce1a15a45f'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:38:34.538296 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a1ed7748-8a74-40c1-904c-e70242a0a929" -d '{"events": [{"server_uuid": "f0ae9486-80b5-43bd-acec-49f871c00e67", "name": "network-vif-deleted", "tag": "d4753771-ff46-428e-9ad0-3dce1a15a45f"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:38:34.573764 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:38:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8c642235-20cd-4c4d-8dfc-177c59d6a90a x-openstack-request-id: req-8c642235-20cd-4c4d-8dfc-177c59d6a90a {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:38:34.574114 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f0ae9486-80b5-43bd-acec-49f871c00e67", "name": "network-vif-deleted", "tag": "d4753771-ff46-428e-9ad0-3dce1a15a45f", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:38:34.574300 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-8c642235-20cd-4c4d-8dfc-177c59d6a90a {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:38:34.574732 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f0ae9486-80b5-43bd-acec-49f871c00e67', 'name': 'network-vif-deleted', 'tag': 'd4753771-ff46-428e-9ad0-3dce1a15a45f', 'status': 'completed', 'code': 200} Nov 09 04:38:34.621460 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-6bb78dcf-72e7-42a9-82bf-6d0ba08aae28 None None] Set router 203a01a6-369d-4e73-a6d0-b0605f8d5a6a gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:38:34.828038 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-6bb78dcf-72e7-42a9-82bf-6d0ba08aae28 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'name': 'tempest-TestVolumeBootPattern-1675179943-router', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.164'}], 'enable_snat': True}, 'gw_port_id': '873960f9-e8b5-48a6-a119-47c32f5b7968', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:34:33Z', 'updated_at': '2021-11-09T04:34:38Z', 'revision_number': 4, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'gw_port': {'id': '873960f9-e8b5-48a6-a119-47c32f5b7968', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:95:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1097, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.164', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:34:34Z', 'updated_at': '2021-11-09T04:34:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'a5f1e54d-1d98-4741-a1ce-59f4cfb5b332', 'name': '', 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'mac_address': 'fa:16:3e:de:ab:2f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1107, 'fixed_ips': [{'subnet_id': 'f6a08667-654b-4e0c-9f85-c6e6712cc239', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:34:37Z', 'updated_at': '2021-11-09T04:34:46Z', 'revision_number': 5, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'subnets': [{'id': 'f6a08667-654b-4e0c-9f85-c6e6712cc239', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:38:34.857519 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6bb78dcf-72e7-42a9-82bf-6d0ba08aae28 None None] Checking router: 203a01a6-369d-4e73-a6d0-b0605f8d5a6a for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:38:34.865603 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6bb78dcf-72e7-42a9-82bf-6d0ba08aae28 None None] Routers {'203a01a6-369d-4e73-a6d0-b0605f8d5a6a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:38:34.866193 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-6bb78dcf-72e7-42a9-82bf-6d0ba08aae28 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:38:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['203a01a6-369d-4e73-a6d0-b0605f8d5a6a'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:38:34.975016 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-6bb78dcf-72e7-42a9-82bf-6d0ba08aae28 None None] Set router 203a01a6-369d-4e73-a6d0-b0605f8d5a6a gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:38:34.986986 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-206d8435-5e23-46c8-8d4e-4f6a78889497 req-8defcd56-8f21-41a5-9eed-6c680c37f649 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:34.988629 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-206d8435-5e23-46c8-8d4e-4f6a78889497 req-8defcd56-8f21-41a5-9eed-6c680c37f649 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=4ce7e684-ab7e-472a-9a8b-5af06f76e48d HTTP/1.1" status: 200 len: 944 time: 0.0563049 Nov 09 04:38:35.039512 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-206d8435-5e23-46c8-8d4e-4f6a78889497 req-afc075ee-0de3-4634-8e38-70a0ed9c1ee3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=bb8c7272-b48f-4a58-8275-a888de0a12b0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0450754 Nov 09 04:38:35.169071 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-6bb78dcf-72e7-42a9-82bf-6d0ba08aae28 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'name': 'tempest-TestVolumeBootPattern-1675179943-router', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.164'}], 'enable_snat': True}, 'gw_port_id': '873960f9-e8b5-48a6-a119-47c32f5b7968', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:34:33Z', 'updated_at': '2021-11-09T04:34:38Z', 'revision_number': 4, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'gw_port': {'id': '873960f9-e8b5-48a6-a119-47c32f5b7968', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:95:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1097, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.164', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:34:34Z', 'updated_at': '2021-11-09T04:34:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'a5f1e54d-1d98-4741-a1ce-59f4cfb5b332', 'name': '', 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'mac_address': 'fa:16:3e:de:ab:2f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1107, 'fixed_ips': [{'subnet_id': 'f6a08667-654b-4e0c-9f85-c6e6712cc239', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:34:37Z', 'updated_at': '2021-11-09T04:34:46Z', 'revision_number': 5, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'subnets': [{'id': 'f6a08667-654b-4e0c-9f85-c6e6712cc239', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:38:35.194263 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6bb78dcf-72e7-42a9-82bf-6d0ba08aae28 None None] The sync data for ids ['203a01a6-369d-4e73-a6d0-b0605f8d5a6a'] in dv-neutron-816802-2-hyperv is: [{'id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'name': 'tempest-TestVolumeBootPattern-1675179943-router', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.164'}], 'enable_snat': True}, 'gw_port_id': '873960f9-e8b5-48a6-a119-47c32f5b7968', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:34:33Z', 'updated_at': '2021-11-09T04:34:38Z', 'revision_number': 4, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'gw_port': {'id': '873960f9-e8b5-48a6-a119-47c32f5b7968', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:95:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1097, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.164', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:34:34Z', 'updated_at': '2021-11-09T04:34:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'a5f1e54d-1d98-4741-a1ce-59f4cfb5b332', 'name': '', 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'mac_address': 'fa:16:3e:de:ab:2f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1107, 'fixed_ips': [{'subnet_id': 'f6a08667-654b-4e0c-9f85-c6e6712cc239', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:34:37Z', 'updated_at': '2021-11-09T04:34:46Z', 'revision_number': 5, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'subnets': [{'id': 'f6a08667-654b-4e0c-9f85-c6e6712cc239', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:38:35.333660 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device e9035c2a-0c37-4cb2-a2db-bf779b1a4f49 up at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:38:35.424404 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6706c964-1a01-4e3f-8974-4294ac2aff5f None None] New status for floating IP cb72ed5d-dc68-4e13-9938-c58a0418642e: DOWN {{(pid=102164) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 04:38:35.462235 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning for port e9035c2a-0c37-4cb2-a2db-bf779b1a4f49 completed by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 09 04:38:35.465107 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning complete for port e9035c2a-0c37-4cb2-a2db-bf779b1a4f49 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:38:35.465479 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:35.563544 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:35.568795 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c1552718-6931-49c1-bcbd-b8da9f93c0aa req-5957a128-7036-4c9a-839d-38f86464ef0d tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=f0ae9486-80b5-43bd-acec-49f871c00e67 HTTP/1.1" status: 200 len: 210 time: 0.0402815 Nov 09 04:38:35.588756 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4ce7e684-ab7e-472a-9a8b-5af06f76e48d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e9035c2a-0c37-4cb2-a2db-bf779b1a4f49'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:38:35.591128 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a33add7f-7189-419b-a9ad-57885bdbcfe6" -d '{"events": [{"server_uuid": "4ce7e684-ab7e-472a-9a8b-5af06f76e48d", "name": "network-vif-plugged", "status": "completed", "tag": "e9035c2a-0c37-4cb2-a2db-bf779b1a4f49"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:38:35.618422 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port e9035c2a-0c37-4cb2-a2db-bf779b1a4f49, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=e9035c2a-0c37-4cb2-a2db-bf779b1a4f49,segment=NetworkSegment(2ebee1f6-c165-461d-bb96-18710a0d5427),segment_id=2ebee1f6-c165-461d-bb96-18710a0d5427)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:38:35.632206 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:38:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5d8c5b88-f4f6-4efb-9551-32b66966b045 x-openstack-request-id: req-5d8c5b88-f4f6-4efb-9551-32b66966b045 {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:38:35.632499 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4ce7e684-ab7e-472a-9a8b-5af06f76e48d", "name": "network-vif-plugged", "status": "completed", "tag": "e9035c2a-0c37-4cb2-a2db-bf779b1a4f49", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:38:35.632762 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-5d8c5b88-f4f6-4efb-9551-32b66966b045 {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:38:35.633315 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4ce7e684-ab7e-472a-9a8b-5af06f76e48d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e9035c2a-0c37-4cb2-a2db-bf779b1a4f49', 'code': 200} Nov 09 04:38:35.672279 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:35.723715 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=e9035c2a-0c37-4cb2-a2db-bf779b1a4f49,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:38:35.905402 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03349222-993b-456d-843b-4a739e63619f req-2cc90acd-addb-4f7d-97f3-54c397cbad68 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:35.907015 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-03349222-993b-456d-843b-4a739e63619f req-2cc90acd-addb-4f7d-97f3-54c397cbad68 service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=4ce7e684-ab7e-472a-9a8b-5af06f76e48d HTTP/1.1" status: 200 len: 1098 time: 0.0409005 Nov 09 04:38:35.954518 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-03349222-993b-456d-843b-4a739e63619f req-0cc42091-dc43-4b3d-ac80-5323ad3d63db service neutron] 10.222.0.26 "GET /v2.0/security-groups?id=bb8c7272-b48f-4a58-8275-a888de0a12b0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0402176 Nov 09 04:38:36.152166 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5558271e-11d2-4d68-b966-d5c0b1863e38 req-561d7808-0640-456f-93de-5bbb13ffe0eb tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:36.153631 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5558271e-11d2-4d68-b966-d5c0b1863e38 req-561d7808-0640-456f-93de-5bbb13ffe0eb tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=4ce7e684-ab7e-472a-9a8b-5af06f76e48d HTTP/1.1" status: 200 len: 945 time: 0.0486305 Nov 09 04:38:36.203264 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5558271e-11d2-4d68-b966-d5c0b1863e38 req-1dfbf990-b595-4352-ab37-5bcb92c5389f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=bb8c7272-b48f-4a58-8275-a888de0a12b0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0433288 Nov 09 04:38:36.655913 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-572523f8-a874-43a6-b66e-d3911eba6fff req-e57607cc-dbad-4f8b-b42e-a75d7d69d520 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=f0ae9486-80b5-43bd-acec-49f871c00e67 HTTP/1.1" status: 200 len: 210 time: 0.0261979 Nov 09 04:38:37.324715 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62e0a351-5798-4049-92fd-a5df5e6202f5 req-e99e707c-4551-40d5-9ecb-8a136ea6f3be tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:37.326194 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-62e0a351-5798-4049-92fd-a5df5e6202f5 req-e99e707c-4551-40d5-9ecb-8a136ea6f3be tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=4ce7e684-ab7e-472a-9a8b-5af06f76e48d HTTP/1.1" status: 200 len: 945 time: 0.0519795 Nov 09 04:38:37.362508 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device d4753771-ff46-428e-9ad0-3dce1a15a45f no longer exists at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:38:37.376306 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-62e0a351-5798-4049-92fd-a5df5e6202f5 req-b15e0eeb-ef75-4b0e-9bcf-dd8469555775 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=bb8c7272-b48f-4a58-8275-a888de0a12b0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0439022 Nov 09 04:38:37.382057 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] No Port match for: d4753771-ff46-428e-9ad0-3dce1a15a45f {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:38:37.382653 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device d4753771-ff46-428e-9ad0-3dce1a15a45f not bound to the agent host hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:38:37.489928 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71dd03c1-d753-4d73-b9ff-6c1ce6284bfc req-360866e1-2b64-4938-91f6-46ba1f280744 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:37.491411 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-71dd03c1-d753-4d73-b9ff-6c1ce6284bfc req-360866e1-2b64-4938-91f6-46ba1f280744 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=4ce7e684-ab7e-472a-9a8b-5af06f76e48d HTTP/1.1" status: 200 len: 945 time: 0.0481865 Nov 09 04:38:37.541496 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-71dd03c1-d753-4d73-b9ff-6c1ce6284bfc req-8deca806-22ed-4d90-adb4-8db7e8a60c81 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=bb8c7272-b48f-4a58-8275-a888de0a12b0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0433912 Nov 09 04:38:37.563949 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 60146) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:38:37.767971 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f1558804-62bc-43c7-a500-fef4f9d25f73 req-a7bfa2f1-fd9e-4b06-b663-19f23f27a748 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=f0ae9486-80b5-43bd-acec-49f871c00e67 HTTP/1.1" status: 200 len: 210 time: 0.0383661 Nov 09 04:38:37.780829 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5aea0d8c-a8e5-49d2-98d6-fc7fc0315cd0 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:37.785279 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-5aea0d8c-a8e5-49d2-98d6-fc7fc0315cd0 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/ports?device_id=4ce7e684-ab7e-472a-9a8b-5af06f76e48d HTTP/1.1" status: 200 len: 1093 time: 0.2174718 Nov 09 04:38:37.785657 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60152) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:38:37.790351 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-972ca48f-652c-4f04-99a4-ec35982ce7be tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'floatingip': {'port_id': 'e9035c2a-0c37-4cb2-a2db-bf779b1a4f49'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:38:37.833995 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-972ca48f-652c-4f04-99a4-ec35982ce7be tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for floatingip, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:38.269298 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-972ca48f-652c-4f04-99a4-ec35982ce7be tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:38.343415 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-972ca48f-652c-4f04-99a4-ec35982ce7be tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:38.443669 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.l3_db [None req-972ca48f-652c-4f04-99a4-ec35982ce7be tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Floating IP 64273749-584c-4af7-8f7e-224624cdeec2 associated. External IP: 172.26.0.65, port: e9035c2a-0c37-4cb2-a2db-bf779b1a4f49. Nov 09 04:38:38.649272 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-972ca48f-652c-4f04-99a4-ec35982ce7be tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Router b9fe8b76-742f-4072-b1f1-39a9dbe806a5 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:38:39.004011 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f7dd6f7e-c0c8-461a-b14f-8974c2f86567 req-5b08ce5d-de09-4113-9414-a0a9d38a1c4a tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=f0ae9486-80b5-43bd-acec-49f871c00e67 HTTP/1.1" status: 200 len: 210 time: 0.0323954 Nov 09 04:38:39.014944 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-972ca48f-652c-4f04-99a4-ec35982ce7be tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:38:39.019861 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-972ca48f-652c-4f04-99a4-ec35982ce7be tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:39.027437 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-62cbe81c-6513-4616-9144-54ac63da2ba9 None None] Sync routers for ids ['b9fe8b76-742f-4072-b1f1-39a9dbe806a5'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:38:39.041007 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-62cbe81c-6513-4616-9144-54ac63da2ba9 None None] Routers {'b9fe8b76-742f-4072-b1f1-39a9dbe806a5'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:38:39.041639 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-62cbe81c-6513-4616-9144-54ac63da2ba9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:38:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['b9fe8b76-742f-4072-b1f1-39a9dbe806a5'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:38:39.051722 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-972ca48f-652c-4f04-99a4-ec35982ce7be tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "PUT /v2.0/floatingips/64273749-584c-4af7-8f7e-224624cdeec2 HTTP/1.1" status: 200 len: 990 time: 1.2648287 Nov 09 04:38:39.056797 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4ce7e684-ab7e-472a-9a8b-5af06f76e48d', 'tag': 'e9035c2a-0c37-4cb2-a2db-bf779b1a4f49'}] {{(pid=102161) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:38:39.056797 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}99dfdda0def497b4372884ef2eb87f06b1e425c8eba5ceda5f64bbab037a07d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9d96c42a-3ef5-45fd-a6ad-a6e260653867" -d '{"events": [{"name": "network-changed", "server_uuid": "4ce7e684-ab7e-472a-9a8b-5af06f76e48d", "tag": "e9035c2a-0c37-4cb2-a2db-bf779b1a4f49"}]}' {{(pid=102161) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:38:39.058913 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 60158) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:38:39.092521 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:38:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a3b6fb63-a7cd-45c7-9caa-d26a28113ae7 x-openstack-request-id: req-a3b6fb63-a7cd-45c7-9caa-d26a28113ae7 {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:38:39.092903 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4ce7e684-ab7e-472a-9a8b-5af06f76e48d", "tag": "e9035c2a-0c37-4cb2-a2db-bf779b1a4f49", "status": "completed", "code": 200}]} {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:38:39.093227 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-a3b6fb63-a7cd-45c7-9caa-d26a28113ae7 {{(pid=102161) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:38:39.093734 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4ce7e684-ab7e-472a-9a8b-5af06f76e48d', 'tag': 'e9035c2a-0c37-4cb2-a2db-bf779b1a4f49', 'status': 'completed', 'code': 200} Nov 09 04:38:39.169590 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-8f6a5877-9c46-4537-bb69-bba227b96644 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/floatingips/64273749-584c-4af7-8f7e-224624cdeec2 HTTP/1.1" status: 200 len: 990 time: 0.1087685 Nov 09 04:38:39.180149 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d96c42a-3ef5-45fd-a6ad-a6e260653867 req-c541d7eb-0c15-4b51-aec6-0d778ec21cfc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:39.182628 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9d96c42a-3ef5-45fd-a6ad-a6e260653867 req-c541d7eb-0c15-4b51-aec6-0d778ec21cfc service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&device_id=4ce7e684-ab7e-472a-9a8b-5af06f76e48d HTTP/1.1" status: 200 len: 1098 time: 0.0639000 Nov 09 04:38:39.287950 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d96c42a-3ef5-45fd-a6ad-a6e260653867 req-62681023-cebd-4fac-ac09-47e87b2fe913 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:39.289657 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9d96c42a-3ef5-45fd-a6ad-a6e260653867 req-62681023-cebd-4fac-ac09-47e87b2fe913 service neutron] 10.222.0.26 "GET /v2.0/networks?id=4ca58d86-8d4d-408b-8308-dfa9f89406f0 HTTP/1.1" status: 200 len: 897 time: 0.0955927 Nov 09 04:38:39.298833 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-62cbe81c-6513-4616-9144-54ac63da2ba9 None None] Set router b9fe8b76-742f-4072-b1f1-39a9dbe806a5 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:38:39.355591 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9d96c42a-3ef5-45fd-a6ad-a6e260653867 req-86b663ca-8f0c-425f-bf8e-71b265172384 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=e9035c2a-0c37-4cb2-a2db-bf779b1a4f49 HTTP/1.1" status: 200 len: 998 time: 0.0589159 Nov 09 04:38:39.404412 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d96c42a-3ef5-45fd-a6ad-a6e260653867 req-a8091cbb-16ae-469a-8bad-98f050a62d3f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:39.405820 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9d96c42a-3ef5-45fd-a6ad-a6e260653867 req-a8091cbb-16ae-469a-8bad-98f050a62d3f service neutron] 10.222.0.26 "GET /v2.0/subnets?id=555b0d63-4eb8-45a4-a06a-bbcb72506fcd HTTP/1.1" status: 200 len: 835 time: 0.0423002 Nov 09 04:38:39.455710 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d96c42a-3ef5-45fd-a6ad-a6e260653867 req-4c04205f-a370-4b16-826c-cc74ef223406 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:39.457270 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9d96c42a-3ef5-45fd-a6ad-a6e260653867 req-4c04205f-a370-4b16-826c-cc74ef223406 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=4ca58d86-8d4d-408b-8308-dfa9f89406f0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0423934 Nov 09 04:38:39.517976 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-62cbe81c-6513-4616-9144-54ac63da2ba9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'name': 'tempest-TestNetworkBasicOps-router-473737147', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.35'}], 'enable_snat': True}, 'gw_port_id': '965ebc5f-0c00-46a9-aaf1-8ed04be937c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:37:20Z', 'updated_at': '2021-11-09T04:37:25Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '965ebc5f-0c00-46a9-aaf1-8ed04be937c6', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:d0:85:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1376, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:37:21Z', 'updated_at': '2021-11-09T04:37:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '64273749-584c-4af7-8f7e-224624cdeec2', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'floating_ip_address': '172.26.0.65', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'port_id': 'e9035c2a-0c37-4cb2-a2db-bf779b1a4f49', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 1391, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4ca58d86-8d4d-408b-8308-dfa9f89406f0', 'mac_address': 'fa:16:3e:33:24:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4ce7e684-ab7e-472a-9a8b-5af06f76e48d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:37:42Z', 'updated_at': '2021-11-09T04:38:38Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a294c982-9115-446d-9b80-0b74de52d18d', 'name': '', 'network_id': '4ca58d86-8d4d-408b-8308-dfa9f89406f0', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:6f:5c:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1379, 'fixed_ips': [{'subnet_id': '555b0d63-4eb8-45a4-a06a-bbcb72506fcd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:37:24Z', 'updated_at': '2021-11-09T04:37:27Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '555b0d63-4eb8-45a4-a06a-bbcb72506fcd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:38:39.548498 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9d96c42a-3ef5-45fd-a6ad-a6e260653867 req-2d5a1e54-7159-45de-82b6-f8a1a23f2012 service neutron] 10.222.0.26 "GET /v2.0/networks/4ca58d86-8d4d-408b-8308-dfa9f89406f0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0822394 Nov 09 04:38:39.550328 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-62cbe81c-6513-4616-9144-54ac63da2ba9 None None] Checking router: b9fe8b76-742f-4072-b1f1-39a9dbe806a5 for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:38:39.558697 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-62cbe81c-6513-4616-9144-54ac63da2ba9 None None] Routers {'b9fe8b76-742f-4072-b1f1-39a9dbe806a5'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:38:39.559299 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-62cbe81c-6513-4616-9144-54ac63da2ba9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:38:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['b9fe8b76-742f-4072-b1f1-39a9dbe806a5'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:38:39.670011 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-62cbe81c-6513-4616-9144-54ac63da2ba9 None None] Set router b9fe8b76-742f-4072-b1f1-39a9dbe806a5 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:38:39.905985 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-62cbe81c-6513-4616-9144-54ac63da2ba9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'name': 'tempest-TestNetworkBasicOps-router-473737147', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.35'}], 'enable_snat': True}, 'gw_port_id': '965ebc5f-0c00-46a9-aaf1-8ed04be937c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:37:20Z', 'updated_at': '2021-11-09T04:37:25Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '965ebc5f-0c00-46a9-aaf1-8ed04be937c6', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:d0:85:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1376, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:37:21Z', 'updated_at': '2021-11-09T04:37:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '64273749-584c-4af7-8f7e-224624cdeec2', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'floating_ip_address': '172.26.0.65', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'port_id': 'e9035c2a-0c37-4cb2-a2db-bf779b1a4f49', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 1391, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4ca58d86-8d4d-408b-8308-dfa9f89406f0', 'mac_address': 'fa:16:3e:33:24:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4ce7e684-ab7e-472a-9a8b-5af06f76e48d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:37:42Z', 'updated_at': '2021-11-09T04:38:38Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a294c982-9115-446d-9b80-0b74de52d18d', 'name': '', 'network_id': '4ca58d86-8d4d-408b-8308-dfa9f89406f0', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:6f:5c:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1379, 'fixed_ips': [{'subnet_id': '555b0d63-4eb8-45a4-a06a-bbcb72506fcd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:37:24Z', 'updated_at': '2021-11-09T04:37:27Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '555b0d63-4eb8-45a4-a06a-bbcb72506fcd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:38:39.938470 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-62cbe81c-6513-4616-9144-54ac63da2ba9 None None] The sync data for ids ['b9fe8b76-742f-4072-b1f1-39a9dbe806a5'] in dv-neutron-816802-2-hyperv is: [{'id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'name': 'tempest-TestNetworkBasicOps-router-473737147', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.35'}], 'enable_snat': True}, 'gw_port_id': '965ebc5f-0c00-46a9-aaf1-8ed04be937c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:37:20Z', 'updated_at': '2021-11-09T04:37:25Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '965ebc5f-0c00-46a9-aaf1-8ed04be937c6', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:d0:85:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1376, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:37:21Z', 'updated_at': '2021-11-09T04:37:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '64273749-584c-4af7-8f7e-224624cdeec2', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'floating_ip_address': '172.26.0.65', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'port_id': 'e9035c2a-0c37-4cb2-a2db-bf779b1a4f49', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 1391, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4ca58d86-8d4d-408b-8308-dfa9f89406f0', 'mac_address': 'fa:16:3e:33:24:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4ce7e684-ab7e-472a-9a8b-5af06f76e48d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:37:42Z', 'updated_at': '2021-11-09T04:38:38Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a294c982-9115-446d-9b80-0b74de52d18d', 'name': '', 'network_id': '4ca58d86-8d4d-408b-8308-dfa9f89406f0', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:6f:5c:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1379, 'fixed_ips': [{'subnet_id': '555b0d63-4eb8-45a4-a06a-bbcb72506fcd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:37:24Z', 'updated_at': '2021-11-09T04:37:27Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '555b0d63-4eb8-45a4-a06a-bbcb72506fcd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:38:39.963368 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9d96c42a-3ef5-45fd-a6ad-a6e260653867 req-b741aba4-25f5-4a64-9dcb-39f241178668 service neutron] 10.222.0.26 "GET /v2.0/networks/4ca58d86-8d4d-408b-8308-dfa9f89406f0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4078217 Nov 09 04:38:40.132786 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-63863af9-b1ba-4967-985b-e2c038381e0a None None] New status for floating IP 64273749-584c-4af7-8f7e-224624cdeec2: ACTIVE {{(pid=102164) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 04:38:40.173422 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 60166) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:38:40.234524 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-7e2c65ee-ec37-4fd2-aff1-72a9a20d8741 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/floatingips/64273749-584c-4af7-8f7e-224624cdeec2 HTTP/1.1" status: 200 len: 990 time: 0.0592194 Nov 09 04:38:40.458459 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-003c3060-092e-4424-94e7-fdcdc84f6562 req-38aaf793-bf0e-4422-865f-643149403670 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1777462302&fields=id&tenant_id=f636e5f4c9f64f69ba3b2ab8816b6096 HTTP/1.1" status: 200 len: 267 time: 0.0456331 Nov 09 04:38:40.560862 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-003c3060-092e-4424-94e7-fdcdc84f6562 req-06cefaf8-ab0d-42d7-81a8-6e152549199f tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:40.562303 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-003c3060-092e-4424-94e7-fdcdc84f6562 req-06cefaf8-ab0d-42d7-81a8-6e152549199f tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/networks?id=999b1b20-f8fc-4caf-84cc-3feda426a0bf HTTP/1.1" status: 200 len: 812 time: 0.0985572 Nov 09 04:38:40.577200 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-003c3060-092e-4424-94e7-fdcdc84f6562 req-46cdfabc-b49a-40f7-a754-7122e92034b1 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/quotas/f636e5f4c9f64f69ba3b2ab8816b6096 HTTP/1.1" status: 200 len: 375 time: 0.0092521 Nov 09 04:38:40.628566 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-003c3060-092e-4424-94e7-fdcdc84f6562 req-4567759a-9d8c-4930-955a-3d18ec2f6cf6 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?tenant_id=f636e5f4c9f64f69ba3b2ab8816b6096&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0460989 Nov 09 04:38:40.725787 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-003c3060-092e-4424-94e7-fdcdc84f6562 req-02e11b6b-1abf-4fed-aee9-862fb3cd29d8 service neutron] 10.222.0.24 "GET /v2.0/networks/999b1b20-f8fc-4caf-84cc-3feda426a0bf?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0838306 Nov 09 04:38:40.813655 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-003c3060-092e-4424-94e7-fdcdc84f6562 req-65116e91-d9dd-43d4-949c-6d0a31dfa9dc service neutron] 10.222.0.24 "GET /v2.0/networks/999b1b20-f8fc-4caf-84cc-3feda426a0bf?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0819888 Nov 09 04:38:41.238547 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 60184) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:38:41.300464 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-fbfe11d5-9b1d-42eb-8aec-f912b88f6d57 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/floatingips/64273749-584c-4af7-8f7e-224624cdeec2 HTTP/1.1" status: 200 len: 992 time: 0.0607116 Nov 09 04:38:41.360079 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4584ad28-b3b6-444e-bec7-3490805be028 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:41.403484 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f8da16d5-2df0-41b0-bebe-990f21d610a3 req-cd27a287-f609-409c-bc7f-d62be8562d48 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=04f80039-ab30-438a-adbf-bd30827f9a50 HTTP/1.1" status: 200 len: 210 time: 0.0258937 Nov 09 04:38:42.151773 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:42.496889 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7b0e672a-64b8-42a6-97f3-052c0174b02e req-6f464cba-511b-4a20-ae38-d0dce7a0ff69 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=04f80039-ab30-438a-adbf-bd30827f9a50 HTTP/1.1" status: 200 len: 210 time: 0.0261831 Nov 09 04:38:43.267511 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-003c3060-092e-4424-94e7-fdcdc84f6562 req-52acd859-c73e-4072-b38e-0fdab71e9414 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:43.269274 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-003c3060-092e-4424-94e7-fdcdc84f6562 req-52acd859-c73e-4072-b38e-0fdab71e9414 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.26 "GET /v2.0/networks?id=999b1b20-f8fc-4caf-84cc-3feda426a0bf HTTP/1.1" status: 200 len: 812 time: 0.1036899 Nov 09 04:38:43.333420 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-003c3060-092e-4424-94e7-fdcdc84f6562 req-f8cfe7a7-b119-41ef-9532-bf261d33f959 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.26 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=f636e5f4c9f64f69ba3b2ab8816b6096 HTTP/1.1" status: 200 len: 380 time: 0.0542581 Nov 09 04:38:43.342919 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-003c3060-092e-4424-94e7-fdcdc84f6562 req-1eaa6e61-74ac-4f59-a8d4-b405bd710f39 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Request body: {'port': {'device_id': '04f80039-ab30-438a-adbf-bd30827f9a50', 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf', 'admin_state_up': True, 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'security_groups': ['3fac99c0-db5e-4deb-ae03-d7c28ceb1106']}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:38:43.523048 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-003c3060-092e-4424-94e7-fdcdc84f6562 req-1eaa6e61-74ac-4f59-a8d4-b405bd710f39 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Made reservation on behalf of f636e5f4c9f64f69ba3b2ab8816b6096 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:38:43.526828 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-003c3060-092e-4424-94e7-fdcdc84f6562 req-1eaa6e61-74ac-4f59-a8d4-b405bd710f39 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:43.656891 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [req-003c3060-092e-4424-94e7-fdcdc84f6562 req-1eaa6e61-74ac-4f59-a8d4-b405bd710f39 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Allocated IP 172.20.0.13 (999b1b20-f8fc-4caf-84cc-3feda426a0bf/f6a08667-654b-4e0c-9f85-c6e6712cc239/65ca937a-8471-4c50-bca1-78fbcfc42fb6) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:38:43.661764 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-3449e3a4-4d49-458c-9953-f2527aa122c5 req-ca8be637-8c97-4653-8a5b-1315208b5d72 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=04f80039-ab30-438a-adbf-bd30827f9a50 HTTP/1.1" status: 200 len: 210 time: 0.0929060 Nov 09 04:38:43.688865 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-2c5278ac-5ee5-43fb-8aaf-ed5b036a78e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:43.803710 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-003c3060-092e-4424-94e7-fdcdc84f6562 req-1eaa6e61-74ac-4f59-a8d4-b405bd710f39 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:43.889315 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-003c3060-092e-4424-94e7-fdcdc84f6562 req-1eaa6e61-74ac-4f59-a8d4-b405bd710f39 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:43.932040 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-003c3060-092e-4424-94e7-fdcdc84f6562 req-1eaa6e61-74ac-4f59-a8d4-b405bd710f39 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Network 999b1b20-f8fc-4caf-84cc-3feda426a0bf is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:38:43.937068 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [req-003c3060-092e-4424-94e7-fdcdc84f6562 req-1eaa6e61-74ac-4f59-a8d4-b405bd710f39 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:38:43.943521 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-003c3060-092e-4424-94e7-fdcdc84f6562 req-1eaa6e61-74ac-4f59-a8d4-b405bd710f39 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:38:43.964515 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eaa6e61-74ac-4f59-a8d4-b405bd710f39 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Pushing event updated for resources: {'Port': ['ID=65ca937a-8471-4c50-bca1-78fbcfc42fb6,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:38:43.995336 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-003c3060-092e-4424-94e7-fdcdc84f6562 req-1eaa6e61-74ac-4f59-a8d4-b405bd710f39 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:43.996417 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-003c3060-092e-4424-94e7-fdcdc84f6562 req-1eaa6e61-74ac-4f59-a8d4-b405bd710f39 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:44.095580 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-003c3060-092e-4424-94e7-fdcdc84f6562 req-1eaa6e61-74ac-4f59-a8d4-b405bd710f39 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.26 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7568829 Nov 09 04:38:44.109254 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-003c3060-092e-4424-94e7-fdcdc84f6562 req-85d0f867-03cd-44ef-9d3d-aae2ae8bdad9 service neutron] Request body: {'port': {'device_id': '04f80039-ab30-438a-adbf-bd30827f9a50', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:38:44.159955 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-a1d278f4-8a71-4ee3-8e56-b66008e02a22 None None] Provisioning complete for port 65ca937a-8471-4c50-bca1-78fbcfc42fb6 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:38:44.160322 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a1d278f4-8a71-4ee3-8e56-b66008e02a22 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:44.173329 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-003c3060-092e-4424-94e7-fdcdc84f6562 req-85d0f867-03cd-44ef-9d3d-aae2ae8bdad9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:44.195578 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-a1d278f4-8a71-4ee3-8e56-b66008e02a22 None None] Port 65ca937a-8471-4c50-bca1-78fbcfc42fb6 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:38:44.433014 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [req-003c3060-092e-4424-94e7-fdcdc84f6562 req-85d0f867-03cd-44ef-9d3d-aae2ae8bdad9 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 65ca937a-8471-4c50-bca1-78fbcfc42fb6 {{(pid=102162) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:38:44.440242 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-003c3060-092e-4424-94e7-fdcdc84f6562 req-85d0f867-03cd-44ef-9d3d-aae2ae8bdad9 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:44.452367 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.provisioning_blocks [req-003c3060-092e-4424-94e7-fdcdc84f6562 req-85d0f867-03cd-44ef-9d3d-aae2ae8bdad9 service neutron] Transition to ACTIVE for port object 65ca937a-8471-4c50-bca1-78fbcfc42fb6 will not be triggered until provisioned by entity L2. {{(pid=102162) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 09 04:38:44.537094 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-003c3060-092e-4424-94e7-fdcdc84f6562 req-85d0f867-03cd-44ef-9d3d-aae2ae8bdad9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:44.613505 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85d0f867-03cd-44ef-9d3d-aae2ae8bdad9 service neutron] Pushing event updated for resources: {'Port': ['ID=65ca937a-8471-4c50-bca1-78fbcfc42fb6,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:38:44.667315 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-003c3060-092e-4424-94e7-fdcdc84f6562 req-85d0f867-03cd-44ef-9d3d-aae2ae8bdad9 service neutron] Attempting to bind port 65ca937a-8471-4c50-bca1-78fbcfc42fb6 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:38:44.667651 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-003c3060-092e-4424-94e7-fdcdc84f6562 req-85d0f867-03cd-44ef-9d3d-aae2ae8bdad9 service neutron] Attempting to bind port 65ca937a-8471-4c50-bca1-78fbcfc42fb6 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'bc4577c9-06a5-450a-9c80-879827986f04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:38:44.667977 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-003c3060-092e-4424-94e7-fdcdc84f6562 req-85d0f867-03cd-44ef-9d3d-aae2ae8bdad9 service neutron] Attempting to bind port 65ca937a-8471-4c50-bca1-78fbcfc42fb6 on network 999b1b20-f8fc-4caf-84cc-3feda426a0bf {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:38:44.672595 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-003c3060-092e-4424-94e7-fdcdc84f6562 req-85d0f867-03cd-44ef-9d3d-aae2ae8bdad9 service neutron] Port 65ca937a-8471-4c50-bca1-78fbcfc42fb6 on network 999b1b20-f8fc-4caf-84cc-3feda426a0bf not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:38:44.672915 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-003c3060-092e-4424-94e7-fdcdc84f6562 req-85d0f867-03cd-44ef-9d3d-aae2ae8bdad9 service neutron] Attempting to bind port 65ca937a-8471-4c50-bca1-78fbcfc42fb6 on network 999b1b20-f8fc-4caf-84cc-3feda426a0bf {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:38:44.678304 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-003c3060-092e-4424-94e7-fdcdc84f6562 req-85d0f867-03cd-44ef-9d3d-aae2ae8bdad9 service neutron] Checking agent: {'id': '7d36b884-4ad2-4878-9464-bf647030b544', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'started_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 38, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:38:44.678669 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-003c3060-092e-4424-94e7-fdcdc84f6562 req-85d0f867-03cd-44ef-9d3d-aae2ae8bdad9 service neutron] Checking segment: {'id': 'bc4577c9-06a5-450a-9c80-879827986f04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:38:44.679053 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-003c3060-092e-4424-94e7-fdcdc84f6562 req-85d0f867-03cd-44ef-9d3d-aae2ae8bdad9 service neutron] Bound using segment: {'id': 'bc4577c9-06a5-450a-9c80-879827986f04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf'} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:38:44.679476 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-003c3060-092e-4424-94e7-fdcdc84f6562 req-85d0f867-03cd-44ef-9d3d-aae2ae8bdad9 service neutron] Bound port: 65ca937a-8471-4c50-bca1-78fbcfc42fb6, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'bc4577c9-06a5-450a-9c80-879827986f04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf'}}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:38:44.679830 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-003c3060-092e-4424-94e7-fdcdc84f6562 req-85d0f867-03cd-44ef-9d3d-aae2ae8bdad9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:44.755815 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-003c3060-092e-4424-94e7-fdcdc84f6562 req-85d0f867-03cd-44ef-9d3d-aae2ae8bdad9 service neutron] For port 65ca937a-8471-4c50-bca1-78fbcfc42fb6, host hv-neutron-8168, cleared binding levels {{(pid=102162) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:38:44.793878 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-003c3060-092e-4424-94e7-fdcdc84f6562 req-85d0f867-03cd-44ef-9d3d-aae2ae8bdad9 service neutron] For port 65ca937a-8471-4c50-bca1-78fbcfc42fb6, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=65ca937a-8471-4c50-bca1-78fbcfc42fb6,segment=NetworkSegment(bc4577c9-06a5-450a-9c80-879827986f04),segment_id=bc4577c9-06a5-450a-9c80-879827986f04)] {{(pid=102162) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:38:44.815103 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d26796f-73da-4acc-8ea4-a39987478a40 req-5336c74e-8979-4745-958f-4f3ef4c63533 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:44.816647 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6d26796f-73da-4acc-8ea4-a39987478a40 req-5336c74e-8979-4745-958f-4f3ef4c63533 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=04f80039-ab30-438a-adbf-bd30827f9a50 HTTP/1.1" status: 200 len: 944 time: 0.0630388 Nov 09 04:38:44.869538 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6d26796f-73da-4acc-8ea4-a39987478a40 req-e4dceb20-ddf9-46c8-bee7-92837461f00a tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0449049 Nov 09 04:38:44.871063 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-003c3060-092e-4424-94e7-fdcdc84f6562 req-85d0f867-03cd-44ef-9d3d-aae2ae8bdad9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:44.908353 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-003c3060-092e-4424-94e7-fdcdc84f6562 req-85d0f867-03cd-44ef-9d3d-aae2ae8bdad9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:44.908928 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-003c3060-092e-4424-94e7-fdcdc84f6562 req-85d0f867-03cd-44ef-9d3d-aae2ae8bdad9 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:44.910269 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-003c3060-092e-4424-94e7-fdcdc84f6562 req-85d0f867-03cd-44ef-9d3d-aae2ae8bdad9 service neutron] 10.222.0.26 "PUT /v2.0/ports/65ca937a-8471-4c50-bca1-78fbcfc42fb6 HTTP/1.1" status: 200 len: 1094 time: 0.8061867 Nov 09 04:38:44.910736 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '04f80039-ab30-438a-adbf-bd30827f9a50', 'tag': '65ca937a-8471-4c50-bca1-78fbcfc42fb6'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:38:44.912968 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7947e6db-fb72-4845-9bb4-2952b9a59065" -d '{"events": [{"name": "network-changed", "server_uuid": "04f80039-ab30-438a-adbf-bd30827f9a50", "tag": "65ca937a-8471-4c50-bca1-78fbcfc42fb6"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:38:44.941251 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85d0f867-03cd-44ef-9d3d-aae2ae8bdad9 service neutron] Pushing event updated for resources: {'Port': ['ID=65ca937a-8471-4c50-bca1-78fbcfc42fb6,revision_number=3']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:38:44.970799 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:38:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-07bb3a03-c611-499d-95a3-2852f52ef6b9 x-openstack-request-id: req-07bb3a03-c611-499d-95a3-2852f52ef6b9 {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:38:44.970799 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "04f80039-ab30-438a-adbf-bd30827f9a50", "tag": "65ca937a-8471-4c50-bca1-78fbcfc42fb6", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:38:44.970799 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-07bb3a03-c611-499d-95a3-2852f52ef6b9 {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:38:44.970799 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '04f80039-ab30-438a-adbf-bd30827f9a50', 'tag': '65ca937a-8471-4c50-bca1-78fbcfc42fb6', 'status': 'completed', 'code': 200} Nov 09 04:38:45.040763 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7947e6db-fb72-4845-9bb4-2952b9a59065 req-dc9a470b-5516-4c64-b700-80e1b8dcd0e5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:45.042499 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7947e6db-fb72-4845-9bb4-2952b9a59065 req-dc9a470b-5516-4c64-b700-80e1b8dcd0e5 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=f636e5f4c9f64f69ba3b2ab8816b6096&device_id=04f80039-ab30-438a-adbf-bd30827f9a50 HTTP/1.1" status: 200 len: 1097 time: 0.0507121 Nov 09 04:38:45.080525 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:45.160896 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7947e6db-fb72-4845-9bb4-2952b9a59065 req-e5e01895-556d-488f-abc1-04e0242c721f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:45.162389 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7947e6db-fb72-4845-9bb4-2952b9a59065 req-e5e01895-556d-488f-abc1-04e0242c721f service neutron] 10.222.0.26 "GET /v2.0/networks?tenant_id=f636e5f4c9f64f69ba3b2ab8816b6096&shared=False HTTP/1.1" status: 200 len: 913 time: 0.1103354 Nov 09 04:38:45.262219 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7947e6db-fb72-4845-9bb4-2952b9a59065 req-c17591b6-a1ac-4bf1-afdc-50719308078e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:45.263749 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7947e6db-fb72-4845-9bb4-2952b9a59065 req-c17591b6-a1ac-4bf1-afdc-50719308078e service neutron] 10.222.0.26 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0923035 Nov 09 04:38:45.344421 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-003c3060-092e-4424-94e7-fdcdc84f6562 req-69ef948c-1cdf-481c-b93b-8cb04b7430ad service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:45.346009 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-003c3060-092e-4424-94e7-fdcdc84f6562 req-69ef948c-1cdf-481c-b93b-8cb04b7430ad service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=f636e5f4c9f64f69ba3b2ab8816b6096&device_id=04f80039-ab30-438a-adbf-bd30827f9a50 HTTP/1.1" status: 200 len: 1097 time: 0.0457442 Nov 09 04:38:45.388698 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-003c3060-092e-4424-94e7-fdcdc84f6562 req-79e0a3f7-7714-404c-b1c0-471360d1e814 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=65ca937a-8471-4c50-bca1-78fbcfc42fb6 HTTP/1.1" status: 200 len: 217 time: 0.0343199 Nov 09 04:38:45.436966 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-003c3060-092e-4424-94e7-fdcdc84f6562 req-6f81ec8e-d866-4b68-bec0-48ba975c2acc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:45.438406 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-003c3060-092e-4424-94e7-fdcdc84f6562 req-6f81ec8e-d866-4b68-bec0-48ba975c2acc service neutron] 10.222.0.26 "GET /v2.0/subnets?id=f6a08667-654b-4e0c-9f85-c6e6712cc239 HTTP/1.1" status: 200 len: 851 time: 0.0431345 Nov 09 04:38:45.483994 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-003c3060-092e-4424-94e7-fdcdc84f6562 req-ab6c7185-f50b-4726-bbfc-747c4bb1f4e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:45.485375 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-003c3060-092e-4424-94e7-fdcdc84f6562 req-ab6c7185-f50b-4726-bbfc-747c4bb1f4e1 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=999b1b20-f8fc-4caf-84cc-3feda426a0bf&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0401690 Nov 09 04:38:45.578049 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-003c3060-092e-4424-94e7-fdcdc84f6562 req-786b6fc5-f859-4c3d-a470-a968182151b7 service neutron] 10.222.0.26 "GET /v2.0/networks/999b1b20-f8fc-4caf-84cc-3feda426a0bf?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0856402 Nov 09 04:38:45.672004 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-003c3060-092e-4424-94e7-fdcdc84f6562 req-e409a83a-7586-40e4-b192-3b2d7b20e9d2 service neutron] 10.222.0.26 "GET /v2.0/networks/999b1b20-f8fc-4caf-84cc-3feda426a0bf?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0870152 Nov 09 04:38:45.991550 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9df2e79-3593-491c-9984-8a4d3074a260 req-2b6ee2ad-da03-4b29-b410-89508bf0abe5 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:45.993221 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c9df2e79-3593-491c-9984-8a4d3074a260 req-2b6ee2ad-da03-4b29-b410-89508bf0abe5 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=04f80039-ab30-438a-adbf-bd30827f9a50 HTTP/1.1" status: 200 len: 944 time: 0.0508423 Nov 09 04:38:46.044337 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c9df2e79-3593-491c-9984-8a4d3074a260 req-1799fb7c-be48-420e-b59d-7c2ae4bd4ad0 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0450115 Nov 09 04:38:46.428531 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:46.471067 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:38:46.948809 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:47.158214 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f98dffa5-b0d1-43a9-bc7e-66bf74d79a59 req-1caf1828-b272-4653-9205-51f84f0db53b tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:47.159700 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f98dffa5-b0d1-43a9-bc7e-66bf74d79a59 req-1caf1828-b272-4653-9205-51f84f0db53b tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=04f80039-ab30-438a-adbf-bd30827f9a50 HTTP/1.1" status: 200 len: 944 time: 0.0476696 Nov 09 04:38:47.207372 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f98dffa5-b0d1-43a9-bc7e-66bf74d79a59 req-ab5e3ff0-bb86-483c-8b5c-e5f084629d8d tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418775 Nov 09 04:38:48.321958 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-121531fb-ae7d-4045-9fcd-a61cb79dd11f req-0c7f2c24-c02f-4816-9997-7c305281d68e tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:48.323578 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-121531fb-ae7d-4045-9fcd-a61cb79dd11f req-0c7f2c24-c02f-4816-9997-7c305281d68e tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=04f80039-ab30-438a-adbf-bd30827f9a50 HTTP/1.1" status: 200 len: 944 time: 0.0503814 Nov 09 04:38:48.382002 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-121531fb-ae7d-4045-9fcd-a61cb79dd11f req-38aeef4a-5236-49ec-bbbd-847f26bdab6c tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0517044 Nov 09 04:38:49.499751 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ab3fd65-f261-4f0e-814d-93ad239edd22 req-1a7cfaa2-2e2b-42c6-bbc9-e3015c5f8e44 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:49.501197 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-2ab3fd65-f261-4f0e-814d-93ad239edd22 req-1a7cfaa2-2e2b-42c6-bbc9-e3015c5f8e44 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=04f80039-ab30-438a-adbf-bd30827f9a50 HTTP/1.1" status: 200 len: 944 time: 0.0513744 Nov 09 04:38:49.549756 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-2ab3fd65-f261-4f0e-814d-93ad239edd22 req-a9298ae3-1bcd-49f7-8030-42554665d786 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426240 Nov 09 04:38:50.666246 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88fcbbf4-da79-483a-aba9-da466df05de7 req-e6b0131c-cd55-47ef-9a5e-2887a3055cf5 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:50.667701 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-88fcbbf4-da79-483a-aba9-da466df05de7 req-e6b0131c-cd55-47ef-9a5e-2887a3055cf5 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=04f80039-ab30-438a-adbf-bd30827f9a50 HTTP/1.1" status: 200 len: 944 time: 0.0513253 Nov 09 04:38:50.715409 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-88fcbbf4-da79-483a-aba9-da466df05de7 req-a778dd1b-f582-403e-b554-007b101c1952 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419261 Nov 09 04:38:51.827433 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb67f605-04d8-4d60-afd8-de8756424afb req-42ece5f1-0d29-4f65-8275-8d34385c4f3f tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:51.828888 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-bb67f605-04d8-4d60-afd8-de8756424afb req-42ece5f1-0d29-4f65-8275-8d34385c4f3f tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=04f80039-ab30-438a-adbf-bd30827f9a50 HTTP/1.1" status: 200 len: 944 time: 0.0482388 Nov 09 04:38:51.876999 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-bb67f605-04d8-4d60-afd8-de8756424afb req-3d228117-5669-44b2-984a-9385789062a6 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421817 Nov 09 04:38:52.035531 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e5950c96-d4f6-4db0-9381-a44e8661a8f3 req-6fd3e188-d84a-4082-aa42-591ad62da7ac service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=dd729d7d-d632-48e2-ad4b-7ce1cb65ee60&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0388191 Nov 09 04:38:52.166812 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5950c96-d4f6-4db0-9381-a44e8661a8f3 req-9da90382-500e-45cf-86fe-ac1e089ab0c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:52.168281 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e5950c96-d4f6-4db0-9381-a44e8661a8f3 req-9da90382-500e-45cf-86fe-ac1e089ab0c3 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&device_id=dd729d7d-d632-48e2-ad4b-7ce1cb65ee60 HTTP/1.1" status: 200 len: 1099 time: 0.0862498 Nov 09 04:38:52.272865 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5950c96-d4f6-4db0-9381-a44e8661a8f3 req-1599cdef-83a4-4da4-8510-f83f970dc571 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:52.274308 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e5950c96-d4f6-4db0-9381-a44e8661a8f3 req-1599cdef-83a4-4da4-8510-f83f970dc571 service neutron] 10.222.0.26 "GET /v2.0/networks?id=4ca58d86-8d4d-408b-8308-dfa9f89406f0 HTTP/1.1" status: 200 len: 897 time: 0.0878394 Nov 09 04:38:52.323131 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e5950c96-d4f6-4db0-9381-a44e8661a8f3 req-dccce628-f220-4c87-be6b-f25c2690f38a service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=1f0f5130-353d-4b95-ab61-f19dec355529 HTTP/1.1" status: 200 len: 217 time: 0.0340581 Nov 09 04:38:52.375219 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5950c96-d4f6-4db0-9381-a44e8661a8f3 req-cd0d9cd0-250e-483b-a00b-6f304d885340 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:52.376664 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e5950c96-d4f6-4db0-9381-a44e8661a8f3 req-cd0d9cd0-250e-483b-a00b-6f304d885340 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=555b0d63-4eb8-45a4-a06a-bbcb72506fcd HTTP/1.1" status: 200 len: 835 time: 0.0463681 Nov 09 04:38:52.420552 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5950c96-d4f6-4db0-9381-a44e8661a8f3 req-621069bd-2af2-4f8b-aebd-38e16d21113d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:52.422028 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e5950c96-d4f6-4db0-9381-a44e8661a8f3 req-621069bd-2af2-4f8b-aebd-38e16d21113d service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=4ca58d86-8d4d-408b-8308-dfa9f89406f0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0389328 Nov 09 04:38:52.433677 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [req-e5950c96-d4f6-4db0-9381-a44e8661a8f3 req-d835cb9d-60b7-4160-a511-82f889474b93 service neutron] http://10.222.0.24:9696/v2.0/extensions returned with HTTP 200 {{(pid=102162) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:38:52.434652 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e5950c96-d4f6-4db0-9381-a44e8661a8f3 req-d835cb9d-60b7-4160-a511-82f889474b93 service neutron] 10.222.0.26 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0051272 Nov 09 04:38:52.522502 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e5950c96-d4f6-4db0-9381-a44e8661a8f3 req-099d9cad-910c-4f12-a1e0-2b1056970906 service neutron] 10.222.0.26 "GET /v2.0/networks/4ca58d86-8d4d-408b-8308-dfa9f89406f0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0799096 Nov 09 04:38:52.613394 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e5950c96-d4f6-4db0-9381-a44e8661a8f3 req-6fb8fb69-4879-4bf6-a772-e5110eacbe75 service neutron] 10.222.0.26 "GET /v2.0/networks/4ca58d86-8d4d-408b-8308-dfa9f89406f0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0840423 Nov 09 04:38:52.988653 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d5d167d-6291-419d-8718-5d26e4719afc req-b6c30188-7c1c-4dc9-9387-e21cfb6b6e34 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:52.990118 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5d5d167d-6291-419d-8718-5d26e4719afc req-b6c30188-7c1c-4dc9-9387-e21cfb6b6e34 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=04f80039-ab30-438a-adbf-bd30827f9a50 HTTP/1.1" status: 200 len: 944 time: 0.0482643 Nov 09 04:38:53.037804 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5d5d167d-6291-419d-8718-5d26e4719afc req-d44b0218-a957-43bc-b4d6-e980407534bb tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418572 Nov 09 04:38:54.148701 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3b7f3a4-1a82-4870-8bdc-372dc53ec7db req-e741fc92-fcf2-4c9f-be10-39b02dddf362 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:54.150039 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c3b7f3a4-1a82-4870-8bdc-372dc53ec7db req-e741fc92-fcf2-4c9f-be10-39b02dddf362 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=04f80039-ab30-438a-adbf-bd30827f9a50 HTTP/1.1" status: 200 len: 944 time: 0.0469756 Nov 09 04:38:54.201005 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c3b7f3a4-1a82-4870-8bdc-372dc53ec7db req-4fdcb8da-6722-4e82-a0f1-a26478da0d0f tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0446630 Nov 09 04:38:55.316988 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68d944e0-c088-427f-8df6-1a910880645b req-692b7ffd-4684-4bc8-9075-50038f3b8ad5 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:55.318467 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-68d944e0-c088-427f-8df6-1a910880645b req-692b7ffd-4684-4bc8-9075-50038f3b8ad5 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=04f80039-ab30-438a-adbf-bd30827f9a50 HTTP/1.1" status: 200 len: 944 time: 0.0523319 Nov 09 04:38:55.376267 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-68d944e0-c088-427f-8df6-1a910880645b req-c69fe556-0fc1-4aad-8624-a8ddc1151fcb tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0519054 Nov 09 04:38:56.487431 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8825a5b3-27cb-4f91-afa7-8d7e2bb7a04b req-b92e7f1c-ddbd-4947-93a4-634904fe7199 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:56.488905 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-8825a5b3-27cb-4f91-afa7-8d7e2bb7a04b req-b92e7f1c-ddbd-4947-93a4-634904fe7199 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=04f80039-ab30-438a-adbf-bd30827f9a50 HTTP/1.1" status: 200 len: 944 time: 0.0486257 Nov 09 04:38:56.536527 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-8825a5b3-27cb-4f91-afa7-8d7e2bb7a04b req-eeb2f327-8219-4c6d-86ec-cc5e4d4ad171 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418105 Nov 09 04:38:57.486827 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 65ca937a-8471-4c50-bca1-78fbcfc42fb6 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=102163) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 09 04:38:57.600017 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 65ca937a-8471-4c50-bca1-78fbcfc42fb6, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=65ca937a-8471-4c50-bca1-78fbcfc42fb6,segment=NetworkSegment(bc4577c9-06a5-450a-9c80-879827986f04),segment_id=bc4577c9-06a5-450a-9c80-879827986f04)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:38:57.611584 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Returning: {'device': '65ca937a-8471-4c50-bca1-78fbcfc42fb6', 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf', 'port_id': '65ca937a-8471-4c50-bca1-78fbcfc42fb6', 'mac_address': 'fa:16:3e:1f:06:df', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 310, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f6a08667-654b-4e0c-9f85-c6e6712cc239', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102163) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 09 04:38:57.654461 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:57.668540 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 65ca937a-8471-4c50-bca1-78fbcfc42fb6 {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:38:57.686146 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-109bc4a3-556d-48ea-a16c-02cbd6c71803 req-1cc4fba7-e8e1-47e6-8932-c7f699e43f7d tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:57.687700 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-109bc4a3-556d-48ea-a16c-02cbd6c71803 req-1cc4fba7-e8e1-47e6-8932-c7f699e43f7d tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=04f80039-ab30-438a-adbf-bd30827f9a50 HTTP/1.1" status: 200 len: 944 time: 0.0579033 Nov 09 04:38:57.688833 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 65ca937a-8471-4c50-bca1-78fbcfc42fb6, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=65ca937a-8471-4c50-bca1-78fbcfc42fb6,segment=NetworkSegment(bc4577c9-06a5-450a-9c80-879827986f04),segment_id=bc4577c9-06a5-450a-9c80-879827986f04)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:38:57.740654 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-109bc4a3-556d-48ea-a16c-02cbd6c71803 req-d34a37a0-338e-431a-9e29-db10857f0e8b tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0455775 Nov 09 04:38:57.774439 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:57.827084 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=65ca937a-8471-4c50-bca1-78fbcfc42fb6,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:38:57.833899 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:38:57.834242 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:38:57.834606 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:38:57.834937 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:38:57.835260 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:38:57.835584 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:38:57.835907 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:38:57.836226 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:38:57.836544 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:38:57.836860 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:38:57.837172 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:38:57.837484 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:38:58.028382 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['65ca937a-8471-4c50-bca1-78fbcfc42fb6'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 04:38:58.854800 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ded4ef2d-620c-431c-9c45-ca823a84db15 req-c8de8732-0c18-4821-9ed6-15bbb8cd020b tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:38:58.856244 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ded4ef2d-620c-431c-9c45-ca823a84db15 req-c8de8732-0c18-4821-9ed6-15bbb8cd020b tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=04f80039-ab30-438a-adbf-bd30827f9a50 HTTP/1.1" status: 200 len: 945 time: 0.0470555 Nov 09 04:38:58.904986 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ded4ef2d-620c-431c-9c45-ca823a84db15 req-46564dd1-5d28-421c-81e6-b042acbc1293 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423243 Nov 09 04:38:59.505062 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 65ca937a-8471-4c50-bca1-78fbcfc42fb6 up at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:38:59.661767 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning for port 65ca937a-8471-4c50-bca1-78fbcfc42fb6 completed by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 09 04:38:59.665571 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning complete for port 65ca937a-8471-4c50-bca1-78fbcfc42fb6 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:38:59.666039 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:59.739500 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:59.763702 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '04f80039-ab30-438a-adbf-bd30827f9a50', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '65ca937a-8471-4c50-bca1-78fbcfc42fb6'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:38:59.765907 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-eead6bc2-d1b2-4d97-8956-e44e27cdb0bf" -d '{"events": [{"server_uuid": "04f80039-ab30-438a-adbf-bd30827f9a50", "name": "network-vif-plugged", "status": "completed", "tag": "65ca937a-8471-4c50-bca1-78fbcfc42fb6"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:38:59.778681 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 65ca937a-8471-4c50-bca1-78fbcfc42fb6, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=65ca937a-8471-4c50-bca1-78fbcfc42fb6,segment=NetworkSegment(bc4577c9-06a5-450a-9c80-879827986f04),segment_id=bc4577c9-06a5-450a-9c80-879827986f04)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:38:59.800691 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:38:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-09e47f3d-f37d-4864-a491-12d287e6de7e x-openstack-request-id: req-09e47f3d-f37d-4864-a491-12d287e6de7e {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:38:59.800996 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "04f80039-ab30-438a-adbf-bd30827f9a50", "name": "network-vif-plugged", "status": "completed", "tag": "65ca937a-8471-4c50-bca1-78fbcfc42fb6", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:38:59.801246 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-09e47f3d-f37d-4864-a491-12d287e6de7e {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:38:59.801642 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '04f80039-ab30-438a-adbf-bd30827f9a50', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '65ca937a-8471-4c50-bca1-78fbcfc42fb6', 'code': 200} Nov 09 04:38:59.839195 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:38:59.885873 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=65ca937a-8471-4c50-bca1-78fbcfc42fb6,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:39:00.126642 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c94c983-fe3c-4052-9f16-f0e5fae4a38d req-64a4a1c8-ac9a-44bb-9358-c4721ba179cd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:00.128163 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5c94c983-fe3c-4052-9f16-f0e5fae4a38d req-64a4a1c8-ac9a-44bb-9358-c4721ba179cd service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=04f80039-ab30-438a-adbf-bd30827f9a50 HTTP/1.1" status: 200 len: 1099 time: 0.0974667 Nov 09 04:39:00.131831 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4093b7a-2acd-4505-a4ef-3713fbe2ea8a req-d35c2e56-854b-4bf9-93e8-0ffdf786477a tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:00.133328 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d4093b7a-2acd-4505-a4ef-3713fbe2ea8a req-d35c2e56-854b-4bf9-93e8-0ffdf786477a tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=04f80039-ab30-438a-adbf-bd30827f9a50 HTTP/1.1" status: 200 len: 946 time: 0.1622345 Nov 09 04:39:00.174915 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5c94c983-fe3c-4052-9f16-f0e5fae4a38d req-549b4b88-1f4c-4e44-b85c-8414e0522717 service neutron] 10.222.0.26 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0396142 Nov 09 04:39:00.183002 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d4093b7a-2acd-4505-a4ef-3713fbe2ea8a req-f9053bd5-311f-455a-95ce-264121e62f63 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434413 Nov 09 04:39:01.296872 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58d15dba-74b4-402a-b46d-1bf8a72770b3 req-69dbb02e-0008-4e94-afea-e94fa753ac11 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:01.298391 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-58d15dba-74b4-402a-b46d-1bf8a72770b3 req-69dbb02e-0008-4e94-afea-e94fa753ac11 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=04f80039-ab30-438a-adbf-bd30827f9a50 HTTP/1.1" status: 200 len: 946 time: 0.0490835 Nov 09 04:39:01.347192 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-58d15dba-74b4-402a-b46d-1bf8a72770b3 req-3044f867-4b6d-408c-81bc-967fa3bcd4c4 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428905 Nov 09 04:39:02.457654 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-761c30c1-05b9-4bac-95f7-4fbb83d29640 req-e5f7715d-b260-404c-9b13-b01d48ad80d2 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:02.459300 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-761c30c1-05b9-4bac-95f7-4fbb83d29640 req-e5f7715d-b260-404c-9b13-b01d48ad80d2 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=04f80039-ab30-438a-adbf-bd30827f9a50 HTTP/1.1" status: 200 len: 946 time: 0.0480647 Nov 09 04:39:02.508125 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-761c30c1-05b9-4bac-95f7-4fbb83d29640 req-d78adaf4-6cc2-459b-9ed9-ecf99fcd7510 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429747 Nov 09 04:39:02.618275 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0985ccdf-6262-47f5-a3c5-92b74db6094f req-38c980ea-785c-4968-8fb5-c1e1404e7e0f tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:02.619750 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-0985ccdf-6262-47f5-a3c5-92b74db6094f req-38c980ea-785c-4968-8fb5-c1e1404e7e0f tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=04f80039-ab30-438a-adbf-bd30827f9a50 HTTP/1.1" status: 200 len: 946 time: 0.0481429 Nov 09 04:39:02.671783 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-0985ccdf-6262-47f5-a3c5-92b74db6094f req-3229bf2c-4861-4bf1-9013-47a1dbfd7a29 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0455143 Nov 09 04:39:02.693275 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 60250) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:39:02.732386 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1344228b-c580-44f8-b652-82e54ca80fca tempest-TestVolumeBootPattern-1884748564 tempest-TestVolumeBootPattern-1884748564-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:02.735322 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-1344228b-c580-44f8-b652-82e54ca80fca tempest-TestVolumeBootPattern-1884748564 tempest-TestVolumeBootPattern-1884748564-project-admin] 10.222.0.24 "GET /v2.0/ports?device_id=04f80039-ab30-438a-adbf-bd30827f9a50 HTTP/1.1" status: 200 len: 1094 time: 0.0402122 Nov 09 04:39:02.737189 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 60252) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:39:02.741473 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-cb454fc2-38da-4698-9665-8884a6292ee3 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Request body: {'floatingip': {'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'port_id': '65ca937a-8471-4c50-bca1-78fbcfc42fb6', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'fixed_ip_address': '172.20.0.13'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:39:02.845137 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cb454fc2-38da-4698-9665-8884a6292ee3 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks [] for floatingip, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:02.941513 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cb454fc2-38da-4698-9665-8884a6292ee3 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:03.042489 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-cb454fc2-38da-4698-9665-8884a6292ee3 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Allocated IP 172.26.0.216 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/a8718040-47a0-445b-9945-70916a800265) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:39:03.138775 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cb454fc2-38da-4698-9665-8884a6292ee3 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:03.250909 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cb454fc2-38da-4698-9665-8884a6292ee3 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:03.286776 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cb454fc2-38da-4698-9665-8884a6292ee3 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:39:03.291477 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-cb454fc2-38da-4698-9665-8884a6292ee3 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:39:03.295001 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cb454fc2-38da-4698-9665-8884a6292ee3 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:39:03.300839 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb454fc2-38da-4698-9665-8884a6292ee3 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Pushing event updated for resources: {'Port': ['ID=a8718040-47a0-445b-9945-70916a800265,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:39:03.640890 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cb454fc2-38da-4698-9665-8884a6292ee3 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:03.760114 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cb454fc2-38da-4698-9665-8884a6292ee3 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:03.907223 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cb454fc2-38da-4698-9665-8884a6292ee3 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:03.964705 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cb454fc2-38da-4698-9665-8884a6292ee3 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:04.035286 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb454fc2-38da-4698-9665-8884a6292ee3 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Pushing event updated for resources: {'Port': ['ID=a8718040-47a0-445b-9945-70916a800265,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:39:04.044029 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cb454fc2-38da-4698-9665-8884a6292ee3 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:04.142584 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.l3_db [None req-cb454fc2-38da-4698-9665-8884a6292ee3 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Floating IP 6b30fd91-6470-4a72-a74d-84beb135dcc6 associated. External IP: 172.26.0.216, port: 65ca937a-8471-4c50-bca1-78fbcfc42fb6. Nov 09 04:39:04.342038 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cb454fc2-38da-4698-9665-8884a6292ee3 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Router 203a01a6-369d-4e73-a6d0-b0605f8d5a6a has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:39:04.446629 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cb454fc2-38da-4698-9665-8884a6292ee3 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:39:04.456869 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ce5c1bdc-7f10-4d97-85b5-d73e4cdcada2 None None] Sync routers for ids ['203a01a6-369d-4e73-a6d0-b0605f8d5a6a'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:39:04.466571 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ce5c1bdc-7f10-4d97-85b5-d73e4cdcada2 None None] Routers {'203a01a6-369d-4e73-a6d0-b0605f8d5a6a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:39:04.467175 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-ce5c1bdc-7f10-4d97-85b5-d73e4cdcada2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:38:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['203a01a6-369d-4e73-a6d0-b0605f8d5a6a'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:39:04.524371 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cb454fc2-38da-4698-9665-8884a6292ee3 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:04.562685 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-cb454fc2-38da-4698-9665-8884a6292ee3 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 1.8131480 Nov 09 04:39:04.562685 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '04f80039-ab30-438a-adbf-bd30827f9a50', 'tag': '65ca937a-8471-4c50-bca1-78fbcfc42fb6'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:39:04.562685 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c53ae832-3c92-480a-a962-a128f8bd3267" -d '{"events": [{"name": "network-changed", "server_uuid": "04f80039-ab30-438a-adbf-bd30827f9a50", "tag": "65ca937a-8471-4c50-bca1-78fbcfc42fb6"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:39:04.574063 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-ce5c1bdc-7f10-4d97-85b5-d73e4cdcada2 None None] Set router 203a01a6-369d-4e73-a6d0-b0605f8d5a6a gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:39:04.649415 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:39:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bb89555e-8816-49f7-815f-9a9ee6084034 x-openstack-request-id: req-bb89555e-8816-49f7-815f-9a9ee6084034 {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:39:04.649949 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "04f80039-ab30-438a-adbf-bd30827f9a50", "tag": "65ca937a-8471-4c50-bca1-78fbcfc42fb6", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:39:04.649949 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-bb89555e-8816-49f7-815f-9a9ee6084034 {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:39:04.650336 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '04f80039-ab30-438a-adbf-bd30827f9a50', 'tag': '65ca937a-8471-4c50-bca1-78fbcfc42fb6', 'status': 'completed', 'code': 200} Nov 09 04:39:04.712847 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c53ae832-3c92-480a-a962-a128f8bd3267 req-da1c2a6e-de9e-4158-88d3-914b7692adf3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:04.714321 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c53ae832-3c92-480a-a962-a128f8bd3267 req-da1c2a6e-de9e-4158-88d3-914b7692adf3 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=f636e5f4c9f64f69ba3b2ab8816b6096&device_id=04f80039-ab30-438a-adbf-bd30827f9a50 HTTP/1.1" status: 200 len: 1099 time: 0.0401068 Nov 09 04:39:04.797423 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-ce5c1bdc-7f10-4d97-85b5-d73e4cdcada2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'name': 'tempest-TestVolumeBootPattern-1675179943-router', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.164'}], 'enable_snat': True}, 'gw_port_id': '873960f9-e8b5-48a6-a119-47c32f5b7968', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:34:33Z', 'updated_at': '2021-11-09T04:34:38Z', 'revision_number': 4, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'gw_port': {'id': '873960f9-e8b5-48a6-a119-47c32f5b7968', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:95:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1097, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.164', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:34:34Z', 'updated_at': '2021-11-09T04:34:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '6b30fd91-6470-4a72-a74d-84beb135dcc6', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'floating_ip_address': '172.26.0.216', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'port_id': '65ca937a-8471-4c50-bca1-78fbcfc42fb6', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 1404, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf', 'mac_address': 'fa:16:3e:1f:06:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04f80039-ab30-438a-adbf-bd30827f9a50', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:39:03Z', 'updated_at': '2021-11-09T04:39:03Z', 'revision_number': 0, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a5f1e54d-1d98-4741-a1ce-59f4cfb5b332', 'name': '', 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'mac_address': 'fa:16:3e:de:ab:2f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1107, 'fixed_ips': [{'subnet_id': 'f6a08667-654b-4e0c-9f85-c6e6712cc239', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:34:37Z', 'updated_at': '2021-11-09T04:34:46Z', 'revision_number': 5, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'subnets': [{'id': 'f6a08667-654b-4e0c-9f85-c6e6712cc239', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:39:04.806351 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c53ae832-3c92-480a-a962-a128f8bd3267 req-2b4b2210-2245-435c-b2ae-53fcaa51048b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:04.807830 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c53ae832-3c92-480a-a962-a128f8bd3267 req-2b4b2210-2245-435c-b2ae-53fcaa51048b service neutron] 10.222.0.26 "GET /v2.0/networks?id=999b1b20-f8fc-4caf-84cc-3feda426a0bf HTTP/1.1" status: 200 len: 913 time: 0.0860364 Nov 09 04:39:04.823766 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ce5c1bdc-7f10-4d97-85b5-d73e4cdcada2 None None] Checking router: 203a01a6-369d-4e73-a6d0-b0605f8d5a6a for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:39:04.832126 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ce5c1bdc-7f10-4d97-85b5-d73e4cdcada2 None None] Routers {'203a01a6-369d-4e73-a6d0-b0605f8d5a6a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:39:04.832725 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-ce5c1bdc-7f10-4d97-85b5-d73e4cdcada2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:38:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['203a01a6-369d-4e73-a6d0-b0605f8d5a6a'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:39:04.871348 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c53ae832-3c92-480a-a962-a128f8bd3267 req-c2437d9a-a237-421d-a58a-b0adb9e260e3 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=65ca937a-8471-4c50-bca1-78fbcfc42fb6 HTTP/1.1" status: 200 len: 1000 time: 0.0560491 Nov 09 04:39:04.924756 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c53ae832-3c92-480a-a962-a128f8bd3267 req-043c62b6-974f-4b17-a2c2-90a85e8e1815 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:04.926224 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c53ae832-3c92-480a-a962-a128f8bd3267 req-043c62b6-974f-4b17-a2c2-90a85e8e1815 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=f6a08667-654b-4e0c-9f85-c6e6712cc239 HTTP/1.1" status: 200 len: 851 time: 0.0479538 Nov 09 04:39:04.936921 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-ce5c1bdc-7f10-4d97-85b5-d73e4cdcada2 None None] Set router 203a01a6-369d-4e73-a6d0-b0605f8d5a6a gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:39:04.972715 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c53ae832-3c92-480a-a962-a128f8bd3267 req-3ad39d94-0de8-4743-9c48-0452b18e637a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:04.974181 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c53ae832-3c92-480a-a962-a128f8bd3267 req-3ad39d94-0de8-4743-9c48-0452b18e637a service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=999b1b20-f8fc-4caf-84cc-3feda426a0bf&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0400357 Nov 09 04:39:05.063495 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c53ae832-3c92-480a-a962-a128f8bd3267 req-c741ba06-1f32-4a3f-a482-3293c5b27f28 service neutron] 10.222.0.26 "GET /v2.0/networks/999b1b20-f8fc-4caf-84cc-3feda426a0bf?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0814846 Nov 09 04:39:05.156009 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-ce5c1bdc-7f10-4d97-85b5-d73e4cdcada2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'name': 'tempest-TestVolumeBootPattern-1675179943-router', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.164'}], 'enable_snat': True}, 'gw_port_id': '873960f9-e8b5-48a6-a119-47c32f5b7968', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:34:33Z', 'updated_at': '2021-11-09T04:34:38Z', 'revision_number': 4, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'gw_port': {'id': '873960f9-e8b5-48a6-a119-47c32f5b7968', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:95:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1097, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.164', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:34:34Z', 'updated_at': '2021-11-09T04:34:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '6b30fd91-6470-4a72-a74d-84beb135dcc6', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'floating_ip_address': '172.26.0.216', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'port_id': '65ca937a-8471-4c50-bca1-78fbcfc42fb6', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 1404, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf', 'mac_address': 'fa:16:3e:1f:06:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04f80039-ab30-438a-adbf-bd30827f9a50', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:39:03Z', 'updated_at': '2021-11-09T04:39:03Z', 'revision_number': 0, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a5f1e54d-1d98-4741-a1ce-59f4cfb5b332', 'name': '', 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'mac_address': 'fa:16:3e:de:ab:2f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1107, 'fixed_ips': [{'subnet_id': 'f6a08667-654b-4e0c-9f85-c6e6712cc239', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:34:37Z', 'updated_at': '2021-11-09T04:34:46Z', 'revision_number': 5, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'subnets': [{'id': 'f6a08667-654b-4e0c-9f85-c6e6712cc239', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:39:05.162634 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c53ae832-3c92-480a-a962-a128f8bd3267 req-cb4940e0-ae6a-4057-ba8d-6b77be275439 service neutron] 10.222.0.26 "GET /v2.0/networks/999b1b20-f8fc-4caf-84cc-3feda426a0bf?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0849223 Nov 09 04:39:05.185005 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ce5c1bdc-7f10-4d97-85b5-d73e4cdcada2 None None] The sync data for ids ['203a01a6-369d-4e73-a6d0-b0605f8d5a6a'] in dv-neutron-816802-2-hyperv is: [{'id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'name': 'tempest-TestVolumeBootPattern-1675179943-router', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.164'}], 'enable_snat': True}, 'gw_port_id': '873960f9-e8b5-48a6-a119-47c32f5b7968', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:34:33Z', 'updated_at': '2021-11-09T04:34:38Z', 'revision_number': 4, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'gw_port': {'id': '873960f9-e8b5-48a6-a119-47c32f5b7968', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:95:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1097, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.164', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:34:34Z', 'updated_at': '2021-11-09T04:34:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '6b30fd91-6470-4a72-a74d-84beb135dcc6', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'floating_ip_address': '172.26.0.216', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'port_id': '65ca937a-8471-4c50-bca1-78fbcfc42fb6', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 1404, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf', 'mac_address': 'fa:16:3e:1f:06:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04f80039-ab30-438a-adbf-bd30827f9a50', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:39:03Z', 'updated_at': '2021-11-09T04:39:03Z', 'revision_number': 0, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a5f1e54d-1d98-4741-a1ce-59f4cfb5b332', 'name': '', 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'mac_address': 'fa:16:3e:de:ab:2f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1107, 'fixed_ips': [{'subnet_id': 'f6a08667-654b-4e0c-9f85-c6e6712cc239', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:34:37Z', 'updated_at': '2021-11-09T04:34:46Z', 'revision_number': 5, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'subnets': [{'id': 'f6a08667-654b-4e0c-9f85-c6e6712cc239', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:39:05.362456 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-61fd27b4-111e-453c-b64f-88d3c557424c None None] New status for floating IP 6b30fd91-6470-4a72-a74d-84beb135dcc6: ACTIVE {{(pid=102164) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 04:39:10.044455 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2c11669-9221-4d71-9622-469721dec01a req-f01a3c9c-546f-44b5-adfb-57820e5c0808 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:10.046505 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e2c11669-9221-4d71-9622-469721dec01a req-f01a3c9c-546f-44b5-adfb-57820e5c0808 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=4ce7e684-ab7e-472a-9a8b-5af06f76e48d HTTP/1.1" status: 200 len: 945 time: 0.0486290 Nov 09 04:39:10.096969 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e2c11669-9221-4d71-9622-469721dec01a req-dc26ffe2-ddf8-4c90-b95b-cd4193dfd395 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=bb8c7272-b48f-4a58-8275-a888de0a12b0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0428689 Nov 09 04:39:11.211803 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec158fa5-2cb4-4e70-9c64-1281937af1e2 req-e147ed54-79e4-4f75-ad11-53b2cabccde5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:11.213258 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ec158fa5-2cb4-4e70-9c64-1281937af1e2 req-e147ed54-79e4-4f75-ad11-53b2cabccde5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=4ce7e684-ab7e-472a-9a8b-5af06f76e48d HTTP/1.1" status: 200 len: 945 time: 0.0480907 Nov 09 04:39:11.266962 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ec158fa5-2cb4-4e70-9c64-1281937af1e2 req-e8341efe-e411-4087-9d11-21242c3cdc19 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=bb8c7272-b48f-4a58-8275-a888de0a12b0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0474992 Nov 09 04:39:11.376124 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0dd3fcab-8d16-48b9-99ba-1392eda365d1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:11.448006 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ad216ba-8b3a-4a20-b14e-e710e2c7b3b6 req-967993a1-e83f-415f-87e5-28c0a36f9322 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:11.449351 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4ad216ba-8b3a-4a20-b14e-e710e2c7b3b6 req-967993a1-e83f-415f-87e5-28c0a36f9322 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "GET /v2.0/ports?device_id=4ce7e684-ab7e-472a-9a8b-5af06f76e48d HTTP/1.1" status: 200 len: 945 time: 0.0519454 Nov 09 04:39:11.541963 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-4ad216ba-8b3a-4a20-b14e-e710e2c7b3b6 req-fe3b265f-47cb-4e78-a8eb-f7c8a491f266 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Deleting port e9035c2a-0c37-4cb2-a2db-bf779b1a4f49 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:39:11.542292 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-4ad216ba-8b3a-4a20-b14e-e710e2c7b3b6 req-fe3b265f-47cb-4e78-a8eb-f7c8a491f266 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:11.632975 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-4ad216ba-8b3a-4a20-b14e-e710e2c7b3b6 req-fe3b265f-47cb-4e78-a8eb-f7c8a491f266 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] For port e9035c2a-0c37-4cb2-a2db-bf779b1a4f49, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=e9035c2a-0c37-4cb2-a2db-bf779b1a4f49,segment=NetworkSegment(2ebee1f6-c165-461d-bb96-18710a0d5427),segment_id=2ebee1f6-c165-461d-bb96-18710a0d5427)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:39:11.633326 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-4ad216ba-8b3a-4a20-b14e-e710e2c7b3b6 req-fe3b265f-47cb-4e78-a8eb-f7c8a491f266 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:12.110676 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-4ad216ba-8b3a-4a20-b14e-e710e2c7b3b6 req-fe3b265f-47cb-4e78-a8eb-f7c8a491f266 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:12.111030 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-4ad216ba-8b3a-4a20-b14e-e710e2c7b3b6 req-fe3b265f-47cb-4e78-a8eb-f7c8a491f266 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:12.111340 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.l3_db [req-4ad216ba-8b3a-4a20-b14e-e710e2c7b3b6 req-fe3b265f-47cb-4e78-a8eb-f7c8a491f266 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Floating IP 64273749-584c-4af7-8f7e-224624cdeec2 disassociated. External IP: 172.26.0.65, port: e9035c2a-0c37-4cb2-a2db-bf779b1a4f49. Nov 09 04:39:12.111742 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-4ad216ba-8b3a-4a20-b14e-e710e2c7b3b6 req-fe3b265f-47cb-4e78-a8eb-f7c8a491f266 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Calling delete_port for e9035c2a-0c37-4cb2-a2db-bf779b1a4f49 owned by compute:nova {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:39:12.247458 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:12.302065 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-4ad216ba-8b3a-4a20-b14e-e710e2c7b3b6 req-fe3b265f-47cb-4e78-a8eb-f7c8a491f266 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:12.330495 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe3b265f-47cb-4e78-a8eb-f7c8a491f266 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'Port': ['ID=e9035c2a-0c37-4cb2-a2db-bf779b1a4f49,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:39:12.398930 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f08da861-f6a8-4f95-9dc6-215df7201690 req-84529f97-1104-4170-a91e-d73abba27cb6 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=4ce7e684-ab7e-472a-9a8b-5af06f76e48d HTTP/1.1" status: 200 len: 210 time: 0.0607722 Nov 09 04:39:12.466585 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [req-4ad216ba-8b3a-4a20-b14e-e710e2c7b3b6 req-fe3b265f-47cb-4e78-a8eb-f7c8a491f266 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Router b9fe8b76-742f-4072-b1f1-39a9dbe806a5 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:39:12.583903 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-4ad216ba-8b3a-4a20-b14e-e710e2c7b3b6 req-fe3b265f-47cb-4e78-a8eb-f7c8a491f266 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:39:12.594349 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f108a9e0-03d5-464c-bb67-70e66e6649dc None None] Sync routers for ids ['b9fe8b76-742f-4072-b1f1-39a9dbe806a5'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:39:12.604250 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f108a9e0-03d5-464c-bb67-70e66e6649dc None None] Routers {'b9fe8b76-742f-4072-b1f1-39a9dbe806a5'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:39:12.604788 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-f108a9e0-03d5-464c-bb67-70e66e6649dc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:38:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['b9fe8b76-742f-4072-b1f1-39a9dbe806a5'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:39:12.628779 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-4ad216ba-8b3a-4a20-b14e-e710e2c7b3b6 req-fe3b265f-47cb-4e78-a8eb-f7c8a491f266 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] No DVR routers for this DVR port e9035c2a-0c37-4cb2-a2db-bf779b1a4f49 on host hv-neutron-8168 {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:39:12.631677 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-4ad216ba-8b3a-4a20-b14e-e710e2c7b3b6 req-fe3b265f-47cb-4e78-a8eb-f7c8a491f266 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:12.635455 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4ad216ba-8b3a-4a20-b14e-e710e2c7b3b6 req-fe3b265f-47cb-4e78-a8eb-f7c8a491f266 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "DELETE /v2.0/ports/e9035c2a-0c37-4cb2-a2db-bf779b1a4f49 HTTP/1.1" status: 204 len: 173 time: 1.1752648 Nov 09 04:39:12.636061 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4ce7e684-ab7e-472a-9a8b-5af06f76e48d', 'name': 'network-vif-deleted', 'tag': 'e9035c2a-0c37-4cb2-a2db-bf779b1a4f49'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:39:12.639138 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d18958cb-0b40-41e4-845a-69c08d7181d1" -d '{"events": [{"server_uuid": "4ce7e684-ab7e-472a-9a8b-5af06f76e48d", "name": "network-vif-deleted", "tag": "e9035c2a-0c37-4cb2-a2db-bf779b1a4f49"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:39:12.680669 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:39:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-60796e04-04ca-46db-a6c2-532688df3e89 x-openstack-request-id: req-60796e04-04ca-46db-a6c2-532688df3e89 {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:39:12.685903 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4ce7e684-ab7e-472a-9a8b-5af06f76e48d", "name": "network-vif-deleted", "tag": "e9035c2a-0c37-4cb2-a2db-bf779b1a4f49", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:39:12.685903 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-60796e04-04ca-46db-a6c2-532688df3e89 {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:39:12.685903 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4ce7e684-ab7e-472a-9a8b-5af06f76e48d', 'name': 'network-vif-deleted', 'tag': 'e9035c2a-0c37-4cb2-a2db-bf779b1a4f49', 'status': 'completed', 'code': 200} Nov 09 04:39:12.719077 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-f108a9e0-03d5-464c-bb67-70e66e6649dc None None] Set router b9fe8b76-742f-4072-b1f1-39a9dbe806a5 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:39:13.077525 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-f108a9e0-03d5-464c-bb67-70e66e6649dc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'name': 'tempest-TestNetworkBasicOps-router-473737147', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.35'}], 'enable_snat': True}, 'gw_port_id': '965ebc5f-0c00-46a9-aaf1-8ed04be937c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:37:20Z', 'updated_at': '2021-11-09T04:37:25Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '965ebc5f-0c00-46a9-aaf1-8ed04be937c6', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:d0:85:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1376, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:37:21Z', 'updated_at': '2021-11-09T04:37:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'a294c982-9115-446d-9b80-0b74de52d18d', 'name': '', 'network_id': '4ca58d86-8d4d-408b-8308-dfa9f89406f0', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:6f:5c:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1379, 'fixed_ips': [{'subnet_id': '555b0d63-4eb8-45a4-a06a-bbcb72506fcd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:37:24Z', 'updated_at': '2021-11-09T04:37:27Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '555b0d63-4eb8-45a4-a06a-bbcb72506fcd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:39:13.106428 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f108a9e0-03d5-464c-bb67-70e66e6649dc None None] Checking router: b9fe8b76-742f-4072-b1f1-39a9dbe806a5 for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:39:13.116243 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f108a9e0-03d5-464c-bb67-70e66e6649dc None None] Routers {'b9fe8b76-742f-4072-b1f1-39a9dbe806a5'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:39:13.116948 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-f108a9e0-03d5-464c-bb67-70e66e6649dc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:38:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['b9fe8b76-742f-4072-b1f1-39a9dbe806a5'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:39:13.229322 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-f108a9e0-03d5-464c-bb67-70e66e6649dc None None] Set router b9fe8b76-742f-4072-b1f1-39a9dbe806a5 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:39:13.441719 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-f108a9e0-03d5-464c-bb67-70e66e6649dc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'name': 'tempest-TestNetworkBasicOps-router-473737147', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.35'}], 'enable_snat': True}, 'gw_port_id': '965ebc5f-0c00-46a9-aaf1-8ed04be937c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:37:20Z', 'updated_at': '2021-11-09T04:37:25Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '965ebc5f-0c00-46a9-aaf1-8ed04be937c6', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:d0:85:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1376, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:37:21Z', 'updated_at': '2021-11-09T04:37:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'a294c982-9115-446d-9b80-0b74de52d18d', 'name': '', 'network_id': '4ca58d86-8d4d-408b-8308-dfa9f89406f0', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:6f:5c:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1379, 'fixed_ips': [{'subnet_id': '555b0d63-4eb8-45a4-a06a-bbcb72506fcd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:37:24Z', 'updated_at': '2021-11-09T04:37:27Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '555b0d63-4eb8-45a4-a06a-bbcb72506fcd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:39:13.476530 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f108a9e0-03d5-464c-bb67-70e66e6649dc None None] The sync data for ids ['b9fe8b76-742f-4072-b1f1-39a9dbe806a5'] in dv-neutron-816802-2-hyperv is: [{'id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'name': 'tempest-TestNetworkBasicOps-router-473737147', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.35'}], 'enable_snat': True}, 'gw_port_id': '965ebc5f-0c00-46a9-aaf1-8ed04be937c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:37:20Z', 'updated_at': '2021-11-09T04:37:25Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '965ebc5f-0c00-46a9-aaf1-8ed04be937c6', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:d0:85:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1376, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:37:21Z', 'updated_at': '2021-11-09T04:37:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'a294c982-9115-446d-9b80-0b74de52d18d', 'name': '', 'network_id': '4ca58d86-8d4d-408b-8308-dfa9f89406f0', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:6f:5c:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1379, 'fixed_ips': [{'subnet_id': '555b0d63-4eb8-45a4-a06a-bbcb72506fcd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:37:24Z', 'updated_at': '2021-11-09T04:37:27Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '555b0d63-4eb8-45a4-a06a-bbcb72506fcd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:39:13.526801 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fcc9014b-ab26-412b-b586-d00a660ce554 req-80c6ba74-05ba-4eef-8d0f-9c3767e706b2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=4ce7e684-ab7e-472a-9a8b-5af06f76e48d HTTP/1.1" status: 200 len: 210 time: 0.0313833 Nov 09 04:39:13.689978 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ffd421a6-674f-4f79-9678-740e9fdffa7c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:13.717775 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-62c7ef5b-d569-427f-8d35-9fb7181172c1 None None] New status for floating IP 64273749-584c-4af7-8f7e-224624cdeec2: DOWN {{(pid=102164) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 04:39:14.586598 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 60284) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:39:14.642394 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c2293bae-83de-4f01-8166-bc731230d60b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:14.666837 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c2293bae-83de-4f01-8166-bc731230d60b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:14.772902 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c2293bae-83de-4f01-8166-bc731230d60b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:14.775460 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c2293bae-83de-4f01-8166-bc731230d60b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:14.776593 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-c2293bae-83de-4f01-8166-bc731230d60b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "DELETE /v2.0/security-groups/bb8c7272-b48f-4a58-8275-a888de0a12b0 HTTP/1.1" status: 204 len: 168 time: 0.1890090 Nov 09 04:39:14.797510 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2293bae-83de-4f01-8166-bc731230d60b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=bb8c7272-b48f-4a58-8275-a888de0a12b0,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:39:14.882492 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 60288) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:39:15.002470 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-5ba0f2c7-3ef6-487a-baed-22e7663009c5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Deleting port 71852c1d-2c17-4a8d-8cf8-3fca0a63af06 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:39:15.002799 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5ba0f2c7-3ef6-487a-baed-22e7663009c5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:15.079196 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5ba0f2c7-3ef6-487a-baed-22e7663009c5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:15.079429 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5ba0f2c7-3ef6-487a-baed-22e7663009c5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:15.091060 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-5ba0f2c7-3ef6-487a-baed-22e7663009c5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Calling delete_port for 71852c1d-2c17-4a8d-8cf8-3fca0a63af06 owned by network:floatingip {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:39:15.098996 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:15.267307 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5ba0f2c7-3ef6-487a-baed-22e7663009c5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:15.293086 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ba0f2c7-3ef6-487a-baed-22e7663009c5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'Port': ['ID=71852c1d-2c17-4a8d-8cf8-3fca0a63af06,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:39:15.352595 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5ba0f2c7-3ef6-487a-baed-22e7663009c5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for floatingip, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:15.355115 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5ba0f2c7-3ef6-487a-baed-22e7663009c5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:15.356239 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-5ba0f2c7-3ef6-487a-baed-22e7663009c5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "DELETE /v2.0/floatingips/64273749-584c-4af7-8f7e-224624cdeec2 HTTP/1.1" status: 204 len: 168 time: 0.4726889 Nov 09 04:39:15.626208 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device e9035c2a-0c37-4cb2-a2db-bf779b1a4f49 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:39:15.645872 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] No Port match for: e9035c2a-0c37-4cb2-a2db-bf779b1a4f49 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:39:15.646210 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device e9035c2a-0c37-4cb2-a2db-bf779b1a4f49 not bound to the agent host hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:39:15.745262 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94f513f5-0647-4b20-94d7-4ab89daa8142 req-ddc3dc0b-e67a-461f-8a71-91da9682da00 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:15.746725 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-94f513f5-0647-4b20-94d7-4ab89daa8142 req-ddc3dc0b-e67a-461f-8a71-91da9682da00 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=dd729d7d-d632-48e2-ad4b-7ce1cb65ee60 HTTP/1.1" status: 200 len: 946 time: 0.0477943 Nov 09 04:39:15.800042 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-94f513f5-0647-4b20-94d7-4ab89daa8142 req-fb9cbff9-a1fc-404a-a92f-76a79f420959 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=7150f69a-1583-405c-a9de-a6e7b0c1a2a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0467432 Nov 09 04:39:16.444038 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:16.923352 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2c692f9-0b4a-441d-8881-a0eff34bb2db req-220d7a49-6151-4dca-b28e-4e93f4df53b0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:16.924826 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b2c692f9-0b4a-441d-8881-a0eff34bb2db req-220d7a49-6151-4dca-b28e-4e93f4df53b0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=dd729d7d-d632-48e2-ad4b-7ce1cb65ee60 HTTP/1.1" status: 200 len: 946 time: 0.0488381 Nov 09 04:39:16.944774 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:16.973416 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b2c692f9-0b4a-441d-8881-a0eff34bb2db req-987d0fb7-3a74-4f91-a4b2-71a68d85ff89 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=7150f69a-1583-405c-a9de-a6e7b0c1a2a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427217 Nov 09 04:39:17.102058 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-713fbc16-1954-4fbb-9843-a666ccf99575 req-e986b64e-b513-4bd5-988e-425a60aa322a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:17.103412 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-713fbc16-1954-4fbb-9843-a666ccf99575 req-e986b64e-b513-4bd5-988e-425a60aa322a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "GET /v2.0/ports?device_id=dd729d7d-d632-48e2-ad4b-7ce1cb65ee60 HTTP/1.1" status: 200 len: 946 time: 0.0469246 Nov 09 04:39:17.191994 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-713fbc16-1954-4fbb-9843-a666ccf99575 req-9e60d493-b7fd-4638-92e7-7e5b0e40efc5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Deleting port 1f0f5130-353d-4b95-ab61-f19dec355529 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:39:17.192331 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-713fbc16-1954-4fbb-9843-a666ccf99575 req-9e60d493-b7fd-4638-92e7-7e5b0e40efc5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:17.282098 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-713fbc16-1954-4fbb-9843-a666ccf99575 req-9e60d493-b7fd-4638-92e7-7e5b0e40efc5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] For port 1f0f5130-353d-4b95-ab61-f19dec355529, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=1f0f5130-353d-4b95-ab61-f19dec355529,segment=NetworkSegment(2ebee1f6-c165-461d-bb96-18710a0d5427),segment_id=2ebee1f6-c165-461d-bb96-18710a0d5427)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:39:17.282492 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-713fbc16-1954-4fbb-9843-a666ccf99575 req-9e60d493-b7fd-4638-92e7-7e5b0e40efc5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:17.295015 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-713fbc16-1954-4fbb-9843-a666ccf99575 req-9e60d493-b7fd-4638-92e7-7e5b0e40efc5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Calling delete_port for 1f0f5130-353d-4b95-ab61-f19dec355529 owned by compute:nova {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:39:17.478714 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-713fbc16-1954-4fbb-9843-a666ccf99575 req-9e60d493-b7fd-4638-92e7-7e5b0e40efc5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:17.506614 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e60d493-b7fd-4638-92e7-7e5b0e40efc5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'Port': ['ID=1f0f5130-353d-4b95-ab61-f19dec355529,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:39:17.548488 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-713fbc16-1954-4fbb-9843-a666ccf99575 req-9e60d493-b7fd-4638-92e7-7e5b0e40efc5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] No DVR routers for this DVR port 1f0f5130-353d-4b95-ab61-f19dec355529 on host hv-neutron-8168 {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:39:17.551065 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-713fbc16-1954-4fbb-9843-a666ccf99575 req-9e60d493-b7fd-4638-92e7-7e5b0e40efc5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:17.558684 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-713fbc16-1954-4fbb-9843-a666ccf99575 req-9e60d493-b7fd-4638-92e7-7e5b0e40efc5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "DELETE /v2.0/ports/1f0f5130-353d-4b95-ab61-f19dec355529 HTTP/1.1" status: 204 len: 173 time: 0.4447918 Nov 09 04:39:17.558684 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'dd729d7d-d632-48e2-ad4b-7ce1cb65ee60', 'name': 'network-vif-deleted', 'tag': '1f0f5130-353d-4b95-ab61-f19dec355529'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:39:17.558684 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d9e6b430-17b1-4810-bc0f-38e342436f39" -d '{"events": [{"server_uuid": "dd729d7d-d632-48e2-ad4b-7ce1cb65ee60", "name": "network-vif-deleted", "tag": "1f0f5130-353d-4b95-ab61-f19dec355529"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:39:17.592410 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:39:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-882ec9df-9f47-44e4-a5ba-cb86cb8b6d70 x-openstack-request-id: req-882ec9df-9f47-44e4-a5ba-cb86cb8b6d70 {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:39:17.592699 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "dd729d7d-d632-48e2-ad4b-7ce1cb65ee60", "name": "network-vif-deleted", "tag": "1f0f5130-353d-4b95-ab61-f19dec355529", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:39:17.592949 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-882ec9df-9f47-44e4-a5ba-cb86cb8b6d70 {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:39:17.593342 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'dd729d7d-d632-48e2-ad4b-7ce1cb65ee60', 'name': 'network-vif-deleted', 'tag': '1f0f5130-353d-4b95-ab61-f19dec355529', 'status': 'completed', 'code': 200} Nov 09 04:39:18.076425 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-3edf6c4a-288b-44dd-be1e-d011626a9790 req-d533a4cc-faa8-49e4-bd9f-296f866c062f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=dd729d7d-d632-48e2-ad4b-7ce1cb65ee60 HTTP/1.1" status: 200 len: 210 time: 0.0257640 Nov 09 04:39:19.132449 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60304) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:39:19.188007 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-20f61134-5539-4670-8b09-017adb2bbf40 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:19.212647 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-20f61134-5539-4670-8b09-017adb2bbf40 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:19.378750 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-20f61134-5539-4670-8b09-017adb2bbf40 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:19.381366 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-20f61134-5539-4670-8b09-017adb2bbf40 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:19.382568 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-20f61134-5539-4670-8b09-017adb2bbf40 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "DELETE /v2.0/security-groups/7150f69a-1583-405c-a9de-a6e7b0c1a2a4 HTTP/1.1" status: 204 len: 168 time: 0.2490947 Nov 09 04:39:19.391664 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20f61134-5539-4670-8b09-017adb2bbf40 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=7150f69a-1583-405c-a9de-a6e7b0c1a2a4,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:39:19.399308 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20f61134-5539-4670-8b09-017adb2bbf40 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:39:19.399657 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20f61134-5539-4670-8b09-017adb2bbf40 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:39:19.399994 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20f61134-5539-4670-8b09-017adb2bbf40 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:39:19.400328 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20f61134-5539-4670-8b09-017adb2bbf40 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:39:19.400655 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20f61134-5539-4670-8b09-017adb2bbf40 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:39:19.400982 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20f61134-5539-4670-8b09-017adb2bbf40 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:39:19.401307 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20f61134-5539-4670-8b09-017adb2bbf40 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:39:19.401635 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20f61134-5539-4670-8b09-017adb2bbf40 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:39:19.401956 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20f61134-5539-4670-8b09-017adb2bbf40 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:39:19.402275 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20f61134-5539-4670-8b09-017adb2bbf40 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:39:19.402619 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20f61134-5539-4670-8b09-017adb2bbf40 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:39:19.402932 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20f61134-5539-4670-8b09-017adb2bbf40 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:39:19.479949 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60308) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:39:19.858836 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-429d03fb-742a-407c-9197-2f0b362707a2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:20.112057 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-429d03fb-742a-407c-9197-2f0b362707a2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Deleting port a294c982-9115-446d-9b80-0b74de52d18d {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:39:20.112300 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-429d03fb-742a-407c-9197-2f0b362707a2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:20.200396 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-429d03fb-742a-407c-9197-2f0b362707a2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] For port a294c982-9115-446d-9b80-0b74de52d18d, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=a294c982-9115-446d-9b80-0b74de52d18d,segment=NetworkSegment(2ebee1f6-c165-461d-bb96-18710a0d5427),segment_id=2ebee1f6-c165-461d-bb96-18710a0d5427)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:39:20.201122 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-429d03fb-742a-407c-9197-2f0b362707a2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:20.213661 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-429d03fb-742a-407c-9197-2f0b362707a2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Calling delete_port for a294c982-9115-446d-9b80-0b74de52d18d owned by network:router_interface {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:39:20.470327 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-429d03fb-742a-407c-9197-2f0b362707a2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:20.508603 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429d03fb-742a-407c-9197-2f0b362707a2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'Port': ['ID=a294c982-9115-446d-9b80-0b74de52d18d,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:39:20.701879 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-429d03fb-742a-407c-9197-2f0b362707a2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:20.954735 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-429d03fb-742a-407c-9197-2f0b362707a2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Router b9fe8b76-742f-4072-b1f1-39a9dbe806a5 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:39:21.062872 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-429d03fb-742a-407c-9197-2f0b362707a2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:39:21.069662 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-429d03fb-742a-407c-9197-2f0b362707a2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "PUT /v2.0/routers/b9fe8b76-742f-4072-b1f1-39a9dbe806a5/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5877519 Nov 09 04:39:21.073250 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60310) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:39:21.076920 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2b6ae8ba-d274-4e05-9b84-4fab26597119 None None] Sync routers for ids ['b9fe8b76-742f-4072-b1f1-39a9dbe806a5'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:39:21.089987 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2b6ae8ba-d274-4e05-9b84-4fab26597119 None None] Routers {'b9fe8b76-742f-4072-b1f1-39a9dbe806a5'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:39:21.090987 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-2b6ae8ba-d274-4e05-9b84-4fab26597119 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:39:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['b9fe8b76-742f-4072-b1f1-39a9dbe806a5'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:39:21.128731 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-be364b4a-3b9f-4245-9a4e-7dce3def0cfe tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Deleting subnet 555b0d63-4eb8-45a4-a06a-bbcb72506fcd {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:39:21.131949 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-be364b4a-3b9f-4245-9a4e-7dce3def0cfe tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:21.172958 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-be364b4a-3b9f-4245-9a4e-7dce3def0cfe tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:21.210991 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-2b6ae8ba-d274-4e05-9b84-4fab26597119 None None] Set router b9fe8b76-742f-4072-b1f1-39a9dbe806a5 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:39:21.255305 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-be364b4a-3b9f-4245-9a4e-7dce3def0cfe tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:21.390289 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-be364b4a-3b9f-4245-9a4e-7dce3def0cfe tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:21.395804 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-2b6ae8ba-d274-4e05-9b84-4fab26597119 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'name': 'tempest-TestNetworkBasicOps-router-473737147', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.35'}], 'enable_snat': True}, 'gw_port_id': '965ebc5f-0c00-46a9-aaf1-8ed04be937c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:37:20Z', 'updated_at': '2021-11-09T04:39:20Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '965ebc5f-0c00-46a9-aaf1-8ed04be937c6', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:d0:85:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1376, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:37:21Z', 'updated_at': '2021-11-09T04:37:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:39:21.419541 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be364b4a-3b9f-4245-9a4e-7dce3def0cfe tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'Subnet': ['ID=555b0d63-4eb8-45a4-a06a-bbcb72506fcd,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:39:21.421530 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-be364b4a-3b9f-4245-9a4e-7dce3def0cfe tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:21.425608 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-be364b4a-3b9f-4245-9a4e-7dce3def0cfe tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "DELETE /v2.0/subnets/555b0d63-4eb8-45a4-a06a-bbcb72506fcd HTTP/1.1" status: 204 len: 168 time: 0.3512332 Nov 09 04:39:21.428355 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 60312) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:39:21.434181 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-856814eb-c707-4e64-9494-58e69e2abcec None None] Network 4ca58d86-8d4d-408b-8308-dfa9f89406f0 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:39:21.434181 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2b6ae8ba-d274-4e05-9b84-4fab26597119 None None] Checking router: b9fe8b76-742f-4072-b1f1-39a9dbe806a5 for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:39:21.485227 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2b6ae8ba-d274-4e05-9b84-4fab26597119 None None] Routers {'b9fe8b76-742f-4072-b1f1-39a9dbe806a5'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:39:21.485861 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-2b6ae8ba-d274-4e05-9b84-4fab26597119 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:39:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['b9fe8b76-742f-4072-b1f1-39a9dbe806a5'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:39:21.535686 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3de4f302-7af5-482d-bdae-75a8cfaf86d9 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:21.633313 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-2b6ae8ba-d274-4e05-9b84-4fab26597119 None None] Set router b9fe8b76-742f-4072-b1f1-39a9dbe806a5 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:39:21.639209 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3de4f302-7af5-482d-bdae-75a8cfaf86d9 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router_gateway, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:21.664944 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 1f0f5130-353d-4b95-ab61-f19dec355529 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:39:21.712652 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8c8afcb0-1774-4c45-8878-a7f40788f7e9 None None] DHCP port deletion for 4ca58d86-8d4d-408b-8308-dfa9f89406f0 request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:39:21.724179 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] No Port match for: 1f0f5130-353d-4b95-ab61-f19dec355529 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:39:21.724523 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 1f0f5130-353d-4b95-ab61-f19dec355529 not bound to the agent host hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:39:21.753243 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-3de4f302-7af5-482d-bdae-75a8cfaf86d9 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Deleting port 965ebc5f-0c00-46a9-aaf1-8ed04be937c6 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:39:21.753575 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3de4f302-7af5-482d-bdae-75a8cfaf86d9 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:21.834454 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-3de4f302-7af5-482d-bdae-75a8cfaf86d9 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] For port 965ebc5f-0c00-46a9-aaf1-8ed04be937c6, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=965ebc5f-0c00-46a9-aaf1-8ed04be937c6,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:39:21.834979 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3de4f302-7af5-482d-bdae-75a8cfaf86d9 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:21.848147 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-3de4f302-7af5-482d-bdae-75a8cfaf86d9 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Calling delete_port for 965ebc5f-0c00-46a9-aaf1-8ed04be937c6 owned by network:router_gateway {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:39:21.849219 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-8c8afcb0-1774-4c45-8878-a7f40788f7e9 None None] Deleting port e366ffd3-3215-4be7-af97-99145a729e4b {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:39:21.849219 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8c8afcb0-1774-4c45-8878-a7f40788f7e9 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:21.919961 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-8c8afcb0-1774-4c45-8878-a7f40788f7e9 None None] For port e366ffd3-3215-4be7-af97-99145a729e4b, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=e366ffd3-3215-4be7-af97-99145a729e4b,segment=NetworkSegment(2ebee1f6-c165-461d-bb96-18710a0d5427),segment_id=2ebee1f6-c165-461d-bb96-18710a0d5427)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:39:21.920279 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8c8afcb0-1774-4c45-8878-a7f40788f7e9 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:21.936962 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-8c8afcb0-1774-4c45-8878-a7f40788f7e9 None None] Calling delete_port for e366ffd3-3215-4be7-af97-99145a729e4b owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:39:21.953514 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-2b6ae8ba-d274-4e05-9b84-4fab26597119 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'name': 'tempest-TestNetworkBasicOps-router-473737147', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.35'}], 'enable_snat': True}, 'gw_port_id': '965ebc5f-0c00-46a9-aaf1-8ed04be937c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:37:20Z', 'updated_at': '2021-11-09T04:39:20Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '965ebc5f-0c00-46a9-aaf1-8ed04be937c6', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:d0:85:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1376, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:37:21Z', 'updated_at': '2021-11-09T04:37:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:39:22.008274 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2b6ae8ba-d274-4e05-9b84-4fab26597119 None None] The sync data for ids ['b9fe8b76-742f-4072-b1f1-39a9dbe806a5'] in dv-neutron-816802-2-hyperv is: [{'id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'name': 'tempest-TestNetworkBasicOps-router-473737147', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.35'}], 'enable_snat': True}, 'gw_port_id': '965ebc5f-0c00-46a9-aaf1-8ed04be937c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:37:20Z', 'updated_at': '2021-11-09T04:39:20Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '965ebc5f-0c00-46a9-aaf1-8ed04be937c6', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:d0:85:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b9fe8b76-742f-4072-b1f1-39a9dbe806a5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1376, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:37:21Z', 'updated_at': '2021-11-09T04:37:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:39:22.135794 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3de4f302-7af5-482d-bdae-75a8cfaf86d9 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:22.161584 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8c8afcb0-1774-4c45-8878-a7f40788f7e9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:22.163892 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3de4f302-7af5-482d-bdae-75a8cfaf86d9 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'Port': ['ID=965ebc5f-0c00-46a9-aaf1-8ed04be937c6,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:39:22.188001 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c8afcb0-1774-4c45-8878-a7f40788f7e9 None None] Pushing event deleted for resources: {'Port': ['ID=e366ffd3-3215-4be7-af97-99145a729e4b,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:39:22.189864 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8c8afcb0-1774-4c45-8878-a7f40788f7e9 None None] No DVR routers for this DVR port e366ffd3-3215-4be7-af97-99145a729e4b on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:39:22.228185 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3de4f302-7af5-482d-bdae-75a8cfaf86d9 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-466373'] for router_gateway, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:22.319869 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3de4f302-7af5-482d-bdae-75a8cfaf86d9 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:22.321912 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3de4f302-7af5-482d-bdae-75a8cfaf86d9 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:22.447948 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3de4f302-7af5-482d-bdae-75a8cfaf86d9 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:22.448605 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3de4f302-7af5-482d-bdae-75a8cfaf86d9 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Fanout notify agent at l3_agent the message router_deleted on router b9fe8b76-742f-4072-b1f1-39a9dbe806a5 {{(pid=102162) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:39:22.462901 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3de4f302-7af5-482d-bdae-75a8cfaf86d9 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:22.465038 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-3de4f302-7af5-482d-bdae-75a8cfaf86d9 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "DELETE /v2.0/routers/b9fe8b76-742f-4072-b1f1-39a9dbe806a5 HTTP/1.1" status: 204 len: 168 time: 1.0347662 Nov 09 04:39:22.467374 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 60314) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:39:22.544651 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ed0fbe1c-287d-4287-b7c1-db0ec51b5edb tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:22.640478 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ed0fbe1c-287d-4287-b7c1-db0ec51b5edb tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:22.661084 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-ed0fbe1c-287d-4287-b7c1-db0ec51b5edb tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4ca58d86-8d4d-408b-8308-dfa9f89406f0']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:39:22.671366 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-ed0fbe1c-287d-4287-b7c1-db0ec51b5edb tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2ebee1f6-c165-461d-bb96-18710a0d5427') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:39:22.671659 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-ed0fbe1c-287d-4287-b7c1-db0ec51b5edb tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2ebee1f6-c165-461d-bb96-18710a0d5427') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:39:22.681299 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ed0fbe1c-287d-4287-b7c1-db0ec51b5edb tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:22.694471 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ed0fbe1c-287d-4287-b7c1-db0ec51b5edb tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:22.700054 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ed0fbe1c-287d-4287-b7c1-db0ec51b5edb tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Releasing vlan 346 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:39:22.700428 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ed0fbe1c-287d-4287-b7c1-db0ec51b5edb tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:22.703325 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:39:22.703325 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:39:22.703325 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:39:22.703325 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:39:22.703325 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:39:22.703325 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:39:22.703325 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:39:22.703325 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:39:22.703325 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:39:22.703325 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:39:22.703325 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:39:22.703325 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:39:22.703325 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:39:22.703325 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:39:22.703325 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:39:22.703325 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:39:22.703325 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:39:22.703325 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:39:22.703325 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:39:22.703325 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:39:22.703325 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:39:22.703325 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:39:22.703325 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:39:22.703325 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:39:22.703325 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:39:22.703325 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:39:22.703325 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:39:22.703325 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:39:22.703325 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:39:22.703325 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:39:22.703325 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:39:22.703325 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:39:22.895500 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ed0fbe1c-287d-4287-b7c1-db0ec51b5edb tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:22.899695 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ed0fbe1c-287d-4287-b7c1-db0ec51b5edb tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:22.907335 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-ed0fbe1c-287d-4287-b7c1-db0ec51b5edb tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "DELETE /v2.0/networks/4ca58d86-8d4d-408b-8308-dfa9f89406f0 HTTP/1.1" status: 204 len: 168 time: 0.4349227 Nov 09 04:39:22.917056 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed0fbe1c-287d-4287-b7c1-db0ec51b5edb tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'Network': ['ID=4ca58d86-8d4d-408b-8308-dfa9f89406f0,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:39:22.929729 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 60316) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:39:22.931686 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-70ff0608-2483-44ed-b95c-cc95806ce30e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'network': {'name': 'tempest-network-smoke--1841214448', 'project_id': '1d10b4824e524068827e58b55e269af3', 'port_security_enabled': True}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:39:23.012668 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-70ff0608-2483-44ed-b95c-cc95806ce30e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Made reservation on behalf of 1d10b4824e524068827e58b55e269af3 for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:39:23.016256 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-70ff0608-2483-44ed-b95c-cc95806ce30e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:23.044205 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-70ff0608-2483-44ed-b95c-cc95806ce30e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 313} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:39:23.055179 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-70ff0608-2483-44ed-b95c-cc95806ce30e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:23.055515 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-70ff0608-2483-44ed-b95c-cc95806ce30e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Added segment 3e8c180a-3f73-4be8-b3d7-21a3b0ec67c0 of type vlan for network 359658ce-f1c6-4bcf-90bc-4a816eebef8a Nov 09 04:39:23.106675 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-70ff0608-2483-44ed-b95c-cc95806ce30e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:23.215816 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-70ff0608-2483-44ed-b95c-cc95806ce30e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:23.221655 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-70ff0608-2483-44ed-b95c-cc95806ce30e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:23.222230 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-70ff0608-2483-44ed-b95c-cc95806ce30e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:23.329499 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70ff0608-2483-44ed-b95c-cc95806ce30e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Network': ['ID=359658ce-f1c6-4bcf-90bc-4a816eebef8a,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:39:23.341131 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 359658ce-f1c6-4bcf-90bc-4a816eebef8a details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:39:23.345147 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device a294c982-9115-446d-9b80-0b74de52d18d no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:39:23.352634 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-70ff0608-2483-44ed-b95c-cc95806ce30e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.4249561 Nov 09 04:39:23.355459 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 60318) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:39:23.359826 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-1544f467-3a0e-415f-bf78-8389d857ff12 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'router': {'name': 'tempest-TestNetworkBasicOps-router-1697092511', 'admin_state_up': True, 'project_id': '1d10b4824e524068827e58b55e269af3', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:39:23.380011 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: a294c982-9115-446d-9b80-0b74de52d18d {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:39:23.380354 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device a294c982-9115-446d-9b80-0b74de52d18d not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:39:23.380777 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 965ebc5f-0c00-46a9-aaf1-8ed04be937c6 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:39:23.429544 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 965ebc5f-0c00-46a9-aaf1-8ed04be937c6 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:39:23.429894 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 965ebc5f-0c00-46a9-aaf1-8ed04be937c6 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:39:23.430316 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device e366ffd3-3215-4be7-af97-99145a729e4b no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:39:23.456304 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: e366ffd3-3215-4be7-af97-99145a729e4b {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:39:23.456647 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device e366ffd3-3215-4be7-af97-99145a729e4b not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:39:23.459695 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1544f467-3a0e-415f-bf78-8389d857ff12 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:23.461140 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1544f467-3a0e-415f-bf78-8389d857ff12 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:23.475005 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:39:23.516788 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1544f467-3a0e-415f-bf78-8389d857ff12 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:23.706221 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1544f467-3a0e-415f-bf78-8389d857ff12 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:23.946389 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1544f467-3a0e-415f-bf78-8389d857ff12 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router_gateway, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:23.964389 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1544f467-3a0e-415f-bf78-8389d857ff12 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:24.068694 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-1544f467-3a0e-415f-bf78-8389d857ff12 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Allocated IP 172.26.0.142 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/98412fb7-ede7-41fa-a41f-2b1e63040f98) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:39:24.172970 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1544f467-3a0e-415f-bf78-8389d857ff12 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:24.271052 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1544f467-3a0e-415f-bf78-8389d857ff12 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:24.311670 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1544f467-3a0e-415f-bf78-8389d857ff12 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:39:24.316375 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-1544f467-3a0e-415f-bf78-8389d857ff12 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:39:24.319915 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1544f467-3a0e-415f-bf78-8389d857ff12 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:39:24.325287 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1544f467-3a0e-415f-bf78-8389d857ff12 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Port': ['ID=98412fb7-ede7-41fa-a41f-2b1e63040f98,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:39:24.999539 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1544f467-3a0e-415f-bf78-8389d857ff12 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router_gateway, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:25.193216 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1544f467-3a0e-415f-bf78-8389d857ff12 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:25.423959 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1544f467-3a0e-415f-bf78-8389d857ff12 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Router b186380e-ee5f-4e3e-a5f8-325fb4d3520b is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102162) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:39:25.533914 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1544f467-3a0e-415f-bf78-8389d857ff12 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:39:25.543702 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-61759b9c-1066-430f-8909-bcc7547db386 None None] Sync routers for ids ['b186380e-ee5f-4e3e-a5f8-325fb4d3520b'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:39:25.557186 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-61759b9c-1066-430f-8909-bcc7547db386 None None] Routers {'b186380e-ee5f-4e3e-a5f8-325fb4d3520b'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:39:25.560423 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-61759b9c-1066-430f-8909-bcc7547db386 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:39:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['b186380e-ee5f-4e3e-a5f8-325fb4d3520b'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:39:25.626233 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1544f467-3a0e-415f-bf78-8389d857ff12 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:25.627575 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-1544f467-3a0e-415f-bf78-8389d857ff12 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 887 time: 2.2712021 Nov 09 04:39:25.630990 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 60322) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:39:25.662022 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-2f66be39-44d8-4797-b70b-d926eb206ffa tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/subnets?project_id=1d10b4824e524068827e58b55e269af3&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0269520 Nov 09 04:39:25.662266 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 60324) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:39:25.664110 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-61759b9c-1066-430f-8909-bcc7547db386 None None] Set router b186380e-ee5f-4e3e-a5f8-325fb4d3520b gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:39:25.748845 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7d0e4107-70fd-454c-9d99-45a0805587aa tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:25.750511 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-7d0e4107-70fd-454c-9d99-45a0805587aa tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.0873127 Nov 09 04:39:25.753496 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 60326) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:39:25.787137 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-86986e72-66ed-427c-9d8c-76577a6ea712 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/subnets?network_id=2b6725f5-ebfe-485a-8f42-ccb5a241ddb5&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0323615 Nov 09 04:39:25.789600 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 60328) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:39:25.794264 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-ee4ff38a-0242-4178-bb6c-c29999cb3959 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-513514492', 'network_id': '359658ce-f1c6-4bcf-90bc-4a816eebef8a', 'project_id': '1d10b4824e524068827e58b55e269af3', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:39:25.851582 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-61759b9c-1066-430f-8909-bcc7547db386 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b186380e-ee5f-4e3e-a5f8-325fb4d3520b', 'name': 'tempest-TestNetworkBasicOps-router-1697092511', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.142'}], 'enable_snat': True}, 'gw_port_id': '98412fb7-ede7-41fa-a41f-2b1e63040f98', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:39:23Z', 'updated_at': '2021-11-09T04:39:24Z', 'revision_number': 3, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '98412fb7-ede7-41fa-a41f-2b1e63040f98', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:77:12:67', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b186380e-ee5f-4e3e-a5f8-325fb4d3520b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1408, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.142', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:39:23Z', 'updated_at': '2021-11-09T04:39:24Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:39:25.876628 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-61759b9c-1066-430f-8909-bcc7547db386 None None] Checking router: b186380e-ee5f-4e3e-a5f8-325fb4d3520b for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:39:25.876963 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-61759b9c-1066-430f-8909-bcc7547db386 None None] Updating router b186380e-ee5f-4e3e-a5f8-325fb4d3520b port 98412fb7-ede7-41fa-a41f-2b1e63040f98 binding host dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 04:39:25.902346 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-61759b9c-1066-430f-8909-bcc7547db386 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:25.972580 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ee4ff38a-0242-4178-bb6c-c29999cb3959 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Made reservation on behalf of 1d10b4824e524068827e58b55e269af3 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:39:25.976163 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ee4ff38a-0242-4178-bb6c-c29999cb3959 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:26.157682 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-61759b9c-1066-430f-8909-bcc7547db386 None None] Publish callbacks [] for port, precommit_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:26.230225 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ee4ff38a-0242-4178-bb6c-c29999cb3959 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:26.249800 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-61759b9c-1066-430f-8909-bcc7547db386 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:26.288986 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee4ff38a-0242-4178-bb6c-c29999cb3959 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Subnet': ['ID=79c0d1fe-bd0e-4079-abdb-8e32c802a558,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:39:26.298102 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ee4ff38a-0242-4178-bb6c-c29999cb3959 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Checking segment: {'id': '3e8c180a-3f73-4be8-b3d7-21a3b0ec67c0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 313, 'network_id': '359658ce-f1c6-4bcf-90bc-4a816eebef8a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:39:26.298488 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ee4ff38a-0242-4178-bb6c-c29999cb3959 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network hostable DHCP agents. Network: 359658ce-f1c6-4bcf-90bc-4a816eebef8a, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:39:26.304977 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53955b90-b0d0-4e32-b0b5-35a2e0a46c9d None None] Pushing event updated for resources: {'Port': ['ID=98412fb7-ede7-41fa-a41f-2b1e63040f98,revision_number=2']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:39:26.307275 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-61759b9c-1066-430f-8909-bcc7547db386 None None] Attempting to bind port 98412fb7-ede7-41fa-a41f-2b1e63040f98 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:39:26.307708 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-61759b9c-1066-430f-8909-bcc7547db386 None None] Attempting to bind port 98412fb7-ede7-41fa-a41f-2b1e63040f98 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:39:26.308057 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61759b9c-1066-430f-8909-bcc7547db386 None None] Attempting to bind port 98412fb7-ede7-41fa-a41f-2b1e63040f98 on network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:39:26.317827 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61759b9c-1066-430f-8909-bcc7547db386 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 39, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:39:26.321345 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61759b9c-1066-430f-8909-bcc7547db386 None None] Checking segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102164) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:39:26.321345 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-61759b9c-1066-430f-8909-bcc7547db386 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:26.321345 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61759b9c-1066-430f-8909-bcc7547db386 None None] Bound using segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:39:26.321345 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-61759b9c-1066-430f-8909-bcc7547db386 None None] Bound port: 98412fb7-ede7-41fa-a41f-2b1e63040f98, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:39:26.321345 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-61759b9c-1066-430f-8909-bcc7547db386 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:26.322640 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53955b90-b0d0-4e32-b0b5-35a2e0a46c9d None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:39:26.322984 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53955b90-b0d0-4e32-b0b5-35a2e0a46c9d None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:39:26.323319 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53955b90-b0d0-4e32-b0b5-35a2e0a46c9d None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:39:26.323645 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53955b90-b0d0-4e32-b0b5-35a2e0a46c9d None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:39:26.323971 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53955b90-b0d0-4e32-b0b5-35a2e0a46c9d None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:39:26.324297 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53955b90-b0d0-4e32-b0b5-35a2e0a46c9d None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:39:26.324619 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53955b90-b0d0-4e32-b0b5-35a2e0a46c9d None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:39:26.324937 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53955b90-b0d0-4e32-b0b5-35a2e0a46c9d None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:39:26.325256 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53955b90-b0d0-4e32-b0b5-35a2e0a46c9d None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:39:26.325682 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53955b90-b0d0-4e32-b0b5-35a2e0a46c9d None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:39:26.326062 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53955b90-b0d0-4e32-b0b5-35a2e0a46c9d None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:39:26.326466 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53955b90-b0d0-4e32-b0b5-35a2e0a46c9d None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:39:26.377540 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-61759b9c-1066-430f-8909-bcc7547db386 None None] For port 98412fb7-ede7-41fa-a41f-2b1e63040f98, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102164) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:39:26.381011 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-61759b9c-1066-430f-8909-bcc7547db386 None None] For port 98412fb7-ede7-41fa-a41f-2b1e63040f98, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=98412fb7-ede7-41fa-a41f-2b1e63040f98,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102164) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:39:26.390055 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ee4ff38a-0242-4178-bb6c-c29999cb3959 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network 359658ce-f1c6-4bcf-90bc-4a816eebef8a is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:39:26.439376 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-61759b9c-1066-430f-8909-bcc7547db386 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:26.464534 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-ee4ff38a-0242-4178-bb6c-c29999cb3959 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 359658ce-f1c6-4bcf-90bc-4a816eebef8a) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:39:26.469340 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ee4ff38a-0242-4178-bb6c-c29999cb3959 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:26.469972 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ee4ff38a-0242-4178-bb6c-c29999cb3959 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:26.477516 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-398c0843-8772-48ad-aada-55fe6340609a None None] Network 359658ce-f1c6-4bcf-90bc-4a816eebef8a requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:39:26.495574 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-61759b9c-1066-430f-8909-bcc7547db386 None None] Routers {'b186380e-ee5f-4e3e-a5f8-325fb4d3520b'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:39:26.496276 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-61759b9c-1066-430f-8909-bcc7547db386 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:39:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['b186380e-ee5f-4e3e-a5f8-325fb4d3520b'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:39:26.545432 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53955b90-b0d0-4e32-b0b5-35a2e0a46c9d None None] Pushing event updated for resources: {'Port': ['ID=98412fb7-ede7-41fa-a41f-2b1e63040f98,revision_number=3']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:39:26.572881 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-ee4ff38a-0242-4178-bb6c-c29999cb3959 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 831 time: 0.7822611 Nov 09 04:39:26.575672 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 60332) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:39:26.631812 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-61759b9c-1066-430f-8909-bcc7547db386 None None] Set router b186380e-ee5f-4e3e-a5f8-325fb4d3520b gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:39:26.645959 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-07272330-5fe8-4a05-96e0-6c46cca7f9bc None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-359658ce-f1c6-4bcf-90bc-4a816eebef8a', 'network_id': '359658ce-f1c6-4bcf-90bc-4a816eebef8a', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ips': [{'subnet_id': '79c0d1fe-bd0e-4079-abdb-8e32c802a558'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:39:26.647013 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-07272330-5fe8-4a05-96e0-6c46cca7f9bc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:26.815527 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-61759b9c-1066-430f-8909-bcc7547db386 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b186380e-ee5f-4e3e-a5f8-325fb4d3520b', 'name': 'tempest-TestNetworkBasicOps-router-1697092511', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.142'}], 'enable_snat': True}, 'gw_port_id': '98412fb7-ede7-41fa-a41f-2b1e63040f98', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:39:23Z', 'updated_at': '2021-11-09T04:39:24Z', 'revision_number': 3, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '98412fb7-ede7-41fa-a41f-2b1e63040f98', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:77:12:67', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b186380e-ee5f-4e3e-a5f8-325fb4d3520b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1408, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.142', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:39:23Z', 'updated_at': '2021-11-09T04:39:26Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:39:26.845557 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-61759b9c-1066-430f-8909-bcc7547db386 None None] The sync data for ids ['b186380e-ee5f-4e3e-a5f8-325fb4d3520b'] in dv-neutron-816802-2-hyperv is: [{'id': 'b186380e-ee5f-4e3e-a5f8-325fb4d3520b', 'name': 'tempest-TestNetworkBasicOps-router-1697092511', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.142'}], 'enable_snat': True}, 'gw_port_id': '98412fb7-ede7-41fa-a41f-2b1e63040f98', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:39:23Z', 'updated_at': '2021-11-09T04:39:24Z', 'revision_number': 3, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '98412fb7-ede7-41fa-a41f-2b1e63040f98', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:77:12:67', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b186380e-ee5f-4e3e-a5f8-325fb4d3520b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1408, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.142', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:39:23Z', 'updated_at': '2021-11-09T04:39:26Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:39:26.931887 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-07272330-5fe8-4a05-96e0-6c46cca7f9bc None None] Allocated IP 172.20.0.2 (359658ce-f1c6-4bcf-90bc-4a816eebef8a/79c0d1fe-bd0e-4079-abdb-8e32c802a558/2b113733-a448-41aa-80e6-bb3a378d923c) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:39:27.059498 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4f10d534-2fc0-4b5a-ac67-0b36e63f12a5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:27.099717 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-07272330-5fe8-4a05-96e0-6c46cca7f9bc None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:27.227313 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-07272330-5fe8-4a05-96e0-6c46cca7f9bc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:27.273074 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-07272330-5fe8-4a05-96e0-6c46cca7f9bc None None] Network 359658ce-f1c6-4bcf-90bc-4a816eebef8a is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:39:27.279743 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-07272330-5fe8-4a05-96e0-6c46cca7f9bc None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:39:27.285874 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-07272330-5fe8-4a05-96e0-6c46cca7f9bc None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:39:27.288938 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07272330-5fe8-4a05-96e0-6c46cca7f9bc None None] Pushing event updated for resources: {'Port': ['ID=2b113733-a448-41aa-80e6-bb3a378d923c,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:39:27.349747 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-07272330-5fe8-4a05-96e0-6c46cca7f9bc None None] Attempting to bind port 2b113733-a448-41aa-80e6-bb3a378d923c on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:39:27.350004 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-07272330-5fe8-4a05-96e0-6c46cca7f9bc None None] Attempting to bind port 2b113733-a448-41aa-80e6-bb3a378d923c by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '3e8c180a-3f73-4be8-b3d7-21a3b0ec67c0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 313, 'network_id': '359658ce-f1c6-4bcf-90bc-4a816eebef8a'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:39:27.350626 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-07272330-5fe8-4a05-96e0-6c46cca7f9bc None None] Attempting to bind port 2b113733-a448-41aa-80e6-bb3a378d923c on network 359658ce-f1c6-4bcf-90bc-4a816eebef8a {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:39:27.357518 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-07272330-5fe8-4a05-96e0-6c46cca7f9bc None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 39, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:39:27.357899 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-07272330-5fe8-4a05-96e0-6c46cca7f9bc None None] Checking segment: {'id': '3e8c180a-3f73-4be8-b3d7-21a3b0ec67c0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 313, 'network_id': '359658ce-f1c6-4bcf-90bc-4a816eebef8a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:39:27.358307 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-07272330-5fe8-4a05-96e0-6c46cca7f9bc None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:27.358781 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-07272330-5fe8-4a05-96e0-6c46cca7f9bc None None] Bound using segment: {'id': '3e8c180a-3f73-4be8-b3d7-21a3b0ec67c0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 313, 'network_id': '359658ce-f1c6-4bcf-90bc-4a816eebef8a'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:39:27.359259 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-07272330-5fe8-4a05-96e0-6c46cca7f9bc None None] Bound port: 2b113733-a448-41aa-80e6-bb3a378d923c, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3e8c180a-3f73-4be8-b3d7-21a3b0ec67c0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 313, 'network_id': '359658ce-f1c6-4bcf-90bc-4a816eebef8a'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:39:27.359645 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-07272330-5fe8-4a05-96e0-6c46cca7f9bc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:27.385349 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-4f10d534-2fc0-4b5a-ac67-0b36e63f12a5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Allocated IP 172.20.0.1 (359658ce-f1c6-4bcf-90bc-4a816eebef8a/79c0d1fe-bd0e-4079-abdb-8e32c802a558/dc5c1965-8ffd-4978-a8a2-af1f55688062) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:39:27.414498 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 98412fb7-ede7-41fa-a41f-2b1e63040f98 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:39:27.474321 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-07272330-5fe8-4a05-96e0-6c46cca7f9bc None None] For port 2b113733-a448-41aa-80e6-bb3a378d923c, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:39:27.478078 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-07272330-5fe8-4a05-96e0-6c46cca7f9bc None None] For port 2b113733-a448-41aa-80e6-bb3a378d923c, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=2b113733-a448-41aa-80e6-bb3a378d923c,segment=NetworkSegment(3e8c180a-3f73-4be8-b3d7-21a3b0ec67c0),segment_id=3e8c180a-3f73-4be8-b3d7-21a3b0ec67c0)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:39:27.490746 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 98412fb7-ede7-41fa-a41f-2b1e63040f98 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:39:27.491064 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:27.521125 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4f10d534-2fc0-4b5a-ac67-0b36e63f12a5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:27.563364 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-07272330-5fe8-4a05-96e0-6c46cca7f9bc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:27.614607 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:27.622584 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4f10d534-2fc0-4b5a-ac67-0b36e63f12a5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:27.653440 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 98412fb7-ede7-41fa-a41f-2b1e63040f98, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=98412fb7-ede7-41fa-a41f-2b1e63040f98,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:39:27.657858 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07272330-5fe8-4a05-96e0-6c46cca7f9bc None None] Pushing event updated for resources: {'Port': ['ID=2b113733-a448-41aa-80e6-bb3a378d923c,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:39:27.680257 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4f10d534-2fc0-4b5a-ac67-0b36e63f12a5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network 359658ce-f1c6-4bcf-90bc-4a816eebef8a is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:39:27.686657 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-4f10d534-2fc0-4b5a-ac67-0b36e63f12a5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:39:27.690878 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4f10d534-2fc0-4b5a-ac67-0b36e63f12a5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:39:27.719188 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f10d534-2fc0-4b5a-ac67-0b36e63f12a5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Port': ['ID=dc5c1965-8ffd-4978-a8a2-af1f55688062,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:39:27.720316 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:27.749222 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4f10d534-2fc0-4b5a-ac67-0b36e63f12a5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:27.777494 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=98412fb7-ede7-41fa-a41f-2b1e63040f98,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:39:28.116439 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4f10d534-2fc0-4b5a-ac67-0b36e63f12a5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:28.403425 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4f10d534-2fc0-4b5a-ac67-0b36e63f12a5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:28.519116 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4f10d534-2fc0-4b5a-ac67-0b36e63f12a5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:28.564218 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5bde36d0-8f13-428c-8ff6-b6f037cb2ad1 None None] Network 359658ce-f1c6-4bcf-90bc-4a816eebef8a requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:39:28.603161 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4f10d534-2fc0-4b5a-ac67-0b36e63f12a5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:28.604890 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f10d534-2fc0-4b5a-ac67-0b36e63f12a5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Port': ['ID=dc5c1965-8ffd-4978-a8a2-af1f55688062,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:39:28.616843 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f10d534-2fc0-4b5a-ac67-0b36e63f12a5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:39:28.617184 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f10d534-2fc0-4b5a-ac67-0b36e63f12a5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:39:28.617523 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f10d534-2fc0-4b5a-ac67-0b36e63f12a5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:39:28.617860 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f10d534-2fc0-4b5a-ac67-0b36e63f12a5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:39:28.618182 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f10d534-2fc0-4b5a-ac67-0b36e63f12a5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:39:28.618537 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f10d534-2fc0-4b5a-ac67-0b36e63f12a5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:39:28.618859 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f10d534-2fc0-4b5a-ac67-0b36e63f12a5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:39:28.619177 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f10d534-2fc0-4b5a-ac67-0b36e63f12a5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:39:28.619492 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f10d534-2fc0-4b5a-ac67-0b36e63f12a5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:39:28.619807 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f10d534-2fc0-4b5a-ac67-0b36e63f12a5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:39:28.620121 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f10d534-2fc0-4b5a-ac67-0b36e63f12a5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:39:28.620433 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f10d534-2fc0-4b5a-ac67-0b36e63f12a5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:39:28.664712 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-6e045d4a-d156-45fa-b999-77450e71da05 None None] Provisioning complete for port 2b113733-a448-41aa-80e6-bb3a378d923c triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:39:28.665094 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6e045d4a-d156-45fa-b999-77450e71da05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:28.717458 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4f10d534-2fc0-4b5a-ac67-0b36e63f12a5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network 359658ce-f1c6-4bcf-90bc-4a816eebef8a is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:39:28.719557 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-4f10d534-2fc0-4b5a-ac67-0b36e63f12a5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:39:28.812621 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6e045d4a-d156-45fa-b999-77450e71da05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:28.837112 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4f10d534-2fc0-4b5a-ac67-0b36e63f12a5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Router b186380e-ee5f-4e3e-a5f8-325fb4d3520b has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:39:28.855089 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-6e045d4a-d156-45fa-b999-77450e71da05 None None] For port 2b113733-a448-41aa-80e6-bb3a378d923c, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=2b113733-a448-41aa-80e6-bb3a378d923c,segment=NetworkSegment(3e8c180a-3f73-4be8-b3d7-21a3b0ec67c0),segment_id=3e8c180a-3f73-4be8-b3d7-21a3b0ec67c0)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:39:28.949750 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6e045d4a-d156-45fa-b999-77450e71da05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:28.962221 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4f10d534-2fc0-4b5a-ac67-0b36e63f12a5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:39:28.969879 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-4f10d534-2fc0-4b5a-ac67-0b36e63f12a5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "PUT /v2.0/routers/b186380e-ee5f-4e3e-a5f8-325fb4d3520b/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.3909068 Nov 09 04:39:28.970982 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 60334) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:39:28.976448 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-db54801b-9b26-4ff2-98e2-abf7ba5ab5ee None None] Sync routers for ids ['b186380e-ee5f-4e3e-a5f8-325fb4d3520b'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:39:29.001360 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-db54801b-9b26-4ff2-98e2-abf7ba5ab5ee None None] Routers {'b186380e-ee5f-4e3e-a5f8-325fb4d3520b'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:39:29.001975 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-db54801b-9b26-4ff2-98e2-abf7ba5ab5ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:39:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['b186380e-ee5f-4e3e-a5f8-325fb4d3520b'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:39:29.051953 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e045d4a-d156-45fa-b999-77450e71da05 None None] Pushing event updated for resources: {'Port': ['ID=2b113733-a448-41aa-80e6-bb3a378d923c,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:39:29.084234 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-22f3f295-6c6c-4960-bb95-4c2a9ce2b5b4 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:29.084706 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-22f3f295-6c6c-4960-bb95-4c2a9ce2b5b4 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:29.085168 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-22f3f295-6c6c-4960-bb95-4c2a9ce2b5b4 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:29.085619 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-22f3f295-6c6c-4960-bb95-4c2a9ce2b5b4 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:29.086068 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-22f3f295-6c6c-4960-bb95-4c2a9ce2b5b4 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:29.086724 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-22f3f295-6c6c-4960-bb95-4c2a9ce2b5b4 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:29.090479 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-22f3f295-6c6c-4960-bb95-4c2a9ce2b5b4 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/networks HTTP/1.1" status: 200 len: 4286 time: 0.1177428 Nov 09 04:39:29.092011 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 60336) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:39:29.108433 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-b67f23fb-f9f2-48b6-b7f7-06a058657b59 None None] Provisioning complete for port 2b113733-a448-41aa-80e6-bb3a378d923c triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:39:29.108725 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b67f23fb-f9f2-48b6-b7f7-06a058657b59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:29.155152 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c9dbb3e4-3bea-4247-b83a-0108b8e87753 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:29.155880 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c9dbb3e4-3bea-4247-b83a-0108b8e87753 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:29.156332 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c9dbb3e4-3bea-4247-b83a-0108b8e87753 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:29.156926 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c9dbb3e4-3bea-4247-b83a-0108b8e87753 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:29.157368 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c9dbb3e4-3bea-4247-b83a-0108b8e87753 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:29.157947 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c9dbb3e4-3bea-4247-b83a-0108b8e87753 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:29.161092 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-c9dbb3e4-3bea-4247-b83a-0108b8e87753 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 4005 time: 0.0674953 Nov 09 04:39:29.165459 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60338) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:39:29.170257 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-db54801b-9b26-4ff2-98e2-abf7ba5ab5ee None None] Set router b186380e-ee5f-4e3e-a5f8-325fb4d3520b gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:39:29.389090 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-b67f23fb-f9f2-48b6-b7f7-06a058657b59 None None] Provisioning complete for port dc5c1965-8ffd-4978-a8a2-af1f55688062 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:39:29.389544 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b67f23fb-f9f2-48b6-b7f7-06a058657b59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:29.459463 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-b67f23fb-f9f2-48b6-b7f7-06a058657b59 None None] Port dc5c1965-8ffd-4978-a8a2-af1f55688062 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:39:29.498183 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 98412fb7-ede7-41fa-a41f-2b1e63040f98 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:39:29.531852 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-db54801b-9b26-4ff2-98e2-abf7ba5ab5ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b186380e-ee5f-4e3e-a5f8-325fb4d3520b', 'name': 'tempest-TestNetworkBasicOps-router-1697092511', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.142'}], 'enable_snat': True}, 'gw_port_id': '98412fb7-ede7-41fa-a41f-2b1e63040f98', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:39:23Z', 'updated_at': '2021-11-09T04:39:27Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '98412fb7-ede7-41fa-a41f-2b1e63040f98', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:77:12:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b186380e-ee5f-4e3e-a5f8-325fb4d3520b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1408, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.142', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:39:23Z', 'updated_at': '2021-11-09T04:39:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'dc5c1965-8ffd-4978-a8a2-af1f55688062', 'name': '', 'network_id': '359658ce-f1c6-4bcf-90bc-4a816eebef8a', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:47:f4:02', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b186380e-ee5f-4e3e-a5f8-325fb4d3520b', 'device_owner': 'network:router_interface', 'standard_attr_id': 1411, 'fixed_ips': [{'subnet_id': '79c0d1fe-bd0e-4079-abdb-8e32c802a558', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:39:27Z', 'updated_at': '2021-11-09T04:39:28Z', 'revision_number': 2, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '79c0d1fe-bd0e-4079-abdb-8e32c802a558', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:39:29.570013 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-e3ec6bda-e8d3-492f-8acd-4499f34da903 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/routers HTTP/1.1" status: 200 len: 3048 time: 0.4026697 Nov 09 04:39:29.570227 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-db54801b-9b26-4ff2-98e2-abf7ba5ab5ee None None] Checking router: b186380e-ee5f-4e3e-a5f8-325fb4d3520b for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:39:29.570748 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60340) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:39:29.570869 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-db54801b-9b26-4ff2-98e2-abf7ba5ab5ee None None] Updating router b186380e-ee5f-4e3e-a5f8-325fb4d3520b port dc5c1965-8ffd-4978-a8a2-af1f55688062 binding host dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 04:39:29.575029 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-6c0cf674-477a-4535-aeaa-1af6730c7c55 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'port': {'name': 'tempest-TestNetworkBasicOps-443713325', 'network_id': '359658ce-f1c6-4bcf-90bc-4a816eebef8a'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:39:29.609589 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-db54801b-9b26-4ff2-98e2-abf7ba5ab5ee None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:29.614811 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-2af153b7-1993-44db-b07e-0d7d612b14a9 None None] Provisioning complete for port dc5c1965-8ffd-4978-a8a2-af1f55688062 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:39:29.615165 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-2af153b7-1993-44db-b07e-0d7d612b14a9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:29.655977 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 98412fb7-ede7-41fa-a41f-2b1e63040f98 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:39:29.656505 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:29.702945 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-2af153b7-1993-44db-b07e-0d7d612b14a9 None None] Port dc5c1965-8ffd-4978-a8a2-af1f55688062 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:39:29.732317 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6c0cf674-477a-4535-aeaa-1af6730c7c55 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Made reservation on behalf of 1d10b4824e524068827e58b55e269af3 for: {'port': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:39:29.735964 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6c0cf674-477a-4535-aeaa-1af6730c7c55 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:29.753331 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [None req-6c0cf674-477a-4535-aeaa-1af6730c7c55 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] device_id is not set on port fa246bc6-659f-4e85-bac6-0f3a578f184d yet. {{(pid=102161) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:39:29.877586 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 2b113733-a448-41aa-80e6-bb3a378d923c up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:39:29.965560 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 2b113733-a448-41aa-80e6-bb3a378d923c triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:39:29.965927 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:30.038110 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-db54801b-9b26-4ff2-98e2-abf7ba5ab5ee None None] Publish callbacks [] for port, precommit_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:30.130456 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-db54801b-9b26-4ff2-98e2-abf7ba5ab5ee None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:30.186606 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-6c0cf674-477a-4535-aeaa-1af6730c7c55 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Allocated IP 172.20.0.7 (359658ce-f1c6-4bcf-90bc-4a816eebef8a/79c0d1fe-bd0e-4079-abdb-8e32c802a558/fa246bc6-659f-4e85-bac6-0f3a578f184d) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:39:30.195281 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f2a790b-14d5-4b01-865c-73ece16dcebc None None] Pushing event updated for resources: {'Port': ['ID=dc5c1965-8ffd-4978-a8a2-af1f55688062,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:39:30.250401 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-db54801b-9b26-4ff2-98e2-abf7ba5ab5ee None None] Attempting to bind port dc5c1965-8ffd-4978-a8a2-af1f55688062 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:39:30.250771 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-db54801b-9b26-4ff2-98e2-abf7ba5ab5ee None None] Attempting to bind port dc5c1965-8ffd-4978-a8a2-af1f55688062 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '3e8c180a-3f73-4be8-b3d7-21a3b0ec67c0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 313, 'network_id': '359658ce-f1c6-4bcf-90bc-4a816eebef8a'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:39:30.251142 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-db54801b-9b26-4ff2-98e2-abf7ba5ab5ee None None] Attempting to bind port dc5c1965-8ffd-4978-a8a2-af1f55688062 on network 359658ce-f1c6-4bcf-90bc-4a816eebef8a {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:39:30.257398 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-db54801b-9b26-4ff2-98e2-abf7ba5ab5ee None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 39, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:39:30.257775 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-db54801b-9b26-4ff2-98e2-abf7ba5ab5ee None None] Checking segment: {'id': '3e8c180a-3f73-4be8-b3d7-21a3b0ec67c0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 313, 'network_id': '359658ce-f1c6-4bcf-90bc-4a816eebef8a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:39:30.258172 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-db54801b-9b26-4ff2-98e2-abf7ba5ab5ee None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:30.259084 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-db54801b-9b26-4ff2-98e2-abf7ba5ab5ee None None] Bound using segment: {'id': '3e8c180a-3f73-4be8-b3d7-21a3b0ec67c0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 313, 'network_id': '359658ce-f1c6-4bcf-90bc-4a816eebef8a'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:39:30.259314 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-db54801b-9b26-4ff2-98e2-abf7ba5ab5ee None None] Bound port: dc5c1965-8ffd-4978-a8a2-af1f55688062, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3e8c180a-3f73-4be8-b3d7-21a3b0ec67c0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 313, 'network_id': '359658ce-f1c6-4bcf-90bc-4a816eebef8a'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:39:30.259695 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-db54801b-9b26-4ff2-98e2-abf7ba5ab5ee None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:30.327288 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-db54801b-9b26-4ff2-98e2-abf7ba5ab5ee None None] For port dc5c1965-8ffd-4978-a8a2-af1f55688062, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:39:30.331669 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-db54801b-9b26-4ff2-98e2-abf7ba5ab5ee None None] For port dc5c1965-8ffd-4978-a8a2-af1f55688062, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=dc5c1965-8ffd-4978-a8a2-af1f55688062,segment=NetworkSegment(3e8c180a-3f73-4be8-b3d7-21a3b0ec67c0),segment_id=3e8c180a-3f73-4be8-b3d7-21a3b0ec67c0)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:39:30.376467 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6c0cf674-477a-4535-aeaa-1af6730c7c55 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:30.425796 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-ead507b0-90cd-43dd-9a94-228d9d6fd9a4 None None] Provisioning complete for port dc5c1965-8ffd-4978-a8a2-af1f55688062 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:39:30.426180 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ead507b0-90cd-43dd-9a94-228d9d6fd9a4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:30.452218 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-db54801b-9b26-4ff2-98e2-abf7ba5ab5ee None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:30.476088 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6c0cf674-477a-4535-aeaa-1af6730c7c55 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:30.488338 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-ead507b0-90cd-43dd-9a94-228d9d6fd9a4 None None] Port dc5c1965-8ffd-4978-a8a2-af1f55688062 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:39:30.518273 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6c0cf674-477a-4535-aeaa-1af6730c7c55 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network 359658ce-f1c6-4bcf-90bc-4a816eebef8a is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:39:30.521931 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f2a790b-14d5-4b01-865c-73ece16dcebc None None] Pushing event updated for resources: {'Port': ['ID=dc5c1965-8ffd-4978-a8a2-af1f55688062,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:39:30.522170 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-6c0cf674-477a-4535-aeaa-1af6730c7c55 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:39:30.524699 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-db54801b-9b26-4ff2-98e2-abf7ba5ab5ee None None] Routers {'b186380e-ee5f-4e3e-a5f8-325fb4d3520b'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:39:30.525302 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-db54801b-9b26-4ff2-98e2-abf7ba5ab5ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:39:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['b186380e-ee5f-4e3e-a5f8-325fb4d3520b'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:39:30.528901 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6c0cf674-477a-4535-aeaa-1af6730c7c55 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:39:30.561665 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c0cf674-477a-4535-aeaa-1af6730c7c55 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Port': ['ID=fa246bc6-659f-4e85-bac6-0f3a578f184d,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:39:30.592787 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6c0cf674-477a-4535-aeaa-1af6730c7c55 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:30.594077 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6c0cf674-477a-4535-aeaa-1af6730c7c55 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:30.644443 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-db54801b-9b26-4ff2-98e2-abf7ba5ab5ee None None] Set router b186380e-ee5f-4e3e-a5f8-325fb4d3520b gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:39:30.664518 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-6c0cf674-477a-4535-aeaa-1af6730c7c55 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/ports HTTP/1.1" status: 201 len: 929 time: 1.0932796 Nov 09 04:39:30.843161 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-05432517-86c1-4ac2-8318-b03d27a10acf None None] Provisioning complete for port dc5c1965-8ffd-4978-a8a2-af1f55688062 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:39:30.843522 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-05432517-86c1-4ac2-8318-b03d27a10acf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:30.979990 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-05432517-86c1-4ac2-8318-b03d27a10acf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:30.984736 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-db54801b-9b26-4ff2-98e2-abf7ba5ab5ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b186380e-ee5f-4e3e-a5f8-325fb4d3520b', 'name': 'tempest-TestNetworkBasicOps-router-1697092511', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.142'}], 'enable_snat': True}, 'gw_port_id': '98412fb7-ede7-41fa-a41f-2b1e63040f98', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:39:23Z', 'updated_at': '2021-11-09T04:39:27Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '98412fb7-ede7-41fa-a41f-2b1e63040f98', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:77:12:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b186380e-ee5f-4e3e-a5f8-325fb4d3520b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1408, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.142', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:39:23Z', 'updated_at': '2021-11-09T04:39:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'dc5c1965-8ffd-4978-a8a2-af1f55688062', 'name': '', 'network_id': '359658ce-f1c6-4bcf-90bc-4a816eebef8a', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:47:f4:02', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b186380e-ee5f-4e3e-a5f8-325fb4d3520b', 'device_owner': 'network:router_interface', 'standard_attr_id': 1411, 'fixed_ips': [{'subnet_id': '79c0d1fe-bd0e-4079-abdb-8e32c802a558', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:39:27Z', 'updated_at': '2021-11-09T04:39:30Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '79c0d1fe-bd0e-4079-abdb-8e32c802a558', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:39:31.021326 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-db54801b-9b26-4ff2-98e2-abf7ba5ab5ee None None] The sync data for ids ['b186380e-ee5f-4e3e-a5f8-325fb4d3520b'] in dv-neutron-816802-2-hyperv is: [{'id': 'b186380e-ee5f-4e3e-a5f8-325fb4d3520b', 'name': 'tempest-TestNetworkBasicOps-router-1697092511', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.142'}], 'enable_snat': True}, 'gw_port_id': '98412fb7-ede7-41fa-a41f-2b1e63040f98', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:39:23Z', 'updated_at': '2021-11-09T04:39:27Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '98412fb7-ede7-41fa-a41f-2b1e63040f98', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:77:12:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b186380e-ee5f-4e3e-a5f8-325fb4d3520b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1408, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.142', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:39:23Z', 'updated_at': '2021-11-09T04:39:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'dc5c1965-8ffd-4978-a8a2-af1f55688062', 'name': '', 'network_id': '359658ce-f1c6-4bcf-90bc-4a816eebef8a', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:47:f4:02', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b186380e-ee5f-4e3e-a5f8-325fb4d3520b', 'device_owner': 'network:router_interface', 'standard_attr_id': 1411, 'fixed_ips': [{'subnet_id': '79c0d1fe-bd0e-4079-abdb-8e32c802a558', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:39:27Z', 'updated_at': '2021-11-09T04:39:30Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '79c0d1fe-bd0e-4079-abdb-8e32c802a558', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:39:31.052911 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-05432517-86c1-4ac2-8318-b03d27a10acf None None] For port dc5c1965-8ffd-4978-a8a2-af1f55688062, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=dc5c1965-8ffd-4978-a8a2-af1f55688062,segment=NetworkSegment(3e8c180a-3f73-4be8-b3d7-21a3b0ec67c0),segment_id=3e8c180a-3f73-4be8-b3d7-21a3b0ec67c0)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:39:31.150389 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60344) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:39:31.151392 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-05432517-86c1-4ac2-8318-b03d27a10acf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:31.156291 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-40baec6b-2604-4013-918a-f292b547b4cc tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-844969754', 'description': 'tempest-secgroup-smoke-844969754 description', 'project_id': '1d10b4824e524068827e58b55e269af3'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:39:31.204047 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05432517-86c1-4ac2-8318-b03d27a10acf None None] Pushing event updated for resources: {'Port': ['ID=dc5c1965-8ffd-4978-a8a2-af1f55688062,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:39:31.259342 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-40baec6b-2604-4013-918a-f292b547b4cc tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:31.271696 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-a2499e55-2a91-4953-8158-24d0536b53c3 None None] Provisioning complete for port fa246bc6-659f-4e85-bac6-0f3a578f184d triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:39:31.275766 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a2499e55-2a91-4953-8158-24d0536b53c3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:31.317934 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-a2499e55-2a91-4953-8158-24d0536b53c3 None None] Port fa246bc6-659f-4e85-bac6-0f3a578f184d cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:39:31.341957 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-40baec6b-2604-4013-918a-f292b547b4cc tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:31.376095 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device dc5c1965-8ffd-4978-a8a2-af1f55688062 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:39:31.492505 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-40baec6b-2604-4013-918a-f292b547b4cc tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:31.530330 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40baec6b-2604-4013-918a-f292b547b4cc tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroup': ['ID=72c53e26-f498-4c4f-b394-d5c2e406bf48,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:39:31.570020 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port dc5c1965-8ffd-4978-a8a2-af1f55688062 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:39:31.570405 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:31.634478 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-40baec6b-2604-4013-918a-f292b547b4cc tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:31.635735 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-40baec6b-2604-4013-918a-f292b547b4cc tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.4841492 Nov 09 04:39:31.638692 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60346) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:39:31.643953 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-a3395ea3-c36c-4505-90f5-23806542fcc1 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': '72c53e26-f498-4c4f-b394-d5c2e406bf48', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:39:31.812169 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a3395ea3-c36c-4505-90f5-23806542fcc1 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:31.872062 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a3395ea3-c36c-4505-90f5-23806542fcc1 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:31.952634 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a3395ea3-c36c-4505-90f5-23806542fcc1 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:31.971073 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3395ea3-c36c-4505-90f5-23806542fcc1 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a821aa6f-4f7a-4e71-963c-887e122709d6,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:39:32.048640 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a3395ea3-c36c-4505-90f5-23806542fcc1 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:32.050469 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a3395ea3-c36c-4505-90f5-23806542fcc1 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.4101408 Nov 09 04:39:32.053228 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60348) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:39:32.057731 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-86168686-ae07-48e9-b763-b309ff58b7e7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': '72c53e26-f498-4c4f-b394-d5c2e406bf48', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:39:32.168824 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-86168686-ae07-48e9-b763-b309ff58b7e7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:32.224777 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-86168686-ae07-48e9-b763-b309ff58b7e7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:32.300831 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-86168686-ae07-48e9-b763-b309ff58b7e7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:32.321150 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86168686-ae07-48e9-b763-b309ff58b7e7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=94dd049d-c3ad-4a09-9c14-b52e5618b301,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:39:32.391116 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-86168686-ae07-48e9-b763-b309ff58b7e7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:32.392328 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-86168686-ae07-48e9-b763-b309ff58b7e7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.3381300 Nov 09 04:39:32.403797 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60350) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:39:32.408461 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-8063be43-03bf-4b87-954c-8c807469a3e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': '72c53e26-f498-4c4f-b394-d5c2e406bf48', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:39:32.532003 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8063be43-03bf-4b87-954c-8c807469a3e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:32.587109 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8063be43-03bf-4b87-954c-8c807469a3e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:32.695017 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8063be43-03bf-4b87-954c-8c807469a3e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:32.715454 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8063be43-03bf-4b87-954c-8c807469a3e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d4ab6f95-8c90-4579-9e0a-99819ea5115c,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:39:32.863479 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8063be43-03bf-4b87-954c-8c807469a3e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:32.864696 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-8063be43-03bf-4b87-954c-8c807469a3e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.4599814 Nov 09 04:39:32.867454 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60352) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:39:32.871870 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-413809b2-3688-4fe7-8d59-36f34ab88b4f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': '72c53e26-f498-4c4f-b394-d5c2e406bf48', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:39:32.997227 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-413809b2-3688-4fe7-8d59-36f34ab88b4f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:33.055497 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-413809b2-3688-4fe7-8d59-36f34ab88b4f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:33.146631 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-413809b2-3688-4fe7-8d59-36f34ab88b4f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:33.163335 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-413809b2-3688-4fe7-8d59-36f34ab88b4f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=67012813-d10d-4b6e-a827-878939c0c0fd,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:39:33.255015 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-413809b2-3688-4fe7-8d59-36f34ab88b4f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:33.256214 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-413809b2-3688-4fe7-8d59-36f34ab88b4f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3878093 Nov 09 04:39:33.258934 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60354) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:39:33.263296 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-1f702874-8119-4742-a626-8953d66279a7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': '72c53e26-f498-4c4f-b394-d5c2e406bf48', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:39:33.378215 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.securitygroups_db [None req-1f702874-8119-4742-a626-8953d66279a7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Project 1d10b4824e524068827e58b55e269af3 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 09 04:39:33.383381 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1f702874-8119-4742-a626-8953d66279a7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:33.440046 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1f702874-8119-4742-a626-8953d66279a7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:33.506805 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1f702874-8119-4742-a626-8953d66279a7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:33.524444 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f702874-8119-4742-a626-8953d66279a7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=be58c3de-d61c-4b0d-8090-b9242be2fa8c,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:39:33.611690 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1f702874-8119-4742-a626-8953d66279a7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:33.613556 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1f702874-8119-4742-a626-8953d66279a7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.3536832 Nov 09 04:39:33.616421 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60356) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:39:33.620702 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-62233dc6-779d-4405-8114-01b867be4e2e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': '72c53e26-f498-4c4f-b394-d5c2e406bf48', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:39:33.715794 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.securitygroups_db [None req-62233dc6-779d-4405-8114-01b867be4e2e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Project 1d10b4824e524068827e58b55e269af3 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 09 04:39:33.720676 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-62233dc6-779d-4405-8114-01b867be4e2e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:33.778942 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-62233dc6-779d-4405-8114-01b867be4e2e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:33.880942 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-62233dc6-779d-4405-8114-01b867be4e2e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:33.901475 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62233dc6-779d-4405-8114-01b867be4e2e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0ebf0d48-7fae-4027-86b5-038a183ffcd7,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:39:33.971298 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-62233dc6-779d-4405-8114-01b867be4e2e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:33.973444 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-62233dc6-779d-4405-8114-01b867be4e2e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.3556404 Nov 09 04:39:34.120131 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-0f7e4bc7-b698-4a27-ae1d-a40746ee2ce0 req-fdefab3b-1142-4ebc-a2d1-7301234b52c8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-844969754&fields=id&tenant_id=1d10b4824e524068827e58b55e269af3 HTTP/1.1" status: 200 len: 267 time: 0.0436685 Nov 09 04:39:34.167078 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f7e4bc7-b698-4a27-ae1d-a40746ee2ce0 req-3b9d88b1-7f77-4a23-9843-948a064afe0c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:34.168394 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-0f7e4bc7-b698-4a27-ae1d-a40746ee2ce0 req-3b9d88b1-7f77-4a23-9843-948a064afe0c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports/fa246bc6-659f-4e85-bac6-0f3a578f184d HTTP/1.1" status: 200 len: 929 time: 0.0423493 Nov 09 04:39:34.183653 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [req-0f7e4bc7-b698-4a27-ae1d-a40746ee2ce0 req-9cef9872-18f9-4e6a-81a2-2ddf2ca69368 service neutron] http://10.222.0.24:9696/v2.0/extensions returned with HTTP 200 {{(pid=102161) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:39:34.184607 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-0f7e4bc7-b698-4a27-ae1d-a40746ee2ce0 req-9cef9872-18f9-4e6a-81a2-2ddf2ca69368 service neutron] 10.222.0.24 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0050650 Nov 09 04:39:34.222836 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-0f7e4bc7-b698-4a27-ae1d-a40746ee2ce0 req-5471045f-41bd-4ae0-8452-530e288ae50b service neutron] 10.222.0.24 "GET /v2.0/ports/fa246bc6-659f-4e85-bac6-0f3a578f184d?fields=binding%3Avnic_type&fields=binding%3Aprofile&fields=network_id&fields=resource_request&fields=numa_affinity_policy&fields=device_profile HTTP/1.1" status: 200 len: 311 time: 0.0317953 Nov 09 04:39:34.312070 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-0f7e4bc7-b698-4a27-ae1d-a40746ee2ce0 req-5ac04e69-e49d-4d36-93bb-fffe94259671 service neutron] 10.222.0.24 "GET /v2.0/networks/359658ce-f1c6-4bcf-90bc-4a816eebef8a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0836537 Nov 09 04:39:34.400638 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-0f7e4bc7-b698-4a27-ae1d-a40746ee2ce0 req-fdc37e2b-3956-441c-b69a-98ceaf62dd42 service neutron] 10.222.0.24 "GET /v2.0/networks/359658ce-f1c6-4bcf-90bc-4a816eebef8a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0820355 Nov 09 04:39:34.644549 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6e3a0560-5c41-4ffc-84d7-b6435ff001db req-67eb5f47-fc59-44ca-8065-013ba9f2a53f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=2c8e0d1f-5173-42bd-9d62-52d2caa539fb HTTP/1.1" status: 200 len: 210 time: 0.0271289 Nov 09 04:39:35.742151 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-186c0ea9-9013-45ff-ae50-f8db88b47876 req-d4c9a306-ba47-45ed-b997-26de9f1ff42f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=2c8e0d1f-5173-42bd-9d62-52d2caa539fb HTTP/1.1" status: 200 len: 210 time: 0.0307388 Nov 09 04:39:36.632578 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f7e4bc7-b698-4a27-ae1d-a40746ee2ce0 req-380285d3-a16c-4e5f-9f0b-7786cc295cbe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:36.633902 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-0f7e4bc7-b698-4a27-ae1d-a40746ee2ce0 req-380285d3-a16c-4e5f-9f0b-7786cc295cbe service neutron] 10.222.0.26 "GET /v2.0/ports/fa246bc6-659f-4e85-bac6-0f3a578f184d HTTP/1.1" status: 200 len: 1025 time: 0.0380683 Nov 09 04:39:36.738501 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f7e4bc7-b698-4a27-ae1d-a40746ee2ce0 req-32a352b9-5e9c-44a7-85b9-8861fe392463 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:36.739956 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-0f7e4bc7-b698-4a27-ae1d-a40746ee2ce0 req-32a352b9-5e9c-44a7-85b9-8861fe392463 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "GET /v2.0/networks?id=359658ce-f1c6-4bcf-90bc-4a816eebef8a HTTP/1.1" status: 200 len: 797 time: 0.0989561 Nov 09 04:39:36.804092 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-0f7e4bc7-b698-4a27-ae1d-a40746ee2ce0 req-ee7b00f7-c4ac-4bb0-9c2d-5b4b7429b236 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=1d10b4824e524068827e58b55e269af3 HTTP/1.1" status: 200 len: 379 time: 0.0541310 Nov 09 04:39:36.826802 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-0f7e4bc7-b698-4a27-ae1d-a40746ee2ce0 req-60cbf815-5040-4fd1-b9da-f80fe47a7433 service neutron] Request body: {'port': {'device_id': '2c8e0d1f-5173-42bd-9d62-52d2caa539fb', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:39:36.859403 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-0fe0e42b-d10c-4f80-9c2c-c3ab47f462d1 req-af6ffbe3-f852-4a79-ba33-bc4de6eee74e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=2c8e0d1f-5173-42bd-9d62-52d2caa539fb HTTP/1.1" status: 200 len: 210 time: 0.0501196 Nov 09 04:39:36.893549 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-0f7e4bc7-b698-4a27-ae1d-a40746ee2ce0 req-60cbf815-5040-4fd1-b9da-f80fe47a7433 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:37.153533 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [req-0f7e4bc7-b698-4a27-ae1d-a40746ee2ce0 req-60cbf815-5040-4fd1-b9da-f80fe47a7433 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id fa246bc6-659f-4e85-bac6-0f3a578f184d {{(pid=102162) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:39:37.160709 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-0f7e4bc7-b698-4a27-ae1d-a40746ee2ce0 req-60cbf815-5040-4fd1-b9da-f80fe47a7433 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:37.172472 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.provisioning_blocks [req-0f7e4bc7-b698-4a27-ae1d-a40746ee2ce0 req-60cbf815-5040-4fd1-b9da-f80fe47a7433 service neutron] Transition to ACTIVE for port object fa246bc6-659f-4e85-bac6-0f3a578f184d will not be triggered until provisioned by entity L2. {{(pid=102162) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 09 04:39:37.264012 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-0f7e4bc7-b698-4a27-ae1d-a40746ee2ce0 req-60cbf815-5040-4fd1-b9da-f80fe47a7433 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:37.313721 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60cbf815-5040-4fd1-b9da-f80fe47a7433 service neutron] Pushing event updated for resources: {'Port': ['ID=fa246bc6-659f-4e85-bac6-0f3a578f184d,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:39:37.387379 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-0f7e4bc7-b698-4a27-ae1d-a40746ee2ce0 req-60cbf815-5040-4fd1-b9da-f80fe47a7433 service neutron] Attempting to bind port fa246bc6-659f-4e85-bac6-0f3a578f184d on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:39:37.387857 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-0f7e4bc7-b698-4a27-ae1d-a40746ee2ce0 req-60cbf815-5040-4fd1-b9da-f80fe47a7433 service neutron] Attempting to bind port fa246bc6-659f-4e85-bac6-0f3a578f184d by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '3e8c180a-3f73-4be8-b3d7-21a3b0ec67c0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 313, 'network_id': '359658ce-f1c6-4bcf-90bc-4a816eebef8a'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:39:37.388778 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0f7e4bc7-b698-4a27-ae1d-a40746ee2ce0 req-60cbf815-5040-4fd1-b9da-f80fe47a7433 service neutron] Attempting to bind port fa246bc6-659f-4e85-bac6-0f3a578f184d on network 359658ce-f1c6-4bcf-90bc-4a816eebef8a {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:39:37.393460 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0f7e4bc7-b698-4a27-ae1d-a40746ee2ce0 req-60cbf815-5040-4fd1-b9da-f80fe47a7433 service neutron] Port fa246bc6-659f-4e85-bac6-0f3a578f184d on network 359658ce-f1c6-4bcf-90bc-4a816eebef8a not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:39:37.393775 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0f7e4bc7-b698-4a27-ae1d-a40746ee2ce0 req-60cbf815-5040-4fd1-b9da-f80fe47a7433 service neutron] Attempting to bind port fa246bc6-659f-4e85-bac6-0f3a578f184d on network 359658ce-f1c6-4bcf-90bc-4a816eebef8a {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:39:37.399244 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0f7e4bc7-b698-4a27-ae1d-a40746ee2ce0 req-60cbf815-5040-4fd1-b9da-f80fe47a7433 service neutron] Checking agent: {'id': '7d36b884-4ad2-4878-9464-bf647030b544', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'started_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 39, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:39:37.403794 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0f7e4bc7-b698-4a27-ae1d-a40746ee2ce0 req-60cbf815-5040-4fd1-b9da-f80fe47a7433 service neutron] Checking segment: {'id': '3e8c180a-3f73-4be8-b3d7-21a3b0ec67c0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 313, 'network_id': '359658ce-f1c6-4bcf-90bc-4a816eebef8a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:39:37.403794 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0f7e4bc7-b698-4a27-ae1d-a40746ee2ce0 req-60cbf815-5040-4fd1-b9da-f80fe47a7433 service neutron] Bound using segment: {'id': '3e8c180a-3f73-4be8-b3d7-21a3b0ec67c0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 313, 'network_id': '359658ce-f1c6-4bcf-90bc-4a816eebef8a'} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:39:37.403794 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-0f7e4bc7-b698-4a27-ae1d-a40746ee2ce0 req-60cbf815-5040-4fd1-b9da-f80fe47a7433 service neutron] Bound port: fa246bc6-659f-4e85-bac6-0f3a578f184d, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '3e8c180a-3f73-4be8-b3d7-21a3b0ec67c0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 313, 'network_id': '359658ce-f1c6-4bcf-90bc-4a816eebef8a'}}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:39:37.403794 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-0f7e4bc7-b698-4a27-ae1d-a40746ee2ce0 req-60cbf815-5040-4fd1-b9da-f80fe47a7433 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:37.472653 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-0f7e4bc7-b698-4a27-ae1d-a40746ee2ce0 req-60cbf815-5040-4fd1-b9da-f80fe47a7433 service neutron] For port fa246bc6-659f-4e85-bac6-0f3a578f184d, host hv-neutron-8168, cleared binding levels {{(pid=102162) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:39:37.476213 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-0f7e4bc7-b698-4a27-ae1d-a40746ee2ce0 req-60cbf815-5040-4fd1-b9da-f80fe47a7433 service neutron] For port fa246bc6-659f-4e85-bac6-0f3a578f184d, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=fa246bc6-659f-4e85-bac6-0f3a578f184d,segment=NetworkSegment(3e8c180a-3f73-4be8-b3d7-21a3b0ec67c0),segment_id=3e8c180a-3f73-4be8-b3d7-21a3b0ec67c0)] {{(pid=102162) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:39:37.564314 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-0f7e4bc7-b698-4a27-ae1d-a40746ee2ce0 req-60cbf815-5040-4fd1-b9da-f80fe47a7433 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:37.601527 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f7e4bc7-b698-4a27-ae1d-a40746ee2ce0 req-60cbf815-5040-4fd1-b9da-f80fe47a7433 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:37.602136 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-0f7e4bc7-b698-4a27-ae1d-a40746ee2ce0 req-60cbf815-5040-4fd1-b9da-f80fe47a7433 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:37.603530 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-0f7e4bc7-b698-4a27-ae1d-a40746ee2ce0 req-60cbf815-5040-4fd1-b9da-f80fe47a7433 service neutron] 10.222.0.26 "PUT /v2.0/ports/fa246bc6-659f-4e85-bac6-0f3a578f184d HTTP/1.1" status: 200 len: 1130 time: 0.7861793 Nov 09 04:39:37.603967 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2c8e0d1f-5173-42bd-9d62-52d2caa539fb', 'tag': 'fa246bc6-659f-4e85-bac6-0f3a578f184d'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:39:37.606199 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f9018084-a13c-4da2-9aa5-a82462803ee9" -d '{"events": [{"name": "network-changed", "server_uuid": "2c8e0d1f-5173-42bd-9d62-52d2caa539fb", "tag": "fa246bc6-659f-4e85-bac6-0f3a578f184d"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:39:37.629083 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60cbf815-5040-4fd1-b9da-f80fe47a7433 service neutron] Pushing event updated for resources: {'Port': ['ID=fa246bc6-659f-4e85-bac6-0f3a578f184d,revision_number=3']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:39:37.657223 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:39:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e636c46d-c840-46f4-8a92-5c140fa51c8a x-openstack-request-id: req-e636c46d-c840-46f4-8a92-5c140fa51c8a {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:39:37.657849 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2c8e0d1f-5173-42bd-9d62-52d2caa539fb", "tag": "fa246bc6-659f-4e85-bac6-0f3a578f184d", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:39:37.657849 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-e636c46d-c840-46f4-8a92-5c140fa51c8a {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:39:37.658313 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2c8e0d1f-5173-42bd-9d62-52d2caa539fb', 'tag': 'fa246bc6-659f-4e85-bac6-0f3a578f184d', 'status': 'completed', 'code': 200} Nov 09 04:39:37.720699 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9018084-a13c-4da2-9aa5-a82462803ee9 req-981a08e4-75a2-4e45-aac0-ffbafaf5bae8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:37.722328 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f9018084-a13c-4da2-9aa5-a82462803ee9 req-981a08e4-75a2-4e45-aac0-ffbafaf5bae8 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&device_id=2c8e0d1f-5173-42bd-9d62-52d2caa539fb HTTP/1.1" status: 200 len: 1133 time: 0.0435042 Nov 09 04:39:37.825383 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9018084-a13c-4da2-9aa5-a82462803ee9 req-9a1f4bb9-260a-47bd-a46f-6929ab3dd873 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:37.827017 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f9018084-a13c-4da2-9aa5-a82462803ee9 req-9a1f4bb9-260a-47bd-a46f-6929ab3dd873 service neutron] 10.222.0.26 "GET /v2.0/networks?tenant_id=1d10b4824e524068827e58b55e269af3&shared=False HTTP/1.1" status: 200 len: 898 time: 0.0974128 Nov 09 04:39:37.921567 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9018084-a13c-4da2-9aa5-a82462803ee9 req-d89dfc03-556b-4502-b34e-b5cee52f6424 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:37.923092 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f9018084-a13c-4da2-9aa5-a82462803ee9 req-d89dfc03-556b-4502-b34e-b5cee52f6424 service neutron] 10.222.0.26 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0897090 Nov 09 04:39:38.006478 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db4980b3-fb29-4802-a950-401fa2a496af req-9d8cefc0-22bf-47c3-9464-0dfd28449048 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:38.008018 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-db4980b3-fb29-4802-a950-401fa2a496af req-9d8cefc0-22bf-47c3-9464-0dfd28449048 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=2c8e0d1f-5173-42bd-9d62-52d2caa539fb HTTP/1.1" status: 200 len: 980 time: 0.0780253 Nov 09 04:39:38.022697 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f7e4bc7-b698-4a27-ae1d-a40746ee2ce0 req-394445dd-7cb5-48a0-8253-848aa390da9b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:38.024072 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-0f7e4bc7-b698-4a27-ae1d-a40746ee2ce0 req-394445dd-7cb5-48a0-8253-848aa390da9b service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&device_id=2c8e0d1f-5173-42bd-9d62-52d2caa539fb HTTP/1.1" status: 200 len: 1133 time: 0.0632911 Nov 09 04:39:38.070122 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-0f7e4bc7-b698-4a27-ae1d-a40746ee2ce0 req-7fcb12cf-2f63-453a-9c87-7df1a14d6d0a service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=fa246bc6-659f-4e85-bac6-0f3a578f184d HTTP/1.1" status: 200 len: 217 time: 0.0371199 Nov 09 04:39:38.116783 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-db4980b3-fb29-4802-a950-401fa2a496af req-917176a6-6916-4ae9-a8b5-2682d4208677 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=2817c110-1ac7-4efe-9682-6d1a22d5b7a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1021945 Nov 09 04:39:38.132683 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f7e4bc7-b698-4a27-ae1d-a40746ee2ce0 req-2e44276c-25a3-4aa0-b789-4d2c80dd4ec9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:38.134099 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-0f7e4bc7-b698-4a27-ae1d-a40746ee2ce0 req-2e44276c-25a3-4aa0-b789-4d2c80dd4ec9 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=79c0d1fe-bd0e-4079-abdb-8e32c802a558 HTTP/1.1" status: 200 len: 834 time: 0.0536680 Nov 09 04:39:38.184525 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f7e4bc7-b698-4a27-ae1d-a40746ee2ce0 req-94cbf909-fe6e-46dc-a21b-ca0cd76837a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:38.185995 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-0f7e4bc7-b698-4a27-ae1d-a40746ee2ce0 req-94cbf909-fe6e-46dc-a21b-ca0cd76837a9 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=359658ce-f1c6-4bcf-90bc-4a816eebef8a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0440302 Nov 09 04:39:38.275631 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-0f7e4bc7-b698-4a27-ae1d-a40746ee2ce0 req-c05d97f1-d3be-462d-9eae-ff6b848e4525 service neutron] 10.222.0.26 "GET /v2.0/networks/359658ce-f1c6-4bcf-90bc-4a816eebef8a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0821276 Nov 09 04:39:38.367138 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-0f7e4bc7-b698-4a27-ae1d-a40746ee2ce0 req-c6a6690f-50fd-4b74-8031-14dcd280d9d2 service neutron] 10.222.0.26 "GET /v2.0/networks/359658ce-f1c6-4bcf-90bc-4a816eebef8a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0840135 Nov 09 04:39:39.232381 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d454431-e542-4e3d-a215-232da1912fd5 req-183dc248-9763-4302-b4db-4c288e5a0e1b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:39.233836 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-9d454431-e542-4e3d-a215-232da1912fd5 req-183dc248-9763-4302-b4db-4c288e5a0e1b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=2c8e0d1f-5173-42bd-9d62-52d2caa539fb HTTP/1.1" status: 200 len: 980 time: 0.0484753 Nov 09 04:39:39.279534 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-9d454431-e542-4e3d-a215-232da1912fd5 req-e67fb011-ca30-4e85-af77-bb1f925f1936 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=2817c110-1ac7-4efe-9682-6d1a22d5b7a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393863 Nov 09 04:39:39.767813 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device fa246bc6-659f-4e85-bac6-0f3a578f184d details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=102163) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 09 04:39:39.859706 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port fa246bc6-659f-4e85-bac6-0f3a578f184d, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=fa246bc6-659f-4e85-bac6-0f3a578f184d,segment=NetworkSegment(3e8c180a-3f73-4be8-b3d7-21a3b0ec67c0),segment_id=3e8c180a-3f73-4be8-b3d7-21a3b0ec67c0)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:39:39.870952 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Returning: {'device': 'fa246bc6-659f-4e85-bac6-0f3a578f184d', 'network_id': '359658ce-f1c6-4bcf-90bc-4a816eebef8a', 'port_id': 'fa246bc6-659f-4e85-bac6-0f3a578f184d', 'mac_address': 'fa:16:3e:a3:af:3f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 313, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '79c0d1fe-bd0e-4079-abdb-8e32c802a558', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102163) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 09 04:39:39.909109 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:39.921484 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id fa246bc6-659f-4e85-bac6-0f3a578f184d {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:39:39.940995 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port fa246bc6-659f-4e85-bac6-0f3a578f184d, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=fa246bc6-659f-4e85-bac6-0f3a578f184d,segment=NetworkSegment(3e8c180a-3f73-4be8-b3d7-21a3b0ec67c0),segment_id=3e8c180a-3f73-4be8-b3d7-21a3b0ec67c0)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:39:40.008703 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:40.055799 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=fa246bc6-659f-4e85-bac6-0f3a578f184d,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:39:40.209950 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['fa246bc6-659f-4e85-bac6-0f3a578f184d'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 04:39:40.391335 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f6f40a0-c9ab-456b-a364-eab6ac4e38d0 req-0d58d609-e27a-4646-805b-9e82634a922e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:40.393395 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-0f6f40a0-c9ab-456b-a364-eab6ac4e38d0 req-0d58d609-e27a-4646-805b-9e82634a922e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=2c8e0d1f-5173-42bd-9d62-52d2caa539fb HTTP/1.1" status: 200 len: 981 time: 0.0473289 Nov 09 04:39:40.437544 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-0f6f40a0-c9ab-456b-a364-eab6ac4e38d0 req-aa2c1986-7297-4ae9-b0b3-47e123ddaec6 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=2817c110-1ac7-4efe-9682-6d1a22d5b7a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0384390 Nov 09 04:39:41.348594 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-931adf53-9487-4dc4-99a1-3e044cb7f051 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:41.549068 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-315cd646-2f46-469c-a968-b4c6bb689632 req-ff90bd04-b855-4379-8c36-a6eecfda34a5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:41.550471 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-315cd646-2f46-469c-a968-b4c6bb689632 req-ff90bd04-b855-4379-8c36-a6eecfda34a5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=2c8e0d1f-5173-42bd-9d62-52d2caa539fb HTTP/1.1" status: 200 len: 981 time: 0.0478039 Nov 09 04:39:41.595758 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-315cd646-2f46-469c-a968-b4c6bb689632 req-7aa1a03b-a51a-4b65-8218-94506764bdde tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=2817c110-1ac7-4efe-9682-6d1a22d5b7a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395684 Nov 09 04:39:41.782103 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device fa246bc6-659f-4e85-bac6-0f3a578f184d up at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:39:41.974560 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning for port fa246bc6-659f-4e85-bac6-0f3a578f184d completed by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 09 04:39:41.978600 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning complete for port fa246bc6-659f-4e85-bac6-0f3a578f184d triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:39:41.978971 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:42.053127 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:42.074899 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2c8e0d1f-5173-42bd-9d62-52d2caa539fb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fa246bc6-659f-4e85-bac6-0f3a578f184d'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:39:42.077444 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6464902c-f743-442d-8a26-8dce4595a453" -d '{"events": [{"server_uuid": "2c8e0d1f-5173-42bd-9d62-52d2caa539fb", "name": "network-vif-plugged", "status": "completed", "tag": "fa246bc6-659f-4e85-bac6-0f3a578f184d"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:39:42.089585 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port fa246bc6-659f-4e85-bac6-0f3a578f184d, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=fa246bc6-659f-4e85-bac6-0f3a578f184d,segment=NetworkSegment(3e8c180a-3f73-4be8-b3d7-21a3b0ec67c0),segment_id=3e8c180a-3f73-4be8-b3d7-21a3b0ec67c0)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:39:42.169040 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:39:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-82c63fec-21b3-4803-823d-15fe57f8ac07 x-openstack-request-id: req-82c63fec-21b3-4803-823d-15fe57f8ac07 {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:39:42.169392 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2c8e0d1f-5173-42bd-9d62-52d2caa539fb", "name": "network-vif-plugged", "status": "completed", "tag": "fa246bc6-659f-4e85-bac6-0f3a578f184d", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:39:42.169647 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-82c63fec-21b3-4803-823d-15fe57f8ac07 {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:39:42.170042 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2c8e0d1f-5173-42bd-9d62-52d2caa539fb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fa246bc6-659f-4e85-bac6-0f3a578f184d', 'code': 200} Nov 09 04:39:42.175297 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:42.208511 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:42.226844 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=fa246bc6-659f-4e85-bac6-0f3a578f184d,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:39:42.484316 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6695d62-2b82-41c7-b98c-e4cd80f68ac2 req-aebd64d8-29b1-499c-957d-82fe3fa73cc0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:42.485686 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b6695d62-2b82-41c7-b98c-e4cd80f68ac2 req-aebd64d8-29b1-499c-957d-82fe3fa73cc0 service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=2c8e0d1f-5173-42bd-9d62-52d2caa539fb HTTP/1.1" status: 200 len: 1135 time: 0.0382948 Nov 09 04:39:42.532468 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b6695d62-2b82-41c7-b98c-e4cd80f68ac2 req-82aff6ce-8365-43b9-841c-db062b13f35a service neutron] 10.222.0.26 "GET /v2.0/security-groups?id=2817c110-1ac7-4efe-9682-6d1a22d5b7a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396216 Nov 09 04:39:42.712504 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67a610d7-8d1d-4fde-85ab-02ff352be00d req-4cbd4df2-da27-4214-be01-4c34bbd7e230 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:42.713974 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-67a610d7-8d1d-4fde-85ab-02ff352be00d req-4cbd4df2-da27-4214-be01-4c34bbd7e230 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=2c8e0d1f-5173-42bd-9d62-52d2caa539fb HTTP/1.1" status: 200 len: 982 time: 0.0520210 Nov 09 04:39:42.760441 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-67a610d7-8d1d-4fde-85ab-02ff352be00d req-803ca540-ae00-4b2f-86bf-7c48a030756f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=2817c110-1ac7-4efe-9682-6d1a22d5b7a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403724 Nov 09 04:39:43.703393 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3852f4c4-9a9e-4b3e-9965-ae11f195b8c8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:43.875599 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c49db96-dce2-4a02-8cac-bb07bb82a890 req-0fa115e3-dab9-447d-9e19-511cc2ebb6c3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:43.877210 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1c49db96-dce2-4a02-8cac-bb07bb82a890 req-0fa115e3-dab9-447d-9e19-511cc2ebb6c3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=2c8e0d1f-5173-42bd-9d62-52d2caa539fb HTTP/1.1" status: 200 len: 982 time: 0.0504377 Nov 09 04:39:43.926634 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1c49db96-dce2-4a02-8cac-bb07bb82a890 req-061bec95-0ff0-441c-bee4-c729974a0f3f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=2817c110-1ac7-4efe-9682-6d1a22d5b7a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411766 Nov 09 04:39:44.038241 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c55cbf81-79f9-4e4d-9396-2c01a38407c1 req-af28da5d-8586-4202-a713-f6bb9c2edfc9 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:44.039782 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c55cbf81-79f9-4e4d-9396-2c01a38407c1 req-af28da5d-8586-4202-a713-f6bb9c2edfc9 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=2c8e0d1f-5173-42bd-9d62-52d2caa539fb HTTP/1.1" status: 200 len: 982 time: 0.0483496 Nov 09 04:39:44.086129 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c55cbf81-79f9-4e4d-9396-2c01a38407c1 req-a16cc2a0-234f-470f-aa06-a0918e456114 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=2817c110-1ac7-4efe-9682-6d1a22d5b7a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405223 Nov 09 04:39:44.107678 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60418) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:39:44.146615 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-88197c36-a714-4c49-9c3b-384b56c2946b tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:44.148088 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-88197c36-a714-4c49-9c3b-384b56c2946b tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/ports?device_id=2c8e0d1f-5173-42bd-9d62-52d2caa539fb HTTP/1.1" status: 200 len: 1130 time: 0.0394669 Nov 09 04:39:44.150899 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60420) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:39:44.155024 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-02d5b61e-691e-4219-8060-29b36d4141d0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'floatingip': {'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'port_id': 'fa246bc6-659f-4e85-bac6-0f3a578f184d', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ip_address': '172.20.0.7'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:39:44.268847 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-02d5b61e-691e-4219-8060-29b36d4141d0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for floatingip, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:44.367355 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-02d5b61e-691e-4219-8060-29b36d4141d0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:44.470900 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-02d5b61e-691e-4219-8060-29b36d4141d0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Allocated IP 172.26.0.32 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/ae007345-f708-4cd5-8b5c-bd8a21ad0785) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:39:44.572952 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-02d5b61e-691e-4219-8060-29b36d4141d0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:44.680863 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-02d5b61e-691e-4219-8060-29b36d4141d0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:44.716246 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-02d5b61e-691e-4219-8060-29b36d4141d0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:39:44.719066 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-02d5b61e-691e-4219-8060-29b36d4141d0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:39:44.721941 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-02d5b61e-691e-4219-8060-29b36d4141d0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:39:44.755849 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02d5b61e-691e-4219-8060-29b36d4141d0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Port': ['ID=ae007345-f708-4cd5-8b5c-bd8a21ad0785,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:39:45.086943 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-02d5b61e-691e-4219-8060-29b36d4141d0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:45.094454 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:45.236445 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-02d5b61e-691e-4219-8060-29b36d4141d0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:45.379256 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-02d5b61e-691e-4219-8060-29b36d4141d0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:45.440418 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-02d5b61e-691e-4219-8060-29b36d4141d0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:45.508181 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02d5b61e-691e-4219-8060-29b36d4141d0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Port': ['ID=ae007345-f708-4cd5-8b5c-bd8a21ad0785,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:39:45.521655 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-02d5b61e-691e-4219-8060-29b36d4141d0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:45.618774 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.l3_db [None req-02d5b61e-691e-4219-8060-29b36d4141d0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Floating IP ceb0f2a6-8f18-4a3a-9ed6-73ea81782e7c associated. External IP: 172.26.0.32, port: fa246bc6-659f-4e85-bac6-0f3a578f184d. Nov 09 04:39:45.818786 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-02d5b61e-691e-4219-8060-29b36d4141d0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Router b186380e-ee5f-4e3e-a5f8-325fb4d3520b has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:39:45.924740 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-02d5b61e-691e-4219-8060-29b36d4141d0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:39:45.934204 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cd035b88-5ec4-4318-a1fa-382edffbf97d None None] Sync routers for ids ['b186380e-ee5f-4e3e-a5f8-325fb4d3520b'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:39:45.943874 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cd035b88-5ec4-4318-a1fa-382edffbf97d None None] Routers {'b186380e-ee5f-4e3e-a5f8-325fb4d3520b'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:39:45.944479 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-cd035b88-5ec4-4318-a1fa-382edffbf97d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:39:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['b186380e-ee5f-4e3e-a5f8-325fb4d3520b'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:39:46.014075 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-02d5b61e-691e-4219-8060-29b36d4141d0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:46.042401 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-02d5b61e-691e-4219-8060-29b36d4141d0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 1032 time: 1.8904805 Nov 09 04:39:46.043010 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2c8e0d1f-5173-42bd-9d62-52d2caa539fb', 'tag': 'fa246bc6-659f-4e85-bac6-0f3a578f184d'}] {{(pid=102161) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:39:46.045308 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}99dfdda0def497b4372884ef2eb87f06b1e425c8eba5ceda5f64bbab037a07d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ad5e95d7-7286-4d58-aa2f-fa4f5039f870" -d '{"events": [{"name": "network-changed", "server_uuid": "2c8e0d1f-5173-42bd-9d62-52d2caa539fb", "tag": "fa246bc6-659f-4e85-bac6-0f3a578f184d"}]}' {{(pid=102161) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:39:46.045499 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 60422) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:39:46.047805 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-cd035b88-5ec4-4318-a1fa-382edffbf97d None None] Set router b186380e-ee5f-4e3e-a5f8-325fb4d3520b gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:39:46.120920 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f04af5d8-7604-4fcf-8595-96e5a7371c2f tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:46.125285 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-f04af5d8-7604-4fcf-8595-96e5a7371c2f tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/ports?device_id=2c8e0d1f-5173-42bd-9d62-52d2caa539fb&network_id=359658ce-f1c6-4bcf-90bc-4a816eebef8a HTTP/1.1" status: 200 len: 1130 time: 0.0761011 Nov 09 04:39:46.151026 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:39:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-12e8ca11-4958-4ccc-bd53-9b9939786510 x-openstack-request-id: req-12e8ca11-4958-4ccc-bd53-9b9939786510 {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:39:46.151540 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2c8e0d1f-5173-42bd-9d62-52d2caa539fb", "tag": "fa246bc6-659f-4e85-bac6-0f3a578f184d", "status": "completed", "code": 200}]} {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:39:46.151711 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-12e8ca11-4958-4ccc-bd53-9b9939786510 {{(pid=102161) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:39:46.152129 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2c8e0d1f-5173-42bd-9d62-52d2caa539fb', 'tag': 'fa246bc6-659f-4e85-bac6-0f3a578f184d', 'status': 'completed', 'code': 200} Nov 09 04:39:46.281218 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-cd035b88-5ec4-4318-a1fa-382edffbf97d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b186380e-ee5f-4e3e-a5f8-325fb4d3520b', 'name': 'tempest-TestNetworkBasicOps-router-1697092511', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.142'}], 'enable_snat': True}, 'gw_port_id': '98412fb7-ede7-41fa-a41f-2b1e63040f98', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:39:23Z', 'updated_at': '2021-11-09T04:39:27Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '98412fb7-ede7-41fa-a41f-2b1e63040f98', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:77:12:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b186380e-ee5f-4e3e-a5f8-325fb4d3520b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1408, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.142', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:39:23Z', 'updated_at': '2021-11-09T04:39:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': 'ceb0f2a6-8f18-4a3a-9ed6-73ea81782e7c', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'floating_ip_address': '172.26.0.32', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': 'b186380e-ee5f-4e3e-a5f8-325fb4d3520b', 'port_id': 'fa246bc6-659f-4e85-bac6-0f3a578f184d', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 1423, 'description': '', 'qos_policy_id': None, 'port_details': {'name': 'tempest-TestNetworkBasicOps-443713325', 'network_id': '359658ce-f1c6-4bcf-90bc-4a816eebef8a', 'mac_address': 'fa:16:3e:a3:af:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2c8e0d1f-5173-42bd-9d62-52d2caa539fb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:39:44Z', 'updated_at': '2021-11-09T04:39:44Z', 'revision_number': 0, 'project_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dc5c1965-8ffd-4978-a8a2-af1f55688062', 'name': '', 'network_id': '359658ce-f1c6-4bcf-90bc-4a816eebef8a', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:47:f4:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b186380e-ee5f-4e3e-a5f8-325fb4d3520b', 'device_owner': 'network:router_interface', 'standard_attr_id': 1411, 'fixed_ips': [{'subnet_id': '79c0d1fe-bd0e-4079-abdb-8e32c802a558', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:39:27Z', 'updated_at': '2021-11-09T04:39:31Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '79c0d1fe-bd0e-4079-abdb-8e32c802a558', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:39:46.313586 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cd035b88-5ec4-4318-a1fa-382edffbf97d None None] Checking router: b186380e-ee5f-4e3e-a5f8-325fb4d3520b for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:39:46.327308 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cd035b88-5ec4-4318-a1fa-382edffbf97d None None] Routers {'b186380e-ee5f-4e3e-a5f8-325fb4d3520b'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:39:46.327308 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-cd035b88-5ec4-4318-a1fa-382edffbf97d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:39:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['b186380e-ee5f-4e3e-a5f8-325fb4d3520b'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:39:46.437504 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-cd035b88-5ec4-4318-a1fa-382edffbf97d None None] Set router b186380e-ee5f-4e3e-a5f8-325fb4d3520b gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:39:46.466292 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:46.577930 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad5e95d7-7286-4d58-aa2f-fa4f5039f870 req-143c8e54-9dc1-4f31-ad09-b37100cb3a50 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:46.579791 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ad5e95d7-7286-4d58-aa2f-fa4f5039f870 req-143c8e54-9dc1-4f31-ad09-b37100cb3a50 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&device_id=2c8e0d1f-5173-42bd-9d62-52d2caa539fb HTTP/1.1" status: 200 len: 1135 time: 0.4034009 Nov 09 04:39:46.605762 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bccf09c-ce15-4075-a957-fe0afacd5627 req-bd4359f8-bac6-49b0-a6db-5aad7f6ee5ae tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:46.607254 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6bccf09c-ce15-4075-a957-fe0afacd5627 req-bd4359f8-bac6-49b0-a6db-5aad7f6ee5ae tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=2c8e0d1f-5173-42bd-9d62-52d2caa539fb HTTP/1.1" status: 200 len: 982 time: 0.0649202 Nov 09 04:39:46.673819 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-cd035b88-5ec4-4318-a1fa-382edffbf97d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b186380e-ee5f-4e3e-a5f8-325fb4d3520b', 'name': 'tempest-TestNetworkBasicOps-router-1697092511', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.142'}], 'enable_snat': True}, 'gw_port_id': '98412fb7-ede7-41fa-a41f-2b1e63040f98', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:39:23Z', 'updated_at': '2021-11-09T04:39:27Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '98412fb7-ede7-41fa-a41f-2b1e63040f98', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:77:12:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b186380e-ee5f-4e3e-a5f8-325fb4d3520b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1408, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.142', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:39:23Z', 'updated_at': '2021-11-09T04:39:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': 'ceb0f2a6-8f18-4a3a-9ed6-73ea81782e7c', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'floating_ip_address': '172.26.0.32', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': 'b186380e-ee5f-4e3e-a5f8-325fb4d3520b', 'port_id': 'fa246bc6-659f-4e85-bac6-0f3a578f184d', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 1423, 'description': '', 'qos_policy_id': None, 'port_details': {'name': 'tempest-TestNetworkBasicOps-443713325', 'network_id': '359658ce-f1c6-4bcf-90bc-4a816eebef8a', 'mac_address': 'fa:16:3e:a3:af:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2c8e0d1f-5173-42bd-9d62-52d2caa539fb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:39:44Z', 'updated_at': '2021-11-09T04:39:44Z', 'revision_number': 0, 'project_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dc5c1965-8ffd-4978-a8a2-af1f55688062', 'name': '', 'network_id': '359658ce-f1c6-4bcf-90bc-4a816eebef8a', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:47:f4:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b186380e-ee5f-4e3e-a5f8-325fb4d3520b', 'device_owner': 'network:router_interface', 'standard_attr_id': 1411, 'fixed_ips': [{'subnet_id': '79c0d1fe-bd0e-4079-abdb-8e32c802a558', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:39:27Z', 'updated_at': '2021-11-09T04:39:31Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '79c0d1fe-bd0e-4079-abdb-8e32c802a558', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:39:46.702557 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cd035b88-5ec4-4318-a1fa-382edffbf97d None None] The sync data for ids ['b186380e-ee5f-4e3e-a5f8-325fb4d3520b'] in dv-neutron-816802-2-hyperv is: [{'id': 'b186380e-ee5f-4e3e-a5f8-325fb4d3520b', 'name': 'tempest-TestNetworkBasicOps-router-1697092511', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.142'}], 'enable_snat': True}, 'gw_port_id': '98412fb7-ede7-41fa-a41f-2b1e63040f98', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:39:23Z', 'updated_at': '2021-11-09T04:39:27Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '98412fb7-ede7-41fa-a41f-2b1e63040f98', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:77:12:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b186380e-ee5f-4e3e-a5f8-325fb4d3520b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1408, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.142', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:39:23Z', 'updated_at': '2021-11-09T04:39:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': 'ceb0f2a6-8f18-4a3a-9ed6-73ea81782e7c', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'floating_ip_address': '172.26.0.32', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': 'b186380e-ee5f-4e3e-a5f8-325fb4d3520b', 'port_id': 'fa246bc6-659f-4e85-bac6-0f3a578f184d', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 1423, 'description': '', 'qos_policy_id': None, 'port_details': {'name': 'tempest-TestNetworkBasicOps-443713325', 'network_id': '359658ce-f1c6-4bcf-90bc-4a816eebef8a', 'mac_address': 'fa:16:3e:a3:af:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2c8e0d1f-5173-42bd-9d62-52d2caa539fb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:39:44Z', 'updated_at': '2021-11-09T04:39:44Z', 'revision_number': 0, 'project_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dc5c1965-8ffd-4978-a8a2-af1f55688062', 'name': '', 'network_id': '359658ce-f1c6-4bcf-90bc-4a816eebef8a', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:47:f4:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b186380e-ee5f-4e3e-a5f8-325fb4d3520b', 'device_owner': 'network:router_interface', 'standard_attr_id': 1411, 'fixed_ips': [{'subnet_id': '79c0d1fe-bd0e-4079-abdb-8e32c802a558', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:39:27Z', 'updated_at': '2021-11-09T04:39:31Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '79c0d1fe-bd0e-4079-abdb-8e32c802a558', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:39:46.705950 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6bccf09c-ce15-4075-a957-fe0afacd5627 req-85240ac3-080f-492e-bc86-ab07cf3de79f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=2817c110-1ac7-4efe-9682-6d1a22d5b7a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0878382 Nov 09 04:39:46.720055 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad5e95d7-7286-4d58-aa2f-fa4f5039f870 req-ce5224eb-cb9a-4a89-b011-ba46f91a1841 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:46.722099 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ad5e95d7-7286-4d58-aa2f-fa4f5039f870 req-ce5224eb-cb9a-4a89-b011-ba46f91a1841 service neutron] 10.222.0.26 "GET /v2.0/networks?id=359658ce-f1c6-4bcf-90bc-4a816eebef8a HTTP/1.1" status: 200 len: 898 time: 0.1338291 Nov 09 04:39:46.788924 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ad5e95d7-7286-4d58-aa2f-fa4f5039f870 req-ea63e84c-af40-4707-9c84-bee91e396adb service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=fa246bc6-659f-4e85-bac6-0f3a578f184d HTTP/1.1" status: 200 len: 1035 time: 0.0593569 Nov 09 04:39:46.842800 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad5e95d7-7286-4d58-aa2f-fa4f5039f870 req-5261f4cc-be18-4d87-9ad4-fdefc981fc36 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:46.844154 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ad5e95d7-7286-4d58-aa2f-fa4f5039f870 req-5261f4cc-be18-4d87-9ad4-fdefc981fc36 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=79c0d1fe-bd0e-4079-abdb-8e32c802a558 HTTP/1.1" status: 200 len: 834 time: 0.0477121 Nov 09 04:39:46.897155 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad5e95d7-7286-4d58-aa2f-fa4f5039f870 req-5641fb13-cfa4-42b9-8ed0-f32f331403dc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:46.899320 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ad5e95d7-7286-4d58-aa2f-fa4f5039f870 req-5641fb13-cfa4-42b9-8ed0-f32f331403dc service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=359658ce-f1c6-4bcf-90bc-4a816eebef8a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0466588 Nov 09 04:39:46.906268 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6266c010-f0ca-4f6b-8fce-d29b0b2127de None None] New status for floating IP ceb0f2a6-8f18-4a3a-9ed6-73ea81782e7c: ACTIVE {{(pid=102163) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 04:39:46.948326 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:46.991641 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ad5e95d7-7286-4d58-aa2f-fa4f5039f870 req-0fb335b5-ca43-4347-8c4c-297f5b9baf36 service neutron] 10.222.0.26 "GET /v2.0/networks/359658ce-f1c6-4bcf-90bc-4a816eebef8a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0844903 Nov 09 04:39:47.086510 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ad5e95d7-7286-4d58-aa2f-fa4f5039f870 req-edb5f47f-f29c-48b8-b971-35322d04faf5 service neutron] 10.222.0.26 "GET /v2.0/networks/359658ce-f1c6-4bcf-90bc-4a816eebef8a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0862787 Nov 09 04:39:47.822592 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae8b14cd-7d94-4cc7-8114-679884828d61 req-347825e5-f6a4-4477-9ae8-f2c30074f303 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:47.824113 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ae8b14cd-7d94-4cc7-8114-679884828d61 req-347825e5-f6a4-4477-9ae8-f2c30074f303 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=2c8e0d1f-5173-42bd-9d62-52d2caa539fb HTTP/1.1" status: 200 len: 982 time: 0.0495617 Nov 09 04:39:47.856407 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04b31454-2c8c-4d17-9fa2-a19a256bb4c8 req-aae371c6-b519-4b3b-b458-24edc093bc2e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:47.857876 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-04b31454-2c8c-4d17-9fa2-a19a256bb4c8 req-aae371c6-b519-4b3b-b458-24edc093bc2e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "GET /v2.0/ports?device_id=2c8e0d1f-5173-42bd-9d62-52d2caa539fb HTTP/1.1" status: 200 len: 982 time: 0.0475862 Nov 09 04:39:47.871960 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ae8b14cd-7d94-4cc7-8114-679884828d61 req-e8d23362-78d3-4188-838a-48a8f41053ce tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=2817c110-1ac7-4efe-9682-6d1a22d5b7a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419044 Nov 09 04:39:47.901799 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04b31454-2c8c-4d17-9fa2-a19a256bb4c8 req-a71cc62e-209e-4d65-8c99-7f85dc13a921 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['binding:profile'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:47.903184 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-04b31454-2c8c-4d17-9fa2-a19a256bb4c8 req-a71cc62e-209e-4d65-8c99-7f85dc13a921 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "GET /v2.0/ports/fa246bc6-659f-4e85-bac6-0f3a578f184d?fields=binding%3Aprofile&fields=network_id HTTP/1.1" status: 200 len: 260 time: 0.0393169 Nov 09 04:39:48.006566 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-04b31454-2c8c-4d17-9fa2-a19a256bb4c8 req-28d97e43-9b93-4951-9f45-50587fb9b0c4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "GET /v2.0/networks/359658ce-f1c6-4bcf-90bc-4a816eebef8a?fields=dns_domain HTTP/1.1" status: 200 len: 212 time: 0.0966799 Nov 09 04:39:48.018740 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-04b31454-2c8c-4d17-9fa2-a19a256bb4c8 req-87b8907f-be4d-453a-86e2-8d069140e655 service neutron] Request body: {'port': {'device_id': '', 'device_owner': '', 'binding:host_id': None, 'binding:profile': {}}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:39:48.068166 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-04b31454-2c8c-4d17-9fa2-a19a256bb4c8 req-87b8907f-be4d-453a-86e2-8d069140e655 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:48.196887 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-04b31454-2c8c-4d17-9fa2-a19a256bb4c8 req-87b8907f-be4d-453a-86e2-8d069140e655 service neutron] For port fa246bc6-659f-4e85-bac6-0f3a578f184d, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=fa246bc6-659f-4e85-bac6-0f3a578f184d,segment=NetworkSegment(3e8c180a-3f73-4be8-b3d7-21a3b0ec67c0),segment_id=3e8c180a-3f73-4be8-b3d7-21a3b0ec67c0)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:39:48.228834 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-04b31454-2c8c-4d17-9fa2-a19a256bb4c8 req-87b8907f-be4d-453a-86e2-8d069140e655 service neutron] For port fa246bc6-659f-4e85-bac6-0f3a578f184d, host hv-neutron-8168, cleared binding levels {{(pid=102162) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:39:48.262524 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [req-04b31454-2c8c-4d17-9fa2-a19a256bb4c8 req-87b8907f-be4d-453a-86e2-8d069140e655 service neutron] device_id is not set on port fa246bc6-659f-4e85-bac6-0f3a578f184d yet. {{(pid=102162) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:39:48.271467 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-04b31454-2c8c-4d17-9fa2-a19a256bb4c8 req-87b8907f-be4d-453a-86e2-8d069140e655 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:48.331367 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-04b31454-2c8c-4d17-9fa2-a19a256bb4c8 req-87b8907f-be4d-453a-86e2-8d069140e655 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:48.426444 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87b8907f-be4d-453a-86e2-8d069140e655 service neutron] Pushing event updated for resources: {'Port': ['ID=fa246bc6-659f-4e85-bac6-0f3a578f184d,revision_number=6']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:39:48.502434 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-04b31454-2c8c-4d17-9fa2-a19a256bb4c8 req-87b8907f-be4d-453a-86e2-8d069140e655 service neutron] No DVR routers for this DVR port fa246bc6-659f-4e85-bac6-0f3a578f184d on host hv-neutron-8168 {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:39:48.586446 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e55f0dc3-7a32-4040-8f6f-4ff51c56e84d None None] Provisioning complete for port fa246bc6-659f-4e85-bac6-0f3a578f184d triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:39:48.587109 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e55f0dc3-7a32-4040-8f6f-4ff51c56e84d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:48.624308 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e55f0dc3-7a32-4040-8f6f-4ff51c56e84d None None] Port fa246bc6-659f-4e85-bac6-0f3a578f184d cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:39:48.639418 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-04b31454-2c8c-4d17-9fa2-a19a256bb4c8 req-87b8907f-be4d-453a-86e2-8d069140e655 service neutron] In _notify_port_updated(), no bound segment for port fa246bc6-659f-4e85-bac6-0f3a578f184d on network 359658ce-f1c6-4bcf-90bc-4a816eebef8a {{(pid=102162) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 09 04:39:48.640258 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04b31454-2c8c-4d17-9fa2-a19a256bb4c8 req-87b8907f-be4d-453a-86e2-8d069140e655 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:48.640861 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-04b31454-2c8c-4d17-9fa2-a19a256bb4c8 req-87b8907f-be4d-453a-86e2-8d069140e655 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:48.642144 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-04b31454-2c8c-4d17-9fa2-a19a256bb4c8 req-87b8907f-be4d-453a-86e2-8d069140e655 service neutron] 10.222.0.26 "PUT /v2.0/ports/fa246bc6-659f-4e85-bac6-0f3a578f184d HTTP/1.1" status: 200 len: 1025 time: 0.6278248 Nov 09 04:39:48.979685 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-155d3f3d-fbde-47f6-ab0b-3cf9804707a6 req-bce55942-da3f-4872-828b-a7a849dbabc4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=2c8e0d1f-5173-42bd-9d62-52d2caa539fb HTTP/1.1" status: 200 len: 210 time: 0.0272710 Nov 09 04:39:50.036052 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 60438) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:39:50.084422 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-17c4cc45-87c6-40b1-94bb-311a31b48578 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:50.085801 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-17c4cc45-87c6-40b1-94bb-311a31b48578 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports/fa246bc6-659f-4e85-bac6-0f3a578f184d HTTP/1.1" status: 200 len: 924 time: 0.0486042 Nov 09 04:39:50.378560 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 60442) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:39:50.383266 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-bb9a576a-0aec-40f7-9733-53db3c2c6a1c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-302479683', 'description': 'tempest-secgroup-smoke-302479683 description', 'project_id': '1d10b4824e524068827e58b55e269af3'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:39:50.471257 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bb9a576a-0aec-40f7-9733-53db3c2c6a1c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:50.534654 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bb9a576a-0aec-40f7-9733-53db3c2c6a1c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:50.637207 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bb9a576a-0aec-40f7-9733-53db3c2c6a1c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:50.666002 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb9a576a-0aec-40f7-9733-53db3c2c6a1c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroup': ['ID=5747651e-9c62-4419-af7a-16cb9f0ece60,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:39:50.757228 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bb9a576a-0aec-40f7-9733-53db3c2c6a1c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:50.758476 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-bb9a576a-0aec-40f7-9733-53db3c2c6a1c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.3787565 Nov 09 04:39:50.761297 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 60444) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:39:50.765536 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-23b2acb5-6836-4ca2-9da9-6c6c44a02914 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': '5747651e-9c62-4419-af7a-16cb9f0ece60', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:39:50.876248 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-23b2acb5-6836-4ca2-9da9-6c6c44a02914 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:50.931371 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-23b2acb5-6836-4ca2-9da9-6c6c44a02914 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:51.031942 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-23b2acb5-6836-4ca2-9da9-6c6c44a02914 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:51.049633 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23b2acb5-6836-4ca2-9da9-6c6c44a02914 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=102dffe2-883f-458f-bbf4-24c7237dbaac,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:39:51.131539 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-23b2acb5-6836-4ca2-9da9-6c6c44a02914 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:51.132778 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-23b2acb5-6836-4ca2-9da9-6c6c44a02914 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3705773 Nov 09 04:39:51.135822 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60446) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:39:51.140408 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-45775e71-b183-43af-8bb9-2764b3b1d16e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': '5747651e-9c62-4419-af7a-16cb9f0ece60', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:39:51.226976 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-45775e71-b183-43af-8bb9-2764b3b1d16e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:51.279700 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-45775e71-b183-43af-8bb9-2764b3b1d16e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:51.359980 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-45775e71-b183-43af-8bb9-2764b3b1d16e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:51.377184 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45775e71-b183-43af-8bb9-2764b3b1d16e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=cc3b8e56-2019-4201-a9fa-ec8d80041b76,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:39:51.447613 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-45775e71-b183-43af-8bb9-2764b3b1d16e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:51.448919 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-45775e71-b183-43af-8bb9-2764b3b1d16e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.3121185 Nov 09 04:39:51.451620 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60448) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:39:51.455825 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-b4a3b321-48f9-461b-b0bf-9786c1c1f424 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': '5747651e-9c62-4419-af7a-16cb9f0ece60', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:39:51.569900 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b4a3b321-48f9-461b-b0bf-9786c1c1f424 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:51.628080 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b4a3b321-48f9-461b-b0bf-9786c1c1f424 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:51.708038 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b4a3b321-48f9-461b-b0bf-9786c1c1f424 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:51.726086 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4a3b321-48f9-461b-b0bf-9786c1c1f424 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4022c92f-3704-4178-95e2-b3effbacf438,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:39:51.796817 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device fa246bc6-659f-4e85-bac6-0f3a578f184d no longer exists at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:39:51.816302 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b4a3b321-48f9-461b-b0bf-9786c1c1f424 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:51.825788 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-b4a3b321-48f9-461b-b0bf-9786c1c1f424 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3649817 Nov 09 04:39:51.825788 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60450) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:39:51.825788 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-fee95253-72f3-40bc-8dda-fab1eec2d0ec tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': '5747651e-9c62-4419-af7a-16cb9f0ece60', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:39:51.834989 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device fa246bc6-659f-4e85-bac6-0f3a578f184d not bound to the agent host hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:39:51.968436 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-fee95253-72f3-40bc-8dda-fab1eec2d0ec tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:52.024893 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-fee95253-72f3-40bc-8dda-fab1eec2d0ec tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:52.102800 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-fee95253-72f3-40bc-8dda-fab1eec2d0ec tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:52.119500 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fee95253-72f3-40bc-8dda-fab1eec2d0ec tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=01dfba3f-185e-46c3-a64b-bbb883d7aa4f,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:39:52.201995 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-fee95253-72f3-40bc-8dda-fab1eec2d0ec tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:52.203242 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-fee95253-72f3-40bc-8dda-fab1eec2d0ec tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3820472 Nov 09 04:39:52.206055 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60452) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:39:52.215049 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-68734ba7-d2ef-41b8-8a87-486d84d152e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': '5747651e-9c62-4419-af7a-16cb9f0ece60', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:39:52.314311 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.securitygroups_db [None req-68734ba7-d2ef-41b8-8a87-486d84d152e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Project 1d10b4824e524068827e58b55e269af3 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 09 04:39:52.319634 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-68734ba7-d2ef-41b8-8a87-486d84d152e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:52.375847 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-68734ba7-d2ef-41b8-8a87-486d84d152e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:52.433835 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-68734ba7-d2ef-41b8-8a87-486d84d152e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:52.451017 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68734ba7-d2ef-41b8-8a87-486d84d152e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ccb4b580-403f-4ae8-a8ad-d098aeafd212,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:39:52.510243 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-68734ba7-d2ef-41b8-8a87-486d84d152e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:52.511478 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-68734ba7-d2ef-41b8-8a87-486d84d152e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.3039083 Nov 09 04:39:52.514204 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60454) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:39:52.518437 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-c9a06aa6-7e2b-44e2-b7d4-c46ea8f3332e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': '5747651e-9c62-4419-af7a-16cb9f0ece60', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:39:52.625753 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.securitygroups_db [None req-c9a06aa6-7e2b-44e2-b7d4-c46ea8f3332e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Project 1d10b4824e524068827e58b55e269af3 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 09 04:39:52.631760 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c9a06aa6-7e2b-44e2-b7d4-c46ea8f3332e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:52.690645 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c9a06aa6-7e2b-44e2-b7d4-c46ea8f3332e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:52.805868 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c9a06aa6-7e2b-44e2-b7d4-c46ea8f3332e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:52.825761 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9a06aa6-7e2b-44e2-b7d4-c46ea8f3332e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c25a181a-7093-4aea-94cb-b3f099b33b5f,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:39:52.953597 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c9a06aa6-7e2b-44e2-b7d4-c46ea8f3332e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:52.954869 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-c9a06aa6-7e2b-44e2-b7d4-c46ea8f3332e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.4397349 Nov 09 04:39:53.100493 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-973c2835-11af-48a7-b22a-9ceb491cdd01 req-efed9c5f-95ad-4e0a-9433-9928a709d808 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-302479683&fields=id&tenant_id=1d10b4824e524068827e58b55e269af3 HTTP/1.1" status: 200 len: 267 time: 0.0434570 Nov 09 04:39:53.147681 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-973c2835-11af-48a7-b22a-9ceb491cdd01 req-6989a2ba-3ac1-4c99-ab2b-80749372fe56 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:53.148925 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-973c2835-11af-48a7-b22a-9ceb491cdd01 req-6989a2ba-3ac1-4c99-ab2b-80749372fe56 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports/fa246bc6-659f-4e85-bac6-0f3a578f184d HTTP/1.1" status: 200 len: 929 time: 0.0419970 Nov 09 04:39:53.192324 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-973c2835-11af-48a7-b22a-9ceb491cdd01 req-43449555-746b-439a-b1bb-f865c327ada8 service neutron] 10.222.0.24 "GET /v2.0/ports/fa246bc6-659f-4e85-bac6-0f3a578f184d?fields=binding%3Avnic_type&fields=binding%3Aprofile&fields=network_id&fields=resource_request&fields=numa_affinity_policy&fields=device_profile HTTP/1.1" status: 200 len: 311 time: 0.0312681 Nov 09 04:39:53.281803 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-973c2835-11af-48a7-b22a-9ceb491cdd01 req-560c21eb-58ee-4f5f-864e-bb099d3e9575 service neutron] 10.222.0.24 "GET /v2.0/networks/359658ce-f1c6-4bcf-90bc-4a816eebef8a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0839210 Nov 09 04:39:53.373263 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-973c2835-11af-48a7-b22a-9ceb491cdd01 req-eec04217-354e-4ee4-90c1-5ebea2b775a6 service neutron] 10.222.0.24 "GET /v2.0/networks/359658ce-f1c6-4bcf-90bc-4a816eebef8a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0849416 Nov 09 04:39:53.599067 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-831b3bfe-6cbd-4088-be39-e95957ffc424 req-67002ad6-d267-474e-ab06-adc667e242ea tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=1ad0a7be-c42e-4f3c-b835-4ac7fe40e8c2 HTTP/1.1" status: 200 len: 210 time: 0.0270731 Nov 09 04:39:54.944581 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f443be34-6a46-4de9-9b16-a9525591075c req-f4faf9ec-1fe9-4764-a1f0-0b3688407729 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=1ad0a7be-c42e-4f3c-b835-4ac7fe40e8c2 HTTP/1.1" status: 200 len: 210 time: 0.2720234 Nov 09 04:39:55.379790 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-973c2835-11af-48a7-b22a-9ceb491cdd01 req-cdf68ff2-2e8b-4045-98e5-3c6819519d85 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:55.381117 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-973c2835-11af-48a7-b22a-9ceb491cdd01 req-cdf68ff2-2e8b-4045-98e5-3c6819519d85 service neutron] 10.222.0.26 "GET /v2.0/ports/fa246bc6-659f-4e85-bac6-0f3a578f184d HTTP/1.1" status: 200 len: 1025 time: 0.0371606 Nov 09 04:39:55.485379 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-973c2835-11af-48a7-b22a-9ceb491cdd01 req-47edf668-7886-4246-aa97-0a41f4284ee4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:55.486914 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-973c2835-11af-48a7-b22a-9ceb491cdd01 req-47edf668-7886-4246-aa97-0a41f4284ee4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "GET /v2.0/networks?id=359658ce-f1c6-4bcf-90bc-4a816eebef8a HTTP/1.1" status: 200 len: 797 time: 0.0988152 Nov 09 04:39:55.562869 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-973c2835-11af-48a7-b22a-9ceb491cdd01 req-4cff89fb-c1d1-4762-b4d8-ad0a5d52d6c5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=1d10b4824e524068827e58b55e269af3 HTTP/1.1" status: 200 len: 471 time: 0.0663223 Nov 09 04:39:55.573579 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-973c2835-11af-48a7-b22a-9ceb491cdd01 req-5cbedac5-d93b-462b-80af-72b10ba7403e service neutron] Request body: {'port': {'device_id': '1ad0a7be-c42e-4f3c-b835-4ac7fe40e8c2', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:39:55.629223 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-973c2835-11af-48a7-b22a-9ceb491cdd01 req-5cbedac5-d93b-462b-80af-72b10ba7403e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:55.888766 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [req-973c2835-11af-48a7-b22a-9ceb491cdd01 req-5cbedac5-d93b-462b-80af-72b10ba7403e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id fa246bc6-659f-4e85-bac6-0f3a578f184d {{(pid=102162) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:39:55.898137 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-973c2835-11af-48a7-b22a-9ceb491cdd01 req-5cbedac5-d93b-462b-80af-72b10ba7403e service neutron] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:55.913498 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.provisioning_blocks [req-973c2835-11af-48a7-b22a-9ceb491cdd01 req-5cbedac5-d93b-462b-80af-72b10ba7403e service neutron] Transition to ACTIVE for port object fa246bc6-659f-4e85-bac6-0f3a578f184d will not be triggered until provisioned by entity L2. {{(pid=102162) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 09 04:39:56.028121 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-973c2835-11af-48a7-b22a-9ceb491cdd01 req-5cbedac5-d93b-462b-80af-72b10ba7403e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:56.136065 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5cbedac5-d93b-462b-80af-72b10ba7403e service neutron] Pushing event updated for resources: {'Port': ['ID=fa246bc6-659f-4e85-bac6-0f3a578f184d,revision_number=7']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:39:56.149792 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2869ca4-04dc-4363-9836-d39bbcdcc0f8 req-26d5bee5-192d-4485-bc42-39c70807e8bd tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:56.151365 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d2869ca4-04dc-4363-9836-d39bbcdcc0f8 req-26d5bee5-192d-4485-bc42-39c70807e8bd tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=1ad0a7be-c42e-4f3c-b835-4ac7fe40e8c2 HTTP/1.1" status: 200 len: 980 time: 0.1341660 Nov 09 04:39:56.253951 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d2869ca4-04dc-4363-9836-d39bbcdcc0f8 req-296bf6b0-3a07-49d8-9d3b-26a607f0e46d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=2817c110-1ac7-4efe-9682-6d1a22d5b7a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0893817 Nov 09 04:39:56.278230 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-973c2835-11af-48a7-b22a-9ceb491cdd01 req-5cbedac5-d93b-462b-80af-72b10ba7403e service neutron] Attempting to bind port fa246bc6-659f-4e85-bac6-0f3a578f184d on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:39:56.278593 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-973c2835-11af-48a7-b22a-9ceb491cdd01 req-5cbedac5-d93b-462b-80af-72b10ba7403e service neutron] Attempting to bind port fa246bc6-659f-4e85-bac6-0f3a578f184d by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '3e8c180a-3f73-4be8-b3d7-21a3b0ec67c0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 313, 'network_id': '359658ce-f1c6-4bcf-90bc-4a816eebef8a'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:39:56.278916 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-973c2835-11af-48a7-b22a-9ceb491cdd01 req-5cbedac5-d93b-462b-80af-72b10ba7403e service neutron] Attempting to bind port fa246bc6-659f-4e85-bac6-0f3a578f184d on network 359658ce-f1c6-4bcf-90bc-4a816eebef8a {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:39:56.283157 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-973c2835-11af-48a7-b22a-9ceb491cdd01 req-5cbedac5-d93b-462b-80af-72b10ba7403e service neutron] Port fa246bc6-659f-4e85-bac6-0f3a578f184d on network 359658ce-f1c6-4bcf-90bc-4a816eebef8a not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:39:56.283469 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-973c2835-11af-48a7-b22a-9ceb491cdd01 req-5cbedac5-d93b-462b-80af-72b10ba7403e service neutron] Attempting to bind port fa246bc6-659f-4e85-bac6-0f3a578f184d on network 359658ce-f1c6-4bcf-90bc-4a816eebef8a {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:39:56.291055 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-973c2835-11af-48a7-b22a-9ceb491cdd01 req-5cbedac5-d93b-462b-80af-72b10ba7403e service neutron] Checking agent: {'id': '7d36b884-4ad2-4878-9464-bf647030b544', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'started_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 39, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:39:56.291384 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-973c2835-11af-48a7-b22a-9ceb491cdd01 req-5cbedac5-d93b-462b-80af-72b10ba7403e service neutron] Checking segment: {'id': '3e8c180a-3f73-4be8-b3d7-21a3b0ec67c0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 313, 'network_id': '359658ce-f1c6-4bcf-90bc-4a816eebef8a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:39:56.291756 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-973c2835-11af-48a7-b22a-9ceb491cdd01 req-5cbedac5-d93b-462b-80af-72b10ba7403e service neutron] Bound using segment: {'id': '3e8c180a-3f73-4be8-b3d7-21a3b0ec67c0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 313, 'network_id': '359658ce-f1c6-4bcf-90bc-4a816eebef8a'} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:39:56.292172 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-973c2835-11af-48a7-b22a-9ceb491cdd01 req-5cbedac5-d93b-462b-80af-72b10ba7403e service neutron] Bound port: fa246bc6-659f-4e85-bac6-0f3a578f184d, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '3e8c180a-3f73-4be8-b3d7-21a3b0ec67c0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 313, 'network_id': '359658ce-f1c6-4bcf-90bc-4a816eebef8a'}}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:39:56.292515 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-973c2835-11af-48a7-b22a-9ceb491cdd01 req-5cbedac5-d93b-462b-80af-72b10ba7403e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:56.357032 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-973c2835-11af-48a7-b22a-9ceb491cdd01 req-5cbedac5-d93b-462b-80af-72b10ba7403e service neutron] For port fa246bc6-659f-4e85-bac6-0f3a578f184d, host hv-neutron-8168, cleared binding levels {{(pid=102162) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:39:56.359959 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-973c2835-11af-48a7-b22a-9ceb491cdd01 req-5cbedac5-d93b-462b-80af-72b10ba7403e service neutron] For port fa246bc6-659f-4e85-bac6-0f3a578f184d, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=fa246bc6-659f-4e85-bac6-0f3a578f184d,segment=NetworkSegment(3e8c180a-3f73-4be8-b3d7-21a3b0ec67c0),segment_id=3e8c180a-3f73-4be8-b3d7-21a3b0ec67c0)] {{(pid=102162) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:39:56.418668 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-973c2835-11af-48a7-b22a-9ceb491cdd01 req-5cbedac5-d93b-462b-80af-72b10ba7403e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:56.452954 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-973c2835-11af-48a7-b22a-9ceb491cdd01 req-5cbedac5-d93b-462b-80af-72b10ba7403e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:56.453568 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-973c2835-11af-48a7-b22a-9ceb491cdd01 req-5cbedac5-d93b-462b-80af-72b10ba7403e service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:56.455012 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-973c2835-11af-48a7-b22a-9ceb491cdd01 req-5cbedac5-d93b-462b-80af-72b10ba7403e service neutron] 10.222.0.26 "PUT /v2.0/ports/fa246bc6-659f-4e85-bac6-0f3a578f184d HTTP/1.1" status: 200 len: 1130 time: 0.8853061 Nov 09 04:39:56.455533 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1ad0a7be-c42e-4f3c-b835-4ac7fe40e8c2', 'tag': 'fa246bc6-659f-4e85-bac6-0f3a578f184d'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:39:56.457706 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4b0f03c5-45fb-42da-a2b6-cf0c4bbf8182" -d '{"events": [{"name": "network-changed", "server_uuid": "1ad0a7be-c42e-4f3c-b835-4ac7fe40e8c2", "tag": "fa246bc6-659f-4e85-bac6-0f3a578f184d"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:39:56.481095 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5cbedac5-d93b-462b-80af-72b10ba7403e service neutron] Pushing event updated for resources: {'Port': ['ID=fa246bc6-659f-4e85-bac6-0f3a578f184d,revision_number=8']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:39:56.502920 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:39:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4bef3f24-2e23-471e-bbbc-aef071ff0943 x-openstack-request-id: req-4bef3f24-2e23-471e-bbbc-aef071ff0943 {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:39:56.503214 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1ad0a7be-c42e-4f3c-b835-4ac7fe40e8c2", "tag": "fa246bc6-659f-4e85-bac6-0f3a578f184d", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:39:56.503465 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-4bef3f24-2e23-471e-bbbc-aef071ff0943 {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:39:56.503952 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1ad0a7be-c42e-4f3c-b835-4ac7fe40e8c2', 'tag': 'fa246bc6-659f-4e85-bac6-0f3a578f184d', 'status': 'completed', 'code': 200} Nov 09 04:39:56.584863 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b0f03c5-45fb-42da-a2b6-cf0c4bbf8182 req-e6a3710d-143b-48fe-86ab-75f875158f22 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:56.586432 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4b0f03c5-45fb-42da-a2b6-cf0c4bbf8182 req-e6a3710d-143b-48fe-86ab-75f875158f22 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&device_id=1ad0a7be-c42e-4f3c-b835-4ac7fe40e8c2 HTTP/1.1" status: 200 len: 1133 time: 0.0528603 Nov 09 04:39:56.699358 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b0f03c5-45fb-42da-a2b6-cf0c4bbf8182 req-44afa258-8024-4c91-a7bc-bb0af2f0b6a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:56.700742 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4b0f03c5-45fb-42da-a2b6-cf0c4bbf8182 req-44afa258-8024-4c91-a7bc-bb0af2f0b6a9 service neutron] 10.222.0.26 "GET /v2.0/networks?tenant_id=1d10b4824e524068827e58b55e269af3&shared=False HTTP/1.1" status: 200 len: 898 time: 0.1058395 Nov 09 04:39:56.809144 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b0f03c5-45fb-42da-a2b6-cf0c4bbf8182 req-b41f3e54-1609-4678-a049-58cf658a3ef6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:56.810688 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4b0f03c5-45fb-42da-a2b6-cf0c4bbf8182 req-b41f3e54-1609-4678-a049-58cf658a3ef6 service neutron] 10.222.0.26 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1021626 Nov 09 04:39:56.897378 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-973c2835-11af-48a7-b22a-9ceb491cdd01 req-6fa88504-d38b-4712-8d35-779d5a70aaff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:56.898908 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-973c2835-11af-48a7-b22a-9ceb491cdd01 req-6fa88504-d38b-4712-8d35-779d5a70aaff service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&device_id=1ad0a7be-c42e-4f3c-b835-4ac7fe40e8c2 HTTP/1.1" status: 200 len: 1133 time: 0.0508769 Nov 09 04:39:56.970960 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-973c2835-11af-48a7-b22a-9ceb491cdd01 req-b8fb9a4c-d6c0-4827-a4ff-b59b749ba8a5 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=fa246bc6-659f-4e85-bac6-0f3a578f184d HTTP/1.1" status: 200 len: 1035 time: 0.0626078 Nov 09 04:39:57.018506 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-973c2835-11af-48a7-b22a-9ceb491cdd01 req-c4ff5e39-ff6d-4dd3-82a8-2aa1023e0099 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:57.019968 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-973c2835-11af-48a7-b22a-9ceb491cdd01 req-c4ff5e39-ff6d-4dd3-82a8-2aa1023e0099 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=79c0d1fe-bd0e-4079-abdb-8e32c802a558 HTTP/1.1" status: 200 len: 834 time: 0.0426528 Nov 09 04:39:57.068297 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-973c2835-11af-48a7-b22a-9ceb491cdd01 req-2444e155-2c17-4909-9edd-16578ddea134 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:57.069972 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-973c2835-11af-48a7-b22a-9ceb491cdd01 req-2444e155-2c17-4909-9edd-16578ddea134 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=359658ce-f1c6-4bcf-90bc-4a816eebef8a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0427454 Nov 09 04:39:57.165177 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-973c2835-11af-48a7-b22a-9ceb491cdd01 req-5b7b6b89-4659-442f-b8a8-f8eb8d806a75 service neutron] 10.222.0.26 "GET /v2.0/networks/359658ce-f1c6-4bcf-90bc-4a816eebef8a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0870423 Nov 09 04:39:57.255758 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-973c2835-11af-48a7-b22a-9ceb491cdd01 req-eb3624cc-04bf-4162-920c-7baff5d4cad9 service neutron] 10.222.0.26 "GET /v2.0/networks/359658ce-f1c6-4bcf-90bc-4a816eebef8a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0828848 Nov 09 04:39:57.380331 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e400ccec-c3c5-49da-a779-8c14e01dd526 req-9cc90e91-feb4-4ef0-ab25-d4d63a69b0de tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:57.381864 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e400ccec-c3c5-49da-a779-8c14e01dd526 req-9cc90e91-feb4-4ef0-ab25-d4d63a69b0de tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=1ad0a7be-c42e-4f3c-b835-4ac7fe40e8c2 HTTP/1.1" status: 200 len: 980 time: 0.0577929 Nov 09 04:39:57.429138 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e400ccec-c3c5-49da-a779-8c14e01dd526 req-48dec6ea-971c-4cab-ab84-a90cde5c007e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=2817c110-1ac7-4efe-9682-6d1a22d5b7a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411901 Nov 09 04:39:58.550381 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d24fbcad-b0d7-4f39-846b-1ea9a45e64bb req-d5989149-15c8-48bf-aa09-85d204138e7a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:58.551883 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d24fbcad-b0d7-4f39-846b-1ea9a45e64bb req-d5989149-15c8-48bf-aa09-85d204138e7a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=1ad0a7be-c42e-4f3c-b835-4ac7fe40e8c2 HTTP/1.1" status: 200 len: 980 time: 0.0514045 Nov 09 04:39:58.602054 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d24fbcad-b0d7-4f39-846b-1ea9a45e64bb req-a1adbc3b-64f4-4037-bb9c-5020bc2be21a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=2817c110-1ac7-4efe-9682-6d1a22d5b7a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430872 Nov 09 04:39:59.717171 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b4d21e8-ea15-4790-b2d1-425295dc9a7c req-71907db1-ac8f-4124-9466-4a402fc25f0e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:39:59.718666 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1b4d21e8-ea15-4790-b2d1-425295dc9a7c req-71907db1-ac8f-4124-9466-4a402fc25f0e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=1ad0a7be-c42e-4f3c-b835-4ac7fe40e8c2 HTTP/1.1" status: 200 len: 980 time: 0.0488343 Nov 09 04:39:59.765651 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1b4d21e8-ea15-4790-b2d1-425295dc9a7c req-acf35e53-3594-4244-8223-b3857bcd2ab3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=2817c110-1ac7-4efe-9682-6d1a22d5b7a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404904 Nov 09 04:39:59.807424 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device fa246bc6-659f-4e85-bac6-0f3a578f184d details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=102163) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 09 04:39:59.904404 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port fa246bc6-659f-4e85-bac6-0f3a578f184d, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=fa246bc6-659f-4e85-bac6-0f3a578f184d,segment=NetworkSegment(3e8c180a-3f73-4be8-b3d7-21a3b0ec67c0),segment_id=3e8c180a-3f73-4be8-b3d7-21a3b0ec67c0)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:39:59.916238 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Returning: {'device': 'fa246bc6-659f-4e85-bac6-0f3a578f184d', 'network_id': '359658ce-f1c6-4bcf-90bc-4a816eebef8a', 'port_id': 'fa246bc6-659f-4e85-bac6-0f3a578f184d', 'mac_address': 'fa:16:3e:a3:af:3f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 313, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '79c0d1fe-bd0e-4079-abdb-8e32c802a558', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102163) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 09 04:39:59.958564 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:39:59.971093 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id fa246bc6-659f-4e85-bac6-0f3a578f184d {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:39:59.990778 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port fa246bc6-659f-4e85-bac6-0f3a578f184d, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=fa246bc6-659f-4e85-bac6-0f3a578f184d,segment=NetworkSegment(3e8c180a-3f73-4be8-b3d7-21a3b0ec67c0),segment_id=3e8c180a-3f73-4be8-b3d7-21a3b0ec67c0)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:40:00.076812 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:00.123369 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=fa246bc6-659f-4e85-bac6-0f3a578f184d,revision_number=9']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:40:00.130372 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:40:00.130734 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:40:00.131079 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:40:00.131414 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:40:00.131750 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:40:00.132078 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:40:00.132406 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:40:00.132733 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:40:00.133060 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:40:00.133384 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:40:00.133705 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:40:00.134023 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:40:00.295730 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['fa246bc6-659f-4e85-bac6-0f3a578f184d'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 04:40:00.470962 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:40:00.878035 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3dc27bf-0e49-4139-9883-31041c371230 req-d4f189b1-9fe4-4474-be2d-12fa44c345ab tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:40:00.882413 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f3dc27bf-0e49-4139-9883-31041c371230 req-d4f189b1-9fe4-4474-be2d-12fa44c345ab tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=1ad0a7be-c42e-4f3c-b835-4ac7fe40e8c2 HTTP/1.1" status: 200 len: 981 time: 0.0483670 Nov 09 04:40:00.929306 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f3dc27bf-0e49-4139-9883-31041c371230 req-442f2b88-a5b8-4268-be8d-c36ae0de3fe9 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=2817c110-1ac7-4efe-9682-6d1a22d5b7a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431693 Nov 09 04:40:01.812332 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device fa246bc6-659f-4e85-bac6-0f3a578f184d up at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:40:01.945285 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning for port fa246bc6-659f-4e85-bac6-0f3a578f184d completed by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 09 04:40:01.949204 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning complete for port fa246bc6-659f-4e85-bac6-0f3a578f184d triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:40:01.949569 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:02.034044 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:02.044288 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae89c8d5-eeda-426c-8712-6478aa02edce req-cf9618d0-ef67-4ea2-b8f0-dd5b4f0e5715 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:40:02.045758 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ae89c8d5-eeda-426c-8712-6478aa02edce req-cf9618d0-ef67-4ea2-b8f0-dd5b4f0e5715 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=1ad0a7be-c42e-4f3c-b835-4ac7fe40e8c2 HTTP/1.1" status: 200 len: 981 time: 0.0487378 Nov 09 04:40:02.056158 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1ad0a7be-c42e-4f3c-b835-4ac7fe40e8c2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fa246bc6-659f-4e85-bac6-0f3a578f184d'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:40:02.058387 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-eb8ecae0-cf1d-4f4f-bf70-40e392618d87" -d '{"events": [{"server_uuid": "1ad0a7be-c42e-4f3c-b835-4ac7fe40e8c2", "name": "network-vif-plugged", "status": "completed", "tag": "fa246bc6-659f-4e85-bac6-0f3a578f184d"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:40:02.071633 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port fa246bc6-659f-4e85-bac6-0f3a578f184d, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=fa246bc6-659f-4e85-bac6-0f3a578f184d,segment=NetworkSegment(3e8c180a-3f73-4be8-b3d7-21a3b0ec67c0),segment_id=3e8c180a-3f73-4be8-b3d7-21a3b0ec67c0)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:40:02.093845 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:40:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-43774df5-22dd-4455-b545-275b6cbba98a x-openstack-request-id: req-43774df5-22dd-4455-b545-275b6cbba98a {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:40:02.094137 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1ad0a7be-c42e-4f3c-b835-4ac7fe40e8c2", "name": "network-vif-plugged", "status": "completed", "tag": "fa246bc6-659f-4e85-bac6-0f3a578f184d", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:40:02.094421 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-43774df5-22dd-4455-b545-275b6cbba98a {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:40:02.094821 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1ad0a7be-c42e-4f3c-b835-4ac7fe40e8c2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fa246bc6-659f-4e85-bac6-0f3a578f184d', 'code': 200} Nov 09 04:40:02.099847 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ae89c8d5-eeda-426c-8712-6478aa02edce req-5c5145e7-8cd5-4c92-a93e-3ee8e6b86dee tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=2817c110-1ac7-4efe-9682-6d1a22d5b7a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0480018 Nov 09 04:40:02.156606 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:02.203546 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=fa246bc6-659f-4e85-bac6-0f3a578f184d,revision_number=10']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:40:02.371197 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-586ac1fe-96a6-41f9-99db-5f7d0b94a7db req-d5cca9c2-eca8-4664-9fb5-b340f53c16e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:40:02.372600 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-586ac1fe-96a6-41f9-99db-5f7d0b94a7db req-d5cca9c2-eca8-4664-9fb5-b340f53c16e8 service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=1ad0a7be-c42e-4f3c-b835-4ac7fe40e8c2 HTTP/1.1" status: 200 len: 1136 time: 0.0395989 Nov 09 04:40:02.416580 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-586ac1fe-96a6-41f9-99db-5f7d0b94a7db req-87a12029-07af-42e8-afba-772a22eb07ba service neutron] 10.222.0.26 "GET /v2.0/security-groups?id=2817c110-1ac7-4efe-9682-6d1a22d5b7a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0372105 Nov 09 04:40:03.212301 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adddc15d-01cb-4d72-8b2e-941d7fd02cf0 req-3ee16608-d73b-4f52-a990-db5d554ee139 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:40:03.213752 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-adddc15d-01cb-4d72-8b2e-941d7fd02cf0 req-3ee16608-d73b-4f52-a990-db5d554ee139 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=1ad0a7be-c42e-4f3c-b835-4ac7fe40e8c2 HTTP/1.1" status: 200 len: 983 time: 0.0476007 Nov 09 04:40:03.258812 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-adddc15d-01cb-4d72-8b2e-941d7fd02cf0 req-0d714f0d-3677-4fc3-b763-ddaad62f8754 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=2817c110-1ac7-4efe-9682-6d1a22d5b7a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390534 Nov 09 04:40:04.370865 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1c2c6a7-ca7a-4a0b-a1c8-a7f13145f935 req-919ccca7-7336-48cb-929c-ed9bf917351f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:40:04.372337 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f1c2c6a7-ca7a-4a0b-a1c8-a7f13145f935 req-919ccca7-7336-48cb-929c-ed9bf917351f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=1ad0a7be-c42e-4f3c-b835-4ac7fe40e8c2 HTTP/1.1" status: 200 len: 983 time: 0.0472684 Nov 09 04:40:04.418553 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f1c2c6a7-ca7a-4a0b-a1c8-a7f13145f935 req-ec4e30df-3d1a-48ce-8794-75e8fdbc0c50 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=2817c110-1ac7-4efe-9682-6d1a22d5b7a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404022 Nov 09 04:40:04.533971 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e123f1f-354d-441a-9262-73ae7db39386 req-d701d99d-6892-4252-b305-833290401cfa tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:40:04.535530 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-6e123f1f-354d-441a-9262-73ae7db39386 req-d701d99d-6892-4252-b305-833290401cfa tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=1ad0a7be-c42e-4f3c-b835-4ac7fe40e8c2 HTTP/1.1" status: 200 len: 983 time: 0.0485997 Nov 09 04:40:04.582816 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-6e123f1f-354d-441a-9262-73ae7db39386 req-082fb4a7-400a-4c03-8026-048763c59d03 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=2817c110-1ac7-4efe-9682-6d1a22d5b7a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413611 Nov 09 04:40:04.604588 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60508) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:40:04.675898 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3928cf0a-2bbb-4f44-9c0e-9795d3e8aab3 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:40:04.677927 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-3928cf0a-2bbb-4f44-9c0e-9795d3e8aab3 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/ports?device_id=1ad0a7be-c42e-4f3c-b835-4ac7fe40e8c2&network_id=359658ce-f1c6-4bcf-90bc-4a816eebef8a HTTP/1.1" status: 200 len: 1131 time: 0.0721416 Nov 09 04:40:05.250290 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fd9e351-6887-4780-a223-8b993975304d req-eb8bd761-f308-46f2-921a-8ea81cd86b6b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:40:05.251780 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-1fd9e351-6887-4780-a223-8b993975304d req-eb8bd761-f308-46f2-921a-8ea81cd86b6b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=1ad0a7be-c42e-4f3c-b835-4ac7fe40e8c2 HTTP/1.1" status: 200 len: 983 time: 0.0492299 Nov 09 04:40:05.297928 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-1fd9e351-6887-4780-a223-8b993975304d req-9788cc29-1f3e-4f02-86f9-5b3e6c4287c3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=2817c110-1ac7-4efe-9682-6d1a22d5b7a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403457 Nov 09 04:40:06.419685 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37c0f3e1-93bf-4388-9672-73eaf509bc2a req-3c72f8c2-024f-4738-849b-ce782b5c9036 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:40:06.421131 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-37c0f3e1-93bf-4388-9672-73eaf509bc2a req-3c72f8c2-024f-4738-849b-ce782b5c9036 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=1ad0a7be-c42e-4f3c-b835-4ac7fe40e8c2 HTTP/1.1" status: 200 len: 983 time: 0.0524690 Nov 09 04:40:06.467607 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-37c0f3e1-93bf-4388-9672-73eaf509bc2a req-955573c1-5d4b-40ad-b40a-cd9eaa2945ce tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=2817c110-1ac7-4efe-9682-6d1a22d5b7a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400202 Nov 09 04:40:06.574893 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a963c9e-4052-4504-be6b-b59c5effb972 req-9c07e437-be3c-420b-b93f-4b7e24d5fb63 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:40:06.576352 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9a963c9e-4052-4504-be6b-b59c5effb972 req-9c07e437-be3c-420b-b93f-4b7e24d5fb63 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "GET /v2.0/ports?device_id=1ad0a7be-c42e-4f3c-b835-4ac7fe40e8c2 HTTP/1.1" status: 200 len: 983 time: 0.0490894 Nov 09 04:40:06.621219 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a963c9e-4052-4504-be6b-b59c5effb972 req-ae4a94bb-0de0-4430-b30d-92b33f8d3776 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['binding:profile'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:40:06.622643 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9a963c9e-4052-4504-be6b-b59c5effb972 req-ae4a94bb-0de0-4430-b30d-92b33f8d3776 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "GET /v2.0/ports/fa246bc6-659f-4e85-bac6-0f3a578f184d?fields=binding%3Aprofile&fields=network_id HTTP/1.1" status: 200 len: 260 time: 0.0398600 Nov 09 04:40:06.727531 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9a963c9e-4052-4504-be6b-b59c5effb972 req-bc323c9c-da8f-4e83-b45b-3a4c07e80ac9 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "GET /v2.0/networks/359658ce-f1c6-4bcf-90bc-4a816eebef8a?fields=dns_domain HTTP/1.1" status: 200 len: 212 time: 0.0994031 Nov 09 04:40:06.738923 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-9a963c9e-4052-4504-be6b-b59c5effb972 req-7acea7e9-5197-40e8-aaf8-6c7f3891bb4a service neutron] Request body: {'port': {'device_id': '', 'device_owner': '', 'binding:host_id': None, 'binding:profile': {}}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:40:06.790461 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-9a963c9e-4052-4504-be6b-b59c5effb972 req-7acea7e9-5197-40e8-aaf8-6c7f3891bb4a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:06.921885 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-9a963c9e-4052-4504-be6b-b59c5effb972 req-7acea7e9-5197-40e8-aaf8-6c7f3891bb4a service neutron] For port fa246bc6-659f-4e85-bac6-0f3a578f184d, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=fa246bc6-659f-4e85-bac6-0f3a578f184d,segment=NetworkSegment(3e8c180a-3f73-4be8-b3d7-21a3b0ec67c0),segment_id=3e8c180a-3f73-4be8-b3d7-21a3b0ec67c0)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:40:06.953422 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-9a963c9e-4052-4504-be6b-b59c5effb972 req-7acea7e9-5197-40e8-aaf8-6c7f3891bb4a service neutron] For port fa246bc6-659f-4e85-bac6-0f3a578f184d, host hv-neutron-8168, cleared binding levels {{(pid=102162) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:40:06.988935 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [req-9a963c9e-4052-4504-be6b-b59c5effb972 req-7acea7e9-5197-40e8-aaf8-6c7f3891bb4a service neutron] device_id is not set on port fa246bc6-659f-4e85-bac6-0f3a578f184d yet. {{(pid=102162) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 09 04:40:06.997578 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-9a963c9e-4052-4504-be6b-b59c5effb972 req-7acea7e9-5197-40e8-aaf8-6c7f3891bb4a service neutron] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:07.073471 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-9a963c9e-4052-4504-be6b-b59c5effb972 req-7acea7e9-5197-40e8-aaf8-6c7f3891bb4a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:07.146646 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7acea7e9-5197-40e8-aaf8-6c7f3891bb4a service neutron] Pushing event updated for resources: {'Port': ['ID=fa246bc6-659f-4e85-bac6-0f3a578f184d,revision_number=11']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:40:07.189311 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-9a963c9e-4052-4504-be6b-b59c5effb972 req-7acea7e9-5197-40e8-aaf8-6c7f3891bb4a service neutron] No DVR routers for this DVR port fa246bc6-659f-4e85-bac6-0f3a578f184d on host hv-neutron-8168 {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:40:07.288084 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e8d60acb-5962-4596-982d-a436c6f4b1d3 None None] Provisioning complete for port fa246bc6-659f-4e85-bac6-0f3a578f184d triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:40:07.288657 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e8d60acb-5962-4596-982d-a436c6f4b1d3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:07.323317 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e8d60acb-5962-4596-982d-a436c6f4b1d3 None None] Port fa246bc6-659f-4e85-bac6-0f3a578f184d cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:40:07.331809 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-9a963c9e-4052-4504-be6b-b59c5effb972 req-7acea7e9-5197-40e8-aaf8-6c7f3891bb4a service neutron] In _notify_port_updated(), no bound segment for port fa246bc6-659f-4e85-bac6-0f3a578f184d on network 359658ce-f1c6-4bcf-90bc-4a816eebef8a {{(pid=102162) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 09 04:40:07.333217 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a963c9e-4052-4504-be6b-b59c5effb972 req-7acea7e9-5197-40e8-aaf8-6c7f3891bb4a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:40:07.334501 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-9a963c9e-4052-4504-be6b-b59c5effb972 req-7acea7e9-5197-40e8-aaf8-6c7f3891bb4a service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:07.335103 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9a963c9e-4052-4504-be6b-b59c5effb972 req-7acea7e9-5197-40e8-aaf8-6c7f3891bb4a service neutron] 10.222.0.26 "PUT /v2.0/ports/fa246bc6-659f-4e85-bac6-0f3a578f184d HTTP/1.1" status: 200 len: 1026 time: 0.6000741 Nov 09 04:40:07.566424 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-e850904b-f6be-4a57-9262-f028aa67b909 req-1506df25-8498-4b8c-aaea-43861608b661 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=1ad0a7be-c42e-4f3c-b835-4ac7fe40e8c2 HTTP/1.1" status: 200 len: 210 time: 0.0302687 Nov 09 04:40:08.621382 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60522) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:40:08.678281 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b9c468f7-e481-498b-93a3-44f113c4eecf tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:08.703077 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b9c468f7-e481-498b-93a3-44f113c4eecf tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:08.882146 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b9c468f7-e481-498b-93a3-44f113c4eecf tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:08.884773 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b9c468f7-e481-498b-93a3-44f113c4eecf tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:08.886059 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-b9c468f7-e481-498b-93a3-44f113c4eecf tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "DELETE /v2.0/security-groups/5747651e-9c62-4419-af7a-16cb9f0ece60 HTTP/1.1" status: 204 len: 168 time: 0.2636456 Nov 09 04:40:08.896276 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9c468f7-e481-498b-93a3-44f113c4eecf tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=5747651e-9c62-4419-af7a-16cb9f0ece60,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:40:08.992243 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60526) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:40:09.144456 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-305252d2-dca0-4c33-841f-a92d56df48df tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Deleting port ae007345-f708-4cd5-8b5c-bd8a21ad0785 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:40:09.144697 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-305252d2-dca0-4c33-841f-a92d56df48df tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:09.221664 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-305252d2-dca0-4c33-841f-a92d56df48df tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:09.221985 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-305252d2-dca0-4c33-841f-a92d56df48df tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:09.234067 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-305252d2-dca0-4c33-841f-a92d56df48df tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Calling delete_port for ae007345-f708-4cd5-8b5c-bd8a21ad0785 owned by network:floatingip {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:40:09.442757 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-305252d2-dca0-4c33-841f-a92d56df48df tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:09.474758 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-305252d2-dca0-4c33-841f-a92d56df48df tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'Port': ['ID=ae007345-f708-4cd5-8b5c-bd8a21ad0785,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:40:09.525808 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-305252d2-dca0-4c33-841f-a92d56df48df tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for floatingip, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:09.526176 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.l3_db [None req-305252d2-dca0-4c33-841f-a92d56df48df tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Floating IP ceb0f2a6-8f18-4a3a-9ed6-73ea81782e7c disassociated (deleted). External IP: 172.26.0.32, port: fa246bc6-659f-4e85-bac6-0f3a578f184d. Nov 09 04:40:09.730662 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-305252d2-dca0-4c33-841f-a92d56df48df tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Router b186380e-ee5f-4e3e-a5f8-325fb4d3520b has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:40:09.834915 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-305252d2-dca0-4c33-841f-a92d56df48df tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:40:09.840237 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-305252d2-dca0-4c33-841f-a92d56df48df tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:09.845023 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-10b8606a-7b1f-48cb-a889-034c0623ec35 None None] Sync routers for ids ['b186380e-ee5f-4e3e-a5f8-325fb4d3520b'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:40:09.855810 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-10b8606a-7b1f-48cb-a889-034c0623ec35 None None] Routers {'b186380e-ee5f-4e3e-a5f8-325fb4d3520b'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:40:09.856671 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-10b8606a-7b1f-48cb-a889-034c0623ec35 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:39:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['b186380e-ee5f-4e3e-a5f8-325fb4d3520b'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:40:09.866029 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-305252d2-dca0-4c33-841f-a92d56df48df tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "DELETE /v2.0/floatingips/ceb0f2a6-8f18-4a3a-9ed6-73ea81782e7c HTTP/1.1" status: 204 len: 168 time: 0.8727217 Nov 09 04:40:09.872863 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device fa246bc6-659f-4e85-bac6-0f3a578f184d no longer exists at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:40:09.913169 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device fa246bc6-659f-4e85-bac6-0f3a578f184d not bound to the agent host hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:40:09.942457 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60532) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:40:09.968571 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-10b8606a-7b1f-48cb-a889-034c0623ec35 None None] Set router b186380e-ee5f-4e3e-a5f8-325fb4d3520b gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:40:09.999793 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6430e8ff-0c54-475a-bfbf-d9fed0e1871f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:10.026236 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6430e8ff-0c54-475a-bfbf-d9fed0e1871f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:10.153445 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6430e8ff-0c54-475a-bfbf-d9fed0e1871f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:10.156171 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6430e8ff-0c54-475a-bfbf-d9fed0e1871f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:10.157397 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-6430e8ff-0c54-475a-bfbf-d9fed0e1871f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "DELETE /v2.0/security-groups/72c53e26-f498-4c4f-b394-d5c2e406bf48 HTTP/1.1" status: 204 len: 168 time: 0.2139432 Nov 09 04:40:10.163969 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-10b8606a-7b1f-48cb-a889-034c0623ec35 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b186380e-ee5f-4e3e-a5f8-325fb4d3520b', 'name': 'tempest-TestNetworkBasicOps-router-1697092511', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.142'}], 'enable_snat': True}, 'gw_port_id': '98412fb7-ede7-41fa-a41f-2b1e63040f98', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:39:23Z', 'updated_at': '2021-11-09T04:39:27Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '98412fb7-ede7-41fa-a41f-2b1e63040f98', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:77:12:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b186380e-ee5f-4e3e-a5f8-325fb4d3520b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1408, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.142', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:39:23Z', 'updated_at': '2021-11-09T04:39:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'dc5c1965-8ffd-4978-a8a2-af1f55688062', 'name': '', 'network_id': '359658ce-f1c6-4bcf-90bc-4a816eebef8a', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:47:f4:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b186380e-ee5f-4e3e-a5f8-325fb4d3520b', 'device_owner': 'network:router_interface', 'standard_attr_id': 1411, 'fixed_ips': [{'subnet_id': '79c0d1fe-bd0e-4079-abdb-8e32c802a558', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:39:27Z', 'updated_at': '2021-11-09T04:39:31Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '79c0d1fe-bd0e-4079-abdb-8e32c802a558', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:40:10.167573 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6430e8ff-0c54-475a-bfbf-d9fed0e1871f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=72c53e26-f498-4c4f-b394-d5c2e406bf48,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:40:10.199095 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-10b8606a-7b1f-48cb-a889-034c0623ec35 None None] Checking router: b186380e-ee5f-4e3e-a5f8-325fb4d3520b for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:40:10.207407 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-10b8606a-7b1f-48cb-a889-034c0623ec35 None None] Routers {'b186380e-ee5f-4e3e-a5f8-325fb4d3520b'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:40:10.208021 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-10b8606a-7b1f-48cb-a889-034c0623ec35 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:39:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['b186380e-ee5f-4e3e-a5f8-325fb4d3520b'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:40:10.280353 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 60536) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:40:10.314715 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-10b8606a-7b1f-48cb-a889-034c0623ec35 None None] Set router b186380e-ee5f-4e3e-a5f8-325fb4d3520b gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:40:10.367340 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-bedcd5d8-fc50-4050-8b8f-8dd20af5d71d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Deleting port fa246bc6-659f-4e85-bac6-0f3a578f184d {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:40:10.367677 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bedcd5d8-fc50-4050-8b8f-8dd20af5d71d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:10.458478 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bedcd5d8-fc50-4050-8b8f-8dd20af5d71d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:10.472300 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-bedcd5d8-fc50-4050-8b8f-8dd20af5d71d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Calling delete_port for fa246bc6-659f-4e85-bac6-0f3a578f184d owned by {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:40:10.602406 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-10b8606a-7b1f-48cb-a889-034c0623ec35 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b186380e-ee5f-4e3e-a5f8-325fb4d3520b', 'name': 'tempest-TestNetworkBasicOps-router-1697092511', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.142'}], 'enable_snat': True}, 'gw_port_id': '98412fb7-ede7-41fa-a41f-2b1e63040f98', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:39:23Z', 'updated_at': '2021-11-09T04:39:27Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '98412fb7-ede7-41fa-a41f-2b1e63040f98', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:77:12:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b186380e-ee5f-4e3e-a5f8-325fb4d3520b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1408, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.142', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:39:23Z', 'updated_at': '2021-11-09T04:39:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'dc5c1965-8ffd-4978-a8a2-af1f55688062', 'name': '', 'network_id': '359658ce-f1c6-4bcf-90bc-4a816eebef8a', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:47:f4:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b186380e-ee5f-4e3e-a5f8-325fb4d3520b', 'device_owner': 'network:router_interface', 'standard_attr_id': 1411, 'fixed_ips': [{'subnet_id': '79c0d1fe-bd0e-4079-abdb-8e32c802a558', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:39:27Z', 'updated_at': '2021-11-09T04:39:31Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '79c0d1fe-bd0e-4079-abdb-8e32c802a558', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:40:10.628520 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-10b8606a-7b1f-48cb-a889-034c0623ec35 None None] The sync data for ids ['b186380e-ee5f-4e3e-a5f8-325fb4d3520b'] in dv-neutron-816802-2-hyperv is: [{'id': 'b186380e-ee5f-4e3e-a5f8-325fb4d3520b', 'name': 'tempest-TestNetworkBasicOps-router-1697092511', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.142'}], 'enable_snat': True}, 'gw_port_id': '98412fb7-ede7-41fa-a41f-2b1e63040f98', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:39:23Z', 'updated_at': '2021-11-09T04:39:27Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '98412fb7-ede7-41fa-a41f-2b1e63040f98', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:77:12:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b186380e-ee5f-4e3e-a5f8-325fb4d3520b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1408, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.142', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:39:23Z', 'updated_at': '2021-11-09T04:39:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'dc5c1965-8ffd-4978-a8a2-af1f55688062', 'name': '', 'network_id': '359658ce-f1c6-4bcf-90bc-4a816eebef8a', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:47:f4:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b186380e-ee5f-4e3e-a5f8-325fb4d3520b', 'device_owner': 'network:router_interface', 'standard_attr_id': 1411, 'fixed_ips': [{'subnet_id': '79c0d1fe-bd0e-4079-abdb-8e32c802a558', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:39:27Z', 'updated_at': '2021-11-09T04:39:31Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '79c0d1fe-bd0e-4079-abdb-8e32c802a558', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:40:10.690854 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bedcd5d8-fc50-4050-8b8f-8dd20af5d71d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:10.726093 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bedcd5d8-fc50-4050-8b8f-8dd20af5d71d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'Port': ['ID=fa246bc6-659f-4e85-bac6-0f3a578f184d,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:40:10.802591 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bedcd5d8-fc50-4050-8b8f-8dd20af5d71d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:10.806316 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-bedcd5d8-fc50-4050-8b8f-8dd20af5d71d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "DELETE /v2.0/ports/fa246bc6-659f-4e85-bac6-0f3a578f184d HTTP/1.1" status: 204 len: 168 time: 0.5248537 Nov 09 04:40:10.809206 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 60538) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:40:10.903969 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f637bb0d-e8a2-456b-98de-2474d6b75258 None None] New status for floating IP ceb0f2a6-8f18-4a3a-9ed6-73ea81782e7c: DOWN {{(pid=102163) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 04:40:11.180003 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f9657723-60f1-447a-abae-2a5a9603e54a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:11.340018 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-13d4096a-795a-4d89-8ac4-1e50f585bcb3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:11.742239 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-f9657723-60f1-447a-abae-2a5a9603e54a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Deleting port dc5c1965-8ffd-4978-a8a2-af1f55688062 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:40:11.742886 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f9657723-60f1-447a-abae-2a5a9603e54a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:11.829074 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-f9657723-60f1-447a-abae-2a5a9603e54a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] For port dc5c1965-8ffd-4978-a8a2-af1f55688062, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=dc5c1965-8ffd-4978-a8a2-af1f55688062,segment=NetworkSegment(3e8c180a-3f73-4be8-b3d7-21a3b0ec67c0),segment_id=3e8c180a-3f73-4be8-b3d7-21a3b0ec67c0)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:40:11.829533 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f9657723-60f1-447a-abae-2a5a9603e54a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:11.842769 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-f9657723-60f1-447a-abae-2a5a9603e54a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Calling delete_port for dc5c1965-8ffd-4978-a8a2-af1f55688062 owned by network:router_interface {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:40:12.102079 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f9657723-60f1-447a-abae-2a5a9603e54a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:12.138424 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9657723-60f1-447a-abae-2a5a9603e54a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'Port': ['ID=dc5c1965-8ffd-4978-a8a2-af1f55688062,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:40:12.170668 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:12.307808 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f9657723-60f1-447a-abae-2a5a9603e54a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:12.519877 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f9657723-60f1-447a-abae-2a5a9603e54a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Router b186380e-ee5f-4e3e-a5f8-325fb4d3520b has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:40:12.626146 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f9657723-60f1-447a-abae-2a5a9603e54a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:40:12.632344 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-f9657723-60f1-447a-abae-2a5a9603e54a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "PUT /v2.0/routers/b186380e-ee5f-4e3e-a5f8-325fb4d3520b/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8220382 Nov 09 04:40:12.635142 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 60540) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:40:12.636324 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cf26c8a6-d4d6-4ab1-91eb-653fb064b6f8 None None] Sync routers for ids ['b186380e-ee5f-4e3e-a5f8-325fb4d3520b'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:40:12.650109 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cf26c8a6-d4d6-4ab1-91eb-653fb064b6f8 None None] Routers {'b186380e-ee5f-4e3e-a5f8-325fb4d3520b'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:40:12.651270 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-cf26c8a6-d4d6-4ab1-91eb-653fb064b6f8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:39:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['b186380e-ee5f-4e3e-a5f8-325fb4d3520b'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:40:12.688706 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-e8543b5e-7a82-4623-85e3-0773809af373 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Deleting subnet 79c0d1fe-bd0e-4079-abdb-8e32c802a558 {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:40:12.698965 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e8543b5e-7a82-4623-85e3-0773809af373 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:12.732751 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e8543b5e-7a82-4623-85e3-0773809af373 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:12.753798 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-cf26c8a6-d4d6-4ab1-91eb-653fb064b6f8 None None] Set router b186380e-ee5f-4e3e-a5f8-325fb4d3520b gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:40:12.818230 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e8543b5e-7a82-4623-85e3-0773809af373 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:12.933096 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-cf26c8a6-d4d6-4ab1-91eb-653fb064b6f8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b186380e-ee5f-4e3e-a5f8-325fb4d3520b', 'name': 'tempest-TestNetworkBasicOps-router-1697092511', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.142'}], 'enable_snat': True}, 'gw_port_id': '98412fb7-ede7-41fa-a41f-2b1e63040f98', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:39:23Z', 'updated_at': '2021-11-09T04:40:11Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '98412fb7-ede7-41fa-a41f-2b1e63040f98', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:77:12:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b186380e-ee5f-4e3e-a5f8-325fb4d3520b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1408, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.142', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:39:23Z', 'updated_at': '2021-11-09T04:39:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:40:12.959364 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cf26c8a6-d4d6-4ab1-91eb-653fb064b6f8 None None] Checking router: b186380e-ee5f-4e3e-a5f8-325fb4d3520b for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:40:12.959702 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e8543b5e-7a82-4623-85e3-0773809af373 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:12.967787 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cf26c8a6-d4d6-4ab1-91eb-653fb064b6f8 None None] Routers {'b186380e-ee5f-4e3e-a5f8-325fb4d3520b'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:40:12.968381 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-cf26c8a6-d4d6-4ab1-91eb-653fb064b6f8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:39:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['b186380e-ee5f-4e3e-a5f8-325fb4d3520b'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:40:12.987152 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8543b5e-7a82-4623-85e3-0773809af373 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'Subnet': ['ID=79c0d1fe-bd0e-4079-abdb-8e32c802a558,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:40:12.991332 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e8543b5e-7a82-4623-85e3-0773809af373 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:12.997359 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60542) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:40:12.997858 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e8543b5e-7a82-4623-85e3-0773809af373 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "DELETE /v2.0/subnets/79c0d1fe-bd0e-4079-abdb-8e32c802a558 HTTP/1.1" status: 204 len: 168 time: 0.3612657 Nov 09 04:40:12.999522 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1aebfa28-1bd1-433a-a6e7-96c1aff4a342 None None] Network 359658ce-f1c6-4bcf-90bc-4a816eebef8a requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:40:13.083356 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-cf26c8a6-d4d6-4ab1-91eb-653fb064b6f8 None None] Set router b186380e-ee5f-4e3e-a5f8-325fb4d3520b gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:40:13.117581 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-16aebb36-b00e-41d8-8f36-e2e1a55c27bf tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:13.185131 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-47d3f230-8718-4dbd-89b3-2f2a313edcc7 None None] DHCP port deletion for 359658ce-f1c6-4bcf-90bc-4a816eebef8a request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:40:13.223689 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-16aebb36-b00e-41d8-8f36-e2e1a55c27bf tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router_gateway, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:13.235271 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-47d3f230-8718-4dbd-89b3-2f2a313edcc7 None None] Deleting port 2b113733-a448-41aa-80e6-bb3a378d923c {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:40:13.240752 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-47d3f230-8718-4dbd-89b3-2f2a313edcc7 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:13.269159 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-cf26c8a6-d4d6-4ab1-91eb-653fb064b6f8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b186380e-ee5f-4e3e-a5f8-325fb4d3520b', 'name': 'tempest-TestNetworkBasicOps-router-1697092511', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.142'}], 'enable_snat': True}, 'gw_port_id': '98412fb7-ede7-41fa-a41f-2b1e63040f98', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:39:23Z', 'updated_at': '2021-11-09T04:40:11Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '98412fb7-ede7-41fa-a41f-2b1e63040f98', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:77:12:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b186380e-ee5f-4e3e-a5f8-325fb4d3520b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1408, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.142', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:39:23Z', 'updated_at': '2021-11-09T04:39:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:40:13.296467 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cf26c8a6-d4d6-4ab1-91eb-653fb064b6f8 None None] The sync data for ids ['b186380e-ee5f-4e3e-a5f8-325fb4d3520b'] in dv-neutron-816802-2-hyperv is: [{'id': 'b186380e-ee5f-4e3e-a5f8-325fb4d3520b', 'name': 'tempest-TestNetworkBasicOps-router-1697092511', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.142'}], 'enable_snat': True}, 'gw_port_id': '98412fb7-ede7-41fa-a41f-2b1e63040f98', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:39:23Z', 'updated_at': '2021-11-09T04:40:11Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '98412fb7-ede7-41fa-a41f-2b1e63040f98', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:77:12:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b186380e-ee5f-4e3e-a5f8-325fb4d3520b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1408, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.142', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:39:23Z', 'updated_at': '2021-11-09T04:39:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:40:13.299359 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-47d3f230-8718-4dbd-89b3-2f2a313edcc7 None None] For port 2b113733-a448-41aa-80e6-bb3a378d923c, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=2b113733-a448-41aa-80e6-bb3a378d923c,segment=NetworkSegment(3e8c180a-3f73-4be8-b3d7-21a3b0ec67c0),segment_id=3e8c180a-3f73-4be8-b3d7-21a3b0ec67c0)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:40:13.299752 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-47d3f230-8718-4dbd-89b3-2f2a313edcc7 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:13.313804 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-47d3f230-8718-4dbd-89b3-2f2a313edcc7 None None] Calling delete_port for 2b113733-a448-41aa-80e6-bb3a378d923c owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:40:13.358791 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-16aebb36-b00e-41d8-8f36-e2e1a55c27bf tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Deleting port 98412fb7-ede7-41fa-a41f-2b1e63040f98 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:40:13.359212 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-16aebb36-b00e-41d8-8f36-e2e1a55c27bf tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:13.439081 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-16aebb36-b00e-41d8-8f36-e2e1a55c27bf tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] For port 98412fb7-ede7-41fa-a41f-2b1e63040f98, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=98412fb7-ede7-41fa-a41f-2b1e63040f98,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:40:13.439418 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-16aebb36-b00e-41d8-8f36-e2e1a55c27bf tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:13.448379 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-47d3f230-8718-4dbd-89b3-2f2a313edcc7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:13.452170 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-16aebb36-b00e-41d8-8f36-e2e1a55c27bf tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Calling delete_port for 98412fb7-ede7-41fa-a41f-2b1e63040f98 owned by network:router_gateway {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:40:13.480901 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-47d3f230-8718-4dbd-89b3-2f2a313edcc7 None None] No DVR routers for this DVR port 2b113733-a448-41aa-80e6-bb3a378d923c on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:40:13.484862 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47d3f230-8718-4dbd-89b3-2f2a313edcc7 None None] Pushing event deleted for resources: {'Port': ['ID=2b113733-a448-41aa-80e6-bb3a378d923c,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:40:13.681364 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-16aebb36-b00e-41d8-8f36-e2e1a55c27bf tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:13.705941 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16aebb36-b00e-41d8-8f36-e2e1a55c27bf tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'Port': ['ID=98412fb7-ede7-41fa-a41f-2b1e63040f98,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:40:13.730420 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-50e95178-c026-4565-be03-f7f9fb4c095f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:13.742849 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 2b113733-a448-41aa-80e6-bb3a378d923c no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:40:13.768797 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 2b113733-a448-41aa-80e6-bb3a378d923c {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:40:13.769416 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 2b113733-a448-41aa-80e6-bb3a378d923c not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:40:13.774146 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-16aebb36-b00e-41d8-8f36-e2e1a55c27bf tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-466373'] for router_gateway, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:13.868096 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-16aebb36-b00e-41d8-8f36-e2e1a55c27bf tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:13.870284 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-16aebb36-b00e-41d8-8f36-e2e1a55c27bf tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:13.973318 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-16aebb36-b00e-41d8-8f36-e2e1a55c27bf tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:13.973886 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-16aebb36-b00e-41d8-8f36-e2e1a55c27bf tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Fanout notify agent at l3_agent the message router_deleted on router b186380e-ee5f-4e3e-a5f8-325fb4d3520b {{(pid=102161) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:40:13.981094 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-16aebb36-b00e-41d8-8f36-e2e1a55c27bf tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:13.982237 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-16aebb36-b00e-41d8-8f36-e2e1a55c27bf tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "DELETE /v2.0/routers/b186380e-ee5f-4e3e-a5f8-325fb4d3520b HTTP/1.1" status: 204 len: 168 time: 0.9830210 Nov 09 04:40:13.984954 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60544) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:40:14.068718 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f71b6968-7941-408c-975b-7c968ede5856 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:14.158051 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f71b6968-7941-408c-975b-7c968ede5856 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:14.177686 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-f71b6968-7941-408c-975b-7c968ede5856 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['359658ce-f1c6-4bcf-90bc-4a816eebef8a']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:40:14.186932 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-f71b6968-7941-408c-975b-7c968ede5856 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3e8c180a-3f73-4be8-b3d7-21a3b0ec67c0') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:40:14.187224 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-f71b6968-7941-408c-975b-7c968ede5856 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3e8c180a-3f73-4be8-b3d7-21a3b0ec67c0') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:40:14.200762 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f71b6968-7941-408c-975b-7c968ede5856 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:14.214065 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f71b6968-7941-408c-975b-7c968ede5856 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:14.219995 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f71b6968-7941-408c-975b-7c968ede5856 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Releasing vlan 313 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:40:14.220347 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f71b6968-7941-408c-975b-7c968ede5856 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:14.223219 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:40:14.223219 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:40:14.223219 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:40:14.223219 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:40:14.223219 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:40:14.223219 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:40:14.223219 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:40:14.223219 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:40:14.223219 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:40:14.223219 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:40:14.223219 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:40:14.223219 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:40:14.223219 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:40:14.223219 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:40:14.223219 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:40:14.223219 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:40:14.223219 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:40:14.223219 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:40:14.223219 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:40:14.223219 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:40:14.223219 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:40:14.223219 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:40:14.223219 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:40:14.223219 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:40:14.223219 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:40:14.223219 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:40:14.223219 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:40:14.223219 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:40:14.223219 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:40:14.223219 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:40:14.223219 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:40:14.223219 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:40:14.419339 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f71b6968-7941-408c-975b-7c968ede5856 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:14.432227 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f71b6968-7941-408c-975b-7c968ede5856 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:14.432227 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-f71b6968-7941-408c-975b-7c968ede5856 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "DELETE /v2.0/networks/359658ce-f1c6-4bcf-90bc-4a816eebef8a HTTP/1.1" status: 204 len: 168 time: 0.4438667 Nov 09 04:40:14.439338 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 60546) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:40:14.442166 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f71b6968-7941-408c-975b-7c968ede5856 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'Network': ['ID=359658ce-f1c6-4bcf-90bc-4a816eebef8a,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:40:14.452782 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-066495d5-094a-4239-ace4-38daa8d1f219 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/agents?agent_type=L3+agent HTTP/1.1" status: 200 len: 838 time: 0.0122888 Nov 09 04:40:14.455282 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 60548) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:40:14.459967 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-cf7de7ae-754e-49ae-ac8c-dca705c7f8e1 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'network': {'name': 'tempest-network-smoke--241788356', 'project_id': '1d10b4824e524068827e58b55e269af3', 'port_security_enabled': True}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:40:14.579162 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cf7de7ae-754e-49ae-ac8c-dca705c7f8e1 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Made reservation on behalf of 1d10b4824e524068827e58b55e269af3 for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:40:14.583032 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cf7de7ae-754e-49ae-ac8c-dca705c7f8e1 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:14.606930 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-cf7de7ae-754e-49ae-ac8c-dca705c7f8e1 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 343} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:40:14.616339 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cf7de7ae-754e-49ae-ac8c-dca705c7f8e1 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:14.616681 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-cf7de7ae-754e-49ae-ac8c-dca705c7f8e1 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Added segment b9865f8d-450a-48dd-a5fd-75229dfd570a of type vlan for network 5c1cc491-3177-49e1-a58d-e9fa4f64046d Nov 09 04:40:14.654442 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cf7de7ae-754e-49ae-ac8c-dca705c7f8e1 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:14.770421 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cf7de7ae-754e-49ae-ac8c-dca705c7f8e1 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:14.776043 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cf7de7ae-754e-49ae-ac8c-dca705c7f8e1 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:40:14.776692 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cf7de7ae-754e-49ae-ac8c-dca705c7f8e1 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:14.841709 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf7de7ae-754e-49ae-ac8c-dca705c7f8e1 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Network': ['ID=5c1cc491-3177-49e1-a58d-e9fa4f64046d,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:40:14.852661 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 5c1cc491-3177-49e1-a58d-e9fa4f64046d details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:40:14.919426 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-cf7de7ae-754e-49ae-ac8c-dca705c7f8e1 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.4631138 Nov 09 04:40:14.922093 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 60552) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:40:14.926444 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-e575a8f6-5396-4ad0-a7bb-f80f87ed4c64 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'router': {'name': 'tempest-TestNetworkBasicOps-router-888680478', 'admin_state_up': True, 'project_id': '1d10b4824e524068827e58b55e269af3', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:40:15.025005 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e575a8f6-5396-4ad0-a7bb-f80f87ed4c64 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:15.026507 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e575a8f6-5396-4ad0-a7bb-f80f87ed4c64 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:15.086510 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e575a8f6-5396-4ad0-a7bb-f80f87ed4c64 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:15.272186 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e575a8f6-5396-4ad0-a7bb-f80f87ed4c64 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:15.297937 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:15.364571 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 98412fb7-ede7-41fa-a41f-2b1e63040f98 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:40:15.384623 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 98412fb7-ede7-41fa-a41f-2b1e63040f98 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:40:15.384985 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 98412fb7-ede7-41fa-a41f-2b1e63040f98 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:40:15.385520 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device dc5c1965-8ffd-4978-a8a2-af1f55688062 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:40:15.403827 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: dc5c1965-8ffd-4978-a8a2-af1f55688062 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:40:15.404164 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device dc5c1965-8ffd-4978-a8a2-af1f55688062 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:40:15.545606 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e575a8f6-5396-4ad0-a7bb-f80f87ed4c64 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router_gateway, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:15.564523 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e575a8f6-5396-4ad0-a7bb-f80f87ed4c64 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:15.667141 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-e575a8f6-5396-4ad0-a7bb-f80f87ed4c64 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Allocated IP 172.26.0.73 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:40:15.769542 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e575a8f6-5396-4ad0-a7bb-f80f87ed4c64 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:15.890994 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e575a8f6-5396-4ad0-a7bb-f80f87ed4c64 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:15.928191 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e575a8f6-5396-4ad0-a7bb-f80f87ed4c64 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:40:15.931000 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-e575a8f6-5396-4ad0-a7bb-f80f87ed4c64 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:40:15.936650 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e575a8f6-5396-4ad0-a7bb-f80f87ed4c64 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:40:15.966119 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e575a8f6-5396-4ad0-a7bb-f80f87ed4c64 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Port': ['ID=2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:40:16.399462 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e575a8f6-5396-4ad0-a7bb-f80f87ed4c64 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router_gateway, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:16.441998 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:16.593626 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e575a8f6-5396-4ad0-a7bb-f80f87ed4c64 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:16.772900 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e575a8f6-5396-4ad0-a7bb-f80f87ed4c64 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Router 64146dbe-0485-4818-add5-b700f57a9d0d is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102162) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:40:16.877143 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e575a8f6-5396-4ad0-a7bb-f80f87ed4c64 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:40:16.892592 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c9436d71-2eff-4f9b-bc1e-2ae19879b64f None None] Sync routers for ids ['64146dbe-0485-4818-add5-b700f57a9d0d'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:40:16.903404 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c9436d71-2eff-4f9b-bc1e-2ae19879b64f None None] Routers {'64146dbe-0485-4818-add5-b700f57a9d0d'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:40:16.904017 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-c9436d71-2eff-4f9b-bc1e-2ae19879b64f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:40:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['64146dbe-0485-4818-add5-b700f57a9d0d'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:40:16.946019 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:16.972351 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e575a8f6-5396-4ad0-a7bb-f80f87ed4c64 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:16.973588 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e575a8f6-5396-4ad0-a7bb-f80f87ed4c64 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 885 time: 2.0504708 Nov 09 04:40:16.977452 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60554) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:40:17.010228 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-55f5cd3a-c9f0-439a-9ab4-50859aea9aed tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/subnets?project_id=1d10b4824e524068827e58b55e269af3&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0315025 Nov 09 04:40:17.013683 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60556) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:40:17.016830 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-c9436d71-2eff-4f9b-bc1e-2ae19879b64f None None] Set router 64146dbe-0485-4818-add5-b700f57a9d0d gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:40:17.106264 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9e063b12-1926-4e3b-9942-41a5935a6a66 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:40:17.108133 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-9e063b12-1926-4e3b-9942-41a5935a6a66 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.0934544 Nov 09 04:40:17.110901 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60558) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:40:17.138116 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-9d513c41-777e-4bc5-822a-3db389a5a01c tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/subnets?network_id=2b6725f5-ebfe-485a-8f42-ccb5a241ddb5&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0261545 Nov 09 04:40:17.143015 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60560) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:40:17.148547 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-e514f7ee-f996-42e7-bf36-b8874abc63ef tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-1641821492', 'network_id': '5c1cc491-3177-49e1-a58d-e9fa4f64046d', 'project_id': '1d10b4824e524068827e58b55e269af3', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:40:17.194085 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-c9436d71-2eff-4f9b-bc1e-2ae19879b64f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '64146dbe-0485-4818-add5-b700f57a9d0d', 'name': 'tempest-TestNetworkBasicOps-router-888680478', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.73'}], 'enable_snat': True}, 'gw_port_id': '2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:40:15Z', 'updated_at': '2021-11-09T04:40:16Z', 'revision_number': 3, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:f7:88', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '64146dbe-0485-4818-add5-b700f57a9d0d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1436, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.73', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:40:15Z', 'updated_at': '2021-11-09T04:40:15Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:40:17.220995 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c9436d71-2eff-4f9b-bc1e-2ae19879b64f None None] Checking router: 64146dbe-0485-4818-add5-b700f57a9d0d for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:40:17.221345 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c9436d71-2eff-4f9b-bc1e-2ae19879b64f None None] Updating router 64146dbe-0485-4818-add5-b700f57a9d0d port 2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368 binding host dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 04:40:17.246956 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c9436d71-2eff-4f9b-bc1e-2ae19879b64f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:17.301956 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e514f7ee-f996-42e7-bf36-b8874abc63ef tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Made reservation on behalf of 1d10b4824e524068827e58b55e269af3 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:40:17.305797 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e514f7ee-f996-42e7-bf36-b8874abc63ef tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:17.497604 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c9436d71-2eff-4f9b-bc1e-2ae19879b64f None None] Publish callbacks [] for port, precommit_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:17.587864 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e514f7ee-f996-42e7-bf36-b8874abc63ef tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:17.602452 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c9436d71-2eff-4f9b-bc1e-2ae19879b64f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:17.653072 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e514f7ee-f996-42e7-bf36-b8874abc63ef tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Subnet': ['ID=b698701a-6942-4c78-8d18-8f81ad97a357,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:40:17.657474 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-c9436d71-2eff-4f9b-bc1e-2ae19879b64f None None] Attempting to bind port 2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:40:17.657914 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-c9436d71-2eff-4f9b-bc1e-2ae19879b64f None None] Attempting to bind port 2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:40:17.658084 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e514f7ee-f996-42e7-bf36-b8874abc63ef tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Checking segment: {'id': 'b9865f8d-450a-48dd-a5fd-75229dfd570a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 343, 'network_id': '5c1cc491-3177-49e1-a58d-e9fa4f64046d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:40:17.658321 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c9436d71-2eff-4f9b-bc1e-2ae19879b64f None None] Attempting to bind port 2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368 on network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:40:17.658467 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e514f7ee-f996-42e7-bf36-b8874abc63ef tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network hostable DHCP agents. Network: 5c1cc491-3177-49e1-a58d-e9fa4f64046d, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:40:17.689024 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c32fd6b-36af-4d90-8f41-e5224c626f5b None None] Pushing event updated for resources: {'Port': ['ID=2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:40:17.689024 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c9436d71-2eff-4f9b-bc1e-2ae19879b64f None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 40, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:40:17.689024 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c9436d71-2eff-4f9b-bc1e-2ae19879b64f None None] Checking segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:40:17.689024 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c9436d71-2eff-4f9b-bc1e-2ae19879b64f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:17.689024 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c9436d71-2eff-4f9b-bc1e-2ae19879b64f None None] Bound using segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:40:17.689024 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-c9436d71-2eff-4f9b-bc1e-2ae19879b64f None None] Bound port: 2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:40:17.689024 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c9436d71-2eff-4f9b-bc1e-2ae19879b64f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:17.717629 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-c9436d71-2eff-4f9b-bc1e-2ae19879b64f None None] For port 2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:40:17.720541 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-c9436d71-2eff-4f9b-bc1e-2ae19879b64f None None] For port 2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:40:17.827209 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e514f7ee-f996-42e7-bf36-b8874abc63ef tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network 5c1cc491-3177-49e1-a58d-e9fa4f64046d is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:40:17.850600 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c9436d71-2eff-4f9b-bc1e-2ae19879b64f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:17.902500 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c9436d71-2eff-4f9b-bc1e-2ae19879b64f None None] Routers {'64146dbe-0485-4818-add5-b700f57a9d0d'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:40:17.903102 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-c9436d71-2eff-4f9b-bc1e-2ae19879b64f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:40:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['64146dbe-0485-4818-add5-b700f57a9d0d'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:40:17.948540 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c32fd6b-36af-4d90-8f41-e5224c626f5b None None] Pushing event updated for resources: {'Port': ['ID=2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:40:17.950218 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-e514f7ee-f996-42e7-bf36-b8874abc63ef tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 5c1cc491-3177-49e1-a58d-e9fa4f64046d) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:40:17.954495 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e514f7ee-f996-42e7-bf36-b8874abc63ef tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:40:17.955815 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e514f7ee-f996-42e7-bf36-b8874abc63ef tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:17.964985 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a849ffb4-21a9-40a5-a688-2a1aaf4c71ef None None] Network 5c1cc491-3177-49e1-a58d-e9fa4f64046d requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:40:18.076253 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-c9436d71-2eff-4f9b-bc1e-2ae19879b64f None None] Set router 64146dbe-0485-4818-add5-b700f57a9d0d gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:40:18.101424 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-e514f7ee-f996-42e7-bf36-b8874abc63ef tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 832 time: 0.9548373 Nov 09 04:40:18.101946 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60562) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:40:18.262227 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d3f9d7b1-a273-4ee2-9e64-dcc54d3b5ddf None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-5c1cc491-3177-49e1-a58d-e9fa4f64046d', 'network_id': '5c1cc491-3177-49e1-a58d-e9fa4f64046d', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ips': [{'subnet_id': 'b698701a-6942-4c78-8d18-8f81ad97a357'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:40:18.263087 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d3f9d7b1-a273-4ee2-9e64-dcc54d3b5ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:18.424058 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-c9436d71-2eff-4f9b-bc1e-2ae19879b64f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '64146dbe-0485-4818-add5-b700f57a9d0d', 'name': 'tempest-TestNetworkBasicOps-router-888680478', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.73'}], 'enable_snat': True}, 'gw_port_id': '2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:40:15Z', 'updated_at': '2021-11-09T04:40:16Z', 'revision_number': 3, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:f7:88', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '64146dbe-0485-4818-add5-b700f57a9d0d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1436, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.73', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:40:15Z', 'updated_at': '2021-11-09T04:40:17Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:40:18.454984 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-d3f9d7b1-a273-4ee2-9e64-dcc54d3b5ddf None None] Allocated IP 172.20.0.2 (5c1cc491-3177-49e1-a58d-e9fa4f64046d/b698701a-6942-4c78-8d18-8f81ad97a357/faccdf70-a317-4fc7-a4c5-9c97ca983e19) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:40:18.457265 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c9436d71-2eff-4f9b-bc1e-2ae19879b64f None None] The sync data for ids ['64146dbe-0485-4818-add5-b700f57a9d0d'] in dv-neutron-816802-2-hyperv is: [{'id': '64146dbe-0485-4818-add5-b700f57a9d0d', 'name': 'tempest-TestNetworkBasicOps-router-888680478', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.73'}], 'enable_snat': True}, 'gw_port_id': '2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:40:15Z', 'updated_at': '2021-11-09T04:40:16Z', 'revision_number': 3, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:f7:88', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '64146dbe-0485-4818-add5-b700f57a9d0d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1436, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.73', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:40:15Z', 'updated_at': '2021-11-09T04:40:17Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:40:18.627423 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d3f9d7b1-a273-4ee2-9e64-dcc54d3b5ddf None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:18.699392 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d3f9d7b1-a273-4ee2-9e64-dcc54d3b5ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:18.749001 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d3f9d7b1-a273-4ee2-9e64-dcc54d3b5ddf None None] Network 5c1cc491-3177-49e1-a58d-e9fa4f64046d is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:40:18.752338 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-d3f9d7b1-a273-4ee2-9e64-dcc54d3b5ddf None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:40:18.755845 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d3f9d7b1-a273-4ee2-9e64-dcc54d3b5ddf None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:40:18.771893 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3f9d7b1-a273-4ee2-9e64-dcc54d3b5ddf None None] Pushing event updated for resources: {'Port': ['ID=faccdf70-a317-4fc7-a4c5-9c97ca983e19,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:40:18.829194 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-d3f9d7b1-a273-4ee2-9e64-dcc54d3b5ddf None None] Attempting to bind port faccdf70-a317-4fc7-a4c5-9c97ca983e19 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:40:18.829696 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-d3f9d7b1-a273-4ee2-9e64-dcc54d3b5ddf None None] Attempting to bind port faccdf70-a317-4fc7-a4c5-9c97ca983e19 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'b9865f8d-450a-48dd-a5fd-75229dfd570a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 343, 'network_id': '5c1cc491-3177-49e1-a58d-e9fa4f64046d'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:40:18.830073 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d3f9d7b1-a273-4ee2-9e64-dcc54d3b5ddf None None] Attempting to bind port faccdf70-a317-4fc7-a4c5-9c97ca983e19 on network 5c1cc491-3177-49e1-a58d-e9fa4f64046d {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:40:18.837399 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d3f9d7b1-a273-4ee2-9e64-dcc54d3b5ddf None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 40, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:40:18.837877 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d3f9d7b1-a273-4ee2-9e64-dcc54d3b5ddf None None] Checking segment: {'id': 'b9865f8d-450a-48dd-a5fd-75229dfd570a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 343, 'network_id': '5c1cc491-3177-49e1-a58d-e9fa4f64046d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:40:18.838400 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d3f9d7b1-a273-4ee2-9e64-dcc54d3b5ddf None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:18.838951 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d3f9d7b1-a273-4ee2-9e64-dcc54d3b5ddf None None] Bound using segment: {'id': 'b9865f8d-450a-48dd-a5fd-75229dfd570a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 343, 'network_id': '5c1cc491-3177-49e1-a58d-e9fa4f64046d'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:40:18.839774 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-d3f9d7b1-a273-4ee2-9e64-dcc54d3b5ddf None None] Bound port: faccdf70-a317-4fc7-a4c5-9c97ca983e19, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b9865f8d-450a-48dd-a5fd-75229dfd570a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 343, 'network_id': '5c1cc491-3177-49e1-a58d-e9fa4f64046d'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:40:18.840261 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d3f9d7b1-a273-4ee2-9e64-dcc54d3b5ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:18.865949 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-429246b5-f3c4-4fec-a98e-352a47051946 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:18.912415 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-d3f9d7b1-a273-4ee2-9e64-dcc54d3b5ddf None None] For port faccdf70-a317-4fc7-a4c5-9c97ca983e19, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:40:18.917527 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-d3f9d7b1-a273-4ee2-9e64-dcc54d3b5ddf None None] For port faccdf70-a317-4fc7-a4c5-9c97ca983e19, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=faccdf70-a317-4fc7-a4c5-9c97ca983e19,segment=NetworkSegment(b9865f8d-450a-48dd-a5fd-75229dfd570a),segment_id=b9865f8d-450a-48dd-a5fd-75229dfd570a)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:40:18.999446 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d3f9d7b1-a273-4ee2-9e64-dcc54d3b5ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:19.059277 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3f9d7b1-a273-4ee2-9e64-dcc54d3b5ddf None None] Pushing event updated for resources: {'Port': ['ID=faccdf70-a317-4fc7-a4c5-9c97ca983e19,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:40:19.168705 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-429246b5-f3c4-4fec-a98e-352a47051946 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Allocated IP 172.20.0.1 (5c1cc491-3177-49e1-a58d-e9fa4f64046d/b698701a-6942-4c78-8d18-8f81ad97a357/3858fcbc-7462-424b-ba66-6f2f0c0cea85) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:40:19.308357 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-429246b5-f3c4-4fec-a98e-352a47051946 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:19.434007 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-429246b5-f3c4-4fec-a98e-352a47051946 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:19.435848 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device faccdf70-a317-4fc7-a4c5-9c97ca983e19 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:40:19.479989 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-429246b5-f3c4-4fec-a98e-352a47051946 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network 5c1cc491-3177-49e1-a58d-e9fa4f64046d is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:40:19.483317 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-429246b5-f3c4-4fec-a98e-352a47051946 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:40:19.487776 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-429246b5-f3c4-4fec-a98e-352a47051946 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:40:19.487940 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port faccdf70-a317-4fc7-a4c5-9c97ca983e19 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:40:19.488303 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:19.491866 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429246b5-f3c4-4fec-a98e-352a47051946 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Port': ['ID=3858fcbc-7462-424b-ba66-6f2f0c0cea85,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:40:19.518910 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429246b5-f3c4-4fec-a98e-352a47051946 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:40:19.519261 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429246b5-f3c4-4fec-a98e-352a47051946 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:40:19.519625 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429246b5-f3c4-4fec-a98e-352a47051946 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:40:19.519948 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429246b5-f3c4-4fec-a98e-352a47051946 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:40:19.520277 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429246b5-f3c4-4fec-a98e-352a47051946 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:40:19.520608 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429246b5-f3c4-4fec-a98e-352a47051946 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:40:19.521485 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429246b5-f3c4-4fec-a98e-352a47051946 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:40:19.521816 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429246b5-f3c4-4fec-a98e-352a47051946 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:40:19.522141 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429246b5-f3c4-4fec-a98e-352a47051946 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:40:19.522492 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429246b5-f3c4-4fec-a98e-352a47051946 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:40:19.522812 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429246b5-f3c4-4fec-a98e-352a47051946 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:40:19.523149 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-429246b5-f3c4-4fec-a98e-352a47051946 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:40:19.545685 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-429246b5-f3c4-4fec-a98e-352a47051946 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:19.565703 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:19.599628 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port faccdf70-a317-4fc7-a4c5-9c97ca983e19, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=faccdf70-a317-4fc7-a4c5-9c97ca983e19,segment=NetworkSegment(b9865f8d-450a-48dd-a5fd-75229dfd570a),segment_id=b9865f8d-450a-48dd-a5fd-75229dfd570a)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:40:19.670660 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:19.671454 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:40:19.752855 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=faccdf70-a317-4fc7-a4c5-9c97ca983e19,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:40:19.768830 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:40:19.769196 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:19.811101 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-429246b5-f3c4-4fec-a98e-352a47051946 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:19.856041 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:19.882401 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:40:19.986824 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:20.041555 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:40:20.056739 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f5adb490-b6c0-4496-8f13-bf5ac0e1880f None None] Network 5c1cc491-3177-49e1-a58d-e9fa4f64046d requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:40:20.116322 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-429246b5-f3c4-4fec-a98e-352a47051946 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:20.163115 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-cff563ae-1fbc-4db9-978c-9f7dabf47025 None None] Provisioning complete for port faccdf70-a317-4fc7-a4c5-9c97ca983e19 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:40:20.163484 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-cff563ae-1fbc-4db9-978c-9f7dabf47025 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:20.170657 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-429246b5-f3c4-4fec-a98e-352a47051946 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:20.253072 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429246b5-f3c4-4fec-a98e-352a47051946 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Port': ['ID=3858fcbc-7462-424b-ba66-6f2f0c0cea85,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:40:20.257208 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-429246b5-f3c4-4fec-a98e-352a47051946 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:20.361023 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-429246b5-f3c4-4fec-a98e-352a47051946 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network 5c1cc491-3177-49e1-a58d-e9fa4f64046d is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:40:20.362474 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-429246b5-f3c4-4fec-a98e-352a47051946 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:40:20.485176 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-429246b5-f3c4-4fec-a98e-352a47051946 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Router 64146dbe-0485-4818-add5-b700f57a9d0d has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:40:20.597603 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-429246b5-f3c4-4fec-a98e-352a47051946 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:40:20.603244 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-429246b5-f3c4-4fec-a98e-352a47051946 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "PUT /v2.0/routers/64146dbe-0485-4818-add5-b700f57a9d0d/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.5006957 Nov 09 04:40:20.605816 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60564) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:40:20.641755 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-45a23c09-9816-4bba-84cf-83762addcb6a None None] Sync routers for ids ['64146dbe-0485-4818-add5-b700f57a9d0d'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:40:20.655428 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-45a23c09-9816-4bba-84cf-83762addcb6a None None] Routers {'64146dbe-0485-4818-add5-b700f57a9d0d'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:40:20.656254 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-45a23c09-9816-4bba-84cf-83762addcb6a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:40:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['64146dbe-0485-4818-add5-b700f57a9d0d'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:40:20.660298 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-8a120852-5caa-4304-a619-d147e524a4a7 None None] Provisioning complete for port 3858fcbc-7462-424b-ba66-6f2f0c0cea85 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:40:20.660298 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8a120852-5caa-4304-a619-d147e524a4a7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:20.705341 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-8a120852-5caa-4304-a619-d147e524a4a7 None None] Port 3858fcbc-7462-424b-ba66-6f2f0c0cea85 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:40:20.724267 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-8a120852-5caa-4304-a619-d147e524a4a7 None None] Provisioning complete for port faccdf70-a317-4fc7-a4c5-9c97ca983e19 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:40:20.725989 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8a120852-5caa-4304-a619-d147e524a4a7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:20.802701 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-45a23c09-9816-4bba-84cf-83762addcb6a None None] Set router 64146dbe-0485-4818-add5-b700f57a9d0d gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:40:20.810436 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dbbfde2d-8b69-4199-8834-baba3ad5b5b8 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:40:20.811056 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dbbfde2d-8b69-4199-8834-baba3ad5b5b8 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:40:20.811584 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dbbfde2d-8b69-4199-8834-baba3ad5b5b8 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:40:20.812099 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dbbfde2d-8b69-4199-8834-baba3ad5b5b8 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:40:20.812612 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dbbfde2d-8b69-4199-8834-baba3ad5b5b8 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:40:20.813122 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dbbfde2d-8b69-4199-8834-baba3ad5b5b8 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:40:20.816614 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-dbbfde2d-8b69-4199-8834-baba3ad5b5b8 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/networks HTTP/1.1" status: 200 len: 4285 time: 0.2098076 Nov 09 04:40:20.834154 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60566) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:40:20.936854 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2fe3586d-0f94-4213-9cb8-3e25e43aa80e tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:40:20.937315 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2fe3586d-0f94-4213-9cb8-3e25e43aa80e tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:40:20.937765 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2fe3586d-0f94-4213-9cb8-3e25e43aa80e tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:40:20.938213 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2fe3586d-0f94-4213-9cb8-3e25e43aa80e tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:40:20.938681 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2fe3586d-0f94-4213-9cb8-3e25e43aa80e tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:40:20.939124 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2fe3586d-0f94-4213-9cb8-3e25e43aa80e tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:40:20.940937 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-2fe3586d-0f94-4213-9cb8-3e25e43aa80e tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 4006 time: 0.1055365 Nov 09 04:40:20.945353 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 60568) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:40:20.949199 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-09a62746-7211-4af8-a132-82fa79f769fa None None] Provisioning complete for port 3858fcbc-7462-424b-ba66-6f2f0c0cea85 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:40:20.949570 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-09a62746-7211-4af8-a132-82fa79f769fa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:20.993881 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-09a62746-7211-4af8-a132-82fa79f769fa None None] Port 3858fcbc-7462-424b-ba66-6f2f0c0cea85 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:40:21.048503 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-45a23c09-9816-4bba-84cf-83762addcb6a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '64146dbe-0485-4818-add5-b700f57a9d0d', 'name': 'tempest-TestNetworkBasicOps-router-888680478', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.73'}], 'enable_snat': True}, 'gw_port_id': '2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:40:15Z', 'updated_at': '2021-11-09T04:40:19Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:f7:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '64146dbe-0485-4818-add5-b700f57a9d0d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1436, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.73', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:40:15Z', 'updated_at': '2021-11-09T04:40:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '3858fcbc-7462-424b-ba66-6f2f0c0cea85', 'name': '', 'network_id': '5c1cc491-3177-49e1-a58d-e9fa4f64046d', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:82:05:a8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '64146dbe-0485-4818-add5-b700f57a9d0d', 'device_owner': 'network:router_interface', 'standard_attr_id': 1439, 'fixed_ips': [{'subnet_id': 'b698701a-6942-4c78-8d18-8f81ad97a357', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:40:19Z', 'updated_at': '2021-11-09T04:40:19Z', 'revision_number': 2, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': 'b698701a-6942-4c78-8d18-8f81ad97a357', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:40:21.079090 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-45a23c09-9816-4bba-84cf-83762addcb6a None None] Checking router: 64146dbe-0485-4818-add5-b700f57a9d0d for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:40:21.079438 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-45a23c09-9816-4bba-84cf-83762addcb6a None None] Updating router 64146dbe-0485-4818-add5-b700f57a9d0d port 3858fcbc-7462-424b-ba66-6f2f0c0cea85 binding host dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 04:40:21.103036 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-109a4693-298b-4ed8-96d7-967b8dc9cb58 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/routers HTTP/1.1" status: 200 len: 3046 time: 0.1564248 Nov 09 04:40:21.107103 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-45a23c09-9816-4bba-84cf-83762addcb6a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:21.119360 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-f0e92d18-406d-41d6-a5f5-0aa4ca988f07 None None] Provisioning complete for port 3858fcbc-7462-424b-ba66-6f2f0c0cea85 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:40:21.119786 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f0e92d18-406d-41d6-a5f5-0aa4ca988f07 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:21.157490 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-f0e92d18-406d-41d6-a5f5-0aa4ca988f07 None None] Port 3858fcbc-7462-424b-ba66-6f2f0c0cea85 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:40:21.373923 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-45a23c09-9816-4bba-84cf-83762addcb6a None None] Publish callbacks [] for port, precommit_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:21.388019 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device faccdf70-a317-4fc7-a4c5-9c97ca983e19 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:40:21.405484 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 60572) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:40:21.410149 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-b1a00d6d-3363-4791-a70c-9ca9401060e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-2020110430', 'description': 'tempest-secgroup-smoke-2020110430 description', 'project_id': '1d10b4824e524068827e58b55e269af3'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:40:21.436527 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port faccdf70-a317-4fc7-a4c5-9c97ca983e19 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:40:21.436889 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:21.516953 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:40:21.524176 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-45a23c09-9816-4bba-84cf-83762addcb6a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:21.564764 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:40:21.565039 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:21.579128 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b1a00d6d-3363-4791-a70c-9ca9401060e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:21.652176 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b1a00d6d-3363-4791-a70c-9ca9401060e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:21.663855 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9da4c62b-d9d5-4da0-a533-ee0c465e6f53 None None] Pushing event updated for resources: {'Port': ['ID=3858fcbc-7462-424b-ba66-6f2f0c0cea85,revision_number=3']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:40:21.719233 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-45a23c09-9816-4bba-84cf-83762addcb6a None None] Attempting to bind port 3858fcbc-7462-424b-ba66-6f2f0c0cea85 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:40:21.719594 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-45a23c09-9816-4bba-84cf-83762addcb6a None None] Attempting to bind port 3858fcbc-7462-424b-ba66-6f2f0c0cea85 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'b9865f8d-450a-48dd-a5fd-75229dfd570a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 343, 'network_id': '5c1cc491-3177-49e1-a58d-e9fa4f64046d'}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:40:21.719950 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-45a23c09-9816-4bba-84cf-83762addcb6a None None] Attempting to bind port 3858fcbc-7462-424b-ba66-6f2f0c0cea85 on network 5c1cc491-3177-49e1-a58d-e9fa4f64046d {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:40:21.726958 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-45a23c09-9816-4bba-84cf-83762addcb6a None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 40, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:40:21.727320 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-45a23c09-9816-4bba-84cf-83762addcb6a None None] Checking segment: {'id': 'b9865f8d-450a-48dd-a5fd-75229dfd570a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 343, 'network_id': '5c1cc491-3177-49e1-a58d-e9fa4f64046d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102164) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:40:21.727709 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-45a23c09-9816-4bba-84cf-83762addcb6a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:21.728090 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-45a23c09-9816-4bba-84cf-83762addcb6a None None] Bound using segment: {'id': 'b9865f8d-450a-48dd-a5fd-75229dfd570a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 343, 'network_id': '5c1cc491-3177-49e1-a58d-e9fa4f64046d'} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:40:21.728547 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-45a23c09-9816-4bba-84cf-83762addcb6a None None] Bound port: 3858fcbc-7462-424b-ba66-6f2f0c0cea85, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b9865f8d-450a-48dd-a5fd-75229dfd570a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 343, 'network_id': '5c1cc491-3177-49e1-a58d-e9fa4f64046d'}}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:40:21.728920 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-45a23c09-9816-4bba-84cf-83762addcb6a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:21.733442 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b1a00d6d-3363-4791-a70c-9ca9401060e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:21.764770 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1a00d6d-3363-4791-a70c-9ca9401060e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroup': ['ID=e5209e89-9c20-4bd3-bbfa-b1e7f3fcefdc,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:40:21.878105 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-6f35f361-d232-4353-9c32-e5e51189f35b None None] Provisioning complete for port 3858fcbc-7462-424b-ba66-6f2f0c0cea85 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:40:21.878724 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6f35f361-d232-4353-9c32-e5e51189f35b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:21.888624 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b1a00d6d-3363-4791-a70c-9ca9401060e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:21.889576 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-45a23c09-9816-4bba-84cf-83762addcb6a None None] For port 3858fcbc-7462-424b-ba66-6f2f0c0cea85, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102164) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:40:21.890293 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-b1a00d6d-3363-4791-a70c-9ca9401060e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.4838011 Nov 09 04:40:21.894150 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-45a23c09-9816-4bba-84cf-83762addcb6a None None] For port 3858fcbc-7462-424b-ba66-6f2f0c0cea85, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=3858fcbc-7462-424b-ba66-6f2f0c0cea85,segment=NetworkSegment(b9865f8d-450a-48dd-a5fd-75229dfd570a),segment_id=b9865f8d-450a-48dd-a5fd-75229dfd570a)] {{(pid=102164) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:40:21.895529 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60574) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:40:21.900612 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-8463c23c-091f-492e-8a5c-0536340be2ce tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': 'e5209e89-9c20-4bd3-bbfa-b1e7f3fcefdc', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:40:21.923302 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-6f35f361-d232-4353-9c32-e5e51189f35b None None] Port 3858fcbc-7462-424b-ba66-6f2f0c0cea85 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:40:21.968016 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-45a23c09-9816-4bba-84cf-83762addcb6a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:21.995074 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8463c23c-091f-492e-8a5c-0536340be2ce tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:22.019351 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-45a23c09-9816-4bba-84cf-83762addcb6a None None] Routers {'64146dbe-0485-4818-add5-b700f57a9d0d'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:40:22.019981 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-45a23c09-9816-4bba-84cf-83762addcb6a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:40:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['64146dbe-0485-4818-add5-b700f57a9d0d'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:40:22.056252 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8463c23c-091f-492e-8a5c-0536340be2ce tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:22.074785 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9da4c62b-d9d5-4da0-a533-ee0c465e6f53 None None] Pushing event updated for resources: {'Port': ['ID=3858fcbc-7462-424b-ba66-6f2f0c0cea85,revision_number=4']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:40:22.142123 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-45a23c09-9816-4bba-84cf-83762addcb6a None None] Set router 64146dbe-0485-4818-add5-b700f57a9d0d gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:40:22.162028 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8463c23c-091f-492e-8a5c-0536340be2ce tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:22.185010 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8463c23c-091f-492e-8a5c-0536340be2ce tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=92cf0c23-45b6-49f2-add3-acb2d3e6f7f5,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:40:22.245213 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-5fd87b2a-4701-4292-b2eb-b5a0c7e50ac1 None None] Provisioning complete for port 3858fcbc-7462-424b-ba66-6f2f0c0cea85 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:40:22.245630 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5fd87b2a-4701-4292-b2eb-b5a0c7e50ac1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:22.266975 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8463c23c-091f-492e-8a5c-0536340be2ce tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:22.269310 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-8463c23c-091f-492e-8a5c-0536340be2ce tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3711200 Nov 09 04:40:22.271999 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60576) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:40:22.277011 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-1d46c39d-2236-4038-9b22-1451f77bbbb5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': 'e5209e89-9c20-4bd3-bbfa-b1e7f3fcefdc', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:40:22.328883 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5fd87b2a-4701-4292-b2eb-b5a0c7e50ac1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:22.349267 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-45a23c09-9816-4bba-84cf-83762addcb6a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '64146dbe-0485-4818-add5-b700f57a9d0d', 'name': 'tempest-TestNetworkBasicOps-router-888680478', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.73'}], 'enable_snat': True}, 'gw_port_id': '2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:40:15Z', 'updated_at': '2021-11-09T04:40:19Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:f7:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '64146dbe-0485-4818-add5-b700f57a9d0d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1436, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.73', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:40:15Z', 'updated_at': '2021-11-09T04:40:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '3858fcbc-7462-424b-ba66-6f2f0c0cea85', 'name': '', 'network_id': '5c1cc491-3177-49e1-a58d-e9fa4f64046d', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:82:05:a8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '64146dbe-0485-4818-add5-b700f57a9d0d', 'device_owner': 'network:router_interface', 'standard_attr_id': 1439, 'fixed_ips': [{'subnet_id': 'b698701a-6942-4c78-8d18-8f81ad97a357', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:40:19Z', 'updated_at': '2021-11-09T04:40:21Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': 'b698701a-6942-4c78-8d18-8f81ad97a357', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:40:22.361085 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-5fd87b2a-4701-4292-b2eb-b5a0c7e50ac1 None None] For port 3858fcbc-7462-424b-ba66-6f2f0c0cea85, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=3858fcbc-7462-424b-ba66-6f2f0c0cea85,segment=NetworkSegment(b9865f8d-450a-48dd-a5fd-75229dfd570a),segment_id=b9865f8d-450a-48dd-a5fd-75229dfd570a)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:40:22.369664 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1d46c39d-2236-4038-9b22-1451f77bbbb5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:22.376234 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-45a23c09-9816-4bba-84cf-83762addcb6a None None] The sync data for ids ['64146dbe-0485-4818-add5-b700f57a9d0d'] in dv-neutron-816802-2-hyperv is: [{'id': '64146dbe-0485-4818-add5-b700f57a9d0d', 'name': 'tempest-TestNetworkBasicOps-router-888680478', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.73'}], 'enable_snat': True}, 'gw_port_id': '2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:40:15Z', 'updated_at': '2021-11-09T04:40:19Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:f7:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '64146dbe-0485-4818-add5-b700f57a9d0d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1436, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.73', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:40:15Z', 'updated_at': '2021-11-09T04:40:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '3858fcbc-7462-424b-ba66-6f2f0c0cea85', 'name': '', 'network_id': '5c1cc491-3177-49e1-a58d-e9fa4f64046d', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:82:05:a8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '64146dbe-0485-4818-add5-b700f57a9d0d', 'device_owner': 'network:router_interface', 'standard_attr_id': 1439, 'fixed_ips': [{'subnet_id': 'b698701a-6942-4c78-8d18-8f81ad97a357', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:40:19Z', 'updated_at': '2021-11-09T04:40:21Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': 'b698701a-6942-4c78-8d18-8f81ad97a357', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:40:22.438993 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1d46c39d-2236-4038-9b22-1451f77bbbb5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:22.476097 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5fd87b2a-4701-4292-b2eb-b5a0c7e50ac1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:22.534619 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fd87b2a-4701-4292-b2eb-b5a0c7e50ac1 None None] Pushing event updated for resources: {'Port': ['ID=3858fcbc-7462-424b-ba66-6f2f0c0cea85,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:40:22.547529 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1d46c39d-2236-4038-9b22-1451f77bbbb5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:22.578612 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d46c39d-2236-4038-9b22-1451f77bbbb5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=76d40475-a7fc-454c-9f17-1909db7130c8,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:40:22.678929 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1d46c39d-2236-4038-9b22-1451f77bbbb5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:22.680218 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1d46c39d-2236-4038-9b22-1451f77bbbb5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.4071338 Nov 09 04:40:22.683317 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60578) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:40:22.688268 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-5f5f568a-e067-4484-9c26-a6244b1cb8f7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': 'e5209e89-9c20-4bd3-bbfa-b1e7f3fcefdc', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:40:22.790732 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5f5f568a-e067-4484-9c26-a6244b1cb8f7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:22.895886 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5f5f568a-e067-4484-9c26-a6244b1cb8f7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:22.991081 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5f5f568a-e067-4484-9c26-a6244b1cb8f7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:23.009888 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f5f568a-e067-4484-9c26-a6244b1cb8f7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=25086a62-4a6b-42b9-9061-bf6f840e4bfa,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:40:23.078092 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5f5f568a-e067-4484-9c26-a6244b1cb8f7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:23.081984 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-5f5f568a-e067-4484-9c26-a6244b1cb8f7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3950753 Nov 09 04:40:23.082148 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60580) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:40:23.088091 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-8fede2fb-362f-4ee1-aea9-0b675aa1fa03 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': 'e5209e89-9c20-4bd3-bbfa-b1e7f3fcefdc', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:40:23.184085 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8fede2fb-362f-4ee1-aea9-0b675aa1fa03 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:23.246680 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8fede2fb-362f-4ee1-aea9-0b675aa1fa03 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:23.351189 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8fede2fb-362f-4ee1-aea9-0b675aa1fa03 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:23.373762 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fede2fb-362f-4ee1-aea9-0b675aa1fa03 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=948d212f-c499-4ca3-a2fe-0aa9b06738ad,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:40:23.400622 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 3858fcbc-7462-424b-ba66-6f2f0c0cea85 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:40:23.449787 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 3858fcbc-7462-424b-ba66-6f2f0c0cea85 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:40:23.450161 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:23.455386 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8fede2fb-362f-4ee1-aea9-0b675aa1fa03 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:23.458627 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-8fede2fb-362f-4ee1-aea9-0b675aa1fa03 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3734646 Nov 09 04:40:23.459698 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60582) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:40:23.464655 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-daba2bad-51e1-4572-9785-095bafec7424 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': 'e5209e89-9c20-4bd3-bbfa-b1e7f3fcefdc', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:40:23.593092 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.securitygroups_db [None req-daba2bad-51e1-4572-9785-095bafec7424 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Project 1d10b4824e524068827e58b55e269af3 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 09 04:40:23.598202 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-daba2bad-51e1-4572-9785-095bafec7424 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:23.655047 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-daba2bad-51e1-4572-9785-095bafec7424 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:23.741510 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-daba2bad-51e1-4572-9785-095bafec7424 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:23.759967 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-daba2bad-51e1-4572-9785-095bafec7424 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5677d0db-f924-4b65-8cc3-0573f12fa175,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:40:23.863894 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-daba2bad-51e1-4572-9785-095bafec7424 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:23.865375 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-daba2bad-51e1-4572-9785-095bafec7424 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.4044433 Nov 09 04:40:23.867891 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60584) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:40:23.872310 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-e61ca411-85d6-4c13-aeec-b8962174f6c6 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': 'e5209e89-9c20-4bd3-bbfa-b1e7f3fcefdc', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:40:24.004662 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.securitygroups_db [None req-e61ca411-85d6-4c13-aeec-b8962174f6c6 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Project 1d10b4824e524068827e58b55e269af3 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 09 04:40:24.009629 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e61ca411-85d6-4c13-aeec-b8962174f6c6 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:24.066732 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e61ca411-85d6-4c13-aeec-b8962174f6c6 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:24.173003 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e61ca411-85d6-4c13-aeec-b8962174f6c6 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:24.189624 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e61ca411-85d6-4c13-aeec-b8962174f6c6 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f83885d8-7315-4308-9891-564b5a24b55d,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:40:24.274827 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e61ca411-85d6-4c13-aeec-b8962174f6c6 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:24.276032 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-e61ca411-85d6-4c13-aeec-b8962174f6c6 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.4072030 Nov 09 04:40:24.422844 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4ba7d234-ca3e-4fcb-983c-39769584c39c req-6fb08ce4-d350-4130-bdca-7edff6766d7e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-2020110430&fields=id&tenant_id=1d10b4824e524068827e58b55e269af3 HTTP/1.1" status: 200 len: 267 time: 0.0446913 Nov 09 04:40:24.533157 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ba7d234-ca3e-4fcb-983c-39769584c39c req-81e2dbd1-aea3-49d4-b42c-d87989ae1c35 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:40:24.534549 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4ba7d234-ca3e-4fcb-983c-39769584c39c req-81e2dbd1-aea3-49d4-b42c-d87989ae1c35 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/networks?id=5c1cc491-3177-49e1-a58d-e9fa4f64046d HTTP/1.1" status: 200 len: 796 time: 0.1051164 Nov 09 04:40:24.549592 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4ba7d234-ca3e-4fcb-983c-39769584c39c req-efc75bf6-6e73-4093-9293-a0a6d6e84e1f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/quotas/1d10b4824e524068827e58b55e269af3 HTTP/1.1" status: 200 len: 375 time: 0.0092187 Nov 09 04:40:24.600488 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4ba7d234-ca3e-4fcb-983c-39769584c39c req-70e1f24b-7c8b-45cb-91fb-582097156f5b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0455933 Nov 09 04:40:24.659583 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [req-4ba7d234-ca3e-4fcb-983c-39769584c39c req-b5196117-5a58-4d95-90d1-72c7b4c9575c service neutron] http://10.222.0.24:9696/v2.0/extensions returned with HTTP 200 {{(pid=102162) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:40:24.660568 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4ba7d234-ca3e-4fcb-983c-39769584c39c req-b5196117-5a58-4d95-90d1-72c7b4c9575c service neutron] 10.222.0.24 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0489223 Nov 09 04:40:24.757449 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4ba7d234-ca3e-4fcb-983c-39769584c39c req-e86b2df9-ddfe-4509-b8c4-463d65763cde service neutron] 10.222.0.24 "GET /v2.0/networks/5c1cc491-3177-49e1-a58d-e9fa4f64046d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0905802 Nov 09 04:40:24.850541 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4ba7d234-ca3e-4fcb-983c-39769584c39c req-13d1ec01-fd31-4a0d-9bfb-e77b8fb4a2f8 service neutron] 10.222.0.24 "GET /v2.0/networks/5c1cc491-3177-49e1-a58d-e9fa4f64046d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0869935 Nov 09 04:40:25.126197 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-4a11c2aa-c489-419d-ba51-5dcc1f343dc4 req-3f3b4523-8523-421a-bc1d-ed1db24a86f2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=b79dd1f1-0baf-43bb-92a9-bf549b3f4fd7 HTTP/1.1" status: 200 len: 210 time: 0.0265150 Nov 09 04:40:26.220532 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-79412523-7fe3-4344-8e55-a6d2289e1073 req-24bb24bc-9323-4859-b831-d4b5daec663e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=b79dd1f1-0baf-43bb-92a9-bf549b3f4fd7 HTTP/1.1" status: 200 len: 210 time: 0.0256371 Nov 09 04:40:27.174770 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ba7d234-ca3e-4fcb-983c-39769584c39c req-b3840c60-f61b-44b7-ba2b-9a497530c0ec tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:40:27.176219 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4ba7d234-ca3e-4fcb-983c-39769584c39c req-b3840c60-f61b-44b7-ba2b-9a497530c0ec tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "GET /v2.0/networks?id=5c1cc491-3177-49e1-a58d-e9fa4f64046d HTTP/1.1" status: 200 len: 796 time: 0.1063113 Nov 09 04:40:27.240832 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4ba7d234-ca3e-4fcb-983c-39769584c39c req-7b069c15-d109-41fd-879d-dbfe71ba65f3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=1d10b4824e524068827e58b55e269af3 HTTP/1.1" status: 200 len: 380 time: 0.0552297 Nov 09 04:40:27.250405 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-4ba7d234-ca3e-4fcb-983c-39769584c39c req-3c94e12b-ef8c-4803-9708-0b232620678e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'port': {'device_id': 'b79dd1f1-0baf-43bb-92a9-bf549b3f4fd7', 'network_id': '5c1cc491-3177-49e1-a58d-e9fa4f64046d', 'admin_state_up': True, 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'security_groups': ['e5209e89-9c20-4bd3-bbfa-b1e7f3fcefdc']}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:40:27.323672 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-58540322-40f9-4a9d-8dab-7899def35ce7 req-15aed06e-94f9-4504-8d97-21d5938da428 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=b79dd1f1-0baf-43bb-92a9-bf549b3f4fd7 HTTP/1.1" status: 200 len: 210 time: 0.0359862 Nov 09 04:40:27.441235 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4ba7d234-ca3e-4fcb-983c-39769584c39c req-3c94e12b-ef8c-4803-9708-0b232620678e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Made reservation on behalf of 1d10b4824e524068827e58b55e269af3 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:40:27.445251 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-4ba7d234-ca3e-4fcb-983c-39769584c39c req-3c94e12b-ef8c-4803-9708-0b232620678e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:27.569692 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [req-4ba7d234-ca3e-4fcb-983c-39769584c39c req-3c94e12b-ef8c-4803-9708-0b232620678e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Allocated IP 172.20.0.5 (5c1cc491-3177-49e1-a58d-e9fa4f64046d/b698701a-6942-4c78-8d18-8f81ad97a357/f93ae6b9-acd9-4c4a-a889-36775bca7179) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:40:27.706836 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-4ba7d234-ca3e-4fcb-983c-39769584c39c req-3c94e12b-ef8c-4803-9708-0b232620678e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:27.807418 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-4ba7d234-ca3e-4fcb-983c-39769584c39c req-3c94e12b-ef8c-4803-9708-0b232620678e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:27.847907 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4ba7d234-ca3e-4fcb-983c-39769584c39c req-3c94e12b-ef8c-4803-9708-0b232620678e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network 5c1cc491-3177-49e1-a58d-e9fa4f64046d is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:40:27.852858 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [req-4ba7d234-ca3e-4fcb-983c-39769584c39c req-3c94e12b-ef8c-4803-9708-0b232620678e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:40:27.856559 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-4ba7d234-ca3e-4fcb-983c-39769584c39c req-3c94e12b-ef8c-4803-9708-0b232620678e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:40:27.887366 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c94e12b-ef8c-4803-9708-0b232620678e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Port': ['ID=f93ae6b9-acd9-4c4a-a889-36775bca7179,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:40:27.916108 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ba7d234-ca3e-4fcb-983c-39769584c39c req-3c94e12b-ef8c-4803-9708-0b232620678e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:40:27.916108 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-4ba7d234-ca3e-4fcb-983c-39769584c39c req-3c94e12b-ef8c-4803-9708-0b232620678e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:27.995778 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4ba7d234-ca3e-4fcb-983c-39769584c39c req-3c94e12b-ef8c-4803-9708-0b232620678e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7492239 Nov 09 04:40:28.010040 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-4ba7d234-ca3e-4fcb-983c-39769584c39c req-15f015ec-ad26-4180-a282-b926416fa92c service neutron] Request body: {'port': {'device_id': 'b79dd1f1-0baf-43bb-92a9-bf549b3f4fd7', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:40:28.138894 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-6b66bcbd-05ae-4108-8a87-6ed06d7de025 None None] Provisioning complete for port f93ae6b9-acd9-4c4a-a889-36775bca7179 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:40:28.139494 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6b66bcbd-05ae-4108-8a87-6ed06d7de025 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:28.174267 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-6b66bcbd-05ae-4108-8a87-6ed06d7de025 None None] Port f93ae6b9-acd9-4c4a-a889-36775bca7179 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:40:28.384550 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-4ba7d234-ca3e-4fcb-983c-39769584c39c req-15f015ec-ad26-4180-a282-b926416fa92c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:28.478056 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63775faa-34fc-4d13-a02b-6163657a9d32 req-75371266-86a0-4157-82c2-569574c836d7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:40:28.479533 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-63775faa-34fc-4d13-a02b-6163657a9d32 req-75371266-86a0-4157-82c2-569574c836d7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=b79dd1f1-0baf-43bb-92a9-bf549b3f4fd7 HTTP/1.1" status: 200 len: 931 time: 0.0866020 Nov 09 04:40:28.595145 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-63775faa-34fc-4d13-a02b-6163657a9d32 req-3ee7d692-f234-44ed-9449-44020cab1a0d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=e5209e89-9c20-4bd3-bbfa-b1e7f3fcefdc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0771792 Nov 09 04:40:28.711518 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [req-4ba7d234-ca3e-4fcb-983c-39769584c39c req-15f015ec-ad26-4180-a282-b926416fa92c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f93ae6b9-acd9-4c4a-a889-36775bca7179 {{(pid=102162) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:40:28.719031 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-4ba7d234-ca3e-4fcb-983c-39769584c39c req-15f015ec-ad26-4180-a282-b926416fa92c service neutron] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:28.731075 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.provisioning_blocks [req-4ba7d234-ca3e-4fcb-983c-39769584c39c req-15f015ec-ad26-4180-a282-b926416fa92c service neutron] Transition to ACTIVE for port object f93ae6b9-acd9-4c4a-a889-36775bca7179 will not be triggered until provisioned by entity L2. {{(pid=102162) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 09 04:40:28.838121 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-4ba7d234-ca3e-4fcb-983c-39769584c39c req-15f015ec-ad26-4180-a282-b926416fa92c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:28.886293 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15f015ec-ad26-4180-a282-b926416fa92c service neutron] Pushing event updated for resources: {'Port': ['ID=f93ae6b9-acd9-4c4a-a889-36775bca7179,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:40:28.909400 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15f015ec-ad26-4180-a282-b926416fa92c service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:40:28.909748 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15f015ec-ad26-4180-a282-b926416fa92c service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:40:28.910151 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15f015ec-ad26-4180-a282-b926416fa92c service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:40:28.910447 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15f015ec-ad26-4180-a282-b926416fa92c service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:40:28.910781 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15f015ec-ad26-4180-a282-b926416fa92c service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:40:28.911134 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15f015ec-ad26-4180-a282-b926416fa92c service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:40:28.911482 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15f015ec-ad26-4180-a282-b926416fa92c service neutron] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:40:28.911819 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15f015ec-ad26-4180-a282-b926416fa92c service neutron] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:40:28.912132 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15f015ec-ad26-4180-a282-b926416fa92c service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:40:28.912456 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15f015ec-ad26-4180-a282-b926416fa92c service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:40:28.912773 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15f015ec-ad26-4180-a282-b926416fa92c service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:40:28.913093 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15f015ec-ad26-4180-a282-b926416fa92c service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:40:28.972013 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-4ba7d234-ca3e-4fcb-983c-39769584c39c req-15f015ec-ad26-4180-a282-b926416fa92c service neutron] Attempting to bind port f93ae6b9-acd9-4c4a-a889-36775bca7179 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:40:28.972349 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-4ba7d234-ca3e-4fcb-983c-39769584c39c req-15f015ec-ad26-4180-a282-b926416fa92c service neutron] Attempting to bind port f93ae6b9-acd9-4c4a-a889-36775bca7179 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'b9865f8d-450a-48dd-a5fd-75229dfd570a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 343, 'network_id': '5c1cc491-3177-49e1-a58d-e9fa4f64046d'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:40:28.972676 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4ba7d234-ca3e-4fcb-983c-39769584c39c req-15f015ec-ad26-4180-a282-b926416fa92c service neutron] Attempting to bind port f93ae6b9-acd9-4c4a-a889-36775bca7179 on network 5c1cc491-3177-49e1-a58d-e9fa4f64046d {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:40:28.977175 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4ba7d234-ca3e-4fcb-983c-39769584c39c req-15f015ec-ad26-4180-a282-b926416fa92c service neutron] Port f93ae6b9-acd9-4c4a-a889-36775bca7179 on network 5c1cc491-3177-49e1-a58d-e9fa4f64046d not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:40:28.977493 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4ba7d234-ca3e-4fcb-983c-39769584c39c req-15f015ec-ad26-4180-a282-b926416fa92c service neutron] Attempting to bind port f93ae6b9-acd9-4c4a-a889-36775bca7179 on network 5c1cc491-3177-49e1-a58d-e9fa4f64046d {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:40:28.982630 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4ba7d234-ca3e-4fcb-983c-39769584c39c req-15f015ec-ad26-4180-a282-b926416fa92c service neutron] Checking agent: {'id': '7d36b884-4ad2-4878-9464-bf647030b544', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'started_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 40, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:40:28.982961 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4ba7d234-ca3e-4fcb-983c-39769584c39c req-15f015ec-ad26-4180-a282-b926416fa92c service neutron] Checking segment: {'id': 'b9865f8d-450a-48dd-a5fd-75229dfd570a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 343, 'network_id': '5c1cc491-3177-49e1-a58d-e9fa4f64046d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:40:28.983370 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4ba7d234-ca3e-4fcb-983c-39769584c39c req-15f015ec-ad26-4180-a282-b926416fa92c service neutron] Bound using segment: {'id': 'b9865f8d-450a-48dd-a5fd-75229dfd570a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 343, 'network_id': '5c1cc491-3177-49e1-a58d-e9fa4f64046d'} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:40:28.983792 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-4ba7d234-ca3e-4fcb-983c-39769584c39c req-15f015ec-ad26-4180-a282-b926416fa92c service neutron] Bound port: f93ae6b9-acd9-4c4a-a889-36775bca7179, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b9865f8d-450a-48dd-a5fd-75229dfd570a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 343, 'network_id': '5c1cc491-3177-49e1-a58d-e9fa4f64046d'}}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:40:28.984147 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-4ba7d234-ca3e-4fcb-983c-39769584c39c req-15f015ec-ad26-4180-a282-b926416fa92c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:29.048949 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-4ba7d234-ca3e-4fcb-983c-39769584c39c req-15f015ec-ad26-4180-a282-b926416fa92c service neutron] For port f93ae6b9-acd9-4c4a-a889-36775bca7179, host hv-neutron-8168, cleared binding levels {{(pid=102162) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:40:29.051991 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-4ba7d234-ca3e-4fcb-983c-39769584c39c req-15f015ec-ad26-4180-a282-b926416fa92c service neutron] For port f93ae6b9-acd9-4c4a-a889-36775bca7179, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=f93ae6b9-acd9-4c4a-a889-36775bca7179,segment=NetworkSegment(b9865f8d-450a-48dd-a5fd-75229dfd570a),segment_id=b9865f8d-450a-48dd-a5fd-75229dfd570a)] {{(pid=102162) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:40:29.139036 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-4ba7d234-ca3e-4fcb-983c-39769584c39c req-15f015ec-ad26-4180-a282-b926416fa92c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:29.172184 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ba7d234-ca3e-4fcb-983c-39769584c39c req-15f015ec-ad26-4180-a282-b926416fa92c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:40:29.172789 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-4ba7d234-ca3e-4fcb-983c-39769584c39c req-15f015ec-ad26-4180-a282-b926416fa92c service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:29.174125 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4ba7d234-ca3e-4fcb-983c-39769584c39c req-15f015ec-ad26-4180-a282-b926416fa92c service neutron] 10.222.0.26 "PUT /v2.0/ports/f93ae6b9-acd9-4c4a-a889-36775bca7179 HTTP/1.1" status: 200 len: 1093 time: 1.1685412 Nov 09 04:40:29.174608 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b79dd1f1-0baf-43bb-92a9-bf549b3f4fd7', 'tag': 'f93ae6b9-acd9-4c4a-a889-36775bca7179'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:40:29.177314 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-44516cbf-0121-4e49-b5cf-abd92b206cf8" -d '{"events": [{"name": "network-changed", "server_uuid": "b79dd1f1-0baf-43bb-92a9-bf549b3f4fd7", "tag": "f93ae6b9-acd9-4c4a-a889-36775bca7179"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:40:29.207096 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15f015ec-ad26-4180-a282-b926416fa92c service neutron] Pushing event updated for resources: {'Port': ['ID=f93ae6b9-acd9-4c4a-a889-36775bca7179,revision_number=3']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:40:29.217554 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:40:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-36177a3b-522d-40be-941f-fa06e2bdce2a x-openstack-request-id: req-36177a3b-522d-40be-941f-fa06e2bdce2a {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:40:29.217843 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b79dd1f1-0baf-43bb-92a9-bf549b3f4fd7", "tag": "f93ae6b9-acd9-4c4a-a889-36775bca7179", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:40:29.218095 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-36177a3b-522d-40be-941f-fa06e2bdce2a {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:40:29.218528 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b79dd1f1-0baf-43bb-92a9-bf549b3f4fd7', 'tag': 'f93ae6b9-acd9-4c4a-a889-36775bca7179', 'status': 'completed', 'code': 200} Nov 09 04:40:29.285337 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44516cbf-0121-4e49-b5cf-abd92b206cf8 req-21dcdf8e-544e-4779-9f63-e05eb62bd5c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:40:29.286924 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-44516cbf-0121-4e49-b5cf-abd92b206cf8 req-21dcdf8e-544e-4779-9f63-e05eb62bd5c5 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&device_id=b79dd1f1-0baf-43bb-92a9-bf549b3f4fd7 HTTP/1.1" status: 200 len: 1096 time: 0.0435050 Nov 09 04:40:29.393978 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44516cbf-0121-4e49-b5cf-abd92b206cf8 req-1d2fc65e-f4aa-4eae-a5c9-fff37934236f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:40:29.395404 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-44516cbf-0121-4e49-b5cf-abd92b206cf8 req-1d2fc65e-f4aa-4eae-a5c9-fff37934236f service neutron] 10.222.0.26 "GET /v2.0/networks?tenant_id=1d10b4824e524068827e58b55e269af3&shared=False HTTP/1.1" status: 200 len: 897 time: 0.1000607 Nov 09 04:40:29.494950 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44516cbf-0121-4e49-b5cf-abd92b206cf8 req-12e2af7b-72ac-4253-8c03-c01f44124164 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:40:29.496327 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-44516cbf-0121-4e49-b5cf-abd92b206cf8 req-12e2af7b-72ac-4253-8c03-c01f44124164 service neutron] 10.222.0.26 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0916247 Nov 09 04:40:29.573752 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ba7d234-ca3e-4fcb-983c-39769584c39c req-bcafe74a-43a4-47c1-9e0e-0afd3fa24e65 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:40:29.575266 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4ba7d234-ca3e-4fcb-983c-39769584c39c req-bcafe74a-43a4-47c1-9e0e-0afd3fa24e65 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&device_id=b79dd1f1-0baf-43bb-92a9-bf549b3f4fd7 HTTP/1.1" status: 200 len: 1096 time: 0.0406744 Nov 09 04:40:29.619492 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4ba7d234-ca3e-4fcb-983c-39769584c39c req-9112dfa2-1b35-49ba-a3ad-235984bdd9c1 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=f93ae6b9-acd9-4c4a-a889-36775bca7179 HTTP/1.1" status: 200 len: 217 time: 0.0345352 Nov 09 04:40:29.693407 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ba7d234-ca3e-4fcb-983c-39769584c39c req-7302a288-49e9-4947-9852-1b40c7b451b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:40:29.694819 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4ba7d234-ca3e-4fcb-983c-39769584c39c req-7302a288-49e9-4947-9852-1b40c7b451b1 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=b698701a-6942-4c78-8d18-8f81ad97a357 HTTP/1.1" status: 200 len: 835 time: 0.0689979 Nov 09 04:40:29.755936 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eaf41054-4f75-4158-a7ad-3b86a60ec5c0 req-b52900f9-8242-486e-a66a-8fb7795c83b9 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:40:29.757372 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-eaf41054-4f75-4158-a7ad-3b86a60ec5c0 req-b52900f9-8242-486e-a66a-8fb7795c83b9 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=b79dd1f1-0baf-43bb-92a9-bf549b3f4fd7 HTTP/1.1" status: 200 len: 943 time: 0.0937693 Nov 09 04:40:29.763327 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ba7d234-ca3e-4fcb-983c-39769584c39c req-78fa397d-f35b-4d59-a6af-3c52b3cb4462 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:40:29.768116 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4ba7d234-ca3e-4fcb-983c-39769584c39c req-78fa397d-f35b-4d59-a6af-3c52b3cb4462 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=5c1cc491-3177-49e1-a58d-e9fa4f64046d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0568995 Nov 09 04:40:29.859113 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-eaf41054-4f75-4158-a7ad-3b86a60ec5c0 req-18357e25-7a77-46b9-a2c8-b56cd4254969 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=e5209e89-9c20-4bd3-bbfa-b1e7f3fcefdc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0935230 Nov 09 04:40:29.887340 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4ba7d234-ca3e-4fcb-983c-39769584c39c req-4aee440a-da92-4e1a-a692-beb31e91598d service neutron] 10.222.0.26 "GET /v2.0/networks/5c1cc491-3177-49e1-a58d-e9fa4f64046d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1092722 Nov 09 04:40:29.976878 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4ba7d234-ca3e-4fcb-983c-39769584c39c req-f581d6de-aa29-4e63-8371-ee0966e7b1c8 service neutron] 10.222.0.26 "GET /v2.0/networks/5c1cc491-3177-49e1-a58d-e9fa4f64046d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0815842 Nov 09 04:40:30.971098 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0070ca90-f03d-4142-809e-b31b3eea6fab req-504749d0-7eb3-4078-8e62-aa78f483ca19 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:40:30.972697 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-0070ca90-f03d-4142-809e-b31b3eea6fab req-504749d0-7eb3-4078-8e62-aa78f483ca19 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=b79dd1f1-0baf-43bb-92a9-bf549b3f4fd7 HTTP/1.1" status: 200 len: 943 time: 0.0471792 Nov 09 04:40:31.034604 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-0070ca90-f03d-4142-809e-b31b3eea6fab req-a8d1a3b4-1478-4708-b14c-55ddfc879585 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=e5209e89-9c20-4bd3-bbfa-b1e7f3fcefdc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0554266 Nov 09 04:40:31.992727 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device f93ae6b9-acd9-4c4a-a889-36775bca7179 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=102163) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 09 04:40:32.088847 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port f93ae6b9-acd9-4c4a-a889-36775bca7179, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=f93ae6b9-acd9-4c4a-a889-36775bca7179,segment=NetworkSegment(b9865f8d-450a-48dd-a5fd-75229dfd570a),segment_id=b9865f8d-450a-48dd-a5fd-75229dfd570a)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:40:32.101104 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Returning: {'device': 'f93ae6b9-acd9-4c4a-a889-36775bca7179', 'network_id': '5c1cc491-3177-49e1-a58d-e9fa4f64046d', 'port_id': 'f93ae6b9-acd9-4c4a-a889-36775bca7179', 'mac_address': 'fa:16:3e:f8:7d:c1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 343, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b698701a-6942-4c78-8d18-8f81ad97a357', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102163) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 09 04:40:32.137218 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:32.150210 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f93ae6b9-acd9-4c4a-a889-36775bca7179 {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:40:32.152850 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8aa42f6b-f560-4afa-8f55-d35ec03707a0 req-79cd884b-a1c4-4b40-aa56-a394eb873179 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:40:32.154546 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8aa42f6b-f560-4afa-8f55-d35ec03707a0 req-79cd884b-a1c4-4b40-aa56-a394eb873179 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=b79dd1f1-0baf-43bb-92a9-bf549b3f4fd7 HTTP/1.1" status: 200 len: 943 time: 0.0532639 Nov 09 04:40:32.170489 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port f93ae6b9-acd9-4c4a-a889-36775bca7179, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=f93ae6b9-acd9-4c4a-a889-36775bca7179,segment=NetworkSegment(b9865f8d-450a-48dd-a5fd-75229dfd570a),segment_id=b9865f8d-450a-48dd-a5fd-75229dfd570a)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:40:32.203415 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8aa42f6b-f560-4afa-8f55-d35ec03707a0 req-d05a88d0-f4f2-4bd3-af6a-0776d422fe03 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=e5209e89-9c20-4bd3-bbfa-b1e7f3fcefdc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427771 Nov 09 04:40:32.255424 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:32.304693 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=f93ae6b9-acd9-4c4a-a889-36775bca7179,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:40:32.474634 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['f93ae6b9-acd9-4c4a-a889-36775bca7179'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 04:40:33.317493 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecb40958-c23e-4bd7-81d7-8caf8bf548d7 req-70c87f23-e21d-409c-8890-886248c5bff0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:40:33.318965 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ecb40958-c23e-4bd7-81d7-8caf8bf548d7 req-70c87f23-e21d-409c-8890-886248c5bff0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=b79dd1f1-0baf-43bb-92a9-bf549b3f4fd7 HTTP/1.1" status: 200 len: 944 time: 0.0478728 Nov 09 04:40:33.368036 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ecb40958-c23e-4bd7-81d7-8caf8bf548d7 req-af039fd0-5cd4-4840-99fa-4e0633fe203f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=e5209e89-9c20-4bd3-bbfa-b1e7f3fcefdc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431654 Nov 09 04:40:34.013447 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device f93ae6b9-acd9-4c4a-a889-36775bca7179 up at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:40:34.172592 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning for port f93ae6b9-acd9-4c4a-a889-36775bca7179 completed by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 09 04:40:34.176278 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning complete for port f93ae6b9-acd9-4c4a-a889-36775bca7179 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:40:34.176711 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:34.249524 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:34.271622 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b79dd1f1-0baf-43bb-92a9-bf549b3f4fd7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f93ae6b9-acd9-4c4a-a889-36775bca7179'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:40:34.273826 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9e4143d5-9139-4908-94db-1a6464e7e9e4" -d '{"events": [{"server_uuid": "b79dd1f1-0baf-43bb-92a9-bf549b3f4fd7", "name": "network-vif-plugged", "status": "completed", "tag": "f93ae6b9-acd9-4c4a-a889-36775bca7179"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:40:34.288809 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port f93ae6b9-acd9-4c4a-a889-36775bca7179, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=f93ae6b9-acd9-4c4a-a889-36775bca7179,segment=NetworkSegment(b9865f8d-450a-48dd-a5fd-75229dfd570a),segment_id=b9865f8d-450a-48dd-a5fd-75229dfd570a)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:40:34.310522 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:40:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-71d7f514-30e2-4587-9ae0-fd592b567784 x-openstack-request-id: req-71d7f514-30e2-4587-9ae0-fd592b567784 {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:40:34.310810 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b79dd1f1-0baf-43bb-92a9-bf549b3f4fd7", "name": "network-vif-plugged", "status": "completed", "tag": "f93ae6b9-acd9-4c4a-a889-36775bca7179", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:40:34.311061 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-71d7f514-30e2-4587-9ae0-fd592b567784 {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:40:34.311452 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b79dd1f1-0baf-43bb-92a9-bf549b3f4fd7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f93ae6b9-acd9-4c4a-a889-36775bca7179', 'code': 200} Nov 09 04:40:34.367192 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:34.415656 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=f93ae6b9-acd9-4c4a-a889-36775bca7179,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:40:34.480891 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c47ad74-f7eb-48b8-9de5-ee7c9192b30d req-aa2720d4-5eff-4259-b372-c6ba5fc07e7c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:40:34.482501 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-8c47ad74-f7eb-48b8-9de5-ee7c9192b30d req-aa2720d4-5eff-4259-b372-c6ba5fc07e7c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=b79dd1f1-0baf-43bb-92a9-bf549b3f4fd7 HTTP/1.1" status: 200 len: 945 time: 0.0474570 Nov 09 04:40:34.530216 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-8c47ad74-f7eb-48b8-9de5-ee7c9192b30d req-728ed992-24f3-4777-b31b-0dccf383f91b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=e5209e89-9c20-4bd3-bbfa-b1e7f3fcefdc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418084 Nov 09 04:40:34.602260 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e626668a-1daa-449a-8c55-ede279a52b2b req-2368e04d-c354-418f-8fdb-a54166f10997 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:40:34.603754 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e626668a-1daa-449a-8c55-ede279a52b2b req-2368e04d-c354-418f-8fdb-a54166f10997 service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=b79dd1f1-0baf-43bb-92a9-bf549b3f4fd7 HTTP/1.1" status: 200 len: 1098 time: 0.0395091 Nov 09 04:40:34.649251 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e626668a-1daa-449a-8c55-ede279a52b2b req-5f17abb5-36c9-409c-a3c2-a1daf58a677c service neutron] 10.222.0.26 "GET /v2.0/security-groups?id=e5209e89-9c20-4bd3-bbfa-b1e7f3fcefdc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0386908 Nov 09 04:40:35.647821 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c8f29d1-1e4b-4071-b840-980b25fd650b req-e534fbea-7a7a-48fc-aa24-60e06637b333 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:40:35.649197 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3c8f29d1-1e4b-4071-b840-980b25fd650b req-e534fbea-7a7a-48fc-aa24-60e06637b333 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=b79dd1f1-0baf-43bb-92a9-bf549b3f4fd7 HTTP/1.1" status: 200 len: 945 time: 0.0487139 Nov 09 04:40:35.701751 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3c8f29d1-1e4b-4071-b840-980b25fd650b req-7d9cfe41-9fe5-4597-a356-612f3b5e1d52 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=e5209e89-9c20-4bd3-bbfa-b1e7f3fcefdc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0463729 Nov 09 04:40:36.824719 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a15de354-1149-47cf-b9cf-44008710da73 req-302b8b19-eb92-4d02-806e-70782c0b378e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:40:36.826164 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-a15de354-1149-47cf-b9cf-44008710da73 req-302b8b19-eb92-4d02-806e-70782c0b378e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=b79dd1f1-0baf-43bb-92a9-bf549b3f4fd7 HTTP/1.1" status: 200 len: 945 time: 0.0573328 Nov 09 04:40:36.880255 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-a15de354-1149-47cf-b9cf-44008710da73 req-eda7134b-763c-4ff7-8f09-0c060a901a37 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=e5209e89-9c20-4bd3-bbfa-b1e7f3fcefdc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0481319 Nov 09 04:40:36.992999 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a93dcd7-ca73-4d5a-b0da-8c3a70e6c3b4 req-85ad5e77-932a-44bc-9377-f949ace7d16b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:40:36.994421 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2a93dcd7-ca73-4d5a-b0da-8c3a70e6c3b4 req-85ad5e77-932a-44bc-9377-f949ace7d16b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=b79dd1f1-0baf-43bb-92a9-bf549b3f4fd7 HTTP/1.1" status: 200 len: 945 time: 0.0488458 Nov 09 04:40:37.042611 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2a93dcd7-ca73-4d5a-b0da-8c3a70e6c3b4 req-d407d593-044e-41d6-a281-4f2fdad1f7b3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=e5209e89-9c20-4bd3-bbfa-b1e7f3fcefdc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422437 Nov 09 04:40:37.063934 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 60644) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:40:37.102506 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a42900cb-4aea-4a57-aca8-2642702c0d0e tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:40:37.103980 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a42900cb-4aea-4a57-aca8-2642702c0d0e tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/ports?device_id=b79dd1f1-0baf-43bb-92a9-bf549b3f4fd7 HTTP/1.1" status: 200 len: 1093 time: 0.0390797 Nov 09 04:40:37.106645 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 60646) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:40:37.110755 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-01686318-dbc6-4ce4-90be-5dcc2caaaed2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'floatingip': {'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'port_id': 'f93ae6b9-acd9-4c4a-a889-36775bca7179', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ip_address': '172.20.0.5'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:40:37.192572 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-01686318-dbc6-4ce4-90be-5dcc2caaaed2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for floatingip, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:37.294145 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-01686318-dbc6-4ce4-90be-5dcc2caaaed2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:37.396175 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-01686318-dbc6-4ce4-90be-5dcc2caaaed2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Allocated IP 172.26.0.169 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/786bcbea-9339-4f20-a04d-a33c0939e4c9) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:40:37.470954 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:40:37.501694 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-01686318-dbc6-4ce4-90be-5dcc2caaaed2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:37.619291 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-01686318-dbc6-4ce4-90be-5dcc2caaaed2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:37.657070 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-01686318-dbc6-4ce4-90be-5dcc2caaaed2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:40:37.661733 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-01686318-dbc6-4ce4-90be-5dcc2caaaed2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:40:37.665217 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-01686318-dbc6-4ce4-90be-5dcc2caaaed2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:40:37.690484 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01686318-dbc6-4ce4-90be-5dcc2caaaed2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Port': ['ID=786bcbea-9339-4f20-a04d-a33c0939e4c9,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:40:38.021221 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-01686318-dbc6-4ce4-90be-5dcc2caaaed2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:38.167371 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-01686318-dbc6-4ce4-90be-5dcc2caaaed2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:38.310761 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-01686318-dbc6-4ce4-90be-5dcc2caaaed2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:38.389206 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-01686318-dbc6-4ce4-90be-5dcc2caaaed2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:38.456706 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01686318-dbc6-4ce4-90be-5dcc2caaaed2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Port': ['ID=786bcbea-9339-4f20-a04d-a33c0939e4c9,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:40:38.471019 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-01686318-dbc6-4ce4-90be-5dcc2caaaed2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:38.568735 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.l3_db [None req-01686318-dbc6-4ce4-90be-5dcc2caaaed2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Floating IP acc6b947-f861-4437-ab99-b1ce234faec4 associated. External IP: 172.26.0.169, port: f93ae6b9-acd9-4c4a-a889-36775bca7179. Nov 09 04:40:38.772063 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-01686318-dbc6-4ce4-90be-5dcc2caaaed2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Router 64146dbe-0485-4818-add5-b700f57a9d0d has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:40:38.889032 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-01686318-dbc6-4ce4-90be-5dcc2caaaed2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:40:38.898829 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ab9e6474-808e-40fa-ab12-eb0d933e8db2 None None] Sync routers for ids ['64146dbe-0485-4818-add5-b700f57a9d0d'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:40:38.908863 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ab9e6474-808e-40fa-ab12-eb0d933e8db2 None None] Routers {'64146dbe-0485-4818-add5-b700f57a9d0d'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:40:38.909466 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-ab9e6474-808e-40fa-ab12-eb0d933e8db2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:40:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['64146dbe-0485-4818-add5-b700f57a9d0d'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:40:38.999953 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-01686318-dbc6-4ce4-90be-5dcc2caaaed2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:39.013676 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-ab9e6474-808e-40fa-ab12-eb0d933e8db2 None None] Set router 64146dbe-0485-4818-add5-b700f57a9d0d gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:40:39.027347 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-01686318-dbc6-4ce4-90be-5dcc2caaaed2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.9196129 Nov 09 04:40:39.028018 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b79dd1f1-0baf-43bb-92a9-bf549b3f4fd7', 'tag': 'f93ae6b9-acd9-4c4a-a889-36775bca7179'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:40:39.029949 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60650) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:40:39.030751 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-544aa594-54d4-45fe-b12a-6891e0806573" -d '{"events": [{"name": "network-changed", "server_uuid": "b79dd1f1-0baf-43bb-92a9-bf549b3f4fd7", "tag": "f93ae6b9-acd9-4c4a-a889-36775bca7179"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:40:39.071932 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:40:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-971389a8-d8e3-4093-be95-7d811089973e x-openstack-request-id: req-971389a8-d8e3-4093-be95-7d811089973e {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:40:39.072227 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b79dd1f1-0baf-43bb-92a9-bf549b3f4fd7", "tag": "f93ae6b9-acd9-4c4a-a889-36775bca7179", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:40:39.073049 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-971389a8-d8e3-4093-be95-7d811089973e {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:40:39.073500 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b79dd1f1-0baf-43bb-92a9-bf549b3f4fd7', 'tag': 'f93ae6b9-acd9-4c4a-a889-36775bca7179', 'status': 'completed', 'code': 200} Nov 09 04:40:39.134319 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-544aa594-54d4-45fe-b12a-6891e0806573 req-0403554a-7241-475c-9545-eb606b779e88 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:40:39.136020 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-544aa594-54d4-45fe-b12a-6891e0806573 req-0403554a-7241-475c-9545-eb606b779e88 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&device_id=b79dd1f1-0baf-43bb-92a9-bf549b3f4fd7 HTTP/1.1" status: 200 len: 1098 time: 0.0418262 Nov 09 04:40:39.140038 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-4101f88e-f8b1-4882-ad1b-4eea71d86464 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/routers/64146dbe-0485-4818-add5-b700f57a9d0d HTTP/1.1" status: 200 len: 921 time: 0.1082315 Nov 09 04:40:39.146817 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60654) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:40:39.208654 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-6aab3b4b-869c-471b-9f84-effe19a4f875 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/floatingips/acc6b947-f861-4437-ab99-b1ce234faec4 HTTP/1.1" status: 200 len: 991 time: 0.0604391 Nov 09 04:40:39.233218 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-544aa594-54d4-45fe-b12a-6891e0806573 req-63d7d035-8ade-4eae-b055-43c9f61431dc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:40:39.234709 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-544aa594-54d4-45fe-b12a-6891e0806573 req-63d7d035-8ade-4eae-b055-43c9f61431dc service neutron] 10.222.0.26 "GET /v2.0/networks?id=5c1cc491-3177-49e1-a58d-e9fa4f64046d HTTP/1.1" status: 200 len: 897 time: 0.0918407 Nov 09 04:40:39.250744 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-ab9e6474-808e-40fa-ab12-eb0d933e8db2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '64146dbe-0485-4818-add5-b700f57a9d0d', 'name': 'tempest-TestNetworkBasicOps-router-888680478', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.73'}], 'enable_snat': True}, 'gw_port_id': '2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:40:15Z', 'updated_at': '2021-11-09T04:40:19Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:f7:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '64146dbe-0485-4818-add5-b700f57a9d0d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1436, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.73', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:40:15Z', 'updated_at': '2021-11-09T04:40:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': 'acc6b947-f861-4437-ab99-b1ce234faec4', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'floating_ip_address': '172.26.0.169', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '64146dbe-0485-4818-add5-b700f57a9d0d', 'port_id': 'f93ae6b9-acd9-4c4a-a889-36775bca7179', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 1451, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5c1cc491-3177-49e1-a58d-e9fa4f64046d', 'mac_address': 'fa:16:3e:f8:7d:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b79dd1f1-0baf-43bb-92a9-bf549b3f4fd7', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:40:37Z', 'updated_at': '2021-11-09T04:40:37Z', 'revision_number': 0, 'project_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3858fcbc-7462-424b-ba66-6f2f0c0cea85', 'name': '', 'network_id': '5c1cc491-3177-49e1-a58d-e9fa4f64046d', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:82:05:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '64146dbe-0485-4818-add5-b700f57a9d0d', 'device_owner': 'network:router_interface', 'standard_attr_id': 1439, 'fixed_ips': [{'subnet_id': 'b698701a-6942-4c78-8d18-8f81ad97a357', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:40:19Z', 'updated_at': '2021-11-09T04:40:22Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': 'b698701a-6942-4c78-8d18-8f81ad97a357', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:40:39.276120 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ab9e6474-808e-40fa-ab12-eb0d933e8db2 None None] Checking router: 64146dbe-0485-4818-add5-b700f57a9d0d for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:40:39.284443 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ab9e6474-808e-40fa-ab12-eb0d933e8db2 None None] Routers {'64146dbe-0485-4818-add5-b700f57a9d0d'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:40:39.284983 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-ab9e6474-808e-40fa-ab12-eb0d933e8db2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:40:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['64146dbe-0485-4818-add5-b700f57a9d0d'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:40:39.302609 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-544aa594-54d4-45fe-b12a-6891e0806573 req-1ca03c47-e71b-48f9-bf12-bf3f6f9db62f service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=f93ae6b9-acd9-4c4a-a889-36775bca7179 HTTP/1.1" status: 200 len: 999 time: 0.0585883 Nov 09 04:40:39.351785 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-544aa594-54d4-45fe-b12a-6891e0806573 req-f967c4f9-f7ea-4d58-ba90-b91129363ffb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:40:39.353292 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-544aa594-54d4-45fe-b12a-6891e0806573 req-f967c4f9-f7ea-4d58-ba90-b91129363ffb service neutron] 10.222.0.26 "GET /v2.0/subnets?id=b698701a-6942-4c78-8d18-8f81ad97a357 HTTP/1.1" status: 200 len: 835 time: 0.0432618 Nov 09 04:40:39.391557 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-ab9e6474-808e-40fa-ab12-eb0d933e8db2 None None] Set router 64146dbe-0485-4818-add5-b700f57a9d0d gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:40:39.401143 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-544aa594-54d4-45fe-b12a-6891e0806573 req-de815438-877e-496d-a1e3-09d322fcd82c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:40:39.402673 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-544aa594-54d4-45fe-b12a-6891e0806573 req-de815438-877e-496d-a1e3-09d322fcd82c service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=5c1cc491-3177-49e1-a58d-e9fa4f64046d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0426927 Nov 09 04:40:39.491854 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-544aa594-54d4-45fe-b12a-6891e0806573 req-5c800a0d-ec11-41f1-9dd2-5b658a4579f5 service neutron] 10.222.0.26 "GET /v2.0/networks/5c1cc491-3177-49e1-a58d-e9fa4f64046d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0821760 Nov 09 04:40:39.584263 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-544aa594-54d4-45fe-b12a-6891e0806573 req-39854bfd-f734-471a-9cd2-e890766a211c service neutron] 10.222.0.26 "GET /v2.0/networks/5c1cc491-3177-49e1-a58d-e9fa4f64046d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0854762 Nov 09 04:40:39.612382 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-ab9e6474-808e-40fa-ab12-eb0d933e8db2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '64146dbe-0485-4818-add5-b700f57a9d0d', 'name': 'tempest-TestNetworkBasicOps-router-888680478', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.73'}], 'enable_snat': True}, 'gw_port_id': '2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:40:15Z', 'updated_at': '2021-11-09T04:40:19Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:f7:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '64146dbe-0485-4818-add5-b700f57a9d0d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1436, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.73', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:40:15Z', 'updated_at': '2021-11-09T04:40:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': 'acc6b947-f861-4437-ab99-b1ce234faec4', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'floating_ip_address': '172.26.0.169', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '64146dbe-0485-4818-add5-b700f57a9d0d', 'port_id': 'f93ae6b9-acd9-4c4a-a889-36775bca7179', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 1451, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5c1cc491-3177-49e1-a58d-e9fa4f64046d', 'mac_address': 'fa:16:3e:f8:7d:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b79dd1f1-0baf-43bb-92a9-bf549b3f4fd7', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:40:37Z', 'updated_at': '2021-11-09T04:40:37Z', 'revision_number': 0, 'project_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3858fcbc-7462-424b-ba66-6f2f0c0cea85', 'name': '', 'network_id': '5c1cc491-3177-49e1-a58d-e9fa4f64046d', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:82:05:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '64146dbe-0485-4818-add5-b700f57a9d0d', 'device_owner': 'network:router_interface', 'standard_attr_id': 1439, 'fixed_ips': [{'subnet_id': 'b698701a-6942-4c78-8d18-8f81ad97a357', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:40:19Z', 'updated_at': '2021-11-09T04:40:22Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': 'b698701a-6942-4c78-8d18-8f81ad97a357', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:40:39.641353 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ab9e6474-808e-40fa-ab12-eb0d933e8db2 None None] The sync data for ids ['64146dbe-0485-4818-add5-b700f57a9d0d'] in dv-neutron-816802-2-hyperv is: [{'id': '64146dbe-0485-4818-add5-b700f57a9d0d', 'name': 'tempest-TestNetworkBasicOps-router-888680478', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.73'}], 'enable_snat': True}, 'gw_port_id': '2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:40:15Z', 'updated_at': '2021-11-09T04:40:19Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:f7:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '64146dbe-0485-4818-add5-b700f57a9d0d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1436, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.73', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:40:15Z', 'updated_at': '2021-11-09T04:40:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': 'acc6b947-f861-4437-ab99-b1ce234faec4', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'floating_ip_address': '172.26.0.169', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '64146dbe-0485-4818-add5-b700f57a9d0d', 'port_id': 'f93ae6b9-acd9-4c4a-a889-36775bca7179', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 1451, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5c1cc491-3177-49e1-a58d-e9fa4f64046d', 'mac_address': 'fa:16:3e:f8:7d:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b79dd1f1-0baf-43bb-92a9-bf549b3f4fd7', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:40:37Z', 'updated_at': '2021-11-09T04:40:37Z', 'revision_number': 0, 'project_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3858fcbc-7462-424b-ba66-6f2f0c0cea85', 'name': '', 'network_id': '5c1cc491-3177-49e1-a58d-e9fa4f64046d', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:82:05:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '64146dbe-0485-4818-add5-b700f57a9d0d', 'device_owner': 'network:router_interface', 'standard_attr_id': 1439, 'fixed_ips': [{'subnet_id': 'b698701a-6942-4c78-8d18-8f81ad97a357', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:40:19Z', 'updated_at': '2021-11-09T04:40:22Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': 'b698701a-6942-4c78-8d18-8f81ad97a357', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:40:39.829091 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6e5f9fb9-f4d1-4090-9c8b-0019596f5b9e None None] New status for floating IP acc6b947-f861-4437-ab99-b1ce234faec4: ACTIVE {{(pid=102164) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 04:40:40.212149 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 60656) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:40:40.270240 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-5be5b5ed-5923-48b2-a57c-529419ee90b7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/floatingips/acc6b947-f861-4437-ab99-b1ce234faec4 HTTP/1.1" status: 200 len: 993 time: 0.0570550 Nov 09 04:40:41.334527 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d0c3934a-d7de-422e-96f3-5cd6d7db7e8f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:42.211969 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:43.688996 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-218c0f54-9bbd-49a2-88d1-22f1a900b695 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:45.120258 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:46.494924 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:46.937769 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:40:54.938641 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5ff9ea58-d1aa-47eb-ac7b-d33bb95ad2ea req-ef67a5ea-3891-4dc2-947f-b3a0ffcf01c0 service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=04f80039-ab30-438a-adbf-bd30827f9a50&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0380521 Nov 09 04:40:55.021795 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ff9ea58-d1aa-47eb-ac7b-d33bb95ad2ea req-bc3a578f-4391-4ffe-9cbf-49dfcb2daf95 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:40:55.023295 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5ff9ea58-d1aa-47eb-ac7b-d33bb95ad2ea req-bc3a578f-4391-4ffe-9cbf-49dfcb2daf95 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=f636e5f4c9f64f69ba3b2ab8816b6096&device_id=04f80039-ab30-438a-adbf-bd30827f9a50 HTTP/1.1" status: 200 len: 1099 time: 0.0419846 Nov 09 04:40:55.122214 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ff9ea58-d1aa-47eb-ac7b-d33bb95ad2ea req-3867680a-199d-4409-98d5-14ad2167c89b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:40:55.123671 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5ff9ea58-d1aa-47eb-ac7b-d33bb95ad2ea req-3867680a-199d-4409-98d5-14ad2167c89b service neutron] 10.222.0.26 "GET /v2.0/networks?id=999b1b20-f8fc-4caf-84cc-3feda426a0bf HTTP/1.1" status: 200 len: 913 time: 0.0824461 Nov 09 04:40:55.191662 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5ff9ea58-d1aa-47eb-ac7b-d33bb95ad2ea req-c483e890-732a-4d83-9eb8-99a913ed5210 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=65ca937a-8471-4c50-bca1-78fbcfc42fb6 HTTP/1.1" status: 200 len: 1002 time: 0.0598795 Nov 09 04:40:55.238967 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ff9ea58-d1aa-47eb-ac7b-d33bb95ad2ea req-1b8bb3bb-85e0-43ca-8560-0010223680c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:40:55.240323 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5ff9ea58-d1aa-47eb-ac7b-d33bb95ad2ea req-1b8bb3bb-85e0-43ca-8560-0010223680c5 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=f6a08667-654b-4e0c-9f85-c6e6712cc239 HTTP/1.1" status: 200 len: 851 time: 0.0422451 Nov 09 04:40:55.283220 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ff9ea58-d1aa-47eb-ac7b-d33bb95ad2ea req-2db0d88d-e2a3-4f11-bb21-9e35a10abf65 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:40:55.290125 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5ff9ea58-d1aa-47eb-ac7b-d33bb95ad2ea req-2db0d88d-e2a3-4f11-bb21-9e35a10abf65 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=999b1b20-f8fc-4caf-84cc-3feda426a0bf&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0369356 Nov 09 04:40:55.376000 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5ff9ea58-d1aa-47eb-ac7b-d33bb95ad2ea req-8749a2e0-214b-4ea7-af9c-c34983653dad service neutron] 10.222.0.26 "GET /v2.0/networks/999b1b20-f8fc-4caf-84cc-3feda426a0bf?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0821609 Nov 09 04:40:55.463174 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5ff9ea58-d1aa-47eb-ac7b-d33bb95ad2ea req-240c4b89-b864-428e-a09d-d872709e1fc5 service neutron] 10.222.0.26 "GET /v2.0/networks/999b1b20-f8fc-4caf-84cc-3feda426a0bf?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0789652 Nov 09 04:41:11.347869 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-cf472185-933e-41ee-8399-4ee3e8708409 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:11.462863 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60668) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:41:11.571903 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-e8349405-1312-434f-865a-96dcdb04173a tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/routers/64146dbe-0485-4818-add5-b700f57a9d0d/l3-agents HTTP/1.1" status: 200 len: 881 time: 0.1076145 Nov 09 04:41:11.574677 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60670) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:41:11.736424 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a387e13b-5a82-41e2-8c21-05f4f46747cf tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Notify agent at dv-neutron-816802-2-hyperv the message router_removed_from_agent {{(pid=102161) _notification_host /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:47}} Nov 09 04:41:11.739580 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a387e13b-5a82-41e2-8c21-05f4f46747cf tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "DELETE /v2.0/agents/ea291deb-d47b-4467-a9a1-d3a1ddaaa20b/l3-routers/64146dbe-0485-4818-add5-b700f57a9d0d HTTP/1.1" status: 204 len: 168 time: 0.1639731 Nov 09 04:41:11.742123 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60672) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:41:12.088137 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-7dfae29c-5486-4937-90c8-daa3375dface tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/routers/64146dbe-0485-4818-add5-b700f57a9d0d/l3-agents HTTP/1.1" status: 200 len: 207 time: 0.3449085 Nov 09 04:41:12.091462 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60674) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:41:12.173522 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-3155ea3c-828f-4e90-85b0-65464b7a30ad tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/floatingips/acc6b947-f861-4437-ab99-b1ce234faec4 HTTP/1.1" status: 200 len: 993 time: 0.0669398 Nov 09 04:41:12.194715 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:12.542835 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2193722d-5d5e-4007-bed0-4bc28f2b2b63 None None] New status for floating IP acc6b947-f861-4437-ab99-b1ce234faec4: DOWN {{(pid=102163) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 04:41:13.163491 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60676) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:41:13.222382 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-4c1e29bd-2fea-4bf2-8c23-f8c3349002f0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/floatingips/acc6b947-f861-4437-ab99-b1ce234faec4 HTTP/1.1" status: 200 len: 991 time: 0.0577714 Nov 09 04:41:13.392902 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 3858fcbc-7462-424b-ba66-6f2f0c0cea85 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:41:13.467767 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:13.497626 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 3858fcbc-7462-424b-ba66-6f2f0c0cea85, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=3858fcbc-7462-424b-ba66-6f2f0c0cea85,segment=NetworkSegment(b9865f8d-450a-48dd-a5fd-75229dfd570a),segment_id=b9865f8d-450a-48dd-a5fd-75229dfd570a)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:41:13.559533 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:13.560193 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:41:13.641665 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=3858fcbc-7462-424b-ba66-6f2f0c0cea85,revision_number=6']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:41:13.650724 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:41:13.651204 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:41:13.651470 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:41:13.651807 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:41:13.652132 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:41:13.652461 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:41:13.652805 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:41:13.653127 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:41:13.653447 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:41:13.653760 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:41:13.654073 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:41:13.654407 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:41:13.694127 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:13.714189 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:41:13.732891 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e7ff40d0-90d4-4495-a45e-5a15a1a0eaf9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:13.784687 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:13.830408 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:41:14.328907 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60680) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:41:14.469766 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:41:14.521929 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a4e40573-b293-45be-8330-1b2345a2abcf tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Router 64146dbe-0485-4818-add5-b700f57a9d0d is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102161) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:41:14.522275 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a4e40573-b293-45be-8330-1b2345a2abcf tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Notify agent at dv-neutron-816802-2-hyperv the message router_added_to_agent {{(pid=102161) _notification_host /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:47}} Nov 09 04:41:14.548315 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a4e40573-b293-45be-8330-1b2345a2abcf tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "POST /v2.0/agents/ea291deb-d47b-4467-a9a1-d3a1ddaaa20b/l3-routers HTTP/1.1" status: 201 len: 201 time: 0.2183423 Nov 09 04:41:14.551062 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60684) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:41:14.570258 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e5ab732a-add3-4fe2-a98f-7c9be1f50ada None None] Sync routers for ids ['64146dbe-0485-4818-add5-b700f57a9d0d'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:41:14.579526 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e5ab732a-add3-4fe2-a98f-7c9be1f50ada None None] Routers {'64146dbe-0485-4818-add5-b700f57a9d0d'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:41:14.580134 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-e5ab732a-add3-4fe2-a98f-7c9be1f50ada None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:41:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['64146dbe-0485-4818-add5-b700f57a9d0d'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:41:14.660736 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-b5272bc3-4a85-43bf-a8c1-e411b104e09e tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/routers/64146dbe-0485-4818-add5-b700f57a9d0d/l3-agents HTTP/1.1" status: 200 len: 881 time: 0.1080370 Nov 09 04:41:14.663564 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60688) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:41:14.685950 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-e5ab732a-add3-4fe2-a98f-7c9be1f50ada None None] Set router 64146dbe-0485-4818-add5-b700f57a9d0d gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:41:14.726905 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-fa88e9a5-8ef6-4149-b6bd-40dfbfa5896d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/floatingips/acc6b947-f861-4437-ab99-b1ce234faec4 HTTP/1.1" status: 200 len: 991 time: 0.0611148 Nov 09 04:41:14.973456 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-e5ab732a-add3-4fe2-a98f-7c9be1f50ada None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '64146dbe-0485-4818-add5-b700f57a9d0d', 'name': 'tempest-TestNetworkBasicOps-router-888680478', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.73'}], 'enable_snat': True}, 'gw_port_id': '2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:40:15Z', 'updated_at': '2021-11-09T04:40:19Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:f7:88', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '64146dbe-0485-4818-add5-b700f57a9d0d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1436, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.73', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:40:15Z', 'updated_at': '2021-11-09T04:41:13Z', 'revision_number': 5, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': 'acc6b947-f861-4437-ab99-b1ce234faec4', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'floating_ip_address': '172.26.0.169', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '64146dbe-0485-4818-add5-b700f57a9d0d', 'port_id': 'f93ae6b9-acd9-4c4a-a889-36775bca7179', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 1451, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5c1cc491-3177-49e1-a58d-e9fa4f64046d', 'mac_address': 'fa:16:3e:f8:7d:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b79dd1f1-0baf-43bb-92a9-bf549b3f4fd7', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:40:37Z', 'updated_at': '2021-11-09T04:41:12Z', 'revision_number': 2, 'project_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3858fcbc-7462-424b-ba66-6f2f0c0cea85', 'name': '', 'network_id': '5c1cc491-3177-49e1-a58d-e9fa4f64046d', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:82:05:a8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '64146dbe-0485-4818-add5-b700f57a9d0d', 'device_owner': 'network:router_interface', 'standard_attr_id': 1439, 'fixed_ips': [{'subnet_id': 'b698701a-6942-4c78-8d18-8f81ad97a357', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:40:19Z', 'updated_at': '2021-11-09T04:41:13Z', 'revision_number': 6, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': 'b698701a-6942-4c78-8d18-8f81ad97a357', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:41:14.999079 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e5ab732a-add3-4fe2-a98f-7c9be1f50ada None None] Checking router: 64146dbe-0485-4818-add5-b700f57a9d0d for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:41:15.006958 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e5ab732a-add3-4fe2-a98f-7c9be1f50ada None None] Routers {'64146dbe-0485-4818-add5-b700f57a9d0d'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:41:15.007536 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-e5ab732a-add3-4fe2-a98f-7c9be1f50ada None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:41:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['64146dbe-0485-4818-add5-b700f57a9d0d'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:41:15.109502 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-e5ab732a-add3-4fe2-a98f-7c9be1f50ada None None] Set router 64146dbe-0485-4818-add5-b700f57a9d0d gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:41:15.113617 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:15.403312 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-e5ab732a-add3-4fe2-a98f-7c9be1f50ada None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '64146dbe-0485-4818-add5-b700f57a9d0d', 'name': 'tempest-TestNetworkBasicOps-router-888680478', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.73'}], 'enable_snat': True}, 'gw_port_id': '2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:40:15Z', 'updated_at': '2021-11-09T04:40:19Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:f7:88', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '64146dbe-0485-4818-add5-b700f57a9d0d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1436, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.73', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:40:15Z', 'updated_at': '2021-11-09T04:41:13Z', 'revision_number': 5, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': 'acc6b947-f861-4437-ab99-b1ce234faec4', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'floating_ip_address': '172.26.0.169', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '64146dbe-0485-4818-add5-b700f57a9d0d', 'port_id': 'f93ae6b9-acd9-4c4a-a889-36775bca7179', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 1451, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5c1cc491-3177-49e1-a58d-e9fa4f64046d', 'mac_address': 'fa:16:3e:f8:7d:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b79dd1f1-0baf-43bb-92a9-bf549b3f4fd7', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:40:37Z', 'updated_at': '2021-11-09T04:41:12Z', 'revision_number': 2, 'project_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3858fcbc-7462-424b-ba66-6f2f0c0cea85', 'name': '', 'network_id': '5c1cc491-3177-49e1-a58d-e9fa4f64046d', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:82:05:a8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '64146dbe-0485-4818-add5-b700f57a9d0d', 'device_owner': 'network:router_interface', 'standard_attr_id': 1439, 'fixed_ips': [{'subnet_id': 'b698701a-6942-4c78-8d18-8f81ad97a357', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:40:19Z', 'updated_at': '2021-11-09T04:41:13Z', 'revision_number': 6, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': 'b698701a-6942-4c78-8d18-8f81ad97a357', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:41:15.428453 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e5ab732a-add3-4fe2-a98f-7c9be1f50ada None None] The sync data for ids ['64146dbe-0485-4818-add5-b700f57a9d0d'] in dv-neutron-816802-2-hyperv is: [{'id': '64146dbe-0485-4818-add5-b700f57a9d0d', 'name': 'tempest-TestNetworkBasicOps-router-888680478', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.73'}], 'enable_snat': True}, 'gw_port_id': '2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:40:15Z', 'updated_at': '2021-11-09T04:40:19Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:f7:88', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '64146dbe-0485-4818-add5-b700f57a9d0d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1436, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.73', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:40:15Z', 'updated_at': '2021-11-09T04:41:13Z', 'revision_number': 5, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': 'acc6b947-f861-4437-ab99-b1ce234faec4', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'floating_ip_address': '172.26.0.169', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '64146dbe-0485-4818-add5-b700f57a9d0d', 'port_id': 'f93ae6b9-acd9-4c4a-a889-36775bca7179', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 1451, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5c1cc491-3177-49e1-a58d-e9fa4f64046d', 'mac_address': 'fa:16:3e:f8:7d:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b79dd1f1-0baf-43bb-92a9-bf549b3f4fd7', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:40:37Z', 'updated_at': '2021-11-09T04:41:12Z', 'revision_number': 2, 'project_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3858fcbc-7462-424b-ba66-6f2f0c0cea85', 'name': '', 'network_id': '5c1cc491-3177-49e1-a58d-e9fa4f64046d', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:82:05:a8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '64146dbe-0485-4818-add5-b700f57a9d0d', 'device_owner': 'network:router_interface', 'standard_attr_id': 1439, 'fixed_ips': [{'subnet_id': 'b698701a-6942-4c78-8d18-8f81ad97a357', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:40:19Z', 'updated_at': '2021-11-09T04:41:13Z', 'revision_number': 6, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': 'b698701a-6942-4c78-8d18-8f81ad97a357', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:41:15.729819 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60690) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:41:15.869946 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-18f6bb00-1924-4221-a59c-f2229caa05f4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/floatingips/acc6b947-f861-4437-ab99-b1ce234faec4 HTTP/1.1" status: 200 len: 991 time: 0.1382041 Nov 09 04:41:16.441711 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:16.874397 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60692) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:41:16.939211 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-70541006-9309-4f0b-8a67-7d8235cd1a0a None None] New status for floating IP acc6b947-f861-4437-ab99-b1ce234faec4: ACTIVE {{(pid=102163) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 04:41:16.950408 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-be51e518-1915-4beb-8191-68b2e3f6e777 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/floatingips/acc6b947-f861-4437-ab99-b1ce234faec4 HTTP/1.1" status: 200 len: 991 time: 0.0738864 Nov 09 04:41:16.977684 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:17.437873 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 3858fcbc-7462-424b-ba66-6f2f0c0cea85 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:41:17.484313 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 3858fcbc-7462-424b-ba66-6f2f0c0cea85 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:41:17.484936 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:17.567111 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:17.604868 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 3858fcbc-7462-424b-ba66-6f2f0c0cea85, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=3858fcbc-7462-424b-ba66-6f2f0c0cea85,segment=NetworkSegment(b9865f8d-450a-48dd-a5fd-75229dfd570a),segment_id=b9865f8d-450a-48dd-a5fd-75229dfd570a)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:41:17.673910 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:17.674696 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:41:17.744440 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=3858fcbc-7462-424b-ba66-6f2f0c0cea85,revision_number=7']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:41:17.756287 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:41:17.756647 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:17.832694 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:17.851437 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:41:17.936414 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:17.953787 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60694) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:41:17.993788 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368,revision_number=6']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:41:18.016919 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a80ee4f4-ee4e-436c-8158-dce07a6b209e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/floatingips/acc6b947-f861-4437-ab99-b1ce234faec4 HTTP/1.1" status: 200 len: 993 time: 0.0619683 Nov 09 04:41:18.252943 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60700) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:41:18.405088 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-2b0c8b13-b833-44e2-a644-737d9141d0a3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Deleting port 786bcbea-9339-4f20-a04d-a33c0939e4c9 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:41:18.405344 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2b0c8b13-b833-44e2-a644-737d9141d0a3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:18.482145 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2b0c8b13-b833-44e2-a644-737d9141d0a3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:18.482491 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2b0c8b13-b833-44e2-a644-737d9141d0a3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:18.494152 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-2b0c8b13-b833-44e2-a644-737d9141d0a3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Calling delete_port for 786bcbea-9339-4f20-a04d-a33c0939e4c9 owned by network:floatingip {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:41:18.753514 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2b0c8b13-b833-44e2-a644-737d9141d0a3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:18.777929 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b0c8b13-b833-44e2-a644-737d9141d0a3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'Port': ['ID=786bcbea-9339-4f20-a04d-a33c0939e4c9,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:41:18.914464 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2b0c8b13-b833-44e2-a644-737d9141d0a3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for floatingip, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:18.914792 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.l3_db [None req-2b0c8b13-b833-44e2-a644-737d9141d0a3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Floating IP acc6b947-f861-4437-ab99-b1ce234faec4 disassociated (deleted). External IP: 172.26.0.169, port: f93ae6b9-acd9-4c4a-a889-36775bca7179. Nov 09 04:41:19.132439 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2b0c8b13-b833-44e2-a644-737d9141d0a3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Router 64146dbe-0485-4818-add5-b700f57a9d0d has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:41:19.242688 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2b0c8b13-b833-44e2-a644-737d9141d0a3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:41:19.247992 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2b0c8b13-b833-44e2-a644-737d9141d0a3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:19.253489 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-45d334cc-274d-4789-ae77-e610ba83191d None None] Sync routers for ids ['64146dbe-0485-4818-add5-b700f57a9d0d'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:41:19.264257 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-45d334cc-274d-4789-ae77-e610ba83191d None None] Routers {'64146dbe-0485-4818-add5-b700f57a9d0d'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:41:19.264942 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-45d334cc-274d-4789-ae77-e610ba83191d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:41:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['64146dbe-0485-4818-add5-b700f57a9d0d'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:41:19.280709 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-2b0c8b13-b833-44e2-a644-737d9141d0a3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "DELETE /v2.0/floatingips/acc6b947-f861-4437-ab99-b1ce234faec4 HTTP/1.1" status: 204 len: 168 time: 1.0266855 Nov 09 04:41:19.281308 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b79dd1f1-0baf-43bb-92a9-bf549b3f4fd7', 'tag': 'f93ae6b9-acd9-4c4a-a889-36775bca7179'}] {{(pid=102161) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:41:19.283777 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}99dfdda0def497b4372884ef2eb87f06b1e425c8eba5ceda5f64bbab037a07d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-18277c97-50a0-46be-84a2-57e4ea25be2f" -d '{"events": [{"name": "network-changed", "server_uuid": "b79dd1f1-0baf-43bb-92a9-bf549b3f4fd7", "tag": "f93ae6b9-acd9-4c4a-a889-36775bca7179"}]}' {{(pid=102161) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:41:19.320870 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:41:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6a8ea416-637b-4cd1-b267-fb3321123fc5 x-openstack-request-id: req-6a8ea416-637b-4cd1-b267-fb3321123fc5 {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:41:19.321372 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b79dd1f1-0baf-43bb-92a9-bf549b3f4fd7", "tag": "f93ae6b9-acd9-4c4a-a889-36775bca7179", "status": "completed", "code": 200}]} {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:41:19.321738 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-6a8ea416-637b-4cd1-b267-fb3321123fc5 {{(pid=102161) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:41:19.322373 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b79dd1f1-0baf-43bb-92a9-bf549b3f4fd7', 'tag': 'f93ae6b9-acd9-4c4a-a889-36775bca7179', 'status': 'completed', 'code': 200} Nov 09 04:41:19.405267 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18277c97-50a0-46be-84a2-57e4ea25be2f req-b5cb0373-3f9f-4488-a6ea-4f4c4e63ddcd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:19.406992 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-18277c97-50a0-46be-84a2-57e4ea25be2f req-b5cb0373-3f9f-4488-a6ea-4f4c4e63ddcd service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&device_id=b79dd1f1-0baf-43bb-92a9-bf549b3f4fd7 HTTP/1.1" status: 200 len: 1098 time: 0.0615358 Nov 09 04:41:19.412690 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-45d334cc-274d-4789-ae77-e610ba83191d None None] Set router 64146dbe-0485-4818-add5-b700f57a9d0d gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:41:19.451282 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 3858fcbc-7462-424b-ba66-6f2f0c0cea85 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:41:19.500743 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 3858fcbc-7462-424b-ba66-6f2f0c0cea85 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:41:19.501379 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:19.525969 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18277c97-50a0-46be-84a2-57e4ea25be2f req-d722d9ad-0320-4d58-aa9f-306e97c91399 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:19.527519 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-18277c97-50a0-46be-84a2-57e4ea25be2f req-d722d9ad-0320-4d58-aa9f-306e97c91399 service neutron] 10.222.0.26 "GET /v2.0/networks?id=5c1cc491-3177-49e1-a58d-e9fa4f64046d HTTP/1.1" status: 200 len: 897 time: 0.1108577 Nov 09 04:41:19.601725 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:41:19.603486 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-18277c97-50a0-46be-84a2-57e4ea25be2f req-20a0123c-7c0e-4f35-89e6-b982d0b72787 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=f93ae6b9-acd9-4c4a-a889-36775bca7179 HTTP/1.1" status: 200 len: 217 time: 0.0690646 Nov 09 04:41:19.641013 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-45d334cc-274d-4789-ae77-e610ba83191d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '64146dbe-0485-4818-add5-b700f57a9d0d', 'name': 'tempest-TestNetworkBasicOps-router-888680478', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.73'}], 'enable_snat': True}, 'gw_port_id': '2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:40:15Z', 'updated_at': '2021-11-09T04:40:19Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:f7:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '64146dbe-0485-4818-add5-b700f57a9d0d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1436, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.73', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:40:15Z', 'updated_at': '2021-11-09T04:41:17Z', 'revision_number': 6, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '3858fcbc-7462-424b-ba66-6f2f0c0cea85', 'name': '', 'network_id': '5c1cc491-3177-49e1-a58d-e9fa4f64046d', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:82:05:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '64146dbe-0485-4818-add5-b700f57a9d0d', 'device_owner': 'network:router_interface', 'standard_attr_id': 1439, 'fixed_ips': [{'subnet_id': 'b698701a-6942-4c78-8d18-8f81ad97a357', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:40:19Z', 'updated_at': '2021-11-09T04:41:17Z', 'revision_number': 7, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': 'b698701a-6942-4c78-8d18-8f81ad97a357', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:41:19.658294 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18277c97-50a0-46be-84a2-57e4ea25be2f req-b9dec411-7c7e-4a75-9d5c-786a44c8fff9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:19.659213 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:41:19.659713 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:19.660567 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-18277c97-50a0-46be-84a2-57e4ea25be2f req-b9dec411-7c7e-4a75-9d5c-786a44c8fff9 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=b698701a-6942-4c78-8d18-8f81ad97a357 HTTP/1.1" status: 200 len: 835 time: 0.0497816 Nov 09 04:41:19.672534 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-45d334cc-274d-4789-ae77-e610ba83191d None None] Checking router: 64146dbe-0485-4818-add5-b700f57a9d0d for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:41:19.682643 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-45d334cc-274d-4789-ae77-e610ba83191d None None] Routers {'64146dbe-0485-4818-add5-b700f57a9d0d'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:41:19.683509 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-45d334cc-274d-4789-ae77-e610ba83191d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:41:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['64146dbe-0485-4818-add5-b700f57a9d0d'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:41:19.719827 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18277c97-50a0-46be-84a2-57e4ea25be2f req-98cdff04-7baa-401d-be0d-6c2a8d10d42b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:19.721278 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-18277c97-50a0-46be-84a2-57e4ea25be2f req-98cdff04-7baa-401d-be0d-6c2a8d10d42b service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=5c1cc491-3177-49e1-a58d-e9fa4f64046d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0518694 Nov 09 04:41:19.822088 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-45d334cc-274d-4789-ae77-e610ba83191d None None] Set router 64146dbe-0485-4818-add5-b700f57a9d0d gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:41:20.041772 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-45d334cc-274d-4789-ae77-e610ba83191d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '64146dbe-0485-4818-add5-b700f57a9d0d', 'name': 'tempest-TestNetworkBasicOps-router-888680478', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.73'}], 'enable_snat': True}, 'gw_port_id': '2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:40:15Z', 'updated_at': '2021-11-09T04:40:19Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:f7:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '64146dbe-0485-4818-add5-b700f57a9d0d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1436, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.73', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:40:15Z', 'updated_at': '2021-11-09T04:41:17Z', 'revision_number': 6, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '3858fcbc-7462-424b-ba66-6f2f0c0cea85', 'name': '', 'network_id': '5c1cc491-3177-49e1-a58d-e9fa4f64046d', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:82:05:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '64146dbe-0485-4818-add5-b700f57a9d0d', 'device_owner': 'network:router_interface', 'standard_attr_id': 1439, 'fixed_ips': [{'subnet_id': 'b698701a-6942-4c78-8d18-8f81ad97a357', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:40:19Z', 'updated_at': '2021-11-09T04:41:17Z', 'revision_number': 7, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': 'b698701a-6942-4c78-8d18-8f81ad97a357', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:41:20.070393 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-45d334cc-274d-4789-ae77-e610ba83191d None None] The sync data for ids ['64146dbe-0485-4818-add5-b700f57a9d0d'] in dv-neutron-816802-2-hyperv is: [{'id': '64146dbe-0485-4818-add5-b700f57a9d0d', 'name': 'tempest-TestNetworkBasicOps-router-888680478', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.73'}], 'enable_snat': True}, 'gw_port_id': '2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:40:15Z', 'updated_at': '2021-11-09T04:40:19Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:f7:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '64146dbe-0485-4818-add5-b700f57a9d0d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1436, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.73', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:40:15Z', 'updated_at': '2021-11-09T04:41:17Z', 'revision_number': 6, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '3858fcbc-7462-424b-ba66-6f2f0c0cea85', 'name': '', 'network_id': '5c1cc491-3177-49e1-a58d-e9fa4f64046d', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:82:05:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '64146dbe-0485-4818-add5-b700f57a9d0d', 'device_owner': 'network:router_interface', 'standard_attr_id': 1439, 'fixed_ips': [{'subnet_id': 'b698701a-6942-4c78-8d18-8f81ad97a357', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:40:19Z', 'updated_at': '2021-11-09T04:41:17Z', 'revision_number': 7, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': 'b698701a-6942-4c78-8d18-8f81ad97a357', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:41:20.182000 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ea6cec5-141e-4621-aa2a-0ef2b89eea90 req-2be919af-5bfe-4bd7-b4a6-dc5f5e20c54f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:20.184209 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3ea6cec5-141e-4621-aa2a-0ef2b89eea90 req-2be919af-5bfe-4bd7-b4a6-dc5f5e20c54f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=b79dd1f1-0baf-43bb-92a9-bf549b3f4fd7 HTTP/1.1" status: 200 len: 945 time: 0.4435213 Nov 09 04:41:20.224694 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-18277c97-50a0-46be-84a2-57e4ea25be2f req-1cc88b27-ef85-4dfd-b150-0250b5f71296 service neutron] 10.222.0.26 "GET /v2.0/networks/5c1cc491-3177-49e1-a58d-e9fa4f64046d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4944093 Nov 09 04:41:20.306705 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3ea6cec5-141e-4621-aa2a-0ef2b89eea90 req-23bbaf29-6299-4558-815b-f7b99054e49b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=e5209e89-9c20-4bd3-bbfa-b1e7f3fcefdc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1111608 Nov 09 04:41:20.343856 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-18277c97-50a0-46be-84a2-57e4ea25be2f req-54300902-0a32-478c-a5e2-78463f0d6d06 service neutron] 10.222.0.26 "GET /v2.0/networks/5c1cc491-3177-49e1-a58d-e9fa4f64046d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1093996 Nov 09 04:41:20.773666 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-79d8a6a8-7ee9-4a47-941a-a8ea895137bf None None] New status for floating IP acc6b947-f861-4437-ab99-b1ce234faec4: DOWN {{(pid=102163) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 04:41:21.023022 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-306517fa-3f6a-4c54-93fc-e1a7f5fa2c64 req-5409e795-0771-434b-a0bb-ad87a9fe0777 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:21.025535 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-306517fa-3f6a-4c54-93fc-e1a7f5fa2c64 req-5409e795-0771-434b-a0bb-ad87a9fe0777 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "GET /v2.0/ports?device_id=b79dd1f1-0baf-43bb-92a9-bf549b3f4fd7 HTTP/1.1" status: 200 len: 945 time: 0.0493031 Nov 09 04:41:21.120304 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-306517fa-3f6a-4c54-93fc-e1a7f5fa2c64 req-5907eb9a-0484-4e11-a3b3-14f82d0e227b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Deleting port f93ae6b9-acd9-4c4a-a889-36775bca7179 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:41:21.120562 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-306517fa-3f6a-4c54-93fc-e1a7f5fa2c64 req-5907eb9a-0484-4e11-a3b3-14f82d0e227b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:21.211137 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-306517fa-3f6a-4c54-93fc-e1a7f5fa2c64 req-5907eb9a-0484-4e11-a3b3-14f82d0e227b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] For port f93ae6b9-acd9-4c4a-a889-36775bca7179, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=f93ae6b9-acd9-4c4a-a889-36775bca7179,segment=NetworkSegment(b9865f8d-450a-48dd-a5fd-75229dfd570a),segment_id=b9865f8d-450a-48dd-a5fd-75229dfd570a)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:41:21.211495 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-306517fa-3f6a-4c54-93fc-e1a7f5fa2c64 req-5907eb9a-0484-4e11-a3b3-14f82d0e227b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:21.224932 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-306517fa-3f6a-4c54-93fc-e1a7f5fa2c64 req-5907eb9a-0484-4e11-a3b3-14f82d0e227b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Calling delete_port for f93ae6b9-acd9-4c4a-a889-36775bca7179 owned by compute:nova {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:41:21.393505 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-306517fa-3f6a-4c54-93fc-e1a7f5fa2c64 req-5907eb9a-0484-4e11-a3b3-14f82d0e227b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:21.415816 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ea2558ba-b4e8-4373-989b-fb9daa22c72a req-9832eae6-4a40-45b2-b993-a3edf147b4ca tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=b79dd1f1-0baf-43bb-92a9-bf549b3f4fd7 HTTP/1.1" status: 200 len: 210 time: 0.0313485 Nov 09 04:41:21.430621 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5907eb9a-0484-4e11-a3b3-14f82d0e227b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'Port': ['ID=f93ae6b9-acd9-4c4a-a889-36775bca7179,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:41:21.463624 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-306517fa-3f6a-4c54-93fc-e1a7f5fa2c64 req-5907eb9a-0484-4e11-a3b3-14f82d0e227b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] No DVR routers for this DVR port f93ae6b9-acd9-4c4a-a889-36775bca7179 on host hv-neutron-8168 {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:41:21.466416 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-306517fa-3f6a-4c54-93fc-e1a7f5fa2c64 req-5907eb9a-0484-4e11-a3b3-14f82d0e227b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:21.470025 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-306517fa-3f6a-4c54-93fc-e1a7f5fa2c64 req-5907eb9a-0484-4e11-a3b3-14f82d0e227b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "DELETE /v2.0/ports/f93ae6b9-acd9-4c4a-a889-36775bca7179 HTTP/1.1" status: 204 len: 173 time: 0.4396777 Nov 09 04:41:21.470551 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b79dd1f1-0baf-43bb-92a9-bf549b3f4fd7', 'name': 'network-vif-deleted', 'tag': 'f93ae6b9-acd9-4c4a-a889-36775bca7179'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:41:21.472754 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6553e39d-865d-4f5d-80a1-a9d54aacae8b" -d '{"events": [{"server_uuid": "b79dd1f1-0baf-43bb-92a9-bf549b3f4fd7", "name": "network-vif-deleted", "tag": "f93ae6b9-acd9-4c4a-a889-36775bca7179"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:41:21.508541 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:41:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-93ef759e-0295-44a2-b28b-15a04cd82cbc x-openstack-request-id: req-93ef759e-0295-44a2-b28b-15a04cd82cbc {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:41:21.508830 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b79dd1f1-0baf-43bb-92a9-bf549b3f4fd7", "name": "network-vif-deleted", "tag": "f93ae6b9-acd9-4c4a-a889-36775bca7179", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:41:21.509103 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-93ef759e-0295-44a2-b28b-15a04cd82cbc {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:41:21.509505 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b79dd1f1-0baf-43bb-92a9-bf549b3f4fd7', 'name': 'network-vif-deleted', 'tag': 'f93ae6b9-acd9-4c4a-a889-36775bca7179', 'status': 'completed', 'code': 200} Nov 09 04:41:22.527967 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b634cb63-77c6-4288-a378-f8ce3d634887 req-912c242e-787b-47ef-b40e-806c9b8fb7d2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=b79dd1f1-0baf-43bb-92a9-bf549b3f4fd7 HTTP/1.1" status: 200 len: 210 time: 0.0308743 Nov 09 04:41:23.586863 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60742) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:41:23.643968 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-403765fd-67bf-475d-a14f-eeb70636f3a4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:23.669718 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-403765fd-67bf-475d-a14f-eeb70636f3a4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:23.804714 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-403765fd-67bf-475d-a14f-eeb70636f3a4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:23.807495 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-403765fd-67bf-475d-a14f-eeb70636f3a4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:23.808651 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-403765fd-67bf-475d-a14f-eeb70636f3a4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "DELETE /v2.0/security-groups/e5209e89-9c20-4bd3-bbfa-b1e7f3fcefdc HTTP/1.1" status: 204 len: 168 time: 0.2207997 Nov 09 04:41:23.826437 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-403765fd-67bf-475d-a14f-eeb70636f3a4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=e5209e89-9c20-4bd3-bbfa-b1e7f3fcefdc,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:41:23.834035 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-403765fd-67bf-475d-a14f-eeb70636f3a4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:41:23.834402 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-403765fd-67bf-475d-a14f-eeb70636f3a4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:41:23.834748 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-403765fd-67bf-475d-a14f-eeb70636f3a4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:41:23.835086 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-403765fd-67bf-475d-a14f-eeb70636f3a4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:41:23.835413 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-403765fd-67bf-475d-a14f-eeb70636f3a4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:41:23.835744 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-403765fd-67bf-475d-a14f-eeb70636f3a4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:41:23.836069 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-403765fd-67bf-475d-a14f-eeb70636f3a4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:41:23.836399 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-403765fd-67bf-475d-a14f-eeb70636f3a4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:41:23.836726 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-403765fd-67bf-475d-a14f-eeb70636f3a4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:41:23.837044 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-403765fd-67bf-475d-a14f-eeb70636f3a4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:41:23.837613 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-403765fd-67bf-475d-a14f-eeb70636f3a4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:41:23.837898 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-403765fd-67bf-475d-a14f-eeb70636f3a4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:41:23.899934 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60746) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:41:24.229338 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device f93ae6b9-acd9-4c4a-a889-36775bca7179 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:41:24.256178 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] No Port match for: f93ae6b9-acd9-4c4a-a889-36775bca7179 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:41:24.257579 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device f93ae6b9-acd9-4c4a-a889-36775bca7179 not bound to the agent host hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:41:24.272081 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f59f357b-2d64-4d5b-85a6-2cbb5b3d89dc tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:24.520829 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-f59f357b-2d64-4d5b-85a6-2cbb5b3d89dc tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Deleting port 3858fcbc-7462-424b-ba66-6f2f0c0cea85 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:41:24.521170 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f59f357b-2d64-4d5b-85a6-2cbb5b3d89dc tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:24.607016 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-f59f357b-2d64-4d5b-85a6-2cbb5b3d89dc tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] For port 3858fcbc-7462-424b-ba66-6f2f0c0cea85, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=3858fcbc-7462-424b-ba66-6f2f0c0cea85,segment=NetworkSegment(b9865f8d-450a-48dd-a5fd-75229dfd570a),segment_id=b9865f8d-450a-48dd-a5fd-75229dfd570a)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:41:24.607722 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f59f357b-2d64-4d5b-85a6-2cbb5b3d89dc tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:24.619832 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-f59f357b-2d64-4d5b-85a6-2cbb5b3d89dc tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Calling delete_port for 3858fcbc-7462-424b-ba66-6f2f0c0cea85 owned by network:router_interface {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:41:24.887687 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f59f357b-2d64-4d5b-85a6-2cbb5b3d89dc tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:24.916616 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f59f357b-2d64-4d5b-85a6-2cbb5b3d89dc tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'Port': ['ID=3858fcbc-7462-424b-ba66-6f2f0c0cea85,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:41:25.095855 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f59f357b-2d64-4d5b-85a6-2cbb5b3d89dc tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:25.327632 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f59f357b-2d64-4d5b-85a6-2cbb5b3d89dc tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Router 64146dbe-0485-4818-add5-b700f57a9d0d has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:41:25.694144 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f59f357b-2d64-4d5b-85a6-2cbb5b3d89dc tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:41:25.700397 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-f59f357b-2d64-4d5b-85a6-2cbb5b3d89dc tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "PUT /v2.0/routers/64146dbe-0485-4818-add5-b700f57a9d0d/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7982316 Nov 09 04:41:25.702221 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60752) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:41:25.705821 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bb27211d-b877-4593-b8c7-1bdb3e47e318 None None] Sync routers for ids ['64146dbe-0485-4818-add5-b700f57a9d0d'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:41:25.716629 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb27211d-b877-4593-b8c7-1bdb3e47e318 None None] Routers {'64146dbe-0485-4818-add5-b700f57a9d0d'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:41:25.717315 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-bb27211d-b877-4593-b8c7-1bdb3e47e318 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:41:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['64146dbe-0485-4818-add5-b700f57a9d0d'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:41:25.754346 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-e37c3533-fe4c-4d59-8685-e014a0c0c12a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Deleting subnet b698701a-6942-4c78-8d18-8f81ad97a357 {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:41:25.758235 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e37c3533-fe4c-4d59-8685-e014a0c0c12a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:25.801998 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e37c3533-fe4c-4d59-8685-e014a0c0c12a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:25.830495 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-bb27211d-b877-4593-b8c7-1bdb3e47e318 None None] Set router 64146dbe-0485-4818-add5-b700f57a9d0d gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:41:25.907480 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e37c3533-fe4c-4d59-8685-e014a0c0c12a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:26.020474 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-bb27211d-b877-4593-b8c7-1bdb3e47e318 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '64146dbe-0485-4818-add5-b700f57a9d0d', 'name': 'tempest-TestNetworkBasicOps-router-888680478', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.73'}], 'enable_snat': True}, 'gw_port_id': '2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:40:15Z', 'updated_at': '2021-11-09T04:41:24Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:f7:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '64146dbe-0485-4818-add5-b700f57a9d0d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1436, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.73', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:40:15Z', 'updated_at': '2021-11-09T04:41:17Z', 'revision_number': 6, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:41:26.035981 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e37c3533-fe4c-4d59-8685-e014a0c0c12a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:26.051879 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bb27211d-b877-4593-b8c7-1bdb3e47e318 None None] Checking router: 64146dbe-0485-4818-add5-b700f57a9d0d for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:41:26.060502 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb27211d-b877-4593-b8c7-1bdb3e47e318 None None] Routers {'64146dbe-0485-4818-add5-b700f57a9d0d'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:41:26.061159 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-bb27211d-b877-4593-b8c7-1bdb3e47e318 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:41:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['64146dbe-0485-4818-add5-b700f57a9d0d'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:41:26.062802 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e37c3533-fe4c-4d59-8685-e014a0c0c12a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'Subnet': ['ID=b698701a-6942-4c78-8d18-8f81ad97a357,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:41:26.069640 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e37c3533-fe4c-4d59-8685-e014a0c0c12a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:26.075647 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 60754) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:41:26.076084 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-e37c3533-fe4c-4d59-8685-e014a0c0c12a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "DELETE /v2.0/subnets/b698701a-6942-4c78-8d18-8f81ad97a357 HTTP/1.1" status: 204 len: 168 time: 0.3727679 Nov 09 04:41:26.080304 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ce6209c0-d2a6-4cea-b72e-c966adca38ff None None] Network 5c1cc491-3177-49e1-a58d-e9fa4f64046d requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:41:26.234179 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-14c7f381-a178-46da-8c10-848956d7fd98 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:26.312236 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-53076f15-18cb-464d-9f2c-dd08d28df4a2 None None] DHCP port deletion for 5c1cc491-3177-49e1-a58d-e9fa4f64046d request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:41:26.314489 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-bb27211d-b877-4593-b8c7-1bdb3e47e318 None None] Set router 64146dbe-0485-4818-add5-b700f57a9d0d gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:41:26.362259 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-53076f15-18cb-464d-9f2c-dd08d28df4a2 None None] Deleting port faccdf70-a317-4fc7-a4c5-9c97ca983e19 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:41:26.362664 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-53076f15-18cb-464d-9f2c-dd08d28df4a2 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:26.366667 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-14c7f381-a178-46da-8c10-848956d7fd98 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router_gateway, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:26.427990 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-53076f15-18cb-464d-9f2c-dd08d28df4a2 None None] For port faccdf70-a317-4fc7-a4c5-9c97ca983e19, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=faccdf70-a317-4fc7-a4c5-9c97ca983e19,segment=NetworkSegment(b9865f8d-450a-48dd-a5fd-75229dfd570a),segment_id=b9865f8d-450a-48dd-a5fd-75229dfd570a)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:41:26.428472 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-53076f15-18cb-464d-9f2c-dd08d28df4a2 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:26.441413 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-53076f15-18cb-464d-9f2c-dd08d28df4a2 None None] Calling delete_port for faccdf70-a317-4fc7-a4c5-9c97ca983e19 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:41:26.499689 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-14c7f381-a178-46da-8c10-848956d7fd98 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Deleting port 2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:41:26.500452 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-14c7f381-a178-46da-8c10-848956d7fd98 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:26.503423 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-bb27211d-b877-4593-b8c7-1bdb3e47e318 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '64146dbe-0485-4818-add5-b700f57a9d0d', 'name': 'tempest-TestNetworkBasicOps-router-888680478', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.73'}], 'enable_snat': True}, 'gw_port_id': '2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:40:15Z', 'updated_at': '2021-11-09T04:41:24Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:f7:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '64146dbe-0485-4818-add5-b700f57a9d0d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1436, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.73', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:40:15Z', 'updated_at': '2021-11-09T04:41:17Z', 'revision_number': 6, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:41:26.529558 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bb27211d-b877-4593-b8c7-1bdb3e47e318 None None] The sync data for ids ['64146dbe-0485-4818-add5-b700f57a9d0d'] in dv-neutron-816802-2-hyperv is: [{'id': '64146dbe-0485-4818-add5-b700f57a9d0d', 'name': 'tempest-TestNetworkBasicOps-router-888680478', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.73'}], 'enable_snat': True}, 'gw_port_id': '2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:40:15Z', 'updated_at': '2021-11-09T04:41:24Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:f7:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '64146dbe-0485-4818-add5-b700f57a9d0d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1436, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.73', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:40:15Z', 'updated_at': '2021-11-09T04:41:17Z', 'revision_number': 6, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:41:26.586518 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-14c7f381-a178-46da-8c10-848956d7fd98 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] For port 2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:41:26.586881 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-14c7f381-a178-46da-8c10-848956d7fd98 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:26.593595 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-53076f15-18cb-464d-9f2c-dd08d28df4a2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:26.601760 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-14c7f381-a178-46da-8c10-848956d7fd98 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Calling delete_port for 2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368 owned by network:router_gateway {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:41:26.618771 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53076f15-18cb-464d-9f2c-dd08d28df4a2 None None] Pushing event deleted for resources: {'Port': ['ID=faccdf70-a317-4fc7-a4c5-9c97ca983e19,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:41:26.622874 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-53076f15-18cb-464d-9f2c-dd08d28df4a2 None None] No DVR routers for this DVR port faccdf70-a317-4fc7-a4c5-9c97ca983e19 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:41:26.870242 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-14c7f381-a178-46da-8c10-848956d7fd98 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:26.906236 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14c7f381-a178-46da-8c10-848956d7fd98 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'Port': ['ID=2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:41:26.975725 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-14c7f381-a178-46da-8c10-848956d7fd98 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-466373'] for router_gateway, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:27.074565 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-14c7f381-a178-46da-8c10-848956d7fd98 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:27.076956 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-14c7f381-a178-46da-8c10-848956d7fd98 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:27.201167 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-14c7f381-a178-46da-8c10-848956d7fd98 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:27.201738 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-14c7f381-a178-46da-8c10-848956d7fd98 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Fanout notify agent at l3_agent the message router_deleted on router 64146dbe-0485-4818-add5-b700f57a9d0d {{(pid=102162) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:41:27.211278 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-14c7f381-a178-46da-8c10-848956d7fd98 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:27.212404 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-14c7f381-a178-46da-8c10-848956d7fd98 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "DELETE /v2.0/routers/64146dbe-0485-4818-add5-b700f57a9d0d HTTP/1.1" status: 204 len: 168 time: 1.1356320 Nov 09 04:41:27.216220 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 60758) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:41:27.305976 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8f1f1c3c-37d7-472f-9592-b4e1ba157fbd tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:27.403326 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8f1f1c3c-37d7-472f-9592-b4e1ba157fbd tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:27.423876 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-8f1f1c3c-37d7-472f-9592-b4e1ba157fbd tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5c1cc491-3177-49e1-a58d-e9fa4f64046d']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:41:27.433932 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-8f1f1c3c-37d7-472f-9592-b4e1ba157fbd tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b9865f8d-450a-48dd-a5fd-75229dfd570a') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:41:27.434227 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-8f1f1c3c-37d7-472f-9592-b4e1ba157fbd tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b9865f8d-450a-48dd-a5fd-75229dfd570a') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:41:27.443437 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8f1f1c3c-37d7-472f-9592-b4e1ba157fbd tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:27.457495 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8f1f1c3c-37d7-472f-9592-b4e1ba157fbd tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:27.463719 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8f1f1c3c-37d7-472f-9592-b4e1ba157fbd tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Releasing vlan 343 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:41:27.464099 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8f1f1c3c-37d7-472f-9592-b4e1ba157fbd tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:27.467604 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:41:27.467604 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:41:27.467604 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:41:27.467604 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:41:27.467604 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:41:27.467604 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:41:27.467604 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:41:27.467604 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:41:27.467604 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:41:27.467604 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:41:27.467604 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:41:27.467604 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:41:27.467604 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:41:27.467604 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:41:27.467604 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:41:27.467604 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:41:27.467604 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:41:27.467604 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:41:27.467604 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:41:27.467604 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:41:27.467604 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:41:27.467604 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:41:27.467604 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:41:27.467604 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:41:27.467604 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:41:27.467604 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:41:27.467604 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:41:27.467604 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:41:27.467604 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:41:27.467604 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:41:27.467604 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:41:27.467604 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:41:27.679751 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8f1f1c3c-37d7-472f-9592-b4e1ba157fbd tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:27.698117 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8f1f1c3c-37d7-472f-9592-b4e1ba157fbd tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:27.710090 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-8f1f1c3c-37d7-472f-9592-b4e1ba157fbd tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "DELETE /v2.0/networks/5c1cc491-3177-49e1-a58d-e9fa4f64046d HTTP/1.1" status: 204 len: 168 time: 0.4876869 Nov 09 04:41:27.710090 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f1f1c3c-37d7-472f-9592-b4e1ba157fbd tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'Network': ['ID=5c1cc491-3177-49e1-a58d-e9fa4f64046d,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:41:27.728992 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60762) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:41:27.729752 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device faccdf70-a317-4fc7-a4c5-9c97ca983e19 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:41:27.734659 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-d185bd0e-2db8-41cc-bb3d-acc0006475b2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'network': {'name': 'tempest-network-smoke--1172673224', 'project_id': '1d10b4824e524068827e58b55e269af3', 'port_security_enabled': True}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:41:27.751854 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: faccdf70-a317-4fc7-a4c5-9c97ca983e19 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:41:27.760973 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device faccdf70-a317-4fc7-a4c5-9c97ca983e19 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:41:27.760973 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 3858fcbc-7462-424b-ba66-6f2f0c0cea85 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:41:27.774409 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 3858fcbc-7462-424b-ba66-6f2f0c0cea85 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:41:27.774779 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 3858fcbc-7462-424b-ba66-6f2f0c0cea85 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:41:27.775189 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:41:27.796020 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:41:27.796355 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 2b8e3d79-cf10-4ca8-ab0e-9eed05b5d368 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:41:27.902378 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d185bd0e-2db8-41cc-bb3d-acc0006475b2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Made reservation on behalf of 1d10b4824e524068827e58b55e269af3 for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:41:27.906133 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d185bd0e-2db8-41cc-bb3d-acc0006475b2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:27.934834 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d185bd0e-2db8-41cc-bb3d-acc0006475b2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 349} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:41:27.946491 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d185bd0e-2db8-41cc-bb3d-acc0006475b2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:27.952317 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-d185bd0e-2db8-41cc-bb3d-acc0006475b2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Added segment 776df773-c3a8-4771-9fc6-803dc540938f of type vlan for network 48525ef7-c383-4b41-af35-4362b85562cf Nov 09 04:41:27.998006 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d185bd0e-2db8-41cc-bb3d-acc0006475b2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:28.098724 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d185bd0e-2db8-41cc-bb3d-acc0006475b2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:28.104383 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d185bd0e-2db8-41cc-bb3d-acc0006475b2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:28.104961 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d185bd0e-2db8-41cc-bb3d-acc0006475b2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:28.173781 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d185bd0e-2db8-41cc-bb3d-acc0006475b2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Network': ['ID=48525ef7-c383-4b41-af35-4362b85562cf,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:41:28.187500 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 48525ef7-c383-4b41-af35-4362b85562cf details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:41:28.214089 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-d185bd0e-2db8-41cc-bb3d-acc0006475b2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.4838102 Nov 09 04:41:28.216865 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60764) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:41:28.223437 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-2dd573fa-3398-41dc-b7b9-79b0b9c707e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'router': {'name': 'tempest-TestNetworkBasicOps-router-952339284', 'admin_state_up': True, 'project_id': '1d10b4824e524068827e58b55e269af3', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:41:28.342095 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2dd573fa-3398-41dc-b7b9-79b0b9c707e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:28.343284 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2dd573fa-3398-41dc-b7b9-79b0b9c707e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:28.409842 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2dd573fa-3398-41dc-b7b9-79b0b9c707e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:28.627357 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2dd573fa-3398-41dc-b7b9-79b0b9c707e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:28.901348 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2dd573fa-3398-41dc-b7b9-79b0b9c707e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router_gateway, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:28.920832 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2dd573fa-3398-41dc-b7b9-79b0b9c707e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:29.024752 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-2dd573fa-3398-41dc-b7b9-79b0b9c707e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Allocated IP 172.26.0.194 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/ec5fce5b-ee83-4955-8947-4ecdfe3bce2b) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:41:29.130218 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2dd573fa-3398-41dc-b7b9-79b0b9c707e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:29.256369 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2dd573fa-3398-41dc-b7b9-79b0b9c707e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:29.296036 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2dd573fa-3398-41dc-b7b9-79b0b9c707e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:41:29.298875 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-2dd573fa-3398-41dc-b7b9-79b0b9c707e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:41:29.301272 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2dd573fa-3398-41dc-b7b9-79b0b9c707e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:41:29.334730 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2dd573fa-3398-41dc-b7b9-79b0b9c707e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Port': ['ID=ec5fce5b-ee83-4955-8947-4ecdfe3bce2b,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:41:29.644006 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2dd573fa-3398-41dc-b7b9-79b0b9c707e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router_gateway, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:29.841505 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2dd573fa-3398-41dc-b7b9-79b0b9c707e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:30.069721 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2dd573fa-3398-41dc-b7b9-79b0b9c707e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Router f13bdef0-14e2-4965-81f3-edd791830726 is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102161) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:41:30.179262 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2dd573fa-3398-41dc-b7b9-79b0b9c707e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:41:30.190445 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ac13ec3f-67f5-4084-81e1-25084169b8f7 None None] Sync routers for ids ['f13bdef0-14e2-4965-81f3-edd791830726'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:41:30.201635 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ac13ec3f-67f5-4084-81e1-25084169b8f7 None None] Routers {'f13bdef0-14e2-4965-81f3-edd791830726'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:41:30.202243 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-ac13ec3f-67f5-4084-81e1-25084169b8f7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:41:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['f13bdef0-14e2-4965-81f3-edd791830726'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:41:30.283334 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2dd573fa-3398-41dc-b7b9-79b0b9c707e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:30.284870 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-2dd573fa-3398-41dc-b7b9-79b0b9c707e0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 886 time: 2.0667984 Nov 09 04:41:30.288791 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60770) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:41:30.306079 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-ac13ec3f-67f5-4084-81e1-25084169b8f7 None None] Set router f13bdef0-14e2-4965-81f3-edd791830726 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:41:30.318985 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-56770af7-d83b-479b-b7a8-7c800e847f29 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/subnets?project_id=1d10b4824e524068827e58b55e269af3&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0270429 Nov 09 04:41:30.321756 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60772) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:41:30.424193 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e7f206b8-bd06-4b4b-873e-27b76a67cb5f tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:30.428986 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-e7f206b8-bd06-4b4b-873e-27b76a67cb5f tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.1032848 Nov 09 04:41:30.429347 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 60776) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:41:30.460771 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-0ca98eaf-3ce6-49c6-92d7-7e1027100d0e tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/subnets?network_id=2b6725f5-ebfe-485a-8f42-ccb5a241ddb5&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0305541 Nov 09 04:41:30.463601 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 60778) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:41:30.468378 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-8a38d6ad-776f-491f-a227-7ed5a48157c7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-1285850856', 'network_id': '48525ef7-c383-4b41-af35-4362b85562cf', 'project_id': '1d10b4824e524068827e58b55e269af3', 'ip_version': 4, 'cidr': '172.20.0.0/28', 'dns_nameservers': ['1.2.3.4']}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:41:30.499341 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-ac13ec3f-67f5-4084-81e1-25084169b8f7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f13bdef0-14e2-4965-81f3-edd791830726', 'name': 'tempest-TestNetworkBasicOps-router-952339284', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.194'}], 'enable_snat': True}, 'gw_port_id': 'ec5fce5b-ee83-4955-8947-4ecdfe3bce2b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:41:28Z', 'updated_at': '2021-11-09T04:41:29Z', 'revision_number': 3, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': 'ec5fce5b-ee83-4955-8947-4ecdfe3bce2b', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:8e:c2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f13bdef0-14e2-4965-81f3-edd791830726', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1455, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:41:28Z', 'updated_at': '2021-11-09T04:41:29Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:41:30.525798 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ac13ec3f-67f5-4084-81e1-25084169b8f7 None None] Checking router: f13bdef0-14e2-4965-81f3-edd791830726 for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:41:30.526147 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ac13ec3f-67f5-4084-81e1-25084169b8f7 None None] Updating router f13bdef0-14e2-4965-81f3-edd791830726 port ec5fce5b-ee83-4955-8947-4ecdfe3bce2b binding host dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 04:41:30.550593 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ac13ec3f-67f5-4084-81e1-25084169b8f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:30.624579 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8a38d6ad-776f-491f-a227-7ed5a48157c7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Made reservation on behalf of 1d10b4824e524068827e58b55e269af3 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:41:30.628103 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8a38d6ad-776f-491f-a227-7ed5a48157c7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:30.817807 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ac13ec3f-67f5-4084-81e1-25084169b8f7 None None] Publish callbacks [] for port, precommit_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:30.904197 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8a38d6ad-776f-491f-a227-7ed5a48157c7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:30.921217 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ac13ec3f-67f5-4084-81e1-25084169b8f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:30.975057 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a38d6ad-776f-491f-a227-7ed5a48157c7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Subnet': ['ID=070d772f-0def-421a-88b5-aa171b2c21ba,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:41:30.975302 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a3caa7f-6f18-4923-85e6-7fe94ad3b1f5 None None] Pushing event updated for resources: {'Port': ['ID=ec5fce5b-ee83-4955-8947-4ecdfe3bce2b,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:41:30.977452 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-ac13ec3f-67f5-4084-81e1-25084169b8f7 None None] Attempting to bind port ec5fce5b-ee83-4955-8947-4ecdfe3bce2b on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:41:30.977831 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-ac13ec3f-67f5-4084-81e1-25084169b8f7 None None] Attempting to bind port ec5fce5b-ee83-4955-8947-4ecdfe3bce2b by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:41:30.978186 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ac13ec3f-67f5-4084-81e1-25084169b8f7 None None] Attempting to bind port ec5fce5b-ee83-4955-8947-4ecdfe3bce2b on network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:41:30.979858 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8a38d6ad-776f-491f-a227-7ed5a48157c7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Checking segment: {'id': '776df773-c3a8-4771-9fc6-803dc540938f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '48525ef7-c383-4b41-af35-4362b85562cf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:41:30.980217 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8a38d6ad-776f-491f-a227-7ed5a48157c7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network hostable DHCP agents. Network: 48525ef7-c383-4b41-af35-4362b85562cf, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:41:30.984017 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ac13ec3f-67f5-4084-81e1-25084169b8f7 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 41, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:41:30.984436 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ac13ec3f-67f5-4084-81e1-25084169b8f7 None None] Checking segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:41:30.986537 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ac13ec3f-67f5-4084-81e1-25084169b8f7 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:30.986537 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ac13ec3f-67f5-4084-81e1-25084169b8f7 None None] Bound using segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:41:30.986537 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-ac13ec3f-67f5-4084-81e1-25084169b8f7 None None] Bound port: ec5fce5b-ee83-4955-8947-4ecdfe3bce2b, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:41:30.986537 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ac13ec3f-67f5-4084-81e1-25084169b8f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:30.992868 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a38d6ad-776f-491f-a227-7ed5a48157c7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:41:30.993217 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a38d6ad-776f-491f-a227-7ed5a48157c7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:41:30.993548 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a38d6ad-776f-491f-a227-7ed5a48157c7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:41:30.993875 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a38d6ad-776f-491f-a227-7ed5a48157c7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:41:30.994238 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a38d6ad-776f-491f-a227-7ed5a48157c7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:41:30.994594 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a38d6ad-776f-491f-a227-7ed5a48157c7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:41:30.994918 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a38d6ad-776f-491f-a227-7ed5a48157c7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:41:30.995311 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a38d6ad-776f-491f-a227-7ed5a48157c7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:41:30.995571 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a38d6ad-776f-491f-a227-7ed5a48157c7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:41:30.995885 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a38d6ad-776f-491f-a227-7ed5a48157c7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:41:30.996201 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a38d6ad-776f-491f-a227-7ed5a48157c7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:41:30.996513 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a38d6ad-776f-491f-a227-7ed5a48157c7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:41:31.047095 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-ac13ec3f-67f5-4084-81e1-25084169b8f7 None None] For port ec5fce5b-ee83-4955-8947-4ecdfe3bce2b, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:41:31.050488 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-ac13ec3f-67f5-4084-81e1-25084169b8f7 None None] For port ec5fce5b-ee83-4955-8947-4ecdfe3bce2b, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=ec5fce5b-ee83-4955-8947-4ecdfe3bce2b,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:41:31.095946 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8a38d6ad-776f-491f-a227-7ed5a48157c7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network 48525ef7-c383-4b41-af35-4362b85562cf is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:41:31.136700 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ac13ec3f-67f5-4084-81e1-25084169b8f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:31.195004 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ac13ec3f-67f5-4084-81e1-25084169b8f7 None None] Routers {'f13bdef0-14e2-4965-81f3-edd791830726'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:41:31.195694 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-ac13ec3f-67f5-4084-81e1-25084169b8f7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:41:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['f13bdef0-14e2-4965-81f3-edd791830726'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:41:31.233582 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a3caa7f-6f18-4923-85e6-7fe94ad3b1f5 None None] Pushing event updated for resources: {'Port': ['ID=ec5fce5b-ee83-4955-8947-4ecdfe3bce2b,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:41:31.238897 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-8a38d6ad-776f-491f-a227-7ed5a48157c7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 48525ef7-c383-4b41-af35-4362b85562cf) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:41:31.244573 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8a38d6ad-776f-491f-a227-7ed5a48157c7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:31.244573 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8a38d6ad-776f-491f-a227-7ed5a48157c7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:31.254935 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f593d5a6-9fd1-4860-b290-f222ad153bc6 None None] Network 48525ef7-c383-4b41-af35-4362b85562cf requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:41:31.362245 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-8a38d6ad-776f-491f-a227-7ed5a48157c7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 841 time: 0.8968737 Nov 09 04:41:31.364804 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 60780) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:41:31.390007 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-ac13ec3f-67f5-4084-81e1-25084169b8f7 None None] Set router f13bdef0-14e2-4965-81f3-edd791830726 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:41:31.738818 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ff1d4909-bb78-4cf7-a282-810947c20552 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-48525ef7-c383-4b41-af35-4362b85562cf', 'network_id': '48525ef7-c383-4b41-af35-4362b85562cf', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ips': [{'subnet_id': '070d772f-0def-421a-88b5-aa171b2c21ba'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:41:31.739948 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ff1d4909-bb78-4cf7-a282-810947c20552 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:31.884699 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d5e47ac0-1958-44da-bd6b-973ecdfd6901 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:31.910842 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-ac13ec3f-67f5-4084-81e1-25084169b8f7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f13bdef0-14e2-4965-81f3-edd791830726', 'name': 'tempest-TestNetworkBasicOps-router-952339284', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.194'}], 'enable_snat': True}, 'gw_port_id': 'ec5fce5b-ee83-4955-8947-4ecdfe3bce2b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:41:28Z', 'updated_at': '2021-11-09T04:41:29Z', 'revision_number': 3, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': 'ec5fce5b-ee83-4955-8947-4ecdfe3bce2b', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:8e:c2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f13bdef0-14e2-4965-81f3-edd791830726', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1455, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:41:28Z', 'updated_at': '2021-11-09T04:41:31Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:41:31.945144 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ac13ec3f-67f5-4084-81e1-25084169b8f7 None None] The sync data for ids ['f13bdef0-14e2-4965-81f3-edd791830726'] in dv-neutron-816802-2-hyperv is: [{'id': 'f13bdef0-14e2-4965-81f3-edd791830726', 'name': 'tempest-TestNetworkBasicOps-router-952339284', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.194'}], 'enable_snat': True}, 'gw_port_id': 'ec5fce5b-ee83-4955-8947-4ecdfe3bce2b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:41:28Z', 'updated_at': '2021-11-09T04:41:29Z', 'revision_number': 3, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': 'ec5fce5b-ee83-4955-8947-4ecdfe3bce2b', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:8e:c2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f13bdef0-14e2-4965-81f3-edd791830726', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1455, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:41:28Z', 'updated_at': '2021-11-09T04:41:31Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:41:31.947065 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-ff1d4909-bb78-4cf7-a282-810947c20552 None None] Allocated IP 172.20.0.2 (48525ef7-c383-4b41-af35-4362b85562cf/070d772f-0def-421a-88b5-aa171b2c21ba/7417a41c-915f-4cab-8e37-08246d66bbc1) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:41:32.123540 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ff1d4909-bb78-4cf7-a282-810947c20552 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:32.210826 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ff1d4909-bb78-4cf7-a282-810947c20552 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:32.254413 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ff1d4909-bb78-4cf7-a282-810947c20552 None None] Network 48525ef7-c383-4b41-af35-4362b85562cf is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:41:32.257164 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-ff1d4909-bb78-4cf7-a282-810947c20552 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:41:32.263701 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ff1d4909-bb78-4cf7-a282-810947c20552 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:41:32.273917 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-d5e47ac0-1958-44da-bd6b-973ecdfd6901 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Allocated IP 172.20.0.1 (48525ef7-c383-4b41-af35-4362b85562cf/070d772f-0def-421a-88b5-aa171b2c21ba/064e1a31-61b7-44c2-be25-3ad23c3252e1) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:41:32.277953 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff1d4909-bb78-4cf7-a282-810947c20552 None None] Pushing event updated for resources: {'Port': ['ID=7417a41c-915f-4cab-8e37-08246d66bbc1,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:41:32.353616 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-ff1d4909-bb78-4cf7-a282-810947c20552 None None] Attempting to bind port 7417a41c-915f-4cab-8e37-08246d66bbc1 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:41:32.354106 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-ff1d4909-bb78-4cf7-a282-810947c20552 None None] Attempting to bind port 7417a41c-915f-4cab-8e37-08246d66bbc1 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '776df773-c3a8-4771-9fc6-803dc540938f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '48525ef7-c383-4b41-af35-4362b85562cf'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:41:32.355212 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ff1d4909-bb78-4cf7-a282-810947c20552 None None] Attempting to bind port 7417a41c-915f-4cab-8e37-08246d66bbc1 on network 48525ef7-c383-4b41-af35-4362b85562cf {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:41:32.367722 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ff1d4909-bb78-4cf7-a282-810947c20552 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 41, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:41:32.367722 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ff1d4909-bb78-4cf7-a282-810947c20552 None None] Checking segment: {'id': '776df773-c3a8-4771-9fc6-803dc540938f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '48525ef7-c383-4b41-af35-4362b85562cf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:41:32.367722 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ff1d4909-bb78-4cf7-a282-810947c20552 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:32.368185 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ff1d4909-bb78-4cf7-a282-810947c20552 None None] Bound using segment: {'id': '776df773-c3a8-4771-9fc6-803dc540938f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '48525ef7-c383-4b41-af35-4362b85562cf'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:41:32.368440 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-ff1d4909-bb78-4cf7-a282-810947c20552 None None] Bound port: 7417a41c-915f-4cab-8e37-08246d66bbc1, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '776df773-c3a8-4771-9fc6-803dc540938f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '48525ef7-c383-4b41-af35-4362b85562cf'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:41:32.368839 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ff1d4909-bb78-4cf7-a282-810947c20552 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:32.437781 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d5e47ac0-1958-44da-bd6b-973ecdfd6901 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:32.437993 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-ff1d4909-bb78-4cf7-a282-810947c20552 None None] For port 7417a41c-915f-4cab-8e37-08246d66bbc1, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:41:32.443243 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-ff1d4909-bb78-4cf7-a282-810947c20552 None None] For port 7417a41c-915f-4cab-8e37-08246d66bbc1, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=7417a41c-915f-4cab-8e37-08246d66bbc1,segment=NetworkSegment(776df773-c3a8-4771-9fc6-803dc540938f),segment_id=776df773-c3a8-4771-9fc6-803dc540938f)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:41:32.582335 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ff1d4909-bb78-4cf7-a282-810947c20552 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:32.616634 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d5e47ac0-1958-44da-bd6b-973ecdfd6901 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:32.687267 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d5e47ac0-1958-44da-bd6b-973ecdfd6901 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network 48525ef7-c383-4b41-af35-4362b85562cf is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:41:32.689465 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-d5e47ac0-1958-44da-bd6b-973ecdfd6901 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:41:32.689594 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff1d4909-bb78-4cf7-a282-810947c20552 None None] Pushing event updated for resources: {'Port': ['ID=7417a41c-915f-4cab-8e37-08246d66bbc1,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:41:32.694175 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d5e47ac0-1958-44da-bd6b-973ecdfd6901 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:41:32.698636 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5e47ac0-1958-44da-bd6b-973ecdfd6901 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Port': ['ID=064e1a31-61b7-44c2-be25-3ad23c3252e1,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:41:32.753636 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d5e47ac0-1958-44da-bd6b-973ecdfd6901 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:32.990135 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d5e47ac0-1958-44da-bd6b-973ecdfd6901 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:33.291796 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d5e47ac0-1958-44da-bd6b-973ecdfd6901 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:33.378547 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d5e47ac0-1958-44da-bd6b-973ecdfd6901 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:33.463180 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d5e47ac0-1958-44da-bd6b-973ecdfd6901 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:33.466729 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5e47ac0-1958-44da-bd6b-973ecdfd6901 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Port': ['ID=064e1a31-61b7-44c2-be25-3ad23c3252e1,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:41:33.484237 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 7417a41c-915f-4cab-8e37-08246d66bbc1 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:41:33.542897 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 7417a41c-915f-4cab-8e37-08246d66bbc1 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:41:33.543512 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:33.569023 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d5e47ac0-1958-44da-bd6b-973ecdfd6901 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network 48525ef7-c383-4b41-af35-4362b85562cf is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:41:33.570916 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-d5e47ac0-1958-44da-bd6b-973ecdfd6901 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:41:33.633629 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:33.674144 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 7417a41c-915f-4cab-8e37-08246d66bbc1, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=7417a41c-915f-4cab-8e37-08246d66bbc1,segment=NetworkSegment(776df773-c3a8-4771-9fc6-803dc540938f),segment_id=776df773-c3a8-4771-9fc6-803dc540938f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:41:33.693300 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d5e47ac0-1958-44da-bd6b-973ecdfd6901 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Router f13bdef0-14e2-4965-81f3-edd791830726 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:41:33.772489 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:33.773295 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device ec5fce5b-ee83-4955-8947-4ecdfe3bce2b up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:41:33.808430 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d5e47ac0-1958-44da-bd6b-973ecdfd6901 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:41:33.815801 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-d5e47ac0-1958-44da-bd6b-973ecdfd6901 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "PUT /v2.0/routers/f13bdef0-14e2-4965-81f3-edd791830726/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.4471078 Nov 09 04:41:33.816281 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 60788) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:41:33.819712 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5c4328b8-0c13-4fd1-ae45-cd2aa123aa89 None None] Sync routers for ids ['f13bdef0-14e2-4965-81f3-edd791830726'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:41:33.835246 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5c4328b8-0c13-4fd1-ae45-cd2aa123aa89 None None] Routers {'f13bdef0-14e2-4965-81f3-edd791830726'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:41:33.836103 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-5c4328b8-0c13-4fd1-ae45-cd2aa123aa89 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:41:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['f13bdef0-14e2-4965-81f3-edd791830726'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:41:33.866009 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port ec5fce5b-ee83-4955-8947-4ecdfe3bce2b triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:41:33.866385 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:33.899715 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=7417a41c-915f-4cab-8e37-08246d66bbc1,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:41:33.937290 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e926c5d7-79bd-42c7-881f-dfe64d231c35 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:33.937673 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e926c5d7-79bd-42c7-881f-dfe64d231c35 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:33.938144 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e926c5d7-79bd-42c7-881f-dfe64d231c35 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:33.938615 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e926c5d7-79bd-42c7-881f-dfe64d231c35 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:33.939118 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e926c5d7-79bd-42c7-881f-dfe64d231c35 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:33.939624 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e926c5d7-79bd-42c7-881f-dfe64d231c35 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:33.941426 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e926c5d7-79bd-42c7-881f-dfe64d231c35 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/networks HTTP/1.1" status: 200 len: 4286 time: 0.1245470 Nov 09 04:41:33.944156 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 60790) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:41:33.953754 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:33.974453 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-5c4328b8-0c13-4fd1-ae45-cd2aa123aa89 None None] Set router f13bdef0-14e2-4965-81f3-edd791830726 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:41:33.990836 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port ec5fce5b-ee83-4955-8947-4ecdfe3bce2b, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=ec5fce5b-ee83-4955-8947-4ecdfe3bce2b,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:41:34.020740 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b033f2e8-e135-475e-bfe9-ac05dae90c77 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:34.021321 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b033f2e8-e135-475e-bfe9-ac05dae90c77 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:34.021778 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b033f2e8-e135-475e-bfe9-ac05dae90c77 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:34.022220 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b033f2e8-e135-475e-bfe9-ac05dae90c77 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:34.022703 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b033f2e8-e135-475e-bfe9-ac05dae90c77 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:34.023139 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b033f2e8-e135-475e-bfe9-ac05dae90c77 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:34.024929 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-b033f2e8-e135-475e-bfe9-ac05dae90c77 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 4015 time: 0.0798526 Nov 09 04:41:34.028151 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60792) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:41:34.108102 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:34.180362 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-4892b855-b231-4792-b82e-49b0d95c0de0 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/routers HTTP/1.1" status: 200 len: 3047 time: 0.1510501 Nov 09 04:41:34.181880 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=ec5fce5b-ee83-4955-8947-4ecdfe3bce2b,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:41:34.245559 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-5c4328b8-0c13-4fd1-ae45-cd2aa123aa89 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f13bdef0-14e2-4965-81f3-edd791830726', 'name': 'tempest-TestNetworkBasicOps-router-952339284', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.194'}], 'enable_snat': True}, 'gw_port_id': 'ec5fce5b-ee83-4955-8947-4ecdfe3bce2b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:41:28Z', 'updated_at': '2021-11-09T04:41:32Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': 'ec5fce5b-ee83-4955-8947-4ecdfe3bce2b', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:8e:c2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f13bdef0-14e2-4965-81f3-edd791830726', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1455, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:41:28Z', 'updated_at': '2021-11-09T04:41:31Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '064e1a31-61b7-44c2-be25-3ad23c3252e1', 'name': '', 'network_id': '48525ef7-c383-4b41-af35-4362b85562cf', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:2a:e3:cf', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f13bdef0-14e2-4965-81f3-edd791830726', 'device_owner': 'network:router_interface', 'standard_attr_id': 1458, 'fixed_ips': [{'subnet_id': '070d772f-0def-421a-88b5-aa171b2c21ba', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:41:32Z', 'updated_at': '2021-11-09T04:41:33Z', 'revision_number': 2, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '070d772f-0def-421a-88b5-aa171b2c21ba', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': ['1.2.3.4'], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:41:34.275217 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5c4328b8-0c13-4fd1-ae45-cd2aa123aa89 None None] Checking router: f13bdef0-14e2-4965-81f3-edd791830726 for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:41:34.275640 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5c4328b8-0c13-4fd1-ae45-cd2aa123aa89 None None] Updating router f13bdef0-14e2-4965-81f3-edd791830726 port 064e1a31-61b7-44c2-be25-3ad23c3252e1 binding host dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 04:41:34.302712 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-5c4328b8-0c13-4fd1-ae45-cd2aa123aa89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:34.363893 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c7eece5e-d2f1-4de2-9b22-e3df440dd41c None None] Network 48525ef7-c383-4b41-af35-4362b85562cf requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:41:34.421815 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60796) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:41:34.426713 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-0a2aa376-e69d-42df-9242-95f85bc3d796 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1865103944', 'description': 'tempest-secgroup-smoke-1865103944 description', 'project_id': '1d10b4824e524068827e58b55e269af3'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:41:34.485093 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-30f3a734-4eda-44a3-b40b-71294f00af7a None None] Provisioning complete for port 7417a41c-915f-4cab-8e37-08246d66bbc1 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:41:34.485093 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-30f3a734-4eda-44a3-b40b-71294f00af7a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:34.550026 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0a2aa376-e69d-42df-9242-95f85bc3d796 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:34.607111 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-5c4328b8-0c13-4fd1-ae45-cd2aa123aa89 None None] Publish callbacks [] for port, precommit_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:34.646463 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0a2aa376-e69d-42df-9242-95f85bc3d796 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:34.715990 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-5c4328b8-0c13-4fd1-ae45-cd2aa123aa89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:34.782104 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8847601-7a42-45a2-a2bf-16a2653f01ff None None] Pushing event updated for resources: {'Port': ['ID=064e1a31-61b7-44c2-be25-3ad23c3252e1,revision_number=3']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:41:34.796035 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0a2aa376-e69d-42df-9242-95f85bc3d796 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:34.809904 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8847601-7a42-45a2-a2bf-16a2653f01ff None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:41:34.809904 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8847601-7a42-45a2-a2bf-16a2653f01ff None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:41:34.809904 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8847601-7a42-45a2-a2bf-16a2653f01ff None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:41:34.809904 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8847601-7a42-45a2-a2bf-16a2653f01ff None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:41:34.812369 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8847601-7a42-45a2-a2bf-16a2653f01ff None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:41:34.812369 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8847601-7a42-45a2-a2bf-16a2653f01ff None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:41:34.812369 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8847601-7a42-45a2-a2bf-16a2653f01ff None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:41:34.812369 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8847601-7a42-45a2-a2bf-16a2653f01ff None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:41:34.812369 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8847601-7a42-45a2-a2bf-16a2653f01ff None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:41:34.812369 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8847601-7a42-45a2-a2bf-16a2653f01ff None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:41:34.812988 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8847601-7a42-45a2-a2bf-16a2653f01ff None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:41:34.813078 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8847601-7a42-45a2-a2bf-16a2653f01ff None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:41:34.826128 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-5c4328b8-0c13-4fd1-ae45-cd2aa123aa89 None None] Attempting to bind port 064e1a31-61b7-44c2-be25-3ad23c3252e1 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:41:34.827168 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-5c4328b8-0c13-4fd1-ae45-cd2aa123aa89 None None] Attempting to bind port 064e1a31-61b7-44c2-be25-3ad23c3252e1 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '776df773-c3a8-4771-9fc6-803dc540938f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '48525ef7-c383-4b41-af35-4362b85562cf'}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:41:34.827705 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c4328b8-0c13-4fd1-ae45-cd2aa123aa89 None None] Attempting to bind port 064e1a31-61b7-44c2-be25-3ad23c3252e1 on network 48525ef7-c383-4b41-af35-4362b85562cf {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:41:34.831213 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-b39eb2b4-6337-4e84-989c-bdfd3a200562 None None] Provisioning complete for port 7417a41c-915f-4cab-8e37-08246d66bbc1 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:41:34.831586 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b39eb2b4-6337-4e84-989c-bdfd3a200562 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:34.834146 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c4328b8-0c13-4fd1-ae45-cd2aa123aa89 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 41, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:41:34.834875 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c4328b8-0c13-4fd1-ae45-cd2aa123aa89 None None] Checking segment: {'id': '776df773-c3a8-4771-9fc6-803dc540938f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '48525ef7-c383-4b41-af35-4362b85562cf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102164) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:41:34.835328 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-5c4328b8-0c13-4fd1-ae45-cd2aa123aa89 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:34.835771 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c4328b8-0c13-4fd1-ae45-cd2aa123aa89 None None] Bound using segment: {'id': '776df773-c3a8-4771-9fc6-803dc540938f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '48525ef7-c383-4b41-af35-4362b85562cf'} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:41:34.836309 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-5c4328b8-0c13-4fd1-ae45-cd2aa123aa89 None None] Bound port: 064e1a31-61b7-44c2-be25-3ad23c3252e1, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '776df773-c3a8-4771-9fc6-803dc540938f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '48525ef7-c383-4b41-af35-4362b85562cf'}}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:41:34.836752 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-5c4328b8-0c13-4fd1-ae45-cd2aa123aa89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:34.840851 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a2aa376-e69d-42df-9242-95f85bc3d796 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroup': ['ID=74002bcd-7488-4d42-8508-4a4b8f5fb88a,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:41:34.920414 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-5c4328b8-0c13-4fd1-ae45-cd2aa123aa89 None None] For port 064e1a31-61b7-44c2-be25-3ad23c3252e1, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102164) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:41:34.923534 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-5c4328b8-0c13-4fd1-ae45-cd2aa123aa89 None None] For port 064e1a31-61b7-44c2-be25-3ad23c3252e1, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=064e1a31-61b7-44c2-be25-3ad23c3252e1,segment=NetworkSegment(776df773-c3a8-4771-9fc6-803dc540938f),segment_id=776df773-c3a8-4771-9fc6-803dc540938f)] {{(pid=102164) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:41:34.944769 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-b39eb2b4-6337-4e84-989c-bdfd3a200562 None None] Provisioning complete for port 064e1a31-61b7-44c2-be25-3ad23c3252e1 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:41:34.945025 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0a2aa376-e69d-42df-9242-95f85bc3d796 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:34.945199 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b39eb2b4-6337-4e84-989c-bdfd3a200562 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:34.946637 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-0a2aa376-e69d-42df-9242-95f85bc3d796 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.5236814 Nov 09 04:41:34.949620 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60800) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:41:34.955251 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-99a8bbc4-213f-4dbc-ad4e-78d6bfa4b1a9 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': '74002bcd-7488-4d42-8508-4a4b8f5fb88a', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:41:34.990352 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-b39eb2b4-6337-4e84-989c-bdfd3a200562 None None] Port 064e1a31-61b7-44c2-be25-3ad23c3252e1 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:41:35.002540 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-5c4328b8-0c13-4fd1-ae45-cd2aa123aa89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:35.065887 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5c4328b8-0c13-4fd1-ae45-cd2aa123aa89 None None] Routers {'f13bdef0-14e2-4965-81f3-edd791830726'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:41:35.066513 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-5c4328b8-0c13-4fd1-ae45-cd2aa123aa89 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:41:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['f13bdef0-14e2-4965-81f3-edd791830726'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:41:35.069493 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8847601-7a42-45a2-a2bf-16a2653f01ff None None] Pushing event updated for resources: {'Port': ['ID=064e1a31-61b7-44c2-be25-3ad23c3252e1,revision_number=4']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:41:35.083005 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-99a8bbc4-213f-4dbc-ad4e-78d6bfa4b1a9 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:35.116711 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-414c5ce0-7ebc-4161-94ae-9cb66690099b None None] Provisioning complete for port 064e1a31-61b7-44c2-be25-3ad23c3252e1 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:41:35.117394 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-414c5ce0-7ebc-4161-94ae-9cb66690099b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:35.175000 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-99a8bbc4-213f-4dbc-ad4e-78d6bfa4b1a9 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:35.191238 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-5c4328b8-0c13-4fd1-ae45-cd2aa123aa89 None None] Set router f13bdef0-14e2-4965-81f3-edd791830726 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:41:35.224749 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-414c5ce0-7ebc-4161-94ae-9cb66690099b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:35.262084 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-414c5ce0-7ebc-4161-94ae-9cb66690099b None None] For port 064e1a31-61b7-44c2-be25-3ad23c3252e1, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=064e1a31-61b7-44c2-be25-3ad23c3252e1,segment=NetworkSegment(776df773-c3a8-4771-9fc6-803dc540938f),segment_id=776df773-c3a8-4771-9fc6-803dc540938f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:41:35.263926 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-99a8bbc4-213f-4dbc-ad4e-78d6bfa4b1a9 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:35.288898 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99a8bbc4-213f-4dbc-ad4e-78d6bfa4b1a9 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1d55197a-e153-4b6d-b15d-305c1cca9c27,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:41:35.361790 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-414c5ce0-7ebc-4161-94ae-9cb66690099b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:35.406581 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-99a8bbc4-213f-4dbc-ad4e-78d6bfa4b1a9 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:35.410758 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-99a8bbc4-213f-4dbc-ad4e-78d6bfa4b1a9 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.4572165 Nov 09 04:41:35.410973 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60802) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:41:35.415503 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-0ec11c2c-4396-42dc-af23-de2f1d26d4af tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': '74002bcd-7488-4d42-8508-4a4b8f5fb88a', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:41:35.428471 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-5c4328b8-0c13-4fd1-ae45-cd2aa123aa89 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f13bdef0-14e2-4965-81f3-edd791830726', 'name': 'tempest-TestNetworkBasicOps-router-952339284', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.194'}], 'enable_snat': True}, 'gw_port_id': 'ec5fce5b-ee83-4955-8947-4ecdfe3bce2b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:41:28Z', 'updated_at': '2021-11-09T04:41:32Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': 'ec5fce5b-ee83-4955-8947-4ecdfe3bce2b', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:8e:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f13bdef0-14e2-4965-81f3-edd791830726', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1455, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:41:28Z', 'updated_at': '2021-11-09T04:41:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '064e1a31-61b7-44c2-be25-3ad23c3252e1', 'name': '', 'network_id': '48525ef7-c383-4b41-af35-4362b85562cf', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:2a:e3:cf', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f13bdef0-14e2-4965-81f3-edd791830726', 'device_owner': 'network:router_interface', 'standard_attr_id': 1458, 'fixed_ips': [{'subnet_id': '070d772f-0def-421a-88b5-aa171b2c21ba', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:41:32Z', 'updated_at': '2021-11-09T04:41:34Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '070d772f-0def-421a-88b5-aa171b2c21ba', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': ['1.2.3.4'], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:41:35.462524 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-414c5ce0-7ebc-4161-94ae-9cb66690099b None None] Pushing event updated for resources: {'Port': ['ID=064e1a31-61b7-44c2-be25-3ad23c3252e1,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:41:35.467556 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 7417a41c-915f-4cab-8e37-08246d66bbc1 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:41:35.469526 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5c4328b8-0c13-4fd1-ae45-cd2aa123aa89 None None] The sync data for ids ['f13bdef0-14e2-4965-81f3-edd791830726'] in dv-neutron-816802-2-hyperv is: [{'id': 'f13bdef0-14e2-4965-81f3-edd791830726', 'name': 'tempest-TestNetworkBasicOps-router-952339284', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.194'}], 'enable_snat': True}, 'gw_port_id': 'ec5fce5b-ee83-4955-8947-4ecdfe3bce2b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:41:28Z', 'updated_at': '2021-11-09T04:41:32Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': 'ec5fce5b-ee83-4955-8947-4ecdfe3bce2b', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:8e:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f13bdef0-14e2-4965-81f3-edd791830726', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1455, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:41:28Z', 'updated_at': '2021-11-09T04:41:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '064e1a31-61b7-44c2-be25-3ad23c3252e1', 'name': '', 'network_id': '48525ef7-c383-4b41-af35-4362b85562cf', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:2a:e3:cf', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f13bdef0-14e2-4965-81f3-edd791830726', 'device_owner': 'network:router_interface', 'standard_attr_id': 1458, 'fixed_ips': [{'subnet_id': '070d772f-0def-421a-88b5-aa171b2c21ba', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:41:32Z', 'updated_at': '2021-11-09T04:41:34Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '070d772f-0def-421a-88b5-aa171b2c21ba', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': ['1.2.3.4'], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:41:35.540259 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-b365df5d-0361-4e4a-b977-dfe1aa9bbcd5 None None] Provisioning complete for port 064e1a31-61b7-44c2-be25-3ad23c3252e1 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:41:35.540950 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b365df5d-0361-4e4a-b977-dfe1aa9bbcd5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:35.568754 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0ec11c2c-4396-42dc-af23-de2f1d26d4af tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:35.616810 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 7417a41c-915f-4cab-8e37-08246d66bbc1 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:41:35.617324 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:35.660619 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0ec11c2c-4396-42dc-af23-de2f1d26d4af tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:35.761990 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0ec11c2c-4396-42dc-af23-de2f1d26d4af tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:35.778505 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device ec5fce5b-ee83-4955-8947-4ecdfe3bce2b up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:41:35.782096 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ec11c2c-4396-42dc-af23-de2f1d26d4af tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=59246552-1162-4408-93bd-9128fd75732f,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:41:35.843235 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port ec5fce5b-ee83-4955-8947-4ecdfe3bce2b triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:41:35.845120 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:35.848675 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-af0ca5f9-2a6b-40ed-a178-c38fdebaa891 None None] Provisioning complete for port 064e1a31-61b7-44c2-be25-3ad23c3252e1 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:41:35.848675 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-af0ca5f9-2a6b-40ed-a178-c38fdebaa891 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:35.891921 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0ec11c2c-4396-42dc-af23-de2f1d26d4af tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:35.894526 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 60806) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:41:35.895068 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-0ec11c2c-4396-42dc-af23-de2f1d26d4af tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.4829967 Nov 09 04:41:35.899231 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-3daa70fb-d7f0-4470-93bf-26c05066c1b9 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': '74002bcd-7488-4d42-8508-4a4b8f5fb88a', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:41:36.008872 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3daa70fb-d7f0-4470-93bf-26c05066c1b9 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:36.076131 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3daa70fb-d7f0-4470-93bf-26c05066c1b9 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:36.170169 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3daa70fb-d7f0-4470-93bf-26c05066c1b9 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:36.191574 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3daa70fb-d7f0-4470-93bf-26c05066c1b9 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6bac3a67-e06d-4072-83f2-cd56fa8dacc9,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:41:36.278107 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3daa70fb-d7f0-4470-93bf-26c05066c1b9 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:36.279763 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-3daa70fb-d7f0-4470-93bf-26c05066c1b9 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3838644 Nov 09 04:41:36.282197 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 60808) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:41:36.286897 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-da753058-62a0-4f3b-b038-e5d45c5ca3c4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': '74002bcd-7488-4d42-8508-4a4b8f5fb88a', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:41:36.394773 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-da753058-62a0-4f3b-b038-e5d45c5ca3c4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:36.456367 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-da753058-62a0-4f3b-b038-e5d45c5ca3c4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:36.547524 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-da753058-62a0-4f3b-b038-e5d45c5ca3c4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:36.565641 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da753058-62a0-4f3b-b038-e5d45c5ca3c4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=55591bfa-a578-4f96-965f-34f097bf4ee0,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:41:36.671992 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-da753058-62a0-4f3b-b038-e5d45c5ca3c4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:36.673258 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-da753058-62a0-4f3b-b038-e5d45c5ca3c4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3899353 Nov 09 04:41:36.676769 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 60810) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:41:36.681337 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-ed4a2659-9fb2-41b2-bafa-2625a3566ea6 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': '74002bcd-7488-4d42-8508-4a4b8f5fb88a', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:41:36.814563 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.securitygroups_db [None req-ed4a2659-9fb2-41b2-bafa-2625a3566ea6 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Project 1d10b4824e524068827e58b55e269af3 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 09 04:41:36.816391 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ed4a2659-9fb2-41b2-bafa-2625a3566ea6 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:36.878165 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ed4a2659-9fb2-41b2-bafa-2625a3566ea6 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:36.999004 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ed4a2659-9fb2-41b2-bafa-2625a3566ea6 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:37.019011 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed4a2659-9fb2-41b2-bafa-2625a3566ea6 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b9b9e0df-8abb-4219-9b89-47fb9f7045f4,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:41:37.145919 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ed4a2659-9fb2-41b2-bafa-2625a3566ea6 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:37.147219 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-ed4a2659-9fb2-41b2-bafa-2625a3566ea6 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.4694128 Nov 09 04:41:37.150014 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 60814) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:41:37.154296 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-2afc4b49-4861-49f4-b183-1a236f5460c8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': '74002bcd-7488-4d42-8508-4a4b8f5fb88a', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:41:37.281304 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.securitygroups_db [None req-2afc4b49-4861-49f4-b183-1a236f5460c8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Project 1d10b4824e524068827e58b55e269af3 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 09 04:41:37.286588 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2afc4b49-4861-49f4-b183-1a236f5460c8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:37.350598 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2afc4b49-4861-49f4-b183-1a236f5460c8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:37.438516 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 064e1a31-61b7-44c2-be25-3ad23c3252e1 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:41:37.453643 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2afc4b49-4861-49f4-b183-1a236f5460c8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:37.472256 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2afc4b49-4861-49f4-b183-1a236f5460c8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8a4081b5-5795-4757-814c-5e862a0bc600,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:41:37.537381 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 064e1a31-61b7-44c2-be25-3ad23c3252e1 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:41:37.537655 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:37.600887 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2afc4b49-4861-49f4-b183-1a236f5460c8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:37.602204 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-2afc4b49-4861-49f4-b183-1a236f5460c8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.4511325 Nov 09 04:41:37.767777 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-34adad88-ba87-409b-a8c2-103f8efd6099 req-d782078e-cc6d-48fb-8dcf-8c193e2e9aed tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1865103944&fields=id&tenant_id=1d10b4824e524068827e58b55e269af3 HTTP/1.1" status: 200 len: 267 time: 0.0474114 Nov 09 04:41:37.882525 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34adad88-ba87-409b-a8c2-103f8efd6099 req-93a13484-758a-491a-ae50-72fa244e7d89 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:37.884000 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-34adad88-ba87-409b-a8c2-103f8efd6099 req-93a13484-758a-491a-ae50-72fa244e7d89 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/networks?id=48525ef7-c383-4b41-af35-4362b85562cf HTTP/1.1" status: 200 len: 797 time: 0.1093919 Nov 09 04:41:37.903202 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-34adad88-ba87-409b-a8c2-103f8efd6099 req-3f4ddd84-9221-480d-9b6e-43e3e396c22d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/quotas/1d10b4824e524068827e58b55e269af3 HTTP/1.1" status: 200 len: 375 time: 0.0135190 Nov 09 04:41:37.969330 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-34adad88-ba87-409b-a8c2-103f8efd6099 req-6b2d90da-5a64-4835-9c71-a1daad09961d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0607202 Nov 09 04:41:38.143364 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-34adad88-ba87-409b-a8c2-103f8efd6099 req-811662d1-46ec-4c41-9b26-688047d7364c service neutron] 10.222.0.24 "GET /v2.0/networks/48525ef7-c383-4b41-af35-4362b85562cf?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1624668 Nov 09 04:41:38.237042 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-34adad88-ba87-409b-a8c2-103f8efd6099 req-c5dcfeac-5024-430c-941d-dbdc778b4e7c service neutron] 10.222.0.24 "GET /v2.0/networks/48525ef7-c383-4b41-af35-4362b85562cf?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0874395 Nov 09 04:41:38.501179 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-edf37af7-6052-4949-8335-eb2274101d13 req-6a26dd08-8c27-4756-995a-ada6d3e1e50c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=efa8cc26-7104-425a-92ab-aeb8d9bb62bc HTTP/1.1" status: 200 len: 210 time: 0.0264096 Nov 09 04:41:39.600118 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-0076a3ea-7030-49f2-90a5-04437aabb90f req-4571f9f4-d150-44bd-9888-ad65e17162f1 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=efa8cc26-7104-425a-92ab-aeb8d9bb62bc HTTP/1.1" status: 200 len: 210 time: 0.0286586 Nov 09 04:41:40.644651 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34adad88-ba87-409b-a8c2-103f8efd6099 req-c460711e-c1f6-446b-8cea-a826e9d012c4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:40.646442 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-34adad88-ba87-409b-a8c2-103f8efd6099 req-c460711e-c1f6-446b-8cea-a826e9d012c4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "GET /v2.0/networks?id=48525ef7-c383-4b41-af35-4362b85562cf HTTP/1.1" status: 200 len: 797 time: 0.1110158 Nov 09 04:41:40.708442 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-22d699aa-fb08-40af-b513-6f74d2e6e880 req-bce4292a-30e3-495d-9c1e-bcfd13bc6c6f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=efa8cc26-7104-425a-92ab-aeb8d9bb62bc HTTP/1.1" status: 200 len: 210 time: 0.0371470 Nov 09 04:41:40.742462 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-34adad88-ba87-409b-a8c2-103f8efd6099 req-4829d8ae-0156-4565-9250-0f2d19f36615 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=1d10b4824e524068827e58b55e269af3 HTTP/1.1" status: 200 len: 380 time: 0.0875254 Nov 09 04:41:40.751456 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-34adad88-ba87-409b-a8c2-103f8efd6099 req-342ebf85-1226-40b0-82a7-9f350d449623 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'port': {'device_id': 'efa8cc26-7104-425a-92ab-aeb8d9bb62bc', 'network_id': '48525ef7-c383-4b41-af35-4362b85562cf', 'admin_state_up': True, 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'security_groups': ['74002bcd-7488-4d42-8508-4a4b8f5fb88a']}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:41:40.960820 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-34adad88-ba87-409b-a8c2-103f8efd6099 req-342ebf85-1226-40b0-82a7-9f350d449623 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Made reservation on behalf of 1d10b4824e524068827e58b55e269af3 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:41:40.964628 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-34adad88-ba87-409b-a8c2-103f8efd6099 req-342ebf85-1226-40b0-82a7-9f350d449623 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:41.100514 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [req-34adad88-ba87-409b-a8c2-103f8efd6099 req-342ebf85-1226-40b0-82a7-9f350d449623 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Allocated IP 172.20.0.8 (48525ef7-c383-4b41-af35-4362b85562cf/070d772f-0def-421a-88b5-aa171b2c21ba/c89ba17b-04dd-4269-8d17-8f5d1eac8808) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:41:41.241084 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-34adad88-ba87-409b-a8c2-103f8efd6099 req-342ebf85-1226-40b0-82a7-9f350d449623 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:41.344136 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-34adad88-ba87-409b-a8c2-103f8efd6099 req-342ebf85-1226-40b0-82a7-9f350d449623 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:41.383649 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b6f6f728-f099-4413-b8c7-ab950b4d8bda None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:41.388599 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-34adad88-ba87-409b-a8c2-103f8efd6099 req-342ebf85-1226-40b0-82a7-9f350d449623 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network 48525ef7-c383-4b41-af35-4362b85562cf is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:41:41.393210 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [req-34adad88-ba87-409b-a8c2-103f8efd6099 req-342ebf85-1226-40b0-82a7-9f350d449623 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:41:41.396876 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-34adad88-ba87-409b-a8c2-103f8efd6099 req-342ebf85-1226-40b0-82a7-9f350d449623 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:41:41.426076 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-342ebf85-1226-40b0-82a7-9f350d449623 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Port': ['ID=c89ba17b-04dd-4269-8d17-8f5d1eac8808,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:41:41.457144 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34adad88-ba87-409b-a8c2-103f8efd6099 req-342ebf85-1226-40b0-82a7-9f350d449623 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:41.457831 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-34adad88-ba87-409b-a8c2-103f8efd6099 req-342ebf85-1226-40b0-82a7-9f350d449623 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:41.565196 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-34adad88-ba87-409b-a8c2-103f8efd6099 req-342ebf85-1226-40b0-82a7-9f350d449623 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8171597 Nov 09 04:41:41.577756 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-34adad88-ba87-409b-a8c2-103f8efd6099 req-6589eec1-87d7-4425-82f4-eb5067a5f2a9 service neutron] Request body: {'port': {'device_id': 'efa8cc26-7104-425a-92ab-aeb8d9bb62bc', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:41:41.634840 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-34adad88-ba87-409b-a8c2-103f8efd6099 req-6589eec1-87d7-4425-82f4-eb5067a5f2a9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:41.661173 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-626b67ef-4bee-464c-85c0-2d2540cb5706 None None] Provisioning complete for port c89ba17b-04dd-4269-8d17-8f5d1eac8808 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:41:41.661531 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-626b67ef-4bee-464c-85c0-2d2540cb5706 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:41.696862 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-626b67ef-4bee-464c-85c0-2d2540cb5706 None None] Port c89ba17b-04dd-4269-8d17-8f5d1eac8808 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:41:41.828401 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b6d3aa6-ee80-4300-b8d3-d489b87a7431 req-0a5df821-b85c-42a1-9b0f-47fb570e2ddd tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:41.829931 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-2b6d3aa6-ee80-4300-b8d3-d489b87a7431 req-0a5df821-b85c-42a1-9b0f-47fb570e2ddd tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=efa8cc26-7104-425a-92ab-aeb8d9bb62bc HTTP/1.1" status: 200 len: 931 time: 0.0507669 Nov 09 04:41:41.889935 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-2b6d3aa6-ee80-4300-b8d3-d489b87a7431 req-48d52e94-4708-4f60-94e8-adab01af8ec2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=74002bcd-7488-4d42-8508-4a4b8f5fb88a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0537813 Nov 09 04:41:41.964787 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [req-34adad88-ba87-409b-a8c2-103f8efd6099 req-6589eec1-87d7-4425-82f4-eb5067a5f2a9 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c89ba17b-04dd-4269-8d17-8f5d1eac8808 {{(pid=102162) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:41:41.972627 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-34adad88-ba87-409b-a8c2-103f8efd6099 req-6589eec1-87d7-4425-82f4-eb5067a5f2a9 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:41.984361 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.provisioning_blocks [req-34adad88-ba87-409b-a8c2-103f8efd6099 req-6589eec1-87d7-4425-82f4-eb5067a5f2a9 service neutron] Transition to ACTIVE for port object c89ba17b-04dd-4269-8d17-8f5d1eac8808 will not be triggered until provisioned by entity L2. {{(pid=102162) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 09 04:41:42.101346 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-34adad88-ba87-409b-a8c2-103f8efd6099 req-6589eec1-87d7-4425-82f4-eb5067a5f2a9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:42.184229 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:42.488928 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6589eec1-87d7-4425-82f4-eb5067a5f2a9 service neutron] Pushing event updated for resources: {'Port': ['ID=c89ba17b-04dd-4269-8d17-8f5d1eac8808,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:41:42.558886 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-34adad88-ba87-409b-a8c2-103f8efd6099 req-6589eec1-87d7-4425-82f4-eb5067a5f2a9 service neutron] Attempting to bind port c89ba17b-04dd-4269-8d17-8f5d1eac8808 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:41:42.559254 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-34adad88-ba87-409b-a8c2-103f8efd6099 req-6589eec1-87d7-4425-82f4-eb5067a5f2a9 service neutron] Attempting to bind port c89ba17b-04dd-4269-8d17-8f5d1eac8808 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '776df773-c3a8-4771-9fc6-803dc540938f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '48525ef7-c383-4b41-af35-4362b85562cf'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:41:42.559584 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-34adad88-ba87-409b-a8c2-103f8efd6099 req-6589eec1-87d7-4425-82f4-eb5067a5f2a9 service neutron] Attempting to bind port c89ba17b-04dd-4269-8d17-8f5d1eac8808 on network 48525ef7-c383-4b41-af35-4362b85562cf {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:41:42.564164 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-34adad88-ba87-409b-a8c2-103f8efd6099 req-6589eec1-87d7-4425-82f4-eb5067a5f2a9 service neutron] Port c89ba17b-04dd-4269-8d17-8f5d1eac8808 on network 48525ef7-c383-4b41-af35-4362b85562cf not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:41:42.564484 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-34adad88-ba87-409b-a8c2-103f8efd6099 req-6589eec1-87d7-4425-82f4-eb5067a5f2a9 service neutron] Attempting to bind port c89ba17b-04dd-4269-8d17-8f5d1eac8808 on network 48525ef7-c383-4b41-af35-4362b85562cf {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:41:42.569419 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-34adad88-ba87-409b-a8c2-103f8efd6099 req-6589eec1-87d7-4425-82f4-eb5067a5f2a9 service neutron] Checking agent: {'id': '7d36b884-4ad2-4878-9464-bf647030b544', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'started_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 41, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:41:42.569754 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-34adad88-ba87-409b-a8c2-103f8efd6099 req-6589eec1-87d7-4425-82f4-eb5067a5f2a9 service neutron] Checking segment: {'id': '776df773-c3a8-4771-9fc6-803dc540938f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '48525ef7-c383-4b41-af35-4362b85562cf'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:41:42.570134 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-34adad88-ba87-409b-a8c2-103f8efd6099 req-6589eec1-87d7-4425-82f4-eb5067a5f2a9 service neutron] Bound using segment: {'id': '776df773-c3a8-4771-9fc6-803dc540938f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '48525ef7-c383-4b41-af35-4362b85562cf'} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:41:42.570590 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-34adad88-ba87-409b-a8c2-103f8efd6099 req-6589eec1-87d7-4425-82f4-eb5067a5f2a9 service neutron] Bound port: c89ba17b-04dd-4269-8d17-8f5d1eac8808, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '776df773-c3a8-4771-9fc6-803dc540938f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '48525ef7-c383-4b41-af35-4362b85562cf'}}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:41:42.570946 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-34adad88-ba87-409b-a8c2-103f8efd6099 req-6589eec1-87d7-4425-82f4-eb5067a5f2a9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:42.656035 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-34adad88-ba87-409b-a8c2-103f8efd6099 req-6589eec1-87d7-4425-82f4-eb5067a5f2a9 service neutron] For port c89ba17b-04dd-4269-8d17-8f5d1eac8808, host hv-neutron-8168, cleared binding levels {{(pid=102162) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:41:42.659214 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-34adad88-ba87-409b-a8c2-103f8efd6099 req-6589eec1-87d7-4425-82f4-eb5067a5f2a9 service neutron] For port c89ba17b-04dd-4269-8d17-8f5d1eac8808, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=c89ba17b-04dd-4269-8d17-8f5d1eac8808,segment=NetworkSegment(776df773-c3a8-4771-9fc6-803dc540938f),segment_id=776df773-c3a8-4771-9fc6-803dc540938f)] {{(pid=102162) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:41:42.784115 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-34adad88-ba87-409b-a8c2-103f8efd6099 req-6589eec1-87d7-4425-82f4-eb5067a5f2a9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:42.819899 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34adad88-ba87-409b-a8c2-103f8efd6099 req-6589eec1-87d7-4425-82f4-eb5067a5f2a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:42.819899 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-34adad88-ba87-409b-a8c2-103f8efd6099 req-6589eec1-87d7-4425-82f4-eb5067a5f2a9 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:42.819899 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-34adad88-ba87-409b-a8c2-103f8efd6099 req-6589eec1-87d7-4425-82f4-eb5067a5f2a9 service neutron] 10.222.0.26 "PUT /v2.0/ports/c89ba17b-04dd-4269-8d17-8f5d1eac8808 HTTP/1.1" status: 200 len: 1093 time: 1.2461505 Nov 09 04:41:42.820533 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'efa8cc26-7104-425a-92ab-aeb8d9bb62bc', 'tag': 'c89ba17b-04dd-4269-8d17-8f5d1eac8808'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:41:42.822236 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e4727d81-3107-4dfb-a49b-946b4a3069ac" -d '{"events": [{"name": "network-changed", "server_uuid": "efa8cc26-7104-425a-92ab-aeb8d9bb62bc", "tag": "c89ba17b-04dd-4269-8d17-8f5d1eac8808"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:41:42.847109 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6589eec1-87d7-4425-82f4-eb5067a5f2a9 service neutron] Pushing event updated for resources: {'Port': ['ID=c89ba17b-04dd-4269-8d17-8f5d1eac8808,revision_number=3']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:41:42.864946 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:41:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-75c505f3-be66-42e6-aa15-47a75c1b124c x-openstack-request-id: req-75c505f3-be66-42e6-aa15-47a75c1b124c {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:41:42.865603 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "efa8cc26-7104-425a-92ab-aeb8d9bb62bc", "tag": "c89ba17b-04dd-4269-8d17-8f5d1eac8808", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:41:42.865603 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-75c505f3-be66-42e6-aa15-47a75c1b124c {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:41:42.865932 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'efa8cc26-7104-425a-92ab-aeb8d9bb62bc', 'tag': 'c89ba17b-04dd-4269-8d17-8f5d1eac8808', 'status': 'completed', 'code': 200} Nov 09 04:41:42.945501 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4727d81-3107-4dfb-a49b-946b4a3069ac req-d531f6f9-24ab-4ac2-ab5c-dd824cbf34ef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:42.947190 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e4727d81-3107-4dfb-a49b-946b4a3069ac req-d531f6f9-24ab-4ac2-ab5c-dd824cbf34ef service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&device_id=efa8cc26-7104-425a-92ab-aeb8d9bb62bc HTTP/1.1" status: 200 len: 1096 time: 0.0595644 Nov 09 04:41:43.059978 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ce7ada4-bb69-4f11-968b-355704bfc352 req-4b3d0fef-cbb3-41c1-9c3e-de7187d6381d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:43.063862 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-2ce7ada4-bb69-4f11-968b-355704bfc352 req-4b3d0fef-cbb3-41c1-9c3e-de7187d6381d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=efa8cc26-7104-425a-92ab-aeb8d9bb62bc HTTP/1.1" status: 200 len: 943 time: 0.0931225 Nov 09 04:41:43.093313 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4727d81-3107-4dfb-a49b-946b4a3069ac req-916bf0a5-c8d9-4672-9d92-a35640895ff4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:43.095434 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e4727d81-3107-4dfb-a49b-946b4a3069ac req-916bf0a5-c8d9-4672-9d92-a35640895ff4 service neutron] 10.222.0.26 "GET /v2.0/networks?tenant_id=1d10b4824e524068827e58b55e269af3&shared=False HTTP/1.1" status: 200 len: 898 time: 0.1397927 Nov 09 04:41:43.141615 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-2ce7ada4-bb69-4f11-968b-355704bfc352 req-05c6e579-c838-456d-ac56-a223ef803f70 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=74002bcd-7488-4d42-8508-4a4b8f5fb88a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0623779 Nov 09 04:41:43.194331 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4727d81-3107-4dfb-a49b-946b4a3069ac req-d0a47bc8-638a-4743-8268-b3b126e1cb7e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:43.195808 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e4727d81-3107-4dfb-a49b-946b4a3069ac req-d0a47bc8-638a-4743-8268-b3b126e1cb7e service neutron] 10.222.0.26 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0917523 Nov 09 04:41:43.285262 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34adad88-ba87-409b-a8c2-103f8efd6099 req-73863627-6037-4e97-86ad-081676be64fd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:43.286839 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-34adad88-ba87-409b-a8c2-103f8efd6099 req-73863627-6037-4e97-86ad-081676be64fd service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&device_id=efa8cc26-7104-425a-92ab-aeb8d9bb62bc HTTP/1.1" status: 200 len: 1096 time: 0.0533018 Nov 09 04:41:43.329404 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-34adad88-ba87-409b-a8c2-103f8efd6099 req-f1bbdaf3-4cb4-40b1-9a3b-b947c362ad94 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=c89ba17b-04dd-4269-8d17-8f5d1eac8808 HTTP/1.1" status: 200 len: 217 time: 0.0351458 Nov 09 04:41:43.385679 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34adad88-ba87-409b-a8c2-103f8efd6099 req-2964354d-860b-4703-840f-e4a80b5fe893 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:43.387196 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-34adad88-ba87-409b-a8c2-103f8efd6099 req-2964354d-860b-4703-840f-e4a80b5fe893 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=070d772f-0def-421a-88b5-aa171b2c21ba HTTP/1.1" status: 200 len: 844 time: 0.0506172 Nov 09 04:41:43.434471 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34adad88-ba87-409b-a8c2-103f8efd6099 req-fc79f6c8-2e54-42fc-8d10-3c5d6b228717 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:43.436030 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-34adad88-ba87-409b-a8c2-103f8efd6099 req-fc79f6c8-2e54-42fc-8d10-3c5d6b228717 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=48525ef7-c383-4b41-af35-4362b85562cf&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0422490 Nov 09 04:41:43.531674 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-34adad88-ba87-409b-a8c2-103f8efd6099 req-61734eb4-89b7-4621-8c68-8220c9efe29b service neutron] 10.222.0.26 "GET /v2.0/networks/48525ef7-c383-4b41-af35-4362b85562cf?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0884609 Nov 09 04:41:43.628474 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-34adad88-ba87-409b-a8c2-103f8efd6099 req-37f61759-c358-4a0d-92fa-b29e26b78102 service neutron] 10.222.0.26 "GET /v2.0/networks/48525ef7-c383-4b41-af35-4362b85562cf?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0891125 Nov 09 04:41:43.701000 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-146b36b0-7f29-487c-8471-ee352eb4ed21 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:44.269431 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2ee1238-ff15-478e-9197-1f3738d0e98d req-650a8b9f-fd10-4b5c-becf-2f3571ec864e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:44.271436 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c2ee1238-ff15-478e-9197-1f3738d0e98d req-650a8b9f-fd10-4b5c-becf-2f3571ec864e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=efa8cc26-7104-425a-92ab-aeb8d9bb62bc HTTP/1.1" status: 200 len: 943 time: 0.0495415 Nov 09 04:41:44.321075 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c2ee1238-ff15-478e-9197-1f3738d0e98d req-a99643da-be64-44e7-9abc-de496fa88cd5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=74002bcd-7488-4d42-8508-4a4b8f5fb88a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434272 Nov 09 04:41:45.123718 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:45.435349 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3023f98-9403-4ada-a47f-71a9d95d8c83 req-ed527c0d-a482-466e-a5d6-0331e2abf555 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:45.436823 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b3023f98-9403-4ada-a47f-71a9d95d8c83 req-ed527c0d-a482-466e-a5d6-0331e2abf555 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=efa8cc26-7104-425a-92ab-aeb8d9bb62bc HTTP/1.1" status: 200 len: 943 time: 0.0478561 Nov 09 04:41:45.485610 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b3023f98-9403-4ada-a47f-71a9d95d8c83 req-23af1bd4-85fa-4978-8fd4-f4463e07095e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=74002bcd-7488-4d42-8508-4a4b8f5fb88a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428212 Nov 09 04:41:46.353664 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device c89ba17b-04dd-4269-8d17-8f5d1eac8808 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=102163) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 09 04:41:46.460714 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port c89ba17b-04dd-4269-8d17-8f5d1eac8808, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=c89ba17b-04dd-4269-8d17-8f5d1eac8808,segment=NetworkSegment(776df773-c3a8-4771-9fc6-803dc540938f),segment_id=776df773-c3a8-4771-9fc6-803dc540938f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:41:46.473104 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Returning: {'device': 'c89ba17b-04dd-4269-8d17-8f5d1eac8808', 'network_id': '48525ef7-c383-4b41-af35-4362b85562cf', 'port_id': 'c89ba17b-04dd-4269-8d17-8f5d1eac8808', 'mac_address': 'fa:16:3e:11:25:92', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 349, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '070d772f-0def-421a-88b5-aa171b2c21ba', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102163) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 09 04:41:46.502566 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-10fb5364-382f-466a-8df4-9b08a8d01a16 req-57689c77-ce50-48ee-a3db-94b6895b4aed tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1777462302&fields=id&tenant_id=f636e5f4c9f64f69ba3b2ab8816b6096 HTTP/1.1" status: 200 len: 267 time: 0.0449464 Nov 09 04:41:46.511704 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:46.514836 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:46.526529 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c89ba17b-04dd-4269-8d17-8f5d1eac8808 {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:41:46.548218 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port c89ba17b-04dd-4269-8d17-8f5d1eac8808, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=c89ba17b-04dd-4269-8d17-8f5d1eac8808,segment=NetworkSegment(776df773-c3a8-4771-9fc6-803dc540938f),segment_id=776df773-c3a8-4771-9fc6-803dc540938f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:41:46.605274 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-465d44fa-83a6-4156-ab3d-5e857d320710 req-25cc373d-a860-456c-a609-bc0cd0ff038c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:46.606786 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-465d44fa-83a6-4156-ab3d-5e857d320710 req-25cc373d-a860-456c-a609-bc0cd0ff038c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=efa8cc26-7104-425a-92ab-aeb8d9bb62bc HTTP/1.1" status: 200 len: 943 time: 0.0508549 Nov 09 04:41:46.618033 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:46.624336 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10fb5364-382f-466a-8df4-9b08a8d01a16 req-694a6464-1cbf-47f0-98fc-69b2e040f4cf tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:46.624336 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-10fb5364-382f-466a-8df4-9b08a8d01a16 req-694a6464-1cbf-47f0-98fc-69b2e040f4cf tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/networks?id=999b1b20-f8fc-4caf-84cc-3feda426a0bf HTTP/1.1" status: 200 len: 812 time: 0.1095817 Nov 09 04:41:46.638511 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-10fb5364-382f-466a-8df4-9b08a8d01a16 req-0799f9e0-6c74-47c0-b42b-f641864c8394 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/quotas/f636e5f4c9f64f69ba3b2ab8816b6096 HTTP/1.1" status: 200 len: 375 time: 0.0108941 Nov 09 04:41:46.665598 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=c89ba17b-04dd-4269-8d17-8f5d1eac8808,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:41:46.669724 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-465d44fa-83a6-4156-ab3d-5e857d320710 req-e9e48401-3f82-4315-909b-f85783723ccf tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=74002bcd-7488-4d42-8508-4a4b8f5fb88a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0564063 Nov 09 04:41:46.703100 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-10fb5364-382f-466a-8df4-9b08a8d01a16 req-9bc3561e-0fac-4430-89a1-96833ab763c7 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?tenant_id=f636e5f4c9f64f69ba3b2ab8816b6096&fields=id HTTP/1.1" status: 200 len: 440 time: 0.0568378 Nov 09 04:41:46.802517 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-10fb5364-382f-466a-8df4-9b08a8d01a16 req-9f531150-86ca-4bcc-96d6-71d3297608c0 service neutron] 10.222.0.24 "GET /v2.0/networks/999b1b20-f8fc-4caf-84cc-3feda426a0bf?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0862303 Nov 09 04:41:46.840468 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['c89ba17b-04dd-4269-8d17-8f5d1eac8808'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 04:41:46.893352 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-10fb5364-382f-466a-8df4-9b08a8d01a16 req-0f52d3e4-7bf9-423f-b17d-d4cf437b53aa service neutron] 10.222.0.24 "GET /v2.0/networks/999b1b20-f8fc-4caf-84cc-3feda426a0bf?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0842211 Nov 09 04:41:46.960959 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:47.543464 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-9b8aedef-1982-43a9-b67c-d6b69c180c39 req-ababf183-044a-4fb8-8486-ace78e9f5718 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=255f168a-466b-4fcf-8478-32dab054b831 HTTP/1.1" status: 200 len: 210 time: 0.0304754 Nov 09 04:41:47.787061 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd69bc12-952d-4b5a-b402-cdf248726aaa req-83020833-a0f0-411a-87d8-8875725dc5b0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:47.788523 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-cd69bc12-952d-4b5a-b402-cdf248726aaa req-83020833-a0f0-411a-87d8-8875725dc5b0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=efa8cc26-7104-425a-92ab-aeb8d9bb62bc HTTP/1.1" status: 200 len: 944 time: 0.0501645 Nov 09 04:41:47.842883 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-cd69bc12-952d-4b5a-b402-cdf248726aaa req-875b9865-7d9b-4dc3-adca-add116a190ff tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=74002bcd-7488-4d42-8508-4a4b8f5fb88a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0476294 Nov 09 04:41:48.353624 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device c89ba17b-04dd-4269-8d17-8f5d1eac8808 up at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:41:48.468890 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning for port c89ba17b-04dd-4269-8d17-8f5d1eac8808 completed by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 09 04:41:48.472890 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning complete for port c89ba17b-04dd-4269-8d17-8f5d1eac8808 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:41:48.474234 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:48.550052 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:48.573143 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'efa8cc26-7104-425a-92ab-aeb8d9bb62bc', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c89ba17b-04dd-4269-8d17-8f5d1eac8808'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:41:48.575436 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-daedcf8a-7aa3-4e81-ba52-c03004f50934" -d '{"events": [{"server_uuid": "efa8cc26-7104-425a-92ab-aeb8d9bb62bc", "name": "network-vif-plugged", "status": "completed", "tag": "c89ba17b-04dd-4269-8d17-8f5d1eac8808"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:41:48.588284 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port c89ba17b-04dd-4269-8d17-8f5d1eac8808, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=c89ba17b-04dd-4269-8d17-8f5d1eac8808,segment=NetworkSegment(776df773-c3a8-4771-9fc6-803dc540938f),segment_id=776df773-c3a8-4771-9fc6-803dc540938f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:41:48.615631 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:41:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0d51df63-7037-48d9-9eb8-94875fa8ea95 x-openstack-request-id: req-0d51df63-7037-48d9-9eb8-94875fa8ea95 {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:41:48.621908 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "efa8cc26-7104-425a-92ab-aeb8d9bb62bc", "name": "network-vif-plugged", "status": "completed", "tag": "c89ba17b-04dd-4269-8d17-8f5d1eac8808", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:41:48.621908 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-0d51df63-7037-48d9-9eb8-94875fa8ea95 {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:41:48.621908 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'efa8cc26-7104-425a-92ab-aeb8d9bb62bc', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c89ba17b-04dd-4269-8d17-8f5d1eac8808', 'code': 200} Nov 09 04:41:48.640594 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:48.645118 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-cd41e706-e96d-435f-a03c-a2f6c5785ecf req-7c4eaab6-c579-4d5d-aec4-0d8b3d5de6c9 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=255f168a-466b-4fcf-8478-32dab054b831 HTTP/1.1" status: 200 len: 210 time: 0.0329344 Nov 09 04:41:48.692180 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=c89ba17b-04dd-4269-8d17-8f5d1eac8808,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:41:48.986646 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5e84fdc-d133-46cf-84c3-4e906e924b33 req-dacd9696-0169-4426-aa9c-f1a0a9a03be2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:48.988116 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d5e84fdc-d133-46cf-84c3-4e906e924b33 req-dacd9696-0169-4426-aa9c-f1a0a9a03be2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=efa8cc26-7104-425a-92ab-aeb8d9bb62bc HTTP/1.1" status: 200 len: 945 time: 0.0742755 Nov 09 04:41:49.001897 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8a159c0-017e-4093-b9fe-8414955581eb req-355086bc-2e35-4614-aaa2-5880064c17c9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:49.003293 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c8a159c0-017e-4093-b9fe-8414955581eb req-355086bc-2e35-4614-aaa2-5880064c17c9 service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=efa8cc26-7104-425a-92ab-aeb8d9bb62bc HTTP/1.1" status: 200 len: 1098 time: 0.0567420 Nov 09 04:41:49.070489 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d5e84fdc-d133-46cf-84c3-4e906e924b33 req-a5bd09f4-0a4f-495f-9c36-260091c4e740 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=74002bcd-7488-4d42-8508-4a4b8f5fb88a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0760298 Nov 09 04:41:49.078404 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c8a159c0-017e-4093-b9fe-8414955581eb req-115e8cc2-95b0-4872-8664-c5cdfd944e2e service neutron] 10.222.0.26 "GET /v2.0/security-groups?id=74002bcd-7488-4d42-8508-4a4b8f5fb88a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0657492 Nov 09 04:41:49.739859 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-7d5d556e-3149-44f7-a921-13e5a35bd387 req-228f4bb7-7413-4857-acf7-4285b8d9518e tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=255f168a-466b-4fcf-8478-32dab054b831 HTTP/1.1" status: 200 len: 210 time: 0.0271001 Nov 09 04:41:49.792807 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10fb5364-382f-466a-8df4-9b08a8d01a16 req-57182841-f747-4066-b967-a4d3d039dea1 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:49.794275 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-10fb5364-382f-466a-8df4-9b08a8d01a16 req-57182841-f747-4066-b967-a4d3d039dea1 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.26 "GET /v2.0/networks?id=999b1b20-f8fc-4caf-84cc-3feda426a0bf HTTP/1.1" status: 200 len: 812 time: 0.1041162 Nov 09 04:41:49.858637 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-10fb5364-382f-466a-8df4-9b08a8d01a16 req-5eac59cb-e86e-4f9e-8736-371876aeb73a tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.26 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=f636e5f4c9f64f69ba3b2ab8816b6096 HTTP/1.1" status: 200 len: 380 time: 0.0532570 Nov 09 04:41:49.870323 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-10fb5364-382f-466a-8df4-9b08a8d01a16 req-38393b7a-bb3f-4fa0-8d64-8c28af0b11b9 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Request body: {'port': {'device_id': '255f168a-466b-4fcf-8478-32dab054b831', 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf', 'admin_state_up': True, 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'security_groups': ['3fac99c0-db5e-4deb-ae03-d7c28ceb1106']}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:41:50.073964 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-10fb5364-382f-466a-8df4-9b08a8d01a16 req-38393b7a-bb3f-4fa0-8d64-8c28af0b11b9 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Made reservation on behalf of f636e5f4c9f64f69ba3b2ab8816b6096 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:41:50.077851 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-10fb5364-382f-466a-8df4-9b08a8d01a16 req-38393b7a-bb3f-4fa0-8d64-8c28af0b11b9 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:50.237847 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59eb369e-3868-4826-b1db-6c400ab52b58 req-d979a55d-d8d7-4859-8272-bf6e677699d1 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:50.239264 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-59eb369e-3868-4826-b1db-6c400ab52b58 req-d979a55d-d8d7-4859-8272-bf6e677699d1 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=efa8cc26-7104-425a-92ab-aeb8d9bb62bc HTTP/1.1" status: 200 len: 945 time: 0.0971828 Nov 09 04:41:50.247267 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [req-10fb5364-382f-466a-8df4-9b08a8d01a16 req-38393b7a-bb3f-4fa0-8d64-8c28af0b11b9 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Allocated IP 172.20.0.9 (999b1b20-f8fc-4caf-84cc-3feda426a0bf/f6a08667-654b-4e0c-9f85-c6e6712cc239/9020ebb6-3d21-44a2-80fa-7c78665742e4) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:41:50.318946 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-59eb369e-3868-4826-b1db-6c400ab52b58 req-0a7c9ad1-9765-4fcc-9e5e-44c42761210d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=74002bcd-7488-4d42-8508-4a4b8f5fb88a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0735486 Nov 09 04:41:50.421523 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-10fb5364-382f-466a-8df4-9b08a8d01a16 req-38393b7a-bb3f-4fa0-8d64-8c28af0b11b9 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:50.536228 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-10fb5364-382f-466a-8df4-9b08a8d01a16 req-38393b7a-bb3f-4fa0-8d64-8c28af0b11b9 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:50.578206 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-10fb5364-382f-466a-8df4-9b08a8d01a16 req-38393b7a-bb3f-4fa0-8d64-8c28af0b11b9 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Network 999b1b20-f8fc-4caf-84cc-3feda426a0bf is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:41:50.583231 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [req-10fb5364-382f-466a-8df4-9b08a8d01a16 req-38393b7a-bb3f-4fa0-8d64-8c28af0b11b9 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:41:50.586978 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-10fb5364-382f-466a-8df4-9b08a8d01a16 req-38393b7a-bb3f-4fa0-8d64-8c28af0b11b9 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:41:50.613627 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38393b7a-bb3f-4fa0-8d64-8c28af0b11b9 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Pushing event updated for resources: {'Port': ['ID=9020ebb6-3d21-44a2-80fa-7c78665742e4,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:41:50.640884 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10fb5364-382f-466a-8df4-9b08a8d01a16 req-38393b7a-bb3f-4fa0-8d64-8c28af0b11b9 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:50.641832 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-10fb5364-382f-466a-8df4-9b08a8d01a16 req-38393b7a-bb3f-4fa0-8d64-8c28af0b11b9 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:50.712093 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-10fb5364-382f-466a-8df4-9b08a8d01a16 req-38393b7a-bb3f-4fa0-8d64-8c28af0b11b9 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.26 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8453047 Nov 09 04:41:50.724575 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-10fb5364-382f-466a-8df4-9b08a8d01a16 req-39775145-9abc-4c4d-864c-b31fd6d77324 service neutron] Request body: {'port': {'device_id': '255f168a-466b-4fcf-8478-32dab054b831', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:41:50.786016 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-10fb5364-382f-466a-8df4-9b08a8d01a16 req-39775145-9abc-4c4d-864c-b31fd6d77324 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:50.835455 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-538ecb77-b8ef-4846-b6dc-d745f246aa74 None None] Provisioning complete for port 9020ebb6-3d21-44a2-80fa-7c78665742e4 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:41:50.836589 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-538ecb77-b8ef-4846-b6dc-d745f246aa74 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:50.861608 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e4bd512-22dc-428b-b975-64d6d2a9ab17 req-3671c42f-e4de-46a5-b70a-216e9613aa72 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:50.870126 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-6e4bd512-22dc-428b-b975-64d6d2a9ab17 req-3671c42f-e4de-46a5-b70a-216e9613aa72 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=255f168a-466b-4fcf-8478-32dab054b831 HTTP/1.1" status: 200 len: 931 time: 0.0595262 Nov 09 04:41:50.887570 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-538ecb77-b8ef-4846-b6dc-d745f246aa74 None None] Port 9020ebb6-3d21-44a2-80fa-7c78665742e4 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:41:50.931211 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-6e4bd512-22dc-428b-b975-64d6d2a9ab17 req-baf317b4-0c90-4a54-930a-eff5e7ffd359 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0591283 Nov 09 04:41:51.067019 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [req-10fb5364-382f-466a-8df4-9b08a8d01a16 req-39775145-9abc-4c4d-864c-b31fd6d77324 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 9020ebb6-3d21-44a2-80fa-7c78665742e4 {{(pid=102162) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:41:51.075104 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-10fb5364-382f-466a-8df4-9b08a8d01a16 req-39775145-9abc-4c4d-864c-b31fd6d77324 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:51.089477 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.provisioning_blocks [req-10fb5364-382f-466a-8df4-9b08a8d01a16 req-39775145-9abc-4c4d-864c-b31fd6d77324 service neutron] Transition to ACTIVE for port object 9020ebb6-3d21-44a2-80fa-7c78665742e4 will not be triggered until provisioned by entity L2. {{(pid=102162) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 09 04:41:51.187933 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-10fb5364-382f-466a-8df4-9b08a8d01a16 req-39775145-9abc-4c4d-864c-b31fd6d77324 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:51.240516 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39775145-9abc-4c4d-864c-b31fd6d77324 service neutron] Pushing event updated for resources: {'Port': ['ID=9020ebb6-3d21-44a2-80fa-7c78665742e4,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:41:51.312260 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-10fb5364-382f-466a-8df4-9b08a8d01a16 req-39775145-9abc-4c4d-864c-b31fd6d77324 service neutron] Attempting to bind port 9020ebb6-3d21-44a2-80fa-7c78665742e4 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:41:51.312635 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-10fb5364-382f-466a-8df4-9b08a8d01a16 req-39775145-9abc-4c4d-864c-b31fd6d77324 service neutron] Attempting to bind port 9020ebb6-3d21-44a2-80fa-7c78665742e4 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'bc4577c9-06a5-450a-9c80-879827986f04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:41:51.312969 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-10fb5364-382f-466a-8df4-9b08a8d01a16 req-39775145-9abc-4c4d-864c-b31fd6d77324 service neutron] Attempting to bind port 9020ebb6-3d21-44a2-80fa-7c78665742e4 on network 999b1b20-f8fc-4caf-84cc-3feda426a0bf {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:41:51.317671 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-10fb5364-382f-466a-8df4-9b08a8d01a16 req-39775145-9abc-4c4d-864c-b31fd6d77324 service neutron] Port 9020ebb6-3d21-44a2-80fa-7c78665742e4 on network 999b1b20-f8fc-4caf-84cc-3feda426a0bf not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:41:51.317991 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-10fb5364-382f-466a-8df4-9b08a8d01a16 req-39775145-9abc-4c4d-864c-b31fd6d77324 service neutron] Attempting to bind port 9020ebb6-3d21-44a2-80fa-7c78665742e4 on network 999b1b20-f8fc-4caf-84cc-3feda426a0bf {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:41:51.323930 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-10fb5364-382f-466a-8df4-9b08a8d01a16 req-39775145-9abc-4c4d-864c-b31fd6d77324 service neutron] Checking agent: {'id': '7d36b884-4ad2-4878-9464-bf647030b544', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'started_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 41, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:41:51.324265 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-10fb5364-382f-466a-8df4-9b08a8d01a16 req-39775145-9abc-4c4d-864c-b31fd6d77324 service neutron] Checking segment: {'id': 'bc4577c9-06a5-450a-9c80-879827986f04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:41:51.324646 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-10fb5364-382f-466a-8df4-9b08a8d01a16 req-39775145-9abc-4c4d-864c-b31fd6d77324 service neutron] Bound using segment: {'id': 'bc4577c9-06a5-450a-9c80-879827986f04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf'} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:41:51.325071 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-10fb5364-382f-466a-8df4-9b08a8d01a16 req-39775145-9abc-4c4d-864c-b31fd6d77324 service neutron] Bound port: 9020ebb6-3d21-44a2-80fa-7c78665742e4, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'bc4577c9-06a5-450a-9c80-879827986f04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf'}}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:41:51.325430 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-10fb5364-382f-466a-8df4-9b08a8d01a16 req-39775145-9abc-4c4d-864c-b31fd6d77324 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:51.416392 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-10fb5364-382f-466a-8df4-9b08a8d01a16 req-39775145-9abc-4c4d-864c-b31fd6d77324 service neutron] For port 9020ebb6-3d21-44a2-80fa-7c78665742e4, host hv-neutron-8168, cleared binding levels {{(pid=102162) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:41:51.443022 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-10fb5364-382f-466a-8df4-9b08a8d01a16 req-39775145-9abc-4c4d-864c-b31fd6d77324 service neutron] For port 9020ebb6-3d21-44a2-80fa-7c78665742e4, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=9020ebb6-3d21-44a2-80fa-7c78665742e4,segment=NetworkSegment(bc4577c9-06a5-450a-9c80-879827986f04),segment_id=bc4577c9-06a5-450a-9c80-879827986f04)] {{(pid=102162) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:41:51.463999 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a850d20-45ed-42c2-a37c-54370b0c84f2 req-8f7e81c5-14c9-4382-a891-71a5a951bec3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:51.465520 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6a850d20-45ed-42c2-a37c-54370b0c84f2 req-8f7e81c5-14c9-4382-a891-71a5a951bec3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=efa8cc26-7104-425a-92ab-aeb8d9bb62bc HTTP/1.1" status: 200 len: 945 time: 0.0639496 Nov 09 04:41:51.471500 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:41:51.519695 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-10fb5364-382f-466a-8df4-9b08a8d01a16 req-39775145-9abc-4c4d-864c-b31fd6d77324 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:51.555397 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6a850d20-45ed-42c2-a37c-54370b0c84f2 req-8543ec97-032d-40b1-835c-b20782466874 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=74002bcd-7488-4d42-8508-4a4b8f5fb88a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0827270 Nov 09 04:41:51.567032 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10fb5364-382f-466a-8df4-9b08a8d01a16 req-39775145-9abc-4c4d-864c-b31fd6d77324 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:51.567647 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-10fb5364-382f-466a-8df4-9b08a8d01a16 req-39775145-9abc-4c4d-864c-b31fd6d77324 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:51.569200 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-10fb5364-382f-466a-8df4-9b08a8d01a16 req-39775145-9abc-4c4d-864c-b31fd6d77324 service neutron] 10.222.0.26 "PUT /v2.0/ports/9020ebb6-3d21-44a2-80fa-7c78665742e4 HTTP/1.1" status: 200 len: 1093 time: 0.8491685 Nov 09 04:41:51.569804 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '255f168a-466b-4fcf-8478-32dab054b831', 'tag': '9020ebb6-3d21-44a2-80fa-7c78665742e4'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:41:51.572441 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b890919e-bc51-4f75-9d9a-6d5acc39e49f" -d '{"events": [{"name": "network-changed", "server_uuid": "255f168a-466b-4fcf-8478-32dab054b831", "tag": "9020ebb6-3d21-44a2-80fa-7c78665742e4"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:41:51.601000 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39775145-9abc-4c4d-864c-b31fd6d77324 service neutron] Pushing event updated for resources: {'Port': ['ID=9020ebb6-3d21-44a2-80fa-7c78665742e4,revision_number=3']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:41:51.629936 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:41:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3e1cb40d-f53f-4f1f-9968-6d293215335d x-openstack-request-id: req-3e1cb40d-f53f-4f1f-9968-6d293215335d {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:41:51.630220 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "255f168a-466b-4fcf-8478-32dab054b831", "tag": "9020ebb6-3d21-44a2-80fa-7c78665742e4", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:41:51.630509 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-3e1cb40d-f53f-4f1f-9968-6d293215335d {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:41:51.630909 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '255f168a-466b-4fcf-8478-32dab054b831', 'tag': '9020ebb6-3d21-44a2-80fa-7c78665742e4', 'status': 'completed', 'code': 200} Nov 09 04:41:51.725387 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b890919e-bc51-4f75-9d9a-6d5acc39e49f req-ab73e4d9-cb74-4f87-8bab-9c18cee36c0d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:51.729804 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b890919e-bc51-4f75-9d9a-6d5acc39e49f req-ab73e4d9-cb74-4f87-8bab-9c18cee36c0d service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=f636e5f4c9f64f69ba3b2ab8816b6096&device_id=255f168a-466b-4fcf-8478-32dab054b831 HTTP/1.1" status: 200 len: 1096 time: 0.0738199 Nov 09 04:41:51.739670 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a753a96d-cd00-4011-9054-9a74c746229f req-ec93630b-269d-4134-9c33-9c13beaeaf16 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:51.741160 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a753a96d-cd00-4011-9054-9a74c746229f req-ec93630b-269d-4134-9c33-9c13beaeaf16 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=efa8cc26-7104-425a-92ab-aeb8d9bb62bc HTTP/1.1" status: 200 len: 945 time: 0.0773938 Nov 09 04:41:51.859767 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a753a96d-cd00-4011-9054-9a74c746229f req-68c3d33e-4ecb-49b0-9120-cee69053e98e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=74002bcd-7488-4d42-8508-4a4b8f5fb88a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0946383 Nov 09 04:41:51.872981 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b890919e-bc51-4f75-9d9a-6d5acc39e49f req-d291d595-04b6-4e6d-85eb-443ad14a852b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:51.874608 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b890919e-bc51-4f75-9d9a-6d5acc39e49f req-d291d595-04b6-4e6d-85eb-443ad14a852b service neutron] 10.222.0.26 "GET /v2.0/networks?tenant_id=f636e5f4c9f64f69ba3b2ab8816b6096&shared=False HTTP/1.1" status: 200 len: 913 time: 0.1323531 Nov 09 04:41:51.886919 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60926) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:41:51.931705 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-14e00092-7b3f-4568-9b82-8ac7fcbb9c8a tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:51.936019 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-14e00092-7b3f-4568-9b82-8ac7fcbb9c8a tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/ports?device_id=efa8cc26-7104-425a-92ab-aeb8d9bb62bc HTTP/1.1" status: 200 len: 1093 time: 0.0456018 Nov 09 04:41:51.936270 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60928) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:41:51.941134 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-b2bc5615-698e-4158-909b-185a7f4cb282 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'floatingip': {'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'port_id': 'c89ba17b-04dd-4269-8d17-8f5d1eac8808', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ip_address': '172.20.0.8'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:41:51.989158 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b890919e-bc51-4f75-9d9a-6d5acc39e49f req-0f9d0a78-9bc0-481a-b68c-4899ec7ca658 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:51.990840 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b890919e-bc51-4f75-9d9a-6d5acc39e49f req-0f9d0a78-9bc0-481a-b68c-4899ec7ca658 service neutron] 10.222.0.26 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1079607 Nov 09 04:41:52.043306 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eabc8529-e83b-4326-af79-a56e12ea3fc8 req-20cde932-ef62-4014-852a-7a0741768956 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:52.044909 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-eabc8529-e83b-4326-af79-a56e12ea3fc8 req-20cde932-ef62-4014-852a-7a0741768956 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=255f168a-466b-4fcf-8478-32dab054b831 HTTP/1.1" status: 200 len: 943 time: 0.0495892 Nov 09 04:41:52.073317 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10fb5364-382f-466a-8df4-9b08a8d01a16 req-dd4e388a-1891-4ee7-ba3c-86c617a5350c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:52.075300 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-10fb5364-382f-466a-8df4-9b08a8d01a16 req-dd4e388a-1891-4ee7-ba3c-86c617a5350c service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=f636e5f4c9f64f69ba3b2ab8816b6096&device_id=255f168a-466b-4fcf-8478-32dab054b831 HTTP/1.1" status: 200 len: 1096 time: 0.0467789 Nov 09 04:41:52.089133 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b2bc5615-698e-4158-909b-185a7f4cb282 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for floatingip, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:52.121742 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-10fb5364-382f-466a-8df4-9b08a8d01a16 req-493e9c6e-e337-4f1f-956b-23826c8a937d service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=9020ebb6-3d21-44a2-80fa-7c78665742e4 HTTP/1.1" status: 200 len: 217 time: 0.0370317 Nov 09 04:41:52.127120 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-eabc8529-e83b-4326-af79-a56e12ea3fc8 req-dbe0b4d0-402c-4da4-ac2d-02b177f94987 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0757365 Nov 09 04:41:52.178961 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10fb5364-382f-466a-8df4-9b08a8d01a16 req-f5c98c65-3b97-4285-9dc3-c858cf225d29 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:52.180427 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-10fb5364-382f-466a-8df4-9b08a8d01a16 req-f5c98c65-3b97-4285-9dc3-c858cf225d29 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=f6a08667-654b-4e0c-9f85-c6e6712cc239 HTTP/1.1" status: 200 len: 851 time: 0.0518684 Nov 09 04:41:52.222766 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b2bc5615-698e-4158-909b-185a7f4cb282 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:52.232072 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10fb5364-382f-466a-8df4-9b08a8d01a16 req-37c21d5c-8cf9-451c-a1c4-b79fce9657d6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:52.233640 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-10fb5364-382f-466a-8df4-9b08a8d01a16 req-37c21d5c-8cf9-451c-a1c4-b79fce9657d6 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=999b1b20-f8fc-4caf-84cc-3feda426a0bf&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0462081 Nov 09 04:41:52.330184 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-b2bc5615-698e-4158-909b-185a7f4cb282 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Allocated IP 172.26.0.102 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/28b98abe-4b0d-440e-9ebe-c0d73636a30c) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:41:52.331835 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-10fb5364-382f-466a-8df4-9b08a8d01a16 req-161bb8d0-2177-49d6-99e2-7fa2b7c6c75b service neutron] 10.222.0.26 "GET /v2.0/networks/999b1b20-f8fc-4caf-84cc-3feda426a0bf?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0888941 Nov 09 04:41:52.444122 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-10fb5364-382f-466a-8df4-9b08a8d01a16 req-499057e7-ff8b-4613-8e27-7dc3dc7d4c66 service neutron] 10.222.0.26 "GET /v2.0/networks/999b1b20-f8fc-4caf-84cc-3feda426a0bf?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1036599 Nov 09 04:41:52.450223 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b2bc5615-698e-4158-909b-185a7f4cb282 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:52.635809 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b2bc5615-698e-4158-909b-185a7f4cb282 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:52.672585 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b2bc5615-698e-4158-909b-185a7f4cb282 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:41:52.675299 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-b2bc5615-698e-4158-909b-185a7f4cb282 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:41:52.680779 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b2bc5615-698e-4158-909b-185a7f4cb282 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:41:52.705804 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2bc5615-698e-4158-909b-185a7f4cb282 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Port': ['ID=28b98abe-4b0d-440e-9ebe-c0d73636a30c,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:41:53.255651 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19f34939-84e5-4fbb-afc4-c10932dafa43 req-468206e0-bc78-4de7-a157-3b4b0ff755c7 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:53.258060 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-19f34939-84e5-4fbb-afc4-c10932dafa43 req-468206e0-bc78-4de7-a157-3b4b0ff755c7 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=255f168a-466b-4fcf-8478-32dab054b831 HTTP/1.1" status: 200 len: 943 time: 0.0591726 Nov 09 04:41:53.323056 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-19f34939-84e5-4fbb-afc4-c10932dafa43 req-50b05eb5-22a0-4d95-9175-212aa26fefc6 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0562377 Nov 09 04:41:53.344038 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b2bc5615-698e-4158-909b-185a7f4cb282 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:53.539385 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b2bc5615-698e-4158-909b-185a7f4cb282 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:53.692239 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b2bc5615-698e-4158-909b-185a7f4cb282 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:53.769224 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b2bc5615-698e-4158-909b-185a7f4cb282 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:53.836913 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2bc5615-698e-4158-909b-185a7f4cb282 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Port': ['ID=28b98abe-4b0d-440e-9ebe-c0d73636a30c,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:41:53.850797 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b2bc5615-698e-4158-909b-185a7f4cb282 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:53.953101 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.l3_db [None req-b2bc5615-698e-4158-909b-185a7f4cb282 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Floating IP 52a062f1-dbcf-42fe-9c80-06ac6e9d9151 associated. External IP: 172.26.0.102, port: c89ba17b-04dd-4269-8d17-8f5d1eac8808. Nov 09 04:41:54.159742 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b2bc5615-698e-4158-909b-185a7f4cb282 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Router f13bdef0-14e2-4965-81f3-edd791830726 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:41:54.277783 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b2bc5615-698e-4158-909b-185a7f4cb282 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:41:54.288765 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a9fae32-a447-4f5b-ad15-3b7c49d839f2 None None] Sync routers for ids ['f13bdef0-14e2-4965-81f3-edd791830726'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:41:54.298722 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a9fae32-a447-4f5b-ad15-3b7c49d839f2 None None] Routers {'f13bdef0-14e2-4965-81f3-edd791830726'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:41:54.302781 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-4a9fae32-a447-4f5b-ad15-3b7c49d839f2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:41:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['f13bdef0-14e2-4965-81f3-edd791830726'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:41:54.345449 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b2bc5615-698e-4158-909b-185a7f4cb282 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:41:54.384212 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-b2bc5615-698e-4158-909b-185a7f4cb282 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.4468246 Nov 09 04:41:54.385416 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'efa8cc26-7104-425a-92ab-aeb8d9bb62bc', 'tag': 'c89ba17b-04dd-4269-8d17-8f5d1eac8808'}] {{(pid=102161) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:41:54.387530 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 60936) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:41:54.394593 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}99dfdda0def497b4372884ef2eb87f06b1e425c8eba5ceda5f64bbab037a07d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f9e00c2b-49d8-4274-a23d-810c2002674a" -d '{"events": [{"name": "network-changed", "server_uuid": "efa8cc26-7104-425a-92ab-aeb8d9bb62bc", "tag": "c89ba17b-04dd-4269-8d17-8f5d1eac8808"}]}' {{(pid=102161) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:41:54.433030 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-4a9fae32-a447-4f5b-ad15-3b7c49d839f2 None None] Set router f13bdef0-14e2-4965-81f3-edd791830726 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:41:54.463790 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:41:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0b4eb29f-d595-4863-9b53-45ebc98875a2 x-openstack-request-id: req-0b4eb29f-d595-4863-9b53-45ebc98875a2 {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:41:54.464815 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "efa8cc26-7104-425a-92ab-aeb8d9bb62bc", "tag": "c89ba17b-04dd-4269-8d17-8f5d1eac8808", "status": "completed", "code": 200}]} {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:41:54.465237 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-0b4eb29f-d595-4863-9b53-45ebc98875a2 {{(pid=102161) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:41:54.465807 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'efa8cc26-7104-425a-92ab-aeb8d9bb62bc', 'tag': 'c89ba17b-04dd-4269-8d17-8f5d1eac8808', 'status': 'completed', 'code': 200} Nov 09 04:41:54.493155 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be9a2849-8d55-4669-9b84-84c8b9180f94 req-4e17c610-22ff-452a-9024-3e97cbc0f62b tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:54.502169 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-be9a2849-8d55-4669-9b84-84c8b9180f94 req-4e17c610-22ff-452a-9024-3e97cbc0f62b tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=255f168a-466b-4fcf-8478-32dab054b831 HTTP/1.1" status: 200 len: 943 time: 0.0928388 Nov 09 04:41:54.513933 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-6a574997-84f4-409c-9873-ebd9914a6315 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/floatingips/52a062f1-dbcf-42fe-9c80-06ac6e9d9151 HTTP/1.1" status: 200 len: 991 time: 0.1250005 Nov 09 04:41:54.530946 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9e00c2b-49d8-4274-a23d-810c2002674a req-57a8b796-c3c1-4cba-83f7-84b3612d15e2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:54.532564 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f9e00c2b-49d8-4274-a23d-810c2002674a req-57a8b796-c3c1-4cba-83f7-84b3612d15e2 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&device_id=efa8cc26-7104-425a-92ab-aeb8d9bb62bc HTTP/1.1" status: 200 len: 1098 time: 0.0516300 Nov 09 04:41:54.584623 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-be9a2849-8d55-4669-9b84-84c8b9180f94 req-48447b59-0fee-42f4-9368-5688d781473f tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0815387 Nov 09 04:41:54.651227 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9e00c2b-49d8-4274-a23d-810c2002674a req-c34d2629-123b-4b30-8459-aba5a1cc184d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:54.652839 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f9e00c2b-49d8-4274-a23d-810c2002674a req-c34d2629-123b-4b30-8459-aba5a1cc184d service neutron] 10.222.0.26 "GET /v2.0/networks?id=48525ef7-c383-4b41-af35-4362b85562cf HTTP/1.1" status: 200 len: 898 time: 0.1115720 Nov 09 04:41:54.700916 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-4a9fae32-a447-4f5b-ad15-3b7c49d839f2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f13bdef0-14e2-4965-81f3-edd791830726', 'name': 'tempest-TestNetworkBasicOps-router-952339284', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.194'}], 'enable_snat': True}, 'gw_port_id': 'ec5fce5b-ee83-4955-8947-4ecdfe3bce2b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:41:28Z', 'updated_at': '2021-11-09T04:41:32Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': 'ec5fce5b-ee83-4955-8947-4ecdfe3bce2b', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:8e:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f13bdef0-14e2-4965-81f3-edd791830726', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1455, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:41:28Z', 'updated_at': '2021-11-09T04:41:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '52a062f1-dbcf-42fe-9c80-06ac6e9d9151', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'floating_ip_address': '172.26.0.102', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': 'f13bdef0-14e2-4965-81f3-edd791830726', 'port_id': 'c89ba17b-04dd-4269-8d17-8f5d1eac8808', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 1471, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '48525ef7-c383-4b41-af35-4362b85562cf', 'mac_address': 'fa:16:3e:11:25:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'efa8cc26-7104-425a-92ab-aeb8d9bb62bc', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:41:52Z', 'updated_at': '2021-11-09T04:41:52Z', 'revision_number': 0, 'project_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '064e1a31-61b7-44c2-be25-3ad23c3252e1', 'name': '', 'network_id': '48525ef7-c383-4b41-af35-4362b85562cf', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:2a:e3:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f13bdef0-14e2-4965-81f3-edd791830726', 'device_owner': 'network:router_interface', 'standard_attr_id': 1458, 'fixed_ips': [{'subnet_id': '070d772f-0def-421a-88b5-aa171b2c21ba', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:41:32Z', 'updated_at': '2021-11-09T04:41:35Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '070d772f-0def-421a-88b5-aa171b2c21ba', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': ['1.2.3.4'], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:41:54.721296 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f9e00c2b-49d8-4274-a23d-810c2002674a req-fbb2ae3a-3696-47e6-a265-54f7a5a25daa service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=c89ba17b-04dd-4269-8d17-8f5d1eac8808 HTTP/1.1" status: 200 len: 999 time: 0.0614491 Nov 09 04:41:54.726726 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a9fae32-a447-4f5b-ad15-3b7c49d839f2 None None] Checking router: f13bdef0-14e2-4965-81f3-edd791830726 for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:41:54.735049 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a9fae32-a447-4f5b-ad15-3b7c49d839f2 None None] Routers {'f13bdef0-14e2-4965-81f3-edd791830726'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:41:54.735644 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-4a9fae32-a447-4f5b-ad15-3b7c49d839f2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:41:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['f13bdef0-14e2-4965-81f3-edd791830726'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:41:54.772297 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9e00c2b-49d8-4274-a23d-810c2002674a req-f6756216-5091-4335-b736-6941585bf401 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:54.774055 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f9e00c2b-49d8-4274-a23d-810c2002674a req-f6756216-5091-4335-b736-6941585bf401 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=070d772f-0def-421a-88b5-aa171b2c21ba HTTP/1.1" status: 200 len: 844 time: 0.0461264 Nov 09 04:41:54.826668 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9e00c2b-49d8-4274-a23d-810c2002674a req-388be48b-552f-4558-a951-972ea389552a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:54.828510 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f9e00c2b-49d8-4274-a23d-810c2002674a req-388be48b-552f-4558-a951-972ea389552a service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=48525ef7-c383-4b41-af35-4362b85562cf&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0468378 Nov 09 04:41:54.841576 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-4a9fae32-a447-4f5b-ad15-3b7c49d839f2 None None] Set router f13bdef0-14e2-4965-81f3-edd791830726 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:41:54.927122 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f9e00c2b-49d8-4274-a23d-810c2002674a req-826cd0b5-7969-4886-ad2d-65df2ebed95a service neutron] 10.222.0.26 "GET /v2.0/networks/48525ef7-c383-4b41-af35-4362b85562cf?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0909212 Nov 09 04:41:55.023994 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f9e00c2b-49d8-4274-a23d-810c2002674a req-c446f0f0-6810-4454-b668-a56670bb8089 service neutron] 10.222.0.26 "GET /v2.0/networks/48525ef7-c383-4b41-af35-4362b85562cf?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0896704 Nov 09 04:41:55.077027 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-4a9fae32-a447-4f5b-ad15-3b7c49d839f2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f13bdef0-14e2-4965-81f3-edd791830726', 'name': 'tempest-TestNetworkBasicOps-router-952339284', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.194'}], 'enable_snat': True}, 'gw_port_id': 'ec5fce5b-ee83-4955-8947-4ecdfe3bce2b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:41:28Z', 'updated_at': '2021-11-09T04:41:32Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': 'ec5fce5b-ee83-4955-8947-4ecdfe3bce2b', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:8e:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f13bdef0-14e2-4965-81f3-edd791830726', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1455, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:41:28Z', 'updated_at': '2021-11-09T04:41:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '52a062f1-dbcf-42fe-9c80-06ac6e9d9151', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'floating_ip_address': '172.26.0.102', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': 'f13bdef0-14e2-4965-81f3-edd791830726', 'port_id': 'c89ba17b-04dd-4269-8d17-8f5d1eac8808', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 1471, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '48525ef7-c383-4b41-af35-4362b85562cf', 'mac_address': 'fa:16:3e:11:25:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'efa8cc26-7104-425a-92ab-aeb8d9bb62bc', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:41:52Z', 'updated_at': '2021-11-09T04:41:52Z', 'revision_number': 0, 'project_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '064e1a31-61b7-44c2-be25-3ad23c3252e1', 'name': '', 'network_id': '48525ef7-c383-4b41-af35-4362b85562cf', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:2a:e3:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f13bdef0-14e2-4965-81f3-edd791830726', 'device_owner': 'network:router_interface', 'standard_attr_id': 1458, 'fixed_ips': [{'subnet_id': '070d772f-0def-421a-88b5-aa171b2c21ba', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:41:32Z', 'updated_at': '2021-11-09T04:41:35Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '070d772f-0def-421a-88b5-aa171b2c21ba', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': ['1.2.3.4'], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:41:55.105035 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a9fae32-a447-4f5b-ad15-3b7c49d839f2 None None] The sync data for ids ['f13bdef0-14e2-4965-81f3-edd791830726'] in dv-neutron-816802-2-hyperv is: [{'id': 'f13bdef0-14e2-4965-81f3-edd791830726', 'name': 'tempest-TestNetworkBasicOps-router-952339284', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.194'}], 'enable_snat': True}, 'gw_port_id': 'ec5fce5b-ee83-4955-8947-4ecdfe3bce2b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:41:28Z', 'updated_at': '2021-11-09T04:41:32Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': 'ec5fce5b-ee83-4955-8947-4ecdfe3bce2b', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:8e:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f13bdef0-14e2-4965-81f3-edd791830726', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1455, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:41:28Z', 'updated_at': '2021-11-09T04:41:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '52a062f1-dbcf-42fe-9c80-06ac6e9d9151', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'floating_ip_address': '172.26.0.102', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': 'f13bdef0-14e2-4965-81f3-edd791830726', 'port_id': 'c89ba17b-04dd-4269-8d17-8f5d1eac8808', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 1471, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '48525ef7-c383-4b41-af35-4362b85562cf', 'mac_address': 'fa:16:3e:11:25:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'efa8cc26-7104-425a-92ab-aeb8d9bb62bc', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:41:52Z', 'updated_at': '2021-11-09T04:41:52Z', 'revision_number': 0, 'project_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '064e1a31-61b7-44c2-be25-3ad23c3252e1', 'name': '', 'network_id': '48525ef7-c383-4b41-af35-4362b85562cf', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:2a:e3:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f13bdef0-14e2-4965-81f3-edd791830726', 'device_owner': 'network:router_interface', 'standard_attr_id': 1458, 'fixed_ips': [{'subnet_id': '070d772f-0def-421a-88b5-aa171b2c21ba', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:41:32Z', 'updated_at': '2021-11-09T04:41:35Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '070d772f-0def-421a-88b5-aa171b2c21ba', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': ['1.2.3.4'], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:41:55.303037 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-973e8029-a1af-4360-a661-089035b41e63 None None] New status for floating IP 52a062f1-dbcf-42fe-9c80-06ac6e9d9151: ACTIVE {{(pid=102164) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 04:41:55.517770 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 60940) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:41:55.578616 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-fa58e7e8-2e62-4997-bfcf-942d8b1e49e8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/floatingips/52a062f1-dbcf-42fe-9c80-06ac6e9d9151 HTTP/1.1" status: 200 len: 993 time: 0.0596795 Nov 09 04:41:55.692551 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23e89f7e-d676-487d-9f9d-caae08d3fd69 req-420aba48-cffc-4e35-8d88-02dc9a065888 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:55.693984 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-23e89f7e-d676-487d-9f9d-caae08d3fd69 req-420aba48-cffc-4e35-8d88-02dc9a065888 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=255f168a-466b-4fcf-8478-32dab054b831 HTTP/1.1" status: 200 len: 943 time: 0.0483446 Nov 09 04:41:55.745625 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-23e89f7e-d676-487d-9f9d-caae08d3fd69 req-a23e4474-3b00-4d4c-8c65-e1e6f9b6a0d2 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0451498 Nov 09 04:41:56.859473 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bc008c0-3554-4ab8-8101-0783756cb2ea req-7382f767-083a-4b39-891d-d33ab5f12e96 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:56.860978 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-7bc008c0-3554-4ab8-8101-0783756cb2ea req-7382f767-083a-4b39-891d-d33ab5f12e96 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=255f168a-466b-4fcf-8478-32dab054b831 HTTP/1.1" status: 200 len: 943 time: 0.0492632 Nov 09 04:41:56.910989 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-7bc008c0-3554-4ab8-8101-0783756cb2ea req-b540297c-79df-4e19-baad-367a159fa7a6 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0438921 Nov 09 04:41:58.034080 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc26480b-58e1-477a-9ef6-9a8cac6c65db req-323d9b80-8653-48ea-a2e7-8545f377f960 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:58.035565 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fc26480b-58e1-477a-9ef6-9a8cac6c65db req-323d9b80-8653-48ea-a2e7-8545f377f960 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=255f168a-466b-4fcf-8478-32dab054b831 HTTP/1.1" status: 200 len: 943 time: 0.0505376 Nov 09 04:41:58.083778 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fc26480b-58e1-477a-9ef6-9a8cac6c65db req-5e759bf9-66f3-420c-8913-52034030b3f8 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423748 Nov 09 04:41:59.204599 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bd0491e-fd73-4e01-9b4f-dc6d67311722 req-ea4c717d-5dc5-450e-9d67-eddb80104471 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:41:59.205970 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-3bd0491e-fd73-4e01-9b4f-dc6d67311722 req-ea4c717d-5dc5-450e-9d67-eddb80104471 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=255f168a-466b-4fcf-8478-32dab054b831 HTTP/1.1" status: 200 len: 943 time: 0.0541964 Nov 09 04:41:59.255137 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-3bd0491e-fd73-4e01-9b4f-dc6d67311722 req-d7abe35e-8a45-490e-b44b-6d24cb858927 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432315 Nov 09 04:42:00.367758 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b94f1cc-8315-4416-a57d-871fae8c073d req-996af541-d489-4430-9d41-5802c5818f6d tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:42:00.369197 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6b94f1cc-8315-4416-a57d-871fae8c073d req-996af541-d489-4430-9d41-5802c5818f6d tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=255f168a-466b-4fcf-8478-32dab054b831 HTTP/1.1" status: 200 len: 943 time: 0.0487139 Nov 09 04:42:00.418959 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6b94f1cc-8315-4416-a57d-871fae8c073d req-17a93b43-eb83-4835-97b5-86a6ffe58c8a tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432200 Nov 09 04:42:01.532371 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5377bac-681a-4632-8866-49832a34666a req-964f3eaa-fba4-4dfa-830c-f809e2bdb01f tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:42:01.533851 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-e5377bac-681a-4632-8866-49832a34666a req-964f3eaa-fba4-4dfa-830c-f809e2bdb01f tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=255f168a-466b-4fcf-8478-32dab054b831 HTTP/1.1" status: 200 len: 943 time: 0.0487003 Nov 09 04:42:01.583031 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-e5377bac-681a-4632-8866-49832a34666a req-953cbd92-724f-459a-9f65-8143f63130a7 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434067 Nov 09 04:42:02.699803 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42a96a6e-82ba-4669-b1fa-af848c39b6b5 req-70972f19-b57f-4bc0-bc4f-ee151d87b8ee tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:42:02.701236 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-42a96a6e-82ba-4669-b1fa-af848c39b6b5 req-70972f19-b57f-4bc0-bc4f-ee151d87b8ee tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=255f168a-466b-4fcf-8478-32dab054b831 HTTP/1.1" status: 200 len: 943 time: 0.0517242 Nov 09 04:42:02.749992 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-42a96a6e-82ba-4669-b1fa-af848c39b6b5 req-121b3c38-543c-4213-9d34-0114cfa91ceb tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427880 Nov 09 04:42:03.868487 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4251851d-8f05-4d68-8123-f863175592e0 req-1a568a5d-111e-4068-a897-eca5c70b1663 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:42:03.870067 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-4251851d-8f05-4d68-8123-f863175592e0 req-1a568a5d-111e-4068-a897-eca5c70b1663 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=255f168a-466b-4fcf-8478-32dab054b831 HTTP/1.1" status: 200 len: 943 time: 0.0536993 Nov 09 04:42:03.926247 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-4251851d-8f05-4d68-8123-f863175592e0 req-c55254ff-b64d-4dfa-8254-ce7257095f47 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0501897 Nov 09 04:42:04.399528 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 9020ebb6-3d21-44a2-80fa-7c78665742e4 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=102163) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 09 04:42:04.493543 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 9020ebb6-3d21-44a2-80fa-7c78665742e4, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=9020ebb6-3d21-44a2-80fa-7c78665742e4,segment=NetworkSegment(bc4577c9-06a5-450a-9c80-879827986f04),segment_id=bc4577c9-06a5-450a-9c80-879827986f04)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:42:04.504210 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Returning: {'device': '9020ebb6-3d21-44a2-80fa-7c78665742e4', 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf', 'port_id': '9020ebb6-3d21-44a2-80fa-7c78665742e4', 'mac_address': 'fa:16:3e:6a:dd:2c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 310, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f6a08667-654b-4e0c-9f85-c6e6712cc239', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102163) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 09 04:42:04.541064 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:42:04.554024 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9020ebb6-3d21-44a2-80fa-7c78665742e4 {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:42:04.572694 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 9020ebb6-3d21-44a2-80fa-7c78665742e4, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=9020ebb6-3d21-44a2-80fa-7c78665742e4,segment=NetworkSegment(bc4577c9-06a5-450a-9c80-879827986f04),segment_id=bc4577c9-06a5-450a-9c80-879827986f04)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:42:04.645168 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:42:04.694069 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=9020ebb6-3d21-44a2-80fa-7c78665742e4,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:42:04.875199 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['9020ebb6-3d21-44a2-80fa-7c78665742e4'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 04:42:05.038456 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28d2801d-9995-4483-aa1c-5b5587ddf174 req-839cf17f-5d48-4a05-aa78-3c7fa8131194 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:42:05.040007 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-28d2801d-9995-4483-aa1c-5b5587ddf174 req-839cf17f-5d48-4a05-aa78-3c7fa8131194 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=255f168a-466b-4fcf-8478-32dab054b831 HTTP/1.1" status: 200 len: 944 time: 0.0474162 Nov 09 04:42:05.089725 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-28d2801d-9995-4483-aa1c-5b5587ddf174 req-93dfb36e-4346-4e81-b156-9743cb170537 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426037 Nov 09 04:42:06.202783 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20f60bb4-e2ea-4f4a-9489-f592f7d0c98f req-fd16bf86-fb53-4a4d-9cde-25087333bf40 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:42:06.204194 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-20f60bb4-e2ea-4f4a-9489-f592f7d0c98f req-fd16bf86-fb53-4a4d-9cde-25087333bf40 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=255f168a-466b-4fcf-8478-32dab054b831 HTTP/1.1" status: 200 len: 944 time: 0.0484040 Nov 09 04:42:06.254049 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-20f60bb4-e2ea-4f4a-9489-f592f7d0c98f req-28c3fdd4-8e56-4e72-9245-d0ac56cf4ab0 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0440083 Nov 09 04:42:06.419114 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 9020ebb6-3d21-44a2-80fa-7c78665742e4 up at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:42:06.553625 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning for port 9020ebb6-3d21-44a2-80fa-7c78665742e4 completed by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 09 04:42:06.557569 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning complete for port 9020ebb6-3d21-44a2-80fa-7c78665742e4 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:42:06.561184 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:42:06.632341 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:42:06.657048 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '255f168a-466b-4fcf-8478-32dab054b831', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9020ebb6-3d21-44a2-80fa-7c78665742e4'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:42:06.659301 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9a4361ef-1660-4f6c-a907-5e189922425f" -d '{"events": [{"server_uuid": "255f168a-466b-4fcf-8478-32dab054b831", "name": "network-vif-plugged", "status": "completed", "tag": "9020ebb6-3d21-44a2-80fa-7c78665742e4"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:42:06.671830 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 9020ebb6-3d21-44a2-80fa-7c78665742e4, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=9020ebb6-3d21-44a2-80fa-7c78665742e4,segment=NetworkSegment(bc4577c9-06a5-450a-9c80-879827986f04),segment_id=bc4577c9-06a5-450a-9c80-879827986f04)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:42:06.696451 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:42:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0b195304-ecbb-4717-b7de-d7fd82dd4ce4 x-openstack-request-id: req-0b195304-ecbb-4717-b7de-d7fd82dd4ce4 {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:42:06.696733 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "255f168a-466b-4fcf-8478-32dab054b831", "name": "network-vif-plugged", "status": "completed", "tag": "9020ebb6-3d21-44a2-80fa-7c78665742e4", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:42:06.697208 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-0b195304-ecbb-4717-b7de-d7fd82dd4ce4 {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:42:06.697605 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '255f168a-466b-4fcf-8478-32dab054b831', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9020ebb6-3d21-44a2-80fa-7c78665742e4', 'code': 200} Nov 09 04:42:06.763338 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:42:06.812376 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=9020ebb6-3d21-44a2-80fa-7c78665742e4,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:42:07.001273 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a62e163-5c79-46b8-a03d-7175083a0804 req-6a4ce86e-c65e-4298-92d2-533277961f20 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:42:07.002761 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8a62e163-5c79-46b8-a03d-7175083a0804 req-6a4ce86e-c65e-4298-92d2-533277961f20 service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=255f168a-466b-4fcf-8478-32dab054b831 HTTP/1.1" status: 200 len: 1098 time: 0.0430098 Nov 09 04:42:07.049875 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8a62e163-5c79-46b8-a03d-7175083a0804 req-bd6b5f0c-656f-4760-917e-7fbbf5b48b57 service neutron] 10.222.0.26 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0380762 Nov 09 04:42:07.364624 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d59f16c-3f3c-4bb2-90b9-efd3fbfdb921 req-aa026948-400a-453b-b134-ef81cb848d2f tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:42:07.366116 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-8d59f16c-3f3c-4bb2-90b9-efd3fbfdb921 req-aa026948-400a-453b-b134-ef81cb848d2f tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=255f168a-466b-4fcf-8478-32dab054b831 HTTP/1.1" status: 200 len: 945 time: 0.0480778 Nov 09 04:42:07.414938 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-8d59f16c-3f3c-4bb2-90b9-efd3fbfdb921 req-849f1bb0-8e12-4b05-b458-419e23c31e19 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424495 Nov 09 04:42:08.532983 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a8dd2e1-04aa-4abe-8923-b839708090fc req-b569ea39-0e7f-4f72-ab74-0d4925336ad1 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:42:08.534481 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2a8dd2e1-04aa-4abe-8923-b839708090fc req-b569ea39-0e7f-4f72-ab74-0d4925336ad1 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=255f168a-466b-4fcf-8478-32dab054b831 HTTP/1.1" status: 200 len: 945 time: 0.0483723 Nov 09 04:42:08.584787 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2a8dd2e1-04aa-4abe-8923-b839708090fc req-2438b2d3-ed15-4b58-96f7-91b0488cbc23 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0441780 Nov 09 04:42:08.702043 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b88d4f0c-a341-4048-a53d-69daf58e046c req-c1216353-66b9-4e7d-94f1-fc46ffaa9b15 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:42:08.703443 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b88d4f0c-a341-4048-a53d-69daf58e046c req-c1216353-66b9-4e7d-94f1-fc46ffaa9b15 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=255f168a-466b-4fcf-8478-32dab054b831 HTTP/1.1" status: 200 len: 945 time: 0.0534961 Nov 09 04:42:08.752685 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b88d4f0c-a341-4048-a53d-69daf58e046c req-37130744-7e38-4b9a-a1de-78c790856c22 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434320 Nov 09 04:42:08.776557 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60972) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:42:08.908844 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-83a13ce2-fee4-4375-b6ff-06b3b58d2717 tempest-TestVolumeBootPattern-1884748564 tempest-TestVolumeBootPattern-1884748564-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:42:08.910342 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-83a13ce2-fee4-4375-b6ff-06b3b58d2717 tempest-TestVolumeBootPattern-1884748564 tempest-TestVolumeBootPattern-1884748564-project-admin] 10.222.0.24 "GET /v2.0/ports?device_id=255f168a-466b-4fcf-8478-32dab054b831 HTTP/1.1" status: 200 len: 1093 time: 0.1328290 Nov 09 04:42:08.913109 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 60976) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:42:08.917276 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-6a7a72ba-b750-4a16-ae68-d955008f136e tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Request body: {'floatingip': {'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'port_id': '9020ebb6-3d21-44a2-80fa-7c78665742e4', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'fixed_ip_address': '172.20.0.9'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:42:09.062520 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6a7a72ba-b750-4a16-ae68-d955008f136e tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks [] for floatingip, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:42:09.160646 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6a7a72ba-b750-4a16-ae68-d955008f136e tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:42:09.269356 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-6a7a72ba-b750-4a16-ae68-d955008f136e tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Allocated IP 172.26.0.125 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/a16b86ad-9e7e-4fe4-a12f-547b9442714b) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:42:09.369267 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6a7a72ba-b750-4a16-ae68-d955008f136e tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:42:09.462870 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6a7a72ba-b750-4a16-ae68-d955008f136e tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:42:09.502264 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6a7a72ba-b750-4a16-ae68-d955008f136e tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:42:09.507165 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-6a7a72ba-b750-4a16-ae68-d955008f136e tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:42:09.509799 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6a7a72ba-b750-4a16-ae68-d955008f136e tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:42:09.533872 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a7a72ba-b750-4a16-ae68-d955008f136e tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Pushing event updated for resources: {'Port': ['ID=a16b86ad-9e7e-4fe4-a12f-547b9442714b,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:42:09.861417 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6a7a72ba-b750-4a16-ae68-d955008f136e tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:42:09.999961 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6a7a72ba-b750-4a16-ae68-d955008f136e tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:42:10.147337 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6a7a72ba-b750-4a16-ae68-d955008f136e tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:42:10.262385 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6a7a72ba-b750-4a16-ae68-d955008f136e tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:42:10.329799 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a7a72ba-b750-4a16-ae68-d955008f136e tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Pushing event updated for resources: {'Port': ['ID=a16b86ad-9e7e-4fe4-a12f-547b9442714b,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:42:10.343744 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6a7a72ba-b750-4a16-ae68-d955008f136e tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:42:10.439850 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.l3_db [None req-6a7a72ba-b750-4a16-ae68-d955008f136e tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Floating IP 60f6b65a-cb39-41e6-8d69-6ed84b3214bc associated. External IP: 172.26.0.125, port: 9020ebb6-3d21-44a2-80fa-7c78665742e4. Nov 09 04:42:10.638689 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6a7a72ba-b750-4a16-ae68-d955008f136e tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Router 203a01a6-369d-4e73-a6d0-b0605f8d5a6a has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:42:10.743740 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6a7a72ba-b750-4a16-ae68-d955008f136e tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:42:10.753327 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7da960c8-d941-40e3-b5d8-e0b461559e50 None None] Sync routers for ids ['203a01a6-369d-4e73-a6d0-b0605f8d5a6a'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:42:10.763313 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7da960c8-d941-40e3-b5d8-e0b461559e50 None None] Routers {'203a01a6-369d-4e73-a6d0-b0605f8d5a6a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:42:10.763957 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-7da960c8-d941-40e3-b5d8-e0b461559e50 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:41:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['203a01a6-369d-4e73-a6d0-b0605f8d5a6a'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:42:10.835456 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6a7a72ba-b750-4a16-ae68-d955008f136e tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:42:10.863368 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-6a7a72ba-b750-4a16-ae68-d955008f136e tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.9492650 Nov 09 04:42:10.864159 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '255f168a-466b-4fcf-8478-32dab054b831', 'tag': '9020ebb6-3d21-44a2-80fa-7c78665742e4'}] {{(pid=102161) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:42:10.866553 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}99dfdda0def497b4372884ef2eb87f06b1e425c8eba5ceda5f64bbab037a07d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cbda576f-57e5-4775-962a-bd7b40ffaddc" -d '{"events": [{"name": "network-changed", "server_uuid": "255f168a-466b-4fcf-8478-32dab054b831", "tag": "9020ebb6-3d21-44a2-80fa-7c78665742e4"}]}' {{(pid=102161) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:42:10.868173 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-7da960c8-d941-40e3-b5d8-e0b461559e50 None None] Set router 203a01a6-369d-4e73-a6d0-b0605f8d5a6a gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:42:10.905821 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:42:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f8278b8f-2728-475e-8535-b2933399ac65 x-openstack-request-id: req-f8278b8f-2728-475e-8535-b2933399ac65 {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:42:10.905821 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "255f168a-466b-4fcf-8478-32dab054b831", "tag": "9020ebb6-3d21-44a2-80fa-7c78665742e4", "status": "completed", "code": 200}]} {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:42:10.905821 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-f8278b8f-2728-475e-8535-b2933399ac65 {{(pid=102161) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:42:10.905821 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '255f168a-466b-4fcf-8478-32dab054b831', 'tag': '9020ebb6-3d21-44a2-80fa-7c78665742e4', 'status': 'completed', 'code': 200} Nov 09 04:42:10.966605 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbda576f-57e5-4775-962a-bd7b40ffaddc req-85ccb9fb-58bd-44ab-bcc5-4be348006d83 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:42:10.968207 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-cbda576f-57e5-4775-962a-bd7b40ffaddc req-85ccb9fb-58bd-44ab-bcc5-4be348006d83 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=f636e5f4c9f64f69ba3b2ab8816b6096&device_id=255f168a-466b-4fcf-8478-32dab054b831 HTTP/1.1" status: 200 len: 1098 time: 0.0401964 Nov 09 04:42:11.063320 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbda576f-57e5-4775-962a-bd7b40ffaddc req-2876e0aa-d92f-4000-b65a-d7bb4ca9a6be service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:42:11.064834 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-cbda576f-57e5-4775-962a-bd7b40ffaddc req-2876e0aa-d92f-4000-b65a-d7bb4ca9a6be service neutron] 10.222.0.26 "GET /v2.0/networks?id=999b1b20-f8fc-4caf-84cc-3feda426a0bf HTTP/1.1" status: 200 len: 913 time: 0.0884073 Nov 09 04:42:11.098419 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-7da960c8-d941-40e3-b5d8-e0b461559e50 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'name': 'tempest-TestVolumeBootPattern-1675179943-router', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.164'}], 'enable_snat': True}, 'gw_port_id': '873960f9-e8b5-48a6-a119-47c32f5b7968', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:34:33Z', 'updated_at': '2021-11-09T04:34:38Z', 'revision_number': 4, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'gw_port': {'id': '873960f9-e8b5-48a6-a119-47c32f5b7968', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:95:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1097, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.164', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:34:34Z', 'updated_at': '2021-11-09T04:34:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '60f6b65a-cb39-41e6-8d69-6ed84b3214bc', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'floating_ip_address': '172.26.0.125', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'port_id': '9020ebb6-3d21-44a2-80fa-7c78665742e4', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 1473, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf', 'mac_address': 'fa:16:3e:6a:dd:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '255f168a-466b-4fcf-8478-32dab054b831', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:42:09Z', 'updated_at': '2021-11-09T04:42:09Z', 'revision_number': 0, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'fixed_ip_address_scope': None}, {'id': '6b30fd91-6470-4a72-a74d-84beb135dcc6', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'floating_ip_address': '172.26.0.216', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'port_id': '65ca937a-8471-4c50-bca1-78fbcfc42fb6', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 1404, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf', 'mac_address': 'fa:16:3e:1f:06:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04f80039-ab30-438a-adbf-bd30827f9a50', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:39:03Z', 'updated_at': '2021-11-09T04:39:05Z', 'revision_number': 1, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a5f1e54d-1d98-4741-a1ce-59f4cfb5b332', 'name': '', 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'mac_address': 'fa:16:3e:de:ab:2f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1107, 'fixed_ips': [{'subnet_id': 'f6a08667-654b-4e0c-9f85-c6e6712cc239', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:34:37Z', 'updated_at': '2021-11-09T04:34:46Z', 'revision_number': 5, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'subnets': [{'id': 'f6a08667-654b-4e0c-9f85-c6e6712cc239', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:42:11.124113 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7da960c8-d941-40e3-b5d8-e0b461559e50 None None] Checking router: 203a01a6-369d-4e73-a6d0-b0605f8d5a6a for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:42:11.130783 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-cbda576f-57e5-4775-962a-bd7b40ffaddc req-3375f22c-1417-4a83-93bd-9973171dd3da service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=9020ebb6-3d21-44a2-80fa-7c78665742e4 HTTP/1.1" status: 200 len: 999 time: 0.0582812 Nov 09 04:42:11.132161 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7da960c8-d941-40e3-b5d8-e0b461559e50 None None] Routers {'203a01a6-369d-4e73-a6d0-b0605f8d5a6a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:42:11.132793 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-7da960c8-d941-40e3-b5d8-e0b461559e50 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:41:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['203a01a6-369d-4e73-a6d0-b0605f8d5a6a'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:42:11.182951 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbda576f-57e5-4775-962a-bd7b40ffaddc req-c724f980-c67e-4604-809b-05824d5ea469 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:42:11.184922 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-cbda576f-57e5-4775-962a-bd7b40ffaddc req-c724f980-c67e-4604-809b-05824d5ea469 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=f6a08667-654b-4e0c-9f85-c6e6712cc239 HTTP/1.1" status: 200 len: 851 time: 0.0468676 Nov 09 04:42:11.239472 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbda576f-57e5-4775-962a-bd7b40ffaddc req-2fbd8d39-dec2-4ed9-b266-5a80ff178395 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:42:11.241010 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-cbda576f-57e5-4775-962a-bd7b40ffaddc req-2fbd8d39-dec2-4ed9-b266-5a80ff178395 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=999b1b20-f8fc-4caf-84cc-3feda426a0bf&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0444429 Nov 09 04:42:11.340276 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-cbda576f-57e5-4775-962a-bd7b40ffaddc req-01dbd5f3-c72d-4eb3-bc6f-99df999b19f3 service neutron] 10.222.0.26 "GET /v2.0/networks/999b1b20-f8fc-4caf-84cc-3feda426a0bf?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0917025 Nov 09 04:42:11.394418 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-7da960c8-d941-40e3-b5d8-e0b461559e50 None None] Set router 203a01a6-369d-4e73-a6d0-b0605f8d5a6a gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:42:11.436277 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-cbda576f-57e5-4775-962a-bd7b40ffaddc req-79654c28-44bd-43b8-9143-a567c62c491e service neutron] 10.222.0.26 "GET /v2.0/networks/999b1b20-f8fc-4caf-84cc-3feda426a0bf?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0857999 Nov 09 04:42:11.469927 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6f7752fb-ae97-42c0-a3fb-7ec5fcfcf0e7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:42:11.624963 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-7da960c8-d941-40e3-b5d8-e0b461559e50 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'name': 'tempest-TestVolumeBootPattern-1675179943-router', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.164'}], 'enable_snat': True}, 'gw_port_id': '873960f9-e8b5-48a6-a119-47c32f5b7968', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:34:33Z', 'updated_at': '2021-11-09T04:34:38Z', 'revision_number': 4, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'gw_port': {'id': '873960f9-e8b5-48a6-a119-47c32f5b7968', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:95:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1097, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.164', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:34:34Z', 'updated_at': '2021-11-09T04:34:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '60f6b65a-cb39-41e6-8d69-6ed84b3214bc', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'floating_ip_address': '172.26.0.125', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'port_id': '9020ebb6-3d21-44a2-80fa-7c78665742e4', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 1473, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf', 'mac_address': 'fa:16:3e:6a:dd:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '255f168a-466b-4fcf-8478-32dab054b831', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:42:09Z', 'updated_at': '2021-11-09T04:42:09Z', 'revision_number': 0, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'fixed_ip_address_scope': None}, {'id': '6b30fd91-6470-4a72-a74d-84beb135dcc6', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'floating_ip_address': '172.26.0.216', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'port_id': '65ca937a-8471-4c50-bca1-78fbcfc42fb6', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 1404, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf', 'mac_address': 'fa:16:3e:1f:06:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04f80039-ab30-438a-adbf-bd30827f9a50', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:39:03Z', 'updated_at': '2021-11-09T04:39:05Z', 'revision_number': 1, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a5f1e54d-1d98-4741-a1ce-59f4cfb5b332', 'name': '', 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'mac_address': 'fa:16:3e:de:ab:2f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1107, 'fixed_ips': [{'subnet_id': 'f6a08667-654b-4e0c-9f85-c6e6712cc239', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:34:37Z', 'updated_at': '2021-11-09T04:34:46Z', 'revision_number': 5, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'subnets': [{'id': 'f6a08667-654b-4e0c-9f85-c6e6712cc239', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:42:11.650572 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7da960c8-d941-40e3-b5d8-e0b461559e50 None None] The sync data for ids ['203a01a6-369d-4e73-a6d0-b0605f8d5a6a'] in dv-neutron-816802-2-hyperv is: [{'id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'name': 'tempest-TestVolumeBootPattern-1675179943-router', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.164'}], 'enable_snat': True}, 'gw_port_id': '873960f9-e8b5-48a6-a119-47c32f5b7968', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:34:33Z', 'updated_at': '2021-11-09T04:34:38Z', 'revision_number': 4, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'gw_port': {'id': '873960f9-e8b5-48a6-a119-47c32f5b7968', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:95:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1097, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.164', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:34:34Z', 'updated_at': '2021-11-09T04:34:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '60f6b65a-cb39-41e6-8d69-6ed84b3214bc', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'floating_ip_address': '172.26.0.125', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'port_id': '9020ebb6-3d21-44a2-80fa-7c78665742e4', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 1473, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf', 'mac_address': 'fa:16:3e:6a:dd:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '255f168a-466b-4fcf-8478-32dab054b831', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:42:09Z', 'updated_at': '2021-11-09T04:42:09Z', 'revision_number': 0, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'fixed_ip_address_scope': None}, {'id': '6b30fd91-6470-4a72-a74d-84beb135dcc6', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'floating_ip_address': '172.26.0.216', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'port_id': '65ca937a-8471-4c50-bca1-78fbcfc42fb6', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 1404, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf', 'mac_address': 'fa:16:3e:1f:06:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04f80039-ab30-438a-adbf-bd30827f9a50', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:39:03Z', 'updated_at': '2021-11-09T04:39:05Z', 'revision_number': 1, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a5f1e54d-1d98-4741-a1ce-59f4cfb5b332', 'name': '', 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'mac_address': 'fa:16:3e:de:ab:2f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1107, 'fixed_ips': [{'subnet_id': 'f6a08667-654b-4e0c-9f85-c6e6712cc239', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:34:37Z', 'updated_at': '2021-11-09T04:34:46Z', 'revision_number': 5, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'subnets': [{'id': 'f6a08667-654b-4e0c-9f85-c6e6712cc239', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:42:11.840663 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-811513df-7e07-459b-8358-1aed0020bd12 None None] New status for floating IP 60f6b65a-cb39-41e6-8d69-6ed84b3214bc: ACTIVE {{(pid=102164) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 04:42:12.164523 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:42:13.688191 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-34cd8584-32c9-4ec7-9565-6e81abc892c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:42:15.128243 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:42:16.442817 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:42:16.981902 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:42:28.470202 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:42:41.386661 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d298280a-44c4-4f05-b271-dd9108f76d68 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:42:42.203434 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:42:43.706946 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f5bc9dfc-caf7-4c4e-ac92-5a4c2b33510a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:42:45.111619 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:42:46.472146 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:42:46.967104 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:42:56.321176 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a485d087-d14b-49e0-904d-7b62dd10e12a req-5a241dcd-6a7f-472b-9451-2067cc84badc service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=04f80039-ab30-438a-adbf-bd30827f9a50&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0374012 Nov 09 04:42:56.402553 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a485d087-d14b-49e0-904d-7b62dd10e12a req-3dad7383-e4bb-4b22-8a9a-6a9ad4cec279 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:42:56.404013 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a485d087-d14b-49e0-904d-7b62dd10e12a req-3dad7383-e4bb-4b22-8a9a-6a9ad4cec279 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=f636e5f4c9f64f69ba3b2ab8816b6096&device_id=04f80039-ab30-438a-adbf-bd30827f9a50 HTTP/1.1" status: 200 len: 1099 time: 0.0425596 Nov 09 04:42:56.502460 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a485d087-d14b-49e0-904d-7b62dd10e12a req-61e8cc73-2725-4e30-8764-d4b5ead99422 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:42:56.503873 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a485d087-d14b-49e0-904d-7b62dd10e12a req-61e8cc73-2725-4e30-8764-d4b5ead99422 service neutron] 10.222.0.26 "GET /v2.0/networks?id=999b1b20-f8fc-4caf-84cc-3feda426a0bf HTTP/1.1" status: 200 len: 913 time: 0.0808876 Nov 09 04:42:56.572792 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a485d087-d14b-49e0-904d-7b62dd10e12a req-bfefa2a4-d4aa-48b4-bb07-cf98a1e5264d service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=65ca937a-8471-4c50-bca1-78fbcfc42fb6 HTTP/1.1" status: 200 len: 1002 time: 0.0611179 Nov 09 04:42:56.620649 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a485d087-d14b-49e0-904d-7b62dd10e12a req-9fa1ac3d-578a-427d-8467-6025900e4cf0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:42:56.622013 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a485d087-d14b-49e0-904d-7b62dd10e12a req-9fa1ac3d-578a-427d-8467-6025900e4cf0 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=f6a08667-654b-4e0c-9f85-c6e6712cc239 HTTP/1.1" status: 200 len: 851 time: 0.0427201 Nov 09 04:42:56.664878 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a485d087-d14b-49e0-904d-7b62dd10e12a req-f98a0417-5bfc-43fd-bb02-c69f9a61a3c7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:42:56.666262 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a485d087-d14b-49e0-904d-7b62dd10e12a req-f98a0417-5bfc-43fd-bb02-c69f9a61a3c7 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=999b1b20-f8fc-4caf-84cc-3feda426a0bf&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0369127 Nov 09 04:42:56.756527 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a485d087-d14b-49e0-904d-7b62dd10e12a req-213f05da-fb1a-42d7-be0f-927bb4f41b98 service neutron] 10.222.0.26 "GET /v2.0/networks/999b1b20-f8fc-4caf-84cc-3feda426a0bf?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0826683 Nov 09 04:42:56.843629 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a485d087-d14b-49e0-904d-7b62dd10e12a req-eea4094f-6701-4758-b71b-2f6718db1387 service neutron] 10.222.0.26 "GET /v2.0/networks/999b1b20-f8fc-4caf-84cc-3feda426a0bf?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0799446 Nov 09 04:43:05.469232 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:43:11.343224 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-33d4ebe2-d75e-4200-ad58-d2d534cb5a95 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:43:12.177599 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:43:13.722111 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f630f289-f273-48bd-8a8b-5b4924c46135 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:43:15.122153 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:43:16.476279 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:43:16.979337 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:43:41.358753 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9b804794-5d85-4e29-bf45-6216ae2a9e30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:43:42.217831 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:43:42.468964 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:43:43.714838 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b909db54-bb18-429a-b089-9320dc084af5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:43:45.137564 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:43:46.491873 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:43:46.960990 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:43:48.488532 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 32800) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:43:48.555434 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-bea4bd8b-e979-469e-a17d-fa0ce732e952 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'subnet': {'dns_nameservers': ['9.8.7.6']}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:43:48.641595 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bea4bd8b-e979-469e-a17d-fa0ce732e952 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_update-5785226'] for subnet, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:43:48.838842 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bea4bd8b-e979-469e-a17d-fa0ce732e952 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8756747267211', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_updated-6995362'] for subnet, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:43:48.869039 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bea4bd8b-e979-469e-a17d-fa0ce732e952 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:43:48.869630 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bea4bd8b-e979-469e-a17d-fa0ce732e952 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:43:48.870929 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-bea4bd8b-e979-469e-a17d-fa0ce732e952 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "PUT /v2.0/subnets/070d772f-0def-421a-88b5-aa171b2c21ba HTTP/1.1" status: 200 len: 836 time: 0.3814249 Nov 09 04:43:48.874489 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dab6c18b-09b4-4e3b-aef6-719be9714dfd None None] Network 48525ef7-c383-4b41-af35-4362b85562cf requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:43:48.891136 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bea4bd8b-e979-469e-a17d-fa0ce732e952 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Subnet': ['ID=070d772f-0def-421a-88b5-aa171b2c21ba,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:43:48.899172 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bea4bd8b-e979-469e-a17d-fa0ce732e952 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:43:48.899494 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bea4bd8b-e979-469e-a17d-fa0ce732e952 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:43:48.899835 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bea4bd8b-e979-469e-a17d-fa0ce732e952 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:43:48.900171 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bea4bd8b-e979-469e-a17d-fa0ce732e952 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:43:48.900504 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bea4bd8b-e979-469e-a17d-fa0ce732e952 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:43:48.900835 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bea4bd8b-e979-469e-a17d-fa0ce732e952 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:43:48.901161 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bea4bd8b-e979-469e-a17d-fa0ce732e952 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:43:48.901489 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bea4bd8b-e979-469e-a17d-fa0ce732e952 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:43:48.901815 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bea4bd8b-e979-469e-a17d-fa0ce732e952 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:43:48.902140 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bea4bd8b-e979-469e-a17d-fa0ce732e952 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:43:48.902503 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bea4bd8b-e979-469e-a17d-fa0ce732e952 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:43:48.902828 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bea4bd8b-e979-469e-a17d-fa0ce732e952 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:43:49.249229 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-6c932adc-9dff-4b82-9372-b10eafd4b7f8 None None] Provisioning complete for port 7417a41c-915f-4cab-8e37-08246d66bbc1 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:43:49.249594 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6c932adc-9dff-4b82-9372-b10eafd4b7f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:43:49.333149 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-6c932adc-9dff-4b82-9372-b10eafd4b7f8 None None] Provisioning complete for port c89ba17b-04dd-4269-8d17-8f5d1eac8808 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:43:49.333438 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6c932adc-9dff-4b82-9372-b10eafd4b7f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:43:49.418707 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-6c932adc-9dff-4b82-9372-b10eafd4b7f8 None None] Provisioning complete for port 064e1a31-61b7-44c2-be25-3ad23c3252e1 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:43:49.418992 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6c932adc-9dff-4b82-9372-b10eafd4b7f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:43:57.364065 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-25aa2a68-1fae-4ea7-b691-906561964be7 req-8a7f0469-ab63-4029-9a76-3f9e847eff34 service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=efa8cc26-7104-425a-92ab-aeb8d9bb62bc&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0879784 Nov 09 04:43:57.423980 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25aa2a68-1fae-4ea7-b691-906561964be7 req-637c7a72-122a-4ded-a3d8-3ba07858dd72 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:43:57.425688 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-25aa2a68-1fae-4ea7-b691-906561964be7 req-637c7a72-122a-4ded-a3d8-3ba07858dd72 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&device_id=efa8cc26-7104-425a-92ab-aeb8d9bb62bc HTTP/1.1" status: 200 len: 1098 time: 0.0402658 Nov 09 04:43:57.538062 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25aa2a68-1fae-4ea7-b691-906561964be7 req-563d8dc5-40c0-48d8-9d5a-cba4b91bcb79 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:43:57.538062 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-25aa2a68-1fae-4ea7-b691-906561964be7 req-563d8dc5-40c0-48d8-9d5a-cba4b91bcb79 service neutron] 10.222.0.26 "GET /v2.0/networks?id=48525ef7-c383-4b41-af35-4362b85562cf HTTP/1.1" status: 200 len: 898 time: 0.0908396 Nov 09 04:43:57.609542 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-25aa2a68-1fae-4ea7-b691-906561964be7 req-031bab5d-6d72-45ee-8d65-5aa3facec541 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=c89ba17b-04dd-4269-8d17-8f5d1eac8808 HTTP/1.1" status: 200 len: 1001 time: 0.0660291 Nov 09 04:43:57.658376 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25aa2a68-1fae-4ea7-b691-906561964be7 req-fc68cc83-8aac-4b37-8c13-e5268329a51f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:43:57.659843 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-25aa2a68-1fae-4ea7-b691-906561964be7 req-fc68cc83-8aac-4b37-8c13-e5268329a51f service neutron] 10.222.0.26 "GET /v2.0/subnets?id=070d772f-0def-421a-88b5-aa171b2c21ba HTTP/1.1" status: 200 len: 844 time: 0.0433607 Nov 09 04:43:57.703311 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25aa2a68-1fae-4ea7-b691-906561964be7 req-2fff3574-e3a4-42ba-afa9-3713a5329706 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:43:57.704793 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-25aa2a68-1fae-4ea7-b691-906561964be7 req-2fff3574-e3a4-42ba-afa9-3713a5329706 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=48525ef7-c383-4b41-af35-4362b85562cf&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0380197 Nov 09 04:43:57.795782 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-25aa2a68-1fae-4ea7-b691-906561964be7 req-a0cac611-067e-4a5b-bafb-038dbe0868fe service neutron] 10.222.0.26 "GET /v2.0/networks/48525ef7-c383-4b41-af35-4362b85562cf?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0831156 Nov 09 04:43:57.884378 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-25aa2a68-1fae-4ea7-b691-906561964be7 req-0b173d22-a87c-4f73-acac-7f89d3402f44 service neutron] 10.222.0.26 "GET /v2.0/networks/48525ef7-c383-4b41-af35-4362b85562cf?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0807865 Nov 09 04:44:11.376472 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4df2eb2d-d569-41d2-8025-593e5c7e6111 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:12.191794 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:13.690422 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-62d3fe16-d9a7-4793-9bf7-f40e0171162c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:15.113149 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:16.456295 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:16.959060 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:19.467618 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:44:25.684557 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 32814) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:44:25.837359 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-6aa82c95-46ab-4211-9424-545e9f3e5ded tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Deleting port a16b86ad-9e7e-4fe4-a12f-547b9442714b {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:44:25.837691 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6aa82c95-46ab-4211-9424-545e9f3e5ded tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:25.911073 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6aa82c95-46ab-4211-9424-545e9f3e5ded tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:25.911398 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6aa82c95-46ab-4211-9424-545e9f3e5ded tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:25.923578 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-6aa82c95-46ab-4211-9424-545e9f3e5ded tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Calling delete_port for a16b86ad-9e7e-4fe4-a12f-547b9442714b owned by network:floatingip {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:44:26.461740 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6aa82c95-46ab-4211-9424-545e9f3e5ded tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:26.484038 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6aa82c95-46ab-4211-9424-545e9f3e5ded tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Pushing event deleted for resources: {'Port': ['ID=a16b86ad-9e7e-4fe4-a12f-547b9442714b,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:44:26.493522 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6aa82c95-46ab-4211-9424-545e9f3e5ded tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:44:26.493878 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6aa82c95-46ab-4211-9424-545e9f3e5ded tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:44:26.494250 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6aa82c95-46ab-4211-9424-545e9f3e5ded tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:44:26.494617 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6aa82c95-46ab-4211-9424-545e9f3e5ded tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:44:26.497507 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6aa82c95-46ab-4211-9424-545e9f3e5ded tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:44:26.497507 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6aa82c95-46ab-4211-9424-545e9f3e5ded tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:44:26.497507 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6aa82c95-46ab-4211-9424-545e9f3e5ded tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:44:26.497507 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6aa82c95-46ab-4211-9424-545e9f3e5ded tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:44:26.497507 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6aa82c95-46ab-4211-9424-545e9f3e5ded tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:44:26.497507 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6aa82c95-46ab-4211-9424-545e9f3e5ded tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:44:26.497507 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6aa82c95-46ab-4211-9424-545e9f3e5ded tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:44:26.498820 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6aa82c95-46ab-4211-9424-545e9f3e5ded tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:44:26.555934 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6aa82c95-46ab-4211-9424-545e9f3e5ded tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks [] for floatingip, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:26.556262 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.l3_db [None req-6aa82c95-46ab-4211-9424-545e9f3e5ded tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Floating IP 60f6b65a-cb39-41e6-8d69-6ed84b3214bc disassociated (deleted). External IP: 172.26.0.125, port: 9020ebb6-3d21-44a2-80fa-7c78665742e4. Nov 09 04:44:26.755842 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6aa82c95-46ab-4211-9424-545e9f3e5ded tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Router 203a01a6-369d-4e73-a6d0-b0605f8d5a6a has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:44:26.858244 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6aa82c95-46ab-4211-9424-545e9f3e5ded tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:44:26.863042 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6aa82c95-46ab-4211-9424-545e9f3e5ded tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:26.868455 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-83541e83-8bc9-4d07-bf8a-3aa63fded7a7 None None] Sync routers for ids ['203a01a6-369d-4e73-a6d0-b0605f8d5a6a'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:44:26.878985 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-83541e83-8bc9-4d07-bf8a-3aa63fded7a7 None None] Routers {'203a01a6-369d-4e73-a6d0-b0605f8d5a6a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:44:26.879767 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-83541e83-8bc9-4d07-bf8a-3aa63fded7a7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:44:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['203a01a6-369d-4e73-a6d0-b0605f8d5a6a'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:44:26.891365 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-6aa82c95-46ab-4211-9424-545e9f3e5ded tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "DELETE /v2.0/floatingips/60f6b65a-cb39-41e6-8d69-6ed84b3214bc HTTP/1.1" status: 204 len: 168 time: 1.2056324 Nov 09 04:44:26.891885 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '255f168a-466b-4fcf-8478-32dab054b831', 'tag': '9020ebb6-3d21-44a2-80fa-7c78665742e4'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:44:26.894137 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5fb1e926-ae57-43ee-983c-ad32f34ab8fd" -d '{"events": [{"name": "network-changed", "server_uuid": "255f168a-466b-4fcf-8478-32dab054b831", "tag": "9020ebb6-3d21-44a2-80fa-7c78665742e4"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:44:26.996131 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-83541e83-8bc9-4d07-bf8a-3aa63fded7a7 None None] Set router 203a01a6-369d-4e73-a6d0-b0605f8d5a6a gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:44:27.017743 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:44:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-eb778f65-a935-4053-90a0-1d1b5d4370a1 x-openstack-request-id: req-eb778f65-a935-4053-90a0-1d1b5d4370a1 {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:44:27.018067 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "255f168a-466b-4fcf-8478-32dab054b831", "tag": "9020ebb6-3d21-44a2-80fa-7c78665742e4", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:44:27.018288 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-eb778f65-a935-4053-90a0-1d1b5d4370a1 {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:44:27.018733 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '255f168a-466b-4fcf-8478-32dab054b831', 'tag': '9020ebb6-3d21-44a2-80fa-7c78665742e4', 'status': 'completed', 'code': 200} Nov 09 04:44:27.082064 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fb1e926-ae57-43ee-983c-ad32f34ab8fd req-66aabe76-f9cc-4b48-bd5d-b96334559f37 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:44:27.083562 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5fb1e926-ae57-43ee-983c-ad32f34ab8fd req-66aabe76-f9cc-4b48-bd5d-b96334559f37 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=f636e5f4c9f64f69ba3b2ab8816b6096&device_id=255f168a-466b-4fcf-8478-32dab054b831 HTTP/1.1" status: 200 len: 1098 time: 0.0419383 Nov 09 04:44:27.173864 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fb1e926-ae57-43ee-983c-ad32f34ab8fd req-aee07813-4535-4077-8420-0bc725c96cbb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:44:27.175354 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5fb1e926-ae57-43ee-983c-ad32f34ab8fd req-aee07813-4535-4077-8420-0bc725c96cbb service neutron] 10.222.0.26 "GET /v2.0/networks?id=999b1b20-f8fc-4caf-84cc-3feda426a0bf HTTP/1.1" status: 200 len: 913 time: 0.0849402 Nov 09 04:44:27.215880 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-83541e83-8bc9-4d07-bf8a-3aa63fded7a7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'name': 'tempest-TestVolumeBootPattern-1675179943-router', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.164'}], 'enable_snat': True}, 'gw_port_id': '873960f9-e8b5-48a6-a119-47c32f5b7968', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:34:33Z', 'updated_at': '2021-11-09T04:34:38Z', 'revision_number': 4, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'gw_port': {'id': '873960f9-e8b5-48a6-a119-47c32f5b7968', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:95:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1097, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.164', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:34:34Z', 'updated_at': '2021-11-09T04:34:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '6b30fd91-6470-4a72-a74d-84beb135dcc6', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'floating_ip_address': '172.26.0.216', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'port_id': '65ca937a-8471-4c50-bca1-78fbcfc42fb6', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 1404, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf', 'mac_address': 'fa:16:3e:1f:06:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04f80039-ab30-438a-adbf-bd30827f9a50', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:39:03Z', 'updated_at': '2021-11-09T04:39:05Z', 'revision_number': 1, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a5f1e54d-1d98-4741-a1ce-59f4cfb5b332', 'name': '', 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'mac_address': 'fa:16:3e:de:ab:2f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1107, 'fixed_ips': [{'subnet_id': 'f6a08667-654b-4e0c-9f85-c6e6712cc239', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:34:37Z', 'updated_at': '2021-11-09T04:34:46Z', 'revision_number': 5, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'subnets': [{'id': 'f6a08667-654b-4e0c-9f85-c6e6712cc239', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:44:27.221114 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5fb1e926-ae57-43ee-983c-ad32f34ab8fd req-467dd8dc-6342-4a46-8ffe-9e6fef711890 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=9020ebb6-3d21-44a2-80fa-7c78665742e4 HTTP/1.1" status: 200 len: 217 time: 0.0386822 Nov 09 04:44:27.242022 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-83541e83-8bc9-4d07-bf8a-3aa63fded7a7 None None] Checking router: 203a01a6-369d-4e73-a6d0-b0605f8d5a6a for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:44:27.251039 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-83541e83-8bc9-4d07-bf8a-3aa63fded7a7 None None] Routers {'203a01a6-369d-4e73-a6d0-b0605f8d5a6a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:44:27.252199 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-83541e83-8bc9-4d07-bf8a-3aa63fded7a7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:44:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['203a01a6-369d-4e73-a6d0-b0605f8d5a6a'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:44:27.279340 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fb1e926-ae57-43ee-983c-ad32f34ab8fd req-b83b812d-af3c-46f3-8554-619cd7662dec service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:44:27.280831 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5fb1e926-ae57-43ee-983c-ad32f34ab8fd req-b83b812d-af3c-46f3-8554-619cd7662dec service neutron] 10.222.0.26 "GET /v2.0/subnets?id=f6a08667-654b-4e0c-9f85-c6e6712cc239 HTTP/1.1" status: 200 len: 851 time: 0.0461793 Nov 09 04:44:27.336265 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fb1e926-ae57-43ee-983c-ad32f34ab8fd req-873210bb-a403-49ea-a860-0dcb2ebac3a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:44:27.338076 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5fb1e926-ae57-43ee-983c-ad32f34ab8fd req-873210bb-a403-49ea-a860-0dcb2ebac3a5 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=999b1b20-f8fc-4caf-84cc-3feda426a0bf&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0497651 Nov 09 04:44:27.368743 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-83541e83-8bc9-4d07-bf8a-3aa63fded7a7 None None] Set router 203a01a6-369d-4e73-a6d0-b0605f8d5a6a gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:44:27.437392 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5fb1e926-ae57-43ee-983c-ad32f34ab8fd req-6f5f1d11-a47c-425a-9cf3-3bd53834e2d0 service neutron] 10.222.0.26 "GET /v2.0/networks/999b1b20-f8fc-4caf-84cc-3feda426a0bf?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0920413 Nov 09 04:44:27.451693 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0aaaa22-e9ce-4158-8771-a084f06dba1d req-a7a38389-2a68-42cf-8ba7-0b09bfe0ec86 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:44:27.453427 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-e0aaaa22-e9ce-4158-8771-a084f06dba1d req-a7a38389-2a68-42cf-8ba7-0b09bfe0ec86 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=255f168a-466b-4fcf-8478-32dab054b831 HTTP/1.1" status: 200 len: 945 time: 0.1006520 Nov 09 04:44:27.505646 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-e0aaaa22-e9ce-4158-8771-a084f06dba1d req-4e644243-4757-47d1-a4a8-8f1cc50545b7 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0463159 Nov 09 04:44:27.544784 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5fb1e926-ae57-43ee-983c-ad32f34ab8fd req-88bf0db2-45af-4d6f-ba08-0939b35ba900 service neutron] 10.222.0.26 "GET /v2.0/networks/999b1b20-f8fc-4caf-84cc-3feda426a0bf?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0993752 Nov 09 04:44:27.638598 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-83541e83-8bc9-4d07-bf8a-3aa63fded7a7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'name': 'tempest-TestVolumeBootPattern-1675179943-router', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.164'}], 'enable_snat': True}, 'gw_port_id': '873960f9-e8b5-48a6-a119-47c32f5b7968', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:34:33Z', 'updated_at': '2021-11-09T04:34:38Z', 'revision_number': 4, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'gw_port': {'id': '873960f9-e8b5-48a6-a119-47c32f5b7968', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:95:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1097, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.164', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:34:34Z', 'updated_at': '2021-11-09T04:34:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '6b30fd91-6470-4a72-a74d-84beb135dcc6', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'floating_ip_address': '172.26.0.216', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'port_id': '65ca937a-8471-4c50-bca1-78fbcfc42fb6', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 1404, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf', 'mac_address': 'fa:16:3e:1f:06:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04f80039-ab30-438a-adbf-bd30827f9a50', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:39:03Z', 'updated_at': '2021-11-09T04:39:05Z', 'revision_number': 1, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a5f1e54d-1d98-4741-a1ce-59f4cfb5b332', 'name': '', 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'mac_address': 'fa:16:3e:de:ab:2f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1107, 'fixed_ips': [{'subnet_id': 'f6a08667-654b-4e0c-9f85-c6e6712cc239', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:34:37Z', 'updated_at': '2021-11-09T04:34:46Z', 'revision_number': 5, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'subnets': [{'id': 'f6a08667-654b-4e0c-9f85-c6e6712cc239', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:44:27.668587 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-83541e83-8bc9-4d07-bf8a-3aa63fded7a7 None None] The sync data for ids ['203a01a6-369d-4e73-a6d0-b0605f8d5a6a'] in dv-neutron-816802-2-hyperv is: [{'id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'name': 'tempest-TestVolumeBootPattern-1675179943-router', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.164'}], 'enable_snat': True}, 'gw_port_id': '873960f9-e8b5-48a6-a119-47c32f5b7968', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:34:33Z', 'updated_at': '2021-11-09T04:34:38Z', 'revision_number': 4, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'gw_port': {'id': '873960f9-e8b5-48a6-a119-47c32f5b7968', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:95:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1097, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.164', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:34:34Z', 'updated_at': '2021-11-09T04:34:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '6b30fd91-6470-4a72-a74d-84beb135dcc6', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'floating_ip_address': '172.26.0.216', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'port_id': '65ca937a-8471-4c50-bca1-78fbcfc42fb6', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 1404, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf', 'mac_address': 'fa:16:3e:1f:06:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04f80039-ab30-438a-adbf-bd30827f9a50', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:39:03Z', 'updated_at': '2021-11-09T04:39:05Z', 'revision_number': 1, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a5f1e54d-1d98-4741-a1ce-59f4cfb5b332', 'name': '', 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'mac_address': 'fa:16:3e:de:ab:2f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1107, 'fixed_ips': [{'subnet_id': 'f6a08667-654b-4e0c-9f85-c6e6712cc239', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:34:37Z', 'updated_at': '2021-11-09T04:34:46Z', 'revision_number': 5, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'subnets': [{'id': 'f6a08667-654b-4e0c-9f85-c6e6712cc239', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:44:27.893981 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e977ad21-a852-4b6c-b696-b53f31f3ffd4 None None] New status for floating IP 60f6b65a-cb39-41e6-8d69-6ed84b3214bc: DOWN {{(pid=102164) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 04:44:28.682925 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-522d0b24-39c4-49e9-8b0e-bd4e8101dd74 req-bafffe20-299a-44aa-844f-aabf42093e23 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:44:28.684369 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-522d0b24-39c4-49e9-8b0e-bd4e8101dd74 req-bafffe20-299a-44aa-844f-aabf42093e23 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=255f168a-466b-4fcf-8478-32dab054b831 HTTP/1.1" status: 200 len: 945 time: 0.0951483 Nov 09 04:44:28.732265 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-522d0b24-39c4-49e9-8b0e-bd4e8101dd74 req-407b7e6c-b4fd-4bd1-9185-fc95cdb8fe28 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420716 Nov 09 04:44:28.924832 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e775a7d2-13e0-482f-8532-04dc8e180e2e req-a7fa558e-b55b-47a2-91fb-2e17b22acd96 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:44:28.926254 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e775a7d2-13e0-482f-8532-04dc8e180e2e req-a7fa558e-b55b-47a2-91fb-2e17b22acd96 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.26 "GET /v2.0/ports?device_id=255f168a-466b-4fcf-8478-32dab054b831 HTTP/1.1" status: 200 len: 945 time: 0.0471275 Nov 09 04:44:29.013121 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-e775a7d2-13e0-482f-8532-04dc8e180e2e req-31292b4d-2a80-476a-aff7-49c20e890952 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Deleting port 9020ebb6-3d21-44a2-80fa-7c78665742e4 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:44:29.013455 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-e775a7d2-13e0-482f-8532-04dc8e180e2e req-31292b4d-2a80-476a-aff7-49c20e890952 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:29.101305 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-e775a7d2-13e0-482f-8532-04dc8e180e2e req-31292b4d-2a80-476a-aff7-49c20e890952 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] For port 9020ebb6-3d21-44a2-80fa-7c78665742e4, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=9020ebb6-3d21-44a2-80fa-7c78665742e4,segment=NetworkSegment(bc4577c9-06a5-450a-9c80-879827986f04),segment_id=bc4577c9-06a5-450a-9c80-879827986f04)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:44:29.101658 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-e775a7d2-13e0-482f-8532-04dc8e180e2e req-31292b4d-2a80-476a-aff7-49c20e890952 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:29.113844 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-e775a7d2-13e0-482f-8532-04dc8e180e2e req-31292b4d-2a80-476a-aff7-49c20e890952 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Calling delete_port for 9020ebb6-3d21-44a2-80fa-7c78665742e4 owned by compute:nova {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:44:29.325046 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-e775a7d2-13e0-482f-8532-04dc8e180e2e req-31292b4d-2a80-476a-aff7-49c20e890952 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:29.352568 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31292b4d-2a80-476a-aff7-49c20e890952 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Pushing event deleted for resources: {'Port': ['ID=9020ebb6-3d21-44a2-80fa-7c78665742e4,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:44:29.391320 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-e775a7d2-13e0-482f-8532-04dc8e180e2e req-31292b4d-2a80-476a-aff7-49c20e890952 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] No DVR routers for this DVR port 9020ebb6-3d21-44a2-80fa-7c78665742e4 on host hv-neutron-8168 {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:44:29.393746 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-e775a7d2-13e0-482f-8532-04dc8e180e2e req-31292b4d-2a80-476a-aff7-49c20e890952 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:29.397052 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e775a7d2-13e0-482f-8532-04dc8e180e2e req-31292b4d-2a80-476a-aff7-49c20e890952 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.26 "DELETE /v2.0/ports/9020ebb6-3d21-44a2-80fa-7c78665742e4 HTTP/1.1" status: 204 len: 173 time: 0.4642346 Nov 09 04:44:29.397475 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '255f168a-466b-4fcf-8478-32dab054b831', 'name': 'network-vif-deleted', 'tag': '9020ebb6-3d21-44a2-80fa-7c78665742e4'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:44:29.399709 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6a504e56-aa6f-44f6-adfb-680d0a259770" -d '{"events": [{"server_uuid": "255f168a-466b-4fcf-8478-32dab054b831", "name": "network-vif-deleted", "tag": "9020ebb6-3d21-44a2-80fa-7c78665742e4"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:44:29.447459 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:44:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ba86fea7-2dfe-4848-90ce-4d86cc96a582 x-openstack-request-id: req-ba86fea7-2dfe-4848-90ce-4d86cc96a582 {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:44:29.447745 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "255f168a-466b-4fcf-8478-32dab054b831", "name": "network-vif-deleted", "tag": "9020ebb6-3d21-44a2-80fa-7c78665742e4", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:44:29.447992 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-ba86fea7-2dfe-4848-90ce-4d86cc96a582 {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:44:29.449000 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '255f168a-466b-4fcf-8478-32dab054b831', 'name': 'network-vif-deleted', 'tag': '9020ebb6-3d21-44a2-80fa-7c78665742e4', 'status': 'completed', 'code': 200} Nov 09 04:44:29.830749 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2a96b97e-36a4-48dd-962c-6ddd3becec14 req-115d90b8-952b-4c26-99f8-16bf5c35a178 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=255f168a-466b-4fcf-8478-32dab054b831 HTTP/1.1" status: 200 len: 210 time: 0.0300608 Nov 09 04:44:30.933160 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f48bd35e-e7d0-4850-a03f-34cc1b56e529 req-d1eafc91-5ccd-43e2-a597-001689b34612 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=255f168a-466b-4fcf-8478-32dab054b831 HTTP/1.1" status: 200 len: 210 time: 0.0300705 Nov 09 04:44:31.350171 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 9020ebb6-3d21-44a2-80fa-7c78665742e4 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:44:31.370253 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] No Port match for: 9020ebb6-3d21-44a2-80fa-7c78665742e4 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:44:31.370622 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 9020ebb6-3d21-44a2-80fa-7c78665742e4 not bound to the agent host hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:44:31.742392 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 32848) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:44:31.907352 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-21f64326-73ec-41cf-815a-77e3c096e3bc tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Deleting port 28b98abe-4b0d-440e-9ebe-c0d73636a30c {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:44:31.907693 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-21f64326-73ec-41cf-815a-77e3c096e3bc tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:31.990187 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-21f64326-73ec-41cf-815a-77e3c096e3bc tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:31.990549 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-21f64326-73ec-41cf-815a-77e3c096e3bc tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:32.005216 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-21f64326-73ec-41cf-815a-77e3c096e3bc tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Calling delete_port for 28b98abe-4b0d-440e-9ebe-c0d73636a30c owned by network:floatingip {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:44:32.039004 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1a045509-d0a2-4fe9-9c1b-08179f1354e7 req-f2552efd-d928-44af-9537-5d7a81bb15be tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=255f168a-466b-4fcf-8478-32dab054b831 HTTP/1.1" status: 200 len: 210 time: 0.0350475 Nov 09 04:44:32.243406 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-21f64326-73ec-41cf-815a-77e3c096e3bc tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:32.280992 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21f64326-73ec-41cf-815a-77e3c096e3bc tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'Port': ['ID=28b98abe-4b0d-440e-9ebe-c0d73636a30c,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:44:32.348424 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-21f64326-73ec-41cf-815a-77e3c096e3bc tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for floatingip, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:32.348750 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.l3_db [None req-21f64326-73ec-41cf-815a-77e3c096e3bc tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Floating IP 52a062f1-dbcf-42fe-9c80-06ac6e9d9151 disassociated (deleted). External IP: 172.26.0.102, port: c89ba17b-04dd-4269-8d17-8f5d1eac8808. Nov 09 04:44:32.558345 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-21f64326-73ec-41cf-815a-77e3c096e3bc tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Router f13bdef0-14e2-4965-81f3-edd791830726 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:44:32.666246 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-21f64326-73ec-41cf-815a-77e3c096e3bc tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:44:32.671720 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-21f64326-73ec-41cf-815a-77e3c096e3bc tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:32.678035 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ff5d7f73-3068-4409-8c7c-2557062d4d63 None None] Sync routers for ids ['f13bdef0-14e2-4965-81f3-edd791830726'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:44:32.693031 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ff5d7f73-3068-4409-8c7c-2557062d4d63 None None] Routers {'f13bdef0-14e2-4965-81f3-edd791830726'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:44:32.693643 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-ff5d7f73-3068-4409-8c7c-2557062d4d63 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:44:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['f13bdef0-14e2-4965-81f3-edd791830726'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:44:32.698968 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-21f64326-73ec-41cf-815a-77e3c096e3bc tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "DELETE /v2.0/floatingips/52a062f1-dbcf-42fe-9c80-06ac6e9d9151 HTTP/1.1" status: 204 len: 168 time: 0.9555159 Nov 09 04:44:32.699525 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'efa8cc26-7104-425a-92ab-aeb8d9bb62bc', 'tag': 'c89ba17b-04dd-4269-8d17-8f5d1eac8808'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:44:32.701864 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e0c73eab-5245-4b6d-b812-1300ad15ea05" -d '{"events": [{"name": "network-changed", "server_uuid": "efa8cc26-7104-425a-92ab-aeb8d9bb62bc", "tag": "c89ba17b-04dd-4269-8d17-8f5d1eac8808"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:44:32.738033 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:44:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b76cd8c0-8bc4-41eb-bc87-09bc63459ef2 x-openstack-request-id: req-b76cd8c0-8bc4-41eb-bc87-09bc63459ef2 {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:44:32.738316 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "efa8cc26-7104-425a-92ab-aeb8d9bb62bc", "tag": "c89ba17b-04dd-4269-8d17-8f5d1eac8808", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:44:32.738590 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-b76cd8c0-8bc4-41eb-bc87-09bc63459ef2 {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:44:32.738991 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'efa8cc26-7104-425a-92ab-aeb8d9bb62bc', 'tag': 'c89ba17b-04dd-4269-8d17-8f5d1eac8808', 'status': 'completed', 'code': 200} Nov 09 04:44:32.810749 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0c73eab-5245-4b6d-b812-1300ad15ea05 req-cf05601a-7189-41e0-b825-e35ca8848b42 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:44:32.812251 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e0c73eab-5245-4b6d-b812-1300ad15ea05 req-cf05601a-7189-41e0-b825-e35ca8848b42 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&device_id=efa8cc26-7104-425a-92ab-aeb8d9bb62bc HTTP/1.1" status: 200 len: 1098 time: 0.0447400 Nov 09 04:44:32.830773 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-ff5d7f73-3068-4409-8c7c-2557062d4d63 None None] Set router f13bdef0-14e2-4965-81f3-edd791830726 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:44:32.919058 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0c73eab-5245-4b6d-b812-1300ad15ea05 req-68e3d495-9e71-4548-999a-56d84d7fc7a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:44:32.920578 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e0c73eab-5245-4b6d-b812-1300ad15ea05 req-68e3d495-9e71-4548-999a-56d84d7fc7a1 service neutron] 10.222.0.26 "GET /v2.0/networks?id=48525ef7-c383-4b41-af35-4362b85562cf HTTP/1.1" status: 200 len: 898 time: 0.1012170 Nov 09 04:44:32.968346 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e0c73eab-5245-4b6d-b812-1300ad15ea05 req-c9d4d337-07bd-4c53-a247-a96d5ca907ef service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=c89ba17b-04dd-4269-8d17-8f5d1eac8808 HTTP/1.1" status: 200 len: 217 time: 0.0391207 Nov 09 04:44:33.022065 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0c73eab-5245-4b6d-b812-1300ad15ea05 req-bce97e3c-fd75-4571-a2cc-0685638f1642 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:44:33.023659 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e0c73eab-5245-4b6d-b812-1300ad15ea05 req-bce97e3c-fd75-4571-a2cc-0685638f1642 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=070d772f-0def-421a-88b5-aa171b2c21ba HTTP/1.1" status: 200 len: 844 time: 0.0487647 Nov 09 04:44:33.079155 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0c73eab-5245-4b6d-b812-1300ad15ea05 req-43fc6511-87c1-4da7-90a1-d4419ced1d5e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:44:33.080794 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e0c73eab-5245-4b6d-b812-1300ad15ea05 req-43fc6511-87c1-4da7-90a1-d4419ced1d5e service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=48525ef7-c383-4b41-af35-4362b85562cf&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0480669 Nov 09 04:44:33.193076 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-be3d57d8-470c-4755-8432-e2966c1fe630 req-875bfe05-c4f9-499a-97c8-cab9d8db8797 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=255f168a-466b-4fcf-8478-32dab054b831 HTTP/1.1" status: 200 len: 210 time: 0.0489120 Nov 09 04:44:33.254376 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-ff5d7f73-3068-4409-8c7c-2557062d4d63 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f13bdef0-14e2-4965-81f3-edd791830726', 'name': 'tempest-TestNetworkBasicOps-router-952339284', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.194'}], 'enable_snat': True}, 'gw_port_id': 'ec5fce5b-ee83-4955-8947-4ecdfe3bce2b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:41:28Z', 'updated_at': '2021-11-09T04:41:32Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': 'ec5fce5b-ee83-4955-8947-4ecdfe3bce2b', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:8e:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f13bdef0-14e2-4965-81f3-edd791830726', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1455, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:41:28Z', 'updated_at': '2021-11-09T04:41:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '064e1a31-61b7-44c2-be25-3ad23c3252e1', 'name': '', 'network_id': '48525ef7-c383-4b41-af35-4362b85562cf', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:2a:e3:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f13bdef0-14e2-4965-81f3-edd791830726', 'device_owner': 'network:router_interface', 'standard_attr_id': 1458, 'fixed_ips': [{'subnet_id': '070d772f-0def-421a-88b5-aa171b2c21ba', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:41:32Z', 'updated_at': '2021-11-09T04:41:35Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '070d772f-0def-421a-88b5-aa171b2c21ba', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': ['9.8.7.6'], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:44:33.257618 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e0c73eab-5245-4b6d-b812-1300ad15ea05 req-20b56ccd-ac99-4dc3-87e7-1c7bbc4af111 service neutron] 10.222.0.26 "GET /v2.0/networks/48525ef7-c383-4b41-af35-4362b85562cf?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1679010 Nov 09 04:44:33.261232 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-014bec46-f671-43cb-b14a-432024ef1c00 req-d366b734-b578-44c9-bb58-527438cfeb30 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:44:33.263333 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-014bec46-f671-43cb-b14a-432024ef1c00 req-d366b734-b578-44c9-bb58-527438cfeb30 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=efa8cc26-7104-425a-92ab-aeb8d9bb62bc HTTP/1.1" status: 200 len: 945 time: 0.0893495 Nov 09 04:44:33.282112 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ff5d7f73-3068-4409-8c7c-2557062d4d63 None None] Checking router: f13bdef0-14e2-4965-81f3-edd791830726 for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:44:33.291345 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ff5d7f73-3068-4409-8c7c-2557062d4d63 None None] Routers {'f13bdef0-14e2-4965-81f3-edd791830726'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:44:33.292540 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-ff5d7f73-3068-4409-8c7c-2557062d4d63 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:44:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['f13bdef0-14e2-4965-81f3-edd791830726'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:44:33.324520 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-014bec46-f671-43cb-b14a-432024ef1c00 req-e58ada80-04ac-4a8c-ab8c-7b98bfe1ccf3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=74002bcd-7488-4d42-8508-4a4b8f5fb88a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0539546 Nov 09 04:44:33.373721 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e0c73eab-5245-4b6d-b812-1300ad15ea05 req-b065c9e4-9f54-4abc-81c1-ba9619d8b543 service neutron] 10.222.0.26 "GET /v2.0/networks/48525ef7-c383-4b41-af35-4362b85562cf?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1064034 Nov 09 04:44:33.402992 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-ff5d7f73-3068-4409-8c7c-2557062d4d63 None None] Set router f13bdef0-14e2-4965-81f3-edd791830726 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:44:33.603399 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-ff5d7f73-3068-4409-8c7c-2557062d4d63 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f13bdef0-14e2-4965-81f3-edd791830726', 'name': 'tempest-TestNetworkBasicOps-router-952339284', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.194'}], 'enable_snat': True}, 'gw_port_id': 'ec5fce5b-ee83-4955-8947-4ecdfe3bce2b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:41:28Z', 'updated_at': '2021-11-09T04:41:32Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': 'ec5fce5b-ee83-4955-8947-4ecdfe3bce2b', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:8e:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f13bdef0-14e2-4965-81f3-edd791830726', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1455, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:41:28Z', 'updated_at': '2021-11-09T04:41:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '064e1a31-61b7-44c2-be25-3ad23c3252e1', 'name': '', 'network_id': '48525ef7-c383-4b41-af35-4362b85562cf', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:2a:e3:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f13bdef0-14e2-4965-81f3-edd791830726', 'device_owner': 'network:router_interface', 'standard_attr_id': 1458, 'fixed_ips': [{'subnet_id': '070d772f-0def-421a-88b5-aa171b2c21ba', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:41:32Z', 'updated_at': '2021-11-09T04:41:35Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '070d772f-0def-421a-88b5-aa171b2c21ba', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': ['9.8.7.6'], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:44:33.629670 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ff5d7f73-3068-4409-8c7c-2557062d4d63 None None] The sync data for ids ['f13bdef0-14e2-4965-81f3-edd791830726'] in dv-neutron-816802-2-hyperv is: [{'id': 'f13bdef0-14e2-4965-81f3-edd791830726', 'name': 'tempest-TestNetworkBasicOps-router-952339284', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.194'}], 'enable_snat': True}, 'gw_port_id': 'ec5fce5b-ee83-4955-8947-4ecdfe3bce2b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:41:28Z', 'updated_at': '2021-11-09T04:41:32Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': 'ec5fce5b-ee83-4955-8947-4ecdfe3bce2b', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:8e:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f13bdef0-14e2-4965-81f3-edd791830726', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1455, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:41:28Z', 'updated_at': '2021-11-09T04:41:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '064e1a31-61b7-44c2-be25-3ad23c3252e1', 'name': '', 'network_id': '48525ef7-c383-4b41-af35-4362b85562cf', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:2a:e3:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f13bdef0-14e2-4965-81f3-edd791830726', 'device_owner': 'network:router_interface', 'standard_attr_id': 1458, 'fixed_ips': [{'subnet_id': '070d772f-0def-421a-88b5-aa171b2c21ba', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:41:32Z', 'updated_at': '2021-11-09T04:41:35Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '070d772f-0def-421a-88b5-aa171b2c21ba', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': ['9.8.7.6'], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:44:33.837250 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e2f51697-1021-4e5d-a38e-8eac767c194d None None] New status for floating IP 52a062f1-dbcf-42fe-9c80-06ac6e9d9151: DOWN {{(pid=102164) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 04:44:34.310902 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1cb5bf08-6ca3-4874-abb3-872c79d5b5a2 req-a2496193-afcf-48ce-96a6-3a5708644427 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=255f168a-466b-4fcf-8478-32dab054b831 HTTP/1.1" status: 200 len: 210 time: 0.0264568 Nov 09 04:44:34.405425 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d77d1b1-b80f-4e82-b2d7-506faad433bf req-04cb5e77-b563-4f08-83d4-19439be36586 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:44:34.406926 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4d77d1b1-b80f-4e82-b2d7-506faad433bf req-04cb5e77-b563-4f08-83d4-19439be36586 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "GET /v2.0/ports?device_id=efa8cc26-7104-425a-92ab-aeb8d9bb62bc HTTP/1.1" status: 200 len: 945 time: 0.0468047 Nov 09 04:44:34.442066 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85172d68-8c08-420e-a848-c917ee0dc2b3 req-3ee5eec9-5f3a-4ee8-b467-2486b3f774b1 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:44:34.443602 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-85172d68-8c08-420e-a848-c917ee0dc2b3 req-3ee5eec9-5f3a-4ee8-b467-2486b3f774b1 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=efa8cc26-7104-425a-92ab-aeb8d9bb62bc HTTP/1.1" status: 200 len: 945 time: 0.0486405 Nov 09 04:44:34.493836 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-85172d68-8c08-420e-a848-c917ee0dc2b3 req-415ae1d6-56b9-4cb8-a90f-3ab5dedc02c8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=74002bcd-7488-4d42-8508-4a4b8f5fb88a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0442624 Nov 09 04:44:34.509457 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-4d77d1b1-b80f-4e82-b2d7-506faad433bf req-b45e5a06-a0de-44fe-97ae-2f07807f63df tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Deleting port c89ba17b-04dd-4269-8d17-8f5d1eac8808 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:44:34.509795 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-4d77d1b1-b80f-4e82-b2d7-506faad433bf req-b45e5a06-a0de-44fe-97ae-2f07807f63df tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:34.599052 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-4d77d1b1-b80f-4e82-b2d7-506faad433bf req-b45e5a06-a0de-44fe-97ae-2f07807f63df tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] For port c89ba17b-04dd-4269-8d17-8f5d1eac8808, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=c89ba17b-04dd-4269-8d17-8f5d1eac8808,segment=NetworkSegment(776df773-c3a8-4771-9fc6-803dc540938f),segment_id=776df773-c3a8-4771-9fc6-803dc540938f)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:44:34.599412 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-4d77d1b1-b80f-4e82-b2d7-506faad433bf req-b45e5a06-a0de-44fe-97ae-2f07807f63df tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:34.612298 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-4d77d1b1-b80f-4e82-b2d7-506faad433bf req-b45e5a06-a0de-44fe-97ae-2f07807f63df tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Calling delete_port for c89ba17b-04dd-4269-8d17-8f5d1eac8808 owned by compute:nova {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:44:34.781132 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-4d77d1b1-b80f-4e82-b2d7-506faad433bf req-b45e5a06-a0de-44fe-97ae-2f07807f63df tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:34.809364 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b45e5a06-a0de-44fe-97ae-2f07807f63df tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'Port': ['ID=c89ba17b-04dd-4269-8d17-8f5d1eac8808,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:44:34.852640 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-4d77d1b1-b80f-4e82-b2d7-506faad433bf req-b45e5a06-a0de-44fe-97ae-2f07807f63df tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] No DVR routers for this DVR port c89ba17b-04dd-4269-8d17-8f5d1eac8808 on host hv-neutron-8168 {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:44:34.855293 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-4d77d1b1-b80f-4e82-b2d7-506faad433bf req-b45e5a06-a0de-44fe-97ae-2f07807f63df tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:34.859045 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4d77d1b1-b80f-4e82-b2d7-506faad433bf req-b45e5a06-a0de-44fe-97ae-2f07807f63df tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "DELETE /v2.0/ports/c89ba17b-04dd-4269-8d17-8f5d1eac8808 HTTP/1.1" status: 204 len: 173 time: 0.4460239 Nov 09 04:44:34.859503 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'efa8cc26-7104-425a-92ab-aeb8d9bb62bc', 'name': 'network-vif-deleted', 'tag': 'c89ba17b-04dd-4269-8d17-8f5d1eac8808'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:44:34.862459 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3037493b-2da6-4437-b083-84e52264c221" -d '{"events": [{"server_uuid": "efa8cc26-7104-425a-92ab-aeb8d9bb62bc", "name": "network-vif-deleted", "tag": "c89ba17b-04dd-4269-8d17-8f5d1eac8808"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:44:34.898566 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:44:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8565d5bc-ea25-477d-89eb-3d896257c7d9 x-openstack-request-id: req-8565d5bc-ea25-477d-89eb-3d896257c7d9 {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:44:34.898862 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "efa8cc26-7104-425a-92ab-aeb8d9bb62bc", "name": "network-vif-deleted", "tag": "c89ba17b-04dd-4269-8d17-8f5d1eac8808", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:44:34.899564 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-8565d5bc-ea25-477d-89eb-3d896257c7d9 {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:44:34.900332 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'efa8cc26-7104-425a-92ab-aeb8d9bb62bc', 'name': 'network-vif-deleted', 'tag': 'c89ba17b-04dd-4269-8d17-8f5d1eac8808', 'status': 'completed', 'code': 200} Nov 09 04:44:35.613374 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-47d3e7c0-710c-4d6a-a805-7f3fe4692959 req-f7c97e73-79d4-4c57-b59c-d98651aea2b7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=efa8cc26-7104-425a-92ab-aeb8d9bb62bc HTTP/1.1" status: 200 len: 210 time: 0.0260730 Nov 09 04:44:36.672805 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 32882) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:44:36.729800 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5bce1495-32e3-4c6c-86b6-db795975ac64 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:36.754388 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5bce1495-32e3-4c6c-86b6-db795975ac64 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:36.867281 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5bce1495-32e3-4c6c-86b6-db795975ac64 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:36.870581 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5bce1495-32e3-4c6c-86b6-db795975ac64 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:36.874612 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-5bce1495-32e3-4c6c-86b6-db795975ac64 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "DELETE /v2.0/security-groups/74002bcd-7488-4d42-8508-4a4b8f5fb88a HTTP/1.1" status: 204 len: 168 time: 0.1978712 Nov 09 04:44:36.896417 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bce1495-32e3-4c6c-86b6-db795975ac64 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=74002bcd-7488-4d42-8508-4a4b8f5fb88a,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:44:36.960310 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 32886) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:44:37.320154 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2dcc16c6-a2ee-4f22-ad8c-ea9296fcf9bf tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:37.378449 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device c89ba17b-04dd-4269-8d17-8f5d1eac8808 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:44:37.398901 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] No Port match for: c89ba17b-04dd-4269-8d17-8f5d1eac8808 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:44:37.399250 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device c89ba17b-04dd-4269-8d17-8f5d1eac8808 not bound to the agent host hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:44:37.859641 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-2dcc16c6-a2ee-4f22-ad8c-ea9296fcf9bf tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Deleting port 064e1a31-61b7-44c2-be25-3ad23c3252e1 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:44:37.859980 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2dcc16c6-a2ee-4f22-ad8c-ea9296fcf9bf tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:37.951693 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-2dcc16c6-a2ee-4f22-ad8c-ea9296fcf9bf tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] For port 064e1a31-61b7-44c2-be25-3ad23c3252e1, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=064e1a31-61b7-44c2-be25-3ad23c3252e1,segment=NetworkSegment(776df773-c3a8-4771-9fc6-803dc540938f),segment_id=776df773-c3a8-4771-9fc6-803dc540938f)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:44:37.951922 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2dcc16c6-a2ee-4f22-ad8c-ea9296fcf9bf tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:37.964672 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-2dcc16c6-a2ee-4f22-ad8c-ea9296fcf9bf tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Calling delete_port for 064e1a31-61b7-44c2-be25-3ad23c3252e1 owned by network:router_interface {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:44:38.215946 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2dcc16c6-a2ee-4f22-ad8c-ea9296fcf9bf tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:38.243919 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2dcc16c6-a2ee-4f22-ad8c-ea9296fcf9bf tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'Port': ['ID=064e1a31-61b7-44c2-be25-3ad23c3252e1,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:44:38.430317 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2dcc16c6-a2ee-4f22-ad8c-ea9296fcf9bf tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:38.648708 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2dcc16c6-a2ee-4f22-ad8c-ea9296fcf9bf tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Router f13bdef0-14e2-4965-81f3-edd791830726 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:44:38.759659 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2dcc16c6-a2ee-4f22-ad8c-ea9296fcf9bf tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:44:38.768327 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-2dcc16c6-a2ee-4f22-ad8c-ea9296fcf9bf tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "PUT /v2.0/routers/f13bdef0-14e2-4965-81f3-edd791830726/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8040886 Nov 09 04:44:38.768327 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 32894) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:44:38.777951 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-59be99be-cb32-47f1-a5bf-dd0fccac29b9 None None] Sync routers for ids ['f13bdef0-14e2-4965-81f3-edd791830726'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:44:38.787966 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-59be99be-cb32-47f1-a5bf-dd0fccac29b9 None None] Routers {'f13bdef0-14e2-4965-81f3-edd791830726'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:44:38.788583 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-59be99be-cb32-47f1-a5bf-dd0fccac29b9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:44:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['f13bdef0-14e2-4965-81f3-edd791830726'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:44:38.822418 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-5e8a634b-dd58-4a8a-9028-b7c3ce3f866f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Deleting subnet 070d772f-0def-421a-88b5-aa171b2c21ba {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:44:38.826375 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5e8a634b-dd58-4a8a-9028-b7c3ce3f866f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:38.867247 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5e8a634b-dd58-4a8a-9028-b7c3ce3f866f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:38.903744 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-59be99be-cb32-47f1-a5bf-dd0fccac29b9 None None] Set router f13bdef0-14e2-4965-81f3-edd791830726 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:44:39.001058 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5e8a634b-dd58-4a8a-9028-b7c3ce3f866f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:39.097843 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-59be99be-cb32-47f1-a5bf-dd0fccac29b9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f13bdef0-14e2-4965-81f3-edd791830726', 'name': 'tempest-TestNetworkBasicOps-router-952339284', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.194'}], 'enable_snat': True}, 'gw_port_id': 'ec5fce5b-ee83-4955-8947-4ecdfe3bce2b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:41:28Z', 'updated_at': '2021-11-09T04:44:38Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': 'ec5fce5b-ee83-4955-8947-4ecdfe3bce2b', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:8e:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f13bdef0-14e2-4965-81f3-edd791830726', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1455, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:41:28Z', 'updated_at': '2021-11-09T04:41:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:44:39.123871 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-59be99be-cb32-47f1-a5bf-dd0fccac29b9 None None] Checking router: f13bdef0-14e2-4965-81f3-edd791830726 for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:44:39.132231 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-59be99be-cb32-47f1-a5bf-dd0fccac29b9 None None] Routers {'f13bdef0-14e2-4965-81f3-edd791830726'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:44:39.132928 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-59be99be-cb32-47f1-a5bf-dd0fccac29b9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:44:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['f13bdef0-14e2-4965-81f3-edd791830726'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:44:39.185937 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5e8a634b-dd58-4a8a-9028-b7c3ce3f866f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:39.218549 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e8a634b-dd58-4a8a-9028-b7c3ce3f866f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'Subnet': ['ID=070d772f-0def-421a-88b5-aa171b2c21ba,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:44:39.220737 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5e8a634b-dd58-4a8a-9028-b7c3ce3f866f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:39.224066 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-5e8a634b-dd58-4a8a-9028-b7c3ce3f866f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "DELETE /v2.0/subnets/070d772f-0def-421a-88b5-aa171b2c21ba HTTP/1.1" status: 204 len: 168 time: 0.4550350 Nov 09 04:44:39.226739 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 32898) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:44:39.235605 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4f9b4586-818e-4485-85a1-7d2188362215 None None] Network 48525ef7-c383-4b41-af35-4362b85562cf requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:44:39.289836 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-59be99be-cb32-47f1-a5bf-dd0fccac29b9 None None] Set router f13bdef0-14e2-4965-81f3-edd791830726 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:44:39.348821 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-665908e6-9657-4664-993a-f334920498c4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:39.453582 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-665908e6-9657-4664-993a-f334920498c4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router_gateway, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:39.588408 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-665908e6-9657-4664-993a-f334920498c4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Deleting port ec5fce5b-ee83-4955-8947-4ecdfe3bce2b {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:44:39.589712 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-665908e6-9657-4664-993a-f334920498c4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:39.610982 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-59be99be-cb32-47f1-a5bf-dd0fccac29b9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f13bdef0-14e2-4965-81f3-edd791830726', 'name': 'tempest-TestNetworkBasicOps-router-952339284', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.194'}], 'enable_snat': True}, 'gw_port_id': 'ec5fce5b-ee83-4955-8947-4ecdfe3bce2b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:41:28Z', 'updated_at': '2021-11-09T04:44:38Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': 'ec5fce5b-ee83-4955-8947-4ecdfe3bce2b', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:8e:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f13bdef0-14e2-4965-81f3-edd791830726', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1455, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:41:28Z', 'updated_at': '2021-11-09T04:41:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:44:39.661214 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-59be99be-cb32-47f1-a5bf-dd0fccac29b9 None None] The sync data for ids ['f13bdef0-14e2-4965-81f3-edd791830726'] in dv-neutron-816802-2-hyperv is: [{'id': 'f13bdef0-14e2-4965-81f3-edd791830726', 'name': 'tempest-TestNetworkBasicOps-router-952339284', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.194'}], 'enable_snat': True}, 'gw_port_id': 'ec5fce5b-ee83-4955-8947-4ecdfe3bce2b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:41:28Z', 'updated_at': '2021-11-09T04:44:38Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': 'ec5fce5b-ee83-4955-8947-4ecdfe3bce2b', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:8e:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f13bdef0-14e2-4965-81f3-edd791830726', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1455, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:41:28Z', 'updated_at': '2021-11-09T04:41:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:44:39.685330 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-11e6a5e0-2ad8-42da-93cf-dc350fbc4049 None None] DHCP port deletion for 48525ef7-c383-4b41-af35-4362b85562cf request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:44:39.745815 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-665908e6-9657-4664-993a-f334920498c4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] For port ec5fce5b-ee83-4955-8947-4ecdfe3bce2b, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=ec5fce5b-ee83-4955-8947-4ecdfe3bce2b,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:44:39.747039 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-665908e6-9657-4664-993a-f334920498c4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:39.751285 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-11e6a5e0-2ad8-42da-93cf-dc350fbc4049 None None] Deleting port 7417a41c-915f-4cab-8e37-08246d66bbc1 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:44:39.751772 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-11e6a5e0-2ad8-42da-93cf-dc350fbc4049 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:39.763427 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-665908e6-9657-4664-993a-f334920498c4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Calling delete_port for ec5fce5b-ee83-4955-8947-4ecdfe3bce2b owned by network:router_gateway {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:44:39.831795 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-11e6a5e0-2ad8-42da-93cf-dc350fbc4049 None None] For port 7417a41c-915f-4cab-8e37-08246d66bbc1, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=7417a41c-915f-4cab-8e37-08246d66bbc1,segment=NetworkSegment(776df773-c3a8-4771-9fc6-803dc540938f),segment_id=776df773-c3a8-4771-9fc6-803dc540938f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:44:39.832758 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-11e6a5e0-2ad8-42da-93cf-dc350fbc4049 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:39.850760 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-11e6a5e0-2ad8-42da-93cf-dc350fbc4049 None None] Calling delete_port for 7417a41c-915f-4cab-8e37-08246d66bbc1 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:44:40.010056 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-11e6a5e0-2ad8-42da-93cf-dc350fbc4049 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:40.042835 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-665908e6-9657-4664-993a-f334920498c4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:40.043323 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11e6a5e0-2ad8-42da-93cf-dc350fbc4049 None None] Pushing event deleted for resources: {'Port': ['ID=7417a41c-915f-4cab-8e37-08246d66bbc1,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:44:40.052683 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-11e6a5e0-2ad8-42da-93cf-dc350fbc4049 None None] No DVR routers for this DVR port 7417a41c-915f-4cab-8e37-08246d66bbc1 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:44:40.054725 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11e6a5e0-2ad8-42da-93cf-dc350fbc4049 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:44:40.055144 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11e6a5e0-2ad8-42da-93cf-dc350fbc4049 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:44:40.055555 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11e6a5e0-2ad8-42da-93cf-dc350fbc4049 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:44:40.055960 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11e6a5e0-2ad8-42da-93cf-dc350fbc4049 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:44:40.056360 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11e6a5e0-2ad8-42da-93cf-dc350fbc4049 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:44:40.056759 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11e6a5e0-2ad8-42da-93cf-dc350fbc4049 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:44:40.057180 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11e6a5e0-2ad8-42da-93cf-dc350fbc4049 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:44:40.058674 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11e6a5e0-2ad8-42da-93cf-dc350fbc4049 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:44:40.059088 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11e6a5e0-2ad8-42da-93cf-dc350fbc4049 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:44:40.059420 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11e6a5e0-2ad8-42da-93cf-dc350fbc4049 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:44:40.059748 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11e6a5e0-2ad8-42da-93cf-dc350fbc4049 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:44:40.060073 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11e6a5e0-2ad8-42da-93cf-dc350fbc4049 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:44:40.100164 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-665908e6-9657-4664-993a-f334920498c4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'Port': ['ID=ec5fce5b-ee83-4955-8947-4ecdfe3bce2b,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:44:40.140960 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-665908e6-9657-4664-993a-f334920498c4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-466373'] for router_gateway, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:40.238880 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-665908e6-9657-4664-993a-f334920498c4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:40.240974 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-665908e6-9657-4664-993a-f334920498c4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:40.346962 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-665908e6-9657-4664-993a-f334920498c4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:40.347508 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-665908e6-9657-4664-993a-f334920498c4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Fanout notify agent at l3_agent the message router_deleted on router f13bdef0-14e2-4965-81f3-edd791830726 {{(pid=102161) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:44:40.354697 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-665908e6-9657-4664-993a-f334920498c4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:40.358296 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-665908e6-9657-4664-993a-f334920498c4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "DELETE /v2.0/routers/f13bdef0-14e2-4965-81f3-edd791830726 HTTP/1.1" status: 204 len: 168 time: 1.1281021 Nov 09 04:44:40.358580 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 32902) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:44:40.440699 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-33243adc-44b2-43c9-9a4f-e885733ba007 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:40.532129 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-33243adc-44b2-43c9-9a4f-e885733ba007 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:40.552102 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-33243adc-44b2-43c9-9a4f-e885733ba007 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['48525ef7-c383-4b41-af35-4362b85562cf']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:44:40.562387 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-33243adc-44b2-43c9-9a4f-e885733ba007 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '776df773-c3a8-4771-9fc6-803dc540938f') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:44:40.562691 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-33243adc-44b2-43c9-9a4f-e885733ba007 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '776df773-c3a8-4771-9fc6-803dc540938f') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:44:40.571758 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-33243adc-44b2-43c9-9a4f-e885733ba007 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:40.585588 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-33243adc-44b2-43c9-9a4f-e885733ba007 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:40.592197 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-33243adc-44b2-43c9-9a4f-e885733ba007 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Releasing vlan 349 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:44:40.592602 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-33243adc-44b2-43c9-9a4f-e885733ba007 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:40.595935 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:44:40.595935 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:44:40.595935 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:44:40.595935 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:44:40.595935 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:44:40.595935 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:44:40.595935 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:44:40.595935 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:44:40.595935 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:44:40.595935 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:44:40.595935 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:44:40.595935 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:44:40.595935 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:44:40.595935 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:44:40.595935 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:44:40.595935 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:44:40.595935 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:44:40.595935 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:44:40.595935 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:44:40.595935 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:44:40.595935 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:44:40.595935 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:44:40.595935 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:44:40.595935 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:44:40.595935 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:44:40.595935 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:44:40.595935 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:44:40.595935 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:44:40.595935 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:44:40.595935 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:44:40.595935 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:44:40.595935 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:44:40.746790 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-33243adc-44b2-43c9-9a4f-e885733ba007 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:40.757331 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-33243adc-44b2-43c9-9a4f-e885733ba007 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:40.757331 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-33243adc-44b2-43c9-9a4f-e885733ba007 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "DELETE /v2.0/networks/48525ef7-c383-4b41-af35-4362b85562cf HTTP/1.1" status: 204 len: 168 time: 0.3970981 Nov 09 04:44:40.767531 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 32904) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:44:40.768742 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33243adc-44b2-43c9-9a4f-e885733ba007 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'Network': ['ID=48525ef7-c383-4b41-af35-4362b85562cf,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:44:40.778027 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-a105dd60-fa47-4d30-91ca-04067c6ecc69 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'network': {'name': 'tempest-network-smoke--1626248206', 'project_id': '1d10b4824e524068827e58b55e269af3', 'port_security_enabled': True}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:44:40.849255 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a105dd60-fa47-4d30-91ca-04067c6ecc69 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Made reservation on behalf of 1d10b4824e524068827e58b55e269af3 for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:44:40.852899 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a105dd60-fa47-4d30-91ca-04067c6ecc69 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:40.876538 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a105dd60-fa47-4d30-91ca-04067c6ecc69 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 336} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:44:40.885489 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a105dd60-fa47-4d30-91ca-04067c6ecc69 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:40.886115 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-a105dd60-fa47-4d30-91ca-04067c6ecc69 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Added segment 9b73abc7-7651-4376-845b-e3dd90806c31 of type vlan for network 1dad64b1-0a3e-4b78-a75f-959e3b1e79b8 Nov 09 04:44:40.928701 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a105dd60-fa47-4d30-91ca-04067c6ecc69 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:41.009341 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a105dd60-fa47-4d30-91ca-04067c6ecc69 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:41.015178 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a105dd60-fa47-4d30-91ca-04067c6ecc69 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:44:41.015759 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a105dd60-fa47-4d30-91ca-04067c6ecc69 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:41.019595 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 32908) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:44:41.080823 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a105dd60-fa47-4d30-91ca-04067c6ecc69 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Network': ['ID=1dad64b1-0a3e-4b78-a75f-959e3b1e79b8,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:44:41.095252 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a105dd60-fa47-4d30-91ca-04067c6ecc69 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.3234208 Nov 09 04:44:41.095450 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 1dad64b1-0a3e-4b78-a75f-959e3b1e79b8 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:44:41.095909 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 32910) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:44:41.100199 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-7458137a-edec-404f-9b2a-3c76bf1036c4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'router': {'name': 'tempest-TestNetworkBasicOps-router-636046836', 'admin_state_up': True, 'project_id': '1d10b4824e524068827e58b55e269af3', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:44:41.164201 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7458137a-edec-404f-9b2a-3c76bf1036c4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:41.165280 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7458137a-edec-404f-9b2a-3c76bf1036c4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:41.179300 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-c2cb0961-979a-4778-84e3-2c95ccc02817 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Deleting port a8718040-47a0-445b-9945-70916a800265 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:44:41.179911 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c2cb0961-979a-4778-84e3-2c95ccc02817 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:41.221129 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7458137a-edec-404f-9b2a-3c76bf1036c4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:41.257978 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c2cb0961-979a-4778-84e3-2c95ccc02817 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:41.258385 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c2cb0961-979a-4778-84e3-2c95ccc02817 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:41.269968 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-c2cb0961-979a-4778-84e3-2c95ccc02817 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Calling delete_port for a8718040-47a0-445b-9945-70916a800265 owned by network:floatingip {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:44:41.379830 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-91d1ccd0-4f2e-46e0-9962-8663b620d2e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:41.429070 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7458137a-edec-404f-9b2a-3c76bf1036c4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:41.494008 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c2cb0961-979a-4778-84e3-2c95ccc02817 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:41.515512 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 7417a41c-915f-4cab-8e37-08246d66bbc1 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:44:41.525081 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2cb0961-979a-4778-84e3-2c95ccc02817 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Pushing event deleted for resources: {'Port': ['ID=a8718040-47a0-445b-9945-70916a800265,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:44:41.540818 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 7417a41c-915f-4cab-8e37-08246d66bbc1 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:44:41.541160 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 7417a41c-915f-4cab-8e37-08246d66bbc1 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:44:41.541797 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 064e1a31-61b7-44c2-be25-3ad23c3252e1 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:44:41.562696 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 064e1a31-61b7-44c2-be25-3ad23c3252e1 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:44:41.563339 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 064e1a31-61b7-44c2-be25-3ad23c3252e1 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:44:41.563941 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device ec5fce5b-ee83-4955-8947-4ecdfe3bce2b no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:44:41.583923 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: ec5fce5b-ee83-4955-8947-4ecdfe3bce2b {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:44:41.584521 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device ec5fce5b-ee83-4955-8947-4ecdfe3bce2b not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:44:41.592231 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c2cb0961-979a-4778-84e3-2c95ccc02817 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks [] for floatingip, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:41.592639 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.l3_db [None req-c2cb0961-979a-4778-84e3-2c95ccc02817 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Floating IP 6b30fd91-6470-4a72-a74d-84beb135dcc6 disassociated (deleted). External IP: 172.26.0.216, port: 65ca937a-8471-4c50-bca1-78fbcfc42fb6. Nov 09 04:44:41.714133 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7458137a-edec-404f-9b2a-3c76bf1036c4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router_gateway, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:41.732920 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7458137a-edec-404f-9b2a-3c76bf1036c4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:41.802482 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c2cb0961-979a-4778-84e3-2c95ccc02817 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Router 203a01a6-369d-4e73-a6d0-b0605f8d5a6a has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:44:41.840176 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-7458137a-edec-404f-9b2a-3c76bf1036c4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Allocated IP 172.26.0.161 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/8e2fba8e-7861-42b3-9f71-2ef66b096ca7) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:44:41.909758 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c2cb0961-979a-4778-84e3-2c95ccc02817 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:44:41.914466 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c2cb0961-979a-4778-84e3-2c95ccc02817 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:41.919511 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-81869425-a602-4abb-9f6e-7ee88774b46f None None] Sync routers for ids ['203a01a6-369d-4e73-a6d0-b0605f8d5a6a'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:44:41.929111 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-81869425-a602-4abb-9f6e-7ee88774b46f None None] Routers {'203a01a6-369d-4e73-a6d0-b0605f8d5a6a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:44:41.929710 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-81869425-a602-4abb-9f6e-7ee88774b46f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:44:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['203a01a6-369d-4e73-a6d0-b0605f8d5a6a'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:44:41.942924 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-c2cb0961-979a-4778-84e3-2c95ccc02817 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "DELETE /v2.0/floatingips/6b30fd91-6470-4a72-a74d-84beb135dcc6 HTTP/1.1" status: 204 len: 168 time: 0.9222007 Nov 09 04:44:41.945854 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '04f80039-ab30-438a-adbf-bd30827f9a50', 'tag': '65ca937a-8471-4c50-bca1-78fbcfc42fb6'}] {{(pid=102161) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:44:41.946154 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}99dfdda0def497b4372884ef2eb87f06b1e425c8eba5ceda5f64bbab037a07d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5676ed51-d1e4-4457-9aad-1f237aa82a1c" -d '{"events": [{"name": "network-changed", "server_uuid": "04f80039-ab30-438a-adbf-bd30827f9a50", "tag": "65ca937a-8471-4c50-bca1-78fbcfc42fb6"}]}' {{(pid=102161) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:44:41.949160 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7458137a-edec-404f-9b2a-3c76bf1036c4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:41.998193 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:44:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-10271b2c-8cef-47ee-9bf2-a7800525e000 x-openstack-request-id: req-10271b2c-8cef-47ee-9bf2-a7800525e000 {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:44:41.998527 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "04f80039-ab30-438a-adbf-bd30827f9a50", "tag": "65ca937a-8471-4c50-bca1-78fbcfc42fb6", "status": "completed", "code": 200}]} {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:44:41.998795 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-10271b2c-8cef-47ee-9bf2-a7800525e000 {{(pid=102161) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:44:41.999194 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '04f80039-ab30-438a-adbf-bd30827f9a50', 'tag': '65ca937a-8471-4c50-bca1-78fbcfc42fb6', 'status': 'completed', 'code': 200} Nov 09 04:44:42.048730 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7458137a-edec-404f-9b2a-3c76bf1036c4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:42.063261 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-81869425-a602-4abb-9f6e-7ee88774b46f None None] Set router 203a01a6-369d-4e73-a6d0-b0605f8d5a6a gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:44:42.093747 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7458137a-edec-404f-9b2a-3c76bf1036c4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:44:42.099369 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-7458137a-edec-404f-9b2a-3c76bf1036c4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:44:42.101789 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7458137a-edec-404f-9b2a-3c76bf1036c4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:44:42.134008 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5676ed51-d1e4-4457-9aad-1f237aa82a1c req-88800278-2429-436c-9e70-c4b43830c5fd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:44:42.135636 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5676ed51-d1e4-4457-9aad-1f237aa82a1c req-88800278-2429-436c-9e70-c4b43830c5fd service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=f636e5f4c9f64f69ba3b2ab8816b6096&device_id=04f80039-ab30-438a-adbf-bd30827f9a50 HTTP/1.1" status: 200 len: 1099 time: 0.1136856 Nov 09 04:44:42.140798 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7458137a-edec-404f-9b2a-3c76bf1036c4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Port': ['ID=8e2fba8e-7861-42b3-9f71-2ef66b096ca7,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:44:42.215255 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:42.271980 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-81869425-a602-4abb-9f6e-7ee88774b46f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'name': 'tempest-TestVolumeBootPattern-1675179943-router', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.164'}], 'enable_snat': True}, 'gw_port_id': '873960f9-e8b5-48a6-a119-47c32f5b7968', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:34:33Z', 'updated_at': '2021-11-09T04:34:38Z', 'revision_number': 4, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'gw_port': {'id': '873960f9-e8b5-48a6-a119-47c32f5b7968', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:95:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1097, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.164', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:34:34Z', 'updated_at': '2021-11-09T04:34:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'a5f1e54d-1d98-4741-a1ce-59f4cfb5b332', 'name': '', 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'mac_address': 'fa:16:3e:de:ab:2f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1107, 'fixed_ips': [{'subnet_id': 'f6a08667-654b-4e0c-9f85-c6e6712cc239', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:34:37Z', 'updated_at': '2021-11-09T04:34:46Z', 'revision_number': 5, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'subnets': [{'id': 'f6a08667-654b-4e0c-9f85-c6e6712cc239', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:44:42.300671 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-81869425-a602-4abb-9f6e-7ee88774b46f None None] Checking router: 203a01a6-369d-4e73-a6d0-b0605f8d5a6a for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:44:42.310838 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-81869425-a602-4abb-9f6e-7ee88774b46f None None] Routers {'203a01a6-369d-4e73-a6d0-b0605f8d5a6a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:44:42.311641 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-81869425-a602-4abb-9f6e-7ee88774b46f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:44:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['203a01a6-369d-4e73-a6d0-b0605f8d5a6a'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:44:42.419460 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-81869425-a602-4abb-9f6e-7ee88774b46f None None] Set router 203a01a6-369d-4e73-a6d0-b0605f8d5a6a gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:44:42.623323 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-81869425-a602-4abb-9f6e-7ee88774b46f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'name': 'tempest-TestVolumeBootPattern-1675179943-router', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.164'}], 'enable_snat': True}, 'gw_port_id': '873960f9-e8b5-48a6-a119-47c32f5b7968', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:34:33Z', 'updated_at': '2021-11-09T04:34:38Z', 'revision_number': 4, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'gw_port': {'id': '873960f9-e8b5-48a6-a119-47c32f5b7968', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:95:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1097, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.164', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:34:34Z', 'updated_at': '2021-11-09T04:34:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'a5f1e54d-1d98-4741-a1ce-59f4cfb5b332', 'name': '', 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'mac_address': 'fa:16:3e:de:ab:2f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1107, 'fixed_ips': [{'subnet_id': 'f6a08667-654b-4e0c-9f85-c6e6712cc239', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:34:37Z', 'updated_at': '2021-11-09T04:34:46Z', 'revision_number': 5, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'subnets': [{'id': 'f6a08667-654b-4e0c-9f85-c6e6712cc239', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:44:42.653624 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-81869425-a602-4abb-9f6e-7ee88774b46f None None] The sync data for ids ['203a01a6-369d-4e73-a6d0-b0605f8d5a6a'] in dv-neutron-816802-2-hyperv is: [{'id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'name': 'tempest-TestVolumeBootPattern-1675179943-router', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.164'}], 'enable_snat': True}, 'gw_port_id': '873960f9-e8b5-48a6-a119-47c32f5b7968', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:34:33Z', 'updated_at': '2021-11-09T04:34:38Z', 'revision_number': 4, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'gw_port': {'id': '873960f9-e8b5-48a6-a119-47c32f5b7968', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:95:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1097, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.164', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:34:34Z', 'updated_at': '2021-11-09T04:34:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'a5f1e54d-1d98-4741-a1ce-59f4cfb5b332', 'name': '', 'network_id': '999b1b20-f8fc-4caf-84cc-3feda426a0bf', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'mac_address': 'fa:16:3e:de:ab:2f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1107, 'fixed_ips': [{'subnet_id': 'f6a08667-654b-4e0c-9f85-c6e6712cc239', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:34:37Z', 'updated_at': '2021-11-09T04:34:46Z', 'revision_number': 5, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'subnets': [{'id': 'f6a08667-654b-4e0c-9f85-c6e6712cc239', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:44:42.695874 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5676ed51-d1e4-4457-9aad-1f237aa82a1c req-5614d931-e007-43df-8dd5-c6d7c16ff13e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:44:42.697323 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5676ed51-d1e4-4457-9aad-1f237aa82a1c req-5614d931-e007-43df-8dd5-c6d7c16ff13e service neutron] 10.222.0.26 "GET /v2.0/networks?id=999b1b20-f8fc-4caf-84cc-3feda426a0bf HTTP/1.1" status: 200 len: 913 time: 0.5531123 Nov 09 04:44:42.748475 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5676ed51-d1e4-4457-9aad-1f237aa82a1c req-314de006-ffcd-4509-bca6-3781c7e7deeb service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=65ca937a-8471-4c50-bca1-78fbcfc42fb6 HTTP/1.1" status: 200 len: 217 time: 0.0414658 Nov 09 04:44:42.760682 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b18e9efc-0682-431e-a4cc-c5f516431cda req-419a7e33-27dc-4915-8089-380b67124cf9 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:44:42.762057 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b18e9efc-0682-431e-a4cc-c5f516431cda req-419a7e33-27dc-4915-8089-380b67124cf9 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=04f80039-ab30-438a-adbf-bd30827f9a50 HTTP/1.1" status: 200 len: 946 time: 0.1165693 Nov 09 04:44:42.878593 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-58da7df3-8611-4a95-9908-4ec93c26b332 None None] New status for floating IP 6b30fd91-6470-4a72-a74d-84beb135dcc6: DOWN {{(pid=102163) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 04:44:42.909318 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5676ed51-d1e4-4457-9aad-1f237aa82a1c req-d17c25b7-99e4-4bbd-b80e-e2ddbe7996f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:44:42.910790 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5676ed51-d1e4-4457-9aad-1f237aa82a1c req-d17c25b7-99e4-4bbd-b80e-e2ddbe7996f2 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=f6a08667-654b-4e0c-9f85-c6e6712cc239 HTTP/1.1" status: 200 len: 851 time: 0.1477196 Nov 09 04:44:42.960677 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b18e9efc-0682-431e-a4cc-c5f516431cda req-10ff2a99-2c8d-4f80-8984-e07b22be5fe5 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/security-groups?id=3fac99c0-db5e-4deb-ae03-d7c28ceb1106&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1902547 Nov 09 04:44:43.015956 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1210ea23-1460-40fd-8cd5-1cb7036a2845 req-976889e7-2067-4913-9cff-6345e11359a3 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:44:43.017385 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1210ea23-1460-40fd-8cd5-1cb7036a2845 req-976889e7-2067-4913-9cff-6345e11359a3 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.26 "GET /v2.0/ports?device_id=04f80039-ab30-438a-adbf-bd30827f9a50 HTTP/1.1" status: 200 len: 946 time: 0.1716456 Nov 09 04:44:43.018230 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7458137a-edec-404f-9b2a-3c76bf1036c4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router_gateway, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:43.061715 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5676ed51-d1e4-4457-9aad-1f237aa82a1c req-b4b3df34-3304-46f3-b501-35bdcfdbd523 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:44:43.063152 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5676ed51-d1e4-4457-9aad-1f237aa82a1c req-b4b3df34-3304-46f3-b501-35bdcfdbd523 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=999b1b20-f8fc-4caf-84cc-3feda426a0bf&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1447020 Nov 09 04:44:43.297069 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5676ed51-d1e4-4457-9aad-1f237aa82a1c req-8ccb3863-b17c-4416-9831-a3235ccac769 service neutron] 10.222.0.26 "GET /v2.0/networks/999b1b20-f8fc-4caf-84cc-3feda426a0bf?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2163064 Nov 09 04:44:43.371000 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-1210ea23-1460-40fd-8cd5-1cb7036a2845 req-92eefd91-d658-42d3-9961-9e99c918aeb3 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Deleting port 65ca937a-8471-4c50-bca1-78fbcfc42fb6 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:44:43.371332 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-1210ea23-1460-40fd-8cd5-1cb7036a2845 req-92eefd91-d658-42d3-9961-9e99c918aeb3 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:43.431748 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7458137a-edec-404f-9b2a-3c76bf1036c4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:43.540538 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5676ed51-d1e4-4457-9aad-1f237aa82a1c req-1a1d6a0a-06a4-4232-ba15-5542a38da6d6 service neutron] 10.222.0.26 "GET /v2.0/networks/999b1b20-f8fc-4caf-84cc-3feda426a0bf?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2359161 Nov 09 04:44:43.582656 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-1210ea23-1460-40fd-8cd5-1cb7036a2845 req-92eefd91-d658-42d3-9961-9e99c918aeb3 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] For port 65ca937a-8471-4c50-bca1-78fbcfc42fb6, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=65ca937a-8471-4c50-bca1-78fbcfc42fb6,segment=NetworkSegment(bc4577c9-06a5-450a-9c80-879827986f04),segment_id=bc4577c9-06a5-450a-9c80-879827986f04)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:44:43.582937 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-1210ea23-1460-40fd-8cd5-1cb7036a2845 req-92eefd91-d658-42d3-9961-9e99c918aeb3 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:43.606130 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-1210ea23-1460-40fd-8cd5-1cb7036a2845 req-92eefd91-d658-42d3-9961-9e99c918aeb3 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Calling delete_port for 65ca937a-8471-4c50-bca1-78fbcfc42fb6 owned by compute:nova {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:44:43.723818 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-fa0fc953-53d9-49e0-be06-d048f8e98182 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:43.803588 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7458137a-edec-404f-9b2a-3c76bf1036c4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Router ab3c88d0-a531-409f-8b0b-c18b0761c90a is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102162) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:44:43.849685 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-1210ea23-1460-40fd-8cd5-1cb7036a2845 req-92eefd91-d658-42d3-9961-9e99c918aeb3 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:43.884108 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92eefd91-d658-42d3-9961-9e99c918aeb3 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Pushing event deleted for resources: {'Port': ['ID=65ca937a-8471-4c50-bca1-78fbcfc42fb6,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:44:43.955707 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-1210ea23-1460-40fd-8cd5-1cb7036a2845 req-92eefd91-d658-42d3-9961-9e99c918aeb3 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] No DVR routers for this DVR port 65ca937a-8471-4c50-bca1-78fbcfc42fb6 on host hv-neutron-8168 {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:44:43.961464 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-1210ea23-1460-40fd-8cd5-1cb7036a2845 req-92eefd91-d658-42d3-9961-9e99c918aeb3 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:43.965265 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1210ea23-1460-40fd-8cd5-1cb7036a2845 req-92eefd91-d658-42d3-9961-9e99c918aeb3 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.26 "DELETE /v2.0/ports/65ca937a-8471-4c50-bca1-78fbcfc42fb6 HTTP/1.1" status: 204 len: 173 time: 0.9135020 Nov 09 04:44:43.965705 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '04f80039-ab30-438a-adbf-bd30827f9a50', 'name': 'network-vif-deleted', 'tag': '65ca937a-8471-4c50-bca1-78fbcfc42fb6'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:44:43.967976 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-07a6f950-2532-4f1d-af54-fb85545748e4" -d '{"events": [{"server_uuid": "04f80039-ab30-438a-adbf-bd30827f9a50", "name": "network-vif-deleted", "tag": "65ca937a-8471-4c50-bca1-78fbcfc42fb6"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:44:43.981295 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7458137a-edec-404f-9b2a-3c76bf1036c4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:44:44.009604 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cc46d597-3969-4c8a-a4ed-47f750003609 None None] Sync routers for ids ['ab3c88d0-a531-409f-8b0b-c18b0761c90a'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:44:44.011548 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:44:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e6f324a3-72e9-4842-9ba7-4eb43d718dfb x-openstack-request-id: req-e6f324a3-72e9-4842-9ba7-4eb43d718dfb {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:44:44.011907 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "04f80039-ab30-438a-adbf-bd30827f9a50", "name": "network-vif-deleted", "tag": "65ca937a-8471-4c50-bca1-78fbcfc42fb6", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:44:44.012228 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-e6f324a3-72e9-4842-9ba7-4eb43d718dfb {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:44:44.012748 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '04f80039-ab30-438a-adbf-bd30827f9a50', 'name': 'network-vif-deleted', 'tag': '65ca937a-8471-4c50-bca1-78fbcfc42fb6', 'status': 'completed', 'code': 200} Nov 09 04:44:44.020988 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cc46d597-3969-4c8a-a4ed-47f750003609 None None] Routers {'ab3c88d0-a531-409f-8b0b-c18b0761c90a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:44:44.023358 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-cc46d597-3969-4c8a-a4ed-47f750003609 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:44:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['ab3c88d0-a531-409f-8b0b-c18b0761c90a'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:44:44.067877 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8c88b99d-9173-45e2-8cd2-e3371cd8b3bd req-75a2e1c3-7c23-407b-b40f-75045480c5f2 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=04f80039-ab30-438a-adbf-bd30827f9a50 HTTP/1.1" status: 200 len: 210 time: 0.0295570 Nov 09 04:44:44.076456 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7458137a-edec-404f-9b2a-3c76bf1036c4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:44.077829 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-7458137a-edec-404f-9b2a-3c76bf1036c4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 886 time: 2.9812434 Nov 09 04:44:44.080983 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 32922) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:44:44.141938 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-cc46d597-3969-4c8a-a4ed-47f750003609 None None] Set router ab3c88d0-a531-409f-8b0b-c18b0761c90a gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:44:44.182514 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-3add20cf-64bc-41cb-aa90-1fce9bf506d9 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/subnets?project_id=1d10b4824e524068827e58b55e269af3&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0974402 Nov 09 04:44:44.182754 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 32926) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:44:44.286608 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-74115c54-e884-4805-9ce5-44126bafe597 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:44:44.292749 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 32928) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:44:44.303879 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-74115c54-e884-4805-9ce5-44126bafe597 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.1200728 Nov 09 04:44:44.328490 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-25736ba8-abde-4cdd-af80-770ef63a5883 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/subnets?network_id=2b6725f5-ebfe-485a-8f42-ccb5a241ddb5&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0338812 Nov 09 04:44:44.331354 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 32930) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:44:44.337289 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-ab27864a-097d-48f7-9f66-aa663aa4737f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-642491014', 'network_id': '1dad64b1-0a3e-4b78-a75f-959e3b1e79b8', 'project_id': '1d10b4824e524068827e58b55e269af3', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:44:44.356079 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-cc46d597-3969-4c8a-a4ed-47f750003609 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'name': 'tempest-TestNetworkBasicOps-router-636046836', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.161'}], 'enable_snat': True}, 'gw_port_id': '8e2fba8e-7861-42b3-9f71-2ef66b096ca7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:44:41Z', 'updated_at': '2021-11-09T04:44:42Z', 'revision_number': 3, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '8e2fba8e-7861-42b3-9f71-2ef66b096ca7', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:d4:05:cb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1477, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.161', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:44:41Z', 'updated_at': '2021-11-09T04:44:41Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:44:44.385850 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cc46d597-3969-4c8a-a4ed-47f750003609 None None] Checking router: ab3c88d0-a531-409f-8b0b-c18b0761c90a for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:44:44.386460 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cc46d597-3969-4c8a-a4ed-47f750003609 None None] Updating router ab3c88d0-a531-409f-8b0b-c18b0761c90a port 8e2fba8e-7861-42b3-9f71-2ef66b096ca7 binding host dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 04:44:44.419452 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-cc46d597-3969-4c8a-a4ed-47f750003609 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:44.529506 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ab27864a-097d-48f7-9f66-aa663aa4737f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Made reservation on behalf of 1d10b4824e524068827e58b55e269af3 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:44:44.533880 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ab27864a-097d-48f7-9f66-aa663aa4737f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:44.669932 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-cc46d597-3969-4c8a-a4ed-47f750003609 None None] Publish callbacks [] for port, precommit_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:44.723787 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-cc46d597-3969-4c8a-a4ed-47f750003609 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:44.772502 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-cc46d597-3969-4c8a-a4ed-47f750003609 None None] Attempting to bind port 8e2fba8e-7861-42b3-9f71-2ef66b096ca7 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:44:44.772861 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-cc46d597-3969-4c8a-a4ed-47f750003609 None None] Attempting to bind port 8e2fba8e-7861-42b3-9f71-2ef66b096ca7 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:44:44.773212 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cc46d597-3969-4c8a-a4ed-47f750003609 None None] Attempting to bind port 8e2fba8e-7861-42b3-9f71-2ef66b096ca7 on network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:44:44.779818 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ab27864a-097d-48f7-9f66-aa663aa4737f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:44.780195 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3bee695-49ec-41c4-86e7-c6252005abc8 None None] Pushing event updated for resources: {'Port': ['ID=8e2fba8e-7861-42b3-9f71-2ef66b096ca7,revision_number=2']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:44:44.787113 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3bee695-49ec-41c4-86e7-c6252005abc8 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:44:44.789137 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3bee695-49ec-41c4-86e7-c6252005abc8 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:44:44.789137 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3bee695-49ec-41c4-86e7-c6252005abc8 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:44:44.789137 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3bee695-49ec-41c4-86e7-c6252005abc8 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:44:44.789137 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3bee695-49ec-41c4-86e7-c6252005abc8 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:44:44.789137 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3bee695-49ec-41c4-86e7-c6252005abc8 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:44:44.789137 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3bee695-49ec-41c4-86e7-c6252005abc8 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:44:44.789684 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3bee695-49ec-41c4-86e7-c6252005abc8 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:44:44.789684 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3bee695-49ec-41c4-86e7-c6252005abc8 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:44:44.790122 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3bee695-49ec-41c4-86e7-c6252005abc8 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:44:44.790464 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3bee695-49ec-41c4-86e7-c6252005abc8 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:44:44.790773 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3bee695-49ec-41c4-86e7-c6252005abc8 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:44:44.799222 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cc46d597-3969-4c8a-a4ed-47f750003609 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 44, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:44:44.799634 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cc46d597-3969-4c8a-a4ed-47f750003609 None None] Checking segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102164) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:44:44.800030 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-cc46d597-3969-4c8a-a4ed-47f750003609 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:44.800414 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cc46d597-3969-4c8a-a4ed-47f750003609 None None] Bound using segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:44:44.800890 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-cc46d597-3969-4c8a-a4ed-47f750003609 None None] Bound port: 8e2fba8e-7861-42b3-9f71-2ef66b096ca7, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:44:44.801293 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-cc46d597-3969-4c8a-a4ed-47f750003609 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:44.840434 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab27864a-097d-48f7-9f66-aa663aa4737f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Subnet': ['ID=9e8e346c-8a1f-4dfb-8ad0-e87375cefb67,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:44:44.857267 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-cc46d597-3969-4c8a-a4ed-47f750003609 None None] For port 8e2fba8e-7861-42b3-9f71-2ef66b096ca7, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102164) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:44:44.859720 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ab27864a-097d-48f7-9f66-aa663aa4737f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Checking segment: {'id': '9b73abc7-7651-4376-845b-e3dd90806c31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '1dad64b1-0a3e-4b78-a75f-959e3b1e79b8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:44:44.860065 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ab27864a-097d-48f7-9f66-aa663aa4737f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network hostable DHCP agents. Network: 1dad64b1-0a3e-4b78-a75f-959e3b1e79b8, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:44:44.860483 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-cc46d597-3969-4c8a-a4ed-47f750003609 None None] For port 8e2fba8e-7861-42b3-9f71-2ef66b096ca7, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=8e2fba8e-7861-42b3-9f71-2ef66b096ca7,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102164) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:44:44.935839 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-cc46d597-3969-4c8a-a4ed-47f750003609 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:44.958240 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ab27864a-097d-48f7-9f66-aa663aa4737f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network 1dad64b1-0a3e-4b78-a75f-959e3b1e79b8 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:44:45.037978 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-ab27864a-097d-48f7-9f66-aa663aa4737f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 1dad64b1-0a3e-4b78-a75f-959e3b1e79b8) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:44:45.049830 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ab27864a-097d-48f7-9f66-aa663aa4737f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:44:45.050454 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ab27864a-097d-48f7-9f66-aa663aa4737f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:45.055909 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b58a637d-be23-4f19-8a35-7acaa932511f None None] Network 1dad64b1-0a3e-4b78-a75f-959e3b1e79b8 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:44:45.086754 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3bee695-49ec-41c4-86e7-c6252005abc8 None None] Pushing event updated for resources: {'Port': ['ID=8e2fba8e-7861-42b3-9f71-2ef66b096ca7,revision_number=3']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:44:45.089940 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cc46d597-3969-4c8a-a4ed-47f750003609 None None] Routers {'ab3c88d0-a531-409f-8b0b-c18b0761c90a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:44:45.090564 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-cc46d597-3969-4c8a-a4ed-47f750003609 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:44:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['ab3c88d0-a531-409f-8b0b-c18b0761c90a'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:44:45.139776 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-ab27864a-097d-48f7-9f66-aa663aa4737f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 831 time: 0.8070900 Nov 09 04:44:45.142264 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 32934) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:44:45.201551 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-cc46d597-3969-4c8a-a4ed-47f750003609 None None] Set router ab3c88d0-a531-409f-8b0b-c18b0761c90a gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:44:45.252823 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f0d91458-1c8f-460d-aa88-1f71cc1b1f55 req-729e2747-0052-4fa7-a972-75727e319b55 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=04f80039-ab30-438a-adbf-bd30827f9a50 HTTP/1.1" status: 200 len: 210 time: 0.0481665 Nov 09 04:44:45.362342 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:45.427305 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 65ca937a-8471-4c50-bca1-78fbcfc42fb6 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:44:45.431838 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-cc46d597-3969-4c8a-a4ed-47f750003609 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'name': 'tempest-TestNetworkBasicOps-router-636046836', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.161'}], 'enable_snat': True}, 'gw_port_id': '8e2fba8e-7861-42b3-9f71-2ef66b096ca7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:44:41Z', 'updated_at': '2021-11-09T04:44:42Z', 'revision_number': 3, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '8e2fba8e-7861-42b3-9f71-2ef66b096ca7', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:d4:05:cb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1477, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.161', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:44:41Z', 'updated_at': '2021-11-09T04:44:44Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:44:45.453230 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cc26fa3b-7d0c-4c43-958a-726de015b470 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-1dad64b1-0a3e-4b78-a75f-959e3b1e79b8', 'network_id': '1dad64b1-0a3e-4b78-a75f-959e3b1e79b8', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ips': [{'subnet_id': '9e8e346c-8a1f-4dfb-8ad0-e87375cefb67'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:44:45.454160 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-cc26fa3b-7d0c-4c43-958a-726de015b470 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:45.456786 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] No Port match for: 65ca937a-8471-4c50-bca1-78fbcfc42fb6 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:44:45.457238 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 65ca937a-8471-4c50-bca1-78fbcfc42fb6 not bound to the agent host hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:44:45.466965 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cc46d597-3969-4c8a-a4ed-47f750003609 None None] The sync data for ids ['ab3c88d0-a531-409f-8b0b-c18b0761c90a'] in dv-neutron-816802-2-hyperv is: [{'id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'name': 'tempest-TestNetworkBasicOps-router-636046836', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.161'}], 'enable_snat': True}, 'gw_port_id': '8e2fba8e-7861-42b3-9f71-2ef66b096ca7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:44:41Z', 'updated_at': '2021-11-09T04:44:42Z', 'revision_number': 3, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '8e2fba8e-7861-42b3-9f71-2ef66b096ca7', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:d4:05:cb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1477, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.161', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:44:41Z', 'updated_at': '2021-11-09T04:44:44Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:44:45.637543 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-cc26fa3b-7d0c-4c43-958a-726de015b470 None None] Allocated IP 172.20.0.2 (1dad64b1-0a3e-4b78-a75f-959e3b1e79b8/9e8e346c-8a1f-4dfb-8ad0-e87375cefb67/c9696481-10e8-4597-ae96-c03504bfb517) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:44:45.698696 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-777da35f-9256-4e49-bb36-887e71049107 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:45.843160 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-cc26fa3b-7d0c-4c43-958a-726de015b470 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:45.912859 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-cc26fa3b-7d0c-4c43-958a-726de015b470 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:45.979753 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc26fa3b-7d0c-4c43-958a-726de015b470 None None] Pushing event updated for resources: {'Port': ['ID=c9696481-10e8-4597-ae96-c03504bfb517,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:44:45.995296 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cc26fa3b-7d0c-4c43-958a-726de015b470 None None] Network 1dad64b1-0a3e-4b78-a75f-959e3b1e79b8 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:44:45.997852 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-cc26fa3b-7d0c-4c43-958a-726de015b470 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:44:46.009067 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cc26fa3b-7d0c-4c43-958a-726de015b470 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:44:46.083852 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-cc26fa3b-7d0c-4c43-958a-726de015b470 None None] Attempting to bind port c9696481-10e8-4597-ae96-c03504bfb517 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:44:46.084831 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-cc26fa3b-7d0c-4c43-958a-726de015b470 None None] Attempting to bind port c9696481-10e8-4597-ae96-c03504bfb517 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '9b73abc7-7651-4376-845b-e3dd90806c31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '1dad64b1-0a3e-4b78-a75f-959e3b1e79b8'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:44:46.085136 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cc26fa3b-7d0c-4c43-958a-726de015b470 None None] Attempting to bind port c9696481-10e8-4597-ae96-c03504bfb517 on network 1dad64b1-0a3e-4b78-a75f-959e3b1e79b8 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:44:46.091537 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cc26fa3b-7d0c-4c43-958a-726de015b470 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 44, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:44:46.092046 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cc26fa3b-7d0c-4c43-958a-726de015b470 None None] Checking segment: {'id': '9b73abc7-7651-4376-845b-e3dd90806c31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '1dad64b1-0a3e-4b78-a75f-959e3b1e79b8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:44:46.092545 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-cc26fa3b-7d0c-4c43-958a-726de015b470 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:46.093079 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cc26fa3b-7d0c-4c43-958a-726de015b470 None None] Bound using segment: {'id': '9b73abc7-7651-4376-845b-e3dd90806c31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '1dad64b1-0a3e-4b78-a75f-959e3b1e79b8'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:44:46.093926 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-cc26fa3b-7d0c-4c43-958a-726de015b470 None None] Bound port: c9696481-10e8-4597-ae96-c03504bfb517, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9b73abc7-7651-4376-845b-e3dd90806c31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '1dad64b1-0a3e-4b78-a75f-959e3b1e79b8'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:44:46.094430 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-cc26fa3b-7d0c-4c43-958a-726de015b470 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:46.169966 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-cc26fa3b-7d0c-4c43-958a-726de015b470 None None] For port c9696481-10e8-4597-ae96-c03504bfb517, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:44:46.173956 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-cc26fa3b-7d0c-4c43-958a-726de015b470 None None] For port c9696481-10e8-4597-ae96-c03504bfb517, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=c9696481-10e8-4597-ae96-c03504bfb517,segment=NetworkSegment(9b73abc7-7651-4376-845b-e3dd90806c31),segment_id=9b73abc7-7651-4376-845b-e3dd90806c31)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:44:46.256183 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-cc26fa3b-7d0c-4c43-958a-726de015b470 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:46.330977 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc26fa3b-7d0c-4c43-958a-726de015b470 None None] Pushing event updated for resources: {'Port': ['ID=c9696481-10e8-4597-ae96-c03504bfb517,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:44:46.419041 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6c47440c-28e7-4fb4-b626-a0f211282c26 req-c02bc550-cd4a-4690-92c4-b79041726912 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=04f80039-ab30-438a-adbf-bd30827f9a50 HTTP/1.1" status: 200 len: 210 time: 0.0398564 Nov 09 04:44:46.447340 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-777da35f-9256-4e49-bb36-887e71049107 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Allocated IP 172.20.0.1 (1dad64b1-0a3e-4b78-a75f-959e3b1e79b8/9e8e346c-8a1f-4dfb-8ad0-e87375cefb67/1307a903-74ab-4faf-8993-e69fd7140798) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:44:46.488291 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:46.614327 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-777da35f-9256-4e49-bb36-887e71049107 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:46.728917 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-777da35f-9256-4e49-bb36-887e71049107 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:46.768904 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-777da35f-9256-4e49-bb36-887e71049107 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network 1dad64b1-0a3e-4b78-a75f-959e3b1e79b8 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:44:46.772212 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-777da35f-9256-4e49-bb36-887e71049107 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:44:46.774724 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-777da35f-9256-4e49-bb36-887e71049107 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:44:46.808511 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-777da35f-9256-4e49-bb36-887e71049107 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Port': ['ID=1307a903-74ab-4faf-8993-e69fd7140798,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:44:46.831308 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-777da35f-9256-4e49-bb36-887e71049107 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:46.998300 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:47.048233 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-777da35f-9256-4e49-bb36-887e71049107 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:47.331488 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-777da35f-9256-4e49-bb36-887e71049107 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:47.402212 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-777da35f-9256-4e49-bb36-887e71049107 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:47.486247 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-777da35f-9256-4e49-bb36-887e71049107 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:47.488958 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-777da35f-9256-4e49-bb36-887e71049107 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Port': ['ID=1307a903-74ab-4faf-8993-e69fd7140798,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:44:47.576624 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-4ea3656b-9126-4336-b27c-35eb882aaa16 req-a91c3d09-d6e9-4b32-8bab-ce0c87cf94cb tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=04f80039-ab30-438a-adbf-bd30827f9a50 HTTP/1.1" status: 200 len: 210 time: 0.0319879 Nov 09 04:44:47.619932 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-777da35f-9256-4e49-bb36-887e71049107 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network 1dad64b1-0a3e-4b78-a75f-959e3b1e79b8 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:44:47.622790 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-777da35f-9256-4e49-bb36-887e71049107 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:44:47.633916 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device c9696481-10e8-4597-ae96-c03504bfb517 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:44:47.692745 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port c9696481-10e8-4597-ae96-c03504bfb517 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:44:47.693329 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:47.759611 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-777da35f-9256-4e49-bb36-887e71049107 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Router ab3c88d0-a531-409f-8b0b-c18b0761c90a has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:44:47.786748 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:47.825147 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port c9696481-10e8-4597-ae96-c03504bfb517, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=c9696481-10e8-4597-ae96-c03504bfb517,segment=NetworkSegment(9b73abc7-7651-4376-845b-e3dd90806c31),segment_id=9b73abc7-7651-4376-845b-e3dd90806c31)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:44:47.887518 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-777da35f-9256-4e49-bb36-887e71049107 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:44:47.891903 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-777da35f-9256-4e49-bb36-887e71049107 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "PUT /v2.0/routers/ab3c88d0-a531-409f-8b0b-c18b0761c90a/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.7483196 Nov 09 04:44:47.894521 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 32940) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:44:47.901844 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-100c7b0b-4614-478a-bab4-e8e5d9a38504 None None] Sync routers for ids ['ab3c88d0-a531-409f-8b0b-c18b0761c90a'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:44:47.909533 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:47.910320 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 8e2fba8e-7861-42b3-9f71-2ef66b096ca7 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:44:47.979421 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-100c7b0b-4614-478a-bab4-e8e5d9a38504 None None] Routers {'ab3c88d0-a531-409f-8b0b-c18b0761c90a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:44:47.980061 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-100c7b0b-4614-478a-bab4-e8e5d9a38504 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:44:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['ab3c88d0-a531-409f-8b0b-c18b0761c90a'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:44:48.011507 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b236d3f8-e11b-4260-8c58-197de3e48d01 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:44:48.012135 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b236d3f8-e11b-4260-8c58-197de3e48d01 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:44:48.012652 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b236d3f8-e11b-4260-8c58-197de3e48d01 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:44:48.013174 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b236d3f8-e11b-4260-8c58-197de3e48d01 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:44:48.013680 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b236d3f8-e11b-4260-8c58-197de3e48d01 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:44:48.014350 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b236d3f8-e11b-4260-8c58-197de3e48d01 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:44:48.016584 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-b236d3f8-e11b-4260-8c58-197de3e48d01 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/networks HTTP/1.1" status: 200 len: 4286 time: 0.1210775 Nov 09 04:44:48.019487 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 32942) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:44:48.066734 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=c9696481-10e8-4597-ae96-c03504bfb517,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:44:48.089576 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-63f5dfa0-c531-4c8e-9ed3-2eb77dd1a8c4 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:44:48.090035 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-63f5dfa0-c531-4c8e-9ed3-2eb77dd1a8c4 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:44:48.090514 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-63f5dfa0-c531-4c8e-9ed3-2eb77dd1a8c4 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:44:48.090957 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-63f5dfa0-c531-4c8e-9ed3-2eb77dd1a8c4 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:44:48.091399 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-63f5dfa0-c531-4c8e-9ed3-2eb77dd1a8c4 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:44:48.091839 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-63f5dfa0-c531-4c8e-9ed3-2eb77dd1a8c4 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:44:48.096087 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-63f5dfa0-c531-4c8e-9ed3-2eb77dd1a8c4 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 4005 time: 0.0731912 Nov 09 04:44:48.096671 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 32944) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:44:48.116929 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 8e2fba8e-7861-42b3-9f71-2ef66b096ca7 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:44:48.117293 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:48.143119 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-160ac66f-f86c-4e2e-b6bd-bcf30040e59a None None] Network 1dad64b1-0a3e-4b78-a75f-959e3b1e79b8 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:44:48.164592 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-100c7b0b-4614-478a-bab4-e8e5d9a38504 None None] Set router ab3c88d0-a531-409f-8b0b-c18b0761c90a gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:44:48.255629 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-ba518072-404d-4b10-a79a-2346a9102174 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/routers HTTP/1.1" status: 200 len: 3047 time: 0.1574397 Nov 09 04:44:48.306824 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-66ffe748-22f7-4dd3-80af-7ef5ef20e627 None None] Provisioning complete for port c9696481-10e8-4597-ae96-c03504bfb517 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:44:48.307191 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-66ffe748-22f7-4dd3-80af-7ef5ef20e627 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:48.453477 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:48.527500 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 8e2fba8e-7861-42b3-9f71-2ef66b096ca7, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=8e2fba8e-7861-42b3-9f71-2ef66b096ca7,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:44:48.546192 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 32948) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:44:48.551253 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-2d08c43c-2219-46da-bcc1-876d0dd43aab tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-247177236', 'description': 'tempest-secgroup-smoke-247177236 description', 'project_id': '1d10b4824e524068827e58b55e269af3'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:44:48.597894 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:48.665731 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=8e2fba8e-7861-42b3-9f71-2ef66b096ca7,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:44:48.667005 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2d08c43c-2219-46da-bcc1-876d0dd43aab tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:48.678632 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-100c7b0b-4614-478a-bab4-e8e5d9a38504 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'name': 'tempest-TestNetworkBasicOps-router-636046836', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.161'}], 'enable_snat': True}, 'gw_port_id': '8e2fba8e-7861-42b3-9f71-2ef66b096ca7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:44:41Z', 'updated_at': '2021-11-09T04:44:46Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '8e2fba8e-7861-42b3-9f71-2ef66b096ca7', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:d4:05:cb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1477, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.161', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:44:41Z', 'updated_at': '2021-11-09T04:44:44Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '1307a903-74ab-4faf-8993-e69fd7140798', 'name': '', 'network_id': '1dad64b1-0a3e-4b78-a75f-959e3b1e79b8', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:f7:0c:aa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1480, 'fixed_ips': [{'subnet_id': '9e8e346c-8a1f-4dfb-8ad0-e87375cefb67', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:44:46Z', 'updated_at': '2021-11-09T04:44:47Z', 'revision_number': 2, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '9e8e346c-8a1f-4dfb-8ad0-e87375cefb67', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:44:48.709764 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-100c7b0b-4614-478a-bab4-e8e5d9a38504 None None] Checking router: ab3c88d0-a531-409f-8b0b-c18b0761c90a for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:44:48.709764 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-100c7b0b-4614-478a-bab4-e8e5d9a38504 None None] Updating router ab3c88d0-a531-409f-8b0b-c18b0761c90a port 1307a903-74ab-4faf-8993-e69fd7140798 binding host dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 04:44:48.710124 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-93dc0612-9805-4c9c-9969-345b69814029 req-67c29961-7b29-4a27-ad26-788c41b83012 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "GET /v2.0/ports?device_id=04f80039-ab30-438a-adbf-bd30827f9a50 HTTP/1.1" status: 200 len: 210 time: 0.0454705 Nov 09 04:44:48.748446 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-100c7b0b-4614-478a-bab4-e8e5d9a38504 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:48.776973 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2d08c43c-2219-46da-bcc1-876d0dd43aab tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:48.837904 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2d08c43c-2219-46da-bcc1-876d0dd43aab tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:48.873759 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d08c43c-2219-46da-bcc1-876d0dd43aab tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroup': ['ID=8425d3b7-b361-4e0f-ad79-89882a770395,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:44:48.941479 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2d08c43c-2219-46da-bcc1-876d0dd43aab tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:48.943048 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-2d08c43c-2219-46da-bcc1-876d0dd43aab tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.3958015 Nov 09 04:44:48.946009 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 32952) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:44:48.951370 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-d03e9f88-0022-4d07-916e-779521b9b241 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': '8425d3b7-b361-4e0f-ad79-89882a770395', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:44:48.964579 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-b1fbd5df-fd83-4d40-894e-fbab6b040cb4 None None] Provisioning complete for port c9696481-10e8-4597-ae96-c03504bfb517 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:44:48.964854 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b1fbd5df-fd83-4d40-894e-fbab6b040cb4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:49.054585 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d03e9f88-0022-4d07-916e-779521b9b241 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:49.116536 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d03e9f88-0022-4d07-916e-779521b9b241 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:49.185652 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d03e9f88-0022-4d07-916e-779521b9b241 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:49.205008 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d03e9f88-0022-4d07-916e-779521b9b241 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3a57d292-bafb-4b6a-af10-434d2185342f,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:44:49.260437 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-100c7b0b-4614-478a-bab4-e8e5d9a38504 None None] Publish callbacks [] for port, precommit_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:49.274587 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-b1fbd5df-fd83-4d40-894e-fbab6b040cb4 None None] Provisioning complete for port 1307a903-74ab-4faf-8993-e69fd7140798 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:44:49.274940 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b1fbd5df-fd83-4d40-894e-fbab6b040cb4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:49.292020 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d03e9f88-0022-4d07-916e-779521b9b241 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:49.294110 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-d03e9f88-0022-4d07-916e-779521b9b241 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3461633 Nov 09 04:44:49.296122 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 32954) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:44:49.300626 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-bc0fceb0-2e10-413d-8d2e-9645af807852 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': '8425d3b7-b361-4e0f-ad79-89882a770395', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:44:49.310101 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-b1fbd5df-fd83-4d40-894e-fbab6b040cb4 None None] Port 1307a903-74ab-4faf-8993-e69fd7140798 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:44:49.313554 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-100c7b0b-4614-478a-bab4-e8e5d9a38504 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:49.360910 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-199df24a-97f3-4458-9e3d-b7003b452c61 None None] Pushing event updated for resources: {'Port': ['ID=1307a903-74ab-4faf-8993-e69fd7140798,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:44:49.413759 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bc0fceb0-2e10-413d-8d2e-9645af807852 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:49.419634 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-100c7b0b-4614-478a-bab4-e8e5d9a38504 None None] Attempting to bind port 1307a903-74ab-4faf-8993-e69fd7140798 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:44:49.420014 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-100c7b0b-4614-478a-bab4-e8e5d9a38504 None None] Attempting to bind port 1307a903-74ab-4faf-8993-e69fd7140798 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '9b73abc7-7651-4376-845b-e3dd90806c31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '1dad64b1-0a3e-4b78-a75f-959e3b1e79b8'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:44:49.420901 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-100c7b0b-4614-478a-bab4-e8e5d9a38504 None None] Attempting to bind port 1307a903-74ab-4faf-8993-e69fd7140798 on network 1dad64b1-0a3e-4b78-a75f-959e3b1e79b8 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:44:49.429925 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-100c7b0b-4614-478a-bab4-e8e5d9a38504 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 44, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:44:49.430300 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-100c7b0b-4614-478a-bab4-e8e5d9a38504 None None] Checking segment: {'id': '9b73abc7-7651-4376-845b-e3dd90806c31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '1dad64b1-0a3e-4b78-a75f-959e3b1e79b8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:44:49.430724 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-100c7b0b-4614-478a-bab4-e8e5d9a38504 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:49.431110 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-100c7b0b-4614-478a-bab4-e8e5d9a38504 None None] Bound using segment: {'id': '9b73abc7-7651-4376-845b-e3dd90806c31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '1dad64b1-0a3e-4b78-a75f-959e3b1e79b8'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:44:49.432128 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-100c7b0b-4614-478a-bab4-e8e5d9a38504 None None] Bound port: 1307a903-74ab-4faf-8993-e69fd7140798, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9b73abc7-7651-4376-845b-e3dd90806c31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '1dad64b1-0a3e-4b78-a75f-959e3b1e79b8'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:44:49.432507 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-100c7b0b-4614-478a-bab4-e8e5d9a38504 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:49.452128 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-50d5c87f-2fdb-4972-a894-783433746ca2 None None] Provisioning complete for port 1307a903-74ab-4faf-8993-e69fd7140798 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:44:49.452567 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-50d5c87f-2fdb-4972-a894-783433746ca2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:49.513870 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bc0fceb0-2e10-413d-8d2e-9645af807852 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:49.522434 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-50d5c87f-2fdb-4972-a894-783433746ca2 None None] Port 1307a903-74ab-4faf-8993-e69fd7140798 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:44:49.543021 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-100c7b0b-4614-478a-bab4-e8e5d9a38504 None None] For port 1307a903-74ab-4faf-8993-e69fd7140798, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:44:49.546694 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-100c7b0b-4614-478a-bab4-e8e5d9a38504 None None] For port 1307a903-74ab-4faf-8993-e69fd7140798, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=1307a903-74ab-4faf-8993-e69fd7140798,segment=NetworkSegment(9b73abc7-7651-4376-845b-e3dd90806c31),segment_id=9b73abc7-7651-4376-845b-e3dd90806c31)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:44:49.557740 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device c9696481-10e8-4597-ae96-c03504bfb517 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:44:49.608158 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port c9696481-10e8-4597-ae96-c03504bfb517 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:44:49.608472 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:49.636281 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bc0fceb0-2e10-413d-8d2e-9645af807852 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:49.653173 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-1d234b87-94cd-4864-8a3a-39a6acb7c2a4 None None] Provisioning complete for port 1307a903-74ab-4faf-8993-e69fd7140798 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:44:49.653529 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1d234b87-94cd-4864-8a3a-39a6acb7c2a4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:49.655658 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc0fceb0-2e10-413d-8d2e-9645af807852 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c93a8901-0f48-49ef-a09e-47fb49d26d97,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:44:49.678621 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-100c7b0b-4614-478a-bab4-e8e5d9a38504 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:49.718204 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bc0fceb0-2e10-413d-8d2e-9645af807852 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:49.722150 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-bc0fceb0-2e10-413d-8d2e-9645af807852 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.4225767 Nov 09 04:44:49.723151 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 32956) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:44:49.728775 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-287d66c4-b6df-4a34-b433-73ee9514229d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': '8425d3b7-b361-4e0f-ad79-89882a770395', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:44:49.758900 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-1d234b87-94cd-4864-8a3a-39a6acb7c2a4 None None] Port 1307a903-74ab-4faf-8993-e69fd7140798 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:44:49.781002 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 32960) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:44:49.783937 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-199df24a-97f3-4458-9e3d-b7003b452c61 None None] Pushing event updated for resources: {'Port': ['ID=1307a903-74ab-4faf-8993-e69fd7140798,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:44:49.787915 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-100c7b0b-4614-478a-bab4-e8e5d9a38504 None None] Routers {'ab3c88d0-a531-409f-8b0b-c18b0761c90a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:44:49.788519 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-100c7b0b-4614-478a-bab4-e8e5d9a38504 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:44:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['ab3c88d0-a531-409f-8b0b-c18b0761c90a'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:44:49.793437 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 8e2fba8e-7861-42b3-9f71-2ef66b096ca7 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:44:49.815525 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-287d66c4-b6df-4a34-b433-73ee9514229d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:49.895189 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-287d66c4-b6df-4a34-b433-73ee9514229d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:49.954092 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-100c7b0b-4614-478a-bab4-e8e5d9a38504 None None] Set router ab3c88d0-a531-409f-8b0b-c18b0761c90a gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:44:49.956599 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 8e2fba8e-7861-42b3-9f71-2ef66b096ca7 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:44:49.956965 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:49.963048 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-287d66c4-b6df-4a34-b433-73ee9514229d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:49.986986 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-287d66c4-b6df-4a34-b433-73ee9514229d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=44129829-6462-4669-a6ce-7ffcc20a808e,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:44:50.063315 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-287d66c4-b6df-4a34-b433-73ee9514229d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:50.064718 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-287d66c4-b6df-4a34-b433-73ee9514229d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3407350 Nov 09 04:44:50.067434 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 32962) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:44:50.071994 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-fbb3b42c-9f40-4a72-b508-449d0b26b08b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': '8425d3b7-b361-4e0f-ad79-89882a770395', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:44:50.079249 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-8bfb6a22-c74c-425c-98d4-f4b42001ee62 None None] Provisioning complete for port 1307a903-74ab-4faf-8993-e69fd7140798 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:44:50.079747 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8bfb6a22-c74c-425c-98d4-f4b42001ee62 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:50.156447 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fbb3b42c-9f40-4a72-b508-449d0b26b08b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:50.199468 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-8375dd65-f8f0-457f-b459-fe3d39fd95de tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Deleting port cc2ee892-a7b2-4a88-8885-ead772c3089b {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:44:50.199802 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8375dd65-f8f0-457f-b459-fe3d39fd95de tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:50.219109 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fbb3b42c-9f40-4a72-b508-449d0b26b08b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:50.278815 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8375dd65-f8f0-457f-b459-fe3d39fd95de tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:50.279139 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8375dd65-f8f0-457f-b459-fe3d39fd95de tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:50.282809 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fbb3b42c-9f40-4a72-b508-449d0b26b08b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:50.292301 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-8375dd65-f8f0-457f-b459-fe3d39fd95de tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Calling delete_port for cc2ee892-a7b2-4a88-8885-ead772c3089b owned by network:floatingip {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:44:50.299032 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8bfb6a22-c74c-425c-98d4-f4b42001ee62 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:50.304642 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbb3b42c-9f40-4a72-b508-449d0b26b08b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0f5f2688-e348-4084-b5cc-8c7a7ab08623,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:44:50.342821 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-8bfb6a22-c74c-425c-98d4-f4b42001ee62 None None] For port 1307a903-74ab-4faf-8993-e69fd7140798, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=1307a903-74ab-4faf-8993-e69fd7140798,segment=NetworkSegment(9b73abc7-7651-4376-845b-e3dd90806c31),segment_id=9b73abc7-7651-4376-845b-e3dd90806c31)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:44:50.347236 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-100c7b0b-4614-478a-bab4-e8e5d9a38504 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'name': 'tempest-TestNetworkBasicOps-router-636046836', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.161'}], 'enable_snat': True}, 'gw_port_id': '8e2fba8e-7861-42b3-9f71-2ef66b096ca7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:44:41Z', 'updated_at': '2021-11-09T04:44:46Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '8e2fba8e-7861-42b3-9f71-2ef66b096ca7', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:d4:05:cb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1477, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.161', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:44:41Z', 'updated_at': '2021-11-09T04:44:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '1307a903-74ab-4faf-8993-e69fd7140798', 'name': '', 'network_id': '1dad64b1-0a3e-4b78-a75f-959e3b1e79b8', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:f7:0c:aa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1480, 'fixed_ips': [{'subnet_id': '9e8e346c-8a1f-4dfb-8ad0-e87375cefb67', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:44:46Z', 'updated_at': '2021-11-09T04:44:49Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '9e8e346c-8a1f-4dfb-8ad0-e87375cefb67', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:44:50.373484 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-100c7b0b-4614-478a-bab4-e8e5d9a38504 None None] The sync data for ids ['ab3c88d0-a531-409f-8b0b-c18b0761c90a'] in dv-neutron-816802-2-hyperv is: [{'id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'name': 'tempest-TestNetworkBasicOps-router-636046836', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.161'}], 'enable_snat': True}, 'gw_port_id': '8e2fba8e-7861-42b3-9f71-2ef66b096ca7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:44:41Z', 'updated_at': '2021-11-09T04:44:46Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '8e2fba8e-7861-42b3-9f71-2ef66b096ca7', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:d4:05:cb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1477, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.161', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:44:41Z', 'updated_at': '2021-11-09T04:44:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '1307a903-74ab-4faf-8993-e69fd7140798', 'name': '', 'network_id': '1dad64b1-0a3e-4b78-a75f-959e3b1e79b8', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:f7:0c:aa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1480, 'fixed_ips': [{'subnet_id': '9e8e346c-8a1f-4dfb-8ad0-e87375cefb67', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:44:46Z', 'updated_at': '2021-11-09T04:44:49Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '9e8e346c-8a1f-4dfb-8ad0-e87375cefb67', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:44:50.389063 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fbb3b42c-9f40-4a72-b508-449d0b26b08b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:50.394483 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-fbb3b42c-9f40-4a72-b508-449d0b26b08b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3219097 Nov 09 04:44:50.394483 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 32964) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:44:50.397919 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-dfcc57bf-2c18-43c5-8af9-0d8e79aa67db tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': '8425d3b7-b361-4e0f-ad79-89882a770395', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:44:50.416798 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8bfb6a22-c74c-425c-98d4-f4b42001ee62 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:50.489883 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bfb6a22-c74c-425c-98d4-f4b42001ee62 None None] Pushing event updated for resources: {'Port': ['ID=1307a903-74ab-4faf-8993-e69fd7140798,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:44:50.496058 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8375dd65-f8f0-457f-b459-fe3d39fd95de tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:50.520831 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8375dd65-f8f0-457f-b459-fe3d39fd95de tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Pushing event deleted for resources: {'Port': ['ID=cc2ee892-a7b2-4a88-8885-ead772c3089b,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:44:50.529379 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.securitygroups_db [None req-dfcc57bf-2c18-43c5-8af9-0d8e79aa67db tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Project 1d10b4824e524068827e58b55e269af3 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 09 04:44:50.535331 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8375dd65-f8f0-457f-b459-fe3d39fd95de tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:44:50.535677 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8375dd65-f8f0-457f-b459-fe3d39fd95de tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:44:50.538943 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8375dd65-f8f0-457f-b459-fe3d39fd95de tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:44:50.538943 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8375dd65-f8f0-457f-b459-fe3d39fd95de tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:44:50.538943 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8375dd65-f8f0-457f-b459-fe3d39fd95de tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:44:50.538943 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8375dd65-f8f0-457f-b459-fe3d39fd95de tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:44:50.539452 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-dfcc57bf-2c18-43c5-8af9-0d8e79aa67db tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:50.539576 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8375dd65-f8f0-457f-b459-fe3d39fd95de tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:44:50.539576 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8375dd65-f8f0-457f-b459-fe3d39fd95de tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:44:50.539576 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8375dd65-f8f0-457f-b459-fe3d39fd95de tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:44:50.539576 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8375dd65-f8f0-457f-b459-fe3d39fd95de tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:44:50.539576 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8375dd65-f8f0-457f-b459-fe3d39fd95de tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:44:50.539576 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8375dd65-f8f0-457f-b459-fe3d39fd95de tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:44:50.595183 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8375dd65-f8f0-457f-b459-fe3d39fd95de tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks [] for floatingip, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:50.606349 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8375dd65-f8f0-457f-b459-fe3d39fd95de tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:50.606349 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-8375dd65-f8f0-457f-b459-fe3d39fd95de tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "DELETE /v2.0/floatingips/cb72ed5d-dc68-4e13-9938-c58a0418642e HTTP/1.1" status: 204 len: 168 time: 0.8164663 Nov 09 04:44:50.608445 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-dfcc57bf-2c18-43c5-8af9-0d8e79aa67db tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:50.682293 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-dfcc57bf-2c18-43c5-8af9-0d8e79aa67db tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:50.703470 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfcc57bf-2c18-43c5-8af9-0d8e79aa67db tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=99f9e8ac-91ce-47b8-8ce8-f947ed071c34,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:44:50.769974 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-dfcc57bf-2c18-43c5-8af9-0d8e79aa67db tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:50.771382 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-dfcc57bf-2c18-43c5-8af9-0d8e79aa67db tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.3772213 Nov 09 04:44:50.774476 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 32972) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:44:50.779292 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-0b0f4f6b-c743-4788-9e49-58086954abd5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': '8425d3b7-b361-4e0f-ad79-89882a770395', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:44:50.892825 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.securitygroups_db [None req-0b0f4f6b-c743-4788-9e49-58086954abd5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Project 1d10b4824e524068827e58b55e269af3 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 09 04:44:50.898774 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0b0f4f6b-c743-4788-9e49-58086954abd5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:50.973246 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0b0f4f6b-c743-4788-9e49-58086954abd5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:51.044194 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0b0f4f6b-c743-4788-9e49-58086954abd5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:51.067700 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b0f4f6b-c743-4788-9e49-58086954abd5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1fe066d1-825d-4c84-b591-85244994a715,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:44:51.130207 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0b0f4f6b-c743-4788-9e49-58086954abd5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:51.131440 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-0b0f4f6b-c743-4788-9e49-58086954abd5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.3563366 Nov 09 04:44:51.313966 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-a61aa001-1b4d-45cc-9f8e-5c8f67f5fa01 req-6d58d326-b0a2-49e5-9cc2-d30f5c1e7cc4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-247177236&fields=id&tenant_id=1d10b4824e524068827e58b55e269af3 HTTP/1.1" status: 200 len: 267 time: 0.0484123 Nov 09 04:44:51.429682 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a61aa001-1b4d-45cc-9f8e-5c8f67f5fa01 req-f7000e2f-a727-4b8a-8399-d6baaecf392f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:44:51.431199 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-a61aa001-1b4d-45cc-9f8e-5c8f67f5fa01 req-f7000e2f-a727-4b8a-8399-d6baaecf392f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/networks?id=1dad64b1-0a3e-4b78-a75f-959e3b1e79b8 HTTP/1.1" status: 200 len: 797 time: 0.1098049 Nov 09 04:44:51.445988 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-a61aa001-1b4d-45cc-9f8e-5c8f67f5fa01 req-b301e123-b0bf-4506-a40e-5cbea2625841 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/quotas/1d10b4824e524068827e58b55e269af3 HTTP/1.1" status: 200 len: 375 time: 0.0088630 Nov 09 04:44:51.506935 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-a61aa001-1b4d-45cc-9f8e-5c8f67f5fa01 req-ae25c0f4-34f3-4a18-b822-d04379007774 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0540552 Nov 09 04:44:51.574494 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 1307a903-74ab-4faf-8993-e69fd7140798 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:44:51.613336 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-a61aa001-1b4d-45cc-9f8e-5c8f67f5fa01 req-60afb3f0-19c1-4d97-ae40-c9c0d886e6df service neutron] 10.222.0.24 "GET /v2.0/networks/1dad64b1-0a3e-4b78-a75f-959e3b1e79b8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0932434 Nov 09 04:44:51.626493 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 1307a903-74ab-4faf-8993-e69fd7140798 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:44:51.626929 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:51.713366 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-a61aa001-1b4d-45cc-9f8e-5c8f67f5fa01 req-c93e3f40-e7c6-4953-8c42-156b930ca863 service neutron] 10.222.0.24 "GET /v2.0/networks/1dad64b1-0a3e-4b78-a75f-959e3b1e79b8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0928197 Nov 09 04:44:51.983308 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2d86bc86-8155-44ba-bacb-a36496116622 req-6da17bf1-8b08-42c6-9496-d1e2afc6f4ce tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=f9ab492e-61b2-4203-af63-a2280af93fd1 HTTP/1.1" status: 200 len: 210 time: 0.0347331 Nov 09 04:44:53.088465 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-82065952-205f-40c3-90f8-9fd4df653342 req-b0b3a52f-e5e0-4e4e-97f9-af1ed35099ca tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=f9ab492e-61b2-4203-af63-a2280af93fd1 HTTP/1.1" status: 200 len: 210 time: 0.0305533 Nov 09 04:44:53.701997 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a61aa001-1b4d-45cc-9f8e-5c8f67f5fa01 req-c15b2422-72d7-483a-afd6-4f3998d7ebf7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:44:53.703365 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a61aa001-1b4d-45cc-9f8e-5c8f67f5fa01 req-c15b2422-72d7-483a-afd6-4f3998d7ebf7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "GET /v2.0/networks?id=1dad64b1-0a3e-4b78-a75f-959e3b1e79b8 HTTP/1.1" status: 200 len: 797 time: 0.1025212 Nov 09 04:44:53.767729 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a61aa001-1b4d-45cc-9f8e-5c8f67f5fa01 req-c13cb575-8a5f-46f5-bfb4-8f7a054ad8ed tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=1d10b4824e524068827e58b55e269af3 HTTP/1.1" status: 200 len: 379 time: 0.0553427 Nov 09 04:44:53.779044 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-a61aa001-1b4d-45cc-9f8e-5c8f67f5fa01 req-d2068333-5bb4-4452-b7d9-8ca32218acb8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'port': {'device_id': 'f9ab492e-61b2-4203-af63-a2280af93fd1', 'network_id': '1dad64b1-0a3e-4b78-a75f-959e3b1e79b8', 'admin_state_up': True, 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'security_groups': ['8425d3b7-b361-4e0f-ad79-89882a770395']}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:44:53.957777 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a61aa001-1b4d-45cc-9f8e-5c8f67f5fa01 req-d2068333-5bb4-4452-b7d9-8ca32218acb8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Made reservation on behalf of 1d10b4824e524068827e58b55e269af3 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:44:53.961645 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-a61aa001-1b4d-45cc-9f8e-5c8f67f5fa01 req-d2068333-5bb4-4452-b7d9-8ca32218acb8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:54.068924 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 33014) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:44:54.097200 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [req-a61aa001-1b4d-45cc-9f8e-5c8f67f5fa01 req-d2068333-5bb4-4452-b7d9-8ca32218acb8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Allocated IP 172.20.0.9 (1dad64b1-0a3e-4b78-a75f-959e3b1e79b8/9e8e346c-8a1f-4dfb-8ad0-e87375cefb67/9dea4e93-eac2-4ff4-bd09-131010862731) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:44:54.153277 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-26729036-1173-48fa-8ed2-c828fa54ea65 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:54.180482 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-26729036-1173-48fa-8ed2-c828fa54ea65 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:54.214492 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-33f6c7d4-c516-4598-b809-68aca9b0bdc0 req-15cc530c-5264-4c22-9639-4a43d715df0f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=f9ab492e-61b2-4203-af63-a2280af93fd1 HTTP/1.1" status: 200 len: 210 time: 0.0304880 Nov 09 04:44:54.300573 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-a61aa001-1b4d-45cc-9f8e-5c8f67f5fa01 req-d2068333-5bb4-4452-b7d9-8ca32218acb8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:54.335042 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-26729036-1173-48fa-8ed2-c828fa54ea65 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:54.337838 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-26729036-1173-48fa-8ed2-c828fa54ea65 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:54.341596 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-26729036-1173-48fa-8ed2-c828fa54ea65 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] 10.222.0.24 "DELETE /v2.0/security-groups/3fac99c0-db5e-4deb-ae03-d7c28ceb1106 HTTP/1.1" status: 204 len: 168 time: 0.2689135 Nov 09 04:44:54.348029 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26729036-1173-48fa-8ed2-c828fa54ea65 tempest-TestVolumeBootPattern-43351158 tempest-TestVolumeBootPattern-43351158-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=3fac99c0-db5e-4deb-ae03-d7c28ceb1106,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:44:54.403871 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-a61aa001-1b4d-45cc-9f8e-5c8f67f5fa01 req-d2068333-5bb4-4452-b7d9-8ca32218acb8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:54.446113 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a61aa001-1b4d-45cc-9f8e-5c8f67f5fa01 req-d2068333-5bb4-4452-b7d9-8ca32218acb8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network 1dad64b1-0a3e-4b78-a75f-959e3b1e79b8 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:44:54.451272 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [req-a61aa001-1b4d-45cc-9f8e-5c8f67f5fa01 req-d2068333-5bb4-4452-b7d9-8ca32218acb8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:44:54.455036 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-a61aa001-1b4d-45cc-9f8e-5c8f67f5fa01 req-d2068333-5bb4-4452-b7d9-8ca32218acb8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:44:54.482811 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2068333-5bb4-4452-b7d9-8ca32218acb8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Port': ['ID=9dea4e93-eac2-4ff4-bd09-131010862731,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:44:54.526891 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a61aa001-1b4d-45cc-9f8e-5c8f67f5fa01 req-d2068333-5bb4-4452-b7d9-8ca32218acb8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:44:54.528776 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-a61aa001-1b4d-45cc-9f8e-5c8f67f5fa01 req-d2068333-5bb4-4452-b7d9-8ca32218acb8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:54.549545 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33022) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:44:54.611969 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a61aa001-1b4d-45cc-9f8e-5c8f67f5fa01 req-d2068333-5bb4-4452-b7d9-8ca32218acb8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8376184 Nov 09 04:44:54.624268 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-a61aa001-1b4d-45cc-9f8e-5c8f67f5fa01 req-c9252c16-898b-4012-a447-7f6243f526ea service neutron] Request body: {'port': {'device_id': 'f9ab492e-61b2-4203-af63-a2280af93fd1', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:44:54.685964 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-a61aa001-1b4d-45cc-9f8e-5c8f67f5fa01 req-c9252c16-898b-4012-a447-7f6243f526ea service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:54.686212 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-655690eb-0f45-4a11-8ae5-f5590cbc3a7f None None] Provisioning complete for port 9dea4e93-eac2-4ff4-bd09-131010862731 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:44:54.686729 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-655690eb-0f45-4a11-8ae5-f5590cbc3a7f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:54.729612 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-655690eb-0f45-4a11-8ae5-f5590cbc3a7f None None] Port 9dea4e93-eac2-4ff4-bd09-131010862731 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:44:55.163017 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [req-a61aa001-1b4d-45cc-9f8e-5c8f67f5fa01 req-c9252c16-898b-4012-a447-7f6243f526ea service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 9dea4e93-eac2-4ff4-bd09-131010862731 {{(pid=102162) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:44:55.171821 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-a61aa001-1b4d-45cc-9f8e-5c8f67f5fa01 req-c9252c16-898b-4012-a447-7f6243f526ea service neutron] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:55.188403 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.provisioning_blocks [req-a61aa001-1b4d-45cc-9f8e-5c8f67f5fa01 req-c9252c16-898b-4012-a447-7f6243f526ea service neutron] Transition to ACTIVE for port object 9dea4e93-eac2-4ff4-bd09-131010862731 will not be triggered until provisioned by entity L2. {{(pid=102162) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 09 04:44:55.258234 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-20e461ca-4cd2-4016-881d-ca944d0eb07d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:55.292085 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-a61aa001-1b4d-45cc-9f8e-5c8f67f5fa01 req-c9252c16-898b-4012-a447-7f6243f526ea service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:55.412601 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9252c16-898b-4012-a447-7f6243f526ea service neutron] Pushing event updated for resources: {'Port': ['ID=9dea4e93-eac2-4ff4-bd09-131010862731,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:44:55.486549 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8859e178-7320-44c4-b836-2ab1d04e186d req-6fa30b8f-f0b0-4c90-ba7c-9d894fc24972 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:44:55.488096 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8859e178-7320-44c4-b836-2ab1d04e186d req-6fa30b8f-f0b0-4c90-ba7c-9d894fc24972 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=f9ab492e-61b2-4203-af63-a2280af93fd1 HTTP/1.1" status: 200 len: 943 time: 0.1641002 Nov 09 04:44:55.582540 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-a61aa001-1b4d-45cc-9f8e-5c8f67f5fa01 req-c9252c16-898b-4012-a447-7f6243f526ea service neutron] Attempting to bind port 9dea4e93-eac2-4ff4-bd09-131010862731 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:44:55.582876 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-a61aa001-1b4d-45cc-9f8e-5c8f67f5fa01 req-c9252c16-898b-4012-a447-7f6243f526ea service neutron] Attempting to bind port 9dea4e93-eac2-4ff4-bd09-131010862731 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '9b73abc7-7651-4376-845b-e3dd90806c31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '1dad64b1-0a3e-4b78-a75f-959e3b1e79b8'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:44:55.583198 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a61aa001-1b4d-45cc-9f8e-5c8f67f5fa01 req-c9252c16-898b-4012-a447-7f6243f526ea service neutron] Attempting to bind port 9dea4e93-eac2-4ff4-bd09-131010862731 on network 1dad64b1-0a3e-4b78-a75f-959e3b1e79b8 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:44:55.595966 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a61aa001-1b4d-45cc-9f8e-5c8f67f5fa01 req-c9252c16-898b-4012-a447-7f6243f526ea service neutron] Port 9dea4e93-eac2-4ff4-bd09-131010862731 on network 1dad64b1-0a3e-4b78-a75f-959e3b1e79b8 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:44:55.596259 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a61aa001-1b4d-45cc-9f8e-5c8f67f5fa01 req-c9252c16-898b-4012-a447-7f6243f526ea service neutron] Attempting to bind port 9dea4e93-eac2-4ff4-bd09-131010862731 on network 1dad64b1-0a3e-4b78-a75f-959e3b1e79b8 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:44:55.612261 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a61aa001-1b4d-45cc-9f8e-5c8f67f5fa01 req-c9252c16-898b-4012-a447-7f6243f526ea service neutron] Checking agent: {'id': '7d36b884-4ad2-4878-9464-bf647030b544', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'started_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 44, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:44:55.612533 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a61aa001-1b4d-45cc-9f8e-5c8f67f5fa01 req-c9252c16-898b-4012-a447-7f6243f526ea service neutron] Checking segment: {'id': '9b73abc7-7651-4376-845b-e3dd90806c31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '1dad64b1-0a3e-4b78-a75f-959e3b1e79b8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:44:55.612905 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a61aa001-1b4d-45cc-9f8e-5c8f67f5fa01 req-c9252c16-898b-4012-a447-7f6243f526ea service neutron] Bound using segment: {'id': '9b73abc7-7651-4376-845b-e3dd90806c31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '1dad64b1-0a3e-4b78-a75f-959e3b1e79b8'} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:44:55.613320 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-a61aa001-1b4d-45cc-9f8e-5c8f67f5fa01 req-c9252c16-898b-4012-a447-7f6243f526ea service neutron] Bound port: 9dea4e93-eac2-4ff4-bd09-131010862731, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '9b73abc7-7651-4376-845b-e3dd90806c31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '1dad64b1-0a3e-4b78-a75f-959e3b1e79b8'}}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:44:55.613667 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-a61aa001-1b4d-45cc-9f8e-5c8f67f5fa01 req-c9252c16-898b-4012-a447-7f6243f526ea service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:55.635708 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8859e178-7320-44c4-b836-2ab1d04e186d req-091560c4-b015-4f4f-a25c-ca58d4a59453 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=8425d3b7-b361-4e0f-ad79-89882a770395&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1360869 Nov 09 04:44:55.732282 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-a61aa001-1b4d-45cc-9f8e-5c8f67f5fa01 req-c9252c16-898b-4012-a447-7f6243f526ea service neutron] For port 9dea4e93-eac2-4ff4-bd09-131010862731, host hv-neutron-8168, cleared binding levels {{(pid=102162) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:44:55.746842 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-a61aa001-1b4d-45cc-9f8e-5c8f67f5fa01 req-c9252c16-898b-4012-a447-7f6243f526ea service neutron] For port 9dea4e93-eac2-4ff4-bd09-131010862731, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=9dea4e93-eac2-4ff4-bd09-131010862731,segment=NetworkSegment(9b73abc7-7651-4376-845b-e3dd90806c31),segment_id=9b73abc7-7651-4376-845b-e3dd90806c31)] {{(pid=102162) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:44:55.765050 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-20e461ca-4cd2-4016-881d-ca944d0eb07d admin admin] Deleting port a5f1e54d-1d98-4741-a1ce-59f4cfb5b332 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:44:55.765384 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-20e461ca-4cd2-4016-881d-ca944d0eb07d admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:55.816152 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-a61aa001-1b4d-45cc-9f8e-5c8f67f5fa01 req-c9252c16-898b-4012-a447-7f6243f526ea service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:55.865602 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a61aa001-1b4d-45cc-9f8e-5c8f67f5fa01 req-c9252c16-898b-4012-a447-7f6243f526ea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:44:55.866209 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-a61aa001-1b4d-45cc-9f8e-5c8f67f5fa01 req-c9252c16-898b-4012-a447-7f6243f526ea service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:55.867615 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a61aa001-1b4d-45cc-9f8e-5c8f67f5fa01 req-c9252c16-898b-4012-a447-7f6243f526ea service neutron] 10.222.0.26 "PUT /v2.0/ports/9dea4e93-eac2-4ff4-bd09-131010862731 HTTP/1.1" status: 200 len: 1093 time: 1.2478981 Nov 09 04:44:55.870184 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f9ab492e-61b2-4203-af63-a2280af93fd1', 'tag': '9dea4e93-eac2-4ff4-bd09-131010862731'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:44:55.872564 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-aa9f9f00-115e-479e-a602-06948c4e0f18" -d '{"events": [{"name": "network-changed", "server_uuid": "f9ab492e-61b2-4203-af63-a2280af93fd1", "tag": "9dea4e93-eac2-4ff4-bd09-131010862731"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:44:55.911191 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9252c16-898b-4012-a447-7f6243f526ea service neutron] Pushing event updated for resources: {'Port': ['ID=9dea4e93-eac2-4ff4-bd09-131010862731,revision_number=3']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:44:55.915741 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-20e461ca-4cd2-4016-881d-ca944d0eb07d admin admin] For port a5f1e54d-1d98-4741-a1ce-59f4cfb5b332, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=a5f1e54d-1d98-4741-a1ce-59f4cfb5b332,segment=NetworkSegment(bc4577c9-06a5-450a-9c80-879827986f04),segment_id=bc4577c9-06a5-450a-9c80-879827986f04)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:44:55.916118 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-20e461ca-4cd2-4016-881d-ca944d0eb07d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:55.919591 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:44:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6cc5c980-1f7e-41cd-8d9c-5caedd36ed1b x-openstack-request-id: req-6cc5c980-1f7e-41cd-8d9c-5caedd36ed1b {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:44:55.919874 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f9ab492e-61b2-4203-af63-a2280af93fd1", "tag": "9dea4e93-eac2-4ff4-bd09-131010862731", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:44:55.920124 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-6cc5c980-1f7e-41cd-8d9c-5caedd36ed1b {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:44:55.921168 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f9ab492e-61b2-4203-af63-a2280af93fd1', 'tag': '9dea4e93-eac2-4ff4-bd09-131010862731', 'status': 'completed', 'code': 200} Nov 09 04:44:55.935368 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-20e461ca-4cd2-4016-881d-ca944d0eb07d admin admin] Calling delete_port for a5f1e54d-1d98-4741-a1ce-59f4cfb5b332 owned by network:router_interface {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:44:56.032224 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa9f9f00-115e-479e-a602-06948c4e0f18 req-a295588e-afd0-4560-8f1b-d371f0b92c82 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:44:56.033714 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-aa9f9f00-115e-479e-a602-06948c4e0f18 req-a295588e-afd0-4560-8f1b-d371f0b92c82 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&device_id=f9ab492e-61b2-4203-af63-a2280af93fd1 HTTP/1.1" status: 200 len: 1096 time: 0.0895333 Nov 09 04:44:56.184907 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa9f9f00-115e-479e-a602-06948c4e0f18 req-aa32449d-e2e0-46e1-b2c0-8474267a9a98 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:44:56.186378 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-aa9f9f00-115e-479e-a602-06948c4e0f18 req-aa32449d-e2e0-46e1-b2c0-8474267a9a98 service neutron] 10.222.0.26 "GET /v2.0/networks?tenant_id=1d10b4824e524068827e58b55e269af3&shared=False HTTP/1.1" status: 200 len: 898 time: 0.1444945 Nov 09 04:44:56.466610 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:44:56.626852 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa9f9f00-115e-479e-a602-06948c4e0f18 req-3cacbfd1-8fe8-45db-87f1-d66f685e455d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:44:56.628314 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-aa9f9f00-115e-479e-a602-06948c4e0f18 req-3cacbfd1-8fe8-45db-87f1-d66f685e455d service neutron] 10.222.0.26 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.4252381 Nov 09 04:44:56.673667 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-20e461ca-4cd2-4016-881d-ca944d0eb07d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:56.717787 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20e461ca-4cd2-4016-881d-ca944d0eb07d admin admin] Pushing event deleted for resources: {'Port': ['ID=a5f1e54d-1d98-4741-a1ce-59f4cfb5b332,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:44:56.805668 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a61aa001-1b4d-45cc-9f8e-5c8f67f5fa01 req-bbebccce-b983-4925-ae85-9efb8818afef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:44:56.807221 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a61aa001-1b4d-45cc-9f8e-5c8f67f5fa01 req-bbebccce-b983-4925-ae85-9efb8818afef service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&device_id=f9ab492e-61b2-4203-af63-a2280af93fd1 HTTP/1.1" status: 200 len: 1096 time: 0.1435475 Nov 09 04:44:56.894830 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63ee7d19-139e-4810-b928-d19e276bfad1 req-33c24f75-2b65-46b0-8027-51964a9db022 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:44:56.896347 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-63ee7d19-139e-4810-b928-d19e276bfad1 req-33c24f75-2b65-46b0-8027-51964a9db022 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=f9ab492e-61b2-4203-af63-a2280af93fd1 HTTP/1.1" status: 200 len: 943 time: 0.1825852 Nov 09 04:44:56.900292 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a61aa001-1b4d-45cc-9f8e-5c8f67f5fa01 req-209d02f1-c58d-4baa-ac82-c452b30be9a2 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=9dea4e93-eac2-4ff4-bd09-131010862731 HTTP/1.1" status: 200 len: 217 time: 0.0833237 Nov 09 04:44:57.025384 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a61aa001-1b4d-45cc-9f8e-5c8f67f5fa01 req-1b4ed78d-82e5-4d60-a3b4-8eec01c24dcc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:44:57.026858 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a61aa001-1b4d-45cc-9f8e-5c8f67f5fa01 req-1b4ed78d-82e5-4d60-a3b4-8eec01c24dcc service neutron] 10.222.0.26 "GET /v2.0/subnets?id=9e8e346c-8a1f-4dfb-8ad0-e87375cefb67 HTTP/1.1" status: 200 len: 834 time: 0.1104410 Nov 09 04:44:57.033713 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-63ee7d19-139e-4810-b928-d19e276bfad1 req-6cd8c66d-9ba1-4354-9d2a-0af157d6f53f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=8425d3b7-b361-4e0f-ad79-89882a770395&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1293695 Nov 09 04:44:57.063201 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-20e461ca-4cd2-4016-881d-ca944d0eb07d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:57.127739 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a61aa001-1b4d-45cc-9f8e-5c8f67f5fa01 req-fd391bdf-3a70-4ff6-bc3f-85c5db90b70c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:44:57.129225 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a61aa001-1b4d-45cc-9f8e-5c8f67f5fa01 req-fd391bdf-3a70-4ff6-bc3f-85c5db90b70c service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=1dad64b1-0a3e-4b78-a75f-959e3b1e79b8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0927765 Nov 09 04:44:57.304721 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a61aa001-1b4d-45cc-9f8e-5c8f67f5fa01 req-2ec52902-0288-4edb-8a09-e9bfbb14faf7 service neutron] 10.222.0.26 "GET /v2.0/networks/1dad64b1-0a3e-4b78-a75f-959e3b1e79b8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1441193 Nov 09 04:44:57.511828 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-20e461ca-4cd2-4016-881d-ca944d0eb07d admin admin] Router 203a01a6-369d-4e73-a6d0-b0605f8d5a6a has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:44:57.511828 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a61aa001-1b4d-45cc-9f8e-5c8f67f5fa01 req-226b2460-b47a-4b92-a563-ef9cdc99606e service neutron] 10.222.0.26 "GET /v2.0/networks/1dad64b1-0a3e-4b78-a75f-959e3b1e79b8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1097336 Nov 09 04:44:57.564294 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-20e461ca-4cd2-4016-881d-ca944d0eb07d admin admin] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:44:57.570568 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-20e461ca-4cd2-4016-881d-ca944d0eb07d admin admin] 10.222.0.24 "PUT /v2.0/routers/203a01a6-369d-4e73-a6d0-b0605f8d5a6a/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.0171096 Nov 09 04:44:57.572820 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 33032) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:44:57.577393 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e205b0f3-5815-4a0f-bfe4-a57990d9e9b5 None None] Sync routers for ids ['203a01a6-369d-4e73-a6d0-b0605f8d5a6a'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:44:57.591219 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e205b0f3-5815-4a0f-bfe4-a57990d9e9b5 None None] Routers {'203a01a6-369d-4e73-a6d0-b0605f8d5a6a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:44:57.592107 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-e205b0f3-5815-4a0f-bfe4-a57990d9e9b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:44:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['203a01a6-369d-4e73-a6d0-b0605f8d5a6a'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:44:57.688247 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bc2bfc6c-0327-49c4-a8c1-1da384e433a3 admin admin] Publish callbacks [] for router, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:57.707379 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-e205b0f3-5815-4a0f-bfe4-a57990d9e9b5 None None] Set router 203a01a6-369d-4e73-a6d0-b0605f8d5a6a gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:44:57.796542 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bc2bfc6c-0327-49c4-a8c1-1da384e433a3 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:57.888177 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-e205b0f3-5815-4a0f-bfe4-a57990d9e9b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'name': 'tempest-TestVolumeBootPattern-1675179943-router', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.164'}], 'enable_snat': True}, 'gw_port_id': '873960f9-e8b5-48a6-a119-47c32f5b7968', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:34:33Z', 'updated_at': '2021-11-09T04:44:56Z', 'revision_number': 5, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'gw_port': {'id': '873960f9-e8b5-48a6-a119-47c32f5b7968', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:95:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1097, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.164', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:34:34Z', 'updated_at': '2021-11-09T04:34:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:44:57.905645 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-bc2bfc6c-0327-49c4-a8c1-1da384e433a3 admin admin] Deleting port 873960f9-e8b5-48a6-a119-47c32f5b7968 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:44:57.905984 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bc2bfc6c-0327-49c4-a8c1-1da384e433a3 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:57.918516 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e205b0f3-5815-4a0f-bfe4-a57990d9e9b5 None None] Checking router: 203a01a6-369d-4e73-a6d0-b0605f8d5a6a for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:44:57.926868 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e205b0f3-5815-4a0f-bfe4-a57990d9e9b5 None None] Routers {'203a01a6-369d-4e73-a6d0-b0605f8d5a6a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:44:57.927465 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-e205b0f3-5815-4a0f-bfe4-a57990d9e9b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:44:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['203a01a6-369d-4e73-a6d0-b0605f8d5a6a'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:44:57.994126 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-bc2bfc6c-0327-49c4-a8c1-1da384e433a3 admin admin] For port 873960f9-e8b5-48a6-a119-47c32f5b7968, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=873960f9-e8b5-48a6-a119-47c32f5b7968,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:44:57.996938 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bc2bfc6c-0327-49c4-a8c1-1da384e433a3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:58.008937 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-bc2bfc6c-0327-49c4-a8c1-1da384e433a3 admin admin] Calling delete_port for 873960f9-e8b5-48a6-a119-47c32f5b7968 owned by network:router_gateway {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:44:58.015650 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-e205b0f3-5815-4a0f-bfe4-a57990d9e9b5 None None] Set router 203a01a6-369d-4e73-a6d0-b0605f8d5a6a gateway port host: None {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:44:58.069463 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-e205b0f3-5815-4a0f-bfe4-a57990d9e9b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'name': 'tempest-TestVolumeBootPattern-1675179943-router', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:34:33Z', 'updated_at': '2021-11-09T04:44:57Z', 'revision_number': 6, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'gw_port_host': None}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:44:58.098321 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e205b0f3-5815-4a0f-bfe4-a57990d9e9b5 None None] The sync data for ids ['203a01a6-369d-4e73-a6d0-b0605f8d5a6a'] in dv-neutron-816802-2-hyperv is: [{'id': '203a01a6-369d-4e73-a6d0-b0605f8d5a6a', 'name': 'tempest-TestVolumeBootPattern-1675179943-router', 'tenant_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:34:33Z', 'updated_at': '2021-11-09T04:44:57Z', 'revision_number': 6, 'project_id': 'f636e5f4c9f64f69ba3b2ab8816b6096', 'gw_port_host': None}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:44:58.174596 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74852f7d-436d-40a0-a686-b4ca7df4c25f req-9a2ebdfa-5fb8-4708-825a-b44b35f045de tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:44:58.176092 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-74852f7d-436d-40a0-a686-b4ca7df4c25f req-9a2ebdfa-5fb8-4708-825a-b44b35f045de tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=f9ab492e-61b2-4203-af63-a2280af93fd1 HTTP/1.1" status: 200 len: 943 time: 0.0626571 Nov 09 04:44:58.253736 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-74852f7d-436d-40a0-a686-b4ca7df4c25f req-5b19b99c-8679-47a8-a5a9-0e9385205015 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=8425d3b7-b361-4e0f-ad79-89882a770395&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0556803 Nov 09 04:44:58.311610 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bc2bfc6c-0327-49c4-a8c1-1da384e433a3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:58.339960 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc2bfc6c-0327-49c4-a8c1-1da384e433a3 admin admin] Pushing event deleted for resources: {'Port': ['ID=873960f9-e8b5-48a6-a119-47c32f5b7968,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:44:58.400486 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bc2bfc6c-0327-49c4-a8c1-1da384e433a3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-466373'] for router_gateway, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:58.491541 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bc2bfc6c-0327-49c4-a8c1-1da384e433a3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:58.494255 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bc2bfc6c-0327-49c4-a8c1-1da384e433a3 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:58.597416 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bc2bfc6c-0327-49c4-a8c1-1da384e433a3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:58.598031 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bc2bfc6c-0327-49c4-a8c1-1da384e433a3 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 203a01a6-369d-4e73-a6d0-b0605f8d5a6a {{(pid=102161) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:44:58.603392 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bc2bfc6c-0327-49c4-a8c1-1da384e433a3 admin admin] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:58.604569 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-bc2bfc6c-0327-49c4-a8c1-1da384e433a3 admin admin] 10.222.0.24 "DELETE /v2.0/routers/203a01a6-369d-4e73-a6d0-b0605f8d5a6a HTTP/1.1" status: 204 len: 168 time: 1.0306680 Nov 09 04:44:58.607064 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 33036) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:44:58.654508 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-ebf05786-aa70-4f70-9a30-1ade04277aa6 admin admin] Deleting subnet f6a08667-654b-4e0c-9f85-c6e6712cc239 {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:44:58.657450 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ebf05786-aa70-4f70-9a30-1ade04277aa6 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:58.691998 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ebf05786-aa70-4f70-9a30-1ade04277aa6 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:58.765858 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ebf05786-aa70-4f70-9a30-1ade04277aa6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:58.885381 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ebf05786-aa70-4f70-9a30-1ade04277aa6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:58.914674 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebf05786-aa70-4f70-9a30-1ade04277aa6 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=f6a08667-654b-4e0c-9f85-c6e6712cc239,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:44:58.920722 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ebf05786-aa70-4f70-9a30-1ade04277aa6 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:58.924136 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-ebf05786-aa70-4f70-9a30-1ade04277aa6 admin admin] 10.222.0.24 "DELETE /v2.0/subnets/f6a08667-654b-4e0c-9f85-c6e6712cc239 HTTP/1.1" status: 204 len: 168 time: 0.3159707 Nov 09 04:44:58.926411 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 33038) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:44:58.931510 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9eb5b5eb-c0c8-4045-be8b-b762d5fb4490 None None] Network 999b1b20-f8fc-4caf-84cc-3feda426a0bf requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:44:59.000526 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7213f214-f17c-4dd3-a89a-24f802148e74 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:59.053020 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-7213f214-f17c-4dd3-a89a-24f802148e74 admin admin] Deleting port b5d07ee2-c2b6-490e-8334-ac606dd5ca2d {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:44:59.053357 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7213f214-f17c-4dd3-a89a-24f802148e74 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:59.112716 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-74fe4969-3a2b-4f1b-96ff-138377d7b66e None None] DHCP port deletion for 999b1b20-f8fc-4caf-84cc-3feda426a0bf request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:44:59.127021 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-7213f214-f17c-4dd3-a89a-24f802148e74 admin admin] For port b5d07ee2-c2b6-490e-8334-ac606dd5ca2d, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=b5d07ee2-c2b6-490e-8334-ac606dd5ca2d,segment=NetworkSegment(bc4577c9-06a5-450a-9c80-879827986f04),segment_id=bc4577c9-06a5-450a-9c80-879827986f04)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:44:59.127530 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7213f214-f17c-4dd3-a89a-24f802148e74 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:59.141324 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-7213f214-f17c-4dd3-a89a-24f802148e74 admin admin] Calling delete_port for b5d07ee2-c2b6-490e-8334-ac606dd5ca2d owned by network:dhcp {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:44:59.164268 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-74fe4969-3a2b-4f1b-96ff-138377d7b66e None None] Deleting port b5d07ee2-c2b6-490e-8334-ac606dd5ca2d {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:44:59.164781 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-74fe4969-3a2b-4f1b-96ff-138377d7b66e None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:59.231943 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-74fe4969-3a2b-4f1b-96ff-138377d7b66e None None] For port b5d07ee2-c2b6-490e-8334-ac606dd5ca2d, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=b5d07ee2-c2b6-490e-8334-ac606dd5ca2d,segment=NetworkSegment(bc4577c9-06a5-450a-9c80-879827986f04),segment_id=bc4577c9-06a5-450a-9c80-879827986f04)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:44:59.234978 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-74fe4969-3a2b-4f1b-96ff-138377d7b66e None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:59.244781 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-74fe4969-3a2b-4f1b-96ff-138377d7b66e None None] Calling delete_port for b5d07ee2-c2b6-490e-8334-ac606dd5ca2d owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:44:59.293590 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7213f214-f17c-4dd3-a89a-24f802148e74 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:59.322561 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7213f214-f17c-4dd3-a89a-24f802148e74 admin admin] Pushing event deleted for resources: {'Port': ['ID=b5d07ee2-c2b6-490e-8334-ac606dd5ca2d,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:44:59.331200 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7213f214-f17c-4dd3-a89a-24f802148e74 admin admin] No DVR routers for this DVR port b5d07ee2-c2b6-490e-8334-ac606dd5ca2d on host dv-neutron-816802-2-hyperv {{(pid=102161) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:44:59.331413 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-74fe4969-3a2b-4f1b-96ff-138377d7b66e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:59.356833 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74fe4969-3a2b-4f1b-96ff-138377d7b66e None None] Pushing event deleted for resources: {'Port': ['ID=b5d07ee2-c2b6-490e-8334-ac606dd5ca2d,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:44:59.360416 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-74fe4969-3a2b-4f1b-96ff-138377d7b66e None None] No DVR routers for this DVR port b5d07ee2-c2b6-490e-8334-ac606dd5ca2d on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:44:59.396130 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9a77a33-5234-4e1b-9db0-6dfb8df354c0 req-262cc62a-99e8-4a25-9285-eb994366ea04 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:44:59.397613 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d9a77a33-5234-4e1b-9db0-6dfb8df354c0 req-262cc62a-99e8-4a25-9285-eb994366ea04 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=f9ab492e-61b2-4203-af63-a2280af93fd1 HTTP/1.1" status: 200 len: 943 time: 0.0736585 Nov 09 04:44:59.406089 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7213f214-f17c-4dd3-a89a-24f802148e74 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:59.426680 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-7213f214-f17c-4dd3-a89a-24f802148e74 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['999b1b20-f8fc-4caf-84cc-3feda426a0bf']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:44:59.437090 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-7213f214-f17c-4dd3-a89a-24f802148e74 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'bc4577c9-06a5-450a-9c80-879827986f04') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:44:59.437388 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-7213f214-f17c-4dd3-a89a-24f802148e74 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'bc4577c9-06a5-450a-9c80-879827986f04') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:44:59.446980 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7213f214-f17c-4dd3-a89a-24f802148e74 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:59.448405 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d9a77a33-5234-4e1b-9db0-6dfb8df354c0 req-6b56a209-3534-4fbb-8f35-8bb56a21729f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=8425d3b7-b361-4e0f-ad79-89882a770395&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0445304 Nov 09 04:44:59.460799 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7213f214-f17c-4dd3-a89a-24f802148e74 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:59.467115 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7213f214-f17c-4dd3-a89a-24f802148e74 admin admin] Releasing vlan 310 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:44:59.467710 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7213f214-f17c-4dd3-a89a-24f802148e74 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:59.469448 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:44:59.469448 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:44:59.469448 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:44:59.469448 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:44:59.469448 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:44:59.469448 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:44:59.469448 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:44:59.469448 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:44:59.469448 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:44:59.469448 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:44:59.469448 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:44:59.469448 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:44:59.469448 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:44:59.469448 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:44:59.469448 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:44:59.469448 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:44:59.469448 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:44:59.469448 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:44:59.469448 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:44:59.469448 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:44:59.469448 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:44:59.469448 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:44:59.469448 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:44:59.469448 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:44:59.469448 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:44:59.469448 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:44:59.469448 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:44:59.469448 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:44:59.469448 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:44:59.469448 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:44:59.469448 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:44:59.469448 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:44:59.485453 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 9dea4e93-eac2-4ff4-bd09-131010862731 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=102163) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 09 04:44:59.564594 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device b5d07ee2-c2b6-490e-8334-ac606dd5ca2d no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:44:59.587920 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: b5d07ee2-c2b6-490e-8334-ac606dd5ca2d {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:44:59.588255 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device b5d07ee2-c2b6-490e-8334-ac606dd5ca2d not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:44:59.588661 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 873960f9-e8b5-48a6-a119-47c32f5b7968 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:44:59.590289 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7213f214-f17c-4dd3-a89a-24f802148e74 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:59.601415 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7213f214-f17c-4dd3-a89a-24f802148e74 admin admin] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:59.605298 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-7213f214-f17c-4dd3-a89a-24f802148e74 admin admin] 10.222.0.24 "DELETE /v2.0/networks/999b1b20-f8fc-4caf-84cc-3feda426a0bf HTTP/1.1" status: 204 len: 168 time: 0.6779673 Nov 09 04:44:59.608306 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33042) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:44:59.611372 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 873960f9-e8b5-48a6-a119-47c32f5b7968 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:44:59.612090 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 873960f9-e8b5-48a6-a119-47c32f5b7968 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:44:59.612090 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device a5f1e54d-1d98-4741-a1ce-59f4cfb5b332 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:44:59.615948 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7213f214-f17c-4dd3-a89a-24f802148e74 admin admin] Pushing event deleted for resources: {'Network': ['ID=999b1b20-f8fc-4caf-84cc-3feda426a0bf,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:44:59.634332 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: a5f1e54d-1d98-4741-a1ce-59f4cfb5b332 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:44:59.634700 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device a5f1e54d-1d98-4741-a1ce-59f4cfb5b332 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:44:59.653662 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 9dea4e93-eac2-4ff4-bd09-131010862731, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=9dea4e93-eac2-4ff4-bd09-131010862731,segment=NetworkSegment(9b73abc7-7651-4376-845b-e3dd90806c31),segment_id=9b73abc7-7651-4376-845b-e3dd90806c31)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:44:59.668258 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Returning: {'device': '9dea4e93-eac2-4ff4-bd09-131010862731', 'network_id': '1dad64b1-0a3e-4b78-a75f-959e3b1e79b8', 'port_id': '9dea4e93-eac2-4ff4-bd09-131010862731', 'mac_address': 'fa:16:3e:5e:61:81', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 336, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '9e8e346c-8a1f-4dfb-8ad0-e87375cefb67', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102163) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 09 04:44:59.704184 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:59.717803 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9dea4e93-eac2-4ff4-bd09-131010862731 {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:44:59.736784 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 9dea4e93-eac2-4ff4-bd09-131010862731, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=9dea4e93-eac2-4ff4-bd09-131010862731,segment=NetworkSegment(9b73abc7-7651-4376-845b-e3dd90806c31),segment_id=9b73abc7-7651-4376-845b-e3dd90806c31)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:44:59.803220 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:44:59.855151 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=9dea4e93-eac2-4ff4-bd09-131010862731,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:44:59.954741 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-dea50d69-e5de-47ff-a85b-407fb7bddce8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:00.032899 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['9dea4e93-eac2-4ff4-bd09-131010862731'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 04:45:00.203627 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-dea50d69-e5de-47ff-a85b-407fb7bddce8 admin admin] Deleting port ead597e3-bb6f-442e-b51f-2fef1e982ee1 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:45:00.203961 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-dea50d69-e5de-47ff-a85b-407fb7bddce8 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:00.281716 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-dea50d69-e5de-47ff-a85b-407fb7bddce8 admin admin] For port ead597e3-bb6f-442e-b51f-2fef1e982ee1, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=ead597e3-bb6f-442e-b51f-2fef1e982ee1,segment=NetworkSegment(2e3ecb82-bb37-4300-a753-caff02939e84),segment_id=2e3ecb82-bb37-4300-a753-caff02939e84)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:45:00.282227 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-dea50d69-e5de-47ff-a85b-407fb7bddce8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:00.295353 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-dea50d69-e5de-47ff-a85b-407fb7bddce8 admin admin] Calling delete_port for ead597e3-bb6f-442e-b51f-2fef1e982ee1 owned by network:router_interface {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:45:00.529194 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-dea50d69-e5de-47ff-a85b-407fb7bddce8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:00.562894 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4264687-2ab3-46d5-901b-b4150544181d req-4c629994-eb06-45f9-84e6-583a8966f2cb tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:45:00.564274 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dea50d69-e5de-47ff-a85b-407fb7bddce8 admin admin] Pushing event deleted for resources: {'Port': ['ID=ead597e3-bb6f-442e-b51f-2fef1e982ee1,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:45:00.564423 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f4264687-2ab3-46d5-901b-b4150544181d req-4c629994-eb06-45f9-84e6-583a8966f2cb tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=f9ab492e-61b2-4203-af63-a2280af93fd1 HTTP/1.1" status: 200 len: 944 time: 0.0485754 Nov 09 04:45:00.620774 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f4264687-2ab3-46d5-901b-b4150544181d req-f77b18d2-c51d-462d-9787-b83d6c4c4f21 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=8425d3b7-b361-4e0f-ad79-89882a770395&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0470929 Nov 09 04:45:00.723499 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-dea50d69-e5de-47ff-a85b-407fb7bddce8 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:00.930716 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dea50d69-e5de-47ff-a85b-407fb7bddce8 admin admin] Router 30ce26b1-f32a-4d74-9af5-e8a0c131f03e has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:45:01.032431 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dea50d69-e5de-47ff-a85b-407fb7bddce8 admin admin] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:45:01.037350 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-dea50d69-e5de-47ff-a85b-407fb7bddce8 admin admin] 10.222.0.24 "PUT /v2.0/routers/30ce26b1-f32a-4d74-9af5-e8a0c131f03e/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4277143 Nov 09 04:45:01.039828 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33046) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:45:01.043065 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3a7a34c7-f8f4-43d8-9ed5-e77bd5c17e49 None None] Sync routers for ids ['30ce26b1-f32a-4d74-9af5-e8a0c131f03e'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:45:01.052681 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3a7a34c7-f8f4-43d8-9ed5-e77bd5c17e49 None None] Routers {'30ce26b1-f32a-4d74-9af5-e8a0c131f03e'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:45:01.053288 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-3a7a34c7-f8f4-43d8-9ed5-e77bd5c17e49 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:44:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['30ce26b1-f32a-4d74-9af5-e8a0c131f03e'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:45:01.139812 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-07d632dd-b3bf-456e-93b6-43ca3655ce67 admin admin] Publish callbacks [] for router, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:01.155771 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-3a7a34c7-f8f4-43d8-9ed5-e77bd5c17e49 None None] Set router 30ce26b1-f32a-4d74-9af5-e8a0c131f03e gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:45:01.234417 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-07d632dd-b3bf-456e-93b6-43ca3655ce67 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:01.330830 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-3a7a34c7-f8f4-43d8-9ed5-e77bd5c17e49 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '30ce26b1-f32a-4d74-9af5-e8a0c131f03e', 'name': 'tempest-TestVolumeBootPattern-1317559415-router', 'tenant_id': '18fad88e828540cf998206d16279d5fb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.51'}], 'enable_snat': True}, 'gw_port_id': 'bb58b49c-f042-43b8-8916-dfb5f218a0cb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:34:43Z', 'updated_at': '2021-11-09T04:45:00Z', 'revision_number': 5, 'project_id': '18fad88e828540cf998206d16279d5fb', 'gw_port': {'id': 'bb58b49c-f042-43b8-8916-dfb5f218a0cb', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:33:56:58', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '30ce26b1-f32a-4d74-9af5-e8a0c131f03e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1126, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.51', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:34:44Z', 'updated_at': '2021-11-09T04:34:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:45:01.344896 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-07d632dd-b3bf-456e-93b6-43ca3655ce67 admin admin] Deleting port bb58b49c-f042-43b8-8916-dfb5f218a0cb {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:45:01.345231 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-07d632dd-b3bf-456e-93b6-43ca3655ce67 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:01.356877 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3a7a34c7-f8f4-43d8-9ed5-e77bd5c17e49 None None] Checking router: 30ce26b1-f32a-4d74-9af5-e8a0c131f03e for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:45:01.364882 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3a7a34c7-f8f4-43d8-9ed5-e77bd5c17e49 None None] Routers {'30ce26b1-f32a-4d74-9af5-e8a0c131f03e'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:45:01.365476 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-3a7a34c7-f8f4-43d8-9ed5-e77bd5c17e49 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:44:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['30ce26b1-f32a-4d74-9af5-e8a0c131f03e'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:45:01.421145 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-07d632dd-b3bf-456e-93b6-43ca3655ce67 admin admin] For port bb58b49c-f042-43b8-8916-dfb5f218a0cb, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=bb58b49c-f042-43b8-8916-dfb5f218a0cb,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:45:01.421408 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-07d632dd-b3bf-456e-93b6-43ca3655ce67 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:01.434235 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-07d632dd-b3bf-456e-93b6-43ca3655ce67 admin admin] Calling delete_port for bb58b49c-f042-43b8-8916-dfb5f218a0cb owned by network:router_gateway {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:45:01.448689 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-3a7a34c7-f8f4-43d8-9ed5-e77bd5c17e49 None None] Set router 30ce26b1-f32a-4d74-9af5-e8a0c131f03e gateway port host: None {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:45:01.503944 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 9dea4e93-eac2-4ff4-bd09-131010862731 up at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:45:01.506206 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-3a7a34c7-f8f4-43d8-9ed5-e77bd5c17e49 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '30ce26b1-f32a-4d74-9af5-e8a0c131f03e', 'name': 'tempest-TestVolumeBootPattern-1317559415-router', 'tenant_id': '18fad88e828540cf998206d16279d5fb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:34:43Z', 'updated_at': '2021-11-09T04:45:01Z', 'revision_number': 6, 'project_id': '18fad88e828540cf998206d16279d5fb', 'gw_port_host': None}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:45:01.549494 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3a7a34c7-f8f4-43d8-9ed5-e77bd5c17e49 None None] The sync data for ids ['30ce26b1-f32a-4d74-9af5-e8a0c131f03e'] in dv-neutron-816802-2-hyperv is: [{'id': '30ce26b1-f32a-4d74-9af5-e8a0c131f03e', 'name': 'tempest-TestVolumeBootPattern-1317559415-router', 'tenant_id': '18fad88e828540cf998206d16279d5fb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:34:43Z', 'updated_at': '2021-11-09T04:45:01Z', 'revision_number': 6, 'project_id': '18fad88e828540cf998206d16279d5fb', 'gw_port_host': None}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:45:01.648648 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning for port 9dea4e93-eac2-4ff4-bd09-131010862731 completed by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 09 04:45:01.652870 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning complete for port 9dea4e93-eac2-4ff4-bd09-131010862731 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:45:01.653343 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:01.681244 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-07d632dd-b3bf-456e-93b6-43ca3655ce67 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:01.715430 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07d632dd-b3bf-456e-93b6-43ca3655ce67 admin admin] Pushing event deleted for resources: {'Port': ['ID=bb58b49c-f042-43b8-8916-dfb5f218a0cb,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:45:01.736901 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:01.759444 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f9ab492e-61b2-4203-af63-a2280af93fd1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9dea4e93-eac2-4ff4-bd09-131010862731'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:45:01.761774 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7a171bc0-546a-4662-9a03-166455beafef" -d '{"events": [{"server_uuid": "f9ab492e-61b2-4203-af63-a2280af93fd1", "name": "network-vif-plugged", "status": "completed", "tag": "9dea4e93-eac2-4ff4-bd09-131010862731"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:45:01.774417 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 9dea4e93-eac2-4ff4-bd09-131010862731, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=9dea4e93-eac2-4ff4-bd09-131010862731,segment=NetworkSegment(9b73abc7-7651-4376-845b-e3dd90806c31),segment_id=9b73abc7-7651-4376-845b-e3dd90806c31)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:45:01.795996 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-07d632dd-b3bf-456e-93b6-43ca3655ce67 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-466373'] for router_gateway, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:01.805837 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7487cbea-01e9-4b27-98bf-33dd868b2dad req-1051e899-c64b-4e7a-9558-fe0bf2e9582e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:45:01.807348 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7487cbea-01e9-4b27-98bf-33dd868b2dad req-1051e899-c64b-4e7a-9558-fe0bf2e9582e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=f9ab492e-61b2-4203-af63-a2280af93fd1 HTTP/1.1" status: 200 len: 944 time: 0.1018386 Nov 09 04:45:01.860531 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:45:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cc2b570f-4476-4561-a98b-d0fa8f9c109d x-openstack-request-id: req-cc2b570f-4476-4561-a98b-d0fa8f9c109d {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:45:01.860807 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f9ab492e-61b2-4203-af63-a2280af93fd1", "name": "network-vif-plugged", "status": "completed", "tag": "9dea4e93-eac2-4ff4-bd09-131010862731", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:45:01.861056 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-cc2b570f-4476-4561-a98b-d0fa8f9c109d {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:45:01.861448 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f9ab492e-61b2-4203-af63-a2280af93fd1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9dea4e93-eac2-4ff4-bd09-131010862731', 'code': 200} Nov 09 04:45:01.876861 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:01.943313 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=9dea4e93-eac2-4ff4-bd09-131010862731,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:45:02.274086 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-07d632dd-b3bf-456e-93b6-43ca3655ce67 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:02.277077 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-07d632dd-b3bf-456e-93b6-43ca3655ce67 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:02.344313 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7487cbea-01e9-4b27-98bf-33dd868b2dad req-4443ce21-2417-43f5-a793-f8be7f556d7f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=8425d3b7-b361-4e0f-ad79-89882a770395&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.5138173 Nov 09 04:45:02.346573 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cb85fb4-c77c-4149-9a7d-31cde00f58ca req-51b6df82-f7e3-4f81-9c99-018c105688dc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:45:02.348057 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1cb85fb4-c77c-4149-9a7d-31cde00f58ca req-51b6df82-f7e3-4f81-9c99-018c105688dc service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=f9ab492e-61b2-4203-af63-a2280af93fd1 HTTP/1.1" status: 200 len: 1098 time: 0.1398764 Nov 09 04:45:02.395246 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1cb85fb4-c77c-4149-9a7d-31cde00f58ca req-acc449c8-29bd-45e5-9443-3b9e23071aef service neutron] 10.222.0.26 "GET /v2.0/security-groups?id=8425d3b7-b361-4e0f-ad79-89882a770395&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0396962 Nov 09 04:45:02.402747 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-07d632dd-b3bf-456e-93b6-43ca3655ce67 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:02.403445 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-07d632dd-b3bf-456e-93b6-43ca3655ce67 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 30ce26b1-f32a-4d74-9af5-e8a0c131f03e {{(pid=102162) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:45:02.407976 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-07d632dd-b3bf-456e-93b6-43ca3655ce67 admin admin] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:02.409195 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-07d632dd-b3bf-456e-93b6-43ca3655ce67 admin admin] 10.222.0.24 "DELETE /v2.0/routers/30ce26b1-f32a-4d74-9af5-e8a0c131f03e HTTP/1.1" status: 204 len: 168 time: 1.3684101 Nov 09 04:45:02.411671 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33056) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:45:02.457303 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-34b924fe-5395-4f29-b7d6-3ba02647479b admin admin] Deleting subnet e227662b-cae0-423b-8216-3677cff71c09 {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:45:02.460637 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-34b924fe-5395-4f29-b7d6-3ba02647479b admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:02.498950 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-34b924fe-5395-4f29-b7d6-3ba02647479b admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:02.578853 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-34b924fe-5395-4f29-b7d6-3ba02647479b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:02.682938 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-34b924fe-5395-4f29-b7d6-3ba02647479b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:02.710236 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34b924fe-5395-4f29-b7d6-3ba02647479b admin admin] Pushing event deleted for resources: {'Subnet': ['ID=e227662b-cae0-423b-8216-3677cff71c09,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:45:02.716379 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-34b924fe-5395-4f29-b7d6-3ba02647479b admin admin] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:02.719585 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-34b924fe-5395-4f29-b7d6-3ba02647479b admin admin] 10.222.0.24 "DELETE /v2.0/subnets/e227662b-cae0-423b-8216-3677cff71c09 HTTP/1.1" status: 204 len: 168 time: 0.3069963 Nov 09 04:45:02.722223 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 33058) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:45:02.723562 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-de4eb351-39ad-4779-b6b2-7436c961fd2e None None] Network 081edca3-e165-4289-b2f5-202ccc9cf76d requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:45:02.793790 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9dab21be-67ee-427e-afb8-b72f2f0ad734 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:02.843805 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-9dab21be-67ee-427e-afb8-b72f2f0ad734 admin admin] Deleting port 02e84f22-2290-4e49-8ae8-eeb78740236c {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:45:02.844136 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9dab21be-67ee-427e-afb8-b72f2f0ad734 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:02.891433 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-023c5072-5256-4afb-bc71-3a15f507d038 None None] DHCP port deletion for 081edca3-e165-4289-b2f5-202ccc9cf76d request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:45:02.911933 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-9dab21be-67ee-427e-afb8-b72f2f0ad734 admin admin] For port 02e84f22-2290-4e49-8ae8-eeb78740236c, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=02e84f22-2290-4e49-8ae8-eeb78740236c,segment=NetworkSegment(2e3ecb82-bb37-4300-a753-caff02939e84),segment_id=2e3ecb82-bb37-4300-a753-caff02939e84)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:45:02.912276 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9dab21be-67ee-427e-afb8-b72f2f0ad734 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:02.925696 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-9dab21be-67ee-427e-afb8-b72f2f0ad734 admin admin] Calling delete_port for 02e84f22-2290-4e49-8ae8-eeb78740236c owned by network:dhcp {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:45:02.940289 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-023c5072-5256-4afb-bc71-3a15f507d038 None None] Deleting port 02e84f22-2290-4e49-8ae8-eeb78740236c {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:45:02.940654 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-023c5072-5256-4afb-bc71-3a15f507d038 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:03.005325 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-023c5072-5256-4afb-bc71-3a15f507d038 None None] For port 02e84f22-2290-4e49-8ae8-eeb78740236c, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=02e84f22-2290-4e49-8ae8-eeb78740236c,segment=NetworkSegment(2e3ecb82-bb37-4300-a753-caff02939e84),segment_id=2e3ecb82-bb37-4300-a753-caff02939e84)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:45:03.005710 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-023c5072-5256-4afb-bc71-3a15f507d038 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:03.018075 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-023c5072-5256-4afb-bc71-3a15f507d038 None None] Calling delete_port for 02e84f22-2290-4e49-8ae8-eeb78740236c owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:45:03.140323 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9dab21be-67ee-427e-afb8-b72f2f0ad734 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:03.145900 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-023c5072-5256-4afb-bc71-3a15f507d038 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:03.167415 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dab21be-67ee-427e-afb8-b72f2f0ad734 admin admin] Pushing event deleted for resources: {'Port': ['ID=02e84f22-2290-4e49-8ae8-eeb78740236c,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:45:03.170664 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-023c5072-5256-4afb-bc71-3a15f507d038 None None] Pushing event deleted for resources: {'Port': ['ID=02e84f22-2290-4e49-8ae8-eeb78740236c,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:45:03.174655 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9dab21be-67ee-427e-afb8-b72f2f0ad734 admin admin] No DVR routers for this DVR port 02e84f22-2290-4e49-8ae8-eeb78740236c on host dv-neutron-816802-2-hyperv {{(pid=102161) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:45:03.179108 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-023c5072-5256-4afb-bc71-3a15f507d038 None None] No DVR routers for this DVR port 02e84f22-2290-4e49-8ae8-eeb78740236c on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:45:03.248734 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9dab21be-67ee-427e-afb8-b72f2f0ad734 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:03.269984 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-9dab21be-67ee-427e-afb8-b72f2f0ad734 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['081edca3-e165-4289-b2f5-202ccc9cf76d']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:45:03.279860 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-9dab21be-67ee-427e-afb8-b72f2f0ad734 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2e3ecb82-bb37-4300-a753-caff02939e84') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:45:03.283615 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-9dab21be-67ee-427e-afb8-b72f2f0ad734 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2e3ecb82-bb37-4300-a753-caff02939e84') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:45:03.289380 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9dab21be-67ee-427e-afb8-b72f2f0ad734 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:03.302130 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9dab21be-67ee-427e-afb8-b72f2f0ad734 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:03.307807 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9dab21be-67ee-427e-afb8-b72f2f0ad734 admin admin] Releasing vlan 303 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:45:03.308187 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9dab21be-67ee-427e-afb8-b72f2f0ad734 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:03.309816 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:45:03.309816 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:45:03.309816 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:45:03.309816 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:45:03.309816 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:45:03.309816 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:45:03.309816 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:45:03.309816 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:45:03.309816 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:45:03.309816 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:45:03.309816 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:45:03.309816 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:45:03.309816 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:45:03.309816 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:45:03.309816 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:45:03.309816 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:45:03.309816 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:45:03.309816 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:45:03.309816 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:45:03.309816 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:45:03.309816 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:45:03.309816 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:45:03.309816 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:45:03.309816 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:45:03.309816 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:45:03.309816 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:45:03.309816 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:45:03.309816 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:45:03.309816 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:45:03.309816 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:45:03.309816 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:45:03.309816 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:45:03.424919 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9dab21be-67ee-427e-afb8-b72f2f0ad734 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:03.449969 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9dab21be-67ee-427e-afb8-b72f2f0ad734 admin admin] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:03.455108 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-9dab21be-67ee-427e-afb8-b72f2f0ad734 admin admin] 10.222.0.24 "DELETE /v2.0/networks/081edca3-e165-4289-b2f5-202ccc9cf76d HTTP/1.1" status: 204 len: 168 time: 0.7316117 Nov 09 04:45:03.476166 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dab21be-67ee-427e-afb8-b72f2f0ad734 admin admin] Pushing event deleted for resources: {'Network': ['ID=081edca3-e165-4289-b2f5-202ccc9cf76d,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:45:03.512655 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1925d222-4c2f-4ac2-8d0c-870b38dd809f req-943e1b21-0406-4e88-aff8-34fddf3fd5de tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:45:03.515046 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-1925d222-4c2f-4ac2-8d0c-870b38dd809f req-943e1b21-0406-4e88-aff8-34fddf3fd5de tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=f9ab492e-61b2-4203-af63-a2280af93fd1 HTTP/1.1" status: 200 len: 945 time: 0.1004167 Nov 09 04:45:03.566756 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device ead597e3-bb6f-442e-b51f-2fef1e982ee1 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:45:03.585682 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-1925d222-4c2f-4ac2-8d0c-870b38dd809f req-ff7c3a0f-17b8-4047-90c8-fe590bedd3c6 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=8425d3b7-b361-4e0f-ad79-89882a770395&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0570540 Nov 09 04:45:03.592756 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: ead597e3-bb6f-442e-b51f-2fef1e982ee1 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:45:03.593103 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device ead597e3-bb6f-442e-b51f-2fef1e982ee1 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:45:03.593522 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 02e84f22-2290-4e49-8ae8-eeb78740236c no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:45:03.613104 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 02e84f22-2290-4e49-8ae8-eeb78740236c {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:45:03.613440 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 02e84f22-2290-4e49-8ae8-eeb78740236c not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:45:03.613874 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device bb58b49c-f042-43b8-8916-dfb5f218a0cb no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:45:03.633232 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: bb58b49c-f042-43b8-8916-dfb5f218a0cb {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:45:03.634149 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device bb58b49c-f042-43b8-8916-dfb5f218a0cb not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:45:03.800253 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33064) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:45:03.840081 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-30da614f-6ad4-4c22-8b16-52432d5de6c6 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=f636e5f4c9f64f69ba3b2ab8816b6096&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0387259 Nov 09 04:45:03.842505 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33066) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:45:03.894370 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2035d728-db48-4a60-a97f-99c0ceaca8dd admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:03.914349 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2035d728-db48-4a60-a97f-99c0ceaca8dd admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:04.048352 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2035d728-db48-4a60-a97f-99c0ceaca8dd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:04.050974 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2035d728-db48-4a60-a97f-99c0ceaca8dd admin admin] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:04.052109 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-2035d728-db48-4a60-a97f-99c0ceaca8dd admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/311e8aaf-5444-4ebd-be1d-d97abb7a470e HTTP/1.1" status: 204 len: 168 time: 0.2087429 Nov 09 04:45:04.060873 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2035d728-db48-4a60-a97f-99c0ceaca8dd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=311e8aaf-5444-4ebd-be1d-d97abb7a470e,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:45:04.699888 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f0d8a43-4578-419c-ba71-7fd254c82ede req-613d33ad-ee77-4002-9041-893d120dd004 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:45:04.701352 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9f0d8a43-4578-419c-ba71-7fd254c82ede req-613d33ad-ee77-4002-9041-893d120dd004 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=f9ab492e-61b2-4203-af63-a2280af93fd1 HTTP/1.1" status: 200 len: 945 time: 0.0475421 Nov 09 04:45:04.732455 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 33074) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:45:04.755533 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9f0d8a43-4578-419c-ba71-7fd254c82ede req-36c8523f-49dc-4ef1-b3d3-4002509f1aa6 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=8425d3b7-b361-4e0f-ad79-89882a770395&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0483668 Nov 09 04:45:04.776870 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a9c1e8a1-2c7b-470f-ae83-93b9323d813e admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=18fad88e828540cf998206d16279d5fb&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0376346 Nov 09 04:45:04.776870 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 33076) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:45:04.834419 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7d2a8ce0-65db-4077-8ec3-2c377f876bc2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:04.872033 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7d2a8ce0-65db-4077-8ec3-2c377f876bc2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:04.899236 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f1a501a-9934-43a0-b070-87c062d612b5 req-3696b536-8f6c-47e6-aed5-54047e43e2c9 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:45:04.900737 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-8f1a501a-9934-43a0-b070-87c062d612b5 req-3696b536-8f6c-47e6-aed5-54047e43e2c9 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=f9ab492e-61b2-4203-af63-a2280af93fd1 HTTP/1.1" status: 200 len: 945 time: 0.0778725 Nov 09 04:45:04.957223 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-8f1a501a-9934-43a0-b070-87c062d612b5 req-ebfca318-de61-4abd-8ef3-c5ed59cb99bc tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=8425d3b7-b361-4e0f-ad79-89882a770395&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0506713 Nov 09 04:45:04.979773 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 33080) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:45:05.017214 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1663012a-1033-41e2-ab2c-44f4bf0401c2 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:45:05.018832 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1663012a-1033-41e2-ab2c-44f4bf0401c2 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/ports?device_id=f9ab492e-61b2-4203-af63-a2280af93fd1 HTTP/1.1" status: 200 len: 1093 time: 0.0381052 Nov 09 04:45:05.021457 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 33082) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:45:05.026242 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-e81e060e-c032-4ae8-b9c8-c17c1e256eb0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'floatingip': {'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'port_id': '9dea4e93-eac2-4ff4-bd09-131010862731', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ip_address': '172.20.0.9'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:45:05.048458 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7d2a8ce0-65db-4077-8ec3-2c377f876bc2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:05.050981 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7d2a8ce0-65db-4077-8ec3-2c377f876bc2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:05.052053 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-7d2a8ce0-65db-4077-8ec3-2c377f876bc2 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/aa20aa92-41a6-4711-858b-8dd2743c6e61 HTTP/1.1" status: 204 len: 168 time: 0.2775154 Nov 09 04:45:05.059475 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d2a8ce0-65db-4077-8ec3-2c377f876bc2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=aa20aa92-41a6-4711-858b-8dd2743c6e61,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:45:05.089282 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e81e060e-c032-4ae8-b9c8-c17c1e256eb0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for floatingip, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:05.188321 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e81e060e-c032-4ae8-b9c8-c17c1e256eb0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:05.293155 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-e81e060e-c032-4ae8-b9c8-c17c1e256eb0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Allocated IP 172.26.0.20 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/f21d41b3-8b9b-4bec-a451-7cbfa55328d6) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:45:05.397297 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e81e060e-c032-4ae8-b9c8-c17c1e256eb0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:05.489404 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e81e060e-c032-4ae8-b9c8-c17c1e256eb0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:05.529685 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e81e060e-c032-4ae8-b9c8-c17c1e256eb0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:45:05.534693 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-e81e060e-c032-4ae8-b9c8-c17c1e256eb0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:45:05.538244 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e81e060e-c032-4ae8-b9c8-c17c1e256eb0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:45:05.565545 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e81e060e-c032-4ae8-b9c8-c17c1e256eb0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Port': ['ID=f21d41b3-8b9b-4bec-a451-7cbfa55328d6,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:45:05.894908 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e81e060e-c032-4ae8-b9c8-c17c1e256eb0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:06.022824 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e81e060e-c032-4ae8-b9c8-c17c1e256eb0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:06.165773 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e81e060e-c032-4ae8-b9c8-c17c1e256eb0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:06.223791 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e81e060e-c032-4ae8-b9c8-c17c1e256eb0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:06.288645 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e81e060e-c032-4ae8-b9c8-c17c1e256eb0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Port': ['ID=f21d41b3-8b9b-4bec-a451-7cbfa55328d6,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:45:06.303330 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e81e060e-c032-4ae8-b9c8-c17c1e256eb0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:06.658931 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.l3_db [None req-e81e060e-c032-4ae8-b9c8-c17c1e256eb0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Floating IP 9b4594ad-5ede-4f40-a4be-03b43f0db565 associated. External IP: 172.26.0.20, port: 9dea4e93-eac2-4ff4-bd09-131010862731. Nov 09 04:45:06.856758 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e81e060e-c032-4ae8-b9c8-c17c1e256eb0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Router ab3c88d0-a531-409f-8b0b-c18b0761c90a has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:45:06.964363 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e81e060e-c032-4ae8-b9c8-c17c1e256eb0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:45:06.974045 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5c5a392f-cc4e-452d-891f-1b80b8459c27 None None] Sync routers for ids ['ab3c88d0-a531-409f-8b0b-c18b0761c90a'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:45:06.983606 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5c5a392f-cc4e-452d-891f-1b80b8459c27 None None] Routers {'ab3c88d0-a531-409f-8b0b-c18b0761c90a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:45:06.984200 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-5c5a392f-cc4e-452d-891f-1b80b8459c27 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:44:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['ab3c88d0-a531-409f-8b0b-c18b0761c90a'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:45:07.068114 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e81e060e-c032-4ae8-b9c8-c17c1e256eb0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:07.086279 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-5c5a392f-cc4e-452d-891f-1b80b8459c27 None None] Set router ab3c88d0-a531-409f-8b0b-c18b0761c90a gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:45:07.095690 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-e81e060e-c032-4ae8-b9c8-c17c1e256eb0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 2.0732274 Nov 09 04:45:07.096287 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f9ab492e-61b2-4203-af63-a2280af93fd1', 'tag': '9dea4e93-eac2-4ff4-bd09-131010862731'}] {{(pid=102161) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:45:07.098596 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}99dfdda0def497b4372884ef2eb87f06b1e425c8eba5ceda5f64bbab037a07d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-75a163a8-a586-4d37-9a62-4e77755ed01c" -d '{"events": [{"name": "network-changed", "server_uuid": "f9ab492e-61b2-4203-af63-a2280af93fd1", "tag": "9dea4e93-eac2-4ff4-bd09-131010862731"}]}' {{(pid=102161) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:45:07.100945 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33086) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:45:07.140262 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-503f7437-2234-421b-8681-fa3f24f81ddf tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:45:07.144428 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-503f7437-2234-421b-8681-fa3f24f81ddf tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/ports?device_id=f9ab492e-61b2-4203-af63-a2280af93fd1 HTTP/1.1" status: 200 len: 1093 time: 0.0422437 Nov 09 04:45:07.322763 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:45:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d307d186-9dc3-4166-b500-e0a0090205a6 x-openstack-request-id: req-d307d186-9dc3-4166-b500-e0a0090205a6 {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:45:07.323190 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f9ab492e-61b2-4203-af63-a2280af93fd1", "tag": "9dea4e93-eac2-4ff4-bd09-131010862731", "status": "completed", "code": 200}]} {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:45:07.324021 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-d307d186-9dc3-4166-b500-e0a0090205a6 {{(pid=102161) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:45:07.324348 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f9ab492e-61b2-4203-af63-a2280af93fd1', 'tag': '9dea4e93-eac2-4ff4-bd09-131010862731', 'status': 'completed', 'code': 200} Nov 09 04:45:07.389510 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75a163a8-a586-4d37-9a62-4e77755ed01c req-f25a1064-71bb-4429-aec0-933870f70147 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:45:07.391156 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-75a163a8-a586-4d37-9a62-4e77755ed01c req-f25a1064-71bb-4429-aec0-933870f70147 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&device_id=f9ab492e-61b2-4203-af63-a2280af93fd1 HTTP/1.1" status: 200 len: 1098 time: 0.0394034 Nov 09 04:45:07.405794 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-5c5a392f-cc4e-452d-891f-1b80b8459c27 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'name': 'tempest-TestNetworkBasicOps-router-636046836', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.161'}], 'enable_snat': True}, 'gw_port_id': '8e2fba8e-7861-42b3-9f71-2ef66b096ca7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:44:41Z', 'updated_at': '2021-11-09T04:44:46Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '8e2fba8e-7861-42b3-9f71-2ef66b096ca7', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:d4:05:cb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1477, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.161', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:44:41Z', 'updated_at': '2021-11-09T04:44:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '9b4594ad-5ede-4f40-a4be-03b43f0db565', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'floating_ip_address': '172.26.0.20', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'port_id': '9dea4e93-eac2-4ff4-bd09-131010862731', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 1492, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '1dad64b1-0a3e-4b78-a75f-959e3b1e79b8', 'mac_address': 'fa:16:3e:5e:61:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f9ab492e-61b2-4203-af63-a2280af93fd1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:45:05Z', 'updated_at': '2021-11-09T04:45:05Z', 'revision_number': 0, 'project_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1307a903-74ab-4faf-8993-e69fd7140798', 'name': '', 'network_id': '1dad64b1-0a3e-4b78-a75f-959e3b1e79b8', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:f7:0c:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1480, 'fixed_ips': [{'subnet_id': '9e8e346c-8a1f-4dfb-8ad0-e87375cefb67', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:44:46Z', 'updated_at': '2021-11-09T04:44:50Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '9e8e346c-8a1f-4dfb-8ad0-e87375cefb67', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:45:07.422388 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 33094) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:45:07.427477 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-79dd408b-7cc1-4861-81cb-dad588c9ef42 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-84762297', 'description': 'tempest-secgroup-smoke-84762297 description', 'project_id': '1d10b4824e524068827e58b55e269af3'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:45:07.440806 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5c5a392f-cc4e-452d-891f-1b80b8459c27 None None] Checking router: ab3c88d0-a531-409f-8b0b-c18b0761c90a for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:45:07.449408 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5c5a392f-cc4e-452d-891f-1b80b8459c27 None None] Routers {'ab3c88d0-a531-409f-8b0b-c18b0761c90a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:45:07.450131 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-5c5a392f-cc4e-452d-891f-1b80b8459c27 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:44:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['ab3c88d0-a531-409f-8b0b-c18b0761c90a'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:45:07.488851 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-79dd408b-7cc1-4861-81cb-dad588c9ef42 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:07.490422 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75a163a8-a586-4d37-9a62-4e77755ed01c req-5d3e61c1-6f0b-49fa-89e7-7bfd190ff77a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:45:07.491662 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-75a163a8-a586-4d37-9a62-4e77755ed01c req-5d3e61c1-6f0b-49fa-89e7-7bfd190ff77a service neutron] 10.222.0.26 "GET /v2.0/networks?id=1dad64b1-0a3e-4b78-a75f-959e3b1e79b8 HTTP/1.1" status: 200 len: 898 time: 0.0938003 Nov 09 04:45:07.561098 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-75a163a8-a586-4d37-9a62-4e77755ed01c req-8c48e42b-603f-4ae1-8b08-e276f1c5b6be service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=9dea4e93-eac2-4ff4-bd09-131010862731 HTTP/1.1" status: 200 len: 998 time: 0.0627186 Nov 09 04:45:07.564917 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-5c5a392f-cc4e-452d-891f-1b80b8459c27 None None] Set router ab3c88d0-a531-409f-8b0b-c18b0761c90a gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:45:07.565072 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-79dd408b-7cc1-4861-81cb-dad588c9ef42 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:07.612890 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75a163a8-a586-4d37-9a62-4e77755ed01c req-a3739fd1-f5e4-483c-97cc-626e40c5671d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:45:07.614395 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-75a163a8-a586-4d37-9a62-4e77755ed01c req-a3739fd1-f5e4-483c-97cc-626e40c5671d service neutron] 10.222.0.26 "GET /v2.0/subnets?id=9e8e346c-8a1f-4dfb-8ad0-e87375cefb67 HTTP/1.1" status: 200 len: 834 time: 0.0437813 Nov 09 04:45:07.646844 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-79dd408b-7cc1-4861-81cb-dad588c9ef42 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:07.664831 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75a163a8-a586-4d37-9a62-4e77755ed01c req-1af5cf3c-0fa2-4fd7-b52d-b2df73cfb5d6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:45:07.666438 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-75a163a8-a586-4d37-9a62-4e77755ed01c req-1af5cf3c-0fa2-4fd7-b52d-b2df73cfb5d6 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=1dad64b1-0a3e-4b78-a75f-959e3b1e79b8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0452745 Nov 09 04:45:07.677981 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79dd408b-7cc1-4861-81cb-dad588c9ef42 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroup': ['ID=0213e3fe-696b-486f-b865-2087043fe0c0,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:45:07.734622 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-79dd408b-7cc1-4861-81cb-dad588c9ef42 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:07.738414 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-79dd408b-7cc1-4861-81cb-dad588c9ef42 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1809 time: 0.3120060 Nov 09 04:45:07.738647 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 33096) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:45:07.743053 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-223a52c8-ce12-4d7f-9188-7a88f25e645d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': '0213e3fe-696b-486f-b865-2087043fe0c0', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:45:07.762535 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-75a163a8-a586-4d37-9a62-4e77755ed01c req-b8393bb7-2ce6-444d-b57a-1df19e73f460 service neutron] 10.222.0.26 "GET /v2.0/networks/1dad64b1-0a3e-4b78-a75f-959e3b1e79b8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0886014 Nov 09 04:45:07.795041 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-5c5a392f-cc4e-452d-891f-1b80b8459c27 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'name': 'tempest-TestNetworkBasicOps-router-636046836', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.161'}], 'enable_snat': True}, 'gw_port_id': '8e2fba8e-7861-42b3-9f71-2ef66b096ca7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:44:41Z', 'updated_at': '2021-11-09T04:44:46Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '8e2fba8e-7861-42b3-9f71-2ef66b096ca7', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:d4:05:cb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1477, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.161', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:44:41Z', 'updated_at': '2021-11-09T04:44:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '9b4594ad-5ede-4f40-a4be-03b43f0db565', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'floating_ip_address': '172.26.0.20', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'port_id': '9dea4e93-eac2-4ff4-bd09-131010862731', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 1492, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '1dad64b1-0a3e-4b78-a75f-959e3b1e79b8', 'mac_address': 'fa:16:3e:5e:61:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f9ab492e-61b2-4203-af63-a2280af93fd1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:45:05Z', 'updated_at': '2021-11-09T04:45:05Z', 'revision_number': 0, 'project_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1307a903-74ab-4faf-8993-e69fd7140798', 'name': '', 'network_id': '1dad64b1-0a3e-4b78-a75f-959e3b1e79b8', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:f7:0c:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1480, 'fixed_ips': [{'subnet_id': '9e8e346c-8a1f-4dfb-8ad0-e87375cefb67', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:44:46Z', 'updated_at': '2021-11-09T04:44:50Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '9e8e346c-8a1f-4dfb-8ad0-e87375cefb67', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:45:07.824633 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5c5a392f-cc4e-452d-891f-1b80b8459c27 None None] The sync data for ids ['ab3c88d0-a531-409f-8b0b-c18b0761c90a'] in dv-neutron-816802-2-hyperv is: [{'id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'name': 'tempest-TestNetworkBasicOps-router-636046836', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.161'}], 'enable_snat': True}, 'gw_port_id': '8e2fba8e-7861-42b3-9f71-2ef66b096ca7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:44:41Z', 'updated_at': '2021-11-09T04:44:46Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '8e2fba8e-7861-42b3-9f71-2ef66b096ca7', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:d4:05:cb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1477, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.161', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:44:41Z', 'updated_at': '2021-11-09T04:44:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '9b4594ad-5ede-4f40-a4be-03b43f0db565', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'floating_ip_address': '172.26.0.20', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'port_id': '9dea4e93-eac2-4ff4-bd09-131010862731', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 1492, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '1dad64b1-0a3e-4b78-a75f-959e3b1e79b8', 'mac_address': 'fa:16:3e:5e:61:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f9ab492e-61b2-4203-af63-a2280af93fd1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:45:05Z', 'updated_at': '2021-11-09T04:45:05Z', 'revision_number': 0, 'project_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1307a903-74ab-4faf-8993-e69fd7140798', 'name': '', 'network_id': '1dad64b1-0a3e-4b78-a75f-959e3b1e79b8', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:f7:0c:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1480, 'fixed_ips': [{'subnet_id': '9e8e346c-8a1f-4dfb-8ad0-e87375cefb67', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:44:46Z', 'updated_at': '2021-11-09T04:44:50Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '9e8e346c-8a1f-4dfb-8ad0-e87375cefb67', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:45:07.841176 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-223a52c8-ce12-4d7f-9188-7a88f25e645d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:07.863111 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-75a163a8-a586-4d37-9a62-4e77755ed01c req-d7a6075a-d12e-42e7-b07d-97fee24333de service neutron] 10.222.0.26 "GET /v2.0/networks/1dad64b1-0a3e-4b78-a75f-959e3b1e79b8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0927892 Nov 09 04:45:07.909087 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-223a52c8-ce12-4d7f-9188-7a88f25e645d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:07.973103 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-223a52c8-ce12-4d7f-9188-7a88f25e645d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:07.992943 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-223a52c8-ce12-4d7f-9188-7a88f25e645d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=24d22f40-f91c-40c9-a68e-e4e7214cfecd,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:45:08.031351 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a4ca6464-6bb1-41af-bb58-6afa710b1052 None None] New status for floating IP 9b4594ad-5ede-4f40-a4be-03b43f0db565: ACTIVE {{(pid=102163) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 04:45:08.096072 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-223a52c8-ce12-4d7f-9188-7a88f25e645d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:08.097203 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-223a52c8-ce12-4d7f-9188-7a88f25e645d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3576229 Nov 09 04:45:08.099974 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 33098) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:45:08.104902 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-efbcb3b4-3ed7-4370-adff-eb8440ffee5e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': '0213e3fe-696b-486f-b865-2087043fe0c0', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:45:08.195752 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-efbcb3b4-3ed7-4370-adff-eb8440ffee5e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:08.256730 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-efbcb3b4-3ed7-4370-adff-eb8440ffee5e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:08.323285 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-efbcb3b4-3ed7-4370-adff-eb8440ffee5e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:08.341924 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-efbcb3b4-3ed7-4370-adff-eb8440ffee5e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2964b339-0caf-45f0-8343-e7be6b01f0fb,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:45:08.408686 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-efbcb3b4-3ed7-4370-adff-eb8440ffee5e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:08.409884 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-efbcb3b4-3ed7-4370-adff-eb8440ffee5e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.3090079 Nov 09 04:45:08.412538 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 33100) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:45:08.416774 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-2aa604fd-2210-4a02-ae3d-fd0000b74d2b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': '0213e3fe-696b-486f-b865-2087043fe0c0', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:45:08.502690 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2aa604fd-2210-4a02-ae3d-fd0000b74d2b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:08.556820 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2aa604fd-2210-4a02-ae3d-fd0000b74d2b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:08.648238 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2aa604fd-2210-4a02-ae3d-fd0000b74d2b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:08.665832 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2aa604fd-2210-4a02-ae3d-fd0000b74d2b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3d77b4e5-88e7-4a75-8a72-2401031feb45,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:45:08.735697 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2aa604fd-2210-4a02-ae3d-fd0000b74d2b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:08.736883 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-2aa604fd-2210-4a02-ae3d-fd0000b74d2b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3234413 Nov 09 04:45:08.739709 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 33102) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:45:08.744589 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-890daa79-1659-4cdb-85c0-d2f5a8664fda tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': '0213e3fe-696b-486f-b865-2087043fe0c0', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:45:08.835806 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-890daa79-1659-4cdb-85c0-d2f5a8664fda tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:08.893026 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-890daa79-1659-4cdb-85c0-d2f5a8664fda tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:08.940190 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-890daa79-1659-4cdb-85c0-d2f5a8664fda tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:08.960011 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-890daa79-1659-4cdb-85c0-d2f5a8664fda tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=25c394bc-d8a7-4be1-aa0c-1734e3db0a7e,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:45:09.015954 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-890daa79-1659-4cdb-85c0-d2f5a8664fda tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:09.017213 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-890daa79-1659-4cdb-85c0-d2f5a8664fda tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.2765496 Nov 09 04:45:09.019968 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 33104) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:45:09.025953 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-be6fe2e5-c603-4811-8631-8cf083e4722c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': '0213e3fe-696b-486f-b865-2087043fe0c0', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:45:09.111233 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.securitygroups_db [None req-be6fe2e5-c603-4811-8631-8cf083e4722c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Project 1d10b4824e524068827e58b55e269af3 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 09 04:45:09.116363 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-be6fe2e5-c603-4811-8631-8cf083e4722c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:09.175143 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-be6fe2e5-c603-4811-8631-8cf083e4722c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:09.236662 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-be6fe2e5-c603-4811-8631-8cf083e4722c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:09.254062 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be6fe2e5-c603-4811-8631-8cf083e4722c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7be97209-17db-4dcf-938f-22605ec2387a,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:45:09.334732 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-be6fe2e5-c603-4811-8631-8cf083e4722c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:09.335966 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-be6fe2e5-c603-4811-8631-8cf083e4722c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.3150783 Nov 09 04:45:09.338714 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 33106) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:45:09.343134 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-7a68224b-c321-4df9-8193-fec2e60dee3c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': '0213e3fe-696b-486f-b865-2087043fe0c0', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:45:09.440954 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.securitygroups_db [None req-7a68224b-c321-4df9-8193-fec2e60dee3c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Project 1d10b4824e524068827e58b55e269af3 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 09 04:45:09.445636 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7a68224b-c321-4df9-8193-fec2e60dee3c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:09.505902 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7a68224b-c321-4df9-8193-fec2e60dee3c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:09.591103 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7a68224b-c321-4df9-8193-fec2e60dee3c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:09.612166 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a68224b-c321-4df9-8193-fec2e60dee3c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=599b4220-67c4-479c-b180-9c93b91969a3,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:45:09.689949 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7a68224b-c321-4df9-8193-fec2e60dee3c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:09.691219 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-7a68224b-c321-4df9-8193-fec2e60dee3c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.3515358 Nov 09 04:45:09.883283 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-80cc0c5b-4301-4168-8cde-f8d41f319da3 req-bcd83cdb-07ed-4982-88e3-6c397c792591 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-84762297&fields=id&tenant_id=1d10b4824e524068827e58b55e269af3 HTTP/1.1" status: 200 len: 267 time: 0.0459263 Nov 09 04:45:09.998241 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80cc0c5b-4301-4168-8cde-f8d41f319da3 req-bfc3beac-da22-4ccb-8201-bb309a8e96f5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:45:09.999711 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-80cc0c5b-4301-4168-8cde-f8d41f319da3 req-bfc3beac-da22-4ccb-8201-bb309a8e96f5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/networks?id=1dad64b1-0a3e-4b78-a75f-959e3b1e79b8 HTTP/1.1" status: 200 len: 797 time: 0.1087563 Nov 09 04:45:10.015085 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-80cc0c5b-4301-4168-8cde-f8d41f319da3 req-d3451847-35e5-4d71-99e8-d7016bf92dff tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/quotas/1d10b4824e524068827e58b55e269af3 HTTP/1.1" status: 200 len: 375 time: 0.0096078 Nov 09 04:45:10.068737 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-80cc0c5b-4301-4168-8cde-f8d41f319da3 req-4c72e8d6-e18c-4e48-94e6-e96ed2ba4ee4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&fields=id HTTP/1.1" status: 200 len: 394 time: 0.0483296 Nov 09 04:45:10.163288 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-80cc0c5b-4301-4168-8cde-f8d41f319da3 req-f9333a9b-3da4-49f6-8971-d6d00dd76208 service neutron] 10.222.0.24 "GET /v2.0/networks/1dad64b1-0a3e-4b78-a75f-959e3b1e79b8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0814543 Nov 09 04:45:10.255193 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-80cc0c5b-4301-4168-8cde-f8d41f319da3 req-272ddda6-5603-46d9-a088-b89d99af3a65 service neutron] 10.222.0.24 "GET /v2.0/networks/1dad64b1-0a3e-4b78-a75f-959e3b1e79b8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0858274 Nov 09 04:45:10.477024 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-1979cb0c-b1bb-45c3-9298-f94670433598 req-facd1aad-ea15-4085-b6b2-0a01b8228c67 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=632189ac-20cc-43b0-93a1-3d6f9e67628d HTTP/1.1" status: 200 len: 210 time: 0.0259233 Nov 09 04:45:11.384972 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8d87f446-79de-4623-89ea-56a56c507f06 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:11.568839 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fa2d44fa-ded8-4564-b552-a0c203e371bd req-fe09e277-3e3e-4f21-8516-3b06df5adbdf tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=632189ac-20cc-43b0-93a1-3d6f9e67628d HTTP/1.1" status: 200 len: 210 time: 0.0257430 Nov 09 04:45:12.207358 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:12.244537 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80cc0c5b-4301-4168-8cde-f8d41f319da3 req-3e27518e-40c7-4ca5-a05d-b61b5c7e6625 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:45:12.245974 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-80cc0c5b-4301-4168-8cde-f8d41f319da3 req-3e27518e-40c7-4ca5-a05d-b61b5c7e6625 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "GET /v2.0/networks?id=1dad64b1-0a3e-4b78-a75f-959e3b1e79b8 HTTP/1.1" status: 200 len: 797 time: 0.1050289 Nov 09 04:45:12.321725 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-80cc0c5b-4301-4168-8cde-f8d41f319da3 req-57b09a6d-6477-4815-80ed-40b89a2d3759 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=1d10b4824e524068827e58b55e269af3 HTTP/1.1" status: 200 len: 470 time: 0.0663984 Nov 09 04:45:12.332912 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-80cc0c5b-4301-4168-8cde-f8d41f319da3 req-eb3814de-3b20-4afa-bd85-9fda31677f99 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'port': {'device_id': '632189ac-20cc-43b0-93a1-3d6f9e67628d', 'network_id': '1dad64b1-0a3e-4b78-a75f-959e3b1e79b8', 'admin_state_up': True, 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'security_groups': ['0213e3fe-696b-486f-b865-2087043fe0c0']}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:45:12.539613 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-80cc0c5b-4301-4168-8cde-f8d41f319da3 req-eb3814de-3b20-4afa-bd85-9fda31677f99 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Made reservation on behalf of 1d10b4824e524068827e58b55e269af3 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:45:12.543149 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-80cc0c5b-4301-4168-8cde-f8d41f319da3 req-eb3814de-3b20-4afa-bd85-9fda31677f99 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:12.664942 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f6c37e19-16e4-45a6-97bc-6b4c0b2918f6 req-091b78b1-7449-4cb4-a90e-7a98735be977 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=632189ac-20cc-43b0-93a1-3d6f9e67628d HTTP/1.1" status: 200 len: 210 time: 0.0265338 Nov 09 04:45:12.666980 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [req-80cc0c5b-4301-4168-8cde-f8d41f319da3 req-eb3814de-3b20-4afa-bd85-9fda31677f99 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Allocated IP 172.20.0.3 (1dad64b1-0a3e-4b78-a75f-959e3b1e79b8/9e8e346c-8a1f-4dfb-8ad0-e87375cefb67/b27dade5-4101-4abe-bf0e-e385d11c806f) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:45:12.804835 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-80cc0c5b-4301-4168-8cde-f8d41f319da3 req-eb3814de-3b20-4afa-bd85-9fda31677f99 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:12.921386 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-80cc0c5b-4301-4168-8cde-f8d41f319da3 req-eb3814de-3b20-4afa-bd85-9fda31677f99 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:12.965760 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-80cc0c5b-4301-4168-8cde-f8d41f319da3 req-eb3814de-3b20-4afa-bd85-9fda31677f99 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network 1dad64b1-0a3e-4b78-a75f-959e3b1e79b8 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:45:12.970965 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [req-80cc0c5b-4301-4168-8cde-f8d41f319da3 req-eb3814de-3b20-4afa-bd85-9fda31677f99 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:45:12.973390 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-80cc0c5b-4301-4168-8cde-f8d41f319da3 req-eb3814de-3b20-4afa-bd85-9fda31677f99 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:45:13.001646 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb3814de-3b20-4afa-bd85-9fda31677f99 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Port': ['ID=b27dade5-4101-4abe-bf0e-e385d11c806f,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:45:13.027813 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80cc0c5b-4301-4168-8cde-f8d41f319da3 req-eb3814de-3b20-4afa-bd85-9fda31677f99 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:45:13.028423 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-80cc0c5b-4301-4168-8cde-f8d41f319da3 req-eb3814de-3b20-4afa-bd85-9fda31677f99 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:13.112680 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-80cc0c5b-4301-4168-8cde-f8d41f319da3 req-eb3814de-3b20-4afa-bd85-9fda31677f99 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7834206 Nov 09 04:45:13.125283 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-80cc0c5b-4301-4168-8cde-f8d41f319da3 req-53ca655d-70d2-4d7c-9e4c-2a402ac3c47f service neutron] Request body: {'port': {'device_id': '632189ac-20cc-43b0-93a1-3d6f9e67628d', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:45:13.183648 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-80cc0c5b-4301-4168-8cde-f8d41f319da3 req-53ca655d-70d2-4d7c-9e4c-2a402ac3c47f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:13.231580 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-7153bae6-6f36-4e70-a274-993eed41b373 None None] Provisioning complete for port b27dade5-4101-4abe-bf0e-e385d11c806f triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:45:13.232124 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7153bae6-6f36-4e70-a274-993eed41b373 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:13.264221 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-7153bae6-6f36-4e70-a274-993eed41b373 None None] Port b27dade5-4101-4abe-bf0e-e385d11c806f cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:45:13.437955 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [req-80cc0c5b-4301-4168-8cde-f8d41f319da3 req-53ca655d-70d2-4d7c-9e4c-2a402ac3c47f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b27dade5-4101-4abe-bf0e-e385d11c806f {{(pid=102162) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:45:13.445426 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-80cc0c5b-4301-4168-8cde-f8d41f319da3 req-53ca655d-70d2-4d7c-9e4c-2a402ac3c47f service neutron] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:13.457058 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.provisioning_blocks [req-80cc0c5b-4301-4168-8cde-f8d41f319da3 req-53ca655d-70d2-4d7c-9e4c-2a402ac3c47f service neutron] Transition to ACTIVE for port object b27dade5-4101-4abe-bf0e-e385d11c806f will not be triggered until provisioned by entity L2. {{(pid=102162) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 09 04:45:13.516291 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-80cc0c5b-4301-4168-8cde-f8d41f319da3 req-53ca655d-70d2-4d7c-9e4c-2a402ac3c47f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:13.570781 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53ca655d-70d2-4d7c-9e4c-2a402ac3c47f service neutron] Pushing event updated for resources: {'Port': ['ID=b27dade5-4101-4abe-bf0e-e385d11c806f,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:45:13.640108 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-80cc0c5b-4301-4168-8cde-f8d41f319da3 req-53ca655d-70d2-4d7c-9e4c-2a402ac3c47f service neutron] Attempting to bind port b27dade5-4101-4abe-bf0e-e385d11c806f on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:45:13.640437 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-80cc0c5b-4301-4168-8cde-f8d41f319da3 req-53ca655d-70d2-4d7c-9e4c-2a402ac3c47f service neutron] Attempting to bind port b27dade5-4101-4abe-bf0e-e385d11c806f by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '9b73abc7-7651-4376-845b-e3dd90806c31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '1dad64b1-0a3e-4b78-a75f-959e3b1e79b8'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:45:13.640763 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-80cc0c5b-4301-4168-8cde-f8d41f319da3 req-53ca655d-70d2-4d7c-9e4c-2a402ac3c47f service neutron] Attempting to bind port b27dade5-4101-4abe-bf0e-e385d11c806f on network 1dad64b1-0a3e-4b78-a75f-959e3b1e79b8 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:45:13.645416 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-80cc0c5b-4301-4168-8cde-f8d41f319da3 req-53ca655d-70d2-4d7c-9e4c-2a402ac3c47f service neutron] Port b27dade5-4101-4abe-bf0e-e385d11c806f on network 1dad64b1-0a3e-4b78-a75f-959e3b1e79b8 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:45:13.645734 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-80cc0c5b-4301-4168-8cde-f8d41f319da3 req-53ca655d-70d2-4d7c-9e4c-2a402ac3c47f service neutron] Attempting to bind port b27dade5-4101-4abe-bf0e-e385d11c806f on network 1dad64b1-0a3e-4b78-a75f-959e3b1e79b8 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:45:13.651732 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-80cc0c5b-4301-4168-8cde-f8d41f319da3 req-53ca655d-70d2-4d7c-9e4c-2a402ac3c47f service neutron] Checking agent: {'id': '7d36b884-4ad2-4878-9464-bf647030b544', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'started_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 45, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:45:13.652066 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-80cc0c5b-4301-4168-8cde-f8d41f319da3 req-53ca655d-70d2-4d7c-9e4c-2a402ac3c47f service neutron] Checking segment: {'id': '9b73abc7-7651-4376-845b-e3dd90806c31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '1dad64b1-0a3e-4b78-a75f-959e3b1e79b8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:45:13.652457 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-80cc0c5b-4301-4168-8cde-f8d41f319da3 req-53ca655d-70d2-4d7c-9e4c-2a402ac3c47f service neutron] Bound using segment: {'id': '9b73abc7-7651-4376-845b-e3dd90806c31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '1dad64b1-0a3e-4b78-a75f-959e3b1e79b8'} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:45:13.652883 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-80cc0c5b-4301-4168-8cde-f8d41f319da3 req-53ca655d-70d2-4d7c-9e4c-2a402ac3c47f service neutron] Bound port: b27dade5-4101-4abe-bf0e-e385d11c806f, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '9b73abc7-7651-4376-845b-e3dd90806c31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '1dad64b1-0a3e-4b78-a75f-959e3b1e79b8'}}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:45:13.653234 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-80cc0c5b-4301-4168-8cde-f8d41f319da3 req-53ca655d-70d2-4d7c-9e4c-2a402ac3c47f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:13.715752 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-91c00aea-167f-41bb-8ccb-7eaf2e17d881 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:13.722920 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-80cc0c5b-4301-4168-8cde-f8d41f319da3 req-53ca655d-70d2-4d7c-9e4c-2a402ac3c47f service neutron] For port b27dade5-4101-4abe-bf0e-e385d11c806f, host hv-neutron-8168, cleared binding levels {{(pid=102162) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:45:13.726225 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-80cc0c5b-4301-4168-8cde-f8d41f319da3 req-53ca655d-70d2-4d7c-9e4c-2a402ac3c47f service neutron] For port b27dade5-4101-4abe-bf0e-e385d11c806f, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=b27dade5-4101-4abe-bf0e-e385d11c806f,segment=NetworkSegment(9b73abc7-7651-4376-845b-e3dd90806c31),segment_id=9b73abc7-7651-4376-845b-e3dd90806c31)] {{(pid=102162) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:45:13.787497 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-079a2684-d2b6-4daa-99ed-64dafece96bd req-b025a577-831d-4589-a961-bf9fa9e5443c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:45:13.788981 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-079a2684-d2b6-4daa-99ed-64dafece96bd req-b025a577-831d-4589-a961-bf9fa9e5443c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=632189ac-20cc-43b0-93a1-3d6f9e67628d HTTP/1.1" status: 200 len: 943 time: 0.0506148 Nov 09 04:45:13.790477 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-80cc0c5b-4301-4168-8cde-f8d41f319da3 req-53ca655d-70d2-4d7c-9e4c-2a402ac3c47f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:13.838303 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80cc0c5b-4301-4168-8cde-f8d41f319da3 req-53ca655d-70d2-4d7c-9e4c-2a402ac3c47f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:45:13.838937 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-80cc0c5b-4301-4168-8cde-f8d41f319da3 req-53ca655d-70d2-4d7c-9e4c-2a402ac3c47f service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:13.840292 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-80cc0c5b-4301-4168-8cde-f8d41f319da3 req-53ca655d-70d2-4d7c-9e4c-2a402ac3c47f service neutron] 10.222.0.26 "PUT /v2.0/ports/b27dade5-4101-4abe-bf0e-e385d11c806f HTTP/1.1" status: 200 len: 1093 time: 0.7196066 Nov 09 04:45:13.842302 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '632189ac-20cc-43b0-93a1-3d6f9e67628d', 'tag': 'b27dade5-4101-4abe-bf0e-e385d11c806f'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:45:13.844574 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-26bf6e1b-4677-44f5-a289-44ebb0a5664d" -d '{"events": [{"name": "network-changed", "server_uuid": "632189ac-20cc-43b0-93a1-3d6f9e67628d", "tag": "b27dade5-4101-4abe-bf0e-e385d11c806f"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:45:13.878563 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53ca655d-70d2-4d7c-9e4c-2a402ac3c47f service neutron] Pushing event updated for resources: {'Port': ['ID=b27dade5-4101-4abe-bf0e-e385d11c806f,revision_number=3']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:45:13.902258 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:45:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8536710f-d7cd-4f2b-9ab4-3805a3cf3745 x-openstack-request-id: req-8536710f-d7cd-4f2b-9ab4-3805a3cf3745 {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:45:13.902576 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "632189ac-20cc-43b0-93a1-3d6f9e67628d", "tag": "b27dade5-4101-4abe-bf0e-e385d11c806f", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:45:13.902830 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-8536710f-d7cd-4f2b-9ab4-3805a3cf3745 {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:45:13.903224 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '632189ac-20cc-43b0-93a1-3d6f9e67628d', 'tag': 'b27dade5-4101-4abe-bf0e-e385d11c806f', 'status': 'completed', 'code': 200} Nov 09 04:45:13.909113 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-079a2684-d2b6-4daa-99ed-64dafece96bd req-e251ee15-417a-4896-89f3-e5ab56e034b1 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=0213e3fe-696b-486f-b865-2087043fe0c0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1131864 Nov 09 04:45:13.956242 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26bf6e1b-4677-44f5-a289-44ebb0a5664d req-475d1de5-5802-4897-bfc7-23737bff72b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:45:13.957634 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-26bf6e1b-4677-44f5-a289-44ebb0a5664d req-475d1de5-5802-4897-bfc7-23737bff72b6 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&device_id=632189ac-20cc-43b0-93a1-3d6f9e67628d HTTP/1.1" status: 200 len: 1096 time: 0.0425074 Nov 09 04:45:14.074380 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26bf6e1b-4677-44f5-a289-44ebb0a5664d req-c3850906-8d9c-4394-bf75-5c6bb51a2f7d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:45:14.075879 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-26bf6e1b-4677-44f5-a289-44ebb0a5664d req-c3850906-8d9c-4394-bf75-5c6bb51a2f7d service neutron] 10.222.0.26 "GET /v2.0/networks?tenant_id=1d10b4824e524068827e58b55e269af3&shared=False HTTP/1.1" status: 200 len: 898 time: 0.0970902 Nov 09 04:45:14.169855 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26bf6e1b-4677-44f5-a289-44ebb0a5664d req-0955913e-8a3d-45e6-ae51-9e248a5f66f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:45:14.171413 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-26bf6e1b-4677-44f5-a289-44ebb0a5664d req-0955913e-8a3d-45e6-ae51-9e248a5f66f4 service neutron] 10.222.0.26 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0876782 Nov 09 04:45:14.252414 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80cc0c5b-4301-4168-8cde-f8d41f319da3 req-1f8ddb1a-2aa2-4d46-887e-eb4d3d05c381 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:45:14.253796 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-80cc0c5b-4301-4168-8cde-f8d41f319da3 req-1f8ddb1a-2aa2-4d46-887e-eb4d3d05c381 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&device_id=632189ac-20cc-43b0-93a1-3d6f9e67628d HTTP/1.1" status: 200 len: 1096 time: 0.0433676 Nov 09 04:45:14.295199 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-80cc0c5b-4301-4168-8cde-f8d41f319da3 req-43eece6f-374d-4472-8e7f-694f8dd7c8e4 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=b27dade5-4101-4abe-bf0e-e385d11c806f HTTP/1.1" status: 200 len: 217 time: 0.0330701 Nov 09 04:45:14.342390 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80cc0c5b-4301-4168-8cde-f8d41f319da3 req-3c6420bc-eb2d-4369-bd1b-ea405f912d2a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:45:14.343813 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-80cc0c5b-4301-4168-8cde-f8d41f319da3 req-3c6420bc-eb2d-4369-bd1b-ea405f912d2a service neutron] 10.222.0.26 "GET /v2.0/subnets?id=9e8e346c-8a1f-4dfb-8ad0-e87375cefb67 HTTP/1.1" status: 200 len: 834 time: 0.0412958 Nov 09 04:45:14.390787 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80cc0c5b-4301-4168-8cde-f8d41f319da3 req-2cdeb5e9-c6cf-4453-8e51-172ed2208648 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:45:14.392274 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-80cc0c5b-4301-4168-8cde-f8d41f319da3 req-2cdeb5e9-c6cf-4453-8e51-172ed2208648 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=1dad64b1-0a3e-4b78-a75f-959e3b1e79b8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0411179 Nov 09 04:45:14.479758 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-80cc0c5b-4301-4168-8cde-f8d41f319da3 req-4cd67277-8f0a-4dd9-8454-0f640f99ddee service neutron] 10.222.0.26 "GET /v2.0/networks/1dad64b1-0a3e-4b78-a75f-959e3b1e79b8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0798476 Nov 09 04:45:14.571240 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-80cc0c5b-4301-4168-8cde-f8d41f319da3 req-264997d9-2461-47d4-977d-0cd2b17f2e83 service neutron] 10.222.0.26 "GET /v2.0/networks/1dad64b1-0a3e-4b78-a75f-959e3b1e79b8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0831501 Nov 09 04:45:15.031527 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6807436a-b87d-410e-9c4a-7ac20066a241 req-d7b3a88a-b28f-48b4-bfdf-c280c92c0f13 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:45:15.032989 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-6807436a-b87d-410e-9c4a-7ac20066a241 req-d7b3a88a-b28f-48b4-bfdf-c280c92c0f13 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=632189ac-20cc-43b0-93a1-3d6f9e67628d HTTP/1.1" status: 200 len: 943 time: 0.0502312 Nov 09 04:45:15.082402 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-6807436a-b87d-410e-9c4a-7ac20066a241 req-cefeb21d-c84e-4476-a14a-9c2fa2eef0ee tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=0213e3fe-696b-486f-b865-2087043fe0c0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0433676 Nov 09 04:45:15.111137 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:16.195128 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-244b4b12-f0a8-46ca-9e7f-9580cdd8b798 req-fb41227a-4edd-4f73-9846-f399eed8e2bc tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:45:16.196477 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-244b4b12-f0a8-46ca-9e7f-9580cdd8b798 req-fb41227a-4edd-4f73-9846-f399eed8e2bc tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=632189ac-20cc-43b0-93a1-3d6f9e67628d HTTP/1.1" status: 200 len: 943 time: 0.0484269 Nov 09 04:45:16.244546 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-244b4b12-f0a8-46ca-9e7f-9580cdd8b798 req-8671573a-4939-43f7-881a-05e739f4f46b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=0213e3fe-696b-486f-b865-2087043fe0c0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0415552 Nov 09 04:45:16.487829 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:16.990843 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:17.360211 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-188ed8ee-5bf8-407a-af8b-a712e0d575e9 req-99b7f6f9-ca64-432f-b86e-e15bc51ec4e2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:45:17.361671 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-188ed8ee-5bf8-407a-af8b-a712e0d575e9 req-99b7f6f9-ca64-432f-b86e-e15bc51ec4e2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=632189ac-20cc-43b0-93a1-3d6f9e67628d HTTP/1.1" status: 200 len: 943 time: 0.0479827 Nov 09 04:45:17.409563 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-188ed8ee-5bf8-407a-af8b-a712e0d575e9 req-a7712a86-863c-4d7c-94c7-a52d2c690d05 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=0213e3fe-696b-486f-b865-2087043fe0c0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0419605 Nov 09 04:45:17.578060 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device b27dade5-4101-4abe-bf0e-e385d11c806f details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=102163) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 09 04:45:17.669593 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port b27dade5-4101-4abe-bf0e-e385d11c806f, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=b27dade5-4101-4abe-bf0e-e385d11c806f,segment=NetworkSegment(9b73abc7-7651-4376-845b-e3dd90806c31),segment_id=9b73abc7-7651-4376-845b-e3dd90806c31)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:45:17.683991 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Returning: {'device': 'b27dade5-4101-4abe-bf0e-e385d11c806f', 'network_id': '1dad64b1-0a3e-4b78-a75f-959e3b1e79b8', 'port_id': 'b27dade5-4101-4abe-bf0e-e385d11c806f', 'mac_address': 'fa:16:3e:9f:04:60', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 336, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '9e8e346c-8a1f-4dfb-8ad0-e87375cefb67', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102163) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 09 04:45:17.720311 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:17.732581 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b27dade5-4101-4abe-bf0e-e385d11c806f {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:45:17.751086 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port b27dade5-4101-4abe-bf0e-e385d11c806f, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=b27dade5-4101-4abe-bf0e-e385d11c806f,segment=NetworkSegment(9b73abc7-7651-4376-845b-e3dd90806c31),segment_id=9b73abc7-7651-4376-845b-e3dd90806c31)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:45:17.835228 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:17.880080 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=b27dade5-4101-4abe-bf0e-e385d11c806f,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:45:18.040821 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['b27dade5-4101-4abe-bf0e-e385d11c806f'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 04:45:18.519583 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d855fab-a5d0-4650-a917-88540ae1278e req-a247e2fd-6bac-4e2e-a4a8-f53009d43ec5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:45:18.521042 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3d855fab-a5d0-4650-a917-88540ae1278e req-a247e2fd-6bac-4e2e-a4a8-f53009d43ec5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=632189ac-20cc-43b0-93a1-3d6f9e67628d HTTP/1.1" status: 200 len: 944 time: 0.0458055 Nov 09 04:45:18.573455 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3d855fab-a5d0-4650-a917-88540ae1278e req-9a6c3dec-6ae8-4f19-a9ab-0ab7721a7b04 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=0213e3fe-696b-486f-b865-2087043fe0c0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0458858 Nov 09 04:45:19.581741 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device b27dade5-4101-4abe-bf0e-e385d11c806f up at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:45:19.689434 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17761f06-8b99-43eb-bb49-809371cdc2dd req-85fd2166-d9f8-4563-a002-ede59bb1b556 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:45:19.690953 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-17761f06-8b99-43eb-bb49-809371cdc2dd req-85fd2166-d9f8-4563-a002-ede59bb1b556 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=632189ac-20cc-43b0-93a1-3d6f9e67628d HTTP/1.1" status: 200 len: 944 time: 0.0509694 Nov 09 04:45:19.704963 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning for port b27dade5-4101-4abe-bf0e-e385d11c806f completed by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 09 04:45:19.709112 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning complete for port b27dade5-4101-4abe-bf0e-e385d11c806f triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:45:19.709480 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:19.739863 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-17761f06-8b99-43eb-bb49-809371cdc2dd req-3f7ac7b5-867f-4c3f-8452-3cae4ac6fa63 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=0213e3fe-696b-486f-b865-2087043fe0c0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0429287 Nov 09 04:45:19.791374 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:19.812232 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '632189ac-20cc-43b0-93a1-3d6f9e67628d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b27dade5-4101-4abe-bf0e-e385d11c806f'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:45:19.814424 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fc973750-9c5f-4467-8ec3-c4d54edbd060" -d '{"events": [{"server_uuid": "632189ac-20cc-43b0-93a1-3d6f9e67628d", "name": "network-vif-plugged", "status": "completed", "tag": "b27dade5-4101-4abe-bf0e-e385d11c806f"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:45:19.826606 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port b27dade5-4101-4abe-bf0e-e385d11c806f, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=b27dade5-4101-4abe-bf0e-e385d11c806f,segment=NetworkSegment(9b73abc7-7651-4376-845b-e3dd90806c31),segment_id=9b73abc7-7651-4376-845b-e3dd90806c31)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:45:19.851013 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:45:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b0d3c541-c78e-4956-858a-8c280c7db1f3 x-openstack-request-id: req-b0d3c541-c78e-4956-858a-8c280c7db1f3 {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:45:19.851294 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "632189ac-20cc-43b0-93a1-3d6f9e67628d", "name": "network-vif-plugged", "status": "completed", "tag": "b27dade5-4101-4abe-bf0e-e385d11c806f", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:45:19.851540 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-b0d3c541-c78e-4956-858a-8c280c7db1f3 {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:45:19.851920 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '632189ac-20cc-43b0-93a1-3d6f9e67628d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b27dade5-4101-4abe-bf0e-e385d11c806f', 'code': 200} Nov 09 04:45:19.898205 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:19.949422 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=b27dade5-4101-4abe-bf0e-e385d11c806f,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:45:20.173144 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8715d078-deaa-474f-aa62-9502641d8056 req-1c7ea47c-3480-4a19-9b11-c535878b810d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:45:20.174642 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8715d078-deaa-474f-aa62-9502641d8056 req-1c7ea47c-3480-4a19-9b11-c535878b810d service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=632189ac-20cc-43b0-93a1-3d6f9e67628d HTTP/1.1" status: 200 len: 1098 time: 0.0372725 Nov 09 04:45:20.218948 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8715d078-deaa-474f-aa62-9502641d8056 req-833ffc0a-6895-42f6-9182-383704d4e5e6 service neutron] 10.222.0.26 "GET /v2.0/security-groups?id=0213e3fe-696b-486f-b865-2087043fe0c0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0372159 Nov 09 04:45:20.853460 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63ba8e2f-20e7-4de5-82fa-90938860aba5 req-8690742c-22c8-48ed-b32c-736449364505 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:45:20.856401 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-63ba8e2f-20e7-4de5-82fa-90938860aba5 req-8690742c-22c8-48ed-b32c-736449364505 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=632189ac-20cc-43b0-93a1-3d6f9e67628d HTTP/1.1" status: 200 len: 945 time: 0.0499873 Nov 09 04:45:20.920975 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-63ba8e2f-20e7-4de5-82fa-90938860aba5 req-7b7b5f43-1d40-47ab-987e-c9c75aa4bec3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=0213e3fe-696b-486f-b865-2087043fe0c0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0579097 Nov 09 04:45:22.035901 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-132b2219-e997-4e5b-a9c7-99ad366de2c5 req-b9c78786-cce0-49e2-ac3e-fe38cc6c6ae0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:45:22.037349 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-132b2219-e997-4e5b-a9c7-99ad366de2c5 req-b9c78786-cce0-49e2-ac3e-fe38cc6c6ae0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=632189ac-20cc-43b0-93a1-3d6f9e67628d HTTP/1.1" status: 200 len: 945 time: 0.0481505 Nov 09 04:45:22.086399 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-132b2219-e997-4e5b-a9c7-99ad366de2c5 req-48c2b046-776e-41e5-90ea-7cffb5c47ef6 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=0213e3fe-696b-486f-b865-2087043fe0c0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0431306 Nov 09 04:45:22.197321 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9430b3e-89c3-46ca-9021-8270ab3248f5 req-5a17e6f4-0e3b-481d-9d47-91e33ca95347 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:45:22.198702 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c9430b3e-89c3-46ca-9021-8270ab3248f5 req-5a17e6f4-0e3b-481d-9d47-91e33ca95347 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=632189ac-20cc-43b0-93a1-3d6f9e67628d HTTP/1.1" status: 200 len: 945 time: 0.0471547 Nov 09 04:45:22.249917 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c9430b3e-89c3-46ca-9021-8270ab3248f5 req-3d2f89ab-c5f5-4765-beba-26ecddde9344 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=0213e3fe-696b-486f-b865-2087043fe0c0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0454276 Nov 09 04:45:22.271217 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 33160) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:45:22.308167 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4dde2c47-dd5a-4bbd-8f91-8300f9f1404e tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:45:22.309616 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-4dde2c47-dd5a-4bbd-8f91-8300f9f1404e tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/ports?device_id=632189ac-20cc-43b0-93a1-3d6f9e67628d HTTP/1.1" status: 200 len: 1093 time: 0.0374317 Nov 09 04:45:22.312458 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 33162) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:45:22.316556 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-d2acb539-803f-408b-a898-2c2307d7ae4d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'floatingip': {'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'port_id': 'b27dade5-4101-4abe-bf0e-e385d11c806f', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ip_address': '172.20.0.3'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:45:22.390562 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d2acb539-803f-408b-a898-2c2307d7ae4d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for floatingip, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:22.481336 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d2acb539-803f-408b-a898-2c2307d7ae4d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:22.582516 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-d2acb539-803f-408b-a898-2c2307d7ae4d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Allocated IP 172.26.0.26 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/53ee7b9f-878b-4d38-b69c-32d196af3e05) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:45:22.677972 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d2acb539-803f-408b-a898-2c2307d7ae4d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:22.762532 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d2acb539-803f-408b-a898-2c2307d7ae4d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:22.796765 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d2acb539-803f-408b-a898-2c2307d7ae4d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:45:22.800951 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-d2acb539-803f-408b-a898-2c2307d7ae4d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:45:22.803351 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d2acb539-803f-408b-a898-2c2307d7ae4d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:45:22.832129 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2acb539-803f-408b-a898-2c2307d7ae4d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Port': ['ID=53ee7b9f-878b-4d38-b69c-32d196af3e05,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:45:23.157745 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d2acb539-803f-408b-a898-2c2307d7ae4d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:23.290717 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d2acb539-803f-408b-a898-2c2307d7ae4d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:23.441101 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d2acb539-803f-408b-a898-2c2307d7ae4d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:23.487302 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d2acb539-803f-408b-a898-2c2307d7ae4d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:23.557725 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2acb539-803f-408b-a898-2c2307d7ae4d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Port': ['ID=53ee7b9f-878b-4d38-b69c-32d196af3e05,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:45:23.565238 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d2acb539-803f-408b-a898-2c2307d7ae4d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:23.662629 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.l3_db [None req-d2acb539-803f-408b-a898-2c2307d7ae4d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Floating IP b9c98577-89c7-42a4-a4d8-c86df2f91932 associated. External IP: 172.26.0.26, port: b27dade5-4101-4abe-bf0e-e385d11c806f. Nov 09 04:45:23.869609 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d2acb539-803f-408b-a898-2c2307d7ae4d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Router ab3c88d0-a531-409f-8b0b-c18b0761c90a has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:45:23.975137 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d2acb539-803f-408b-a898-2c2307d7ae4d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:45:23.985037 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8a15afba-4c24-4581-9a96-0fe9afc5259e None None] Sync routers for ids ['ab3c88d0-a531-409f-8b0b-c18b0761c90a'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:45:23.995738 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8a15afba-4c24-4581-9a96-0fe9afc5259e None None] Routers {'ab3c88d0-a531-409f-8b0b-c18b0761c90a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:45:23.996364 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-8a15afba-4c24-4581-9a96-0fe9afc5259e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:45:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['ab3c88d0-a531-409f-8b0b-c18b0761c90a'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:45:24.093999 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d2acb539-803f-408b-a898-2c2307d7ae4d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:24.100456 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-8a15afba-4c24-4581-9a96-0fe9afc5259e None None] Set router ab3c88d0-a531-409f-8b0b-c18b0761c90a gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:45:24.134460 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-d2acb539-803f-408b-a898-2c2307d7ae4d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 1.8085063 Nov 09 04:45:24.134460 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '632189ac-20cc-43b0-93a1-3d6f9e67628d', 'tag': 'b27dade5-4101-4abe-bf0e-e385d11c806f'}] {{(pid=102161) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:45:24.134460 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}99dfdda0def497b4372884ef2eb87f06b1e425c8eba5ceda5f64bbab037a07d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-af1c36dc-b203-4b5e-8bc7-942cbc14daaa" -d '{"events": [{"name": "network-changed", "server_uuid": "632189ac-20cc-43b0-93a1-3d6f9e67628d", "tag": "b27dade5-4101-4abe-bf0e-e385d11c806f"}]}' {{(pid=102161) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:45:24.162674 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:45:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b19adc69-e862-4c4e-83f1-33163e507446 x-openstack-request-id: req-b19adc69-e862-4c4e-83f1-33163e507446 {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:45:24.162967 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "632189ac-20cc-43b0-93a1-3d6f9e67628d", "tag": "b27dade5-4101-4abe-bf0e-e385d11c806f", "status": "completed", "code": 200}]} {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:45:24.163221 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-b19adc69-e862-4c4e-83f1-33163e507446 {{(pid=102161) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:45:24.163627 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '632189ac-20cc-43b0-93a1-3d6f9e67628d', 'tag': 'b27dade5-4101-4abe-bf0e-e385d11c806f', 'status': 'completed', 'code': 200} Nov 09 04:45:24.229465 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af1c36dc-b203-4b5e-8bc7-942cbc14daaa req-b9868c9a-49af-4609-8ab4-4d2ca097743d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:45:24.230953 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-af1c36dc-b203-4b5e-8bc7-942cbc14daaa req-b9868c9a-49af-4609-8ab4-4d2ca097743d service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&device_id=632189ac-20cc-43b0-93a1-3d6f9e67628d HTTP/1.1" status: 200 len: 1098 time: 0.0426404 Nov 09 04:45:24.319807 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af1c36dc-b203-4b5e-8bc7-942cbc14daaa req-20f086eb-2517-46cc-8777-acc6d05ad312 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:45:24.321769 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-af1c36dc-b203-4b5e-8bc7-942cbc14daaa req-20f086eb-2517-46cc-8777-acc6d05ad312 service neutron] 10.222.0.26 "GET /v2.0/networks?id=1dad64b1-0a3e-4b78-a75f-959e3b1e79b8 HTTP/1.1" status: 200 len: 898 time: 0.0822020 Nov 09 04:45:24.323081 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-8a15afba-4c24-4581-9a96-0fe9afc5259e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'name': 'tempest-TestNetworkBasicOps-router-636046836', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.161'}], 'enable_snat': True}, 'gw_port_id': '8e2fba8e-7861-42b3-9f71-2ef66b096ca7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:44:41Z', 'updated_at': '2021-11-09T04:44:46Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '8e2fba8e-7861-42b3-9f71-2ef66b096ca7', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:d4:05:cb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1477, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.161', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:44:41Z', 'updated_at': '2021-11-09T04:44:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '9b4594ad-5ede-4f40-a4be-03b43f0db565', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'floating_ip_address': '172.26.0.20', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'port_id': '9dea4e93-eac2-4ff4-bd09-131010862731', 'fixed_ip_address': '172.20.0.9', 'status': 'ACTIVE', 'standard_attr_id': 1492, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '1dad64b1-0a3e-4b78-a75f-959e3b1e79b8', 'mac_address': 'fa:16:3e:5e:61:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f9ab492e-61b2-4203-af63-a2280af93fd1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:45:05Z', 'updated_at': '2021-11-09T04:45:08Z', 'revision_number': 1, 'project_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ip_address_scope': None}, {'id': 'b9c98577-89c7-42a4-a4d8-c86df2f91932', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'floating_ip_address': '172.26.0.26', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'port_id': 'b27dade5-4101-4abe-bf0e-e385d11c806f', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 1504, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '1dad64b1-0a3e-4b78-a75f-959e3b1e79b8', 'mac_address': 'fa:16:3e:9f:04:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '632189ac-20cc-43b0-93a1-3d6f9e67628d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:45:23Z', 'updated_at': '2021-11-09T04:45:23Z', 'revision_number': 0, 'project_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1307a903-74ab-4faf-8993-e69fd7140798', 'name': '', 'network_id': '1dad64b1-0a3e-4b78-a75f-959e3b1e79b8', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:f7:0c:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1480, 'fixed_ips': [{'subnet_id': '9e8e346c-8a1f-4dfb-8ad0-e87375cefb67', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:44:46Z', 'updated_at': '2021-11-09T04:44:50Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '9e8e346c-8a1f-4dfb-8ad0-e87375cefb67', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:45:24.354055 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8a15afba-4c24-4581-9a96-0fe9afc5259e None None] Checking router: ab3c88d0-a531-409f-8b0b-c18b0761c90a for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:45:24.365928 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8a15afba-4c24-4581-9a96-0fe9afc5259e None None] Routers {'ab3c88d0-a531-409f-8b0b-c18b0761c90a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:45:24.366564 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-8a15afba-4c24-4581-9a96-0fe9afc5259e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:45:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['ab3c88d0-a531-409f-8b0b-c18b0761c90a'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:45:24.391621 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-af1c36dc-b203-4b5e-8bc7-942cbc14daaa req-9f883dea-6da5-4dc6-9b72-6915f96c7f33 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=b27dade5-4101-4abe-bf0e-e385d11c806f HTTP/1.1" status: 200 len: 998 time: 0.0621817 Nov 09 04:45:24.440909 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af1c36dc-b203-4b5e-8bc7-942cbc14daaa req-0d026cab-d091-4fd2-9c23-02052d506e21 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:45:24.442339 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-af1c36dc-b203-4b5e-8bc7-942cbc14daaa req-0d026cab-d091-4fd2-9c23-02052d506e21 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=9e8e346c-8a1f-4dfb-8ad0-e87375cefb67 HTTP/1.1" status: 200 len: 834 time: 0.0432305 Nov 09 04:45:24.473885 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-8a15afba-4c24-4581-9a96-0fe9afc5259e None None] Set router ab3c88d0-a531-409f-8b0b-c18b0761c90a gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:45:24.492728 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af1c36dc-b203-4b5e-8bc7-942cbc14daaa req-aeb9b358-6b9c-4fd1-9776-30732711f53e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:45:24.494761 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-af1c36dc-b203-4b5e-8bc7-942cbc14daaa req-aeb9b358-6b9c-4fd1-9776-30732711f53e service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=1dad64b1-0a3e-4b78-a75f-959e3b1e79b8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0384333 Nov 09 04:45:24.587058 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-af1c36dc-b203-4b5e-8bc7-942cbc14daaa req-e7691517-dc9c-4e81-9f23-d18422b90cf4 service neutron] 10.222.0.26 "GET /v2.0/networks/1dad64b1-0a3e-4b78-a75f-959e3b1e79b8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0845342 Nov 09 04:45:24.676883 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-af1c36dc-b203-4b5e-8bc7-942cbc14daaa req-9cd5623f-5739-4b8d-9f96-0d3934be916d service neutron] 10.222.0.26 "GET /v2.0/networks/1dad64b1-0a3e-4b78-a75f-959e3b1e79b8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0815549 Nov 09 04:45:24.695716 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-8a15afba-4c24-4581-9a96-0fe9afc5259e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'name': 'tempest-TestNetworkBasicOps-router-636046836', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.161'}], 'enable_snat': True}, 'gw_port_id': '8e2fba8e-7861-42b3-9f71-2ef66b096ca7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:44:41Z', 'updated_at': '2021-11-09T04:44:46Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '8e2fba8e-7861-42b3-9f71-2ef66b096ca7', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:d4:05:cb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1477, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.161', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:44:41Z', 'updated_at': '2021-11-09T04:44:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '9b4594ad-5ede-4f40-a4be-03b43f0db565', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'floating_ip_address': '172.26.0.20', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'port_id': '9dea4e93-eac2-4ff4-bd09-131010862731', 'fixed_ip_address': '172.20.0.9', 'status': 'ACTIVE', 'standard_attr_id': 1492, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '1dad64b1-0a3e-4b78-a75f-959e3b1e79b8', 'mac_address': 'fa:16:3e:5e:61:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f9ab492e-61b2-4203-af63-a2280af93fd1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:45:05Z', 'updated_at': '2021-11-09T04:45:08Z', 'revision_number': 1, 'project_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ip_address_scope': None}, {'id': 'b9c98577-89c7-42a4-a4d8-c86df2f91932', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'floating_ip_address': '172.26.0.26', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'port_id': 'b27dade5-4101-4abe-bf0e-e385d11c806f', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 1504, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '1dad64b1-0a3e-4b78-a75f-959e3b1e79b8', 'mac_address': 'fa:16:3e:9f:04:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '632189ac-20cc-43b0-93a1-3d6f9e67628d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:45:23Z', 'updated_at': '2021-11-09T04:45:23Z', 'revision_number': 0, 'project_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1307a903-74ab-4faf-8993-e69fd7140798', 'name': '', 'network_id': '1dad64b1-0a3e-4b78-a75f-959e3b1e79b8', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:f7:0c:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1480, 'fixed_ips': [{'subnet_id': '9e8e346c-8a1f-4dfb-8ad0-e87375cefb67', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:44:46Z', 'updated_at': '2021-11-09T04:44:50Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '9e8e346c-8a1f-4dfb-8ad0-e87375cefb67', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:45:24.722209 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8a15afba-4c24-4581-9a96-0fe9afc5259e None None] The sync data for ids ['ab3c88d0-a531-409f-8b0b-c18b0761c90a'] in dv-neutron-816802-2-hyperv is: [{'id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'name': 'tempest-TestNetworkBasicOps-router-636046836', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.161'}], 'enable_snat': True}, 'gw_port_id': '8e2fba8e-7861-42b3-9f71-2ef66b096ca7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:44:41Z', 'updated_at': '2021-11-09T04:44:46Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '8e2fba8e-7861-42b3-9f71-2ef66b096ca7', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:d4:05:cb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1477, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.161', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:44:41Z', 'updated_at': '2021-11-09T04:44:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '9b4594ad-5ede-4f40-a4be-03b43f0db565', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'floating_ip_address': '172.26.0.20', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'port_id': '9dea4e93-eac2-4ff4-bd09-131010862731', 'fixed_ip_address': '172.20.0.9', 'status': 'ACTIVE', 'standard_attr_id': 1492, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '1dad64b1-0a3e-4b78-a75f-959e3b1e79b8', 'mac_address': 'fa:16:3e:5e:61:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f9ab492e-61b2-4203-af63-a2280af93fd1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:45:05Z', 'updated_at': '2021-11-09T04:45:08Z', 'revision_number': 1, 'project_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ip_address_scope': None}, {'id': 'b9c98577-89c7-42a4-a4d8-c86df2f91932', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'floating_ip_address': '172.26.0.26', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'port_id': 'b27dade5-4101-4abe-bf0e-e385d11c806f', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 1504, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '1dad64b1-0a3e-4b78-a75f-959e3b1e79b8', 'mac_address': 'fa:16:3e:9f:04:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '632189ac-20cc-43b0-93a1-3d6f9e67628d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:45:23Z', 'updated_at': '2021-11-09T04:45:23Z', 'revision_number': 0, 'project_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1307a903-74ab-4faf-8993-e69fd7140798', 'name': '', 'network_id': '1dad64b1-0a3e-4b78-a75f-959e3b1e79b8', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:f7:0c:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1480, 'fixed_ips': [{'subnet_id': '9e8e346c-8a1f-4dfb-8ad0-e87375cefb67', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:44:46Z', 'updated_at': '2021-11-09T04:44:50Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '9e8e346c-8a1f-4dfb-8ad0-e87375cefb67', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:45:24.897380 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-227af054-bfde-4afe-ab78-9cf4e1ada93a None None] New status for floating IP b9c98577-89c7-42a4-a4d8-c86df2f91932: ACTIVE {{(pid=102163) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 04:45:33.465001 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:45:41.378035 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9dc5ae06-53ee-4695-a210-7a9c8b2c7dd7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:42.229704 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:43.703662 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d064ba6a-26a1-4704-9034-a5dc35d27d48 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:45.120842 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:46.452257 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:45:46.971151 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:00.441008 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 33180) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:46:00.503272 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-80d7296a-badc-49f5-baaa-9b11b2614b0e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/floatingips/9b4594ad-5ede-4f40-a4be-03b43f0db565 HTTP/1.1" status: 200 len: 992 time: 0.0611515 Nov 09 04:46:01.315943 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-da3e6579-1bc6-4a72-b14b-fc3997cc7a23 req-02434678-39ed-43fd-8248-1b9ebcf431bb service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=f9ab492e-61b2-4203-af63-a2280af93fd1&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0424957 Nov 09 04:46:01.345959 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 33188) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:46:01.351802 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-ac7e9913-23fc-4511-bd96-3e3999b6f72a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'port': {'admin_state_up': False}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:46:01.398942 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da3e6579-1bc6-4a72-b14b-fc3997cc7a23 req-e4edfa24-7ac2-4694-97ed-a483ec63d6ce service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:01.400423 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-da3e6579-1bc6-4a72-b14b-fc3997cc7a23 req-e4edfa24-7ac2-4694-97ed-a483ec63d6ce service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&device_id=f9ab492e-61b2-4203-af63-a2280af93fd1 HTTP/1.1" status: 200 len: 1098 time: 0.0391524 Nov 09 04:46:01.414867 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ac7e9913-23fc-4511-bd96-3e3999b6f72a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:01.506270 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da3e6579-1bc6-4a72-b14b-fc3997cc7a23 req-1a950b32-2872-4079-9852-07ef376cc27a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:01.507781 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-da3e6579-1bc6-4a72-b14b-fc3997cc7a23 req-1a950b32-2872-4079-9852-07ef376cc27a service neutron] 10.222.0.26 "GET /v2.0/networks?id=1dad64b1-0a3e-4b78-a75f-959e3b1e79b8 HTTP/1.1" status: 200 len: 898 time: 0.0845301 Nov 09 04:46:01.561723 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-ac7e9913-23fc-4511-bd96-3e3999b6f72a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] For port 9dea4e93-eac2-4ff4-bd09-131010862731, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=9dea4e93-eac2-4ff4-bd09-131010862731,segment=NetworkSegment(9b73abc7-7651-4376-845b-e3dd90806c31),segment_id=9b73abc7-7651-4376-845b-e3dd90806c31)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:46:01.584321 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-da3e6579-1bc6-4a72-b14b-fc3997cc7a23 req-f89402a5-b4ae-4f15-93cb-a92a94707895 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=9dea4e93-eac2-4ff4-bd09-131010862731 HTTP/1.1" status: 200 len: 1000 time: 0.0615363 Nov 09 04:46:01.591898 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ac7e9913-23fc-4511-bd96-3e3999b6f72a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:01.626221 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da3e6579-1bc6-4a72-b14b-fc3997cc7a23 req-27c14d40-f752-429e-a41f-33227cabde13 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:01.627748 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-da3e6579-1bc6-4a72-b14b-fc3997cc7a23 req-27c14d40-f752-429e-a41f-33227cabde13 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=9e8e346c-8a1f-4dfb-8ad0-e87375cefb67 HTTP/1.1" status: 200 len: 834 time: 0.0434332 Nov 09 04:46:01.667760 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ac7e9913-23fc-4511-bd96-3e3999b6f72a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:01.672309 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da3e6579-1bc6-4a72-b14b-fc3997cc7a23 req-ce3e0d17-81b2-4d6f-bb78-c169a8702f0e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:01.673851 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-da3e6579-1bc6-4a72-b14b-fc3997cc7a23 req-ce3e0d17-81b2-4d6f-bb78-c169a8702f0e service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=1dad64b1-0a3e-4b78-a75f-959e3b1e79b8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0386927 Nov 09 04:46:01.711674 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ac7e9913-23fc-4511-bd96-3e3999b6f72a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:01.712298 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ac7e9913-23fc-4511-bd96-3e3999b6f72a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:01.713701 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-ac7e9913-23fc-4511-bd96-3e3999b6f72a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "PUT /v2.0/ports/9dea4e93-eac2-4ff4-bd09-131010862731 HTTP/1.1" status: 200 len: 938 time: 0.3666894 Nov 09 04:46:01.714270 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f9ab492e-61b2-4203-af63-a2280af93fd1', 'tag': '9dea4e93-eac2-4ff4-bd09-131010862731'}] {{(pid=102161) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:46:01.717186 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}99dfdda0def497b4372884ef2eb87f06b1e425c8eba5ceda5f64bbab037a07d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-25d000a3-2aa2-4c58-860c-abb9de6abca2" -d '{"events": [{"name": "network-changed", "server_uuid": "f9ab492e-61b2-4203-af63-a2280af93fd1", "tag": "9dea4e93-eac2-4ff4-bd09-131010862731"}]}' {{(pid=102161) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:46:01.748294 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac7e9913-23fc-4511-bd96-3e3999b6f72a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Port': ['ID=9dea4e93-eac2-4ff4-bd09-131010862731,revision_number=6']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:46:01.758063 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac7e9913-23fc-4511-bd96-3e3999b6f72a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:46:01.758457 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac7e9913-23fc-4511-bd96-3e3999b6f72a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:46:01.758802 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac7e9913-23fc-4511-bd96-3e3999b6f72a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:46:01.759148 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac7e9913-23fc-4511-bd96-3e3999b6f72a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:46:01.759471 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac7e9913-23fc-4511-bd96-3e3999b6f72a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:46:01.759802 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac7e9913-23fc-4511-bd96-3e3999b6f72a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:46:01.760130 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac7e9913-23fc-4511-bd96-3e3999b6f72a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:46:01.760595 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac7e9913-23fc-4511-bd96-3e3999b6f72a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:46:01.760929 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac7e9913-23fc-4511-bd96-3e3999b6f72a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:46:01.761254 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac7e9913-23fc-4511-bd96-3e3999b6f72a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:46:01.761574 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac7e9913-23fc-4511-bd96-3e3999b6f72a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:46:01.761894 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac7e9913-23fc-4511-bd96-3e3999b6f72a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:46:01.784649 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-da3e6579-1bc6-4a72-b14b-fc3997cc7a23 req-4dd30721-5c55-4574-aaf6-5d149ab5663a service neutron] 10.222.0.26 "GET /v2.0/networks/1dad64b1-0a3e-4b78-a75f-959e3b1e79b8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1011374 Nov 09 04:46:01.784796 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:46:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7297f29c-e410-4b55-a868-0be83745524b x-openstack-request-id: req-7297f29c-e410-4b55-a868-0be83745524b {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:46:01.784796 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f9ab492e-61b2-4203-af63-a2280af93fd1", "tag": "9dea4e93-eac2-4ff4-bd09-131010862731", "status": "completed", "code": 200}]} {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:46:01.784796 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-7297f29c-e410-4b55-a868-0be83745524b {{(pid=102161) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:46:01.784796 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f9ab492e-61b2-4203-af63-a2280af93fd1', 'tag': '9dea4e93-eac2-4ff4-bd09-131010862731', 'status': 'completed', 'code': 200} Nov 09 04:46:01.878878 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-da3e6579-1bc6-4a72-b14b-fc3997cc7a23 req-4b499880-7e9a-47e3-87bb-f11bab782715 service neutron] 10.222.0.26 "GET /v2.0/networks/1dad64b1-0a3e-4b78-a75f-959e3b1e79b8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0866733 Nov 09 04:46:01.908175 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-76e06a3a-f743-4fd3-aa3f-cf94f401fdae None None] Provisioning complete for port 9dea4e93-eac2-4ff4-bd09-131010862731 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:46:01.908769 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-76e06a3a-f743-4fd3-aa3f-cf94f401fdae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:01.948243 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-76e06a3a-f743-4fd3-aa3f-cf94f401fdae None None] Port 9dea4e93-eac2-4ff4-bd09-131010862731 is administratively disabled so it will not transition to active. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:356}} Nov 09 04:46:01.962891 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25d000a3-2aa2-4c58-860c-abb9de6abca2 req-4a212107-d278-46c4-a308-9894d5460969 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:01.964367 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-25d000a3-2aa2-4c58-860c-abb9de6abca2 req-4a212107-d278-46c4-a308-9894d5460969 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&device_id=f9ab492e-61b2-4203-af63-a2280af93fd1 HTTP/1.1" status: 200 len: 1099 time: 0.0432632 Nov 09 04:46:02.055443 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25d000a3-2aa2-4c58-860c-abb9de6abca2 req-e45e59c9-c0af-4e4b-8752-0d7561e625b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:02.056910 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-25d000a3-2aa2-4c58-860c-abb9de6abca2 req-e45e59c9-c0af-4e4b-8752-0d7561e625b8 service neutron] 10.222.0.26 "GET /v2.0/networks?id=1dad64b1-0a3e-4b78-a75f-959e3b1e79b8 HTTP/1.1" status: 200 len: 898 time: 0.0846453 Nov 09 04:46:02.123873 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-25d000a3-2aa2-4c58-860c-abb9de6abca2 req-6d844348-5ae5-443f-8ea0-cb76c987f4a3 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=9dea4e93-eac2-4ff4-bd09-131010862731 HTTP/1.1" status: 200 len: 1001 time: 0.0596218 Nov 09 04:46:02.176590 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25d000a3-2aa2-4c58-860c-abb9de6abca2 req-d7414dcb-010f-441b-8653-575b9104f6a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:02.177980 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-25d000a3-2aa2-4c58-860c-abb9de6abca2 req-d7414dcb-010f-441b-8653-575b9104f6a6 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=9e8e346c-8a1f-4dfb-8ad0-e87375cefb67 HTTP/1.1" status: 200 len: 834 time: 0.0425589 Nov 09 04:46:02.221470 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25d000a3-2aa2-4c58-860c-abb9de6abca2 req-b57366ec-6488-4204-884c-3b99a95e2e9c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:02.222950 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-25d000a3-2aa2-4c58-860c-abb9de6abca2 req-b57366ec-6488-4204-884c-3b99a95e2e9c service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=1dad64b1-0a3e-4b78-a75f-959e3b1e79b8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0370095 Nov 09 04:46:02.313281 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-25d000a3-2aa2-4c58-860c-abb9de6abca2 req-7bdbec5e-66c8-4123-aeaa-91dd0b1d2115 service neutron] 10.222.0.26 "GET /v2.0/networks/1dad64b1-0a3e-4b78-a75f-959e3b1e79b8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0829415 Nov 09 04:46:02.400169 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-25d000a3-2aa2-4c58-860c-abb9de6abca2 req-5e0c2574-2bc9-42f1-8ef7-93d44c29f617 service neutron] 10.222.0.26 "GET /v2.0/networks/1dad64b1-0a3e-4b78-a75f-959e3b1e79b8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0793583 Nov 09 04:46:05.102652 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 33196) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:46:05.107968 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-8c1ed159-341e-430c-9326-349748380212 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'port': {'admin_state_up': True}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:46:05.167336 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8c1ed159-341e-430c-9326-349748380212 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:05.310662 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-8c1ed159-341e-430c-9326-349748380212 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] For port 9dea4e93-eac2-4ff4-bd09-131010862731, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=9dea4e93-eac2-4ff4-bd09-131010862731,segment=NetworkSegment(9b73abc7-7651-4376-845b-e3dd90806c31),segment_id=9b73abc7-7651-4376-845b-e3dd90806c31)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:46:05.340504 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8c1ed159-341e-430c-9326-349748380212 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:05.399282 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8c1ed159-341e-430c-9326-349748380212 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:05.438017 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8c1ed159-341e-430c-9326-349748380212 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:05.438721 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8c1ed159-341e-430c-9326-349748380212 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:05.441130 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-8c1ed159-341e-430c-9326-349748380212 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "PUT /v2.0/ports/9dea4e93-eac2-4ff4-bd09-131010862731 HTTP/1.1" status: 200 len: 937 time: 0.3364375 Nov 09 04:46:05.441130 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f9ab492e-61b2-4203-af63-a2280af93fd1', 'tag': '9dea4e93-eac2-4ff4-bd09-131010862731'}] {{(pid=102161) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:46:05.443078 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}99dfdda0def497b4372884ef2eb87f06b1e425c8eba5ceda5f64bbab037a07d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ecfe83b7-6ed8-4024-ad55-1f4008591c6f" -d '{"events": [{"name": "network-changed", "server_uuid": "f9ab492e-61b2-4203-af63-a2280af93fd1", "tag": "9dea4e93-eac2-4ff4-bd09-131010862731"}]}' {{(pid=102161) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:46:05.443251 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33198) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:46:05.475967 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c1ed159-341e-430c-9326-349748380212 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Port': ['ID=9dea4e93-eac2-4ff4-bd09-131010862731,revision_number=7']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:46:05.491205 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:46:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b7f7e166-7025-4fe6-8ec8-af25601f62f1 x-openstack-request-id: req-b7f7e166-7025-4fe6-8ec8-af25601f62f1 {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:46:05.491840 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f9ab492e-61b2-4203-af63-a2280af93fd1", "tag": "9dea4e93-eac2-4ff4-bd09-131010862731", "status": "completed", "code": 200}]} {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:46:05.492317 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-b7f7e166-7025-4fe6-8ec8-af25601f62f1 {{(pid=102161) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:46:05.493430 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f9ab492e-61b2-4203-af63-a2280af93fd1', 'tag': '9dea4e93-eac2-4ff4-bd09-131010862731', 'status': 'completed', 'code': 200} Nov 09 04:46:05.546228 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-b003896e-1580-47b6-9d3f-762407b090de tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/floatingips/9b4594ad-5ede-4f40-a4be-03b43f0db565 HTTP/1.1" status: 200 len: 992 time: 0.1003375 Nov 09 04:46:05.563548 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecfe83b7-6ed8-4024-ad55-1f4008591c6f req-cd300153-0123-4fc0-bef3-5f6903288cc3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:05.565085 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ecfe83b7-6ed8-4024-ad55-1f4008591c6f req-cd300153-0123-4fc0-bef3-5f6903288cc3 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&device_id=f9ab492e-61b2-4203-af63-a2280af93fd1 HTTP/1.1" status: 200 len: 1098 time: 0.0538101 Nov 09 04:46:05.664955 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecfe83b7-6ed8-4024-ad55-1f4008591c6f req-994a6130-3160-4231-aaf7-bd438e3f2119 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:05.666515 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ecfe83b7-6ed8-4024-ad55-1f4008591c6f req-994a6130-3160-4231-aaf7-bd438e3f2119 service neutron] 10.222.0.26 "GET /v2.0/networks?id=1dad64b1-0a3e-4b78-a75f-959e3b1e79b8 HTTP/1.1" status: 200 len: 898 time: 0.0936480 Nov 09 04:46:05.681432 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['9dea4e93-eac2-4ff4-bd09-131010862731'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 04:46:05.722171 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-fe523f89-a070-4170-a271-abb696bd1f91 None None] Provisioning complete for port 9dea4e93-eac2-4ff4-bd09-131010862731 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:46:05.722516 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-fe523f89-a070-4170-a271-abb696bd1f91 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:05.733213 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ecfe83b7-6ed8-4024-ad55-1f4008591c6f req-4e3046bd-950a-42d6-8c81-dc5c60306fd8 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=9dea4e93-eac2-4ff4-bd09-131010862731 HTTP/1.1" status: 200 len: 1000 time: 0.0582366 Nov 09 04:46:05.781998 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecfe83b7-6ed8-4024-ad55-1f4008591c6f req-eaebf233-0a61-4135-840b-edd05c7a1b10 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:05.783483 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ecfe83b7-6ed8-4024-ad55-1f4008591c6f req-eaebf233-0a61-4135-840b-edd05c7a1b10 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=9e8e346c-8a1f-4dfb-8ad0-e87375cefb67 HTTP/1.1" status: 200 len: 834 time: 0.0430877 Nov 09 04:46:05.831767 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecfe83b7-6ed8-4024-ad55-1f4008591c6f req-dcbd3a3c-61e3-4a1a-9fc8-c8d8caeb71cc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:05.833513 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ecfe83b7-6ed8-4024-ad55-1f4008591c6f req-dcbd3a3c-61e3-4a1a-9fc8-c8d8caeb71cc service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=1dad64b1-0a3e-4b78-a75f-959e3b1e79b8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0423639 Nov 09 04:46:05.926838 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ecfe83b7-6ed8-4024-ad55-1f4008591c6f req-3b3dd95e-e27a-450c-8284-090d6e98d08f service neutron] 10.222.0.26 "GET /v2.0/networks/1dad64b1-0a3e-4b78-a75f-959e3b1e79b8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0852349 Nov 09 04:46:06.032422 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ecfe83b7-6ed8-4024-ad55-1f4008591c6f req-bb0d8dd9-d265-49a3-a1f2-03201f90df15 service neutron] 10.222.0.26 "GET /v2.0/networks/1dad64b1-0a3e-4b78-a75f-959e3b1e79b8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0961995 Nov 09 04:46:08.070127 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33208) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:46:08.221719 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-cd51cd67-3953-49b2-b4c5-40a94b3d4069 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Deleting port 53ee7b9f-878b-4d38-b69c-32d196af3e05 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:46:08.221959 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cd51cd67-3953-49b2-b4c5-40a94b3d4069 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:08.297600 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cd51cd67-3953-49b2-b4c5-40a94b3d4069 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:08.297917 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cd51cd67-3953-49b2-b4c5-40a94b3d4069 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:08.309400 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-cd51cd67-3953-49b2-b4c5-40a94b3d4069 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Calling delete_port for 53ee7b9f-878b-4d38-b69c-32d196af3e05 owned by network:floatingip {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:46:08.851171 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cd51cd67-3953-49b2-b4c5-40a94b3d4069 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:08.876089 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd51cd67-3953-49b2-b4c5-40a94b3d4069 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'Port': ['ID=53ee7b9f-878b-4d38-b69c-32d196af3e05,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:46:08.885727 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd51cd67-3953-49b2-b4c5-40a94b3d4069 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:46:08.886098 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd51cd67-3953-49b2-b4c5-40a94b3d4069 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:46:08.886522 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd51cd67-3953-49b2-b4c5-40a94b3d4069 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:46:08.890510 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd51cd67-3953-49b2-b4c5-40a94b3d4069 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:46:08.890510 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd51cd67-3953-49b2-b4c5-40a94b3d4069 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:46:08.890510 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd51cd67-3953-49b2-b4c5-40a94b3d4069 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:46:08.890510 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd51cd67-3953-49b2-b4c5-40a94b3d4069 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:46:08.890510 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd51cd67-3953-49b2-b4c5-40a94b3d4069 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:46:08.890510 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd51cd67-3953-49b2-b4c5-40a94b3d4069 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:46:08.890510 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd51cd67-3953-49b2-b4c5-40a94b3d4069 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:46:08.890510 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd51cd67-3953-49b2-b4c5-40a94b3d4069 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:46:08.890510 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd51cd67-3953-49b2-b4c5-40a94b3d4069 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:46:08.946828 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cd51cd67-3953-49b2-b4c5-40a94b3d4069 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for floatingip, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:08.947157 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.l3_db [None req-cd51cd67-3953-49b2-b4c5-40a94b3d4069 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Floating IP b9c98577-89c7-42a4-a4d8-c86df2f91932 disassociated (deleted). External IP: 172.26.0.26, port: b27dade5-4101-4abe-bf0e-e385d11c806f. Nov 09 04:46:09.147042 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cd51cd67-3953-49b2-b4c5-40a94b3d4069 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Router ab3c88d0-a531-409f-8b0b-c18b0761c90a has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:46:09.250147 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cd51cd67-3953-49b2-b4c5-40a94b3d4069 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:46:09.255023 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cd51cd67-3953-49b2-b4c5-40a94b3d4069 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:09.260948 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-32c6bf94-7d30-46eb-8b7d-af1a7665fce0 None None] Sync routers for ids ['ab3c88d0-a531-409f-8b0b-c18b0761c90a'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:46:09.270854 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-32c6bf94-7d30-46eb-8b7d-af1a7665fce0 None None] Routers {'ab3c88d0-a531-409f-8b0b-c18b0761c90a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:46:09.271463 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-32c6bf94-7d30-46eb-8b7d-af1a7665fce0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:45:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['ab3c88d0-a531-409f-8b0b-c18b0761c90a'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:46:09.280995 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-cd51cd67-3953-49b2-b4c5-40a94b3d4069 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "DELETE /v2.0/floatingips/b9c98577-89c7-42a4-a4d8-c86df2f91932 HTTP/1.1" status: 204 len: 168 time: 1.2097373 Nov 09 04:46:09.281580 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '632189ac-20cc-43b0-93a1-3d6f9e67628d', 'tag': 'b27dade5-4101-4abe-bf0e-e385d11c806f'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:46:09.283842 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-840084eb-1a61-46bb-89f0-088d64ccdc91" -d '{"events": [{"name": "network-changed", "server_uuid": "632189ac-20cc-43b0-93a1-3d6f9e67628d", "tag": "b27dade5-4101-4abe-bf0e-e385d11c806f"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:46:09.327714 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:46:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d57f104f-b0e6-46ce-922c-9a37e5991cf6 x-openstack-request-id: req-d57f104f-b0e6-46ce-922c-9a37e5991cf6 {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:46:09.328012 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "632189ac-20cc-43b0-93a1-3d6f9e67628d", "tag": "b27dade5-4101-4abe-bf0e-e385d11c806f", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:46:09.328264 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-d57f104f-b0e6-46ce-922c-9a37e5991cf6 {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:46:09.328671 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '632189ac-20cc-43b0-93a1-3d6f9e67628d', 'tag': 'b27dade5-4101-4abe-bf0e-e385d11c806f', 'status': 'completed', 'code': 200} Nov 09 04:46:09.393501 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-840084eb-1a61-46bb-89f0-088d64ccdc91 req-c2abfa03-026d-40bc-b2a7-2c3b3d946993 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:09.395088 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-840084eb-1a61-46bb-89f0-088d64ccdc91 req-c2abfa03-026d-40bc-b2a7-2c3b3d946993 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&device_id=632189ac-20cc-43b0-93a1-3d6f9e67628d HTTP/1.1" status: 200 len: 1098 time: 0.0439744 Nov 09 04:46:09.472603 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-32c6bf94-7d30-46eb-8b7d-af1a7665fce0 None None] Set router ab3c88d0-a531-409f-8b0b-c18b0761c90a gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:46:09.489658 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-840084eb-1a61-46bb-89f0-088d64ccdc91 req-45fd78be-958d-4a93-ac9d-703ef4520cae service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:09.491157 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-840084eb-1a61-46bb-89f0-088d64ccdc91 req-45fd78be-958d-4a93-ac9d-703ef4520cae service neutron] 10.222.0.26 "GET /v2.0/networks?id=1dad64b1-0a3e-4b78-a75f-959e3b1e79b8 HTTP/1.1" status: 200 len: 898 time: 0.0885623 Nov 09 04:46:09.533220 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-840084eb-1a61-46bb-89f0-088d64ccdc91 req-b1cb94b3-1f7c-4506-9229-7125fb35f601 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=b27dade5-4101-4abe-bf0e-e385d11c806f HTTP/1.1" status: 200 len: 217 time: 0.0342045 Nov 09 04:46:09.590348 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-840084eb-1a61-46bb-89f0-088d64ccdc91 req-8eb130f5-4291-4068-a95d-54da1b3bb8f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:09.591827 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-840084eb-1a61-46bb-89f0-088d64ccdc91 req-8eb130f5-4291-4068-a95d-54da1b3bb8f8 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=9e8e346c-8a1f-4dfb-8ad0-e87375cefb67 HTTP/1.1" status: 200 len: 834 time: 0.0516093 Nov 09 04:46:09.639663 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-840084eb-1a61-46bb-89f0-088d64ccdc91 req-4e5c5d85-e38b-4485-a023-31e2deab3794 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:09.641548 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-840084eb-1a61-46bb-89f0-088d64ccdc91 req-4e5c5d85-e38b-4485-a023-31e2deab3794 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=1dad64b1-0a3e-4b78-a75f-959e3b1e79b8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0420392 Nov 09 04:46:09.714527 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-32c6bf94-7d30-46eb-8b7d-af1a7665fce0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'name': 'tempest-TestNetworkBasicOps-router-636046836', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.161'}], 'enable_snat': True}, 'gw_port_id': '8e2fba8e-7861-42b3-9f71-2ef66b096ca7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:44:41Z', 'updated_at': '2021-11-09T04:44:46Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '8e2fba8e-7861-42b3-9f71-2ef66b096ca7', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:d4:05:cb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1477, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.161', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:44:41Z', 'updated_at': '2021-11-09T04:44:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '9b4594ad-5ede-4f40-a4be-03b43f0db565', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'floating_ip_address': '172.26.0.20', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'port_id': '9dea4e93-eac2-4ff4-bd09-131010862731', 'fixed_ip_address': '172.20.0.9', 'status': 'ACTIVE', 'standard_attr_id': 1492, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '1dad64b1-0a3e-4b78-a75f-959e3b1e79b8', 'mac_address': 'fa:16:3e:5e:61:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f9ab492e-61b2-4203-af63-a2280af93fd1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:45:05Z', 'updated_at': '2021-11-09T04:45:08Z', 'revision_number': 1, 'project_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1307a903-74ab-4faf-8993-e69fd7140798', 'name': '', 'network_id': '1dad64b1-0a3e-4b78-a75f-959e3b1e79b8', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:f7:0c:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1480, 'fixed_ips': [{'subnet_id': '9e8e346c-8a1f-4dfb-8ad0-e87375cefb67', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:44:46Z', 'updated_at': '2021-11-09T04:44:50Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '9e8e346c-8a1f-4dfb-8ad0-e87375cefb67', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:46:09.735813 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b67531c-e9c2-4a79-bc72-f406cf022b62 req-8f6687b6-5aec-4b59-b915-0ff11980f086 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:09.740154 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-5b67531c-e9c2-4a79-bc72-f406cf022b62 req-8f6687b6-5aec-4b59-b915-0ff11980f086 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=632189ac-20cc-43b0-93a1-3d6f9e67628d HTTP/1.1" status: 200 len: 945 time: 0.0665720 Nov 09 04:46:09.742492 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-32c6bf94-7d30-46eb-8b7d-af1a7665fce0 None None] Checking router: ab3c88d0-a531-409f-8b0b-c18b0761c90a for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:46:09.743133 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-840084eb-1a61-46bb-89f0-088d64ccdc91 req-044aad8b-e2eb-4125-b4e6-cb9fc58d33d3 service neutron] 10.222.0.26 "GET /v2.0/networks/1dad64b1-0a3e-4b78-a75f-959e3b1e79b8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0901728 Nov 09 04:46:09.751505 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-32c6bf94-7d30-46eb-8b7d-af1a7665fce0 None None] Routers {'ab3c88d0-a531-409f-8b0b-c18b0761c90a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:46:09.752106 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-32c6bf94-7d30-46eb-8b7d-af1a7665fce0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:45:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['ab3c88d0-a531-409f-8b0b-c18b0761c90a'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:46:09.798947 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-5b67531c-e9c2-4a79-bc72-f406cf022b62 req-f2675e7d-6cec-4628-9342-6b06d0bf4977 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=0213e3fe-696b-486f-b865-2087043fe0c0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0521913 Nov 09 04:46:09.843393 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-840084eb-1a61-46bb-89f0-088d64ccdc91 req-104484c8-aafe-4358-b3fc-bcd6c744097e service neutron] 10.222.0.26 "GET /v2.0/networks/1dad64b1-0a3e-4b78-a75f-959e3b1e79b8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0923328 Nov 09 04:46:09.859526 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-32c6bf94-7d30-46eb-8b7d-af1a7665fce0 None None] Set router ab3c88d0-a531-409f-8b0b-c18b0761c90a gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:46:10.087583 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-32c6bf94-7d30-46eb-8b7d-af1a7665fce0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'name': 'tempest-TestNetworkBasicOps-router-636046836', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.161'}], 'enable_snat': True}, 'gw_port_id': '8e2fba8e-7861-42b3-9f71-2ef66b096ca7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:44:41Z', 'updated_at': '2021-11-09T04:44:46Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '8e2fba8e-7861-42b3-9f71-2ef66b096ca7', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:d4:05:cb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1477, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.161', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:44:41Z', 'updated_at': '2021-11-09T04:44:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '9b4594ad-5ede-4f40-a4be-03b43f0db565', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'floating_ip_address': '172.26.0.20', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'port_id': '9dea4e93-eac2-4ff4-bd09-131010862731', 'fixed_ip_address': '172.20.0.9', 'status': 'ACTIVE', 'standard_attr_id': 1492, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '1dad64b1-0a3e-4b78-a75f-959e3b1e79b8', 'mac_address': 'fa:16:3e:5e:61:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f9ab492e-61b2-4203-af63-a2280af93fd1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:45:05Z', 'updated_at': '2021-11-09T04:45:08Z', 'revision_number': 1, 'project_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1307a903-74ab-4faf-8993-e69fd7140798', 'name': '', 'network_id': '1dad64b1-0a3e-4b78-a75f-959e3b1e79b8', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:f7:0c:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1480, 'fixed_ips': [{'subnet_id': '9e8e346c-8a1f-4dfb-8ad0-e87375cefb67', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:44:46Z', 'updated_at': '2021-11-09T04:44:50Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '9e8e346c-8a1f-4dfb-8ad0-e87375cefb67', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:46:10.113856 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-32c6bf94-7d30-46eb-8b7d-af1a7665fce0 None None] The sync data for ids ['ab3c88d0-a531-409f-8b0b-c18b0761c90a'] in dv-neutron-816802-2-hyperv is: [{'id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'name': 'tempest-TestNetworkBasicOps-router-636046836', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.161'}], 'enable_snat': True}, 'gw_port_id': '8e2fba8e-7861-42b3-9f71-2ef66b096ca7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:44:41Z', 'updated_at': '2021-11-09T04:44:46Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '8e2fba8e-7861-42b3-9f71-2ef66b096ca7', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:d4:05:cb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1477, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.161', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:44:41Z', 'updated_at': '2021-11-09T04:44:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '9b4594ad-5ede-4f40-a4be-03b43f0db565', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'floating_ip_address': '172.26.0.20', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'port_id': '9dea4e93-eac2-4ff4-bd09-131010862731', 'fixed_ip_address': '172.20.0.9', 'status': 'ACTIVE', 'standard_attr_id': 1492, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '1dad64b1-0a3e-4b78-a75f-959e3b1e79b8', 'mac_address': 'fa:16:3e:5e:61:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f9ab492e-61b2-4203-af63-a2280af93fd1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:45:05Z', 'updated_at': '2021-11-09T04:45:08Z', 'revision_number': 1, 'project_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1307a903-74ab-4faf-8993-e69fd7140798', 'name': '', 'network_id': '1dad64b1-0a3e-4b78-a75f-959e3b1e79b8', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:f7:0c:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1480, 'fixed_ips': [{'subnet_id': '9e8e346c-8a1f-4dfb-8ad0-e87375cefb67', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:44:46Z', 'updated_at': '2021-11-09T04:44:50Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '9e8e346c-8a1f-4dfb-8ad0-e87375cefb67', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:46:10.320117 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1580d6b6-a8a1-47bd-a679-80d0ca2c291b None None] New status for floating IP b9c98577-89c7-42a4-a4d8-c86df2f91932: DOWN {{(pid=102163) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 04:46:10.463294 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:46:10.912326 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12feeffb-e420-4e9b-8db3-8fff8c856335 req-f8e7cd33-05cd-490f-a7e4-7f21ca677bc6 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:10.913796 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-12feeffb-e420-4e9b-8db3-8fff8c856335 req-f8e7cd33-05cd-490f-a7e4-7f21ca677bc6 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=632189ac-20cc-43b0-93a1-3d6f9e67628d HTTP/1.1" status: 200 len: 945 time: 0.0495181 Nov 09 04:46:10.961291 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-12feeffb-e420-4e9b-8db3-8fff8c856335 req-80b018fc-792d-462c-963e-b6f9592475a1 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=0213e3fe-696b-486f-b865-2087043fe0c0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0416343 Nov 09 04:46:11.045862 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4002545b-50b3-4859-a177-4365384f4a18 req-cf740eb3-79c4-4f61-8e10-8be408251994 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:11.047355 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4002545b-50b3-4859-a177-4365384f4a18 req-cf740eb3-79c4-4f61-8e10-8be408251994 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "GET /v2.0/ports?device_id=632189ac-20cc-43b0-93a1-3d6f9e67628d HTTP/1.1" status: 200 len: 945 time: 0.0511241 Nov 09 04:46:11.141943 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-4002545b-50b3-4859-a177-4365384f4a18 req-174a0999-9322-488f-89ef-0bcec52a505f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Deleting port b27dade5-4101-4abe-bf0e-e385d11c806f {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:46:11.142220 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-4002545b-50b3-4859-a177-4365384f4a18 req-174a0999-9322-488f-89ef-0bcec52a505f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:11.231247 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-4002545b-50b3-4859-a177-4365384f4a18 req-174a0999-9322-488f-89ef-0bcec52a505f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] For port b27dade5-4101-4abe-bf0e-e385d11c806f, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=b27dade5-4101-4abe-bf0e-e385d11c806f,segment=NetworkSegment(9b73abc7-7651-4376-845b-e3dd90806c31),segment_id=9b73abc7-7651-4376-845b-e3dd90806c31)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:46:11.231600 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-4002545b-50b3-4859-a177-4365384f4a18 req-174a0999-9322-488f-89ef-0bcec52a505f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:11.244047 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-4002545b-50b3-4859-a177-4365384f4a18 req-174a0999-9322-488f-89ef-0bcec52a505f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Calling delete_port for b27dade5-4101-4abe-bf0e-e385d11c806f owned by compute:nova {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:46:11.376686 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c1af04d5-af07-4f2e-ba88-ed66ad6f4b93 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:11.428814 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-4002545b-50b3-4859-a177-4365384f4a18 req-174a0999-9322-488f-89ef-0bcec52a505f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:11.461838 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-174a0999-9322-488f-89ef-0bcec52a505f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'Port': ['ID=b27dade5-4101-4abe-bf0e-e385d11c806f,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:46:11.499937 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-4002545b-50b3-4859-a177-4365384f4a18 req-174a0999-9322-488f-89ef-0bcec52a505f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] No DVR routers for this DVR port b27dade5-4101-4abe-bf0e-e385d11c806f on host hv-neutron-8168 {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:46:11.502411 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-4002545b-50b3-4859-a177-4365384f4a18 req-174a0999-9322-488f-89ef-0bcec52a505f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:11.505705 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4002545b-50b3-4859-a177-4365384f4a18 req-174a0999-9322-488f-89ef-0bcec52a505f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "DELETE /v2.0/ports/b27dade5-4101-4abe-bf0e-e385d11c806f HTTP/1.1" status: 204 len: 173 time: 0.4519396 Nov 09 04:46:11.506179 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '632189ac-20cc-43b0-93a1-3d6f9e67628d', 'name': 'network-vif-deleted', 'tag': 'b27dade5-4101-4abe-bf0e-e385d11c806f'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:46:11.508439 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-64df66e1-7776-4587-8270-235287dd981d" -d '{"events": [{"server_uuid": "632189ac-20cc-43b0-93a1-3d6f9e67628d", "name": "network-vif-deleted", "tag": "b27dade5-4101-4abe-bf0e-e385d11c806f"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:46:11.542921 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:46:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-983be75e-e49b-435c-ba79-7389861e788a x-openstack-request-id: req-983be75e-e49b-435c-ba79-7389861e788a {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:46:11.543722 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "632189ac-20cc-43b0-93a1-3d6f9e67628d", "name": "network-vif-deleted", "tag": "b27dade5-4101-4abe-bf0e-e385d11c806f", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:46:11.543969 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-983be75e-e49b-435c-ba79-7389861e788a {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:46:11.544365 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '632189ac-20cc-43b0-93a1-3d6f9e67628d', 'name': 'network-vif-deleted', 'tag': 'b27dade5-4101-4abe-bf0e-e385d11c806f', 'status': 'completed', 'code': 200} Nov 09 04:46:12.070737 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6169702f-fefb-4206-9263-ecd986ad306d req-e4a6d2e1-9dfb-4a9c-8f3f-4d655095ddf7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=632189ac-20cc-43b0-93a1-3d6f9e67628d HTTP/1.1" status: 200 len: 210 time: 0.0250483 Nov 09 04:46:12.199763 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:13.128886 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33226) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:46:13.182900 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a9bf5876-850d-4215-88ee-3d8ddf475524 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:13.207243 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a9bf5876-850d-4215-88ee-3d8ddf475524 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:13.336581 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a9bf5876-850d-4215-88ee-3d8ddf475524 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:13.339413 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a9bf5876-850d-4215-88ee-3d8ddf475524 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:13.341604 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a9bf5876-850d-4215-88ee-3d8ddf475524 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "DELETE /v2.0/security-groups/0213e3fe-696b-486f-b865-2087043fe0c0 HTTP/1.1" status: 204 len: 168 time: 0.2106991 Nov 09 04:46:13.349613 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9bf5876-850d-4215-88ee-3d8ddf475524 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=0213e3fe-696b-486f-b865-2087043fe0c0,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:46:13.423986 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33230) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:46:13.576025 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-da493c50-18ad-4b3b-ad97-9c4d3e5bfc6c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Deleting port f21d41b3-8b9b-4bec-a451-7cbfa55328d6 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:46:13.576361 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-da493c50-18ad-4b3b-ad97-9c4d3e5bfc6c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:13.650297 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-da493c50-18ad-4b3b-ad97-9c4d3e5bfc6c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:13.650654 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-da493c50-18ad-4b3b-ad97-9c4d3e5bfc6c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:13.661998 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-da493c50-18ad-4b3b-ad97-9c4d3e5bfc6c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Calling delete_port for f21d41b3-8b9b-4bec-a451-7cbfa55328d6 owned by network:floatingip {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:46:13.685737 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6eedc1b7-83ff-4bd3-9829-4f752011c877 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:13.874154 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-da493c50-18ad-4b3b-ad97-9c4d3e5bfc6c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:13.876477 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device b27dade5-4101-4abe-bf0e-e385d11c806f no longer exists at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:46:13.900694 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] No Port match for: b27dade5-4101-4abe-bf0e-e385d11c806f {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:46:13.900920 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da493c50-18ad-4b3b-ad97-9c4d3e5bfc6c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'Port': ['ID=f21d41b3-8b9b-4bec-a451-7cbfa55328d6,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:46:13.901035 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device b27dade5-4101-4abe-bf0e-e385d11c806f not bound to the agent host hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:46:13.962281 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-da493c50-18ad-4b3b-ad97-9c4d3e5bfc6c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for floatingip, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:13.962672 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.l3_db [None req-da493c50-18ad-4b3b-ad97-9c4d3e5bfc6c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Floating IP 9b4594ad-5ede-4f40-a4be-03b43f0db565 disassociated (deleted). External IP: 172.26.0.20, port: 9dea4e93-eac2-4ff4-bd09-131010862731. Nov 09 04:46:14.191484 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-da493c50-18ad-4b3b-ad97-9c4d3e5bfc6c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Router ab3c88d0-a531-409f-8b0b-c18b0761c90a has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:46:14.295819 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-da493c50-18ad-4b3b-ad97-9c4d3e5bfc6c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:46:14.300418 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-da493c50-18ad-4b3b-ad97-9c4d3e5bfc6c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:14.304905 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7a4135ae-c8e7-4b9f-9395-10d131742e83 None None] Sync routers for ids ['ab3c88d0-a531-409f-8b0b-c18b0761c90a'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:46:14.313763 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7a4135ae-c8e7-4b9f-9395-10d131742e83 None None] Routers {'ab3c88d0-a531-409f-8b0b-c18b0761c90a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:46:14.314377 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-7a4135ae-c8e7-4b9f-9395-10d131742e83 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:46:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['ab3c88d0-a531-409f-8b0b-c18b0761c90a'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:46:14.328809 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-da493c50-18ad-4b3b-ad97-9c4d3e5bfc6c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "DELETE /v2.0/floatingips/9b4594ad-5ede-4f40-a4be-03b43f0db565 HTTP/1.1" status: 204 len: 168 time: 0.9012675 Nov 09 04:46:14.328809 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f9ab492e-61b2-4203-af63-a2280af93fd1', 'tag': '9dea4e93-eac2-4ff4-bd09-131010862731'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:46:14.329162 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fa3b1f82-f4fa-497e-b9f5-f1ef48877b96" -d '{"events": [{"name": "network-changed", "server_uuid": "f9ab492e-61b2-4203-af63-a2280af93fd1", "tag": "9dea4e93-eac2-4ff4-bd09-131010862731"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:46:14.367051 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:46:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-938e3a0f-73f9-4fd4-895d-a5c2f04003cc x-openstack-request-id: req-938e3a0f-73f9-4fd4-895d-a5c2f04003cc {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:46:14.367364 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f9ab492e-61b2-4203-af63-a2280af93fd1", "tag": "9dea4e93-eac2-4ff4-bd09-131010862731", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:46:14.367591 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-938e3a0f-73f9-4fd4-895d-a5c2f04003cc {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:46:14.368019 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f9ab492e-61b2-4203-af63-a2280af93fd1', 'tag': '9dea4e93-eac2-4ff4-bd09-131010862731', 'status': 'completed', 'code': 200} Nov 09 04:46:14.425002 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-7a4135ae-c8e7-4b9f-9395-10d131742e83 None None] Set router ab3c88d0-a531-409f-8b0b-c18b0761c90a gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:46:14.431027 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa3b1f82-f4fa-497e-b9f5-f1ef48877b96 req-3ed97ae3-7c9b-411c-8d8b-12b7f9e074f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:14.432541 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fa3b1f82-f4fa-497e-b9f5-f1ef48877b96 req-3ed97ae3-7c9b-411c-8d8b-12b7f9e074f3 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&device_id=f9ab492e-61b2-4203-af63-a2280af93fd1 HTTP/1.1" status: 200 len: 1098 time: 0.0411966 Nov 09 04:46:14.528068 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa3b1f82-f4fa-497e-b9f5-f1ef48877b96 req-103cc09e-7367-48a6-b86b-925c7a5192c9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:14.529625 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fa3b1f82-f4fa-497e-b9f5-f1ef48877b96 req-103cc09e-7367-48a6-b86b-925c7a5192c9 service neutron] 10.222.0.26 "GET /v2.0/networks?id=1dad64b1-0a3e-4b78-a75f-959e3b1e79b8 HTTP/1.1" status: 200 len: 898 time: 0.0896697 Nov 09 04:46:14.571137 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fa3b1f82-f4fa-497e-b9f5-f1ef48877b96 req-e7af8ad5-2f70-402f-9484-80997eab82e1 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=9dea4e93-eac2-4ff4-bd09-131010862731 HTTP/1.1" status: 200 len: 217 time: 0.0344613 Nov 09 04:46:14.623740 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa3b1f82-f4fa-497e-b9f5-f1ef48877b96 req-1b7a0af3-1385-4d96-b946-859c85755068 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:14.625369 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fa3b1f82-f4fa-497e-b9f5-f1ef48877b96 req-1b7a0af3-1385-4d96-b946-859c85755068 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=9e8e346c-8a1f-4dfb-8ad0-e87375cefb67 HTTP/1.1" status: 200 len: 834 time: 0.0475905 Nov 09 04:46:14.627118 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-7a4135ae-c8e7-4b9f-9395-10d131742e83 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'name': 'tempest-TestNetworkBasicOps-router-636046836', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.161'}], 'enable_snat': True}, 'gw_port_id': '8e2fba8e-7861-42b3-9f71-2ef66b096ca7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:44:41Z', 'updated_at': '2021-11-09T04:44:46Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '8e2fba8e-7861-42b3-9f71-2ef66b096ca7', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:d4:05:cb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1477, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.161', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:44:41Z', 'updated_at': '2021-11-09T04:44:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '1307a903-74ab-4faf-8993-e69fd7140798', 'name': '', 'network_id': '1dad64b1-0a3e-4b78-a75f-959e3b1e79b8', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:f7:0c:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1480, 'fixed_ips': [{'subnet_id': '9e8e346c-8a1f-4dfb-8ad0-e87375cefb67', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:44:46Z', 'updated_at': '2021-11-09T04:44:50Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '9e8e346c-8a1f-4dfb-8ad0-e87375cefb67', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:46:14.656361 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7a4135ae-c8e7-4b9f-9395-10d131742e83 None None] Checking router: ab3c88d0-a531-409f-8b0b-c18b0761c90a for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:46:14.664551 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7a4135ae-c8e7-4b9f-9395-10d131742e83 None None] Routers {'ab3c88d0-a531-409f-8b0b-c18b0761c90a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:46:14.665149 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-7a4135ae-c8e7-4b9f-9395-10d131742e83 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:46:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['ab3c88d0-a531-409f-8b0b-c18b0761c90a'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:46:14.675937 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa3b1f82-f4fa-497e-b9f5-f1ef48877b96 req-a1463861-10bf-4e60-8126-4887fd405b08 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:14.678077 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fa3b1f82-f4fa-497e-b9f5-f1ef48877b96 req-a1463861-10bf-4e60-8126-4887fd405b08 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=1dad64b1-0a3e-4b78-a75f-959e3b1e79b8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0455894 Nov 09 04:46:14.772583 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-7a4135ae-c8e7-4b9f-9395-10d131742e83 None None] Set router ab3c88d0-a531-409f-8b0b-c18b0761c90a gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:46:14.803791 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fa3b1f82-f4fa-497e-b9f5-f1ef48877b96 req-e8624c25-1873-4536-83cc-2191a74439dc service neutron] 10.222.0.26 "GET /v2.0/networks/1dad64b1-0a3e-4b78-a75f-959e3b1e79b8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1113741 Nov 09 04:46:14.812051 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d20a4097-62b9-46c9-b3c0-95164bee9d17 req-5be075d4-4fc0-41f6-84f8-0b168a35458a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:14.813448 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d20a4097-62b9-46c9-b3c0-95164bee9d17 req-5be075d4-4fc0-41f6-84f8-0b168a35458a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=f9ab492e-61b2-4203-af63-a2280af93fd1 HTTP/1.1" status: 200 len: 945 time: 0.0705957 Nov 09 04:46:14.920093 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d20a4097-62b9-46c9-b3c0-95164bee9d17 req-bf1c92f7-885a-4994-bdaa-65547012d22f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=8425d3b7-b361-4e0f-ad79-89882a770395&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0985873 Nov 09 04:46:14.936577 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fa3b1f82-f4fa-497e-b9f5-f1ef48877b96 req-7a8fd40f-ce2d-4a5c-8560-ad09458a5e5b service neutron] 10.222.0.26 "GET /v2.0/networks/1dad64b1-0a3e-4b78-a75f-959e3b1e79b8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1222088 Nov 09 04:46:14.971382 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-7a4135ae-c8e7-4b9f-9395-10d131742e83 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'name': 'tempest-TestNetworkBasicOps-router-636046836', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.161'}], 'enable_snat': True}, 'gw_port_id': '8e2fba8e-7861-42b3-9f71-2ef66b096ca7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:44:41Z', 'updated_at': '2021-11-09T04:44:46Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '8e2fba8e-7861-42b3-9f71-2ef66b096ca7', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:d4:05:cb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1477, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.161', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:44:41Z', 'updated_at': '2021-11-09T04:44:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '1307a903-74ab-4faf-8993-e69fd7140798', 'name': '', 'network_id': '1dad64b1-0a3e-4b78-a75f-959e3b1e79b8', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:f7:0c:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1480, 'fixed_ips': [{'subnet_id': '9e8e346c-8a1f-4dfb-8ad0-e87375cefb67', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:44:46Z', 'updated_at': '2021-11-09T04:44:50Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '9e8e346c-8a1f-4dfb-8ad0-e87375cefb67', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:46:14.996994 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7a4135ae-c8e7-4b9f-9395-10d131742e83 None None] The sync data for ids ['ab3c88d0-a531-409f-8b0b-c18b0761c90a'] in dv-neutron-816802-2-hyperv is: [{'id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'name': 'tempest-TestNetworkBasicOps-router-636046836', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.161'}], 'enable_snat': True}, 'gw_port_id': '8e2fba8e-7861-42b3-9f71-2ef66b096ca7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:44:41Z', 'updated_at': '2021-11-09T04:44:46Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '8e2fba8e-7861-42b3-9f71-2ef66b096ca7', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:d4:05:cb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1477, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.161', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:44:41Z', 'updated_at': '2021-11-09T04:44:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '1307a903-74ab-4faf-8993-e69fd7140798', 'name': '', 'network_id': '1dad64b1-0a3e-4b78-a75f-959e3b1e79b8', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:f7:0c:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1480, 'fixed_ips': [{'subnet_id': '9e8e346c-8a1f-4dfb-8ad0-e87375cefb67', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:44:46Z', 'updated_at': '2021-11-09T04:44:50Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '9e8e346c-8a1f-4dfb-8ad0-e87375cefb67', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:46:15.148396 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:15.207866 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f81d0530-1bd5-4fa0-b1b0-f67d8f84babd None None] New status for floating IP 9b4594ad-5ede-4f40-a4be-03b43f0db565: DOWN {{(pid=102163) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 04:46:16.038727 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9377b110-c1d1-4b8a-b8fc-152732ddc3c1 req-3f70f087-86ad-457e-a5e9-abb82197a65e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:16.040206 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-9377b110-c1d1-4b8a-b8fc-152732ddc3c1 req-3f70f087-86ad-457e-a5e9-abb82197a65e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=f9ab492e-61b2-4203-af63-a2280af93fd1 HTTP/1.1" status: 200 len: 945 time: 0.0500391 Nov 09 04:46:16.090918 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-9377b110-c1d1-4b8a-b8fc-152732ddc3c1 req-256880d7-2069-4cc0-ba7f-560bd2c5fb37 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=8425d3b7-b361-4e0f-ad79-89882a770395&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0441651 Nov 09 04:46:16.248201 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc27f54e-024d-4703-a6d2-be30ae13c502 req-a2aed803-5f47-477d-860e-d7688d5a9fa5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:16.249517 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-dc27f54e-024d-4703-a6d2-be30ae13c502 req-a2aed803-5f47-477d-860e-d7688d5a9fa5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "GET /v2.0/ports?device_id=f9ab492e-61b2-4203-af63-a2280af93fd1 HTTP/1.1" status: 200 len: 945 time: 0.0518742 Nov 09 04:46:16.335430 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-dc27f54e-024d-4703-a6d2-be30ae13c502 req-19674168-24a3-43be-bc11-1618ef8055eb tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Deleting port 9dea4e93-eac2-4ff4-bd09-131010862731 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:46:16.335762 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-dc27f54e-024d-4703-a6d2-be30ae13c502 req-19674168-24a3-43be-bc11-1618ef8055eb tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:16.425060 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-dc27f54e-024d-4703-a6d2-be30ae13c502 req-19674168-24a3-43be-bc11-1618ef8055eb tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] For port 9dea4e93-eac2-4ff4-bd09-131010862731, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=9dea4e93-eac2-4ff4-bd09-131010862731,segment=NetworkSegment(9b73abc7-7651-4376-845b-e3dd90806c31),segment_id=9b73abc7-7651-4376-845b-e3dd90806c31)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:46:16.425415 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-dc27f54e-024d-4703-a6d2-be30ae13c502 req-19674168-24a3-43be-bc11-1618ef8055eb tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:16.438463 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-dc27f54e-024d-4703-a6d2-be30ae13c502 req-19674168-24a3-43be-bc11-1618ef8055eb tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Calling delete_port for 9dea4e93-eac2-4ff4-bd09-131010862731 owned by compute:nova {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:46:16.468239 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:16.616766 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-dc27f54e-024d-4703-a6d2-be30ae13c502 req-19674168-24a3-43be-bc11-1618ef8055eb tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:16.648385 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19674168-24a3-43be-bc11-1618ef8055eb tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'Port': ['ID=9dea4e93-eac2-4ff4-bd09-131010862731,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:46:16.687179 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-dc27f54e-024d-4703-a6d2-be30ae13c502 req-19674168-24a3-43be-bc11-1618ef8055eb tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] No DVR routers for this DVR port 9dea4e93-eac2-4ff4-bd09-131010862731 on host hv-neutron-8168 {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:46:16.689504 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-dc27f54e-024d-4703-a6d2-be30ae13c502 req-19674168-24a3-43be-bc11-1618ef8055eb tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:16.692841 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-dc27f54e-024d-4703-a6d2-be30ae13c502 req-19674168-24a3-43be-bc11-1618ef8055eb tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "DELETE /v2.0/ports/9dea4e93-eac2-4ff4-bd09-131010862731 HTTP/1.1" status: 204 len: 173 time: 0.4365566 Nov 09 04:46:16.693287 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f9ab492e-61b2-4203-af63-a2280af93fd1', 'name': 'network-vif-deleted', 'tag': '9dea4e93-eac2-4ff4-bd09-131010862731'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:46:16.695526 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6fb50ff9-4fb5-4773-b727-4c02863f7ea5" -d '{"events": [{"server_uuid": "f9ab492e-61b2-4203-af63-a2280af93fd1", "name": "network-vif-deleted", "tag": "9dea4e93-eac2-4ff4-bd09-131010862731"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:46:16.733348 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:46:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-097ea649-884b-422f-9f38-949b425571e7 x-openstack-request-id: req-097ea649-884b-422f-9f38-949b425571e7 {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:46:16.733654 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f9ab492e-61b2-4203-af63-a2280af93fd1", "name": "network-vif-deleted", "tag": "9dea4e93-eac2-4ff4-bd09-131010862731", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:46:16.733904 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-097ea649-884b-422f-9f38-949b425571e7 {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:46:16.734300 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f9ab492e-61b2-4203-af63-a2280af93fd1', 'name': 'network-vif-deleted', 'tag': '9dea4e93-eac2-4ff4-bd09-131010862731', 'status': 'completed', 'code': 200} Nov 09 04:46:16.988447 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:17.194563 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c87c2a94-b4ad-4c96-9de7-b8503ea1c48d req-09621491-d954-4c84-9b2b-4d87a69def28 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=f9ab492e-61b2-4203-af63-a2280af93fd1 HTTP/1.1" status: 200 len: 210 time: 0.0252757 Nov 09 04:46:18.249645 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33246) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:46:18.304465 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-dd699eaa-9074-4409-a8fd-f76fef39872b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:18.328918 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-dd699eaa-9074-4409-a8fd-f76fef39872b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:18.444749 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-dd699eaa-9074-4409-a8fd-f76fef39872b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:18.447363 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-dd699eaa-9074-4409-a8fd-f76fef39872b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:18.448514 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-dd699eaa-9074-4409-a8fd-f76fef39872b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "DELETE /v2.0/security-groups/8425d3b7-b361-4e0f-ad79-89882a770395 HTTP/1.1" status: 204 len: 168 time: 0.1978807 Nov 09 04:46:18.458678 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd699eaa-9074-4409-a8fd-f76fef39872b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=8425d3b7-b361-4e0f-ad79-89882a770395,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:46:18.532112 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33250) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:46:18.879628 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5bf85701-3367-466b-8608-ff4c272360ed tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:19.126067 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-5bf85701-3367-466b-8608-ff4c272360ed tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Deleting port 1307a903-74ab-4faf-8993-e69fd7140798 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:46:19.126427 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5bf85701-3367-466b-8608-ff4c272360ed tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:19.211413 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-5bf85701-3367-466b-8608-ff4c272360ed tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] For port 1307a903-74ab-4faf-8993-e69fd7140798, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=1307a903-74ab-4faf-8993-e69fd7140798,segment=NetworkSegment(9b73abc7-7651-4376-845b-e3dd90806c31),segment_id=9b73abc7-7651-4376-845b-e3dd90806c31)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:46:19.211679 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5bf85701-3367-466b-8608-ff4c272360ed tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:19.227576 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-5bf85701-3367-466b-8608-ff4c272360ed tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Calling delete_port for 1307a903-74ab-4faf-8993-e69fd7140798 owned by network:router_interface {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:46:19.472597 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5bf85701-3367-466b-8608-ff4c272360ed tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:19.500503 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bf85701-3367-466b-8608-ff4c272360ed tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'Port': ['ID=1307a903-74ab-4faf-8993-e69fd7140798,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:46:19.907397 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 9dea4e93-eac2-4ff4-bd09-131010862731 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:46:19.929065 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] No Port match for: 9dea4e93-eac2-4ff4-bd09-131010862731 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:46:19.929418 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 9dea4e93-eac2-4ff4-bd09-131010862731 not bound to the agent host hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:46:19.999575 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5bf85701-3367-466b-8608-ff4c272360ed tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:20.221700 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5bf85701-3367-466b-8608-ff4c272360ed tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Router ab3c88d0-a531-409f-8b0b-c18b0761c90a has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:46:20.326040 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5bf85701-3367-466b-8608-ff4c272360ed tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:46:20.332897 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-5bf85701-3367-466b-8608-ff4c272360ed tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "PUT /v2.0/routers/ab3c88d0-a531-409f-8b0b-c18b0761c90a/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7978368 Nov 09 04:46:20.333893 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33252) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:46:20.336445 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8adbced6-a87a-4f17-9b41-3116dc24e821 None None] Sync routers for ids ['ab3c88d0-a531-409f-8b0b-c18b0761c90a'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:46:20.345899 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8adbced6-a87a-4f17-9b41-3116dc24e821 None None] Routers {'ab3c88d0-a531-409f-8b0b-c18b0761c90a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:46:20.346546 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-8adbced6-a87a-4f17-9b41-3116dc24e821 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:46:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['ab3c88d0-a531-409f-8b0b-c18b0761c90a'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:46:20.383802 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-1c573f41-c1ae-4429-9446-a0376cf6849e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Deleting subnet 9e8e346c-8a1f-4dfb-8ad0-e87375cefb67 {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:46:20.387880 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1c573f41-c1ae-4429-9446-a0376cf6849e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:20.431943 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1c573f41-c1ae-4429-9446-a0376cf6849e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:20.525024 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1c573f41-c1ae-4429-9446-a0376cf6849e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:20.553804 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-8adbced6-a87a-4f17-9b41-3116dc24e821 None None] Set router ab3c88d0-a531-409f-8b0b-c18b0761c90a gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:46:20.651118 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1c573f41-c1ae-4429-9446-a0376cf6849e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:20.678454 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c573f41-c1ae-4429-9446-a0376cf6849e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'Subnet': ['ID=9e8e346c-8a1f-4dfb-8ad0-e87375cefb67,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:46:20.682091 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1c573f41-c1ae-4429-9446-a0376cf6849e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:20.685354 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-1c573f41-c1ae-4429-9446-a0376cf6849e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "DELETE /v2.0/subnets/9e8e346c-8a1f-4dfb-8ad0-e87375cefb67 HTTP/1.1" status: 204 len: 168 time: 0.3504972 Nov 09 04:46:20.688061 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33254) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:46:20.692665 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d0d8cc01-93c2-443b-a3e2-72e594a99910 None None] Network 1dad64b1-0a3e-4b78-a75f-959e3b1e79b8 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:46:20.733323 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-8adbced6-a87a-4f17-9b41-3116dc24e821 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'name': 'tempest-TestNetworkBasicOps-router-636046836', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.161'}], 'enable_snat': True}, 'gw_port_id': '8e2fba8e-7861-42b3-9f71-2ef66b096ca7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:44:41Z', 'updated_at': '2021-11-09T04:46:19Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '8e2fba8e-7861-42b3-9f71-2ef66b096ca7', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:d4:05:cb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1477, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.161', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:44:41Z', 'updated_at': '2021-11-09T04:44:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:46:20.759143 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8adbced6-a87a-4f17-9b41-3116dc24e821 None None] Checking router: ab3c88d0-a531-409f-8b0b-c18b0761c90a for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:46:20.769011 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8adbced6-a87a-4f17-9b41-3116dc24e821 None None] Routers {'ab3c88d0-a531-409f-8b0b-c18b0761c90a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:46:20.769611 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-8adbced6-a87a-4f17-9b41-3116dc24e821 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:46:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['ab3c88d0-a531-409f-8b0b-c18b0761c90a'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:46:20.801784 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a42cc97a-91d3-47a2-9984-9f614d18501e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:20.878104 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-8adbced6-a87a-4f17-9b41-3116dc24e821 None None] Set router ab3c88d0-a531-409f-8b0b-c18b0761c90a gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:46:20.885367 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-01efb8fc-aa07-4ed0-abf6-6d56cadfc618 None None] DHCP port deletion for 1dad64b1-0a3e-4b78-a75f-959e3b1e79b8 request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:46:20.918642 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a42cc97a-91d3-47a2-9984-9f614d18501e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router_gateway, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:20.939896 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-01efb8fc-aa07-4ed0-abf6-6d56cadfc618 None None] Deleting port c9696481-10e8-4597-ae96-c03504bfb517 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:46:20.940505 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-01efb8fc-aa07-4ed0-abf6-6d56cadfc618 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:21.003358 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-01efb8fc-aa07-4ed0-abf6-6d56cadfc618 None None] For port c9696481-10e8-4597-ae96-c03504bfb517, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=c9696481-10e8-4597-ae96-c03504bfb517,segment=NetworkSegment(9b73abc7-7651-4376-845b-e3dd90806c31),segment_id=9b73abc7-7651-4376-845b-e3dd90806c31)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:46:21.003845 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-01efb8fc-aa07-4ed0-abf6-6d56cadfc618 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:21.018898 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-01efb8fc-aa07-4ed0-abf6-6d56cadfc618 None None] Calling delete_port for c9696481-10e8-4597-ae96-c03504bfb517 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:46:21.030265 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-a42cc97a-91d3-47a2-9984-9f614d18501e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Deleting port 8e2fba8e-7861-42b3-9f71-2ef66b096ca7 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:46:21.030629 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a42cc97a-91d3-47a2-9984-9f614d18501e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:21.064849 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-8adbced6-a87a-4f17-9b41-3116dc24e821 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'name': 'tempest-TestNetworkBasicOps-router-636046836', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.161'}], 'enable_snat': True}, 'gw_port_id': '8e2fba8e-7861-42b3-9f71-2ef66b096ca7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:44:41Z', 'updated_at': '2021-11-09T04:46:19Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '8e2fba8e-7861-42b3-9f71-2ef66b096ca7', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:d4:05:cb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1477, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.161', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:44:41Z', 'updated_at': '2021-11-09T04:44:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:46:21.091907 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8adbced6-a87a-4f17-9b41-3116dc24e821 None None] The sync data for ids ['ab3c88d0-a531-409f-8b0b-c18b0761c90a'] in dv-neutron-816802-2-hyperv is: [{'id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'name': 'tempest-TestNetworkBasicOps-router-636046836', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.161'}], 'enable_snat': True}, 'gw_port_id': '8e2fba8e-7861-42b3-9f71-2ef66b096ca7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:44:41Z', 'updated_at': '2021-11-09T04:46:19Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': '8e2fba8e-7861-42b3-9f71-2ef66b096ca7', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:d4:05:cb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ab3c88d0-a531-409f-8b0b-c18b0761c90a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1477, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.161', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:44:41Z', 'updated_at': '2021-11-09T04:44:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:46:21.117111 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-a42cc97a-91d3-47a2-9984-9f614d18501e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] For port 8e2fba8e-7861-42b3-9f71-2ef66b096ca7, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=8e2fba8e-7861-42b3-9f71-2ef66b096ca7,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:46:21.117495 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a42cc97a-91d3-47a2-9984-9f614d18501e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:21.135965 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-a42cc97a-91d3-47a2-9984-9f614d18501e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Calling delete_port for 8e2fba8e-7861-42b3-9f71-2ef66b096ca7 owned by network:router_gateway {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:46:21.165111 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-01efb8fc-aa07-4ed0-abf6-6d56cadfc618 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:21.190556 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01efb8fc-aa07-4ed0-abf6-6d56cadfc618 None None] Pushing event deleted for resources: {'Port': ['ID=c9696481-10e8-4597-ae96-c03504bfb517,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:46:21.195230 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-01efb8fc-aa07-4ed0-abf6-6d56cadfc618 None None] No DVR routers for this DVR port c9696481-10e8-4597-ae96-c03504bfb517 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:46:21.202387 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-01efb8fc-aa07-4ed0-abf6-6d56cadfc618 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:46:21.202746 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-01efb8fc-aa07-4ed0-abf6-6d56cadfc618 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:46:21.205358 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-01efb8fc-aa07-4ed0-abf6-6d56cadfc618 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:46:21.205358 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-01efb8fc-aa07-4ed0-abf6-6d56cadfc618 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:46:21.205358 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-01efb8fc-aa07-4ed0-abf6-6d56cadfc618 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:46:21.205358 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-01efb8fc-aa07-4ed0-abf6-6d56cadfc618 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:46:21.205358 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-01efb8fc-aa07-4ed0-abf6-6d56cadfc618 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:46:21.205358 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-01efb8fc-aa07-4ed0-abf6-6d56cadfc618 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:46:21.205358 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-01efb8fc-aa07-4ed0-abf6-6d56cadfc618 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:46:21.205358 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-01efb8fc-aa07-4ed0-abf6-6d56cadfc618 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:46:21.206630 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-01efb8fc-aa07-4ed0-abf6-6d56cadfc618 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:46:21.206630 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-01efb8fc-aa07-4ed0-abf6-6d56cadfc618 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:46:21.365302 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a42cc97a-91d3-47a2-9984-9f614d18501e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:21.390991 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a42cc97a-91d3-47a2-9984-9f614d18501e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'Port': ['ID=8e2fba8e-7861-42b3-9f71-2ef66b096ca7,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:46:21.454506 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a42cc97a-91d3-47a2-9984-9f614d18501e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-466373'] for router_gateway, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:21.550734 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a42cc97a-91d3-47a2-9984-9f614d18501e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:21.558592 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a42cc97a-91d3-47a2-9984-9f614d18501e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:21.634071 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device c9696481-10e8-4597-ae96-c03504bfb517 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:46:21.655953 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: c9696481-10e8-4597-ae96-c03504bfb517 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:46:21.656513 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device c9696481-10e8-4597-ae96-c03504bfb517 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:46:21.657254 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 1307a903-74ab-4faf-8993-e69fd7140798 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:46:21.662446 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a42cc97a-91d3-47a2-9984-9f614d18501e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:21.662977 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a42cc97a-91d3-47a2-9984-9f614d18501e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Fanout notify agent at l3_agent the message router_deleted on router ab3c88d0-a531-409f-8b0b-c18b0761c90a {{(pid=102162) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:46:21.670544 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a42cc97a-91d3-47a2-9984-9f614d18501e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:21.674244 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a42cc97a-91d3-47a2-9984-9f614d18501e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "DELETE /v2.0/routers/ab3c88d0-a531-409f-8b0b-c18b0761c90a HTTP/1.1" status: 204 len: 168 time: 0.9827220 Nov 09 04:46:21.677700 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33256) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:46:21.677837 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 1307a903-74ab-4faf-8993-e69fd7140798 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:46:21.678059 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 1307a903-74ab-4faf-8993-e69fd7140798 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:46:21.753141 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e032e516-8c4a-43b8-bcb7-8d0fa470e7f7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:21.847405 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e032e516-8c4a-43b8-bcb7-8d0fa470e7f7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:21.867683 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-e032e516-8c4a-43b8-bcb7-8d0fa470e7f7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1dad64b1-0a3e-4b78-a75f-959e3b1e79b8']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:46:21.876828 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-e032e516-8c4a-43b8-bcb7-8d0fa470e7f7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9b73abc7-7651-4376-845b-e3dd90806c31') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:46:21.877125 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-e032e516-8c4a-43b8-bcb7-8d0fa470e7f7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9b73abc7-7651-4376-845b-e3dd90806c31') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:46:21.886528 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e032e516-8c4a-43b8-bcb7-8d0fa470e7f7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:21.901533 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e032e516-8c4a-43b8-bcb7-8d0fa470e7f7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:21.908000 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e032e516-8c4a-43b8-bcb7-8d0fa470e7f7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Releasing vlan 336 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:46:21.908401 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e032e516-8c4a-43b8-bcb7-8d0fa470e7f7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:21.911367 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:46:21.911367 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:46:21.911367 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:46:21.911367 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:46:21.911367 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:46:21.911367 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:46:21.911367 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:46:21.911367 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:46:21.911367 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:46:21.911367 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:46:21.911367 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:46:21.911367 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:46:21.911367 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:46:21.911367 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:46:21.911367 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:46:21.911367 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:46:21.911367 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:46:21.911367 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:46:21.911367 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:46:21.911367 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:46:21.911367 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:46:21.911367 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:46:21.911367 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:46:21.911367 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:46:21.911367 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:46:21.911367 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:46:21.911367 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:46:21.911367 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:46:21.911367 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:46:21.911367 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:46:21.911367 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:46:21.911367 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:46:22.050717 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e032e516-8c4a-43b8-bcb7-8d0fa470e7f7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:22.057529 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e032e516-8c4a-43b8-bcb7-8d0fa470e7f7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:22.060789 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e032e516-8c4a-43b8-bcb7-8d0fa470e7f7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "DELETE /v2.0/networks/1dad64b1-0a3e-4b78-a75f-959e3b1e79b8 HTTP/1.1" status: 204 len: 168 time: 0.3852832 Nov 09 04:46:22.074967 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e032e516-8c4a-43b8-bcb7-8d0fa470e7f7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'Network': ['ID=1dad64b1-0a3e-4b78-a75f-959e3b1e79b8,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:46:22.085279 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33258) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:46:22.091017 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-cbb76cac-7b10-499f-a911-7979276fd101 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'network': {'name': 'tempest-network-smoke--690671766', 'project_id': '1d10b4824e524068827e58b55e269af3', 'port_security_enabled': True}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:46:22.176284 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cbb76cac-7b10-499f-a911-7979276fd101 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Made reservation on behalf of 1d10b4824e524068827e58b55e269af3 for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:46:22.179775 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cbb76cac-7b10-499f-a911-7979276fd101 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:22.203534 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-cbb76cac-7b10-499f-a911-7979276fd101 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 335} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:46:22.212527 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cbb76cac-7b10-499f-a911-7979276fd101 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:22.212868 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-cbb76cac-7b10-499f-a911-7979276fd101 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Added segment a5eb9e23-3752-4ef9-8f5b-e308ed2db66c of type vlan for network d94a3ee1-87a4-4c0a-bb76-ba163a1da09e Nov 09 04:46:22.251650 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cbb76cac-7b10-499f-a911-7979276fd101 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:22.359099 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cbb76cac-7b10-499f-a911-7979276fd101 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:22.364798 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cbb76cac-7b10-499f-a911-7979276fd101 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:22.365371 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cbb76cac-7b10-499f-a911-7979276fd101 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:22.431825 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbb76cac-7b10-499f-a911-7979276fd101 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Network': ['ID=d94a3ee1-87a4-4c0a-bb76-ba163a1da09e,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:46:22.442103 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network d94a3ee1-87a4-4c0a-bb76-ba163a1da09e details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:46:22.447785 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-cbb76cac-7b10-499f-a911-7979276fd101 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.3614585 Nov 09 04:46:22.451245 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33260) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:46:22.455752 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-85965574-933d-4edb-bcd5-b76c0add9289 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'router': {'name': 'tempest-TestNetworkBasicOps-router-1242364910', 'admin_state_up': True, 'project_id': '1d10b4824e524068827e58b55e269af3', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:46:22.553036 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-85965574-933d-4edb-bcd5-b76c0add9289 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:22.554089 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-85965574-933d-4edb-bcd5-b76c0add9289 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:22.604428 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-85965574-933d-4edb-bcd5-b76c0add9289 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:22.804838 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-85965574-933d-4edb-bcd5-b76c0add9289 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:23.050643 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-85965574-933d-4edb-bcd5-b76c0add9289 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router_gateway, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:23.072464 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-85965574-933d-4edb-bcd5-b76c0add9289 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:23.170454 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-85965574-933d-4edb-bcd5-b76c0add9289 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Allocated IP 172.26.0.38 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/ba92efc6-6b25-4cf4-8928-e43ee8af86b3) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:46:23.270389 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-85965574-933d-4edb-bcd5-b76c0add9289 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:23.353616 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-85965574-933d-4edb-bcd5-b76c0add9289 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:23.388130 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-85965574-933d-4edb-bcd5-b76c0add9289 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:46:23.392375 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-85965574-933d-4edb-bcd5-b76c0add9289 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:46:23.397790 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-85965574-933d-4edb-bcd5-b76c0add9289 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:46:23.424911 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85965574-933d-4edb-bcd5-b76c0add9289 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Port': ['ID=ba92efc6-6b25-4cf4-8928-e43ee8af86b3,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:46:23.523854 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 8e2fba8e-7861-42b3-9f71-2ef66b096ca7 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:46:23.544927 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 8e2fba8e-7861-42b3-9f71-2ef66b096ca7 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:46:23.545276 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 8e2fba8e-7861-42b3-9f71-2ef66b096ca7 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:46:23.711822 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-85965574-933d-4edb-bcd5-b76c0add9289 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router_gateway, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:23.903274 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-85965574-933d-4edb-bcd5-b76c0add9289 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:24.096056 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-85965574-933d-4edb-bcd5-b76c0add9289 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Router 5387c31a-0c24-4e3c-affa-fa1ec6b6049c is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102162) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:46:24.201167 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-85965574-933d-4edb-bcd5-b76c0add9289 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:46:24.210529 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-86674dad-7a5c-4844-832a-750e50d7af70 None None] Sync routers for ids ['5387c31a-0c24-4e3c-affa-fa1ec6b6049c'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:46:24.221089 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-86674dad-7a5c-4844-832a-750e50d7af70 None None] Routers {'5387c31a-0c24-4e3c-affa-fa1ec6b6049c'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:46:24.221702 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-86674dad-7a5c-4844-832a-750e50d7af70 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:46:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['5387c31a-0c24-4e3c-affa-fa1ec6b6049c'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:46:24.275394 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-85965574-933d-4edb-bcd5-b76c0add9289 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:24.276722 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-85965574-933d-4edb-bcd5-b76c0add9289 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 886 time: 1.8245225 Nov 09 04:46:24.280481 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33262) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:46:24.307585 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-1a7b19cc-bf74-45e0-afb0-acc775009864 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/subnets?project_id=1d10b4824e524068827e58b55e269af3&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0259833 Nov 09 04:46:24.310182 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33264) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:46:24.336031 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-86674dad-7a5c-4844-832a-750e50d7af70 None None] Set router 5387c31a-0c24-4e3c-affa-fa1ec6b6049c gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:46:24.394274 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e0231e40-3a06-44b5-a403-58d1e6b7f6db tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:24.395697 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e0231e40-3a06-44b5-a403-58d1e6b7f6db tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.0845921 Nov 09 04:46:24.398561 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33266) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:46:24.428694 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-25ef702f-fefc-4c72-8c98-cec2555d5e43 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/subnets?network_id=2b6725f5-ebfe-485a-8f42-ccb5a241ddb5&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0291204 Nov 09 04:46:24.431243 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33268) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:46:24.436372 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-500b67e8-9749-450c-9b6f-d7392f206f28 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-362582603', 'network_id': 'd94a3ee1-87a4-4c0a-bb76-ba163a1da09e', 'project_id': '1d10b4824e524068827e58b55e269af3', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:46:24.515281 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-86674dad-7a5c-4844-832a-750e50d7af70 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5387c31a-0c24-4e3c-affa-fa1ec6b6049c', 'name': 'tempest-TestNetworkBasicOps-router-1242364910', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.38'}], 'enable_snat': True}, 'gw_port_id': 'ba92efc6-6b25-4cf4-8928-e43ee8af86b3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:46:22Z', 'updated_at': '2021-11-09T04:46:23Z', 'revision_number': 3, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': 'ba92efc6-6b25-4cf4-8928-e43ee8af86b3', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:c6:79', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5387c31a-0c24-4e3c-affa-fa1ec6b6049c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1508, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.38', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:46:23Z', 'updated_at': '2021-11-09T04:46:23Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:46:24.541034 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-86674dad-7a5c-4844-832a-750e50d7af70 None None] Checking router: 5387c31a-0c24-4e3c-affa-fa1ec6b6049c for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:46:24.541723 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-86674dad-7a5c-4844-832a-750e50d7af70 None None] Updating router 5387c31a-0c24-4e3c-affa-fa1ec6b6049c port ba92efc6-6b25-4cf4-8928-e43ee8af86b3 binding host dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 04:46:24.565651 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-86674dad-7a5c-4844-832a-750e50d7af70 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:24.580967 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-500b67e8-9749-450c-9b6f-d7392f206f28 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Made reservation on behalf of 1d10b4824e524068827e58b55e269af3 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:46:24.584938 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-500b67e8-9749-450c-9b6f-d7392f206f28 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:24.814694 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-86674dad-7a5c-4844-832a-750e50d7af70 None None] Publish callbacks [] for port, precommit_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:24.816753 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-500b67e8-9749-450c-9b6f-d7392f206f28 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:24.879527 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-500b67e8-9749-450c-9b6f-d7392f206f28 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Subnet': ['ID=5c7b951e-9bbe-42a8-b060-2593a9b43d55,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:46:24.883862 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-500b67e8-9749-450c-9b6f-d7392f206f28 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Checking segment: {'id': 'a5eb9e23-3752-4ef9-8f5b-e308ed2db66c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 335, 'network_id': 'd94a3ee1-87a4-4c0a-bb76-ba163a1da09e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:46:24.884224 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-500b67e8-9749-450c-9b6f-d7392f206f28 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network hostable DHCP agents. Network: d94a3ee1-87a4-4c0a-bb76-ba163a1da09e, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:46:24.936538 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-86674dad-7a5c-4844-832a-750e50d7af70 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:24.985870 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-86674dad-7a5c-4844-832a-750e50d7af70 None None] Attempting to bind port ba92efc6-6b25-4cf4-8928-e43ee8af86b3 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:46:24.986238 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-86674dad-7a5c-4844-832a-750e50d7af70 None None] Attempting to bind port ba92efc6-6b25-4cf4-8928-e43ee8af86b3 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:46:24.986630 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-86674dad-7a5c-4844-832a-750e50d7af70 None None] Attempting to bind port ba92efc6-6b25-4cf4-8928-e43ee8af86b3 on network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:46:24.991793 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a90a79d-81e1-4093-8390-131dea1f83cd None None] Pushing event updated for resources: {'Port': ['ID=ba92efc6-6b25-4cf4-8928-e43ee8af86b3,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:46:24.993634 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-500b67e8-9749-450c-9b6f-d7392f206f28 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network d94a3ee1-87a4-4c0a-bb76-ba163a1da09e is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:46:24.996201 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-86674dad-7a5c-4844-832a-750e50d7af70 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 46, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:46:24.996575 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-86674dad-7a5c-4844-832a-750e50d7af70 None None] Checking segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:46:24.996963 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-86674dad-7a5c-4844-832a-750e50d7af70 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:24.997345 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-86674dad-7a5c-4844-832a-750e50d7af70 None None] Bound using segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:46:24.997807 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-86674dad-7a5c-4844-832a-750e50d7af70 None None] Bound port: ba92efc6-6b25-4cf4-8928-e43ee8af86b3, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:46:24.998179 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-86674dad-7a5c-4844-832a-750e50d7af70 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:25.047560 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-86674dad-7a5c-4844-832a-750e50d7af70 None None] For port ba92efc6-6b25-4cf4-8928-e43ee8af86b3, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:46:25.050550 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-86674dad-7a5c-4844-832a-750e50d7af70 None None] For port ba92efc6-6b25-4cf4-8928-e43ee8af86b3, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=ba92efc6-6b25-4cf4-8928-e43ee8af86b3,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:46:25.091163 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-500b67e8-9749-450c-9b6f-d7392f206f28 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, d94a3ee1-87a4-4c0a-bb76-ba163a1da09e) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:46:25.096324 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-500b67e8-9749-450c-9b6f-d7392f206f28 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:25.096898 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-500b67e8-9749-450c-9b6f-d7392f206f28 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:25.101073 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d6195adc-2259-4da3-ba3f-4231cce83cba None None] Network d94a3ee1-87a4-4c0a-bb76-ba163a1da09e requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:46:25.121589 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-86674dad-7a5c-4844-832a-750e50d7af70 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:25.179680 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-500b67e8-9749-450c-9b6f-d7392f206f28 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 831 time: 0.7471659 Nov 09 04:46:25.182985 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33270) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:46:25.230672 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-86674dad-7a5c-4844-832a-750e50d7af70 None None] Routers {'5387c31a-0c24-4e3c-affa-fa1ec6b6049c'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:46:25.231291 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-86674dad-7a5c-4844-832a-750e50d7af70 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:46:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['5387c31a-0c24-4e3c-affa-fa1ec6b6049c'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:46:25.232912 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a90a79d-81e1-4093-8390-131dea1f83cd None None] Pushing event updated for resources: {'Port': ['ID=ba92efc6-6b25-4cf4-8928-e43ee8af86b3,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:46:25.377511 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4348453f-e749-4453-b84a-1f4369aaecc4 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-d94a3ee1-87a4-4c0a-bb76-ba163a1da09e', 'network_id': 'd94a3ee1-87a4-4c0a-bb76-ba163a1da09e', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ips': [{'subnet_id': '5c7b951e-9bbe-42a8-b060-2593a9b43d55'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:46:25.378345 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4348453f-e749-4453-b84a-1f4369aaecc4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:25.540742 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-86674dad-7a5c-4844-832a-750e50d7af70 None None] Set router 5387c31a-0c24-4e3c-affa-fa1ec6b6049c gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:46:25.638519 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8661e869-d5aa-40bf-b777-f4290f1fb7be tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:25.796105 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-4348453f-e749-4453-b84a-1f4369aaecc4 None None] Allocated IP 172.20.0.2 (d94a3ee1-87a4-4c0a-bb76-ba163a1da09e/5c7b951e-9bbe-42a8-b060-2593a9b43d55/491fba02-7da3-4a54-9393-b4da06ff0c8a) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:46:25.886335 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-86674dad-7a5c-4844-832a-750e50d7af70 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5387c31a-0c24-4e3c-affa-fa1ec6b6049c', 'name': 'tempest-TestNetworkBasicOps-router-1242364910', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.38'}], 'enable_snat': True}, 'gw_port_id': 'ba92efc6-6b25-4cf4-8928-e43ee8af86b3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:46:22Z', 'updated_at': '2021-11-09T04:46:23Z', 'revision_number': 3, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': 'ba92efc6-6b25-4cf4-8928-e43ee8af86b3', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:c6:79', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5387c31a-0c24-4e3c-affa-fa1ec6b6049c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1508, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.38', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:46:23Z', 'updated_at': '2021-11-09T04:46:25Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:46:25.922065 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-86674dad-7a5c-4844-832a-750e50d7af70 None None] The sync data for ids ['5387c31a-0c24-4e3c-affa-fa1ec6b6049c'] in dv-neutron-816802-2-hyperv is: [{'id': '5387c31a-0c24-4e3c-affa-fa1ec6b6049c', 'name': 'tempest-TestNetworkBasicOps-router-1242364910', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.38'}], 'enable_snat': True}, 'gw_port_id': 'ba92efc6-6b25-4cf4-8928-e43ee8af86b3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:46:22Z', 'updated_at': '2021-11-09T04:46:23Z', 'revision_number': 3, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': 'ba92efc6-6b25-4cf4-8928-e43ee8af86b3', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:c6:79', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5387c31a-0c24-4e3c-affa-fa1ec6b6049c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1508, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.38', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:46:23Z', 'updated_at': '2021-11-09T04:46:25Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:46:25.996966 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4348453f-e749-4453-b84a-1f4369aaecc4 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:26.097869 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4348453f-e749-4453-b84a-1f4369aaecc4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:26.154758 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4348453f-e749-4453-b84a-1f4369aaecc4 None None] Network d94a3ee1-87a4-4c0a-bb76-ba163a1da09e is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:46:26.159655 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-4348453f-e749-4453-b84a-1f4369aaecc4 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:46:26.163217 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4348453f-e749-4453-b84a-1f4369aaecc4 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:46:26.176606 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4348453f-e749-4453-b84a-1f4369aaecc4 None None] Pushing event updated for resources: {'Port': ['ID=491fba02-7da3-4a54-9393-b4da06ff0c8a,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:46:26.232051 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-4348453f-e749-4453-b84a-1f4369aaecc4 None None] Attempting to bind port 491fba02-7da3-4a54-9393-b4da06ff0c8a on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:46:26.232564 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-4348453f-e749-4453-b84a-1f4369aaecc4 None None] Attempting to bind port 491fba02-7da3-4a54-9393-b4da06ff0c8a by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'a5eb9e23-3752-4ef9-8f5b-e308ed2db66c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 335, 'network_id': 'd94a3ee1-87a4-4c0a-bb76-ba163a1da09e'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:46:26.232936 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4348453f-e749-4453-b84a-1f4369aaecc4 None None] Attempting to bind port 491fba02-7da3-4a54-9393-b4da06ff0c8a on network d94a3ee1-87a4-4c0a-bb76-ba163a1da09e {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:46:26.238481 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4348453f-e749-4453-b84a-1f4369aaecc4 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 46, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:46:26.238865 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4348453f-e749-4453-b84a-1f4369aaecc4 None None] Checking segment: {'id': 'a5eb9e23-3752-4ef9-8f5b-e308ed2db66c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 335, 'network_id': 'd94a3ee1-87a4-4c0a-bb76-ba163a1da09e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:46:26.239265 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4348453f-e749-4453-b84a-1f4369aaecc4 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:26.239659 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4348453f-e749-4453-b84a-1f4369aaecc4 None None] Bound using segment: {'id': 'a5eb9e23-3752-4ef9-8f5b-e308ed2db66c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 335, 'network_id': 'd94a3ee1-87a4-4c0a-bb76-ba163a1da09e'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:46:26.240920 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-4348453f-e749-4453-b84a-1f4369aaecc4 None None] Bound port: 491fba02-7da3-4a54-9393-b4da06ff0c8a, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a5eb9e23-3752-4ef9-8f5b-e308ed2db66c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 335, 'network_id': 'd94a3ee1-87a4-4c0a-bb76-ba163a1da09e'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:46:26.240920 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4348453f-e749-4453-b84a-1f4369aaecc4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:26.306658 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-4348453f-e749-4453-b84a-1f4369aaecc4 None None] For port 491fba02-7da3-4a54-9393-b4da06ff0c8a, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:46:26.310634 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-4348453f-e749-4453-b84a-1f4369aaecc4 None None] For port 491fba02-7da3-4a54-9393-b4da06ff0c8a, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=491fba02-7da3-4a54-9393-b4da06ff0c8a,segment=NetworkSegment(a5eb9e23-3752-4ef9-8f5b-e308ed2db66c),segment_id=a5eb9e23-3752-4ef9-8f5b-e308ed2db66c)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:46:26.320344 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-8661e869-d5aa-40bf-b777-f4290f1fb7be tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Allocated IP 172.20.0.1 (d94a3ee1-87a4-4c0a-bb76-ba163a1da09e/5c7b951e-9bbe-42a8-b060-2593a9b43d55/704374ec-101b-43d6-885d-6f94bd9e79f5) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:46:26.383440 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4348453f-e749-4453-b84a-1f4369aaecc4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:26.447404 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4348453f-e749-4453-b84a-1f4369aaecc4 None None] Pushing event updated for resources: {'Port': ['ID=491fba02-7da3-4a54-9393-b4da06ff0c8a,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:46:26.451480 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8661e869-d5aa-40bf-b777-f4290f1fb7be tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:26.571220 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8661e869-d5aa-40bf-b777-f4290f1fb7be tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:26.630486 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8661e869-d5aa-40bf-b777-f4290f1fb7be tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network d94a3ee1-87a4-4c0a-bb76-ba163a1da09e is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:46:26.635388 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-8661e869-d5aa-40bf-b777-f4290f1fb7be tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:46:26.640300 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8661e869-d5aa-40bf-b777-f4290f1fb7be tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:46:26.667015 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8661e869-d5aa-40bf-b777-f4290f1fb7be tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Port': ['ID=704374ec-101b-43d6-885d-6f94bd9e79f5,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:46:26.692056 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8661e869-d5aa-40bf-b777-f4290f1fb7be tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:26.891646 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8661e869-d5aa-40bf-b777-f4290f1fb7be tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:27.172376 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8661e869-d5aa-40bf-b777-f4290f1fb7be tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:27.227995 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8661e869-d5aa-40bf-b777-f4290f1fb7be tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:27.301982 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8661e869-d5aa-40bf-b777-f4290f1fb7be tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:27.303687 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8661e869-d5aa-40bf-b777-f4290f1fb7be tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Port': ['ID=704374ec-101b-43d6-885d-6f94bd9e79f5,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:46:27.307328 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5a2274d2-b61c-4a45-ad1f-db11581e3c9d None None] Network d94a3ee1-87a4-4c0a-bb76-ba163a1da09e requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:46:27.398128 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8661e869-d5aa-40bf-b777-f4290f1fb7be tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network d94a3ee1-87a4-4c0a-bb76-ba163a1da09e is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:46:27.400172 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-8661e869-d5aa-40bf-b777-f4290f1fb7be tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:46:27.438090 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-c998def5-e1f1-4c9d-8f7a-8d1df8abb40e None None] Provisioning complete for port 491fba02-7da3-4a54-9393-b4da06ff0c8a triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:46:27.438758 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c998def5-e1f1-4c9d-8f7a-8d1df8abb40e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:27.522247 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8661e869-d5aa-40bf-b777-f4290f1fb7be tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Router 5387c31a-0c24-4e3c-affa-fa1ec6b6049c has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:46:27.555238 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c998def5-e1f1-4c9d-8f7a-8d1df8abb40e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:27.603559 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-c998def5-e1f1-4c9d-8f7a-8d1df8abb40e None None] For port 491fba02-7da3-4a54-9393-b4da06ff0c8a, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=491fba02-7da3-4a54-9393-b4da06ff0c8a,segment=NetworkSegment(a5eb9e23-3752-4ef9-8f5b-e308ed2db66c),segment_id=a5eb9e23-3752-4ef9-8f5b-e308ed2db66c)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:46:27.650279 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8661e869-d5aa-40bf-b777-f4290f1fb7be tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:46:27.656669 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-8661e869-d5aa-40bf-b777-f4290f1fb7be tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "PUT /v2.0/routers/5387c31a-0c24-4e3c-affa-fa1ec6b6049c/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.4720814 Nov 09 04:46:27.659015 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33272) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:46:27.668695 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c998def5-e1f1-4c9d-8f7a-8d1df8abb40e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:27.710425 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 491fba02-7da3-4a54-9393-b4da06ff0c8a up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:46:27.759880 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c998def5-e1f1-4c9d-8f7a-8d1df8abb40e None None] Pushing event updated for resources: {'Port': ['ID=491fba02-7da3-4a54-9393-b4da06ff0c8a,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:46:27.775064 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6786b879-2cb6-422c-874c-696a58eef198 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:27.775566 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6786b879-2cb6-422c-874c-696a58eef198 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:27.776000 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6786b879-2cb6-422c-874c-696a58eef198 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:27.776437 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6786b879-2cb6-422c-874c-696a58eef198 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:27.778730 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-6786b879-2cb6-422c-874c-696a58eef198 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/networks HTTP/1.1" status: 200 len: 2885 time: 0.1187198 Nov 09 04:46:27.781563 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33274) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:46:27.787371 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 491fba02-7da3-4a54-9393-b4da06ff0c8a triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:46:27.787832 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:27.842869 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4fc6272a-8335-42c8-afd6-a427fc434927 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:27.843504 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4fc6272a-8335-42c8-afd6-a427fc434927 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:27.844027 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4fc6272a-8335-42c8-afd6-a427fc434927 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:27.844539 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4fc6272a-8335-42c8-afd6-a427fc434927 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:27.848853 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-4fc6272a-8335-42c8-afd6-a427fc434927 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2727 time: 0.0639646 Nov 09 04:46:27.849215 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33276) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:46:27.864850 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7381a7fe-2935-43a6-b934-e8cbf432ebcf None None] Sync routers for ids ['5387c31a-0c24-4e3c-affa-fa1ec6b6049c'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:46:27.875659 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7381a7fe-2935-43a6-b934-e8cbf432ebcf None None] Routers {'5387c31a-0c24-4e3c-affa-fa1ec6b6049c'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:46:27.876431 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-7381a7fe-2935-43a6-b934-e8cbf432ebcf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:46:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['5387c31a-0c24-4e3c-affa-fa1ec6b6049c'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:46:27.897372 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device ba92efc6-6b25-4cf4-8928-e43ee8af86b3 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:46:27.939968 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-3de601cb-e241-4d56-9b17-52838ab7e14b None None] Provisioning complete for port 491fba02-7da3-4a54-9393-b4da06ff0c8a triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:46:27.940343 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3de601cb-e241-4d56-9b17-52838ab7e14b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:28.003724 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-ec713297-1604-4e74-96e3-7d8dc74ffb86 tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/routers HTTP/1.1" status: 200 len: 1606 time: 0.1533105 Nov 09 04:46:28.004651 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port ba92efc6-6b25-4cf4-8928-e43ee8af86b3 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:46:28.005028 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:28.017070 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-7381a7fe-2935-43a6-b934-e8cbf432ebcf None None] Set router 5387c31a-0c24-4e3c-affa-fa1ec6b6049c gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:46:28.136811 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:28.144097 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-3de601cb-e241-4d56-9b17-52838ab7e14b None None] Provisioning complete for port 704374ec-101b-43d6-885d-6f94bd9e79f5 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:46:28.144614 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3de601cb-e241-4d56-9b17-52838ab7e14b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:28.185985 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-3de601cb-e241-4d56-9b17-52838ab7e14b None None] Port 704374ec-101b-43d6-885d-6f94bd9e79f5 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:46:28.202807 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port ba92efc6-6b25-4cf4-8928-e43ee8af86b3, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=ba92efc6-6b25-4cf4-8928-e43ee8af86b3,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:46:28.229507 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-7381a7fe-2935-43a6-b934-e8cbf432ebcf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5387c31a-0c24-4e3c-affa-fa1ec6b6049c', 'name': 'tempest-TestNetworkBasicOps-router-1242364910', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.38'}], 'enable_snat': True}, 'gw_port_id': 'ba92efc6-6b25-4cf4-8928-e43ee8af86b3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:46:22Z', 'updated_at': '2021-11-09T04:46:26Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': 'ba92efc6-6b25-4cf4-8928-e43ee8af86b3', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:c6:79', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5387c31a-0c24-4e3c-affa-fa1ec6b6049c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1508, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.38', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:46:23Z', 'updated_at': '2021-11-09T04:46:25Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '704374ec-101b-43d6-885d-6f94bd9e79f5', 'name': '', 'network_id': 'd94a3ee1-87a4-4c0a-bb76-ba163a1da09e', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:39:ed:c3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5387c31a-0c24-4e3c-affa-fa1ec6b6049c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1511, 'fixed_ips': [{'subnet_id': '5c7b951e-9bbe-42a8-b060-2593a9b43d55', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:46:26Z', 'updated_at': '2021-11-09T04:46:27Z', 'revision_number': 2, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '5c7b951e-9bbe-42a8-b060-2593a9b43d55', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:46:28.257340 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7381a7fe-2935-43a6-b934-e8cbf432ebcf None None] Checking router: 5387c31a-0c24-4e3c-affa-fa1ec6b6049c for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:46:28.257683 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7381a7fe-2935-43a6-b934-e8cbf432ebcf None None] Updating router 5387c31a-0c24-4e3c-affa-fa1ec6b6049c port 704374ec-101b-43d6-885d-6f94bd9e79f5 binding host dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 04:46:28.269592 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:28.285431 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-7381a7fe-2935-43a6-b934-e8cbf432ebcf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:28.326087 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e7fcc320-5014-432f-8132-31ea6eeeec64 None None] Provisioning complete for port 704374ec-101b-43d6-885d-6f94bd9e79f5 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:46:28.326657 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e7fcc320-5014-432f-8132-31ea6eeeec64 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:28.329020 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=ba92efc6-6b25-4cf4-8928-e43ee8af86b3,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:46:28.360719 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33280) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:46:28.365312 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-3c13eacc-af9b-418d-8253-591e98989258 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1665363080', 'description': 'tempest-secgroup-smoke-1665363080 description', 'project_id': '1d10b4824e524068827e58b55e269af3'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:46:28.366686 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e7fcc320-5014-432f-8132-31ea6eeeec64 None None] Port 704374ec-101b-43d6-885d-6f94bd9e79f5 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:46:28.450005 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3c13eacc-af9b-418d-8253-591e98989258 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:28.487889 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-c17b0766-c611-41b1-a8ab-1c6504015c19 None None] Provisioning complete for port 704374ec-101b-43d6-885d-6f94bd9e79f5 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:46:28.488571 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c17b0766-c611-41b1-a8ab-1c6504015c19 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:28.522787 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-c17b0766-c611-41b1-a8ab-1c6504015c19 None None] Port 704374ec-101b-43d6-885d-6f94bd9e79f5 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:46:28.523023 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3c13eacc-af9b-418d-8253-591e98989258 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:28.558825 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-7381a7fe-2935-43a6-b934-e8cbf432ebcf None None] Publish callbacks [] for port, precommit_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:28.586904 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3c13eacc-af9b-418d-8253-591e98989258 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:28.615439 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-7381a7fe-2935-43a6-b934-e8cbf432ebcf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:28.620141 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c13eacc-af9b-418d-8253-591e98989258 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroup': ['ID=ded86ab2-85c5-4652-99a6-99be87d49327,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:46:28.664976 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18dd6855-9ea0-476b-8dae-48cc72b1354d None None] Pushing event updated for resources: {'Port': ['ID=704374ec-101b-43d6-885d-6f94bd9e79f5,revision_number=3']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:46:28.670607 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3c13eacc-af9b-418d-8253-591e98989258 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:28.672979 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-3c13eacc-af9b-418d-8253-591e98989258 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.3102005 Nov 09 04:46:28.679198 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33282) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:46:28.684292 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-007106a4-a3fd-474f-8959-cb3141629948 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': 'ded86ab2-85c5-4652-99a6-99be87d49327', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:46:28.688665 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18dd6855-9ea0-476b-8dae-48cc72b1354d None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:46:28.689010 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18dd6855-9ea0-476b-8dae-48cc72b1354d None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:46:28.689338 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18dd6855-9ea0-476b-8dae-48cc72b1354d None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:46:28.689662 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18dd6855-9ea0-476b-8dae-48cc72b1354d None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:46:28.689984 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18dd6855-9ea0-476b-8dae-48cc72b1354d None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:46:28.690301 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18dd6855-9ea0-476b-8dae-48cc72b1354d None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:46:28.690663 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18dd6855-9ea0-476b-8dae-48cc72b1354d None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:46:28.690967 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18dd6855-9ea0-476b-8dae-48cc72b1354d None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:46:28.691278 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18dd6855-9ea0-476b-8dae-48cc72b1354d None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:46:28.691593 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18dd6855-9ea0-476b-8dae-48cc72b1354d None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:46:28.691903 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18dd6855-9ea0-476b-8dae-48cc72b1354d None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:46:28.692491 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18dd6855-9ea0-476b-8dae-48cc72b1354d None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:46:28.723905 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-7381a7fe-2935-43a6-b934-e8cbf432ebcf None None] Attempting to bind port 704374ec-101b-43d6-885d-6f94bd9e79f5 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:46:28.724266 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-7381a7fe-2935-43a6-b934-e8cbf432ebcf None None] Attempting to bind port 704374ec-101b-43d6-885d-6f94bd9e79f5 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'a5eb9e23-3752-4ef9-8f5b-e308ed2db66c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 335, 'network_id': 'd94a3ee1-87a4-4c0a-bb76-ba163a1da09e'}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:46:28.724618 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7381a7fe-2935-43a6-b934-e8cbf432ebcf None None] Attempting to bind port 704374ec-101b-43d6-885d-6f94bd9e79f5 on network d94a3ee1-87a4-4c0a-bb76-ba163a1da09e {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:46:28.729653 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7381a7fe-2935-43a6-b934-e8cbf432ebcf None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 46, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:46:28.730122 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7381a7fe-2935-43a6-b934-e8cbf432ebcf None None] Checking segment: {'id': 'a5eb9e23-3752-4ef9-8f5b-e308ed2db66c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 335, 'network_id': 'd94a3ee1-87a4-4c0a-bb76-ba163a1da09e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102164) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:46:28.730440 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-7381a7fe-2935-43a6-b934-e8cbf432ebcf None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:28.730823 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7381a7fe-2935-43a6-b934-e8cbf432ebcf None None] Bound using segment: {'id': 'a5eb9e23-3752-4ef9-8f5b-e308ed2db66c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 335, 'network_id': 'd94a3ee1-87a4-4c0a-bb76-ba163a1da09e'} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:46:28.731273 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-7381a7fe-2935-43a6-b934-e8cbf432ebcf None None] Bound port: 704374ec-101b-43d6-885d-6f94bd9e79f5, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a5eb9e23-3752-4ef9-8f5b-e308ed2db66c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 335, 'network_id': 'd94a3ee1-87a4-4c0a-bb76-ba163a1da09e'}}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:46:28.731639 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-7381a7fe-2935-43a6-b934-e8cbf432ebcf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:28.771191 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-007106a4-a3fd-474f-8959-cb3141629948 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:28.804557 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-7381a7fe-2935-43a6-b934-e8cbf432ebcf None None] For port 704374ec-101b-43d6-885d-6f94bd9e79f5, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102164) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:46:28.807695 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-7381a7fe-2935-43a6-b934-e8cbf432ebcf None None] For port 704374ec-101b-43d6-885d-6f94bd9e79f5, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=704374ec-101b-43d6-885d-6f94bd9e79f5,segment=NetworkSegment(a5eb9e23-3752-4ef9-8f5b-e308ed2db66c),segment_id=a5eb9e23-3752-4ef9-8f5b-e308ed2db66c)] {{(pid=102164) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:46:28.832020 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-007106a4-a3fd-474f-8959-cb3141629948 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:28.845190 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-7381a7fe-2935-43a6-b934-e8cbf432ebcf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:28.885288 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-007106a4-a3fd-474f-8959-cb3141629948 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:28.906528 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-007106a4-a3fd-474f-8959-cb3141629948 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=220f3c6f-bb79-4d01-8dde-015716a11bbb,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:46:28.948386 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-cc690d7a-b517-4dad-ac56-182be43a7fde None None] Provisioning complete for port 704374ec-101b-43d6-885d-6f94bd9e79f5 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:46:28.948761 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-cc690d7a-b517-4dad-ac56-182be43a7fde None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:28.950283 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-007106a4-a3fd-474f-8959-cb3141629948 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:28.954412 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 33284) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:46:28.955654 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-007106a4-a3fd-474f-8959-cb3141629948 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2742133 Nov 09 04:46:28.960639 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-ce983a6f-cd95-4b40-a6a3-82a9dd178723 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': 'ded86ab2-85c5-4652-99a6-99be87d49327', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:46:28.985050 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18dd6855-9ea0-476b-8dae-48cc72b1354d None None] Pushing event updated for resources: {'Port': ['ID=704374ec-101b-43d6-885d-6f94bd9e79f5,revision_number=4']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:46:29.002344 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7381a7fe-2935-43a6-b934-e8cbf432ebcf None None] Routers {'5387c31a-0c24-4e3c-affa-fa1ec6b6049c'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:46:29.003014 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-7381a7fe-2935-43a6-b934-e8cbf432ebcf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:46:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['5387c31a-0c24-4e3c-affa-fa1ec6b6049c'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:46:29.039199 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-cc690d7a-b517-4dad-ac56-182be43a7fde None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:29.076930 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-cc690d7a-b517-4dad-ac56-182be43a7fde None None] For port 704374ec-101b-43d6-885d-6f94bd9e79f5, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=704374ec-101b-43d6-885d-6f94bd9e79f5,segment=NetworkSegment(a5eb9e23-3752-4ef9-8f5b-e308ed2db66c),segment_id=a5eb9e23-3752-4ef9-8f5b-e308ed2db66c)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:46:29.081498 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ce983a6f-cd95-4b40-a6a3-82a9dd178723 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:29.117016 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-7381a7fe-2935-43a6-b934-e8cbf432ebcf None None] Set router 5387c31a-0c24-4e3c-affa-fa1ec6b6049c gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:46:29.134600 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ce983a6f-cd95-4b40-a6a3-82a9dd178723 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:29.147764 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-cc690d7a-b517-4dad-ac56-182be43a7fde None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:29.196688 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc690d7a-b517-4dad-ac56-182be43a7fde None None] Pushing event updated for resources: {'Port': ['ID=704374ec-101b-43d6-885d-6f94bd9e79f5,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:46:29.203722 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ce983a6f-cd95-4b40-a6a3-82a9dd178723 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:29.222325 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce983a6f-cd95-4b40-a6a3-82a9dd178723 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6f13aeab-7312-4d66-91b6-5351fd5a37f1,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:46:29.269483 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-c2a5a115-f9ae-4cb8-b32d-b11220b199e2 None None] Provisioning complete for port 704374ec-101b-43d6-885d-6f94bd9e79f5 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:46:29.269849 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c2a5a115-f9ae-4cb8-b32d-b11220b199e2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:29.287105 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ce983a6f-cd95-4b40-a6a3-82a9dd178723 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:29.288346 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-ce983a6f-cd95-4b40-a6a3-82a9dd178723 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.3316064 Nov 09 04:46:29.291146 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 33286) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:46:29.296604 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-44d1abbb-516c-4048-b611-05fc1d675a47 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': 'ded86ab2-85c5-4652-99a6-99be87d49327', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:46:29.326855 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-7381a7fe-2935-43a6-b934-e8cbf432ebcf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5387c31a-0c24-4e3c-affa-fa1ec6b6049c', 'name': 'tempest-TestNetworkBasicOps-router-1242364910', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.38'}], 'enable_snat': True}, 'gw_port_id': 'ba92efc6-6b25-4cf4-8928-e43ee8af86b3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:46:22Z', 'updated_at': '2021-11-09T04:46:26Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': 'ba92efc6-6b25-4cf4-8928-e43ee8af86b3', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:c6:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5387c31a-0c24-4e3c-affa-fa1ec6b6049c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1508, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.38', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:46:23Z', 'updated_at': '2021-11-09T04:46:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '704374ec-101b-43d6-885d-6f94bd9e79f5', 'name': '', 'network_id': 'd94a3ee1-87a4-4c0a-bb76-ba163a1da09e', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:39:ed:c3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5387c31a-0c24-4e3c-affa-fa1ec6b6049c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1511, 'fixed_ips': [{'subnet_id': '5c7b951e-9bbe-42a8-b060-2593a9b43d55', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:46:26Z', 'updated_at': '2021-11-09T04:46:28Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '5c7b951e-9bbe-42a8-b060-2593a9b43d55', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:46:29.358914 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7381a7fe-2935-43a6-b934-e8cbf432ebcf None None] The sync data for ids ['5387c31a-0c24-4e3c-affa-fa1ec6b6049c'] in dv-neutron-816802-2-hyperv is: [{'id': '5387c31a-0c24-4e3c-affa-fa1ec6b6049c', 'name': 'tempest-TestNetworkBasicOps-router-1242364910', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.38'}], 'enable_snat': True}, 'gw_port_id': 'ba92efc6-6b25-4cf4-8928-e43ee8af86b3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:46:22Z', 'updated_at': '2021-11-09T04:46:26Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': 'ba92efc6-6b25-4cf4-8928-e43ee8af86b3', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:c6:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5387c31a-0c24-4e3c-affa-fa1ec6b6049c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1508, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.38', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:46:23Z', 'updated_at': '2021-11-09T04:46:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '704374ec-101b-43d6-885d-6f94bd9e79f5', 'name': '', 'network_id': 'd94a3ee1-87a4-4c0a-bb76-ba163a1da09e', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:39:ed:c3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5387c31a-0c24-4e3c-affa-fa1ec6b6049c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1511, 'fixed_ips': [{'subnet_id': '5c7b951e-9bbe-42a8-b060-2593a9b43d55', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:46:26Z', 'updated_at': '2021-11-09T04:46:28Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '5c7b951e-9bbe-42a8-b060-2593a9b43d55', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:46:29.396277 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-44d1abbb-516c-4048-b611-05fc1d675a47 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:29.469282 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-44d1abbb-516c-4048-b611-05fc1d675a47 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:29.542094 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-44d1abbb-516c-4048-b611-05fc1d675a47 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:29.561601 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44d1abbb-516c-4048-b611-05fc1d675a47 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d7f68903-c36b-410e-829b-26cea4ce61f6,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:46:29.644610 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 491fba02-7da3-4a54-9393-b4da06ff0c8a up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:46:29.647017 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-44d1abbb-516c-4048-b611-05fc1d675a47 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:29.648491 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-44d1abbb-516c-4048-b611-05fc1d675a47 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3559186 Nov 09 04:46:29.651259 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33288) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:46:29.657074 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-319ac0d0-9ea9-46d2-979a-b088bc280a0e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': 'ded86ab2-85c5-4652-99a6-99be87d49327', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:46:29.697821 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 491fba02-7da3-4a54-9393-b4da06ff0c8a triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:46:29.698192 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:29.741791 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-319ac0d0-9ea9-46d2-979a-b088bc280a0e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:29.783663 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 704374ec-101b-43d6-885d-6f94bd9e79f5 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:46:29.809564 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-319ac0d0-9ea9-46d2-979a-b088bc280a0e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:29.838033 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 704374ec-101b-43d6-885d-6f94bd9e79f5 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:46:29.838033 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:29.885934 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-319ac0d0-9ea9-46d2-979a-b088bc280a0e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:29.915293 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-319ac0d0-9ea9-46d2-979a-b088bc280a0e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=08f4d9f7-286b-4517-b73f-4bb2daaf202a,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:46:29.932294 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device ba92efc6-6b25-4cf4-8928-e43ee8af86b3 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:46:29.985705 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port ba92efc6-6b25-4cf4-8928-e43ee8af86b3 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:46:29.985705 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:30.126228 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-319ac0d0-9ea9-46d2-979a-b088bc280a0e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:30.127568 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-319ac0d0-9ea9-46d2-979a-b088bc280a0e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.4741721 Nov 09 04:46:30.135603 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33290) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:46:30.140107 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-b58de91d-b4f8-4985-9e1a-1aa98a6c82fa tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': 'ded86ab2-85c5-4652-99a6-99be87d49327', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:46:30.239117 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.securitygroups_db [None req-b58de91d-b4f8-4985-9e1a-1aa98a6c82fa tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Project 1d10b4824e524068827e58b55e269af3 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 09 04:46:30.244876 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b58de91d-b4f8-4985-9e1a-1aa98a6c82fa tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:30.308561 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b58de91d-b4f8-4985-9e1a-1aa98a6c82fa tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:30.398829 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b58de91d-b4f8-4985-9e1a-1aa98a6c82fa tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:30.421438 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b58de91d-b4f8-4985-9e1a-1aa98a6c82fa tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=be0c407e-c43b-4198-a01e-ac52c35d637c,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:46:30.492146 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b58de91d-b4f8-4985-9e1a-1aa98a6c82fa tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:30.493360 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-b58de91d-b4f8-4985-9e1a-1aa98a6c82fa tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.3567982 Nov 09 04:46:30.496339 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33292) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:46:30.500696 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-ffba2726-3b1e-4c4a-ab8a-02a5f97cea61 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'security_group_rule': {'security_group_id': 'ded86ab2-85c5-4652-99a6-99be87d49327', 'project_id': '1d10b4824e524068827e58b55e269af3', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:46:30.581780 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.securitygroups_db [None req-ffba2726-3b1e-4c4a-ab8a-02a5f97cea61 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Project 1d10b4824e524068827e58b55e269af3 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 09 04:46:30.587616 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ffba2726-3b1e-4c4a-ab8a-02a5f97cea61 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:30.646637 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ffba2726-3b1e-4c4a-ab8a-02a5f97cea61 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:30.724393 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ffba2726-3b1e-4c4a-ab8a-02a5f97cea61 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:30.744780 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffba2726-3b1e-4c4a-ab8a-02a5f97cea61 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=dae3d459-d6ac-44b5-9aa9-00c1f53dc327,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:46:30.812404 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ffba2726-3b1e-4c4a-ab8a-02a5f97cea61 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:30.815019 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-ffba2726-3b1e-4c4a-ab8a-02a5f97cea61 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.3164849 Nov 09 04:46:30.976534 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ffe62024-62a9-4557-a944-ff53f2b4aeff req-0f002079-9753-4087-9781-a7fa10295d5d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1665363080&fields=id&tenant_id=1d10b4824e524068827e58b55e269af3 HTTP/1.1" status: 200 len: 267 time: 0.0454726 Nov 09 04:46:31.095416 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffe62024-62a9-4557-a944-ff53f2b4aeff req-6e0ff947-80d4-4688-b264-01ba8cc4d4a1 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:31.097837 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ffe62024-62a9-4557-a944-ff53f2b4aeff req-6e0ff947-80d4-4688-b264-01ba8cc4d4a1 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/networks?id=d94a3ee1-87a4-4c0a-bb76-ba163a1da09e HTTP/1.1" status: 200 len: 796 time: 0.1138813 Nov 09 04:46:31.113519 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ffe62024-62a9-4557-a944-ff53f2b4aeff req-28f3285e-41c7-41c9-ad52-7f73c67da530 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/quotas/1d10b4824e524068827e58b55e269af3 HTTP/1.1" status: 200 len: 375 time: 0.0100312 Nov 09 04:46:31.162887 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ffe62024-62a9-4557-a944-ff53f2b4aeff req-07e9178b-0aed-41b2-9b8b-a0dbaea961a5 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0440254 Nov 09 04:46:31.257072 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ffe62024-62a9-4557-a944-ff53f2b4aeff req-9578c413-f171-48ba-b583-c87f5d501918 service neutron] 10.222.0.24 "GET /v2.0/networks/d94a3ee1-87a4-4c0a-bb76-ba163a1da09e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0829563 Nov 09 04:46:31.345142 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ffe62024-62a9-4557-a944-ff53f2b4aeff req-21ad2dc4-4132-40cb-9641-5ab3767ffae8 service neutron] 10.222.0.24 "GET /v2.0/networks/d94a3ee1-87a4-4c0a-bb76-ba163a1da09e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0813651 Nov 09 04:46:31.606501 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-33e99c86-c175-4dde-98eb-15936bf1d3bf req-75183380-cf18-470a-b4c0-e3f73e200d9f tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=225294e2-4901-42ff-87f7-49b3a90b7cf4 HTTP/1.1" status: 200 len: 210 time: 0.0251501 Nov 09 04:46:32.700231 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-28955ea4-0d95-463b-8ddf-6ff96125ade7 req-04ab21e3-460c-4791-8708-a5fde0c4663c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=225294e2-4901-42ff-87f7-49b3a90b7cf4 HTTP/1.1" status: 200 len: 210 time: 0.0272515 Nov 09 04:46:33.414534 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffe62024-62a9-4557-a944-ff53f2b4aeff req-04a33b9d-0cc4-4865-863b-8294de5fb194 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:33.416093 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ffe62024-62a9-4557-a944-ff53f2b4aeff req-04a33b9d-0cc4-4865-863b-8294de5fb194 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "GET /v2.0/networks?id=d94a3ee1-87a4-4c0a-bb76-ba163a1da09e HTTP/1.1" status: 200 len: 796 time: 0.1044970 Nov 09 04:46:33.480432 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ffe62024-62a9-4557-a944-ff53f2b4aeff req-90a46d0b-373f-4df3-a24a-5e254b7d7d8b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=1d10b4824e524068827e58b55e269af3 HTTP/1.1" status: 200 len: 380 time: 0.0536833 Nov 09 04:46:33.490546 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-ffe62024-62a9-4557-a944-ff53f2b4aeff req-3ea62d45-2abd-4dc2-abdb-113c344410da tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'port': {'device_id': '225294e2-4901-42ff-87f7-49b3a90b7cf4', 'network_id': 'd94a3ee1-87a4-4c0a-bb76-ba163a1da09e', 'admin_state_up': True, 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'security_groups': ['ded86ab2-85c5-4652-99a6-99be87d49327']}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:46:33.644463 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ffe62024-62a9-4557-a944-ff53f2b4aeff req-3ea62d45-2abd-4dc2-abdb-113c344410da tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Made reservation on behalf of 1d10b4824e524068827e58b55e269af3 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:46:33.648060 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-ffe62024-62a9-4557-a944-ff53f2b4aeff req-3ea62d45-2abd-4dc2-abdb-113c344410da tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:33.799403 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b0ef5eb8-97f4-46e0-a59e-334d97fb6006 req-3d880fec-42e6-421c-a33c-e78615d31bd2 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=225294e2-4901-42ff-87f7-49b3a90b7cf4 HTTP/1.1" status: 200 len: 210 time: 0.0312068 Nov 09 04:46:33.800413 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [req-ffe62024-62a9-4557-a944-ff53f2b4aeff req-3ea62d45-2abd-4dc2-abdb-113c344410da tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Allocated IP 172.20.0.7 (d94a3ee1-87a4-4c0a-bb76-ba163a1da09e/5c7b951e-9bbe-42a8-b060-2593a9b43d55/817a4aeb-acd4-483a-82ca-30aa17e90689) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:46:33.946867 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-ffe62024-62a9-4557-a944-ff53f2b4aeff req-3ea62d45-2abd-4dc2-abdb-113c344410da tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:34.016038 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-ffe62024-62a9-4557-a944-ff53f2b4aeff req-3ea62d45-2abd-4dc2-abdb-113c344410da tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:34.055116 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ffe62024-62a9-4557-a944-ff53f2b4aeff req-3ea62d45-2abd-4dc2-abdb-113c344410da tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network d94a3ee1-87a4-4c0a-bb76-ba163a1da09e is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:46:34.058037 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [req-ffe62024-62a9-4557-a944-ff53f2b4aeff req-3ea62d45-2abd-4dc2-abdb-113c344410da tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:46:34.064985 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-ffe62024-62a9-4557-a944-ff53f2b4aeff req-3ea62d45-2abd-4dc2-abdb-113c344410da tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:46:34.089592 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ea62d45-2abd-4dc2-abdb-113c344410da tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Port': ['ID=817a4aeb-acd4-483a-82ca-30aa17e90689,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:46:34.118786 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffe62024-62a9-4557-a944-ff53f2b4aeff req-3ea62d45-2abd-4dc2-abdb-113c344410da tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:34.124843 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-ffe62024-62a9-4557-a944-ff53f2b4aeff req-3ea62d45-2abd-4dc2-abdb-113c344410da tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:34.190391 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ffe62024-62a9-4557-a944-ff53f2b4aeff req-3ea62d45-2abd-4dc2-abdb-113c344410da tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7034774 Nov 09 04:46:34.203907 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-ffe62024-62a9-4557-a944-ff53f2b4aeff req-684a1505-6cac-438b-a51d-41663f4acc99 service neutron] Request body: {'port': {'device_id': '225294e2-4901-42ff-87f7-49b3a90b7cf4', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:46:34.262577 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-ffe62024-62a9-4557-a944-ff53f2b4aeff req-684a1505-6cac-438b-a51d-41663f4acc99 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:34.301961 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-b6bab339-f0f7-4af3-b294-28779f93455c None None] Provisioning complete for port 817a4aeb-acd4-483a-82ca-30aa17e90689 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:46:34.302585 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b6bab339-f0f7-4af3-b294-28779f93455c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:34.342729 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-b6bab339-f0f7-4af3-b294-28779f93455c None None] Port 817a4aeb-acd4-483a-82ca-30aa17e90689 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:46:34.515689 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [req-ffe62024-62a9-4557-a944-ff53f2b4aeff req-684a1505-6cac-438b-a51d-41663f4acc99 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 817a4aeb-acd4-483a-82ca-30aa17e90689 {{(pid=102162) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:46:34.522748 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-ffe62024-62a9-4557-a944-ff53f2b4aeff req-684a1505-6cac-438b-a51d-41663f4acc99 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:34.534956 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.provisioning_blocks [req-ffe62024-62a9-4557-a944-ff53f2b4aeff req-684a1505-6cac-438b-a51d-41663f4acc99 service neutron] Transition to ACTIVE for port object 817a4aeb-acd4-483a-82ca-30aa17e90689 will not be triggered until provisioned by entity L2. {{(pid=102162) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 09 04:46:34.598900 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-ffe62024-62a9-4557-a944-ff53f2b4aeff req-684a1505-6cac-438b-a51d-41663f4acc99 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:34.650790 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-684a1505-6cac-438b-a51d-41663f4acc99 service neutron] Pushing event updated for resources: {'Port': ['ID=817a4aeb-acd4-483a-82ca-30aa17e90689,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:46:34.721647 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-ffe62024-62a9-4557-a944-ff53f2b4aeff req-684a1505-6cac-438b-a51d-41663f4acc99 service neutron] Attempting to bind port 817a4aeb-acd4-483a-82ca-30aa17e90689 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:46:34.725219 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-ffe62024-62a9-4557-a944-ff53f2b4aeff req-684a1505-6cac-438b-a51d-41663f4acc99 service neutron] Attempting to bind port 817a4aeb-acd4-483a-82ca-30aa17e90689 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'a5eb9e23-3752-4ef9-8f5b-e308ed2db66c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 335, 'network_id': 'd94a3ee1-87a4-4c0a-bb76-ba163a1da09e'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:46:34.725219 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ffe62024-62a9-4557-a944-ff53f2b4aeff req-684a1505-6cac-438b-a51d-41663f4acc99 service neutron] Attempting to bind port 817a4aeb-acd4-483a-82ca-30aa17e90689 on network d94a3ee1-87a4-4c0a-bb76-ba163a1da09e {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:46:34.726716 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ffe62024-62a9-4557-a944-ff53f2b4aeff req-684a1505-6cac-438b-a51d-41663f4acc99 service neutron] Port 817a4aeb-acd4-483a-82ca-30aa17e90689 on network d94a3ee1-87a4-4c0a-bb76-ba163a1da09e not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:46:34.727034 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ffe62024-62a9-4557-a944-ff53f2b4aeff req-684a1505-6cac-438b-a51d-41663f4acc99 service neutron] Attempting to bind port 817a4aeb-acd4-483a-82ca-30aa17e90689 on network d94a3ee1-87a4-4c0a-bb76-ba163a1da09e {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:46:34.732623 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ffe62024-62a9-4557-a944-ff53f2b4aeff req-684a1505-6cac-438b-a51d-41663f4acc99 service neutron] Checking agent: {'id': '7d36b884-4ad2-4878-9464-bf647030b544', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'started_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 46, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:46:34.733094 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ffe62024-62a9-4557-a944-ff53f2b4aeff req-684a1505-6cac-438b-a51d-41663f4acc99 service neutron] Checking segment: {'id': 'a5eb9e23-3752-4ef9-8f5b-e308ed2db66c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 335, 'network_id': 'd94a3ee1-87a4-4c0a-bb76-ba163a1da09e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:46:34.733476 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ffe62024-62a9-4557-a944-ff53f2b4aeff req-684a1505-6cac-438b-a51d-41663f4acc99 service neutron] Bound using segment: {'id': 'a5eb9e23-3752-4ef9-8f5b-e308ed2db66c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 335, 'network_id': 'd94a3ee1-87a4-4c0a-bb76-ba163a1da09e'} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:46:34.733894 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-ffe62024-62a9-4557-a944-ff53f2b4aeff req-684a1505-6cac-438b-a51d-41663f4acc99 service neutron] Bound port: 817a4aeb-acd4-483a-82ca-30aa17e90689, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a5eb9e23-3752-4ef9-8f5b-e308ed2db66c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 335, 'network_id': 'd94a3ee1-87a4-4c0a-bb76-ba163a1da09e'}}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:46:34.734235 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-ffe62024-62a9-4557-a944-ff53f2b4aeff req-684a1505-6cac-438b-a51d-41663f4acc99 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:34.799591 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-ffe62024-62a9-4557-a944-ff53f2b4aeff req-684a1505-6cac-438b-a51d-41663f4acc99 service neutron] For port 817a4aeb-acd4-483a-82ca-30aa17e90689, host hv-neutron-8168, cleared binding levels {{(pid=102162) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:46:34.802735 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-ffe62024-62a9-4557-a944-ff53f2b4aeff req-684a1505-6cac-438b-a51d-41663f4acc99 service neutron] For port 817a4aeb-acd4-483a-82ca-30aa17e90689, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=817a4aeb-acd4-483a-82ca-30aa17e90689,segment=NetworkSegment(a5eb9e23-3752-4ef9-8f5b-e308ed2db66c),segment_id=a5eb9e23-3752-4ef9-8f5b-e308ed2db66c)] {{(pid=102162) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:46:34.867697 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-ffe62024-62a9-4557-a944-ff53f2b4aeff req-684a1505-6cac-438b-a51d-41663f4acc99 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:34.902145 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffe62024-62a9-4557-a944-ff53f2b4aeff req-684a1505-6cac-438b-a51d-41663f4acc99 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:34.902783 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-ffe62024-62a9-4557-a944-ff53f2b4aeff req-684a1505-6cac-438b-a51d-41663f4acc99 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:34.904269 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ffe62024-62a9-4557-a944-ff53f2b4aeff req-684a1505-6cac-438b-a51d-41663f4acc99 service neutron] 10.222.0.26 "PUT /v2.0/ports/817a4aeb-acd4-483a-82ca-30aa17e90689 HTTP/1.1" status: 200 len: 1093 time: 0.7046952 Nov 09 04:46:34.904659 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '225294e2-4901-42ff-87f7-49b3a90b7cf4', 'tag': '817a4aeb-acd4-483a-82ca-30aa17e90689'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:46:34.907080 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-41357c14-2cff-4636-a937-f8bb3518f5c9" -d '{"events": [{"name": "network-changed", "server_uuid": "225294e2-4901-42ff-87f7-49b3a90b7cf4", "tag": "817a4aeb-acd4-483a-82ca-30aa17e90689"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:46:34.934161 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2748b083-f031-40dd-a95f-bb18a0471e76 req-28839e8c-5e9c-47c3-80cf-c19a5258f392 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:34.936609 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-2748b083-f031-40dd-a95f-bb18a0471e76 req-28839e8c-5e9c-47c3-80cf-c19a5258f392 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=225294e2-4901-42ff-87f7-49b3a90b7cf4 HTTP/1.1" status: 200 len: 943 time: 0.0691113 Nov 09 04:46:34.959788 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:46:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6122c198-3771-454b-9f86-757e5bb6d74d x-openstack-request-id: req-6122c198-3771-454b-9f86-757e5bb6d74d {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:46:34.960074 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "225294e2-4901-42ff-87f7-49b3a90b7cf4", "tag": "817a4aeb-acd4-483a-82ca-30aa17e90689", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:46:34.960585 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-6122c198-3771-454b-9f86-757e5bb6d74d {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:46:34.961000 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '225294e2-4901-42ff-87f7-49b3a90b7cf4', 'tag': '817a4aeb-acd4-483a-82ca-30aa17e90689', 'status': 'completed', 'code': 200} Nov 09 04:46:34.961608 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-684a1505-6cac-438b-a51d-41663f4acc99 service neutron] Pushing event updated for resources: {'Port': ['ID=817a4aeb-acd4-483a-82ca-30aa17e90689,revision_number=3']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:46:35.001096 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-2748b083-f031-40dd-a95f-bb18a0471e76 req-e77f23e7-8590-41ed-bb98-1ab53f451cac tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=ded86ab2-85c5-4652-99a6-99be87d49327&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0575876 Nov 09 04:46:35.019520 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41357c14-2cff-4636-a937-f8bb3518f5c9 req-e16c485d-c3af-4726-aaae-80b49ac0eb75 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:35.021108 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-41357c14-2cff-4636-a937-f8bb3518f5c9 req-e16c485d-c3af-4726-aaae-80b49ac0eb75 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&device_id=225294e2-4901-42ff-87f7-49b3a90b7cf4 HTTP/1.1" status: 200 len: 1096 time: 0.0465753 Nov 09 04:46:35.123707 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41357c14-2cff-4636-a937-f8bb3518f5c9 req-edf79cfb-ff18-4aaa-af01-68f8ed6836e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:35.125187 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-41357c14-2cff-4636-a937-f8bb3518f5c9 req-edf79cfb-ff18-4aaa-af01-68f8ed6836e9 service neutron] 10.222.0.26 "GET /v2.0/networks?tenant_id=1d10b4824e524068827e58b55e269af3&shared=False HTTP/1.1" status: 200 len: 897 time: 0.0946856 Nov 09 04:46:35.224561 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41357c14-2cff-4636-a937-f8bb3518f5c9 req-3af58c87-8646-492d-b4ed-41ab09ba6cfd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:35.226003 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-41357c14-2cff-4636-a937-f8bb3518f5c9 req-3af58c87-8646-492d-b4ed-41ab09ba6cfd service neutron] 10.222.0.26 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0936296 Nov 09 04:46:35.300716 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffe62024-62a9-4557-a944-ff53f2b4aeff req-610278af-707a-46f6-841a-48a55e88a6de service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:35.302080 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ffe62024-62a9-4557-a944-ff53f2b4aeff req-610278af-707a-46f6-841a-48a55e88a6de service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&device_id=225294e2-4901-42ff-87f7-49b3a90b7cf4 HTTP/1.1" status: 200 len: 1096 time: 0.0392838 Nov 09 04:46:35.347841 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ffe62024-62a9-4557-a944-ff53f2b4aeff req-1f744a4e-3ab2-4f58-8809-49f9095532b0 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=817a4aeb-acd4-483a-82ca-30aa17e90689 HTTP/1.1" status: 200 len: 217 time: 0.0364075 Nov 09 04:46:35.395895 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffe62024-62a9-4557-a944-ff53f2b4aeff req-9455b9fc-f658-47fc-9fba-351b1b11eeb8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:35.397330 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ffe62024-62a9-4557-a944-ff53f2b4aeff req-9455b9fc-f658-47fc-9fba-351b1b11eeb8 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=5c7b951e-9bbe-42a8-b060-2593a9b43d55 HTTP/1.1" status: 200 len: 834 time: 0.0425642 Nov 09 04:46:35.441725 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffe62024-62a9-4557-a944-ff53f2b4aeff req-f02a2b6b-4706-422d-b28a-ba6e6c31a760 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:35.443233 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ffe62024-62a9-4557-a944-ff53f2b4aeff req-f02a2b6b-4706-422d-b28a-ba6e6c31a760 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=d94a3ee1-87a4-4c0a-bb76-ba163a1da09e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0380387 Nov 09 04:46:35.539099 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ffe62024-62a9-4557-a944-ff53f2b4aeff req-e8cb1bab-2b35-4f80-a900-a4f3bdc721b7 service neutron] 10.222.0.26 "GET /v2.0/networks/d94a3ee1-87a4-4c0a-bb76-ba163a1da09e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0847740 Nov 09 04:46:35.627858 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ffe62024-62a9-4557-a944-ff53f2b4aeff req-bc708bb5-0536-4a9b-a4c2-6ca676988951 service neutron] 10.222.0.26 "GET /v2.0/networks/d94a3ee1-87a4-4c0a-bb76-ba163a1da09e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0806587 Nov 09 04:46:36.133632 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7eb07120-e291-4b34-a3e9-4ebb7ded99d2 req-72e288a2-f149-4dac-8bc1-a81916d9a151 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:36.135216 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7eb07120-e291-4b34-a3e9-4ebb7ded99d2 req-72e288a2-f149-4dac-8bc1-a81916d9a151 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=225294e2-4901-42ff-87f7-49b3a90b7cf4 HTTP/1.1" status: 200 len: 943 time: 0.0488043 Nov 09 04:46:36.187601 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7eb07120-e291-4b34-a3e9-4ebb7ded99d2 req-aa7741ed-8cfa-45c8-b5f3-3106ae0f9e3c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=ded86ab2-85c5-4652-99a6-99be87d49327&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0458794 Nov 09 04:46:37.298708 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f944588-6e53-4012-b418-dbdf4b529f0b req-eeafb1fb-e716-44df-b683-fd2729f7818a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:37.300217 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-0f944588-6e53-4012-b418-dbdf4b529f0b req-eeafb1fb-e716-44df-b683-fd2729f7818a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=225294e2-4901-42ff-87f7-49b3a90b7cf4 HTTP/1.1" status: 200 len: 943 time: 0.0474954 Nov 09 04:46:37.349255 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-0f944588-6e53-4012-b418-dbdf4b529f0b req-6abbf5f3-ac0e-44e8-a1a3-3f9f609884e8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=ded86ab2-85c5-4652-99a6-99be87d49327&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431473 Nov 09 04:46:37.981747 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 817a4aeb-acd4-483a-82ca-30aa17e90689 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=102163) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 09 04:46:38.075859 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 817a4aeb-acd4-483a-82ca-30aa17e90689, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=817a4aeb-acd4-483a-82ca-30aa17e90689,segment=NetworkSegment(a5eb9e23-3752-4ef9-8f5b-e308ed2db66c),segment_id=a5eb9e23-3752-4ef9-8f5b-e308ed2db66c)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:46:38.086885 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Returning: {'device': '817a4aeb-acd4-483a-82ca-30aa17e90689', 'network_id': 'd94a3ee1-87a4-4c0a-bb76-ba163a1da09e', 'port_id': '817a4aeb-acd4-483a-82ca-30aa17e90689', 'mac_address': 'fa:16:3e:f2:83:be', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 335, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5c7b951e-9bbe-42a8-b060-2593a9b43d55', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102163) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 09 04:46:38.123057 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:38.135758 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 817a4aeb-acd4-483a-82ca-30aa17e90689 {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:46:38.155169 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 817a4aeb-acd4-483a-82ca-30aa17e90689, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=817a4aeb-acd4-483a-82ca-30aa17e90689,segment=NetworkSegment(a5eb9e23-3752-4ef9-8f5b-e308ed2db66c),segment_id=a5eb9e23-3752-4ef9-8f5b-e308ed2db66c)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:46:38.215782 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:38.264811 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=817a4aeb-acd4-483a-82ca-30aa17e90689,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:46:38.419412 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['817a4aeb-acd4-483a-82ca-30aa17e90689'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 04:46:38.460295 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7431ade1-9f45-4cae-97fe-55b04f560376 req-c24815f0-0a51-455c-83ed-b34900a66776 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:38.461778 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7431ade1-9f45-4cae-97fe-55b04f560376 req-c24815f0-0a51-455c-83ed-b34900a66776 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=225294e2-4901-42ff-87f7-49b3a90b7cf4 HTTP/1.1" status: 200 len: 944 time: 0.0471706 Nov 09 04:46:38.511412 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7431ade1-9f45-4cae-97fe-55b04f560376 req-1bbd8a25-f833-46cd-b723-8b41829a88f3 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=ded86ab2-85c5-4652-99a6-99be87d49327&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426314 Nov 09 04:46:39.625917 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90717907-af8b-4903-8cbd-6192317a41be req-7d790437-24e1-4385-90a1-7efc7ee02cd7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:39.627414 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-90717907-af8b-4903-8cbd-6192317a41be req-7d790437-24e1-4385-90a1-7efc7ee02cd7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=225294e2-4901-42ff-87f7-49b3a90b7cf4 HTTP/1.1" status: 200 len: 944 time: 0.0492013 Nov 09 04:46:39.679458 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-90717907-af8b-4903-8cbd-6192317a41be req-e2f70347-0a6d-45da-bf63-881a039499d9 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=ded86ab2-85c5-4652-99a6-99be87d49327&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0462334 Nov 09 04:46:39.981310 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 817a4aeb-acd4-483a-82ca-30aa17e90689 up at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:46:40.083292 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning for port 817a4aeb-acd4-483a-82ca-30aa17e90689 completed by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 09 04:46:40.086973 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning complete for port 817a4aeb-acd4-483a-82ca-30aa17e90689 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:46:40.087332 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:40.171876 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:40.193356 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '225294e2-4901-42ff-87f7-49b3a90b7cf4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '817a4aeb-acd4-483a-82ca-30aa17e90689'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:46:40.195618 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3c93b60a-fcdf-4a0a-8fd3-67b777d089f0" -d '{"events": [{"server_uuid": "225294e2-4901-42ff-87f7-49b3a90b7cf4", "name": "network-vif-plugged", "status": "completed", "tag": "817a4aeb-acd4-483a-82ca-30aa17e90689"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:46:40.212173 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 817a4aeb-acd4-483a-82ca-30aa17e90689, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=817a4aeb-acd4-483a-82ca-30aa17e90689,segment=NetworkSegment(a5eb9e23-3752-4ef9-8f5b-e308ed2db66c),segment_id=a5eb9e23-3752-4ef9-8f5b-e308ed2db66c)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:46:40.236023 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:46:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-37a02a86-c923-4431-9a0f-7efeb95d4ead x-openstack-request-id: req-37a02a86-c923-4431-9a0f-7efeb95d4ead {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:46:40.236023 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "225294e2-4901-42ff-87f7-49b3a90b7cf4", "name": "network-vif-plugged", "status": "completed", "tag": "817a4aeb-acd4-483a-82ca-30aa17e90689", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:46:40.236023 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-37a02a86-c923-4431-9a0f-7efeb95d4ead {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:46:40.236023 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '225294e2-4901-42ff-87f7-49b3a90b7cf4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '817a4aeb-acd4-483a-82ca-30aa17e90689', 'code': 200} Nov 09 04:46:40.284055 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:40.331333 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=817a4aeb-acd4-483a-82ca-30aa17e90689,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:46:40.506314 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b43675b-c578-41c7-bdf7-580366ed8ea0 req-6409aa7a-2a97-4571-b9ed-74118c51d301 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:40.507795 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4b43675b-c578-41c7-bdf7-580366ed8ea0 req-6409aa7a-2a97-4571-b9ed-74118c51d301 service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=225294e2-4901-42ff-87f7-49b3a90b7cf4 HTTP/1.1" status: 200 len: 1098 time: 0.0388868 Nov 09 04:46:40.554581 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4b43675b-c578-41c7-bdf7-580366ed8ea0 req-bd08abe6-0cbf-4685-ada4-3c7898af239c service neutron] 10.222.0.26 "GET /v2.0/security-groups?id=ded86ab2-85c5-4652-99a6-99be87d49327&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0383008 Nov 09 04:46:40.790442 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad2ea7ce-80c8-4c75-be7e-ff98a93cf3f1 req-aa767147-8228-481b-acf5-f5911afbf75e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:40.791917 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ad2ea7ce-80c8-4c75-be7e-ff98a93cf3f1 req-aa767147-8228-481b-acf5-f5911afbf75e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=225294e2-4901-42ff-87f7-49b3a90b7cf4 HTTP/1.1" status: 200 len: 945 time: 0.0476606 Nov 09 04:46:40.842937 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ad2ea7ce-80c8-4c75-be7e-ff98a93cf3f1 req-fdae4b3b-a6c7-40f3-93ae-e8412fefaa41 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=ded86ab2-85c5-4652-99a6-99be87d49327&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0445874 Nov 09 04:46:41.369577 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-39b5c7e2-910e-4211-8c59-e8449f0d128f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:41.964436 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-304dd32e-33f4-42f2-a8ae-446c45d94421 req-d5e9ae71-1a12-475a-a5da-d1e5fe9f02b0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:41.965879 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-304dd32e-33f4-42f2-a8ae-446c45d94421 req-d5e9ae71-1a12-475a-a5da-d1e5fe9f02b0 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=225294e2-4901-42ff-87f7-49b3a90b7cf4 HTTP/1.1" status: 200 len: 945 time: 0.0530009 Nov 09 04:46:42.014087 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-304dd32e-33f4-42f2-a8ae-446c45d94421 req-8669d93d-b229-4f38-8a6b-e85b956f28ad tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=ded86ab2-85c5-4652-99a6-99be87d49327&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421927 Nov 09 04:46:42.126331 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58422b74-b7e9-477f-a54b-5835d887d048 req-132be478-4cf2-4c1f-8467-a7abc940ef6a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:42.127801 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-58422b74-b7e9-477f-a54b-5835d887d048 req-132be478-4cf2-4c1f-8467-a7abc940ef6a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=225294e2-4901-42ff-87f7-49b3a90b7cf4 HTTP/1.1" status: 200 len: 945 time: 0.0484979 Nov 09 04:46:42.179560 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-58422b74-b7e9-477f-a54b-5835d887d048 req-060bf15f-864f-431e-87f9-bb7cf0e420c4 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=ded86ab2-85c5-4652-99a6-99be87d49327&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0460060 Nov 09 04:46:42.202910 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 33348) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:46:42.220744 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:42.245473 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dd612049-52e0-41db-8c68-8ebd79a9594e tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:42.247018 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-dd612049-52e0-41db-8c68-8ebd79a9594e tempest-TestNetworkBasicOps-1146114790 tempest-TestNetworkBasicOps-1146114790-project-admin] 10.222.0.24 "GET /v2.0/ports?device_id=225294e2-4901-42ff-87f7-49b3a90b7cf4 HTTP/1.1" status: 200 len: 1093 time: 0.0431533 Nov 09 04:46:42.249798 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 33350) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:46:42.254087 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-04cc0958-cbdf-4ab6-9c2b-0bcaff7a614d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'floatingip': {'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'port_id': '817a4aeb-acd4-483a-82ca-30aa17e90689', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ip_address': '172.20.0.7'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:46:42.329037 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-04cc0958-cbdf-4ab6-9c2b-0bcaff7a614d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for floatingip, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:42.420818 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-04cc0958-cbdf-4ab6-9c2b-0bcaff7a614d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:42.782654 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-04cc0958-cbdf-4ab6-9c2b-0bcaff7a614d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Allocated IP 172.26.0.186 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/bb99f079-845c-4fd2-84a8-d3f3245e56be) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:46:42.878560 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-04cc0958-cbdf-4ab6-9c2b-0bcaff7a614d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:42.959128 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-04cc0958-cbdf-4ab6-9c2b-0bcaff7a614d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:42.997434 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-04cc0958-cbdf-4ab6-9c2b-0bcaff7a614d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:46:43.000221 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-04cc0958-cbdf-4ab6-9c2b-0bcaff7a614d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:46:43.003005 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-04cc0958-cbdf-4ab6-9c2b-0bcaff7a614d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:46:43.034060 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04cc0958-cbdf-4ab6-9c2b-0bcaff7a614d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Port': ['ID=bb99f079-845c-4fd2-84a8-d3f3245e56be,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:46:43.358738 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-04cc0958-cbdf-4ab6-9c2b-0bcaff7a614d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:43.479746 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-04cc0958-cbdf-4ab6-9c2b-0bcaff7a614d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:43.627298 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-04cc0958-cbdf-4ab6-9c2b-0bcaff7a614d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:43.717905 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-04cc0958-cbdf-4ab6-9c2b-0bcaff7a614d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:43.747896 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8ce93ff8-6590-44af-9476-0fb15befb979 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:43.785903 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04cc0958-cbdf-4ab6-9c2b-0bcaff7a614d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event updated for resources: {'Port': ['ID=bb99f079-845c-4fd2-84a8-d3f3245e56be,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:46:43.794279 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-04cc0958-cbdf-4ab6-9c2b-0bcaff7a614d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:43.894409 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.l3_db [None req-04cc0958-cbdf-4ab6-9c2b-0bcaff7a614d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Floating IP 85e06c71-c1da-46b2-9da1-faf6a61a02e5 associated. External IP: 172.26.0.186, port: 817a4aeb-acd4-483a-82ca-30aa17e90689. Nov 09 04:46:44.097499 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-04cc0958-cbdf-4ab6-9c2b-0bcaff7a614d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Router 5387c31a-0c24-4e3c-affa-fa1ec6b6049c has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:46:44.206067 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-04cc0958-cbdf-4ab6-9c2b-0bcaff7a614d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:46:44.216170 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f7ea202a-409c-4442-aacc-408c45eea6c7 None None] Sync routers for ids ['5387c31a-0c24-4e3c-affa-fa1ec6b6049c'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:46:44.225427 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f7ea202a-409c-4442-aacc-408c45eea6c7 None None] Routers {'5387c31a-0c24-4e3c-affa-fa1ec6b6049c'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:46:44.226029 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-f7ea202a-409c-4442-aacc-408c45eea6c7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:46:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['5387c31a-0c24-4e3c-affa-fa1ec6b6049c'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:46:44.332414 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-04cc0958-cbdf-4ab6-9c2b-0bcaff7a614d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:44.364057 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-04cc0958-cbdf-4ab6-9c2b-0bcaff7a614d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.1106517 Nov 09 04:46:44.364057 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '225294e2-4901-42ff-87f7-49b3a90b7cf4', 'tag': '817a4aeb-acd4-483a-82ca-30aa17e90689'}] {{(pid=102161) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:46:44.364729 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}99dfdda0def497b4372884ef2eb87f06b1e425c8eba5ceda5f64bbab037a07d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c671e655-79db-437f-bfeb-4ffc79580aef" -d '{"events": [{"name": "network-changed", "server_uuid": "225294e2-4901-42ff-87f7-49b3a90b7cf4", "tag": "817a4aeb-acd4-483a-82ca-30aa17e90689"}]}' {{(pid=102161) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:46:44.365434 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33352) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:46:44.401427 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:46:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-75f4906c-951e-4871-8180-97bfd6bd88a6 x-openstack-request-id: req-75f4906c-951e-4871-8180-97bfd6bd88a6 {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:46:44.401735 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "225294e2-4901-42ff-87f7-49b3a90b7cf4", "tag": "817a4aeb-acd4-483a-82ca-30aa17e90689", "status": "completed", "code": 200}]} {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:46:44.401992 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-75f4906c-951e-4871-8180-97bfd6bd88a6 {{(pid=102161) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:46:44.403541 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '225294e2-4901-42ff-87f7-49b3a90b7cf4', 'tag': '817a4aeb-acd4-483a-82ca-30aa17e90689', 'status': 'completed', 'code': 200} Nov 09 04:46:44.439968 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-1e1f0fb4-e087-442f-9501-869391c9140c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/floatingips/85e06c71-c1da-46b2-9da1-faf6a61a02e5 HTTP/1.1" status: 200 len: 991 time: 0.0733585 Nov 09 04:46:44.473974 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-f7ea202a-409c-4442-aacc-408c45eea6c7 None None] Set router 5387c31a-0c24-4e3c-affa-fa1ec6b6049c gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:46:44.474748 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c671e655-79db-437f-bfeb-4ffc79580aef req-551df18b-4e92-4fe2-837b-e67341e8afe0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:44.476247 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c671e655-79db-437f-bfeb-4ffc79580aef req-551df18b-4e92-4fe2-837b-e67341e8afe0 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&device_id=225294e2-4901-42ff-87f7-49b3a90b7cf4 HTTP/1.1" status: 200 len: 1098 time: 0.0468421 Nov 09 04:46:44.569314 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c671e655-79db-437f-bfeb-4ffc79580aef req-5d88ee60-b104-4564-b7cd-d56b4c10b2fa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:44.571197 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c671e655-79db-437f-bfeb-4ffc79580aef req-5d88ee60-b104-4564-b7cd-d56b4c10b2fa service neutron] 10.222.0.26 "GET /v2.0/networks?id=d94a3ee1-87a4-4c0a-bb76-ba163a1da09e HTTP/1.1" status: 200 len: 897 time: 0.0848691 Nov 09 04:46:44.641790 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c671e655-79db-437f-bfeb-4ffc79580aef req-028bcf39-df93-4cff-b23c-25052e236633 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=817a4aeb-acd4-483a-82ca-30aa17e90689 HTTP/1.1" status: 200 len: 999 time: 0.0625577 Nov 09 04:46:44.691225 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c671e655-79db-437f-bfeb-4ffc79580aef req-30e62df4-3596-4033-be41-18f070a72d53 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:44.692710 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c671e655-79db-437f-bfeb-4ffc79580aef req-30e62df4-3596-4033-be41-18f070a72d53 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=5c7b951e-9bbe-42a8-b060-2593a9b43d55 HTTP/1.1" status: 200 len: 834 time: 0.0435145 Nov 09 04:46:44.696901 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-f7ea202a-409c-4442-aacc-408c45eea6c7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5387c31a-0c24-4e3c-affa-fa1ec6b6049c', 'name': 'tempest-TestNetworkBasicOps-router-1242364910', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.38'}], 'enable_snat': True}, 'gw_port_id': 'ba92efc6-6b25-4cf4-8928-e43ee8af86b3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:46:22Z', 'updated_at': '2021-11-09T04:46:26Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': 'ba92efc6-6b25-4cf4-8928-e43ee8af86b3', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:c6:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5387c31a-0c24-4e3c-affa-fa1ec6b6049c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1508, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.38', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:46:23Z', 'updated_at': '2021-11-09T04:46:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '85e06c71-c1da-46b2-9da1-faf6a61a02e5', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'floating_ip_address': '172.26.0.186', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '5387c31a-0c24-4e3c-affa-fa1ec6b6049c', 'port_id': '817a4aeb-acd4-483a-82ca-30aa17e90689', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 1523, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd94a3ee1-87a4-4c0a-bb76-ba163a1da09e', 'mac_address': 'fa:16:3e:f2:83:be', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '225294e2-4901-42ff-87f7-49b3a90b7cf4', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:46:43Z', 'updated_at': '2021-11-09T04:46:43Z', 'revision_number': 0, 'project_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '704374ec-101b-43d6-885d-6f94bd9e79f5', 'name': '', 'network_id': 'd94a3ee1-87a4-4c0a-bb76-ba163a1da09e', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:39:ed:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5387c31a-0c24-4e3c-affa-fa1ec6b6049c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1511, 'fixed_ips': [{'subnet_id': '5c7b951e-9bbe-42a8-b060-2593a9b43d55', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:46:26Z', 'updated_at': '2021-11-09T04:46:29Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '5c7b951e-9bbe-42a8-b060-2593a9b43d55', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:46:44.722583 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f7ea202a-409c-4442-aacc-408c45eea6c7 None None] Checking router: 5387c31a-0c24-4e3c-affa-fa1ec6b6049c for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:46:44.732725 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f7ea202a-409c-4442-aacc-408c45eea6c7 None None] Routers {'5387c31a-0c24-4e3c-affa-fa1ec6b6049c'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:46:44.732725 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-f7ea202a-409c-4442-aacc-408c45eea6c7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:46:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['5387c31a-0c24-4e3c-affa-fa1ec6b6049c'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:46:44.737678 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c671e655-79db-437f-bfeb-4ffc79580aef req-b1086a0e-78ff-475f-9b07-9d41dccedc6e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:46:44.739429 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c671e655-79db-437f-bfeb-4ffc79580aef req-b1086a0e-78ff-475f-9b07-9d41dccedc6e service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=d94a3ee1-87a4-4c0a-bb76-ba163a1da09e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0385954 Nov 09 04:46:44.832899 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c671e655-79db-437f-bfeb-4ffc79580aef req-c80e183c-89d7-4db9-99f2-39fa2a5fdbc9 service neutron] 10.222.0.26 "GET /v2.0/networks/d94a3ee1-87a4-4c0a-bb76-ba163a1da09e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0852149 Nov 09 04:46:44.836669 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-f7ea202a-409c-4442-aacc-408c45eea6c7 None None] Set router 5387c31a-0c24-4e3c-affa-fa1ec6b6049c gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:46:44.922129 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c671e655-79db-437f-bfeb-4ffc79580aef req-daf4fbad-a97c-4467-aead-f93bd18be598 service neutron] 10.222.0.26 "GET /v2.0/networks/d94a3ee1-87a4-4c0a-bb76-ba163a1da09e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0812018 Nov 09 04:46:45.070453 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-f7ea202a-409c-4442-aacc-408c45eea6c7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5387c31a-0c24-4e3c-affa-fa1ec6b6049c', 'name': 'tempest-TestNetworkBasicOps-router-1242364910', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.38'}], 'enable_snat': True}, 'gw_port_id': 'ba92efc6-6b25-4cf4-8928-e43ee8af86b3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:46:22Z', 'updated_at': '2021-11-09T04:46:26Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': 'ba92efc6-6b25-4cf4-8928-e43ee8af86b3', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:c6:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5387c31a-0c24-4e3c-affa-fa1ec6b6049c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1508, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.38', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:46:23Z', 'updated_at': '2021-11-09T04:46:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '85e06c71-c1da-46b2-9da1-faf6a61a02e5', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'floating_ip_address': '172.26.0.186', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '5387c31a-0c24-4e3c-affa-fa1ec6b6049c', 'port_id': '817a4aeb-acd4-483a-82ca-30aa17e90689', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 1523, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd94a3ee1-87a4-4c0a-bb76-ba163a1da09e', 'mac_address': 'fa:16:3e:f2:83:be', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '225294e2-4901-42ff-87f7-49b3a90b7cf4', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:46:43Z', 'updated_at': '2021-11-09T04:46:43Z', 'revision_number': 0, 'project_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '704374ec-101b-43d6-885d-6f94bd9e79f5', 'name': '', 'network_id': 'd94a3ee1-87a4-4c0a-bb76-ba163a1da09e', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:39:ed:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5387c31a-0c24-4e3c-affa-fa1ec6b6049c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1511, 'fixed_ips': [{'subnet_id': '5c7b951e-9bbe-42a8-b060-2593a9b43d55', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:46:26Z', 'updated_at': '2021-11-09T04:46:29Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '5c7b951e-9bbe-42a8-b060-2593a9b43d55', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:46:45.097198 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f7ea202a-409c-4442-aacc-408c45eea6c7 None None] The sync data for ids ['5387c31a-0c24-4e3c-affa-fa1ec6b6049c'] in dv-neutron-816802-2-hyperv is: [{'id': '5387c31a-0c24-4e3c-affa-fa1ec6b6049c', 'name': 'tempest-TestNetworkBasicOps-router-1242364910', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.38'}], 'enable_snat': True}, 'gw_port_id': 'ba92efc6-6b25-4cf4-8928-e43ee8af86b3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:46:22Z', 'updated_at': '2021-11-09T04:46:26Z', 'revision_number': 4, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': 'ba92efc6-6b25-4cf4-8928-e43ee8af86b3', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:c6:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5387c31a-0c24-4e3c-affa-fa1ec6b6049c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1508, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.38', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:46:23Z', 'updated_at': '2021-11-09T04:46:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '85e06c71-c1da-46b2-9da1-faf6a61a02e5', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'floating_ip_address': '172.26.0.186', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '5387c31a-0c24-4e3c-affa-fa1ec6b6049c', 'port_id': '817a4aeb-acd4-483a-82ca-30aa17e90689', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 1523, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd94a3ee1-87a4-4c0a-bb76-ba163a1da09e', 'mac_address': 'fa:16:3e:f2:83:be', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '225294e2-4901-42ff-87f7-49b3a90b7cf4', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:46:43Z', 'updated_at': '2021-11-09T04:46:43Z', 'revision_number': 0, 'project_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '704374ec-101b-43d6-885d-6f94bd9e79f5', 'name': '', 'network_id': 'd94a3ee1-87a4-4c0a-bb76-ba163a1da09e', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:39:ed:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5387c31a-0c24-4e3c-affa-fa1ec6b6049c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1511, 'fixed_ips': [{'subnet_id': '5c7b951e-9bbe-42a8-b060-2593a9b43d55', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:46:26Z', 'updated_at': '2021-11-09T04:46:29Z', 'revision_number': 5, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '5c7b951e-9bbe-42a8-b060-2593a9b43d55', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:46:45.135453 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:45.281279 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d9269e17-8c23-42fd-a21e-08fba22ce4f1 None None] New status for floating IP 85e06c71-c1da-46b2-9da1-faf6a61a02e5: ACTIVE {{(pid=102164) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 04:46:45.442278 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33356) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:46:45.507508 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-46816690-2a64-473c-b703-361deb8a083d tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/floatingips/85e06c71-c1da-46b2-9da1-faf6a61a02e5 HTTP/1.1" status: 200 len: 991 time: 0.0641415 Nov 09 04:46:46.506655 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:46.510645 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33358) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:46:46.569807 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-4d21fc5b-9047-4db6-b977-57a8db6d343b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/floatingips/85e06c71-c1da-46b2-9da1-faf6a61a02e5 HTTP/1.1" status: 200 len: 993 time: 0.0579274 Nov 09 04:46:46.986262 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:46:47.461970 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:47:11.339453 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6b95e962-b3a5-4141-ad13-64acaa4a54b6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:12.208497 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:13.175412 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33370) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:47:13.179852 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-770ffa39-fb2e-40ec-ac18-ab2c7180c64c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'router': {'admin_state_up': False}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:47:13.474868 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-770ffa39-fb2e-40ec-ac18-ab2c7180c64c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-466202', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-464271', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-936'] for router, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:13.546672 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-770ffa39-fb2e-40ec-ac18-ab2c7180c64c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-466195', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-466408', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-464260'] for router, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:13.653772 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-770ffa39-fb2e-40ec-ac18-ab2c7180c64c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Router 5387c31a-0c24-4e3c-affa-fa1ec6b6049c has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:47:13.694346 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6c00711a-266e-43fb-89b1-b5496f077382 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:14.086515 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-770ffa39-fb2e-40ec-ac18-ab2c7180c64c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:47:14.093924 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-770ffa39-fb2e-40ec-ac18-ab2c7180c64c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:14.095103 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-770ffa39-fb2e-40ec-ac18-ab2c7180c64c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "PUT /v2.0/routers/5387c31a-0c24-4e3c-affa-fa1ec6b6049c HTTP/1.1" status: 200 len: 888 time: 0.9187825 Nov 09 04:47:14.097299 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3140dcc5-694b-4a2d-a60f-3a2862a3e4ce None None] Sync routers for ids ['5387c31a-0c24-4e3c-affa-fa1ec6b6049c'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:47:14.106482 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3140dcc5-694b-4a2d-a60f-3a2862a3e4ce None None] Routers {'5387c31a-0c24-4e3c-affa-fa1ec6b6049c'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:47:14.107098 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-3140dcc5-694b-4a2d-a60f-3a2862a3e4ce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:47:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['5387c31a-0c24-4e3c-affa-fa1ec6b6049c'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:47:14.138651 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-3140dcc5-694b-4a2d-a60f-3a2862a3e4ce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:47:14.147515 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3140dcc5-694b-4a2d-a60f-3a2862a3e4ce None None] Routers {'5387c31a-0c24-4e3c-affa-fa1ec6b6049c'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:47:14.148095 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-3140dcc5-694b-4a2d-a60f-3a2862a3e4ce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:47:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['5387c31a-0c24-4e3c-affa-fa1ec6b6049c'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:47:14.179467 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-3140dcc5-694b-4a2d-a60f-3a2862a3e4ce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:47:14.180085 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3140dcc5-694b-4a2d-a60f-3a2862a3e4ce None None] The sync data for ids ['5387c31a-0c24-4e3c-affa-fa1ec6b6049c'] in dv-neutron-816802-2-hyperv is: [] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:47:14.943934 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2d323517-027b-4e3d-a4ed-77be44dec6cb None None] New status for floating IP 85e06c71-c1da-46b2-9da1-faf6a61a02e5: DOWN {{(pid=102164) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 04:47:15.128344 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:15.700531 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 704374ec-101b-43d6-885d-6f94bd9e79f5 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:47:15.773973 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:15.804843 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 704374ec-101b-43d6-885d-6f94bd9e79f5, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=704374ec-101b-43d6-885d-6f94bd9e79f5,segment=NetworkSegment(a5eb9e23-3752-4ef9-8f5b-e308ed2db66c),segment_id=a5eb9e23-3752-4ef9-8f5b-e308ed2db66c)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:47:15.858724 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:15.859393 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device ba92efc6-6b25-4cf4-8928-e43ee8af86b3 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:47:15.935235 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=704374ec-101b-43d6-885d-6f94bd9e79f5,revision_number=6']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:47:15.974143 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:15.993697 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port ba92efc6-6b25-4cf4-8928-e43ee8af86b3, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=ba92efc6-6b25-4cf4-8928-e43ee8af86b3,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:47:16.145486 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:16.191647 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=ba92efc6-6b25-4cf4-8928-e43ee8af86b3,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:47:16.207665 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33374) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:47:16.212254 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-4ab7cc8d-fa17-4726-b742-152472d05031 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Request body: {'router': {'admin_state_up': True}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:47:16.477114 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:16.507636 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4ab7cc8d-fa17-4726-b742-152472d05031 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-466202', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-464271', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-936'] for router, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:16.602682 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4ab7cc8d-fa17-4726-b742-152472d05031 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-466195', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-466408', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-464260'] for router, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:16.708764 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4ab7cc8d-fa17-4726-b742-152472d05031 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Router 5387c31a-0c24-4e3c-affa-fa1ec6b6049c has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:47:16.815012 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4ab7cc8d-fa17-4726-b742-152472d05031 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:47:16.822453 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4ab7cc8d-fa17-4726-b742-152472d05031 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:16.823224 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-4ab7cc8d-fa17-4726-b742-152472d05031 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "PUT /v2.0/routers/5387c31a-0c24-4e3c-affa-fa1ec6b6049c HTTP/1.1" status: 200 len: 887 time: 0.6143000 Nov 09 04:47:16.825068 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2606e2e6-1583-4ed6-9ecf-0b2b391a9f4b None None] Sync routers for ids ['5387c31a-0c24-4e3c-affa-fa1ec6b6049c'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:47:16.825812 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33376) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:47:16.838858 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2606e2e6-1583-4ed6-9ecf-0b2b391a9f4b None None] Routers {'5387c31a-0c24-4e3c-affa-fa1ec6b6049c'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:47:16.839551 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-2606e2e6-1583-4ed6-9ecf-0b2b391a9f4b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:47:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['5387c31a-0c24-4e3c-affa-fa1ec6b6049c'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:47:16.887858 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-bfd1eaa0-11b1-48fd-9626-0ca660912912 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/floatingips/85e06c71-c1da-46b2-9da1-faf6a61a02e5 HTTP/1.1" status: 200 len: 991 time: 0.0603836 Nov 09 04:47:16.957335 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-2606e2e6-1583-4ed6-9ecf-0b2b391a9f4b None None] Set router 5387c31a-0c24-4e3c-affa-fa1ec6b6049c gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:47:17.025137 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:17.176116 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-2606e2e6-1583-4ed6-9ecf-0b2b391a9f4b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5387c31a-0c24-4e3c-affa-fa1ec6b6049c', 'name': 'tempest-TestNetworkBasicOps-router-1242364910', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.38'}], 'enable_snat': True}, 'gw_port_id': 'ba92efc6-6b25-4cf4-8928-e43ee8af86b3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:46:22Z', 'updated_at': '2021-11-09T04:47:16Z', 'revision_number': 6, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': 'ba92efc6-6b25-4cf4-8928-e43ee8af86b3', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:c6:79', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5387c31a-0c24-4e3c-affa-fa1ec6b6049c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1508, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.38', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:46:23Z', 'updated_at': '2021-11-09T04:47:15Z', 'revision_number': 5, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '85e06c71-c1da-46b2-9da1-faf6a61a02e5', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'floating_ip_address': '172.26.0.186', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '5387c31a-0c24-4e3c-affa-fa1ec6b6049c', 'port_id': '817a4aeb-acd4-483a-82ca-30aa17e90689', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 1523, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd94a3ee1-87a4-4c0a-bb76-ba163a1da09e', 'mac_address': 'fa:16:3e:f2:83:be', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '225294e2-4901-42ff-87f7-49b3a90b7cf4', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:46:43Z', 'updated_at': '2021-11-09T04:47:15Z', 'revision_number': 2, 'project_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '704374ec-101b-43d6-885d-6f94bd9e79f5', 'name': '', 'network_id': 'd94a3ee1-87a4-4c0a-bb76-ba163a1da09e', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:39:ed:c3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5387c31a-0c24-4e3c-affa-fa1ec6b6049c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1511, 'fixed_ips': [{'subnet_id': '5c7b951e-9bbe-42a8-b060-2593a9b43d55', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:46:26Z', 'updated_at': '2021-11-09T04:47:15Z', 'revision_number': 6, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '5c7b951e-9bbe-42a8-b060-2593a9b43d55', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:47:17.201487 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2606e2e6-1583-4ed6-9ecf-0b2b391a9f4b None None] Checking router: 5387c31a-0c24-4e3c-affa-fa1ec6b6049c for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:47:17.210005 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2606e2e6-1583-4ed6-9ecf-0b2b391a9f4b None None] Routers {'5387c31a-0c24-4e3c-affa-fa1ec6b6049c'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:47:17.210636 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-2606e2e6-1583-4ed6-9ecf-0b2b391a9f4b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:47:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['5387c31a-0c24-4e3c-affa-fa1ec6b6049c'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:47:17.312063 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-2606e2e6-1583-4ed6-9ecf-0b2b391a9f4b None None] Set router 5387c31a-0c24-4e3c-affa-fa1ec6b6049c gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:47:17.527399 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-2606e2e6-1583-4ed6-9ecf-0b2b391a9f4b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5387c31a-0c24-4e3c-affa-fa1ec6b6049c', 'name': 'tempest-TestNetworkBasicOps-router-1242364910', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.38'}], 'enable_snat': True}, 'gw_port_id': 'ba92efc6-6b25-4cf4-8928-e43ee8af86b3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:46:22Z', 'updated_at': '2021-11-09T04:47:16Z', 'revision_number': 6, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': 'ba92efc6-6b25-4cf4-8928-e43ee8af86b3', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:c6:79', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5387c31a-0c24-4e3c-affa-fa1ec6b6049c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1508, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.38', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:46:23Z', 'updated_at': '2021-11-09T04:47:15Z', 'revision_number': 5, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '85e06c71-c1da-46b2-9da1-faf6a61a02e5', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'floating_ip_address': '172.26.0.186', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '5387c31a-0c24-4e3c-affa-fa1ec6b6049c', 'port_id': '817a4aeb-acd4-483a-82ca-30aa17e90689', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 1523, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd94a3ee1-87a4-4c0a-bb76-ba163a1da09e', 'mac_address': 'fa:16:3e:f2:83:be', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '225294e2-4901-42ff-87f7-49b3a90b7cf4', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:46:43Z', 'updated_at': '2021-11-09T04:47:15Z', 'revision_number': 2, 'project_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '704374ec-101b-43d6-885d-6f94bd9e79f5', 'name': '', 'network_id': 'd94a3ee1-87a4-4c0a-bb76-ba163a1da09e', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:39:ed:c3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5387c31a-0c24-4e3c-affa-fa1ec6b6049c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1511, 'fixed_ips': [{'subnet_id': '5c7b951e-9bbe-42a8-b060-2593a9b43d55', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:46:26Z', 'updated_at': '2021-11-09T04:47:15Z', 'revision_number': 6, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '5c7b951e-9bbe-42a8-b060-2593a9b43d55', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:47:17.553180 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2606e2e6-1583-4ed6-9ecf-0b2b391a9f4b None None] The sync data for ids ['5387c31a-0c24-4e3c-affa-fa1ec6b6049c'] in dv-neutron-816802-2-hyperv is: [{'id': '5387c31a-0c24-4e3c-affa-fa1ec6b6049c', 'name': 'tempest-TestNetworkBasicOps-router-1242364910', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.38'}], 'enable_snat': True}, 'gw_port_id': 'ba92efc6-6b25-4cf4-8928-e43ee8af86b3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:46:22Z', 'updated_at': '2021-11-09T04:47:16Z', 'revision_number': 6, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': 'ba92efc6-6b25-4cf4-8928-e43ee8af86b3', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:c6:79', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5387c31a-0c24-4e3c-affa-fa1ec6b6049c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1508, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.38', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:46:23Z', 'updated_at': '2021-11-09T04:47:15Z', 'revision_number': 5, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '85e06c71-c1da-46b2-9da1-faf6a61a02e5', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'floating_ip_address': '172.26.0.186', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '5387c31a-0c24-4e3c-affa-fa1ec6b6049c', 'port_id': '817a4aeb-acd4-483a-82ca-30aa17e90689', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 1523, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd94a3ee1-87a4-4c0a-bb76-ba163a1da09e', 'mac_address': 'fa:16:3e:f2:83:be', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '225294e2-4901-42ff-87f7-49b3a90b7cf4', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:46:43Z', 'updated_at': '2021-11-09T04:47:15Z', 'revision_number': 2, 'project_id': '1d10b4824e524068827e58b55e269af3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '704374ec-101b-43d6-885d-6f94bd9e79f5', 'name': '', 'network_id': 'd94a3ee1-87a4-4c0a-bb76-ba163a1da09e', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:39:ed:c3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5387c31a-0c24-4e3c-affa-fa1ec6b6049c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1511, 'fixed_ips': [{'subnet_id': '5c7b951e-9bbe-42a8-b060-2593a9b43d55', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:46:26Z', 'updated_at': '2021-11-09T04:47:15Z', 'revision_number': 6, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '5c7b951e-9bbe-42a8-b060-2593a9b43d55', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:47:17.891672 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33378) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:47:17.958286 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-1db337cd-72ca-492d-878e-7e6f7505e65a tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/floatingips/85e06c71-c1da-46b2-9da1-faf6a61a02e5 HTTP/1.1" status: 200 len: 991 time: 0.0653870 Nov 09 04:47:18.962152 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33380) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:47:18.994192 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f0ff7b44-3d3f-4e8d-9fb1-bc92f50c1dba None None] New status for floating IP 85e06c71-c1da-46b2-9da1-faf6a61a02e5: ACTIVE {{(pid=102164) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 04:47:19.022489 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-ef57da6f-35d0-4a69-a932-e7735bf9bbe6 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/floatingips/85e06c71-c1da-46b2-9da1-faf6a61a02e5 HTTP/1.1" status: 200 len: 991 time: 0.0591352 Nov 09 04:47:19.740215 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 704374ec-101b-43d6-885d-6f94bd9e79f5 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:47:19.790411 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 704374ec-101b-43d6-885d-6f94bd9e79f5 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:47:19.790780 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:19.864100 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:19.895181 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 704374ec-101b-43d6-885d-6f94bd9e79f5, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=704374ec-101b-43d6-885d-6f94bd9e79f5,segment=NetworkSegment(a5eb9e23-3752-4ef9-8f5b-e308ed2db66c),segment_id=a5eb9e23-3752-4ef9-8f5b-e308ed2db66c)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:47:19.956904 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:19.957608 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device ba92efc6-6b25-4cf4-8928-e43ee8af86b3 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:47:20.026284 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33382) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:47:20.034343 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=704374ec-101b-43d6-885d-6f94bd9e79f5,revision_number=7']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:47:20.047179 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port ba92efc6-6b25-4cf4-8928-e43ee8af86b3 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:47:20.047543 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:20.094020 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-c94d8842-160a-4839-91f3-9112d05c408b tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/floatingips/85e06c71-c1da-46b2-9da1-faf6a61a02e5 HTTP/1.1" status: 200 len: 993 time: 0.0665751 Nov 09 04:47:20.124633 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:20.144722 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port ba92efc6-6b25-4cf4-8928-e43ee8af86b3, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=ba92efc6-6b25-4cf4-8928-e43ee8af86b3,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:47:20.196457 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:20.243886 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=ba92efc6-6b25-4cf4-8928-e43ee8af86b3,revision_number=6']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:47:20.338765 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33388) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:47:20.489790 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-81086d3f-2477-430e-b917-6a48e7497784 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Deleting port bb99f079-845c-4fd2-84a8-d3f3245e56be {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:47:20.490122 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-81086d3f-2477-430e-b917-6a48e7497784 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:20.563090 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-81086d3f-2477-430e-b917-6a48e7497784 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:20.563413 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-81086d3f-2477-430e-b917-6a48e7497784 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:20.574903 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-81086d3f-2477-430e-b917-6a48e7497784 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Calling delete_port for bb99f079-845c-4fd2-84a8-d3f3245e56be owned by network:floatingip {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:47:20.768014 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-81086d3f-2477-430e-b917-6a48e7497784 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:20.792923 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81086d3f-2477-430e-b917-6a48e7497784 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'Port': ['ID=bb99f079-845c-4fd2-84a8-d3f3245e56be,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:47:20.823651 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81086d3f-2477-430e-b917-6a48e7497784 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:47:20.823921 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81086d3f-2477-430e-b917-6a48e7497784 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:47:20.824296 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81086d3f-2477-430e-b917-6a48e7497784 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:47:20.824627 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81086d3f-2477-430e-b917-6a48e7497784 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:47:20.824952 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81086d3f-2477-430e-b917-6a48e7497784 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:47:20.825313 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81086d3f-2477-430e-b917-6a48e7497784 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:47:20.825638 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81086d3f-2477-430e-b917-6a48e7497784 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:47:20.825959 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81086d3f-2477-430e-b917-6a48e7497784 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:47:20.826305 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81086d3f-2477-430e-b917-6a48e7497784 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:47:20.826647 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81086d3f-2477-430e-b917-6a48e7497784 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:47:20.826965 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81086d3f-2477-430e-b917-6a48e7497784 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:47:20.827279 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81086d3f-2477-430e-b917-6a48e7497784 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:47:20.867254 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-81086d3f-2477-430e-b917-6a48e7497784 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for floatingip, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:20.867581 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.l3_db [None req-81086d3f-2477-430e-b917-6a48e7497784 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Floating IP 85e06c71-c1da-46b2-9da1-faf6a61a02e5 disassociated (deleted). External IP: 172.26.0.186, port: 817a4aeb-acd4-483a-82ca-30aa17e90689. Nov 09 04:47:21.068028 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-81086d3f-2477-430e-b917-6a48e7497784 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Router 5387c31a-0c24-4e3c-affa-fa1ec6b6049c has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:47:21.171884 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-81086d3f-2477-430e-b917-6a48e7497784 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:47:21.176258 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-81086d3f-2477-430e-b917-6a48e7497784 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:21.181950 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5a1f23f9-b9d8-488c-a3fc-e43b379b40dc None None] Sync routers for ids ['5387c31a-0c24-4e3c-affa-fa1ec6b6049c'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:47:21.190834 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5a1f23f9-b9d8-488c-a3fc-e43b379b40dc None None] Routers {'5387c31a-0c24-4e3c-affa-fa1ec6b6049c'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:47:21.191438 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-5a1f23f9-b9d8-488c-a3fc-e43b379b40dc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:47:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['5387c31a-0c24-4e3c-affa-fa1ec6b6049c'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:47:21.202382 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-81086d3f-2477-430e-b917-6a48e7497784 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "DELETE /v2.0/floatingips/85e06c71-c1da-46b2-9da1-faf6a61a02e5 HTTP/1.1" status: 204 len: 168 time: 0.8625402 Nov 09 04:47:21.202956 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '225294e2-4901-42ff-87f7-49b3a90b7cf4', 'tag': '817a4aeb-acd4-483a-82ca-30aa17e90689'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:47:21.205183 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ebbccacc-337b-436c-a76e-59cc8471ad74" -d '{"events": [{"name": "network-changed", "server_uuid": "225294e2-4901-42ff-87f7-49b3a90b7cf4", "tag": "817a4aeb-acd4-483a-82ca-30aa17e90689"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:47:21.245929 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:47:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-25267ae6-2bc9-41f0-9489-dd283ac72f89 x-openstack-request-id: req-25267ae6-2bc9-41f0-9489-dd283ac72f89 {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:47:21.246216 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "225294e2-4901-42ff-87f7-49b3a90b7cf4", "tag": "817a4aeb-acd4-483a-82ca-30aa17e90689", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:47:21.246544 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-25267ae6-2bc9-41f0-9489-dd283ac72f89 {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:47:21.246891 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '225294e2-4901-42ff-87f7-49b3a90b7cf4', 'tag': '817a4aeb-acd4-483a-82ca-30aa17e90689', 'status': 'completed', 'code': 200} Nov 09 04:47:21.307610 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-5a1f23f9-b9d8-488c-a3fc-e43b379b40dc None None] Set router 5387c31a-0c24-4e3c-affa-fa1ec6b6049c gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:47:21.322745 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebbccacc-337b-436c-a76e-59cc8471ad74 req-fa461314-d9d1-4eba-b1c3-0d90f8ed2c9d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:47:21.322745 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ebbccacc-337b-436c-a76e-59cc8471ad74 req-fa461314-d9d1-4eba-b1c3-0d90f8ed2c9d service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1d10b4824e524068827e58b55e269af3&device_id=225294e2-4901-42ff-87f7-49b3a90b7cf4 HTTP/1.1" status: 200 len: 1098 time: 0.0403192 Nov 09 04:47:21.405127 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebbccacc-337b-436c-a76e-59cc8471ad74 req-d6d5fc2b-aaef-41ea-b779-3470dd1b89e2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:47:21.406549 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ebbccacc-337b-436c-a76e-59cc8471ad74 req-d6d5fc2b-aaef-41ea-b779-3470dd1b89e2 service neutron] 10.222.0.26 "GET /v2.0/networks?id=d94a3ee1-87a4-4c0a-bb76-ba163a1da09e HTTP/1.1" status: 200 len: 897 time: 0.0888488 Nov 09 04:47:21.447523 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ebbccacc-337b-436c-a76e-59cc8471ad74 req-b69aa8f2-4376-490b-9d38-90d3b99eff6c service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=817a4aeb-acd4-483a-82ca-30aa17e90689 HTTP/1.1" status: 200 len: 217 time: 0.0342784 Nov 09 04:47:21.498828 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebbccacc-337b-436c-a76e-59cc8471ad74 req-3c8f4772-8965-4dea-8986-73b3fd16e218 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:47:21.500295 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ebbccacc-337b-436c-a76e-59cc8471ad74 req-3c8f4772-8965-4dea-8986-73b3fd16e218 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=5c7b951e-9bbe-42a8-b060-2593a9b43d55 HTTP/1.1" status: 200 len: 834 time: 0.0463130 Nov 09 04:47:21.551176 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebbccacc-337b-436c-a76e-59cc8471ad74 req-4fd7e3f5-d723-44b9-8a5b-698380a2d272 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:47:21.552799 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ebbccacc-337b-436c-a76e-59cc8471ad74 req-4fd7e3f5-d723-44b9-8a5b-698380a2d272 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=d94a3ee1-87a4-4c0a-bb76-ba163a1da09e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0438089 Nov 09 04:47:21.661200 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ebbccacc-337b-436c-a76e-59cc8471ad74 req-e730666c-b348-477f-9a12-75bf39c79279 service neutron] 10.222.0.26 "GET /v2.0/networks/d94a3ee1-87a4-4c0a-bb76-ba163a1da09e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0931001 Nov 09 04:47:21.674916 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-5a1f23f9-b9d8-488c-a3fc-e43b379b40dc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5387c31a-0c24-4e3c-affa-fa1ec6b6049c', 'name': 'tempest-TestNetworkBasicOps-router-1242364910', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.38'}], 'enable_snat': True}, 'gw_port_id': 'ba92efc6-6b25-4cf4-8928-e43ee8af86b3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:46:22Z', 'updated_at': '2021-11-09T04:47:16Z', 'revision_number': 6, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': 'ba92efc6-6b25-4cf4-8928-e43ee8af86b3', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:c6:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5387c31a-0c24-4e3c-affa-fa1ec6b6049c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1508, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.38', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:46:23Z', 'updated_at': '2021-11-09T04:47:20Z', 'revision_number': 6, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '704374ec-101b-43d6-885d-6f94bd9e79f5', 'name': '', 'network_id': 'd94a3ee1-87a4-4c0a-bb76-ba163a1da09e', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:39:ed:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5387c31a-0c24-4e3c-affa-fa1ec6b6049c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1511, 'fixed_ips': [{'subnet_id': '5c7b951e-9bbe-42a8-b060-2593a9b43d55', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:46:26Z', 'updated_at': '2021-11-09T04:47:19Z', 'revision_number': 7, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '5c7b951e-9bbe-42a8-b060-2593a9b43d55', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:47:21.698084 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d52e64ac-7ab9-4ca4-a602-476b8b5bedfd req-b4954a40-b32e-4a00-93c1-9c91dda6ef69 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:47:21.700269 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d52e64ac-7ab9-4ca4-a602-476b8b5bedfd req-b4954a40-b32e-4a00-93c1-9c91dda6ef69 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=225294e2-4901-42ff-87f7-49b3a90b7cf4 HTTP/1.1" status: 200 len: 945 time: 0.0671873 Nov 09 04:47:21.704249 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5a1f23f9-b9d8-488c-a3fc-e43b379b40dc None None] Checking router: 5387c31a-0c24-4e3c-affa-fa1ec6b6049c for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:47:21.712992 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5a1f23f9-b9d8-488c-a3fc-e43b379b40dc None None] Routers {'5387c31a-0c24-4e3c-affa-fa1ec6b6049c'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:47:21.713598 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-5a1f23f9-b9d8-488c-a3fc-e43b379b40dc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:47:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['5387c31a-0c24-4e3c-affa-fa1ec6b6049c'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:47:21.753268 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 704374ec-101b-43d6-885d-6f94bd9e79f5 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:47:21.764112 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d52e64ac-7ab9-4ca4-a602-476b8b5bedfd req-da4f9f99-ab89-4dda-a1ef-34f133c9d737 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=ded86ab2-85c5-4652-99a6-99be87d49327&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0508778 Nov 09 04:47:21.770209 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ebbccacc-337b-436c-a76e-59cc8471ad74 req-0a457762-78a3-4f2e-a52e-1a7f56a154e2 service neutron] 10.222.0.26 "GET /v2.0/networks/d94a3ee1-87a4-4c0a-bb76-ba163a1da09e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1003828 Nov 09 04:47:21.854914 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-5a1f23f9-b9d8-488c-a3fc-e43b379b40dc None None] Set router 5387c31a-0c24-4e3c-affa-fa1ec6b6049c gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:47:21.886468 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 704374ec-101b-43d6-885d-6f94bd9e79f5 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:47:21.886808 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:22.083998 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device ba92efc6-6b25-4cf4-8928-e43ee8af86b3 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:47:22.148720 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-5a1f23f9-b9d8-488c-a3fc-e43b379b40dc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5387c31a-0c24-4e3c-affa-fa1ec6b6049c', 'name': 'tempest-TestNetworkBasicOps-router-1242364910', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.38'}], 'enable_snat': True}, 'gw_port_id': 'ba92efc6-6b25-4cf4-8928-e43ee8af86b3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:46:22Z', 'updated_at': '2021-11-09T04:47:16Z', 'revision_number': 6, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': 'ba92efc6-6b25-4cf4-8928-e43ee8af86b3', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:c6:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5387c31a-0c24-4e3c-affa-fa1ec6b6049c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1508, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.38', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:46:23Z', 'updated_at': '2021-11-09T04:47:20Z', 'revision_number': 6, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '704374ec-101b-43d6-885d-6f94bd9e79f5', 'name': '', 'network_id': 'd94a3ee1-87a4-4c0a-bb76-ba163a1da09e', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:39:ed:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5387c31a-0c24-4e3c-affa-fa1ec6b6049c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1511, 'fixed_ips': [{'subnet_id': '5c7b951e-9bbe-42a8-b060-2593a9b43d55', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:46:26Z', 'updated_at': '2021-11-09T04:47:19Z', 'revision_number': 7, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '5c7b951e-9bbe-42a8-b060-2593a9b43d55', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:47:22.151672 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port ba92efc6-6b25-4cf4-8928-e43ee8af86b3 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:47:22.152036 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:22.176405 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5a1f23f9-b9d8-488c-a3fc-e43b379b40dc None None] The sync data for ids ['5387c31a-0c24-4e3c-affa-fa1ec6b6049c'] in dv-neutron-816802-2-hyperv is: [{'id': '5387c31a-0c24-4e3c-affa-fa1ec6b6049c', 'name': 'tempest-TestNetworkBasicOps-router-1242364910', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.38'}], 'enable_snat': True}, 'gw_port_id': 'ba92efc6-6b25-4cf4-8928-e43ee8af86b3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:46:22Z', 'updated_at': '2021-11-09T04:47:16Z', 'revision_number': 6, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': 'ba92efc6-6b25-4cf4-8928-e43ee8af86b3', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:c6:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5387c31a-0c24-4e3c-affa-fa1ec6b6049c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1508, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.38', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:46:23Z', 'updated_at': '2021-11-09T04:47:20Z', 'revision_number': 6, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '704374ec-101b-43d6-885d-6f94bd9e79f5', 'name': '', 'network_id': 'd94a3ee1-87a4-4c0a-bb76-ba163a1da09e', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'mac_address': 'fa:16:3e:39:ed:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5387c31a-0c24-4e3c-affa-fa1ec6b6049c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1511, 'fixed_ips': [{'subnet_id': '5c7b951e-9bbe-42a8-b060-2593a9b43d55', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:46:26Z', 'updated_at': '2021-11-09T04:47:19Z', 'revision_number': 7, 'project_id': '1d10b4824e524068827e58b55e269af3', 'subnets': [{'id': '5c7b951e-9bbe-42a8-b060-2593a9b43d55', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:47:22.778037 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d2273c55-72b1-49f1-b6bd-b9f4b875c33e None None] New status for floating IP 85e06c71-c1da-46b2-9da1-faf6a61a02e5: DOWN {{(pid=102164) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 04:47:22.884552 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89f37c28-63a4-4816-9c98-5b6ac105765c req-55c0a328-ca62-49f4-9fe7-5a6ec2794038 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:47:22.886065 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-89f37c28-63a4-4816-9c98-5b6ac105765c req-55c0a328-ca62-49f4-9fe7-5a6ec2794038 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=225294e2-4901-42ff-87f7-49b3a90b7cf4 HTTP/1.1" status: 200 len: 945 time: 0.0500925 Nov 09 04:47:22.961661 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd0b0eb4-9cbc-48bd-bc8d-fe30507d5517 req-5d7c6b40-37c4-4643-8b2f-33e7dde52a7e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:47:22.963120 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-dd0b0eb4-9cbc-48bd-bc8d-fe30507d5517 req-5d7c6b40-37c4-4643-8b2f-33e7dde52a7e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "GET /v2.0/ports?device_id=225294e2-4901-42ff-87f7-49b3a90b7cf4 HTTP/1.1" status: 200 len: 945 time: 0.0761678 Nov 09 04:47:22.967734 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-89f37c28-63a4-4816-9c98-5b6ac105765c req-ecdf1acc-a3e1-48bf-9d33-80a0bc6f894e tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/security-groups?id=ded86ab2-85c5-4652-99a6-99be87d49327&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0726347 Nov 09 04:47:23.052350 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-dd0b0eb4-9cbc-48bd-bc8d-fe30507d5517 req-7881427b-6011-4160-b1c0-e9f569b49959 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Deleting port 817a4aeb-acd4-483a-82ca-30aa17e90689 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:47:23.052684 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-dd0b0eb4-9cbc-48bd-bc8d-fe30507d5517 req-7881427b-6011-4160-b1c0-e9f569b49959 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:23.139674 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-dd0b0eb4-9cbc-48bd-bc8d-fe30507d5517 req-7881427b-6011-4160-b1c0-e9f569b49959 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] For port 817a4aeb-acd4-483a-82ca-30aa17e90689, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=817a4aeb-acd4-483a-82ca-30aa17e90689,segment=NetworkSegment(a5eb9e23-3752-4ef9-8f5b-e308ed2db66c),segment_id=a5eb9e23-3752-4ef9-8f5b-e308ed2db66c)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:47:23.140033 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-dd0b0eb4-9cbc-48bd-bc8d-fe30507d5517 req-7881427b-6011-4160-b1c0-e9f569b49959 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:23.153307 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-dd0b0eb4-9cbc-48bd-bc8d-fe30507d5517 req-7881427b-6011-4160-b1c0-e9f569b49959 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Calling delete_port for 817a4aeb-acd4-483a-82ca-30aa17e90689 owned by compute:nova {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:47:23.339129 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-dd0b0eb4-9cbc-48bd-bc8d-fe30507d5517 req-7881427b-6011-4160-b1c0-e9f569b49959 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:23.366100 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7881427b-6011-4160-b1c0-e9f569b49959 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'Port': ['ID=817a4aeb-acd4-483a-82ca-30aa17e90689,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:47:23.411029 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-dd0b0eb4-9cbc-48bd-bc8d-fe30507d5517 req-7881427b-6011-4160-b1c0-e9f569b49959 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] No DVR routers for this DVR port 817a4aeb-acd4-483a-82ca-30aa17e90689 on host hv-neutron-8168 {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:47:23.413947 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-dd0b0eb4-9cbc-48bd-bc8d-fe30507d5517 req-7881427b-6011-4160-b1c0-e9f569b49959 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:23.416837 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-dd0b0eb4-9cbc-48bd-bc8d-fe30507d5517 req-7881427b-6011-4160-b1c0-e9f569b49959 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.26 "DELETE /v2.0/ports/817a4aeb-acd4-483a-82ca-30aa17e90689 HTTP/1.1" status: 204 len: 173 time: 0.4474382 Nov 09 04:47:23.417273 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '225294e2-4901-42ff-87f7-49b3a90b7cf4', 'name': 'network-vif-deleted', 'tag': '817a4aeb-acd4-483a-82ca-30aa17e90689'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:47:23.419640 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6358c499-d59f-46b4-b128-d22ce2952772" -d '{"events": [{"server_uuid": "225294e2-4901-42ff-87f7-49b3a90b7cf4", "name": "network-vif-deleted", "tag": "817a4aeb-acd4-483a-82ca-30aa17e90689"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:47:23.455569 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:47:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3040b033-013a-4b98-8e31-54cf61248240 x-openstack-request-id: req-3040b033-013a-4b98-8e31-54cf61248240 {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:47:23.455895 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "225294e2-4901-42ff-87f7-49b3a90b7cf4", "name": "network-vif-deleted", "tag": "817a4aeb-acd4-483a-82ca-30aa17e90689", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:47:23.456158 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-3040b033-013a-4b98-8e31-54cf61248240 {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:47:23.456809 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '225294e2-4901-42ff-87f7-49b3a90b7cf4', 'name': 'network-vif-deleted', 'tag': '817a4aeb-acd4-483a-82ca-30aa17e90689', 'status': 'completed', 'code': 200} Nov 09 04:47:24.068161 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4d32ef00-4436-43aa-899b-8b303af96827 req-57d7388f-1000-4192-9a88-b2d449ae8c65 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "GET /v2.0/ports?device_id=225294e2-4901-42ff-87f7-49b3a90b7cf4 HTTP/1.1" status: 200 len: 210 time: 0.0255246 Nov 09 04:47:24.462119 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:47:25.124322 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 33404) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:47:25.179340 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-977266f4-56af-468d-aa28-0b7c9698ef57 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:25.204662 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-977266f4-56af-468d-aa28-0b7c9698ef57 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:25.322164 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-977266f4-56af-468d-aa28-0b7c9698ef57 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:25.324820 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-977266f4-56af-468d-aa28-0b7c9698ef57 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:25.325972 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-977266f4-56af-468d-aa28-0b7c9698ef57 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "DELETE /v2.0/security-groups/ded86ab2-85c5-4652-99a6-99be87d49327 HTTP/1.1" status: 204 len: 168 time: 0.2006834 Nov 09 04:47:25.335164 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-977266f4-56af-468d-aa28-0b7c9698ef57 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=ded86ab2-85c5-4652-99a6-99be87d49327,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:47:25.343019 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-977266f4-56af-468d-aa28-0b7c9698ef57 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:47:25.346695 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-977266f4-56af-468d-aa28-0b7c9698ef57 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:47:25.346695 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-977266f4-56af-468d-aa28-0b7c9698ef57 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:47:25.346695 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-977266f4-56af-468d-aa28-0b7c9698ef57 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:47:25.346695 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-977266f4-56af-468d-aa28-0b7c9698ef57 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:47:25.346695 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-977266f4-56af-468d-aa28-0b7c9698ef57 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:47:25.346695 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-977266f4-56af-468d-aa28-0b7c9698ef57 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:47:25.346695 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-977266f4-56af-468d-aa28-0b7c9698ef57 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:47:25.346695 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-977266f4-56af-468d-aa28-0b7c9698ef57 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:47:25.346695 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-977266f4-56af-468d-aa28-0b7c9698ef57 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:47:25.346695 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-977266f4-56af-468d-aa28-0b7c9698ef57 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:47:25.346695 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-977266f4-56af-468d-aa28-0b7c9698ef57 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:47:25.414593 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33408) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:47:26.081938 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2ee35b05-a7c7-4c56-8ee6-eacdf8e42ae7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:26.119941 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 817a4aeb-acd4-483a-82ca-30aa17e90689 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:47:26.139653 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] No Port match for: 817a4aeb-acd4-483a-82ca-30aa17e90689 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:47:26.139996 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 817a4aeb-acd4-483a-82ca-30aa17e90689 not bound to the agent host hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:47:26.333625 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-2ee35b05-a7c7-4c56-8ee6-eacdf8e42ae7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Deleting port 704374ec-101b-43d6-885d-6f94bd9e79f5 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:47:26.333874 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2ee35b05-a7c7-4c56-8ee6-eacdf8e42ae7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:26.421995 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-2ee35b05-a7c7-4c56-8ee6-eacdf8e42ae7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] For port 704374ec-101b-43d6-885d-6f94bd9e79f5, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=704374ec-101b-43d6-885d-6f94bd9e79f5,segment=NetworkSegment(a5eb9e23-3752-4ef9-8f5b-e308ed2db66c),segment_id=a5eb9e23-3752-4ef9-8f5b-e308ed2db66c)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:47:26.422676 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2ee35b05-a7c7-4c56-8ee6-eacdf8e42ae7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:26.434632 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-2ee35b05-a7c7-4c56-8ee6-eacdf8e42ae7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Calling delete_port for 704374ec-101b-43d6-885d-6f94bd9e79f5 owned by network:router_interface {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:47:26.699063 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2ee35b05-a7c7-4c56-8ee6-eacdf8e42ae7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:26.724498 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ee35b05-a7c7-4c56-8ee6-eacdf8e42ae7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'Port': ['ID=704374ec-101b-43d6-885d-6f94bd9e79f5,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:47:26.909482 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2ee35b05-a7c7-4c56-8ee6-eacdf8e42ae7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:27.116761 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2ee35b05-a7c7-4c56-8ee6-eacdf8e42ae7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Router 5387c31a-0c24-4e3c-affa-fa1ec6b6049c has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:47:27.221139 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2ee35b05-a7c7-4c56-8ee6-eacdf8e42ae7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:47:27.226182 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-2ee35b05-a7c7-4c56-8ee6-eacdf8e42ae7 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "PUT /v2.0/routers/5387c31a-0c24-4e3c-affa-fa1ec6b6049c/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8103511 Nov 09 04:47:27.229162 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 33410) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:47:27.231159 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-be920042-657d-42ce-8531-b02769252e81 None None] Sync routers for ids ['5387c31a-0c24-4e3c-affa-fa1ec6b6049c'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:47:27.242017 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-be920042-657d-42ce-8531-b02769252e81 None None] Routers {'5387c31a-0c24-4e3c-affa-fa1ec6b6049c'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:47:27.242773 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-be920042-657d-42ce-8531-b02769252e81 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:47:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['5387c31a-0c24-4e3c-affa-fa1ec6b6049c'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:47:27.285040 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-4016e19f-c210-4a61-a43d-87f55e647f9c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Deleting subnet 5c7b951e-9bbe-42a8-b060-2593a9b43d55 {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:47:27.288143 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4016e19f-c210-4a61-a43d-87f55e647f9c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:27.329033 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4016e19f-c210-4a61-a43d-87f55e647f9c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:27.355603 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-be920042-657d-42ce-8531-b02769252e81 None None] Set router 5387c31a-0c24-4e3c-affa-fa1ec6b6049c gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:47:27.409966 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4016e19f-c210-4a61-a43d-87f55e647f9c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:27.522282 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4016e19f-c210-4a61-a43d-87f55e647f9c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:27.533372 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-be920042-657d-42ce-8531-b02769252e81 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5387c31a-0c24-4e3c-affa-fa1ec6b6049c', 'name': 'tempest-TestNetworkBasicOps-router-1242364910', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.38'}], 'enable_snat': True}, 'gw_port_id': 'ba92efc6-6b25-4cf4-8928-e43ee8af86b3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:46:22Z', 'updated_at': '2021-11-09T04:47:26Z', 'revision_number': 7, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': 'ba92efc6-6b25-4cf4-8928-e43ee8af86b3', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:c6:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5387c31a-0c24-4e3c-affa-fa1ec6b6049c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1508, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.38', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:46:23Z', 'updated_at': '2021-11-09T04:47:20Z', 'revision_number': 6, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:47:27.548212 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4016e19f-c210-4a61-a43d-87f55e647f9c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'Subnet': ['ID=5c7b951e-9bbe-42a8-b060-2593a9b43d55,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:47:27.554077 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4016e19f-c210-4a61-a43d-87f55e647f9c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:27.559916 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33412) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:47:27.561139 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-4016e19f-c210-4a61-a43d-87f55e647f9c tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "DELETE /v2.0/subnets/5c7b951e-9bbe-42a8-b060-2593a9b43d55 HTTP/1.1" status: 204 len: 168 time: 0.3297572 Nov 09 04:47:27.562814 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ee25dce0-539d-48d3-ac88-ddc28bb30359 None None] Network d94a3ee1-87a4-4c0a-bb76-ba163a1da09e requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:47:27.565149 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-be920042-657d-42ce-8531-b02769252e81 None None] Checking router: 5387c31a-0c24-4e3c-affa-fa1ec6b6049c for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:47:27.617406 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-be920042-657d-42ce-8531-b02769252e81 None None] Routers {'5387c31a-0c24-4e3c-affa-fa1ec6b6049c'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:47:27.618036 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-be920042-657d-42ce-8531-b02769252e81 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:47:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['5387c31a-0c24-4e3c-affa-fa1ec6b6049c'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:47:27.682081 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a4531011-ca47-459d-8a79-7b771c3f3fd8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:27.774992 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-be920042-657d-42ce-8531-b02769252e81 None None] Set router 5387c31a-0c24-4e3c-affa-fa1ec6b6049c gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:47:27.795667 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a4531011-ca47-459d-8a79-7b771c3f3fd8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router_gateway, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:27.854426 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-32d359d7-12c5-4b23-99ea-2e4a4fcf1819 None None] DHCP port deletion for d94a3ee1-87a4-4c0a-bb76-ba163a1da09e request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:47:27.945268 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-a4531011-ca47-459d-8a79-7b771c3f3fd8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Deleting port ba92efc6-6b25-4cf4-8928-e43ee8af86b3 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:47:27.945510 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a4531011-ca47-459d-8a79-7b771c3f3fd8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:27.976141 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-32d359d7-12c5-4b23-99ea-2e4a4fcf1819 None None] Deleting port 491fba02-7da3-4a54-9393-b4da06ff0c8a {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:47:27.976499 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-32d359d7-12c5-4b23-99ea-2e4a4fcf1819 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:28.029922 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-a4531011-ca47-459d-8a79-7b771c3f3fd8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] For port ba92efc6-6b25-4cf4-8928-e43ee8af86b3, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=ba92efc6-6b25-4cf4-8928-e43ee8af86b3,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:47:28.030284 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a4531011-ca47-459d-8a79-7b771c3f3fd8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:28.042875 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-a4531011-ca47-459d-8a79-7b771c3f3fd8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Calling delete_port for ba92efc6-6b25-4cf4-8928-e43ee8af86b3 owned by network:router_gateway {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:47:28.046715 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-32d359d7-12c5-4b23-99ea-2e4a4fcf1819 None None] For port 491fba02-7da3-4a54-9393-b4da06ff0c8a, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=491fba02-7da3-4a54-9393-b4da06ff0c8a,segment=NetworkSegment(a5eb9e23-3752-4ef9-8f5b-e308ed2db66c),segment_id=a5eb9e23-3752-4ef9-8f5b-e308ed2db66c)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:47:28.047138 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-32d359d7-12c5-4b23-99ea-2e4a4fcf1819 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:28.058136 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-be920042-657d-42ce-8531-b02769252e81 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5387c31a-0c24-4e3c-affa-fa1ec6b6049c', 'name': 'tempest-TestNetworkBasicOps-router-1242364910', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.38'}], 'enable_snat': True}, 'gw_port_id': 'ba92efc6-6b25-4cf4-8928-e43ee8af86b3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:46:22Z', 'updated_at': '2021-11-09T04:47:26Z', 'revision_number': 7, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': 'ba92efc6-6b25-4cf4-8928-e43ee8af86b3', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:c6:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5387c31a-0c24-4e3c-affa-fa1ec6b6049c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1508, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.38', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:46:23Z', 'updated_at': '2021-11-09T04:47:20Z', 'revision_number': 6, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:47:28.063353 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-32d359d7-12c5-4b23-99ea-2e4a4fcf1819 None None] Calling delete_port for 491fba02-7da3-4a54-9393-b4da06ff0c8a owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:47:28.093953 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-be920042-657d-42ce-8531-b02769252e81 None None] The sync data for ids ['5387c31a-0c24-4e3c-affa-fa1ec6b6049c'] in dv-neutron-816802-2-hyperv is: [{'id': '5387c31a-0c24-4e3c-affa-fa1ec6b6049c', 'name': 'tempest-TestNetworkBasicOps-router-1242364910', 'tenant_id': '1d10b4824e524068827e58b55e269af3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.38'}], 'enable_snat': True}, 'gw_port_id': 'ba92efc6-6b25-4cf4-8928-e43ee8af86b3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:46:22Z', 'updated_at': '2021-11-09T04:47:26Z', 'revision_number': 7, 'project_id': '1d10b4824e524068827e58b55e269af3', 'gw_port': {'id': 'ba92efc6-6b25-4cf4-8928-e43ee8af86b3', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:c6:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5387c31a-0c24-4e3c-affa-fa1ec6b6049c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1508, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.38', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:46:23Z', 'updated_at': '2021-11-09T04:47:20Z', 'revision_number': 6, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:47:28.281766 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a4531011-ca47-459d-8a79-7b771c3f3fd8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:28.308350 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4531011-ca47-459d-8a79-7b771c3f3fd8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'Port': ['ID=ba92efc6-6b25-4cf4-8928-e43ee8af86b3,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:47:28.379236 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a4531011-ca47-459d-8a79-7b771c3f3fd8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-466373'] for router_gateway, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:28.385134 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-32d359d7-12c5-4b23-99ea-2e4a4fcf1819 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:28.409176 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32d359d7-12c5-4b23-99ea-2e4a4fcf1819 None None] Pushing event deleted for resources: {'Port': ['ID=491fba02-7da3-4a54-9393-b4da06ff0c8a,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:47:28.417946 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-32d359d7-12c5-4b23-99ea-2e4a4fcf1819 None None] No DVR routers for this DVR port 491fba02-7da3-4a54-9393-b4da06ff0c8a on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:47:28.420260 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32d359d7-12c5-4b23-99ea-2e4a4fcf1819 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:47:28.420610 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32d359d7-12c5-4b23-99ea-2e4a4fcf1819 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:47:28.420952 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32d359d7-12c5-4b23-99ea-2e4a4fcf1819 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:47:28.421367 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32d359d7-12c5-4b23-99ea-2e4a4fcf1819 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:47:28.421694 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32d359d7-12c5-4b23-99ea-2e4a4fcf1819 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:47:28.422023 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32d359d7-12c5-4b23-99ea-2e4a4fcf1819 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:47:28.422349 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32d359d7-12c5-4b23-99ea-2e4a4fcf1819 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:47:28.422698 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32d359d7-12c5-4b23-99ea-2e4a4fcf1819 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:47:28.423021 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32d359d7-12c5-4b23-99ea-2e4a4fcf1819 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:47:28.423342 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32d359d7-12c5-4b23-99ea-2e4a4fcf1819 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:47:28.423665 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32d359d7-12c5-4b23-99ea-2e4a4fcf1819 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:47:28.423979 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32d359d7-12c5-4b23-99ea-2e4a4fcf1819 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:47:28.473346 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a4531011-ca47-459d-8a79-7b771c3f3fd8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:28.475660 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a4531011-ca47-459d-8a79-7b771c3f3fd8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:28.584588 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a4531011-ca47-459d-8a79-7b771c3f3fd8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:28.585216 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a4531011-ca47-459d-8a79-7b771c3f3fd8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Fanout notify agent at l3_agent the message router_deleted on router 5387c31a-0c24-4e3c-affa-fa1ec6b6049c {{(pid=102162) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:47:28.593879 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a4531011-ca47-459d-8a79-7b771c3f3fd8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:28.594945 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a4531011-ca47-459d-8a79-7b771c3f3fd8 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "DELETE /v2.0/routers/5387c31a-0c24-4e3c-affa-fa1ec6b6049c HTTP/1.1" status: 204 len: 168 time: 1.0330415 Nov 09 04:47:28.597630 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33414) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:47:28.670931 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-34547afd-e0f6-4585-92df-ebb3f23cb420 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:28.761720 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-34547afd-e0f6-4585-92df-ebb3f23cb420 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:28.785599 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-34547afd-e0f6-4585-92df-ebb3f23cb420 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d94a3ee1-87a4-4c0a-bb76-ba163a1da09e']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:47:28.795828 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-34547afd-e0f6-4585-92df-ebb3f23cb420 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a5eb9e23-3752-4ef9-8f5b-e308ed2db66c') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:47:28.795828 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-34547afd-e0f6-4585-92df-ebb3f23cb420 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a5eb9e23-3752-4ef9-8f5b-e308ed2db66c') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:47:28.804962 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-34547afd-e0f6-4585-92df-ebb3f23cb420 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:28.818206 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-34547afd-e0f6-4585-92df-ebb3f23cb420 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:28.824084 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-34547afd-e0f6-4585-92df-ebb3f23cb420 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Releasing vlan 335 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:47:28.828590 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-34547afd-e0f6-4585-92df-ebb3f23cb420 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:28.828590 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:47:28.828590 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:47:28.828590 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:47:28.828590 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:47:28.828590 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:47:28.828590 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:47:28.828590 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:47:28.828590 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:47:28.828590 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:47:28.828590 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:47:28.828590 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:47:28.828590 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:47:28.828590 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:47:28.828590 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:47:28.828590 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:47:28.828590 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:47:28.828590 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:47:28.828590 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:47:28.828590 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:47:28.828590 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:47:28.828590 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:47:28.828590 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:47:28.828590 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:47:28.828590 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:47:28.828590 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:47:28.828590 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:47:28.828590 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:47:28.828590 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:47:28.828590 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:47:28.828590 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:47:28.828590 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:47:28.828590 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:47:28.944945 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-34547afd-e0f6-4585-92df-ebb3f23cb420 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:28.952936 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-34547afd-e0f6-4585-92df-ebb3f23cb420 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:28.955629 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-34547afd-e0f6-4585-92df-ebb3f23cb420 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] 10.222.0.24 "DELETE /v2.0/networks/d94a3ee1-87a4-4c0a-bb76-ba163a1da09e HTTP/1.1" status: 204 len: 168 time: 0.3570802 Nov 09 04:47:28.967273 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34547afd-e0f6-4585-92df-ebb3f23cb420 tempest-TestNetworkBasicOps-683618413 tempest-TestNetworkBasicOps-683618413-project] Pushing event deleted for resources: {'Network': ['ID=d94a3ee1-87a4-4c0a-bb76-ba163a1da09e,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:47:29.412443 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33420) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:47:29.537703 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-4d61ae7e-d746-44ab-99f4-01017fc1c3e6 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=1d10b4824e524068827e58b55e269af3&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1240981 Nov 09 04:47:29.540240 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33424) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:47:29.585588 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-eb5901f3-4007-421f-8fa3-b3324835d362 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:29.605926 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-eb5901f3-4007-421f-8fa3-b3324835d362 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:29.709891 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 491fba02-7da3-4a54-9393-b4da06ff0c8a no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:47:29.710413 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-eb5901f3-4007-421f-8fa3-b3324835d362 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:29.712703 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-eb5901f3-4007-421f-8fa3-b3324835d362 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:29.713847 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-eb5901f3-4007-421f-8fa3-b3324835d362 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/2817c110-1ac7-4efe-9682-6d1a22d5b7a5 HTTP/1.1" status: 204 len: 168 time: 0.1727366 Nov 09 04:47:29.721742 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb5901f3-4007-421f-8fa3-b3324835d362 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2817c110-1ac7-4efe-9682-6d1a22d5b7a5,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:47:29.740709 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 491fba02-7da3-4a54-9393-b4da06ff0c8a {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:47:29.741053 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 491fba02-7da3-4a54-9393-b4da06ff0c8a not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:47:29.741473 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 704374ec-101b-43d6-885d-6f94bd9e79f5 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:47:29.768568 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 704374ec-101b-43d6-885d-6f94bd9e79f5 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:47:29.768919 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 704374ec-101b-43d6-885d-6f94bd9e79f5 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:47:29.769337 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device ba92efc6-6b25-4cf4-8928-e43ee8af86b3 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:47:29.788566 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: ba92efc6-6b25-4cf4-8928-e43ee8af86b3 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:47:29.788906 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device ba92efc6-6b25-4cf4-8928-e43ee8af86b3 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:47:30.251860 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33430) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:47:30.264793 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-98bc11b9-0da3-494f-9721-581938683474 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:30.348366 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-98bc11b9-0da3-494f-9721-581938683474 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:30.390279 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-98bc11b9-0da3-494f-9721-581938683474 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:30.428036 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-98bc11b9-0da3-494f-9721-581938683474 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=bb225fd1939d42e29753719d030b047f&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1750679 Nov 09 04:47:30.428794 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98bc11b9-0da3-494f-9721-581938683474 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=63b56f27-0efc-41e9-b7e7-5542bcad26ad,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:47:30.430764 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 33432) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:47:30.478168 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8a909301-3c5a-4faf-84d6-38b3bb2b27d3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:30.498866 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8a909301-3c5a-4faf-84d6-38b3bb2b27d3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:30.619055 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8a909301-3c5a-4faf-84d6-38b3bb2b27d3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:30.621674 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8a909301-3c5a-4faf-84d6-38b3bb2b27d3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:30.622940 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-8a909301-3c5a-4faf-84d6-38b3bb2b27d3 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/63b56f27-0efc-41e9-b7e7-5542bcad26ad HTTP/1.1" status: 204 len: 168 time: 0.1911612 Nov 09 04:47:30.630719 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a909301-3c5a-4faf-84d6-38b3bb2b27d3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=63b56f27-0efc-41e9-b7e7-5542bcad26ad,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:47:37.737700 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-aed78754-9a1f-40fc-bf53-098661b1c1c4 req-94dd3e30-33df-4776-bb2b-5b7a758c19d7 tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] 10.222.0.24 "GET /v2.0/networks?tenant_id=b2925b572b86446da33d2782203e6c95&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0302358 Nov 09 04:47:37.919874 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aed78754-9a1f-40fc-bf53-098661b1c1c4 req-8b5a052c-338e-4df9-a282-709c13078eee tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:47:37.921388 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-aed78754-9a1f-40fc-bf53-098661b1c1c4 req-8b5a052c-338e-4df9-a282-709c13078eee tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] 10.222.0.24 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1784675 Nov 09 04:47:37.935952 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-aed78754-9a1f-40fc-bf53-098661b1c1c4 req-d0394490-2f98-49c1-916f-ce9b2e05b30c tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] 10.222.0.24 "GET /v2.0/quotas/b2925b572b86446da33d2782203e6c95 HTTP/1.1" status: 200 len: 375 time: 0.0088456 Nov 09 04:47:37.967607 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-aed78754-9a1f-40fc-bf53-098661b1c1c4 req-ac0bfa2f-7078-4f3d-9afb-0c4a70b4d0f0 tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] 10.222.0.24 "GET /v2.0/ports?tenant_id=b2925b572b86446da33d2782203e6c95&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0265024 Nov 09 04:47:38.196313 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6288a0b1-5294-4389-a9ab-0d9e405e3b28 req-0983898a-dbb4-4c58-bee4-ba84208ebf6e tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] 10.222.0.24 "GET /v2.0/ports?device_id=ff686d2d-0527-4daf-82ad-232ed5388b0b HTTP/1.1" status: 200 len: 210 time: 0.0273125 Nov 09 04:47:39.292002 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-4dc7b69f-0ad2-4129-ae72-95f79d6c638b req-8aada5da-ff76-4214-b65d-4b77e5129ffd tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] 10.222.0.24 "GET /v2.0/ports?device_id=ff686d2d-0527-4daf-82ad-232ed5388b0b HTTP/1.1" status: 200 len: 210 time: 0.0282161 Nov 09 04:47:40.236734 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-aed78754-9a1f-40fc-bf53-098661b1c1c4 req-cc3367a3-acc8-4cba-9352-2e3c4cc8a42b tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] 10.222.0.26 "GET /v2.0/networks?tenant_id=b2925b572b86446da33d2782203e6c95&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0286844 Nov 09 04:47:40.420237 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f04cf09b-bd92-4565-8945-a3f33e6a6449 req-cc2bd2f2-7d49-43a6-8afd-6d02f6008870 tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] 10.222.0.24 "GET /v2.0/ports?device_id=ff686d2d-0527-4daf-82ad-232ed5388b0b HTTP/1.1" status: 200 len: 210 time: 0.0531325 Nov 09 04:47:40.446123 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aed78754-9a1f-40fc-bf53-098661b1c1c4 req-9587d419-cd5c-4fa4-856c-3b91de35d71f tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:47:40.447570 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-aed78754-9a1f-40fc-bf53-098661b1c1c4 req-9587d419-cd5c-4fa4-856c-3b91de35d71f tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] 10.222.0.26 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2050686 Nov 09 04:47:40.460331 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-aed78754-9a1f-40fc-bf53-098661b1c1c4 req-b13d4772-c0cd-48f2-920a-5840f42c592f tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] Request body: {'port': {'device_id': 'ff686d2d-0527-4daf-82ad-232ed5388b0b', 'network_id': '4ebec4f8-ab1a-452b-a4e5-d8a3ef247cf7', 'admin_state_up': True, 'tenant_id': 'b2925b572b86446da33d2782203e6c95'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:47:40.624371 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-aed78754-9a1f-40fc-bf53-098661b1c1c4 req-b13d4772-c0cd-48f2-920a-5840f42c592f tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] Made reservation on behalf of b2925b572b86446da33d2782203e6c95 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:47:40.627916 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-aed78754-9a1f-40fc-bf53-098661b1c1c4 req-b13d4772-c0cd-48f2-920a-5840f42c592f tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:40.640082 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-aed78754-9a1f-40fc-bf53-098661b1c1c4 req-b13d4772-c0cd-48f2-920a-5840f42c592f tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:40.710211 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-aed78754-9a1f-40fc-bf53-098661b1c1c4 req-b13d4772-c0cd-48f2-920a-5840f42c592f tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:40.784266 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-aed78754-9a1f-40fc-bf53-098661b1c1c4 req-b13d4772-c0cd-48f2-920a-5840f42c592f tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:40.844693 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b13d4772-c0cd-48f2-920a-5840f42c592f tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] Pushing event updated for resources: {'SecurityGroup': ['ID=9b9d1470-7f43-4f96-b8b9-9b40e4fc964f,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:47:40.913066 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [req-aed78754-9a1f-40fc-bf53-098661b1c1c4 req-b13d4772-c0cd-48f2-920a-5840f42c592f tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] Allocated IP 192.168.233.201 (4ebec4f8-ab1a-452b-a4e5-d8a3ef247cf7/d8e36c73-ed38-4b28-87ea-6ec74f207dd1/2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:47:41.054452 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-aed78754-9a1f-40fc-bf53-098661b1c1c4 req-b13d4772-c0cd-48f2-920a-5840f42c592f tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:41.121882 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-aed78754-9a1f-40fc-bf53-098661b1c1c4 req-b13d4772-c0cd-48f2-920a-5840f42c592f tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:41.163382 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-aed78754-9a1f-40fc-bf53-098661b1c1c4 req-b13d4772-c0cd-48f2-920a-5840f42c592f tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] Network 4ebec4f8-ab1a-452b-a4e5-d8a3ef247cf7 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:47:41.168293 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [req-aed78754-9a1f-40fc-bf53-098661b1c1c4 req-b13d4772-c0cd-48f2-920a-5840f42c592f tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:47:41.172697 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-aed78754-9a1f-40fc-bf53-098661b1c1c4 req-b13d4772-c0cd-48f2-920a-5840f42c592f tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:47:41.199693 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b13d4772-c0cd-48f2-920a-5840f42c592f tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] Pushing event updated for resources: {'Port': ['ID=2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:47:41.229184 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aed78754-9a1f-40fc-bf53-098661b1c1c4 req-b13d4772-c0cd-48f2-920a-5840f42c592f tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:47:41.229950 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-aed78754-9a1f-40fc-bf53-098661b1c1c4 req-b13d4772-c0cd-48f2-920a-5840f42c592f tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:41.279512 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-aed78754-9a1f-40fc-bf53-098661b1c1c4 req-b13d4772-c0cd-48f2-920a-5840f42c592f tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] 10.222.0.26 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 0.8227530 Nov 09 04:47:41.292173 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-aed78754-9a1f-40fc-bf53-098661b1c1c4 req-f9965778-bea0-4019-ae3d-b8f289f6da23 service neutron] Request body: {'port': {'device_id': 'ff686d2d-0527-4daf-82ad-232ed5388b0b', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:47:41.347581 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-aed78754-9a1f-40fc-bf53-098661b1c1c4 req-f9965778-bea0-4019-ae3d-b8f289f6da23 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:41.351052 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-a2f3d569-365c-4e7a-ab83-6dc227351e0d None None] Provisioning complete for port 2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:47:41.351536 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a2f3d569-365c-4e7a-ab83-6dc227351e0d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:41.387405 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-a2f3d569-365c-4e7a-ab83-6dc227351e0d None None] Port 2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:47:41.390504 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d9e9c61d-79c6-49e7-bd7e-9ccf2a4964bf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:41.539051 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d70ee5b-902a-47b5-827b-6eba54c7fb7d req-93197e85-e782-45cf-87c2-baca3fc21377 tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:47:41.540526 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-6d70ee5b-902a-47b5-827b-6eba54c7fb7d req-93197e85-e782-45cf-87c2-baca3fc21377 tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] 10.222.0.24 "GET /v2.0/ports?device_id=ff686d2d-0527-4daf-82ad-232ed5388b0b HTTP/1.1" status: 200 len: 936 time: 0.0482299 Nov 09 04:47:41.591326 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-6d70ee5b-902a-47b5-827b-6eba54c7fb7d req-021c4d7c-2def-4cb5-be9c-495903183ad9 tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] 10.222.0.24 "GET /v2.0/security-groups?id=9b9d1470-7f43-4f96-b8b9-9b40e4fc964f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441043 Nov 09 04:47:41.609735 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [req-aed78754-9a1f-40fc-bf53-098661b1c1c4 req-f9965778-bea0-4019-ae3d-b8f289f6da23 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac {{(pid=102162) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:47:41.617284 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-aed78754-9a1f-40fc-bf53-098661b1c1c4 req-f9965778-bea0-4019-ae3d-b8f289f6da23 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:41.629150 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.provisioning_blocks [req-aed78754-9a1f-40fc-bf53-098661b1c1c4 req-f9965778-bea0-4019-ae3d-b8f289f6da23 service neutron] Transition to ACTIVE for port object 2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac will not be triggered until provisioned by entity L2. {{(pid=102162) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 09 04:47:41.692462 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-aed78754-9a1f-40fc-bf53-098661b1c1c4 req-f9965778-bea0-4019-ae3d-b8f289f6da23 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:41.742466 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9965778-bea0-4019-ae3d-b8f289f6da23 service neutron] Pushing event updated for resources: {'Port': ['ID=2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:47:41.813586 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-aed78754-9a1f-40fc-bf53-098661b1c1c4 req-f9965778-bea0-4019-ae3d-b8f289f6da23 service neutron] Attempting to bind port 2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:47:41.814172 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-aed78754-9a1f-40fc-bf53-098661b1c1c4 req-f9965778-bea0-4019-ae3d-b8f289f6da23 service neutron] Attempting to bind port 2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '0c5d83af-b6a6-4c01-9649-7c99fc2fff40', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 347, 'network_id': '4ebec4f8-ab1a-452b-a4e5-d8a3ef247cf7'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:47:41.814736 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aed78754-9a1f-40fc-bf53-098661b1c1c4 req-f9965778-bea0-4019-ae3d-b8f289f6da23 service neutron] Attempting to bind port 2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac on network 4ebec4f8-ab1a-452b-a4e5-d8a3ef247cf7 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:47:41.821011 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aed78754-9a1f-40fc-bf53-098661b1c1c4 req-f9965778-bea0-4019-ae3d-b8f289f6da23 service neutron] Port 2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac on network 4ebec4f8-ab1a-452b-a4e5-d8a3ef247cf7 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:47:41.821408 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aed78754-9a1f-40fc-bf53-098661b1c1c4 req-f9965778-bea0-4019-ae3d-b8f289f6da23 service neutron] Attempting to bind port 2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac on network 4ebec4f8-ab1a-452b-a4e5-d8a3ef247cf7 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:47:41.827269 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aed78754-9a1f-40fc-bf53-098661b1c1c4 req-f9965778-bea0-4019-ae3d-b8f289f6da23 service neutron] Checking agent: {'id': '7d36b884-4ad2-4878-9464-bf647030b544', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'started_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 47, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:47:41.827601 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aed78754-9a1f-40fc-bf53-098661b1c1c4 req-f9965778-bea0-4019-ae3d-b8f289f6da23 service neutron] Checking segment: {'id': '0c5d83af-b6a6-4c01-9649-7c99fc2fff40', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 347, 'network_id': '4ebec4f8-ab1a-452b-a4e5-d8a3ef247cf7'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:47:41.827980 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aed78754-9a1f-40fc-bf53-098661b1c1c4 req-f9965778-bea0-4019-ae3d-b8f289f6da23 service neutron] Bound using segment: {'id': '0c5d83af-b6a6-4c01-9649-7c99fc2fff40', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 347, 'network_id': '4ebec4f8-ab1a-452b-a4e5-d8a3ef247cf7'} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:47:41.828611 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-aed78754-9a1f-40fc-bf53-098661b1c1c4 req-f9965778-bea0-4019-ae3d-b8f289f6da23 service neutron] Bound port: 2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '0c5d83af-b6a6-4c01-9649-7c99fc2fff40', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 347, 'network_id': '4ebec4f8-ab1a-452b-a4e5-d8a3ef247cf7'}}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:47:41.828963 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-aed78754-9a1f-40fc-bf53-098661b1c1c4 req-f9965778-bea0-4019-ae3d-b8f289f6da23 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:41.900476 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-aed78754-9a1f-40fc-bf53-098661b1c1c4 req-f9965778-bea0-4019-ae3d-b8f289f6da23 service neutron] For port 2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac, host hv-neutron-8168, cleared binding levels {{(pid=102162) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:47:41.904176 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-aed78754-9a1f-40fc-bf53-098661b1c1c4 req-f9965778-bea0-4019-ae3d-b8f289f6da23 service neutron] For port 2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac,segment=NetworkSegment(0c5d83af-b6a6-4c01-9649-7c99fc2fff40),segment_id=0c5d83af-b6a6-4c01-9649-7c99fc2fff40)] {{(pid=102162) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:47:41.967987 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-aed78754-9a1f-40fc-bf53-098661b1c1c4 req-f9965778-bea0-4019-ae3d-b8f289f6da23 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:42.002237 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aed78754-9a1f-40fc-bf53-098661b1c1c4 req-f9965778-bea0-4019-ae3d-b8f289f6da23 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:47:42.002946 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-aed78754-9a1f-40fc-bf53-098661b1c1c4 req-f9965778-bea0-4019-ae3d-b8f289f6da23 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:42.004296 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-aed78754-9a1f-40fc-bf53-098661b1c1c4 req-f9965778-bea0-4019-ae3d-b8f289f6da23 service neutron] 10.222.0.26 "PUT /v2.0/ports/2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac HTTP/1.1" status: 200 len: 1098 time: 0.7168310 Nov 09 04:47:42.004776 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ff686d2d-0527-4daf-82ad-232ed5388b0b', 'tag': '2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:47:42.007030 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-478f7419-85e8-4f1f-98ea-a58569ea5c59" -d '{"events": [{"name": "network-changed", "server_uuid": "ff686d2d-0527-4daf-82ad-232ed5388b0b", "tag": "2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:47:42.074335 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9965778-bea0-4019-ae3d-b8f289f6da23 service neutron] Pushing event updated for resources: {'Port': ['ID=2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac,revision_number=3']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:47:42.074335 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:47:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c16b6701-5649-4f11-8cdf-381083f8dcf9 x-openstack-request-id: req-c16b6701-5649-4f11-8cdf-381083f8dcf9 {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:47:42.074335 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ff686d2d-0527-4daf-82ad-232ed5388b0b", "tag": "2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:47:42.074335 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-c16b6701-5649-4f11-8cdf-381083f8dcf9 {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:47:42.074335 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ff686d2d-0527-4daf-82ad-232ed5388b0b', 'tag': '2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac', 'status': 'completed', 'code': 200} Nov 09 04:47:42.115111 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-478f7419-85e8-4f1f-98ea-a58569ea5c59 req-a8d34c74-6817-4ffd-a650-c1327a0c49ed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:47:42.116542 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-478f7419-85e8-4f1f-98ea-a58569ea5c59 req-a8d34c74-6817-4ffd-a650-c1327a0c49ed service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=b2925b572b86446da33d2782203e6c95&device_id=ff686d2d-0527-4daf-82ad-232ed5388b0b HTTP/1.1" status: 200 len: 1101 time: 0.0441360 Nov 09 04:47:42.145172 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-478f7419-85e8-4f1f-98ea-a58569ea5c59 req-7d6cc486-7312-4d22-b60b-bb8726c572c6 service neutron] 10.222.0.26 "GET /v2.0/networks?tenant_id=b2925b572b86446da33d2782203e6c95&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0207198 Nov 09 04:47:42.241857 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:42.248013 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-478f7419-85e8-4f1f-98ea-a58569ea5c59 req-abc1f120-5c26-49fb-b3e3-0e055d5d3f91 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:47:42.249490 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-478f7419-85e8-4f1f-98ea-a58569ea5c59 req-abc1f120-5c26-49fb-b3e3-0e055d5d3f91 service neutron] 10.222.0.26 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0975423 Nov 09 04:47:42.333461 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aed78754-9a1f-40fc-bf53-098661b1c1c4 req-bedd75b2-387d-4b78-bdd9-d49484fe1345 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:47:42.333461 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-aed78754-9a1f-40fc-bf53-098661b1c1c4 req-bedd75b2-387d-4b78-bdd9-d49484fe1345 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=b2925b572b86446da33d2782203e6c95&device_id=ff686d2d-0527-4daf-82ad-232ed5388b0b HTTP/1.1" status: 200 len: 1101 time: 0.0412304 Nov 09 04:47:42.377877 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-aed78754-9a1f-40fc-bf53-098661b1c1c4 req-20050567-2541-4ed0-8634-a2c6acc22627 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.201&port_id=2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac HTTP/1.1" status: 200 len: 217 time: 0.0345151 Nov 09 04:47:42.429862 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aed78754-9a1f-40fc-bf53-098661b1c1c4 req-ff63d8a9-2339-4a8b-bd3d-708803f9a887 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:47:42.431318 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-aed78754-9a1f-40fc-bf53-098661b1c1c4 req-ff63d8a9-2339-4a8b-bd3d-708803f9a887 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=d8e36c73-ed38-4b28-87ea-6ec74f207dd1 HTTP/1.1" status: 200 len: 843 time: 0.0472519 Nov 09 04:47:42.475156 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aed78754-9a1f-40fc-bf53-098661b1c1c4 req-3c43e886-8e25-41af-bef3-a0d98facbaf4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:47:42.476574 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-aed78754-9a1f-40fc-bf53-098661b1c1c4 req-3c43e886-8e25-41af-bef3-a0d98facbaf4 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=4ebec4f8-ab1a-452b-a4e5-d8a3ef247cf7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1180 time: 0.0384173 Nov 09 04:47:42.563338 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-aed78754-9a1f-40fc-bf53-098661b1c1c4 req-9665a9dc-f46e-413f-913e-cb5e1cf24818 service neutron] 10.222.0.26 "GET /v2.0/networks/4ebec4f8-ab1a-452b-a4e5-d8a3ef247cf7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0795922 Nov 09 04:47:42.661992 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-aed78754-9a1f-40fc-bf53-098661b1c1c4 req-6e6e1389-af42-428c-8980-7132a0ba90e3 service neutron] 10.222.0.26 "GET /v2.0/networks/4ebec4f8-ab1a-452b-a4e5-d8a3ef247cf7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0909057 Nov 09 04:47:42.708879 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff92cd37-5eff-455d-b747-c7235cd7c894 req-76aeeafb-18bb-4dc4-aaed-5809b878e62b tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:47:42.710332 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ff92cd37-5eff-455d-b747-c7235cd7c894 req-76aeeafb-18bb-4dc4-aaed-5809b878e62b tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] 10.222.0.24 "GET /v2.0/ports?device_id=ff686d2d-0527-4daf-82ad-232ed5388b0b HTTP/1.1" status: 200 len: 948 time: 0.0484791 Nov 09 04:47:42.757755 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ff92cd37-5eff-455d-b747-c7235cd7c894 req-8e151ba8-2739-4117-8852-058bb0210047 tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] 10.222.0.24 "GET /v2.0/security-groups?id=9b9d1470-7f43-4f96-b8b9-9b40e4fc964f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407820 Nov 09 04:47:43.681152 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ec3587f4-1c44-4ea0-b8c7-9cba4f740972 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:43.869601 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-617750c9-d016-41fd-9d70-b05d8ced6b1f req-9bdcbdf9-c632-4003-be98-f17ff6134e05 tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:47:43.871148 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-617750c9-d016-41fd-9d70-b05d8ced6b1f req-9bdcbdf9-c632-4003-be98-f17ff6134e05 tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] 10.222.0.24 "GET /v2.0/ports?device_id=ff686d2d-0527-4daf-82ad-232ed5388b0b HTTP/1.1" status: 200 len: 948 time: 0.0480378 Nov 09 04:47:43.917598 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-617750c9-d016-41fd-9d70-b05d8ced6b1f req-6a1863ea-9eed-4e57-8fe2-a8541625d133 tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] 10.222.0.24 "GET /v2.0/security-groups?id=9b9d1470-7f43-4f96-b8b9-9b40e4fc964f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398405 Nov 09 04:47:44.156292 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=102163) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 09 04:47:44.249586 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac,segment=NetworkSegment(0c5d83af-b6a6-4c01-9649-7c99fc2fff40),segment_id=0c5d83af-b6a6-4c01-9649-7c99fc2fff40)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:47:44.261013 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Returning: {'device': '2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac', 'network_id': '4ebec4f8-ab1a-452b-a4e5-d8a3ef247cf7', 'port_id': '2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac', 'mac_address': 'fa:16:3e:05:c8:0a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 347, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd8e36c73-ed38-4b28-87ea-6ec74f207dd1', 'ip_address': '192.168.233.201'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102163) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 09 04:47:44.297048 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:44.308979 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:47:44.327095 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac,segment=NetworkSegment(0c5d83af-b6a6-4c01-9649-7c99fc2fff40),segment_id=0c5d83af-b6a6-4c01-9649-7c99fc2fff40)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:47:44.372172 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:44.423708 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:47:44.705438 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 04:47:45.030121 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-915d1a56-4eba-4eee-8232-964834b5c5ee req-09dd3740-ae8f-4b63-89ac-4d56b0c020ac tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:47:45.031606 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-915d1a56-4eba-4eee-8232-964834b5c5ee req-09dd3740-ae8f-4b63-89ac-4d56b0c020ac tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] 10.222.0.24 "GET /v2.0/ports?device_id=ff686d2d-0527-4daf-82ad-232ed5388b0b HTTP/1.1" status: 200 len: 949 time: 0.0473244 Nov 09 04:47:45.077351 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-915d1a56-4eba-4eee-8232-964834b5c5ee req-0694de36-0309-4438-85db-3ae02e5a6a31 tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] 10.222.0.24 "GET /v2.0/security-groups?id=9b9d1470-7f43-4f96-b8b9-9b40e4fc964f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399833 Nov 09 04:47:45.132655 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:46.158625 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac up at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:47:46.193680 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a23482eb-c3c0-46da-9410-b9d72185664e req-bee22b63-0123-4539-8b5e-6e4f65a4768e tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:47:46.195186 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a23482eb-c3c0-46da-9410-b9d72185664e req-bee22b63-0123-4539-8b5e-6e4f65a4768e tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] 10.222.0.24 "GET /v2.0/ports?device_id=ff686d2d-0527-4daf-82ad-232ed5388b0b HTTP/1.1" status: 200 len: 949 time: 0.0518947 Nov 09 04:47:46.241579 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a23482eb-c3c0-46da-9410-b9d72185664e req-f72b95a0-43cc-45b0-be85-6174025481ec tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] 10.222.0.24 "GET /v2.0/security-groups?id=9b9d1470-7f43-4f96-b8b9-9b40e4fc964f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405114 Nov 09 04:47:46.275540 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning for port 2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac completed by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 09 04:47:46.279990 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning complete for port 2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:47:46.280351 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:46.355656 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:46.377408 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ff686d2d-0527-4daf-82ad-232ed5388b0b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:47:46.379693 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c4610709-8ad8-4b58-8857-cc7871757b28" -d '{"events": [{"server_uuid": "ff686d2d-0527-4daf-82ad-232ed5388b0b", "name": "network-vif-plugged", "status": "completed", "tag": "2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:47:46.396631 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac,segment=NetworkSegment(0c5d83af-b6a6-4c01-9649-7c99fc2fff40),segment_id=0c5d83af-b6a6-4c01-9649-7c99fc2fff40)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:47:46.417721 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:47:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-df3f870b-bd0a-44b0-8e9b-7aca0d511ee4 x-openstack-request-id: req-df3f870b-bd0a-44b0-8e9b-7aca0d511ee4 {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:47:46.417999 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ff686d2d-0527-4daf-82ad-232ed5388b0b", "name": "network-vif-plugged", "status": "completed", "tag": "2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:47:46.418245 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-df3f870b-bd0a-44b0-8e9b-7aca0d511ee4 {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:47:46.418664 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ff686d2d-0527-4daf-82ad-232ed5388b0b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac', 'code': 200} Nov 09 04:47:46.475635 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:46.500732 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:46.523297 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:47:46.709227 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7132ea3-df3b-4fb1-bcf6-c70c70b41385 req-6734cc7d-3b9c-455a-bc01-4e119ada1ff3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:47:46.709227 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a7132ea3-df3b-4fb1-bcf6-c70c70b41385 req-6734cc7d-3b9c-455a-bc01-4e119ada1ff3 service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=ff686d2d-0527-4daf-82ad-232ed5388b0b HTTP/1.1" status: 200 len: 1103 time: 0.0407326 Nov 09 04:47:46.748804 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a7132ea3-df3b-4fb1-bcf6-c70c70b41385 req-b0a9be2b-44a3-4ebf-8050-3e82fb2b5ead service neutron] 10.222.0.26 "GET /v2.0/security-groups?id=9b9d1470-7f43-4f96-b8b9-9b40e4fc964f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0366085 Nov 09 04:47:46.949445 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:47.357176 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9b4c84f-bc20-45a3-bdca-1fb31a5f4853 req-b1ee2310-d172-477b-95df-699296e2ba61 tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:47:47.358646 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e9b4c84f-bc20-45a3-bdca-1fb31a5f4853 req-b1ee2310-d172-477b-95df-699296e2ba61 tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] 10.222.0.24 "GET /v2.0/ports?device_id=ff686d2d-0527-4daf-82ad-232ed5388b0b HTTP/1.1" status: 200 len: 950 time: 0.0511045 Nov 09 04:47:47.403867 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e9b4c84f-bc20-45a3-bdca-1fb31a5f4853 req-de8dff22-0e4c-4d77-8100-e88f863c50f6 tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] 10.222.0.24 "GET /v2.0/security-groups?id=9b9d1470-7f43-4f96-b8b9-9b40e4fc964f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393107 Nov 09 04:47:48.523685 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6758044d-689a-47ca-ae8b-c98d342ac82c req-2fb02419-da6b-4b29-a0f5-08f3d722b2a1 tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:47:48.525150 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-6758044d-689a-47ca-ae8b-c98d342ac82c req-2fb02419-da6b-4b29-a0f5-08f3d722b2a1 tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] 10.222.0.24 "GET /v2.0/ports?device_id=ff686d2d-0527-4daf-82ad-232ed5388b0b HTTP/1.1" status: 200 len: 950 time: 0.0513735 Nov 09 04:47:48.570984 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-6758044d-689a-47ca-ae8b-c98d342ac82c req-fa441f14-8354-416d-abaf-216db548209c tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] 10.222.0.24 "GET /v2.0/security-groups?id=9b9d1470-7f43-4f96-b8b9-9b40e4fc964f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391736 Nov 09 04:47:49.009267 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [req-67747609-a850-4c0d-b8cf-5efd1803cdf1 req-fc738156-b6a3-4c2d-9410-86c0d7256ca5 service neutron] http://10.222.0.24:9696/v2.0/extensions returned with HTTP 200 {{(pid=102162) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:47:49.010268 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-67747609-a850-4c0d-b8cf-5efd1803cdf1 req-fc738156-b6a3-4c2d-9410-86c0d7256ca5 service neutron] 10.222.0.24 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0940323 Nov 09 04:47:49.558154 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [req-2335db9b-a22c-4dc9-ac81-f3ef5b58ac3a req-825c79f5-5426-4db9-a6fd-376685ba035d service neutron] http://10.222.0.24:9696/v2.0/extensions returned with HTTP 200 {{(pid=102161) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:47:49.559215 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-2335db9b-a22c-4dc9-ac81-f3ef5b58ac3a req-825c79f5-5426-4db9-a6fd-376685ba035d service neutron] 10.222.0.24 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0521464 Nov 09 04:47:50.099765 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27702a79-49a6-4b96-988d-7a3284c6ba2b req-d4f4e200-fa6a-4f38-ad11-a0ababe5be86 tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:47:50.111886 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-27702a79-49a6-4b96-988d-7a3284c6ba2b req-d4f4e200-fa6a-4f38-ad11-a0ababe5be86 tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] 10.222.0.24 "GET /v2.0/ports?device_id=ff686d2d-0527-4daf-82ad-232ed5388b0b HTTP/1.1" status: 200 len: 950 time: 0.0481126 Nov 09 04:47:50.146757 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-27702a79-49a6-4b96-988d-7a3284c6ba2b req-e3f8496d-d0f2-450d-bbcc-21925cc9a511 tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] 10.222.0.24 "GET /v2.0/security-groups?id=9b9d1470-7f43-4f96-b8b9-9b40e4fc964f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396824 Nov 09 04:47:51.263277 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95ebfebc-6743-4e2e-92de-c45d2456a4f3 req-0afaf8dc-74e9-46bd-a6a6-f1149c51b60d tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:47:51.264752 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-95ebfebc-6743-4e2e-92de-c45d2456a4f3 req-0afaf8dc-74e9-46bd-a6a6-f1149c51b60d tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] 10.222.0.24 "GET /v2.0/ports?device_id=ff686d2d-0527-4daf-82ad-232ed5388b0b HTTP/1.1" status: 200 len: 950 time: 0.0485725 Nov 09 04:47:51.312767 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-95ebfebc-6743-4e2e-92de-c45d2456a4f3 req-226bbac0-a81c-4dbc-bb85-800a50774209 tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] 10.222.0.24 "GET /v2.0/security-groups?id=9b9d1470-7f43-4f96-b8b9-9b40e4fc964f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420640 Nov 09 04:47:51.380156 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a09f662-7b4c-4949-bd67-742442b4b551 req-bf09ca03-39aa-400a-a841-a9696f9077ab tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:47:51.381548 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4a09f662-7b4c-4949-bd67-742442b4b551 req-bf09ca03-39aa-400a-a841-a9696f9077ab tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] 10.222.0.26 "GET /v2.0/ports?device_id=ff686d2d-0527-4daf-82ad-232ed5388b0b HTTP/1.1" status: 200 len: 950 time: 0.0461605 Nov 09 04:47:51.469959 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-4a09f662-7b4c-4949-bd67-742442b4b551 req-98c21338-a06a-410b-a584-b25971bcf3e6 tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] Deleting port 2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:47:51.470203 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-4a09f662-7b4c-4949-bd67-742442b4b551 req-98c21338-a06a-410b-a584-b25971bcf3e6 tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:51.553446 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-4a09f662-7b4c-4949-bd67-742442b4b551 req-98c21338-a06a-410b-a584-b25971bcf3e6 tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] For port 2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac,segment=NetworkSegment(0c5d83af-b6a6-4c01-9649-7c99fc2fff40),segment_id=0c5d83af-b6a6-4c01-9649-7c99fc2fff40)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:47:51.553792 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-4a09f662-7b4c-4949-bd67-742442b4b551 req-98c21338-a06a-410b-a584-b25971bcf3e6 tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:51.565818 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-4a09f662-7b4c-4949-bd67-742442b4b551 req-98c21338-a06a-410b-a584-b25971bcf3e6 tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] Calling delete_port for 2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac owned by compute:nova {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:47:52.057796 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-4a09f662-7b4c-4949-bd67-742442b4b551 req-98c21338-a06a-410b-a584-b25971bcf3e6 tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:52.069361 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 04:47:52.084577 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98c21338-a06a-410b-a584-b25971bcf3e6 tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] Pushing event deleted for resources: {'Port': ['ID=2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:47:52.142127 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-4a09f662-7b4c-4949-bd67-742442b4b551 req-98c21338-a06a-410b-a584-b25971bcf3e6 tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] No DVR routers for this DVR port 2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac on host hv-neutron-8168 {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:47:52.144662 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-4a09f662-7b4c-4949-bd67-742442b4b551 req-98c21338-a06a-410b-a584-b25971bcf3e6 tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:52.148052 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4a09f662-7b4c-4949-bd67-742442b4b551 req-98c21338-a06a-410b-a584-b25971bcf3e6 tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] 10.222.0.26 "DELETE /v2.0/ports/2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac HTTP/1.1" status: 204 len: 173 time: 0.7592235 Nov 09 04:47:52.148497 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ff686d2d-0527-4daf-82ad-232ed5388b0b', 'name': 'network-vif-deleted', 'tag': '2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:47:52.150770 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-47c3bc38-0844-4b05-b31f-20c547461e1b" -d '{"events": [{"server_uuid": "ff686d2d-0527-4daf-82ad-232ed5388b0b", "name": "network-vif-deleted", "tag": "2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:47:52.189426 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:47:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-102a1c57-dcc6-4ade-af4c-92e195a0c34c x-openstack-request-id: req-102a1c57-dcc6-4ade-af4c-92e195a0c34c {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:47:52.189711 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ff686d2d-0527-4daf-82ad-232ed5388b0b", "name": "network-vif-deleted", "tag": "2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:47:52.189954 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-102a1c57-dcc6-4ade-af4c-92e195a0c34c {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:47:52.190345 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ff686d2d-0527-4daf-82ad-232ed5388b0b', 'name': 'network-vif-deleted', 'tag': '2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac', 'status': 'completed', 'code': 200} Nov 09 04:47:52.425431 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-86c090d0-bc0b-4e45-818f-0bb7b0d7c3e0 req-54243f41-0da0-419e-a7de-8be116143dd3 tempest-ServersAdminNegativeTestJSON-1752139875 tempest-ServersAdminNegativeTestJSON-1752139875-project] 10.222.0.24 "GET /v2.0/ports?device_id=ff686d2d-0527-4daf-82ad-232ed5388b0b HTTP/1.1" status: 200 len: 210 time: 0.0255275 Nov 09 04:47:53.955170 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33572) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:47:54.079837 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-b9c12eda-4e9b-4cc3-9487-4eecc9dddff0 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=b2925b572b86446da33d2782203e6c95&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1232660 Nov 09 04:47:54.082492 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33576) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:47:54.126193 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9f0f64a4-95c2-4559-bdd2-f030ba5d1012 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:54.146970 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9f0f64a4-95c2-4559-bdd2-f030ba5d1012 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:54.202939 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac no longer exists at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:47:54.226562 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] No Port match for: 2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:47:54.226902 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 2cb7d9b2-1daf-4aa4-9ec4-6aefbc1da0ac not bound to the agent host hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:47:54.252317 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9f0f64a4-95c2-4559-bdd2-f030ba5d1012 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:54.254934 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9f0f64a4-95c2-4559-bdd2-f030ba5d1012 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:54.256067 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-9f0f64a4-95c2-4559-bdd2-f030ba5d1012 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/9b9d1470-7f43-4f96-b8b9-9b40e4fc964f HTTP/1.1" status: 204 len: 168 time: 0.1727071 Nov 09 04:47:54.263931 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f0f64a4-95c2-4559-bdd2-f030ba5d1012 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9b9d1470-7f43-4f96-b8b9-9b40e4fc964f,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:47:54.782769 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33582) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:47:54.795659 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1abac543-9bd7-4aa1-a6cb-f6ea6d0ef739 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:54.868792 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1abac543-9bd7-4aa1-a6cb-f6ea6d0ef739 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:54.920429 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1abac543-9bd7-4aa1-a6cb-f6ea6d0ef739 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:54.957176 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1abac543-9bd7-4aa1-a6cb-f6ea6d0ef739 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5a9fbb11-1ccb-46e9-9e47-a0e4e2b782d0,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:47:54.961984 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-1abac543-9bd7-4aa1-a6cb-f6ea6d0ef739 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=2edece3c29cc40f0ab883159b1cfef0a&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1781573 Nov 09 04:47:54.964586 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33584) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:47:55.011054 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cd880c52-67a5-4162-b29a-1c79f08af404 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:55.031991 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cd880c52-67a5-4162-b29a-1c79f08af404 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:55.137629 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cd880c52-67a5-4162-b29a-1c79f08af404 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:55.140686 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-cd880c52-67a5-4162-b29a-1c79f08af404 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:55.141807 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-cd880c52-67a5-4162-b29a-1c79f08af404 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/5a9fbb11-1ccb-46e9-9e47-a0e4e2b782d0 HTTP/1.1" status: 204 len: 168 time: 0.1763344 Nov 09 04:47:55.149597 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd880c52-67a5-4162-b29a-1c79f08af404 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5a9fbb11-1ccb-46e9-9e47-a0e4e2b782d0,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:47:56.215912 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33606) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:47:56.305777 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-06349721-e656-434b-bc2d-efd755fe27ac admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-44351747-network', 'tenant_id': '439796a9e9454c25aec4d3397b048cd5'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:47:56.372205 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-06349721-e656-434b-bc2d-efd755fe27ac admin admin] Made reservation on behalf of 439796a9e9454c25aec4d3397b048cd5 for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:47:56.374524 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-06349721-e656-434b-bc2d-efd755fe27ac admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:56.383294 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-06349721-e656-434b-bc2d-efd755fe27ac admin admin] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:56.456678 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-06349721-e656-434b-bc2d-efd755fe27ac admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:56.515121 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-06349721-e656-434b-bc2d-efd755fe27ac admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:56.541355 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-06349721-e656-434b-bc2d-efd755fe27ac admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 304} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:47:56.546724 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06349721-e656-434b-bc2d-efd755fe27ac admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fb6b691b-1a10-49c2-9fcc-249743c63c28,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:47:56.554122 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-06349721-e656-434b-bc2d-efd755fe27ac admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:56.554122 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-06349721-e656-434b-bc2d-efd755fe27ac admin admin] Added segment 47f9f5ba-b60a-4ca0-b699-b14d6890be57 of type vlan for network e694d638-bf4f-4830-b082-ec442ad6f5cc Nov 09 04:47:56.593185 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-06349721-e656-434b-bc2d-efd755fe27ac admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:56.680295 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-06349721-e656-434b-bc2d-efd755fe27ac admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:56.681216 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-06349721-e656-434b-bc2d-efd755fe27ac admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:47:56.681783 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-06349721-e656-434b-bc2d-efd755fe27ac admin admin] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:56.775682 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06349721-e656-434b-bc2d-efd755fe27ac admin admin] Pushing event updated for resources: {'Network': ['ID=e694d638-bf4f-4830-b082-ec442ad6f5cc,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:47:56.786132 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network e694d638-bf4f-4830-b082-ec442ad6f5cc details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:47:56.794879 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-06349721-e656-434b-bc2d-efd755fe27ac admin admin] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 0.5789428 Nov 09 04:47:56.795031 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33610) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:47:56.800356 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-bbc89dc1-a867-497a-80fe-73aeb81e4939 admin admin] Request body: {'subnet': {'network_id': 'e694d638-bf4f-4830-b082-ec442ad6f5cc', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-44351747-subnet', 'tenant_id': '439796a9e9454c25aec4d3397b048cd5', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:47:56.880571 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bbc89dc1-a867-497a-80fe-73aeb81e4939 admin admin] Made reservation on behalf of 439796a9e9454c25aec4d3397b048cd5 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:47:56.882954 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bbc89dc1-a867-497a-80fe-73aeb81e4939 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:57.115729 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bbc89dc1-a867-497a-80fe-73aeb81e4939 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:57.172742 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbc89dc1-a867-497a-80fe-73aeb81e4939 admin admin] Pushing event updated for resources: {'Subnet': ['ID=8b6f842c-d1b7-43f0-96e7-0cb746a562dd,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:47:57.179966 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bbc89dc1-a867-497a-80fe-73aeb81e4939 admin admin] Checking segment: {'id': '47f9f5ba-b60a-4ca0-b699-b14d6890be57', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 304, 'network_id': 'e694d638-bf4f-4830-b082-ec442ad6f5cc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:47:57.180331 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bbc89dc1-a867-497a-80fe-73aeb81e4939 admin admin] Network hostable DHCP agents. Network: e694d638-bf4f-4830-b082-ec442ad6f5cc, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:47:57.281108 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bbc89dc1-a867-497a-80fe-73aeb81e4939 admin admin] Network e694d638-bf4f-4830-b082-ec442ad6f5cc is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:47:57.383696 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-bbc89dc1-a867-497a-80fe-73aeb81e4939 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, e694d638-bf4f-4830-b082-ec442ad6f5cc) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:47:57.387691 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bbc89dc1-a867-497a-80fe-73aeb81e4939 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:47:57.388287 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bbc89dc1-a867-497a-80fe-73aeb81e4939 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:47:57.397220 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0f02197d-e10a-4ae0-a1ce-cc5b658c6429 None None] Network e694d638-bf4f-4830-b082-ec442ad6f5cc requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:47:57.496671 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-bbc89dc1-a867-497a-80fe-73aeb81e4939 admin admin] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.6925800 Nov 09 04:47:57.525356 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d446b091-3732-4862-add0-f52d565bd401 None None] Network e694d638-bf4f-4830-b082-ec442ad6f5cc requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:47:57.926532 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21b96fa4-1aeb-4f65-bb87-9356a51dc188 req-27fc3f95-a4ae-42ca-8937-a49682accf77 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:47:57.927929 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-21b96fa4-1aeb-4f65-bb87-9356a51dc188 req-27fc3f95-a4ae-42ca-8937-a49682accf77 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/networks?id=e694d638-bf4f-4830-b082-ec442ad6f5cc HTTP/1.1" status: 200 len: 810 time: 0.1067305 Nov 09 04:47:57.943144 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-21b96fa4-1aeb-4f65-bb87-9356a51dc188 req-1f8ac776-10ff-4b93-b540-96d570bdf648 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/quotas/439796a9e9454c25aec4d3397b048cd5 HTTP/1.1" status: 200 len: 375 time: 0.0095663 Nov 09 04:47:57.974634 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-21b96fa4-1aeb-4f65-bb87-9356a51dc188 req-7e0cc108-661a-44b4-9280-044a535e8ad0 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/ports?tenant_id=439796a9e9454c25aec4d3397b048cd5&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0260093 Nov 09 04:47:58.073899 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-21b96fa4-1aeb-4f65-bb87-9356a51dc188 req-efff3c20-1b6b-490d-94f0-78519645a339 service neutron] 10.222.0.24 "GET /v2.0/networks/e694d638-bf4f-4830-b082-ec442ad6f5cc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0927916 Nov 09 04:47:58.159599 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-21b96fa4-1aeb-4f65-bb87-9356a51dc188 req-4093696f-a45b-4801-b785-e4ec5d72ca0b service neutron] 10.222.0.24 "GET /v2.0/networks/e694d638-bf4f-4830-b082-ec442ad6f5cc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0796974 Nov 09 04:47:58.384328 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-3be5d570-ac8c-4939-9836-61bbb7605712 req-62bbb5c0-7bb3-4a36-b5df-9cc976c2ad7e tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/ports?device_id=e552d33b-85b5-4963-90e4-09d5ce3bd32e HTTP/1.1" status: 200 len: 210 time: 0.0388312 Nov 09 04:47:59.477361 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-64f505a5-cc5f-41b3-80a7-73c46140434e req-60f0998b-2030-4ed1-a348-566d1405fdc9 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/ports?device_id=e552d33b-85b5-4963-90e4-09d5ce3bd32e HTTP/1.1" status: 200 len: 210 time: 0.0269389 Nov 09 04:48:00.266427 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21b96fa4-1aeb-4f65-bb87-9356a51dc188 req-feeeb802-bc21-4968-9d6e-9a6fac952f82 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:00.267780 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-21b96fa4-1aeb-4f65-bb87-9356a51dc188 req-feeeb802-bc21-4968-9d6e-9a6fac952f82 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.26 "GET /v2.0/networks?id=e694d638-bf4f-4830-b082-ec442ad6f5cc HTTP/1.1" status: 200 len: 810 time: 0.1055815 Nov 09 04:48:00.281225 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-21b96fa4-1aeb-4f65-bb87-9356a51dc188 req-1a27fdae-dbb6-42b1-a458-c52a34934184 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Request body: {'port': {'device_id': 'e552d33b-85b5-4963-90e4-09d5ce3bd32e', 'network_id': 'e694d638-bf4f-4830-b082-ec442ad6f5cc', 'admin_state_up': True, 'tenant_id': '439796a9e9454c25aec4d3397b048cd5'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:48:00.457748 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-21b96fa4-1aeb-4f65-bb87-9356a51dc188 req-1a27fdae-dbb6-42b1-a458-c52a34934184 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Made reservation on behalf of 439796a9e9454c25aec4d3397b048cd5 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:48:00.461352 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-21b96fa4-1aeb-4f65-bb87-9356a51dc188 req-1a27fdae-dbb6-42b1-a458-c52a34934184 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:00.569629 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c8d1bb3b-695c-48b5-9a43-3deccd96bf32 req-c42a90ba-30ba-4565-8041-e0ef87429f0a tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/ports?device_id=e552d33b-85b5-4963-90e4-09d5ce3bd32e HTTP/1.1" status: 200 len: 210 time: 0.0258887 Nov 09 04:48:00.584338 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [req-21b96fa4-1aeb-4f65-bb87-9356a51dc188 req-1a27fdae-dbb6-42b1-a458-c52a34934184 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Allocated IP 172.20.0.4 (e694d638-bf4f-4830-b082-ec442ad6f5cc/8b6f842c-d1b7-43f0-96e7-0cb746a562dd/1df90dc2-fce1-4c9f-a9f3-ae2501dfd368) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:48:00.731880 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-21b96fa4-1aeb-4f65-bb87-9356a51dc188 req-1a27fdae-dbb6-42b1-a458-c52a34934184 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:00.812516 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-21b96fa4-1aeb-4f65-bb87-9356a51dc188 req-1a27fdae-dbb6-42b1-a458-c52a34934184 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:00.851646 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-21b96fa4-1aeb-4f65-bb87-9356a51dc188 req-1a27fdae-dbb6-42b1-a458-c52a34934184 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Network e694d638-bf4f-4830-b082-ec442ad6f5cc is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:48:00.854444 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [req-21b96fa4-1aeb-4f65-bb87-9356a51dc188 req-1a27fdae-dbb6-42b1-a458-c52a34934184 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:48:00.859832 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-21b96fa4-1aeb-4f65-bb87-9356a51dc188 req-1a27fdae-dbb6-42b1-a458-c52a34934184 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:48:00.890506 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a27fdae-dbb6-42b1-a458-c52a34934184 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Pushing event updated for resources: {'Port': ['ID=1df90dc2-fce1-4c9f-a9f3-ae2501dfd368,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:48:00.914815 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21b96fa4-1aeb-4f65-bb87-9356a51dc188 req-1a27fdae-dbb6-42b1-a458-c52a34934184 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:00.915409 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-21b96fa4-1aeb-4f65-bb87-9356a51dc188 req-1a27fdae-dbb6-42b1-a458-c52a34934184 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:00.980060 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-21b96fa4-1aeb-4f65-bb87-9356a51dc188 req-1a27fdae-dbb6-42b1-a458-c52a34934184 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.26 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7031932 Nov 09 04:48:00.992311 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-21b96fa4-1aeb-4f65-bb87-9356a51dc188 req-92a5f54e-4ebc-45e4-b6da-88bcc0606e68 service neutron] Request body: {'port': {'device_id': 'e552d33b-85b5-4963-90e4-09d5ce3bd32e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:48:01.043475 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-21b96fa4-1aeb-4f65-bb87-9356a51dc188 req-92a5f54e-4ebc-45e4-b6da-88bcc0606e68 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:01.289923 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [req-21b96fa4-1aeb-4f65-bb87-9356a51dc188 req-92a5f54e-4ebc-45e4-b6da-88bcc0606e68 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1df90dc2-fce1-4c9f-a9f3-ae2501dfd368 {{(pid=102162) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:48:01.297677 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-21b96fa4-1aeb-4f65-bb87-9356a51dc188 req-92a5f54e-4ebc-45e4-b6da-88bcc0606e68 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:01.309279 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.provisioning_blocks [req-21b96fa4-1aeb-4f65-bb87-9356a51dc188 req-92a5f54e-4ebc-45e4-b6da-88bcc0606e68 service neutron] Transition to ACTIVE for port object 1df90dc2-fce1-4c9f-a9f3-ae2501dfd368 will not be triggered until provisioned by entity L2. {{(pid=102162) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 09 04:48:01.371589 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-21b96fa4-1aeb-4f65-bb87-9356a51dc188 req-92a5f54e-4ebc-45e4-b6da-88bcc0606e68 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:01.426010 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92a5f54e-4ebc-45e4-b6da-88bcc0606e68 service neutron] Pushing event updated for resources: {'Port': ['ID=1df90dc2-fce1-4c9f-a9f3-ae2501dfd368,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:48:01.460949 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:48:01.487978 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-21b96fa4-1aeb-4f65-bb87-9356a51dc188 req-92a5f54e-4ebc-45e4-b6da-88bcc0606e68 service neutron] Attempting to bind port 1df90dc2-fce1-4c9f-a9f3-ae2501dfd368 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:48:01.488305 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-21b96fa4-1aeb-4f65-bb87-9356a51dc188 req-92a5f54e-4ebc-45e4-b6da-88bcc0606e68 service neutron] Attempting to bind port 1df90dc2-fce1-4c9f-a9f3-ae2501dfd368 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '47f9f5ba-b60a-4ca0-b699-b14d6890be57', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 304, 'network_id': 'e694d638-bf4f-4830-b082-ec442ad6f5cc'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:48:01.488626 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-21b96fa4-1aeb-4f65-bb87-9356a51dc188 req-92a5f54e-4ebc-45e4-b6da-88bcc0606e68 service neutron] Attempting to bind port 1df90dc2-fce1-4c9f-a9f3-ae2501dfd368 on network e694d638-bf4f-4830-b082-ec442ad6f5cc {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:48:01.492723 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-21b96fa4-1aeb-4f65-bb87-9356a51dc188 req-92a5f54e-4ebc-45e4-b6da-88bcc0606e68 service neutron] Port 1df90dc2-fce1-4c9f-a9f3-ae2501dfd368 on network e694d638-bf4f-4830-b082-ec442ad6f5cc not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:48:01.493032 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-21b96fa4-1aeb-4f65-bb87-9356a51dc188 req-92a5f54e-4ebc-45e4-b6da-88bcc0606e68 service neutron] Attempting to bind port 1df90dc2-fce1-4c9f-a9f3-ae2501dfd368 on network e694d638-bf4f-4830-b082-ec442ad6f5cc {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:48:01.497608 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-21b96fa4-1aeb-4f65-bb87-9356a51dc188 req-92a5f54e-4ebc-45e4-b6da-88bcc0606e68 service neutron] Checking agent: {'id': '7d36b884-4ad2-4878-9464-bf647030b544', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'started_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 47, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:48:01.497940 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-21b96fa4-1aeb-4f65-bb87-9356a51dc188 req-92a5f54e-4ebc-45e4-b6da-88bcc0606e68 service neutron] Checking segment: {'id': '47f9f5ba-b60a-4ca0-b699-b14d6890be57', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 304, 'network_id': 'e694d638-bf4f-4830-b082-ec442ad6f5cc'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:48:01.498314 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-21b96fa4-1aeb-4f65-bb87-9356a51dc188 req-92a5f54e-4ebc-45e4-b6da-88bcc0606e68 service neutron] Bound using segment: {'id': '47f9f5ba-b60a-4ca0-b699-b14d6890be57', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 304, 'network_id': 'e694d638-bf4f-4830-b082-ec442ad6f5cc'} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:48:01.498751 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-21b96fa4-1aeb-4f65-bb87-9356a51dc188 req-92a5f54e-4ebc-45e4-b6da-88bcc0606e68 service neutron] Bound port: 1df90dc2-fce1-4c9f-a9f3-ae2501dfd368, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '47f9f5ba-b60a-4ca0-b699-b14d6890be57', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 304, 'network_id': 'e694d638-bf4f-4830-b082-ec442ad6f5cc'}}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:48:01.499087 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-21b96fa4-1aeb-4f65-bb87-9356a51dc188 req-92a5f54e-4ebc-45e4-b6da-88bcc0606e68 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:01.558130 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-21b96fa4-1aeb-4f65-bb87-9356a51dc188 req-92a5f54e-4ebc-45e4-b6da-88bcc0606e68 service neutron] For port 1df90dc2-fce1-4c9f-a9f3-ae2501dfd368, host hv-neutron-8168, cleared binding levels {{(pid=102162) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:48:01.561019 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-21b96fa4-1aeb-4f65-bb87-9356a51dc188 req-92a5f54e-4ebc-45e4-b6da-88bcc0606e68 service neutron] For port 1df90dc2-fce1-4c9f-a9f3-ae2501dfd368, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=1df90dc2-fce1-4c9f-a9f3-ae2501dfd368,segment=NetworkSegment(47f9f5ba-b60a-4ca0-b699-b14d6890be57),segment_id=47f9f5ba-b60a-4ca0-b699-b14d6890be57)] {{(pid=102162) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:48:01.618429 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-21b96fa4-1aeb-4f65-bb87-9356a51dc188 req-92a5f54e-4ebc-45e4-b6da-88bcc0606e68 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:01.663411 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21b96fa4-1aeb-4f65-bb87-9356a51dc188 req-92a5f54e-4ebc-45e4-b6da-88bcc0606e68 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:01.664020 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-21b96fa4-1aeb-4f65-bb87-9356a51dc188 req-92a5f54e-4ebc-45e4-b6da-88bcc0606e68 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:01.665331 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-21b96fa4-1aeb-4f65-bb87-9356a51dc188 req-92a5f54e-4ebc-45e4-b6da-88bcc0606e68 service neutron] 10.222.0.26 "PUT /v2.0/ports/1df90dc2-fce1-4c9f-a9f3-ae2501dfd368 HTTP/1.1" status: 200 len: 1093 time: 0.6770592 Nov 09 04:48:01.667447 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e552d33b-85b5-4963-90e4-09d5ce3bd32e', 'tag': '1df90dc2-fce1-4c9f-a9f3-ae2501dfd368'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:48:01.670027 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8e2d5cd4-86ba-4fce-a7ac-fb51ca1ea7ee" -d '{"events": [{"name": "network-changed", "server_uuid": "e552d33b-85b5-4963-90e4-09d5ce3bd32e", "tag": "1df90dc2-fce1-4c9f-a9f3-ae2501dfd368"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:48:01.712796 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92a5f54e-4ebc-45e4-b6da-88bcc0606e68 service neutron] Pushing event updated for resources: {'Port': ['ID=1df90dc2-fce1-4c9f-a9f3-ae2501dfd368,revision_number=3']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:48:01.720424 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:48:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e69d56da-4c24-450d-b27e-67a054f08ba6 x-openstack-request-id: req-e69d56da-4c24-450d-b27e-67a054f08ba6 {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:48:01.720712 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e552d33b-85b5-4963-90e4-09d5ce3bd32e", "tag": "1df90dc2-fce1-4c9f-a9f3-ae2501dfd368", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:48:01.720958 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-e69d56da-4c24-450d-b27e-67a054f08ba6 {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:48:01.721351 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e552d33b-85b5-4963-90e4-09d5ce3bd32e', 'tag': '1df90dc2-fce1-4c9f-a9f3-ae2501dfd368', 'status': 'completed', 'code': 200} Nov 09 04:48:01.729859 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27180138-9594-4a76-be32-325eda699b3e req-53d669b8-8e3e-40fc-a909-e08bad3247f7 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:01.731379 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-27180138-9594-4a76-be32-325eda699b3e req-53d669b8-8e3e-40fc-a909-e08bad3247f7 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/ports?device_id=e552d33b-85b5-4963-90e4-09d5ce3bd32e HTTP/1.1" status: 200 len: 943 time: 0.0837653 Nov 09 04:48:01.805779 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-27180138-9594-4a76-be32-325eda699b3e req-4196b024-0ae0-4e1f-889d-b25b7356dfb4 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/security-groups?id=fb6b691b-1a10-49c2-9fcc-249743c63c28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0681770 Nov 09 04:48:01.809177 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e2d5cd4-86ba-4fce-a7ac-fb51ca1ea7ee req-da8072ea-9068-4355-bcd5-c27d918ba907 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:01.809794 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8e2d5cd4-86ba-4fce-a7ac-fb51ca1ea7ee req-da8072ea-9068-4355-bcd5-c27d918ba907 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=439796a9e9454c25aec4d3397b048cd5&device_id=e552d33b-85b5-4963-90e4-09d5ce3bd32e HTTP/1.1" status: 200 len: 1096 time: 0.0664828 Nov 09 04:48:01.909343 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e2d5cd4-86ba-4fce-a7ac-fb51ca1ea7ee req-f9207b6f-5947-44b9-a52a-880e2f159001 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:01.910845 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8e2d5cd4-86ba-4fce-a7ac-fb51ca1ea7ee req-f9207b6f-5947-44b9-a52a-880e2f159001 service neutron] 10.222.0.26 "GET /v2.0/networks?tenant_id=439796a9e9454c25aec4d3397b048cd5&shared=False HTTP/1.1" status: 200 len: 911 time: 0.0930436 Nov 09 04:48:02.003172 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e2d5cd4-86ba-4fce-a7ac-fb51ca1ea7ee req-518a04b6-89c1-49f3-9470-6bae54f3797d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:02.004597 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8e2d5cd4-86ba-4fce-a7ac-fb51ca1ea7ee req-518a04b6-89c1-49f3-9470-6bae54f3797d service neutron] 10.222.0.26 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0872037 Nov 09 04:48:02.079953 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21b96fa4-1aeb-4f65-bb87-9356a51dc188 req-e52565c4-007e-42c9-a90b-fb9791514e69 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:02.081587 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-21b96fa4-1aeb-4f65-bb87-9356a51dc188 req-e52565c4-007e-42c9-a90b-fb9791514e69 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=439796a9e9454c25aec4d3397b048cd5&device_id=e552d33b-85b5-4963-90e4-09d5ce3bd32e HTTP/1.1" status: 200 len: 1096 time: 0.0399144 Nov 09 04:48:02.123727 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-21b96fa4-1aeb-4f65-bb87-9356a51dc188 req-1cc1a896-797a-4b26-843d-9d44e1198454 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=1df90dc2-fce1-4c9f-a9f3-ae2501dfd368 HTTP/1.1" status: 200 len: 217 time: 0.0337908 Nov 09 04:48:02.172883 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21b96fa4-1aeb-4f65-bb87-9356a51dc188 req-72c9d3b3-0936-4a33-bfa2-9db1475abf81 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:02.174268 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-21b96fa4-1aeb-4f65-bb87-9356a51dc188 req-72c9d3b3-0936-4a33-bfa2-9db1475abf81 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=8b6f842c-d1b7-43f0-96e7-0cb746a562dd HTTP/1.1" status: 200 len: 850 time: 0.0446093 Nov 09 04:48:02.205929 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-21b96fa4-1aeb-4f65-bb87-9356a51dc188 req-dcaecd95-1c3c-44b2-b185-87c6ece502b9 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=e694d638-bf4f-4830-b082-ec442ad6f5cc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0242088 Nov 09 04:48:02.292413 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-21b96fa4-1aeb-4f65-bb87-9356a51dc188 req-04dd6867-d8ab-46b2-8243-3375f10c655a service neutron] 10.222.0.26 "GET /v2.0/networks/e694d638-bf4f-4830-b082-ec442ad6f5cc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0788338 Nov 09 04:48:02.383109 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-21b96fa4-1aeb-4f65-bb87-9356a51dc188 req-5caa4f81-6ca5-4f71-9ea2-8af3fac8cf3b service neutron] 10.222.0.26 "GET /v2.0/networks/e694d638-bf4f-4830-b082-ec442ad6f5cc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0832646 Nov 09 04:48:02.920092 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff4d377c-1055-4407-b235-1fac5aee8d10 req-22d02b24-bb3f-4eea-8514-9ef8b162b8ab tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:02.921540 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ff4d377c-1055-4407-b235-1fac5aee8d10 req-22d02b24-bb3f-4eea-8514-9ef8b162b8ab tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/ports?device_id=e552d33b-85b5-4963-90e4-09d5ce3bd32e HTTP/1.1" status: 200 len: 943 time: 0.0485401 Nov 09 04:48:02.967969 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ff4d377c-1055-4407-b235-1fac5aee8d10 req-64cae070-9c90-4b7d-9c87-bd3ed8ddb9e5 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/security-groups?id=fb6b691b-1a10-49c2-9fcc-249743c63c28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406117 Nov 09 04:48:04.078685 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e317fd4f-6293-4322-9ddc-df6683ce0219 req-9ffcfc6c-aede-415f-bd41-4a53f533f7c6 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:04.080127 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e317fd4f-6293-4322-9ddc-df6683ce0219 req-9ffcfc6c-aede-415f-bd41-4a53f533f7c6 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/ports?device_id=e552d33b-85b5-4963-90e4-09d5ce3bd32e HTTP/1.1" status: 200 len: 943 time: 0.0479767 Nov 09 04:48:04.125776 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e317fd4f-6293-4322-9ddc-df6683ce0219 req-d79c102b-31c1-4bce-9305-c42e2eb35423 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/security-groups?id=fb6b691b-1a10-49c2-9fcc-249743c63c28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396667 Nov 09 04:48:04.266573 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 1df90dc2-fce1-4c9f-a9f3-ae2501dfd368 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=102163) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 09 04:48:04.359533 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 1df90dc2-fce1-4c9f-a9f3-ae2501dfd368, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=1df90dc2-fce1-4c9f-a9f3-ae2501dfd368,segment=NetworkSegment(47f9f5ba-b60a-4ca0-b699-b14d6890be57),segment_id=47f9f5ba-b60a-4ca0-b699-b14d6890be57)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:48:04.370297 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Returning: {'device': '1df90dc2-fce1-4c9f-a9f3-ae2501dfd368', 'network_id': 'e694d638-bf4f-4830-b082-ec442ad6f5cc', 'port_id': '1df90dc2-fce1-4c9f-a9f3-ae2501dfd368', 'mac_address': 'fa:16:3e:bf:e4:5a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 304, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '8b6f842c-d1b7-43f0-96e7-0cb746a562dd', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102163) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 09 04:48:04.410319 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:04.422529 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1df90dc2-fce1-4c9f-a9f3-ae2501dfd368 {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:48:04.441374 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 1df90dc2-fce1-4c9f-a9f3-ae2501dfd368, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=1df90dc2-fce1-4c9f-a9f3-ae2501dfd368,segment=NetworkSegment(47f9f5ba-b60a-4ca0-b699-b14d6890be57),segment_id=47f9f5ba-b60a-4ca0-b699-b14d6890be57)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:48:04.514280 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:04.566687 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=1df90dc2-fce1-4c9f-a9f3-ae2501dfd368,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:48:04.706300 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['1df90dc2-fce1-4c9f-a9f3-ae2501dfd368'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 04:48:05.235078 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1e50cc5-7477-45ed-87b7-2867a7a1a024 req-b4ae5ae5-eae8-4be0-927d-4edd9ba0c938 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:05.236523 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-e1e50cc5-7477-45ed-87b7-2867a7a1a024 req-b4ae5ae5-eae8-4be0-927d-4edd9ba0c938 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/ports?device_id=e552d33b-85b5-4963-90e4-09d5ce3bd32e HTTP/1.1" status: 200 len: 944 time: 0.0473793 Nov 09 04:48:05.285881 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-e1e50cc5-7477-45ed-87b7-2867a7a1a024 req-e13cbb82-e35e-4952-bfaf-1e1bfb7127d3 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/security-groups?id=fb6b691b-1a10-49c2-9fcc-249743c63c28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435476 Nov 09 04:48:06.290211 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 1df90dc2-fce1-4c9f-a9f3-ae2501dfd368 up at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:48:06.404475 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44558876-1372-4081-ac68-765bc5f26e67 req-3cb10d6a-cebd-418b-a53f-01c9c9929cc3 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:06.406569 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-44558876-1372-4081-ac68-765bc5f26e67 req-3cb10d6a-cebd-418b-a53f-01c9c9929cc3 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/ports?device_id=e552d33b-85b5-4963-90e4-09d5ce3bd32e HTTP/1.1" status: 200 len: 944 time: 0.0553362 Nov 09 04:48:06.406697 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning for port 1df90dc2-fce1-4c9f-a9f3-ae2501dfd368 completed by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 09 04:48:06.410731 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning complete for port 1df90dc2-fce1-4c9f-a9f3-ae2501dfd368 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:48:06.411093 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:06.453622 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-44558876-1372-4081-ac68-765bc5f26e67 req-72d57955-fe64-458d-982e-841614c04582 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/security-groups?id=fb6b691b-1a10-49c2-9fcc-249743c63c28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412202 Nov 09 04:48:06.492988 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:06.513667 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e552d33b-85b5-4963-90e4-09d5ce3bd32e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1df90dc2-fce1-4c9f-a9f3-ae2501dfd368'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:48:06.516398 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0e881a40-0337-4865-ae7c-fdea22252a83" -d '{"events": [{"server_uuid": "e552d33b-85b5-4963-90e4-09d5ce3bd32e", "name": "network-vif-plugged", "status": "completed", "tag": "1df90dc2-fce1-4c9f-a9f3-ae2501dfd368"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:48:06.528412 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 1df90dc2-fce1-4c9f-a9f3-ae2501dfd368, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=1df90dc2-fce1-4c9f-a9f3-ae2501dfd368,segment=NetworkSegment(47f9f5ba-b60a-4ca0-b699-b14d6890be57),segment_id=47f9f5ba-b60a-4ca0-b699-b14d6890be57)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:48:06.551500 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:48:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-38f773a1-6c14-47dd-961f-5a34b0a08c8a x-openstack-request-id: req-38f773a1-6c14-47dd-961f-5a34b0a08c8a {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:48:06.551500 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e552d33b-85b5-4963-90e4-09d5ce3bd32e", "name": "network-vif-plugged", "status": "completed", "tag": "1df90dc2-fce1-4c9f-a9f3-ae2501dfd368", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:48:06.551696 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-38f773a1-6c14-47dd-961f-5a34b0a08c8a {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:48:06.551911 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e552d33b-85b5-4963-90e4-09d5ce3bd32e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1df90dc2-fce1-4c9f-a9f3-ae2501dfd368', 'code': 200} Nov 09 04:48:06.593948 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:06.642274 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=1df90dc2-fce1-4c9f-a9f3-ae2501dfd368,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:48:06.851917 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78be8094-d0c3-469f-9920-70f924f75b60 req-f08fb57f-c33e-4338-968f-142f77099763 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:06.853295 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-78be8094-d0c3-469f-9920-70f924f75b60 req-f08fb57f-c33e-4338-968f-142f77099763 service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=e552d33b-85b5-4963-90e4-09d5ce3bd32e HTTP/1.1" status: 200 len: 1098 time: 0.0392535 Nov 09 04:48:06.897550 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-78be8094-d0c3-469f-9920-70f924f75b60 req-115ac266-1011-4964-9813-86ee695201a7 service neutron] 10.222.0.26 "GET /v2.0/security-groups?id=fb6b691b-1a10-49c2-9fcc-249743c63c28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0358827 Nov 09 04:48:07.565475 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cea96ba3-4cb6-4628-b1de-53465534320d req-56445108-4f98-49b7-8a63-5687a725b7e5 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:07.566954 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-cea96ba3-4cb6-4628-b1de-53465534320d req-56445108-4f98-49b7-8a63-5687a725b7e5 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/ports?device_id=e552d33b-85b5-4963-90e4-09d5ce3bd32e HTTP/1.1" status: 200 len: 945 time: 0.0468819 Nov 09 04:48:07.616645 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-cea96ba3-4cb6-4628-b1de-53465534320d req-12117335-2b5c-4b46-9a0f-69bfe862d6a3 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/security-groups?id=fb6b691b-1a10-49c2-9fcc-249743c63c28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434370 Nov 09 04:48:08.732226 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33a1ecb7-47d0-42d3-8091-988804720c5e req-72cb1f7d-7bee-4a31-854c-b6f5f5035167 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:08.733678 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-33a1ecb7-47d0-42d3-8091-988804720c5e req-72cb1f7d-7bee-4a31-854c-b6f5f5035167 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/ports?device_id=e552d33b-85b5-4963-90e4-09d5ce3bd32e HTTP/1.1" status: 200 len: 945 time: 0.0485938 Nov 09 04:48:08.779468 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-33a1ecb7-47d0-42d3-8091-988804720c5e req-fd5eece9-0842-4a7b-abfa-d34286eefdd8 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/security-groups?id=fb6b691b-1a10-49c2-9fcc-249743c63c28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397990 Nov 09 04:48:09.235098 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc09c168-b28a-4346-93c1-9c093aa277ac req-24588920-e0be-4078-8d49-3c01d3fc4dbb tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:09.236542 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-cc09c168-b28a-4346-93c1-9c093aa277ac req-24588920-e0be-4078-8d49-3c01d3fc4dbb tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/ports?device_id=e552d33b-85b5-4963-90e4-09d5ce3bd32e HTTP/1.1" status: 200 len: 945 time: 0.0475757 Nov 09 04:48:09.281875 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-cc09c168-b28a-4346-93c1-9c093aa277ac req-2cc4e111-3208-4345-85a4-53b23fd70ea4 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/security-groups?id=fb6b691b-1a10-49c2-9fcc-249743c63c28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394812 Nov 09 04:48:09.371304 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33672) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:48:09.449600 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d18c115c-52bd-459d-a224-de681935443b req-84122233-10b7-42b4-a327-0470c140d93f service neutron] 10.222.0.24 "GET /v2.0/ports?device_id=e552d33b-85b5-4963-90e4-09d5ce3bd32e&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0771778 Nov 09 04:48:09.458579 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [req-d18c115c-52bd-459d-a224-de681935443b req-96b256fb-1fe0-4a88-ab97-3d9dfa448638 service neutron] http://10.222.0.24:9696/v2.0/extensions returned with HTTP 200 {{(pid=102162) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:48:09.459500 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d18c115c-52bd-459d-a224-de681935443b req-96b256fb-1fe0-4a88-ab97-3d9dfa448638 service neutron] 10.222.0.24 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0050492 Nov 09 04:48:10.397585 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18927f09-a0ae-4f79-8bbe-7722ac7c44e9 req-9cf863cc-8396-4ff6-bec1-5f06a9c58c12 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:10.404909 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-18927f09-a0ae-4f79-8bbe-7722ac7c44e9 req-9cf863cc-8396-4ff6-bec1-5f06a9c58c12 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/ports?device_id=e552d33b-85b5-4963-90e4-09d5ce3bd32e HTTP/1.1" status: 200 len: 945 time: 0.0549495 Nov 09 04:48:10.461294 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-18927f09-a0ae-4f79-8bbe-7722ac7c44e9 req-9bc1cf96-df90-4bad-848e-6b2bb26ff679 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/security-groups?id=fb6b691b-1a10-49c2-9fcc-249743c63c28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0504889 Nov 09 04:48:11.388292 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-de4122b4-e0db-41ed-bae0-1092057d725a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:11.403422 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d18c115c-52bd-459d-a224-de681935443b req-8c0a9dcf-68de-4cf3-b2e7-818d87848e31 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:11.411221 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d18c115c-52bd-459d-a224-de681935443b req-8c0a9dcf-68de-4cf3-b2e7-818d87848e31 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=439796a9e9454c25aec4d3397b048cd5&device_id=e552d33b-85b5-4963-90e4-09d5ce3bd32e HTTP/1.1" status: 200 len: 1098 time: 0.0397913 Nov 09 04:48:11.495539 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d18c115c-52bd-459d-a224-de681935443b req-1dfe0dc2-6eeb-4ca2-9aed-700212d74e32 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:11.497035 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d18c115c-52bd-459d-a224-de681935443b req-1dfe0dc2-6eeb-4ca2-9aed-700212d74e32 service neutron] 10.222.0.26 "GET /v2.0/networks?id=e694d638-bf4f-4830-b082-ec442ad6f5cc HTTP/1.1" status: 200 len: 911 time: 0.0855956 Nov 09 04:48:11.539110 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d18c115c-52bd-459d-a224-de681935443b req-11ca07ea-5c69-416f-8aaf-928680b7e263 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=1df90dc2-fce1-4c9f-a9f3-ae2501dfd368 HTTP/1.1" status: 200 len: 217 time: 0.0353227 Nov 09 04:48:11.577958 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e1ac38c-8e0c-47f0-977c-46e60203601e req-fb21e445-e647-4dfb-9b44-5fbef3502a8f tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:11.580026 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-8e1ac38c-8e0c-47f0-977c-46e60203601e req-fb21e445-e647-4dfb-9b44-5fbef3502a8f tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/ports?device_id=e552d33b-85b5-4963-90e4-09d5ce3bd32e HTTP/1.1" status: 200 len: 945 time: 0.0519099 Nov 09 04:48:11.591395 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d18c115c-52bd-459d-a224-de681935443b req-a7352612-4b5f-40c5-9617-f7a77a253a1f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:11.592837 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d18c115c-52bd-459d-a224-de681935443b req-a7352612-4b5f-40c5-9617-f7a77a253a1f service neutron] 10.222.0.26 "GET /v2.0/subnets?id=8b6f842c-d1b7-43f0-96e7-0cb746a562dd HTTP/1.1" status: 200 len: 850 time: 0.0467870 Nov 09 04:48:11.623146 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d18c115c-52bd-459d-a224-de681935443b req-a2c73e68-7867-448b-be4a-744ee938796e service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=e694d638-bf4f-4830-b082-ec442ad6f5cc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0236251 Nov 09 04:48:11.627107 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-8e1ac38c-8e0c-47f0-977c-46e60203601e req-97d7851e-eed9-45ac-8343-7e62c1051d0b tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/security-groups?id=fb6b691b-1a10-49c2-9fcc-249743c63c28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409374 Nov 09 04:48:11.712460 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d18c115c-52bd-459d-a224-de681935443b req-da5347e7-cbef-42fa-a869-1fe10102d0cf service neutron] 10.222.0.26 "GET /v2.0/networks/e694d638-bf4f-4830-b082-ec442ad6f5cc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0813916 Nov 09 04:48:11.809038 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d18c115c-52bd-459d-a224-de681935443b req-b43000f3-4704-4f7a-b8f8-6eef102f1b4a service neutron] 10.222.0.26 "GET /v2.0/networks/e694d638-bf4f-4830-b082-ec442ad6f5cc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0826275 Nov 09 04:48:12.228229 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:12.746518 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28da62a8-71f1-49a8-b54c-b354c7824b0a req-fb30f298-9c4f-47e0-823e-4584f91984f9 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:12.747980 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-28da62a8-71f1-49a8-b54c-b354c7824b0a req-fb30f298-9c4f-47e0-823e-4584f91984f9 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/ports?device_id=e552d33b-85b5-4963-90e4-09d5ce3bd32e HTTP/1.1" status: 200 len: 945 time: 0.0529189 Nov 09 04:48:12.793424 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-28da62a8-71f1-49a8-b54c-b354c7824b0a req-a32144c9-6578-4e97-ba09-d341c943891d tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/security-groups?id=fb6b691b-1a10-49c2-9fcc-249743c63c28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390933 Nov 09 04:48:13.685418 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-18f89b61-e14b-4700-8b9f-ac8a98da0b57 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:13.905715 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa399caf-0fa6-4460-af84-e6f7a608cc80 req-8ee2f7c8-bc57-460d-ba74-bba026427c37 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:13.907214 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-aa399caf-0fa6-4460-af84-e6f7a608cc80 req-8ee2f7c8-bc57-460d-ba74-bba026427c37 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/ports?device_id=e552d33b-85b5-4963-90e4-09d5ce3bd32e HTTP/1.1" status: 200 len: 945 time: 0.0489154 Nov 09 04:48:13.953599 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-aa399caf-0fa6-4460-af84-e6f7a608cc80 req-769b069d-46f9-4d62-bd5b-557e19187ba5 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/security-groups?id=fb6b691b-1a10-49c2-9fcc-249743c63c28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405850 Nov 09 04:48:15.069302 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4273e00-ac51-4d90-b166-03d0376e36ff req-812bbaa5-6cfe-41c5-a5f3-85366998ad60 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:15.070789 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b4273e00-ac51-4d90-b166-03d0376e36ff req-812bbaa5-6cfe-41c5-a5f3-85366998ad60 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/ports?device_id=e552d33b-85b5-4963-90e4-09d5ce3bd32e HTTP/1.1" status: 200 len: 945 time: 0.0519331 Nov 09 04:48:15.118086 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b4273e00-ac51-4d90-b166-03d0376e36ff req-1bc4dc29-00ef-4d3b-94d3-a5c101406872 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/security-groups?id=fb6b691b-1a10-49c2-9fcc-249743c63c28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414052 Nov 09 04:48:15.131246 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:16.227517 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f567856a-f048-4d95-8e27-e90a94fe4fa0 req-a6785c9e-e36d-4815-997a-f92e06a4e7f8 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:16.228969 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f567856a-f048-4d95-8e27-e90a94fe4fa0 req-a6785c9e-e36d-4815-997a-f92e06a4e7f8 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/ports?device_id=e552d33b-85b5-4963-90e4-09d5ce3bd32e HTTP/1.1" status: 200 len: 945 time: 0.0475755 Nov 09 04:48:16.277885 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f567856a-f048-4d95-8e27-e90a94fe4fa0 req-786fc519-2584-4304-9812-997c9a480067 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/security-groups?id=fb6b691b-1a10-49c2-9fcc-249743c63c28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425830 Nov 09 04:48:16.519519 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:16.959711 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:17.394894 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53ba5127-ed49-4a9a-ba11-166a9305281b req-ea13d1f5-e9f6-4e68-a61f-4038abae2e57 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:17.396367 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-53ba5127-ed49-4a9a-ba11-166a9305281b req-ea13d1f5-e9f6-4e68-a61f-4038abae2e57 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/ports?device_id=e552d33b-85b5-4963-90e4-09d5ce3bd32e HTTP/1.1" status: 200 len: 945 time: 0.0520120 Nov 09 04:48:17.450088 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-53ba5127-ed49-4a9a-ba11-166a9305281b req-8ce9e2c3-e9f8-4dae-a116-18ab708b568d tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/security-groups?id=fb6b691b-1a10-49c2-9fcc-249743c63c28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0476871 Nov 09 04:48:18.565830 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db4b20aa-4598-4ee1-aa61-716ee0d497ff req-ff0fbf25-076c-4d5a-94a1-55fd196285bf tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:18.567316 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-db4b20aa-4598-4ee1-aa61-716ee0d497ff req-ff0fbf25-076c-4d5a-94a1-55fd196285bf tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/ports?device_id=e552d33b-85b5-4963-90e4-09d5ce3bd32e HTTP/1.1" status: 200 len: 945 time: 0.0495048 Nov 09 04:48:18.613084 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-db4b20aa-4598-4ee1-aa61-716ee0d497ff req-5f7c56c6-9fb5-4b89-95fb-816f5a41af0e tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/security-groups?id=fb6b691b-1a10-49c2-9fcc-249743c63c28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401390 Nov 09 04:48:19.728206 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87b999a9-7f53-4dec-ab74-145b7e95fde9 req-f523eb95-279a-4eb2-b831-1ee4a0a679f4 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:19.729643 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-87b999a9-7f53-4dec-ab74-145b7e95fde9 req-f523eb95-279a-4eb2-b831-1ee4a0a679f4 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/ports?device_id=e552d33b-85b5-4963-90e4-09d5ce3bd32e HTTP/1.1" status: 200 len: 945 time: 0.0506697 Nov 09 04:48:19.775221 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-87b999a9-7f53-4dec-ab74-145b7e95fde9 req-c14eef44-cac6-4234-9a12-f13cf58d6458 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/security-groups?id=fb6b691b-1a10-49c2-9fcc-249743c63c28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397742 Nov 09 04:48:20.887374 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57546f7d-1566-4d82-8ccb-c27cc787029c req-033b27c0-68d4-476d-9d0b-8a19a5d0fe8b tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:20.888863 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-57546f7d-1566-4d82-8ccb-c27cc787029c req-033b27c0-68d4-476d-9d0b-8a19a5d0fe8b tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/ports?device_id=e552d33b-85b5-4963-90e4-09d5ce3bd32e HTTP/1.1" status: 200 len: 945 time: 0.0486717 Nov 09 04:48:20.935105 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-57546f7d-1566-4d82-8ccb-c27cc787029c req-cc4386aa-a05a-476c-a98d-609a0a643fad tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/security-groups?id=fb6b691b-1a10-49c2-9fcc-249743c63c28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404346 Nov 09 04:48:22.049477 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c058a77d-e7a4-449e-8122-9beaa9df9b21 req-042dddea-8134-4e90-88ef-5324715faefa tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:22.050939 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c058a77d-e7a4-449e-8122-9beaa9df9b21 req-042dddea-8134-4e90-88ef-5324715faefa tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/ports?device_id=e552d33b-85b5-4963-90e4-09d5ce3bd32e HTTP/1.1" status: 200 len: 945 time: 0.0484486 Nov 09 04:48:22.096271 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c058a77d-e7a4-449e-8122-9beaa9df9b21 req-3354cc96-ac5f-41ad-a2cc-6ad6daa57185 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/security-groups?id=fb6b691b-1a10-49c2-9fcc-249743c63c28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395250 Nov 09 04:48:23.211251 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1fc4799-b335-447e-a6d9-e36f7fe916bc req-6e8ddd79-f8e3-4485-84bb-dba792150388 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:23.212605 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f1fc4799-b335-447e-a6d9-e36f7fe916bc req-6e8ddd79-f8e3-4485-84bb-dba792150388 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/ports?device_id=e552d33b-85b5-4963-90e4-09d5ce3bd32e HTTP/1.1" status: 200 len: 945 time: 0.0509727 Nov 09 04:48:23.258755 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f1fc4799-b335-447e-a6d9-e36f7fe916bc req-78ae8030-1961-441b-876d-770b02a75012 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/security-groups?id=fb6b691b-1a10-49c2-9fcc-249743c63c28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402935 Nov 09 04:48:24.370086 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d196bde2-1840-4065-b24b-1e3131f151ed req-ef02d7bb-9bb0-4fbc-9554-4109212adc8e tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:24.371548 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d196bde2-1840-4065-b24b-1e3131f151ed req-ef02d7bb-9bb0-4fbc-9554-4109212adc8e tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/ports?device_id=e552d33b-85b5-4963-90e4-09d5ce3bd32e HTTP/1.1" status: 200 len: 945 time: 0.0477083 Nov 09 04:48:24.422020 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d196bde2-1840-4065-b24b-1e3131f151ed req-d7eb4e5b-1fda-4dc4-9853-3585a7c1d585 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/security-groups?id=fb6b691b-1a10-49c2-9fcc-249743c63c28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440631 Nov 09 04:48:25.534600 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83f8b3b5-970c-42e9-ae40-0d5c648d5bad req-67d9d87e-c46d-464a-8459-9809fe04ef0c tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:25.536045 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-83f8b3b5-970c-42e9-ae40-0d5c648d5bad req-67d9d87e-c46d-464a-8459-9809fe04ef0c tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/ports?device_id=e552d33b-85b5-4963-90e4-09d5ce3bd32e HTTP/1.1" status: 200 len: 945 time: 0.0469682 Nov 09 04:48:25.582100 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-83f8b3b5-970c-42e9-ae40-0d5c648d5bad req-61d2546f-aa2f-4a6d-8ff7-00759285a03c tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/security-groups?id=fb6b691b-1a10-49c2-9fcc-249743c63c28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404325 Nov 09 04:48:26.695826 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc66cb7b-4a3d-407e-a273-4a5b7ecfc04a req-e496ab5a-47a5-4e1c-8818-cab1aa05de8c tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:26.697270 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-cc66cb7b-4a3d-407e-a273-4a5b7ecfc04a req-e496ab5a-47a5-4e1c-8818-cab1aa05de8c tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/ports?device_id=e552d33b-85b5-4963-90e4-09d5ce3bd32e HTTP/1.1" status: 200 len: 945 time: 0.0479810 Nov 09 04:48:26.743171 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-cc66cb7b-4a3d-407e-a273-4a5b7ecfc04a req-59cb35c8-6e91-4bb3-9f3c-fc9c9b1e5e54 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/security-groups?id=fb6b691b-1a10-49c2-9fcc-249743c63c28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401690 Nov 09 04:48:27.858216 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e88219f0-e80a-4edd-8643-5decc1e744c7 req-d0af44ce-429b-4202-89d1-90fb40dc21ee tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:27.859716 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-e88219f0-e80a-4edd-8643-5decc1e744c7 req-d0af44ce-429b-4202-89d1-90fb40dc21ee tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/ports?device_id=e552d33b-85b5-4963-90e4-09d5ce3bd32e HTTP/1.1" status: 200 len: 945 time: 0.0519395 Nov 09 04:48:27.907189 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-e88219f0-e80a-4edd-8643-5decc1e744c7 req-1a8fd505-0fe0-43d0-9f54-7af290bec9aa tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/security-groups?id=fb6b691b-1a10-49c2-9fcc-249743c63c28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407271 Nov 09 04:48:29.026138 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77322bc0-5080-4ca5-83e2-66fca80c19f0 req-796b43ad-8960-4fa1-bb48-78e5b3de4e9d tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:29.027613 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-77322bc0-5080-4ca5-83e2-66fca80c19f0 req-796b43ad-8960-4fa1-bb48-78e5b3de4e9d tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/ports?device_id=e552d33b-85b5-4963-90e4-09d5ce3bd32e HTTP/1.1" status: 200 len: 945 time: 0.0479808 Nov 09 04:48:29.072350 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-77322bc0-5080-4ca5-83e2-66fca80c19f0 req-7d9a4bc6-e222-4dc4-a6b8-2bafb98705c8 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/security-groups?id=fb6b691b-1a10-49c2-9fcc-249743c63c28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390019 Nov 09 04:48:30.183726 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65f83263-62f9-44df-91b4-e99d752d3a3d req-13c0cca7-afc8-47f1-b108-c274b09c798b tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:30.185165 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-65f83263-62f9-44df-91b4-e99d752d3a3d req-13c0cca7-afc8-47f1-b108-c274b09c798b tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/ports?device_id=e552d33b-85b5-4963-90e4-09d5ce3bd32e HTTP/1.1" status: 200 len: 945 time: 0.0476885 Nov 09 04:48:30.232127 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-65f83263-62f9-44df-91b4-e99d752d3a3d req-c5c1159e-5751-4424-8f10-c85225f19d3c tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/security-groups?id=fb6b691b-1a10-49c2-9fcc-249743c63c28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408912 Nov 09 04:48:31.347507 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c52f803-7c06-4cc4-90fd-3a06a634ed77 req-553fc3cd-dbe2-4e75-be93-42102b1eaad2 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:31.348932 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9c52f803-7c06-4cc4-90fd-3a06a634ed77 req-553fc3cd-dbe2-4e75-be93-42102b1eaad2 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/ports?device_id=e552d33b-85b5-4963-90e4-09d5ce3bd32e HTTP/1.1" status: 200 len: 945 time: 0.0514262 Nov 09 04:48:31.394261 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9c52f803-7c06-4cc4-90fd-3a06a634ed77 req-dd107c35-f4c6-4339-9728-7041e592bd61 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/security-groups?id=fb6b691b-1a10-49c2-9fcc-249743c63c28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394471 Nov 09 04:48:32.506663 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-940e4466-79d2-4b89-b736-7a75dfa6118a req-e98992c5-2841-47f3-bf50-2fcd47a8c422 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:32.508117 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-940e4466-79d2-4b89-b736-7a75dfa6118a req-e98992c5-2841-47f3-bf50-2fcd47a8c422 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/ports?device_id=e552d33b-85b5-4963-90e4-09d5ce3bd32e HTTP/1.1" status: 200 len: 945 time: 0.0480316 Nov 09 04:48:32.557854 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-940e4466-79d2-4b89-b736-7a75dfa6118a req-b6679c42-3f5e-4ec9-a95a-6b069b678915 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/security-groups?id=fb6b691b-1a10-49c2-9fcc-249743c63c28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0439932 Nov 09 04:48:33.674064 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18c153f4-2995-45d5-bcea-ce3667150030 req-02c32b7f-7ca3-48dd-b7a6-b8665cdfad50 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:33.675587 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-18c153f4-2995-45d5-bcea-ce3667150030 req-02c32b7f-7ca3-48dd-b7a6-b8665cdfad50 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/ports?device_id=e552d33b-85b5-4963-90e4-09d5ce3bd32e HTTP/1.1" status: 200 len: 945 time: 0.0511494 Nov 09 04:48:33.723192 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-18c153f4-2995-45d5-bcea-ce3667150030 req-388c30dd-abd1-4728-929c-8627c704f059 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/security-groups?id=fb6b691b-1a10-49c2-9fcc-249743c63c28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416708 Nov 09 04:48:34.835371 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c72243d-1c16-490e-a373-6be1feeec5e1 req-a5178082-3d71-4644-9da8-bc81ae632cea tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:34.836788 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-0c72243d-1c16-490e-a373-6be1feeec5e1 req-a5178082-3d71-4644-9da8-bc81ae632cea tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/ports?device_id=e552d33b-85b5-4963-90e4-09d5ce3bd32e HTTP/1.1" status: 200 len: 945 time: 0.0479503 Nov 09 04:48:34.882623 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-0c72243d-1c16-490e-a373-6be1feeec5e1 req-4e202132-7aa9-418c-b8d4-36f39aeee6ae tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/security-groups?id=fb6b691b-1a10-49c2-9fcc-249743c63c28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399909 Nov 09 04:48:35.994033 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ec6397c-4083-405a-b6f0-602c301551e4 req-dc2017f4-f9d1-49ff-bea1-c0b508fdd3f3 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:35.995420 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7ec6397c-4083-405a-b6f0-602c301551e4 req-dc2017f4-f9d1-49ff-bea1-c0b508fdd3f3 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/ports?device_id=e552d33b-85b5-4963-90e4-09d5ce3bd32e HTTP/1.1" status: 200 len: 945 time: 0.0477731 Nov 09 04:48:36.045562 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7ec6397c-4083-405a-b6f0-602c301551e4 req-6d2effb0-625e-46ce-aa62-3f1a6dfe993e tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/security-groups?id=fb6b691b-1a10-49c2-9fcc-249743c63c28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436711 Nov 09 04:48:37.163362 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3b5354d-96c5-439f-8748-4d5e9c5b101f req-7341ad4e-679e-4ebf-a2dd-d580e3146980 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:37.164723 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c3b5354d-96c5-439f-8748-4d5e9c5b101f req-7341ad4e-679e-4ebf-a2dd-d580e3146980 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/ports?device_id=e552d33b-85b5-4963-90e4-09d5ce3bd32e HTTP/1.1" status: 200 len: 945 time: 0.0472729 Nov 09 04:48:37.210341 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c3b5354d-96c5-439f-8748-4d5e9c5b101f req-be384fb7-edb6-47d2-a527-3fa162189f18 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/security-groups?id=fb6b691b-1a10-49c2-9fcc-249743c63c28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399098 Nov 09 04:48:38.325060 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d62a95f0-f0ed-4611-ae9b-e72917f690bf req-8e3b1a6a-d0ad-418c-8481-d79e9d3a7500 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:38.326552 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d62a95f0-f0ed-4611-ae9b-e72917f690bf req-8e3b1a6a-d0ad-418c-8481-d79e9d3a7500 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/ports?device_id=e552d33b-85b5-4963-90e4-09d5ce3bd32e HTTP/1.1" status: 200 len: 945 time: 0.0502753 Nov 09 04:48:38.373838 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d62a95f0-f0ed-4611-ae9b-e72917f690bf req-245d3386-4fa5-4420-8b65-c5803dedccc7 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/security-groups?id=fb6b691b-1a10-49c2-9fcc-249743c63c28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406070 Nov 09 04:48:38.459842 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:48:38.867832 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d18c115c-52bd-459d-a224-de681935443b req-0e661ffb-6fe2-468e-8ccd-ae2feab5c0cc service neutron] 10.222.0.26 "GET /v2.0/ports/1df90dc2-fce1-4c9f-a9f3-ae2501dfd368/bindings/hv-neutron-8168 HTTP/1.1" status: 200 len: 384 time: 0.0539229 Nov 09 04:48:39.452261 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d18c115c-52bd-459d-a224-de681935443b req-004e3a87-ceb3-414d-abe7-ea06b3f3c1a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:39.454290 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d18c115c-52bd-459d-a224-de681935443b req-004e3a87-ceb3-414d-abe7-ea06b3f3c1a0 service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=e552d33b-85b5-4963-90e4-09d5ce3bd32e&tenant_id=439796a9e9454c25aec4d3397b048cd5 HTTP/1.1" status: 200 len: 1098 time: 0.0733840 Nov 09 04:48:39.493209 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e7d3e6c-c8e0-4f8c-ba68-1f3d27deb3e4 req-8cdfee7b-d686-4725-81c1-b510de0ae58f tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:39.494678 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-7e7d3e6c-c8e0-4f8c-ba68-1f3d27deb3e4 req-8cdfee7b-d686-4725-81c1-b510de0ae58f tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/ports?device_id=e552d33b-85b5-4963-90e4-09d5ce3bd32e HTTP/1.1" status: 200 len: 945 time: 0.0524619 Nov 09 04:48:39.515236 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d18c115c-52bd-459d-a224-de681935443b req-8c5acc00-76ed-4d78-b691-d6d55f840182 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:39.517245 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d18c115c-52bd-459d-a224-de681935443b req-8c5acc00-76ed-4d78-b691-d6d55f840182 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=439796a9e9454c25aec4d3397b048cd5&device_id=e552d33b-85b5-4963-90e4-09d5ce3bd32e HTTP/1.1" status: 200 len: 1098 time: 0.0396693 Nov 09 04:48:39.542792 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-7e7d3e6c-c8e0-4f8c-ba68-1f3d27deb3e4 req-a5d3f19c-c5ce-472c-9cab-ff199eb9c443 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/security-groups?id=fb6b691b-1a10-49c2-9fcc-249743c63c28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421169 Nov 09 04:48:39.607975 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d18c115c-52bd-459d-a224-de681935443b req-faf454fd-c38f-4dd0-a643-05adb3ae0999 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:39.609415 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d18c115c-52bd-459d-a224-de681935443b req-faf454fd-c38f-4dd0-a643-05adb3ae0999 service neutron] 10.222.0.26 "GET /v2.0/networks?id=e694d638-bf4f-4830-b082-ec442ad6f5cc HTTP/1.1" status: 200 len: 911 time: 0.0855832 Nov 09 04:48:39.649433 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d18c115c-52bd-459d-a224-de681935443b req-c2b2b7eb-10fb-4b29-a324-749a5e3b863e service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=1df90dc2-fce1-4c9f-a9f3-ae2501dfd368 HTTP/1.1" status: 200 len: 217 time: 0.0333490 Nov 09 04:48:39.696545 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d18c115c-52bd-459d-a224-de681935443b req-86f7d3ac-4be7-4e79-9dfc-7c580a628c2a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:39.697942 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d18c115c-52bd-459d-a224-de681935443b req-86f7d3ac-4be7-4e79-9dfc-7c580a628c2a service neutron] 10.222.0.26 "GET /v2.0/subnets?id=8b6f842c-d1b7-43f0-96e7-0cb746a562dd HTTP/1.1" status: 200 len: 850 time: 0.0416040 Nov 09 04:48:39.728424 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d18c115c-52bd-459d-a224-de681935443b req-37d94405-3220-4fea-bb9a-fa1c71fc1781 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=e694d638-bf4f-4830-b082-ec442ad6f5cc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0235863 Nov 09 04:48:39.817444 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d18c115c-52bd-459d-a224-de681935443b req-e849d778-272e-4866-b83d-de3926dbdc55 service neutron] 10.222.0.26 "GET /v2.0/networks/e694d638-bf4f-4830-b082-ec442ad6f5cc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0809083 Nov 09 04:48:39.910288 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d18c115c-52bd-459d-a224-de681935443b req-5659a109-7e3f-4baf-a882-5ef5a9405b1c service neutron] 10.222.0.26 "GET /v2.0/networks/e694d638-bf4f-4830-b082-ec442ad6f5cc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0846088 Nov 09 04:48:40.656290 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cb185e0-bb95-4d63-abb4-c3b891c6f79f req-d338a998-cc4e-415f-91a2-7b2add1ceb62 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:40.658452 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3cb185e0-bb95-4d63-abb4-c3b891c6f79f req-d338a998-cc4e-415f-91a2-7b2add1ceb62 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/ports?device_id=e552d33b-85b5-4963-90e4-09d5ce3bd32e HTTP/1.1" status: 200 len: 945 time: 0.0487323 Nov 09 04:48:40.704737 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3cb185e0-bb95-4d63-abb4-c3b891c6f79f req-b04d9ea8-7445-4e9c-89cb-797b13f29f94 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/security-groups?id=fb6b691b-1a10-49c2-9fcc-249743c63c28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405085 Nov 09 04:48:41.358380 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-098c83c4-4b34-4855-9fbd-f21b170b87cf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:41.826867 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f38b0db-2524-4486-af2f-460f1fd8e8ae req-86171180-d458-419d-bd70-539597fe4516 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:41.828374 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-2f38b0db-2524-4486-af2f-460f1fd8e8ae req-86171180-d458-419d-bd70-539597fe4516 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/ports?device_id=e552d33b-85b5-4963-90e4-09d5ce3bd32e HTTP/1.1" status: 200 len: 945 time: 0.0551336 Nov 09 04:48:41.875475 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-2f38b0db-2524-4486-af2f-460f1fd8e8ae req-1bd82fe0-c600-460f-8428-506ea524a358 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/security-groups?id=fb6b691b-1a10-49c2-9fcc-249743c63c28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405934 Nov 09 04:48:42.238831 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:42.313501 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-333bcadf-78b0-4895-9c8a-8325c694a520 req-b3777500-fd1f-473d-80ca-db4fdc5a09cd tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:42.314856 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-333bcadf-78b0-4895-9c8a-8325c694a520 req-b3777500-fd1f-473d-80ca-db4fdc5a09cd tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.26 "GET /v2.0/ports?device_id=e552d33b-85b5-4963-90e4-09d5ce3bd32e&tenant_id=439796a9e9454c25aec4d3397b048cd5&binding%3Ahost_id=hv-neutron-8168 HTTP/1.1" status: 200 len: 945 time: 0.0821731 Nov 09 04:48:42.422543 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-333bcadf-78b0-4895-9c8a-8325c694a520 req-73d3782f-680b-4513-9a23-28568e6ac4f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:42.424033 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-333bcadf-78b0-4895-9c8a-8325c694a520 req-73d3782f-680b-4513-9a23-28568e6ac4f3 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=439796a9e9454c25aec4d3397b048cd5&device_id=e552d33b-85b5-4963-90e4-09d5ce3bd32e HTTP/1.1" status: 200 len: 1098 time: 0.0399263 Nov 09 04:48:42.469573 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 1df90dc2-fce1-4c9f-a9f3-ae2501dfd368 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=102163) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 09 04:48:42.472727 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 1df90dc2-fce1-4c9f-a9f3-ae2501dfd368 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:48:42.514326 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-333bcadf-78b0-4895-9c8a-8325c694a520 req-67031f3b-594a-4411-85d7-81407a0a4e6b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:42.515881 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-333bcadf-78b0-4895-9c8a-8325c694a520 req-67031f3b-594a-4411-85d7-81407a0a4e6b service neutron] 10.222.0.26 "GET /v2.0/networks?id=e694d638-bf4f-4830-b082-ec442ad6f5cc HTTP/1.1" status: 200 len: 911 time: 0.0854204 Nov 09 04:48:42.559345 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-333bcadf-78b0-4895-9c8a-8325c694a520 req-d8516733-2848-4b20-9ed8-cd8a23efc093 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=1df90dc2-fce1-4c9f-a9f3-ae2501dfd368 HTTP/1.1" status: 200 len: 217 time: 0.0355272 Nov 09 04:48:42.608397 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-333bcadf-78b0-4895-9c8a-8325c694a520 req-97d5dc5d-4ade-4df1-9d69-b29ad9c8304f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:42.609734 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-333bcadf-78b0-4895-9c8a-8325c694a520 req-97d5dc5d-4ade-4df1-9d69-b29ad9c8304f service neutron] 10.222.0.26 "GET /v2.0/subnets?id=8b6f842c-d1b7-43f0-96e7-0cb746a562dd HTTP/1.1" status: 200 len: 850 time: 0.0431919 Nov 09 04:48:42.632107 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 1df90dc2-fce1-4c9f-a9f3-ae2501dfd368, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=1df90dc2-fce1-4c9f-a9f3-ae2501dfd368,segment=NetworkSegment(47f9f5ba-b60a-4ca0-b699-b14d6890be57),segment_id=47f9f5ba-b60a-4ca0-b699-b14d6890be57)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:48:42.640469 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-333bcadf-78b0-4895-9c8a-8325c694a520 req-07cc693b-9617-4d88-afbf-92fa38cc1e38 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=e694d638-bf4f-4830-b082-ec442ad6f5cc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0232220 Nov 09 04:48:42.641613 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:42.646229 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Returning: {'device': '1df90dc2-fce1-4c9f-a9f3-ae2501dfd368', 'network_id': 'e694d638-bf4f-4830-b082-ec442ad6f5cc', 'port_id': '1df90dc2-fce1-4c9f-a9f3-ae2501dfd368', 'mac_address': 'fa:16:3e:bf:e4:5a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 304, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '8b6f842c-d1b7-43f0-96e7-0cb746a562dd', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102163) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 09 04:48:42.688324 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e552d33b-85b5-4963-90e4-09d5ce3bd32e', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '1df90dc2-fce1-4c9f-a9f3-ae2501dfd368'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:48:42.691121 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bcbbfb14-6dc2-4bf0-9b99-87613e3831b8" -d '{"events": [{"server_uuid": "e552d33b-85b5-4963-90e4-09d5ce3bd32e", "name": "network-vif-unplugged", "status": "completed", "tag": "1df90dc2-fce1-4c9f-a9f3-ae2501dfd368"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:48:42.710271 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 1df90dc2-fce1-4c9f-a9f3-ae2501dfd368, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=1df90dc2-fce1-4c9f-a9f3-ae2501dfd368,segment=NetworkSegment(47f9f5ba-b60a-4ca0-b699-b14d6890be57),segment_id=47f9f5ba-b60a-4ca0-b699-b14d6890be57)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:48:42.717023 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:42.728028 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 1df90dc2-fce1-4c9f-a9f3-ae2501dfd368 {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:48:42.734018 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-333bcadf-78b0-4895-9c8a-8325c694a520 req-5b1aed86-173e-4190-ba5d-02865df067d9 service neutron] 10.222.0.26 "GET /v2.0/networks/e694d638-bf4f-4830-b082-ec442ad6f5cc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0857801 Nov 09 04:48:42.743309 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 09 Nov 2021 04:48:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a21faaf5-3bad-4e9d-97b0-0e1bf13eefb3 x-openstack-request-id: req-a21faaf5-3bad-4e9d-97b0-0e1bf13eefb3 {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:48:42.743600 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e552d33b-85b5-4963-90e4-09d5ce3bd32e", "name": "network-vif-unplugged", "status": "completed", "tag": "1df90dc2-fce1-4c9f-a9f3-ae2501dfd368", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:48:42.743848 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-a21faaf5-3bad-4e9d-97b0-0e1bf13eefb3 {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:48:42.744227 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e552d33b-85b5-4963-90e4-09d5ce3bd32e', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '1df90dc2-fce1-4c9f-a9f3-ae2501dfd368', 'code': 200} Nov 09 04:48:42.782216 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:42.822250 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-333bcadf-78b0-4895-9c8a-8325c694a520 req-464ef8fa-2b20-4248-b149-6cf7845eab66 service neutron] 10.222.0.26 "GET /v2.0/networks/e694d638-bf4f-4830-b082-ec442ad6f5cc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0810792 Nov 09 04:48:42.854344 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.db.api [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=102163) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:48:42.854717 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG oslo_db.api [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:48:42.858991 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=1df90dc2-fce1-4c9f-a9f3-ae2501dfd368,revision_number=6']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:48:42.865819 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:48:42.868931 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:48:42.868931 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:48:42.868931 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:48:42.868931 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:48:42.868931 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:48:42.868931 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:48:42.868931 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:48:42.868931 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:48:42.868931 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:48:42.869698 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:48:42.869698 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:48:43.389423 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:43.402118 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1df90dc2-fce1-4c9f-a9f3-ae2501dfd368 {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:48:43.420615 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 1df90dc2-fce1-4c9f-a9f3-ae2501dfd368, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=1df90dc2-fce1-4c9f-a9f3-ae2501dfd368,segment=NetworkSegment(47f9f5ba-b60a-4ca0-b699-b14d6890be57),segment_id=47f9f5ba-b60a-4ca0-b699-b14d6890be57)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:48:43.501676 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:43.551747 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=1df90dc2-fce1-4c9f-a9f3-ae2501dfd368,revision_number=7']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:48:43.555892 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['1df90dc2-fce1-4c9f-a9f3-ae2501dfd368'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 04:48:43.712671 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a9e4b271-dc45-4410-abce-6cdd7b49894a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:44.095577 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d806520-1bc9-4481-b551-bd941b2ad6b8 req-af3af6f6-157a-4cc0-a02c-694fd1cb6df3 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:44.097809 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-0d806520-1bc9-4481-b551-bd941b2ad6b8 req-af3af6f6-157a-4cc0-a02c-694fd1cb6df3 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/ports?device_id=e552d33b-85b5-4963-90e4-09d5ce3bd32e HTTP/1.1" status: 200 len: 944 time: 0.0533750 Nov 09 04:48:44.147182 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-0d806520-1bc9-4481-b551-bd941b2ad6b8 req-0a68772b-fdbd-4a56-8aad-ad9f2bb1cb48 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/security-groups?id=fb6b691b-1a10-49c2-9fcc-249743c63c28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434794 Nov 09 04:48:44.468409 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 1df90dc2-fce1-4c9f-a9f3-ae2501dfd368 up at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:48:44.524170 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning complete for port 1df90dc2-fce1-4c9f-a9f3-ae2501dfd368 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:48:44.524839 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:44.744904 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:44.765560 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e552d33b-85b5-4963-90e4-09d5ce3bd32e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1df90dc2-fce1-4c9f-a9f3-ae2501dfd368'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:48:44.767797 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3c703030-dd03-48f3-81af-3e41b467dce0" -d '{"events": [{"server_uuid": "e552d33b-85b5-4963-90e4-09d5ce3bd32e", "name": "network-vif-plugged", "status": "completed", "tag": "1df90dc2-fce1-4c9f-a9f3-ae2501dfd368"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:48:44.779695 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 1df90dc2-fce1-4c9f-a9f3-ae2501dfd368, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=1df90dc2-fce1-4c9f-a9f3-ae2501dfd368,segment=NetworkSegment(47f9f5ba-b60a-4ca0-b699-b14d6890be57),segment_id=47f9f5ba-b60a-4ca0-b699-b14d6890be57)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:48:44.803615 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:48:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-527345c5-1c42-4897-8f36-d4a4da17cb26 x-openstack-request-id: req-527345c5-1c42-4897-8f36-d4a4da17cb26 {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:48:44.803917 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e552d33b-85b5-4963-90e4-09d5ce3bd32e", "name": "network-vif-plugged", "status": "completed", "tag": "1df90dc2-fce1-4c9f-a9f3-ae2501dfd368", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:48:44.804160 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-527345c5-1c42-4897-8f36-d4a4da17cb26 {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:48:44.804535 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e552d33b-85b5-4963-90e4-09d5ce3bd32e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1df90dc2-fce1-4c9f-a9f3-ae2501dfd368', 'code': 200} Nov 09 04:48:44.832836 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:44.878033 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=1df90dc2-fce1-4c9f-a9f3-ae2501dfd368,revision_number=8']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:48:45.113086 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:45.259597 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17265f34-62e1-43cf-8aa0-e63a1c82ad55 req-e604ed20-284e-4556-a8f6-57230bc7cfb5 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:45.261057 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-17265f34-62e1-43cf-8aa0-e63a1c82ad55 req-e604ed20-284e-4556-a8f6-57230bc7cfb5 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/ports?device_id=e552d33b-85b5-4963-90e4-09d5ce3bd32e HTTP/1.1" status: 200 len: 945 time: 0.0475118 Nov 09 04:48:45.305982 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-17265f34-62e1-43cf-8aa0-e63a1c82ad55 req-0c8246cc-34d1-4964-8d0a-35d90f2c57b6 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/security-groups?id=fb6b691b-1a10-49c2-9fcc-249743c63c28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392594 Nov 09 04:48:45.741657 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-333bcadf-78b0-4895-9c8a-8325c694a520 req-422f4b8b-6379-4ad5-8872-021cf7fd466f tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:45.743089 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-333bcadf-78b0-4895-9c8a-8325c694a520 req-422f4b8b-6379-4ad5-8872-021cf7fd466f tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.26 "GET /v2.0/ports?device_id=e552d33b-85b5-4963-90e4-09d5ce3bd32e HTTP/1.1" status: 200 len: 945 time: 0.0507586 Nov 09 04:48:45.826638 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-333bcadf-78b0-4895-9c8a-8325c694a520 req-e6bc74d4-5183-42a7-a6a8-46ff5eccf760 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Deleting port 1df90dc2-fce1-4c9f-a9f3-ae2501dfd368 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:48:45.826969 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-333bcadf-78b0-4895-9c8a-8325c694a520 req-e6bc74d4-5183-42a7-a6a8-46ff5eccf760 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:45.915140 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-333bcadf-78b0-4895-9c8a-8325c694a520 req-e6bc74d4-5183-42a7-a6a8-46ff5eccf760 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] For port 1df90dc2-fce1-4c9f-a9f3-ae2501dfd368, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=1df90dc2-fce1-4c9f-a9f3-ae2501dfd368,segment=NetworkSegment(47f9f5ba-b60a-4ca0-b699-b14d6890be57),segment_id=47f9f5ba-b60a-4ca0-b699-b14d6890be57)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:48:45.915495 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-333bcadf-78b0-4895-9c8a-8325c694a520 req-e6bc74d4-5183-42a7-a6a8-46ff5eccf760 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:46.260489 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-333bcadf-78b0-4895-9c8a-8325c694a520 req-e6bc74d4-5183-42a7-a6a8-46ff5eccf760 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Calling delete_port for 1df90dc2-fce1-4c9f-a9f3-ae2501dfd368 owned by compute:nova {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:48:46.427241 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cd535ac-66fb-4c90-bb5b-2fefcd5637e1 req-a02044e1-389f-45ae-96c6-489aa55d30ea tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:46.428732 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1cd535ac-66fb-4c90-bb5b-2fefcd5637e1 req-a02044e1-389f-45ae-96c6-489aa55d30ea tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/ports?device_id=e552d33b-85b5-4963-90e4-09d5ce3bd32e HTTP/1.1" status: 200 len: 945 time: 0.0531812 Nov 09 04:48:46.441757 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-333bcadf-78b0-4895-9c8a-8325c694a520 req-e6bc74d4-5183-42a7-a6a8-46ff5eccf760 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:46.454108 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['1df90dc2-fce1-4c9f-a9f3-ae2501dfd368'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 04:48:46.481335 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6bc74d4-5183-42a7-a6a8-46ff5eccf760 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Pushing event deleted for resources: {'Port': ['ID=1df90dc2-fce1-4c9f-a9f3-ae2501dfd368,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:48:46.484150 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:46.511564 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6bc74d4-5183-42a7-a6a8-46ff5eccf760 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:48:46.511851 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6bc74d4-5183-42a7-a6a8-46ff5eccf760 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:48:46.512177 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6bc74d4-5183-42a7-a6a8-46ff5eccf760 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:48:46.512508 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6bc74d4-5183-42a7-a6a8-46ff5eccf760 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:48:46.512841 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6bc74d4-5183-42a7-a6a8-46ff5eccf760 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:48:46.513165 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6bc74d4-5183-42a7-a6a8-46ff5eccf760 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:48:46.513487 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6bc74d4-5183-42a7-a6a8-46ff5eccf760 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:48:46.513812 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6bc74d4-5183-42a7-a6a8-46ff5eccf760 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:48:46.514130 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6bc74d4-5183-42a7-a6a8-46ff5eccf760 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:48:46.514471 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6bc74d4-5183-42a7-a6a8-46ff5eccf760 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:48:46.514789 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6bc74d4-5183-42a7-a6a8-46ff5eccf760 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:48:46.515104 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6bc74d4-5183-42a7-a6a8-46ff5eccf760 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:48:46.543015 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-333bcadf-78b0-4895-9c8a-8325c694a520 req-e6bc74d4-5183-42a7-a6a8-46ff5eccf760 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] No DVR routers for this DVR port 1df90dc2-fce1-4c9f-a9f3-ae2501dfd368 on host hv-neutron-8168 {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:48:46.545807 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-333bcadf-78b0-4895-9c8a-8325c694a520 req-e6bc74d4-5183-42a7-a6a8-46ff5eccf760 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:46.549779 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-333bcadf-78b0-4895-9c8a-8325c694a520 req-e6bc74d4-5183-42a7-a6a8-46ff5eccf760 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.26 "DELETE /v2.0/ports/1df90dc2-fce1-4c9f-a9f3-ae2501dfd368 HTTP/1.1" status: 204 len: 173 time: 0.7993765 Nov 09 04:48:46.550214 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e552d33b-85b5-4963-90e4-09d5ce3bd32e', 'name': 'network-vif-deleted', 'tag': '1df90dc2-fce1-4c9f-a9f3-ae2501dfd368'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:48:46.552554 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9f472f60-dd02-4199-b01a-5aac61ebc84c" -d '{"events": [{"server_uuid": "e552d33b-85b5-4963-90e4-09d5ce3bd32e", "name": "network-vif-deleted", "tag": "1df90dc2-fce1-4c9f-a9f3-ae2501dfd368"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:48:46.558757 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1cd535ac-66fb-4c90-bb5b-2fefcd5637e1 req-ec4005cd-ce39-449f-b93f-11beb94c1f95 tempest-DeleteServersTestJSON-753398604 tempest-DeleteServersTestJSON-753398604-project] 10.222.0.24 "GET /v2.0/security-groups?id=fb6b691b-1a10-49c2-9fcc-249743c63c28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1241529 Nov 09 04:48:46.588578 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:48:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cb6b64c7-341d-4a9e-93f4-4eb68830ae20 x-openstack-request-id: req-cb6b64c7-341d-4a9e-93f4-4eb68830ae20 {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:48:46.588867 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e552d33b-85b5-4963-90e4-09d5ce3bd32e", "name": "network-vif-deleted", "tag": "1df90dc2-fce1-4c9f-a9f3-ae2501dfd368", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:48:46.589116 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-cb6b64c7-341d-4a9e-93f4-4eb68830ae20 {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:48:46.589540 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e552d33b-85b5-4963-90e4-09d5ce3bd32e', 'name': 'network-vif-deleted', 'tag': '1df90dc2-fce1-4c9f-a9f3-ae2501dfd368', 'status': 'completed', 'code': 200} Nov 09 04:48:46.969421 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:47.683445 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 33778) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:48:47.731138 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-2e4f943e-8388-4113-9338-250b851d4f05 admin admin] Deleting subnet 8b6f842c-d1b7-43f0-96e7-0cb746a562dd {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:48:47.734159 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2e4f943e-8388-4113-9338-250b851d4f05 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:47.770699 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2e4f943e-8388-4113-9338-250b851d4f05 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:47.808308 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2e4f943e-8388-4113-9338-250b851d4f05 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:47.913229 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2e4f943e-8388-4113-9338-250b851d4f05 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:47.937868 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e4f943e-8388-4113-9338-250b851d4f05 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=8b6f842c-d1b7-43f0-96e7-0cb746a562dd,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:48:47.942773 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2e4f943e-8388-4113-9338-250b851d4f05 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:47.945846 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-2e4f943e-8388-4113-9338-250b851d4f05 admin admin] 10.222.0.24 "DELETE /v2.0/subnets/8b6f842c-d1b7-43f0-96e7-0cb746a562dd HTTP/1.1" status: 204 len: 168 time: 0.2613955 Nov 09 04:48:47.948498 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33780) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:48:47.950795 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e4f943e-8388-4113-9338-250b851d4f05 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:48:47.951142 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e4f943e-8388-4113-9338-250b851d4f05 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:48:47.951475 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e4f943e-8388-4113-9338-250b851d4f05 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:48:47.951806 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e4f943e-8388-4113-9338-250b851d4f05 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:48:47.952134 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e4f943e-8388-4113-9338-250b851d4f05 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:48:47.952458 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e4f943e-8388-4113-9338-250b851d4f05 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:48:47.952780 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e4f943e-8388-4113-9338-250b851d4f05 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:48:47.953104 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e4f943e-8388-4113-9338-250b851d4f05 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:48:47.953422 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e4f943e-8388-4113-9338-250b851d4f05 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:48:47.953741 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e4f943e-8388-4113-9338-250b851d4f05 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:48:47.954058 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e4f943e-8388-4113-9338-250b851d4f05 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:48:47.954419 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e4f943e-8388-4113-9338-250b851d4f05 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:48:48.019751 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f7dba76b-6273-4a03-8fe4-6c68dfa7c1d8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:48.094453 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f7dba76b-6273-4a03-8fe4-6c68dfa7c1d8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:48.118029 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-f7dba76b-6273-4a03-8fe4-6c68dfa7c1d8 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e694d638-bf4f-4830-b082-ec442ad6f5cc']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:48:48.128489 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-f7dba76b-6273-4a03-8fe4-6c68dfa7c1d8 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '47f9f5ba-b60a-4ca0-b699-b14d6890be57') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:48:48.128765 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-f7dba76b-6273-4a03-8fe4-6c68dfa7c1d8 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '47f9f5ba-b60a-4ca0-b699-b14d6890be57') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:48:48.138585 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f7dba76b-6273-4a03-8fe4-6c68dfa7c1d8 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:48.152956 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f7dba76b-6273-4a03-8fe4-6c68dfa7c1d8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:48.159327 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f7dba76b-6273-4a03-8fe4-6c68dfa7c1d8 admin admin] Releasing vlan 304 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:48:48.165788 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f7dba76b-6273-4a03-8fe4-6c68dfa7c1d8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:48.165788 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:48:48.165788 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:48:48.165788 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:48:48.165788 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:48:48.165788 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:48:48.165788 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:48:48.165788 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:48:48.165788 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:48:48.165788 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:48:48.165788 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:48:48.165788 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:48:48.165788 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:48:48.165788 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:48:48.165788 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:48:48.165788 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:48:48.165788 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:48:48.165788 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:48:48.165788 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:48:48.165788 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:48:48.165788 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:48:48.165788 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:48:48.165788 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:48:48.165788 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:48:48.165788 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:48:48.165788 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:48:48.165788 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:48:48.165788 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:48:48.165788 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:48:48.165788 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:48:48.165788 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:48:48.165788 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:48:48.165788 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:48:48.289931 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f7dba76b-6273-4a03-8fe4-6c68dfa7c1d8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:48.295088 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f7dba76b-6273-4a03-8fe4-6c68dfa7c1d8 admin admin] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:48.298190 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-f7dba76b-6273-4a03-8fe4-6c68dfa7c1d8 admin admin] 10.222.0.24 "DELETE /v2.0/networks/e694d638-bf4f-4830-b082-ec442ad6f5cc HTTP/1.1" status: 204 len: 168 time: 0.3486910 Nov 09 04:48:48.308569 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7dba76b-6273-4a03-8fe4-6c68dfa7c1d8 admin admin] Pushing event deleted for resources: {'Network': ['ID=e694d638-bf4f-4830-b082-ec442ad6f5cc,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:48:48.475218 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 1df90dc2-fce1-4c9f-a9f3-ae2501dfd368 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:48:48.494522 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] No Port match for: 1df90dc2-fce1-4c9f-a9f3-ae2501dfd368 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:48:48.494873 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 1df90dc2-fce1-4c9f-a9f3-ae2501dfd368 not bound to the agent host hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:48:48.555793 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33784) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:48:48.596798 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-d8282318-22e3-48d8-8dd6-c26d0f061f60 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=439796a9e9454c25aec4d3397b048cd5&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0398281 Nov 09 04:48:48.599225 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33786) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:48:48.648907 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-67a96e71-fed9-407a-beef-625bee20ac46 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:48.668896 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-67a96e71-fed9-407a-beef-625bee20ac46 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:48.786541 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-67a96e71-fed9-407a-beef-625bee20ac46 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:48.789187 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-67a96e71-fed9-407a-beef-625bee20ac46 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:48.790347 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-67a96e71-fed9-407a-beef-625bee20ac46 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/fb6b691b-1a10-49c2-9fcc-249743c63c28 HTTP/1.1" status: 204 len: 168 time: 0.1902034 Nov 09 04:48:48.800455 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67a96e71-fed9-407a-beef-625bee20ac46 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fb6b691b-1a10-49c2-9fcc-249743c63c28,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:48:49.663737 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33808) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:48:49.754481 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-8780ed4b-c6f6-461d-b2fa-eda2686f789b admin admin] Request body: {'network': {'name': 'tempest-ServerDiskConfigTestJSON-462260501-network', 'tenant_id': '429656387d9541bbb7aea9dd5d2534cb'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:48:49.861109 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8780ed4b-c6f6-461d-b2fa-eda2686f789b admin admin] Made reservation on behalf of 429656387d9541bbb7aea9dd5d2534cb for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:48:49.863280 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8780ed4b-c6f6-461d-b2fa-eda2686f789b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:49.871432 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8780ed4b-c6f6-461d-b2fa-eda2686f789b admin admin] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:49.942050 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8780ed4b-c6f6-461d-b2fa-eda2686f789b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:49.992047 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8780ed4b-c6f6-461d-b2fa-eda2686f789b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:50.015575 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8780ed4b-c6f6-461d-b2fa-eda2686f789b admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 332} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:48:50.025374 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8780ed4b-c6f6-461d-b2fa-eda2686f789b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=759776ed-4cbf-4868-85c0-f1aebe6b5dc9,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:48:50.029876 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8780ed4b-c6f6-461d-b2fa-eda2686f789b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:50.030212 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-8780ed4b-c6f6-461d-b2fa-eda2686f789b admin admin] Added segment cdaf1228-49b2-4d2a-83ed-bceae5b9bca8 of type vlan for network 286563ae-11dd-41c3-932c-9747a97a5b19 Nov 09 04:48:50.067380 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8780ed4b-c6f6-461d-b2fa-eda2686f789b admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:50.123646 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8780ed4b-c6f6-461d-b2fa-eda2686f789b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:50.124497 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8780ed4b-c6f6-461d-b2fa-eda2686f789b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:50.125062 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8780ed4b-c6f6-461d-b2fa-eda2686f789b admin admin] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:50.184973 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8780ed4b-c6f6-461d-b2fa-eda2686f789b admin admin] Pushing event updated for resources: {'Network': ['ID=286563ae-11dd-41c3-932c-9747a97a5b19,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:48:50.194501 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 286563ae-11dd-41c3-932c-9747a97a5b19 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:48:50.213264 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-8780ed4b-c6f6-461d-b2fa-eda2686f789b admin admin] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.5484529 Nov 09 04:48:50.216034 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 33812) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:48:50.220707 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-ae4d665d-291d-404e-8634-eca16d6e0108 admin admin] Request body: {'subnet': {'network_id': '286563ae-11dd-41c3-932c-9747a97a5b19', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerDiskConfigTestJSON-462260501-subnet', 'tenant_id': '429656387d9541bbb7aea9dd5d2534cb', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:48:50.295209 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ae4d665d-291d-404e-8634-eca16d6e0108 admin admin] Made reservation on behalf of 429656387d9541bbb7aea9dd5d2534cb for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:48:50.297526 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ae4d665d-291d-404e-8634-eca16d6e0108 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:50.512733 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ae4d665d-291d-404e-8634-eca16d6e0108 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:50.563803 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae4d665d-291d-404e-8634-eca16d6e0108 admin admin] Pushing event updated for resources: {'Subnet': ['ID=f39bfd16-f1ca-4a88-adf8-6562c8af0c74,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:48:50.575819 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ae4d665d-291d-404e-8634-eca16d6e0108 admin admin] Checking segment: {'id': 'cdaf1228-49b2-4d2a-83ed-bceae5b9bca8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 332, 'network_id': '286563ae-11dd-41c3-932c-9747a97a5b19'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:48:50.576177 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ae4d665d-291d-404e-8634-eca16d6e0108 admin admin] Network hostable DHCP agents. Network: 286563ae-11dd-41c3-932c-9747a97a5b19, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:48:50.672565 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ae4d665d-291d-404e-8634-eca16d6e0108 admin admin] Network 286563ae-11dd-41c3-932c-9747a97a5b19 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:48:50.764046 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-ae4d665d-291d-404e-8634-eca16d6e0108 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 286563ae-11dd-41c3-932c-9747a97a5b19) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:48:50.767851 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ae4d665d-291d-404e-8634-eca16d6e0108 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:50.768436 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ae4d665d-291d-404e-8634-eca16d6e0108 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:50.773136 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2b58841c-1a18-43dd-8895-f53c39fd3b14 None None] Network 286563ae-11dd-41c3-932c-9747a97a5b19 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:48:50.847075 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-ae4d665d-291d-404e-8634-eca16d6e0108 admin admin] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.6299765 Nov 09 04:48:50.895269 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-27649b1d-9549-4165-89cd-1d68a1262e9d None None] Network 286563ae-11dd-41c3-932c-9747a97a5b19 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:48:51.260570 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8a486d8-6f11-4a57-bab6-18a5f8b7a011 req-4ccec62e-f8ad-47f6-9efe-a23226b09114 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:51.262030 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b8a486d8-6f11-4a57-bab6-18a5f8b7a011 req-4ccec62e-f8ad-47f6-9efe-a23226b09114 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/networks?id=286563ae-11dd-41c3-932c-9747a97a5b19 HTTP/1.1" status: 200 len: 814 time: 0.1049602 Nov 09 04:48:51.276965 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b8a486d8-6f11-4a57-bab6-18a5f8b7a011 req-d86f6e76-7637-4b19-9c89-8dc03a345713 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/quotas/429656387d9541bbb7aea9dd5d2534cb HTTP/1.1" status: 200 len: 375 time: 0.0091689 Nov 09 04:48:51.307536 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b8a486d8-6f11-4a57-bab6-18a5f8b7a011 req-b80d6750-47c0-4ffa-a13e-1f993f7ba114 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?tenant_id=429656387d9541bbb7aea9dd5d2534cb&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0255468 Nov 09 04:48:51.396305 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b8a486d8-6f11-4a57-bab6-18a5f8b7a011 req-a4576261-e487-4565-8c50-1b3fc821a5d3 service neutron] 10.222.0.24 "GET /v2.0/networks/286563ae-11dd-41c3-932c-9747a97a5b19?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0820873 Nov 09 04:48:51.488240 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b8a486d8-6f11-4a57-bab6-18a5f8b7a011 req-c3725750-9dc6-44c5-9c3d-0d1ff676dd45 service neutron] 10.222.0.24 "GET /v2.0/networks/286563ae-11dd-41c3-932c-9747a97a5b19?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0860577 Nov 09 04:48:51.706561 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3e9edc7a-5906-460b-9f2d-92fbf7d3e2e7 req-c83ad96a-b4e1-4c9c-bf97-1ac38e163d2a tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=94544813-0543-4944-94b8-b667efa641a9 HTTP/1.1" status: 200 len: 210 time: 0.0263562 Nov 09 04:48:52.800427 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-549031eb-1e3a-4d5b-a08e-1240543a266e req-5c1a7ce9-271a-471b-af31-4efc85819069 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=94544813-0543-4944-94b8-b667efa641a9 HTTP/1.1" status: 200 len: 210 time: 0.0269597 Nov 09 04:48:53.422388 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8a486d8-6f11-4a57-bab6-18a5f8b7a011 req-e91c5f42-3e3b-4d56-876a-1319eb07a4ce tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:53.423816 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b8a486d8-6f11-4a57-bab6-18a5f8b7a011 req-e91c5f42-3e3b-4d56-876a-1319eb07a4ce tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.26 "GET /v2.0/networks?id=286563ae-11dd-41c3-932c-9747a97a5b19 HTTP/1.1" status: 200 len: 814 time: 0.1279840 Nov 09 04:48:53.437127 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-b8a486d8-6f11-4a57-bab6-18a5f8b7a011 req-0d3c46af-8734-4917-956f-e5c2aa26e674 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Request body: {'port': {'device_id': '94544813-0543-4944-94b8-b667efa641a9', 'network_id': '286563ae-11dd-41c3-932c-9747a97a5b19', 'admin_state_up': True, 'tenant_id': '429656387d9541bbb7aea9dd5d2534cb'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:48:53.632592 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b8a486d8-6f11-4a57-bab6-18a5f8b7a011 req-0d3c46af-8734-4917-956f-e5c2aa26e674 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Made reservation on behalf of 429656387d9541bbb7aea9dd5d2534cb for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:48:53.636182 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-b8a486d8-6f11-4a57-bab6-18a5f8b7a011 req-0d3c46af-8734-4917-956f-e5c2aa26e674 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:53.768551 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [req-b8a486d8-6f11-4a57-bab6-18a5f8b7a011 req-0d3c46af-8734-4917-956f-e5c2aa26e674 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Allocated IP 172.20.0.4 (286563ae-11dd-41c3-932c-9747a97a5b19/f39bfd16-f1ca-4a88-adf8-6562c8af0c74/f3317116-a956-4f8c-b3f9-1f6e630d4058) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:48:53.902467 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b2ecdb65-5939-49e1-a1eb-aa3bf744ab8d req-c22f72f8-a16d-4fa1-8fb0-26584496e186 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=94544813-0543-4944-94b8-b667efa641a9 HTTP/1.1" status: 200 len: 210 time: 0.0311520 Nov 09 04:48:53.937684 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-b8a486d8-6f11-4a57-bab6-18a5f8b7a011 req-0d3c46af-8734-4917-956f-e5c2aa26e674 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:54.039733 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-b8a486d8-6f11-4a57-bab6-18a5f8b7a011 req-0d3c46af-8734-4917-956f-e5c2aa26e674 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:54.083939 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b8a486d8-6f11-4a57-bab6-18a5f8b7a011 req-0d3c46af-8734-4917-956f-e5c2aa26e674 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Network 286563ae-11dd-41c3-932c-9747a97a5b19 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:48:54.087401 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [req-b8a486d8-6f11-4a57-bab6-18a5f8b7a011 req-0d3c46af-8734-4917-956f-e5c2aa26e674 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:48:54.093096 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-b8a486d8-6f11-4a57-bab6-18a5f8b7a011 req-0d3c46af-8734-4917-956f-e5c2aa26e674 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:48:54.118038 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d3c46af-8734-4917-956f-e5c2aa26e674 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Pushing event updated for resources: {'Port': ['ID=f3317116-a956-4f8c-b3f9-1f6e630d4058,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:48:54.145257 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8a486d8-6f11-4a57-bab6-18a5f8b7a011 req-0d3c46af-8734-4917-956f-e5c2aa26e674 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:54.145844 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-b8a486d8-6f11-4a57-bab6-18a5f8b7a011 req-0d3c46af-8734-4917-956f-e5c2aa26e674 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:54.234620 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b8a486d8-6f11-4a57-bab6-18a5f8b7a011 req-0d3c46af-8734-4917-956f-e5c2aa26e674 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.26 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8010063 Nov 09 04:48:54.245531 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [req-b8a486d8-6f11-4a57-bab6-18a5f8b7a011 req-acb49d16-72a2-4e58-a3cc-ba4aec9eacf7 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] http://10.222.0.24:9696/v2.0/extensions returned with HTTP 200 {{(pid=102162) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:48:54.246512 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b8a486d8-6f11-4a57-bab6-18a5f8b7a011 req-acb49d16-72a2-4e58-a3cc-ba4aec9eacf7 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.26 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0054522 Nov 09 04:48:54.258329 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-b8a486d8-6f11-4a57-bab6-18a5f8b7a011 req-9ea478b6-5385-4332-bb99-8dbaa59ba931 service neutron] Request body: {'port': {'device_id': '94544813-0543-4944-94b8-b667efa641a9', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:48:54.310090 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-b8a486d8-6f11-4a57-bab6-18a5f8b7a011 req-9ea478b6-5385-4332-bb99-8dbaa59ba931 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:54.563804 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [req-b8a486d8-6f11-4a57-bab6-18a5f8b7a011 req-9ea478b6-5385-4332-bb99-8dbaa59ba931 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f3317116-a956-4f8c-b3f9-1f6e630d4058 {{(pid=102162) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:48:54.571245 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-b8a486d8-6f11-4a57-bab6-18a5f8b7a011 req-9ea478b6-5385-4332-bb99-8dbaa59ba931 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:54.583325 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.provisioning_blocks [req-b8a486d8-6f11-4a57-bab6-18a5f8b7a011 req-9ea478b6-5385-4332-bb99-8dbaa59ba931 service neutron] Transition to ACTIVE for port object f3317116-a956-4f8c-b3f9-1f6e630d4058 will not be triggered until provisioned by entity L2. {{(pid=102162) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 09 04:48:54.660723 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-b8a486d8-6f11-4a57-bab6-18a5f8b7a011 req-9ea478b6-5385-4332-bb99-8dbaa59ba931 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:54.711191 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ea478b6-5385-4332-bb99-8dbaa59ba931 service neutron] Pushing event updated for resources: {'Port': ['ID=f3317116-a956-4f8c-b3f9-1f6e630d4058,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:48:54.779482 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-b8a486d8-6f11-4a57-bab6-18a5f8b7a011 req-9ea478b6-5385-4332-bb99-8dbaa59ba931 service neutron] Attempting to bind port f3317116-a956-4f8c-b3f9-1f6e630d4058 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:48:54.779802 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-b8a486d8-6f11-4a57-bab6-18a5f8b7a011 req-9ea478b6-5385-4332-bb99-8dbaa59ba931 service neutron] Attempting to bind port f3317116-a956-4f8c-b3f9-1f6e630d4058 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'cdaf1228-49b2-4d2a-83ed-bceae5b9bca8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 332, 'network_id': '286563ae-11dd-41c3-932c-9747a97a5b19'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:48:54.780115 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b8a486d8-6f11-4a57-bab6-18a5f8b7a011 req-9ea478b6-5385-4332-bb99-8dbaa59ba931 service neutron] Attempting to bind port f3317116-a956-4f8c-b3f9-1f6e630d4058 on network 286563ae-11dd-41c3-932c-9747a97a5b19 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:48:54.784144 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b8a486d8-6f11-4a57-bab6-18a5f8b7a011 req-9ea478b6-5385-4332-bb99-8dbaa59ba931 service neutron] Port f3317116-a956-4f8c-b3f9-1f6e630d4058 on network 286563ae-11dd-41c3-932c-9747a97a5b19 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:48:54.784448 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b8a486d8-6f11-4a57-bab6-18a5f8b7a011 req-9ea478b6-5385-4332-bb99-8dbaa59ba931 service neutron] Attempting to bind port f3317116-a956-4f8c-b3f9-1f6e630d4058 on network 286563ae-11dd-41c3-932c-9747a97a5b19 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:48:54.789610 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b8a486d8-6f11-4a57-bab6-18a5f8b7a011 req-9ea478b6-5385-4332-bb99-8dbaa59ba931 service neutron] Checking agent: {'id': '7d36b884-4ad2-4878-9464-bf647030b544', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'started_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 48, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:48:54.789931 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b8a486d8-6f11-4a57-bab6-18a5f8b7a011 req-9ea478b6-5385-4332-bb99-8dbaa59ba931 service neutron] Checking segment: {'id': 'cdaf1228-49b2-4d2a-83ed-bceae5b9bca8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 332, 'network_id': '286563ae-11dd-41c3-932c-9747a97a5b19'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:48:54.790300 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b8a486d8-6f11-4a57-bab6-18a5f8b7a011 req-9ea478b6-5385-4332-bb99-8dbaa59ba931 service neutron] Bound using segment: {'id': 'cdaf1228-49b2-4d2a-83ed-bceae5b9bca8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 332, 'network_id': '286563ae-11dd-41c3-932c-9747a97a5b19'} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:48:54.790741 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-b8a486d8-6f11-4a57-bab6-18a5f8b7a011 req-9ea478b6-5385-4332-bb99-8dbaa59ba931 service neutron] Bound port: f3317116-a956-4f8c-b3f9-1f6e630d4058, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'cdaf1228-49b2-4d2a-83ed-bceae5b9bca8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 332, 'network_id': '286563ae-11dd-41c3-932c-9747a97a5b19'}}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:48:54.791078 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-b8a486d8-6f11-4a57-bab6-18a5f8b7a011 req-9ea478b6-5385-4332-bb99-8dbaa59ba931 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:54.850879 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-b8a486d8-6f11-4a57-bab6-18a5f8b7a011 req-9ea478b6-5385-4332-bb99-8dbaa59ba931 service neutron] For port f3317116-a956-4f8c-b3f9-1f6e630d4058, host hv-neutron-8168, cleared binding levels {{(pid=102162) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:48:54.853879 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-b8a486d8-6f11-4a57-bab6-18a5f8b7a011 req-9ea478b6-5385-4332-bb99-8dbaa59ba931 service neutron] For port f3317116-a956-4f8c-b3f9-1f6e630d4058, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=f3317116-a956-4f8c-b3f9-1f6e630d4058,segment=NetworkSegment(cdaf1228-49b2-4d2a-83ed-bceae5b9bca8),segment_id=cdaf1228-49b2-4d2a-83ed-bceae5b9bca8)] {{(pid=102162) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:48:54.947064 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-b8a486d8-6f11-4a57-bab6-18a5f8b7a011 req-9ea478b6-5385-4332-bb99-8dbaa59ba931 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:54.980955 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8a486d8-6f11-4a57-bab6-18a5f8b7a011 req-9ea478b6-5385-4332-bb99-8dbaa59ba931 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:54.981564 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-b8a486d8-6f11-4a57-bab6-18a5f8b7a011 req-9ea478b6-5385-4332-bb99-8dbaa59ba931 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:54.982955 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b8a486d8-6f11-4a57-bab6-18a5f8b7a011 req-9ea478b6-5385-4332-bb99-8dbaa59ba931 service neutron] 10.222.0.26 "PUT /v2.0/ports/f3317116-a956-4f8c-b3f9-1f6e630d4058 HTTP/1.1" status: 200 len: 1093 time: 0.7283418 Nov 09 04:48:54.983449 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '94544813-0543-4944-94b8-b667efa641a9', 'tag': 'f3317116-a956-4f8c-b3f9-1f6e630d4058'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:48:54.985708 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bd4e9742-506e-4c68-bf48-7679df4f2c9c" -d '{"events": [{"name": "network-changed", "server_uuid": "94544813-0543-4944-94b8-b667efa641a9", "tag": "f3317116-a956-4f8c-b3f9-1f6e630d4058"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:48:55.011879 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ea478b6-5385-4332-bb99-8dbaa59ba931 service neutron] Pushing event updated for resources: {'Port': ['ID=f3317116-a956-4f8c-b3f9-1f6e630d4058,revision_number=3']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:48:55.017845 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af41bc29-86dd-4448-8980-3582708ba99b req-16395e1b-9cbe-4592-b85b-fdb503df2061 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:55.019457 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-af41bc29-86dd-4448-8980-3582708ba99b req-16395e1b-9cbe-4592-b85b-fdb503df2061 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=94544813-0543-4944-94b8-b667efa641a9 HTTP/1.1" status: 200 len: 943 time: 0.0508101 Nov 09 04:48:55.035462 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:48:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-505fcc41-89db-4a58-bf81-86de9a0db0bb x-openstack-request-id: req-505fcc41-89db-4a58-bf81-86de9a0db0bb {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:48:55.035744 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "94544813-0543-4944-94b8-b667efa641a9", "tag": "f3317116-a956-4f8c-b3f9-1f6e630d4058", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:48:55.036014 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-505fcc41-89db-4a58-bf81-86de9a0db0bb {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:48:55.036416 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '94544813-0543-4944-94b8-b667efa641a9', 'tag': 'f3317116-a956-4f8c-b3f9-1f6e630d4058', 'status': 'completed', 'code': 200} Nov 09 04:48:55.073500 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-af41bc29-86dd-4448-8980-3582708ba99b req-e5afa66a-2e3e-4f3c-9fcc-c8e3dc9afb12 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0476913 Nov 09 04:48:55.096828 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd4e9742-506e-4c68-bf48-7679df4f2c9c req-aca5cc02-0199-4491-b713-98853ba99ab1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:55.098317 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-bd4e9742-506e-4c68-bf48-7679df4f2c9c req-aca5cc02-0199-4491-b713-98853ba99ab1 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=429656387d9541bbb7aea9dd5d2534cb&device_id=94544813-0543-4944-94b8-b667efa641a9 HTTP/1.1" status: 200 len: 1096 time: 0.0417182 Nov 09 04:48:55.197049 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd4e9742-506e-4c68-bf48-7679df4f2c9c req-6ca8b887-0cbb-4fee-8476-ed7a9cfdf2d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:55.198419 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-bd4e9742-506e-4c68-bf48-7679df4f2c9c req-6ca8b887-0cbb-4fee-8476-ed7a9cfdf2d2 service neutron] 10.222.0.26 "GET /v2.0/networks?tenant_id=429656387d9541bbb7aea9dd5d2534cb&shared=False HTTP/1.1" status: 200 len: 915 time: 0.0920839 Nov 09 04:48:55.292837 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd4e9742-506e-4c68-bf48-7679df4f2c9c req-f9eca4d0-9702-46bf-988c-ab9a24015a6c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:55.294288 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-bd4e9742-506e-4c68-bf48-7679df4f2c9c req-f9eca4d0-9702-46bf-988c-ab9a24015a6c service neutron] 10.222.0.26 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0884876 Nov 09 04:48:55.368495 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8a486d8-6f11-4a57-bab6-18a5f8b7a011 req-d25bc582-3278-4856-a6f8-7a328ffc2ffa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:55.370054 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b8a486d8-6f11-4a57-bab6-18a5f8b7a011 req-d25bc582-3278-4856-a6f8-7a328ffc2ffa service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=429656387d9541bbb7aea9dd5d2534cb&device_id=94544813-0543-4944-94b8-b667efa641a9 HTTP/1.1" status: 200 len: 1096 time: 0.0411401 Nov 09 04:48:55.411991 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b8a486d8-6f11-4a57-bab6-18a5f8b7a011 req-e719dc86-e426-4523-9e7e-c611724e449e service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=f3317116-a956-4f8c-b3f9-1f6e630d4058 HTTP/1.1" status: 200 len: 217 time: 0.0342007 Nov 09 04:48:55.460632 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8a486d8-6f11-4a57-bab6-18a5f8b7a011 req-a9df4274-5cef-418b-8368-838a0ff7bb00 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:55.461942 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b8a486d8-6f11-4a57-bab6-18a5f8b7a011 req-a9df4274-5cef-418b-8368-838a0ff7bb00 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=f39bfd16-f1ca-4a88-adf8-6562c8af0c74 HTTP/1.1" status: 200 len: 854 time: 0.0429211 Nov 09 04:48:55.496301 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b8a486d8-6f11-4a57-bab6-18a5f8b7a011 req-4261f64a-941a-4b70-adda-8f95358db840 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=286563ae-11dd-41c3-932c-9747a97a5b19&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0266135 Nov 09 04:48:55.584252 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b8a486d8-6f11-4a57-bab6-18a5f8b7a011 req-8a1617d5-1a9b-4376-93e5-4ab68999f3d9 service neutron] 10.222.0.26 "GET /v2.0/networks/286563ae-11dd-41c3-932c-9747a97a5b19?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0811353 Nov 09 04:48:55.675715 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b8a486d8-6f11-4a57-bab6-18a5f8b7a011 req-f3b3fdeb-ecfb-414c-9372-f78b34b32ec9 service neutron] 10.222.0.26 "GET /v2.0/networks/286563ae-11dd-41c3-932c-9747a97a5b19?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0834222 Nov 09 04:48:56.189539 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d2eafea-fb06-4cc7-b610-3f79dbfe8663 req-1c26b9eb-8499-452f-b0b5-5362e73af3dc tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:56.190907 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8d2eafea-fb06-4cc7-b610-3f79dbfe8663 req-1c26b9eb-8499-452f-b0b5-5362e73af3dc tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=94544813-0543-4944-94b8-b667efa641a9 HTTP/1.1" status: 200 len: 943 time: 0.0488439 Nov 09 04:48:56.237310 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8d2eafea-fb06-4cc7-b610-3f79dbfe8663 req-27010d69-e6f3-4b5e-aeef-6af06ba22448 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405598 Nov 09 04:48:56.506457 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device f3317116-a956-4f8c-b3f9-1f6e630d4058 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=102163) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 09 04:48:56.603024 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port f3317116-a956-4f8c-b3f9-1f6e630d4058, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=f3317116-a956-4f8c-b3f9-1f6e630d4058,segment=NetworkSegment(cdaf1228-49b2-4d2a-83ed-bceae5b9bca8),segment_id=cdaf1228-49b2-4d2a-83ed-bceae5b9bca8)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:48:56.613784 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Returning: {'device': 'f3317116-a956-4f8c-b3f9-1f6e630d4058', 'network_id': '286563ae-11dd-41c3-932c-9747a97a5b19', 'port_id': 'f3317116-a956-4f8c-b3f9-1f6e630d4058', 'mac_address': 'fa:16:3e:c7:5f:a9', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 332, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f39bfd16-f1ca-4a88-adf8-6562c8af0c74', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102163) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 09 04:48:56.649570 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:56.662212 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f3317116-a956-4f8c-b3f9-1f6e630d4058 {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:48:56.680020 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port f3317116-a956-4f8c-b3f9-1f6e630d4058, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=f3317116-a956-4f8c-b3f9-1f6e630d4058,segment=NetworkSegment(cdaf1228-49b2-4d2a-83ed-bceae5b9bca8),segment_id=cdaf1228-49b2-4d2a-83ed-bceae5b9bca8)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:48:56.729339 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:56.778186 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=f3317116-a956-4f8c-b3f9-1f6e630d4058,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:48:56.935711 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['f3317116-a956-4f8c-b3f9-1f6e630d4058'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 04:48:57.356274 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5461cce7-19b5-4de1-ab09-4e593cedb725 req-85507a09-19a7-4b9c-8bc4-9e7a9b727df2 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:57.358064 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-5461cce7-19b5-4de1-ab09-4e593cedb725 req-85507a09-19a7-4b9c-8bc4-9e7a9b727df2 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=94544813-0543-4944-94b8-b667efa641a9 HTTP/1.1" status: 200 len: 944 time: 0.0559642 Nov 09 04:48:57.408421 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-5461cce7-19b5-4de1-ab09-4e593cedb725 req-25f06df2-dd00-4b98-a64c-a58137c50dc9 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438364 Nov 09 04:48:58.514596 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device f3317116-a956-4f8c-b3f9-1f6e630d4058 up at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:48:58.524322 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-020566a8-5bd2-4155-85ab-59853078f784 req-5dd9c49b-79f0-46c3-880a-87c2c977c57c tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:58.525802 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-020566a8-5bd2-4155-85ab-59853078f784 req-5dd9c49b-79f0-46c3-880a-87c2c977c57c tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=94544813-0543-4944-94b8-b667efa641a9 HTTP/1.1" status: 200 len: 944 time: 0.0487816 Nov 09 04:48:58.578939 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-020566a8-5bd2-4155-85ab-59853078f784 req-8d0fb298-68cc-4559-8ed6-3bf624ed1a11 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0472291 Nov 09 04:48:58.632001 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning for port f3317116-a956-4f8c-b3f9-1f6e630d4058 completed by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 09 04:48:58.636040 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning complete for port f3317116-a956-4f8c-b3f9-1f6e630d4058 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:48:58.636403 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:58.712278 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:58.734981 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '94544813-0543-4944-94b8-b667efa641a9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f3317116-a956-4f8c-b3f9-1f6e630d4058'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:48:58.737213 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d36be55c-ca10-45f7-aa2d-98d6d1192aba" -d '{"events": [{"server_uuid": "94544813-0543-4944-94b8-b667efa641a9", "name": "network-vif-plugged", "status": "completed", "tag": "f3317116-a956-4f8c-b3f9-1f6e630d4058"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:48:58.749717 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port f3317116-a956-4f8c-b3f9-1f6e630d4058, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=f3317116-a956-4f8c-b3f9-1f6e630d4058,segment=NetworkSegment(cdaf1228-49b2-4d2a-83ed-bceae5b9bca8),segment_id=cdaf1228-49b2-4d2a-83ed-bceae5b9bca8)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:48:58.773958 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:48:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9123c45a-2a76-46d7-bde6-6056f11899a2 x-openstack-request-id: req-9123c45a-2a76-46d7-bde6-6056f11899a2 {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:48:58.774276 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "94544813-0543-4944-94b8-b667efa641a9", "name": "network-vif-plugged", "status": "completed", "tag": "f3317116-a956-4f8c-b3f9-1f6e630d4058", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:48:58.774564 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-9123c45a-2a76-46d7-bde6-6056f11899a2 {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:48:58.774986 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '94544813-0543-4944-94b8-b667efa641a9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f3317116-a956-4f8c-b3f9-1f6e630d4058', 'code': 200} Nov 09 04:48:58.821034 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:48:58.866874 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=f3317116-a956-4f8c-b3f9-1f6e630d4058,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:48:59.121131 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ec45d9a-1979-412d-85ed-9c6e7b6085c6 req-0155c26e-29f2-4324-8873-01000a678f8b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:59.122639 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5ec45d9a-1979-412d-85ed-9c6e7b6085c6 req-0155c26e-29f2-4324-8873-01000a678f8b service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=94544813-0543-4944-94b8-b667efa641a9 HTTP/1.1" status: 200 len: 1098 time: 0.0825269 Nov 09 04:48:59.167559 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5ec45d9a-1979-412d-85ed-9c6e7b6085c6 req-6195bbee-71ae-4bdd-af5a-120489c617d4 service neutron] 10.222.0.26 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0372355 Nov 09 04:48:59.692473 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c5be624-2c19-46da-8844-cd2bec1d6df1 req-337ff776-e52d-4bac-bb5a-cab7865ade4a tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:48:59.694053 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6c5be624-2c19-46da-8844-cd2bec1d6df1 req-337ff776-e52d-4bac-bb5a-cab7865ade4a tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=94544813-0543-4944-94b8-b667efa641a9 HTTP/1.1" status: 200 len: 945 time: 0.0491545 Nov 09 04:48:59.747678 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6c5be624-2c19-46da-8844-cd2bec1d6df1 req-6a063e6d-01c0-49a9-9d80-7e25aec1f5d7 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0474091 Nov 09 04:49:00.860512 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a560d32-fcda-4e4e-b0d8-146df0468437 req-2ce275a4-6038-4479-aa89-a2aebd37c772 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:00.861958 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-8a560d32-fcda-4e4e-b0d8-146df0468437 req-2ce275a4-6038-4479-aa89-a2aebd37c772 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=94544813-0543-4944-94b8-b667efa641a9 HTTP/1.1" status: 200 len: 945 time: 0.0483203 Nov 09 04:49:00.908197 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-8a560d32-fcda-4e4e-b0d8-146df0468437 req-ae29eb9c-b106-4228-a8ff-321e7cc610fb tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402486 Nov 09 04:49:01.023754 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f199357-10a9-45b2-9925-65d7bc882b3f req-0720da1f-bab0-4a7e-8fc6-78d63e7e99c6 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:01.025303 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2f199357-10a9-45b2-9925-65d7bc882b3f req-0720da1f-bab0-4a7e-8fc6-78d63e7e99c6 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=94544813-0543-4944-94b8-b667efa641a9 HTTP/1.1" status: 200 len: 945 time: 0.0529675 Nov 09 04:49:01.071514 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2f199357-10a9-45b2-9925-65d7bc882b3f req-218668f5-372f-4d01-a2b5-3b9481d1b473 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404034 Nov 09 04:49:01.179719 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [req-eafe1457-6e55-4e60-a971-3129b713e04f req-942ffb91-e7d7-47a9-8137-723016ae879c service neutron] (102161) timed out ('10.222.0.26', 56229) {{(pid=102161) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:820}} Nov 09 04:49:01.377291 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef1329d4-414f-4a61-9f56-77e768086d27 req-d58044e3-4bfe-48dc-af5f-54d7461a14a7 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:01.378773 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ef1329d4-414f-4a61-9f56-77e768086d27 req-d58044e3-4bfe-48dc-af5f-54d7461a14a7 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=94544813-0543-4944-94b8-b667efa641a9 HTTP/1.1" status: 200 len: 945 time: 0.0478222 Nov 09 04:49:01.425453 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ef1329d4-414f-4a61-9f56-77e768086d27 req-795e5508-0d3d-4c6e-91c1-eb859321cdc9 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402887 Nov 09 04:49:01.541210 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bfb3575-aece-47f4-a02c-1cdca6d96c06 req-b62167b7-31f9-4ddb-8fb5-f1612e3aa377 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:01.542623 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-1bfb3575-aece-47f4-a02c-1cdca6d96c06 req-b62167b7-31f9-4ddb-8fb5-f1612e3aa377 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=94544813-0543-4944-94b8-b667efa641a9 HTTP/1.1" status: 200 len: 945 time: 0.0523410 Nov 09 04:49:01.588605 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-1bfb3575-aece-47f4-a02c-1cdca6d96c06 req-49bf8be3-24c9-4816-a95a-e3b7a383a419 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402870 Nov 09 04:49:01.999910 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65378028-1f90-45f0-840c-623788d19416 req-5a29172f-53c2-40f0-a2ba-4393711a5fb7 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:02.001348 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-65378028-1f90-45f0-840c-623788d19416 req-5a29172f-53c2-40f0-a2ba-4393711a5fb7 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=94544813-0543-4944-94b8-b667efa641a9 HTTP/1.1" status: 200 len: 945 time: 0.0487230 Nov 09 04:49:02.048868 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-65378028-1f90-45f0-840c-623788d19416 req-a12cdde3-e83f-49dd-bb54-2f848c96d9ee tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415277 Nov 09 04:49:02.135908 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c6dd0f04-d2b3-4937-8a8d-f9d79c5ded06 req-bcd6fe6e-6226-4794-84e4-dbfdd1106f84 service neutron] 10.222.0.24 "GET /v2.0/ports?device_id=94544813-0543-4944-94b8-b667efa641a9&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0379901 Nov 09 04:49:03.167853 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4c26e61-4390-4f41-9a27-0272c8416c10 req-bb5fe983-46ca-4927-ab7e-a5b1203a07b5 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:03.169421 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a4c26e61-4390-4f41-9a27-0272c8416c10 req-bb5fe983-46ca-4927-ab7e-a5b1203a07b5 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=94544813-0543-4944-94b8-b667efa641a9 HTTP/1.1" status: 200 len: 945 time: 0.0515947 Nov 09 04:49:03.217421 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a4c26e61-4390-4f41-9a27-0272c8416c10 req-db390685-868c-4bce-b8b4-97eee8af284d tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419705 Nov 09 04:49:03.986929 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6dd0f04-d2b3-4937-8a8d-f9d79c5ded06 req-09f2708f-a2e3-4545-a922-747e7410a12c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:03.988280 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c6dd0f04-d2b3-4937-8a8d-f9d79c5ded06 req-09f2708f-a2e3-4545-a922-747e7410a12c service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=429656387d9541bbb7aea9dd5d2534cb&device_id=94544813-0543-4944-94b8-b667efa641a9 HTTP/1.1" status: 200 len: 1098 time: 0.0400295 Nov 09 04:49:04.082625 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6dd0f04-d2b3-4937-8a8d-f9d79c5ded06 req-5f406e19-ac4b-41b2-8005-40c2cb77f9d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:04.084073 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c6dd0f04-d2b3-4937-8a8d-f9d79c5ded06 req-5f406e19-ac4b-41b2-8005-40c2cb77f9d5 service neutron] 10.222.0.26 "GET /v2.0/networks?id=286563ae-11dd-41c3-932c-9747a97a5b19 HTTP/1.1" status: 200 len: 915 time: 0.0875833 Nov 09 04:49:04.124745 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c6dd0f04-d2b3-4937-8a8d-f9d79c5ded06 req-06f38bc3-bc03-4afa-8da5-488440065871 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=f3317116-a956-4f8c-b3f9-1f6e630d4058 HTTP/1.1" status: 200 len: 217 time: 0.0333931 Nov 09 04:49:04.171903 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6dd0f04-d2b3-4937-8a8d-f9d79c5ded06 req-f6315495-2885-4de6-9a0e-8e7a9a1d106e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:04.173280 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c6dd0f04-d2b3-4937-8a8d-f9d79c5ded06 req-f6315495-2885-4de6-9a0e-8e7a9a1d106e service neutron] 10.222.0.26 "GET /v2.0/subnets?id=f39bfd16-f1ca-4a88-adf8-6562c8af0c74 HTTP/1.1" status: 200 len: 854 time: 0.0421724 Nov 09 04:49:04.207565 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c6dd0f04-d2b3-4937-8a8d-f9d79c5ded06 req-4b25a9e6-89ec-49ee-a13f-207a79045e4b service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=286563ae-11dd-41c3-932c-9747a97a5b19&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0273182 Nov 09 04:49:04.296992 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c6dd0f04-d2b3-4937-8a8d-f9d79c5ded06 req-b9d770cb-1398-4fa1-b19b-8f99a08f8c20 service neutron] 10.222.0.26 "GET /v2.0/networks/286563ae-11dd-41c3-932c-9747a97a5b19?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0816236 Nov 09 04:49:04.329838 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-021cf09a-8a47-4fb7-9680-91511b9a7bae req-d1b0a196-cfac-403a-a3d6-30209d0403dc tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:04.331323 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-021cf09a-8a47-4fb7-9680-91511b9a7bae req-d1b0a196-cfac-403a-a3d6-30209d0403dc tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=94544813-0543-4944-94b8-b667efa641a9 HTTP/1.1" status: 200 len: 945 time: 0.0475380 Nov 09 04:49:04.382113 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-021cf09a-8a47-4fb7-9680-91511b9a7bae req-c4eaabd5-4a41-4e47-8dcf-495660d5e899 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435166 Nov 09 04:49:04.392374 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c6dd0f04-d2b3-4937-8a8d-f9d79c5ded06 req-992f39d7-073a-46e8-bd44-792f18c91825 service neutron] 10.222.0.26 "GET /v2.0/networks/286563ae-11dd-41c3-932c-9747a97a5b19?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0887463 Nov 09 04:49:05.325383 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66943822-1bc0-469c-838d-0382ae7a5e52 req-1ecaab28-b80e-4a11-88ed-75b245a34b18 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:05.326857 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-66943822-1bc0-469c-838d-0382ae7a5e52 req-1ecaab28-b80e-4a11-88ed-75b245a34b18 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=429656387d9541bbb7aea9dd5d2534cb&device_id=94544813-0543-4944-94b8-b667efa641a9 HTTP/1.1" status: 200 len: 1098 time: 0.0392714 Nov 09 04:49:05.435578 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66943822-1bc0-469c-838d-0382ae7a5e52 req-1986ef92-9994-49f5-8e71-1bd3f71ecf59 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:05.437036 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-66943822-1bc0-469c-838d-0382ae7a5e52 req-1986ef92-9994-49f5-8e71-1bd3f71ecf59 service neutron] 10.222.0.26 "GET /v2.0/networks?id=286563ae-11dd-41c3-932c-9747a97a5b19 HTTP/1.1" status: 200 len: 915 time: 0.0873508 Nov 09 04:49:05.499516 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-66943822-1bc0-469c-838d-0382ae7a5e52 req-ed7f8d07-3406-45fe-95f1-3312bb396604 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=f3317116-a956-4f8c-b3f9-1f6e630d4058 HTTP/1.1" status: 200 len: 217 time: 0.0546589 Nov 09 04:49:05.551012 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac90a4e2-0eb2-45c6-afff-da4fdc213f9a req-980e8477-1de5-45b5-9665-1df630318f6f tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:05.552441 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ac90a4e2-0eb2-45c6-afff-da4fdc213f9a req-980e8477-1de5-45b5-9665-1df630318f6f tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=94544813-0543-4944-94b8-b667efa641a9 HTTP/1.1" status: 200 len: 945 time: 0.1017046 Nov 09 04:49:05.570607 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66943822-1bc0-469c-838d-0382ae7a5e52 req-d0f6d2da-3046-452b-80be-ff32569f1773 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:05.571943 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-66943822-1bc0-469c-838d-0382ae7a5e52 req-d0f6d2da-3046-452b-80be-ff32569f1773 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=f39bfd16-f1ca-4a88-adf8-6562c8af0c74 HTTP/1.1" status: 200 len: 854 time: 0.0653613 Nov 09 04:49:05.615374 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-66943822-1bc0-469c-838d-0382ae7a5e52 req-bbbcc56e-8353-4972-88ce-1e2bfc1c8aff service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=286563ae-11dd-41c3-932c-9747a97a5b19&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0306365 Nov 09 04:49:05.633162 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ac90a4e2-0eb2-45c6-afff-da4fdc213f9a req-36e0df3a-8f92-472c-80c6-e5c48ed73ab5 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0749018 Nov 09 04:49:05.707596 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-66943822-1bc0-469c-838d-0382ae7a5e52 req-81ab1da8-4fb4-437e-b7f8-ed70daca6845 service neutron] 10.222.0.26 "GET /v2.0/networks/286563ae-11dd-41c3-932c-9747a97a5b19?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0840302 Nov 09 04:49:05.799967 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-66943822-1bc0-469c-838d-0382ae7a5e52 req-1cfa8e5f-15c3-4982-8ddd-fe7b394a3c6a service neutron] 10.222.0.26 "GET /v2.0/networks/286563ae-11dd-41c3-932c-9747a97a5b19?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0842395 Nov 09 04:49:06.745982 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c14ebc39-984e-4931-ae53-8a75bdbc0290 req-8c6582fb-0a1c-4c3c-b025-9f777dcfa796 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:06.747465 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c14ebc39-984e-4931-ae53-8a75bdbc0290 req-8c6582fb-0a1c-4c3c-b025-9f777dcfa796 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=94544813-0543-4944-94b8-b667efa641a9 HTTP/1.1" status: 200 len: 945 time: 0.0484307 Nov 09 04:49:06.793628 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c14ebc39-984e-4931-ae53-8a75bdbc0290 req-f60d8cc0-a287-46f4-9bd6-66cd16e4b20c tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403383 Nov 09 04:49:07.905847 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f85f09c2-3ed0-416a-9b0d-19f69aad4309 req-17c95d38-5438-4b5b-bfb8-8fbd26189aca tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:07.907322 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f85f09c2-3ed0-416a-9b0d-19f69aad4309 req-17c95d38-5438-4b5b-bfb8-8fbd26189aca tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=94544813-0543-4944-94b8-b667efa641a9 HTTP/1.1" status: 200 len: 945 time: 0.0486703 Nov 09 04:49:07.953315 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f85f09c2-3ed0-416a-9b0d-19f69aad4309 req-872baa01-132f-4ed6-b48b-ee0ee8441e67 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396490 Nov 09 04:49:09.064736 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bf94e76-6b36-4f53-a42c-106624ee29da req-73030a51-8a17-4e5a-b8d5-398b731860ab tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:09.066483 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-4bf94e76-6b36-4f53-a42c-106624ee29da req-73030a51-8a17-4e5a-b8d5-398b731860ab tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=94544813-0543-4944-94b8-b667efa641a9 HTTP/1.1" status: 200 len: 945 time: 0.0479348 Nov 09 04:49:09.112536 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-4bf94e76-6b36-4f53-a42c-106624ee29da req-42034bf4-d0b3-491f-b481-6a3016e1c44e tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404961 Nov 09 04:49:10.229475 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18c50bf1-72fb-4a8a-9565-c85f23c1cb60 req-ef7fc7d8-b8f5-44ef-b642-7e98f7ea5ddb tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:10.230956 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-18c50bf1-72fb-4a8a-9565-c85f23c1cb60 req-ef7fc7d8-b8f5-44ef-b642-7e98f7ea5ddb tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=94544813-0543-4944-94b8-b667efa641a9 HTTP/1.1" status: 200 len: 945 time: 0.0528760 Nov 09 04:49:10.277546 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-18c50bf1-72fb-4a8a-9565-c85f23c1cb60 req-100adf73-6b0b-4869-9772-c2d7076f28f1 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408764 Nov 09 04:49:11.374825 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-57957783-ead8-4e3c-a159-772782ceef6c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:49:11.395143 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e79b7c51-a213-48ee-9d32-70deb0463e8e req-c835ca1f-c404-4bd1-bc66-bdb9308407c9 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:11.396608 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-e79b7c51-a213-48ee-9d32-70deb0463e8e req-c835ca1f-c404-4bd1-bc66-bdb9308407c9 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=94544813-0543-4944-94b8-b667efa641a9 HTTP/1.1" status: 200 len: 945 time: 0.0528519 Nov 09 04:49:11.442432 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-e79b7c51-a213-48ee-9d32-70deb0463e8e req-b9fac975-b5fa-436b-a567-2173e2d9f402 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398331 Nov 09 04:49:12.243551 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:49:12.554168 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca352fa7-a173-46a9-a453-c20f6c56bbb9 req-e28ea023-da8c-41a6-8483-b9325759a273 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:12.556299 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ca352fa7-a173-46a9-a453-c20f6c56bbb9 req-e28ea023-da8c-41a6-8483-b9325759a273 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=94544813-0543-4944-94b8-b667efa641a9 HTTP/1.1" status: 200 len: 945 time: 0.0477805 Nov 09 04:49:12.603169 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ca352fa7-a173-46a9-a453-c20f6c56bbb9 req-06501ded-122e-4ec9-9cb0-f9f767aaa619 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411181 Nov 09 04:49:13.689000 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e2d3de06-e633-4e0d-8e70-565691f491be None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:49:13.719929 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6263afc-e946-4eae-98f1-94a4004d906f req-57505df0-6fa4-4ffc-81da-ee52079acaac tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:13.721399 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b6263afc-e946-4eae-98f1-94a4004d906f req-57505df0-6fa4-4ffc-81da-ee52079acaac tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=94544813-0543-4944-94b8-b667efa641a9 HTTP/1.1" status: 200 len: 945 time: 0.0485792 Nov 09 04:49:13.770228 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b6263afc-e946-4eae-98f1-94a4004d906f req-2cc28e81-edae-4131-ae09-ab39bcdeaac5 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420585 Nov 09 04:49:14.885345 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f07faea-0860-411d-9255-78872e60c4eb req-49a74b9c-8777-41a6-b5b4-ed458417c2f7 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:14.886839 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5f07faea-0860-411d-9255-78872e60c4eb req-49a74b9c-8777-41a6-b5b4-ed458417c2f7 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=94544813-0543-4944-94b8-b667efa641a9 HTTP/1.1" status: 200 len: 945 time: 0.0510871 Nov 09 04:49:14.933589 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5f07faea-0860-411d-9255-78872e60c4eb req-c68ce039-4a4d-4e55-a1f8-becf26174643 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409758 Nov 09 04:49:15.140043 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:49:15.458800 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:49:16.048864 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a029e48-8971-4552-adbb-178a9e2983af req-6c6fe21c-54fb-47d4-bc12-b3bc9940dd6b tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:16.050338 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-3a029e48-8971-4552-adbb-178a9e2983af req-6c6fe21c-54fb-47d4-bc12-b3bc9940dd6b tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=94544813-0543-4944-94b8-b667efa641a9 HTTP/1.1" status: 200 len: 945 time: 0.0483427 Nov 09 04:49:16.099854 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-3a029e48-8971-4552-adbb-178a9e2983af req-99697dab-a380-4ea1-8ee7-09a65c8ae739 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426970 Nov 09 04:49:16.488457 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:49:16.968197 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:49:17.213239 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c31c30e1-c25f-4db9-8d68-775db914257a req-ce184025-b012-4559-ab9c-584c00e1b453 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:17.214722 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c31c30e1-c25f-4db9-8d68-775db914257a req-ce184025-b012-4559-ab9c-584c00e1b453 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=94544813-0543-4944-94b8-b667efa641a9 HTTP/1.1" status: 200 len: 945 time: 0.0484071 Nov 09 04:49:17.261321 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c31c30e1-c25f-4db9-8d68-775db914257a req-ab927c50-8dbe-4ade-a91b-070e88c199c9 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408912 Nov 09 04:49:18.373080 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-042fc930-117b-4944-87ae-90149bbb74c1 req-97af16d0-9a1b-4066-8b36-40bc98ad0129 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:18.374576 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-042fc930-117b-4944-87ae-90149bbb74c1 req-97af16d0-9a1b-4066-8b36-40bc98ad0129 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=94544813-0543-4944-94b8-b667efa641a9 HTTP/1.1" status: 200 len: 945 time: 0.0491595 Nov 09 04:49:18.420937 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-042fc930-117b-4944-87ae-90149bbb74c1 req-74956130-fff5-49ff-a86d-4480d090e8e9 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401559 Nov 09 04:49:19.534179 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df95b017-430a-4fa6-89b0-b6fe64fbcd8a req-3420ebd9-15e8-4015-ba4e-694eb87115a2 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:19.535639 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-df95b017-430a-4fa6-89b0-b6fe64fbcd8a req-3420ebd9-15e8-4015-ba4e-694eb87115a2 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=94544813-0543-4944-94b8-b667efa641a9 HTTP/1.1" status: 200 len: 945 time: 0.0473773 Nov 09 04:49:19.584246 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-df95b017-430a-4fa6-89b0-b6fe64fbcd8a req-021e2a0c-1a86-491e-be13-b477abf89250 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428972 Nov 09 04:49:20.701780 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1b0b6d9-aa95-49ae-83dd-52579eeb5efb req-a302374d-b9b8-42f7-8193-3d738f4b351b tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:20.703261 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c1b0b6d9-aa95-49ae-83dd-52579eeb5efb req-a302374d-b9b8-42f7-8193-3d738f4b351b tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=94544813-0543-4944-94b8-b667efa641a9 HTTP/1.1" status: 200 len: 945 time: 0.0474682 Nov 09 04:49:20.749619 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c1b0b6d9-aa95-49ae-83dd-52579eeb5efb req-0c149a0b-7707-4922-8b62-363c3e3d2a4b tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403175 Nov 09 04:49:21.862068 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92b63242-2b0d-4250-b0ca-3b1bb84df1e6 req-db29e8cf-866d-4194-a656-8017a2f34947 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:21.863604 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-92b63242-2b0d-4250-b0ca-3b1bb84df1e6 req-db29e8cf-866d-4194-a656-8017a2f34947 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=94544813-0543-4944-94b8-b667efa641a9 HTTP/1.1" status: 200 len: 945 time: 0.0486441 Nov 09 04:49:21.911408 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-92b63242-2b0d-4250-b0ca-3b1bb84df1e6 req-afe6721c-da89-47af-87b1-079306ac6b5a tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419488 Nov 09 04:49:23.026932 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6da1cb6c-1e3f-45a8-ad69-8c05948101ac req-d7d8c003-005d-4d21-95af-e618393f384f tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:23.028395 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-6da1cb6c-1e3f-45a8-ad69-8c05948101ac req-d7d8c003-005d-4d21-95af-e618393f384f tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=94544813-0543-4944-94b8-b667efa641a9 HTTP/1.1" status: 200 len: 945 time: 0.0517194 Nov 09 04:49:23.076473 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-6da1cb6c-1e3f-45a8-ad69-8c05948101ac req-5c243caa-8969-40ef-b98b-086b5c8c390c tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420570 Nov 09 04:49:24.186518 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-347c2ea9-51c0-406d-a839-b2dcb950a8ba req-0cfff306-7d11-4ff7-a5fd-66d09147cd3a tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:24.187945 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-347c2ea9-51c0-406d-a839-b2dcb950a8ba req-0cfff306-7d11-4ff7-a5fd-66d09147cd3a tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=94544813-0543-4944-94b8-b667efa641a9 HTTP/1.1" status: 200 len: 945 time: 0.0465782 Nov 09 04:49:24.233987 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-347c2ea9-51c0-406d-a839-b2dcb950a8ba req-c2d57a35-5782-4456-8bc3-340f71d2dcf2 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401123 Nov 09 04:49:25.345532 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42423677-752a-48b1-978e-b696d6e9dbf1 req-bd5dc598-cd4f-408e-bf5a-d16eee6b83ab tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:25.347003 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-42423677-752a-48b1-978e-b696d6e9dbf1 req-bd5dc598-cd4f-408e-bf5a-d16eee6b83ab tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=94544813-0543-4944-94b8-b667efa641a9 HTTP/1.1" status: 200 len: 945 time: 0.0478003 Nov 09 04:49:25.393016 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-42423677-752a-48b1-978e-b696d6e9dbf1 req-1668899e-5807-456e-a207-c54b0cbed968 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401313 Nov 09 04:49:26.509425 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe4b6869-01fe-4c56-92c2-37b0f6162c50 req-5e1a7840-06b3-4d59-8365-25696d1ffd1b tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:26.510901 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fe4b6869-01fe-4c56-92c2-37b0f6162c50 req-5e1a7840-06b3-4d59-8365-25696d1ffd1b tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=94544813-0543-4944-94b8-b667efa641a9 HTTP/1.1" status: 200 len: 945 time: 0.0520072 Nov 09 04:49:26.556752 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fe4b6869-01fe-4c56-92c2-37b0f6162c50 req-6e488790-f7d9-4792-8cb0-8d910b281c72 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400302 Nov 09 04:49:27.724225 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be2e68cf-c27f-4db3-888d-caa380d7222f req-e5e9c8f8-6328-447a-9c33-876de568e625 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:27.725694 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-be2e68cf-c27f-4db3-888d-caa380d7222f req-e5e9c8f8-6328-447a-9c33-876de568e625 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=94544813-0543-4944-94b8-b667efa641a9 HTTP/1.1" status: 200 len: 945 time: 0.1038609 Nov 09 04:49:27.770525 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-be2e68cf-c27f-4db3-888d-caa380d7222f req-6bfe5acd-2df1-4bc8-b4bf-61820892bc81 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390568 Nov 09 04:49:28.934236 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-891b63d3-8fe9-4b6b-a483-25c7e0451b11 req-20ae2aeb-ae26-4cb9-80c2-5b778ef4388a tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:28.935728 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-891b63d3-8fe9-4b6b-a483-25c7e0451b11 req-20ae2aeb-ae26-4cb9-80c2-5b778ef4388a tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=94544813-0543-4944-94b8-b667efa641a9 HTTP/1.1" status: 200 len: 945 time: 0.1001887 Nov 09 04:49:28.984466 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-891b63d3-8fe9-4b6b-a483-25c7e0451b11 req-0c1adf6c-1077-451e-892f-3daa61247769 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429573 Nov 09 04:49:30.098205 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c48bec1-0826-4657-8ce1-ba375e14dd21 req-04bd1aa4-e573-494e-ac4b-31c8b2c75e7b tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:30.099671 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-1c48bec1-0826-4657-8ce1-ba375e14dd21 req-04bd1aa4-e573-494e-ac4b-31c8b2c75e7b tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=94544813-0543-4944-94b8-b667efa641a9 HTTP/1.1" status: 200 len: 945 time: 0.0478566 Nov 09 04:49:30.145455 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-1c48bec1-0826-4657-8ce1-ba375e14dd21 req-230b5140-f15d-4105-b728-44e31b2ab27d tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394821 Nov 09 04:49:31.257103 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5261ec11-b7a3-4dcb-b3f1-e12208065ab6 req-cdffc219-5afd-4b47-b593-cb0986daa183 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:31.258560 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5261ec11-b7a3-4dcb-b3f1-e12208065ab6 req-cdffc219-5afd-4b47-b593-cb0986daa183 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=94544813-0543-4944-94b8-b667efa641a9 HTTP/1.1" status: 200 len: 945 time: 0.0470443 Nov 09 04:49:31.333063 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5261ec11-b7a3-4dcb-b3f1-e12208065ab6 req-97451fca-d329-4bee-9e13-b2b26d1493ea tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0687127 Nov 09 04:49:31.360373 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c6dd0f04-d2b3-4937-8a8d-f9d79c5ded06 req-24ee78f9-777a-4881-a1a1-21964067c73d service neutron] 10.222.0.26 "GET /v2.0/ports/f3317116-a956-4f8c-b3f9-1f6e630d4058/bindings/hv-neutron-8168 HTTP/1.1" status: 200 len: 384 time: 0.0681570 Nov 09 04:49:31.745208 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6dd0f04-d2b3-4937-8a8d-f9d79c5ded06 req-735a4cc3-a3da-44da-9811-b53fe2c8b458 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:31.746801 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c6dd0f04-d2b3-4937-8a8d-f9d79c5ded06 req-735a4cc3-a3da-44da-9811-b53fe2c8b458 service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=94544813-0543-4944-94b8-b667efa641a9&tenant_id=429656387d9541bbb7aea9dd5d2534cb HTTP/1.1" status: 200 len: 1098 time: 0.0409544 Nov 09 04:49:31.809450 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6dd0f04-d2b3-4937-8a8d-f9d79c5ded06 req-fec73d72-0cd9-4190-9a0b-443e73faa5c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:31.810935 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c6dd0f04-d2b3-4937-8a8d-f9d79c5ded06 req-fec73d72-0cd9-4190-9a0b-443e73faa5c8 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=429656387d9541bbb7aea9dd5d2534cb&device_id=94544813-0543-4944-94b8-b667efa641a9 HTTP/1.1" status: 200 len: 1098 time: 0.0412159 Nov 09 04:49:31.904372 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6dd0f04-d2b3-4937-8a8d-f9d79c5ded06 req-ca3493f0-7778-4ec5-b33e-4dc60d5d8397 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:31.905813 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c6dd0f04-d2b3-4937-8a8d-f9d79c5ded06 req-ca3493f0-7778-4ec5-b33e-4dc60d5d8397 service neutron] 10.222.0.26 "GET /v2.0/networks?id=286563ae-11dd-41c3-932c-9747a97a5b19 HTTP/1.1" status: 200 len: 915 time: 0.0872719 Nov 09 04:49:31.947198 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c6dd0f04-d2b3-4937-8a8d-f9d79c5ded06 req-ca5e57b4-7974-49da-b83b-ce16ffbadb9b service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=f3317116-a956-4f8c-b3f9-1f6e630d4058 HTTP/1.1" status: 200 len: 217 time: 0.0341845 Nov 09 04:49:31.998285 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6dd0f04-d2b3-4937-8a8d-f9d79c5ded06 req-575f6271-84ed-4d9f-8171-16a8ff9a6dd4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:31.999610 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c6dd0f04-d2b3-4937-8a8d-f9d79c5ded06 req-575f6271-84ed-4d9f-8171-16a8ff9a6dd4 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=f39bfd16-f1ca-4a88-adf8-6562c8af0c74 HTTP/1.1" status: 200 len: 854 time: 0.0449855 Nov 09 04:49:32.029899 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c6dd0f04-d2b3-4937-8a8d-f9d79c5ded06 req-6053f473-710f-496f-8306-78a3fffa587d service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=286563ae-11dd-41c3-932c-9747a97a5b19&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0222938 Nov 09 04:49:32.116905 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c6dd0f04-d2b3-4937-8a8d-f9d79c5ded06 req-1f94e233-ef9a-4073-96b0-2fe13cb40539 service neutron] 10.222.0.26 "GET /v2.0/networks/286563ae-11dd-41c3-932c-9747a97a5b19?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0796788 Nov 09 04:49:32.206858 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c6dd0f04-d2b3-4937-8a8d-f9d79c5ded06 req-e6d30539-6bb8-4f44-b5a9-b8f256f45dbc service neutron] 10.222.0.26 "GET /v2.0/networks/286563ae-11dd-41c3-932c-9747a97a5b19?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0828004 Nov 09 04:49:32.447030 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d415402-58d1-4a0e-911e-07755bd4ca75 req-7b19bc21-1b0c-479c-bc43-03305413a9ae tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:32.448518 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-6d415402-58d1-4a0e-911e-07755bd4ca75 req-7b19bc21-1b0c-479c-bc43-03305413a9ae tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=94544813-0543-4944-94b8-b667efa641a9 HTTP/1.1" status: 200 len: 945 time: 0.0482647 Nov 09 04:49:32.500740 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-6d415402-58d1-4a0e-911e-07755bd4ca75 req-168c6c79-1779-4660-818e-0d3672b319bc tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0463212 Nov 09 04:49:33.624098 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a85061b-f0ec-4d22-829f-f85f61d28764 req-d27569af-e8e7-46c2-8b2e-74442baa6ca3 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:33.625837 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6a85061b-f0ec-4d22-829f-f85f61d28764 req-d27569af-e8e7-46c2-8b2e-74442baa6ca3 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=94544813-0543-4944-94b8-b667efa641a9 HTTP/1.1" status: 200 len: 945 time: 0.0530386 Nov 09 04:49:33.673299 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6a85061b-f0ec-4d22-829f-f85f61d28764 req-8ea76095-0ec6-4951-9ae5-0c7996af4d65 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410786 Nov 09 04:49:34.703795 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device f3317116-a956-4f8c-b3f9-1f6e630d4058 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:49:34.782789 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:49:34.791572 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-981bca4f-3866-41d1-8473-d6fb53085393 req-903826e3-1e39-4e0c-8258-3aaee39f2d4d tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:34.793045 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-981bca4f-3866-41d1-8473-d6fb53085393 req-903826e3-1e39-4e0c-8258-3aaee39f2d4d tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=94544813-0543-4944-94b8-b667efa641a9 HTTP/1.1" status: 200 len: 945 time: 0.0479066 Nov 09 04:49:34.804798 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '94544813-0543-4944-94b8-b667efa641a9', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'f3317116-a956-4f8c-b3f9-1f6e630d4058'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:49:34.807007 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b539787d-82fb-43e6-9430-0a494270b2c4" -d '{"events": [{"server_uuid": "94544813-0543-4944-94b8-b667efa641a9", "name": "network-vif-unplugged", "status": "completed", "tag": "f3317116-a956-4f8c-b3f9-1f6e630d4058"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:49:34.819923 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port f3317116-a956-4f8c-b3f9-1f6e630d4058, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=f3317116-a956-4f8c-b3f9-1f6e630d4058,segment=NetworkSegment(cdaf1228-49b2-4d2a-83ed-bceae5b9bca8),segment_id=cdaf1228-49b2-4d2a-83ed-bceae5b9bca8)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:49:34.841420 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-981bca4f-3866-41d1-8473-d6fb53085393 req-d9e2775d-71ae-40e3-a5cf-ff7342067cbf tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422919 Nov 09 04:49:34.857424 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 09 Nov 2021 04:49:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8386e622-ce94-4295-9e60-a695a95f9e25 x-openstack-request-id: req-8386e622-ce94-4295-9e60-a695a95f9e25 {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:49:34.857709 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "94544813-0543-4944-94b8-b667efa641a9", "name": "network-vif-unplugged", "status": "completed", "tag": "f3317116-a956-4f8c-b3f9-1f6e630d4058", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:49:34.857958 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-8386e622-ce94-4295-9e60-a695a95f9e25 {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:49:34.858409 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '94544813-0543-4944-94b8-b667efa641a9', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'f3317116-a956-4f8c-b3f9-1f6e630d4058', 'code': 200} Nov 09 04:49:34.887732 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:49:34.935521 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=f3317116-a956-4f8c-b3f9-1f6e630d4058,revision_number=6']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:49:35.196692 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc0206b6-4163-495b-a050-8d2fbc2a3d61 req-2c8a7a7c-fb43-4d5a-ba2d-6126ea91ea9c tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:35.198157 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-bc0206b6-4163-495b-a050-8d2fbc2a3d61 req-2c8a7a7c-fb43-4d5a-ba2d-6126ea91ea9c tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=94544813-0543-4944-94b8-b667efa641a9 HTTP/1.1" status: 200 len: 943 time: 0.0531771 Nov 09 04:49:35.270677 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-bc0206b6-4163-495b-a050-8d2fbc2a3d61 req-ead73ecd-739f-4368-a150-66cd4089774c tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0664997 Nov 09 04:49:35.290321 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3fda31b-cfe6-4ca5-979e-1ff9e40d0794 req-e397a244-f3eb-4206-9c8e-61dae268470c tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:35.290321 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c3fda31b-cfe6-4ca5-979e-1ff9e40d0794 req-e397a244-f3eb-4206-9c8e-61dae268470c tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.26 "GET /v2.0/ports?device_id=94544813-0543-4944-94b8-b667efa641a9&tenant_id=429656387d9541bbb7aea9dd5d2534cb&binding%3Ahost_id=hv-neutron-8168 HTTP/1.1" status: 200 len: 943 time: 0.0644324 Nov 09 04:49:35.370115 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3fda31b-cfe6-4ca5-979e-1ff9e40d0794 req-00833d9b-bc9f-42b5-9ccb-46547a6e889a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:35.371500 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c3fda31b-cfe6-4ca5-979e-1ff9e40d0794 req-00833d9b-bc9f-42b5-9ccb-46547a6e889a service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=429656387d9541bbb7aea9dd5d2534cb&device_id=94544813-0543-4944-94b8-b667efa641a9 HTTP/1.1" status: 200 len: 1096 time: 0.0392182 Nov 09 04:49:35.462604 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3fda31b-cfe6-4ca5-979e-1ff9e40d0794 req-2a0cf275-d50a-4c94-b0c4-ca4b0c70fe22 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:35.464049 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c3fda31b-cfe6-4ca5-979e-1ff9e40d0794 req-2a0cf275-d50a-4c94-b0c4-ca4b0c70fe22 service neutron] 10.222.0.26 "GET /v2.0/networks?id=286563ae-11dd-41c3-932c-9747a97a5b19 HTTP/1.1" status: 200 len: 915 time: 0.0855880 Nov 09 04:49:35.504165 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c3fda31b-cfe6-4ca5-979e-1ff9e40d0794 req-fa1728ed-0dfb-4ef1-826b-97443567a6fe service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=f3317116-a956-4f8c-b3f9-1f6e630d4058 HTTP/1.1" status: 200 len: 217 time: 0.0329835 Nov 09 04:49:35.550262 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3fda31b-cfe6-4ca5-979e-1ff9e40d0794 req-0123669a-ded2-49f9-b2e4-ae3669e9d6c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:35.551695 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c3fda31b-cfe6-4ca5-979e-1ff9e40d0794 req-0123669a-ded2-49f9-b2e4-ae3669e9d6c5 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=f39bfd16-f1ca-4a88-adf8-6562c8af0c74 HTTP/1.1" status: 200 len: 854 time: 0.0412295 Nov 09 04:49:35.585785 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c3fda31b-cfe6-4ca5-979e-1ff9e40d0794 req-f2155c6a-fec5-4ed2-809b-0298d60f8329 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=286563ae-11dd-41c3-932c-9747a97a5b19&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0258644 Nov 09 04:49:35.672603 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c3fda31b-cfe6-4ca5-979e-1ff9e40d0794 req-98a74c9f-a158-42b9-83db-0c0b765ae74b service neutron] 10.222.0.26 "GET /v2.0/networks/286563ae-11dd-41c3-932c-9747a97a5b19?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0791705 Nov 09 04:49:35.762952 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c3fda31b-cfe6-4ca5-979e-1ff9e40d0794 req-cc1586dd-5492-47fe-9af7-0e31d45436bf service neutron] 10.222.0.26 "GET /v2.0/networks/286563ae-11dd-41c3-932c-9747a97a5b19?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0835006 Nov 09 04:49:36.385428 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-565c09d1-72b8-4079-931c-b41c692967e1 req-29246ebf-7465-49f3-a90c-549b64eeb2a0 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:36.386955 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-565c09d1-72b8-4079-931c-b41c692967e1 req-29246ebf-7465-49f3-a90c-549b64eeb2a0 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=94544813-0543-4944-94b8-b667efa641a9 HTTP/1.1" status: 200 len: 943 time: 0.0479002 Nov 09 04:49:36.432929 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-565c09d1-72b8-4079-931c-b41c692967e1 req-13b59ecf-7255-423a-a9f3-b69eb5a8a9c7 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398655 Nov 09 04:49:37.545993 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5437eed-cb7a-4b72-a4df-e1bf43e368de req-8efbdac2-9fec-472a-a724-10563e93486a tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:37.547487 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e5437eed-cb7a-4b72-a4df-e1bf43e368de req-8efbdac2-9fec-472a-a724-10563e93486a tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=94544813-0543-4944-94b8-b667efa641a9 HTTP/1.1" status: 200 len: 943 time: 0.0483563 Nov 09 04:49:37.594179 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e5437eed-cb7a-4b72-a4df-e1bf43e368de req-f5475156-a73a-47e5-bd8d-0c9179efa646 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407588 Nov 09 04:49:37.965346 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2645be72-cdf4-4a8b-81d5-c7946cccf626 req-4fd70fad-b2a9-4805-b4c6-39ec9415ab14 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:37.966752 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-2645be72-cdf4-4a8b-81d5-c7946cccf626 req-4fd70fad-b2a9-4805-b4c6-39ec9415ab14 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=94544813-0543-4944-94b8-b667efa641a9 HTTP/1.1" status: 200 len: 943 time: 0.3083248 Nov 09 04:49:38.012234 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-2645be72-cdf4-4a8b-81d5-c7946cccf626 req-57a15a91-932c-479e-8fec-3745ef0c96ca tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396302 Nov 09 04:49:38.121047 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0713960e-68c3-45e0-888d-639d4757eb5a req-124e0047-7904-4e14-8806-071e8551e2ac tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:38.122506 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-0713960e-68c3-45e0-888d-639d4757eb5a req-124e0047-7904-4e14-8806-071e8551e2ac tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=94544813-0543-4944-94b8-b667efa641a9 HTTP/1.1" status: 200 len: 943 time: 0.0470586 Nov 09 04:49:38.171793 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-0713960e-68c3-45e0-888d-639d4757eb5a req-7d79f0c7-32ee-487d-8d7e-1cdf56fed442 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435662 Nov 09 04:49:38.648161 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2562c5d3-78de-45dc-9a07-bf485ecce04c req-ced167d7-81ab-4f7c-a39e-593d7e9f9a3e tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:38.649633 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2562c5d3-78de-45dc-9a07-bf485ecce04c req-ced167d7-81ab-4f7c-a39e-593d7e9f9a3e tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/networks?id=286563ae-11dd-41c3-932c-9747a97a5b19 HTTP/1.1" status: 200 len: 814 time: 0.0973625 Nov 09 04:49:38.664403 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2562c5d3-78de-45dc-9a07-bf485ecce04c req-cc05dfb7-cd35-45af-83b0-9bbcd5aa6d1f tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/quotas/429656387d9541bbb7aea9dd5d2534cb HTTP/1.1" status: 200 len: 375 time: 0.0091293 Nov 09 04:49:38.711351 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2562c5d3-78de-45dc-9a07-bf485ecce04c req-0bde5dcf-270e-48b5-a94d-0fe8bd3a9c0e tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?tenant_id=429656387d9541bbb7aea9dd5d2534cb&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0419827 Nov 09 04:49:38.804061 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2562c5d3-78de-45dc-9a07-bf485ecce04c req-b1a3d4a6-3d43-45b8-af28-ac46f9a53f90 service neutron] 10.222.0.24 "GET /v2.0/networks/286563ae-11dd-41c3-932c-9747a97a5b19?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0859473 Nov 09 04:49:38.889741 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2562c5d3-78de-45dc-9a07-bf485ecce04c req-352eba0e-c1a9-42bf-8a17-12697ac584f9 service neutron] 10.222.0.24 "GET /v2.0/networks/286563ae-11dd-41c3-932c-9747a97a5b19?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0796990 Nov 09 04:49:39.112351 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ede24bf4-ec80-46cc-9b7c-620be42da43c req-218afb59-f4d0-49c1-8456-7d067c55683b tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92 HTTP/1.1" status: 200 len: 210 time: 0.0257921 Nov 09 04:49:40.214259 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-508305d6-7c89-42b1-bcea-efe80cfa8120 req-66fb4e33-b84d-42fb-b4f4-d9bbae904440 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92 HTTP/1.1" status: 200 len: 210 time: 0.0378788 Nov 09 04:49:40.249834 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19b0a6b6-77ba-437d-b02b-b201b2106a2c req-3b1f670c-62a5-475b-96cf-53abcc1be196 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:40.251303 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-19b0a6b6-77ba-437d-b02b-b201b2106a2c req-3b1f670c-62a5-475b-96cf-53abcc1be196 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.26 "GET /v2.0/ports?device_id=94544813-0543-4944-94b8-b667efa641a9 HTTP/1.1" status: 200 len: 943 time: 0.0657477 Nov 09 04:49:40.336984 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-19b0a6b6-77ba-437d-b02b-b201b2106a2c req-fe808a13-7212-4e74-9bd3-2e3c3b305cc8 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Deleting port f3317116-a956-4f8c-b3f9-1f6e630d4058 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:49:40.337291 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-19b0a6b6-77ba-437d-b02b-b201b2106a2c req-fe808a13-7212-4e74-9bd3-2e3c3b305cc8 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:49:40.426057 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-19b0a6b6-77ba-437d-b02b-b201b2106a2c req-fe808a13-7212-4e74-9bd3-2e3c3b305cc8 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] For port f3317116-a956-4f8c-b3f9-1f6e630d4058, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=f3317116-a956-4f8c-b3f9-1f6e630d4058,segment=NetworkSegment(cdaf1228-49b2-4d2a-83ed-bceae5b9bca8),segment_id=cdaf1228-49b2-4d2a-83ed-bceae5b9bca8)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:49:40.426438 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-19b0a6b6-77ba-437d-b02b-b201b2106a2c req-fe808a13-7212-4e74-9bd3-2e3c3b305cc8 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:49:40.438815 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-19b0a6b6-77ba-437d-b02b-b201b2106a2c req-fe808a13-7212-4e74-9bd3-2e3c3b305cc8 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Calling delete_port for f3317116-a956-4f8c-b3f9-1f6e630d4058 owned by compute:nova {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:49:40.642138 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-19b0a6b6-77ba-437d-b02b-b201b2106a2c req-fe808a13-7212-4e74-9bd3-2e3c3b305cc8 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:49:40.669204 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe808a13-7212-4e74-9bd3-2e3c3b305cc8 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Pushing event deleted for resources: {'Port': ['ID=f3317116-a956-4f8c-b3f9-1f6e630d4058,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:49:40.708240 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-19b0a6b6-77ba-437d-b02b-b201b2106a2c req-fe808a13-7212-4e74-9bd3-2e3c3b305cc8 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] No DVR routers for this DVR port f3317116-a956-4f8c-b3f9-1f6e630d4058 on host hv-neutron-8168 {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:49:40.711178 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-19b0a6b6-77ba-437d-b02b-b201b2106a2c req-fe808a13-7212-4e74-9bd3-2e3c3b305cc8 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:49:40.714531 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-19b0a6b6-77ba-437d-b02b-b201b2106a2c req-fe808a13-7212-4e74-9bd3-2e3c3b305cc8 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.26 "DELETE /v2.0/ports/f3317116-a956-4f8c-b3f9-1f6e630d4058 HTTP/1.1" status: 204 len: 173 time: 0.4572945 Nov 09 04:49:40.714960 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '94544813-0543-4944-94b8-b667efa641a9', 'name': 'network-vif-deleted', 'tag': 'f3317116-a956-4f8c-b3f9-1f6e630d4058'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:49:40.717301 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d6884939-7e97-4e30-964a-d987729f7fef" -d '{"events": [{"server_uuid": "94544813-0543-4944-94b8-b667efa641a9", "name": "network-vif-deleted", "tag": "f3317116-a956-4f8c-b3f9-1f6e630d4058"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:49:41.149986 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:49:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c18f7227-c9b0-4420-9449-cea70144d42d x-openstack-request-id: req-c18f7227-c9b0-4420-9449-cea70144d42d {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:49:41.150276 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "94544813-0543-4944-94b8-b667efa641a9", "name": "network-vif-deleted", "tag": "f3317116-a956-4f8c-b3f9-1f6e630d4058", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:49:41.150540 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-c18f7227-c9b0-4420-9449-cea70144d42d {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:49:41.150922 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '94544813-0543-4944-94b8-b667efa641a9', 'name': 'network-vif-deleted', 'tag': 'f3317116-a956-4f8c-b3f9-1f6e630d4058', 'status': 'completed', 'code': 200} Nov 09 04:49:41.192736 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2562c5d3-78de-45dc-9a07-bf485ecce04c req-9ca44cd4-f4bf-4000-b9a0-b7087456f7f0 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:41.194813 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2562c5d3-78de-45dc-9a07-bf485ecce04c req-9ca44cd4-f4bf-4000-b9a0-b7087456f7f0 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.26 "GET /v2.0/networks?id=286563ae-11dd-41c3-932c-9747a97a5b19 HTTP/1.1" status: 200 len: 814 time: 0.4525375 Nov 09 04:49:41.210230 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-2562c5d3-78de-45dc-9a07-bf485ecce04c req-b0440dc6-a056-4da8-ae7e-867f957aafa1 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Request body: {'port': {'device_id': 'fde13afa-a0c8-415f-a738-5f2e93f56d92', 'network_id': '286563ae-11dd-41c3-932c-9747a97a5b19', 'admin_state_up': True, 'tenant_id': '429656387d9541bbb7aea9dd5d2534cb'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:49:41.324425 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-34ef5837-a694-4436-a6b1-af6900293ee8 req-c8e9a9a2-4460-4387-a5a6-2a784261424f tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92 HTTP/1.1" status: 200 len: 210 time: 0.0381651 Nov 09 04:49:41.342336 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-fa750aa5-00be-44d6-b72e-df49e3da5d76 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:49:41.413179 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-2562c5d3-78de-45dc-9a07-bf485ecce04c req-b0440dc6-a056-4da8-ae7e-867f957aafa1 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Made reservation on behalf of 429656387d9541bbb7aea9dd5d2534cb for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:49:41.416808 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-2562c5d3-78de-45dc-9a07-bf485ecce04c req-b0440dc6-a056-4da8-ae7e-867f957aafa1 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:49:41.536129 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [req-2562c5d3-78de-45dc-9a07-bf485ecce04c req-b0440dc6-a056-4da8-ae7e-867f957aafa1 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Allocated IP 172.20.0.9 (286563ae-11dd-41c3-932c-9747a97a5b19/f39bfd16-f1ca-4a88-adf8-6562c8af0c74/dfb8b610-306d-4aae-a313-bcad721134b4) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:49:41.686242 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-2562c5d3-78de-45dc-9a07-bf485ecce04c req-b0440dc6-a056-4da8-ae7e-867f957aafa1 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:49:41.791140 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-2562c5d3-78de-45dc-9a07-bf485ecce04c req-b0440dc6-a056-4da8-ae7e-867f957aafa1 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:49:41.832809 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-2562c5d3-78de-45dc-9a07-bf485ecce04c req-b0440dc6-a056-4da8-ae7e-867f957aafa1 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Network 286563ae-11dd-41c3-932c-9747a97a5b19 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:49:41.837713 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [req-2562c5d3-78de-45dc-9a07-bf485ecce04c req-b0440dc6-a056-4da8-ae7e-867f957aafa1 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:49:41.843055 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-2562c5d3-78de-45dc-9a07-bf485ecce04c req-b0440dc6-a056-4da8-ae7e-867f957aafa1 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:49:41.847677 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0440dc6-a056-4da8-ae7e-867f957aafa1 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Pushing event updated for resources: {'Port': ['ID=dfb8b610-306d-4aae-a313-bcad721134b4,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:49:41.897213 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2562c5d3-78de-45dc-9a07-bf485ecce04c req-b0440dc6-a056-4da8-ae7e-867f957aafa1 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:41.897853 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-2562c5d3-78de-45dc-9a07-bf485ecce04c req-b0440dc6-a056-4da8-ae7e-867f957aafa1 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:49:41.993514 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2562c5d3-78de-45dc-9a07-bf485ecce04c req-b0440dc6-a056-4da8-ae7e-867f957aafa1 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.26 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7867115 Nov 09 04:49:42.006798 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-2562c5d3-78de-45dc-9a07-bf485ecce04c req-b66b7b68-81df-444f-8537-20bb6a60f96e service neutron] Request body: {'port': {'device_id': 'fde13afa-a0c8-415f-a738-5f2e93f56d92', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:49:42.057860 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-2562c5d3-78de-45dc-9a07-bf485ecce04c req-b66b7b68-81df-444f-8537-20bb6a60f96e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:49:42.241996 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:49:42.307375 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [req-2562c5d3-78de-45dc-9a07-bf485ecce04c req-b66b7b68-81df-444f-8537-20bb6a60f96e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id dfb8b610-306d-4aae-a313-bcad721134b4 {{(pid=102162) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:49:42.314523 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-2562c5d3-78de-45dc-9a07-bf485ecce04c req-b66b7b68-81df-444f-8537-20bb6a60f96e service neutron] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:49:42.326061 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.provisioning_blocks [req-2562c5d3-78de-45dc-9a07-bf485ecce04c req-b66b7b68-81df-444f-8537-20bb6a60f96e service neutron] Transition to ACTIVE for port object dfb8b610-306d-4aae-a313-bcad721134b4 will not be triggered until provisioned by entity L2. {{(pid=102162) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 09 04:49:42.401763 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-2562c5d3-78de-45dc-9a07-bf485ecce04c req-b66b7b68-81df-444f-8537-20bb6a60f96e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:49:42.443035 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3483940-89b7-426f-90df-9fe2d6e35a89 req-34218557-af48-4733-a28d-7d0ca71bc451 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:42.444577 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c3483940-89b7-426f-90df-9fe2d6e35a89 req-34218557-af48-4733-a28d-7d0ca71bc451 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92 HTTP/1.1" status: 200 len: 943 time: 0.0495915 Nov 09 04:49:42.454452 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b66b7b68-81df-444f-8537-20bb6a60f96e service neutron] Pushing event updated for resources: {'Port': ['ID=dfb8b610-306d-4aae-a313-bcad721134b4,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:49:42.492309 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c3483940-89b7-426f-90df-9fe2d6e35a89 req-3656ee6f-bc00-48b0-b9a0-67436f0f5c55 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416420 Nov 09 04:49:42.521834 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-2562c5d3-78de-45dc-9a07-bf485ecce04c req-b66b7b68-81df-444f-8537-20bb6a60f96e service neutron] Attempting to bind port dfb8b610-306d-4aae-a313-bcad721134b4 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:49:42.522164 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-2562c5d3-78de-45dc-9a07-bf485ecce04c req-b66b7b68-81df-444f-8537-20bb6a60f96e service neutron] Attempting to bind port dfb8b610-306d-4aae-a313-bcad721134b4 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'cdaf1228-49b2-4d2a-83ed-bceae5b9bca8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 332, 'network_id': '286563ae-11dd-41c3-932c-9747a97a5b19'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:49:42.522526 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2562c5d3-78de-45dc-9a07-bf485ecce04c req-b66b7b68-81df-444f-8537-20bb6a60f96e service neutron] Attempting to bind port dfb8b610-306d-4aae-a313-bcad721134b4 on network 286563ae-11dd-41c3-932c-9747a97a5b19 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:49:42.526717 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2562c5d3-78de-45dc-9a07-bf485ecce04c req-b66b7b68-81df-444f-8537-20bb6a60f96e service neutron] Port dfb8b610-306d-4aae-a313-bcad721134b4 on network 286563ae-11dd-41c3-932c-9747a97a5b19 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:49:42.527037 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2562c5d3-78de-45dc-9a07-bf485ecce04c req-b66b7b68-81df-444f-8537-20bb6a60f96e service neutron] Attempting to bind port dfb8b610-306d-4aae-a313-bcad721134b4 on network 286563ae-11dd-41c3-932c-9747a97a5b19 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:49:42.531683 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2562c5d3-78de-45dc-9a07-bf485ecce04c req-b66b7b68-81df-444f-8537-20bb6a60f96e service neutron] Checking agent: {'id': '7d36b884-4ad2-4878-9464-bf647030b544', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'started_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 49, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:49:42.532012 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2562c5d3-78de-45dc-9a07-bf485ecce04c req-b66b7b68-81df-444f-8537-20bb6a60f96e service neutron] Checking segment: {'id': 'cdaf1228-49b2-4d2a-83ed-bceae5b9bca8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 332, 'network_id': '286563ae-11dd-41c3-932c-9747a97a5b19'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:49:42.532387 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2562c5d3-78de-45dc-9a07-bf485ecce04c req-b66b7b68-81df-444f-8537-20bb6a60f96e service neutron] Bound using segment: {'id': 'cdaf1228-49b2-4d2a-83ed-bceae5b9bca8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 332, 'network_id': '286563ae-11dd-41c3-932c-9747a97a5b19'} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:49:42.532803 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-2562c5d3-78de-45dc-9a07-bf485ecce04c req-b66b7b68-81df-444f-8537-20bb6a60f96e service neutron] Bound port: dfb8b610-306d-4aae-a313-bcad721134b4, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'cdaf1228-49b2-4d2a-83ed-bceae5b9bca8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 332, 'network_id': '286563ae-11dd-41c3-932c-9747a97a5b19'}}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:49:42.533148 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-2562c5d3-78de-45dc-9a07-bf485ecce04c req-b66b7b68-81df-444f-8537-20bb6a60f96e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:49:42.593917 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-2562c5d3-78de-45dc-9a07-bf485ecce04c req-b66b7b68-81df-444f-8537-20bb6a60f96e service neutron] For port dfb8b610-306d-4aae-a313-bcad721134b4, host hv-neutron-8168, cleared binding levels {{(pid=102162) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:49:42.596819 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-2562c5d3-78de-45dc-9a07-bf485ecce04c req-b66b7b68-81df-444f-8537-20bb6a60f96e service neutron] For port dfb8b610-306d-4aae-a313-bcad721134b4, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=dfb8b610-306d-4aae-a313-bcad721134b4,segment=NetworkSegment(cdaf1228-49b2-4d2a-83ed-bceae5b9bca8),segment_id=cdaf1228-49b2-4d2a-83ed-bceae5b9bca8)] {{(pid=102162) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:49:42.636270 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-2562c5d3-78de-45dc-9a07-bf485ecce04c req-b66b7b68-81df-444f-8537-20bb6a60f96e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:49:42.673296 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2562c5d3-78de-45dc-9a07-bf485ecce04c req-b66b7b68-81df-444f-8537-20bb6a60f96e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:42.673907 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-2562c5d3-78de-45dc-9a07-bf485ecce04c req-b66b7b68-81df-444f-8537-20bb6a60f96e service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:49:42.675314 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2562c5d3-78de-45dc-9a07-bf485ecce04c req-b66b7b68-81df-444f-8537-20bb6a60f96e service neutron] 10.222.0.26 "PUT /v2.0/ports/dfb8b610-306d-4aae-a313-bcad721134b4 HTTP/1.1" status: 200 len: 1093 time: 0.6731672 Nov 09 04:49:42.696945 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b66b7b68-81df-444f-8537-20bb6a60f96e service neutron] Pushing event updated for resources: {'Port': ['ID=dfb8b610-306d-4aae-a313-bcad721134b4,revision_number=3']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:49:42.723142 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device f3317116-a956-4f8c-b3f9-1f6e630d4058 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:49:42.748649 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] No Port match for: f3317116-a956-4f8c-b3f9-1f6e630d4058 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:49:42.748987 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device f3317116-a956-4f8c-b3f9-1f6e630d4058 not bound to the agent host hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:49:42.789949 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2562c5d3-78de-45dc-9a07-bf485ecce04c req-6253f1ba-db97-4808-bef8-20aec113fda5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:42.791439 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2562c5d3-78de-45dc-9a07-bf485ecce04c req-6253f1ba-db97-4808-bef8-20aec113fda5 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=429656387d9541bbb7aea9dd5d2534cb&device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92 HTTP/1.1" status: 200 len: 1096 time: 0.0400903 Nov 09 04:49:42.833032 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2562c5d3-78de-45dc-9a07-bf485ecce04c req-73b5a328-ce2a-42c1-af65-9d0f3099d042 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=dfb8b610-306d-4aae-a313-bcad721134b4 HTTP/1.1" status: 200 len: 217 time: 0.0325654 Nov 09 04:49:42.885645 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2562c5d3-78de-45dc-9a07-bf485ecce04c req-5fd9af8c-7cdd-400a-8797-d05e5da2d59f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:42.887137 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2562c5d3-78de-45dc-9a07-bf485ecce04c req-5fd9af8c-7cdd-400a-8797-d05e5da2d59f service neutron] 10.222.0.26 "GET /v2.0/subnets?id=f39bfd16-f1ca-4a88-adf8-6562c8af0c74 HTTP/1.1" status: 200 len: 854 time: 0.0470855 Nov 09 04:49:42.918731 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2562c5d3-78de-45dc-9a07-bf485ecce04c req-93dd7d49-64af-44bd-a930-de0e80b25599 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=286563ae-11dd-41c3-932c-9747a97a5b19&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0241292 Nov 09 04:49:43.004303 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2562c5d3-78de-45dc-9a07-bf485ecce04c req-5c3d0039-7d93-4761-8f8b-48fdd2d20055 service neutron] 10.222.0.26 "GET /v2.0/networks/286563ae-11dd-41c3-932c-9747a97a5b19?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0788243 Nov 09 04:49:43.094440 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2562c5d3-78de-45dc-9a07-bf485ecce04c req-3cd9ebb9-0170-4d18-8390-74e8d2f5df98 service neutron] 10.222.0.26 "GET /v2.0/networks/286563ae-11dd-41c3-932c-9747a97a5b19?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0835693 Nov 09 04:49:43.152122 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fde13afa-a0c8-415f-a738-5f2e93f56d92', 'tag': 'dfb8b610-306d-4aae-a313-bcad721134b4'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:49:43.154373 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b12d8dc3-57eb-4702-ab76-9e0f745a1a8e" -d '{"events": [{"name": "network-changed", "server_uuid": "fde13afa-a0c8-415f-a738-5f2e93f56d92", "tag": "dfb8b610-306d-4aae-a313-bcad721134b4"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:49:43.189926 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:49:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9a30c2f9-4208-4498-a821-ee30b66b7e2d x-openstack-request-id: req-9a30c2f9-4208-4498-a821-ee30b66b7e2d {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:49:43.190232 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "fde13afa-a0c8-415f-a738-5f2e93f56d92", "tag": "dfb8b610-306d-4aae-a313-bcad721134b4", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:49:43.190513 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-9a30c2f9-4208-4498-a821-ee30b66b7e2d {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:49:43.190919 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fde13afa-a0c8-415f-a738-5f2e93f56d92', 'tag': 'dfb8b610-306d-4aae-a313-bcad721134b4', 'status': 'completed', 'code': 200} Nov 09 04:49:43.278021 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b12d8dc3-57eb-4702-ab76-9e0f745a1a8e req-86787c8a-afbc-473c-9878-55e9f8632f35 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:43.279605 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b12d8dc3-57eb-4702-ab76-9e0f745a1a8e req-86787c8a-afbc-473c-9878-55e9f8632f35 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=429656387d9541bbb7aea9dd5d2534cb&device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92 HTTP/1.1" status: 200 len: 1096 time: 0.0416873 Nov 09 04:49:43.375420 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b12d8dc3-57eb-4702-ab76-9e0f745a1a8e req-71cbdab0-85df-47c5-9637-1ab18260e0af service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:43.376884 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b12d8dc3-57eb-4702-ab76-9e0f745a1a8e req-71cbdab0-85df-47c5-9637-1ab18260e0af service neutron] 10.222.0.26 "GET /v2.0/networks?id=286563ae-11dd-41c3-932c-9747a97a5b19 HTTP/1.1" status: 200 len: 915 time: 0.0900772 Nov 09 04:49:43.417800 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b12d8dc3-57eb-4702-ab76-9e0f745a1a8e req-08620f6a-f196-4816-88aa-6f1fa396f98b service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=dfb8b610-306d-4aae-a313-bcad721134b4 HTTP/1.1" status: 200 len: 217 time: 0.0333624 Nov 09 04:49:43.466077 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b12d8dc3-57eb-4702-ab76-9e0f745a1a8e req-01b44539-a5e6-4747-8ced-e8c3d6930d1c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:43.467559 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b12d8dc3-57eb-4702-ab76-9e0f745a1a8e req-01b44539-a5e6-4747-8ced-e8c3d6930d1c service neutron] 10.222.0.26 "GET /v2.0/subnets?id=f39bfd16-f1ca-4a88-adf8-6562c8af0c74 HTTP/1.1" status: 200 len: 854 time: 0.0429611 Nov 09 04:49:43.502909 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b12d8dc3-57eb-4702-ab76-9e0f745a1a8e req-524a4f62-73bd-4d68-83cf-16a198bdcff1 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=286563ae-11dd-41c3-932c-9747a97a5b19&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0271518 Nov 09 04:49:43.594944 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b12d8dc3-57eb-4702-ab76-9e0f745a1a8e req-77d8bd1c-791d-4c28-8dd4-f42ebed6a0e8 service neutron] 10.222.0.26 "GET /v2.0/networks/286563ae-11dd-41c3-932c-9747a97a5b19?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0840154 Nov 09 04:49:43.610971 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec4566d5-7b52-478d-8b94-15475dc28c88 req-64dd61e3-a5bf-4a76-b148-871b138eae80 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:43.612475 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ec4566d5-7b52-478d-8b94-15475dc28c88 req-64dd61e3-a5bf-4a76-b148-871b138eae80 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92 HTTP/1.1" status: 200 len: 943 time: 0.0537808 Nov 09 04:49:43.662417 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ec4566d5-7b52-478d-8b94-15475dc28c88 req-884ebe69-deda-4576-a639-c1d05e3fc402 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409062 Nov 09 04:49:43.687545 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6aa79b88-474f-4ff0-b1bb-ca6092b4459c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:49:43.698924 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b12d8dc3-57eb-4702-ab76-9e0f745a1a8e req-83c0732a-5f28-4313-b077-e4e3654d2abe service neutron] 10.222.0.26 "GET /v2.0/networks/286563ae-11dd-41c3-932c-9747a97a5b19?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0957005 Nov 09 04:49:44.785607 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-027acfa4-de68-4a4a-8b1e-c81cca9b6e27 req-1a8891ae-049c-473b-a177-9652a77e0538 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:44.787097 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-027acfa4-de68-4a4a-8b1e-c81cca9b6e27 req-1a8891ae-049c-473b-a177-9652a77e0538 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92 HTTP/1.1" status: 200 len: 943 time: 0.0554709 Nov 09 04:49:44.833526 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-027acfa4-de68-4a4a-8b1e-c81cca9b6e27 req-773fe539-8c12-468d-bb2d-a79127e31e68 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403516 Nov 09 04:49:45.189888 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:49:45.944338 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c961a015-77f6-42c9-afd6-ce1a8cc2a00d req-057134af-f791-4c3c-b080-d8452ba4753a tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:45.945773 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c961a015-77f6-42c9-afd6-ce1a8cc2a00d req-057134af-f791-4c3c-b080-d8452ba4753a tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92 HTTP/1.1" status: 200 len: 943 time: 0.0473108 Nov 09 04:49:45.992099 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c961a015-77f6-42c9-afd6-ce1a8cc2a00d req-a6bc4fcf-63fd-4f50-980b-20d8dd7987eb tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403540 Nov 09 04:49:46.486921 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:49:46.753927 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device dfb8b610-306d-4aae-a313-bcad721134b4 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=102163) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 09 04:49:46.851129 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port dfb8b610-306d-4aae-a313-bcad721134b4, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=dfb8b610-306d-4aae-a313-bcad721134b4,segment=NetworkSegment(cdaf1228-49b2-4d2a-83ed-bceae5b9bca8),segment_id=cdaf1228-49b2-4d2a-83ed-bceae5b9bca8)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:49:46.861870 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Returning: {'device': 'dfb8b610-306d-4aae-a313-bcad721134b4', 'network_id': '286563ae-11dd-41c3-932c-9747a97a5b19', 'port_id': 'dfb8b610-306d-4aae-a313-bcad721134b4', 'mac_address': 'fa:16:3e:e8:dd:ec', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 332, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f39bfd16-f1ca-4a88-adf8-6562c8af0c74', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102163) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 09 04:49:46.907744 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:49:46.920275 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id dfb8b610-306d-4aae-a313-bcad721134b4 {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:49:46.943070 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port dfb8b610-306d-4aae-a313-bcad721134b4, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=dfb8b610-306d-4aae-a313-bcad721134b4,segment=NetworkSegment(cdaf1228-49b2-4d2a-83ed-bceae5b9bca8),segment_id=cdaf1228-49b2-4d2a-83ed-bceae5b9bca8)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:49:47.007557 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:49:47.036201 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:49:47.086231 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=dfb8b610-306d-4aae-a313-bcad721134b4,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:49:47.093667 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:49:47.094010 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:49:47.094348 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:49:47.094705 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:49:47.095034 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:49:47.095360 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:49:47.095687 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:49:47.096014 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:49:47.096338 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:49:47.096655 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:49:47.096997 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:49:47.097294 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:49:47.230597 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['dfb8b610-306d-4aae-a313-bcad721134b4'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 04:49:47.275615 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb240c12-0a26-4df9-ba3c-6b52e90904e7 req-a3ca6eff-a973-4b08-b4b1-c8bf509e188b tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:47.277443 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-bb240c12-0a26-4df9-ba3c-6b52e90904e7 req-a3ca6eff-a973-4b08-b4b1-c8bf509e188b tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92 HTTP/1.1" status: 200 len: 944 time: 0.0492430 Nov 09 04:49:47.324486 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-bb240c12-0a26-4df9-ba3c-6b52e90904e7 req-0d0b389b-5cad-4324-9fa6-450e9bb1e52b tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409832 Nov 09 04:49:48.440132 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1717b40d-504d-4f0f-a53f-8259fca0ec16 req-1d6bd680-4ba9-48be-9ffd-9bc0cfdbbf7d tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:48.441605 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-1717b40d-504d-4f0f-a53f-8259fca0ec16 req-1d6bd680-4ba9-48be-9ffd-9bc0cfdbbf7d tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92 HTTP/1.1" status: 200 len: 944 time: 0.0510843 Nov 09 04:49:48.487990 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-1717b40d-504d-4f0f-a53f-8259fca0ec16 req-b073e6a6-393d-4269-ba51-eb8233cae533 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405831 Nov 09 04:49:48.766643 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device dfb8b610-306d-4aae-a313-bcad721134b4 up at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:49:48.852527 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning for port dfb8b610-306d-4aae-a313-bcad721134b4 completed by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 09 04:49:48.856282 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning complete for port dfb8b610-306d-4aae-a313-bcad721134b4 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:49:48.856648 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:49:48.931123 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:49:48.952814 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fde13afa-a0c8-415f-a738-5f2e93f56d92', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'dfb8b610-306d-4aae-a313-bcad721134b4'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:49:48.955376 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-93e7fb0b-04b4-42e3-9234-4beefd67d95a" -d '{"events": [{"server_uuid": "fde13afa-a0c8-415f-a738-5f2e93f56d92", "name": "network-vif-plugged", "status": "completed", "tag": "dfb8b610-306d-4aae-a313-bcad721134b4"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:49:48.971613 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port dfb8b610-306d-4aae-a313-bcad721134b4, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=dfb8b610-306d-4aae-a313-bcad721134b4,segment=NetworkSegment(cdaf1228-49b2-4d2a-83ed-bceae5b9bca8),segment_id=cdaf1228-49b2-4d2a-83ed-bceae5b9bca8)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:49:48.991498 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:49:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b8c4f7b2-922e-4082-a7b0-7e1f2a7def64 x-openstack-request-id: req-b8c4f7b2-922e-4082-a7b0-7e1f2a7def64 {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:49:48.991781 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fde13afa-a0c8-415f-a738-5f2e93f56d92", "name": "network-vif-plugged", "status": "completed", "tag": "dfb8b610-306d-4aae-a313-bcad721134b4", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:49:48.992028 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-b8c4f7b2-922e-4082-a7b0-7e1f2a7def64 {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:49:48.992417 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fde13afa-a0c8-415f-a738-5f2e93f56d92', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'dfb8b610-306d-4aae-a313-bcad721134b4', 'code': 200} Nov 09 04:49:49.035820 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:49:49.083022 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=dfb8b610-306d-4aae-a313-bcad721134b4,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:49:49.290995 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48697d5c-aa1b-4883-ba14-048d2ea67e65 req-7bf641e9-f86d-4642-a22e-dea6d5c8608e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:49.292402 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-48697d5c-aa1b-4883-ba14-048d2ea67e65 req-7bf641e9-f86d-4642-a22e-dea6d5c8608e service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92 HTTP/1.1" status: 200 len: 1098 time: 0.0433762 Nov 09 04:49:49.337976 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-48697d5c-aa1b-4883-ba14-048d2ea67e65 req-24d5d77e-7820-48a1-8267-6ffed21a55fa service neutron] 10.222.0.26 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0379028 Nov 09 04:49:49.601821 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9a5762d-40f6-4a0a-b0e9-e606801e3c7b req-5083b441-2a7e-4782-8352-cee5a4dd78f5 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:49.603232 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f9a5762d-40f6-4a0a-b0e9-e606801e3c7b req-5083b441-2a7e-4782-8352-cee5a4dd78f5 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92 HTTP/1.1" status: 200 len: 945 time: 0.0514326 Nov 09 04:49:49.650251 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f9a5762d-40f6-4a0a-b0e9-e606801e3c7b req-dd925b2a-b50b-4e04-abd0-e892ab7ff3c3 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411043 Nov 09 04:49:50.762921 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3abddc79-3a3f-4775-89a1-71a2d3d92fba req-4a22bf49-6843-4a7f-8f59-f97dc17cd8c4 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:50.764362 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3abddc79-3a3f-4775-89a1-71a2d3d92fba req-4a22bf49-6843-4a7f-8f59-f97dc17cd8c4 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92 HTTP/1.1" status: 200 len: 945 time: 0.0477226 Nov 09 04:49:50.816380 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3abddc79-3a3f-4775-89a1-71a2d3d92fba req-1770a182-c050-46da-b411-95823883315d tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0462096 Nov 09 04:49:50.928468 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-059a59f4-3909-4693-a8ee-06ad2356b3d2 req-d00cddd0-fd46-4cc3-97e2-faa4a657cac8 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:50.929838 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-059a59f4-3909-4693-a8ee-06ad2356b3d2 req-d00cddd0-fd46-4cc3-97e2-faa4a657cac8 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92 HTTP/1.1" status: 200 len: 945 time: 0.0480993 Nov 09 04:49:50.979530 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-059a59f4-3909-4693-a8ee-06ad2356b3d2 req-7d778816-0133-4005-87a9-c918cf4cee7b tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438089 Nov 09 04:49:51.307642 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f67f658-3d1c-431f-96f9-ac2e42a36b2c req-b8051932-e1c9-4ab5-bee0-37275ef54794 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:51.309121 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-2f67f658-3d1c-431f-96f9-ac2e42a36b2c req-b8051932-e1c9-4ab5-bee0-37275ef54794 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92 HTTP/1.1" status: 200 len: 945 time: 0.0483952 Nov 09 04:49:51.356518 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-2f67f658-3d1c-431f-96f9-ac2e42a36b2c req-4c750268-9e5b-4077-b1bc-e59cf7b6807f tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415733 Nov 09 04:49:51.396322 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9d6b00e5-0604-45c5-b0fd-d3b6681cdc8e req-836cc0f3-4ec3-428d-b15d-74fdd83ed78a service neutron] 10.222.0.24 "GET /v2.0/ports?device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0426261 Nov 09 04:49:52.457591 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:49:52.473754 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbe5f06f-0ae9-4f3e-b4f6-2762a31517ba req-502d7a07-1581-4eed-8e3c-3ff183ff5901 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:52.475340 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-bbe5f06f-0ae9-4f3e-b4f6-2762a31517ba req-502d7a07-1581-4eed-8e3c-3ff183ff5901 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92 HTTP/1.1" status: 200 len: 945 time: 0.0499463 Nov 09 04:49:52.523043 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-bbe5f06f-0ae9-4f3e-b4f6-2762a31517ba req-c7f91c1d-0854-46bd-bf8d-6a0764a1aeaf tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415921 Nov 09 04:49:53.144377 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d6b00e5-0604-45c5-b0fd-d3b6681cdc8e req-e92acf1b-7c18-45e8-8451-c21510092c11 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:53.145742 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9d6b00e5-0604-45c5-b0fd-d3b6681cdc8e req-e92acf1b-7c18-45e8-8451-c21510092c11 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=429656387d9541bbb7aea9dd5d2534cb&device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92 HTTP/1.1" status: 200 len: 1098 time: 0.0389984 Nov 09 04:49:53.238324 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d6b00e5-0604-45c5-b0fd-d3b6681cdc8e req-89852af7-81bd-4d1d-a916-edde5ff4bdb0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:53.239805 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9d6b00e5-0604-45c5-b0fd-d3b6681cdc8e req-89852af7-81bd-4d1d-a916-edde5ff4bdb0 service neutron] 10.222.0.26 "GET /v2.0/networks?id=286563ae-11dd-41c3-932c-9747a97a5b19 HTTP/1.1" status: 200 len: 915 time: 0.0866411 Nov 09 04:49:53.280744 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9d6b00e5-0604-45c5-b0fd-d3b6681cdc8e req-4b04692d-e353-4135-ad69-88ced536041e service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=dfb8b610-306d-4aae-a313-bcad721134b4 HTTP/1.1" status: 200 len: 217 time: 0.0336859 Nov 09 04:49:53.327911 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d6b00e5-0604-45c5-b0fd-d3b6681cdc8e req-8099c21f-45b9-4c32-8b22-d2c5e9a92bbb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:53.329534 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9d6b00e5-0604-45c5-b0fd-d3b6681cdc8e req-8099c21f-45b9-4c32-8b22-d2c5e9a92bbb service neutron] 10.222.0.26 "GET /v2.0/subnets?id=f39bfd16-f1ca-4a88-adf8-6562c8af0c74 HTTP/1.1" status: 200 len: 854 time: 0.0419822 Nov 09 04:49:53.364238 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9d6b00e5-0604-45c5-b0fd-d3b6681cdc8e req-6c4010c1-771d-41e3-848d-9675334feec1 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=286563ae-11dd-41c3-932c-9747a97a5b19&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0272889 Nov 09 04:49:53.452629 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9d6b00e5-0604-45c5-b0fd-d3b6681cdc8e req-88b024ce-9292-427d-8a0f-80fb9c360625 service neutron] 10.222.0.26 "GET /v2.0/networks/286563ae-11dd-41c3-932c-9747a97a5b19?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0803092 Nov 09 04:49:53.544932 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9d6b00e5-0604-45c5-b0fd-d3b6681cdc8e req-66bb9264-e879-4788-93d6-83468ac07ac6 service neutron] 10.222.0.26 "GET /v2.0/networks/286563ae-11dd-41c3-932c-9747a97a5b19?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0849462 Nov 09 04:49:53.644187 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2059247a-9486-48f7-86ac-2b50f94a784b req-0d162ad8-cf4c-4ec4-9be3-9f6accc5a20a tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:53.645694 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-2059247a-9486-48f7-86ac-2b50f94a784b req-0d162ad8-cf4c-4ec4-9be3-9f6accc5a20a tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92 HTTP/1.1" status: 200 len: 945 time: 0.0509439 Nov 09 04:49:53.691259 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-2059247a-9486-48f7-86ac-2b50f94a784b req-b8446ec5-7af2-4267-88a5-ccb6fd3e3b2c tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389037 Nov 09 04:49:54.806675 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c8731bb-466f-443d-9bd4-1672e0545ee6 req-96ea52b8-1706-43ba-ab06-bab480cb2c59 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:54.808162 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5c8731bb-466f-443d-9bd4-1672e0545ee6 req-96ea52b8-1706-43ba-ab06-bab480cb2c59 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92 HTTP/1.1" status: 200 len: 945 time: 0.0506799 Nov 09 04:49:54.854967 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5c8731bb-466f-443d-9bd4-1672e0545ee6 req-a29f45d7-7a52-4eac-9e51-19bb2503755d tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409787 Nov 09 04:49:55.972514 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-112375f7-fc2f-4e7d-a7f3-9ce9cb198de4 req-caa9ad61-8d60-4a30-88a4-6118f2d48487 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:55.974033 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-112375f7-fc2f-4e7d-a7f3-9ce9cb198de4 req-caa9ad61-8d60-4a30-88a4-6118f2d48487 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92 HTTP/1.1" status: 200 len: 945 time: 0.0526950 Nov 09 04:49:56.020890 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-112375f7-fc2f-4e7d-a7f3-9ce9cb198de4 req-3d23c1c9-6d6f-41b8-bc26-2f8daaf9e6a6 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405006 Nov 09 04:49:57.136935 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1587de55-0ac2-442d-99e9-59f1694c75c7 req-5a3657c6-6fb5-4610-9069-a533a653e7d0 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:57.138451 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1587de55-0ac2-442d-99e9-59f1694c75c7 req-5a3657c6-6fb5-4610-9069-a533a653e7d0 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92 HTTP/1.1" status: 200 len: 945 time: 0.0479598 Nov 09 04:49:57.190088 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1587de55-0ac2-442d-99e9-59f1694c75c7 req-b1e7b3db-7245-48dd-b81a-5e7c7dd9a171 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0458302 Nov 09 04:49:58.301854 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-444a044f-4d1b-452f-9831-a5c0d4a451ec req-166d4cf9-1f96-42cb-826f-038416ec859f tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:58.303315 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-444a044f-4d1b-452f-9831-a5c0d4a451ec req-166d4cf9-1f96-42cb-826f-038416ec859f tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92 HTTP/1.1" status: 200 len: 945 time: 0.0467966 Nov 09 04:49:58.348859 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-444a044f-4d1b-452f-9831-a5c0d4a451ec req-59ce2ddb-77c6-4cd7-bf4e-3504c1ba17f8 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391629 Nov 09 04:49:59.463342 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32945124-749c-483f-84ff-7621000cf7b2 req-a2bdc20f-6e7c-41cf-900c-c4938cd96e9f tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:49:59.464773 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-32945124-749c-483f-84ff-7621000cf7b2 req-a2bdc20f-6e7c-41cf-900c-c4938cd96e9f tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92 HTTP/1.1" status: 200 len: 945 time: 0.0477595 Nov 09 04:49:59.509893 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-32945124-749c-483f-84ff-7621000cf7b2 req-b6e8cf64-297c-4594-8df0-7a03b870be6e tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393050 Nov 09 04:50:00.622803 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c96e5b1d-cdc2-4490-9f16-989530c583f7 req-7567121c-335f-4bff-9878-6e956483a3df tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:00.624243 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c96e5b1d-cdc2-4490-9f16-989530c583f7 req-7567121c-335f-4bff-9878-6e956483a3df tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92 HTTP/1.1" status: 200 len: 945 time: 0.0484564 Nov 09 04:50:00.674726 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c96e5b1d-cdc2-4490-9f16-989530c583f7 req-e4d000ac-7b4f-4a34-9a70-143fd8d2c063 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0447323 Nov 09 04:50:01.789812 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-485c54f9-26c3-4a98-9304-a449fbd628af req-d82dcfd6-8e29-43b8-80a2-445636d646ce tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:01.791285 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-485c54f9-26c3-4a98-9304-a449fbd628af req-d82dcfd6-8e29-43b8-80a2-445636d646ce tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92 HTTP/1.1" status: 200 len: 945 time: 0.0475671 Nov 09 04:50:01.838040 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-485c54f9-26c3-4a98-9304-a449fbd628af req-09ac105e-0ea4-4384-bc34-679989d3c1f0 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409935 Nov 09 04:50:02.950783 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64c06ede-3dd3-4ef7-aec4-1c68df96c315 req-454f2549-b37b-4621-8f96-d3159fd743d9 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:02.952266 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-64c06ede-3dd3-4ef7-aec4-1c68df96c315 req-454f2549-b37b-4621-8f96-d3159fd743d9 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92 HTTP/1.1" status: 200 len: 945 time: 0.0482957 Nov 09 04:50:02.997360 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-64c06ede-3dd3-4ef7-aec4-1c68df96c315 req-3f3d1173-b644-408c-9a07-0419abf95eaf tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390930 Nov 09 04:50:04.113221 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48dfcf34-f53d-44a6-965b-5f27f4d03b59 req-8ad9d684-868f-4311-a173-eeee7ab1d969 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:04.114751 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-48dfcf34-f53d-44a6-965b-5f27f4d03b59 req-8ad9d684-868f-4311-a173-eeee7ab1d969 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92 HTTP/1.1" status: 200 len: 945 time: 0.0510283 Nov 09 04:50:04.160509 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-48dfcf34-f53d-44a6-965b-5f27f4d03b59 req-66044526-2c38-4f48-9bb8-9dcacc0092fc tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394306 Nov 09 04:50:05.275372 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdbfa895-9b84-4b04-b391-cb3f04e19903 req-70087cbc-5b71-4038-b6d7-781099124409 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:05.276859 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-bdbfa895-9b84-4b04-b391-cb3f04e19903 req-70087cbc-5b71-4038-b6d7-781099124409 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92 HTTP/1.1" status: 200 len: 945 time: 0.0499852 Nov 09 04:50:05.322910 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-bdbfa895-9b84-4b04-b391-cb3f04e19903 req-ecfbd281-5839-4382-af75-7cc86e8dd123 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402176 Nov 09 04:50:06.324671 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d9009db-1977-4d4b-9631-428a838d0490 req-c6d47f18-c881-42fb-8b29-79f7ccfaff85 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:06.326111 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6d9009db-1977-4d4b-9631-428a838d0490 req-c6d47f18-c881-42fb-8b29-79f7ccfaff85 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=429656387d9541bbb7aea9dd5d2534cb&device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92 HTTP/1.1" status: 200 len: 1098 time: 0.0391495 Nov 09 04:50:06.470376 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9f52143-18b0-46e7-8463-7ac825738a33 req-5d0bf53a-4541-472c-bfd9-6a3673978d15 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:06.471849 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b9f52143-18b0-46e7-8463-7ac825738a33 req-5d0bf53a-4541-472c-bfd9-6a3673978d15 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92 HTTP/1.1" status: 200 len: 945 time: 0.0696762 Nov 09 04:50:06.473160 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d9009db-1977-4d4b-9631-428a838d0490 req-ff85b905-555e-4482-badb-892867a3c2d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:06.474493 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6d9009db-1977-4d4b-9631-428a838d0490 req-ff85b905-555e-4482-badb-892867a3c2d5 service neutron] 10.222.0.26 "GET /v2.0/networks?id=286563ae-11dd-41c3-932c-9747a97a5b19 HTTP/1.1" status: 200 len: 915 time: 0.1275702 Nov 09 04:50:06.525014 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6d9009db-1977-4d4b-9631-428a838d0490 req-62330db0-f306-4810-983f-a650cd760fdb service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=dfb8b610-306d-4aae-a313-bcad721134b4 HTTP/1.1" status: 200 len: 217 time: 0.0411394 Nov 09 04:50:06.579119 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b9f52143-18b0-46e7-8463-7ac825738a33 req-27201996-b2ba-4c72-b8e3-34c90d0c32ad tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1005499 Nov 09 04:50:06.593681 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d9009db-1977-4d4b-9631-428a838d0490 req-88da535a-607c-43ad-8c58-62e2b5e7f3f7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:06.595165 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6d9009db-1977-4d4b-9631-428a838d0490 req-88da535a-607c-43ad-8c58-62e2b5e7f3f7 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=f39bfd16-f1ca-4a88-adf8-6562c8af0c74 HTTP/1.1" status: 200 len: 854 time: 0.0590780 Nov 09 04:50:06.630170 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6d9009db-1977-4d4b-9631-428a838d0490 req-b60ee0a3-be04-4630-9259-4cd07df8fa89 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=286563ae-11dd-41c3-932c-9747a97a5b19&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0231020 Nov 09 04:50:06.721972 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6d9009db-1977-4d4b-9631-428a838d0490 req-f4a50720-6935-4db6-9afc-43fb5f368454 service neutron] 10.222.0.26 "GET /v2.0/networks/286563ae-11dd-41c3-932c-9747a97a5b19?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0839572 Nov 09 04:50:06.810932 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6d9009db-1977-4d4b-9631-428a838d0490 req-49f32ae2-6383-45c6-b94d-aa816011f165 service neutron] 10.222.0.26 "GET /v2.0/networks/286563ae-11dd-41c3-932c-9747a97a5b19?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0787051 Nov 09 04:50:07.696334 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b27e6a6-dbbd-4b9b-8686-b6b18e7eeb6c req-8e894326-f0f2-48d7-9600-eac8f35f72c6 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:07.697817 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-8b27e6a6-dbbd-4b9b-8686-b6b18e7eeb6c req-8e894326-f0f2-48d7-9600-eac8f35f72c6 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92 HTTP/1.1" status: 200 len: 945 time: 0.0529647 Nov 09 04:50:07.744537 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-8b27e6a6-dbbd-4b9b-8686-b6b18e7eeb6c req-1060e91c-f365-4d44-87ec-3064dac6b0b3 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408518 Nov 09 04:50:08.861173 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-864aa1a3-6ec9-4625-b0e0-080f764c1616 req-d3b6b13b-d599-405e-adc3-79f01c386df6 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:08.863851 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-864aa1a3-6ec9-4625-b0e0-080f764c1616 req-d3b6b13b-d599-405e-adc3-79f01c386df6 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92 HTTP/1.1" status: 200 len: 945 time: 0.0532072 Nov 09 04:50:08.915359 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-864aa1a3-6ec9-4625-b0e0-080f764c1616 req-ce2f954e-2808-455d-8bb7-10898070df9c tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0448895 Nov 09 04:50:10.029578 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60950ce6-bdd8-430c-a97d-1823bf9b57d6 req-140dcb92-e774-4f60-aefc-17667fa6d871 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:10.031049 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-60950ce6-bdd8-430c-a97d-1823bf9b57d6 req-140dcb92-e774-4f60-aefc-17667fa6d871 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92 HTTP/1.1" status: 200 len: 945 time: 0.0478086 Nov 09 04:50:10.076861 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-60950ce6-bdd8-430c-a97d-1823bf9b57d6 req-f38883b4-28ff-4518-b208-2ba53a3b09bc tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400028 Nov 09 04:50:11.189668 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a740f74-80df-4b71-b7e5-2e64c35edf0d req-32249dcb-4436-48f4-b4b7-7d42bfa514ea tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:11.191060 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5a740f74-80df-4b71-b7e5-2e64c35edf0d req-32249dcb-4436-48f4-b4b7-7d42bfa514ea tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92 HTTP/1.1" status: 200 len: 945 time: 0.0472486 Nov 09 04:50:11.236827 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5a740f74-80df-4b71-b7e5-2e64c35edf0d req-65c49a30-b14a-48f0-bc39-95f6b862c949 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393255 Nov 09 04:50:11.349120 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-82c537d6-7d91-47ae-9ad0-56691acf52a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:12.228881 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:12.506790 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-575e05fc-1638-4ae9-88a9-707bfc546349 req-5f872867-7c21-468a-84be-656cc370964d tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:12.508214 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-575e05fc-1638-4ae9-88a9-707bfc546349 req-5f872867-7c21-468a-84be-656cc370964d tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92 HTTP/1.1" status: 200 len: 945 time: 0.0518365 Nov 09 04:50:12.554260 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-575e05fc-1638-4ae9-88a9-707bfc546349 req-9e56f38c-7bcc-43de-8f22-107c8ca54ac3 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399199 Nov 09 04:50:13.669251 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5be9db9c-e326-414b-b9b0-16214af4b20b req-2f5f1e40-4eee-47c1-9eeb-014e00e672f3 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:13.670730 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5be9db9c-e326-414b-b9b0-16214af4b20b req-2f5f1e40-4eee-47c1-9eeb-014e00e672f3 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92 HTTP/1.1" status: 200 len: 945 time: 0.0484264 Nov 09 04:50:13.691839 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-355a8af4-44b3-4d30-a460-7c02846f9ac1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:13.716886 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5be9db9c-e326-414b-b9b0-16214af4b20b req-7d5efbfb-a377-4ccb-9a5d-637727b27f93 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403087 Nov 09 04:50:14.828190 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af1cb0f1-86a2-4578-8e28-e797dd1d6ba8 req-a7d06c36-e9cf-479a-9fc2-785ebd2d57e5 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:14.829903 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-af1cb0f1-86a2-4578-8e28-e797dd1d6ba8 req-a7d06c36-e9cf-479a-9fc2-785ebd2d57e5 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92 HTTP/1.1" status: 200 len: 945 time: 0.0483227 Nov 09 04:50:14.879781 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-af1cb0f1-86a2-4578-8e28-e797dd1d6ba8 req-f8d4204b-c68e-410a-b2d2-a789d2c69145 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432467 Nov 09 04:50:15.148676 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:15.997856 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3f7b9a8-b9ff-468e-81cd-7d9167351db2 req-310c30d0-0d4e-438d-8a10-a644e9915714 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:15.999290 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c3f7b9a8-b9ff-468e-81cd-7d9167351db2 req-310c30d0-0d4e-438d-8a10-a644e9915714 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92 HTTP/1.1" status: 200 len: 945 time: 0.0518591 Nov 09 04:50:16.050641 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c3f7b9a8-b9ff-468e-81cd-7d9167351db2 req-400a8693-cbbb-4a1d-a91b-b3c48c784610 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429668 Nov 09 04:50:16.491981 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:16.960004 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:17.164425 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e434e2b-8ca9-4eb8-99e4-8151c9fb950f req-3d12e5c6-fcaa-4d50-a15e-5c09036cbcf5 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:17.165817 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-6e434e2b-8ca9-4eb8-99e4-8151c9fb950f req-3d12e5c6-fcaa-4d50-a15e-5c09036cbcf5 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92 HTTP/1.1" status: 200 len: 945 time: 0.0479040 Nov 09 04:50:17.215482 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-6e434e2b-8ca9-4eb8-99e4-8151c9fb950f req-5ca667ea-1011-4b24-8d1c-7f2d7e2ea77c tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438702 Nov 09 04:50:18.326963 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d21697c2-f284-4da4-9e36-bea86eefc174 req-4048e04f-654e-4fcf-b2c8-db464d423b04 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:18.328640 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d21697c2-f284-4da4-9e36-bea86eefc174 req-4048e04f-654e-4fcf-b2c8-db464d423b04 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92 HTTP/1.1" status: 200 len: 945 time: 0.0473595 Nov 09 04:50:18.375479 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d21697c2-f284-4da4-9e36-bea86eefc174 req-87bbfb06-e56c-4401-9633-5c5ff3611244 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410314 Nov 09 04:50:19.487264 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a54a707-d78f-49eb-8eb3-7bac0526b295 req-e032f12a-50e0-40c4-9002-1f6d6f0a4975 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:19.488710 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-5a54a707-d78f-49eb-8eb3-7bac0526b295 req-e032f12a-50e0-40c4-9002-1f6d6f0a4975 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92 HTTP/1.1" status: 200 len: 945 time: 0.0479188 Nov 09 04:50:19.535313 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-5a54a707-d78f-49eb-8eb3-7bac0526b295 req-3e1607ef-f996-4e45-ab05-04df6a85b2b3 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401573 Nov 09 04:50:20.459834 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9d6b00e5-0604-45c5-b0fd-d3b6681cdc8e req-ddeabc5e-6176-43dd-9a7a-d0b99399c292 service neutron] 10.222.0.26 "GET /v2.0/ports/dfb8b610-306d-4aae-a313-bcad721134b4/bindings/hv-neutron-8168 HTTP/1.1" status: 200 len: 384 time: 0.0528646 Nov 09 04:50:20.652876 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93ace621-38c1-4405-91da-3b74cb7add27 req-0f93b58b-a682-411d-8c0c-cb76884fa120 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:20.654344 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-93ace621-38c1-4405-91da-3b74cb7add27 req-0f93b58b-a682-411d-8c0c-cb76884fa120 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92 HTTP/1.1" status: 200 len: 945 time: 0.0520434 Nov 09 04:50:20.700612 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-93ace621-38c1-4405-91da-3b74cb7add27 req-0c1a87f3-9254-474b-8fc3-95541a7684a3 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402613 Nov 09 04:50:20.925379 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d6b00e5-0604-45c5-b0fd-d3b6681cdc8e req-5d5314bf-0f59-4369-8cb6-0eb5b1463cb6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:20.927246 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9d6b00e5-0604-45c5-b0fd-d3b6681cdc8e req-5d5314bf-0f59-4369-8cb6-0eb5b1463cb6 service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92&tenant_id=429656387d9541bbb7aea9dd5d2534cb HTTP/1.1" status: 200 len: 1098 time: 0.0423641 Nov 09 04:50:20.988157 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d6b00e5-0604-45c5-b0fd-d3b6681cdc8e req-90d33171-c966-43fa-824c-5e8c18d232f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:20.989497 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9d6b00e5-0604-45c5-b0fd-d3b6681cdc8e req-90d33171-c966-43fa-824c-5e8c18d232f8 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=429656387d9541bbb7aea9dd5d2534cb&device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92 HTTP/1.1" status: 200 len: 1098 time: 0.0379376 Nov 09 04:50:21.081028 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d6b00e5-0604-45c5-b0fd-d3b6681cdc8e req-2573839c-78b2-4a96-a663-c48bf2d25aea service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:21.082481 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9d6b00e5-0604-45c5-b0fd-d3b6681cdc8e req-2573839c-78b2-4a96-a663-c48bf2d25aea service neutron] 10.222.0.26 "GET /v2.0/networks?id=286563ae-11dd-41c3-932c-9747a97a5b19 HTTP/1.1" status: 200 len: 915 time: 0.0851774 Nov 09 04:50:21.123708 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9d6b00e5-0604-45c5-b0fd-d3b6681cdc8e req-e4b0f917-35ed-4e7d-b984-3b21c02448aa service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=dfb8b610-306d-4aae-a313-bcad721134b4 HTTP/1.1" status: 200 len: 217 time: 0.0330763 Nov 09 04:50:21.174555 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d6b00e5-0604-45c5-b0fd-d3b6681cdc8e req-5a48ddfc-68b0-42b7-a495-6f5a65f75c91 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:21.175944 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9d6b00e5-0604-45c5-b0fd-d3b6681cdc8e req-5a48ddfc-68b0-42b7-a495-6f5a65f75c91 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=f39bfd16-f1ca-4a88-adf8-6562c8af0c74 HTTP/1.1" status: 200 len: 854 time: 0.0450485 Nov 09 04:50:21.206293 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9d6b00e5-0604-45c5-b0fd-d3b6681cdc8e req-7b7db14d-8758-49ef-8d9f-c7184209d268 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=286563ae-11dd-41c3-932c-9747a97a5b19&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0233386 Nov 09 04:50:21.292969 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9d6b00e5-0604-45c5-b0fd-d3b6681cdc8e req-8d1ce173-6ee8-44bc-984e-29737851198a service neutron] 10.222.0.26 "GET /v2.0/networks/286563ae-11dd-41c3-932c-9747a97a5b19?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0794938 Nov 09 04:50:21.383570 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9d6b00e5-0604-45c5-b0fd-d3b6681cdc8e req-11ef6a6c-9683-435f-bfef-9ad1d34f242a service neutron] 10.222.0.26 "GET /v2.0/networks/286563ae-11dd-41c3-932c-9747a97a5b19?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0834758 Nov 09 04:50:21.812617 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-751908bd-576a-4a7d-8e5a-faffd74d4bed req-3a838a30-9f56-4004-b7f5-859c75aeffa4 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:21.814101 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-751908bd-576a-4a7d-8e5a-faffd74d4bed req-3a838a30-9f56-4004-b7f5-859c75aeffa4 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92 HTTP/1.1" status: 200 len: 945 time: 0.0472987 Nov 09 04:50:21.861494 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-751908bd-576a-4a7d-8e5a-faffd74d4bed req-6129bd27-c50e-4eec-9631-ed2ab26ce9d1 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408220 Nov 09 04:50:22.982591 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-619575d9-cc76-4924-ae35-0b2873387747 req-257b51d0-971e-475c-9175-ba5dc10c33df tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:22.984034 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-619575d9-cc76-4924-ae35-0b2873387747 req-257b51d0-971e-475c-9175-ba5dc10c33df tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92 HTTP/1.1" status: 200 len: 945 time: 0.0479252 Nov 09 04:50:23.030228 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-619575d9-cc76-4924-ae35-0b2873387747 req-372d9732-c311-47da-bd41-6d9c294c1213 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395513 Nov 09 04:50:24.147037 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9643c2a-5f67-42cc-9f1e-905cb98f7c57 req-8980af0f-1e97-427e-af9c-9a45308e3ffb tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:24.148484 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-a9643c2a-5f67-42cc-9f1e-905cb98f7c57 req-8980af0f-1e97-427e-af9c-9a45308e3ffb tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92 HTTP/1.1" status: 200 len: 945 time: 0.0517828 Nov 09 04:50:24.194838 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-a9643c2a-5f67-42cc-9f1e-905cb98f7c57 req-54a28af7-c33b-4626-86e6-fb07779a6020 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405869 Nov 09 04:50:24.491357 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-943a55e1-b6d2-4550-90db-3561131baadc req-e802420b-8d93-45ef-b211-7d86e36f36fb tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:24.492819 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-943a55e1-b6d2-4550-90db-3561131baadc req-e802420b-8d93-45ef-b211-7d86e36f36fb tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92 HTTP/1.1" status: 200 len: 945 time: 0.0496111 Nov 09 04:50:24.539584 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-943a55e1-b6d2-4550-90db-3561131baadc req-c2091282-568b-489d-b717-c20b3cea2173 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408969 Nov 09 04:50:24.590827 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-935b7084-e97c-4290-9229-a0ec8cacfa26 req-535fadcb-b0cf-4dbe-a841-c5146a25e5b4 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:24.592308 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-935b7084-e97c-4290-9229-a0ec8cacfa26 req-535fadcb-b0cf-4dbe-a841-c5146a25e5b4 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.26 "GET /v2.0/ports?device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92&tenant_id=429656387d9541bbb7aea9dd5d2534cb&binding%3Ahost_id=hv-neutron-8168 HTTP/1.1" status: 200 len: 945 time: 0.0542192 Nov 09 04:50:24.673044 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-935b7084-e97c-4290-9229-a0ec8cacfa26 req-1cd8ff59-60df-4868-a83c-464e429036e3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:24.674425 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-935b7084-e97c-4290-9229-a0ec8cacfa26 req-1cd8ff59-60df-4868-a83c-464e429036e3 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=429656387d9541bbb7aea9dd5d2534cb&device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92 HTTP/1.1" status: 200 len: 1098 time: 0.0393875 Nov 09 04:50:24.761590 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-935b7084-e97c-4290-9229-a0ec8cacfa26 req-338c6180-55c4-49f9-bb9f-0fd65322fc52 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:24.763091 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-935b7084-e97c-4290-9229-a0ec8cacfa26 req-338c6180-55c4-49f9-bb9f-0fd65322fc52 service neutron] 10.222.0.26 "GET /v2.0/networks?id=286563ae-11dd-41c3-932c-9747a97a5b19 HTTP/1.1" status: 200 len: 915 time: 0.0820649 Nov 09 04:50:24.806594 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-935b7084-e97c-4290-9229-a0ec8cacfa26 req-945ea58b-52ae-4d86-bb1d-7b540551ec81 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=dfb8b610-306d-4aae-a313-bcad721134b4 HTTP/1.1" status: 200 len: 217 time: 0.0368381 Nov 09 04:50:24.854779 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-935b7084-e97c-4290-9229-a0ec8cacfa26 req-5b2f2190-f115-48b2-a46f-cf20f666dbbd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:24.856162 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-935b7084-e97c-4290-9229-a0ec8cacfa26 req-5b2f2190-f115-48b2-a46f-cf20f666dbbd service neutron] 10.222.0.26 "GET /v2.0/subnets?id=f39bfd16-f1ca-4a88-adf8-6562c8af0c74 HTTP/1.1" status: 200 len: 854 time: 0.0430155 Nov 09 04:50:24.886075 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-935b7084-e97c-4290-9229-a0ec8cacfa26 req-46f937d6-efbd-4591-922e-fca0085837a5 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=286563ae-11dd-41c3-932c-9747a97a5b19&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0224774 Nov 09 04:50:24.917219 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device dfb8b610-306d-4aae-a313-bcad721134b4 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=102163) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 09 04:50:24.921655 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device dfb8b610-306d-4aae-a313-bcad721134b4 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:50:24.982406 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-935b7084-e97c-4290-9229-a0ec8cacfa26 req-48c120b6-507c-43d6-9c0a-a75e738fcbe8 service neutron] 10.222.0.26 "GET /v2.0/networks/286563ae-11dd-41c3-932c-9747a97a5b19?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0894306 Nov 09 04:50:25.070873 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port dfb8b610-306d-4aae-a313-bcad721134b4, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=dfb8b610-306d-4aae-a313-bcad721134b4,segment=NetworkSegment(cdaf1228-49b2-4d2a-83ed-bceae5b9bca8),segment_id=cdaf1228-49b2-4d2a-83ed-bceae5b9bca8)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:50:25.071141 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-935b7084-e97c-4290-9229-a0ec8cacfa26 req-d2126435-ef59-47e6-b7ab-209f89549ea5 service neutron] 10.222.0.26 "GET /v2.0/networks/286563ae-11dd-41c3-932c-9747a97a5b19?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0815318 Nov 09 04:50:25.073143 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:25.089369 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Returning: {'device': 'dfb8b610-306d-4aae-a313-bcad721134b4', 'network_id': '286563ae-11dd-41c3-932c-9747a97a5b19', 'port_id': 'dfb8b610-306d-4aae-a313-bcad721134b4', 'mac_address': 'fa:16:3e:e8:dd:ec', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 332, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f39bfd16-f1ca-4a88-adf8-6562c8af0c74', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102163) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 09 04:50:25.106227 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fde13afa-a0c8-415f-a738-5f2e93f56d92', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'dfb8b610-306d-4aae-a313-bcad721134b4'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:50:25.108438 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a420d672-d20c-4faa-99af-614c348a624d" -d '{"events": [{"server_uuid": "fde13afa-a0c8-415f-a738-5f2e93f56d92", "name": "network-vif-unplugged", "status": "completed", "tag": "dfb8b610-306d-4aae-a313-bcad721134b4"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:50:25.140233 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port dfb8b610-306d-4aae-a313-bcad721134b4, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=dfb8b610-306d-4aae-a313-bcad721134b4,segment=NetworkSegment(cdaf1228-49b2-4d2a-83ed-bceae5b9bca8),segment_id=cdaf1228-49b2-4d2a-83ed-bceae5b9bca8)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:50:25.150764 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:25.167006 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id dfb8b610-306d-4aae-a313-bcad721134b4 {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:50:25.206593 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:25.249736 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 09 Nov 2021 04:50:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-644d5028-958d-4876-991a-94d2470c35a5 x-openstack-request-id: req-644d5028-958d-4876-991a-94d2470c35a5 {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:50:25.250030 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fde13afa-a0c8-415f-a738-5f2e93f56d92", "name": "network-vif-unplugged", "status": "completed", "tag": "dfb8b610-306d-4aae-a313-bcad721134b4", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:50:25.250294 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-644d5028-958d-4876-991a-94d2470c35a5 {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:50:25.250691 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fde13afa-a0c8-415f-a738-5f2e93f56d92', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'dfb8b610-306d-4aae-a313-bcad721134b4', 'code': 200} Nov 09 04:50:25.282129 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.db.api [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=102163) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:50:25.282515 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG oslo_db.api [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:50:25.282988 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=dfb8b610-306d-4aae-a313-bcad721134b4,revision_number=6']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:50:25.654958 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-577f4697-0aa4-45e2-a36c-c076926e0f93 req-e53169a6-f3b7-4499-a18a-8bbd3976ce9d tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:25.656415 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-577f4697-0aa4-45e2-a36c-c076926e0f93 req-e53169a6-f3b7-4499-a18a-8bbd3976ce9d tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92 HTTP/1.1" status: 200 len: 943 time: 0.0482092 Nov 09 04:50:25.708616 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-577f4697-0aa4-45e2-a36c-c076926e0f93 req-ae59fdae-aa86-48b8-8be2-dc2e71c3831e tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0461349 Nov 09 04:50:25.818306 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:25.833670 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id dfb8b610-306d-4aae-a313-bcad721134b4 {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:50:25.852874 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port dfb8b610-306d-4aae-a313-bcad721134b4, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=dfb8b610-306d-4aae-a313-bcad721134b4,segment=NetworkSegment(cdaf1228-49b2-4d2a-83ed-bceae5b9bca8),segment_id=cdaf1228-49b2-4d2a-83ed-bceae5b9bca8)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:50:25.914860 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:26.115789 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=dfb8b610-306d-4aae-a313-bcad721134b4,revision_number=7']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:50:26.121061 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['dfb8b610-306d-4aae-a313-bcad721134b4'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 04:50:26.821032 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31abab1a-f3d6-4327-986b-0385fa141ab5 req-03883bd8-a40a-4be4-958d-42e7eaf32629 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:26.822479 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-31abab1a-f3d6-4327-986b-0385fa141ab5 req-03883bd8-a40a-4be4-958d-42e7eaf32629 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92 HTTP/1.1" status: 200 len: 944 time: 0.0466573 Nov 09 04:50:26.872355 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-31abab1a-f3d6-4327-986b-0385fa141ab5 req-9783cb1a-2732-4602-b737-711e4919ea94 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441706 Nov 09 04:50:26.934287 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device dfb8b610-306d-4aae-a313-bcad721134b4 up at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:50:26.982170 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning complete for port dfb8b610-306d-4aae-a313-bcad721134b4 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:50:26.982558 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:26.985052 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1220985-ae55-4cce-a28b-cac15f79a0e8 req-7e74f49e-d60e-478b-9da6-820665019ab3 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:26.986621 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d1220985-ae55-4cce-a28b-cac15f79a0e8 req-7e74f49e-d60e-478b-9da6-820665019ab3 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92 HTTP/1.1" status: 200 len: 944 time: 0.0486951 Nov 09 04:50:27.034020 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d1220985-ae55-4cce-a28b-cac15f79a0e8 req-4eb58acf-9831-47d8-9e8b-d84fc15091f2 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406969 Nov 09 04:50:27.056694 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:27.091273 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port dfb8b610-306d-4aae-a313-bcad721134b4, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=dfb8b610-306d-4aae-a313-bcad721134b4,segment=NetworkSegment(cdaf1228-49b2-4d2a-83ed-bceae5b9bca8),segment_id=cdaf1228-49b2-4d2a-83ed-bceae5b9bca8)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:50:27.145889 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f3eb5eb-c7dc-43c6-801c-aec5301f7f3b req-83e07845-cac0-44c7-a0b0-108f7d8629cd tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:27.147378 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3f3eb5eb-c7dc-43c6-801c-aec5301f7f3b req-83e07845-cac0-44c7-a0b0-108f7d8629cd tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92 HTTP/1.1" status: 200 len: 944 time: 0.0482423 Nov 09 04:50:27.148558 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:27.196697 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3f3eb5eb-c7dc-43c6-801c-aec5301f7f3b req-1c133aa6-c8a1-4fe6-96f3-e0d1d32b516d tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423443 Nov 09 04:50:27.196904 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=dfb8b610-306d-4aae-a313-bcad721134b4,revision_number=8']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:50:27.251745 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fde13afa-a0c8-415f-a738-5f2e93f56d92', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'dfb8b610-306d-4aae-a313-bcad721134b4'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:50:27.254050 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c6d714d3-a0da-4206-ab73-6924cc821542" -d '{"events": [{"server_uuid": "fde13afa-a0c8-415f-a738-5f2e93f56d92", "name": "network-vif-plugged", "status": "completed", "tag": "dfb8b610-306d-4aae-a313-bcad721134b4"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:50:27.289040 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:50:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-89c587cd-11fb-4e66-9066-aa675d859d32 x-openstack-request-id: req-89c587cd-11fb-4e66-9066-aa675d859d32 {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:50:27.289333 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fde13afa-a0c8-415f-a738-5f2e93f56d92", "name": "network-vif-plugged", "status": "completed", "tag": "dfb8b610-306d-4aae-a313-bcad721134b4", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:50:27.289617 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-89c587cd-11fb-4e66-9066-aa675d859d32 {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:50:27.289977 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fde13afa-a0c8-415f-a738-5f2e93f56d92', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'dfb8b610-306d-4aae-a313-bcad721134b4', 'code': 200} Nov 09 04:50:27.744043 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbd3bce5-d14b-4202-ab75-82a2819769d5 req-88f222d3-d5b1-4898-b4c6-450b69e4e683 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:27.745592 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-bbd3bce5-d14b-4202-ab75-82a2819769d5 req-88f222d3-d5b1-4898-b4c6-450b69e4e683 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92 HTTP/1.1" status: 200 len: 945 time: 0.0483639 Nov 09 04:50:27.791622 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-bbd3bce5-d14b-4202-ab75-82a2819769d5 req-c77dcd5b-72fe-4e4a-8799-a65f11a1a8f6 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400772 Nov 09 04:50:28.902551 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78463ab0-6b10-493c-bf94-f32b9486244f req-e1bd5d8f-2fbe-4f57-af60-d8e3730808f9 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:28.904017 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-78463ab0-6b10-493c-bf94-f32b9486244f req-e1bd5d8f-2fbe-4f57-af60-d8e3730808f9 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92 HTTP/1.1" status: 200 len: 945 time: 0.0480011 Nov 09 04:50:28.950069 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-78463ab0-6b10-493c-bf94-f32b9486244f req-7994f911-1d84-4edf-be8c-f151fdec84e9 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/security-groups?id=759776ed-4cbf-4868-85c0-f1aebe6b5dc9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402606 Nov 09 04:50:29.279499 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e55374f9-05ca-4781-a640-4e558265bb8b req-e40efe3b-3e5b-4ff9-b982-80cafb80ce09 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:29.280931 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e55374f9-05ca-4781-a640-4e558265bb8b req-e40efe3b-3e5b-4ff9-b982-80cafb80ce09 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.26 "GET /v2.0/ports?device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92 HTTP/1.1" status: 200 len: 945 time: 0.0497632 Nov 09 04:50:29.366777 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-e55374f9-05ca-4781-a640-4e558265bb8b req-9d832ca0-a918-45c9-afa2-f872a92929e5 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Deleting port dfb8b610-306d-4aae-a313-bcad721134b4 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:50:29.367107 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-e55374f9-05ca-4781-a640-4e558265bb8b req-9d832ca0-a918-45c9-afa2-f872a92929e5 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:29.456235 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:50:29.457249 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-e55374f9-05ca-4781-a640-4e558265bb8b req-9d832ca0-a918-45c9-afa2-f872a92929e5 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] For port dfb8b610-306d-4aae-a313-bcad721134b4, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=dfb8b610-306d-4aae-a313-bcad721134b4,segment=NetworkSegment(cdaf1228-49b2-4d2a-83ed-bceae5b9bca8),segment_id=cdaf1228-49b2-4d2a-83ed-bceae5b9bca8)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:50:29.457613 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-e55374f9-05ca-4781-a640-4e558265bb8b req-9d832ca0-a918-45c9-afa2-f872a92929e5 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:29.470728 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-e55374f9-05ca-4781-a640-4e558265bb8b req-9d832ca0-a918-45c9-afa2-f872a92929e5 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Calling delete_port for dfb8b610-306d-4aae-a313-bcad721134b4 owned by compute:nova {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:50:29.639888 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-e55374f9-05ca-4781-a640-4e558265bb8b req-9d832ca0-a918-45c9-afa2-f872a92929e5 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:29.650916 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['dfb8b610-306d-4aae-a313-bcad721134b4'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 04:50:29.667908 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d832ca0-a918-45c9-afa2-f872a92929e5 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Pushing event deleted for resources: {'Port': ['ID=dfb8b610-306d-4aae-a313-bcad721134b4,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:50:29.694303 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d832ca0-a918-45c9-afa2-f872a92929e5 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:50:29.694679 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d832ca0-a918-45c9-afa2-f872a92929e5 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:50:29.695024 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d832ca0-a918-45c9-afa2-f872a92929e5 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:50:29.695357 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d832ca0-a918-45c9-afa2-f872a92929e5 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:50:29.695687 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d832ca0-a918-45c9-afa2-f872a92929e5 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:50:29.696014 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d832ca0-a918-45c9-afa2-f872a92929e5 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:50:29.696338 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d832ca0-a918-45c9-afa2-f872a92929e5 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:50:29.696661 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d832ca0-a918-45c9-afa2-f872a92929e5 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:50:29.696981 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d832ca0-a918-45c9-afa2-f872a92929e5 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:50:29.697301 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d832ca0-a918-45c9-afa2-f872a92929e5 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:50:29.697620 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d832ca0-a918-45c9-afa2-f872a92929e5 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:50:29.697938 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d832ca0-a918-45c9-afa2-f872a92929e5 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:50:29.715984 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-e55374f9-05ca-4781-a640-4e558265bb8b req-9d832ca0-a918-45c9-afa2-f872a92929e5 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] No DVR routers for this DVR port dfb8b610-306d-4aae-a313-bcad721134b4 on host hv-neutron-8168 {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:50:29.718235 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-e55374f9-05ca-4781-a640-4e558265bb8b req-9d832ca0-a918-45c9-afa2-f872a92929e5 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:29.721627 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e55374f9-05ca-4781-a640-4e558265bb8b req-9d832ca0-a918-45c9-afa2-f872a92929e5 tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.26 "DELETE /v2.0/ports/dfb8b610-306d-4aae-a313-bcad721134b4 HTTP/1.1" status: 204 len: 173 time: 0.4349763 Nov 09 04:50:29.722054 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fde13afa-a0c8-415f-a738-5f2e93f56d92', 'name': 'network-vif-deleted', 'tag': 'dfb8b610-306d-4aae-a313-bcad721134b4'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:50:29.724309 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ad6b7910-ecee-4a7e-ae78-2ddaae9b2a8e" -d '{"events": [{"server_uuid": "fde13afa-a0c8-415f-a738-5f2e93f56d92", "name": "network-vif-deleted", "tag": "dfb8b610-306d-4aae-a313-bcad721134b4"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:50:29.759547 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:50:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6cbbfbd1-6e23-4765-a098-668d12a262ad x-openstack-request-id: req-6cbbfbd1-6e23-4765-a098-668d12a262ad {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:50:29.759842 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fde13afa-a0c8-415f-a738-5f2e93f56d92", "name": "network-vif-deleted", "tag": "dfb8b610-306d-4aae-a313-bcad721134b4", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:50:29.760100 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-6cbbfbd1-6e23-4765-a098-668d12a262ad {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:50:29.760502 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fde13afa-a0c8-415f-a738-5f2e93f56d92', 'name': 'network-vif-deleted', 'tag': 'dfb8b610-306d-4aae-a313-bcad721134b4', 'status': 'completed', 'code': 200} Nov 09 04:50:30.052258 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6b6e11f1-57ca-4dde-b781-a4963f340fef req-b3961194-3ff4-40e4-bb65-16e147fb3e8f tempest-ServerDiskConfigTestJSON-954554883 tempest-ServerDiskConfigTestJSON-954554883-project] 10.222.0.24 "GET /v2.0/ports?device_id=fde13afa-a0c8-415f-a738-5f2e93f56d92 HTTP/1.1" status: 200 len: 210 time: 0.0251901 Nov 09 04:50:31.176227 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 34164) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:50:31.223679 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-528be0af-00f7-4418-84e5-feec2d9185da admin admin] Deleting subnet f39bfd16-f1ca-4a88-adf8-6562c8af0c74 {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:50:31.226745 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-528be0af-00f7-4418-84e5-feec2d9185da admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:31.259348 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-528be0af-00f7-4418-84e5-feec2d9185da admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:31.296329 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-528be0af-00f7-4418-84e5-feec2d9185da admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:31.417739 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-528be0af-00f7-4418-84e5-feec2d9185da admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:31.440644 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-528be0af-00f7-4418-84e5-feec2d9185da admin admin] Pushing event deleted for resources: {'Subnet': ['ID=f39bfd16-f1ca-4a88-adf8-6562c8af0c74,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:50:31.446818 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-528be0af-00f7-4418-84e5-feec2d9185da admin admin] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:31.449959 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-528be0af-00f7-4418-84e5-feec2d9185da admin admin] 10.222.0.24 "DELETE /v2.0/subnets/f39bfd16-f1ca-4a88-adf8-6562c8af0c74 HTTP/1.1" status: 204 len: 168 time: 0.2727404 Nov 09 04:50:31.452456 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 34166) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:50:31.521827 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-446d2b84-1b77-46ad-9786-de5dc2f29038 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:31.598647 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-446d2b84-1b77-46ad-9786-de5dc2f29038 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:31.618024 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-446d2b84-1b77-46ad-9786-de5dc2f29038 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['286563ae-11dd-41c3-932c-9747a97a5b19']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:50:31.626893 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-446d2b84-1b77-46ad-9786-de5dc2f29038 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'cdaf1228-49b2-4d2a-83ed-bceae5b9bca8') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:50:31.627185 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-446d2b84-1b77-46ad-9786-de5dc2f29038 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'cdaf1228-49b2-4d2a-83ed-bceae5b9bca8') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:50:31.636603 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-446d2b84-1b77-46ad-9786-de5dc2f29038 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:31.648933 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-446d2b84-1b77-46ad-9786-de5dc2f29038 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:31.654532 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-446d2b84-1b77-46ad-9786-de5dc2f29038 admin admin] Releasing vlan 332 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:50:31.654904 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-446d2b84-1b77-46ad-9786-de5dc2f29038 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:31.656463 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:50:31.656463 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:50:31.656463 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:50:31.656463 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:50:31.656463 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:50:31.656463 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:50:31.656463 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:50:31.656463 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:50:31.656463 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:50:31.656463 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:50:31.656463 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:50:31.656463 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:50:31.656463 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:50:31.656463 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:50:31.656463 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:50:31.656463 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:50:31.656463 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:50:31.656463 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:50:31.656463 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:50:31.656463 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:50:31.656463 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:50:31.656463 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:50:31.656463 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:50:31.656463 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:50:31.656463 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:50:31.656463 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:50:31.656463 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:50:31.656463 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:50:31.656463 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:50:31.656463 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:50:31.656463 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:50:31.656463 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:50:31.771637 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-446d2b84-1b77-46ad-9786-de5dc2f29038 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:31.776989 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-446d2b84-1b77-46ad-9786-de5dc2f29038 admin admin] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:31.780136 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-446d2b84-1b77-46ad-9786-de5dc2f29038 admin admin] 10.222.0.24 "DELETE /v2.0/networks/286563ae-11dd-41c3-932c-9747a97a5b19 HTTP/1.1" status: 204 len: 168 time: 0.3265300 Nov 09 04:50:31.791076 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-446d2b84-1b77-46ad-9786-de5dc2f29038 admin admin] Pushing event deleted for resources: {'Network': ['ID=286563ae-11dd-41c3-932c-9747a97a5b19,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:50:32.054349 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 34170) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:50:32.104112 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-99293e22-a2f4-444b-b875-93ffcdf84f07 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=429656387d9541bbb7aea9dd5d2534cb&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0482941 Nov 09 04:50:32.106447 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 34172) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:50:32.154325 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-89c67e9a-b169-43c1-8458-35d7ead52dea admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:32.175274 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-89c67e9a-b169-43c1-8458-35d7ead52dea admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:32.308389 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-89c67e9a-b169-43c1-8458-35d7ead52dea admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:32.310977 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-89c67e9a-b169-43c1-8458-35d7ead52dea admin admin] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:32.312140 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-89c67e9a-b169-43c1-8458-35d7ead52dea admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/759776ed-4cbf-4868-85c0-f1aebe6b5dc9 HTTP/1.1" status: 204 len: 168 time: 0.2047992 Nov 09 04:50:32.319612 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89c67e9a-b169-43c1-8458-35d7ead52dea admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=759776ed-4cbf-4868-85c0-f1aebe6b5dc9,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:50:32.326603 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89c67e9a-b169-43c1-8458-35d7ead52dea admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:50:32.326953 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89c67e9a-b169-43c1-8458-35d7ead52dea admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:50:32.327289 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89c67e9a-b169-43c1-8458-35d7ead52dea admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:50:32.327622 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89c67e9a-b169-43c1-8458-35d7ead52dea admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:50:32.328211 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89c67e9a-b169-43c1-8458-35d7ead52dea admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:50:32.328544 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89c67e9a-b169-43c1-8458-35d7ead52dea admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:50:32.328871 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89c67e9a-b169-43c1-8458-35d7ead52dea admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:50:32.329198 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89c67e9a-b169-43c1-8458-35d7ead52dea admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:50:32.329520 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89c67e9a-b169-43c1-8458-35d7ead52dea admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:50:32.329842 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89c67e9a-b169-43c1-8458-35d7ead52dea admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:50:32.330162 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89c67e9a-b169-43c1-8458-35d7ead52dea admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:50:32.330510 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89c67e9a-b169-43c1-8458-35d7ead52dea admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:50:33.298842 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 34194) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:50:33.393170 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-5372694f-26ad-4b0e-a642-da85b3e33825 admin admin] Request body: {'network': {'name': 'tempest-ServerActionsTestJSON-1679556620-network', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:50:33.485343 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5372694f-26ad-4b0e-a642-da85b3e33825 admin admin] Made reservation on behalf of 1a8335b645d04ccbad2f2ed5288b68e8 for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:50:33.487955 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5372694f-26ad-4b0e-a642-da85b3e33825 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:33.497602 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5372694f-26ad-4b0e-a642-da85b3e33825 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:33.577234 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5372694f-26ad-4b0e-a642-da85b3e33825 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:33.663490 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5372694f-26ad-4b0e-a642-da85b3e33825 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:33.685978 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5372694f-26ad-4b0e-a642-da85b3e33825 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 310} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:50:33.701948 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5372694f-26ad-4b0e-a642-da85b3e33825 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=160d79dd-7918-4181-8544-a1e2fc21201b,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:50:33.705036 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5372694f-26ad-4b0e-a642-da85b3e33825 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:33.705401 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-5372694f-26ad-4b0e-a642-da85b3e33825 admin admin] Added segment 24d74bfa-ba9d-4c10-aa08-4a4fed47543f of type vlan for network d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 Nov 09 04:50:33.753537 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5372694f-26ad-4b0e-a642-da85b3e33825 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:33.822615 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5372694f-26ad-4b0e-a642-da85b3e33825 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:33.823841 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5372694f-26ad-4b0e-a642-da85b3e33825 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:33.824504 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5372694f-26ad-4b0e-a642-da85b3e33825 admin admin] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:33.916823 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5372694f-26ad-4b0e-a642-da85b3e33825 admin admin] Pushing event updated for resources: {'Network': ['ID=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:50:33.926879 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:50:33.939139 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-5372694f-26ad-4b0e-a642-da85b3e33825 admin admin] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.6391113 Nov 09 04:50:33.942165 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 34198) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:50:33.947731 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-764789b3-230a-4e38-89d0-8579c2d3c910 admin admin] Request body: {'subnet': {'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerActionsTestJSON-1679556620-subnet', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:50:34.051052 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-764789b3-230a-4e38-89d0-8579c2d3c910 admin admin] Made reservation on behalf of 1a8335b645d04ccbad2f2ed5288b68e8 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:50:34.053474 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-764789b3-230a-4e38-89d0-8579c2d3c910 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:34.273837 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-764789b3-230a-4e38-89d0-8579c2d3c910 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:34.329699 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-764789b3-230a-4e38-89d0-8579c2d3c910 admin admin] Pushing event updated for resources: {'Subnet': ['ID=96831da9-b0dd-45f9-8543-0ac226a68c6a,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:50:34.339840 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-764789b3-230a-4e38-89d0-8579c2d3c910 admin admin] Checking segment: {'id': '24d74bfa-ba9d-4c10-aa08-4a4fed47543f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:50:34.340194 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-764789b3-230a-4e38-89d0-8579c2d3c910 admin admin] Network hostable DHCP agents. Network: d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:50:34.433663 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-764789b3-230a-4e38-89d0-8579c2d3c910 admin admin] Network d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:50:34.502405 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-764789b3-230a-4e38-89d0-8579c2d3c910 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:50:34.506507 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-764789b3-230a-4e38-89d0-8579c2d3c910 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:34.507094 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-764789b3-230a-4e38-89d0-8579c2d3c910 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:34.511528 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6f597c6a-96b7-4ace-a96e-aeb2706e39c6 None None] Network d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:50:34.590724 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-764789b3-230a-4e38-89d0-8579c2d3c910 admin admin] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.6472888 Nov 09 04:50:34.593268 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 34200) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:50:34.598183 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-5c65842a-dad4-4455-af4c-00d530a60e89 admin admin] Request body: {'router': {'name': 'tempest-ServerActionsTestJSON-1679556620-router', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:50:34.650816 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c8220aaf-10e3-4764-8309-0b8227c695e2 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21', 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'fixed_ips': [{'subnet_id': '96831da9-b0dd-45f9-8543-0ac226a68c6a'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:50:34.654673 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c8220aaf-10e3-4764-8309-0b8227c695e2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:34.703135 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5c65842a-dad4-4455-af4c-00d530a60e89 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:34.704194 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5c65842a-dad4-4455-af4c-00d530a60e89 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:34.754129 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5c65842a-dad4-4455-af4c-00d530a60e89 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:34.782320 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-c8220aaf-10e3-4764-8309-0b8227c695e2 None None] Allocated IP 172.20.0.2 (d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21/96831da9-b0dd-45f9-8543-0ac226a68c6a/636c3090-6f35-4c2e-b217-1594d9525b9d) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:50:34.920827 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c8220aaf-10e3-4764-8309-0b8227c695e2 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:34.943785 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5c65842a-dad4-4455-af4c-00d530a60e89 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:34.955471 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device dfb8b610-306d-4aae-a313-bcad721134b4 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:50:34.978017 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c8220aaf-10e3-4764-8309-0b8227c695e2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:34.979751 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] No Port match for: dfb8b610-306d-4aae-a313-bcad721134b4 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:50:34.980083 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device dfb8b610-306d-4aae-a313-bcad721134b4 not bound to the agent host hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:50:35.014960 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c8220aaf-10e3-4764-8309-0b8227c695e2 None None] Network d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:50:35.017628 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-c8220aaf-10e3-4764-8309-0b8227c695e2 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:50:35.025461 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c8220aaf-10e3-4764-8309-0b8227c695e2 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:50:35.030799 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8220aaf-10e3-4764-8309-0b8227c695e2 None None] Pushing event updated for resources: {'Port': ['ID=636c3090-6f35-4c2e-b217-1594d9525b9d,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:50:35.080619 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-c8220aaf-10e3-4764-8309-0b8227c695e2 None None] Attempting to bind port 636c3090-6f35-4c2e-b217-1594d9525b9d on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:50:35.080981 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-c8220aaf-10e3-4764-8309-0b8227c695e2 None None] Attempting to bind port 636c3090-6f35-4c2e-b217-1594d9525b9d by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '24d74bfa-ba9d-4c10-aa08-4a4fed47543f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:50:35.081355 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c8220aaf-10e3-4764-8309-0b8227c695e2 None None] Attempting to bind port 636c3090-6f35-4c2e-b217-1594d9525b9d on network d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:50:35.086244 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c8220aaf-10e3-4764-8309-0b8227c695e2 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 50, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:50:35.091834 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c8220aaf-10e3-4764-8309-0b8227c695e2 None None] Checking segment: {'id': '24d74bfa-ba9d-4c10-aa08-4a4fed47543f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:50:35.091834 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c8220aaf-10e3-4764-8309-0b8227c695e2 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:35.091834 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c8220aaf-10e3-4764-8309-0b8227c695e2 None None] Bound using segment: {'id': '24d74bfa-ba9d-4c10-aa08-4a4fed47543f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:50:35.091834 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-c8220aaf-10e3-4764-8309-0b8227c695e2 None None] Bound port: 636c3090-6f35-4c2e-b217-1594d9525b9d, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '24d74bfa-ba9d-4c10-aa08-4a4fed47543f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:50:35.091834 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c8220aaf-10e3-4764-8309-0b8227c695e2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:35.152952 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-c8220aaf-10e3-4764-8309-0b8227c695e2 None None] For port 636c3090-6f35-4c2e-b217-1594d9525b9d, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:50:35.155859 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-c8220aaf-10e3-4764-8309-0b8227c695e2 None None] For port 636c3090-6f35-4c2e-b217-1594d9525b9d, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=636c3090-6f35-4c2e-b217-1594d9525b9d,segment=NetworkSegment(24d74bfa-ba9d-4c10-aa08-4a4fed47543f),segment_id=24d74bfa-ba9d-4c10-aa08-4a4fed47543f)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:50:35.192179 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5c65842a-dad4-4455-af4c-00d530a60e89 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:35.215712 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5c65842a-dad4-4455-af4c-00d530a60e89 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:35.217055 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c8220aaf-10e3-4764-8309-0b8227c695e2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:35.276265 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8220aaf-10e3-4764-8309-0b8227c695e2 None None] Pushing event updated for resources: {'Port': ['ID=636c3090-6f35-4c2e-b217-1594d9525b9d,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:50:35.320619 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-5c65842a-dad4-4455-af4c-00d530a60e89 admin admin] Allocated IP 172.26.0.77 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/6b137909-e697-434a-93b2-4272af33f319) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:50:35.442046 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5c65842a-dad4-4455-af4c-00d530a60e89 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:35.531723 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5c65842a-dad4-4455-af4c-00d530a60e89 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:35.569267 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5c65842a-dad4-4455-af4c-00d530a60e89 admin admin] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:50:35.575527 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-5c65842a-dad4-4455-af4c-00d530a60e89 admin admin] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:50:35.577844 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5c65842a-dad4-4455-af4c-00d530a60e89 admin admin] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:50:35.584814 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c65842a-dad4-4455-af4c-00d530a60e89 admin admin] Pushing event updated for resources: {'Port': ['ID=6b137909-e697-434a-93b2-4272af33f319,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:50:35.837381 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 636c3090-6f35-4c2e-b217-1594d9525b9d up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:50:35.892587 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 636c3090-6f35-4c2e-b217-1594d9525b9d triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:50:35.892958 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:35.924563 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5c65842a-dad4-4455-af4c-00d530a60e89 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:35.979671 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:36.016733 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 636c3090-6f35-4c2e-b217-1594d9525b9d, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=636c3090-6f35-4c2e-b217-1594d9525b9d,segment=NetworkSegment(24d74bfa-ba9d-4c10-aa08-4a4fed47543f),segment_id=24d74bfa-ba9d-4c10-aa08-4a4fed47543f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:50:36.085260 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:36.136453 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=636c3090-6f35-4c2e-b217-1594d9525b9d,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:50:36.138328 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5c65842a-dad4-4455-af4c-00d530a60e89 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:36.158542 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cdecee95-95aa-4d84-859d-19bff5bd2e50 None None] Network d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:50:36.269944 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-eb0a4070-dc67-46e2-9b71-734b5c9bac86 None None] Provisioning complete for port 636c3090-6f35-4c2e-b217-1594d9525b9d triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:50:36.270308 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-eb0a4070-dc67-46e2-9b71-734b5c9bac86 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:36.320024 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5c65842a-dad4-4455-af4c-00d530a60e89 admin admin] Router 8cd82ce8-0774-460f-8427-ef14caab402a is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102161) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:50:36.428416 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5c65842a-dad4-4455-af4c-00d530a60e89 admin admin] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:50:36.437500 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-09423b13-2eec-4793-a13f-7d67f4a0db70 None None] Sync routers for ids ['8cd82ce8-0774-460f-8427-ef14caab402a'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:50:36.448123 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-09423b13-2eec-4793-a13f-7d67f4a0db70 None None] Routers {'8cd82ce8-0774-460f-8427-ef14caab402a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:50:36.448747 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-09423b13-2eec-4793-a13f-7d67f4a0db70 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:50:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8cd82ce8-0774-460f-8427-ef14caab402a'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:50:36.533688 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5c65842a-dad4-4455-af4c-00d530a60e89 admin admin] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:36.535306 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-5c65842a-dad4-4455-af4c-00d530a60e89 admin admin] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 1.9404590 Nov 09 04:50:36.537869 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 34202) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:50:36.604614 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-4fc3b95e-6efe-4f14-8376-ccd496eb40a3 None None] Provisioning complete for port 636c3090-6f35-4c2e-b217-1594d9525b9d triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:50:36.605135 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4fc3b95e-6efe-4f14-8376-ccd496eb40a3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:36.638496 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-09423b13-2eec-4793-a13f-7d67f4a0db70 None None] Set router 8cd82ce8-0774-460f-8427-ef14caab402a gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:50:36.817045 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-09423b13-2eec-4793-a13f-7d67f4a0db70 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'name': 'tempest-ServerActionsTestJSON-1679556620-router', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77'}], 'enable_snat': True}, 'gw_port_id': '6b137909-e697-434a-93b2-4272af33f319', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:50:34Z', 'updated_at': '2021-11-09T04:50:35Z', 'revision_number': 3, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'gw_port': {'id': '6b137909-e697-434a-93b2-4272af33f319', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:88:5d:d2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1569, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:35Z', 'updated_at': '2021-11-09T04:50:35Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:50:36.844731 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-09423b13-2eec-4793-a13f-7d67f4a0db70 None None] Checking router: 8cd82ce8-0774-460f-8427-ef14caab402a for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:50:36.845075 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-09423b13-2eec-4793-a13f-7d67f4a0db70 None None] Updating router 8cd82ce8-0774-460f-8427-ef14caab402a port 6b137909-e697-434a-93b2-4272af33f319 binding host dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 04:50:36.870919 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-09423b13-2eec-4793-a13f-7d67f4a0db70 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:37.126246 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-09423b13-2eec-4793-a13f-7d67f4a0db70 None None] Publish callbacks [] for port, precommit_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:37.188280 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-09423b13-2eec-4793-a13f-7d67f4a0db70 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:37.213840 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-eac0c3c3-4cfe-4907-ba53-a6dd29895ab5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:37.238662 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-09423b13-2eec-4793-a13f-7d67f4a0db70 None None] Attempting to bind port 6b137909-e697-434a-93b2-4272af33f319 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:50:37.239027 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-09423b13-2eec-4793-a13f-7d67f4a0db70 None None] Attempting to bind port 6b137909-e697-434a-93b2-4272af33f319 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:50:37.239384 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-09423b13-2eec-4793-a13f-7d67f4a0db70 None None] Attempting to bind port 6b137909-e697-434a-93b2-4272af33f319 on network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:50:37.247003 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da363f69-c1c3-4686-8381-585fb35ca295 None None] Pushing event updated for resources: {'Port': ['ID=6b137909-e697-434a-93b2-4272af33f319,revision_number=2']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:50:37.250781 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-09423b13-2eec-4793-a13f-7d67f4a0db70 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 50, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:50:37.250781 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-09423b13-2eec-4793-a13f-7d67f4a0db70 None None] Checking segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102164) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:50:37.251019 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-09423b13-2eec-4793-a13f-7d67f4a0db70 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:37.251316 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-09423b13-2eec-4793-a13f-7d67f4a0db70 None None] Bound using segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:50:37.251778 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-09423b13-2eec-4793-a13f-7d67f4a0db70 None None] Bound port: 6b137909-e697-434a-93b2-4272af33f319, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:50:37.252159 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-09423b13-2eec-4793-a13f-7d67f4a0db70 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:37.258176 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da363f69-c1c3-4686-8381-585fb35ca295 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:50:37.258552 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da363f69-c1c3-4686-8381-585fb35ca295 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:50:37.258889 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da363f69-c1c3-4686-8381-585fb35ca295 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:50:37.259219 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da363f69-c1c3-4686-8381-585fb35ca295 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:50:37.259541 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da363f69-c1c3-4686-8381-585fb35ca295 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:50:37.259864 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da363f69-c1c3-4686-8381-585fb35ca295 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:50:37.260183 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da363f69-c1c3-4686-8381-585fb35ca295 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:50:37.260502 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da363f69-c1c3-4686-8381-585fb35ca295 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:50:37.260825 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da363f69-c1c3-4686-8381-585fb35ca295 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:50:37.261140 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da363f69-c1c3-4686-8381-585fb35ca295 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:50:37.261489 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da363f69-c1c3-4686-8381-585fb35ca295 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:50:37.261795 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da363f69-c1c3-4686-8381-585fb35ca295 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:50:37.314422 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-09423b13-2eec-4793-a13f-7d67f4a0db70 None None] For port 6b137909-e697-434a-93b2-4272af33f319, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102164) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:50:37.317420 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-09423b13-2eec-4793-a13f-7d67f4a0db70 None None] For port 6b137909-e697-434a-93b2-4272af33f319, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=6b137909-e697-434a-93b2-4272af33f319,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102164) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:50:37.377755 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-09423b13-2eec-4793-a13f-7d67f4a0db70 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:37.413089 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-eac0c3c3-4cfe-4907-ba53-a6dd29895ab5 admin admin] Allocated IP 172.20.0.1 (d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21/96831da9-b0dd-45f9-8543-0ac226a68c6a/a23873f3-df1f-49c6-93aa-691a0e18c829) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:50:37.433948 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-09423b13-2eec-4793-a13f-7d67f4a0db70 None None] Routers {'8cd82ce8-0774-460f-8427-ef14caab402a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:50:37.434614 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-09423b13-2eec-4793-a13f-7d67f4a0db70 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:50:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8cd82ce8-0774-460f-8427-ef14caab402a'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:50:37.439439 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da363f69-c1c3-4686-8381-585fb35ca295 None None] Pushing event updated for resources: {'Port': ['ID=6b137909-e697-434a-93b2-4272af33f319,revision_number=3']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:50:37.517333 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-eac0c3c3-4cfe-4907-ba53-a6dd29895ab5 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:37.541335 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-09423b13-2eec-4793-a13f-7d67f4a0db70 None None] Set router 8cd82ce8-0774-460f-8427-ef14caab402a gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:50:37.605919 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-eac0c3c3-4cfe-4907-ba53-a6dd29895ab5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:37.644234 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eac0c3c3-4cfe-4907-ba53-a6dd29895ab5 admin admin] Network d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:50:37.648857 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-eac0c3c3-4cfe-4907-ba53-a6dd29895ab5 admin admin] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:50:37.651471 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eac0c3c3-4cfe-4907-ba53-a6dd29895ab5 admin admin] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:50:37.665105 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eac0c3c3-4cfe-4907-ba53-a6dd29895ab5 admin admin] Pushing event updated for resources: {'Port': ['ID=a23873f3-df1f-49c6-93aa-691a0e18c829,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:50:37.704157 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-eac0c3c3-4cfe-4907-ba53-a6dd29895ab5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:37.721289 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-09423b13-2eec-4793-a13f-7d67f4a0db70 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'name': 'tempest-ServerActionsTestJSON-1679556620-router', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77'}], 'enable_snat': True}, 'gw_port_id': '6b137909-e697-434a-93b2-4272af33f319', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:50:34Z', 'updated_at': '2021-11-09T04:50:35Z', 'revision_number': 3, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'gw_port': {'id': '6b137909-e697-434a-93b2-4272af33f319', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:88:5d:d2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1569, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:35Z', 'updated_at': '2021-11-09T04:50:37Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:50:37.751085 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-09423b13-2eec-4793-a13f-7d67f4a0db70 None None] The sync data for ids ['8cd82ce8-0774-460f-8427-ef14caab402a'] in dv-neutron-816802-2-hyperv is: [{'id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'name': 'tempest-ServerActionsTestJSON-1679556620-router', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77'}], 'enable_snat': True}, 'gw_port_id': '6b137909-e697-434a-93b2-4272af33f319', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:50:34Z', 'updated_at': '2021-11-09T04:50:35Z', 'revision_number': 3, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'gw_port': {'id': '6b137909-e697-434a-93b2-4272af33f319', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:88:5d:d2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1569, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:35Z', 'updated_at': '2021-11-09T04:50:37Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:50:37.834993 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 636c3090-6f35-4c2e-b217-1594d9525b9d up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:50:37.889543 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 636c3090-6f35-4c2e-b217-1594d9525b9d triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:50:37.890120 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:37.921530 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-eac0c3c3-4cfe-4907-ba53-a6dd29895ab5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:37.938274 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-5eed43ff-f7d4-45e9-a9be-9b6fb492ffe5 None None] Provisioning complete for port a23873f3-df1f-49c6-93aa-691a0e18c829 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:50:37.938542 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5eed43ff-f7d4-45e9-a9be-9b6fb492ffe5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:37.999466 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-5eed43ff-f7d4-45e9-a9be-9b6fb492ffe5 None None] Port a23873f3-df1f-49c6-93aa-691a0e18c829 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:50:38.116014 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-eac0c3c3-4cfe-4907-ba53-a6dd29895ab5 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:38.188046 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-eac0c3c3-4cfe-4907-ba53-a6dd29895ab5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:38.256872 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-eac0c3c3-4cfe-4907-ba53-a6dd29895ab5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:38.258527 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eac0c3c3-4cfe-4907-ba53-a6dd29895ab5 admin admin] Pushing event updated for resources: {'Port': ['ID=a23873f3-df1f-49c6-93aa-691a0e18c829,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:50:38.356092 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eac0c3c3-4cfe-4907-ba53-a6dd29895ab5 admin admin] Network d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:50:38.357765 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-eac0c3c3-4cfe-4907-ba53-a6dd29895ab5 admin admin] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:50:38.486968 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-eac0c3c3-4cfe-4907-ba53-a6dd29895ab5 admin admin] Router 8cd82ce8-0774-460f-8427-ef14caab402a has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:50:38.600340 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-eac0c3c3-4cfe-4907-ba53-a6dd29895ab5 admin admin] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:50:38.605444 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-eac0c3c3-4cfe-4907-ba53-a6dd29895ab5 admin admin] 10.222.0.24 "PUT /v2.0/routers/8cd82ce8-0774-460f-8427-ef14caab402a/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.0663660 Nov 09 04:50:38.624617 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-d4bed6d4-8a11-407a-83cd-41eb438415f5 None None] Provisioning complete for port a23873f3-df1f-49c6-93aa-691a0e18c829 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:50:38.625000 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d4bed6d4-8a11-407a-83cd-41eb438415f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:38.658593 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-d4bed6d4-8a11-407a-83cd-41eb438415f5 None None] Port a23873f3-df1f-49c6-93aa-691a0e18c829 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:50:39.315623 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8b4bffb1-6f32-4fba-80b1-371c572e7f23 None None] Sync routers for ids ['8cd82ce8-0774-460f-8427-ef14caab402a'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:50:39.325430 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8b4bffb1-6f32-4fba-80b1-371c572e7f23 None None] Routers {'8cd82ce8-0774-460f-8427-ef14caab402a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:50:39.326044 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-8b4bffb1-6f32-4fba-80b1-371c572e7f23 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:50:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8cd82ce8-0774-460f-8427-ef14caab402a'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:50:39.349996 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 34210) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:50:39.353791 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-6418bfda-f542-4464-9de2-4a4d20bfeaea tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Request body: {'security_group': {'name': 'tempest-securitygroup--873602357', 'description': 'tempest-description--494157859'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:50:39.430129 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-8b4bffb1-6f32-4fba-80b1-371c572e7f23 None None] Set router 8cd82ce8-0774-460f-8427-ef14caab402a gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:50:39.445226 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6418bfda-f542-4464-9de2-4a4d20bfeaea tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:39.510619 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6418bfda-f542-4464-9de2-4a4d20bfeaea tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:39.576632 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6418bfda-f542-4464-9de2-4a4d20bfeaea tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:39.608232 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6418bfda-f542-4464-9de2-4a4d20bfeaea tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f9cad1da-5723-46c3-9e10-9af8b6b844b8,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:50:39.624506 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-8b4bffb1-6f32-4fba-80b1-371c572e7f23 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'name': 'tempest-ServerActionsTestJSON-1679556620-router', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77'}], 'enable_snat': True}, 'gw_port_id': '6b137909-e697-434a-93b2-4272af33f319', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:50:34Z', 'updated_at': '2021-11-09T04:50:37Z', 'revision_number': 4, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'gw_port': {'id': '6b137909-e697-434a-93b2-4272af33f319', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:88:5d:d2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1569, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:35Z', 'updated_at': '2021-11-09T04:50:37Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'a23873f3-df1f-49c6-93aa-691a0e18c829', 'name': '', 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'mac_address': 'fa:16:3e:58:72:46', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1570, 'fixed_ips': [{'subnet_id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:37Z', 'updated_at': '2021-11-09T04:50:37Z', 'revision_number': 2, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'subnets': [{'id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:50:39.653667 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8b4bffb1-6f32-4fba-80b1-371c572e7f23 None None] Checking router: 8cd82ce8-0774-460f-8427-ef14caab402a for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:50:39.654014 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8b4bffb1-6f32-4fba-80b1-371c572e7f23 None None] Updating router 8cd82ce8-0774-460f-8427-ef14caab402a port a23873f3-df1f-49c6-93aa-691a0e18c829 binding host dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 04:50:39.658896 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6418bfda-f542-4464-9de2-4a4d20bfeaea tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:39.660165 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-6418bfda-f542-4464-9de2-4a4d20bfeaea tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1797 time: 0.3100677 Nov 09 04:50:39.663611 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 34212) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:50:39.668050 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-f569cf10-922e-49dc-83ac-dfe55118d83a tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Request body: {'security_group_rule': {'security_group_id': 'f9cad1da-5723-46c3-9e10-9af8b6b844b8', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:50:39.678087 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8b4bffb1-6f32-4fba-80b1-371c572e7f23 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:39.741248 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f569cf10-922e-49dc-83ac-dfe55118d83a tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:39.800311 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f569cf10-922e-49dc-83ac-dfe55118d83a tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:39.847317 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 6b137909-e697-434a-93b2-4272af33f319 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:50:39.856631 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f569cf10-922e-49dc-83ac-dfe55118d83a tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:39.874613 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f569cf10-922e-49dc-83ac-dfe55118d83a tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=97fde3c8-2078-4e6f-a8d6-8d9748083a2f,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:50:39.933526 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f569cf10-922e-49dc-83ac-dfe55118d83a tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:39.937238 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-f569cf10-922e-49dc-83ac-dfe55118d83a tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2703497 Nov 09 04:50:39.937363 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 6b137909-e697-434a-93b2-4272af33f319 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:50:39.937363 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:39.937522 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 34214) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:50:39.942023 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-d1a587c7-c4dd-430d-ad12-f9d2c41fb076 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Request body: {'security_group_rule': {'security_group_id': 'f9cad1da-5723-46c3-9e10-9af8b6b844b8', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:50:40.011664 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8b4bffb1-6f32-4fba-80b1-371c572e7f23 None None] Publish callbacks [] for port, precommit_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:40.015847 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d1a587c7-c4dd-430d-ad12-f9d2c41fb076 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:40.054001 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:40.070649 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d1a587c7-c4dd-430d-ad12-f9d2c41fb076 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:40.073024 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8b4bffb1-6f32-4fba-80b1-371c572e7f23 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:40.077135 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 6b137909-e697-434a-93b2-4272af33f319, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=6b137909-e697-434a-93b2-4272af33f319,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:50:40.131637 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1744f7bf-d6f9-404c-8474-97e0b98bf821 None None] Pushing event updated for resources: {'Port': ['ID=a23873f3-df1f-49c6-93aa-691a0e18c829,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:50:40.148730 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d1a587c7-c4dd-430d-ad12-f9d2c41fb076 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:40.151957 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:40.176807 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1a587c7-c4dd-430d-ad12-f9d2c41fb076 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c3a52dc3-e83c-482f-8f07-0cc8733554ca,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:50:40.201655 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-8b4bffb1-6f32-4fba-80b1-371c572e7f23 None None] Attempting to bind port a23873f3-df1f-49c6-93aa-691a0e18c829 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:50:40.202025 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-8b4bffb1-6f32-4fba-80b1-371c572e7f23 None None] Attempting to bind port a23873f3-df1f-49c6-93aa-691a0e18c829 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '24d74bfa-ba9d-4c10-aa08-4a4fed47543f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:50:40.202411 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8b4bffb1-6f32-4fba-80b1-371c572e7f23 None None] Attempting to bind port a23873f3-df1f-49c6-93aa-691a0e18c829 on network d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:50:40.215318 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8b4bffb1-6f32-4fba-80b1-371c572e7f23 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 50, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:50:40.215696 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8b4bffb1-6f32-4fba-80b1-371c572e7f23 None None] Checking segment: {'id': '24d74bfa-ba9d-4c10-aa08-4a4fed47543f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:50:40.216092 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8b4bffb1-6f32-4fba-80b1-371c572e7f23 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:40.216478 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8b4bffb1-6f32-4fba-80b1-371c572e7f23 None None] Bound using segment: {'id': '24d74bfa-ba9d-4c10-aa08-4a4fed47543f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:50:40.216944 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-8b4bffb1-6f32-4fba-80b1-371c572e7f23 None None] Bound port: a23873f3-df1f-49c6-93aa-691a0e18c829, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '24d74bfa-ba9d-4c10-aa08-4a4fed47543f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:50:40.217326 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8b4bffb1-6f32-4fba-80b1-371c572e7f23 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:40.236103 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=6b137909-e697-434a-93b2-4272af33f319,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:50:40.253130 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d1a587c7-c4dd-430d-ad12-f9d2c41fb076 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:40.256030 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-d1a587c7-c4dd-430d-ad12-f9d2c41fb076 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3171992 Nov 09 04:50:40.258651 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 34216) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:50:40.263168 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-2f3dcad5-44d1-4608-a8af-1a307055ceb6 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Request body: {'floatingip': {'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:50:40.292668 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-8b4bffb1-6f32-4fba-80b1-371c572e7f23 None None] For port a23873f3-df1f-49c6-93aa-691a0e18c829, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:50:40.296373 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-8b4bffb1-6f32-4fba-80b1-371c572e7f23 None None] For port a23873f3-df1f-49c6-93aa-691a0e18c829, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=a23873f3-df1f-49c6-93aa-691a0e18c829,segment=NetworkSegment(24d74bfa-ba9d-4c10-aa08-4a4fed47543f),segment_id=24d74bfa-ba9d-4c10-aa08-4a4fed47543f)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:50:40.347905 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2f3dcad5-44d1-4608-a8af-1a307055ceb6 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks [] for floatingip, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:40.374784 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8b4bffb1-6f32-4fba-80b1-371c572e7f23 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:40.447784 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1744f7bf-d6f9-404c-8474-97e0b98bf821 None None] Pushing event updated for resources: {'Port': ['ID=a23873f3-df1f-49c6-93aa-691a0e18c829,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:50:40.449138 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2f3dcad5-44d1-4608-a8af-1a307055ceb6 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:40.450942 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-d07b68eb-c61e-4e6f-b0a8-5b860f38d44c None None] Provisioning complete for port a23873f3-df1f-49c6-93aa-691a0e18c829 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:50:40.451467 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d07b68eb-c61e-4e6f-b0a8-5b860f38d44c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:40.453881 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8b4bffb1-6f32-4fba-80b1-371c572e7f23 None None] Routers {'8cd82ce8-0774-460f-8427-ef14caab402a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:50:40.454634 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-8b4bffb1-6f32-4fba-80b1-371c572e7f23 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:50:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8cd82ce8-0774-460f-8427-ef14caab402a'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:50:40.572019 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-2f3dcad5-44d1-4608-a8af-1a307055ceb6 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Allocated IP 172.26.0.146 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/98f9fb3c-9a2b-40f2-b28c-9059fcf82379) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:50:40.680900 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2f3dcad5-44d1-4608-a8af-1a307055ceb6 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:40.759913 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-8b4bffb1-6f32-4fba-80b1-371c572e7f23 None None] Set router 8cd82ce8-0774-460f-8427-ef14caab402a gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:50:40.765718 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2f3dcad5-44d1-4608-a8af-1a307055ceb6 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:40.797468 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d07b68eb-c61e-4e6f-b0a8-5b860f38d44c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:40.802447 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2f3dcad5-44d1-4608-a8af-1a307055ceb6 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:50:40.805235 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-2f3dcad5-44d1-4608-a8af-1a307055ceb6 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:50:40.815086 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2f3dcad5-44d1-4608-a8af-1a307055ceb6 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:50:40.839466 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f3dcad5-44d1-4608-a8af-1a307055ceb6 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Pushing event updated for resources: {'Port': ['ID=98f9fb3c-9a2b-40f2-b28c-9059fcf82379,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:50:40.879528 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-d07b68eb-c61e-4e6f-b0a8-5b860f38d44c None None] For port a23873f3-df1f-49c6-93aa-691a0e18c829, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=a23873f3-df1f-49c6-93aa-691a0e18c829,segment=NetworkSegment(24d74bfa-ba9d-4c10-aa08-4a4fed47543f),segment_id=24d74bfa-ba9d-4c10-aa08-4a4fed47543f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:50:40.903487 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2f3dcad5-44d1-4608-a8af-1a307055ceb6 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:40.960243 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d07b68eb-c61e-4e6f-b0a8-5b860f38d44c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:40.997991 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2f3dcad5-44d1-4608-a8af-1a307055ceb6 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:41.021713 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d07b68eb-c61e-4e6f-b0a8-5b860f38d44c None None] Pushing event updated for resources: {'Port': ['ID=a23873f3-df1f-49c6-93aa-691a0e18c829,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:50:41.033042 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-8b4bffb1-6f32-4fba-80b1-371c572e7f23 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'name': 'tempest-ServerActionsTestJSON-1679556620-router', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77'}], 'enable_snat': True}, 'gw_port_id': '6b137909-e697-434a-93b2-4272af33f319', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:50:34Z', 'updated_at': '2021-11-09T04:50:37Z', 'revision_number': 4, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'gw_port': {'id': '6b137909-e697-434a-93b2-4272af33f319', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:88:5d:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1569, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:35Z', 'updated_at': '2021-11-09T04:50:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'a23873f3-df1f-49c6-93aa-691a0e18c829', 'name': '', 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'mac_address': 'fa:16:3e:58:72:46', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1570, 'fixed_ips': [{'subnet_id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:37Z', 'updated_at': '2021-11-09T04:50:40Z', 'revision_number': 4, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'subnets': [{'id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:50:41.059235 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8b4bffb1-6f32-4fba-80b1-371c572e7f23 None None] The sync data for ids ['8cd82ce8-0774-460f-8427-ef14caab402a'] in dv-neutron-816802-2-hyperv is: [{'id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'name': 'tempest-ServerActionsTestJSON-1679556620-router', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77'}], 'enable_snat': True}, 'gw_port_id': '6b137909-e697-434a-93b2-4272af33f319', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:50:34Z', 'updated_at': '2021-11-09T04:50:37Z', 'revision_number': 4, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'gw_port': {'id': '6b137909-e697-434a-93b2-4272af33f319', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:88:5d:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1569, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:35Z', 'updated_at': '2021-11-09T04:50:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'a23873f3-df1f-49c6-93aa-691a0e18c829', 'name': '', 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'mac_address': 'fa:16:3e:58:72:46', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1570, 'fixed_ips': [{'subnet_id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:37Z', 'updated_at': '2021-11-09T04:50:40Z', 'revision_number': 4, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'subnets': [{'id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:50:41.079893 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-6dbc4fb7-a887-4c96-86f6-cbb5315c97a8 None None] Provisioning complete for port a23873f3-df1f-49c6-93aa-691a0e18c829 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:50:41.080258 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6dbc4fb7-a887-4c96-86f6-cbb5315c97a8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:41.163942 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2f3dcad5-44d1-4608-a8af-1a307055ceb6 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:41.223605 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2f3dcad5-44d1-4608-a8af-1a307055ceb6 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:41.289748 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f3dcad5-44d1-4608-a8af-1a307055ceb6 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Pushing event updated for resources: {'Port': ['ID=98f9fb3c-9a2b-40f2-b28c-9059fcf82379,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:50:41.305123 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2f3dcad5-44d1-4608-a8af-1a307055ceb6 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:41.383035 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f49db820-5c60-4f04-9c9a-7493b41c81b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:41.413923 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-2f3dcad5-44d1-4608-a8af-1a307055ceb6 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:41.420614 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-2f3dcad5-44d1-4608-a8af-1a307055ceb6 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 1.1555808 Nov 09 04:50:41.575249 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-4c7bfb5d-fd01-4a21-ade9-0153b9bfe923 req-523c1c45-2676-4588-9b2e-7f9ded44c1c1 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?name=tempest-securitygroup--873602357&fields=id&tenant_id=1a8335b645d04ccbad2f2ed5288b68e8 HTTP/1.1" status: 200 len: 267 time: 0.0443144 Nov 09 04:50:41.685503 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c7bfb5d-fd01-4a21-ade9-0153b9bfe923 req-056ffb86-91b9-4357-a96b-e05dfd7696ff tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:41.687077 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-4c7bfb5d-fd01-4a21-ade9-0153b9bfe923 req-056ffb86-91b9-4357-a96b-e05dfd7696ff tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/networks?id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 HTTP/1.1" status: 200 len: 812 time: 0.1045632 Nov 09 04:50:41.702540 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-4c7bfb5d-fd01-4a21-ade9-0153b9bfe923 req-144207c5-e868-4b51-a39d-981412d276ab tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/quotas/1a8335b645d04ccbad2f2ed5288b68e8 HTTP/1.1" status: 200 len: 375 time: 0.0096507 Nov 09 04:50:41.762883 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-4c7bfb5d-fd01-4a21-ade9-0153b9bfe923 req-bc340824-fdfa-417a-bc2a-2c766e5d9ceb tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?tenant_id=1a8335b645d04ccbad2f2ed5288b68e8&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0543275 Nov 09 04:50:41.781546 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [req-4c7bfb5d-fd01-4a21-ade9-0153b9bfe923 req-649ab8fc-22ca-4a7a-8101-766283c7015f service neutron] http://10.222.0.24:9696/v2.0/extensions returned with HTTP 200 {{(pid=102161) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:50:41.782579 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-4c7bfb5d-fd01-4a21-ade9-0153b9bfe923 req-649ab8fc-22ca-4a7a-8101-766283c7015f service neutron] 10.222.0.24 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0052679 Nov 09 04:50:41.890289 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-4c7bfb5d-fd01-4a21-ade9-0153b9bfe923 req-fe17a0cc-688b-4b2f-8313-b2ddfd8f453c service neutron] 10.222.0.24 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0969682 Nov 09 04:50:41.905030 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 6b137909-e697-434a-93b2-4272af33f319 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:50:41.956176 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 6b137909-e697-434a-93b2-4272af33f319 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:50:41.956779 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:41.997477 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-4c7bfb5d-fd01-4a21-ade9-0153b9bfe923 req-0dd3e1f7-2bae-4774-8ec3-5efdbe7f3cec service neutron] 10.222.0.24 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1029899 Nov 09 04:50:42.042515 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device a23873f3-df1f-49c6-93aa-691a0e18c829 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:50:42.091247 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port a23873f3-df1f-49c6-93aa-691a0e18c829 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:50:42.091615 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:42.398064 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f22b9dd6-3ef9-40ae-a212-8f51a2dd3140 req-443aa858-5bb9-4259-95ef-8234cb5a1593 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6 HTTP/1.1" status: 200 len: 210 time: 0.0323582 Nov 09 04:50:42.400568 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:43.351652 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-e693679f-fe59-4980-ba0c-917168c17d7c req-e6b65fca-b98b-4236-b983-d418de02453b tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6 HTTP/1.1" status: 200 len: 210 time: 0.0265322 Nov 09 04:50:43.690147 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ef33814e-d50f-4a02-a317-64e62f37b149 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:44.067643 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c7bfb5d-fd01-4a21-ade9-0153b9bfe923 req-5d5566e0-6762-4156-9c80-294bb6805c61 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:44.069061 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4c7bfb5d-fd01-4a21-ade9-0153b9bfe923 req-5d5566e0-6762-4156-9c80-294bb6805c61 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.26 "GET /v2.0/networks?id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 HTTP/1.1" status: 200 len: 812 time: 0.1013792 Nov 09 04:50:44.129369 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4c7bfb5d-fd01-4a21-ade9-0153b9bfe923 req-af4874dc-8ebd-4da6-8bf2-8f40023c4286 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.26 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=1a8335b645d04ccbad2f2ed5288b68e8 HTTP/1.1" status: 200 len: 379 time: 0.0498052 Nov 09 04:50:44.139058 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-4c7bfb5d-fd01-4a21-ade9-0153b9bfe923 req-db77cc56-fd7f-4c27-9e6e-57c8d179ed9d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Request body: {'port': {'device_id': 'febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6', 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21', 'admin_state_up': True, 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'security_groups': ['f9cad1da-5723-46c3-9e10-9af8b6b844b8']}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:50:44.307928 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4c7bfb5d-fd01-4a21-ade9-0153b9bfe923 req-db77cc56-fd7f-4c27-9e6e-57c8d179ed9d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Made reservation on behalf of 1a8335b645d04ccbad2f2ed5288b68e8 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:50:44.311667 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-4c7bfb5d-fd01-4a21-ade9-0153b9bfe923 req-db77cc56-fd7f-4c27-9e6e-57c8d179ed9d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:44.438021 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [req-4c7bfb5d-fd01-4a21-ade9-0153b9bfe923 req-db77cc56-fd7f-4c27-9e6e-57c8d179ed9d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Allocated IP 172.20.0.8 (d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21/96831da9-b0dd-45f9-8543-0ac226a68c6a/cae1e34a-0dec-4c1a-8eaf-49691add1205) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:50:44.485277 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2fab4931-ffa5-4efd-a18f-0265b741b3d7 req-73ab77d4-650e-45fd-8112-5cd23728d874 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6 HTTP/1.1" status: 200 len: 210 time: 0.0317380 Nov 09 04:50:44.592013 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-4c7bfb5d-fd01-4a21-ade9-0153b9bfe923 req-db77cc56-fd7f-4c27-9e6e-57c8d179ed9d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:44.713360 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-4c7bfb5d-fd01-4a21-ade9-0153b9bfe923 req-db77cc56-fd7f-4c27-9e6e-57c8d179ed9d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:44.757528 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4c7bfb5d-fd01-4a21-ade9-0153b9bfe923 req-db77cc56-fd7f-4c27-9e6e-57c8d179ed9d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Network d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:50:44.762378 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [req-4c7bfb5d-fd01-4a21-ade9-0153b9bfe923 req-db77cc56-fd7f-4c27-9e6e-57c8d179ed9d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:50:44.766057 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-4c7bfb5d-fd01-4a21-ade9-0153b9bfe923 req-db77cc56-fd7f-4c27-9e6e-57c8d179ed9d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:50:44.772913 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db77cc56-fd7f-4c27-9e6e-57c8d179ed9d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Pushing event updated for resources: {'Port': ['ID=cae1e34a-0dec-4c1a-8eaf-49691add1205,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:50:44.821024 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c7bfb5d-fd01-4a21-ade9-0153b9bfe923 req-db77cc56-fd7f-4c27-9e6e-57c8d179ed9d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:44.821024 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-4c7bfb5d-fd01-4a21-ade9-0153b9bfe923 req-db77cc56-fd7f-4c27-9e6e-57c8d179ed9d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:44.927775 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4c7bfb5d-fd01-4a21-ade9-0153b9bfe923 req-db77cc56-fd7f-4c27-9e6e-57c8d179ed9d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.26 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7920823 Nov 09 04:50:44.939816 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-4c7bfb5d-fd01-4a21-ade9-0153b9bfe923 req-74aa676a-f8c8-4de5-9cd7-07e5896bd4ee service neutron] Request body: {'port': {'device_id': 'febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:50:44.994843 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-4c7bfb5d-fd01-4a21-ade9-0153b9bfe923 req-74aa676a-f8c8-4de5-9cd7-07e5896bd4ee service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:45.031845 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-0be2cfff-7705-449c-9641-12324a99aec9 None None] Provisioning complete for port cae1e34a-0dec-4c1a-8eaf-49691add1205 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:50:45.032459 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0be2cfff-7705-449c-9641-12324a99aec9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:45.067365 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-0be2cfff-7705-449c-9641-12324a99aec9 None None] Port cae1e34a-0dec-4c1a-8eaf-49691add1205 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:50:45.142378 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:45.593080 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [req-4c7bfb5d-fd01-4a21-ade9-0153b9bfe923 req-74aa676a-f8c8-4de5-9cd7-07e5896bd4ee service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id cae1e34a-0dec-4c1a-8eaf-49691add1205 {{(pid=102162) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:50:45.601003 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-4c7bfb5d-fd01-4a21-ade9-0153b9bfe923 req-74aa676a-f8c8-4de5-9cd7-07e5896bd4ee service neutron] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:45.605177 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc1b7cfa-1838-4bab-9906-d85fc03615de req-a7cc4a55-634a-44ee-b646-33d724182e8f tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:45.606675 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-dc1b7cfa-1838-4bab-9906-d85fc03615de req-a7cc4a55-634a-44ee-b646-33d724182e8f tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6 HTTP/1.1" status: 200 len: 931 time: 0.0498011 Nov 09 04:50:45.612794 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.provisioning_blocks [req-4c7bfb5d-fd01-4a21-ade9-0153b9bfe923 req-74aa676a-f8c8-4de5-9cd7-07e5896bd4ee service neutron] Transition to ACTIVE for port object cae1e34a-0dec-4c1a-8eaf-49691add1205 will not be triggered until provisioned by entity L2. {{(pid=102162) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 09 04:50:45.652701 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-dc1b7cfa-1838-4bab-9906-d85fc03615de req-1b5cc2e1-ec39-4f2d-9ce4-6eed96bf7bcd tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0401077 Nov 09 04:50:45.684879 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-4c7bfb5d-fd01-4a21-ade9-0153b9bfe923 req-74aa676a-f8c8-4de5-9cd7-07e5896bd4ee service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:45.736947 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74aa676a-f8c8-4de5-9cd7-07e5896bd4ee service neutron] Pushing event updated for resources: {'Port': ['ID=cae1e34a-0dec-4c1a-8eaf-49691add1205,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:50:45.804246 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-4c7bfb5d-fd01-4a21-ade9-0153b9bfe923 req-74aa676a-f8c8-4de5-9cd7-07e5896bd4ee service neutron] Attempting to bind port cae1e34a-0dec-4c1a-8eaf-49691add1205 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:50:45.804586 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-4c7bfb5d-fd01-4a21-ade9-0153b9bfe923 req-74aa676a-f8c8-4de5-9cd7-07e5896bd4ee service neutron] Attempting to bind port cae1e34a-0dec-4c1a-8eaf-49691add1205 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '24d74bfa-ba9d-4c10-aa08-4a4fed47543f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:50:45.804910 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4c7bfb5d-fd01-4a21-ade9-0153b9bfe923 req-74aa676a-f8c8-4de5-9cd7-07e5896bd4ee service neutron] Attempting to bind port cae1e34a-0dec-4c1a-8eaf-49691add1205 on network d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:50:45.809516 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4c7bfb5d-fd01-4a21-ade9-0153b9bfe923 req-74aa676a-f8c8-4de5-9cd7-07e5896bd4ee service neutron] Port cae1e34a-0dec-4c1a-8eaf-49691add1205 on network d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:50:45.809830 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4c7bfb5d-fd01-4a21-ade9-0153b9bfe923 req-74aa676a-f8c8-4de5-9cd7-07e5896bd4ee service neutron] Attempting to bind port cae1e34a-0dec-4c1a-8eaf-49691add1205 on network d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:50:45.814719 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4c7bfb5d-fd01-4a21-ade9-0153b9bfe923 req-74aa676a-f8c8-4de5-9cd7-07e5896bd4ee service neutron] Checking agent: {'id': '7d36b884-4ad2-4878-9464-bf647030b544', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'started_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 50, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:50:45.815052 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4c7bfb5d-fd01-4a21-ade9-0153b9bfe923 req-74aa676a-f8c8-4de5-9cd7-07e5896bd4ee service neutron] Checking segment: {'id': '24d74bfa-ba9d-4c10-aa08-4a4fed47543f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:50:45.815436 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4c7bfb5d-fd01-4a21-ade9-0153b9bfe923 req-74aa676a-f8c8-4de5-9cd7-07e5896bd4ee service neutron] Bound using segment: {'id': '24d74bfa-ba9d-4c10-aa08-4a4fed47543f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21'} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:50:45.815857 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-4c7bfb5d-fd01-4a21-ade9-0153b9bfe923 req-74aa676a-f8c8-4de5-9cd7-07e5896bd4ee service neutron] Bound port: cae1e34a-0dec-4c1a-8eaf-49691add1205, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '24d74bfa-ba9d-4c10-aa08-4a4fed47543f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21'}}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:50:45.816206 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-4c7bfb5d-fd01-4a21-ade9-0153b9bfe923 req-74aa676a-f8c8-4de5-9cd7-07e5896bd4ee service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:45.883614 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-4c7bfb5d-fd01-4a21-ade9-0153b9bfe923 req-74aa676a-f8c8-4de5-9cd7-07e5896bd4ee service neutron] For port cae1e34a-0dec-4c1a-8eaf-49691add1205, host hv-neutron-8168, cleared binding levels {{(pid=102162) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:50:45.886953 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-4c7bfb5d-fd01-4a21-ade9-0153b9bfe923 req-74aa676a-f8c8-4de5-9cd7-07e5896bd4ee service neutron] For port cae1e34a-0dec-4c1a-8eaf-49691add1205, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=cae1e34a-0dec-4c1a-8eaf-49691add1205,segment=NetworkSegment(24d74bfa-ba9d-4c10-aa08-4a4fed47543f),segment_id=24d74bfa-ba9d-4c10-aa08-4a4fed47543f)] {{(pid=102162) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:50:46.011444 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-4c7bfb5d-fd01-4a21-ade9-0153b9bfe923 req-74aa676a-f8c8-4de5-9cd7-07e5896bd4ee service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:46.045697 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c7bfb5d-fd01-4a21-ade9-0153b9bfe923 req-74aa676a-f8c8-4de5-9cd7-07e5896bd4ee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:46.046315 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-4c7bfb5d-fd01-4a21-ade9-0153b9bfe923 req-74aa676a-f8c8-4de5-9cd7-07e5896bd4ee service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:46.047728 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4c7bfb5d-fd01-4a21-ade9-0153b9bfe923 req-74aa676a-f8c8-4de5-9cd7-07e5896bd4ee service neutron] 10.222.0.26 "PUT /v2.0/ports/cae1e34a-0dec-4c1a-8eaf-49691add1205 HTTP/1.1" status: 200 len: 1093 time: 1.1119840 Nov 09 04:50:46.048149 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6', 'tag': 'cae1e34a-0dec-4c1a-8eaf-49691add1205'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:50:46.050520 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-aa6e9757-0705-4dbd-83a7-edfd9cdfca00" -d '{"events": [{"name": "network-changed", "server_uuid": "febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6", "tag": "cae1e34a-0dec-4c1a-8eaf-49691add1205"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:50:46.079863 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74aa676a-f8c8-4de5-9cd7-07e5896bd4ee service neutron] Pushing event updated for resources: {'Port': ['ID=cae1e34a-0dec-4c1a-8eaf-49691add1205,revision_number=3']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:50:46.092795 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:50:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0116a8f9-3945-481c-9017-6dfd7030d67a x-openstack-request-id: req-0116a8f9-3945-481c-9017-6dfd7030d67a {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:50:46.093091 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6", "tag": "cae1e34a-0dec-4c1a-8eaf-49691add1205", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:50:46.093337 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-0116a8f9-3945-481c-9017-6dfd7030d67a {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:50:46.093743 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6', 'tag': 'cae1e34a-0dec-4c1a-8eaf-49691add1205', 'status': 'completed', 'code': 200} Nov 09 04:50:46.158535 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa6e9757-0705-4dbd-83a7-edfd9cdfca00 req-2f17f36c-a28a-4dba-b501-4ce6d0d2c70e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:46.163706 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-aa6e9757-0705-4dbd-83a7-edfd9cdfca00 req-2f17f36c-a28a-4dba-b501-4ce6d0d2c70e service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1a8335b645d04ccbad2f2ed5288b68e8&device_id=febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6 HTTP/1.1" status: 200 len: 1096 time: 0.0458727 Nov 09 04:50:46.258852 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa6e9757-0705-4dbd-83a7-edfd9cdfca00 req-dc607518-21db-4e98-8f79-169afffa55fd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:46.260329 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-aa6e9757-0705-4dbd-83a7-edfd9cdfca00 req-dc607518-21db-4e98-8f79-169afffa55fd service neutron] 10.222.0.26 "GET /v2.0/networks?tenant_id=1a8335b645d04ccbad2f2ed5288b68e8&shared=False HTTP/1.1" status: 200 len: 913 time: 0.0929646 Nov 09 04:50:46.357847 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa6e9757-0705-4dbd-83a7-edfd9cdfca00 req-0b7f5061-01aa-409a-87db-7322ed43676d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:46.359270 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-aa6e9757-0705-4dbd-83a7-edfd9cdfca00 req-0b7f5061-01aa-409a-87db-7322ed43676d service neutron] 10.222.0.26 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0914252 Nov 09 04:50:46.432350 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c7bfb5d-fd01-4a21-ade9-0153b9bfe923 req-6274021b-12e1-43d5-a0e7-4d2d196bb253 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:46.433820 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4c7bfb5d-fd01-4a21-ade9-0153b9bfe923 req-6274021b-12e1-43d5-a0e7-4d2d196bb253 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1a8335b645d04ccbad2f2ed5288b68e8&device_id=febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6 HTTP/1.1" status: 200 len: 1096 time: 0.0389378 Nov 09 04:50:46.475677 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4c7bfb5d-fd01-4a21-ade9-0153b9bfe923 req-2a078fc9-d765-491e-be79-d6046010ede0 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=cae1e34a-0dec-4c1a-8eaf-49691add1205 HTTP/1.1" status: 200 len: 217 time: 0.0338929 Nov 09 04:50:46.490198 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:46.527672 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c7bfb5d-fd01-4a21-ade9-0153b9bfe923 req-a48eae63-bf25-4f3c-a6b1-47e124db5928 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:46.529105 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4c7bfb5d-fd01-4a21-ade9-0153b9bfe923 req-a48eae63-bf25-4f3c-a6b1-47e124db5928 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=96831da9-b0dd-45f9-8543-0ac226a68c6a HTTP/1.1" status: 200 len: 851 time: 0.0464139 Nov 09 04:50:46.572529 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c7bfb5d-fd01-4a21-ade9-0153b9bfe923 req-1c9f0efa-5d86-4704-b3d7-88719b01c5e5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:46.573882 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4c7bfb5d-fd01-4a21-ade9-0153b9bfe923 req-1c9f0efa-5d86-4704-b3d7-88719b01c5e5 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0382080 Nov 09 04:50:46.666162 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4c7bfb5d-fd01-4a21-ade9-0153b9bfe923 req-e80e67a9-3fc8-46d1-9304-033fe63a9e4f service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0841763 Nov 09 04:50:46.756810 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4c7bfb5d-fd01-4a21-ade9-0153b9bfe923 req-75f7a1e4-a2e3-4b2f-86ce-1018e9203ab5 service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0833652 Nov 09 04:50:46.764038 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e5429f2-7171-439b-a73c-fa44853bc601 req-0fc9120a-770e-4b5a-b9b8-677eca097f86 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:46.765520 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-8e5429f2-7171-439b-a73c-fa44853bc601 req-0fc9120a-770e-4b5a-b9b8-677eca097f86 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6 HTTP/1.1" status: 200 len: 943 time: 0.0474863 Nov 09 04:50:46.815669 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-8e5429f2-7171-439b-a73c-fa44853bc601 req-f49cc953-a729-4da3-84f0-20d9d71b2742 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0441287 Nov 09 04:50:46.959176 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:47.934489 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f391cb27-c0ac-4fc8-859b-8883d69d9756 req-0de00d39-ee4e-4bdd-85ff-20f465464ad6 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:47.935950 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f391cb27-c0ac-4fc8-859b-8883d69d9756 req-0de00d39-ee4e-4bdd-85ff-20f465464ad6 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6 HTTP/1.1" status: 200 len: 943 time: 0.0527678 Nov 09 04:50:47.985604 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f391cb27-c0ac-4fc8-859b-8883d69d9756 req-041c1280-3a62-4448-bf61-fc757cf1a1f3 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0436339 Nov 09 04:50:49.099165 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4adf9e66-37b7-4e41-baf4-0a7d1ce81365 req-675f67f8-9d38-43f5-bb3e-a0d2b35dfc1d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:49.100542 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-4adf9e66-37b7-4e41-baf4-0a7d1ce81365 req-675f67f8-9d38-43f5-bb3e-a0d2b35dfc1d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6 HTTP/1.1" status: 200 len: 943 time: 0.0486350 Nov 09 04:50:49.145508 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-4adf9e66-37b7-4e41-baf4-0a7d1ce81365 req-b7d9dcce-0780-43b3-8650-69b73057738b tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0391772 Nov 09 04:50:50.257051 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2f33e0a-43b2-470f-b4d9-ca9c6cf60fe2 req-0b3831af-7784-4410-bf06-190addb240d7 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:50.258547 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f2f33e0a-43b2-470f-b4d9-ca9c6cf60fe2 req-0b3831af-7784-4410-bf06-190addb240d7 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6 HTTP/1.1" status: 200 len: 943 time: 0.0475557 Nov 09 04:50:50.304567 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f2f33e0a-43b2-470f-b4d9-ca9c6cf60fe2 req-3eaca62b-08ea-49a6-adaa-1a58fe6d22e9 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0401599 Nov 09 04:50:50.969924 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device cae1e34a-0dec-4c1a-8eaf-49691add1205 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=102163) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 09 04:50:51.070109 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port cae1e34a-0dec-4c1a-8eaf-49691add1205, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=cae1e34a-0dec-4c1a-8eaf-49691add1205,segment=NetworkSegment(24d74bfa-ba9d-4c10-aa08-4a4fed47543f),segment_id=24d74bfa-ba9d-4c10-aa08-4a4fed47543f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:50:51.081364 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Returning: {'device': 'cae1e34a-0dec-4c1a-8eaf-49691add1205', 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21', 'port_id': 'cae1e34a-0dec-4c1a-8eaf-49691add1205', 'mac_address': 'fa:16:3e:1b:46:9c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 310, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102163) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 09 04:50:51.120549 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:51.133327 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id cae1e34a-0dec-4c1a-8eaf-49691add1205 {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:50:51.151597 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port cae1e34a-0dec-4c1a-8eaf-49691add1205, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=cae1e34a-0dec-4c1a-8eaf-49691add1205,segment=NetworkSegment(24d74bfa-ba9d-4c10-aa08-4a4fed47543f),segment_id=24d74bfa-ba9d-4c10-aa08-4a4fed47543f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:50:51.228376 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:51.274171 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=cae1e34a-0dec-4c1a-8eaf-49691add1205,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:50:51.280968 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:50:51.281314 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:50:51.281653 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:50:51.281983 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:50:51.282308 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:50:51.282657 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:50:51.282980 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:50:51.283303 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:50:51.283624 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:50:51.283955 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:50:51.284256 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:50:51.284571 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:50:51.415772 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f6ca90d-13c3-4c0e-b5b0-3455e778b2bb req-4696e6b3-d917-48fe-8816-61ef6db2a660 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:51.417227 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-7f6ca90d-13c3-4c0e-b5b0-3455e778b2bb req-4696e6b3-d917-48fe-8816-61ef6db2a660 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6 HTTP/1.1" status: 200 len: 944 time: 0.0481498 Nov 09 04:50:51.434399 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['cae1e34a-0dec-4c1a-8eaf-49691add1205'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 04:50:51.466134 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-7f6ca90d-13c3-4c0e-b5b0-3455e778b2bb req-f7e5afb0-16ea-4c09-926b-778ea8d03470 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0411949 Nov 09 04:50:52.578474 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3169f103-38f2-4920-b3ac-c35fc0544a33 req-19c24bfb-2679-4272-ad00-54cad58ef660 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:52.579923 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3169f103-38f2-4920-b3ac-c35fc0544a33 req-19c24bfb-2679-4272-ad00-54cad58ef660 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6 HTTP/1.1" status: 200 len: 944 time: 0.0479860 Nov 09 04:50:52.624855 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3169f103-38f2-4920-b3ac-c35fc0544a33 req-28ffe895-0793-4fa4-80d7-c9c95c744bca tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0391805 Nov 09 04:50:52.986036 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device cae1e34a-0dec-4c1a-8eaf-49691add1205 up at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:50:53.090008 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning for port cae1e34a-0dec-4c1a-8eaf-49691add1205 completed by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 09 04:50:53.093940 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning complete for port cae1e34a-0dec-4c1a-8eaf-49691add1205 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:50:53.094308 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:53.171066 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:53.191807 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cae1e34a-0dec-4c1a-8eaf-49691add1205'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:50:53.194074 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-883484a8-790d-49f7-bbcf-466fec90fee7" -d '{"events": [{"server_uuid": "febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6", "name": "network-vif-plugged", "status": "completed", "tag": "cae1e34a-0dec-4c1a-8eaf-49691add1205"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:50:53.206703 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port cae1e34a-0dec-4c1a-8eaf-49691add1205, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=cae1e34a-0dec-4c1a-8eaf-49691add1205,segment=NetworkSegment(24d74bfa-ba9d-4c10-aa08-4a4fed47543f),segment_id=24d74bfa-ba9d-4c10-aa08-4a4fed47543f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:50:53.230578 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:50:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-84faa9f8-7da7-4080-9d12-370d7c3debec x-openstack-request-id: req-84faa9f8-7da7-4080-9d12-370d7c3debec {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:50:53.230868 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6", "name": "network-vif-plugged", "status": "completed", "tag": "cae1e34a-0dec-4c1a-8eaf-49691add1205", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:50:53.231118 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-84faa9f8-7da7-4080-9d12-370d7c3debec {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:50:53.231516 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cae1e34a-0dec-4c1a-8eaf-49691add1205', 'code': 200} Nov 09 04:50:53.250214 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:53.297199 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=cae1e34a-0dec-4c1a-8eaf-49691add1205,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:50:53.549246 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45517274-cfef-4f8a-aef1-85a2b7b964b0 req-b96f42ff-cd18-4454-8102-eb9b0f140b6c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:53.550704 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-45517274-cfef-4f8a-aef1-85a2b7b964b0 req-b96f42ff-cd18-4454-8102-eb9b0f140b6c service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6 HTTP/1.1" status: 200 len: 1098 time: 0.0415664 Nov 09 04:50:53.595935 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-45517274-cfef-4f8a-aef1-85a2b7b964b0 req-037f3e53-789e-4d31-a4c9-c6a74fbacf1a service neutron] 10.222.0.26 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0379126 Nov 09 04:50:53.736585 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ad23e42-f102-442f-bfbc-2ab1678e90f1 req-a714182d-ba0e-4f0e-b10c-880fef750747 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:53.738019 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8ad23e42-f102-442f-bfbc-2ab1678e90f1 req-a714182d-ba0e-4f0e-b10c-880fef750747 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6 HTTP/1.1" status: 200 len: 945 time: 0.0479736 Nov 09 04:50:53.783965 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8ad23e42-f102-442f-bfbc-2ab1678e90f1 req-9b6c55a9-a911-4f6d-8e39-fe6ccef7fc8d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0400329 Nov 09 04:50:54.904034 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-828da6dc-4140-4454-b374-36a908ac8381 req-74956472-9a20-47a4-8eff-a2a28d33422b tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:54.905483 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-828da6dc-4140-4454-b374-36a908ac8381 req-74956472-9a20-47a4-8eff-a2a28d33422b tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6 HTTP/1.1" status: 200 len: 945 time: 0.0531607 Nov 09 04:50:54.951794 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-828da6dc-4140-4454-b374-36a908ac8381 req-367ffc16-db40-468b-b0a7-6c466836f256 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0403130 Nov 09 04:50:56.064212 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c91c15e-09f3-4d51-b292-2fbc26075bed req-bda514cf-4557-414a-8f73-07f54ecd2369 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:56.065719 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1c91c15e-09f3-4d51-b292-2fbc26075bed req-bda514cf-4557-414a-8f73-07f54ecd2369 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6 HTTP/1.1" status: 200 len: 945 time: 0.0484524 Nov 09 04:50:56.116116 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1c91c15e-09f3-4d51-b292-2fbc26075bed req-30a0629e-c520-4576-98b8-d1bc72a6da19 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0433147 Nov 09 04:50:56.223183 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7d4164e-069b-4b9f-98f8-3cefc42a3081 req-480940b8-150c-45f0-b608-8dad084596b7 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:56.224612 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f7d4164e-069b-4b9f-98f8-3cefc42a3081 req-480940b8-150c-45f0-b608-8dad084596b7 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6 HTTP/1.1" status: 200 len: 945 time: 0.0476036 Nov 09 04:50:56.233512 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 34274) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:50:56.237746 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-2a1e6855-97cc-4eef-827d-a9485dbe5363 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Request body: {'floatingip': {'port_id': 'cae1e34a-0dec-4c1a-8eaf-49691add1205'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:50:56.280141 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2a1e6855-97cc-4eef-827d-a9485dbe5363 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks [] for floatingip, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:56.697476 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2a1e6855-97cc-4eef-827d-a9485dbe5363 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:56.765010 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2a1e6855-97cc-4eef-827d-a9485dbe5363 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:56.864587 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.l3_db [None req-2a1e6855-97cc-4eef-827d-a9485dbe5363 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Floating IP b0d36e82-421b-451c-b46c-718f80940b13 associated. External IP: 172.26.0.146, port: cae1e34a-0dec-4c1a-8eaf-49691add1205. Nov 09 04:50:57.079891 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2a1e6855-97cc-4eef-827d-a9485dbe5363 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Router 8cd82ce8-0774-460f-8427-ef14caab402a has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:50:57.470014 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2a1e6855-97cc-4eef-827d-a9485dbe5363 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:50:57.480700 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2a1e6855-97cc-4eef-827d-a9485dbe5363 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:50:57.487312 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7d236cda-2232-4b03-916f-5516ee74ebc1 None None] Sync routers for ids ['8cd82ce8-0774-460f-8427-ef14caab402a'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:50:57.503221 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7d236cda-2232-4b03-916f-5516ee74ebc1 None None] Routers {'8cd82ce8-0774-460f-8427-ef14caab402a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:50:57.503514 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-7d236cda-2232-4b03-916f-5516ee74ebc1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:50:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8cd82ce8-0774-460f-8427-ef14caab402a'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:50:57.512659 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-2a1e6855-97cc-4eef-827d-a9485dbe5363 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "PUT /v2.0/floatingips/b0d36e82-421b-451c-b46c-718f80940b13 HTTP/1.1" status: 200 len: 991 time: 1.2755587 Nov 09 04:50:57.512659 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6', 'tag': 'cae1e34a-0dec-4c1a-8eaf-49691add1205'}] {{(pid=102161) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:50:57.513190 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}99dfdda0def497b4372884ef2eb87f06b1e425c8eba5ceda5f64bbab037a07d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1d5f60d8-b8f5-4a09-b62b-c3e23134d6c9" -d '{"events": [{"name": "network-changed", "server_uuid": "febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6", "tag": "cae1e34a-0dec-4c1a-8eaf-49691add1205"}]}' {{(pid=102161) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:50:57.629781 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:50:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2055ae67-09db-481c-9afd-aa8f3b087d66 x-openstack-request-id: req-2055ae67-09db-481c-9afd-aa8f3b087d66 {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:50:57.630070 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6", "tag": "cae1e34a-0dec-4c1a-8eaf-49691add1205", "status": "completed", "code": 200}]} {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:50:57.630324 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-2055ae67-09db-481c-9afd-aa8f3b087d66 {{(pid=102161) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:50:57.630457 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-7d236cda-2232-4b03-916f-5516ee74ebc1 None None] Set router 8cd82ce8-0774-460f-8427-ef14caab402a gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:50:57.631580 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6', 'tag': 'cae1e34a-0dec-4c1a-8eaf-49691add1205', 'status': 'completed', 'code': 200} Nov 09 04:50:57.692206 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d5f60d8-b8f5-4a09-b62b-c3e23134d6c9 req-69c1d9df-160d-402a-8442-aa00cdf49b29 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:57.694201 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1d5f60d8-b8f5-4a09-b62b-c3e23134d6c9 req-69c1d9df-160d-402a-8442-aa00cdf49b29 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1a8335b645d04ccbad2f2ed5288b68e8&device_id=febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6 HTTP/1.1" status: 200 len: 1098 time: 0.0410812 Nov 09 04:50:57.786942 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d5f60d8-b8f5-4a09-b62b-c3e23134d6c9 req-98ba5699-ab8a-4ba4-b904-804fa1df2d0c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:57.789112 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1d5f60d8-b8f5-4a09-b62b-c3e23134d6c9 req-98ba5699-ab8a-4ba4-b904-804fa1df2d0c service neutron] 10.222.0.26 "GET /v2.0/networks?id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 HTTP/1.1" status: 200 len: 913 time: 0.0872531 Nov 09 04:50:57.863858 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1d5f60d8-b8f5-4a09-b62b-c3e23134d6c9 req-706c682f-fff6-4a66-910a-e72c3d47748a service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=cae1e34a-0dec-4c1a-8eaf-49691add1205 HTTP/1.1" status: 200 len: 999 time: 0.0659437 Nov 09 04:50:57.914446 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d5f60d8-b8f5-4a09-b62b-c3e23134d6c9 req-1571b6fd-005e-47e4-a1bb-f1406ad1a475 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:57.916792 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1d5f60d8-b8f5-4a09-b62b-c3e23134d6c9 req-1571b6fd-005e-47e4-a1bb-f1406ad1a475 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=96831da9-b0dd-45f9-8543-0ac226a68c6a HTTP/1.1" status: 200 len: 851 time: 0.0450456 Nov 09 04:50:57.961498 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d5f60d8-b8f5-4a09-b62b-c3e23134d6c9 req-50c1850f-aaec-4b20-87bb-423d64c318e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:50:57.963026 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1d5f60d8-b8f5-4a09-b62b-c3e23134d6c9 req-50c1850f-aaec-4b20-87bb-423d64c318e0 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0398636 Nov 09 04:50:57.964913 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-7d236cda-2232-4b03-916f-5516ee74ebc1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'name': 'tempest-ServerActionsTestJSON-1679556620-router', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77'}], 'enable_snat': True}, 'gw_port_id': '6b137909-e697-434a-93b2-4272af33f319', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:50:34Z', 'updated_at': '2021-11-09T04:50:37Z', 'revision_number': 4, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'gw_port': {'id': '6b137909-e697-434a-93b2-4272af33f319', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:88:5d:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1569, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:35Z', 'updated_at': '2021-11-09T04:50:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': 'b0d36e82-421b-451c-b46c-718f80940b13', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'floating_ip_address': '172.26.0.146', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'port_id': 'cae1e34a-0dec-4c1a-8eaf-49691add1205', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 1577, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21', 'mac_address': 'fa:16:3e:1b:46:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:50:40Z', 'updated_at': '2021-11-09T04:50:56Z', 'revision_number': 1, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a23873f3-df1f-49c6-93aa-691a0e18c829', 'name': '', 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'mac_address': 'fa:16:3e:58:72:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1570, 'fixed_ips': [{'subnet_id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:37Z', 'updated_at': '2021-11-09T04:50:40Z', 'revision_number': 5, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'subnets': [{'id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:50:57.991610 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7d236cda-2232-4b03-916f-5516ee74ebc1 None None] Checking router: 8cd82ce8-0774-460f-8427-ef14caab402a for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:50:57.999616 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7d236cda-2232-4b03-916f-5516ee74ebc1 None None] Routers {'8cd82ce8-0774-460f-8427-ef14caab402a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:50:58.000758 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-7d236cda-2232-4b03-916f-5516ee74ebc1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:50:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8cd82ce8-0774-460f-8427-ef14caab402a'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:50:58.059992 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1d5f60d8-b8f5-4a09-b62b-c3e23134d6c9 req-389a3421-3c9b-4e31-a5dc-dae29da53a47 service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0894561 Nov 09 04:50:58.106061 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-7d236cda-2232-4b03-916f-5516ee74ebc1 None None] Set router 8cd82ce8-0774-460f-8427-ef14caab402a gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:50:58.155196 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1d5f60d8-b8f5-4a09-b62b-c3e23134d6c9 req-11706bcc-3353-4448-88e2-76be53dc20ff service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0879202 Nov 09 04:50:58.327247 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-7d236cda-2232-4b03-916f-5516ee74ebc1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'name': 'tempest-ServerActionsTestJSON-1679556620-router', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77'}], 'enable_snat': True}, 'gw_port_id': '6b137909-e697-434a-93b2-4272af33f319', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:50:34Z', 'updated_at': '2021-11-09T04:50:37Z', 'revision_number': 4, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'gw_port': {'id': '6b137909-e697-434a-93b2-4272af33f319', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:88:5d:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1569, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:35Z', 'updated_at': '2021-11-09T04:50:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': 'b0d36e82-421b-451c-b46c-718f80940b13', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'floating_ip_address': '172.26.0.146', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'port_id': 'cae1e34a-0dec-4c1a-8eaf-49691add1205', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 1577, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21', 'mac_address': 'fa:16:3e:1b:46:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:50:40Z', 'updated_at': '2021-11-09T04:50:56Z', 'revision_number': 1, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a23873f3-df1f-49c6-93aa-691a0e18c829', 'name': '', 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'mac_address': 'fa:16:3e:58:72:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1570, 'fixed_ips': [{'subnet_id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:37Z', 'updated_at': '2021-11-09T04:50:40Z', 'revision_number': 5, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'subnets': [{'id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:50:58.353851 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7d236cda-2232-4b03-916f-5516ee74ebc1 None None] The sync data for ids ['8cd82ce8-0774-460f-8427-ef14caab402a'] in dv-neutron-816802-2-hyperv is: [{'id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'name': 'tempest-ServerActionsTestJSON-1679556620-router', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77'}], 'enable_snat': True}, 'gw_port_id': '6b137909-e697-434a-93b2-4272af33f319', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:50:34Z', 'updated_at': '2021-11-09T04:50:37Z', 'revision_number': 4, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'gw_port': {'id': '6b137909-e697-434a-93b2-4272af33f319', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:88:5d:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1569, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:35Z', 'updated_at': '2021-11-09T04:50:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': 'b0d36e82-421b-451c-b46c-718f80940b13', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'floating_ip_address': '172.26.0.146', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'port_id': 'cae1e34a-0dec-4c1a-8eaf-49691add1205', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 1577, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21', 'mac_address': 'fa:16:3e:1b:46:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:50:40Z', 'updated_at': '2021-11-09T04:50:56Z', 'revision_number': 1, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a23873f3-df1f-49c6-93aa-691a0e18c829', 'name': '', 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'mac_address': 'fa:16:3e:58:72:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1570, 'fixed_ips': [{'subnet_id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:37Z', 'updated_at': '2021-11-09T04:50:40Z', 'revision_number': 5, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'subnets': [{'id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:50:58.538479 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f778b208-320c-48f8-a811-b091189b2b9e None None] New status for floating IP b0d36e82-421b-451c-b46c-718f80940b13: ACTIVE {{(pid=102163) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 04:51:06.455705 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:51:08.299990 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-62e389d6-8523-41c3-8c78-93fafdf121a6 req-5fa0f70b-3c49-4118-9dfe-ee6d28d536f2 service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0381348 Nov 09 04:51:08.385782 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62e389d6-8523-41c3-8c78-93fafdf121a6 req-663d9fab-9d38-495a-8188-861af53f7c2b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:51:08.387306 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-62e389d6-8523-41c3-8c78-93fafdf121a6 req-663d9fab-9d38-495a-8188-861af53f7c2b service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1a8335b645d04ccbad2f2ed5288b68e8&device_id=febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6 HTTP/1.1" status: 200 len: 1098 time: 0.0427229 Nov 09 04:51:08.531414 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62e389d6-8523-41c3-8c78-93fafdf121a6 req-497849b9-c6dd-48c0-9de2-3a016f36a730 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:51:08.532846 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-62e389d6-8523-41c3-8c78-93fafdf121a6 req-497849b9-c6dd-48c0-9de2-3a016f36a730 service neutron] 10.222.0.26 "GET /v2.0/networks?id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 HTTP/1.1" status: 200 len: 913 time: 0.0873830 Nov 09 04:51:08.596226 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-62e389d6-8523-41c3-8c78-93fafdf121a6 req-b12f4315-77e2-462a-906a-f42e48f19a4c service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=cae1e34a-0dec-4c1a-8eaf-49691add1205 HTTP/1.1" status: 200 len: 1001 time: 0.0558908 Nov 09 04:51:08.642857 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62e389d6-8523-41c3-8c78-93fafdf121a6 req-12ae19a9-a935-4081-b045-bdeaece3d729 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:51:08.644204 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-62e389d6-8523-41c3-8c78-93fafdf121a6 req-12ae19a9-a935-4081-b045-bdeaece3d729 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=96831da9-b0dd-45f9-8543-0ac226a68c6a HTTP/1.1" status: 200 len: 851 time: 0.0417376 Nov 09 04:51:08.690599 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62e389d6-8523-41c3-8c78-93fafdf121a6 req-1d4922fe-f87c-4b1e-b36d-52985bb17870 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:51:08.692015 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-62e389d6-8523-41c3-8c78-93fafdf121a6 req-1d4922fe-f87c-4b1e-b36d-52985bb17870 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0413809 Nov 09 04:51:08.780349 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-62e389d6-8523-41c3-8c78-93fafdf121a6 req-d41958f6-fbb3-4f6e-8a2e-852cd87593e3 service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0805783 Nov 09 04:51:08.871522 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-62e389d6-8523-41c3-8c78-93fafdf121a6 req-8eb0580f-3389-400b-aa92-4eebda20073e service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0840425 Nov 09 04:51:11.392312 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-098244b3-4163-4e2c-98be-381e536f8648 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:51:12.283980 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:51:13.694855 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0bd8ea1a-1a79-42d2-b9a4-54760df60a0c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:51:15.141150 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:51:16.522851 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:51:16.980790 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:51:33.680442 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b80d22a-5076-498c-8ec7-895db165a0c4 req-8681d67b-cb29-443b-ba78-1d478535757e tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:51:33.682031 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-7b80d22a-5076-498c-8ec7-895db165a0c4 req-8681d67b-cb29-443b-ba78-1d478535757e tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6 HTTP/1.1" status: 200 len: 945 time: 0.0508459 Nov 09 04:51:33.731845 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-7b80d22a-5076-498c-8ec7-895db165a0c4 req-3db0c6ac-0857-4d61-b51d-9b83dfdf864a tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0437796 Nov 09 04:51:34.131187 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8718514c-ab8f-4ee2-a725-37e3f1d608a7 req-7b938abc-0180-420e-9cfa-d26d4a25441a tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:51:34.133125 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-8718514c-ab8f-4ee2-a725-37e3f1d608a7 req-7b938abc-0180-420e-9cfa-d26d4a25441a tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6 HTTP/1.1" status: 200 len: 945 time: 0.0500588 Nov 09 04:51:34.180428 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-8718514c-ab8f-4ee2-a725-37e3f1d608a7 req-ae81515e-8e52-4b2a-8a0c-44ef3857c806 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0414863 Nov 09 04:51:34.285122 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-45ef1a09-3800-4006-9add-cb416d5f8cff req-c99108ea-0804-452e-b05b-7186eef1cd68 service neutron] 10.222.0.24 "GET /v2.0/ports?device_id=febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0383861 Nov 09 04:51:35.299232 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59d1a165-46d2-4e0d-a1c5-4d8044464414 req-13bec4f3-1c75-415a-b87d-89f2ca811a54 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:51:35.300728 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-59d1a165-46d2-4e0d-a1c5-4d8044464414 req-13bec4f3-1c75-415a-b87d-89f2ca811a54 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6 HTTP/1.1" status: 200 len: 945 time: 0.0506077 Nov 09 04:51:35.348041 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-59d1a165-46d2-4e0d-a1c5-4d8044464414 req-a31fcce8-69cc-4478-aa64-a02127910e80 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0408401 Nov 09 04:51:36.115307 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45ef1a09-3800-4006-9add-cb416d5f8cff req-6cf1b9cc-4d65-4cbd-b0ab-05ee7d987a9d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:51:36.116707 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-45ef1a09-3800-4006-9add-cb416d5f8cff req-6cf1b9cc-4d65-4cbd-b0ab-05ee7d987a9d service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1a8335b645d04ccbad2f2ed5288b68e8&device_id=febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6 HTTP/1.1" status: 200 len: 1098 time: 0.0443943 Nov 09 04:51:36.206585 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45ef1a09-3800-4006-9add-cb416d5f8cff req-a72a94a0-3248-4652-abdd-f2aafbd2cfee service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:51:36.208611 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-45ef1a09-3800-4006-9add-cb416d5f8cff req-a72a94a0-3248-4652-abdd-f2aafbd2cfee service neutron] 10.222.0.26 "GET /v2.0/networks?id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 HTTP/1.1" status: 200 len: 913 time: 0.0834761 Nov 09 04:51:36.275394 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-45ef1a09-3800-4006-9add-cb416d5f8cff req-2713f2fb-3242-469c-9da8-d4870008aac1 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=cae1e34a-0dec-4c1a-8eaf-49691add1205 HTTP/1.1" status: 200 len: 1001 time: 0.0601633 Nov 09 04:51:36.324258 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45ef1a09-3800-4006-9add-cb416d5f8cff req-c852a4d0-a240-46c8-8657-5aedec1dce78 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:51:36.325661 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-45ef1a09-3800-4006-9add-cb416d5f8cff req-c852a4d0-a240-46c8-8657-5aedec1dce78 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=96831da9-b0dd-45f9-8543-0ac226a68c6a HTTP/1.1" status: 200 len: 851 time: 0.0425234 Nov 09 04:51:36.370869 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45ef1a09-3800-4006-9add-cb416d5f8cff req-d1411744-3c1e-4276-8730-5fec2ac44284 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:51:36.372329 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-45ef1a09-3800-4006-9add-cb416d5f8cff req-d1411744-3c1e-4276-8730-5fec2ac44284 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0379481 Nov 09 04:51:36.464558 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8c5c89f-7efc-4e3a-bfaf-9a252d219334 req-84dd3125-0600-47a5-b75f-7baccf960438 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:51:36.466042 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f8c5c89f-7efc-4e3a-bfaf-9a252d219334 req-84dd3125-0600-47a5-b75f-7baccf960438 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6 HTTP/1.1" status: 200 len: 945 time: 0.0487423 Nov 09 04:51:36.467637 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-45ef1a09-3800-4006-9add-cb416d5f8cff req-e8cb292d-0dc7-45d7-b107-73868f437d94 service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0867691 Nov 09 04:51:36.516794 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f8c5c89f-7efc-4e3a-bfaf-9a252d219334 req-4a57f608-03b7-4324-9fc9-687ac133ac87 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0448301 Nov 09 04:51:36.556743 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-45ef1a09-3800-4006-9add-cb416d5f8cff req-ea5e093f-b1ff-4b98-9038-cc3d0d436e09 service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0818741 Nov 09 04:51:37.634553 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf60ce0c-658f-4df0-a739-918fefbd2c0f req-5b210463-cdba-4493-8f02-ac8ea6327521 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:51:37.636012 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-bf60ce0c-658f-4df0-a739-918fefbd2c0f req-5b210463-cdba-4493-8f02-ac8ea6327521 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6 HTTP/1.1" status: 200 len: 945 time: 0.0526419 Nov 09 04:51:37.681716 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-bf60ce0c-658f-4df0-a739-918fefbd2c0f req-7cb2c6b0-c3ef-47ae-98bb-c192b6e1d665 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0398421 Nov 09 04:51:38.793987 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42132e03-435f-4127-8d3d-75be87f791d7 req-3e3647ed-6659-4ae9-9311-55848e02ccbe tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:51:38.795440 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-42132e03-435f-4127-8d3d-75be87f791d7 req-3e3647ed-6659-4ae9-9311-55848e02ccbe tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6 HTTP/1.1" status: 200 len: 945 time: 0.0472548 Nov 09 04:51:38.840259 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-42132e03-435f-4127-8d3d-75be87f791d7 req-d135f913-2a62-48c4-85d6-bdf30d34ef61 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0389910 Nov 09 04:51:39.952958 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff7e7456-4791-4c40-afaa-d0ea8b0404c6 req-c7a488c6-dc60-47cf-96d9-f76a8da666a9 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:51:39.954412 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ff7e7456-4791-4c40-afaa-d0ea8b0404c6 req-c7a488c6-dc60-47cf-96d9-f76a8da666a9 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6 HTTP/1.1" status: 200 len: 945 time: 0.0477366 Nov 09 04:51:40.000663 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ff7e7456-4791-4c40-afaa-d0ea8b0404c6 req-d8d71c44-2868-48ce-892b-36e6694f4770 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0404873 Nov 09 04:51:41.112947 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfd6fb86-7b15-4f7e-9f7d-0932677cfa00 req-685dfca7-1c38-4828-9930-34463c18a170 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:51:41.114421 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-cfd6fb86-7b15-4f7e-9f7d-0932677cfa00 req-685dfca7-1c38-4828-9930-34463c18a170 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6 HTTP/1.1" status: 200 len: 945 time: 0.0478339 Nov 09 04:51:41.159807 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-cfd6fb86-7b15-4f7e-9f7d-0932677cfa00 req-ee518f54-91a7-43d2-9321-186bb08f0bd5 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0394683 Nov 09 04:51:41.368681 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-370dad1e-5b2b-4063-95e3-b679cd57eb4a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:51:42.277200 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65e53a8d-9511-44bd-b2aa-a92e7fff9814 req-1a406f2f-6749-4156-8fce-511b8ef70752 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:51:42.277814 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:51:42.278710 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-65e53a8d-9511-44bd-b2aa-a92e7fff9814 req-1a406f2f-6749-4156-8fce-511b8ef70752 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6 HTTP/1.1" status: 200 len: 945 time: 0.0475605 Nov 09 04:51:42.329021 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-65e53a8d-9511-44bd-b2aa-a92e7fff9814 req-8bb5c677-7495-4f41-aa99-507dee9a3799 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0444183 Nov 09 04:51:43.445929 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9eb4e0dd-3a48-4928-8921-d2d067634ecb req-4a89dfb6-aa69-4efb-a568-30823e38c9bf tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:51:43.447415 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-9eb4e0dd-3a48-4928-8921-d2d067634ecb req-4a89dfb6-aa69-4efb-a568-30823e38c9bf tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6 HTTP/1.1" status: 200 len: 945 time: 0.0517237 Nov 09 04:51:43.454945 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:51:43.492804 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-9eb4e0dd-3a48-4928-8921-d2d067634ecb req-e99c2518-fb69-41ed-8cfc-c7276be66061 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0392923 Nov 09 04:51:43.705823 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-99ae2854-7eb6-4734-bae3-a8056805c188 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:51:44.609114 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0c06693-a0c9-4646-9335-71da488289e1 req-92c7d569-65c2-4e20-be3b-6fcfd4e6eae8 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:51:44.613239 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d0c06693-a0c9-4646-9335-71da488289e1 req-92c7d569-65c2-4e20-be3b-6fcfd4e6eae8 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6 HTTP/1.1" status: 200 len: 945 time: 0.0487983 Nov 09 04:51:44.657292 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d0c06693-a0c9-4646-9335-71da488289e1 req-2f8f267c-3ddf-423f-ad8d-6213c5eecb44 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0406938 Nov 09 04:51:45.167836 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:51:45.768553 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ccfcf5d-a168-48a1-9a2d-872435af8f80 req-7789dbc8-8bc4-43be-95cf-b61cd6829008 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:51:45.769985 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-3ccfcf5d-a168-48a1-9a2d-872435af8f80 req-7789dbc8-8bc4-43be-95cf-b61cd6829008 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6 HTTP/1.1" status: 200 len: 945 time: 0.0469828 Nov 09 04:51:45.816184 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-3ccfcf5d-a168-48a1-9a2d-872435af8f80 req-96dd88c0-d5bf-40d6-b125-4b6229530304 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0398812 Nov 09 04:51:46.499594 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:51:46.929285 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-783a3460-61c9-485c-886d-d046d782b363 req-97cab1ea-24c2-494b-8218-fa16e0a56208 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:51:46.930769 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-783a3460-61c9-485c-886d-d046d782b363 req-97cab1ea-24c2-494b-8218-fa16e0a56208 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6 HTTP/1.1" status: 200 len: 945 time: 0.0484970 Nov 09 04:51:46.951232 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:51:46.977483 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-783a3460-61c9-485c-886d-d046d782b363 req-941c861a-05b1-48d6-b5e8-da88ebcdd50e tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0408025 Nov 09 04:51:48.095379 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c300815d-e765-4b44-9b4f-61b6a3895b90 req-772a270c-7a73-4852-a848-c10cc07815a8 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:51:48.096741 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c300815d-e765-4b44-9b4f-61b6a3895b90 req-772a270c-7a73-4852-a848-c10cc07815a8 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6 HTTP/1.1" status: 200 len: 945 time: 0.0513976 Nov 09 04:51:48.146072 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c300815d-e765-4b44-9b4f-61b6a3895b90 req-dda05e3e-c745-41ff-9fbc-5fea72d92748 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0429595 Nov 09 04:51:48.414715 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-45ef1a09-3800-4006-9add-cb416d5f8cff req-a195c410-e065-403f-b490-0d7696c420b2 service neutron] 10.222.0.26 "GET /v2.0/ports/cae1e34a-0dec-4c1a-8eaf-49691add1205/bindings/hv-neutron-8168 HTTP/1.1" status: 200 len: 384 time: 0.0579257 Nov 09 04:51:48.888047 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45ef1a09-3800-4006-9add-cb416d5f8cff req-6be3ff33-70e4-4763-9511-d9099339a6a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:51:48.889543 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-45ef1a09-3800-4006-9add-cb416d5f8cff req-6be3ff33-70e4-4763-9511-d9099339a6a3 service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6&tenant_id=1a8335b645d04ccbad2f2ed5288b68e8 HTTP/1.1" status: 200 len: 1098 time: 0.0398476 Nov 09 04:51:48.949373 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45ef1a09-3800-4006-9add-cb416d5f8cff req-446e3d9e-91c8-4c2b-92d4-60d2dacaf694 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:51:48.950841 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-45ef1a09-3800-4006-9add-cb416d5f8cff req-446e3d9e-91c8-4c2b-92d4-60d2dacaf694 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1a8335b645d04ccbad2f2ed5288b68e8&device_id=febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6 HTTP/1.1" status: 200 len: 1098 time: 0.0385222 Nov 09 04:51:49.045595 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45ef1a09-3800-4006-9add-cb416d5f8cff req-f849d94e-e513-4c4c-84b8-4c15f6c424d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:51:49.047094 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-45ef1a09-3800-4006-9add-cb416d5f8cff req-f849d94e-e513-4c4c-84b8-4c15f6c424d0 service neutron] 10.222.0.26 "GET /v2.0/networks?id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 HTTP/1.1" status: 200 len: 913 time: 0.0886343 Nov 09 04:51:49.110973 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-45ef1a09-3800-4006-9add-cb416d5f8cff req-e82688fd-fafb-45f8-8ced-94334be1a618 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=cae1e34a-0dec-4c1a-8eaf-49691add1205 HTTP/1.1" status: 200 len: 1001 time: 0.0566750 Nov 09 04:51:49.159424 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45ef1a09-3800-4006-9add-cb416d5f8cff req-4e54f4ca-dea4-4155-9dc2-c864a82b46fe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:51:49.160754 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-45ef1a09-3800-4006-9add-cb416d5f8cff req-4e54f4ca-dea4-4155-9dc2-c864a82b46fe service neutron] 10.222.0.26 "GET /v2.0/subnets?id=96831da9-b0dd-45f9-8543-0ac226a68c6a HTTP/1.1" status: 200 len: 851 time: 0.0429175 Nov 09 04:51:49.210918 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45ef1a09-3800-4006-9add-cb416d5f8cff req-6594e5dd-43a6-439f-aa0b-fb38dd9a7150 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:51:49.212417 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-45ef1a09-3800-4006-9add-cb416d5f8cff req-6594e5dd-43a6-439f-aa0b-fb38dd9a7150 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0446959 Nov 09 04:51:49.311529 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-286b5fe3-d65c-4e24-af26-b9c224aae329 req-a697fb9e-b67d-44bc-aee2-609ef520bcea tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:51:49.313076 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-286b5fe3-d65c-4e24-af26-b9c224aae329 req-a697fb9e-b67d-44bc-aee2-609ef520bcea tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6 HTTP/1.1" status: 200 len: 945 time: 0.0991187 Nov 09 04:51:49.347928 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-45ef1a09-3800-4006-9add-cb416d5f8cff req-e1751bf7-5a14-4c88-92b0-1cde1133e1dd service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1259568 Nov 09 04:51:49.397622 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-286b5fe3-d65c-4e24-af26-b9c224aae329 req-baf81d18-919d-4057-a76d-96e9ee2f80a4 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0779731 Nov 09 04:51:49.453130 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-45ef1a09-3800-4006-9add-cb416d5f8cff req-42c56804-9ae0-4c38-a2df-e9ed5f44f143 service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0947773 Nov 09 04:51:50.511552 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aaff8935-2735-476b-a6f4-d791e44f540b req-28dceba2-4079-4ed1-98a9-63817f038ffb tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:51:50.513009 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-aaff8935-2735-476b-a6f4-d791e44f540b req-28dceba2-4079-4ed1-98a9-63817f038ffb tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6 HTTP/1.1" status: 200 len: 945 time: 0.0480082 Nov 09 04:51:50.558962 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-aaff8935-2735-476b-a6f4-d791e44f540b req-09a00e95-5bda-4b00-a9d7-6e7ccc295e5e tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0401158 Nov 09 04:51:51.675072 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47c612b9-6521-496a-80ce-277862a78341 req-c6912360-40d4-4c74-857e-a5f8646b2862 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:51:51.676513 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-47c612b9-6521-496a-80ce-277862a78341 req-c6912360-40d4-4c74-857e-a5f8646b2862 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6 HTTP/1.1" status: 200 len: 945 time: 0.0525053 Nov 09 04:51:51.722779 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-47c612b9-6521-496a-80ce-277862a78341 req-fb3a6636-199c-4091-8aa6-fd3ad6f86a32 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0398457 Nov 09 04:51:52.069213 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8851edf7-b91f-46fb-b66b-891cff0a9a1c req-b5eeec1c-6bd2-4241-9c66-d75a1afb2543 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:51:52.070715 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8851edf7-b91f-46fb-b66b-891cff0a9a1c req-b5eeec1c-6bd2-4241-9c66-d75a1afb2543 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6 HTTP/1.1" status: 200 len: 945 time: 0.0486355 Nov 09 04:51:52.120549 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8851edf7-b91f-46fb-b66b-891cff0a9a1c req-c3f71d26-41b5-462e-ae03-80386b26d07b tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0430179 Nov 09 04:51:52.177110 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0f96fa8-6f55-43d8-bb53-33b479d2f2e0 req-655da149-44ee-4451-b06e-b42955ae06f2 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:51:52.179169 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f0f96fa8-6f55-43d8-bb53-33b479d2f2e0 req-655da149-44ee-4451-b06e-b42955ae06f2 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.26 "GET /v2.0/ports?device_id=febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6&tenant_id=1a8335b645d04ccbad2f2ed5288b68e8&binding%3Ahost_id=hv-neutron-8168 HTTP/1.1" status: 200 len: 945 time: 0.0488482 Nov 09 04:51:52.261053 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0f96fa8-6f55-43d8-bb53-33b479d2f2e0 req-075cf092-997e-4ce4-96f8-9c11c3850848 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:51:52.262583 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f0f96fa8-6f55-43d8-bb53-33b479d2f2e0 req-075cf092-997e-4ce4-96f8-9c11c3850848 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1a8335b645d04ccbad2f2ed5288b68e8&device_id=febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6 HTTP/1.1" status: 200 len: 1098 time: 0.0426214 Nov 09 04:51:52.352010 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0f96fa8-6f55-43d8-bb53-33b479d2f2e0 req-9f22f474-b212-4e9c-98bc-9688c8879749 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:51:52.353484 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f0f96fa8-6f55-43d8-bb53-33b479d2f2e0 req-9f22f474-b212-4e9c-98bc-9688c8879749 service neutron] 10.222.0.26 "GET /v2.0/networks?id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 HTTP/1.1" status: 200 len: 913 time: 0.0840309 Nov 09 04:51:52.421023 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f0f96fa8-6f55-43d8-bb53-33b479d2f2e0 req-1c615f25-e381-4997-9288-0cba38621ee4 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=cae1e34a-0dec-4c1a-8eaf-49691add1205 HTTP/1.1" status: 200 len: 1001 time: 0.0605769 Nov 09 04:51:52.470938 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0f96fa8-6f55-43d8-bb53-33b479d2f2e0 req-6f5fd5ed-d832-4ba7-8309-a922eaf14f5e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:51:52.472373 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f0f96fa8-6f55-43d8-bb53-33b479d2f2e0 req-6f5fd5ed-d832-4ba7-8309-a922eaf14f5e service neutron] 10.222.0.26 "GET /v2.0/subnets?id=96831da9-b0dd-45f9-8543-0ac226a68c6a HTTP/1.1" status: 200 len: 851 time: 0.0442550 Nov 09 04:51:52.515996 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0f96fa8-6f55-43d8-bb53-33b479d2f2e0 req-3e0f1efc-5c59-4e44-a1f2-5fda79b09d0d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:51:52.517446 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f0f96fa8-6f55-43d8-bb53-33b479d2f2e0 req-3e0f1efc-5c59-4e44-a1f2-5fda79b09d0d service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0384130 Nov 09 04:51:52.607592 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f0f96fa8-6f55-43d8-bb53-33b479d2f2e0 req-e33e22df-27db-4976-a872-2c800ad85982 service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0829716 Nov 09 04:51:52.694692 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f0f96fa8-6f55-43d8-bb53-33b479d2f2e0 req-84e33d66-af93-43d8-8a0c-565ed06a4b90 service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0798802 Nov 09 04:51:53.244029 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c05b325-14f6-481d-93a4-de2fe65750bf req-a7e7d252-7008-4597-bab4-0d261e46e678 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:51:53.245512 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-1c05b325-14f6-481d-93a4-de2fe65750bf req-a7e7d252-7008-4597-bab4-0d261e46e678 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6 HTTP/1.1" status: 200 len: 945 time: 0.0572379 Nov 09 04:51:53.294976 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-1c05b325-14f6-481d-93a4-de2fe65750bf req-4b5a36a6-b7da-495d-9b3a-66b97d5f9d88 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0433550 Nov 09 04:51:53.304334 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device cae1e34a-0dec-4c1a-8eaf-49691add1205 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=102163) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 09 04:51:53.308319 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device cae1e34a-0dec-4c1a-8eaf-49691add1205 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:51:53.454424 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:51:53.483074 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port cae1e34a-0dec-4c1a-8eaf-49691add1205, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=cae1e34a-0dec-4c1a-8eaf-49691add1205,segment=NetworkSegment(24d74bfa-ba9d-4c10-aa08-4a4fed47543f),segment_id=24d74bfa-ba9d-4c10-aa08-4a4fed47543f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:51:53.493881 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'cae1e34a-0dec-4c1a-8eaf-49691add1205'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:51:53.496109 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d9ca8174-f407-4f42-a24c-fab031a172f8" -d '{"events": [{"server_uuid": "febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6", "name": "network-vif-unplugged", "status": "completed", "tag": "cae1e34a-0dec-4c1a-8eaf-49691add1205"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:51:53.509540 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Returning: {'device': 'cae1e34a-0dec-4c1a-8eaf-49691add1205', 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21', 'port_id': 'cae1e34a-0dec-4c1a-8eaf-49691add1205', 'mac_address': 'fa:16:3e:1b:46:9c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 310, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102163) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 09 04:51:53.512034 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port cae1e34a-0dec-4c1a-8eaf-49691add1205, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=cae1e34a-0dec-4c1a-8eaf-49691add1205,segment=NetworkSegment(24d74bfa-ba9d-4c10-aa08-4a4fed47543f),segment_id=24d74bfa-ba9d-4c10-aa08-4a4fed47543f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:51:53.536387 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 09 Nov 2021 04:51:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-86a9d524-d3a9-4b92-a88c-af5a4be18fe4 x-openstack-request-id: req-86a9d524-d3a9-4b92-a88c-af5a4be18fe4 {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:51:53.536387 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6", "name": "network-vif-unplugged", "status": "completed", "tag": "cae1e34a-0dec-4c1a-8eaf-49691add1205", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:51:53.536387 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-86a9d524-d3a9-4b92-a88c-af5a4be18fe4 {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:51:53.536387 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'cae1e34a-0dec-4c1a-8eaf-49691add1205', 'code': 200} Nov 09 04:51:53.550949 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:51:53.567764 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id cae1e34a-0dec-4c1a-8eaf-49691add1205 {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:51:53.585723 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:51:53.657685 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.db.api [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=102163) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:51:53.658045 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG oslo_db.api [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:51:53.658547 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=cae1e34a-0dec-4c1a-8eaf-49691add1205,revision_number=6']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:51:53.665935 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:51:53.666288 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:51:53.666649 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:51:53.666985 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:51:53.667319 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:51:53.667654 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:51:53.667985 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:51:53.668316 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:51:53.668643 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:51:53.668965 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:51:53.669288 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:51:53.669608 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:51:54.192349 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:51:54.208024 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id cae1e34a-0dec-4c1a-8eaf-49691add1205 {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:51:54.227959 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port cae1e34a-0dec-4c1a-8eaf-49691add1205, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=cae1e34a-0dec-4c1a-8eaf-49691add1205,segment=NetworkSegment(24d74bfa-ba9d-4c10-aa08-4a4fed47543f),segment_id=24d74bfa-ba9d-4c10-aa08-4a4fed47543f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:51:54.321582 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:51:54.373105 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=cae1e34a-0dec-4c1a-8eaf-49691add1205,revision_number=7']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:51:54.381735 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['cae1e34a-0dec-4c1a-8eaf-49691add1205'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 04:51:54.414491 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89f4e1f2-32c0-4d3a-8549-3272a55e88f4 req-5fb2c52b-bfc5-4ae5-9772-e73a178886d0 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:51:54.415969 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-89f4e1f2-32c0-4d3a-8549-3272a55e88f4 req-5fb2c52b-bfc5-4ae5-9772-e73a178886d0 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6 HTTP/1.1" status: 200 len: 944 time: 0.0524087 Nov 09 04:51:54.463349 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-89f4e1f2-32c0-4d3a-8549-3272a55e88f4 req-be9ea7d7-779b-42a4-b4dc-ab616a29f454 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0411174 Nov 09 04:51:54.580618 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6f78bdd-0e07-4eea-86eb-aee1925667ba req-17858553-7c8d-4856-aa5c-bfc83d995d09 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:51:54.582069 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f6f78bdd-0e07-4eea-86eb-aee1925667ba req-17858553-7c8d-4856-aa5c-bfc83d995d09 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6 HTTP/1.1" status: 200 len: 944 time: 0.0518901 Nov 09 04:51:54.628243 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f6f78bdd-0e07-4eea-86eb-aee1925667ba req-f8128c00-203d-4bf8-a9b6-2b40e49f196e tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0403295 Nov 09 04:51:54.737833 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3646d74-9395-4e79-a509-3c2b47f4e48f req-54ebe1fb-8d9a-4c25-b944-78be0b5dfe15 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:51:54.739222 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-e3646d74-9395-4e79-a509-3c2b47f4e48f req-54ebe1fb-8d9a-4c25-b944-78be0b5dfe15 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6 HTTP/1.1" status: 200 len: 944 time: 0.0472710 Nov 09 04:51:54.785537 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-e3646d74-9395-4e79-a509-3c2b47f4e48f req-d9d1adad-499e-428b-abd7-c75221ecaba5 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0399923 Nov 09 04:51:55.174454 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7b9a32e-0b0b-4ea2-aacc-e22b2e224408 req-8c5eea2e-075e-445c-aad4-8dd584ff9581 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:51:55.175905 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d7b9a32e-0b0b-4ea2-aacc-e22b2e224408 req-8c5eea2e-075e-445c-aad4-8dd584ff9581 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6 HTTP/1.1" status: 200 len: 944 time: 0.0502677 Nov 09 04:51:55.228371 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d7b9a32e-0b0b-4ea2-aacc-e22b2e224408 req-838856ba-474e-411e-bdc8-d77909e82e6b tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0457771 Nov 09 04:51:55.304758 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device cae1e34a-0dec-4c1a-8eaf-49691add1205 up at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:51:55.353924 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning complete for port cae1e34a-0dec-4c1a-8eaf-49691add1205 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:51:55.354547 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:51:55.426702 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:51:55.456271 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port cae1e34a-0dec-4c1a-8eaf-49691add1205, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=cae1e34a-0dec-4c1a-8eaf-49691add1205,segment=NetworkSegment(24d74bfa-ba9d-4c10-aa08-4a4fed47543f),segment_id=24d74bfa-ba9d-4c10-aa08-4a4fed47543f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:51:55.523190 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:51:55.546839 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cae1e34a-0dec-4c1a-8eaf-49691add1205'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:51:55.548978 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ce518266-c7a2-407d-8045-f6f1125dee95" -d '{"events": [{"server_uuid": "febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6", "name": "network-vif-plugged", "status": "completed", "tag": "cae1e34a-0dec-4c1a-8eaf-49691add1205"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:51:55.576187 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=cae1e34a-0dec-4c1a-8eaf-49691add1205,revision_number=8']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:51:55.587078 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:51:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8976451f-1ef3-4b78-818b-9fd4f113b571 x-openstack-request-id: req-8976451f-1ef3-4b78-818b-9fd4f113b571 {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:51:55.587372 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6", "name": "network-vif-plugged", "status": "completed", "tag": "cae1e34a-0dec-4c1a-8eaf-49691add1205", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:51:55.587621 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-8976451f-1ef3-4b78-818b-9fd4f113b571 {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:51:55.588010 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cae1e34a-0dec-4c1a-8eaf-49691add1205', 'code': 200} Nov 09 04:51:56.340660 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11a510fd-ce9b-4cb7-9a43-5d9de3929e8d req-16265956-00a7-402c-9bca-c54a40ac3a3e tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:51:56.342095 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-11a510fd-ce9b-4cb7-9a43-5d9de3929e8d req-16265956-00a7-402c-9bca-c54a40ac3a3e tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6 HTTP/1.1" status: 200 len: 945 time: 0.0470018 Nov 09 04:51:56.388481 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-11a510fd-ce9b-4cb7-9a43-5d9de3929e8d req-0df8df0d-b2ec-44f9-aa17-cfa1c31feef9 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0405593 Nov 09 04:51:56.900935 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ebb27db-a262-421e-8315-ff86f740dbbb req-e5e887a2-a1bf-45f2-a116-da47285a77f0 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:51:56.902452 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4ebb27db-a262-421e-8315-ff86f740dbbb req-e5e887a2-a1bf-45f2-a116-da47285a77f0 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.26 "GET /v2.0/ports?device_id=febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6 HTTP/1.1" status: 200 len: 945 time: 0.0480807 Nov 09 04:51:56.994056 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-4ebb27db-a262-421e-8315-ff86f740dbbb req-68140c2d-e66b-4846-9bf2-e3fca0d7b942 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Deleting port cae1e34a-0dec-4c1a-8eaf-49691add1205 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:51:56.994331 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-4ebb27db-a262-421e-8315-ff86f740dbbb req-68140c2d-e66b-4846-9bf2-e3fca0d7b942 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:51:57.082991 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-4ebb27db-a262-421e-8315-ff86f740dbbb req-68140c2d-e66b-4846-9bf2-e3fca0d7b942 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] For port cae1e34a-0dec-4c1a-8eaf-49691add1205, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=cae1e34a-0dec-4c1a-8eaf-49691add1205,segment=NetworkSegment(24d74bfa-ba9d-4c10-aa08-4a4fed47543f),segment_id=24d74bfa-ba9d-4c10-aa08-4a4fed47543f)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:51:57.083344 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-4ebb27db-a262-421e-8315-ff86f740dbbb req-68140c2d-e66b-4846-9bf2-e3fca0d7b942 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:51:57.257902 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-4ebb27db-a262-421e-8315-ff86f740dbbb req-68140c2d-e66b-4846-9bf2-e3fca0d7b942 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:51:57.258177 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-4ebb27db-a262-421e-8315-ff86f740dbbb req-68140c2d-e66b-4846-9bf2-e3fca0d7b942 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:51:57.258515 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.l3_db [req-4ebb27db-a262-421e-8315-ff86f740dbbb req-68140c2d-e66b-4846-9bf2-e3fca0d7b942 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Floating IP b0d36e82-421b-451c-b46c-718f80940b13 disassociated. External IP: 172.26.0.146, port: cae1e34a-0dec-4c1a-8eaf-49691add1205. Nov 09 04:51:57.258854 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-4ebb27db-a262-421e-8315-ff86f740dbbb req-68140c2d-e66b-4846-9bf2-e3fca0d7b942 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Calling delete_port for cae1e34a-0dec-4c1a-8eaf-49691add1205 owned by compute:nova {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:51:57.453073 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-4ebb27db-a262-421e-8315-ff86f740dbbb req-68140c2d-e66b-4846-9bf2-e3fca0d7b942 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:51:57.490661 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68140c2d-e66b-4846-9bf2-e3fca0d7b942 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Pushing event deleted for resources: {'Port': ['ID=cae1e34a-0dec-4c1a-8eaf-49691add1205,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:51:57.512198 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6bdc1db4-c0ea-4093-b998-91f781fca31a req-d2a30f67-685f-4e0c-b4d2-68493fa35c2a tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6 HTTP/1.1" status: 200 len: 210 time: 0.0511642 Nov 09 04:51:57.519359 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68140c2d-e66b-4846-9bf2-e3fca0d7b942 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:51:57.519705 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68140c2d-e66b-4846-9bf2-e3fca0d7b942 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:51:57.520046 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68140c2d-e66b-4846-9bf2-e3fca0d7b942 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:51:57.520379 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68140c2d-e66b-4846-9bf2-e3fca0d7b942 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:51:57.520921 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68140c2d-e66b-4846-9bf2-e3fca0d7b942 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:51:57.521046 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68140c2d-e66b-4846-9bf2-e3fca0d7b942 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:51:57.521342 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68140c2d-e66b-4846-9bf2-e3fca0d7b942 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:51:57.521756 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68140c2d-e66b-4846-9bf2-e3fca0d7b942 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:51:57.522070 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68140c2d-e66b-4846-9bf2-e3fca0d7b942 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:51:57.522409 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68140c2d-e66b-4846-9bf2-e3fca0d7b942 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:51:57.522733 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68140c2d-e66b-4846-9bf2-e3fca0d7b942 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:51:57.523071 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68140c2d-e66b-4846-9bf2-e3fca0d7b942 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:51:57.639937 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [req-4ebb27db-a262-421e-8315-ff86f740dbbb req-68140c2d-e66b-4846-9bf2-e3fca0d7b942 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Router 8cd82ce8-0774-460f-8427-ef14caab402a has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:51:57.748882 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-4ebb27db-a262-421e-8315-ff86f740dbbb req-68140c2d-e66b-4846-9bf2-e3fca0d7b942 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:51:57.759610 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-92beacc7-dba6-4ccc-8406-49dd10b71275 None None] Sync routers for ids ['8cd82ce8-0774-460f-8427-ef14caab402a'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:51:57.769704 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-92beacc7-dba6-4ccc-8406-49dd10b71275 None None] Routers {'8cd82ce8-0774-460f-8427-ef14caab402a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:51:57.770311 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-92beacc7-dba6-4ccc-8406-49dd10b71275 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:51:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8cd82ce8-0774-460f-8427-ef14caab402a'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:51:57.789047 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-4ebb27db-a262-421e-8315-ff86f740dbbb req-68140c2d-e66b-4846-9bf2-e3fca0d7b942 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] No DVR routers for this DVR port cae1e34a-0dec-4c1a-8eaf-49691add1205 on host hv-neutron-8168 {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:51:57.791531 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-4ebb27db-a262-421e-8315-ff86f740dbbb req-68140c2d-e66b-4846-9bf2-e3fca0d7b942 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:51:57.794907 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4ebb27db-a262-421e-8315-ff86f740dbbb req-68140c2d-e66b-4846-9bf2-e3fca0d7b942 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.26 "DELETE /v2.0/ports/cae1e34a-0dec-4c1a-8eaf-49691add1205 HTTP/1.1" status: 204 len: 173 time: 0.8848825 Nov 09 04:51:57.795453 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6', 'name': 'network-vif-deleted', 'tag': 'cae1e34a-0dec-4c1a-8eaf-49691add1205'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:51:57.797947 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1f9587f4-6144-4cef-88c1-c841dcad1ad5" -d '{"events": [{"server_uuid": "febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6", "name": "network-vif-deleted", "tag": "cae1e34a-0dec-4c1a-8eaf-49691add1205"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:51:57.843547 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:51:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bd5b7009-b911-481b-ae97-554d485f2449 x-openstack-request-id: req-bd5b7009-b911-481b-ae97-554d485f2449 {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:51:57.843831 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6", "name": "network-vif-deleted", "tag": "cae1e34a-0dec-4c1a-8eaf-49691add1205", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:51:57.844076 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-bd5b7009-b911-481b-ae97-554d485f2449 {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:51:57.844477 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6', 'name': 'network-vif-deleted', 'tag': 'cae1e34a-0dec-4c1a-8eaf-49691add1205', 'status': 'completed', 'code': 200} Nov 09 04:51:57.890921 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-92beacc7-dba6-4ccc-8406-49dd10b71275 None None] Set router 8cd82ce8-0774-460f-8427-ef14caab402a gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:51:58.090646 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-92beacc7-dba6-4ccc-8406-49dd10b71275 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'name': 'tempest-ServerActionsTestJSON-1679556620-router', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77'}], 'enable_snat': True}, 'gw_port_id': '6b137909-e697-434a-93b2-4272af33f319', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:50:34Z', 'updated_at': '2021-11-09T04:50:37Z', 'revision_number': 4, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'gw_port': {'id': '6b137909-e697-434a-93b2-4272af33f319', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:88:5d:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1569, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:35Z', 'updated_at': '2021-11-09T04:50:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'a23873f3-df1f-49c6-93aa-691a0e18c829', 'name': '', 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'mac_address': 'fa:16:3e:58:72:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1570, 'fixed_ips': [{'subnet_id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:37Z', 'updated_at': '2021-11-09T04:50:40Z', 'revision_number': 5, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'subnets': [{'id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:51:58.121414 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-92beacc7-dba6-4ccc-8406-49dd10b71275 None None] Checking router: 8cd82ce8-0774-460f-8427-ef14caab402a for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:51:58.129786 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-92beacc7-dba6-4ccc-8406-49dd10b71275 None None] Routers {'8cd82ce8-0774-460f-8427-ef14caab402a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:51:58.130398 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-92beacc7-dba6-4ccc-8406-49dd10b71275 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:51:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8cd82ce8-0774-460f-8427-ef14caab402a'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:51:58.233803 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-92beacc7-dba6-4ccc-8406-49dd10b71275 None None] Set router 8cd82ce8-0774-460f-8427-ef14caab402a gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:51:58.424540 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-92beacc7-dba6-4ccc-8406-49dd10b71275 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'name': 'tempest-ServerActionsTestJSON-1679556620-router', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77'}], 'enable_snat': True}, 'gw_port_id': '6b137909-e697-434a-93b2-4272af33f319', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:50:34Z', 'updated_at': '2021-11-09T04:50:37Z', 'revision_number': 4, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'gw_port': {'id': '6b137909-e697-434a-93b2-4272af33f319', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:88:5d:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1569, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:35Z', 'updated_at': '2021-11-09T04:50:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'a23873f3-df1f-49c6-93aa-691a0e18c829', 'name': '', 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'mac_address': 'fa:16:3e:58:72:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1570, 'fixed_ips': [{'subnet_id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:37Z', 'updated_at': '2021-11-09T04:50:40Z', 'revision_number': 5, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'subnets': [{'id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:51:58.450123 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-92beacc7-dba6-4ccc-8406-49dd10b71275 None None] The sync data for ids ['8cd82ce8-0774-460f-8427-ef14caab402a'] in dv-neutron-816802-2-hyperv is: [{'id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'name': 'tempest-ServerActionsTestJSON-1679556620-router', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77'}], 'enable_snat': True}, 'gw_port_id': '6b137909-e697-434a-93b2-4272af33f319', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:50:34Z', 'updated_at': '2021-11-09T04:50:37Z', 'revision_number': 4, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'gw_port': {'id': '6b137909-e697-434a-93b2-4272af33f319', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:88:5d:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1569, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:35Z', 'updated_at': '2021-11-09T04:50:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'a23873f3-df1f-49c6-93aa-691a0e18c829', 'name': '', 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'mac_address': 'fa:16:3e:58:72:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1570, 'fixed_ips': [{'subnet_id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:37Z', 'updated_at': '2021-11-09T04:50:40Z', 'revision_number': 5, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'subnets': [{'id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:51:58.624084 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-84f2838b-859b-44fd-a091-6f81adb227f9 req-7a031013-eca6-4428-87e3-02781a2f3099 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=febaf3e4-36a1-41a3-b224-a5f1ef6ea5d6 HTTP/1.1" status: 200 len: 210 time: 0.0256567 Nov 09 04:51:58.684922 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-699bb688-c56f-4655-a841-64cda77e6ae5 None None] New status for floating IP b0d36e82-421b-451c-b46c-718f80940b13: DOWN {{(pid=102163) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 04:51:59.853280 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-7132655d-df10-4dc7-93d9-d1e44672fb1b req-0414ee68-7c2c-4574-875d-e8a528ad6c3c tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?name=tempest-securitygroup--873602357&fields=id&tenant_id=1a8335b645d04ccbad2f2ed5288b68e8 HTTP/1.1" status: 200 len: 267 time: 0.0408854 Nov 09 04:51:59.962732 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7132655d-df10-4dc7-93d9-d1e44672fb1b req-d4750919-b5e6-4738-a3f2-461a3028c807 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:51:59.964112 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-7132655d-df10-4dc7-93d9-d1e44672fb1b req-d4750919-b5e6-4738-a3f2-461a3028c807 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/networks?id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 HTTP/1.1" status: 200 len: 812 time: 0.1043546 Nov 09 04:51:59.978380 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-7132655d-df10-4dc7-93d9-d1e44672fb1b req-cfa18f5d-2ee3-4a11-ae3b-218d08ffa7e0 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/quotas/1a8335b645d04ccbad2f2ed5288b68e8 HTTP/1.1" status: 200 len: 375 time: 0.0086751 Nov 09 04:52:00.028516 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-7132655d-df10-4dc7-93d9-d1e44672fb1b req-1d502137-e29c-4169-b54b-56143e0a2943 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?tenant_id=1a8335b645d04ccbad2f2ed5288b68e8&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0452170 Nov 09 04:52:00.125904 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-7132655d-df10-4dc7-93d9-d1e44672fb1b req-aaf6caf0-0c46-4a8e-b47f-07860c47c1ce service neutron] 10.222.0.24 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0849090 Nov 09 04:52:00.213952 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-7132655d-df10-4dc7-93d9-d1e44672fb1b req-e4f11dd4-9005-46f3-ae95-bd966409d728 service neutron] 10.222.0.24 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0818322 Nov 09 04:52:00.450006 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ceb8e689-b7c7-43ed-8b80-08138bd35738 req-f8480f4a-50de-4893-9229-f9c691a5b9d6 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=9f96942e-fbc5-4cc3-954f-99f534bfe705 HTTP/1.1" status: 200 len: 210 time: 0.0264804 Nov 09 04:52:01.357410 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device cae1e34a-0dec-4c1a-8eaf-49691add1205 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:52:01.377184 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] No Port match for: cae1e34a-0dec-4c1a-8eaf-49691add1205 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:52:01.377518 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device cae1e34a-0dec-4c1a-8eaf-49691add1205 not bound to the agent host hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:52:01.546244 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-40da3b3c-e1f6-4674-b077-5faa2902e057 req-fd93fa91-a1c1-4747-896d-8950717a7921 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=9f96942e-fbc5-4cc3-954f-99f534bfe705 HTTP/1.1" status: 200 len: 210 time: 0.0312173 Nov 09 04:52:02.279477 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7132655d-df10-4dc7-93d9-d1e44672fb1b req-4cfedc57-f12d-4bb7-a587-802d8a720e51 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:52:02.280941 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7132655d-df10-4dc7-93d9-d1e44672fb1b req-4cfedc57-f12d-4bb7-a587-802d8a720e51 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.26 "GET /v2.0/networks?id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 HTTP/1.1" status: 200 len: 812 time: 0.1033924 Nov 09 04:52:02.342561 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7132655d-df10-4dc7-93d9-d1e44672fb1b req-8cecdfed-1139-4cff-9b6a-e5393ea5c527 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.26 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=1a8335b645d04ccbad2f2ed5288b68e8 HTTP/1.1" status: 200 len: 379 time: 0.0516098 Nov 09 04:52:02.357679 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-7132655d-df10-4dc7-93d9-d1e44672fb1b req-d90cd6a3-4de1-47d4-8169-14ef12cd546d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Request body: {'port': {'device_id': '9f96942e-fbc5-4cc3-954f-99f534bfe705', 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21', 'admin_state_up': True, 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'security_groups': ['f9cad1da-5723-46c3-9e10-9af8b6b844b8']}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:52:02.538849 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-7132655d-df10-4dc7-93d9-d1e44672fb1b req-d90cd6a3-4de1-47d4-8169-14ef12cd546d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Made reservation on behalf of 1a8335b645d04ccbad2f2ed5288b68e8 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:52:02.542316 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-7132655d-df10-4dc7-93d9-d1e44672fb1b req-d90cd6a3-4de1-47d4-8169-14ef12cd546d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:52:02.645303 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ce8b3bd3-1bd3-4dd5-8c84-537737804113 req-1318acd5-fbe8-4480-b667-bb7315d94789 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=9f96942e-fbc5-4cc3-954f-99f534bfe705 HTTP/1.1" status: 200 len: 210 time: 0.0313118 Nov 09 04:52:02.687969 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [req-7132655d-df10-4dc7-93d9-d1e44672fb1b req-d90cd6a3-4de1-47d4-8169-14ef12cd546d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Allocated IP 172.20.0.9 (d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21/96831da9-b0dd-45f9-8543-0ac226a68c6a/cb9b5bfd-d631-4dd4-86ff-370b702159f1) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:52:02.821161 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-7132655d-df10-4dc7-93d9-d1e44672fb1b req-d90cd6a3-4de1-47d4-8169-14ef12cd546d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:52:02.904968 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-7132655d-df10-4dc7-93d9-d1e44672fb1b req-d90cd6a3-4de1-47d4-8169-14ef12cd546d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:52:02.945848 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-7132655d-df10-4dc7-93d9-d1e44672fb1b req-d90cd6a3-4de1-47d4-8169-14ef12cd546d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Network d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:52:02.951232 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [req-7132655d-df10-4dc7-93d9-d1e44672fb1b req-d90cd6a3-4de1-47d4-8169-14ef12cd546d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:52:02.955234 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-7132655d-df10-4dc7-93d9-d1e44672fb1b req-d90cd6a3-4de1-47d4-8169-14ef12cd546d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:52:02.977636 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d90cd6a3-4de1-47d4-8169-14ef12cd546d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Pushing event updated for resources: {'Port': ['ID=cb9b5bfd-d631-4dd4-86ff-370b702159f1,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:52:03.007177 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7132655d-df10-4dc7-93d9-d1e44672fb1b req-d90cd6a3-4de1-47d4-8169-14ef12cd546d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:52:03.007793 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-7132655d-df10-4dc7-93d9-d1e44672fb1b req-d90cd6a3-4de1-47d4-8169-14ef12cd546d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:52:03.096158 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7132655d-df10-4dc7-93d9-d1e44672fb1b req-d90cd6a3-4de1-47d4-8169-14ef12cd546d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.26 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7420712 Nov 09 04:52:03.108860 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-7132655d-df10-4dc7-93d9-d1e44672fb1b req-81396d69-c0f2-4959-bf35-bace05eff672 service neutron] Request body: {'port': {'device_id': '9f96942e-fbc5-4cc3-954f-99f534bfe705', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:52:03.171575 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-7132655d-df10-4dc7-93d9-d1e44672fb1b req-81396d69-c0f2-4959-bf35-bace05eff672 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:52:03.188417 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-1e09b27b-ff6d-4581-b289-2fea16cff033 None None] Provisioning complete for port cb9b5bfd-d631-4dd4-86ff-370b702159f1 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:52:03.189091 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1e09b27b-ff6d-4581-b289-2fea16cff033 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:52:03.225635 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-1e09b27b-ff6d-4581-b289-2fea16cff033 None None] Port cb9b5bfd-d631-4dd4-86ff-370b702159f1 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:52:03.423461 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [req-7132655d-df10-4dc7-93d9-d1e44672fb1b req-81396d69-c0f2-4959-bf35-bace05eff672 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id cb9b5bfd-d631-4dd4-86ff-370b702159f1 {{(pid=102162) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:52:03.430493 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-7132655d-df10-4dc7-93d9-d1e44672fb1b req-81396d69-c0f2-4959-bf35-bace05eff672 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:52:03.441797 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.provisioning_blocks [req-7132655d-df10-4dc7-93d9-d1e44672fb1b req-81396d69-c0f2-4959-bf35-bace05eff672 service neutron] Transition to ACTIVE for port object cb9b5bfd-d631-4dd4-86ff-370b702159f1 will not be triggered until provisioned by entity L2. {{(pid=102162) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 09 04:52:03.509477 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-7132655d-df10-4dc7-93d9-d1e44672fb1b req-81396d69-c0f2-4959-bf35-bace05eff672 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:52:03.562507 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81396d69-c0f2-4959-bf35-bace05eff672 service neutron] Pushing event updated for resources: {'Port': ['ID=cb9b5bfd-d631-4dd4-86ff-370b702159f1,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:52:03.637071 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-7132655d-df10-4dc7-93d9-d1e44672fb1b req-81396d69-c0f2-4959-bf35-bace05eff672 service neutron] Attempting to bind port cb9b5bfd-d631-4dd4-86ff-370b702159f1 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:52:03.637395 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-7132655d-df10-4dc7-93d9-d1e44672fb1b req-81396d69-c0f2-4959-bf35-bace05eff672 service neutron] Attempting to bind port cb9b5bfd-d631-4dd4-86ff-370b702159f1 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '24d74bfa-ba9d-4c10-aa08-4a4fed47543f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:52:03.637719 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7132655d-df10-4dc7-93d9-d1e44672fb1b req-81396d69-c0f2-4959-bf35-bace05eff672 service neutron] Attempting to bind port cb9b5bfd-d631-4dd4-86ff-370b702159f1 on network d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:52:03.642151 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7132655d-df10-4dc7-93d9-d1e44672fb1b req-81396d69-c0f2-4959-bf35-bace05eff672 service neutron] Port cb9b5bfd-d631-4dd4-86ff-370b702159f1 on network d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:52:03.642499 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7132655d-df10-4dc7-93d9-d1e44672fb1b req-81396d69-c0f2-4959-bf35-bace05eff672 service neutron] Attempting to bind port cb9b5bfd-d631-4dd4-86ff-370b702159f1 on network d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:52:03.649421 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7132655d-df10-4dc7-93d9-d1e44672fb1b req-81396d69-c0f2-4959-bf35-bace05eff672 service neutron] Checking agent: {'id': '7d36b884-4ad2-4878-9464-bf647030b544', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'started_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 51, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:52:03.649756 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7132655d-df10-4dc7-93d9-d1e44672fb1b req-81396d69-c0f2-4959-bf35-bace05eff672 service neutron] Checking segment: {'id': '24d74bfa-ba9d-4c10-aa08-4a4fed47543f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:52:03.650138 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7132655d-df10-4dc7-93d9-d1e44672fb1b req-81396d69-c0f2-4959-bf35-bace05eff672 service neutron] Bound using segment: {'id': '24d74bfa-ba9d-4c10-aa08-4a4fed47543f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21'} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:52:03.650700 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-7132655d-df10-4dc7-93d9-d1e44672fb1b req-81396d69-c0f2-4959-bf35-bace05eff672 service neutron] Bound port: cb9b5bfd-d631-4dd4-86ff-370b702159f1, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '24d74bfa-ba9d-4c10-aa08-4a4fed47543f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21'}}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:52:03.651051 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-7132655d-df10-4dc7-93d9-d1e44672fb1b req-81396d69-c0f2-4959-bf35-bace05eff672 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:52:03.718770 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-7132655d-df10-4dc7-93d9-d1e44672fb1b req-81396d69-c0f2-4959-bf35-bace05eff672 service neutron] For port cb9b5bfd-d631-4dd4-86ff-370b702159f1, host hv-neutron-8168, cleared binding levels {{(pid=102162) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:52:03.722852 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-7132655d-df10-4dc7-93d9-d1e44672fb1b req-81396d69-c0f2-4959-bf35-bace05eff672 service neutron] For port cb9b5bfd-d631-4dd4-86ff-370b702159f1, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=cb9b5bfd-d631-4dd4-86ff-370b702159f1,segment=NetworkSegment(24d74bfa-ba9d-4c10-aa08-4a4fed47543f),segment_id=24d74bfa-ba9d-4c10-aa08-4a4fed47543f)] {{(pid=102162) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:52:03.761307 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71e06bd8-30d4-4774-85c5-a1a1b9fe5e8b req-c5d191b4-31da-4bf0-b63e-39d905f919da tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:52:03.762836 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-71e06bd8-30d4-4774-85c5-a1a1b9fe5e8b req-c5d191b4-31da-4bf0-b63e-39d905f919da tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=9f96942e-fbc5-4cc3-954f-99f534bfe705 HTTP/1.1" status: 200 len: 943 time: 0.0487607 Nov 09 04:52:03.802177 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-7132655d-df10-4dc7-93d9-d1e44672fb1b req-81396d69-c0f2-4959-bf35-bace05eff672 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:52:03.811361 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-71e06bd8-30d4-4774-85c5-a1a1b9fe5e8b req-0e51b211-9de4-4d3d-a163-2ead8f0825fe tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0423684 Nov 09 04:52:03.839147 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7132655d-df10-4dc7-93d9-d1e44672fb1b req-81396d69-c0f2-4959-bf35-bace05eff672 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:52:03.839752 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-7132655d-df10-4dc7-93d9-d1e44672fb1b req-81396d69-c0f2-4959-bf35-bace05eff672 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:52:03.841152 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7132655d-df10-4dc7-93d9-d1e44672fb1b req-81396d69-c0f2-4959-bf35-bace05eff672 service neutron] 10.222.0.26 "PUT /v2.0/ports/cb9b5bfd-d631-4dd4-86ff-370b702159f1 HTTP/1.1" status: 200 len: 1093 time: 0.7365904 Nov 09 04:52:03.841599 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9f96942e-fbc5-4cc3-954f-99f534bfe705', 'tag': 'cb9b5bfd-d631-4dd4-86ff-370b702159f1'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:52:03.843978 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-43869e4a-6d15-4204-bfba-3cd76c8eff1c" -d '{"events": [{"name": "network-changed", "server_uuid": "9f96942e-fbc5-4cc3-954f-99f534bfe705", "tag": "cb9b5bfd-d631-4dd4-86ff-370b702159f1"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:52:03.878672 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81396d69-c0f2-4959-bf35-bace05eff672 service neutron] Pushing event updated for resources: {'Port': ['ID=cb9b5bfd-d631-4dd4-86ff-370b702159f1,revision_number=3']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:52:03.885528 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:52:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7badd7b0-ac8d-4fb1-830c-fae0dd94bcd1 x-openstack-request-id: req-7badd7b0-ac8d-4fb1-830c-fae0dd94bcd1 {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:52:03.885809 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9f96942e-fbc5-4cc3-954f-99f534bfe705", "tag": "cb9b5bfd-d631-4dd4-86ff-370b702159f1", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:52:03.886084 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-7badd7b0-ac8d-4fb1-830c-fae0dd94bcd1 {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:52:03.886487 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9f96942e-fbc5-4cc3-954f-99f534bfe705', 'tag': 'cb9b5bfd-d631-4dd4-86ff-370b702159f1', 'status': 'completed', 'code': 200} Nov 09 04:52:04.286790 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43869e4a-6d15-4204-bfba-3cd76c8eff1c req-23bb32f1-7d4c-4f29-9105-dd9bb13cb95f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:52:04.288353 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-43869e4a-6d15-4204-bfba-3cd76c8eff1c req-23bb32f1-7d4c-4f29-9105-dd9bb13cb95f service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1a8335b645d04ccbad2f2ed5288b68e8&device_id=9f96942e-fbc5-4cc3-954f-99f534bfe705 HTTP/1.1" status: 200 len: 1096 time: 0.3837433 Nov 09 04:52:04.380910 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43869e4a-6d15-4204-bfba-3cd76c8eff1c req-9036a1d0-b7d5-4d92-a141-7da98fd5826e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:52:04.383015 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-43869e4a-6d15-4204-bfba-3cd76c8eff1c req-9036a1d0-b7d5-4d92-a141-7da98fd5826e service neutron] 10.222.0.26 "GET /v2.0/networks?tenant_id=1a8335b645d04ccbad2f2ed5288b68e8&shared=False HTTP/1.1" status: 200 len: 913 time: 0.0871096 Nov 09 04:52:04.482421 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43869e4a-6d15-4204-bfba-3cd76c8eff1c req-5bcd0740-14b4-429a-bb1f-007c0af6ff2f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:52:04.483875 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-43869e4a-6d15-4204-bfba-3cd76c8eff1c req-5bcd0740-14b4-429a-bb1f-007c0af6ff2f service neutron] 10.222.0.26 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0942576 Nov 09 04:52:04.557991 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7132655d-df10-4dc7-93d9-d1e44672fb1b req-dee79f3a-302f-47bd-ae6c-6e93ded0c2c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:52:04.559409 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7132655d-df10-4dc7-93d9-d1e44672fb1b req-dee79f3a-302f-47bd-ae6c-6e93ded0c2c8 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1a8335b645d04ccbad2f2ed5288b68e8&device_id=9f96942e-fbc5-4cc3-954f-99f534bfe705 HTTP/1.1" status: 200 len: 1096 time: 0.0387874 Nov 09 04:52:04.603333 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7132655d-df10-4dc7-93d9-d1e44672fb1b req-77fd9332-b54c-4e5c-b096-c51a28c291a1 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=cb9b5bfd-d631-4dd4-86ff-370b702159f1 HTTP/1.1" status: 200 len: 217 time: 0.0361578 Nov 09 04:52:04.650288 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7132655d-df10-4dc7-93d9-d1e44672fb1b req-ba65f948-219b-4ab2-af5c-c802cd31ab73 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:52:04.651753 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7132655d-df10-4dc7-93d9-d1e44672fb1b req-ba65f948-219b-4ab2-af5c-c802cd31ab73 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=96831da9-b0dd-45f9-8543-0ac226a68c6a HTTP/1.1" status: 200 len: 851 time: 0.0415735 Nov 09 04:52:04.695093 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7132655d-df10-4dc7-93d9-d1e44672fb1b req-3c414b56-7931-4904-9abe-8126c63fbb73 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:52:04.696476 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7132655d-df10-4dc7-93d9-d1e44672fb1b req-3c414b56-7931-4904-9abe-8126c63fbb73 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0376756 Nov 09 04:52:04.811519 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7132655d-df10-4dc7-93d9-d1e44672fb1b req-9a64f339-a291-4f26-b883-14ed97fd2cec service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1076462 Nov 09 04:52:04.902143 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7132655d-df10-4dc7-93d9-d1e44672fb1b req-4c553163-23b9-4df0-aaac-340544f446f3 service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0830994 Nov 09 04:52:04.924755 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8efcb591-1dee-45bf-9a84-2eee3a3f2fb0 req-f3fef0f4-9b3e-4970-95d5-22bbff6c8542 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:52:04.926329 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-8efcb591-1dee-45bf-9a84-2eee3a3f2fb0 req-f3fef0f4-9b3e-4970-95d5-22bbff6c8542 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=9f96942e-fbc5-4cc3-954f-99f534bfe705 HTTP/1.1" status: 200 len: 943 time: 0.0484726 Nov 09 04:52:04.972809 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-8efcb591-1dee-45bf-9a84-2eee3a3f2fb0 req-3a4eba14-93b0-4d28-831d-0ea3b99a21fc tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0399523 Nov 09 04:52:06.091490 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3cf915d-787d-4171-952a-788f8963c7d0 req-b1c9d059-c5e8-4ef9-9e88-d915c346a8b8 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:52:06.092864 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b3cf915d-787d-4171-952a-788f8963c7d0 req-b1c9d059-c5e8-4ef9-9e88-d915c346a8b8 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=9f96942e-fbc5-4cc3-954f-99f534bfe705 HTTP/1.1" status: 200 len: 943 time: 0.0523188 Nov 09 04:52:06.137920 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b3cf915d-787d-4171-952a-788f8963c7d0 req-2e165c06-4207-45d0-9185-edce5a608756 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0391593 Nov 09 04:52:07.253908 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0d17625-dc30-49a3-9b02-ceb3ccde014a req-6d678c40-fc18-4d4b-8d70-d6a345474934 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:52:07.255379 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-e0d17625-dc30-49a3-9b02-ceb3ccde014a req-6d678c40-fc18-4d4b-8d70-d6a345474934 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=9f96942e-fbc5-4cc3-954f-99f534bfe705 HTTP/1.1" status: 200 len: 943 time: 0.0518367 Nov 09 04:52:07.301073 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-e0d17625-dc30-49a3-9b02-ceb3ccde014a req-747188a2-52a9-4639-9c8f-8cd23d118b67 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0397644 Nov 09 04:52:07.366298 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device cb9b5bfd-d631-4dd4-86ff-370b702159f1 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=102163) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 09 04:52:07.460630 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port cb9b5bfd-d631-4dd4-86ff-370b702159f1, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=cb9b5bfd-d631-4dd4-86ff-370b702159f1,segment=NetworkSegment(24d74bfa-ba9d-4c10-aa08-4a4fed47543f),segment_id=24d74bfa-ba9d-4c10-aa08-4a4fed47543f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:52:07.471912 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Returning: {'device': 'cb9b5bfd-d631-4dd4-86ff-370b702159f1', 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21', 'port_id': 'cb9b5bfd-d631-4dd4-86ff-370b702159f1', 'mac_address': 'fa:16:3e:c2:de:26', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 310, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102163) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 09 04:52:07.507341 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:52:07.520127 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id cb9b5bfd-d631-4dd4-86ff-370b702159f1 {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:52:07.539512 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port cb9b5bfd-d631-4dd4-86ff-370b702159f1, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=cb9b5bfd-d631-4dd4-86ff-370b702159f1,segment=NetworkSegment(24d74bfa-ba9d-4c10-aa08-4a4fed47543f),segment_id=24d74bfa-ba9d-4c10-aa08-4a4fed47543f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:52:07.612196 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:52:07.657836 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=cb9b5bfd-d631-4dd4-86ff-370b702159f1,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:52:07.822438 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['cb9b5bfd-d631-4dd4-86ff-370b702159f1'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 04:52:08.413299 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39315e89-6224-416f-bbf5-a85db5215fad req-83f7e799-3d1d-43fd-a988-cb7d16c85123 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:52:08.415340 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-39315e89-6224-416f-bbf5-a85db5215fad req-83f7e799-3d1d-43fd-a988-cb7d16c85123 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=9f96942e-fbc5-4cc3-954f-99f534bfe705 HTTP/1.1" status: 200 len: 944 time: 0.0467260 Nov 09 04:52:08.460053 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-39315e89-6224-416f-bbf5-a85db5215fad req-c3ad416f-3529-44b9-a252-b7ff9f741843 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0389080 Nov 09 04:52:09.367976 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device cb9b5bfd-d631-4dd4-86ff-370b702159f1 up at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:52:09.475892 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning for port cb9b5bfd-d631-4dd4-86ff-370b702159f1 completed by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 09 04:52:09.481877 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning complete for port cb9b5bfd-d631-4dd4-86ff-370b702159f1 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:52:09.482424 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:52:09.560815 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:52:09.572593 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28e794db-3b2b-4321-9dda-cd835d7ff31c req-84a45473-2d33-41ea-a082-7453a2f868ad tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:52:09.574061 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-28e794db-3b2b-4321-9dda-cd835d7ff31c req-84a45473-2d33-41ea-a082-7453a2f868ad tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=9f96942e-fbc5-4cc3-954f-99f534bfe705 HTTP/1.1" status: 200 len: 944 time: 0.0469081 Nov 09 04:52:09.582518 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9f96942e-fbc5-4cc3-954f-99f534bfe705', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cb9b5bfd-d631-4dd4-86ff-370b702159f1'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:52:09.584734 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6d45ef6b-5cf7-47c7-aba3-3dbd02a9e014" -d '{"events": [{"server_uuid": "9f96942e-fbc5-4cc3-954f-99f534bfe705", "name": "network-vif-plugged", "status": "completed", "tag": "cb9b5bfd-d631-4dd4-86ff-370b702159f1"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:52:09.597755 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port cb9b5bfd-d631-4dd4-86ff-370b702159f1, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=cb9b5bfd-d631-4dd4-86ff-370b702159f1,segment=NetworkSegment(24d74bfa-ba9d-4c10-aa08-4a4fed47543f),segment_id=24d74bfa-ba9d-4c10-aa08-4a4fed47543f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:52:09.623292 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:52:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-00e2bd97-c070-4869-8919-d12086e876a8 x-openstack-request-id: req-00e2bd97-c070-4869-8919-d12086e876a8 {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:52:09.623292 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9f96942e-fbc5-4cc3-954f-99f534bfe705", "name": "network-vif-plugged", "status": "completed", "tag": "cb9b5bfd-d631-4dd4-86ff-370b702159f1", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:52:09.623292 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-00e2bd97-c070-4869-8919-d12086e876a8 {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:52:09.623292 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9f96942e-fbc5-4cc3-954f-99f534bfe705', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cb9b5bfd-d631-4dd4-86ff-370b702159f1', 'code': 200} Nov 09 04:52:09.623730 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-28e794db-3b2b-4321-9dda-cd835d7ff31c req-a440b0ea-cfaa-412e-8d34-2ca9ca62fded tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0435343 Nov 09 04:52:09.670088 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:52:09.716981 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=cb9b5bfd-d631-4dd4-86ff-370b702159f1,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:52:09.984521 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-592e3200-220b-419a-87cf-e3bbbc5e47eb req-9a4887d5-986c-45db-816c-896a9d7ceca6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:52:09.986085 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-592e3200-220b-419a-87cf-e3bbbc5e47eb req-9a4887d5-986c-45db-816c-896a9d7ceca6 service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=9f96942e-fbc5-4cc3-954f-99f534bfe705 HTTP/1.1" status: 200 len: 1098 time: 0.0383923 Nov 09 04:52:10.033435 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-592e3200-220b-419a-87cf-e3bbbc5e47eb req-b84649de-18ad-499f-8e2e-14f090431a13 service neutron] 10.222.0.26 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0393195 Nov 09 04:52:10.737365 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a46bc124-3c02-4dbb-8463-c57d5283f5c0 req-b327645e-d9b7-404f-85c2-d07b887e3f8f tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:52:10.738831 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a46bc124-3c02-4dbb-8463-c57d5283f5c0 req-b327645e-d9b7-404f-85c2-d07b887e3f8f tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=9f96942e-fbc5-4cc3-954f-99f534bfe705 HTTP/1.1" status: 200 len: 945 time: 0.0466938 Nov 09 04:52:10.784822 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a46bc124-3c02-4dbb-8463-c57d5283f5c0 req-6e89c0fb-dcba-4097-a565-2d3e7e5deca0 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0396063 Nov 09 04:52:11.349076 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-307cd4c5-1f60-42bf-9c53-f3c14dea1476 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:52:11.898351 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0446269-c8e5-4436-908e-c539f6ba635d req-ed502aa6-0179-49d4-99d7-bf7ca507d368 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:52:11.899894 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-a0446269-c8e5-4436-908e-c539f6ba635d req-ed502aa6-0179-49d4-99d7-bf7ca507d368 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=9f96942e-fbc5-4cc3-954f-99f534bfe705 HTTP/1.1" status: 200 len: 945 time: 0.0486605 Nov 09 04:52:11.950097 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-a0446269-c8e5-4436-908e-c539f6ba635d req-32a21896-e04a-4c4c-a83c-642a2066a6c0 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0442510 Nov 09 04:52:12.057199 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5da30e8-7e4f-4c8e-adf8-c93b79379f8b req-fa01339d-6b18-43b1-8714-d70765c1eb96 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:52:12.058573 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e5da30e8-7e4f-4c8e-adf8-c93b79379f8b req-fa01339d-6b18-43b1-8714-d70765c1eb96 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=9f96942e-fbc5-4cc3-954f-99f534bfe705 HTTP/1.1" status: 200 len: 945 time: 0.0463521 Nov 09 04:52:12.066878 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 34502) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:52:12.071206 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-7fb76605-4166-40a6-83c6-18c16b9953f8 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Request body: {'floatingip': {'port_id': 'cb9b5bfd-d631-4dd4-86ff-370b702159f1'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:52:12.111547 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7fb76605-4166-40a6-83c6-18c16b9953f8 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks [] for floatingip, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:52:12.292835 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:52:12.531268 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7fb76605-4166-40a6-83c6-18c16b9953f8 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:52:12.572564 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7fb76605-4166-40a6-83c6-18c16b9953f8 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:52:12.667908 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.l3_db [None req-7fb76605-4166-40a6-83c6-18c16b9953f8 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Floating IP b0d36e82-421b-451c-b46c-718f80940b13 associated. External IP: 172.26.0.146, port: cb9b5bfd-d631-4dd4-86ff-370b702159f1. Nov 09 04:52:12.869649 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7fb76605-4166-40a6-83c6-18c16b9953f8 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Router 8cd82ce8-0774-460f-8427-ef14caab402a has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:52:12.975888 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7fb76605-4166-40a6-83c6-18c16b9953f8 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:52:12.980866 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7fb76605-4166-40a6-83c6-18c16b9953f8 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:52:12.985662 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-70d9759b-f7fd-4879-af99-47336c1fc0e2 None None] Sync routers for ids ['8cd82ce8-0774-460f-8427-ef14caab402a'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:52:12.995472 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-70d9759b-f7fd-4879-af99-47336c1fc0e2 None None] Routers {'8cd82ce8-0774-460f-8427-ef14caab402a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:52:12.996069 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-70d9759b-f7fd-4879-af99-47336c1fc0e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:51:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8cd82ce8-0774-460f-8427-ef14caab402a'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:52:13.010349 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-7fb76605-4166-40a6-83c6-18c16b9953f8 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "PUT /v2.0/floatingips/b0d36e82-421b-451c-b46c-718f80940b13 HTTP/1.1" status: 200 len: 991 time: 0.9398155 Nov 09 04:52:13.010349 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9f96942e-fbc5-4cc3-954f-99f534bfe705', 'tag': 'cb9b5bfd-d631-4dd4-86ff-370b702159f1'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:52:13.011248 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-47def611-7214-43f9-a57c-fcb848d6c19e" -d '{"events": [{"name": "network-changed", "server_uuid": "9f96942e-fbc5-4cc3-954f-99f534bfe705", "tag": "cb9b5bfd-d631-4dd4-86ff-370b702159f1"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:52:13.048730 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:52:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-81cc1bbe-ad79-4fa3-bd1b-749e0723f724 x-openstack-request-id: req-81cc1bbe-ad79-4fa3-bd1b-749e0723f724 {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:52:13.049015 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9f96942e-fbc5-4cc3-954f-99f534bfe705", "tag": "cb9b5bfd-d631-4dd4-86ff-370b702159f1", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:52:13.049265 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-81cc1bbe-ad79-4fa3-bd1b-749e0723f724 {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:52:13.049665 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9f96942e-fbc5-4cc3-954f-99f534bfe705', 'tag': 'cb9b5bfd-d631-4dd4-86ff-370b702159f1', 'status': 'completed', 'code': 200} Nov 09 04:52:13.114983 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47def611-7214-43f9-a57c-fcb848d6c19e req-a4f498c5-8729-4597-a7b0-1f5001583f4d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:52:13.116491 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-47def611-7214-43f9-a57c-fcb848d6c19e req-a4f498c5-8729-4597-a7b0-1f5001583f4d service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1a8335b645d04ccbad2f2ed5288b68e8&device_id=9f96942e-fbc5-4cc3-954f-99f534bfe705 HTTP/1.1" status: 200 len: 1098 time: 0.0426056 Nov 09 04:52:13.191583 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-70d9759b-f7fd-4879-af99-47336c1fc0e2 None None] Set router 8cd82ce8-0774-460f-8427-ef14caab402a gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:52:13.213292 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47def611-7214-43f9-a57c-fcb848d6c19e req-17aa0632-25fc-4bbd-8183-9453f2bc7da7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:52:13.215246 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-47def611-7214-43f9-a57c-fcb848d6c19e req-17aa0632-25fc-4bbd-8183-9453f2bc7da7 service neutron] 10.222.0.26 "GET /v2.0/networks?id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 HTTP/1.1" status: 200 len: 913 time: 0.0907006 Nov 09 04:52:13.282602 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-47def611-7214-43f9-a57c-fcb848d6c19e req-9bcc59a4-6688-4eb3-ac80-e3caee5972b9 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=cb9b5bfd-d631-4dd4-86ff-370b702159f1 HTTP/1.1" status: 200 len: 999 time: 0.0600863 Nov 09 04:52:13.336940 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47def611-7214-43f9-a57c-fcb848d6c19e req-7e9288f4-aa1e-4592-987d-3b77c0979c06 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:52:13.338563 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-47def611-7214-43f9-a57c-fcb848d6c19e req-7e9288f4-aa1e-4592-987d-3b77c0979c06 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=96831da9-b0dd-45f9-8543-0ac226a68c6a HTTP/1.1" status: 200 len: 851 time: 0.0487676 Nov 09 04:52:13.382865 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47def611-7214-43f9-a57c-fcb848d6c19e req-b19b1a79-d927-4ae4-bf26-b3ee2993da1d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:52:13.384427 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-47def611-7214-43f9-a57c-fcb848d6c19e req-b19b1a79-d927-4ae4-bf26-b3ee2993da1d service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0392609 Nov 09 04:52:13.412602 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-70d9759b-f7fd-4879-af99-47336c1fc0e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'name': 'tempest-ServerActionsTestJSON-1679556620-router', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77'}], 'enable_snat': True}, 'gw_port_id': '6b137909-e697-434a-93b2-4272af33f319', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:50:34Z', 'updated_at': '2021-11-09T04:50:37Z', 'revision_number': 4, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'gw_port': {'id': '6b137909-e697-434a-93b2-4272af33f319', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:88:5d:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1569, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:35Z', 'updated_at': '2021-11-09T04:50:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': 'b0d36e82-421b-451c-b46c-718f80940b13', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'floating_ip_address': '172.26.0.146', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'port_id': 'cb9b5bfd-d631-4dd4-86ff-370b702159f1', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 1577, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21', 'mac_address': 'fa:16:3e:c2:de:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9f96942e-fbc5-4cc3-954f-99f534bfe705', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:50:40Z', 'updated_at': '2021-11-09T04:52:12Z', 'revision_number': 5, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a23873f3-df1f-49c6-93aa-691a0e18c829', 'name': '', 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'mac_address': 'fa:16:3e:58:72:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1570, 'fixed_ips': [{'subnet_id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:37Z', 'updated_at': '2021-11-09T04:50:40Z', 'revision_number': 5, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'subnets': [{'id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:52:13.443359 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-70d9759b-f7fd-4879-af99-47336c1fc0e2 None None] Checking router: 8cd82ce8-0774-460f-8427-ef14caab402a for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:52:13.452159 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-70d9759b-f7fd-4879-af99-47336c1fc0e2 None None] Routers {'8cd82ce8-0774-460f-8427-ef14caab402a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:52:13.452773 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-70d9759b-f7fd-4879-af99-47336c1fc0e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:51:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8cd82ce8-0774-460f-8427-ef14caab402a'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:52:13.477205 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-47def611-7214-43f9-a57c-fcb848d6c19e req-6920254c-0d95-473c-8dc2-7f00da62b785 service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0860035 Nov 09 04:52:13.558736 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-70d9759b-f7fd-4879-af99-47336c1fc0e2 None None] Set router 8cd82ce8-0774-460f-8427-ef14caab402a gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:52:13.576878 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-47def611-7214-43f9-a57c-fcb848d6c19e req-e23eca30-cee7-4a9e-a7a9-21a0f7279697 service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0928912 Nov 09 04:52:13.687522 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-546071f5-5058-4182-920e-9f28e28c250e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:52:13.783905 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-70d9759b-f7fd-4879-af99-47336c1fc0e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'name': 'tempest-ServerActionsTestJSON-1679556620-router', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77'}], 'enable_snat': True}, 'gw_port_id': '6b137909-e697-434a-93b2-4272af33f319', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:50:34Z', 'updated_at': '2021-11-09T04:50:37Z', 'revision_number': 4, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'gw_port': {'id': '6b137909-e697-434a-93b2-4272af33f319', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:88:5d:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1569, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:35Z', 'updated_at': '2021-11-09T04:50:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': 'b0d36e82-421b-451c-b46c-718f80940b13', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'floating_ip_address': '172.26.0.146', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'port_id': 'cb9b5bfd-d631-4dd4-86ff-370b702159f1', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 1577, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21', 'mac_address': 'fa:16:3e:c2:de:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9f96942e-fbc5-4cc3-954f-99f534bfe705', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:50:40Z', 'updated_at': '2021-11-09T04:52:12Z', 'revision_number': 5, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a23873f3-df1f-49c6-93aa-691a0e18c829', 'name': '', 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'mac_address': 'fa:16:3e:58:72:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1570, 'fixed_ips': [{'subnet_id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:37Z', 'updated_at': '2021-11-09T04:50:40Z', 'revision_number': 5, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'subnets': [{'id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:52:13.808742 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-70d9759b-f7fd-4879-af99-47336c1fc0e2 None None] The sync data for ids ['8cd82ce8-0774-460f-8427-ef14caab402a'] in dv-neutron-816802-2-hyperv is: [{'id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'name': 'tempest-ServerActionsTestJSON-1679556620-router', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77'}], 'enable_snat': True}, 'gw_port_id': '6b137909-e697-434a-93b2-4272af33f319', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:50:34Z', 'updated_at': '2021-11-09T04:50:37Z', 'revision_number': 4, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'gw_port': {'id': '6b137909-e697-434a-93b2-4272af33f319', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:88:5d:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1569, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:35Z', 'updated_at': '2021-11-09T04:50:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': 'b0d36e82-421b-451c-b46c-718f80940b13', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'floating_ip_address': '172.26.0.146', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'port_id': 'cb9b5bfd-d631-4dd4-86ff-370b702159f1', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 1577, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21', 'mac_address': 'fa:16:3e:c2:de:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9f96942e-fbc5-4cc3-954f-99f534bfe705', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:50:40Z', 'updated_at': '2021-11-09T04:52:12Z', 'revision_number': 5, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a23873f3-df1f-49c6-93aa-691a0e18c829', 'name': '', 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'mac_address': 'fa:16:3e:58:72:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1570, 'fixed_ips': [{'subnet_id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:37Z', 'updated_at': '2021-11-09T04:50:40Z', 'revision_number': 5, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'subnets': [{'id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:52:13.993664 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a947682-ef09-4ecb-9b28-b0db5006a2af None None] New status for floating IP b0d36e82-421b-451c-b46c-718f80940b13: ACTIVE {{(pid=102163) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 04:52:15.149913 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:52:16.509166 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:52:16.989142 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:52:20.456691 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:52:41.384011 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-01cd6323-2d7b-4695-9784-8b50b7d95dce None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:52:42.285799 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:52:43.736383 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b986b572-e32d-4b87-b9e9-8f8006430547 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:52:45.154447 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:52:46.497193 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:52:46.965772 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:52:50.417326 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5965ed10-d887-4469-86a9-feab8d653a6b req-99e62c44-119a-47cf-8e1e-9b548f5d06ef tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:52:50.418757 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-5965ed10-d887-4469-86a9-feab8d653a6b req-99e62c44-119a-47cf-8e1e-9b548f5d06ef tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=9f96942e-fbc5-4cc3-954f-99f534bfe705 HTTP/1.1" status: 200 len: 945 time: 0.0495887 Nov 09 04:52:50.466755 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-5965ed10-d887-4469-86a9-feab8d653a6b req-891f93b4-4192-4354-8cd6-9e545b0b0561 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0421393 Nov 09 04:52:51.580726 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01fd62ef-9484-426e-accd-89ee28f2a3be req-6040960c-0e14-4080-984b-6108f7133d51 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:52:51.582167 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-01fd62ef-9484-426e-accd-89ee28f2a3be req-6040960c-0e14-4080-984b-6108f7133d51 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=9f96942e-fbc5-4cc3-954f-99f534bfe705 HTTP/1.1" status: 200 len: 945 time: 0.0473070 Nov 09 04:52:51.635164 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-01fd62ef-9484-426e-accd-89ee28f2a3be req-2a851e88-af00-4e59-81e8-aded21e40f82 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0470591 Nov 09 04:52:52.750118 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e86d5b8e-5892-4fc3-a68e-96de5a15816d req-8587f71d-fc80-4f11-b0a8-bdd89d54b9c8 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:52:52.751625 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-e86d5b8e-5892-4fc3-a68e-96de5a15816d req-8587f71d-fc80-4f11-b0a8-bdd89d54b9c8 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=9f96942e-fbc5-4cc3-954f-99f534bfe705 HTTP/1.1" status: 200 len: 945 time: 0.0498374 Nov 09 04:52:52.797233 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-e86d5b8e-5892-4fc3-a68e-96de5a15816d req-2a13c902-c131-4e7e-aa7b-b0f1b0a33177 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0398667 Nov 09 04:52:53.909133 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8100be77-708a-4ef5-9e84-c24531dfc2a9 req-54f6f568-e699-493a-9a2a-a5f9ace4a2ee tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:52:53.910688 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8100be77-708a-4ef5-9e84-c24531dfc2a9 req-54f6f568-e699-493a-9a2a-a5f9ace4a2ee tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=9f96942e-fbc5-4cc3-954f-99f534bfe705 HTTP/1.1" status: 200 len: 945 time: 0.0472503 Nov 09 04:52:53.961389 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8100be77-708a-4ef5-9e84-c24531dfc2a9 req-ae255e1f-f6bc-446f-b327-83a61db04c85 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0425456 Nov 09 04:52:55.073190 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b09c6ea2-7c68-4aa9-b96d-715377c2d67f req-fc44d530-a82d-428c-b28d-c18ad9ec9b80 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:52:55.074679 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b09c6ea2-7c68-4aa9-b96d-715377c2d67f req-fc44d530-a82d-428c-b28d-c18ad9ec9b80 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=9f96942e-fbc5-4cc3-954f-99f534bfe705 HTTP/1.1" status: 200 len: 945 time: 0.0478086 Nov 09 04:52:55.121180 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b09c6ea2-7c68-4aa9-b96d-715377c2d67f req-7c8ee57a-1421-473c-a101-27627929354d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0405188 Nov 09 04:52:56.233312 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b45a7c1-fb0d-461d-b617-d4f3052c3194 req-789d04f7-6cfe-484a-be6a-34e5bd907dce tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:52:56.234765 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5b45a7c1-fb0d-461d-b617-d4f3052c3194 req-789d04f7-6cfe-484a-be6a-34e5bd907dce tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=9f96942e-fbc5-4cc3-954f-99f534bfe705 HTTP/1.1" status: 200 len: 945 time: 0.0477335 Nov 09 04:52:56.280573 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5b45a7c1-fb0d-461d-b617-d4f3052c3194 req-36694fe2-ee5a-4503-b235-13b49e4080f8 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0400739 Nov 09 04:52:57.403332 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c9cc56f-fdd1-4f32-83d8-6cc2487e6a58 req-76014624-319e-4bac-9108-50ca2741d135 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:52:57.409317 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-5c9cc56f-fdd1-4f32-83d8-6cc2487e6a58 req-76014624-319e-4bac-9108-50ca2741d135 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=9f96942e-fbc5-4cc3-954f-99f534bfe705 HTTP/1.1" status: 200 len: 945 time: 0.0565381 Nov 09 04:52:57.459117 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-5c9cc56f-fdd1-4f32-83d8-6cc2487e6a58 req-3a2aaf43-f07a-4491-a675-cf975fe8bb9a tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0481083 Nov 09 04:52:57.461981 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:52:58.579593 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-946a140b-4263-4cd6-8561-84bfe5f7357b req-427ae2c1-e6f6-4ff2-96fb-101214d437f5 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:52:58.581061 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-946a140b-4263-4cd6-8561-84bfe5f7357b req-427ae2c1-e6f6-4ff2-96fb-101214d437f5 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=9f96942e-fbc5-4cc3-954f-99f534bfe705 HTTP/1.1" status: 200 len: 945 time: 0.0530813 Nov 09 04:52:58.627914 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-946a140b-4263-4cd6-8561-84bfe5f7357b req-7d3cb264-f7ee-46ee-96ee-7971da92e93a tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0409710 Nov 09 04:52:59.742163 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db1d9ea3-66dc-45d0-ba3f-0940c0182c56 req-61a9f35e-0f37-4a32-a23f-7a3a6056f212 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:52:59.743720 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-db1d9ea3-66dc-45d0-ba3f-0940c0182c56 req-61a9f35e-0f37-4a32-a23f-7a3a6056f212 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=9f96942e-fbc5-4cc3-954f-99f534bfe705 HTTP/1.1" status: 200 len: 945 time: 0.0509856 Nov 09 04:52:59.789181 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-db1d9ea3-66dc-45d0-ba3f-0940c0182c56 req-abb24219-10f7-498d-ada5-c00f9f229fa7 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0396230 Nov 09 04:53:00.900898 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb9e446d-3139-40b2-a175-acbc15c33a44 req-5951c799-2ca6-474d-aa95-82e88144c7be tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:00.902392 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-cb9e446d-3139-40b2-a175-acbc15c33a44 req-5951c799-2ca6-474d-aa95-82e88144c7be tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=9f96942e-fbc5-4cc3-954f-99f534bfe705 HTTP/1.1" status: 200 len: 945 time: 0.0477512 Nov 09 04:53:00.949325 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-cb9e446d-3139-40b2-a175-acbc15c33a44 req-91428301-025c-4ede-9b15-15b7fe04b1ff tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0408955 Nov 09 04:53:01.355581 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9414051e-582a-4b0d-a7ee-15dcd09c6db3 req-27792a82-5664-4db4-b1c9-14577d76ffa2 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:01.356971 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9414051e-582a-4b0d-a7ee-15dcd09c6db3 req-27792a82-5664-4db4-b1c9-14577d76ffa2 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=9f96942e-fbc5-4cc3-954f-99f534bfe705 HTTP/1.1" status: 200 len: 945 time: 0.0481911 Nov 09 04:53:01.429587 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9414051e-582a-4b0d-a7ee-15dcd09c6db3 req-b8e94e3f-6d17-45cc-b63f-37af065e8f84 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0666602 Nov 09 04:53:01.441905 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-30855367-17dc-4bbd-9c1c-d32376b53c6f req-deca8f97-20fa-450e-ae70-c1786988f757 service neutron] 10.222.0.24 "GET /v2.0/ports?device_id=9f96942e-fbc5-4cc3-954f-99f534bfe705&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0514176 Nov 09 04:53:02.542838 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-964c9a6b-6458-403a-9372-5416dbb98d60 req-ef92a303-d4cc-4a42-805a-a1c31286a6f9 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:02.544688 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-964c9a6b-6458-403a-9372-5416dbb98d60 req-ef92a303-d4cc-4a42-805a-a1c31286a6f9 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=9f96942e-fbc5-4cc3-954f-99f534bfe705 HTTP/1.1" status: 200 len: 945 time: 0.0476477 Nov 09 04:53:02.592451 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-964c9a6b-6458-403a-9372-5416dbb98d60 req-78ebc675-6e04-4e8c-89df-84f579afcc04 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0420043 Nov 09 04:53:03.270454 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30855367-17dc-4bbd-9c1c-d32376b53c6f req-7fcad3c6-22fe-446a-9318-2e506edf922f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:03.271909 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-30855367-17dc-4bbd-9c1c-d32376b53c6f req-7fcad3c6-22fe-446a-9318-2e506edf922f service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1a8335b645d04ccbad2f2ed5288b68e8&device_id=9f96942e-fbc5-4cc3-954f-99f534bfe705 HTTP/1.1" status: 200 len: 1098 time: 0.0388212 Nov 09 04:53:03.363443 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30855367-17dc-4bbd-9c1c-d32376b53c6f req-2e7ada08-df62-44bf-b468-2a9f589cfc67 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:03.364906 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-30855367-17dc-4bbd-9c1c-d32376b53c6f req-2e7ada08-df62-44bf-b468-2a9f589cfc67 service neutron] 10.222.0.26 "GET /v2.0/networks?id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 HTTP/1.1" status: 200 len: 913 time: 0.0856524 Nov 09 04:53:03.440526 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-30855367-17dc-4bbd-9c1c-d32376b53c6f req-cf20cfc6-1657-4465-8404-bab98601125d service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=cb9b5bfd-d631-4dd4-86ff-370b702159f1 HTTP/1.1" status: 200 len: 1001 time: 0.0678506 Nov 09 04:53:03.487759 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30855367-17dc-4bbd-9c1c-d32376b53c6f req-28c95356-4b2c-4f05-bd7a-aa3eac725b30 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:03.489135 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-30855367-17dc-4bbd-9c1c-d32376b53c6f req-28c95356-4b2c-4f05-bd7a-aa3eac725b30 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=96831da9-b0dd-45f9-8543-0ac226a68c6a HTTP/1.1" status: 200 len: 851 time: 0.0412717 Nov 09 04:53:03.535346 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30855367-17dc-4bbd-9c1c-d32376b53c6f req-b0ba71ea-1303-4784-b15a-deaa17d65409 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:03.536723 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-30855367-17dc-4bbd-9c1c-d32376b53c6f req-b0ba71ea-1303-4784-b15a-deaa17d65409 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0405259 Nov 09 04:53:03.623362 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-30855367-17dc-4bbd-9c1c-d32376b53c6f req-cba11ef9-60dc-4dd0-9a8d-0a82ea7cac5b service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0792696 Nov 09 04:53:03.744033 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-30855367-17dc-4bbd-9c1c-d32376b53c6f req-d93b8cfc-38a4-4b26-8494-74454d27c37a service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1136475 Nov 09 04:53:03.752696 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdaef9aa-209f-46c7-947c-012579c7b2c4 req-ffd51261-9cb6-4a49-90c1-4a5d57915e1d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:03.754350 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fdaef9aa-209f-46c7-947c-012579c7b2c4 req-ffd51261-9cb6-4a49-90c1-4a5d57915e1d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=9f96942e-fbc5-4cc3-954f-99f534bfe705 HTTP/1.1" status: 200 len: 945 time: 0.0705259 Nov 09 04:53:03.802869 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fdaef9aa-209f-46c7-947c-012579c7b2c4 req-de5cb5d4-7335-4e44-90a0-32a4aed50fe9 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0421560 Nov 09 04:53:04.919697 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c0a4bea-c7d9-45cd-a9e7-8c35a1b9bf9d req-b3a822be-0bc8-4475-943e-983d942f2119 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:04.921163 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-7c0a4bea-c7d9-45cd-a9e7-8c35a1b9bf9d req-b3a822be-0bc8-4475-943e-983d942f2119 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=9f96942e-fbc5-4cc3-954f-99f534bfe705 HTTP/1.1" status: 200 len: 945 time: 0.0520146 Nov 09 04:53:04.966930 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-7c0a4bea-c7d9-45cd-a9e7-8c35a1b9bf9d req-49753154-9c3b-425d-b69a-483e0150cc96 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0399222 Nov 09 04:53:05.588277 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-30855367-17dc-4bbd-9c1c-d32376b53c6f req-b123525d-aaea-441e-b9d5-0156f4daa29a service neutron] 10.222.0.26 "GET /v2.0/ports/cb9b5bfd-d631-4dd4-86ff-370b702159f1/bindings/hv-neutron-8168 HTTP/1.1" status: 200 len: 384 time: 0.0564528 Nov 09 04:53:06.082388 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddbf4902-5fad-4ad2-adb6-406243fa7de4 req-9af89aa2-4c69-410c-9d3c-ec6556fcf123 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:06.083900 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ddbf4902-5fad-4ad2-adb6-406243fa7de4 req-9af89aa2-4c69-410c-9d3c-ec6556fcf123 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=9f96942e-fbc5-4cc3-954f-99f534bfe705 HTTP/1.1" status: 200 len: 945 time: 0.0508659 Nov 09 04:53:06.152094 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30855367-17dc-4bbd-9c1c-d32376b53c6f req-04370639-5fca-4f59-ab89-9af542a77509 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:06.153482 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-30855367-17dc-4bbd-9c1c-d32376b53c6f req-04370639-5fca-4f59-ab89-9af542a77509 service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=9f96942e-fbc5-4cc3-954f-99f534bfe705&tenant_id=1a8335b645d04ccbad2f2ed5288b68e8 HTTP/1.1" status: 200 len: 1098 time: 0.0687337 Nov 09 04:53:06.156745 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ddbf4902-5fad-4ad2-adb6-406243fa7de4 req-a543d9dd-9240-4a1e-a2a0-93b60a8a031e tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0645998 Nov 09 04:53:06.212562 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30855367-17dc-4bbd-9c1c-d32376b53c6f req-3bd5a7b9-2b74-40eb-8ab1-3485d6b0779a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:06.214001 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-30855367-17dc-4bbd-9c1c-d32376b53c6f req-3bd5a7b9-2b74-40eb-8ab1-3485d6b0779a service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1a8335b645d04ccbad2f2ed5288b68e8&device_id=9f96942e-fbc5-4cc3-954f-99f534bfe705 HTTP/1.1" status: 200 len: 1098 time: 0.0391316 Nov 09 04:53:06.305286 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30855367-17dc-4bbd-9c1c-d32376b53c6f req-b2db2b2f-a031-4f28-a051-78a6b3e0c077 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:06.306754 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-30855367-17dc-4bbd-9c1c-d32376b53c6f req-b2db2b2f-a031-4f28-a051-78a6b3e0c077 service neutron] 10.222.0.26 "GET /v2.0/networks?id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 HTTP/1.1" status: 200 len: 913 time: 0.0855803 Nov 09 04:53:06.371043 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-30855367-17dc-4bbd-9c1c-d32376b53c6f req-03cd5eb6-f335-4f5c-9c9f-d07f6cb91e69 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=cb9b5bfd-d631-4dd4-86ff-370b702159f1 HTTP/1.1" status: 200 len: 1001 time: 0.0571842 Nov 09 04:53:06.423921 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30855367-17dc-4bbd-9c1c-d32376b53c6f req-c5942e9d-0c13-4b53-a7be-56d8064d36c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:06.425260 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-30855367-17dc-4bbd-9c1c-d32376b53c6f req-c5942e9d-0c13-4b53-a7be-56d8064d36c8 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=96831da9-b0dd-45f9-8543-0ac226a68c6a HTTP/1.1" status: 200 len: 851 time: 0.0472879 Nov 09 04:53:06.468758 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30855367-17dc-4bbd-9c1c-d32376b53c6f req-594ee9c8-fc14-4339-ba52-c73f09e7bcf7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:06.470164 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-30855367-17dc-4bbd-9c1c-d32376b53c6f req-594ee9c8-fc14-4339-ba52-c73f09e7bcf7 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0378375 Nov 09 04:53:06.559700 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-30855367-17dc-4bbd-9c1c-d32376b53c6f req-984cc82f-2f8f-47dd-91d3-40fc54ecf063 service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0813425 Nov 09 04:53:06.646852 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-30855367-17dc-4bbd-9c1c-d32376b53c6f req-1293a0d7-4ecd-4ae0-a386-d6379f4ef96c service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0790832 Nov 09 04:53:07.273539 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84caafb3-65c3-43e2-bb09-8cc1c0e0eb32 req-4b92a9a6-a9b6-4b0f-bafd-35912fa1512c tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:07.275000 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-84caafb3-65c3-43e2-bb09-8cc1c0e0eb32 req-4b92a9a6-a9b6-4b0f-bafd-35912fa1512c tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=9f96942e-fbc5-4cc3-954f-99f534bfe705 HTTP/1.1" status: 200 len: 945 time: 0.0471833 Nov 09 04:53:07.321322 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-84caafb3-65c3-43e2-bb09-8cc1c0e0eb32 req-cf5eaa1b-78c5-4c35-b148-8f9cef926cfa tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0405037 Nov 09 04:53:08.433921 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-352bae62-fa21-4bcd-89c3-1daebec0da6c req-dcad8f26-912f-4649-bdec-b9cbcdc565b1 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:08.435399 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-352bae62-fa21-4bcd-89c3-1daebec0da6c req-dcad8f26-912f-4649-bdec-b9cbcdc565b1 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=9f96942e-fbc5-4cc3-954f-99f534bfe705 HTTP/1.1" status: 200 len: 945 time: 0.0466967 Nov 09 04:53:08.485517 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-352bae62-fa21-4bcd-89c3-1daebec0da6c req-52e8018d-c48b-458e-9eef-1ada4180a297 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0440354 Nov 09 04:53:08.890220 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f04ab495-b182-431e-9708-9b5fa326de3b req-e50add76-5d6d-4e01-a461-42e17622795d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:08.891730 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f04ab495-b182-431e-9708-9b5fa326de3b req-e50add76-5d6d-4e01-a461-42e17622795d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=9f96942e-fbc5-4cc3-954f-99f534bfe705 HTTP/1.1" status: 200 len: 945 time: 0.0472198 Nov 09 04:53:08.939395 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f04ab495-b182-431e-9708-9b5fa326de3b req-79f7ead6-6f68-4094-9697-7d27de7af324 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0417199 Nov 09 04:53:08.990305 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8e48a00-322e-4692-9a63-1279879d847b req-5bfb483f-77d7-417a-97cf-bf7d86efbc6e tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:08.991836 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f8e48a00-322e-4692-9a63-1279879d847b req-5bfb483f-77d7-417a-97cf-bf7d86efbc6e tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.26 "GET /v2.0/ports?device_id=9f96942e-fbc5-4cc3-954f-99f534bfe705&tenant_id=1a8335b645d04ccbad2f2ed5288b68e8&binding%3Ahost_id=hv-neutron-8168 HTTP/1.1" status: 200 len: 945 time: 0.0516078 Nov 09 04:53:09.070840 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8e48a00-322e-4692-9a63-1279879d847b req-fb8778f8-61ab-46d5-80c7-acabb331863a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:09.072167 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f8e48a00-322e-4692-9a63-1279879d847b req-fb8778f8-61ab-46d5-80c7-acabb331863a service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1a8335b645d04ccbad2f2ed5288b68e8&device_id=9f96942e-fbc5-4cc3-954f-99f534bfe705 HTTP/1.1" status: 200 len: 1098 time: 0.0386987 Nov 09 04:53:09.162258 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8e48a00-322e-4692-9a63-1279879d847b req-1b1db288-1ce1-43ab-92b5-4c4756b4bfc7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:09.163767 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f8e48a00-322e-4692-9a63-1279879d847b req-1b1db288-1ce1-43ab-92b5-4c4756b4bfc7 service neutron] 10.222.0.26 "GET /v2.0/networks?id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 HTTP/1.1" status: 200 len: 913 time: 0.0850835 Nov 09 04:53:09.230895 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f8e48a00-322e-4692-9a63-1279879d847b req-d8644942-3f94-48a2-9c2e-bbb19c63e49e service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=cb9b5bfd-d631-4dd4-86ff-370b702159f1 HTTP/1.1" status: 200 len: 1001 time: 0.0601273 Nov 09 04:53:09.301274 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8e48a00-322e-4692-9a63-1279879d847b req-1e82ab91-ecf1-424d-8439-84e97b500b9b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:09.302712 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f8e48a00-322e-4692-9a63-1279879d847b req-1e82ab91-ecf1-424d-8439-84e97b500b9b service neutron] 10.222.0.26 "GET /v2.0/subnets?id=96831da9-b0dd-45f9-8543-0ac226a68c6a HTTP/1.1" status: 200 len: 851 time: 0.0650933 Nov 09 04:53:09.321244 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3d2e962a-934e-4863-8a96-e9ecf7cccc0d req-c5f35be6-cc1d-42a9-84a5-717600424c7f service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=9f96942e-fbc5-4cc3-954f-99f534bfe705&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0586243 Nov 09 04:53:09.347664 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8e48a00-322e-4692-9a63-1279879d847b req-b1306193-268b-4beb-b10e-cd7063d1e396 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:09.349011 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f8e48a00-322e-4692-9a63-1279879d847b req-b1306193-268b-4beb-b10e-cd7063d1e396 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0391130 Nov 09 04:53:09.444411 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f8e48a00-322e-4692-9a63-1279879d847b req-aa072550-869e-4cb7-a2d9-23b25960fa06 service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0884135 Nov 09 04:53:09.530256 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f8e48a00-322e-4692-9a63-1279879d847b req-757156dd-18e8-472d-9db0-4908895685b2 service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0788243 Nov 09 04:53:09.573305 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device cb9b5bfd-d631-4dd4-86ff-370b702159f1 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=102163) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 09 04:53:09.577355 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device cb9b5bfd-d631-4dd4-86ff-370b702159f1 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:53:09.644902 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d2e962a-934e-4863-8a96-e9ecf7cccc0d req-d9aa449c-33b1-4948-80bb-efd2bc1fbb04 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:09.646423 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3d2e962a-934e-4863-8a96-e9ecf7cccc0d req-d9aa449c-33b1-4948-80bb-efd2bc1fbb04 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1a8335b645d04ccbad2f2ed5288b68e8&device_id=9f96942e-fbc5-4cc3-954f-99f534bfe705 HTTP/1.1" status: 200 len: 1098 time: 0.0446377 Nov 09 04:53:09.713153 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:53:09.750560 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9f96942e-fbc5-4cc3-954f-99f534bfe705', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'cb9b5bfd-d631-4dd4-86ff-370b702159f1'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:53:09.751465 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d2e962a-934e-4863-8a96-e9ecf7cccc0d req-ece07f2f-57e0-4b57-be94-53d8f8642d26 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:09.752799 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8880e62a-5408-4511-af16-d4be9348c4cf" -d '{"events": [{"server_uuid": "9f96942e-fbc5-4cc3-954f-99f534bfe705", "name": "network-vif-unplugged", "status": "completed", "tag": "cb9b5bfd-d631-4dd4-86ff-370b702159f1"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:53:09.752950 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3d2e962a-934e-4863-8a96-e9ecf7cccc0d req-ece07f2f-57e0-4b57-be94-53d8f8642d26 service neutron] 10.222.0.26 "GET /v2.0/networks?id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 HTTP/1.1" status: 200 len: 913 time: 0.0873613 Nov 09 04:53:09.758149 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port cb9b5bfd-d631-4dd4-86ff-370b702159f1, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=cb9b5bfd-d631-4dd4-86ff-370b702159f1,segment=NetworkSegment(24d74bfa-ba9d-4c10-aa08-4a4fed47543f),segment_id=24d74bfa-ba9d-4c10-aa08-4a4fed47543f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:53:09.773508 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port cb9b5bfd-d631-4dd4-86ff-370b702159f1, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=cb9b5bfd-d631-4dd4-86ff-370b702159f1,segment=NetworkSegment(24d74bfa-ba9d-4c10-aa08-4a4fed47543f),segment_id=24d74bfa-ba9d-4c10-aa08-4a4fed47543f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:53:09.776257 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Returning: {'device': 'cb9b5bfd-d631-4dd4-86ff-370b702159f1', 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21', 'port_id': 'cb9b5bfd-d631-4dd4-86ff-370b702159f1', 'mac_address': 'fa:16:3e:c2:de:26', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 310, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102163) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 09 04:53:09.803691 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 09 Nov 2021 04:53:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f6530a4f-d1a0-4ddb-b135-a4078b3a1f9d x-openstack-request-id: req-f6530a4f-d1a0-4ddb-b135-a4078b3a1f9d {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:53:09.804039 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9f96942e-fbc5-4cc3-954f-99f534bfe705", "name": "network-vif-unplugged", "status": "completed", "tag": "cb9b5bfd-d631-4dd4-86ff-370b702159f1", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:53:09.804806 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-f6530a4f-d1a0-4ddb-b135-a4078b3a1f9d {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:53:09.805186 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9f96942e-fbc5-4cc3-954f-99f534bfe705', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'cb9b5bfd-d631-4dd4-86ff-370b702159f1', 'code': 200} Nov 09 04:53:09.820678 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:53:09.828136 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3d2e962a-934e-4863-8a96-e9ecf7cccc0d req-7abc02d4-6501-44b1-90c5-0982f376e97a service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=cb9b5bfd-d631-4dd4-86ff-370b702159f1 HTTP/1.1" status: 200 len: 1001 time: 0.0670733 Nov 09 04:53:09.830140 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:53:09.838762 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id cb9b5bfd-d631-4dd4-86ff-370b702159f1 {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:53:09.879763 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d2e962a-934e-4863-8a96-e9ecf7cccc0d req-61c737be-751c-49a2-b7ea-c8da61ade437 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:09.881276 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3d2e962a-934e-4863-8a96-e9ecf7cccc0d req-61c737be-751c-49a2-b7ea-c8da61ade437 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=96831da9-b0dd-45f9-8543-0ac226a68c6a HTTP/1.1" status: 200 len: 851 time: 0.0446978 Nov 09 04:53:09.911583 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=cb9b5bfd-d631-4dd4-86ff-370b702159f1,revision_number=6']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:53:09.914104 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.db.api [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=102163) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:53:09.914479 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG oslo_db.api [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:53:09.919878 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:53:09.920220 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:53:09.920557 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:53:09.920888 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:53:09.921215 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:53:09.921543 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:53:09.921869 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:53:09.922191 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:53:09.922539 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:53:09.922857 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:53:09.923175 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:53:09.923485 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:53:09.926931 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d2e962a-934e-4863-8a96-e9ecf7cccc0d req-24a41580-0fa9-4845-b4a5-64425d0e88ae service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:09.928693 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3d2e962a-934e-4863-8a96-e9ecf7cccc0d req-24a41580-0fa9-4845-b4a5-64425d0e88ae service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0400476 Nov 09 04:53:10.044122 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3d2e962a-934e-4863-8a96-e9ecf7cccc0d req-0b26b623-ce78-4c29-b88c-3d32c6c20f1c service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1071789 Nov 09 04:53:10.088633 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91193c82-530f-415f-9ef9-cad4fc486fc2 req-ec437a72-dc33-4639-a223-b79db16c6900 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:10.089983 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-91193c82-530f-415f-9ef9-cad4fc486fc2 req-ec437a72-dc33-4639-a223-b79db16c6900 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=9f96942e-fbc5-4cc3-954f-99f534bfe705 HTTP/1.1" status: 200 len: 943 time: 0.0806277 Nov 09 04:53:10.179891 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-91193c82-530f-415f-9ef9-cad4fc486fc2 req-d6a4eea2-35bb-453a-81cb-95af179e0c77 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0626202 Nov 09 04:53:10.181820 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3d2e962a-934e-4863-8a96-e9ecf7cccc0d req-ec7dd2e8-602b-41f5-a127-f4643a65ddd2 service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1298463 Nov 09 04:53:10.453675 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:53:10.466740 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id cb9b5bfd-d631-4dd4-86ff-370b702159f1 {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:53:10.485081 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port cb9b5bfd-d631-4dd4-86ff-370b702159f1, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=cb9b5bfd-d631-4dd4-86ff-370b702159f1,segment=NetworkSegment(24d74bfa-ba9d-4c10-aa08-4a4fed47543f),segment_id=24d74bfa-ba9d-4c10-aa08-4a4fed47543f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:53:10.547728 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:53:10.597546 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=cb9b5bfd-d631-4dd4-86ff-370b702159f1,revision_number=7']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:53:10.607801 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['cb9b5bfd-d631-4dd4-86ff-370b702159f1'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 04:53:11.298899 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ba82853-c469-4c5a-86f8-6a43ef39b18f req-795aa067-3150-424d-a185-e47ff7b4f192 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:11.301311 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-3ba82853-c469-4c5a-86f8-6a43ef39b18f req-795aa067-3150-424d-a185-e47ff7b4f192 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=9f96942e-fbc5-4cc3-954f-99f534bfe705 HTTP/1.1" status: 200 len: 944 time: 0.0518260 Nov 09 04:53:11.347110 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-3ba82853-c469-4c5a-86f8-6a43ef39b18f req-83e5b241-b34e-47d5-9e6d-e6679405db02 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0399051 Nov 09 04:53:11.353968 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0205b9fe-6897-4780-b9f9-59b59de0fb5d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:53:11.466145 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e322c6e-e562-42d0-81d1-33baa6647104 req-d55280e4-e548-4bda-a0b5-38f93bced5ed tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:11.467592 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9e322c6e-e562-42d0-81d1-33baa6647104 req-d55280e4-e548-4bda-a0b5-38f93bced5ed tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=9f96942e-fbc5-4cc3-954f-99f534bfe705 HTTP/1.1" status: 200 len: 944 time: 0.0534987 Nov 09 04:53:11.513680 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9e322c6e-e562-42d0-81d1-33baa6647104 req-949d2d6d-1ec9-426c-bd67-fbd181de45d7 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0402951 Nov 09 04:53:11.583517 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device cb9b5bfd-d631-4dd4-86ff-370b702159f1 up at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:53:11.631429 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning complete for port cb9b5bfd-d631-4dd4-86ff-370b702159f1 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:53:11.632089 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:53:11.709560 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:53:11.748810 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port cb9b5bfd-d631-4dd4-86ff-370b702159f1, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=cb9b5bfd-d631-4dd4-86ff-370b702159f1,segment=NetworkSegment(24d74bfa-ba9d-4c10-aa08-4a4fed47543f),segment_id=24d74bfa-ba9d-4c10-aa08-4a4fed47543f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:53:11.806015 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9f96942e-fbc5-4cc3-954f-99f534bfe705', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cb9b5bfd-d631-4dd4-86ff-370b702159f1'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:53:11.808387 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8c6d1d5e-7cec-4225-a83b-1af05ff81e5e" -d '{"events": [{"server_uuid": "9f96942e-fbc5-4cc3-954f-99f534bfe705", "name": "network-vif-plugged", "status": "completed", "tag": "cb9b5bfd-d631-4dd4-86ff-370b702159f1"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:53:11.830306 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-952cea20-77d2-47b7-93db-0bacd19efb91 req-b017bdd4-4e9f-4368-826d-d9aa5c7b6b4a tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:11.831717 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-952cea20-77d2-47b7-93db-0bacd19efb91 req-b017bdd4-4e9f-4368-826d-d9aa5c7b6b4a tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=9f96942e-fbc5-4cc3-954f-99f534bfe705 HTTP/1.1" status: 200 len: 944 time: 0.0497091 Nov 09 04:53:11.847125 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:53:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-00c1064f-4200-4dd2-82c5-3d143a8a8517 x-openstack-request-id: req-00c1064f-4200-4dd2-82c5-3d143a8a8517 {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:53:11.847411 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9f96942e-fbc5-4cc3-954f-99f534bfe705", "name": "network-vif-plugged", "status": "completed", "tag": "cb9b5bfd-d631-4dd4-86ff-370b702159f1", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:53:11.847657 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-00c1064f-4200-4dd2-82c5-3d143a8a8517 {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:53:11.848039 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9f96942e-fbc5-4cc3-954f-99f534bfe705', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cb9b5bfd-d631-4dd4-86ff-370b702159f1', 'code': 200} Nov 09 04:53:11.862526 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:53:11.896403 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-952cea20-77d2-47b7-93db-0bacd19efb91 req-25e8d452-2029-4a19-85cc-0c1990208845 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0523534 Nov 09 04:53:11.923730 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=cb9b5bfd-d631-4dd4-86ff-370b702159f1,revision_number=8']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:53:11.963308 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1a6142b-88e9-496e-b898-4cdbc63faccf req-ec074797-6873-4462-bc67-b3732a187750 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:11.964772 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b1a6142b-88e9-496e-b898-4cdbc63faccf req-ec074797-6873-4462-bc67-b3732a187750 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1a8335b645d04ccbad2f2ed5288b68e8&device_id=9f96942e-fbc5-4cc3-954f-99f534bfe705 HTTP/1.1" status: 200 len: 1098 time: 0.0413871 Nov 09 04:53:12.051421 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1a6142b-88e9-496e-b898-4cdbc63faccf req-f5e3cf3a-5ca7-4199-a4fc-32cf47f7609b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:12.052849 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b1a6142b-88e9-496e-b898-4cdbc63faccf req-f5e3cf3a-5ca7-4199-a4fc-32cf47f7609b service neutron] 10.222.0.26 "GET /v2.0/networks?id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 HTTP/1.1" status: 200 len: 913 time: 0.0810785 Nov 09 04:53:12.119275 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b1a6142b-88e9-496e-b898-4cdbc63faccf req-4074b21d-2b22-49a0-9539-37813d36d142 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=cb9b5bfd-d631-4dd4-86ff-370b702159f1 HTTP/1.1" status: 200 len: 1001 time: 0.0593717 Nov 09 04:53:12.166462 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1a6142b-88e9-496e-b898-4cdbc63faccf req-d4088675-d11b-48c9-a7ac-54bc8281db66 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:12.167868 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b1a6142b-88e9-496e-b898-4cdbc63faccf req-d4088675-d11b-48c9-a7ac-54bc8281db66 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=96831da9-b0dd-45f9-8543-0ac226a68c6a HTTP/1.1" status: 200 len: 851 time: 0.0420294 Nov 09 04:53:12.212124 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1a6142b-88e9-496e-b898-4cdbc63faccf req-2e2f0624-3cf5-4479-a9e7-9dce2d159a8b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:12.213574 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b1a6142b-88e9-496e-b898-4cdbc63faccf req-2e2f0624-3cf5-4479-a9e7-9dce2d159a8b service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0387614 Nov 09 04:53:12.284688 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:53:12.305984 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b1a6142b-88e9-496e-b898-4cdbc63faccf req-c5b7c45d-0179-4797-90fe-1fe07096d696 service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0850172 Nov 09 04:53:12.396957 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b1a6142b-88e9-496e-b898-4cdbc63faccf req-d41c9ccf-cd23-49cb-b498-1408e8efd72e service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0839095 Nov 09 04:53:13.018878 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc15ceac-f728-4001-a0c6-085f735c8c54 req-7ebd02b7-ee8e-4ffe-bfaa-a9a8e09bde98 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:13.020404 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-bc15ceac-f728-4001-a0c6-085f735c8c54 req-7ebd02b7-ee8e-4ffe-bfaa-a9a8e09bde98 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=9f96942e-fbc5-4cc3-954f-99f534bfe705 HTTP/1.1" status: 200 len: 945 time: 0.0492339 Nov 09 04:53:13.068391 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-bc15ceac-f728-4001-a0c6-085f735c8c54 req-79662d90-1290-4ff6-aed4-f0be50927df4 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0403807 Nov 09 04:53:13.498783 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c8aea30-f4dd-4e19-acbb-8cb7b5d1ec1e req-f2d1d240-2edf-4fae-ad50-51a5af3b75fb tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:13.500146 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-9c8aea30-f4dd-4e19-acbb-8cb7b5d1ec1e req-f2d1d240-2edf-4fae-ad50-51a5af3b75fb tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=9f96942e-fbc5-4cc3-954f-99f534bfe705 HTTP/1.1" status: 200 len: 945 time: 0.0476255 Nov 09 04:53:13.549528 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-9c8aea30-f4dd-4e19-acbb-8cb7b5d1ec1e req-c70c3510-d994-468a-b160-184e65992fba tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0436561 Nov 09 04:53:13.706386 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7509b996-240d-4e08-b778-d6165968a858 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:53:15.006538 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9e88f54-eed4-4415-bc75-22c63b297933 req-44822be5-b145-4410-92ac-2f07b1765e41 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:15.008049 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f9e88f54-eed4-4415-bc75-22c63b297933 req-44822be5-b145-4410-92ac-2f07b1765e41 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=9f96942e-fbc5-4cc3-954f-99f534bfe705 HTTP/1.1" status: 200 len: 945 time: 0.3902273 Nov 09 04:53:15.053396 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f9e88f54-eed4-4415-bc75-22c63b297933 req-31b72719-a2b0-4b79-9486-8bd711ccec92 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0394022 Nov 09 04:53:15.186273 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:53:15.206584 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f322483-7993-4ed9-9861-2234c4ab1713 req-e56a96ab-95d9-455b-bf88-6772dbe1557c tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:15.208004 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1f322483-7993-4ed9-9861-2234c4ab1713 req-e56a96ab-95d9-455b-bf88-6772dbe1557c tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.26 "GET /v2.0/ports?device_id=9f96942e-fbc5-4cc3-954f-99f534bfe705 HTTP/1.1" status: 200 len: 945 time: 0.0469143 Nov 09 04:53:15.295564 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-1f322483-7993-4ed9-9861-2234c4ab1713 req-dcd81252-5300-45f7-82e8-2e6b0005e71c tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Deleting port cb9b5bfd-d631-4dd4-86ff-370b702159f1 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:53:15.295897 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-1f322483-7993-4ed9-9861-2234c4ab1713 req-dcd81252-5300-45f7-82e8-2e6b0005e71c tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:53:15.379223 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-1f322483-7993-4ed9-9861-2234c4ab1713 req-dcd81252-5300-45f7-82e8-2e6b0005e71c tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] For port cb9b5bfd-d631-4dd4-86ff-370b702159f1, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=cb9b5bfd-d631-4dd4-86ff-370b702159f1,segment=NetworkSegment(24d74bfa-ba9d-4c10-aa08-4a4fed47543f),segment_id=24d74bfa-ba9d-4c10-aa08-4a4fed47543f)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:53:15.379575 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-1f322483-7993-4ed9-9861-2234c4ab1713 req-dcd81252-5300-45f7-82e8-2e6b0005e71c tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:53:15.553081 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-1f322483-7993-4ed9-9861-2234c4ab1713 req-dcd81252-5300-45f7-82e8-2e6b0005e71c tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:53:15.553430 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-1f322483-7993-4ed9-9861-2234c4ab1713 req-dcd81252-5300-45f7-82e8-2e6b0005e71c tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:53:15.553770 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.l3_db [req-1f322483-7993-4ed9-9861-2234c4ab1713 req-dcd81252-5300-45f7-82e8-2e6b0005e71c tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Floating IP b0d36e82-421b-451c-b46c-718f80940b13 disassociated. External IP: 172.26.0.146, port: cb9b5bfd-d631-4dd4-86ff-370b702159f1. Nov 09 04:53:15.554101 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-1f322483-7993-4ed9-9861-2234c4ab1713 req-dcd81252-5300-45f7-82e8-2e6b0005e71c tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Calling delete_port for cb9b5bfd-d631-4dd4-86ff-370b702159f1 owned by compute:nova {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:53:15.763788 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-1f322483-7993-4ed9-9861-2234c4ab1713 req-dcd81252-5300-45f7-82e8-2e6b0005e71c tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:53:15.796767 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcd81252-5300-45f7-82e8-2e6b0005e71c tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Pushing event deleted for resources: {'Port': ['ID=cb9b5bfd-d631-4dd4-86ff-370b702159f1,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:53:15.807977 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dcd81252-5300-45f7-82e8-2e6b0005e71c tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:53:15.808320 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dcd81252-5300-45f7-82e8-2e6b0005e71c tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:53:15.808668 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dcd81252-5300-45f7-82e8-2e6b0005e71c tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:53:15.808998 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dcd81252-5300-45f7-82e8-2e6b0005e71c tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:53:15.809330 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dcd81252-5300-45f7-82e8-2e6b0005e71c tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:53:15.809661 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dcd81252-5300-45f7-82e8-2e6b0005e71c tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:53:15.809988 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dcd81252-5300-45f7-82e8-2e6b0005e71c tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:53:15.810312 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dcd81252-5300-45f7-82e8-2e6b0005e71c tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:53:15.810661 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dcd81252-5300-45f7-82e8-2e6b0005e71c tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:53:15.810984 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dcd81252-5300-45f7-82e8-2e6b0005e71c tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:53:15.811302 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dcd81252-5300-45f7-82e8-2e6b0005e71c tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:53:15.811620 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dcd81252-5300-45f7-82e8-2e6b0005e71c tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:53:15.928887 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [req-1f322483-7993-4ed9-9861-2234c4ab1713 req-dcd81252-5300-45f7-82e8-2e6b0005e71c tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Router 8cd82ce8-0774-460f-8427-ef14caab402a has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:53:16.036266 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-1f322483-7993-4ed9-9861-2234c4ab1713 req-dcd81252-5300-45f7-82e8-2e6b0005e71c tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:53:16.046750 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-341bddc9-5139-41ff-8026-3ae20945bedf None None] Sync routers for ids ['8cd82ce8-0774-460f-8427-ef14caab402a'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:53:16.060036 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-341bddc9-5139-41ff-8026-3ae20945bedf None None] Routers {'8cd82ce8-0774-460f-8427-ef14caab402a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:53:16.060560 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-341bddc9-5139-41ff-8026-3ae20945bedf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:53:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8cd82ce8-0774-460f-8427-ef14caab402a'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:53:16.079560 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-1f322483-7993-4ed9-9861-2234c4ab1713 req-dcd81252-5300-45f7-82e8-2e6b0005e71c tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] No DVR routers for this DVR port cb9b5bfd-d631-4dd4-86ff-370b702159f1 on host hv-neutron-8168 {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:53:16.082128 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-1f322483-7993-4ed9-9861-2234c4ab1713 req-dcd81252-5300-45f7-82e8-2e6b0005e71c tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:53:16.085522 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1f322483-7993-4ed9-9861-2234c4ab1713 req-dcd81252-5300-45f7-82e8-2e6b0005e71c tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.26 "DELETE /v2.0/ports/cb9b5bfd-d631-4dd4-86ff-370b702159f1 HTTP/1.1" status: 204 len: 173 time: 0.8717542 Nov 09 04:53:16.085980 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9f96942e-fbc5-4cc3-954f-99f534bfe705', 'name': 'network-vif-deleted', 'tag': 'cb9b5bfd-d631-4dd4-86ff-370b702159f1'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:53:16.088320 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4a38e585-1fda-4ad1-ac30-cbc0e94dc647" -d '{"events": [{"server_uuid": "9f96942e-fbc5-4cc3-954f-99f534bfe705", "name": "network-vif-deleted", "tag": "cb9b5bfd-d631-4dd4-86ff-370b702159f1"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:53:16.135738 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:53:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e1fdcf29-751d-4818-99b1-4a8e7ed9b852 x-openstack-request-id: req-e1fdcf29-751d-4818-99b1-4a8e7ed9b852 {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:53:16.136050 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9f96942e-fbc5-4cc3-954f-99f534bfe705", "name": "network-vif-deleted", "tag": "cb9b5bfd-d631-4dd4-86ff-370b702159f1", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:53:16.138512 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-e1fdcf29-751d-4818-99b1-4a8e7ed9b852 {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:53:16.138512 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9f96942e-fbc5-4cc3-954f-99f534bfe705', 'name': 'network-vif-deleted', 'tag': 'cb9b5bfd-d631-4dd4-86ff-370b702159f1', 'status': 'completed', 'code': 200} Nov 09 04:53:16.176554 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-341bddc9-5139-41ff-8026-3ae20945bedf None None] Set router 8cd82ce8-0774-460f-8427-ef14caab402a gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:53:16.185853 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-25f6ca9d-08fe-4aa3-bb9a-5368563aaefa req-50d5f878-d132-4913-b2f1-ba3874ed7a2b tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=9f96942e-fbc5-4cc3-954f-99f534bfe705 HTTP/1.1" status: 200 len: 210 time: 0.0347614 Nov 09 04:53:16.372428 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-341bddc9-5139-41ff-8026-3ae20945bedf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'name': 'tempest-ServerActionsTestJSON-1679556620-router', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77'}], 'enable_snat': True}, 'gw_port_id': '6b137909-e697-434a-93b2-4272af33f319', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:50:34Z', 'updated_at': '2021-11-09T04:50:37Z', 'revision_number': 4, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'gw_port': {'id': '6b137909-e697-434a-93b2-4272af33f319', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:88:5d:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1569, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:35Z', 'updated_at': '2021-11-09T04:50:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'a23873f3-df1f-49c6-93aa-691a0e18c829', 'name': '', 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'mac_address': 'fa:16:3e:58:72:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1570, 'fixed_ips': [{'subnet_id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:37Z', 'updated_at': '2021-11-09T04:50:40Z', 'revision_number': 5, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'subnets': [{'id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:53:16.398222 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-341bddc9-5139-41ff-8026-3ae20945bedf None None] Checking router: 8cd82ce8-0774-460f-8427-ef14caab402a for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:53:16.406129 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-341bddc9-5139-41ff-8026-3ae20945bedf None None] Routers {'8cd82ce8-0774-460f-8427-ef14caab402a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:53:16.406758 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-341bddc9-5139-41ff-8026-3ae20945bedf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:53:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8cd82ce8-0774-460f-8427-ef14caab402a'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:53:16.510689 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-341bddc9-5139-41ff-8026-3ae20945bedf None None] Set router 8cd82ce8-0774-460f-8427-ef14caab402a gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:53:16.523206 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:53:16.795837 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-341bddc9-5139-41ff-8026-3ae20945bedf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'name': 'tempest-ServerActionsTestJSON-1679556620-router', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77'}], 'enable_snat': True}, 'gw_port_id': '6b137909-e697-434a-93b2-4272af33f319', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:50:34Z', 'updated_at': '2021-11-09T04:50:37Z', 'revision_number': 4, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'gw_port': {'id': '6b137909-e697-434a-93b2-4272af33f319', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:88:5d:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1569, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:35Z', 'updated_at': '2021-11-09T04:50:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'a23873f3-df1f-49c6-93aa-691a0e18c829', 'name': '', 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'mac_address': 'fa:16:3e:58:72:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1570, 'fixed_ips': [{'subnet_id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:37Z', 'updated_at': '2021-11-09T04:50:40Z', 'revision_number': 5, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'subnets': [{'id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:53:16.820831 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-341bddc9-5139-41ff-8026-3ae20945bedf None None] The sync data for ids ['8cd82ce8-0774-460f-8427-ef14caab402a'] in dv-neutron-816802-2-hyperv is: [{'id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'name': 'tempest-ServerActionsTestJSON-1679556620-router', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77'}], 'enable_snat': True}, 'gw_port_id': '6b137909-e697-434a-93b2-4272af33f319', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:50:34Z', 'updated_at': '2021-11-09T04:50:37Z', 'revision_number': 4, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'gw_port': {'id': '6b137909-e697-434a-93b2-4272af33f319', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:88:5d:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1569, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:35Z', 'updated_at': '2021-11-09T04:50:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'a23873f3-df1f-49c6-93aa-691a0e18c829', 'name': '', 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'mac_address': 'fa:16:3e:58:72:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1570, 'fixed_ips': [{'subnet_id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:37Z', 'updated_at': '2021-11-09T04:50:40Z', 'revision_number': 5, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'subnets': [{'id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:53:16.981190 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:53:17.049458 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a92df0d4-9653-4cc8-b058-bd746280f066 None None] New status for floating IP b0d36e82-421b-451c-b46c-718f80940b13: DOWN {{(pid=102163) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 04:53:17.433698 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d4ee930c-e0bc-41c7-b73e-7b891cc4b36a req-08396728-cc02-40df-a77c-e4704d947464 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?name=tempest-securitygroup--873602357&fields=id&tenant_id=1a8335b645d04ccbad2f2ed5288b68e8 HTTP/1.1" status: 200 len: 267 time: 0.0410821 Nov 09 04:53:17.541313 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4ee930c-e0bc-41c7-b73e-7b891cc4b36a req-582364c8-2dcb-481e-b2b4-189b7a3b4c73 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:17.542782 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d4ee930c-e0bc-41c7-b73e-7b891cc4b36a req-582364c8-2dcb-481e-b2b4-189b7a3b4c73 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/networks?id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 HTTP/1.1" status: 200 len: 812 time: 0.1024427 Nov 09 04:53:17.558028 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d4ee930c-e0bc-41c7-b73e-7b891cc4b36a req-7691f157-3097-4d36-b6e9-76cda8e9493d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/quotas/1a8335b645d04ccbad2f2ed5288b68e8 HTTP/1.1" status: 200 len: 375 time: 0.0095232 Nov 09 04:53:17.609871 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d4ee930c-e0bc-41c7-b73e-7b891cc4b36a req-df570619-f807-4637-90e8-0637d837a00b tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?tenant_id=1a8335b645d04ccbad2f2ed5288b68e8&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0464764 Nov 09 04:53:17.693090 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [req-d4ee930c-e0bc-41c7-b73e-7b891cc4b36a req-d7fc05c7-45d7-4fe9-8f8a-b71ca0fe4803 service neutron] http://10.222.0.24:9696/v2.0/extensions returned with HTTP 200 {{(pid=102162) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:53:17.694081 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d4ee930c-e0bc-41c7-b73e-7b891cc4b36a req-d7fc05c7-45d7-4fe9-8f8a-b71ca0fe4803 service neutron] 10.222.0.24 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0727055 Nov 09 04:53:17.783842 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d4ee930c-e0bc-41c7-b73e-7b891cc4b36a req-ace3be39-5972-4627-81a2-c36e97457882 service neutron] 10.222.0.24 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0834429 Nov 09 04:53:17.874512 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d4ee930c-e0bc-41c7-b73e-7b891cc4b36a req-180fd918-a7b7-4f67-8eb5-f8a522fba2b5 service neutron] 10.222.0.24 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0839438 Nov 09 04:53:18.120336 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-86614f30-c538-4e9e-8400-228676548fe1 req-90311d5c-d3a6-43ce-8641-6cc29071666a tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=4b4f3ece-1f90-46f7-9469-2d6071123890 HTTP/1.1" status: 200 len: 210 time: 0.0258615 Nov 09 04:53:19.212644 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3250d60c-b984-4e97-bd79-ae644ae6ab58 req-1e477c33-dff8-4e7d-89f3-21296fdb5273 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=4b4f3ece-1f90-46f7-9469-2d6071123890 HTTP/1.1" status: 200 len: 210 time: 0.0264776 Nov 09 04:53:19.618017 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device cb9b5bfd-d631-4dd4-86ff-370b702159f1 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:53:19.637974 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] No Port match for: cb9b5bfd-d631-4dd4-86ff-370b702159f1 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:53:19.638309 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device cb9b5bfd-d631-4dd4-86ff-370b702159f1 not bound to the agent host hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:53:20.015319 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4ee930c-e0bc-41c7-b73e-7b891cc4b36a req-ff2a7e00-6142-4a5d-b2f7-e2ba7b64ed3d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:20.016763 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d4ee930c-e0bc-41c7-b73e-7b891cc4b36a req-ff2a7e00-6142-4a5d-b2f7-e2ba7b64ed3d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.26 "GET /v2.0/networks?id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 HTTP/1.1" status: 200 len: 812 time: 0.1066570 Nov 09 04:53:20.078517 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d4ee930c-e0bc-41c7-b73e-7b891cc4b36a req-2ee71295-cb0d-401c-88d8-deba42c3fc87 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.26 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=1a8335b645d04ccbad2f2ed5288b68e8 HTTP/1.1" status: 200 len: 379 time: 0.0512459 Nov 09 04:53:20.095828 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-d4ee930c-e0bc-41c7-b73e-7b891cc4b36a req-2cf36bad-ef16-4b8c-9f21-485218801d49 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Request body: {'port': {'device_id': '4b4f3ece-1f90-46f7-9469-2d6071123890', 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21', 'admin_state_up': True, 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'security_groups': ['f9cad1da-5723-46c3-9e10-9af8b6b844b8']}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:53:20.295894 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d4ee930c-e0bc-41c7-b73e-7b891cc4b36a req-2cf36bad-ef16-4b8c-9f21-485218801d49 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Made reservation on behalf of 1a8335b645d04ccbad2f2ed5288b68e8 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:53:20.299538 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-d4ee930c-e0bc-41c7-b73e-7b891cc4b36a req-2cf36bad-ef16-4b8c-9f21-485218801d49 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:53:20.305940 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-a743089c-35e5-4a5d-b7bb-84e492107d6f req-a27e6eda-9992-4581-8314-002bb0c2e5d5 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=4b4f3ece-1f90-46f7-9469-2d6071123890 HTTP/1.1" status: 200 len: 210 time: 0.0275705 Nov 09 04:53:20.424840 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [req-d4ee930c-e0bc-41c7-b73e-7b891cc4b36a req-2cf36bad-ef16-4b8c-9f21-485218801d49 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Allocated IP 172.20.0.7 (d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21/96831da9-b0dd-45f9-8543-0ac226a68c6a/85840a23-4305-4396-97ee-99e835aa6a14) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:53:20.560870 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-d4ee930c-e0bc-41c7-b73e-7b891cc4b36a req-2cf36bad-ef16-4b8c-9f21-485218801d49 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:53:20.673697 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-d4ee930c-e0bc-41c7-b73e-7b891cc4b36a req-2cf36bad-ef16-4b8c-9f21-485218801d49 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:53:20.714162 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d4ee930c-e0bc-41c7-b73e-7b891cc4b36a req-2cf36bad-ef16-4b8c-9f21-485218801d49 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Network d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:53:20.717207 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [req-d4ee930c-e0bc-41c7-b73e-7b891cc4b36a req-2cf36bad-ef16-4b8c-9f21-485218801d49 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:53:20.723985 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-d4ee930c-e0bc-41c7-b73e-7b891cc4b36a req-2cf36bad-ef16-4b8c-9f21-485218801d49 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:53:20.749256 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2cf36bad-ef16-4b8c-9f21-485218801d49 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Pushing event updated for resources: {'Port': ['ID=85840a23-4305-4396-97ee-99e835aa6a14,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:53:20.778321 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4ee930c-e0bc-41c7-b73e-7b891cc4b36a req-2cf36bad-ef16-4b8c-9f21-485218801d49 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:20.778961 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-d4ee930c-e0bc-41c7-b73e-7b891cc4b36a req-2cf36bad-ef16-4b8c-9f21-485218801d49 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:53:20.841690 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d4ee930c-e0bc-41c7-b73e-7b891cc4b36a req-2cf36bad-ef16-4b8c-9f21-485218801d49 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.26 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7494113 Nov 09 04:53:20.855611 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-d4ee930c-e0bc-41c7-b73e-7b891cc4b36a req-ccd67c14-ec10-4417-9498-5df03e9f15af service neutron] Request body: {'port': {'device_id': '4b4f3ece-1f90-46f7-9469-2d6071123890', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:53:20.916546 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-d4ee930c-e0bc-41c7-b73e-7b891cc4b36a req-ccd67c14-ec10-4417-9498-5df03e9f15af service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:53:20.928659 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-c266e02c-311c-4955-b55c-1d6cb1e2e224 None None] Provisioning complete for port 85840a23-4305-4396-97ee-99e835aa6a14 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:53:20.929147 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c266e02c-311c-4955-b55c-1d6cb1e2e224 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:53:20.966290 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-c266e02c-311c-4955-b55c-1d6cb1e2e224 None None] Port 85840a23-4305-4396-97ee-99e835aa6a14 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:53:21.173625 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [req-d4ee930c-e0bc-41c7-b73e-7b891cc4b36a req-ccd67c14-ec10-4417-9498-5df03e9f15af service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 85840a23-4305-4396-97ee-99e835aa6a14 {{(pid=102162) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:53:21.180799 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-d4ee930c-e0bc-41c7-b73e-7b891cc4b36a req-ccd67c14-ec10-4417-9498-5df03e9f15af service neutron] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:53:21.192081 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.provisioning_blocks [req-d4ee930c-e0bc-41c7-b73e-7b891cc4b36a req-ccd67c14-ec10-4417-9498-5df03e9f15af service neutron] Transition to ACTIVE for port object 85840a23-4305-4396-97ee-99e835aa6a14 will not be triggered until provisioned by entity L2. {{(pid=102162) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 09 04:53:21.254847 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-d4ee930c-e0bc-41c7-b73e-7b891cc4b36a req-ccd67c14-ec10-4417-9498-5df03e9f15af service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:53:21.322772 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccd67c14-ec10-4417-9498-5df03e9f15af service neutron] Pushing event updated for resources: {'Port': ['ID=85840a23-4305-4396-97ee-99e835aa6a14,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:53:21.383243 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-d4ee930c-e0bc-41c7-b73e-7b891cc4b36a req-ccd67c14-ec10-4417-9498-5df03e9f15af service neutron] Attempting to bind port 85840a23-4305-4396-97ee-99e835aa6a14 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:53:21.383574 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-d4ee930c-e0bc-41c7-b73e-7b891cc4b36a req-ccd67c14-ec10-4417-9498-5df03e9f15af service neutron] Attempting to bind port 85840a23-4305-4396-97ee-99e835aa6a14 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '24d74bfa-ba9d-4c10-aa08-4a4fed47543f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:53:21.383902 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d4ee930c-e0bc-41c7-b73e-7b891cc4b36a req-ccd67c14-ec10-4417-9498-5df03e9f15af service neutron] Attempting to bind port 85840a23-4305-4396-97ee-99e835aa6a14 on network d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:53:21.396952 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d4ee930c-e0bc-41c7-b73e-7b891cc4b36a req-ccd67c14-ec10-4417-9498-5df03e9f15af service neutron] Port 85840a23-4305-4396-97ee-99e835aa6a14 on network d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:53:21.397293 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d4ee930c-e0bc-41c7-b73e-7b891cc4b36a req-ccd67c14-ec10-4417-9498-5df03e9f15af service neutron] Attempting to bind port 85840a23-4305-4396-97ee-99e835aa6a14 on network d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:53:21.417616 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d4ee930c-e0bc-41c7-b73e-7b891cc4b36a req-ccd67c14-ec10-4417-9498-5df03e9f15af service neutron] Checking agent: {'id': '7d36b884-4ad2-4878-9464-bf647030b544', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'started_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 53, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:53:21.417955 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d4ee930c-e0bc-41c7-b73e-7b891cc4b36a req-ccd67c14-ec10-4417-9498-5df03e9f15af service neutron] Checking segment: {'id': '24d74bfa-ba9d-4c10-aa08-4a4fed47543f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:53:21.418341 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d4ee930c-e0bc-41c7-b73e-7b891cc4b36a req-ccd67c14-ec10-4417-9498-5df03e9f15af service neutron] Bound using segment: {'id': '24d74bfa-ba9d-4c10-aa08-4a4fed47543f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21'} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:53:21.418807 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-d4ee930c-e0bc-41c7-b73e-7b891cc4b36a req-ccd67c14-ec10-4417-9498-5df03e9f15af service neutron] Bound port: 85840a23-4305-4396-97ee-99e835aa6a14, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '24d74bfa-ba9d-4c10-aa08-4a4fed47543f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21'}}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:53:21.419163 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-d4ee930c-e0bc-41c7-b73e-7b891cc4b36a req-ccd67c14-ec10-4417-9498-5df03e9f15af service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:53:21.472420 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3ac371b-9e23-49f8-b4d5-83c3b6fba186 req-2872222c-9d9a-4518-865f-e166281c5302 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:21.474210 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b3ac371b-9e23-49f8-b4d5-83c3b6fba186 req-2872222c-9d9a-4518-865f-e166281c5302 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=4b4f3ece-1f90-46f7-9469-2d6071123890 HTTP/1.1" status: 200 len: 943 time: 0.0932736 Nov 09 04:53:21.522064 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-d4ee930c-e0bc-41c7-b73e-7b891cc4b36a req-ccd67c14-ec10-4417-9498-5df03e9f15af service neutron] For port 85840a23-4305-4396-97ee-99e835aa6a14, host hv-neutron-8168, cleared binding levels {{(pid=102162) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:53:21.526532 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-d4ee930c-e0bc-41c7-b73e-7b891cc4b36a req-ccd67c14-ec10-4417-9498-5df03e9f15af service neutron] For port 85840a23-4305-4396-97ee-99e835aa6a14, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=85840a23-4305-4396-97ee-99e835aa6a14,segment=NetworkSegment(24d74bfa-ba9d-4c10-aa08-4a4fed47543f),segment_id=24d74bfa-ba9d-4c10-aa08-4a4fed47543f)] {{(pid=102162) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:53:21.540598 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b3ac371b-9e23-49f8-b4d5-83c3b6fba186 req-2e0addfb-22fd-479f-9040-63a264617fdf tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0592265 Nov 09 04:53:21.599311 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-d4ee930c-e0bc-41c7-b73e-7b891cc4b36a req-ccd67c14-ec10-4417-9498-5df03e9f15af service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:53:21.638370 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4ee930c-e0bc-41c7-b73e-7b891cc4b36a req-ccd67c14-ec10-4417-9498-5df03e9f15af service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:21.638994 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-d4ee930c-e0bc-41c7-b73e-7b891cc4b36a req-ccd67c14-ec10-4417-9498-5df03e9f15af service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:53:21.640347 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d4ee930c-e0bc-41c7-b73e-7b891cc4b36a req-ccd67c14-ec10-4417-9498-5df03e9f15af service neutron] 10.222.0.26 "PUT /v2.0/ports/85840a23-4305-4396-97ee-99e835aa6a14 HTTP/1.1" status: 200 len: 1093 time: 0.7892082 Nov 09 04:53:21.640783 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4b4f3ece-1f90-46f7-9469-2d6071123890', 'tag': '85840a23-4305-4396-97ee-99e835aa6a14'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:53:21.643068 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-715a6506-ffaa-4fc7-8103-a91e2aea822c" -d '{"events": [{"name": "network-changed", "server_uuid": "4b4f3ece-1f90-46f7-9469-2d6071123890", "tag": "85840a23-4305-4396-97ee-99e835aa6a14"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:53:21.675307 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccd67c14-ec10-4417-9498-5df03e9f15af service neutron] Pushing event updated for resources: {'Port': ['ID=85840a23-4305-4396-97ee-99e835aa6a14,revision_number=3']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:53:21.689369 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:53:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-42a77599-ed21-4e80-98d7-83bb0d8d1efc x-openstack-request-id: req-42a77599-ed21-4e80-98d7-83bb0d8d1efc {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:53:21.689694 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4b4f3ece-1f90-46f7-9469-2d6071123890", "tag": "85840a23-4305-4396-97ee-99e835aa6a14", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:53:21.689943 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-42a77599-ed21-4e80-98d7-83bb0d8d1efc {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:53:21.690343 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4b4f3ece-1f90-46f7-9469-2d6071123890', 'tag': '85840a23-4305-4396-97ee-99e835aa6a14', 'status': 'completed', 'code': 200} Nov 09 04:53:21.760362 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-715a6506-ffaa-4fc7-8103-a91e2aea822c req-29fa1d53-a6ae-405c-b211-119ce5adc7c7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:21.762058 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-715a6506-ffaa-4fc7-8103-a91e2aea822c req-29fa1d53-a6ae-405c-b211-119ce5adc7c7 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1a8335b645d04ccbad2f2ed5288b68e8&device_id=4b4f3ece-1f90-46f7-9469-2d6071123890 HTTP/1.1" status: 200 len: 1096 time: 0.0495760 Nov 09 04:53:21.862255 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-715a6506-ffaa-4fc7-8103-a91e2aea822c req-6847abfd-c0cd-4b71-96b7-1cdbf8b3d7d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:21.863746 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-715a6506-ffaa-4fc7-8103-a91e2aea822c req-6847abfd-c0cd-4b71-96b7-1cdbf8b3d7d1 service neutron] 10.222.0.26 "GET /v2.0/networks?tenant_id=1a8335b645d04ccbad2f2ed5288b68e8&shared=False HTTP/1.1" status: 200 len: 913 time: 0.0938363 Nov 09 04:53:21.964217 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-715a6506-ffaa-4fc7-8103-a91e2aea822c req-57fd8f8e-e66d-4b33-a17f-a3c5032d9438 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:21.965609 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-715a6506-ffaa-4fc7-8103-a91e2aea822c req-57fd8f8e-e66d-4b33-a17f-a3c5032d9438 service neutron] 10.222.0.26 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0932639 Nov 09 04:53:22.040808 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4ee930c-e0bc-41c7-b73e-7b891cc4b36a req-a30de206-b344-4c0b-887d-431f86c3a594 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:22.042286 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d4ee930c-e0bc-41c7-b73e-7b891cc4b36a req-a30de206-b344-4c0b-887d-431f86c3a594 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1a8335b645d04ccbad2f2ed5288b68e8&device_id=4b4f3ece-1f90-46f7-9469-2d6071123890 HTTP/1.1" status: 200 len: 1096 time: 0.0404537 Nov 09 04:53:22.088306 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d4ee930c-e0bc-41c7-b73e-7b891cc4b36a req-baabe1b0-7f8f-4649-b5e2-cf47f3c30174 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=85840a23-4305-4396-97ee-99e835aa6a14 HTTP/1.1" status: 200 len: 217 time: 0.0383008 Nov 09 04:53:22.136527 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4ee930c-e0bc-41c7-b73e-7b891cc4b36a req-1f17d03e-e731-4a11-9daa-8a99d452cd2d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:22.137926 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d4ee930c-e0bc-41c7-b73e-7b891cc4b36a req-1f17d03e-e731-4a11-9daa-8a99d452cd2d service neutron] 10.222.0.26 "GET /v2.0/subnets?id=96831da9-b0dd-45f9-8543-0ac226a68c6a HTTP/1.1" status: 200 len: 851 time: 0.0429809 Nov 09 04:53:22.184229 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4ee930c-e0bc-41c7-b73e-7b891cc4b36a req-937a33e5-9757-4b3f-80d1-f82b647210e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:22.185667 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d4ee930c-e0bc-41c7-b73e-7b891cc4b36a req-937a33e5-9757-4b3f-80d1-f82b647210e9 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0398977 Nov 09 04:53:22.278479 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d4ee930c-e0bc-41c7-b73e-7b891cc4b36a req-3d864029-96aa-4874-af2e-e04697b5390b service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0844808 Nov 09 04:53:22.368062 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d4ee930c-e0bc-41c7-b73e-7b891cc4b36a req-9a75e40e-6a4c-49a7-ab4a-f24a0ec391b4 service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0826118 Nov 09 04:53:22.655481 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2fdec52-8603-44bc-96ce-e3715dfba688 req-b7889140-2a69-4cb0-9eba-a87c17c48e3b tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:22.659095 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d2fdec52-8603-44bc-96ce-e3715dfba688 req-b7889140-2a69-4cb0-9eba-a87c17c48e3b tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=4b4f3ece-1f90-46f7-9469-2d6071123890 HTTP/1.1" status: 200 len: 943 time: 0.0477886 Nov 09 04:53:22.708546 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d2fdec52-8603-44bc-96ce-e3715dfba688 req-a38523db-2bea-4c7a-b519-01172d19302d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0457726 Nov 09 04:53:23.825960 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-252a37ae-66da-4f6e-b5ed-52aad2387d07 req-7634df28-bd77-4592-b6b0-952fa0332756 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:23.827479 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-252a37ae-66da-4f6e-b5ed-52aad2387d07 req-7634df28-bd77-4592-b6b0-952fa0332756 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=4b4f3ece-1f90-46f7-9469-2d6071123890 HTTP/1.1" status: 200 len: 943 time: 0.0518274 Nov 09 04:53:23.874323 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-252a37ae-66da-4f6e-b5ed-52aad2387d07 req-85dc52d9-6cfa-4037-b7df-a1c1974f8d56 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0408804 Nov 09 04:53:24.985313 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90a3579c-9f35-4a8d-925c-2212b6f6e13e req-41885ba0-4967-4fa1-b003-574e2a383715 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:24.986759 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-90a3579c-9f35-4a8d-925c-2212b6f6e13e req-41885ba0-4967-4fa1-b003-574e2a383715 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=4b4f3ece-1f90-46f7-9469-2d6071123890 HTTP/1.1" status: 200 len: 943 time: 0.0469894 Nov 09 04:53:25.032599 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-90a3579c-9f35-4a8d-925c-2212b6f6e13e req-e7f85b26-6f47-4af9-b92d-d7e78b8da1f5 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0393648 Nov 09 04:53:25.650271 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 85840a23-4305-4396-97ee-99e835aa6a14 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=102163) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 09 04:53:25.742811 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 85840a23-4305-4396-97ee-99e835aa6a14, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=85840a23-4305-4396-97ee-99e835aa6a14,segment=NetworkSegment(24d74bfa-ba9d-4c10-aa08-4a4fed47543f),segment_id=24d74bfa-ba9d-4c10-aa08-4a4fed47543f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:53:25.753555 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Returning: {'device': '85840a23-4305-4396-97ee-99e835aa6a14', 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21', 'port_id': '85840a23-4305-4396-97ee-99e835aa6a14', 'mac_address': 'fa:16:3e:59:91:43', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 310, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102163) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 09 04:53:25.789110 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:53:25.800912 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 85840a23-4305-4396-97ee-99e835aa6a14 {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:53:25.820183 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 85840a23-4305-4396-97ee-99e835aa6a14, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=85840a23-4305-4396-97ee-99e835aa6a14,segment=NetworkSegment(24d74bfa-ba9d-4c10-aa08-4a4fed47543f),segment_id=24d74bfa-ba9d-4c10-aa08-4a4fed47543f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:53:25.873156 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:53:25.918447 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=85840a23-4305-4396-97ee-99e835aa6a14,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:53:26.079644 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['85840a23-4305-4396-97ee-99e835aa6a14'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 04:53:26.150550 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcd6a318-cd36-40e0-9018-073f6fccb91e req-7f4c28d8-69fa-4273-91a0-ef7553702256 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:26.152056 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-bcd6a318-cd36-40e0-9018-073f6fccb91e req-7f4c28d8-69fa-4273-91a0-ef7553702256 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=4b4f3ece-1f90-46f7-9469-2d6071123890 HTTP/1.1" status: 200 len: 944 time: 0.0519857 Nov 09 04:53:26.199340 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-bcd6a318-cd36-40e0-9018-073f6fccb91e req-c8ce6267-582e-4e7b-a983-3f73d17831c7 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0413311 Nov 09 04:53:27.311912 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14f5d133-c022-4513-b8ed-a7fe9d1367a0 req-ee3e5793-85f0-4a94-a9f0-adfdb11182e0 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:27.313370 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-14f5d133-c022-4513-b8ed-a7fe9d1367a0 req-ee3e5793-85f0-4a94-a9f0-adfdb11182e0 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=4b4f3ece-1f90-46f7-9469-2d6071123890 HTTP/1.1" status: 200 len: 944 time: 0.0476291 Nov 09 04:53:27.359449 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-14f5d133-c022-4513-b8ed-a7fe9d1367a0 req-91e66888-8805-47fa-b289-a6a412425c30 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0402956 Nov 09 04:53:27.679947 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 85840a23-4305-4396-97ee-99e835aa6a14 up at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:53:27.769446 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning for port 85840a23-4305-4396-97ee-99e835aa6a14 completed by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 09 04:53:27.773471 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning complete for port 85840a23-4305-4396-97ee-99e835aa6a14 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:53:27.773828 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:53:27.848192 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:53:27.869161 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4b4f3ece-1f90-46f7-9469-2d6071123890', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '85840a23-4305-4396-97ee-99e835aa6a14'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:53:27.874028 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-354eb632-00ed-4c5b-904d-0b7031da9f00" -d '{"events": [{"server_uuid": "4b4f3ece-1f90-46f7-9469-2d6071123890", "name": "network-vif-plugged", "status": "completed", "tag": "85840a23-4305-4396-97ee-99e835aa6a14"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:53:27.883810 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 85840a23-4305-4396-97ee-99e835aa6a14, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=85840a23-4305-4396-97ee-99e835aa6a14,segment=NetworkSegment(24d74bfa-ba9d-4c10-aa08-4a4fed47543f),segment_id=24d74bfa-ba9d-4c10-aa08-4a4fed47543f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:53:27.909437 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:53:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-38827305-0324-4897-954a-5907c388870e x-openstack-request-id: req-38827305-0324-4897-954a-5907c388870e {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:53:27.909724 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4b4f3ece-1f90-46f7-9469-2d6071123890", "name": "network-vif-plugged", "status": "completed", "tag": "85840a23-4305-4396-97ee-99e835aa6a14", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:53:27.909975 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-38827305-0324-4897-954a-5907c388870e {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:53:27.910429 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4b4f3ece-1f90-46f7-9469-2d6071123890', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '85840a23-4305-4396-97ee-99e835aa6a14', 'code': 200} Nov 09 04:53:27.957428 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:53:28.002949 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=85840a23-4305-4396-97ee-99e835aa6a14,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:53:28.192132 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0658d088-3046-4ae9-b402-f5271f7b5376 req-3b926036-91cb-4a06-b9a0-a64838698b4f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:28.193623 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-0658d088-3046-4ae9-b402-f5271f7b5376 req-3b926036-91cb-4a06-b9a0-a64838698b4f service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=4b4f3ece-1f90-46f7-9469-2d6071123890 HTTP/1.1" status: 200 len: 1098 time: 0.0434637 Nov 09 04:53:28.237246 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-0658d088-3046-4ae9-b402-f5271f7b5376 req-fc2a2197-36d7-4279-9d0b-5c356e723179 service neutron] 10.222.0.26 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0360978 Nov 09 04:53:28.472698 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c42a9661-8b50-41a9-80c7-a400c3989540 req-affa4352-2171-441a-b4b8-7b0ef527cc1e tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:28.474150 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c42a9661-8b50-41a9-80c7-a400c3989540 req-affa4352-2171-441a-b4b8-7b0ef527cc1e tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=4b4f3ece-1f90-46f7-9469-2d6071123890 HTTP/1.1" status: 200 len: 945 time: 0.0481579 Nov 09 04:53:28.519473 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c42a9661-8b50-41a9-80c7-a400c3989540 req-adcee35a-7e63-4aa3-a1fa-6460477ea978 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0395064 Nov 09 04:53:29.634723 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc83609e-4d3a-4f29-8a94-1bed4dfa970c req-31e3dfc7-bece-4f9a-a88f-eb7256868737 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:29.636169 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-fc83609e-4d3a-4f29-8a94-1bed4dfa970c req-31e3dfc7-bece-4f9a-a88f-eb7256868737 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=4b4f3ece-1f90-46f7-9469-2d6071123890 HTTP/1.1" status: 200 len: 945 time: 0.0473082 Nov 09 04:53:29.685341 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-fc83609e-4d3a-4f29-8a94-1bed4dfa970c req-dfac7e22-6018-40d4-8f03-ec8979e6e60c tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0433261 Nov 09 04:53:29.797281 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f532201b-25bc-4119-87d4-806e844cb0af req-d8cd31be-d02d-4cf6-8263-3641bf2cc494 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:29.798822 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f532201b-25bc-4119-87d4-806e844cb0af req-d8cd31be-d02d-4cf6-8263-3641bf2cc494 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=4b4f3ece-1f90-46f7-9469-2d6071123890 HTTP/1.1" status: 200 len: 945 time: 0.0511217 Nov 09 04:53:29.807109 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 34734) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:53:29.811370 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-15abb9cd-44ae-4b44-8d97-606e0bc78a8d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Request body: {'floatingip': {'port_id': '85840a23-4305-4396-97ee-99e835aa6a14'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:53:29.848989 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-15abb9cd-44ae-4b44-8d97-606e0bc78a8d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks [] for floatingip, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:53:30.263109 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-15abb9cd-44ae-4b44-8d97-606e0bc78a8d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:53:30.363038 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-15abb9cd-44ae-4b44-8d97-606e0bc78a8d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:53:30.463611 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.l3_db [None req-15abb9cd-44ae-4b44-8d97-606e0bc78a8d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Floating IP b0d36e82-421b-451c-b46c-718f80940b13 associated. External IP: 172.26.0.146, port: 85840a23-4305-4396-97ee-99e835aa6a14. Nov 09 04:53:30.663961 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-15abb9cd-44ae-4b44-8d97-606e0bc78a8d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Router 8cd82ce8-0774-460f-8427-ef14caab402a has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:53:30.770900 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-15abb9cd-44ae-4b44-8d97-606e0bc78a8d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:53:30.775696 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-15abb9cd-44ae-4b44-8d97-606e0bc78a8d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:53:30.785315 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9f08af13-9618-44dc-9f96-2c595dc180ea None None] Sync routers for ids ['8cd82ce8-0774-460f-8427-ef14caab402a'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:53:30.804255 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9f08af13-9618-44dc-9f96-2c595dc180ea None None] Routers {'8cd82ce8-0774-460f-8427-ef14caab402a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:53:30.805007 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-9f08af13-9618-44dc-9f96-2c595dc180ea None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:53:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8cd82ce8-0774-460f-8427-ef14caab402a'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:53:30.811856 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-15abb9cd-44ae-4b44-8d97-606e0bc78a8d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "PUT /v2.0/floatingips/b0d36e82-421b-451c-b46c-718f80940b13 HTTP/1.1" status: 200 len: 991 time: 1.0037010 Nov 09 04:53:30.813064 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4b4f3ece-1f90-46f7-9469-2d6071123890', 'tag': '85840a23-4305-4396-97ee-99e835aa6a14'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:53:30.815491 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e41de2ed-0e13-4e2f-9edf-c0be2ccff331" -d '{"events": [{"name": "network-changed", "server_uuid": "4b4f3ece-1f90-46f7-9469-2d6071123890", "tag": "85840a23-4305-4396-97ee-99e835aa6a14"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:53:30.853615 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:53:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d4d752b4-c593-4b29-a1c9-4fbd7e9abcc3 x-openstack-request-id: req-d4d752b4-c593-4b29-a1c9-4fbd7e9abcc3 {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:53:30.853615 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4b4f3ece-1f90-46f7-9469-2d6071123890", "tag": "85840a23-4305-4396-97ee-99e835aa6a14", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:53:30.853615 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-d4d752b4-c593-4b29-a1c9-4fbd7e9abcc3 {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:53:30.853615 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4b4f3ece-1f90-46f7-9469-2d6071123890', 'tag': '85840a23-4305-4396-97ee-99e835aa6a14', 'status': 'completed', 'code': 200} Nov 09 04:53:30.921079 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e41de2ed-0e13-4e2f-9edf-c0be2ccff331 req-9b6c3822-c057-43d0-b541-de9df7113c49 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:30.922935 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e41de2ed-0e13-4e2f-9edf-c0be2ccff331 req-9b6c3822-c057-43d0-b541-de9df7113c49 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1a8335b645d04ccbad2f2ed5288b68e8&device_id=4b4f3ece-1f90-46f7-9469-2d6071123890 HTTP/1.1" status: 200 len: 1098 time: 0.0418856 Nov 09 04:53:30.924143 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-9f08af13-9618-44dc-9f96-2c595dc180ea None None] Set router 8cd82ce8-0774-460f-8427-ef14caab402a gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:53:31.012527 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e41de2ed-0e13-4e2f-9edf-c0be2ccff331 req-31f72fc2-5e3d-424e-b310-4821028e9f08 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:31.014029 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e41de2ed-0e13-4e2f-9edf-c0be2ccff331 req-31f72fc2-5e3d-424e-b310-4821028e9f08 service neutron] 10.222.0.26 "GET /v2.0/networks?id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 HTTP/1.1" status: 200 len: 913 time: 0.0836570 Nov 09 04:53:31.149634 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-9f08af13-9618-44dc-9f96-2c595dc180ea None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'name': 'tempest-ServerActionsTestJSON-1679556620-router', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77'}], 'enable_snat': True}, 'gw_port_id': '6b137909-e697-434a-93b2-4272af33f319', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:50:34Z', 'updated_at': '2021-11-09T04:50:37Z', 'revision_number': 4, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'gw_port': {'id': '6b137909-e697-434a-93b2-4272af33f319', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:88:5d:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1569, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:35Z', 'updated_at': '2021-11-09T04:50:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': 'b0d36e82-421b-451c-b46c-718f80940b13', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'floating_ip_address': '172.26.0.146', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'port_id': '85840a23-4305-4396-97ee-99e835aa6a14', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 1577, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21', 'mac_address': 'fa:16:3e:59:91:43', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b4f3ece-1f90-46f7-9469-2d6071123890', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:50:40Z', 'updated_at': '2021-11-09T04:53:30Z', 'revision_number': 9, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a23873f3-df1f-49c6-93aa-691a0e18c829', 'name': '', 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'mac_address': 'fa:16:3e:58:72:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1570, 'fixed_ips': [{'subnet_id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:37Z', 'updated_at': '2021-11-09T04:50:40Z', 'revision_number': 5, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'subnets': [{'id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:53:31.176800 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9f08af13-9618-44dc-9f96-2c595dc180ea None None] Checking router: 8cd82ce8-0774-460f-8427-ef14caab402a for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:53:31.185465 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9f08af13-9618-44dc-9f96-2c595dc180ea None None] Routers {'8cd82ce8-0774-460f-8427-ef14caab402a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:53:31.186074 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-9f08af13-9618-44dc-9f96-2c595dc180ea None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:53:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8cd82ce8-0774-460f-8427-ef14caab402a'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:53:31.296286 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-9f08af13-9618-44dc-9f96-2c595dc180ea None None] Set router 8cd82ce8-0774-460f-8427-ef14caab402a gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:53:31.428043 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e41de2ed-0e13-4e2f-9edf-c0be2ccff331 req-d2500588-58c8-4186-a98e-a5a28f38aaec service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=85840a23-4305-4396-97ee-99e835aa6a14 HTTP/1.1" status: 200 len: 999 time: 0.4058406 Nov 09 04:53:31.475233 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e41de2ed-0e13-4e2f-9edf-c0be2ccff331 req-97cbe889-b1f5-4999-8f5a-8fa68ffaaa21 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:31.477213 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e41de2ed-0e13-4e2f-9edf-c0be2ccff331 req-97cbe889-b1f5-4999-8f5a-8fa68ffaaa21 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=96831da9-b0dd-45f9-8543-0ac226a68c6a HTTP/1.1" status: 200 len: 851 time: 0.0420721 Nov 09 04:53:31.524653 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e41de2ed-0e13-4e2f-9edf-c0be2ccff331 req-efec3e61-6ac9-4144-b013-1e07c78da71b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:53:31.526100 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e41de2ed-0e13-4e2f-9edf-c0be2ccff331 req-efec3e61-6ac9-4144-b013-1e07c78da71b service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0423062 Nov 09 04:53:31.528155 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-9f08af13-9618-44dc-9f96-2c595dc180ea None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'name': 'tempest-ServerActionsTestJSON-1679556620-router', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77'}], 'enable_snat': True}, 'gw_port_id': '6b137909-e697-434a-93b2-4272af33f319', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:50:34Z', 'updated_at': '2021-11-09T04:50:37Z', 'revision_number': 4, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'gw_port': {'id': '6b137909-e697-434a-93b2-4272af33f319', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:88:5d:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1569, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:35Z', 'updated_at': '2021-11-09T04:50:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': 'b0d36e82-421b-451c-b46c-718f80940b13', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'floating_ip_address': '172.26.0.146', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'port_id': '85840a23-4305-4396-97ee-99e835aa6a14', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 1577, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21', 'mac_address': 'fa:16:3e:59:91:43', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b4f3ece-1f90-46f7-9469-2d6071123890', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:50:40Z', 'updated_at': '2021-11-09T04:53:30Z', 'revision_number': 9, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a23873f3-df1f-49c6-93aa-691a0e18c829', 'name': '', 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'mac_address': 'fa:16:3e:58:72:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1570, 'fixed_ips': [{'subnet_id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:37Z', 'updated_at': '2021-11-09T04:50:40Z', 'revision_number': 5, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'subnets': [{'id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:53:31.555383 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9f08af13-9618-44dc-9f96-2c595dc180ea None None] The sync data for ids ['8cd82ce8-0774-460f-8427-ef14caab402a'] in dv-neutron-816802-2-hyperv is: [{'id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'name': 'tempest-ServerActionsTestJSON-1679556620-router', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77'}], 'enable_snat': True}, 'gw_port_id': '6b137909-e697-434a-93b2-4272af33f319', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:50:34Z', 'updated_at': '2021-11-09T04:50:37Z', 'revision_number': 4, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'gw_port': {'id': '6b137909-e697-434a-93b2-4272af33f319', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:88:5d:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1569, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:35Z', 'updated_at': '2021-11-09T04:50:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': 'b0d36e82-421b-451c-b46c-718f80940b13', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'floating_ip_address': '172.26.0.146', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'port_id': '85840a23-4305-4396-97ee-99e835aa6a14', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 1577, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21', 'mac_address': 'fa:16:3e:59:91:43', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b4f3ece-1f90-46f7-9469-2d6071123890', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:50:40Z', 'updated_at': '2021-11-09T04:53:30Z', 'revision_number': 9, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a23873f3-df1f-49c6-93aa-691a0e18c829', 'name': '', 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'mac_address': 'fa:16:3e:58:72:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1570, 'fixed_ips': [{'subnet_id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:37Z', 'updated_at': '2021-11-09T04:50:40Z', 'revision_number': 5, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'subnets': [{'id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:53:31.623247 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e41de2ed-0e13-4e2f-9edf-c0be2ccff331 req-7bd566e2-4257-40bb-8f24-4b85bffae5e7 service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0861511 Nov 09 04:53:31.719761 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e41de2ed-0e13-4e2f-9edf-c0be2ccff331 req-4ddb79f4-82f3-4af6-9046-fca6b1f74e73 service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0886204 Nov 09 04:53:31.747366 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e8f14dfd-37ce-4534-a95f-ada582444ebb None None] New status for floating IP b0d36e82-421b-451c-b46c-718f80940b13: ACTIVE {{(pid=102163) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 04:53:34.462089 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:53:41.350569 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-64e8222f-fc14-4a85-9cba-7a7df797ff05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:53:42.335195 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:53:43.758495 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-81213f7e-b59f-4272-ad05-ed5a3f08deba None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:53:45.167677 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:53:46.504997 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:53:46.945015 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:54:08.291647 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be55318b-d28b-4699-b315-6f919a660773 req-e197767e-cc34-4b04-aa96-951cadb78c01 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:08.293177 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-be55318b-d28b-4699-b315-6f919a660773 req-e197767e-cc34-4b04-aa96-951cadb78c01 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=4b4f3ece-1f90-46f7-9469-2d6071123890 HTTP/1.1" status: 200 len: 945 time: 0.0494835 Nov 09 04:54:08.340265 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-be55318b-d28b-4699-b315-6f919a660773 req-d0945ac8-3d92-4bc5-972a-0f197da27a3a tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0413249 Nov 09 04:54:08.447573 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4da552a1-6d98-40d7-8fde-029f2389cc61 req-a4d2f501-38dc-4531-a85b-57f19eb3479d service neutron] 10.222.0.24 "GET /v2.0/ports?device_id=4b4f3ece-1f90-46f7-9469-2d6071123890&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0815361 Nov 09 04:54:09.456630 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a443ef85-9564-47c7-a9a2-65be8553b061 req-a4fca1f5-f016-4afb-ac01-43eb7d449ef4 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:09.458066 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a443ef85-9564-47c7-a9a2-65be8553b061 req-a4fca1f5-f016-4afb-ac01-43eb7d449ef4 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=4b4f3ece-1f90-46f7-9469-2d6071123890 HTTP/1.1" status: 200 len: 945 time: 0.0472734 Nov 09 04:54:09.504705 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a443ef85-9564-47c7-a9a2-65be8553b061 req-5693589e-6c62-4064-bcf5-bc602473a322 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0398488 Nov 09 04:54:10.250843 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4da552a1-6d98-40d7-8fde-029f2389cc61 req-5bd7a846-ce12-4dd4-9f2d-a1623ad80848 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:10.252331 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4da552a1-6d98-40d7-8fde-029f2389cc61 req-5bd7a846-ce12-4dd4-9f2d-a1623ad80848 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1a8335b645d04ccbad2f2ed5288b68e8&device_id=4b4f3ece-1f90-46f7-9469-2d6071123890 HTTP/1.1" status: 200 len: 1098 time: 0.0881989 Nov 09 04:54:10.342774 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4da552a1-6d98-40d7-8fde-029f2389cc61 req-88a915cb-c0fd-44ea-ab30-a07c65ef3e74 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:10.344299 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4da552a1-6d98-40d7-8fde-029f2389cc61 req-88a915cb-c0fd-44ea-ab30-a07c65ef3e74 service neutron] 10.222.0.26 "GET /v2.0/networks?id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 HTTP/1.1" status: 200 len: 913 time: 0.0829675 Nov 09 04:54:10.411269 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4da552a1-6d98-40d7-8fde-029f2389cc61 req-ed2978fa-b880-4e01-8051-6b46510a8b57 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=85840a23-4305-4396-97ee-99e835aa6a14 HTTP/1.1" status: 200 len: 1002 time: 0.0598993 Nov 09 04:54:10.460942 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4da552a1-6d98-40d7-8fde-029f2389cc61 req-8210025a-53c5-4a13-ae54-73348f4051e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:10.462288 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4da552a1-6d98-40d7-8fde-029f2389cc61 req-8210025a-53c5-4a13-ae54-73348f4051e4 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=96831da9-b0dd-45f9-8543-0ac226a68c6a HTTP/1.1" status: 200 len: 851 time: 0.0444341 Nov 09 04:54:10.505966 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4da552a1-6d98-40d7-8fde-029f2389cc61 req-fb35d1e7-5130-4286-9c22-a0a50c9dc4ae service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:10.507951 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4da552a1-6d98-40d7-8fde-029f2389cc61 req-fb35d1e7-5130-4286-9c22-a0a50c9dc4ae service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0385919 Nov 09 04:54:10.600382 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4da552a1-6d98-40d7-8fde-029f2389cc61 req-4bdf83e7-e90b-48cd-a255-d5c383c0519b service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0853176 Nov 09 04:54:10.622293 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3632e687-710c-4e2d-a991-b5a64030da0a req-71de2927-6a32-4d1f-bc37-80032ad06e66 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:10.623895 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-3632e687-710c-4e2d-a991-b5a64030da0a req-71de2927-6a32-4d1f-bc37-80032ad06e66 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=4b4f3ece-1f90-46f7-9469-2d6071123890 HTTP/1.1" status: 200 len: 945 time: 0.0516338 Nov 09 04:54:10.670536 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-3632e687-710c-4e2d-a991-b5a64030da0a req-93b9fe8f-bab3-4eb3-bfc9-f36a565ae8e2 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0408523 Nov 09 04:54:10.690077 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4da552a1-6d98-40d7-8fde-029f2389cc61 req-ed79cce8-a825-4917-93bb-3268be90d887 service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0829482 Nov 09 04:54:10.793106 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a150e08-e05b-42ea-8400-7af3a5c250bf req-14d8f51e-846b-463c-9a29-4133559a1a0e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:10.795003 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-0a150e08-e05b-42ea-8400-7af3a5c250bf req-14d8f51e-846b-463c-9a29-4133559a1a0e service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1a8335b645d04ccbad2f2ed5288b68e8&device_id=4b4f3ece-1f90-46f7-9469-2d6071123890 HTTP/1.1" status: 200 len: 1098 time: 0.0472777 Nov 09 04:54:10.903390 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a150e08-e05b-42ea-8400-7af3a5c250bf req-2b35286f-b4bf-4338-8032-4e796ec2d746 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:10.904859 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-0a150e08-e05b-42ea-8400-7af3a5c250bf req-2b35286f-b4bf-4338-8032-4e796ec2d746 service neutron] 10.222.0.26 "GET /v2.0/networks?id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 HTTP/1.1" status: 200 len: 913 time: 0.0864406 Nov 09 04:54:10.975443 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-0a150e08-e05b-42ea-8400-7af3a5c250bf req-152b6810-0f1e-47d2-bacf-07a16c7d201b service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=85840a23-4305-4396-97ee-99e835aa6a14 HTTP/1.1" status: 200 len: 1002 time: 0.0625923 Nov 09 04:54:11.025241 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a150e08-e05b-42ea-8400-7af3a5c250bf req-71855720-a021-42cd-a080-51202a258102 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:11.026726 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-0a150e08-e05b-42ea-8400-7af3a5c250bf req-71855720-a021-42cd-a080-51202a258102 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=96831da9-b0dd-45f9-8543-0ac226a68c6a HTTP/1.1" status: 200 len: 851 time: 0.0449531 Nov 09 04:54:11.073135 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a150e08-e05b-42ea-8400-7af3a5c250bf req-af8134fe-5b85-4878-b980-6d857019ec00 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:11.074820 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-0a150e08-e05b-42ea-8400-7af3a5c250bf req-af8134fe-5b85-4878-b980-6d857019ec00 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0402184 Nov 09 04:54:11.166119 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-0a150e08-e05b-42ea-8400-7af3a5c250bf req-b56162b6-ad79-485a-af26-223d41f35ffe service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0837388 Nov 09 04:54:11.253204 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-0a150e08-e05b-42ea-8400-7af3a5c250bf req-862c531f-ac6e-4174-a6ef-5ea97a816720 service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0800891 Nov 09 04:54:11.362243 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c354f136-da8f-4284-a5f4-62d7e422e0a2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:54:11.461587 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:54:11.788349 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3da5bdfb-900d-41a8-bdd6-b1a66b4f5db3 req-157867d4-a5ae-4fb7-bf26-0dac555724ab tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:11.789843 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3da5bdfb-900d-41a8-bdd6-b1a66b4f5db3 req-157867d4-a5ae-4fb7-bf26-0dac555724ab tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=4b4f3ece-1f90-46f7-9469-2d6071123890 HTTP/1.1" status: 200 len: 945 time: 0.0523131 Nov 09 04:54:11.836085 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3da5bdfb-900d-41a8-bdd6-b1a66b4f5db3 req-bd2afdd3-b7d3-4a07-8e65-de28384c18d8 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0403666 Nov 09 04:54:12.288266 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:54:12.949559 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f35eaef-bae0-46cf-b556-0551babffd30 req-e27910b7-8499-45cc-a282-54ca0ed6e222 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:12.951351 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-4f35eaef-bae0-46cf-b556-0551babffd30 req-e27910b7-8499-45cc-a282-54ca0ed6e222 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=4b4f3ece-1f90-46f7-9469-2d6071123890 HTTP/1.1" status: 200 len: 945 time: 0.0493555 Nov 09 04:54:12.997363 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-4f35eaef-bae0-46cf-b556-0551babffd30 req-960e2b19-b53d-4f1c-b806-7f130f52c016 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0402634 Nov 09 04:54:13.704387 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-68eb20c7-0efd-497b-9ecf-86834e238757 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:54:14.110614 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fe64124-9781-4dd1-a879-f027a8788e78 req-8c14bcc4-bece-4355-923c-52c33a838e9f tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:14.112063 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6fe64124-9781-4dd1-a879-f027a8788e78 req-8c14bcc4-bece-4355-923c-52c33a838e9f tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=4b4f3ece-1f90-46f7-9469-2d6071123890 HTTP/1.1" status: 200 len: 945 time: 0.0485008 Nov 09 04:54:14.158673 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6fe64124-9781-4dd1-a879-f027a8788e78 req-484c3aa8-907b-4861-9c41-0f0c5550392e tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0406489 Nov 09 04:54:15.161051 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:54:15.272150 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3edaf0f7-ec9a-4a05-b2ca-c919cda9330e req-2c8d07ab-0990-447a-a4d3-3d84aaa707a1 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:15.273698 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-3edaf0f7-ec9a-4a05-b2ca-c919cda9330e req-2c8d07ab-0990-447a-a4d3-3d84aaa707a1 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=4b4f3ece-1f90-46f7-9469-2d6071123890 HTTP/1.1" status: 200 len: 945 time: 0.0490344 Nov 09 04:54:15.323206 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-3edaf0f7-ec9a-4a05-b2ca-c919cda9330e req-9e1c1498-7c29-4caf-9219-bc37e17ccb4a tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0436223 Nov 09 04:54:16.434078 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddc0ffd6-ed07-49a6-9658-098c19e20b71 req-948293bf-3a99-42ed-ae56-fcf5b6822206 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:16.435534 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ddc0ffd6-ed07-49a6-9658-098c19e20b71 req-948293bf-3a99-42ed-ae56-fcf5b6822206 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=4b4f3ece-1f90-46f7-9469-2d6071123890 HTTP/1.1" status: 200 len: 945 time: 0.0474086 Nov 09 04:54:16.487732 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ddc0ffd6-ed07-49a6-9658-098c19e20b71 req-bb84d639-6dfd-447b-8fea-d63a5048d9b7 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0463500 Nov 09 04:54:16.568174 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:54:16.989152 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:54:17.617515 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d006c23f-a3c1-43f1-a90c-3ca7c0afacd9 req-79d1b2da-2357-43c7-9ab7-69de1fa3a662 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:17.619013 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d006c23f-a3c1-43f1-a90c-3ca7c0afacd9 req-79d1b2da-2357-43c7-9ab7-69de1fa3a662 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=4b4f3ece-1f90-46f7-9469-2d6071123890 HTTP/1.1" status: 200 len: 945 time: 0.0484028 Nov 09 04:54:17.671672 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d006c23f-a3c1-43f1-a90c-3ca7c0afacd9 req-1fce122c-00e3-4e6b-8a54-689287c058bb tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0464005 Nov 09 04:54:18.783600 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12be1aca-90d9-4306-a5eb-6b444ed9cc55 req-f40df147-b478-40b4-bae3-71a7748f81ee tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:18.785033 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-12be1aca-90d9-4306-a5eb-6b444ed9cc55 req-f40df147-b478-40b4-bae3-71a7748f81ee tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=4b4f3ece-1f90-46f7-9469-2d6071123890 HTTP/1.1" status: 200 len: 945 time: 0.0472710 Nov 09 04:54:18.830777 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-12be1aca-90d9-4306-a5eb-6b444ed9cc55 req-30bb9b3e-d141-4ef0-901b-f1f4dc124627 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0394499 Nov 09 04:54:19.946405 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2502c2d7-f0d6-4233-b6cc-be5ded4d449d req-a026efa5-4722-40be-9e7c-7350458237ec tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:19.947875 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-2502c2d7-f0d6-4233-b6cc-be5ded4d449d req-a026efa5-4722-40be-9e7c-7350458237ec tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=4b4f3ece-1f90-46f7-9469-2d6071123890 HTTP/1.1" status: 200 len: 945 time: 0.0480483 Nov 09 04:54:19.994087 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-2502c2d7-f0d6-4233-b6cc-be5ded4d449d req-0590d015-94fd-40e5-a434-fd534f4ad884 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0400918 Nov 09 04:54:21.109713 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa706995-6d37-4ccc-97e2-743aea7dbae6 req-501d57ae-cc62-442b-8d72-ee0dae2f906e tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:21.111234 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-aa706995-6d37-4ccc-97e2-743aea7dbae6 req-501d57ae-cc62-442b-8d72-ee0dae2f906e tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=4b4f3ece-1f90-46f7-9469-2d6071123890 HTTP/1.1" status: 200 len: 945 time: 0.0492594 Nov 09 04:54:21.158186 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-aa706995-6d37-4ccc-97e2-743aea7dbae6 req-eef119c1-253c-4b08-9078-673036c474c0 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0408149 Nov 09 04:54:22.276371 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4996390-d1c5-4ef2-9160-de97b5820658 req-542a7667-324f-45ac-9e09-a894eda5a81f tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:22.277914 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b4996390-d1c5-4ef2-9160-de97b5820658 req-542a7667-324f-45ac-9e09-a894eda5a81f tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=4b4f3ece-1f90-46f7-9469-2d6071123890 HTTP/1.1" status: 200 len: 945 time: 0.0524538 Nov 09 04:54:22.324348 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b4996390-d1c5-4ef2-9160-de97b5820658 req-5048e6f0-ac80-4462-902f-afdaa0ea1e9a tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0403223 Nov 09 04:54:22.561613 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4da552a1-6d98-40d7-8fde-029f2389cc61 req-d2d11d37-da71-4fe9-ab5b-f42de9f26245 service neutron] 10.222.0.26 "GET /v2.0/ports/85840a23-4305-4396-97ee-99e835aa6a14/bindings/hv-neutron-8168 HTTP/1.1" status: 200 len: 384 time: 0.0596182 Nov 09 04:54:22.974746 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4da552a1-6d98-40d7-8fde-029f2389cc61 req-fdb68a4f-dde7-4b31-ba8a-5b44e1b48094 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:22.976248 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4da552a1-6d98-40d7-8fde-029f2389cc61 req-fdb68a4f-dde7-4b31-ba8a-5b44e1b48094 service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=4b4f3ece-1f90-46f7-9469-2d6071123890&tenant_id=1a8335b645d04ccbad2f2ed5288b68e8 HTTP/1.1" status: 200 len: 1098 time: 0.0415576 Nov 09 04:54:23.037612 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4da552a1-6d98-40d7-8fde-029f2389cc61 req-b4089b11-07f0-4980-9518-e4646a5dad5a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:23.039136 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4da552a1-6d98-40d7-8fde-029f2389cc61 req-b4089b11-07f0-4980-9518-e4646a5dad5a service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1a8335b645d04ccbad2f2ed5288b68e8&device_id=4b4f3ece-1f90-46f7-9469-2d6071123890 HTTP/1.1" status: 200 len: 1098 time: 0.0399632 Nov 09 04:54:23.129768 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4da552a1-6d98-40d7-8fde-029f2389cc61 req-04775a23-afbb-4529-86b5-a0cc166eefd0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:23.131746 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4da552a1-6d98-40d7-8fde-029f2389cc61 req-04775a23-afbb-4529-86b5-a0cc166eefd0 service neutron] 10.222.0.26 "GET /v2.0/networks?id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 HTTP/1.1" status: 200 len: 913 time: 0.0857148 Nov 09 04:54:23.195288 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4da552a1-6d98-40d7-8fde-029f2389cc61 req-f1fd312b-b2c1-4a0d-938a-dd61e26b5a05 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=85840a23-4305-4396-97ee-99e835aa6a14 HTTP/1.1" status: 200 len: 1002 time: 0.0560868 Nov 09 04:54:23.248268 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4da552a1-6d98-40d7-8fde-029f2389cc61 req-507ad0bf-67cf-4fd7-8d09-9d14ab50f229 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:23.249726 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4da552a1-6d98-40d7-8fde-029f2389cc61 req-507ad0bf-67cf-4fd7-8d09-9d14ab50f229 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=96831da9-b0dd-45f9-8543-0ac226a68c6a HTTP/1.1" status: 200 len: 851 time: 0.0476780 Nov 09 04:54:23.299156 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4da552a1-6d98-40d7-8fde-029f2389cc61 req-14763fc3-1868-417a-a91b-a12c5a61c3dc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:23.300610 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4da552a1-6d98-40d7-8fde-029f2389cc61 req-14763fc3-1868-417a-a91b-a12c5a61c3dc service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0431828 Nov 09 04:54:23.389004 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4da552a1-6d98-40d7-8fde-029f2389cc61 req-d324bda6-1947-47d2-a41c-72f8c06c2106 service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0808575 Nov 09 04:54:23.493886 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab48f11b-a551-48a2-8a29-18ce4723ec9f req-28e3f339-a1b4-4bf0-b65e-39766e1baff7 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:23.495282 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ab48f11b-a551-48a2-8a29-18ce4723ec9f req-28e3f339-a1b4-4bf0-b65e-39766e1baff7 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=4b4f3ece-1f90-46f7-9469-2d6071123890 HTTP/1.1" status: 200 len: 945 time: 0.1051524 Nov 09 04:54:23.519206 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4da552a1-6d98-40d7-8fde-029f2389cc61 req-5858235b-3e4b-4423-8de7-921f86c62600 service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1195261 Nov 09 04:54:23.557328 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ab48f11b-a551-48a2-8a29-18ce4723ec9f req-c7c150fd-3808-4646-bd1d-d8c5567301f0 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0543637 Nov 09 04:54:24.684451 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f64144df-72a7-4e54-8ac8-c2874f103097 req-986afc4a-ff5a-4904-987e-d07a7aec4b38 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:24.685934 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f64144df-72a7-4e54-8ac8-c2874f103097 req-986afc4a-ff5a-4904-987e-d07a7aec4b38 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=4b4f3ece-1f90-46f7-9469-2d6071123890 HTTP/1.1" status: 200 len: 945 time: 0.0472085 Nov 09 04:54:24.731940 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f64144df-72a7-4e54-8ac8-c2874f103097 req-500128e3-2f00-4ca9-8476-e605977cfd27 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0401344 Nov 09 04:54:25.852773 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa95ab16-a56f-4847-8b35-81c5a27f3da8 req-e7cedfd3-9a4f-4b7c-95e8-cb65bfa48d17 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:25.854271 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-aa95ab16-a56f-4847-8b35-81c5a27f3da8 req-e7cedfd3-9a4f-4b7c-95e8-cb65bfa48d17 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=4b4f3ece-1f90-46f7-9469-2d6071123890 HTTP/1.1" status: 200 len: 945 time: 0.0553327 Nov 09 04:54:25.899331 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 85840a23-4305-4396-97ee-99e835aa6a14 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=102163) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 09 04:54:25.902691 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-aa95ab16-a56f-4847-8b35-81c5a27f3da8 req-f3650c57-e4a4-4340-bc21-fd1e06ba94a7 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0424833 Nov 09 04:54:25.996435 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 85840a23-4305-4396-97ee-99e835aa6a14, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=85840a23-4305-4396-97ee-99e835aa6a14,segment=NetworkSegment(24d74bfa-ba9d-4c10-aa08-4a4fed47543f),segment_id=24d74bfa-ba9d-4c10-aa08-4a4fed47543f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:54:26.008623 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Returning: {'device': '85840a23-4305-4396-97ee-99e835aa6a14', 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21', 'port_id': '85840a23-4305-4396-97ee-99e835aa6a14', 'mac_address': 'fa:16:3e:59:91:43', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 310, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102163) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 09 04:54:26.044691 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:54:26.058785 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 85840a23-4305-4396-97ee-99e835aa6a14 {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:54:26.080938 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 85840a23-4305-4396-97ee-99e835aa6a14, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=85840a23-4305-4396-97ee-99e835aa6a14,segment=NetworkSegment(24d74bfa-ba9d-4c10-aa08-4a4fed47543f),segment_id=24d74bfa-ba9d-4c10-aa08-4a4fed47543f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:54:26.148866 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:54:26.202434 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=85840a23-4305-4396-97ee-99e835aa6a14,revision_number=6']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:54:26.206683 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['85840a23-4305-4396-97ee-99e835aa6a14'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 04:54:26.214278 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:54:26.214656 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:54:26.214995 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:54:26.215328 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:54:26.215661 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:54:26.215989 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:54:26.216315 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:54:26.216641 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:54:26.216965 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:54:26.217285 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:54:26.217604 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:54:26.217920 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:54:26.483496 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b81f359f-3e4b-454a-b3a4-b01bb1779834 req-bab09f1f-4b84-42c9-b4a6-addb55251973 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:26.484946 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b81f359f-3e4b-454a-b3a4-b01bb1779834 req-bab09f1f-4b84-42c9-b4a6-addb55251973 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=4b4f3ece-1f90-46f7-9469-2d6071123890 HTTP/1.1" status: 200 len: 944 time: 0.0579574 Nov 09 04:54:26.555265 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-632e6319-2617-4240-9a90-1c03c7e28390 req-57996f4f-39c3-4cf2-934a-27f901312ee8 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:26.556659 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-632e6319-2617-4240-9a90-1c03c7e28390 req-57996f4f-39c3-4cf2-934a-27f901312ee8 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.26 "GET /v2.0/ports?device_id=4b4f3ece-1f90-46f7-9469-2d6071123890&tenant_id=1a8335b645d04ccbad2f2ed5288b68e8&binding%3Ahost_id=hv-neutron-8168 HTTP/1.1" status: 200 len: 944 time: 0.0905602 Nov 09 04:54:26.560108 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b81f359f-3e4b-454a-b3a4-b01bb1779834 req-d13be677-e8e1-43f6-957f-e3f7a5841b86 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0617914 Nov 09 04:54:26.617771 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-632e6319-2617-4240-9a90-1c03c7e28390 req-92f30e5b-559e-4efd-9781-849b19049265 service neutron] 10.222.0.26 "GET /v2.0/ports/85840a23-4305-4396-97ee-99e835aa6a14/bindings/hv-neutron-8168 HTTP/1.1" status: 200 len: 384 time: 0.0534861 Nov 09 04:54:26.682038 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-632e6319-2617-4240-9a90-1c03c7e28390 req-8e09dfd5-d710-4ca3-8d45-de6e09e4ffc4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:26.683429 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-632e6319-2617-4240-9a90-1c03c7e28390 req-8e09dfd5-d710-4ca3-8d45-de6e09e4ffc4 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1a8335b645d04ccbad2f2ed5288b68e8&device_id=4b4f3ece-1f90-46f7-9469-2d6071123890 HTTP/1.1" status: 200 len: 1097 time: 0.0402262 Nov 09 04:54:26.773761 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-632e6319-2617-4240-9a90-1c03c7e28390 req-ee27122d-3302-4998-89f2-84ba70454a90 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:26.775207 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-632e6319-2617-4240-9a90-1c03c7e28390 req-ee27122d-3302-4998-89f2-84ba70454a90 service neutron] 10.222.0.26 "GET /v2.0/networks?id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 HTTP/1.1" status: 200 len: 913 time: 0.0851974 Nov 09 04:54:26.837913 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-632e6319-2617-4240-9a90-1c03c7e28390 req-ecec572f-0eeb-4d0a-b2c0-bae2b626ee1a service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=85840a23-4305-4396-97ee-99e835aa6a14 HTTP/1.1" status: 200 len: 1001 time: 0.0559916 Nov 09 04:54:26.884599 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-632e6319-2617-4240-9a90-1c03c7e28390 req-d131be4a-c6fb-4a36-a6d1-61313cb78cc7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:26.886080 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-632e6319-2617-4240-9a90-1c03c7e28390 req-d131be4a-c6fb-4a36-a6d1-61313cb78cc7 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=96831da9-b0dd-45f9-8543-0ac226a68c6a HTTP/1.1" status: 200 len: 851 time: 0.0413380 Nov 09 04:54:26.934446 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-632e6319-2617-4240-9a90-1c03c7e28390 req-f986a5e6-ff75-463d-b72a-753bdcf15b1d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:26.935848 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-632e6319-2617-4240-9a90-1c03c7e28390 req-f986a5e6-ff75-463d-b72a-753bdcf15b1d service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0431440 Nov 09 04:54:27.022344 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-632e6319-2617-4240-9a90-1c03c7e28390 req-b082055d-4947-42eb-9035-ced53b641ea0 service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0788469 Nov 09 04:54:27.112465 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-632e6319-2617-4240-9a90-1c03c7e28390 req-3655ac42-25f5-4a15-bb05-0870baed7671 service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0832140 Nov 09 04:54:27.679343 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d44dab4d-4c56-4684-b5b1-6ad5b554c63c req-f0ab0725-1f76-4acc-8919-957cc93733a9 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:27.680832 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d44dab4d-4c56-4684-b5b1-6ad5b554c63c req-f0ab0725-1f76-4acc-8919-957cc93733a9 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=4b4f3ece-1f90-46f7-9469-2d6071123890 HTTP/1.1" status: 200 len: 944 time: 0.0521407 Nov 09 04:54:27.732696 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d44dab4d-4c56-4684-b5b1-6ad5b554c63c req-8627f1b8-cd84-4c10-aafb-4ffbc7820b5d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0457852 Nov 09 04:54:27.899893 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 85840a23-4305-4396-97ee-99e835aa6a14 up at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:54:27.949685 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning complete for port 85840a23-4305-4396-97ee-99e835aa6a14 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:54:27.950052 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:54:28.023309 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:54:28.044715 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4b4f3ece-1f90-46f7-9469-2d6071123890', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '85840a23-4305-4396-97ee-99e835aa6a14'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:54:28.046932 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cc194e38-a80c-488d-9af1-2a592b468fc3" -d '{"events": [{"server_uuid": "4b4f3ece-1f90-46f7-9469-2d6071123890", "name": "network-vif-plugged", "status": "completed", "tag": "85840a23-4305-4396-97ee-99e835aa6a14"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:54:28.059619 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 85840a23-4305-4396-97ee-99e835aa6a14, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=85840a23-4305-4396-97ee-99e835aa6a14,segment=NetworkSegment(24d74bfa-ba9d-4c10-aa08-4a4fed47543f),segment_id=24d74bfa-ba9d-4c10-aa08-4a4fed47543f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:54:28.089712 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:54:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3e712c70-cac2-4b63-ba10-a69669c42354 x-openstack-request-id: req-3e712c70-cac2-4b63-ba10-a69669c42354 {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:54:28.090007 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4b4f3ece-1f90-46f7-9469-2d6071123890", "name": "network-vif-plugged", "status": "completed", "tag": "85840a23-4305-4396-97ee-99e835aa6a14", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:54:28.090319 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-3e712c70-cac2-4b63-ba10-a69669c42354 {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:54:28.090678 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4b4f3ece-1f90-46f7-9469-2d6071123890', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '85840a23-4305-4396-97ee-99e835aa6a14', 'code': 200} Nov 09 04:54:28.138784 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:54:28.187514 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=85840a23-4305-4396-97ee-99e835aa6a14,revision_number=7']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:54:28.920558 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-407cfdf4-e16e-4734-8bba-fdc791d5f361 req-39330e31-eedf-4157-9407-1d66ac85d507 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:28.922142 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-407cfdf4-e16e-4734-8bba-fdc791d5f361 req-39330e31-eedf-4157-9407-1d66ac85d507 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=4b4f3ece-1f90-46f7-9469-2d6071123890 HTTP/1.1" status: 200 len: 945 time: 0.1234519 Nov 09 04:54:28.968601 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-407cfdf4-e16e-4734-8bba-fdc791d5f361 req-ce312d7d-8355-4757-8f0a-74b49b494247 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0406060 Nov 09 04:54:29.978200 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-632e6319-2617-4240-9a90-1c03c7e28390 req-cd3a2e45-a2be-48b3-ad20-3e86ad181986 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:29.979679 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-632e6319-2617-4240-9a90-1c03c7e28390 req-cd3a2e45-a2be-48b3-ad20-3e86ad181986 service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=4b4f3ece-1f90-46f7-9469-2d6071123890&tenant_id=1a8335b645d04ccbad2f2ed5288b68e8 HTTP/1.1" status: 200 len: 1098 time: 0.0396874 Nov 09 04:54:30.046550 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-632e6319-2617-4240-9a90-1c03c7e28390 req-8cac6f52-3bdb-4ae3-97c2-2a40c5dea24f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:30.047999 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-632e6319-2617-4240-9a90-1c03c7e28390 req-8cac6f52-3bdb-4ae3-97c2-2a40c5dea24f service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1a8335b645d04ccbad2f2ed5288b68e8&device_id=4b4f3ece-1f90-46f7-9469-2d6071123890 HTTP/1.1" status: 200 len: 1098 time: 0.0448573 Nov 09 04:54:30.176628 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-875e1b08-ce6d-45d4-9940-6eed3de5f082 req-55aea84c-7735-43d6-91ea-047277fbecc4 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:30.178120 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-875e1b08-ce6d-45d4-9940-6eed3de5f082 req-55aea84c-7735-43d6-91ea-047277fbecc4 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=4b4f3ece-1f90-46f7-9469-2d6071123890 HTTP/1.1" status: 200 len: 945 time: 0.1382585 Nov 09 04:54:30.179562 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-632e6319-2617-4240-9a90-1c03c7e28390 req-cdf5bf05-df62-44fb-a77f-7ac021ec86be service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:30.180840 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-632e6319-2617-4240-9a90-1c03c7e28390 req-cdf5bf05-df62-44fb-a77f-7ac021ec86be service neutron] 10.222.0.26 "GET /v2.0/networks?id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 HTTP/1.1" status: 200 len: 913 time: 0.1242769 Nov 09 04:54:30.274265 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-875e1b08-ce6d-45d4-9940-6eed3de5f082 req-60f5e94e-5ec8-4ae9-83fb-f22835eea12a tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0896761 Nov 09 04:54:30.278166 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-632e6319-2617-4240-9a90-1c03c7e28390 req-8cafcb41-0642-447a-bf7c-b6a7a2e628cb service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=85840a23-4305-4396-97ee-99e835aa6a14 HTTP/1.1" status: 200 len: 1002 time: 0.0881262 Nov 09 04:54:30.327079 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-632e6319-2617-4240-9a90-1c03c7e28390 req-d904e70a-6769-4671-ab69-575290cdd2a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:30.328469 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-632e6319-2617-4240-9a90-1c03c7e28390 req-d904e70a-6769-4671-ab69-575290cdd2a6 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=96831da9-b0dd-45f9-8543-0ac226a68c6a HTTP/1.1" status: 200 len: 851 time: 0.0437582 Nov 09 04:54:30.372136 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-632e6319-2617-4240-9a90-1c03c7e28390 req-e4ddc1ff-83e0-4617-9b37-70c0630651ee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:30.373559 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-632e6319-2617-4240-9a90-1c03c7e28390 req-e4ddc1ff-83e0-4617-9b37-70c0630651ee service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0380645 Nov 09 04:54:30.464465 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-632e6319-2617-4240-9a90-1c03c7e28390 req-9907d239-edeb-40da-954e-63be1e27c30c service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0826044 Nov 09 04:54:30.550293 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-632e6319-2617-4240-9a90-1c03c7e28390 req-91e2c052-799c-4073-94af-2967f3ec015e service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0787508 Nov 09 04:54:31.392850 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7bcf99a-8a08-4c68-bf62-804e3a35d7e2 req-e55b1ea3-f18f-44d7-a8cb-d709bde4f07a tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:31.394310 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d7bcf99a-8a08-4c68-bf62-804e3a35d7e2 req-e55b1ea3-f18f-44d7-a8cb-d709bde4f07a tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=4b4f3ece-1f90-46f7-9469-2d6071123890 HTTP/1.1" status: 200 len: 945 time: 0.0487726 Nov 09 04:54:31.443935 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d7bcf99a-8a08-4c68-bf62-804e3a35d7e2 req-302e475a-247c-4faf-97f4-dabb1abeefaa tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0432112 Nov 09 04:54:32.559161 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04b32726-4a2a-494e-ae81-6aa5108b27be req-0c875602-e4a7-4dab-9aae-55154bf7448f tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:32.560591 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-04b32726-4a2a-494e-ae81-6aa5108b27be req-0c875602-e4a7-4dab-9aae-55154bf7448f tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=4b4f3ece-1f90-46f7-9469-2d6071123890 HTTP/1.1" status: 200 len: 945 time: 0.0504389 Nov 09 04:54:32.612083 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-04b32726-4a2a-494e-ae81-6aa5108b27be req-90ec6c70-dae2-4723-a070-6f5402cb7334 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0456541 Nov 09 04:54:32.723255 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92685414-c471-4375-921b-8468c26d65d1 req-61084349-56ca-4ace-b7f3-86a17ac7483e tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:32.724602 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-92685414-c471-4375-921b-8468c26d65d1 req-61084349-56ca-4ace-b7f3-86a17ac7483e tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=4b4f3ece-1f90-46f7-9469-2d6071123890 HTTP/1.1" status: 200 len: 945 time: 0.0480483 Nov 09 04:54:32.770007 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-92685414-c471-4375-921b-8468c26d65d1 req-4727d240-6511-4113-8d9c-aa2a1d9d5f71 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0395331 Nov 09 04:54:32.886213 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a816b808-981e-4020-b010-b024b8a4d90d req-2ad56ffa-bd9f-4efc-9370-b8d4b88485bd tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:32.887723 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a816b808-981e-4020-b010-b024b8a4d90d req-2ad56ffa-bd9f-4efc-9370-b8d4b88485bd tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=4b4f3ece-1f90-46f7-9469-2d6071123890 HTTP/1.1" status: 200 len: 945 time: 0.0534575 Nov 09 04:54:32.934272 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a816b808-981e-4020-b010-b024b8a4d90d req-1ed1e181-78e7-4c01-8fa5-b37d40c30718 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0404575 Nov 09 04:54:33.350142 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4407c43d-ed93-413a-89b8-b786a7b03765 req-4ed33516-1a0f-40a2-afb3-8e9dcd300115 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:33.351623 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4407c43d-ed93-413a-89b8-b786a7b03765 req-4ed33516-1a0f-40a2-afb3-8e9dcd300115 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=4b4f3ece-1f90-46f7-9469-2d6071123890 HTTP/1.1" status: 200 len: 945 time: 0.0471082 Nov 09 04:54:33.402488 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4407c43d-ed93-413a-89b8-b786a7b03765 req-f7b5178b-406e-4176-ad52-faf8e92533d1 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0449038 Nov 09 04:54:33.906036 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 85840a23-4305-4396-97ee-99e835aa6a14 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=102163) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 09 04:54:33.909135 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 85840a23-4305-4396-97ee-99e835aa6a14 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:54:34.046980 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:54:34.064980 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 85840a23-4305-4396-97ee-99e835aa6a14, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=85840a23-4305-4396-97ee-99e835aa6a14,segment=NetworkSegment(24d74bfa-ba9d-4c10-aa08-4a4fed47543f),segment_id=24d74bfa-ba9d-4c10-aa08-4a4fed47543f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:54:34.081646 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Returning: {'device': '85840a23-4305-4396-97ee-99e835aa6a14', 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21', 'port_id': '85840a23-4305-4396-97ee-99e835aa6a14', 'mac_address': 'fa:16:3e:59:91:43', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 310, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102163) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 09 04:54:34.087994 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4b4f3ece-1f90-46f7-9469-2d6071123890', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '85840a23-4305-4396-97ee-99e835aa6a14'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:54:34.090175 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1404143c-ce45-44b4-97a8-d99fa8a7934f" -d '{"events": [{"server_uuid": "4b4f3ece-1f90-46f7-9469-2d6071123890", "name": "network-vif-unplugged", "status": "completed", "tag": "85840a23-4305-4396-97ee-99e835aa6a14"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:54:34.104803 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 85840a23-4305-4396-97ee-99e835aa6a14, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=85840a23-4305-4396-97ee-99e835aa6a14,segment=NetworkSegment(24d74bfa-ba9d-4c10-aa08-4a4fed47543f),segment_id=24d74bfa-ba9d-4c10-aa08-4a4fed47543f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:54:34.128543 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 09 Nov 2021 04:54:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2fcc61bd-391a-43ed-a02a-bcd2395dc498 x-openstack-request-id: req-2fcc61bd-391a-43ed-a02a-bcd2395dc498 {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:54:34.128829 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4b4f3ece-1f90-46f7-9469-2d6071123890", "name": "network-vif-unplugged", "status": "completed", "tag": "85840a23-4305-4396-97ee-99e835aa6a14", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:54:34.129076 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-2fcc61bd-391a-43ed-a02a-bcd2395dc498 {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:54:34.129458 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4b4f3ece-1f90-46f7-9469-2d6071123890', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '85840a23-4305-4396-97ee-99e835aa6a14', 'code': 200} Nov 09 04:54:34.137371 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:54:34.153079 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 85840a23-4305-4396-97ee-99e835aa6a14 {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:54:34.177517 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:54:34.244736 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.db.api [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=102163) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:54:34.245088 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG oslo_db.api [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:54:34.247632 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=85840a23-4305-4396-97ee-99e835aa6a14,revision_number=8']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:54:34.514624 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df048de7-abaf-4006-948b-21b97e077fa3 req-535c84a1-8309-4a6f-8cc1-98a4b7158598 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:34.516059 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-df048de7-abaf-4006-948b-21b97e077fa3 req-535c84a1-8309-4a6f-8cc1-98a4b7158598 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=4b4f3ece-1f90-46f7-9469-2d6071123890 HTTP/1.1" status: 200 len: 943 time: 0.0468860 Nov 09 04:54:34.561171 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-df048de7-abaf-4006-948b-21b97e077fa3 req-b50f9394-5c81-432a-a58b-d2d7e45025a2 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0387697 Nov 09 04:54:34.781036 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:54:34.793473 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 85840a23-4305-4396-97ee-99e835aa6a14 {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:54:34.812844 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 85840a23-4305-4396-97ee-99e835aa6a14, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=85840a23-4305-4396-97ee-99e835aa6a14,segment=NetworkSegment(24d74bfa-ba9d-4c10-aa08-4a4fed47543f),segment_id=24d74bfa-ba9d-4c10-aa08-4a4fed47543f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:54:34.891729 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:54:34.944434 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=85840a23-4305-4396-97ee-99e835aa6a14,revision_number=9']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:54:34.950265 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['85840a23-4305-4396-97ee-99e835aa6a14'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 04:54:35.519040 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2983883b-bef4-4024-b92f-c36eb17e2636 req-2c1ccf2e-e8c5-4885-bdb6-e3a5ce7dc24d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:35.520448 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2983883b-bef4-4024-b92f-c36eb17e2636 req-2c1ccf2e-e8c5-4885-bdb6-e3a5ce7dc24d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.26 "GET /v2.0/ports?device_id=4b4f3ece-1f90-46f7-9469-2d6071123890 HTTP/1.1" status: 200 len: 944 time: 0.0467644 Nov 09 04:54:35.607770 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-2983883b-bef4-4024-b92f-c36eb17e2636 req-2380832e-fbcd-47b2-8af5-0b42da754f84 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Deleting port 85840a23-4305-4396-97ee-99e835aa6a14 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:54:35.608101 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-2983883b-bef4-4024-b92f-c36eb17e2636 req-2380832e-fbcd-47b2-8af5-0b42da754f84 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:54:35.676153 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ca77621-b55b-42b5-8b6a-f9443e9ebe60 req-7a8a17f0-a64d-4df0-9b74-7b50b82ed0dc tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:35.678168 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-1ca77621-b55b-42b5-8b6a-f9443e9ebe60 req-7a8a17f0-a64d-4df0-9b74-7b50b82ed0dc tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=4b4f3ece-1f90-46f7-9469-2d6071123890 HTTP/1.1" status: 200 len: 944 time: 0.0491898 Nov 09 04:54:35.696763 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-2983883b-bef4-4024-b92f-c36eb17e2636 req-2380832e-fbcd-47b2-8af5-0b42da754f84 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] For port 85840a23-4305-4396-97ee-99e835aa6a14, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=85840a23-4305-4396-97ee-99e835aa6a14,segment=NetworkSegment(24d74bfa-ba9d-4c10-aa08-4a4fed47543f),segment_id=24d74bfa-ba9d-4c10-aa08-4a4fed47543f)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:54:35.701861 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-2983883b-bef4-4024-b92f-c36eb17e2636 req-2380832e-fbcd-47b2-8af5-0b42da754f84 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:54:35.725726 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-1ca77621-b55b-42b5-8b6a-f9443e9ebe60 req-701cbe31-de15-4fca-aeec-d9e27f8d4579 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0413237 Nov 09 04:54:35.867388 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-2983883b-bef4-4024-b92f-c36eb17e2636 req-2380832e-fbcd-47b2-8af5-0b42da754f84 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:54:35.867655 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-2983883b-bef4-4024-b92f-c36eb17e2636 req-2380832e-fbcd-47b2-8af5-0b42da754f84 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:54:35.867961 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.l3_db [req-2983883b-bef4-4024-b92f-c36eb17e2636 req-2380832e-fbcd-47b2-8af5-0b42da754f84 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Floating IP b0d36e82-421b-451c-b46c-718f80940b13 disassociated. External IP: 172.26.0.146, port: 85840a23-4305-4396-97ee-99e835aa6a14. Nov 09 04:54:35.868293 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-2983883b-bef4-4024-b92f-c36eb17e2636 req-2380832e-fbcd-47b2-8af5-0b42da754f84 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Calling delete_port for 85840a23-4305-4396-97ee-99e835aa6a14 owned by compute:nova {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:54:35.914281 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 85840a23-4305-4396-97ee-99e835aa6a14 up at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:54:35.966220 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning complete for port 85840a23-4305-4396-97ee-99e835aa6a14 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:54:35.966220 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:54:36.042788 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:54:36.053719 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-2983883b-bef4-4024-b92f-c36eb17e2636 req-2380832e-fbcd-47b2-8af5-0b42da754f84 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:54:36.086602 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2380832e-fbcd-47b2-8af5-0b42da754f84 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Pushing event deleted for resources: {'Port': ['ID=85840a23-4305-4396-97ee-99e835aa6a14,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:54:36.097771 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2380832e-fbcd-47b2-8af5-0b42da754f84 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:54:36.098115 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2380832e-fbcd-47b2-8af5-0b42da754f84 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:54:36.098998 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2380832e-fbcd-47b2-8af5-0b42da754f84 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:54:36.099343 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2380832e-fbcd-47b2-8af5-0b42da754f84 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:54:36.099647 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2380832e-fbcd-47b2-8af5-0b42da754f84 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:54:36.099975 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2380832e-fbcd-47b2-8af5-0b42da754f84 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:54:36.100298 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2380832e-fbcd-47b2-8af5-0b42da754f84 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:54:36.100622 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2380832e-fbcd-47b2-8af5-0b42da754f84 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:54:36.100956 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2380832e-fbcd-47b2-8af5-0b42da754f84 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:54:36.101275 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2380832e-fbcd-47b2-8af5-0b42da754f84 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:54:36.101593 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2380832e-fbcd-47b2-8af5-0b42da754f84 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:54:36.101908 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2380832e-fbcd-47b2-8af5-0b42da754f84 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:54:36.210807 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [req-2983883b-bef4-4024-b92f-c36eb17e2636 req-2380832e-fbcd-47b2-8af5-0b42da754f84 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Router 8cd82ce8-0774-460f-8427-ef14caab402a has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:54:36.317390 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-2983883b-bef4-4024-b92f-c36eb17e2636 req-2380832e-fbcd-47b2-8af5-0b42da754f84 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:54:36.326942 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a7f3b7ea-b3df-4379-8079-bdd7ab4f52d5 None None] Sync routers for ids ['8cd82ce8-0774-460f-8427-ef14caab402a'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:54:36.337389 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a7f3b7ea-b3df-4379-8079-bdd7ab4f52d5 None None] Routers {'8cd82ce8-0774-460f-8427-ef14caab402a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:54:36.338025 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-a7f3b7ea-b3df-4379-8079-bdd7ab4f52d5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:54:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8cd82ce8-0774-460f-8427-ef14caab402a'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:54:36.359867 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-2983883b-bef4-4024-b92f-c36eb17e2636 req-2380832e-fbcd-47b2-8af5-0b42da754f84 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] No DVR routers for this DVR port 85840a23-4305-4396-97ee-99e835aa6a14 on host hv-neutron-8168 {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:54:36.362398 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-2983883b-bef4-4024-b92f-c36eb17e2636 req-2380832e-fbcd-47b2-8af5-0b42da754f84 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:54:36.365731 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2983883b-bef4-4024-b92f-c36eb17e2636 req-2380832e-fbcd-47b2-8af5-0b42da754f84 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.26 "DELETE /v2.0/ports/85840a23-4305-4396-97ee-99e835aa6a14 HTTP/1.1" status: 204 len: 173 time: 0.8396332 Nov 09 04:54:36.366176 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4b4f3ece-1f90-46f7-9469-2d6071123890', 'name': 'network-vif-deleted', 'tag': '85840a23-4305-4396-97ee-99e835aa6a14'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:54:36.368493 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-66e1e4f4-7b7e-42b3-b767-60b020c070ac" -d '{"events": [{"server_uuid": "4b4f3ece-1f90-46f7-9469-2d6071123890", "name": "network-vif-deleted", "tag": "85840a23-4305-4396-97ee-99e835aa6a14"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:54:36.404279 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:54:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0445687f-1dcb-4fed-a2f3-bf34549111c8 x-openstack-request-id: req-0445687f-1dcb-4fed-a2f3-bf34549111c8 {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:54:36.404664 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4b4f3ece-1f90-46f7-9469-2d6071123890", "name": "network-vif-deleted", "tag": "85840a23-4305-4396-97ee-99e835aa6a14", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:54:36.404852 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-0445687f-1dcb-4fed-a2f3-bf34549111c8 {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:54:36.405222 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4b4f3ece-1f90-46f7-9469-2d6071123890', 'name': 'network-vif-deleted', 'tag': '85840a23-4305-4396-97ee-99e835aa6a14', 'status': 'completed', 'code': 200} Nov 09 04:54:36.442958 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-a7f3b7ea-b3df-4379-8079-bdd7ab4f52d5 None None] Set router 8cd82ce8-0774-460f-8427-ef14caab402a gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:54:36.636174 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-a7f3b7ea-b3df-4379-8079-bdd7ab4f52d5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'name': 'tempest-ServerActionsTestJSON-1679556620-router', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77'}], 'enable_snat': True}, 'gw_port_id': '6b137909-e697-434a-93b2-4272af33f319', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:50:34Z', 'updated_at': '2021-11-09T04:50:37Z', 'revision_number': 4, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'gw_port': {'id': '6b137909-e697-434a-93b2-4272af33f319', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:88:5d:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1569, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:35Z', 'updated_at': '2021-11-09T04:50:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'a23873f3-df1f-49c6-93aa-691a0e18c829', 'name': '', 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'mac_address': 'fa:16:3e:58:72:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1570, 'fixed_ips': [{'subnet_id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:37Z', 'updated_at': '2021-11-09T04:50:40Z', 'revision_number': 5, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'subnets': [{'id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:54:36.666335 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a7f3b7ea-b3df-4379-8079-bdd7ab4f52d5 None None] Checking router: 8cd82ce8-0774-460f-8427-ef14caab402a for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:54:36.674632 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a7f3b7ea-b3df-4379-8079-bdd7ab4f52d5 None None] Routers {'8cd82ce8-0774-460f-8427-ef14caab402a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:54:36.675221 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-a7f3b7ea-b3df-4379-8079-bdd7ab4f52d5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:54:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8cd82ce8-0774-460f-8427-ef14caab402a'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:54:36.780232 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-a7f3b7ea-b3df-4379-8079-bdd7ab4f52d5 None None] Set router 8cd82ce8-0774-460f-8427-ef14caab402a gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:54:36.839641 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-dd297846-82bd-437a-979a-3c5aa3b1ac5e req-df198eea-2704-46df-a8ba-3c8b99b19e6b tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=4b4f3ece-1f90-46f7-9469-2d6071123890 HTTP/1.1" status: 200 len: 210 time: 0.0310128 Nov 09 04:54:37.060746 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-a7f3b7ea-b3df-4379-8079-bdd7ab4f52d5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'name': 'tempest-ServerActionsTestJSON-1679556620-router', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77'}], 'enable_snat': True}, 'gw_port_id': '6b137909-e697-434a-93b2-4272af33f319', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:50:34Z', 'updated_at': '2021-11-09T04:50:37Z', 'revision_number': 4, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'gw_port': {'id': '6b137909-e697-434a-93b2-4272af33f319', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:88:5d:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1569, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:35Z', 'updated_at': '2021-11-09T04:50:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'a23873f3-df1f-49c6-93aa-691a0e18c829', 'name': '', 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'mac_address': 'fa:16:3e:58:72:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1570, 'fixed_ips': [{'subnet_id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:37Z', 'updated_at': '2021-11-09T04:50:40Z', 'revision_number': 5, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'subnets': [{'id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:54:37.087006 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a7f3b7ea-b3df-4379-8079-bdd7ab4f52d5 None None] The sync data for ids ['8cd82ce8-0774-460f-8427-ef14caab402a'] in dv-neutron-816802-2-hyperv is: [{'id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'name': 'tempest-ServerActionsTestJSON-1679556620-router', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77'}], 'enable_snat': True}, 'gw_port_id': '6b137909-e697-434a-93b2-4272af33f319', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:50:34Z', 'updated_at': '2021-11-09T04:50:37Z', 'revision_number': 4, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'gw_port': {'id': '6b137909-e697-434a-93b2-4272af33f319', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:88:5d:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1569, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:35Z', 'updated_at': '2021-11-09T04:50:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'a23873f3-df1f-49c6-93aa-691a0e18c829', 'name': '', 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'mac_address': 'fa:16:3e:58:72:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1570, 'fixed_ips': [{'subnet_id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:37Z', 'updated_at': '2021-11-09T04:50:40Z', 'revision_number': 5, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'subnets': [{'id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:54:37.300016 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b7092737-3f1b-47ca-80af-4346ee159eda None None] New status for floating IP b0d36e82-421b-451c-b46c-718f80940b13: DOWN {{(pid=102163) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 04:54:38.089424 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-67f233e6-d573-43b8-a736-66b4a527d695 req-1810dc97-007a-47d2-8491-95f476efe53e tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?name=tempest-securitygroup--873602357&fields=id&tenant_id=1a8335b645d04ccbad2f2ed5288b68e8 HTTP/1.1" status: 200 len: 267 time: 0.0425353 Nov 09 04:54:38.192631 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67f233e6-d573-43b8-a736-66b4a527d695 req-7a9ad5e8-b389-454c-8951-0209873abde9 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:38.193979 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-67f233e6-d573-43b8-a736-66b4a527d695 req-7a9ad5e8-b389-454c-8951-0209873abde9 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/networks?id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 HTTP/1.1" status: 200 len: 812 time: 0.0979788 Nov 09 04:54:38.208645 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-67f233e6-d573-43b8-a736-66b4a527d695 req-7f3aa073-eeeb-4330-95c7-7611becd02ea tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/quotas/1a8335b645d04ccbad2f2ed5288b68e8 HTTP/1.1" status: 200 len: 375 time: 0.0086417 Nov 09 04:54:38.265869 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-67f233e6-d573-43b8-a736-66b4a527d695 req-9a770ea2-0f36-4a5a-bb41-432ca33b6b96 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?tenant_id=1a8335b645d04ccbad2f2ed5288b68e8&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0518050 Nov 09 04:54:38.361535 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-67f233e6-d573-43b8-a736-66b4a527d695 req-747e5902-35d0-43df-8a1e-57ce296ee33e service neutron] 10.222.0.24 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0817714 Nov 09 04:54:38.456841 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-67f233e6-d573-43b8-a736-66b4a527d695 req-93f5e0f6-23d8-41ea-961d-ab36db6cfe63 service neutron] 10.222.0.24 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0885615 Nov 09 04:54:38.707380 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-527c41f7-9dae-4806-b58a-e5c51d476c1c req-6fd65708-b517-4380-bb9c-0d4b181b6c0b tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 210 time: 0.0266078 Nov 09 04:54:39.808372 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ae04e150-215c-47c1-b393-9e1d5c75a418 req-24b2db84-6a57-440b-a2bf-310b0bf0bc3c tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 210 time: 0.0272753 Nov 09 04:54:39.947320 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 85840a23-4305-4396-97ee-99e835aa6a14 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:54:39.967618 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] No Port match for: 85840a23-4305-4396-97ee-99e835aa6a14 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:54:39.967953 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 85840a23-4305-4396-97ee-99e835aa6a14 not bound to the agent host hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:54:40.419548 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67f233e6-d573-43b8-a736-66b4a527d695 req-45a23eb1-c86e-4013-ab56-ec027c82465b tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:40.421254 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-67f233e6-d573-43b8-a736-66b4a527d695 req-45a23eb1-c86e-4013-ab56-ec027c82465b tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.26 "GET /v2.0/networks?id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 HTTP/1.1" status: 200 len: 812 time: 0.1029968 Nov 09 04:54:40.483492 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-67f233e6-d573-43b8-a736-66b4a527d695 req-e509949a-462c-464e-92a8-7709cd9bbf75 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.26 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=1a8335b645d04ccbad2f2ed5288b68e8 HTTP/1.1" status: 200 len: 379 time: 0.0518699 Nov 09 04:54:40.493131 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-67f233e6-d573-43b8-a736-66b4a527d695 req-c75c6108-9dd3-4977-a431-30ebe67cd686 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Request body: {'port': {'device_id': '5281ed15-8461-45dc-b7a9-7646ab20e2f1', 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21', 'admin_state_up': True, 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'security_groups': ['f9cad1da-5723-46c3-9e10-9af8b6b844b8']}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:54:40.709207 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-67f233e6-d573-43b8-a736-66b4a527d695 req-c75c6108-9dd3-4977-a431-30ebe67cd686 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Made reservation on behalf of 1a8335b645d04ccbad2f2ed5288b68e8 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:54:40.712821 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-67f233e6-d573-43b8-a736-66b4a527d695 req-c75c6108-9dd3-4977-a431-30ebe67cd686 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:54:40.844056 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [req-67f233e6-d573-43b8-a736-66b4a527d695 req-c75c6108-9dd3-4977-a431-30ebe67cd686 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Allocated IP 172.20.0.3 (d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21/96831da9-b0dd-45f9-8543-0ac226a68c6a/937de9d0-81e1-4c07-83c2-85629ef8f9f4) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:54:40.903960 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d2fc6338-578c-4806-8d25-156fa6c50993 req-f1e91516-522b-4297-a2c8-b4fdc2937888 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 210 time: 0.0276394 Nov 09 04:54:40.979744 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-67f233e6-d573-43b8-a736-66b4a527d695 req-c75c6108-9dd3-4977-a431-30ebe67cd686 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:54:41.058479 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-67f233e6-d573-43b8-a736-66b4a527d695 req-c75c6108-9dd3-4977-a431-30ebe67cd686 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:54:41.100090 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-67f233e6-d573-43b8-a736-66b4a527d695 req-c75c6108-9dd3-4977-a431-30ebe67cd686 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Network d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:54:41.104981 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [req-67f233e6-d573-43b8-a736-66b4a527d695 req-c75c6108-9dd3-4977-a431-30ebe67cd686 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:54:41.108625 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-67f233e6-d573-43b8-a736-66b4a527d695 req-c75c6108-9dd3-4977-a431-30ebe67cd686 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:54:41.132019 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c75c6108-9dd3-4977-a431-30ebe67cd686 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Pushing event updated for resources: {'Port': ['ID=937de9d0-81e1-4c07-83c2-85629ef8f9f4,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:54:41.160654 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67f233e6-d573-43b8-a736-66b4a527d695 req-c75c6108-9dd3-4977-a431-30ebe67cd686 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:41.161262 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-67f233e6-d573-43b8-a736-66b4a527d695 req-c75c6108-9dd3-4977-a431-30ebe67cd686 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:54:41.232859 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-67f233e6-d573-43b8-a736-66b4a527d695 req-c75c6108-9dd3-4977-a431-30ebe67cd686 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.26 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7431736 Nov 09 04:54:41.246206 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-67f233e6-d573-43b8-a736-66b4a527d695 req-1849c157-4369-4dc4-828d-6173b7e02d6e service neutron] Request body: {'port': {'device_id': '5281ed15-8461-45dc-b7a9-7646ab20e2f1', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:54:41.303705 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-67f233e6-d573-43b8-a736-66b4a527d695 req-1849c157-4369-4dc4-828d-6173b7e02d6e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:54:41.338548 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4cbc838d-7118-4d32-9d1e-2dcaca1b2115 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:54:41.376271 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-a3f68495-bee6-40e8-b095-5fe27c9f2c77 None None] Provisioning complete for port 937de9d0-81e1-4c07-83c2-85629ef8f9f4 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:54:41.376645 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a3f68495-bee6-40e8-b095-5fe27c9f2c77 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:54:41.415364 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-a3f68495-bee6-40e8-b095-5fe27c9f2c77 None None] Port 937de9d0-81e1-4c07-83c2-85629ef8f9f4 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:54:41.898711 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [req-67f233e6-d573-43b8-a736-66b4a527d695 req-1849c157-4369-4dc4-828d-6173b7e02d6e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 937de9d0-81e1-4c07-83c2-85629ef8f9f4 {{(pid=102162) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:54:41.905893 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-67f233e6-d573-43b8-a736-66b4a527d695 req-1849c157-4369-4dc4-828d-6173b7e02d6e service neutron] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:54:41.917437 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.provisioning_blocks [req-67f233e6-d573-43b8-a736-66b4a527d695 req-1849c157-4369-4dc4-828d-6173b7e02d6e service neutron] Transition to ACTIVE for port object 937de9d0-81e1-4c07-83c2-85629ef8f9f4 will not be triggered until provisioned by entity L2. {{(pid=102162) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 09 04:54:41.998540 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-67f233e6-d573-43b8-a736-66b4a527d695 req-1849c157-4369-4dc4-828d-6173b7e02d6e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:54:42.057113 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1849c157-4369-4dc4-828d-6173b7e02d6e service neutron] Pushing event updated for resources: {'Port': ['ID=937de9d0-81e1-4c07-83c2-85629ef8f9f4,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:54:42.068125 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a3df265-d718-4382-9025-6c70f196f1d6 req-652755d3-3f12-416a-a656-080848e10f3f tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:42.069649 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5a3df265-d718-4382-9025-6c70f196f1d6 req-652755d3-3f12-416a-a656-080848e10f3f tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 931 time: 0.0984704 Nov 09 04:54:42.165149 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5a3df265-d718-4382-9025-6c70f196f1d6 req-d3f93bf3-0608-48b2-afee-ee54f5efadd1 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0748179 Nov 09 04:54:42.174784 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-67f233e6-d573-43b8-a736-66b4a527d695 req-1849c157-4369-4dc4-828d-6173b7e02d6e service neutron] Attempting to bind port 937de9d0-81e1-4c07-83c2-85629ef8f9f4 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:54:42.175118 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-67f233e6-d573-43b8-a736-66b4a527d695 req-1849c157-4369-4dc4-828d-6173b7e02d6e service neutron] Attempting to bind port 937de9d0-81e1-4c07-83c2-85629ef8f9f4 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '24d74bfa-ba9d-4c10-aa08-4a4fed47543f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:54:42.175445 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-67f233e6-d573-43b8-a736-66b4a527d695 req-1849c157-4369-4dc4-828d-6173b7e02d6e service neutron] Attempting to bind port 937de9d0-81e1-4c07-83c2-85629ef8f9f4 on network d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:54:42.180249 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-67f233e6-d573-43b8-a736-66b4a527d695 req-1849c157-4369-4dc4-828d-6173b7e02d6e service neutron] Port 937de9d0-81e1-4c07-83c2-85629ef8f9f4 on network d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:54:42.180691 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-67f233e6-d573-43b8-a736-66b4a527d695 req-1849c157-4369-4dc4-828d-6173b7e02d6e service neutron] Attempting to bind port 937de9d0-81e1-4c07-83c2-85629ef8f9f4 on network d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:54:42.185336 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-67f233e6-d573-43b8-a736-66b4a527d695 req-1849c157-4369-4dc4-828d-6173b7e02d6e service neutron] Checking agent: {'id': '7d36b884-4ad2-4878-9464-bf647030b544', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'started_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 54, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:54:42.185669 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-67f233e6-d573-43b8-a736-66b4a527d695 req-1849c157-4369-4dc4-828d-6173b7e02d6e service neutron] Checking segment: {'id': '24d74bfa-ba9d-4c10-aa08-4a4fed47543f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:54:42.186046 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-67f233e6-d573-43b8-a736-66b4a527d695 req-1849c157-4369-4dc4-828d-6173b7e02d6e service neutron] Bound using segment: {'id': '24d74bfa-ba9d-4c10-aa08-4a4fed47543f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21'} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:54:42.186492 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-67f233e6-d573-43b8-a736-66b4a527d695 req-1849c157-4369-4dc4-828d-6173b7e02d6e service neutron] Bound port: 937de9d0-81e1-4c07-83c2-85629ef8f9f4, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '24d74bfa-ba9d-4c10-aa08-4a4fed47543f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21'}}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:54:42.186845 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-67f233e6-d573-43b8-a736-66b4a527d695 req-1849c157-4369-4dc4-828d-6173b7e02d6e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:54:42.253303 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-67f233e6-d573-43b8-a736-66b4a527d695 req-1849c157-4369-4dc4-828d-6173b7e02d6e service neutron] For port 937de9d0-81e1-4c07-83c2-85629ef8f9f4, host hv-neutron-8168, cleared binding levels {{(pid=102162) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:54:42.257034 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-67f233e6-d573-43b8-a736-66b4a527d695 req-1849c157-4369-4dc4-828d-6173b7e02d6e service neutron] For port 937de9d0-81e1-4c07-83c2-85629ef8f9f4, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=937de9d0-81e1-4c07-83c2-85629ef8f9f4,segment=NetworkSegment(24d74bfa-ba9d-4c10-aa08-4a4fed47543f),segment_id=24d74bfa-ba9d-4c10-aa08-4a4fed47543f)] {{(pid=102162) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:54:42.348715 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-67f233e6-d573-43b8-a736-66b4a527d695 req-1849c157-4369-4dc4-828d-6173b7e02d6e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:54:42.376686 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:54:42.381869 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67f233e6-d573-43b8-a736-66b4a527d695 req-1849c157-4369-4dc4-828d-6173b7e02d6e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:42.382511 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-67f233e6-d573-43b8-a736-66b4a527d695 req-1849c157-4369-4dc4-828d-6173b7e02d6e service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:54:42.386479 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-67f233e6-d573-43b8-a736-66b4a527d695 req-1849c157-4369-4dc4-828d-6173b7e02d6e service neutron] 10.222.0.26 "PUT /v2.0/ports/937de9d0-81e1-4c07-83c2-85629ef8f9f4 HTTP/1.1" status: 200 len: 1093 time: 1.1420803 Nov 09 04:54:42.386479 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5281ed15-8461-45dc-b7a9-7646ab20e2f1', 'tag': '937de9d0-81e1-4c07-83c2-85629ef8f9f4'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:54:42.386777 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-90a22474-5aba-4a05-b16f-abfb0d622956" -d '{"events": [{"name": "network-changed", "server_uuid": "5281ed15-8461-45dc-b7a9-7646ab20e2f1", "tag": "937de9d0-81e1-4c07-83c2-85629ef8f9f4"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:54:42.416059 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1849c157-4369-4dc4-828d-6173b7e02d6e service neutron] Pushing event updated for resources: {'Port': ['ID=937de9d0-81e1-4c07-83c2-85629ef8f9f4,revision_number=3']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:54:42.494784 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:54:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e1748624-837e-4ff7-8ab5-3e614cac84bb x-openstack-request-id: req-e1748624-837e-4ff7-8ab5-3e614cac84bb {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:54:42.495072 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5281ed15-8461-45dc-b7a9-7646ab20e2f1", "tag": "937de9d0-81e1-4c07-83c2-85629ef8f9f4", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:54:42.495318 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-e1748624-837e-4ff7-8ab5-3e614cac84bb {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:54:42.495716 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5281ed15-8461-45dc-b7a9-7646ab20e2f1', 'tag': '937de9d0-81e1-4c07-83c2-85629ef8f9f4', 'status': 'completed', 'code': 200} Nov 09 04:54:42.539979 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67f233e6-d573-43b8-a736-66b4a527d695 req-befd5f30-aec9-4e8c-b5e9-2133b227ab09 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:42.541560 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-67f233e6-d573-43b8-a736-66b4a527d695 req-befd5f30-aec9-4e8c-b5e9-2133b227ab09 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1a8335b645d04ccbad2f2ed5288b68e8&device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 1096 time: 0.0427670 Nov 09 04:54:42.584146 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-67f233e6-d573-43b8-a736-66b4a527d695 req-1df58962-ba53-4153-81f2-27719c49ac62 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=937de9d0-81e1-4c07-83c2-85629ef8f9f4 HTTP/1.1" status: 200 len: 217 time: 0.0347681 Nov 09 04:54:42.640137 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67f233e6-d573-43b8-a736-66b4a527d695 req-be41e66f-ff37-4228-bbbd-af2ccdab7cbc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:42.641507 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-67f233e6-d573-43b8-a736-66b4a527d695 req-be41e66f-ff37-4228-bbbd-af2ccdab7cbc service neutron] 10.222.0.26 "GET /v2.0/subnets?id=96831da9-b0dd-45f9-8543-0ac226a68c6a HTTP/1.1" status: 200 len: 851 time: 0.0455780 Nov 09 04:54:42.688200 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67f233e6-d573-43b8-a736-66b4a527d695 req-45c92270-5307-4e2c-ab59-ad89f24d2631 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:42.689672 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-67f233e6-d573-43b8-a736-66b4a527d695 req-45c92270-5307-4e2c-ab59-ad89f24d2631 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0405412 Nov 09 04:54:42.779775 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-67f233e6-d573-43b8-a736-66b4a527d695 req-17345060-b0f2-4310-a6fe-75256fb8bb29 service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0821800 Nov 09 04:54:42.866792 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-67f233e6-d573-43b8-a736-66b4a527d695 req-43dde49b-3acb-4547-8acc-93400c2f914a service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0795078 Nov 09 04:54:43.008064 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90a22474-5aba-4a05-b16f-abfb0d622956 req-aaddc43b-12b9-4f69-9c29-3199eada9862 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:43.009416 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-90a22474-5aba-4a05-b16f-abfb0d622956 req-aaddc43b-12b9-4f69-9c29-3199eada9862 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1a8335b645d04ccbad2f2ed5288b68e8&device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 1096 time: 0.0398481 Nov 09 04:54:43.104072 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90a22474-5aba-4a05-b16f-abfb0d622956 req-1ab8f93a-76c0-4d2e-9cd3-1554b6cfebd8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:43.105527 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-90a22474-5aba-4a05-b16f-abfb0d622956 req-1ab8f93a-76c0-4d2e-9cd3-1554b6cfebd8 service neutron] 10.222.0.26 "GET /v2.0/networks?id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 HTTP/1.1" status: 200 len: 913 time: 0.0879626 Nov 09 04:54:43.147806 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-90a22474-5aba-4a05-b16f-abfb0d622956 req-e208d916-3acd-4910-9541-26831201ee86 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=937de9d0-81e1-4c07-83c2-85629ef8f9f4 HTTP/1.1" status: 200 len: 217 time: 0.0333557 Nov 09 04:54:43.200228 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90a22474-5aba-4a05-b16f-abfb0d622956 req-78124629-f2fc-4f51-bd14-6de5f8e500da service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:43.201662 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-90a22474-5aba-4a05-b16f-abfb0d622956 req-78124629-f2fc-4f51-bd14-6de5f8e500da service neutron] 10.222.0.26 "GET /v2.0/subnets?id=96831da9-b0dd-45f9-8543-0ac226a68c6a HTTP/1.1" status: 200 len: 851 time: 0.0467193 Nov 09 04:54:43.274000 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90a22474-5aba-4a05-b16f-abfb0d622956 req-3860213f-3aa0-4368-a95d-e8d25968a153 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:43.275540 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-90a22474-5aba-4a05-b16f-abfb0d622956 req-3860213f-3aa0-4368-a95d-e8d25968a153 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0658708 Nov 09 04:54:43.291358 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-465fc0d9-305f-4415-a823-f1d5ef8c2aab req-f2bed687-fc96-4f84-b72d-3c2bb629677d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:43.292763 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-465fc0d9-305f-4415-a823-f1d5ef8c2aab req-f2bed687-fc96-4f84-b72d-3c2bb629677d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 943 time: 0.0587640 Nov 09 04:54:43.393541 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-465fc0d9-305f-4415-a823-f1d5ef8c2aab req-5551936f-6c4e-49bb-aad8-90a541a9b3ac tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0930531 Nov 09 04:54:43.412220 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-90a22474-5aba-4a05-b16f-abfb0d622956 req-50a501ce-c9e0-43dd-9296-8ec0f5e29d62 service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1185498 Nov 09 04:54:43.501834 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-90a22474-5aba-4a05-b16f-abfb0d622956 req-2cb12488-0971-4cf1-87e5-5cb1340b915b service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0815415 Nov 09 04:54:43.721103 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56fd8674-62a3-40b4-9731-5b43e6f71234 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:54:44.507629 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a33846b2-7a3f-4c74-bf10-c20ac3aa1029 req-ea76f42d-bd44-4760-b6ae-a4ca63a1a4f5 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:44.509079 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-a33846b2-7a3f-4c74-bf10-c20ac3aa1029 req-ea76f42d-bd44-4760-b6ae-a4ca63a1a4f5 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 943 time: 0.0473475 Nov 09 04:54:44.554348 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-a33846b2-7a3f-4c74-bf10-c20ac3aa1029 req-db3ec5da-5ec6-4d07-abf8-678972ea2310 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0394359 Nov 09 04:54:45.161114 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:54:45.669712 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-443a01f1-855a-4201-89be-71afc8ef7538 req-4e22b201-3ef1-4c6d-bfe9-2f1981900b2f tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:45.671196 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-443a01f1-855a-4201-89be-71afc8ef7538 req-4e22b201-3ef1-4c6d-bfe9-2f1981900b2f tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 943 time: 0.0513875 Nov 09 04:54:45.717356 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-443a01f1-855a-4201-89be-71afc8ef7538 req-71f68ea5-263b-404f-b98f-aee7cd4645ac tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0395627 Nov 09 04:54:45.946265 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 937de9d0-81e1-4c07-83c2-85629ef8f9f4 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=102163) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 09 04:54:46.041054 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 937de9d0-81e1-4c07-83c2-85629ef8f9f4, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=937de9d0-81e1-4c07-83c2-85629ef8f9f4,segment=NetworkSegment(24d74bfa-ba9d-4c10-aa08-4a4fed47543f),segment_id=24d74bfa-ba9d-4c10-aa08-4a4fed47543f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:54:46.051894 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Returning: {'device': '937de9d0-81e1-4c07-83c2-85629ef8f9f4', 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21', 'port_id': '937de9d0-81e1-4c07-83c2-85629ef8f9f4', 'mac_address': 'fa:16:3e:34:39:5a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 310, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102163) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 09 04:54:46.091322 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:54:46.103960 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 937de9d0-81e1-4c07-83c2-85629ef8f9f4 {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:54:46.122906 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 937de9d0-81e1-4c07-83c2-85629ef8f9f4, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=937de9d0-81e1-4c07-83c2-85629ef8f9f4,segment=NetworkSegment(24d74bfa-ba9d-4c10-aa08-4a4fed47543f),segment_id=24d74bfa-ba9d-4c10-aa08-4a4fed47543f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:54:46.201004 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:54:46.249301 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=937de9d0-81e1-4c07-83c2-85629ef8f9f4,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:54:46.402504 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['937de9d0-81e1-4c07-83c2-85629ef8f9f4'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 04:54:46.555271 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:54:46.834847 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aad1258c-02dd-4d5e-8cad-074f316d5516 req-5871d0ec-2701-4f97-8e64-f960b55e1c7a tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:46.836316 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-aad1258c-02dd-4d5e-8cad-074f316d5516 req-5871d0ec-2701-4f97-8e64-f960b55e1c7a tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 944 time: 0.0521698 Nov 09 04:54:46.882478 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-aad1258c-02dd-4d5e-8cad-074f316d5516 req-778fa941-e575-4266-8f2c-eaa88d5eb812 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0403275 Nov 09 04:54:46.966495 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:54:47.975148 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 937de9d0-81e1-4c07-83c2-85629ef8f9f4 up at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:54:48.000632 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c872a40a-9ece-4a4d-82c6-bd13de4f40a1 req-4c8b78c8-bd77-46f5-94bf-6e6a0984f499 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:48.002133 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c872a40a-9ece-4a4d-82c6-bd13de4f40a1 req-4c8b78c8-bd77-46f5-94bf-6e6a0984f499 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 944 time: 0.0478587 Nov 09 04:54:48.049405 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c872a40a-9ece-4a4d-82c6-bd13de4f40a1 req-db3aa6a3-202d-4039-8dfd-8b07943ba969 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0407121 Nov 09 04:54:48.069469 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning for port 937de9d0-81e1-4c07-83c2-85629ef8f9f4 completed by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 09 04:54:48.073291 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning complete for port 937de9d0-81e1-4c07-83c2-85629ef8f9f4 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:54:48.073998 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:54:48.148626 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:54:48.169674 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5281ed15-8461-45dc-b7a9-7646ab20e2f1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '937de9d0-81e1-4c07-83c2-85629ef8f9f4'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:54:48.171921 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e5fe2424-1822-4cf4-be0e-1df7f25289b3" -d '{"events": [{"server_uuid": "5281ed15-8461-45dc-b7a9-7646ab20e2f1", "name": "network-vif-plugged", "status": "completed", "tag": "937de9d0-81e1-4c07-83c2-85629ef8f9f4"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:54:48.184082 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 937de9d0-81e1-4c07-83c2-85629ef8f9f4, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=937de9d0-81e1-4c07-83c2-85629ef8f9f4,segment=NetworkSegment(24d74bfa-ba9d-4c10-aa08-4a4fed47543f),segment_id=24d74bfa-ba9d-4c10-aa08-4a4fed47543f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:54:48.206762 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:54:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0b89fd78-06f3-4dd5-9b23-f5f8d9ef51e9 x-openstack-request-id: req-0b89fd78-06f3-4dd5-9b23-f5f8d9ef51e9 {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:54:48.206762 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5281ed15-8461-45dc-b7a9-7646ab20e2f1", "name": "network-vif-plugged", "status": "completed", "tag": "937de9d0-81e1-4c07-83c2-85629ef8f9f4", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:54:48.207581 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-0b89fd78-06f3-4dd5-9b23-f5f8d9ef51e9 {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:54:48.207974 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5281ed15-8461-45dc-b7a9-7646ab20e2f1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '937de9d0-81e1-4c07-83c2-85629ef8f9f4', 'code': 200} Nov 09 04:54:48.239998 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:54:48.291062 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=937de9d0-81e1-4c07-83c2-85629ef8f9f4,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:54:48.461396 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:54:48.474988 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64335c8a-60f4-4c5c-9510-b534dd908aab req-a362d77c-d118-4970-80a0-b7fe3e972995 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:48.476472 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-64335c8a-60f4-4c5c-9510-b534dd908aab req-a362d77c-d118-4970-80a0-b7fe3e972995 service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 1098 time: 0.0443671 Nov 09 04:54:48.519896 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-64335c8a-60f4-4c5c-9510-b534dd908aab req-ea101b09-1905-4546-80d6-cd7ffda1c997 service neutron] 10.222.0.26 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0364449 Nov 09 04:54:49.162495 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df914087-335c-43b4-bda1-89d5ccb4f5b0 req-8f663771-29f6-48ec-9510-40a9de1e6e31 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:49.163855 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-df914087-335c-43b4-bda1-89d5ccb4f5b0 req-8f663771-29f6-48ec-9510-40a9de1e6e31 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 945 time: 0.0477116 Nov 09 04:54:49.209548 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-df914087-335c-43b4-bda1-89d5ccb4f5b0 req-727fd9ec-c011-4ea9-903f-0c91ad8bc939 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0399585 Nov 09 04:54:50.322942 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84aa14b7-91ab-4aff-9631-5ce306978228 req-aebb5b4d-60ec-4a91-bb3b-344a6c2c5a63 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:50.324647 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-84aa14b7-91ab-4aff-9631-5ce306978228 req-aebb5b4d-60ec-4a91-bb3b-344a6c2c5a63 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 945 time: 0.0479586 Nov 09 04:54:50.369990 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-84aa14b7-91ab-4aff-9631-5ce306978228 req-12d42338-e1a8-4717-95d4-98d6710e0ffd tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0395553 Nov 09 04:54:50.478102 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf2d0ae2-0e84-427e-b46b-49a3ba3a3c6c req-5d8b67a5-badf-4291-a6aa-1ad0e0f4cbb8 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:50.479607 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-cf2d0ae2-0e84-427e-b46b-49a3ba3a3c6c req-5d8b67a5-badf-4291-a6aa-1ad0e0f4cbb8 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 945 time: 0.0481973 Nov 09 04:54:50.488102 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 34980) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:54:50.492373 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-e387aa51-54f2-444d-95c6-1bb0e3df5fff tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Request body: {'floatingip': {'port_id': '937de9d0-81e1-4c07-83c2-85629ef8f9f4'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:54:50.533444 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e387aa51-54f2-444d-95c6-1bb0e3df5fff tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks [] for floatingip, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:54:50.959355 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e387aa51-54f2-444d-95c6-1bb0e3df5fff tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:54:51.029496 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e387aa51-54f2-444d-95c6-1bb0e3df5fff tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:54:51.124035 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.l3_db [None req-e387aa51-54f2-444d-95c6-1bb0e3df5fff tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Floating IP b0d36e82-421b-451c-b46c-718f80940b13 associated. External IP: 172.26.0.146, port: 937de9d0-81e1-4c07-83c2-85629ef8f9f4. Nov 09 04:54:51.322147 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e387aa51-54f2-444d-95c6-1bb0e3df5fff tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Router 8cd82ce8-0774-460f-8427-ef14caab402a has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:54:51.424086 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e387aa51-54f2-444d-95c6-1bb0e3df5fff tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:54:51.429363 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e387aa51-54f2-444d-95c6-1bb0e3df5fff tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:54:51.433814 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e6e39660-365c-47c0-96e2-ad6cf24eb80d None None] Sync routers for ids ['8cd82ce8-0774-460f-8427-ef14caab402a'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:54:51.444198 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e6e39660-365c-47c0-96e2-ad6cf24eb80d None None] Routers {'8cd82ce8-0774-460f-8427-ef14caab402a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:54:51.444803 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-e6e39660-365c-47c0-96e2-ad6cf24eb80d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:54:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8cd82ce8-0774-460f-8427-ef14caab402a'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:54:51.456331 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e387aa51-54f2-444d-95c6-1bb0e3df5fff tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "PUT /v2.0/floatingips/b0d36e82-421b-451c-b46c-718f80940b13 HTTP/1.1" status: 200 len: 992 time: 0.9672546 Nov 09 04:54:51.456936 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5281ed15-8461-45dc-b7a9-7646ab20e2f1', 'tag': '937de9d0-81e1-4c07-83c2-85629ef8f9f4'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:54:51.459240 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d7188908-218f-4963-a999-a1a3d96ce455" -d '{"events": [{"name": "network-changed", "server_uuid": "5281ed15-8461-45dc-b7a9-7646ab20e2f1", "tag": "937de9d0-81e1-4c07-83c2-85629ef8f9f4"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:54:51.500193 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:54:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f9ba0b6d-3638-40ac-b76f-f67c89ddfc63 x-openstack-request-id: req-f9ba0b6d-3638-40ac-b76f-f67c89ddfc63 {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:54:51.500780 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5281ed15-8461-45dc-b7a9-7646ab20e2f1", "tag": "937de9d0-81e1-4c07-83c2-85629ef8f9f4", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:54:51.500780 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-f9ba0b6d-3638-40ac-b76f-f67c89ddfc63 {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:54:51.501528 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5281ed15-8461-45dc-b7a9-7646ab20e2f1', 'tag': '937de9d0-81e1-4c07-83c2-85629ef8f9f4', 'status': 'completed', 'code': 200} Nov 09 04:54:51.560524 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-e6e39660-365c-47c0-96e2-ad6cf24eb80d None None] Set router 8cd82ce8-0774-460f-8427-ef14caab402a gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:54:51.564277 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7188908-218f-4963-a999-a1a3d96ce455 req-d9c92218-9dc7-4fd2-989c-48da7306649f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:51.565867 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d7188908-218f-4963-a999-a1a3d96ce455 req-d9c92218-9dc7-4fd2-989c-48da7306649f service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1a8335b645d04ccbad2f2ed5288b68e8&device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 1098 time: 0.0410087 Nov 09 04:54:51.658230 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7188908-218f-4963-a999-a1a3d96ce455 req-35368c53-51a4-4642-b9df-68fe7b4c80ad service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:51.659649 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d7188908-218f-4963-a999-a1a3d96ce455 req-35368c53-51a4-4642-b9df-68fe7b4c80ad service neutron] 10.222.0.26 "GET /v2.0/networks?id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 HTTP/1.1" status: 200 len: 913 time: 0.0869370 Nov 09 04:54:51.729920 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d7188908-218f-4963-a999-a1a3d96ce455 req-5bc92752-5e3e-44b1-9c98-92b78e4c344a service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=937de9d0-81e1-4c07-83c2-85629ef8f9f4 HTTP/1.1" status: 200 len: 1000 time: 0.0630257 Nov 09 04:54:51.779895 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-e6e39660-365c-47c0-96e2-ad6cf24eb80d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'name': 'tempest-ServerActionsTestJSON-1679556620-router', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77'}], 'enable_snat': True}, 'gw_port_id': '6b137909-e697-434a-93b2-4272af33f319', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:50:34Z', 'updated_at': '2021-11-09T04:50:37Z', 'revision_number': 4, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'gw_port': {'id': '6b137909-e697-434a-93b2-4272af33f319', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:88:5d:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1569, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:35Z', 'updated_at': '2021-11-09T04:50:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': 'b0d36e82-421b-451c-b46c-718f80940b13', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'floating_ip_address': '172.26.0.146', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'port_id': '937de9d0-81e1-4c07-83c2-85629ef8f9f4', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 1577, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21', 'mac_address': 'fa:16:3e:34:39:5a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5281ed15-8461-45dc-b7a9-7646ab20e2f1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:50:40Z', 'updated_at': '2021-11-09T04:54:50Z', 'revision_number': 13, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a23873f3-df1f-49c6-93aa-691a0e18c829', 'name': '', 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'mac_address': 'fa:16:3e:58:72:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1570, 'fixed_ips': [{'subnet_id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:37Z', 'updated_at': '2021-11-09T04:50:40Z', 'revision_number': 5, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'subnets': [{'id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:54:51.782444 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7188908-218f-4963-a999-a1a3d96ce455 req-141ae554-e64e-41ba-a5d0-325b3d5f316f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:51.783903 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d7188908-218f-4963-a999-a1a3d96ce455 req-141ae554-e64e-41ba-a5d0-325b3d5f316f service neutron] 10.222.0.26 "GET /v2.0/subnets?id=96831da9-b0dd-45f9-8543-0ac226a68c6a HTTP/1.1" status: 200 len: 851 time: 0.0469170 Nov 09 04:54:51.813287 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e6e39660-365c-47c0-96e2-ad6cf24eb80d None None] Checking router: 8cd82ce8-0774-460f-8427-ef14caab402a for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:54:51.821665 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e6e39660-365c-47c0-96e2-ad6cf24eb80d None None] Routers {'8cd82ce8-0774-460f-8427-ef14caab402a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:54:51.822263 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-e6e39660-365c-47c0-96e2-ad6cf24eb80d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:54:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8cd82ce8-0774-460f-8427-ef14caab402a'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:54:51.829829 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7188908-218f-4963-a999-a1a3d96ce455 req-7fe839c4-4aa1-4657-afce-d1664e381948 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:54:51.831349 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d7188908-218f-4963-a999-a1a3d96ce455 req-7fe839c4-4aa1-4657-afce-d1664e381948 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0403023 Nov 09 04:54:51.923434 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-e6e39660-365c-47c0-96e2-ad6cf24eb80d None None] Set router 8cd82ce8-0774-460f-8427-ef14caab402a gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:54:51.924722 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d7188908-218f-4963-a999-a1a3d96ce455 req-433a692e-d1ac-4ffa-a11c-99f1cd74165e service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0860975 Nov 09 04:54:52.014349 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d7188908-218f-4963-a999-a1a3d96ce455 req-010168c2-e9c8-4f53-9b96-ebd13fb7f3f7 service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0822561 Nov 09 04:54:52.144465 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-e6e39660-365c-47c0-96e2-ad6cf24eb80d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'name': 'tempest-ServerActionsTestJSON-1679556620-router', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77'}], 'enable_snat': True}, 'gw_port_id': '6b137909-e697-434a-93b2-4272af33f319', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:50:34Z', 'updated_at': '2021-11-09T04:50:37Z', 'revision_number': 4, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'gw_port': {'id': '6b137909-e697-434a-93b2-4272af33f319', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:88:5d:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1569, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:35Z', 'updated_at': '2021-11-09T04:50:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': 'b0d36e82-421b-451c-b46c-718f80940b13', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'floating_ip_address': '172.26.0.146', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'port_id': '937de9d0-81e1-4c07-83c2-85629ef8f9f4', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 1577, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21', 'mac_address': 'fa:16:3e:34:39:5a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5281ed15-8461-45dc-b7a9-7646ab20e2f1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:50:40Z', 'updated_at': '2021-11-09T04:54:50Z', 'revision_number': 13, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a23873f3-df1f-49c6-93aa-691a0e18c829', 'name': '', 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'mac_address': 'fa:16:3e:58:72:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1570, 'fixed_ips': [{'subnet_id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:37Z', 'updated_at': '2021-11-09T04:50:40Z', 'revision_number': 5, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'subnets': [{'id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:54:52.170710 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e6e39660-365c-47c0-96e2-ad6cf24eb80d None None] The sync data for ids ['8cd82ce8-0774-460f-8427-ef14caab402a'] in dv-neutron-816802-2-hyperv is: [{'id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'name': 'tempest-ServerActionsTestJSON-1679556620-router', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77'}], 'enable_snat': True}, 'gw_port_id': '6b137909-e697-434a-93b2-4272af33f319', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:50:34Z', 'updated_at': '2021-11-09T04:50:37Z', 'revision_number': 4, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'gw_port': {'id': '6b137909-e697-434a-93b2-4272af33f319', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:88:5d:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1569, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:35Z', 'updated_at': '2021-11-09T04:50:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': 'b0d36e82-421b-451c-b46c-718f80940b13', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'floating_ip_address': '172.26.0.146', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'port_id': '937de9d0-81e1-4c07-83c2-85629ef8f9f4', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 1577, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21', 'mac_address': 'fa:16:3e:34:39:5a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5281ed15-8461-45dc-b7a9-7646ab20e2f1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T04:50:40Z', 'updated_at': '2021-11-09T04:54:50Z', 'revision_number': 13, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a23873f3-df1f-49c6-93aa-691a0e18c829', 'name': '', 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'mac_address': 'fa:16:3e:58:72:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1570, 'fixed_ips': [{'subnet_id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:37Z', 'updated_at': '2021-11-09T04:50:40Z', 'revision_number': 5, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'subnets': [{'id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:54:52.358242 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eee87db8-198e-4759-a101-c9e7ac43fc41 None None] New status for floating IP b0d36e82-421b-451c-b46c-718f80940b13: ACTIVE {{(pid=102163) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 04:55:11.336903 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4a21dcf6-e45b-4f3b-8ce0-0043144a3c52 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:55:12.296533 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-349a407b-3633-4329-8c55-4fd0407fed91 req-4bdd83c6-7591-43b6-a9dc-ec27aadbe15f service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0399721 Nov 09 04:55:12.326058 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:55:12.381311 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-349a407b-3633-4329-8c55-4fd0407fed91 req-4f4dffc2-662b-49ad-b191-53c249de827d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:55:12.382798 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-349a407b-3633-4329-8c55-4fd0407fed91 req-4f4dffc2-662b-49ad-b191-53c249de827d service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1a8335b645d04ccbad2f2ed5288b68e8&device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 1098 time: 0.0443370 Nov 09 04:55:12.485243 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-349a407b-3633-4329-8c55-4fd0407fed91 req-24d3675e-8f68-400f-99f2-f280537c3d6e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:55:12.486708 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-349a407b-3633-4329-8c55-4fd0407fed91 req-24d3675e-8f68-400f-99f2-f280537c3d6e service neutron] 10.222.0.26 "GET /v2.0/networks?id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 HTTP/1.1" status: 200 len: 913 time: 0.0847952 Nov 09 04:55:12.554497 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-349a407b-3633-4329-8c55-4fd0407fed91 req-661e3f6a-9b5b-40c7-a78a-d20d4c80e982 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=937de9d0-81e1-4c07-83c2-85629ef8f9f4 HTTP/1.1" status: 200 len: 1002 time: 0.0598762 Nov 09 04:55:12.602963 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-349a407b-3633-4329-8c55-4fd0407fed91 req-c4395cf8-2727-4c7f-8001-05879c034e66 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:55:12.604371 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-349a407b-3633-4329-8c55-4fd0407fed91 req-c4395cf8-2727-4c7f-8001-05879c034e66 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=96831da9-b0dd-45f9-8543-0ac226a68c6a HTTP/1.1" status: 200 len: 851 time: 0.0434046 Nov 09 04:55:12.648497 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-349a407b-3633-4329-8c55-4fd0407fed91 req-37bb721c-309d-4211-bf4c-7b3320ac37c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:55:12.649904 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-349a407b-3633-4329-8c55-4fd0407fed91 req-37bb721c-309d-4211-bf4c-7b3320ac37c8 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0387480 Nov 09 04:55:12.740720 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-349a407b-3633-4329-8c55-4fd0407fed91 req-5608b747-f331-4ff5-b040-d4d4b1127ee4 service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0834117 Nov 09 04:55:12.827199 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-349a407b-3633-4329-8c55-4fd0407fed91 req-509c7570-fc40-4023-8b52-0ab955ca28a5 service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0796285 Nov 09 04:55:13.674127 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-081dc8f7-f986-4321-80e6-af596ec35d5f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:55:15.165433 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:55:16.531392 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:55:17.091295 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:55:25.460563 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:55:31.441508 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55a66257-418d-4b19-b899-dd5e7b3b418d req-e1ef65a9-e09b-44f7-9616-20e5f1d3ae9d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:55:31.443032 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-55a66257-418d-4b19-b899-dd5e7b3b418d req-e1ef65a9-e09b-44f7-9616-20e5f1d3ae9d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 945 time: 0.0525172 Nov 09 04:55:31.488433 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-55a66257-418d-4b19-b899-dd5e7b3b418d req-adc6d383-818c-4d3f-ac3e-a0f7d5084fe2 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0394213 Nov 09 04:55:41.339915 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3d58d0b4-a782-4b5c-9c34-102f0c20c75b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:55:42.352953 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:55:43.696183 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-34bc42b8-4245-43ac-86b5-3d9ca9198a69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:55:44.363851 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-038b5444-7c4a-44c0-a1be-faa333208c34 req-5793fd7c-19e8-436e-8089-34e9dd2eab05 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:55:44.365335 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-038b5444-7c4a-44c0-a1be-faa333208c34 req-5793fd7c-19e8-436e-8089-34e9dd2eab05 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 945 time: 0.0493329 Nov 09 04:55:44.411200 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-038b5444-7c4a-44c0-a1be-faa333208c34 req-22d5164d-7564-439e-80f1-3b972e84c0a9 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0399561 Nov 09 04:55:44.474683 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a564c9db-782a-4d36-92c5-fd3b44124fe9 req-63e12349-1288-4064-82ef-c4b1f1072d3d service neutron] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0384886 Nov 09 04:55:45.164646 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:55:45.527988 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca9f6e06-6029-406a-8bea-822c2d9f9333 req-2336a056-f640-4fa3-94bd-0b60884a3e47 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:55:45.529501 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ca9f6e06-6029-406a-8bea-822c2d9f9333 req-2336a056-f640-4fa3-94bd-0b60884a3e47 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 945 time: 0.0484469 Nov 09 04:55:45.578332 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ca9f6e06-6029-406a-8bea-822c2d9f9333 req-23a958da-f8e3-4e3a-876d-27a9c80aad23 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0427983 Nov 09 04:55:46.306411 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a564c9db-782a-4d36-92c5-fd3b44124fe9 req-3a301a5b-4ce3-4954-a40a-aea51dec2b25 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:55:46.307895 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a564c9db-782a-4d36-92c5-fd3b44124fe9 req-3a301a5b-4ce3-4954-a40a-aea51dec2b25 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1a8335b645d04ccbad2f2ed5288b68e8&device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 1098 time: 0.0436206 Nov 09 04:55:46.396228 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a564c9db-782a-4d36-92c5-fd3b44124fe9 req-0949f43e-eb67-4ad9-942c-65d127335f0f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:55:46.397682 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a564c9db-782a-4d36-92c5-fd3b44124fe9 req-0949f43e-eb67-4ad9-942c-65d127335f0f service neutron] 10.222.0.26 "GET /v2.0/networks?id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 HTTP/1.1" status: 200 len: 913 time: 0.0817292 Nov 09 04:55:46.465090 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a564c9db-782a-4d36-92c5-fd3b44124fe9 req-0365d9c5-7426-4799-b670-1b14eca05c67 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=937de9d0-81e1-4c07-83c2-85629ef8f9f4 HTTP/1.1" status: 200 len: 1002 time: 0.0598433 Nov 09 04:55:46.514285 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a564c9db-782a-4d36-92c5-fd3b44124fe9 req-b88f9686-bf14-48eb-99a8-8a4a6b150303 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:55:46.515770 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a564c9db-782a-4d36-92c5-fd3b44124fe9 req-b88f9686-bf14-48eb-99a8-8a4a6b150303 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=96831da9-b0dd-45f9-8543-0ac226a68c6a HTTP/1.1" status: 200 len: 851 time: 0.0423212 Nov 09 04:55:46.524656 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:55:46.561576 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a564c9db-782a-4d36-92c5-fd3b44124fe9 req-0600ac8f-9959-4d05-9689-9edd332e3af2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:55:46.562978 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a564c9db-782a-4d36-92c5-fd3b44124fe9 req-0600ac8f-9959-4d05-9689-9edd332e3af2 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0394459 Nov 09 04:55:46.655617 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a564c9db-782a-4d36-92c5-fd3b44124fe9 req-712f739f-ff14-4cbe-a3cd-d4307fca375b service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0844665 Nov 09 04:55:46.692180 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78856aba-a4cf-482c-b452-30ff7a6fa43b req-ef13db4a-929e-4787-b8c0-6343ea5c5500 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:55:46.693660 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-78856aba-a4cf-482c-b452-30ff7a6fa43b req-ef13db4a-929e-4787-b8c0-6343ea5c5500 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 945 time: 0.0477364 Nov 09 04:55:46.741572 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-78856aba-a4cf-482c-b452-30ff7a6fa43b req-4c2f9ba9-1b3e-4581-a617-b65c710dd930 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0413792 Nov 09 04:55:46.745047 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a564c9db-782a-4d36-92c5-fd3b44124fe9 req-49fb0943-92f6-4c7d-999f-9a821b92f69d service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0825830 Nov 09 04:55:46.964600 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:55:47.857216 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7250bfc2-ca1f-47f3-8fe4-e35a269d2752 req-71ef3b07-0afa-4873-8a71-04f5b24d4174 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:55:47.858664 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7250bfc2-ca1f-47f3-8fe4-e35a269d2752 req-71ef3b07-0afa-4873-8a71-04f5b24d4174 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 945 time: 0.0512474 Nov 09 04:55:47.905035 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7250bfc2-ca1f-47f3-8fe4-e35a269d2752 req-148ecc15-2ad4-4741-ad34-721fd16517a9 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0404553 Nov 09 04:55:49.025982 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb720b36-1155-42a3-8d08-4f6c3a7cae28 req-cad8f7ad-f5df-41e4-9022-9fcbe5932ae8 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:55:49.027474 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-bb720b36-1155-42a3-8d08-4f6c3a7cae28 req-cad8f7ad-f5df-41e4-9022-9fcbe5932ae8 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 945 time: 0.0546331 Nov 09 04:55:49.073403 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-bb720b36-1155-42a3-8d08-4f6c3a7cae28 req-55443246-86bf-4e59-8039-bb23643d31e2 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0400765 Nov 09 04:55:50.187616 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8def9131-aa23-4b7a-8add-886725e2f325 req-37cb1b7b-48d6-4c8c-9d68-e156a5082380 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:55:50.188969 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8def9131-aa23-4b7a-8add-886725e2f325 req-37cb1b7b-48d6-4c8c-9d68-e156a5082380 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 945 time: 0.0468647 Nov 09 04:55:50.235080 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8def9131-aa23-4b7a-8add-886725e2f325 req-f7bf3538-8f01-41db-b7c5-7fe9df94a48a tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0397370 Nov 09 04:55:51.348181 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d378248f-55b1-4658-a5c5-e271f88115d4 req-25ab96f8-ab4c-46f5-b4b6-44bf46c8b2bc tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:55:51.349635 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d378248f-55b1-4658-a5c5-e271f88115d4 req-25ab96f8-ab4c-46f5-b4b6-44bf46c8b2bc tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 945 time: 0.0482614 Nov 09 04:55:51.395025 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d378248f-55b1-4658-a5c5-e271f88115d4 req-025408d9-1643-4df1-8fb8-6c5398bc56b6 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0396991 Nov 09 04:55:52.506855 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52f2f6b0-2fae-4efb-94d9-f071b8b0c186 req-83467f21-6156-4092-a975-9af7ae46bbb0 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:55:52.508282 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-52f2f6b0-2fae-4efb-94d9-f071b8b0c186 req-83467f21-6156-4092-a975-9af7ae46bbb0 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 945 time: 0.0472271 Nov 09 04:55:52.557309 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-52f2f6b0-2fae-4efb-94d9-f071b8b0c186 req-8f714adb-1e5d-4458-ab81-6390b6e22b56 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0431449 Nov 09 04:55:53.672445 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e87e6038-5a5a-41da-a9e7-db0c64e41fa7 req-d644c1ec-1bd0-4dc8-a586-85bfc4e9c119 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:55:53.678004 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-e87e6038-5a5a-41da-a9e7-db0c64e41fa7 req-d644c1ec-1bd0-4dc8-a586-85bfc4e9c119 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 945 time: 0.0509036 Nov 09 04:55:53.720569 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-e87e6038-5a5a-41da-a9e7-db0c64e41fa7 req-fc183da0-0f65-43ac-b24a-4a3e82d8ae4f tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0404122 Nov 09 04:55:54.834029 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f2ed54e-6f6f-4b13-a5c4-7bcbedae8534 req-234b1c58-19c1-49a6-b8dd-1f5c381f3ce7 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:55:54.835498 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4f2ed54e-6f6f-4b13-a5c4-7bcbedae8534 req-234b1c58-19c1-49a6-b8dd-1f5c381f3ce7 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 945 time: 0.0473707 Nov 09 04:55:54.881270 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4f2ed54e-6f6f-4b13-a5c4-7bcbedae8534 req-58d50cf6-a864-4c66-a36b-76d86d95d7ba tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0399802 Nov 09 04:55:56.000664 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4787e4c1-a619-4365-b3d3-de749f0cab64 req-f7db6939-df0f-4f6d-98e9-d0a414497204 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:55:56.002139 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-4787e4c1-a619-4365-b3d3-de749f0cab64 req-f7db6939-df0f-4f6d-98e9-d0a414497204 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 945 time: 0.0518620 Nov 09 04:55:56.049476 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-4787e4c1-a619-4365-b3d3-de749f0cab64 req-28943f23-36e2-4ebf-82c9-7a7c1301c563 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0407226 Nov 09 04:55:57.168923 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ae0df83-0030-476c-9a27-ef96c9678010 req-61599c5a-b0cc-4a28-9113-5001ba9bb7a0 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:55:57.170404 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7ae0df83-0030-476c-9a27-ef96c9678010 req-61599c5a-b0cc-4a28-9113-5001ba9bb7a0 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 945 time: 0.0491433 Nov 09 04:55:57.217651 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7ae0df83-0030-476c-9a27-ef96c9678010 req-090f318c-c5e3-4a4d-9e1d-4afe037d3baf tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0407736 Nov 09 04:55:58.331477 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b51c66a-14a5-412b-8993-bb0191f1296b req-51d90760-42c4-4c0c-8ac0-38dfe88277e8 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:55:58.332912 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-9b51c66a-14a5-412b-8993-bb0191f1296b req-51d90760-42c4-4c0c-8ac0-38dfe88277e8 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 945 time: 0.0481060 Nov 09 04:55:58.386044 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-9b51c66a-14a5-412b-8993-bb0191f1296b req-32fef4df-e875-4f52-919b-9ae867f033c1 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0473499 Nov 09 04:55:59.504183 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97b5c368-a3c8-4f4d-81a8-18f6ca8f7b74 req-ec7c2003-254a-446a-898f-a1e71d8c4e3c tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:55:59.505632 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-97b5c368-a3c8-4f4d-81a8-18f6ca8f7b74 req-ec7c2003-254a-446a-898f-a1e71d8c4e3c tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 945 time: 0.0531135 Nov 09 04:55:59.553328 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-97b5c368-a3c8-4f4d-81a8-18f6ca8f7b74 req-c4ff5adc-8909-49de-b7ba-dafb3d12c19c tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0412791 Nov 09 04:56:00.666411 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca212d63-7dad-4e28-90eb-5b8bef5ba21a req-309c3fbb-1f5a-4d56-81e4-364040baa1be tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:00.667858 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ca212d63-7dad-4e28-90eb-5b8bef5ba21a req-309c3fbb-1f5a-4d56-81e4-364040baa1be tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 945 time: 0.0472312 Nov 09 04:56:00.713995 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ca212d63-7dad-4e28-90eb-5b8bef5ba21a req-3e3a1975-6a01-45c7-adaa-1b062837c275 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0402591 Nov 09 04:56:01.827316 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abbd46ba-7f10-4dd9-a0d6-43c90ff7b58d req-fa628345-992a-43bc-af56-951f85c00a4a tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:01.828769 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-abbd46ba-7f10-4dd9-a0d6-43c90ff7b58d req-fa628345-992a-43bc-af56-951f85c00a4a tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 945 time: 0.0480032 Nov 09 04:56:01.875833 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-abbd46ba-7f10-4dd9-a0d6-43c90ff7b58d req-719d824e-2191-471e-b801-5fd3d48c855c tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0406227 Nov 09 04:56:02.459564 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:56:02.990101 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f90f0f0d-1c18-40ef-a8e2-cf56ea724359 req-df4ee370-4536-4dfa-bc04-68fabeb44bd7 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:02.991589 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f90f0f0d-1c18-40ef-a8e2-cf56ea724359 req-df4ee370-4536-4dfa-bc04-68fabeb44bd7 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 945 time: 0.0481176 Nov 09 04:56:03.036901 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f90f0f0d-1c18-40ef-a8e2-cf56ea724359 req-e5247235-7aa4-4dae-bf02-a336d3886505 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0395420 Nov 09 04:56:04.154515 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67a2949f-2857-4a5f-b20a-8ddfa87ad16f req-739df38c-f15a-43f3-8ea7-6572602addac tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:04.155891 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-67a2949f-2857-4a5f-b20a-8ddfa87ad16f req-739df38c-f15a-43f3-8ea7-6572602addac tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 945 time: 0.0526628 Nov 09 04:56:04.204203 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-67a2949f-2857-4a5f-b20a-8ddfa87ad16f req-10c008be-255a-427c-9f2b-da7f753936cb tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0425231 Nov 09 04:56:05.320135 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afe7e377-e3c7-4ef8-895d-b33f544bd815 req-b998a840-f239-46b1-82d3-dac2002f5f75 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:05.321586 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-afe7e377-e3c7-4ef8-895d-b33f544bd815 req-b998a840-f239-46b1-82d3-dac2002f5f75 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 945 time: 0.0512435 Nov 09 04:56:05.368109 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-afe7e377-e3c7-4ef8-895d-b33f544bd815 req-fb8dd855-78c6-42bb-98c2-f23c57834cb8 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0403845 Nov 09 04:56:06.481803 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebef6986-8acc-4d2a-baed-8da1cd6d819b req-1338bfc7-4f64-42a9-aed1-62d9861a6fd1 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:06.483251 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ebef6986-8acc-4d2a-baed-8da1cd6d819b req-1338bfc7-4f64-42a9-aed1-62d9861a6fd1 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 945 time: 0.0466812 Nov 09 04:56:06.529590 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ebef6986-8acc-4d2a-baed-8da1cd6d819b req-eabea803-57ee-4b09-8e8f-45f1893caa18 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0398159 Nov 09 04:56:07.645333 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a08d20e3-2eea-4026-b407-3d09d6d1034b req-a5c4cf1e-6125-4099-a0e4-131ab3c0ba5e tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:07.646814 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-a08d20e3-2eea-4026-b407-3d09d6d1034b req-a5c4cf1e-6125-4099-a0e4-131ab3c0ba5e tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 945 time: 0.0486546 Nov 09 04:56:07.693229 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-a08d20e3-2eea-4026-b407-3d09d6d1034b req-00f99513-bf41-451c-8976-35e451b27ad8 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0406048 Nov 09 04:56:08.805528 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61c95e13-60db-4e69-b378-1973069bfb3a req-d7f4f68d-bf18-43c3-8d99-9ce14c9c2ff4 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:08.806980 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-61c95e13-60db-4e69-b378-1973069bfb3a req-d7f4f68d-bf18-43c3-8d99-9ce14c9c2ff4 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 945 time: 0.0473471 Nov 09 04:56:08.851825 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-61c95e13-60db-4e69-b378-1973069bfb3a req-f7532098-762a-4de1-a08f-462972f3aec8 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0390399 Nov 09 04:56:09.965455 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7719cee5-f3c5-4194-824e-2a62f458ab18 req-1e4eed4a-208c-45d0-bee7-f08e2ef7fe60 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:09.966946 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-7719cee5-f3c5-4194-824e-2a62f458ab18 req-1e4eed4a-208c-45d0-bee7-f08e2ef7fe60 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 945 time: 0.0486948 Nov 09 04:56:10.016103 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-7719cee5-f3c5-4194-824e-2a62f458ab18 req-aa3ec956-1a10-4d61-9cf5-60b8c9f0a5a5 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0433259 Nov 09 04:56:11.132540 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30a7fe12-c7cb-4317-9a36-df34801b67ae req-77bc6edb-4e46-4b9c-a1e5-7e02ee24d8b6 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:11.133992 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-30a7fe12-c7cb-4317-9a36-df34801b67ae req-77bc6edb-4e46-4b9c-a1e5-7e02ee24d8b6 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 945 time: 0.0509021 Nov 09 04:56:11.192870 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-30a7fe12-c7cb-4317-9a36-df34801b67ae req-297e0f2b-68f0-419f-9935-a66dfd09a27c tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0527205 Nov 09 04:56:11.346786 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-262aa3af-d588-4f80-9f14-a56e37019093 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:56:12.312786 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b5e5360-3cb0-44b3-b61a-751ea80a911a req-e2779551-8082-4a78-ba08-1841c8fb224a tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:12.314256 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-2b5e5360-3cb0-44b3-b61a-751ea80a911a req-e2779551-8082-4a78-ba08-1841c8fb224a tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 945 time: 0.0494723 Nov 09 04:56:12.355920 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:56:12.361970 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-2b5e5360-3cb0-44b3-b61a-751ea80a911a req-0debdee0-4a7d-447c-980f-f3c23287301d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0409720 Nov 09 04:56:13.476986 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25dae59a-0dae-4358-bdc2-a08932dc1f18 req-08cde15b-cac6-42f3-8cb8-87c78295a8b6 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:13.478460 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-25dae59a-0dae-4358-bdc2-a08932dc1f18 req-08cde15b-cac6-42f3-8cb8-87c78295a8b6 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 945 time: 0.0480080 Nov 09 04:56:13.528180 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-25dae59a-0dae-4358-bdc2-a08932dc1f18 req-23f0c3aa-e28a-411f-a154-e33f24647ee4 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0438385 Nov 09 04:56:13.726974 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0b860e31-7e55-4673-8885-8f4885e86dac None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:56:14.319226 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b822d388-61d4-4e4c-8687-5f5894ef7242 req-3ff09d4d-6a5b-4e87-98a0-01a06c563679 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:14.320699 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b822d388-61d4-4e4c-8687-5f5894ef7242 req-3ff09d4d-6a5b-4e87-98a0-01a06c563679 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1a8335b645d04ccbad2f2ed5288b68e8&device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 1098 time: 0.0443232 Nov 09 04:56:14.422546 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b822d388-61d4-4e4c-8687-5f5894ef7242 req-3f3c514a-db6f-42ef-b479-0657dd12361f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:14.423954 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b822d388-61d4-4e4c-8687-5f5894ef7242 req-3f3c514a-db6f-42ef-b479-0657dd12361f service neutron] 10.222.0.26 "GET /v2.0/networks?id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 HTTP/1.1" status: 200 len: 913 time: 0.0846682 Nov 09 04:56:14.491919 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b822d388-61d4-4e4c-8687-5f5894ef7242 req-3a54ec1d-6f18-4d6d-a280-719b93f9af69 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=937de9d0-81e1-4c07-83c2-85629ef8f9f4 HTTP/1.1" status: 200 len: 1002 time: 0.0609283 Nov 09 04:56:14.541078 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b822d388-61d4-4e4c-8687-5f5894ef7242 req-8e6f3077-fb8d-47e7-850a-9a75e0d7826e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:14.542553 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b822d388-61d4-4e4c-8687-5f5894ef7242 req-8e6f3077-fb8d-47e7-850a-9a75e0d7826e service neutron] 10.222.0.26 "GET /v2.0/subnets?id=96831da9-b0dd-45f9-8543-0ac226a68c6a HTTP/1.1" status: 200 len: 851 time: 0.0439243 Nov 09 04:56:14.589133 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b822d388-61d4-4e4c-8687-5f5894ef7242 req-83b58063-8282-4aaf-82a1-e5b3ad76bc80 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:14.590657 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b822d388-61d4-4e4c-8687-5f5894ef7242 req-83b58063-8282-4aaf-82a1-e5b3ad76bc80 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0414438 Nov 09 04:56:14.655872 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9983b81a-16e6-42c2-8908-b511a660bc6a req-298376f9-5d92-45b8-aedb-3de5f45abf5c tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:14.657450 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-9983b81a-16e6-42c2-8908-b511a660bc6a req-298376f9-5d92-45b8-aedb-3de5f45abf5c tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 945 time: 0.0594034 Nov 09 04:56:14.712260 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-9983b81a-16e6-42c2-8908-b511a660bc6a req-22fe0075-373b-456e-88dd-de510e3f54be tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0475712 Nov 09 04:56:15.037018 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b822d388-61d4-4e4c-8687-5f5894ef7242 req-d05bf4fe-4d36-4a13-a1e6-97f47a513054 service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4390707 Nov 09 04:56:15.126107 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b822d388-61d4-4e4c-8687-5f5894ef7242 req-eceab5ac-3ec6-4493-ba56-387eacceaf5a service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0817659 Nov 09 04:56:15.175726 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:56:15.833474 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-275c8d32-b714-4139-b5b4-9b96edc22f88 req-96b329c0-db98-4463-a57e-e2a986ad4de6 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:15.834980 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-275c8d32-b714-4139-b5b4-9b96edc22f88 req-96b329c0-db98-4463-a57e-e2a986ad4de6 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 945 time: 0.0497055 Nov 09 04:56:15.885349 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-275c8d32-b714-4139-b5b4-9b96edc22f88 req-8eab2cc8-4686-40b2-8812-71425ac362e2 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0442233 Nov 09 04:56:16.179784 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a564c9db-782a-4d36-92c5-fd3b44124fe9 req-962daa71-8220-4b4f-85ea-fb00b1e60304 service neutron] 10.222.0.26 "GET /v2.0/ports/937de9d0-81e1-4c07-83c2-85629ef8f9f4/bindings/hv-neutron-8168 HTTP/1.1" status: 200 len: 384 time: 0.0531147 Nov 09 04:56:16.555601 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:56:16.729736 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a564c9db-782a-4d36-92c5-fd3b44124fe9 req-bdf87ba6-e5ae-4b62-ba97-44a53a58a1bb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:16.731126 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a564c9db-782a-4d36-92c5-fd3b44124fe9 req-bdf87ba6-e5ae-4b62-ba97-44a53a58a1bb service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1&tenant_id=1a8335b645d04ccbad2f2ed5288b68e8 HTTP/1.1" status: 200 len: 1098 time: 0.0404932 Nov 09 04:56:16.791980 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a564c9db-782a-4d36-92c5-fd3b44124fe9 req-e0f26d5e-f468-42cd-9bd8-183b6679871e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:16.793396 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a564c9db-782a-4d36-92c5-fd3b44124fe9 req-e0f26d5e-f468-42cd-9bd8-183b6679871e service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1a8335b645d04ccbad2f2ed5288b68e8&device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 1098 time: 0.0381663 Nov 09 04:56:16.884807 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a564c9db-782a-4d36-92c5-fd3b44124fe9 req-504d25d0-c8e8-4e19-8e2a-bddbfb04b20c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:16.886308 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a564c9db-782a-4d36-92c5-fd3b44124fe9 req-504d25d0-c8e8-4e19-8e2a-bddbfb04b20c service neutron] 10.222.0.26 "GET /v2.0/networks?id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 HTTP/1.1" status: 200 len: 913 time: 0.0850387 Nov 09 04:56:16.960687 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a564c9db-782a-4d36-92c5-fd3b44124fe9 req-1f725e3d-03e7-4b46-838e-e856a2fc5ff5 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=937de9d0-81e1-4c07-83c2-85629ef8f9f4 HTTP/1.1" status: 200 len: 1002 time: 0.0638366 Nov 09 04:56:17.016944 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a564c9db-782a-4d36-92c5-fd3b44124fe9 req-a1c6f142-92be-408f-88ef-ee4247dad636 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:17.017612 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99332f9b-4974-48ad-b3fa-1d6780bafe9b req-879ba3e4-336e-4aa7-93a2-66c6c7fb4d0c tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:17.018520 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a564c9db-782a-4d36-92c5-fd3b44124fe9 req-a1c6f142-92be-408f-88ef-ee4247dad636 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=96831da9-b0dd-45f9-8543-0ac226a68c6a HTTP/1.1" status: 200 len: 851 time: 0.0511780 Nov 09 04:56:17.019207 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-99332f9b-4974-48ad-b3fa-1d6780bafe9b req-879ba3e4-336e-4aa7-93a2-66c6c7fb4d0c tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 945 time: 0.0579469 Nov 09 04:56:17.064258 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a564c9db-782a-4d36-92c5-fd3b44124fe9 req-d4003dc4-2d44-4c6d-b525-4f00b2621ddf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:17.065843 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a564c9db-782a-4d36-92c5-fd3b44124fe9 req-d4003dc4-2d44-4c6d-b525-4f00b2621ddf service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0406237 Nov 09 04:56:17.069893 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-99332f9b-4974-48ad-b3fa-1d6780bafe9b req-8f6ba748-438c-4572-bc95-4e1cb15a18a9 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0436330 Nov 09 04:56:17.105947 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:56:17.157846 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a564c9db-782a-4d36-92c5-fd3b44124fe9 req-979d9382-12ba-4747-b1ec-b06e0fc912a3 service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0846233 Nov 09 04:56:17.247322 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a564c9db-782a-4d36-92c5-fd3b44124fe9 req-73ebe824-7e87-472e-99da-8de6e6bc5e99 service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0822353 Nov 09 04:56:18.192828 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca4f5e85-bd51-4661-9023-cffa0aecb7dc req-91aa4463-fcab-4e47-b1b6-fe1cf612e092 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:18.194580 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ca4f5e85-bd51-4661-9023-cffa0aecb7dc req-91aa4463-fcab-4e47-b1b6-fe1cf612e092 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 945 time: 0.0487428 Nov 09 04:56:18.248621 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ca4f5e85-bd51-4661-9023-cffa0aecb7dc req-ebb929cb-68e0-4572-ba8f-a6e0c5566303 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0477154 Nov 09 04:56:18.393821 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 937de9d0-81e1-4c07-83c2-85629ef8f9f4 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:56:18.474779 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:56:18.498400 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5281ed15-8461-45dc-b7a9-7646ab20e2f1', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '937de9d0-81e1-4c07-83c2-85629ef8f9f4'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:56:18.500625 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-997e257d-2462-4a81-9ce5-385838eb8919" -d '{"events": [{"server_uuid": "5281ed15-8461-45dc-b7a9-7646ab20e2f1", "name": "network-vif-unplugged", "status": "completed", "tag": "937de9d0-81e1-4c07-83c2-85629ef8f9f4"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:56:18.515175 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 937de9d0-81e1-4c07-83c2-85629ef8f9f4, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=937de9d0-81e1-4c07-83c2-85629ef8f9f4,segment=NetworkSegment(24d74bfa-ba9d-4c10-aa08-4a4fed47543f),segment_id=24d74bfa-ba9d-4c10-aa08-4a4fed47543f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:56:18.592150 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:56:18.615964 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 09 Nov 2021 04:56:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7e7067cb-f28f-46e5-b429-22ea0d533d2e x-openstack-request-id: req-7e7067cb-f28f-46e5-b429-22ea0d533d2e {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:56:18.616245 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5281ed15-8461-45dc-b7a9-7646ab20e2f1", "name": "network-vif-unplugged", "status": "completed", "tag": "937de9d0-81e1-4c07-83c2-85629ef8f9f4", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:56:18.616634 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-7e7067cb-f28f-46e5-b429-22ea0d533d2e {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:56:18.616960 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5281ed15-8461-45dc-b7a9-7646ab20e2f1', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '937de9d0-81e1-4c07-83c2-85629ef8f9f4', 'code': 200} Nov 09 04:56:18.643517 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=937de9d0-81e1-4c07-83c2-85629ef8f9f4,revision_number=6']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:56:18.650496 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:56:18.650854 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:56:18.651200 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:56:18.651538 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:56:18.651978 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:56:18.652317 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:56:18.652647 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:56:18.652981 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:56:18.653311 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:56:18.653636 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:56:18.653961 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:56:18.654284 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:56:19.364969 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1e78ce2-ef14-40ec-ad0b-761d392ad103 req-387b0d24-517e-4f28-a5dd-9ba8b041e1ea tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:19.366561 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d1e78ce2-ef14-40ec-ad0b-761d392ad103 req-387b0d24-517e-4f28-a5dd-9ba8b041e1ea tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 943 time: 0.0504448 Nov 09 04:56:19.413766 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d1e78ce2-ef14-40ec-ad0b-761d392ad103 req-b1aa6aac-f46b-470d-9530-9a0cc814b203 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0413465 Nov 09 04:56:20.532878 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cee2fa5a-ddf3-4e85-8566-9089e59bd320 req-084d199b-6653-49b0-9338-1f0edea24830 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:20.534345 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-cee2fa5a-ddf3-4e85-8566-9089e59bd320 req-084d199b-6653-49b0-9338-1f0edea24830 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 943 time: 0.0493658 Nov 09 04:56:20.581110 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-cee2fa5a-ddf3-4e85-8566-9089e59bd320 req-c699a7dd-d9e2-4d85-a736-0aab79fe3185 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0407815 Nov 09 04:56:21.703475 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6df7b95c-618d-464c-b133-526fa63d83e4 req-9906f90a-751b-4ad1-bf0b-47f188d584b6 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:21.704948 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6df7b95c-618d-464c-b133-526fa63d83e4 req-9906f90a-751b-4ad1-bf0b-47f188d584b6 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 943 time: 0.0523181 Nov 09 04:56:21.751506 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6df7b95c-618d-464c-b133-526fa63d83e4 req-151b51e8-57d9-43d6-bb2f-09bdacc041a3 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0405879 Nov 09 04:56:22.868962 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea9df286-6aed-455e-b5a5-c2327263df07 req-912d2137-cc9b-4ab6-a5ee-225bdd3eabb6 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:22.870435 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ea9df286-6aed-455e-b5a5-c2327263df07 req-912d2137-cc9b-4ab6-a5ee-225bdd3eabb6 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 943 time: 0.0516093 Nov 09 04:56:22.916319 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ea9df286-6aed-455e-b5a5-c2327263df07 req-1b6cbba2-2b9d-4c65-bab8-a1927340e3be tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0401120 Nov 09 04:56:24.037108 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1c5f74b-33bd-43ba-9391-058502be1e7a req-2732e7d0-8f44-4ddb-901b-fd4ba56066a2 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:24.038749 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b1c5f74b-33bd-43ba-9391-058502be1e7a req-2732e7d0-8f44-4ddb-901b-fd4ba56066a2 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 943 time: 0.0548100 Nov 09 04:56:24.084904 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b1c5f74b-33bd-43ba-9391-058502be1e7a req-55e49f6f-582b-44ca-a1b6-cbbbb6f04429 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0403044 Nov 09 04:56:24.393122 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 937de9d0-81e1-4c07-83c2-85629ef8f9f4 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=102163) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 09 04:56:24.483600 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 937de9d0-81e1-4c07-83c2-85629ef8f9f4, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=937de9d0-81e1-4c07-83c2-85629ef8f9f4,segment=NetworkSegment(24d74bfa-ba9d-4c10-aa08-4a4fed47543f),segment_id=24d74bfa-ba9d-4c10-aa08-4a4fed47543f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:56:24.494822 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Returning: {'device': '937de9d0-81e1-4c07-83c2-85629ef8f9f4', 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21', 'port_id': '937de9d0-81e1-4c07-83c2-85629ef8f9f4', 'mac_address': 'fa:16:3e:34:39:5a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 310, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102163) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 09 04:56:24.533152 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:56:24.544937 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 937de9d0-81e1-4c07-83c2-85629ef8f9f4 {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:56:24.564277 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 937de9d0-81e1-4c07-83c2-85629ef8f9f4, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=937de9d0-81e1-4c07-83c2-85629ef8f9f4,segment=NetworkSegment(24d74bfa-ba9d-4c10-aa08-4a4fed47543f),segment_id=24d74bfa-ba9d-4c10-aa08-4a4fed47543f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:56:24.617978 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:56:24.667584 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=937de9d0-81e1-4c07-83c2-85629ef8f9f4,revision_number=7']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:56:24.681287 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['937de9d0-81e1-4c07-83c2-85629ef8f9f4'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 04:56:25.199106 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e4da93e-2cfc-4807-9b98-a0133ea9e14a req-536ec107-faa5-47ce-a9b3-c2ed308a92b7 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:25.200584 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-2e4da93e-2cfc-4807-9b98-a0133ea9e14a req-536ec107-faa5-47ce-a9b3-c2ed308a92b7 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 944 time: 0.0474799 Nov 09 04:56:25.246761 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-2e4da93e-2cfc-4807-9b98-a0133ea9e14a req-c1d3a875-c82f-4e55-bd35-ee25f781439e tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0403028 Nov 09 04:56:26.360905 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d63a3e28-fd3f-4503-98f7-0e73a1d49345 req-721c36e2-49f5-4787-a5d3-614cb98638a5 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:26.362333 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d63a3e28-fd3f-4503-98f7-0e73a1d49345 req-721c36e2-49f5-4787-a5d3-614cb98638a5 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 944 time: 0.0482883 Nov 09 04:56:26.400939 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 937de9d0-81e1-4c07-83c2-85629ef8f9f4 up at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:56:26.409190 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d63a3e28-fd3f-4503-98f7-0e73a1d49345 req-8df3ac0f-eee9-40df-98cb-c991abf6c3d7 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0409374 Nov 09 04:56:26.446592 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning complete for port 937de9d0-81e1-4c07-83c2-85629ef8f9f4 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:56:26.447211 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:56:26.522825 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:56:26.546514 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5281ed15-8461-45dc-b7a9-7646ab20e2f1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '937de9d0-81e1-4c07-83c2-85629ef8f9f4'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:56:26.550946 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e87e1afb-9883-41d9-b07e-3c49abe355d0" -d '{"events": [{"server_uuid": "5281ed15-8461-45dc-b7a9-7646ab20e2f1", "name": "network-vif-plugged", "status": "completed", "tag": "937de9d0-81e1-4c07-83c2-85629ef8f9f4"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:56:26.565171 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 937de9d0-81e1-4c07-83c2-85629ef8f9f4, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=937de9d0-81e1-4c07-83c2-85629ef8f9f4,segment=NetworkSegment(24d74bfa-ba9d-4c10-aa08-4a4fed47543f),segment_id=24d74bfa-ba9d-4c10-aa08-4a4fed47543f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:56:26.607989 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:56:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-30630f09-c4e9-4410-8a6c-ad1886386db9 x-openstack-request-id: req-30630f09-c4e9-4410-8a6c-ad1886386db9 {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:56:26.607989 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5281ed15-8461-45dc-b7a9-7646ab20e2f1", "name": "network-vif-plugged", "status": "completed", "tag": "937de9d0-81e1-4c07-83c2-85629ef8f9f4", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:56:26.607989 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-30630f09-c4e9-4410-8a6c-ad1886386db9 {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:56:26.607989 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5281ed15-8461-45dc-b7a9-7646ab20e2f1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '937de9d0-81e1-4c07-83c2-85629ef8f9f4', 'code': 200} Nov 09 04:56:26.623758 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:56:26.668946 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=937de9d0-81e1-4c07-83c2-85629ef8f9f4,revision_number=8']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:56:27.524088 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5542c78f-f92d-4d77-a1d7-da45ff1bc6d7 req-437269e6-2353-428a-a542-134721de8924 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:27.525603 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5542c78f-f92d-4d77-a1d7-da45ff1bc6d7 req-437269e6-2353-428a-a542-134721de8924 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 945 time: 0.0485208 Nov 09 04:56:27.593931 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5542c78f-f92d-4d77-a1d7-da45ff1bc6d7 req-84958784-b2aa-4453-b94d-073f93973edc tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0614629 Nov 09 04:56:28.711533 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7309bc89-d84c-4adc-9aaf-baec0b628e61 req-1b19449f-1c26-40f4-ad33-5cc9da426495 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:28.712990 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-7309bc89-d84c-4adc-9aaf-baec0b628e61 req-1b19449f-1c26-40f4-ad33-5cc9da426495 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 945 time: 0.0486634 Nov 09 04:56:28.763489 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-7309bc89-d84c-4adc-9aaf-baec0b628e61 req-8f30155c-fb3e-42df-a066-900b14216260 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0444875 Nov 09 04:56:29.877947 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f04d689-b345-4f8d-a8d2-c196012691c5 req-d924cd6b-eaa8-4452-8fd7-7b10c5a4ca13 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:29.879432 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4f04d689-b345-4f8d-a8d2-c196012691c5 req-d924cd6b-eaa8-4452-8fd7-7b10c5a4ca13 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 945 time: 0.0474522 Nov 09 04:56:29.928553 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4f04d689-b345-4f8d-a8d2-c196012691c5 req-bdd32ae0-65cd-4136-9450-e42e0294bd7b tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0429800 Nov 09 04:56:30.520792 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86cdaa08-33c4-4d61-9e70-6a45d31ea92e req-91c4045d-cd37-45f0-a1c2-008be4fe5f8c tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:30.522234 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-86cdaa08-33c4-4d61-9e70-6a45d31ea92e req-91c4045d-cd37-45f0-a1c2-008be4fe5f8c tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 945 time: 0.0777519 Nov 09 04:56:30.556469 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f908911e-782b-412d-ba07-0d51a51b3372 req-f9a2eb1a-4928-4c44-b9d0-610b977ac5f5 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:30.557861 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f908911e-782b-412d-ba07-0d51a51b3372 req-f9a2eb1a-4928-4c44-b9d0-610b977ac5f5 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.26 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1&tenant_id=1a8335b645d04ccbad2f2ed5288b68e8&binding%3Ahost_id=hv-neutron-8168 HTTP/1.1" status: 200 len: 945 time: 0.0768433 Nov 09 04:56:30.608948 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-86cdaa08-33c4-4d61-9e70-6a45d31ea92e req-e333b63b-cea6-4032-a627-003daacb872c tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0802891 Nov 09 04:56:30.633492 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f908911e-782b-412d-ba07-0d51a51b3372 req-8d96ab77-724a-48b8-aa15-cbf3380bbe7a service neutron] 10.222.0.26 "GET /v2.0/ports/937de9d0-81e1-4c07-83c2-85629ef8f9f4/bindings/hv-neutron-8168 HTTP/1.1" status: 200 len: 384 time: 0.0659935 Nov 09 04:56:30.695312 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f908911e-782b-412d-ba07-0d51a51b3372 req-5a335649-24ef-4f7d-ab23-ddab3c2556be service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:30.696967 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f908911e-782b-412d-ba07-0d51a51b3372 req-5a335649-24ef-4f7d-ab23-ddab3c2556be service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1a8335b645d04ccbad2f2ed5288b68e8&device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 1098 time: 0.0399289 Nov 09 04:56:30.788564 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f908911e-782b-412d-ba07-0d51a51b3372 req-a9529d68-824e-4647-8e39-d4d0df5cc5cf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:30.789988 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f908911e-782b-412d-ba07-0d51a51b3372 req-a9529d68-824e-4647-8e39-d4d0df5cc5cf service neutron] 10.222.0.26 "GET /v2.0/networks?id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 HTTP/1.1" status: 200 len: 913 time: 0.0866666 Nov 09 04:56:30.853248 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f908911e-782b-412d-ba07-0d51a51b3372 req-22bf506a-3a61-4788-80f7-19ecc12a7e06 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=937de9d0-81e1-4c07-83c2-85629ef8f9f4 HTTP/1.1" status: 200 len: 1002 time: 0.0562954 Nov 09 04:56:30.905268 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f908911e-782b-412d-ba07-0d51a51b3372 req-52760b8f-404d-43d5-a8d6-e4d8d105084b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:30.906748 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f908911e-782b-412d-ba07-0d51a51b3372 req-52760b8f-404d-43d5-a8d6-e4d8d105084b service neutron] 10.222.0.26 "GET /v2.0/subnets?id=96831da9-b0dd-45f9-8543-0ac226a68c6a HTTP/1.1" status: 200 len: 851 time: 0.0471611 Nov 09 04:56:30.951380 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f908911e-782b-412d-ba07-0d51a51b3372 req-4fb08e9a-7180-4daf-876c-eb93795c4bc7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:30.952743 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f908911e-782b-412d-ba07-0d51a51b3372 req-4fb08e9a-7180-4daf-876c-eb93795c4bc7 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0388765 Nov 09 04:56:31.039488 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f908911e-782b-412d-ba07-0d51a51b3372 req-c46e6352-9d98-4410-a29b-ea9f0294b546 service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0790002 Nov 09 04:56:31.130804 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f908911e-782b-412d-ba07-0d51a51b3372 req-f5a57f62-bb6f-443b-9619-dbe6f2ee7c6b service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0844243 Nov 09 04:56:31.724890 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7563d745-2a77-4a50-8826-dc75982b4563 req-14103936-8dbb-45d8-9e0a-cc6097a8c621 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:31.726340 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-7563d745-2a77-4a50-8826-dc75982b4563 req-14103936-8dbb-45d8-9e0a-cc6097a8c621 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 945 time: 0.0483785 Nov 09 04:56:31.771859 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-7563d745-2a77-4a50-8826-dc75982b4563 req-22b8e79d-8366-46a5-a491-e63371fcb230 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0395482 Nov 09 04:56:32.890094 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f7b4bcd-d6fd-4f12-a756-794055e0f926 req-6fcb6b8f-c5b5-4c72-a449-e425d47ff9f3 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:32.891633 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6f7b4bcd-d6fd-4f12-a756-794055e0f926 req-6fcb6b8f-c5b5-4c72-a449-e425d47ff9f3 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 945 time: 0.0490270 Nov 09 04:56:32.937888 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6f7b4bcd-d6fd-4f12-a756-794055e0f926 req-e2f4262d-8882-4c36-958f-883ff788f934 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0402248 Nov 09 04:56:34.055564 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02c0a16e-a2ed-4e40-97a5-6922506fb411 req-ee97a6b2-1daf-4fb9-a2c6-a325bf3b87d9 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:34.057175 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-02c0a16e-a2ed-4e40-97a5-6922506fb411 req-ee97a6b2-1daf-4fb9-a2c6-a325bf3b87d9 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 945 time: 0.0488949 Nov 09 04:56:34.107830 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-02c0a16e-a2ed-4e40-97a5-6922506fb411 req-18324504-a8b7-4280-b208-b8743cca9332 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0444677 Nov 09 04:56:35.234506 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-006d95c9-9000-42eb-81ba-6629065f0956 req-a83e63d0-3aa1-4673-855b-757ecef5d8ab tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:35.235965 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-006d95c9-9000-42eb-81ba-6629065f0956 req-a83e63d0-3aa1-4673-855b-757ecef5d8ab tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 945 time: 0.0544252 Nov 09 04:56:35.285257 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-006d95c9-9000-42eb-81ba-6629065f0956 req-dd251521-58ba-4ce3-b116-871a47221387 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0426292 Nov 09 04:56:36.404107 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc03ad93-066d-4449-a2cb-15baaad4d699 req-957ea78d-4a63-4956-a83b-59adcb4f4564 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:36.405562 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-dc03ad93-066d-4449-a2cb-15baaad4d699 req-957ea78d-4a63-4956-a83b-59adcb4f4564 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 945 time: 0.0510960 Nov 09 04:56:36.453123 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-dc03ad93-066d-4449-a2cb-15baaad4d699 req-8361a49a-e9f4-4edf-a8c8-f75dda8ef6f6 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0410278 Nov 09 04:56:36.460959 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f908911e-782b-412d-ba07-0d51a51b3372 req-7911f754-9ce7-493b-ae3c-f645a7c1ca23 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:36.462476 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f908911e-782b-412d-ba07-0d51a51b3372 req-7911f754-9ce7-493b-ae3c-f645a7c1ca23 service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1&tenant_id=1a8335b645d04ccbad2f2ed5288b68e8 HTTP/1.1" status: 200 len: 1098 time: 0.0409255 Nov 09 04:56:36.477863 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 937de9d0-81e1-4c07-83c2-85629ef8f9f4 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:56:36.530106 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f908911e-782b-412d-ba07-0d51a51b3372 req-d3303344-7dbf-4c6a-8c77-f9508fce6300 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:36.534635 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f908911e-782b-412d-ba07-0d51a51b3372 req-d3303344-7dbf-4c6a-8c77-f9508fce6300 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=1a8335b645d04ccbad2f2ed5288b68e8&device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 1098 time: 0.0399606 Nov 09 04:56:36.555701 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:56:36.577681 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5281ed15-8461-45dc-b7a9-7646ab20e2f1', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '937de9d0-81e1-4c07-83c2-85629ef8f9f4'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:56:36.579927 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d528ef1a-7f98-44af-99dd-37b11ac919bc" -d '{"events": [{"server_uuid": "5281ed15-8461-45dc-b7a9-7646ab20e2f1", "name": "network-vif-unplugged", "status": "completed", "tag": "937de9d0-81e1-4c07-83c2-85629ef8f9f4"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:56:36.593203 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 937de9d0-81e1-4c07-83c2-85629ef8f9f4, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=937de9d0-81e1-4c07-83c2-85629ef8f9f4,segment=NetworkSegment(24d74bfa-ba9d-4c10-aa08-4a4fed47543f),segment_id=24d74bfa-ba9d-4c10-aa08-4a4fed47543f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:56:36.624296 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 09 Nov 2021 04:56:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9b7897e7-f425-4e2f-8565-5e924752fd68 x-openstack-request-id: req-9b7897e7-f425-4e2f-8565-5e924752fd68 {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:56:36.624593 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5281ed15-8461-45dc-b7a9-7646ab20e2f1", "name": "network-vif-unplugged", "status": "completed", "tag": "937de9d0-81e1-4c07-83c2-85629ef8f9f4", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:56:36.624847 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-9b7897e7-f425-4e2f-8565-5e924752fd68 {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:56:36.625240 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5281ed15-8461-45dc-b7a9-7646ab20e2f1', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '937de9d0-81e1-4c07-83c2-85629ef8f9f4', 'code': 200} Nov 09 04:56:36.627790 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f908911e-782b-412d-ba07-0d51a51b3372 req-824980b4-2793-4578-a8cd-4309a027cb3d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:36.629300 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f908911e-782b-412d-ba07-0d51a51b3372 req-824980b4-2793-4578-a8cd-4309a027cb3d service neutron] 10.222.0.26 "GET /v2.0/networks?id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 HTTP/1.1" status: 200 len: 913 time: 0.0895603 Nov 09 04:56:36.653708 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:56:36.698127 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f908911e-782b-412d-ba07-0d51a51b3372 req-4123c58f-bec8-4f72-bf03-d42d58dd07e0 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=937de9d0-81e1-4c07-83c2-85629ef8f9f4 HTTP/1.1" status: 200 len: 1002 time: 0.0612872 Nov 09 04:56:36.703602 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=937de9d0-81e1-4c07-83c2-85629ef8f9f4,revision_number=9']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:56:36.752247 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f908911e-782b-412d-ba07-0d51a51b3372 req-2c9936e5-8327-4897-954f-85b6b9e9ac29 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:36.754325 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f908911e-782b-412d-ba07-0d51a51b3372 req-2c9936e5-8327-4897-954f-85b6b9e9ac29 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=96831da9-b0dd-45f9-8543-0ac226a68c6a HTTP/1.1" status: 200 len: 851 time: 0.0484545 Nov 09 04:56:36.798054 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f908911e-782b-412d-ba07-0d51a51b3372 req-20d26e82-0167-4837-91a3-0de9136bdc11 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:36.800028 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f908911e-782b-412d-ba07-0d51a51b3372 req-20d26e82-0167-4837-91a3-0de9136bdc11 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0382016 Nov 09 04:56:36.891063 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f908911e-782b-412d-ba07-0d51a51b3372 req-cfa0d47b-f7ed-4d20-b824-ad71b9339b6e service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0838535 Nov 09 04:56:36.980333 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f908911e-782b-412d-ba07-0d51a51b3372 req-c82af8d1-93ac-4cb8-b76f-2f81a03672b0 service neutron] 10.222.0.26 "GET /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0809963 Nov 09 04:56:37.571474 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac498132-afab-4dc0-b3a9-dfc164d2770b req-a8a9897e-e6fb-48df-905f-def8e98eb57f tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:37.573255 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ac498132-afab-4dc0-b3a9-dfc164d2770b req-a8a9897e-e6fb-48df-905f-def8e98eb57f tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 943 time: 0.0490711 Nov 09 04:56:37.620764 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ac498132-afab-4dc0-b3a9-dfc164d2770b req-6461920e-bbc4-4307-997e-157c43803bef tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0414653 Nov 09 04:56:38.747817 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25e71924-0a8d-487f-ab09-ade706f2c77a req-366cc99b-421f-4340-a3c2-162bb6a32dd5 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:38.749196 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-25e71924-0a8d-487f-ab09-ade706f2c77a req-366cc99b-421f-4340-a3c2-162bb6a32dd5 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 943 time: 0.0495603 Nov 09 04:56:38.800760 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-25e71924-0a8d-487f-ab09-ade706f2c77a req-db85b06a-cc9f-45a4-82d2-341b1ee9d0be tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0448370 Nov 09 04:56:39.458734 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:56:39.921531 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4851e660-2aaf-4672-b39c-405ec307cdd0 req-16f5efb8-98e5-425b-88c3-22c1b953cee1 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:39.923051 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-4851e660-2aaf-4672-b39c-405ec307cdd0 req-16f5efb8-98e5-425b-88c3-22c1b953cee1 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 943 time: 0.0533907 Nov 09 04:56:39.972199 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-4851e660-2aaf-4672-b39c-405ec307cdd0 req-6d9ab918-5afb-4604-bcf4-88b7a42da0e5 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0429029 Nov 09 04:56:41.090568 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f212ce7d-c0e8-4114-96cb-dbf44041bc68 req-d865b80d-cc58-455c-b61e-e169563c8e5e tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:41.092035 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f212ce7d-c0e8-4114-96cb-dbf44041bc68 req-d865b80d-cc58-455c-b61e-e169563c8e5e tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 943 time: 0.0484991 Nov 09 04:56:41.138664 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f212ce7d-c0e8-4114-96cb-dbf44041bc68 req-39c0831b-c839-4642-8ea4-ad8775d4d278 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0396960 Nov 09 04:56:41.337344 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b19a6c0d-9487-407a-99ba-aa6afb6aebd6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:56:42.256791 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b60f9f7-7c1c-4b9d-a2f6-fea2448dc09c req-d62d1567-6fbe-4f10-bfc0-32a79e20fb7e tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:42.258286 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-1b60f9f7-7c1c-4b9d-a2f6-fea2448dc09c req-d62d1567-6fbe-4f10-bfc0-32a79e20fb7e tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 943 time: 0.0514383 Nov 09 04:56:42.310132 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-1b60f9f7-7c1c-4b9d-a2f6-fea2448dc09c req-da862daa-0ff6-49e7-b54a-fc2890cb50cc tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0457690 Nov 09 04:56:42.373793 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:56:43.426411 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1a72c01-c515-4723-b49c-74fed20d96c1 req-454d2e74-736c-4ecf-aeaf-5dd1b6befcd2 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:43.427976 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c1a72c01-c515-4723-b49c-74fed20d96c1 req-454d2e74-736c-4ecf-aeaf-5dd1b6befcd2 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 943 time: 0.0483310 Nov 09 04:56:43.474865 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c1a72c01-c515-4723-b49c-74fed20d96c1 req-03ba694f-bffa-4e19-ad92-2d6fbad88411 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0410366 Nov 09 04:56:43.693726 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a22d8571-aaa0-43fc-8a86-2788bab015f7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:56:44.508225 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 937de9d0-81e1-4c07-83c2-85629ef8f9f4 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=102163) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 09 04:56:44.589292 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-619f9b15-5e4c-4a3e-bec9-3aaa261252e1 req-2dc8b7bd-140b-4f01-8f1a-219114609983 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:44.590828 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-619f9b15-5e4c-4a3e-bec9-3aaa261252e1 req-2dc8b7bd-140b-4f01-8f1a-219114609983 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 943 time: 0.0486546 Nov 09 04:56:44.604247 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 937de9d0-81e1-4c07-83c2-85629ef8f9f4, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=937de9d0-81e1-4c07-83c2-85629ef8f9f4,segment=NetworkSegment(24d74bfa-ba9d-4c10-aa08-4a4fed47543f),segment_id=24d74bfa-ba9d-4c10-aa08-4a4fed47543f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:56:44.615486 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Returning: {'device': '937de9d0-81e1-4c07-83c2-85629ef8f9f4', 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21', 'port_id': '937de9d0-81e1-4c07-83c2-85629ef8f9f4', 'mac_address': 'fa:16:3e:34:39:5a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 310, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102163) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 09 04:56:44.640948 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-619f9b15-5e4c-4a3e-bec9-3aaa261252e1 req-d3cc5213-f350-4bc6-a92a-542aaeadfc45 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0443003 Nov 09 04:56:44.653105 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:56:44.666413 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 937de9d0-81e1-4c07-83c2-85629ef8f9f4 {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:56:44.684994 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 937de9d0-81e1-4c07-83c2-85629ef8f9f4, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=937de9d0-81e1-4c07-83c2-85629ef8f9f4,segment=NetworkSegment(24d74bfa-ba9d-4c10-aa08-4a4fed47543f),segment_id=24d74bfa-ba9d-4c10-aa08-4a4fed47543f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:56:44.767917 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:56:44.820477 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=937de9d0-81e1-4c07-83c2-85629ef8f9f4,revision_number=10']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:56:44.826628 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['937de9d0-81e1-4c07-83c2-85629ef8f9f4'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 04:56:45.173357 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:56:45.760418 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e39211b8-c72e-4b1b-a824-6d3736230922 req-7c932540-69ee-4f33-9036-4beb94b53b0a tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:45.761889 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e39211b8-c72e-4b1b-a824-6d3736230922 req-7c932540-69ee-4f33-9036-4beb94b53b0a tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 945 time: 0.0522289 Nov 09 04:56:45.807693 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e39211b8-c72e-4b1b-a824-6d3736230922 req-6341d788-9d9b-42e4-971e-83994a4dcf02 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0399230 Nov 09 04:56:46.523287 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 937de9d0-81e1-4c07-83c2-85629ef8f9f4 up at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:56:46.545460 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:56:46.570540 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning complete for port 937de9d0-81e1-4c07-83c2-85629ef8f9f4 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:56:46.570898 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:56:46.645738 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:56:46.667048 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5281ed15-8461-45dc-b7a9-7646ab20e2f1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '937de9d0-81e1-4c07-83c2-85629ef8f9f4'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:56:46.669219 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f05b2bdb-91d6-4b6c-b5c5-f73e6a29358d" -d '{"events": [{"server_uuid": "5281ed15-8461-45dc-b7a9-7646ab20e2f1", "name": "network-vif-plugged", "status": "completed", "tag": "937de9d0-81e1-4c07-83c2-85629ef8f9f4"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:56:46.682068 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 937de9d0-81e1-4c07-83c2-85629ef8f9f4, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=937de9d0-81e1-4c07-83c2-85629ef8f9f4,segment=NetworkSegment(24d74bfa-ba9d-4c10-aa08-4a4fed47543f),segment_id=24d74bfa-ba9d-4c10-aa08-4a4fed47543f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:56:46.712980 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:56:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fcff2e26-633e-4947-bf5c-ae1e67ee0723 x-openstack-request-id: req-fcff2e26-633e-4947-bf5c-ae1e67ee0723 {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:56:46.713216 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5281ed15-8461-45dc-b7a9-7646ab20e2f1", "name": "network-vif-plugged", "status": "completed", "tag": "937de9d0-81e1-4c07-83c2-85629ef8f9f4", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:56:46.713486 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-fcff2e26-633e-4947-bf5c-ae1e67ee0723 {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:56:46.713940 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5281ed15-8461-45dc-b7a9-7646ab20e2f1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '937de9d0-81e1-4c07-83c2-85629ef8f9f4', 'code': 200} Nov 09 04:56:46.759639 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:56:46.804817 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=937de9d0-81e1-4c07-83c2-85629ef8f9f4,revision_number=11']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:56:46.923442 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b84e64c4-8749-4cf0-a451-e4eb71120ba4 req-e6fe53e7-110f-4baf-8143-e37181232684 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:46.925482 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b84e64c4-8749-4cf0-a451-e4eb71120ba4 req-e6fe53e7-110f-4baf-8143-e37181232684 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 946 time: 0.0488939 Nov 09 04:56:46.962305 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:56:46.972553 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b84e64c4-8749-4cf0-a451-e4eb71120ba4 req-4953ad98-a015-473a-91a3-ec993f107cce tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0410028 Nov 09 04:56:48.088564 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27c1ffb9-0ccc-41b0-bf01-393ea0ed1e2e req-9834f27b-fa76-4f73-9601-5e14316f25b2 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:48.090029 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-27c1ffb9-0ccc-41b0-bf01-393ea0ed1e2e req-9834f27b-fa76-4f73-9601-5e14316f25b2 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 946 time: 0.0480208 Nov 09 04:56:48.135584 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-27c1ffb9-0ccc-41b0-bf01-393ea0ed1e2e req-a5a9ab00-8961-4527-b8b4-5f923ef7f167 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0396528 Nov 09 04:56:49.257907 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52e29df7-b322-433f-98ea-4b9c1f791622 req-5cb3dd72-b077-4f83-95bd-20af5c567b3d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:49.259373 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-52e29df7-b322-433f-98ea-4b9c1f791622 req-5cb3dd72-b077-4f83-95bd-20af5c567b3d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 946 time: 0.0541286 Nov 09 04:56:49.309734 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-52e29df7-b322-433f-98ea-4b9c1f791622 req-a1bb9b11-ad1d-4ddf-a724-362d14b216c4 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0443947 Nov 09 04:56:50.430296 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ffd064b-1134-4c6d-9dca-88250c2eb9c4 req-e582b9a4-4597-4123-9e37-b16b118c6289 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:50.431828 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-5ffd064b-1134-4c6d-9dca-88250c2eb9c4 req-e582b9a4-4597-4123-9e37-b16b118c6289 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 946 time: 0.0481551 Nov 09 04:56:50.478095 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-5ffd064b-1134-4c6d-9dca-88250c2eb9c4 req-99525141-3ac5-4934-850e-249d7f6a7098 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0404916 Nov 09 04:56:50.590769 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9288196c-7041-4979-890b-6f9026027523 req-5c50342a-2f9f-4122-a17a-4df81ba8e13d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:50.592143 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9288196c-7041-4979-890b-6f9026027523 req-5c50342a-2f9f-4122-a17a-4df81ba8e13d tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 946 time: 0.0481403 Nov 09 04:56:50.638655 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9288196c-7041-4979-890b-6f9026027523 req-b2e7744a-1398-41c7-9a2c-3a1e3c544089 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0401328 Nov 09 04:56:50.754555 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ca49a0c-cba1-4bb8-8bd2-b6c92c147b01 req-3475fc53-3542-43e4-89ee-ef97f04cb16f tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:50.756025 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-9ca49a0c-cba1-4bb8-8bd2-b6c92c147b01 req-3475fc53-3542-43e4-89ee-ef97f04cb16f tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 946 time: 0.0524132 Nov 09 04:56:50.802329 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-9ca49a0c-cba1-4bb8-8bd2-b6c92c147b01 req-a6e67cb0-d2ec-49a6-9653-c817802711b5 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0404446 Nov 09 04:56:51.275403 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-087e34fe-dcf8-4040-9117-cdfba5fe5c80 req-f3dcad70-14b0-421c-ac98-b211a188a465 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:51.276848 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-087e34fe-dcf8-4040-9117-cdfba5fe5c80 req-f3dcad70-14b0-421c-ac98-b211a188a465 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 946 time: 0.0476520 Nov 09 04:56:51.322569 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-087e34fe-dcf8-4040-9117-cdfba5fe5c80 req-247186eb-7944-4385-a21f-1e036bb5e803 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0398662 Nov 09 04:56:52.444706 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52130db9-ed6e-480b-ba34-9ee850f5380d req-5a43809c-c981-4915-8542-e56b5d88aba5 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:52.446204 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-52130db9-ed6e-480b-ba34-9ee850f5380d req-5a43809c-c981-4915-8542-e56b5d88aba5 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 946 time: 0.0501289 Nov 09 04:56:52.501007 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-52130db9-ed6e-480b-ba34-9ee850f5380d req-a8ed3d19-341b-4a70-bc05-ae238d183a4e tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0453372 Nov 09 04:56:53.617116 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2d6f09e-c78f-48bf-8828-3e6159a081ba req-2fb70e51-7181-466a-995f-11b64a665092 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:53.618077 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98e7adea-d368-4123-8d9a-1b0cade55bfe req-f3ce951b-c597-4224-b4a8-c6fe92d6ed06 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:56:53.618719 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-e2d6f09e-c78f-48bf-8828-3e6159a081ba req-2fb70e51-7181-466a-995f-11b64a665092 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 946 time: 0.0484345 Nov 09 04:56:53.619531 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-98e7adea-d368-4123-8d9a-1b0cade55bfe req-f3ce951b-c597-4224-b4a8-c6fe92d6ed06 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.26 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 946 time: 0.0510623 Nov 09 04:56:53.669981 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-e2d6f09e-c78f-48bf-8828-3e6159a081ba req-eab94d02-c873-40ad-b817-1426b0da819c tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups?id=f9cad1da-5723-46c3-9e10-9af8b6b844b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0451555 Nov 09 04:56:53.708751 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-98e7adea-d368-4123-8d9a-1b0cade55bfe req-352048f5-6b94-425d-a1ac-d11430d8c521 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Deleting port 937de9d0-81e1-4c07-83c2-85629ef8f9f4 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:56:53.709090 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-98e7adea-d368-4123-8d9a-1b0cade55bfe req-352048f5-6b94-425d-a1ac-d11430d8c521 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:56:53.806189 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-98e7adea-d368-4123-8d9a-1b0cade55bfe req-352048f5-6b94-425d-a1ac-d11430d8c521 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] For port 937de9d0-81e1-4c07-83c2-85629ef8f9f4, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=937de9d0-81e1-4c07-83c2-85629ef8f9f4,segment=NetworkSegment(24d74bfa-ba9d-4c10-aa08-4a4fed47543f),segment_id=24d74bfa-ba9d-4c10-aa08-4a4fed47543f)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:56:53.806616 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-98e7adea-d368-4123-8d9a-1b0cade55bfe req-352048f5-6b94-425d-a1ac-d11430d8c521 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:56:53.975723 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-98e7adea-d368-4123-8d9a-1b0cade55bfe req-352048f5-6b94-425d-a1ac-d11430d8c521 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:56:53.976082 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-98e7adea-d368-4123-8d9a-1b0cade55bfe req-352048f5-6b94-425d-a1ac-d11430d8c521 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:56:53.976391 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.l3_db [req-98e7adea-d368-4123-8d9a-1b0cade55bfe req-352048f5-6b94-425d-a1ac-d11430d8c521 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Floating IP b0d36e82-421b-451c-b46c-718f80940b13 disassociated. External IP: 172.26.0.146, port: 937de9d0-81e1-4c07-83c2-85629ef8f9f4. Nov 09 04:56:53.976727 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-98e7adea-d368-4123-8d9a-1b0cade55bfe req-352048f5-6b94-425d-a1ac-d11430d8c521 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Calling delete_port for 937de9d0-81e1-4c07-83c2-85629ef8f9f4 owned by compute:nova {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:56:54.188760 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-98e7adea-d368-4123-8d9a-1b0cade55bfe req-352048f5-6b94-425d-a1ac-d11430d8c521 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:56:54.220037 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-352048f5-6b94-425d-a1ac-d11430d8c521 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Pushing event deleted for resources: {'Port': ['ID=937de9d0-81e1-4c07-83c2-85629ef8f9f4,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:56:54.227995 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-352048f5-6b94-425d-a1ac-d11430d8c521 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:56:54.228329 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-352048f5-6b94-425d-a1ac-d11430d8c521 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:56:54.228678 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-352048f5-6b94-425d-a1ac-d11430d8c521 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:56:54.229014 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-352048f5-6b94-425d-a1ac-d11430d8c521 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:56:54.229348 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-352048f5-6b94-425d-a1ac-d11430d8c521 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:56:54.229681 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-352048f5-6b94-425d-a1ac-d11430d8c521 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:56:54.230009 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-352048f5-6b94-425d-a1ac-d11430d8c521 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:56:54.230335 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-352048f5-6b94-425d-a1ac-d11430d8c521 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:56:54.230680 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-352048f5-6b94-425d-a1ac-d11430d8c521 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:56:54.231006 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-352048f5-6b94-425d-a1ac-d11430d8c521 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:56:54.231326 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-352048f5-6b94-425d-a1ac-d11430d8c521 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:56:54.231648 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-352048f5-6b94-425d-a1ac-d11430d8c521 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:56:54.348500 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [req-98e7adea-d368-4123-8d9a-1b0cade55bfe req-352048f5-6b94-425d-a1ac-d11430d8c521 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Router 8cd82ce8-0774-460f-8427-ef14caab402a has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:56:54.458434 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-98e7adea-d368-4123-8d9a-1b0cade55bfe req-352048f5-6b94-425d-a1ac-d11430d8c521 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:56:54.468115 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5884229a-f550-470d-b2a7-3881b6e02834 None None] Sync routers for ids ['8cd82ce8-0774-460f-8427-ef14caab402a'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:56:54.477353 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5884229a-f550-470d-b2a7-3881b6e02834 None None] Routers {'8cd82ce8-0774-460f-8427-ef14caab402a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:56:54.477958 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-5884229a-f550-470d-b2a7-3881b6e02834 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:56:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8cd82ce8-0774-460f-8427-ef14caab402a'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:56:54.496865 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-98e7adea-d368-4123-8d9a-1b0cade55bfe req-352048f5-6b94-425d-a1ac-d11430d8c521 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] No DVR routers for this DVR port 937de9d0-81e1-4c07-83c2-85629ef8f9f4 on host hv-neutron-8168 {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:56:54.499336 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-98e7adea-d368-4123-8d9a-1b0cade55bfe req-352048f5-6b94-425d-a1ac-d11430d8c521 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:56:54.504629 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-98e7adea-d368-4123-8d9a-1b0cade55bfe req-352048f5-6b94-425d-a1ac-d11430d8c521 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.26 "DELETE /v2.0/ports/937de9d0-81e1-4c07-83c2-85629ef8f9f4 HTTP/1.1" status: 204 len: 173 time: 0.8790915 Nov 09 04:56:54.505082 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5281ed15-8461-45dc-b7a9-7646ab20e2f1', 'name': 'network-vif-deleted', 'tag': '937de9d0-81e1-4c07-83c2-85629ef8f9f4'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:56:54.507436 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e28dcb11-9fd2-4395-9d68-51f3c9aa3083" -d '{"events": [{"server_uuid": "5281ed15-8461-45dc-b7a9-7646ab20e2f1", "name": "network-vif-deleted", "tag": "937de9d0-81e1-4c07-83c2-85629ef8f9f4"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:56:54.546332 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:56:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b59a3ff3-22d7-41c8-bf88-d5ef049a45cc x-openstack-request-id: req-b59a3ff3-22d7-41c8-bf88-d5ef049a45cc {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:56:54.546723 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5281ed15-8461-45dc-b7a9-7646ab20e2f1", "name": "network-vif-deleted", "tag": "937de9d0-81e1-4c07-83c2-85629ef8f9f4", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:56:54.547148 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-b59a3ff3-22d7-41c8-bf88-d5ef049a45cc {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:56:54.547560 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5281ed15-8461-45dc-b7a9-7646ab20e2f1', 'name': 'network-vif-deleted', 'tag': '937de9d0-81e1-4c07-83c2-85629ef8f9f4', 'status': 'completed', 'code': 200} Nov 09 04:56:54.584155 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-5884229a-f550-470d-b2a7-3881b6e02834 None None] Set router 8cd82ce8-0774-460f-8427-ef14caab402a gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:56:54.776217 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d94049b9-7ec1-4805-963f-b5c175e3d73b req-61590c97-5e8f-42c2-986d-37855d04715a tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 210 time: 0.0283728 Nov 09 04:56:54.791276 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-5884229a-f550-470d-b2a7-3881b6e02834 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'name': 'tempest-ServerActionsTestJSON-1679556620-router', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77'}], 'enable_snat': True}, 'gw_port_id': '6b137909-e697-434a-93b2-4272af33f319', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:50:34Z', 'updated_at': '2021-11-09T04:50:37Z', 'revision_number': 4, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'gw_port': {'id': '6b137909-e697-434a-93b2-4272af33f319', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:88:5d:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1569, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:35Z', 'updated_at': '2021-11-09T04:50:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'a23873f3-df1f-49c6-93aa-691a0e18c829', 'name': '', 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'mac_address': 'fa:16:3e:58:72:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1570, 'fixed_ips': [{'subnet_id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:37Z', 'updated_at': '2021-11-09T04:50:40Z', 'revision_number': 5, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'subnets': [{'id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:56:54.818225 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5884229a-f550-470d-b2a7-3881b6e02834 None None] Checking router: 8cd82ce8-0774-460f-8427-ef14caab402a for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:56:54.826724 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5884229a-f550-470d-b2a7-3881b6e02834 None None] Routers {'8cd82ce8-0774-460f-8427-ef14caab402a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:56:54.827316 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-5884229a-f550-470d-b2a7-3881b6e02834 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:56:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8cd82ce8-0774-460f-8427-ef14caab402a'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:56:55.020201 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-5884229a-f550-470d-b2a7-3881b6e02834 None None] Set router 8cd82ce8-0774-460f-8427-ef14caab402a gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:56:55.224063 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-5884229a-f550-470d-b2a7-3881b6e02834 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'name': 'tempest-ServerActionsTestJSON-1679556620-router', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77'}], 'enable_snat': True}, 'gw_port_id': '6b137909-e697-434a-93b2-4272af33f319', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:50:34Z', 'updated_at': '2021-11-09T04:50:37Z', 'revision_number': 4, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'gw_port': {'id': '6b137909-e697-434a-93b2-4272af33f319', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:88:5d:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1569, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:35Z', 'updated_at': '2021-11-09T04:50:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'a23873f3-df1f-49c6-93aa-691a0e18c829', 'name': '', 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'mac_address': 'fa:16:3e:58:72:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1570, 'fixed_ips': [{'subnet_id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:37Z', 'updated_at': '2021-11-09T04:50:40Z', 'revision_number': 5, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'subnets': [{'id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:56:55.254781 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5884229a-f550-470d-b2a7-3881b6e02834 None None] The sync data for ids ['8cd82ce8-0774-460f-8427-ef14caab402a'] in dv-neutron-816802-2-hyperv is: [{'id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'name': 'tempest-ServerActionsTestJSON-1679556620-router', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77'}], 'enable_snat': True}, 'gw_port_id': '6b137909-e697-434a-93b2-4272af33f319', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:50:34Z', 'updated_at': '2021-11-09T04:50:37Z', 'revision_number': 4, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'gw_port': {'id': '6b137909-e697-434a-93b2-4272af33f319', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:88:5d:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1569, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:35Z', 'updated_at': '2021-11-09T04:50:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'a23873f3-df1f-49c6-93aa-691a0e18c829', 'name': '', 'network_id': 'd9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'mac_address': 'fa:16:3e:58:72:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1570, 'fixed_ips': [{'subnet_id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:37Z', 'updated_at': '2021-11-09T04:50:40Z', 'revision_number': 5, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'subnets': [{'id': '96831da9-b0dd-45f9-8543-0ac226a68c6a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:56:55.467612 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cd3ec127-72c9-4fc8-ac88-d4016f63c76b None None] New status for floating IP b0d36e82-421b-451c-b46c-718f80940b13: DOWN {{(pid=102163) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 04:56:55.868455 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-12a38ca5-c759-48c4-b139-23071df42369 req-cac4252a-b303-47a2-b9ce-9b80a36e942b tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 210 time: 0.0277195 Nov 09 04:56:56.569772 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 937de9d0-81e1-4c07-83c2-85629ef8f9f4 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:56:56.590697 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] No Port match for: 937de9d0-81e1-4c07-83c2-85629ef8f9f4 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:56:56.591044 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 937de9d0-81e1-4c07-83c2-85629ef8f9f4 not bound to the agent host hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:56:56.964666 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-10e2a237-514a-489e-9ae1-3e32f6318d6d req-896bef7a-ca3b-4384-8894-131a3013b8d6 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 210 time: 0.0273581 Nov 09 04:56:58.062951 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f86cd793-5d47-4e23-9988-9f6697f625a7 req-50930344-7594-41a1-bc1f-95f87aaa9b36 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 210 time: 0.0301681 Nov 09 04:56:59.166661 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ca083751-f0f3-48e2-bcac-f792a14e239a req-1c9e926a-2997-4c62-b19c-a777f091eef0 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/ports?device_id=5281ed15-8461-45dc-b7a9-7646ab20e2f1 HTTP/1.1" status: 200 len: 210 time: 0.0256763 Nov 09 04:57:04.077290 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 35344) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:57:04.131196 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-aab7e26d-cbcc-42a9-97d6-86e3db4c2783 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:04.154140 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-aab7e26d-cbcc-42a9-97d6-86e3db4c2783 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:04.276062 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-aab7e26d-cbcc-42a9-97d6-86e3db4c2783 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:04.278921 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-aab7e26d-cbcc-42a9-97d6-86e3db4c2783 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:04.280109 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-aab7e26d-cbcc-42a9-97d6-86e3db4c2783 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "DELETE /v2.0/security-groups/f9cad1da-5723-46c3-9e10-9af8b6b844b8 HTTP/1.1" status: 204 len: 168 time: 0.2014918 Nov 09 04:57:04.284089 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 35346) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:57:04.290736 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aab7e26d-cbcc-42a9-97d6-86e3db4c2783 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=f9cad1da-5723-46c3-9e10-9af8b6b844b8,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:57:04.301333 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-55e11932-9237-4066-83a6-0366450b9422 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] show failed (client error): The resource could not be found. Nov 09 04:57:04.304875 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-55e11932-9237-4066-83a6-0366450b9422 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "GET /v2.0/security-groups/f9cad1da-5723-46c3-9e10-9af8b6b844b8 HTTP/1.1" status: 404 len: 347 time: 0.0172951 Nov 09 04:57:04.305144 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 35348) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:57:04.443697 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-27971e48-c0d1-41ed-874d-78d396290be9 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Deleting port 98f9fb3c-9a2b-40f2-b28c-9059fcf82379 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:57:04.443978 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-27971e48-c0d1-41ed-874d-78d396290be9 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:04.523435 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-27971e48-c0d1-41ed-874d-78d396290be9 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:04.523754 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-27971e48-c0d1-41ed-874d-78d396290be9 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:04.535106 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-27971e48-c0d1-41ed-874d-78d396290be9 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Calling delete_port for 98f9fb3c-9a2b-40f2-b28c-9059fcf82379 owned by network:floatingip {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:57:04.727638 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-27971e48-c0d1-41ed-874d-78d396290be9 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:04.752669 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27971e48-c0d1-41ed-874d-78d396290be9 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Pushing event deleted for resources: {'Port': ['ID=98f9fb3c-9a2b-40f2-b28c-9059fcf82379,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:57:04.764332 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27971e48-c0d1-41ed-874d-78d396290be9 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:57:04.764688 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27971e48-c0d1-41ed-874d-78d396290be9 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:57:04.765025 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27971e48-c0d1-41ed-874d-78d396290be9 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:57:04.765360 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27971e48-c0d1-41ed-874d-78d396290be9 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:57:04.765690 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27971e48-c0d1-41ed-874d-78d396290be9 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:57:04.766018 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27971e48-c0d1-41ed-874d-78d396290be9 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:57:04.766343 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27971e48-c0d1-41ed-874d-78d396290be9 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:57:04.766690 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27971e48-c0d1-41ed-874d-78d396290be9 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:57:04.767021 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27971e48-c0d1-41ed-874d-78d396290be9 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:57:04.767345 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27971e48-c0d1-41ed-874d-78d396290be9 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:57:04.767666 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27971e48-c0d1-41ed-874d-78d396290be9 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:57:04.768296 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27971e48-c0d1-41ed-874d-78d396290be9 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:57:04.824418 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-27971e48-c0d1-41ed-874d-78d396290be9 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks [] for floatingip, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:04.827176 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-27971e48-c0d1-41ed-874d-78d396290be9 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:04.828303 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-27971e48-c0d1-41ed-874d-78d396290be9 tempest-ServerActionsTestJSON-21601174 tempest-ServerActionsTestJSON-21601174-project] 10.222.0.24 "DELETE /v2.0/floatingips/b0d36e82-421b-451c-b46c-718f80940b13 HTTP/1.1" status: 204 len: 168 time: 0.5222800 Nov 09 04:57:04.831180 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 35350) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:57:05.503241 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2d5b07fa-c72f-47e6-bdd0-20315bdd8e22 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:05.740503 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-2d5b07fa-c72f-47e6-bdd0-20315bdd8e22 admin admin] Deleting port a23873f3-df1f-49c6-93aa-691a0e18c829 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:57:05.740834 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2d5b07fa-c72f-47e6-bdd0-20315bdd8e22 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:05.818502 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-2d5b07fa-c72f-47e6-bdd0-20315bdd8e22 admin admin] For port a23873f3-df1f-49c6-93aa-691a0e18c829, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=a23873f3-df1f-49c6-93aa-691a0e18c829,segment=NetworkSegment(24d74bfa-ba9d-4c10-aa08-4a4fed47543f),segment_id=24d74bfa-ba9d-4c10-aa08-4a4fed47543f)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:57:05.818854 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2d5b07fa-c72f-47e6-bdd0-20315bdd8e22 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:05.830877 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-2d5b07fa-c72f-47e6-bdd0-20315bdd8e22 admin admin] Calling delete_port for a23873f3-df1f-49c6-93aa-691a0e18c829 owned by network:router_interface {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:57:06.068150 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2d5b07fa-c72f-47e6-bdd0-20315bdd8e22 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:06.094203 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d5b07fa-c72f-47e6-bdd0-20315bdd8e22 admin admin] Pushing event deleted for resources: {'Port': ['ID=a23873f3-df1f-49c6-93aa-691a0e18c829,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:57:06.256469 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2d5b07fa-c72f-47e6-bdd0-20315bdd8e22 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:06.463900 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2d5b07fa-c72f-47e6-bdd0-20315bdd8e22 admin admin] Router 8cd82ce8-0774-460f-8427-ef14caab402a has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:57:06.570652 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2d5b07fa-c72f-47e6-bdd0-20315bdd8e22 admin admin] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:57:06.575877 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-2d5b07fa-c72f-47e6-bdd0-20315bdd8e22 admin admin] 10.222.0.24 "PUT /v2.0/routers/8cd82ce8-0774-460f-8427-ef14caab402a/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7437174 Nov 09 04:57:06.578595 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 35358) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:57:06.579909 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-08337b99-522d-4efe-8304-e95a48a372ce None None] Sync routers for ids ['8cd82ce8-0774-460f-8427-ef14caab402a'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:57:06.589274 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-08337b99-522d-4efe-8304-e95a48a372ce None None] Routers {'8cd82ce8-0774-460f-8427-ef14caab402a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:57:06.589944 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-08337b99-522d-4efe-8304-e95a48a372ce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:56:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8cd82ce8-0774-460f-8427-ef14caab402a'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:57:06.680571 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2d4c5c83-3615-4478-b6d4-07d5616f7c6a admin admin] Publish callbacks [] for router, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:06.693818 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-08337b99-522d-4efe-8304-e95a48a372ce None None] Set router 8cd82ce8-0774-460f-8427-ef14caab402a gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:57:06.782591 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2d4c5c83-3615-4478-b6d4-07d5616f7c6a admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:06.865191 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-08337b99-522d-4efe-8304-e95a48a372ce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'name': 'tempest-ServerActionsTestJSON-1679556620-router', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77'}], 'enable_snat': True}, 'gw_port_id': '6b137909-e697-434a-93b2-4272af33f319', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:50:34Z', 'updated_at': '2021-11-09T04:57:05Z', 'revision_number': 5, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'gw_port': {'id': '6b137909-e697-434a-93b2-4272af33f319', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:88:5d:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1569, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.77', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:50:35Z', 'updated_at': '2021-11-09T04:50:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:57:06.882788 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-2d4c5c83-3615-4478-b6d4-07d5616f7c6a admin admin] Deleting port 6b137909-e697-434a-93b2-4272af33f319 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:57:06.883121 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2d4c5c83-3615-4478-b6d4-07d5616f7c6a admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:06.895409 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-08337b99-522d-4efe-8304-e95a48a372ce None None] Checking router: 8cd82ce8-0774-460f-8427-ef14caab402a for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:57:06.904602 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-08337b99-522d-4efe-8304-e95a48a372ce None None] Routers {'8cd82ce8-0774-460f-8427-ef14caab402a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:57:06.905193 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-08337b99-522d-4efe-8304-e95a48a372ce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:56:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['8cd82ce8-0774-460f-8427-ef14caab402a'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:57:06.964286 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-2d4c5c83-3615-4478-b6d4-07d5616f7c6a admin admin] For port 6b137909-e697-434a-93b2-4272af33f319, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=6b137909-e697-434a-93b2-4272af33f319,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:57:06.964286 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2d4c5c83-3615-4478-b6d4-07d5616f7c6a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:06.976568 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-2d4c5c83-3615-4478-b6d4-07d5616f7c6a admin admin] Calling delete_port for 6b137909-e697-434a-93b2-4272af33f319 owned by network:router_gateway {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:57:06.986488 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-08337b99-522d-4efe-8304-e95a48a372ce None None] Set router 8cd82ce8-0774-460f-8427-ef14caab402a gateway port host: None {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:57:07.039676 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-08337b99-522d-4efe-8304-e95a48a372ce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'name': 'tempest-ServerActionsTestJSON-1679556620-router', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:50:34Z', 'updated_at': '2021-11-09T04:57:06Z', 'revision_number': 6, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'gw_port_host': None}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:57:07.064839 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-08337b99-522d-4efe-8304-e95a48a372ce None None] The sync data for ids ['8cd82ce8-0774-460f-8427-ef14caab402a'] in dv-neutron-816802-2-hyperv is: [{'id': '8cd82ce8-0774-460f-8427-ef14caab402a', 'name': 'tempest-ServerActionsTestJSON-1679556620-router', 'tenant_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:50:34Z', 'updated_at': '2021-11-09T04:57:06Z', 'revision_number': 6, 'project_id': '1a8335b645d04ccbad2f2ed5288b68e8', 'gw_port_host': None}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:57:07.184193 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2d4c5c83-3615-4478-b6d4-07d5616f7c6a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:07.210028 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d4c5c83-3615-4478-b6d4-07d5616f7c6a admin admin] Pushing event deleted for resources: {'Port': ['ID=6b137909-e697-434a-93b2-4272af33f319,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:57:07.268090 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2d4c5c83-3615-4478-b6d4-07d5616f7c6a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-466373'] for router_gateway, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:07.355792 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2d4c5c83-3615-4478-b6d4-07d5616f7c6a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:07.357749 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2d4c5c83-3615-4478-b6d4-07d5616f7c6a admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:07.479416 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2d4c5c83-3615-4478-b6d4-07d5616f7c6a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:07.479872 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2d4c5c83-3615-4478-b6d4-07d5616f7c6a admin admin] Fanout notify agent at l3_agent the message router_deleted on router 8cd82ce8-0774-460f-8427-ef14caab402a {{(pid=102161) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:57:07.484728 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2d4c5c83-3615-4478-b6d4-07d5616f7c6a admin admin] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:07.488544 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-2d4c5c83-3615-4478-b6d4-07d5616f7c6a admin admin] 10.222.0.24 "DELETE /v2.0/routers/8cd82ce8-0774-460f-8427-ef14caab402a HTTP/1.1" status: 204 len: 168 time: 0.9065163 Nov 09 04:57:07.490226 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 35362) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:57:07.532345 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-7d74a0c7-6948-4119-aa17-c011369e1cf8 admin admin] Deleting subnet 96831da9-b0dd-45f9-8543-0ac226a68c6a {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:57:07.535310 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7d74a0c7-6948-4119-aa17-c011369e1cf8 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:07.569633 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7d74a0c7-6948-4119-aa17-c011369e1cf8 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:07.652821 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7d74a0c7-6948-4119-aa17-c011369e1cf8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:07.764890 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7d74a0c7-6948-4119-aa17-c011369e1cf8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:07.790716 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d74a0c7-6948-4119-aa17-c011369e1cf8 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=96831da9-b0dd-45f9-8543-0ac226a68c6a,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:57:07.794614 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7d74a0c7-6948-4119-aa17-c011369e1cf8 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:07.800298 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-7d74a0c7-6948-4119-aa17-c011369e1cf8 admin admin] 10.222.0.24 "DELETE /v2.0/subnets/96831da9-b0dd-45f9-8543-0ac226a68c6a HTTP/1.1" status: 204 len: 168 time: 0.3082492 Nov 09 04:57:07.800445 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bca6b568-1fbb-4227-9308-c798e93cc99f None None] Network d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:57:07.800891 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 35364) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:57:07.875548 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c9106584-e21c-4c27-85bf-ce03b59742dc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:07.933737 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-c9106584-e21c-4c27-85bf-ce03b59742dc admin admin] Deleting port 636c3090-6f35-4c2e-b217-1594d9525b9d {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:57:07.934072 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c9106584-e21c-4c27-85bf-ce03b59742dc admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:07.978178 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7127d4a4-c8a2-4eb0-8e2a-fc8a7625f321 None None] DHCP port deletion for d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:57:08.007280 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-c9106584-e21c-4c27-85bf-ce03b59742dc admin admin] For port 636c3090-6f35-4c2e-b217-1594d9525b9d, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=636c3090-6f35-4c2e-b217-1594d9525b9d,segment=NetworkSegment(24d74bfa-ba9d-4c10-aa08-4a4fed47543f),segment_id=24d74bfa-ba9d-4c10-aa08-4a4fed47543f)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:57:08.008021 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c9106584-e21c-4c27-85bf-ce03b59742dc admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:08.029484 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-7127d4a4-c8a2-4eb0-8e2a-fc8a7625f321 None None] Deleting port 636c3090-6f35-4c2e-b217-1594d9525b9d {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:57:08.029694 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-c9106584-e21c-4c27-85bf-ce03b59742dc admin admin] Calling delete_port for 636c3090-6f35-4c2e-b217-1594d9525b9d owned by network:dhcp {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:57:08.029853 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7127d4a4-c8a2-4eb0-8e2a-fc8a7625f321 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:08.089340 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 6b137909-e697-434a-93b2-4272af33f319 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:57:08.122836 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-7127d4a4-c8a2-4eb0-8e2a-fc8a7625f321 None None] For port 636c3090-6f35-4c2e-b217-1594d9525b9d, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=636c3090-6f35-4c2e-b217-1594d9525b9d,segment=NetworkSegment(24d74bfa-ba9d-4c10-aa08-4a4fed47543f),segment_id=24d74bfa-ba9d-4c10-aa08-4a4fed47543f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:57:08.127771 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7127d4a4-c8a2-4eb0-8e2a-fc8a7625f321 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:08.127771 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 6b137909-e697-434a-93b2-4272af33f319 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:57:08.127771 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 6b137909-e697-434a-93b2-4272af33f319 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:57:08.127771 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device a23873f3-df1f-49c6-93aa-691a0e18c829 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:57:08.153037 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: a23873f3-df1f-49c6-93aa-691a0e18c829 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:57:08.153446 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device a23873f3-df1f-49c6-93aa-691a0e18c829 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:57:08.153838 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 636c3090-6f35-4c2e-b217-1594d9525b9d no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:57:08.155565 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-7127d4a4-c8a2-4eb0-8e2a-fc8a7625f321 None None] Calling delete_port for 636c3090-6f35-4c2e-b217-1594d9525b9d owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:57:08.199452 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c9106584-e21c-4c27-85bf-ce03b59742dc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:08.225194 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9106584-e21c-4c27-85bf-ce03b59742dc admin admin] Pushing event deleted for resources: {'Port': ['ID=636c3090-6f35-4c2e-b217-1594d9525b9d,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:57:08.228942 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c9106584-e21c-4c27-85bf-ce03b59742dc admin admin] No DVR routers for this DVR port 636c3090-6f35-4c2e-b217-1594d9525b9d on host dv-neutron-816802-2-hyperv {{(pid=102161) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:57:08.237457 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No active binding found for port 636c3090-6f35-4c2e-b217-1594d9525b9d {{(pid=102163) get_port_binding_host /opt/stack/neutron/neutron/plugins/ml2/db.py:216}} Nov 09 04:57:08.237877 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 636c3090-6f35-4c2e-b217-1594d9525b9d not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:57:08.273230 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7127d4a4-c8a2-4eb0-8e2a-fc8a7625f321 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:08.298518 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7127d4a4-c8a2-4eb0-8e2a-fc8a7625f321 None None] Pushing event deleted for resources: {'Port': ['ID=636c3090-6f35-4c2e-b217-1594d9525b9d,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:57:08.303808 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7127d4a4-c8a2-4eb0-8e2a-fc8a7625f321 None None] No DVR routers for this DVR port 636c3090-6f35-4c2e-b217-1594d9525b9d on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:57:08.304748 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c9106584-e21c-4c27-85bf-ce03b59742dc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:08.326241 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-c9106584-e21c-4c27-85bf-ce03b59742dc admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:57:08.335420 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-c9106584-e21c-4c27-85bf-ce03b59742dc admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '24d74bfa-ba9d-4c10-aa08-4a4fed47543f') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:57:08.335715 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-c9106584-e21c-4c27-85bf-ce03b59742dc admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '24d74bfa-ba9d-4c10-aa08-4a4fed47543f') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:57:08.345031 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c9106584-e21c-4c27-85bf-ce03b59742dc admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:08.358872 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c9106584-e21c-4c27-85bf-ce03b59742dc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:08.365514 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c9106584-e21c-4c27-85bf-ce03b59742dc admin admin] Releasing vlan 310 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:57:08.365914 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c9106584-e21c-4c27-85bf-ce03b59742dc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:08.367587 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:57:08.367587 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:57:08.367587 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:57:08.367587 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:57:08.367587 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:57:08.367587 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:57:08.367587 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:57:08.367587 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:57:08.367587 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:57:08.367587 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:57:08.367587 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:57:08.367587 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:57:08.367587 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:57:08.367587 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:57:08.367587 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:57:08.367587 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:57:08.367587 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:57:08.367587 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:57:08.367587 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:57:08.367587 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:57:08.367587 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:57:08.367587 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:57:08.367587 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:57:08.367587 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:57:08.367587 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:57:08.367587 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:57:08.367587 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:57:08.367587 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:57:08.367587 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:57:08.367587 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:57:08.367587 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:57:08.367587 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:57:08.458481 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c9106584-e21c-4c27-85bf-ce03b59742dc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:08.463544 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c9106584-e21c-4c27-85bf-ce03b59742dc admin admin] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:08.466687 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-c9106584-e21c-4c27-85bf-ce03b59742dc admin admin] 10.222.0.24 "DELETE /v2.0/networks/d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21 HTTP/1.1" status: 204 len: 168 time: 0.6650958 Nov 09 04:57:08.477829 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9106584-e21c-4c27-85bf-ce03b59742dc admin admin] Pushing event deleted for resources: {'Network': ['ID=d9bc1ac1-1aeb-4f8b-9f6d-d28d4fb05d21,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:57:08.735817 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 35368) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:57:08.780133 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-3bef18e9-f25a-4fbd-904e-3443711f042d admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=1a8335b645d04ccbad2f2ed5288b68e8&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0431561 Nov 09 04:57:08.782562 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 35370) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:57:08.828031 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-00e951ec-56b8-4e20-8071-781c9b5a38ff admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:08.849401 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-00e951ec-56b8-4e20-8071-781c9b5a38ff admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:08.989987 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-00e951ec-56b8-4e20-8071-781c9b5a38ff admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:08.992628 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-00e951ec-56b8-4e20-8071-781c9b5a38ff admin admin] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:08.993817 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-00e951ec-56b8-4e20-8071-781c9b5a38ff admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/160d79dd-7918-4181-8544-a1e2fc21201b HTTP/1.1" status: 204 len: 168 time: 0.2103505 Nov 09 04:57:09.001781 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00e951ec-56b8-4e20-8071-781c9b5a38ff admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=160d79dd-7918-4181-8544-a1e2fc21201b,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:57:10.049542 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 35392) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:57:10.142546 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-5be188c8-5701-4bc3-b32e-4f3ba059eb0d admin admin] Request body: {'network': {'name': 'tempest-ServersNegativeTestJSON-1835539796-network', 'tenant_id': 'caaa6bb6cfb8410fa008d69912c73bd6'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:57:10.240749 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5be188c8-5701-4bc3-b32e-4f3ba059eb0d admin admin] Made reservation on behalf of caaa6bb6cfb8410fa008d69912c73bd6 for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:57:10.243056 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5be188c8-5701-4bc3-b32e-4f3ba059eb0d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:10.251458 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5be188c8-5701-4bc3-b32e-4f3ba059eb0d admin admin] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:10.322915 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5be188c8-5701-4bc3-b32e-4f3ba059eb0d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:10.423881 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5be188c8-5701-4bc3-b32e-4f3ba059eb0d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:10.448697 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5be188c8-5701-4bc3-b32e-4f3ba059eb0d admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 300} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:57:10.457132 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5be188c8-5701-4bc3-b32e-4f3ba059eb0d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=34faeb60-1a3f-4e94-b217-129f3f06065a,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:57:10.463395 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5be188c8-5701-4bc3-b32e-4f3ba059eb0d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:10.463788 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-5be188c8-5701-4bc3-b32e-4f3ba059eb0d admin admin] Added segment 35f725ee-5e24-4053-aa6a-1de1610a48ad of type vlan for network 94c21177-56da-413b-867f-dae9860433c2 Nov 09 04:57:10.504782 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5be188c8-5701-4bc3-b32e-4f3ba059eb0d admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:10.624761 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5be188c8-5701-4bc3-b32e-4f3ba059eb0d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:10.625647 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5be188c8-5701-4bc3-b32e-4f3ba059eb0d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:10.626213 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5be188c8-5701-4bc3-b32e-4f3ba059eb0d admin admin] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:10.686683 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5be188c8-5701-4bc3-b32e-4f3ba059eb0d admin admin] Pushing event updated for resources: {'Network': ['ID=94c21177-56da-413b-867f-dae9860433c2,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:57:10.697504 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 94c21177-56da-413b-867f-dae9860433c2 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:57:10.730297 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-5be188c8-5701-4bc3-b32e-4f3ba059eb0d admin admin] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.6796935 Nov 09 04:57:10.733217 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 35396) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:57:10.738083 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-0ecd282c-5680-4885-87d9-f13e72e7acde admin admin] Request body: {'subnet': {'network_id': '94c21177-56da-413b-867f-dae9860433c2', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServersNegativeTestJSON-1835539796-subnet', 'tenant_id': 'caaa6bb6cfb8410fa008d69912c73bd6', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:57:10.873048 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0ecd282c-5680-4885-87d9-f13e72e7acde admin admin] Made reservation on behalf of caaa6bb6cfb8410fa008d69912c73bd6 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:57:10.875789 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0ecd282c-5680-4885-87d9-f13e72e7acde admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:11.132745 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0ecd282c-5680-4885-87d9-f13e72e7acde admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:11.185863 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ecd282c-5680-4885-87d9-f13e72e7acde admin admin] Pushing event updated for resources: {'Subnet': ['ID=b173abdc-1bbb-4046-a9d8-4d269a090b4b,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:57:11.195745 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0ecd282c-5680-4885-87d9-f13e72e7acde admin admin] Checking segment: {'id': '35f725ee-5e24-4053-aa6a-1de1610a48ad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 300, 'network_id': '94c21177-56da-413b-867f-dae9860433c2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:57:11.196376 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0ecd282c-5680-4885-87d9-f13e72e7acde admin admin] Network hostable DHCP agents. Network: 94c21177-56da-413b-867f-dae9860433c2, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:57:11.301778 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0ecd282c-5680-4885-87d9-f13e72e7acde admin admin] Network 94c21177-56da-413b-867f-dae9860433c2 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:57:11.375734 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-beb7318a-a56a-4603-a5a7-33f39d8f2021 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:11.452432 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-0ecd282c-5680-4885-87d9-f13e72e7acde admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 94c21177-56da-413b-867f-dae9860433c2) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:57:11.456250 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0ecd282c-5680-4885-87d9-f13e72e7acde admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:11.456824 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0ecd282c-5680-4885-87d9-f13e72e7acde admin admin] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:11.460709 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ea5040e3-ba4c-4ae5-802e-1f59e872d88e None None] Network 94c21177-56da-413b-867f-dae9860433c2 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:57:11.568855 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-0ecd282c-5680-4885-87d9-f13e72e7acde admin admin] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.8272889 Nov 09 04:57:11.583297 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-edea8afc-7c60-450c-a570-4967ba5f5cbf None None] Network 94c21177-56da-413b-867f-dae9860433c2 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:57:11.968424 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acff7e23-7fc3-4b16-8ba5-35e167112e18 req-6d07ea1b-5689-4060-8b79-a36e36ef10f2 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:11.969811 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-acff7e23-7fc3-4b16-8ba5-35e167112e18 req-6d07ea1b-5689-4060-8b79-a36e36ef10f2 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/networks?id=94c21177-56da-413b-867f-dae9860433c2 HTTP/1.1" status: 200 len: 814 time: 0.1032720 Nov 09 04:57:11.984273 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-acff7e23-7fc3-4b16-8ba5-35e167112e18 req-7f3509c8-1ef0-4047-a2d7-aa6e1cefa907 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/quotas/caaa6bb6cfb8410fa008d69912c73bd6 HTTP/1.1" status: 200 len: 375 time: 0.0087306 Nov 09 04:57:12.014945 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-acff7e23-7fc3-4b16-8ba5-35e167112e18 req-d2202b09-5e80-4c5e-a8ae-e3892ca761e8 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/ports?tenant_id=caaa6bb6cfb8410fa008d69912c73bd6&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0253046 Nov 09 04:57:12.150577 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-acff7e23-7fc3-4b16-8ba5-35e167112e18 req-547c6574-f74d-4754-9786-67b465eaedf1 service neutron] 10.222.0.24 "GET /v2.0/networks/94c21177-56da-413b-867f-dae9860433c2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1283071 Nov 09 04:57:12.239072 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-acff7e23-7fc3-4b16-8ba5-35e167112e18 req-14c1359d-2a45-42c5-b150-f30c59182a9c service neutron] 10.222.0.24 "GET /v2.0/networks/94c21177-56da-413b-867f-dae9860433c2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0823956 Nov 09 04:57:12.413031 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:12.500706 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2c223051-6424-4643-85f1-052b7bd22ad7 req-d4dd6167-8086-46bb-80a9-293ec9632a39 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/ports?device_id=b1c3af91-1490-484c-8de6-c7d8832e77ab HTTP/1.1" status: 200 len: 210 time: 0.0316939 Nov 09 04:57:13.598973 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-42ab4f90-ad48-467a-93af-b1f2cfbbaadc req-7e3140b9-af35-4830-9b8b-8a4aebf73f5a tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/ports?device_id=b1c3af91-1490-484c-8de6-c7d8832e77ab HTTP/1.1" status: 200 len: 210 time: 0.0282428 Nov 09 04:57:13.718703 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4de1e7df-dbd1-4a2d-9a70-4d0fa6bd836a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:14.496923 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acff7e23-7fc3-4b16-8ba5-35e167112e18 req-ff30884a-d90e-4ac1-88f0-bd28e70ecd0c tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:14.498468 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-acff7e23-7fc3-4b16-8ba5-35e167112e18 req-ff30884a-d90e-4ac1-88f0-bd28e70ecd0c tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.26 "GET /v2.0/networks?id=94c21177-56da-413b-867f-dae9860433c2 HTTP/1.1" status: 200 len: 814 time: 0.1015148 Nov 09 04:57:14.512416 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-acff7e23-7fc3-4b16-8ba5-35e167112e18 req-2787d062-fce1-427a-bf95-16fc97e9bdf4 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Request body: {'port': {'device_id': 'b1c3af91-1490-484c-8de6-c7d8832e77ab', 'network_id': '94c21177-56da-413b-867f-dae9860433c2', 'admin_state_up': True, 'tenant_id': 'caaa6bb6cfb8410fa008d69912c73bd6'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:57:14.693560 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5fe1b7bc-e980-45c6-8424-4f3a9428a486 req-5729aab2-227d-47ad-ac69-631556850481 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/ports?device_id=b1c3af91-1490-484c-8de6-c7d8832e77ab HTTP/1.1" status: 200 len: 210 time: 0.0266781 Nov 09 04:57:14.707172 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-acff7e23-7fc3-4b16-8ba5-35e167112e18 req-2787d062-fce1-427a-bf95-16fc97e9bdf4 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Made reservation on behalf of caaa6bb6cfb8410fa008d69912c73bd6 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:57:14.711176 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-acff7e23-7fc3-4b16-8ba5-35e167112e18 req-2787d062-fce1-427a-bf95-16fc97e9bdf4 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:14.837206 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [req-acff7e23-7fc3-4b16-8ba5-35e167112e18 req-2787d062-fce1-427a-bf95-16fc97e9bdf4 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Allocated IP 172.20.0.9 (94c21177-56da-413b-867f-dae9860433c2/b173abdc-1bbb-4046-a9d8-4d269a090b4b/de14b9c1-e0ff-4adc-982a-590708805995) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:57:14.978416 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-acff7e23-7fc3-4b16-8ba5-35e167112e18 req-2787d062-fce1-427a-bf95-16fc97e9bdf4 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:15.084941 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-acff7e23-7fc3-4b16-8ba5-35e167112e18 req-2787d062-fce1-427a-bf95-16fc97e9bdf4 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:15.128978 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-acff7e23-7fc3-4b16-8ba5-35e167112e18 req-2787d062-fce1-427a-bf95-16fc97e9bdf4 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Network 94c21177-56da-413b-867f-dae9860433c2 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:57:15.131960 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [req-acff7e23-7fc3-4b16-8ba5-35e167112e18 req-2787d062-fce1-427a-bf95-16fc97e9bdf4 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:57:15.137972 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-acff7e23-7fc3-4b16-8ba5-35e167112e18 req-2787d062-fce1-427a-bf95-16fc97e9bdf4 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:57:15.162124 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2787d062-fce1-427a-bf95-16fc97e9bdf4 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Pushing event updated for resources: {'Port': ['ID=de14b9c1-e0ff-4adc-982a-590708805995,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:57:15.186925 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:15.188974 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acff7e23-7fc3-4b16-8ba5-35e167112e18 req-2787d062-fce1-427a-bf95-16fc97e9bdf4 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:15.189579 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-acff7e23-7fc3-4b16-8ba5-35e167112e18 req-2787d062-fce1-427a-bf95-16fc97e9bdf4 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:15.281201 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-acff7e23-7fc3-4b16-8ba5-35e167112e18 req-2787d062-fce1-427a-bf95-16fc97e9bdf4 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.26 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7727649 Nov 09 04:57:15.293764 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-acff7e23-7fc3-4b16-8ba5-35e167112e18 req-c3ee3f41-ba38-4d06-937a-508777bfd8be service neutron] Request body: {'port': {'device_id': 'b1c3af91-1490-484c-8de6-c7d8832e77ab', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:57:15.345260 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-acff7e23-7fc3-4b16-8ba5-35e167112e18 req-c3ee3f41-ba38-4d06-937a-508777bfd8be service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:15.597572 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [req-acff7e23-7fc3-4b16-8ba5-35e167112e18 req-c3ee3f41-ba38-4d06-937a-508777bfd8be service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id de14b9c1-e0ff-4adc-982a-590708805995 {{(pid=102162) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:57:15.605388 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-acff7e23-7fc3-4b16-8ba5-35e167112e18 req-c3ee3f41-ba38-4d06-937a-508777bfd8be service neutron] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:15.618254 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.provisioning_blocks [req-acff7e23-7fc3-4b16-8ba5-35e167112e18 req-c3ee3f41-ba38-4d06-937a-508777bfd8be service neutron] Transition to ACTIVE for port object de14b9c1-e0ff-4adc-982a-590708805995 will not be triggered until provisioned by entity L2. {{(pid=102162) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 09 04:57:15.683916 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-acff7e23-7fc3-4b16-8ba5-35e167112e18 req-c3ee3f41-ba38-4d06-937a-508777bfd8be service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:15.735157 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3ee3f41-ba38-4d06-937a-508777bfd8be service neutron] Pushing event updated for resources: {'Port': ['ID=de14b9c1-e0ff-4adc-982a-590708805995,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:57:15.801900 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-acff7e23-7fc3-4b16-8ba5-35e167112e18 req-c3ee3f41-ba38-4d06-937a-508777bfd8be service neutron] Attempting to bind port de14b9c1-e0ff-4adc-982a-590708805995 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:57:15.802810 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-acff7e23-7fc3-4b16-8ba5-35e167112e18 req-c3ee3f41-ba38-4d06-937a-508777bfd8be service neutron] Attempting to bind port de14b9c1-e0ff-4adc-982a-590708805995 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '35f725ee-5e24-4053-aa6a-1de1610a48ad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 300, 'network_id': '94c21177-56da-413b-867f-dae9860433c2'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:57:15.803136 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-acff7e23-7fc3-4b16-8ba5-35e167112e18 req-c3ee3f41-ba38-4d06-937a-508777bfd8be service neutron] Attempting to bind port de14b9c1-e0ff-4adc-982a-590708805995 on network 94c21177-56da-413b-867f-dae9860433c2 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:57:15.807562 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-acff7e23-7fc3-4b16-8ba5-35e167112e18 req-c3ee3f41-ba38-4d06-937a-508777bfd8be service neutron] Port de14b9c1-e0ff-4adc-982a-590708805995 on network 94c21177-56da-413b-867f-dae9860433c2 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:57:15.808005 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-acff7e23-7fc3-4b16-8ba5-35e167112e18 req-c3ee3f41-ba38-4d06-937a-508777bfd8be service neutron] Attempting to bind port de14b9c1-e0ff-4adc-982a-590708805995 on network 94c21177-56da-413b-867f-dae9860433c2 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:57:15.812880 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-acff7e23-7fc3-4b16-8ba5-35e167112e18 req-c3ee3f41-ba38-4d06-937a-508777bfd8be service neutron] Checking agent: {'id': '7d36b884-4ad2-4878-9464-bf647030b544', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'started_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 57, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:57:15.813205 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-acff7e23-7fc3-4b16-8ba5-35e167112e18 req-c3ee3f41-ba38-4d06-937a-508777bfd8be service neutron] Checking segment: {'id': '35f725ee-5e24-4053-aa6a-1de1610a48ad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 300, 'network_id': '94c21177-56da-413b-867f-dae9860433c2'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:57:15.813582 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-acff7e23-7fc3-4b16-8ba5-35e167112e18 req-c3ee3f41-ba38-4d06-937a-508777bfd8be service neutron] Bound using segment: {'id': '35f725ee-5e24-4053-aa6a-1de1610a48ad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 300, 'network_id': '94c21177-56da-413b-867f-dae9860433c2'} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:57:15.813994 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-acff7e23-7fc3-4b16-8ba5-35e167112e18 req-c3ee3f41-ba38-4d06-937a-508777bfd8be service neutron] Bound port: de14b9c1-e0ff-4adc-982a-590708805995, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '35f725ee-5e24-4053-aa6a-1de1610a48ad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 300, 'network_id': '94c21177-56da-413b-867f-dae9860433c2'}}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:57:15.814340 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-acff7e23-7fc3-4b16-8ba5-35e167112e18 req-c3ee3f41-ba38-4d06-937a-508777bfd8be service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:15.819064 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d800dd8e-74df-40ab-b23b-a4ac6f52a429 req-2c2d535f-5c3d-47a6-93b5-603f9d7db92b tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:15.820532 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d800dd8e-74df-40ab-b23b-a4ac6f52a429 req-2c2d535f-5c3d-47a6-93b5-603f9d7db92b tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/ports?device_id=b1c3af91-1490-484c-8de6-c7d8832e77ab HTTP/1.1" status: 200 len: 943 time: 0.0529809 Nov 09 04:57:15.866988 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d800dd8e-74df-40ab-b23b-a4ac6f52a429 req-0be46417-432c-43a9-bc2d-fcffff94e883 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/security-groups?id=34faeb60-1a3f-4e94-b217-129f3f06065a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399356 Nov 09 04:57:15.876066 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-acff7e23-7fc3-4b16-8ba5-35e167112e18 req-c3ee3f41-ba38-4d06-937a-508777bfd8be service neutron] For port de14b9c1-e0ff-4adc-982a-590708805995, host hv-neutron-8168, cleared binding levels {{(pid=102162) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:57:15.879309 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-acff7e23-7fc3-4b16-8ba5-35e167112e18 req-c3ee3f41-ba38-4d06-937a-508777bfd8be service neutron] For port de14b9c1-e0ff-4adc-982a-590708805995, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=de14b9c1-e0ff-4adc-982a-590708805995,segment=NetworkSegment(35f725ee-5e24-4053-aa6a-1de1610a48ad),segment_id=35f725ee-5e24-4053-aa6a-1de1610a48ad)] {{(pid=102162) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:57:15.964848 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-acff7e23-7fc3-4b16-8ba5-35e167112e18 req-c3ee3f41-ba38-4d06-937a-508777bfd8be service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:15.992331 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acff7e23-7fc3-4b16-8ba5-35e167112e18 req-c3ee3f41-ba38-4d06-937a-508777bfd8be service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:15.992737 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-acff7e23-7fc3-4b16-8ba5-35e167112e18 req-c3ee3f41-ba38-4d06-937a-508777bfd8be service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:15.994092 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-acff7e23-7fc3-4b16-8ba5-35e167112e18 req-c3ee3f41-ba38-4d06-937a-508777bfd8be service neutron] 10.222.0.26 "PUT /v2.0/ports/de14b9c1-e0ff-4adc-982a-590708805995 HTTP/1.1" status: 200 len: 1093 time: 0.7044322 Nov 09 04:57:15.994572 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b1c3af91-1490-484c-8de6-c7d8832e77ab', 'tag': 'de14b9c1-e0ff-4adc-982a-590708805995'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:57:15.996806 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4b180e03-a0ba-43fd-9e0c-fd7ed58a8998" -d '{"events": [{"name": "network-changed", "server_uuid": "b1c3af91-1490-484c-8de6-c7d8832e77ab", "tag": "de14b9c1-e0ff-4adc-982a-590708805995"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:57:16.021519 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3ee3f41-ba38-4d06-937a-508777bfd8be service neutron] Pushing event updated for resources: {'Port': ['ID=de14b9c1-e0ff-4adc-982a-590708805995,revision_number=3']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:57:16.033596 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:57:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-08f3ef5c-8b19-4d92-aaab-030262692a22 x-openstack-request-id: req-08f3ef5c-8b19-4d92-aaab-030262692a22 {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:57:16.033886 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b1c3af91-1490-484c-8de6-c7d8832e77ab", "tag": "de14b9c1-e0ff-4adc-982a-590708805995", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:57:16.034154 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-08f3ef5c-8b19-4d92-aaab-030262692a22 {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:57:16.034586 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b1c3af91-1490-484c-8de6-c7d8832e77ab', 'tag': 'de14b9c1-e0ff-4adc-982a-590708805995', 'status': 'completed', 'code': 200} Nov 09 04:57:16.096229 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b180e03-a0ba-43fd-9e0c-fd7ed58a8998 req-e12de647-476d-45c6-ae89-b9dee74012b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:16.097747 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4b180e03-a0ba-43fd-9e0c-fd7ed58a8998 req-e12de647-476d-45c6-ae89-b9dee74012b6 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=caaa6bb6cfb8410fa008d69912c73bd6&device_id=b1c3af91-1490-484c-8de6-c7d8832e77ab HTTP/1.1" status: 200 len: 1096 time: 0.0424490 Nov 09 04:57:16.197023 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b180e03-a0ba-43fd-9e0c-fd7ed58a8998 req-f3d486f7-30b0-4601-9bb0-6dabb0bfb69c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:16.198390 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4b180e03-a0ba-43fd-9e0c-fd7ed58a8998 req-f3d486f7-30b0-4601-9bb0-6dabb0bfb69c service neutron] 10.222.0.26 "GET /v2.0/networks?tenant_id=caaa6bb6cfb8410fa008d69912c73bd6&shared=False HTTP/1.1" status: 200 len: 915 time: 0.0920603 Nov 09 04:57:16.294702 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b180e03-a0ba-43fd-9e0c-fd7ed58a8998 req-b78a1b0e-c899-45b4-b856-ca67396f68d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:16.296135 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4b180e03-a0ba-43fd-9e0c-fd7ed58a8998 req-b78a1b0e-c899-45b4-b856-ca67396f68d4 service neutron] 10.222.0.26 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0902979 Nov 09 04:57:16.371003 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acff7e23-7fc3-4b16-8ba5-35e167112e18 req-51c07bba-f5f7-4439-9e9c-eecd9643030e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:16.372525 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-acff7e23-7fc3-4b16-8ba5-35e167112e18 req-51c07bba-f5f7-4439-9e9c-eecd9643030e service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=caaa6bb6cfb8410fa008d69912c73bd6&device_id=b1c3af91-1490-484c-8de6-c7d8832e77ab HTTP/1.1" status: 200 len: 1096 time: 0.0405507 Nov 09 04:57:16.414074 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-acff7e23-7fc3-4b16-8ba5-35e167112e18 req-8a4ff086-3510-43e3-8bfc-43b080bd5f0d service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=de14b9c1-e0ff-4adc-982a-590708805995 HTTP/1.1" status: 200 len: 217 time: 0.0334466 Nov 09 04:57:16.457667 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:57:16.461716 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acff7e23-7fc3-4b16-8ba5-35e167112e18 req-1983fb63-3111-4b17-8c2c-9dda895b2427 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:16.463182 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-acff7e23-7fc3-4b16-8ba5-35e167112e18 req-1983fb63-3111-4b17-8c2c-9dda895b2427 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=b173abdc-1bbb-4046-a9d8-4d269a090b4b HTTP/1.1" status: 200 len: 854 time: 0.0424528 Nov 09 04:57:16.498229 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-acff7e23-7fc3-4b16-8ba5-35e167112e18 req-13a19473-779a-4ec1-a265-b7fdecdb32e8 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=94c21177-56da-413b-867f-dae9860433c2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0275207 Nov 09 04:57:16.552490 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:16.591786 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-acff7e23-7fc3-4b16-8ba5-35e167112e18 req-91f4abdd-1596-45f8-b5fa-1f94af492c71 service neutron] 10.222.0.26 "GET /v2.0/networks/94c21177-56da-413b-867f-dae9860433c2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0851700 Nov 09 04:57:16.681203 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-acff7e23-7fc3-4b16-8ba5-35e167112e18 req-b6db5867-a857-4876-8155-ab5d1aae1147 service neutron] 10.222.0.26 "GET /v2.0/networks/94c21177-56da-413b-867f-dae9860433c2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0828714 Nov 09 04:57:16.966562 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:16.978866 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07a775a0-b0e5-4c1e-8d78-2cf8482a201f req-f3f923f6-ccc1-4f83-a319-1ae3a4fee5c6 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:16.980369 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-07a775a0-b0e5-4c1e-8d78-2cf8482a201f req-f3f923f6-ccc1-4f83-a319-1ae3a4fee5c6 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/ports?device_id=b1c3af91-1490-484c-8de6-c7d8832e77ab HTTP/1.1" status: 200 len: 943 time: 0.0483060 Nov 09 04:57:17.026822 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-07a775a0-b0e5-4c1e-8d78-2cf8482a201f req-a850726b-c344-4046-9753-da23082d9337 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/security-groups?id=34faeb60-1a3f-4e94-b217-129f3f06065a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404708 Nov 09 04:57:18.140641 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ccbae01-c05b-4e20-b9b7-2061e48c6455 req-1ca26dde-6beb-4ebf-9fa3-188c953fdb62 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:18.142001 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6ccbae01-c05b-4e20-b9b7-2061e48c6455 req-1ca26dde-6beb-4ebf-9fa3-188c953fdb62 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/ports?device_id=b1c3af91-1490-484c-8de6-c7d8832e77ab HTTP/1.1" status: 200 len: 943 time: 0.0476339 Nov 09 04:57:18.187525 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6ccbae01-c05b-4e20-b9b7-2061e48c6455 req-cfdc837d-44ae-43bc-ac4f-926daeca7a66 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/security-groups?id=34faeb60-1a3f-4e94-b217-129f3f06065a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390265 Nov 09 04:57:18.672098 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device de14b9c1-e0ff-4adc-982a-590708805995 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=102163) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 09 04:57:18.773335 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port de14b9c1-e0ff-4adc-982a-590708805995, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=de14b9c1-e0ff-4adc-982a-590708805995,segment=NetworkSegment(35f725ee-5e24-4053-aa6a-1de1610a48ad),segment_id=35f725ee-5e24-4053-aa6a-1de1610a48ad)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:57:18.784700 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Returning: {'device': 'de14b9c1-e0ff-4adc-982a-590708805995', 'network_id': '94c21177-56da-413b-867f-dae9860433c2', 'port_id': 'de14b9c1-e0ff-4adc-982a-590708805995', 'mac_address': 'fa:16:3e:b3:4e:98', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 300, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b173abdc-1bbb-4046-a9d8-4d269a090b4b', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102163) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 09 04:57:18.821992 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:18.835387 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id de14b9c1-e0ff-4adc-982a-590708805995 {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:57:18.857640 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port de14b9c1-e0ff-4adc-982a-590708805995, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=de14b9c1-e0ff-4adc-982a-590708805995,segment=NetworkSegment(35f725ee-5e24-4053-aa6a-1de1610a48ad),segment_id=35f725ee-5e24-4053-aa6a-1de1610a48ad)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:57:18.929948 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:18.976731 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=de14b9c1-e0ff-4adc-982a-590708805995,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:57:18.983507 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:57:18.983851 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:57:18.984182 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:57:18.984516 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:57:18.984839 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:57:18.985164 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:57:18.985487 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:57:18.985903 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:57:18.986332 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:57:18.986673 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:57:18.986994 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:57:18.987308 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:57:19.173580 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['de14b9c1-e0ff-4adc-982a-590708805995'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 04:57:19.298113 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b38def7a-9522-4015-a0e3-4ab20e7f66b1 req-ee86fd7d-c73f-4f0c-887f-67b7b49b2353 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:19.299593 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b38def7a-9522-4015-a0e3-4ab20e7f66b1 req-ee86fd7d-c73f-4f0c-887f-67b7b49b2353 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/ports?device_id=b1c3af91-1490-484c-8de6-c7d8832e77ab HTTP/1.1" status: 200 len: 944 time: 0.0465906 Nov 09 04:57:19.348903 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b38def7a-9522-4015-a0e3-4ab20e7f66b1 req-e6eb8d8d-795b-4e5e-9d67-92b9e2834978 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/security-groups?id=34faeb60-1a3f-4e94-b217-129f3f06065a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428786 Nov 09 04:57:20.461457 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f79efe39-27f1-4254-b793-855f463ff941 req-8f9cb7ee-7805-4778-bbdc-4bc772bafef6 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:20.462902 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f79efe39-27f1-4254-b793-855f463ff941 req-8f9cb7ee-7805-4778-bbdc-4bc772bafef6 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/ports?device_id=b1c3af91-1490-484c-8de6-c7d8832e77ab HTTP/1.1" status: 200 len: 944 time: 0.0465124 Nov 09 04:57:20.512605 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f79efe39-27f1-4254-b793-855f463ff941 req-82104622-ef7f-4251-b9e3-20021b89a83f tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/security-groups?id=34faeb60-1a3f-4e94-b217-129f3f06065a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438840 Nov 09 04:57:20.679737 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device de14b9c1-e0ff-4adc-982a-590708805995 up at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:57:20.809897 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning for port de14b9c1-e0ff-4adc-982a-590708805995 completed by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 09 04:57:20.813734 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning complete for port de14b9c1-e0ff-4adc-982a-590708805995 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:57:20.814093 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:20.887894 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:20.909339 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b1c3af91-1490-484c-8de6-c7d8832e77ab', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'de14b9c1-e0ff-4adc-982a-590708805995'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:57:20.911553 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bf6e9c8a-ccb8-440c-8683-7e10fde4ba7e" -d '{"events": [{"server_uuid": "b1c3af91-1490-484c-8de6-c7d8832e77ab", "name": "network-vif-plugged", "status": "completed", "tag": "de14b9c1-e0ff-4adc-982a-590708805995"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:57:20.924048 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port de14b9c1-e0ff-4adc-982a-590708805995, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=de14b9c1-e0ff-4adc-982a-590708805995,segment=NetworkSegment(35f725ee-5e24-4053-aa6a-1de1610a48ad),segment_id=35f725ee-5e24-4053-aa6a-1de1610a48ad)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:57:20.949036 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:57:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-be122f70-d416-44c3-89f4-e02edb5a1b64 x-openstack-request-id: req-be122f70-d416-44c3-89f4-e02edb5a1b64 {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:57:20.949321 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b1c3af91-1490-484c-8de6-c7d8832e77ab", "name": "network-vif-plugged", "status": "completed", "tag": "de14b9c1-e0ff-4adc-982a-590708805995", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:57:20.949587 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-be122f70-d416-44c3-89f4-e02edb5a1b64 {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:57:20.949993 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b1c3af91-1490-484c-8de6-c7d8832e77ab', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'de14b9c1-e0ff-4adc-982a-590708805995', 'code': 200} Nov 09 04:57:20.993090 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:21.041464 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=de14b9c1-e0ff-4adc-982a-590708805995,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:57:21.240118 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b433e00f-4764-4648-bb02-fff98e357f9a req-a31b9872-bb20-43d4-9edc-1aed5c7926ec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:21.241490 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b433e00f-4764-4648-bb02-fff98e357f9a req-a31b9872-bb20-43d4-9edc-1aed5c7926ec service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=b1c3af91-1490-484c-8de6-c7d8832e77ab HTTP/1.1" status: 200 len: 1098 time: 0.0387387 Nov 09 04:57:21.284190 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b433e00f-4764-4648-bb02-fff98e357f9a req-59a0c901-34ea-4b40-b6b4-e7fba0cf694a service neutron] 10.222.0.26 "GET /v2.0/security-groups?id=34faeb60-1a3f-4e94-b217-129f3f06065a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0355957 Nov 09 04:57:21.623769 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8a86b8b-17b6-4229-abdd-1b17e49314a0 req-d0efb23a-3eeb-4c22-8867-6c1c7bc27eca tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:21.625212 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d8a86b8b-17b6-4229-abdd-1b17e49314a0 req-d0efb23a-3eeb-4c22-8867-6c1c7bc27eca tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/ports?device_id=b1c3af91-1490-484c-8de6-c7d8832e77ab HTTP/1.1" status: 200 len: 945 time: 0.0467606 Nov 09 04:57:21.671041 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d8a86b8b-17b6-4229-abdd-1b17e49314a0 req-bed0bbb5-d35e-4f82-834b-961b47c26b49 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/security-groups?id=34faeb60-1a3f-4e94-b217-129f3f06065a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400851 Nov 09 04:57:22.787627 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0738c36a-af37-4490-8e75-b723c0f1848c req-69e495d3-7492-4c96-9fbf-22bc8dfaa6f9 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:22.789246 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-0738c36a-af37-4490-8e75-b723c0f1848c req-69e495d3-7492-4c96-9fbf-22bc8dfaa6f9 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/ports?device_id=b1c3af91-1490-484c-8de6-c7d8832e77ab HTTP/1.1" status: 200 len: 945 time: 0.0480266 Nov 09 04:57:22.834911 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-0738c36a-af37-4490-8e75-b723c0f1848c req-d249e3ea-4f95-43dc-a586-51ca94658584 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/security-groups?id=34faeb60-1a3f-4e94-b217-129f3f06065a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399394 Nov 09 04:57:23.056468 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48ba53fc-a7b8-4b91-8cc9-705bdd8fac20 req-9d01ef64-7293-486b-bc66-fed8b1e82bf5 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:23.057918 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-48ba53fc-a7b8-4b91-8cc9-705bdd8fac20 req-9d01ef64-7293-486b-bc66-fed8b1e82bf5 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/networks?id=94c21177-56da-413b-867f-dae9860433c2 HTTP/1.1" status: 200 len: 814 time: 0.1038415 Nov 09 04:57:23.073316 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-48ba53fc-a7b8-4b91-8cc9-705bdd8fac20 req-df839ffe-438b-40e6-878a-f6466d1d8936 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/quotas/caaa6bb6cfb8410fa008d69912c73bd6 HTTP/1.1" status: 200 len: 375 time: 0.0094819 Nov 09 04:57:23.119543 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-48ba53fc-a7b8-4b91-8cc9-705bdd8fac20 req-6bba09cf-f8e9-4ba9-83a1-10ad827883ec tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/ports?tenant_id=caaa6bb6cfb8410fa008d69912c73bd6&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0408421 Nov 09 04:57:23.209986 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-48ba53fc-a7b8-4b91-8cc9-705bdd8fac20 req-7fe28c65-627c-4a5b-bdd8-b3b35ca2fe76 service neutron] 10.222.0.24 "GET /v2.0/networks/94c21177-56da-413b-867f-dae9860433c2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0829809 Nov 09 04:57:23.295941 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-48ba53fc-a7b8-4b91-8cc9-705bdd8fac20 req-6ff97469-6535-471e-b89a-393f6cb97696 service neutron] 10.222.0.24 "GET /v2.0/networks/94c21177-56da-413b-867f-dae9860433c2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0795071 Nov 09 04:57:23.557636 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-7b03fff1-71e4-4b6e-a748-189eacb34b68 req-682f0099-0fc3-4e6b-b390-9e519cc22f7d tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/ports?device_id=ca42d071-45d3-4699-b94f-69be9a4bccc8 HTTP/1.1" status: 200 len: 210 time: 0.0261486 Nov 09 04:57:24.652913 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ce516a85-c72b-4364-89dc-95400f1bfc7c req-5ad70099-4f5d-4e1c-8d4a-91a11fd80f86 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/ports?device_id=ca42d071-45d3-4699-b94f-69be9a4bccc8 HTTP/1.1" status: 200 len: 210 time: 0.0295863 Nov 09 04:57:25.698826 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48ba53fc-a7b8-4b91-8cc9-705bdd8fac20 req-db1058c0-4273-42e7-9924-9394320e76aa tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:25.700273 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-48ba53fc-a7b8-4b91-8cc9-705bdd8fac20 req-db1058c0-4273-42e7-9924-9394320e76aa tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.26 "GET /v2.0/networks?id=94c21177-56da-413b-867f-dae9860433c2 HTTP/1.1" status: 200 len: 814 time: 0.0992610 Nov 09 04:57:25.713950 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-48ba53fc-a7b8-4b91-8cc9-705bdd8fac20 req-a6d490ee-d45a-46ec-90c0-9ca8b56489ca tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Request body: {'port': {'device_id': 'ca42d071-45d3-4699-b94f-69be9a4bccc8', 'network_id': '94c21177-56da-413b-867f-dae9860433c2', 'admin_state_up': True, 'tenant_id': 'caaa6bb6cfb8410fa008d69912c73bd6'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:57:25.755238 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-a3c88569-e5a3-447a-a5b7-c58ea2b04ea1 req-a5776d39-a5d3-45d7-997a-fdce766e072b tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/ports?device_id=ca42d071-45d3-4699-b94f-69be9a4bccc8 HTTP/1.1" status: 200 len: 210 time: 0.0280948 Nov 09 04:57:26.246432 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-48ba53fc-a7b8-4b91-8cc9-705bdd8fac20 req-a6d490ee-d45a-46ec-90c0-9ca8b56489ca tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Made reservation on behalf of caaa6bb6cfb8410fa008d69912c73bd6 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:57:26.249822 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-48ba53fc-a7b8-4b91-8cc9-705bdd8fac20 req-a6d490ee-d45a-46ec-90c0-9ca8b56489ca tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:26.372811 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [req-48ba53fc-a7b8-4b91-8cc9-705bdd8fac20 req-a6d490ee-d45a-46ec-90c0-9ca8b56489ca tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Allocated IP 172.20.0.13 (94c21177-56da-413b-867f-dae9860433c2/b173abdc-1bbb-4046-a9d8-4d269a090b4b/fcbb52c1-da17-4616-8925-605cc3038fd3) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:57:26.515753 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-48ba53fc-a7b8-4b91-8cc9-705bdd8fac20 req-a6d490ee-d45a-46ec-90c0-9ca8b56489ca tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:26.606941 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-48ba53fc-a7b8-4b91-8cc9-705bdd8fac20 req-a6d490ee-d45a-46ec-90c0-9ca8b56489ca tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:26.619606 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['de14b9c1-e0ff-4adc-982a-590708805995'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 04:57:26.647162 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-48ba53fc-a7b8-4b91-8cc9-705bdd8fac20 req-a6d490ee-d45a-46ec-90c0-9ca8b56489ca tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Network 94c21177-56da-413b-867f-dae9860433c2 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:57:26.650745 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [req-48ba53fc-a7b8-4b91-8cc9-705bdd8fac20 req-a6d490ee-d45a-46ec-90c0-9ca8b56489ca tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:57:26.656591 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-48ba53fc-a7b8-4b91-8cc9-705bdd8fac20 req-a6d490ee-d45a-46ec-90c0-9ca8b56489ca tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:57:26.685571 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6d490ee-d45a-46ec-90c0-9ca8b56489ca tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Pushing event updated for resources: {'Port': ['ID=fcbb52c1-da17-4616-8925-605cc3038fd3,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:57:26.715111 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48ba53fc-a7b8-4b91-8cc9-705bdd8fac20 req-a6d490ee-d45a-46ec-90c0-9ca8b56489ca tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:26.715749 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-48ba53fc-a7b8-4b91-8cc9-705bdd8fac20 req-a6d490ee-d45a-46ec-90c0-9ca8b56489ca tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:26.834312 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-48ba53fc-a7b8-4b91-8cc9-705bdd8fac20 req-a6d490ee-d45a-46ec-90c0-9ca8b56489ca tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.26 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.1247180 Nov 09 04:57:26.856970 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-48ba53fc-a7b8-4b91-8cc9-705bdd8fac20 req-e8b460ec-1009-4133-9b27-fb48879a8979 service neutron] Request body: {'port': {'device_id': 'ca42d071-45d3-4699-b94f-69be9a4bccc8', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:57:26.916192 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa089177-93bb-4268-a97d-c4daed423cad req-700521d8-2274-4b83-949d-1bfeb559bb37 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:26.917661 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fa089177-93bb-4268-a97d-c4daed423cad req-700521d8-2274-4b83-949d-1bfeb559bb37 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/ports?device_id=ca42d071-45d3-4699-b94f-69be9a4bccc8 HTTP/1.1" status: 200 len: 932 time: 0.0949960 Nov 09 04:57:26.925495 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-48ba53fc-a7b8-4b91-8cc9-705bdd8fac20 req-e8b460ec-1009-4133-9b27-fb48879a8979 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:27.006957 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fa089177-93bb-4268-a97d-c4daed423cad req-1da0934d-601b-4cd6-acf0-854c5623082a tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/security-groups?id=34faeb60-1a3f-4e94-b217-129f3f06065a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0831883 Nov 09 04:57:27.212373 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [req-48ba53fc-a7b8-4b91-8cc9-705bdd8fac20 req-e8b460ec-1009-4133-9b27-fb48879a8979 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id fcbb52c1-da17-4616-8925-605cc3038fd3 {{(pid=102162) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:57:27.219606 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-48ba53fc-a7b8-4b91-8cc9-705bdd8fac20 req-e8b460ec-1009-4133-9b27-fb48879a8979 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:27.231480 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.provisioning_blocks [req-48ba53fc-a7b8-4b91-8cc9-705bdd8fac20 req-e8b460ec-1009-4133-9b27-fb48879a8979 service neutron] Transition to ACTIVE for port object fcbb52c1-da17-4616-8925-605cc3038fd3 will not be triggered until provisioned by entity L2. {{(pid=102162) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 09 04:57:27.306518 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-48ba53fc-a7b8-4b91-8cc9-705bdd8fac20 req-e8b460ec-1009-4133-9b27-fb48879a8979 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:27.356509 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8b460ec-1009-4133-9b27-fb48879a8979 service neutron] Pushing event updated for resources: {'Port': ['ID=fcbb52c1-da17-4616-8925-605cc3038fd3,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:57:27.420993 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-48ba53fc-a7b8-4b91-8cc9-705bdd8fac20 req-e8b460ec-1009-4133-9b27-fb48879a8979 service neutron] Attempting to bind port fcbb52c1-da17-4616-8925-605cc3038fd3 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:57:27.421321 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-48ba53fc-a7b8-4b91-8cc9-705bdd8fac20 req-e8b460ec-1009-4133-9b27-fb48879a8979 service neutron] Attempting to bind port fcbb52c1-da17-4616-8925-605cc3038fd3 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '35f725ee-5e24-4053-aa6a-1de1610a48ad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 300, 'network_id': '94c21177-56da-413b-867f-dae9860433c2'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:57:27.421637 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-48ba53fc-a7b8-4b91-8cc9-705bdd8fac20 req-e8b460ec-1009-4133-9b27-fb48879a8979 service neutron] Attempting to bind port fcbb52c1-da17-4616-8925-605cc3038fd3 on network 94c21177-56da-413b-867f-dae9860433c2 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:57:27.425876 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-48ba53fc-a7b8-4b91-8cc9-705bdd8fac20 req-e8b460ec-1009-4133-9b27-fb48879a8979 service neutron] Port fcbb52c1-da17-4616-8925-605cc3038fd3 on network 94c21177-56da-413b-867f-dae9860433c2 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:57:27.426188 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-48ba53fc-a7b8-4b91-8cc9-705bdd8fac20 req-e8b460ec-1009-4133-9b27-fb48879a8979 service neutron] Attempting to bind port fcbb52c1-da17-4616-8925-605cc3038fd3 on network 94c21177-56da-413b-867f-dae9860433c2 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:57:27.430971 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-48ba53fc-a7b8-4b91-8cc9-705bdd8fac20 req-e8b460ec-1009-4133-9b27-fb48879a8979 service neutron] Checking agent: {'id': '7d36b884-4ad2-4878-9464-bf647030b544', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'started_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 57, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:57:27.431298 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-48ba53fc-a7b8-4b91-8cc9-705bdd8fac20 req-e8b460ec-1009-4133-9b27-fb48879a8979 service neutron] Checking segment: {'id': '35f725ee-5e24-4053-aa6a-1de1610a48ad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 300, 'network_id': '94c21177-56da-413b-867f-dae9860433c2'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:57:27.431674 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-48ba53fc-a7b8-4b91-8cc9-705bdd8fac20 req-e8b460ec-1009-4133-9b27-fb48879a8979 service neutron] Bound using segment: {'id': '35f725ee-5e24-4053-aa6a-1de1610a48ad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 300, 'network_id': '94c21177-56da-413b-867f-dae9860433c2'} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:57:27.432085 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-48ba53fc-a7b8-4b91-8cc9-705bdd8fac20 req-e8b460ec-1009-4133-9b27-fb48879a8979 service neutron] Bound port: fcbb52c1-da17-4616-8925-605cc3038fd3, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '35f725ee-5e24-4053-aa6a-1de1610a48ad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 300, 'network_id': '94c21177-56da-413b-867f-dae9860433c2'}}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:57:27.432424 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-48ba53fc-a7b8-4b91-8cc9-705bdd8fac20 req-e8b460ec-1009-4133-9b27-fb48879a8979 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:27.496282 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-48ba53fc-a7b8-4b91-8cc9-705bdd8fac20 req-e8b460ec-1009-4133-9b27-fb48879a8979 service neutron] For port fcbb52c1-da17-4616-8925-605cc3038fd3, host hv-neutron-8168, cleared binding levels {{(pid=102162) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:57:27.499389 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-48ba53fc-a7b8-4b91-8cc9-705bdd8fac20 req-e8b460ec-1009-4133-9b27-fb48879a8979 service neutron] For port fcbb52c1-da17-4616-8925-605cc3038fd3, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=fcbb52c1-da17-4616-8925-605cc3038fd3,segment=NetworkSegment(35f725ee-5e24-4053-aa6a-1de1610a48ad),segment_id=35f725ee-5e24-4053-aa6a-1de1610a48ad)] {{(pid=102162) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:57:27.558152 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-48ba53fc-a7b8-4b91-8cc9-705bdd8fac20 req-e8b460ec-1009-4133-9b27-fb48879a8979 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:27.595917 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48ba53fc-a7b8-4b91-8cc9-705bdd8fac20 req-e8b460ec-1009-4133-9b27-fb48879a8979 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:27.596530 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-48ba53fc-a7b8-4b91-8cc9-705bdd8fac20 req-e8b460ec-1009-4133-9b27-fb48879a8979 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:27.597908 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-48ba53fc-a7b8-4b91-8cc9-705bdd8fac20 req-e8b460ec-1009-4133-9b27-fb48879a8979 service neutron] 10.222.0.26 "PUT /v2.0/ports/fcbb52c1-da17-4616-8925-605cc3038fd3 HTTP/1.1" status: 200 len: 1094 time: 0.7460825 Nov 09 04:57:27.598353 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ca42d071-45d3-4699-b94f-69be9a4bccc8', 'tag': 'fcbb52c1-da17-4616-8925-605cc3038fd3'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:57:27.600653 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8b54280f-27f4-4ae4-9190-ec8fe0588993" -d '{"events": [{"name": "network-changed", "server_uuid": "ca42d071-45d3-4699-b94f-69be9a4bccc8", "tag": "fcbb52c1-da17-4616-8925-605cc3038fd3"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:57:27.623080 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8b460ec-1009-4133-9b27-fb48879a8979 service neutron] Pushing event updated for resources: {'Port': ['ID=fcbb52c1-da17-4616-8925-605cc3038fd3,revision_number=3']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:57:27.644144 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:57:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0a71be4e-3ea8-4b06-b3cd-4a89d3fada2a x-openstack-request-id: req-0a71be4e-3ea8-4b06-b3cd-4a89d3fada2a {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:57:27.644144 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ca42d071-45d3-4699-b94f-69be9a4bccc8", "tag": "fcbb52c1-da17-4616-8925-605cc3038fd3", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:57:27.644144 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-0a71be4e-3ea8-4b06-b3cd-4a89d3fada2a {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:57:27.644144 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ca42d071-45d3-4699-b94f-69be9a4bccc8', 'tag': 'fcbb52c1-da17-4616-8925-605cc3038fd3', 'status': 'completed', 'code': 200} Nov 09 04:57:27.703024 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b54280f-27f4-4ae4-9190-ec8fe0588993 req-7f179832-3464-4347-9f7c-501146c36d5b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:27.704512 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8b54280f-27f4-4ae4-9190-ec8fe0588993 req-7f179832-3464-4347-9f7c-501146c36d5b service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=caaa6bb6cfb8410fa008d69912c73bd6&device_id=ca42d071-45d3-4699-b94f-69be9a4bccc8 HTTP/1.1" status: 200 len: 1097 time: 0.0411949 Nov 09 04:57:27.802750 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b54280f-27f4-4ae4-9190-ec8fe0588993 req-b6707bf6-dba4-4767-b986-a535de80d0b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:27.804726 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8b54280f-27f4-4ae4-9190-ec8fe0588993 req-b6707bf6-dba4-4767-b986-a535de80d0b7 service neutron] 10.222.0.26 "GET /v2.0/networks?tenant_id=caaa6bb6cfb8410fa008d69912c73bd6&shared=False HTTP/1.1" status: 200 len: 915 time: 0.0916972 Nov 09 04:57:27.899876 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b54280f-27f4-4ae4-9190-ec8fe0588993 req-36b0a770-813c-4a6c-8171-e61cb788b7ed service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:27.901317 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8b54280f-27f4-4ae4-9190-ec8fe0588993 req-36b0a770-813c-4a6c-8171-e61cb788b7ed service neutron] 10.222.0.26 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0904655 Nov 09 04:57:27.981965 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48ba53fc-a7b8-4b91-8cc9-705bdd8fac20 req-0b743e63-9cc5-4d3a-9e05-6075488b64f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:27.983539 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-48ba53fc-a7b8-4b91-8cc9-705bdd8fac20 req-0b743e63-9cc5-4d3a-9e05-6075488b64f4 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=caaa6bb6cfb8410fa008d69912c73bd6&device_id=ca42d071-45d3-4699-b94f-69be9a4bccc8 HTTP/1.1" status: 200 len: 1097 time: 0.0412004 Nov 09 04:57:28.024503 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-48ba53fc-a7b8-4b91-8cc9-705bdd8fac20 req-a3e4f065-9f51-412f-af35-8e5d9ccb0212 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=fcbb52c1-da17-4616-8925-605cc3038fd3 HTTP/1.1" status: 200 len: 217 time: 0.0335875 Nov 09 04:57:28.073709 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48ba53fc-a7b8-4b91-8cc9-705bdd8fac20 req-b47ff2e5-3b7b-479b-bb44-ae4748201236 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:28.075109 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-48ba53fc-a7b8-4b91-8cc9-705bdd8fac20 req-b47ff2e5-3b7b-479b-bb44-ae4748201236 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=b173abdc-1bbb-4046-a9d8-4d269a090b4b HTTP/1.1" status: 200 len: 854 time: 0.0445259 Nov 09 04:57:28.124867 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-48ba53fc-a7b8-4b91-8cc9-705bdd8fac20 req-7c8142c3-ba69-4b82-ac75-aafe45e7b8ff service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=94c21177-56da-413b-867f-dae9860433c2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0407605 Nov 09 04:57:28.168575 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a967d6ba-3443-4395-b914-f55bdb6cb24b req-abf990a1-ec26-4553-9e54-0773e4c94f75 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:28.170013 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a967d6ba-3443-4395-b914-f55bdb6cb24b req-abf990a1-ec26-4553-9e54-0773e4c94f75 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/ports?device_id=ca42d071-45d3-4699-b94f-69be9a4bccc8 HTTP/1.1" status: 200 len: 944 time: 0.0940394 Nov 09 04:57:28.267043 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a967d6ba-3443-4395-b914-f55bdb6cb24b req-8a9db273-36eb-4ed2-9e27-fb7ea4e2efc6 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/security-groups?id=34faeb60-1a3f-4e94-b217-129f3f06065a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0709054 Nov 09 04:57:28.271949 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-48ba53fc-a7b8-4b91-8cc9-705bdd8fac20 req-a110bf32-a1e8-4b93-bd8d-cc9c130694d6 service neutron] 10.222.0.26 "GET /v2.0/networks/94c21177-56da-413b-867f-dae9860433c2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1385911 Nov 09 04:57:28.363489 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-48ba53fc-a7b8-4b91-8cc9-705bdd8fac20 req-4c98d5ef-efb3-4cb5-85de-8f95be23c11b service neutron] 10.222.0.26 "GET /v2.0/networks/94c21177-56da-413b-867f-dae9860433c2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0848601 Nov 09 04:57:29.389763 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6063587d-0dc9-4f33-91ef-bba9b8497ac0 req-d38b611c-9a20-4a23-a0cd-78fd839ba6ad tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:29.391473 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-6063587d-0dc9-4f33-91ef-bba9b8497ac0 req-d38b611c-9a20-4a23-a0cd-78fd839ba6ad tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/ports?device_id=ca42d071-45d3-4699-b94f-69be9a4bccc8 HTTP/1.1" status: 200 len: 944 time: 0.0548701 Nov 09 04:57:29.438064 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-6063587d-0dc9-4f33-91ef-bba9b8497ac0 req-ebdafdca-f4ea-4300-967f-d86e51b530bb tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/security-groups?id=34faeb60-1a3f-4e94-b217-129f3f06065a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407386 Nov 09 04:57:30.548465 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6642d620-b14e-4b58-a7a8-80dd06087b6e req-3c7e507b-022e-46e5-809a-050d07cd32a2 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:30.549903 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6642d620-b14e-4b58-a7a8-80dd06087b6e req-3c7e507b-022e-46e5-809a-050d07cd32a2 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/ports?device_id=ca42d071-45d3-4699-b94f-69be9a4bccc8 HTTP/1.1" status: 200 len: 944 time: 0.0471089 Nov 09 04:57:30.604150 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6642d620-b14e-4b58-a7a8-80dd06087b6e req-ea97d854-7016-4cbe-98dc-e793e57061e0 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/security-groups?id=34faeb60-1a3f-4e94-b217-129f3f06065a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0477262 Nov 09 04:57:30.724953 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device fcbb52c1-da17-4616-8925-605cc3038fd3 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=102163) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 09 04:57:30.815520 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port fcbb52c1-da17-4616-8925-605cc3038fd3, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=fcbb52c1-da17-4616-8925-605cc3038fd3,segment=NetworkSegment(35f725ee-5e24-4053-aa6a-1de1610a48ad),segment_id=35f725ee-5e24-4053-aa6a-1de1610a48ad)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:57:30.826477 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Returning: {'device': 'fcbb52c1-da17-4616-8925-605cc3038fd3', 'network_id': '94c21177-56da-413b-867f-dae9860433c2', 'port_id': 'fcbb52c1-da17-4616-8925-605cc3038fd3', 'mac_address': 'fa:16:3e:97:fc:19', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 300, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b173abdc-1bbb-4046-a9d8-4d269a090b4b', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102163) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 09 04:57:30.866337 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:30.878321 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id fcbb52c1-da17-4616-8925-605cc3038fd3 {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:57:30.896812 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port fcbb52c1-da17-4616-8925-605cc3038fd3, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=fcbb52c1-da17-4616-8925-605cc3038fd3,segment=NetworkSegment(35f725ee-5e24-4053-aa6a-1de1610a48ad),segment_id=35f725ee-5e24-4053-aa6a-1de1610a48ad)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:57:30.952358 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:31.000317 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=fcbb52c1-da17-4616-8925-605cc3038fd3,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:57:31.190702 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['fcbb52c1-da17-4616-8925-605cc3038fd3'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 04:57:31.716820 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-700d3761-873e-4edf-b13e-d3e8b60a6a69 req-8d6be8bd-a2a4-4100-b500-1811ecbb7a30 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:31.718276 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-700d3761-873e-4edf-b13e-d3e8b60a6a69 req-8d6be8bd-a2a4-4100-b500-1811ecbb7a30 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/ports?device_id=ca42d071-45d3-4699-b94f-69be9a4bccc8 HTTP/1.1" status: 200 len: 945 time: 0.0490420 Nov 09 04:57:31.764392 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-700d3761-873e-4edf-b13e-d3e8b60a6a69 req-f6e1a94d-8086-4c23-b911-2f95b8113b40 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/security-groups?id=34faeb60-1a3f-4e94-b217-129f3f06065a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402286 Nov 09 04:57:32.764813 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device fcbb52c1-da17-4616-8925-605cc3038fd3 up at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:57:32.868959 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning for port fcbb52c1-da17-4616-8925-605cc3038fd3 completed by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 09 04:57:32.872992 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning complete for port fcbb52c1-da17-4616-8925-605cc3038fd3 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:57:32.873362 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:32.878638 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a67291d-72f2-4391-b491-086f41be7d69 req-a065f4e2-58ca-476b-bb13-7d017a0be2dc tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:32.883341 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4a67291d-72f2-4391-b491-086f41be7d69 req-a065f4e2-58ca-476b-bb13-7d017a0be2dc tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/ports?device_id=ca42d071-45d3-4699-b94f-69be9a4bccc8 HTTP/1.1" status: 200 len: 945 time: 0.0482204 Nov 09 04:57:32.927377 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4a67291d-72f2-4391-b491-086f41be7d69 req-e87e1905-1851-4a0f-bf01-f73ea0b9995a tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/security-groups?id=34faeb60-1a3f-4e94-b217-129f3f06065a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407593 Nov 09 04:57:32.952308 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:32.973952 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ca42d071-45d3-4699-b94f-69be9a4bccc8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fcbb52c1-da17-4616-8925-605cc3038fd3'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:57:32.976774 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0a20f414-44e2-4570-9292-337be72429b8" -d '{"events": [{"server_uuid": "ca42d071-45d3-4699-b94f-69be9a4bccc8", "name": "network-vif-plugged", "status": "completed", "tag": "fcbb52c1-da17-4616-8925-605cc3038fd3"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:57:32.988548 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port fcbb52c1-da17-4616-8925-605cc3038fd3, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=fcbb52c1-da17-4616-8925-605cc3038fd3,segment=NetworkSegment(35f725ee-5e24-4053-aa6a-1de1610a48ad),segment_id=35f725ee-5e24-4053-aa6a-1de1610a48ad)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:57:33.012732 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:57:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c2fa9ca6-bc23-4b2f-9b53-73cd58db4745 x-openstack-request-id: req-c2fa9ca6-bc23-4b2f-9b53-73cd58db4745 {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:57:33.013022 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ca42d071-45d3-4699-b94f-69be9a4bccc8", "name": "network-vif-plugged", "status": "completed", "tag": "fcbb52c1-da17-4616-8925-605cc3038fd3", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:57:33.013295 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-c2fa9ca6-bc23-4b2f-9b53-73cd58db4745 {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:57:33.013683 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ca42d071-45d3-4699-b94f-69be9a4bccc8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fcbb52c1-da17-4616-8925-605cc3038fd3', 'code': 200} Nov 09 04:57:33.051812 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:33.099523 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=fcbb52c1-da17-4616-8925-605cc3038fd3,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:57:33.303170 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-479e12f3-ea09-4937-ae0e-1c9778625a43 req-482144fc-0697-4ab9-af7a-b4df5221afd1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:33.304570 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-479e12f3-ea09-4937-ae0e-1c9778625a43 req-482144fc-0697-4ab9-af7a-b4df5221afd1 service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=ca42d071-45d3-4699-b94f-69be9a4bccc8 HTTP/1.1" status: 200 len: 1099 time: 0.0397298 Nov 09 04:57:33.347528 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-479e12f3-ea09-4937-ae0e-1c9778625a43 req-7e766186-8b08-47fe-8fc9-dbdc4b54b496 service neutron] 10.222.0.26 "GET /v2.0/security-groups?id=34faeb60-1a3f-4e94-b217-129f3f06065a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0362036 Nov 09 04:57:34.047288 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b22b87a0-abdc-4ee9-a3f4-49cea44490df req-c4e71822-3f69-4bbb-8449-52d5fe68a7fc tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:34.048800 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b22b87a0-abdc-4ee9-a3f4-49cea44490df req-c4e71822-3f69-4bbb-8449-52d5fe68a7fc tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/ports?device_id=ca42d071-45d3-4699-b94f-69be9a4bccc8 HTTP/1.1" status: 200 len: 946 time: 0.0524766 Nov 09 04:57:34.094999 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b22b87a0-abdc-4ee9-a3f4-49cea44490df req-0c0609f3-3799-42cf-a744-166db0f57ad0 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/security-groups?id=34faeb60-1a3f-4e94-b217-129f3f06065a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402727 Nov 09 04:57:35.207638 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8450014-376d-4d3b-af62-1c6cf6778daf req-cec24838-7dd1-4301-a9a9-918ef0e74faa tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:35.209005 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d8450014-376d-4d3b-af62-1c6cf6778daf req-cec24838-7dd1-4301-a9a9-918ef0e74faa tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/ports?device_id=ca42d071-45d3-4699-b94f-69be9a4bccc8 HTTP/1.1" status: 200 len: 946 time: 0.0477178 Nov 09 04:57:35.258320 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d8450014-376d-4d3b-af62-1c6cf6778daf req-61f670e3-f06a-4c2d-987d-8db5eb10da8e tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/security-groups?id=34faeb60-1a3f-4e94-b217-129f3f06065a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434124 Nov 09 04:57:35.676809 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48e1a894-ecef-436c-a74f-aed7a81a843f req-52bced30-7ac9-467e-9bf1-66afe717d5e3 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:35.678272 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-48e1a894-ecef-436c-a74f-aed7a81a843f req-52bced30-7ac9-467e-9bf1-66afe717d5e3 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/ports?device_id=ca42d071-45d3-4699-b94f-69be9a4bccc8 HTTP/1.1" status: 200 len: 946 time: 0.0476687 Nov 09 04:57:35.724931 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-48e1a894-ecef-436c-a74f-aed7a81a843f req-a1e87f0f-6402-4f76-b631-fd14fd46690f tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/security-groups?id=34faeb60-1a3f-4e94-b217-129f3f06065a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399570 Nov 09 04:57:36.843368 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85f211fd-eab9-4151-838e-b327a214e9d9 req-3ef21fea-2e1f-43b7-976f-0da28b33e7c2 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:36.844843 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-85f211fd-eab9-4151-838e-b327a214e9d9 req-3ef21fea-2e1f-43b7-976f-0da28b33e7c2 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/ports?device_id=ca42d071-45d3-4699-b94f-69be9a4bccc8 HTTP/1.1" status: 200 len: 946 time: 0.0505052 Nov 09 04:57:36.891747 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-85f211fd-eab9-4151-838e-b327a214e9d9 req-fca0db57-5793-4a8d-8eb5-2238c2568c68 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/security-groups?id=34faeb60-1a3f-4e94-b217-129f3f06065a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408597 Nov 09 04:57:37.080328 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eda9b3f6-287d-4356-a20a-a877a2d61553 req-00b97f6a-8b08-40e2-b71f-c4abd596a32e tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:37.081760 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-eda9b3f6-287d-4356-a20a-a877a2d61553 req-00b97f6a-8b08-40e2-b71f-c4abd596a32e tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.26 "GET /v2.0/ports?device_id=ca42d071-45d3-4699-b94f-69be9a4bccc8 HTTP/1.1" status: 200 len: 946 time: 0.0516016 Nov 09 04:57:37.173766 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-eda9b3f6-287d-4356-a20a-a877a2d61553 req-5710e593-51cc-4062-a636-14522d856111 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Deleting port fcbb52c1-da17-4616-8925-605cc3038fd3 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:57:37.174100 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-eda9b3f6-287d-4356-a20a-a877a2d61553 req-5710e593-51cc-4062-a636-14522d856111 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:37.263593 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-eda9b3f6-287d-4356-a20a-a877a2d61553 req-5710e593-51cc-4062-a636-14522d856111 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] For port fcbb52c1-da17-4616-8925-605cc3038fd3, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=fcbb52c1-da17-4616-8925-605cc3038fd3,segment=NetworkSegment(35f725ee-5e24-4053-aa6a-1de1610a48ad),segment_id=35f725ee-5e24-4053-aa6a-1de1610a48ad)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:57:37.263950 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-eda9b3f6-287d-4356-a20a-a877a2d61553 req-5710e593-51cc-4062-a636-14522d856111 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:37.276184 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-eda9b3f6-287d-4356-a20a-a877a2d61553 req-5710e593-51cc-4062-a636-14522d856111 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Calling delete_port for fcbb52c1-da17-4616-8925-605cc3038fd3 owned by compute:nova {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:57:37.463213 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-eda9b3f6-287d-4356-a20a-a877a2d61553 req-5710e593-51cc-4062-a636-14522d856111 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:37.474740 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['de14b9c1-e0ff-4adc-982a-590708805995', 'fcbb52c1-da17-4616-8925-605cc3038fd3'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 04:57:37.495016 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5710e593-51cc-4062-a636-14522d856111 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Pushing event deleted for resources: {'Port': ['ID=fcbb52c1-da17-4616-8925-605cc3038fd3,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:57:37.535119 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-eda9b3f6-287d-4356-a20a-a877a2d61553 req-5710e593-51cc-4062-a636-14522d856111 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] No DVR routers for this DVR port fcbb52c1-da17-4616-8925-605cc3038fd3 on host hv-neutron-8168 {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:57:37.537655 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-eda9b3f6-287d-4356-a20a-a877a2d61553 req-5710e593-51cc-4062-a636-14522d856111 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:37.541595 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-eda9b3f6-287d-4356-a20a-a877a2d61553 req-5710e593-51cc-4062-a636-14522d856111 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.26 "DELETE /v2.0/ports/fcbb52c1-da17-4616-8925-605cc3038fd3 HTTP/1.1" status: 204 len: 173 time: 0.4469483 Nov 09 04:57:37.542035 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ca42d071-45d3-4699-b94f-69be9a4bccc8', 'name': 'network-vif-deleted', 'tag': 'fcbb52c1-da17-4616-8925-605cc3038fd3'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:57:37.544340 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-73da4798-a677-4bb6-88b6-df26238f407a" -d '{"events": [{"server_uuid": "ca42d071-45d3-4699-b94f-69be9a4bccc8", "name": "network-vif-deleted", "tag": "fcbb52c1-da17-4616-8925-605cc3038fd3"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:57:37.581323 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:57:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-dc92d77e-cbc9-4d04-bb9d-efe8cbfd9397 x-openstack-request-id: req-dc92d77e-cbc9-4d04-bb9d-efe8cbfd9397 {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:57:37.581643 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ca42d071-45d3-4699-b94f-69be9a4bccc8", "name": "network-vif-deleted", "tag": "fcbb52c1-da17-4616-8925-605cc3038fd3", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:57:37.581898 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-dc92d77e-cbc9-4d04-bb9d-efe8cbfd9397 {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:57:37.582294 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ca42d071-45d3-4699-b94f-69be9a4bccc8', 'name': 'network-vif-deleted', 'tag': 'fcbb52c1-da17-4616-8925-605cc3038fd3', 'status': 'completed', 'code': 200} Nov 09 04:57:37.995138 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-dcb611d1-e32a-4e50-84d7-c2742fc793e7 req-ff7fb558-c5a7-4e39-807e-534a76814668 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/ports?device_id=ca42d071-45d3-4699-b94f-69be9a4bccc8 HTTP/1.1" status: 200 len: 210 time: 0.0266926 Nov 09 04:57:39.142258 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3815e22b-1725-42c5-a3d7-4f31fe208ea8 req-02335df4-c5df-428d-9ba6-f887d3d47854 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:39.143741 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3815e22b-1725-42c5-a3d7-4f31fe208ea8 req-02335df4-c5df-428d-9ba6-f887d3d47854 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/ports?device_id=b1c3af91-1490-484c-8de6-c7d8832e77ab HTTP/1.1" status: 200 len: 945 time: 0.0481250 Nov 09 04:57:39.194083 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3815e22b-1725-42c5-a3d7-4f31fe208ea8 req-1750cedb-3698-4e33-a410-5b8449c4cac3 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/security-groups?id=34faeb60-1a3f-4e94-b217-129f3f06065a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440722 Nov 09 04:57:39.321894 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-656996ca-591c-41e8-b39e-aaab9cde2cf4 req-16c36bd4-0aa8-454a-a4f4-e0a0dde0a666 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:39.323277 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-656996ca-591c-41e8-b39e-aaab9cde2cf4 req-16c36bd4-0aa8-454a-a4f4-e0a0dde0a666 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/ports?device_id=b1c3af91-1490-484c-8de6-c7d8832e77ab HTTP/1.1" status: 200 len: 945 time: 0.0485475 Nov 09 04:57:39.368695 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-656996ca-591c-41e8-b39e-aaab9cde2cf4 req-234dd666-2cc5-4f9d-97d3-88c2a48923c7 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/security-groups?id=34faeb60-1a3f-4e94-b217-129f3f06065a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396614 Nov 09 04:57:39.480522 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c5069b0-3dda-460a-a97c-17134353e540 req-4d4ed349-6b16-4f13-8057-7147124502fb tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:39.481956 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-0c5069b0-3dda-460a-a97c-17134353e540 req-4d4ed349-6b16-4f13-8057-7147124502fb tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/ports?device_id=b1c3af91-1490-484c-8de6-c7d8832e77ab HTTP/1.1" status: 200 len: 945 time: 0.0471957 Nov 09 04:57:39.527365 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-0c5069b0-3dda-460a-a97c-17134353e540 req-f11c4226-ce40-49da-a5d7-e97e69aa8c52 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/security-groups?id=34faeb60-1a3f-4e94-b217-129f3f06065a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396140 Nov 09 04:57:39.693165 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd380525-0c2c-43c2-93c1-5581cad2faa3 req-73754632-42ab-4bb4-9772-5ca53eea93b4 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:39.711875 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-dd380525-0c2c-43c2-93c1-5581cad2faa3 req-73754632-42ab-4bb4-9772-5ca53eea93b4 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/ports?device_id=b1c3af91-1490-484c-8de6-c7d8832e77ab HTTP/1.1" status: 200 len: 945 time: 0.0518966 Nov 09 04:57:39.741111 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-dd380525-0c2c-43c2-93c1-5581cad2faa3 req-19326321-9468-4de5-8520-e7c85958460c tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/security-groups?id=34faeb60-1a3f-4e94-b217-129f3f06065a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397499 Nov 09 04:57:39.852465 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b166dfb-1726-4b0d-a7b9-a1e9352c7ab7 req-bddc8985-7121-47eb-a8c5-35766250cf99 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:39.853835 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3b166dfb-1726-4b0d-a7b9-a1e9352c7ab7 req-bddc8985-7121-47eb-a8c5-35766250cf99 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/ports?device_id=b1c3af91-1490-484c-8de6-c7d8832e77ab HTTP/1.1" status: 200 len: 945 time: 0.0474365 Nov 09 04:57:39.900493 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3b166dfb-1726-4b0d-a7b9-a1e9352c7ab7 req-884b5a2b-44d0-4a5c-a027-9713ee4c734f tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/security-groups?id=34faeb60-1a3f-4e94-b217-129f3f06065a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407293 Nov 09 04:57:40.024796 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9cad673-1bc3-40ac-a0f5-e2f30120478d req-fd824897-d7bc-4254-8ef3-af23904be8ab tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:40.026239 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e9cad673-1bc3-40ac-a0f5-e2f30120478d req-fd824897-d7bc-4254-8ef3-af23904be8ab tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/ports?device_id=b1c3af91-1490-484c-8de6-c7d8832e77ab HTTP/1.1" status: 200 len: 945 time: 0.0514803 Nov 09 04:57:40.073800 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e9cad673-1bc3-40ac-a0f5-e2f30120478d req-451966f6-9da1-474d-8151-0888581abb34 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/security-groups?id=34faeb60-1a3f-4e94-b217-129f3f06065a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415621 Nov 09 04:57:40.576130 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6ee0201-e7a1-4b7a-a6ea-c387974acb4d req-e9610b53-a669-42bc-9cfd-52060b991e72 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:40.577624 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b6ee0201-e7a1-4b7a-a6ea-c387974acb4d req-e9610b53-a669-42bc-9cfd-52060b991e72 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/ports?device_id=b1c3af91-1490-484c-8de6-c7d8832e77ab HTTP/1.1" status: 200 len: 945 time: 0.0488288 Nov 09 04:57:40.624437 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b6ee0201-e7a1-4b7a-a6ea-c387974acb4d req-2b6b62f9-9a2e-4353-a77b-8da7cebaecfc tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/security-groups?id=34faeb60-1a3f-4e94-b217-129f3f06065a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408537 Nov 09 04:57:40.806112 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device fcbb52c1-da17-4616-8925-605cc3038fd3 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:57:40.826036 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] No Port match for: fcbb52c1-da17-4616-8925-605cc3038fd3 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:57:40.826399 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device fcbb52c1-da17-4616-8925-605cc3038fd3 not bound to the agent host hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:57:41.325363 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c3fe8b68-3baa-413f-87a1-a59cd5bf7cfa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:41.751302 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a44ba03-e206-4f14-841c-408f95ff5b7e req-11878a81-5b5e-4548-9918-579e1bd1009c tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:41.752765 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-8a44ba03-e206-4f14-841c-408f95ff5b7e req-11878a81-5b5e-4548-9918-579e1bd1009c tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/ports?device_id=b1c3af91-1490-484c-8de6-c7d8832e77ab HTTP/1.1" status: 200 len: 945 time: 0.0532470 Nov 09 04:57:41.805045 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-8a44ba03-e206-4f14-841c-408f95ff5b7e req-2b6bdafe-fb50-454e-92a8-e7e9570247a3 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/security-groups?id=34faeb60-1a3f-4e94-b217-129f3f06065a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0463798 Nov 09 04:57:41.946334 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23624668-d275-4758-8a57-451e4be9a0fb req-27292f9b-38b0-43a0-9385-3bafd419b460 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:41.947764 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-23624668-d275-4758-8a57-451e4be9a0fb req-27292f9b-38b0-43a0-9385-3bafd419b460 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.26 "GET /v2.0/ports?device_id=b1c3af91-1490-484c-8de6-c7d8832e77ab HTTP/1.1" status: 200 len: 945 time: 0.0537438 Nov 09 04:57:42.047162 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-23624668-d275-4758-8a57-451e4be9a0fb req-3dd76634-b625-4ed6-9b2f-63ba34783dd6 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Deleting port de14b9c1-e0ff-4adc-982a-590708805995 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:57:42.047496 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-23624668-d275-4758-8a57-451e4be9a0fb req-3dd76634-b625-4ed6-9b2f-63ba34783dd6 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:42.140340 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-23624668-d275-4758-8a57-451e4be9a0fb req-3dd76634-b625-4ed6-9b2f-63ba34783dd6 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] For port de14b9c1-e0ff-4adc-982a-590708805995, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=de14b9c1-e0ff-4adc-982a-590708805995,segment=NetworkSegment(35f725ee-5e24-4053-aa6a-1de1610a48ad),segment_id=35f725ee-5e24-4053-aa6a-1de1610a48ad)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:57:42.140719 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-23624668-d275-4758-8a57-451e4be9a0fb req-3dd76634-b625-4ed6-9b2f-63ba34783dd6 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:42.153632 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-23624668-d275-4758-8a57-451e4be9a0fb req-3dd76634-b625-4ed6-9b2f-63ba34783dd6 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Calling delete_port for de14b9c1-e0ff-4adc-982a-590708805995 owned by compute:nova {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:57:42.354839 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-23624668-d275-4758-8a57-451e4be9a0fb req-3dd76634-b625-4ed6-9b2f-63ba34783dd6 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:42.367228 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['de14b9c1-e0ff-4adc-982a-590708805995'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 04:57:42.387640 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3dd76634-b625-4ed6-9b2f-63ba34783dd6 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Pushing event deleted for resources: {'Port': ['ID=de14b9c1-e0ff-4adc-982a-590708805995,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:57:42.392289 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:42.432167 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-23624668-d275-4758-8a57-451e4be9a0fb req-3dd76634-b625-4ed6-9b2f-63ba34783dd6 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] No DVR routers for this DVR port de14b9c1-e0ff-4adc-982a-590708805995 on host hv-neutron-8168 {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:57:42.434729 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-23624668-d275-4758-8a57-451e4be9a0fb req-3dd76634-b625-4ed6-9b2f-63ba34783dd6 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:42.438218 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-23624668-d275-4758-8a57-451e4be9a0fb req-3dd76634-b625-4ed6-9b2f-63ba34783dd6 tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.26 "DELETE /v2.0/ports/de14b9c1-e0ff-4adc-982a-590708805995 HTTP/1.1" status: 204 len: 173 time: 0.4833217 Nov 09 04:57:42.438675 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b1c3af91-1490-484c-8de6-c7d8832e77ab', 'name': 'network-vif-deleted', 'tag': 'de14b9c1-e0ff-4adc-982a-590708805995'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:57:42.440986 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ebca3c31-ec26-44eb-9140-fdf42d9a2a22" -d '{"events": [{"server_uuid": "b1c3af91-1490-484c-8de6-c7d8832e77ab", "name": "network-vif-deleted", "tag": "de14b9c1-e0ff-4adc-982a-590708805995"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:57:42.477258 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:57:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fac8dcba-b77a-489c-aa84-05aca0b92d22 x-openstack-request-id: req-fac8dcba-b77a-489c-aa84-05aca0b92d22 {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:57:42.477555 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b1c3af91-1490-484c-8de6-c7d8832e77ab", "name": "network-vif-deleted", "tag": "de14b9c1-e0ff-4adc-982a-590708805995", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:57:42.477813 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-fac8dcba-b77a-489c-aa84-05aca0b92d22 {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:57:42.478269 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b1c3af91-1490-484c-8de6-c7d8832e77ab', 'name': 'network-vif-deleted', 'tag': 'de14b9c1-e0ff-4adc-982a-590708805995', 'status': 'completed', 'code': 200} Nov 09 04:57:42.912534 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-21ed7007-898a-46c5-ba57-8834f9642845 req-da65c4b1-89f1-44f7-b319-fb127ce0018a tempest-ServersNegativeTestJSON-2024394988 tempest-ServersNegativeTestJSON-2024394988-project] 10.222.0.24 "GET /v2.0/ports?device_id=b1c3af91-1490-484c-8de6-c7d8832e77ab HTTP/1.1" status: 200 len: 210 time: 0.0293467 Nov 09 04:57:43.748331 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ff42c011-0e28-4eb5-9495-15df74633311 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:43.971156 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 35550) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:57:44.026265 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-75aa26d6-628c-4fe6-9423-d07e728de289 admin admin] Deleting subnet b173abdc-1bbb-4046-a9d8-4d269a090b4b {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:57:44.029544 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-75aa26d6-628c-4fe6-9423-d07e728de289 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:44.072835 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-75aa26d6-628c-4fe6-9423-d07e728de289 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:44.111114 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-75aa26d6-628c-4fe6-9423-d07e728de289 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:44.226279 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-75aa26d6-628c-4fe6-9423-d07e728de289 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:44.250949 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75aa26d6-628c-4fe6-9423-d07e728de289 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=b173abdc-1bbb-4046-a9d8-4d269a090b4b,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:57:44.254446 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-75aa26d6-628c-4fe6-9423-d07e728de289 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:44.258229 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-75aa26d6-628c-4fe6-9423-d07e728de289 admin admin] 10.222.0.24 "DELETE /v2.0/subnets/b173abdc-1bbb-4046-a9d8-4d269a090b4b HTTP/1.1" status: 204 len: 168 time: 0.2858162 Nov 09 04:57:44.260692 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 35552) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:57:44.335338 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4fe525fd-386c-4d33-b305-7bc41d5b1be1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:44.412159 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4fe525fd-386c-4d33-b305-7bc41d5b1be1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:44.431930 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-4fe525fd-386c-4d33-b305-7bc41d5b1be1 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['94c21177-56da-413b-867f-dae9860433c2']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:57:44.440874 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-4fe525fd-386c-4d33-b305-7bc41d5b1be1 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '35f725ee-5e24-4053-aa6a-1de1610a48ad') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:57:44.441166 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-4fe525fd-386c-4d33-b305-7bc41d5b1be1 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '35f725ee-5e24-4053-aa6a-1de1610a48ad') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:57:44.450966 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4fe525fd-386c-4d33-b305-7bc41d5b1be1 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:44.464666 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4fe525fd-386c-4d33-b305-7bc41d5b1be1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:44.470892 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4fe525fd-386c-4d33-b305-7bc41d5b1be1 admin admin] Releasing vlan 300 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:57:44.473824 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4fe525fd-386c-4d33-b305-7bc41d5b1be1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:44.473824 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:57:44.473824 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:57:44.473824 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:57:44.473824 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:57:44.473824 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:57:44.473824 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:57:44.473824 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:57:44.473824 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:57:44.473824 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:57:44.473824 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:57:44.473824 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:57:44.473824 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:57:44.473824 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:57:44.473824 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:57:44.473824 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:57:44.473824 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:57:44.473824 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:57:44.473824 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:57:44.473824 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:57:44.473824 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:57:44.473824 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:57:44.473824 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:57:44.473824 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:57:44.473824 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:57:44.473824 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:57:44.473824 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:57:44.473824 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:57:44.473824 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:57:44.473824 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:57:44.473824 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:57:44.473824 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:57:44.473824 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:57:44.617831 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4fe525fd-386c-4d33-b305-7bc41d5b1be1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:44.623378 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4fe525fd-386c-4d33-b305-7bc41d5b1be1 admin admin] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:44.634813 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-4fe525fd-386c-4d33-b305-7bc41d5b1be1 admin admin] 10.222.0.24 "DELETE /v2.0/networks/94c21177-56da-413b-867f-dae9860433c2 HTTP/1.1" status: 204 len: 168 time: 0.3673155 Nov 09 04:57:44.641809 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4fe525fd-386c-4d33-b305-7bc41d5b1be1 admin admin] Pushing event deleted for resources: {'Network': ['ID=94c21177-56da-413b-867f-dae9860433c2,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:57:45.100562 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 35556) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:57:45.140898 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-6f300d54-64a6-43e3-9f7f-df23c92344a4 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=caaa6bb6cfb8410fa008d69912c73bd6&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0390229 Nov 09 04:57:45.143341 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 35558) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:57:45.189353 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5a5151c5-1c17-4014-be61-5137b4fff456 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:45.203307 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:45.210916 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5a5151c5-1c17-4014-be61-5137b4fff456 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:45.317373 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5a5151c5-1c17-4014-be61-5137b4fff456 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:45.319963 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5a5151c5-1c17-4014-be61-5137b4fff456 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:45.327819 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-5a5151c5-1c17-4014-be61-5137b4fff456 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/34faeb60-1a3f-4e94-b217-129f3f06065a HTTP/1.1" status: 204 len: 168 time: 0.1771219 Nov 09 04:57:45.329015 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a5151c5-1c17-4014-be61-5137b4fff456 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=34faeb60-1a3f-4e94-b217-129f3f06065a,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:57:46.377882 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 35580) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:57:46.471189 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-f0009f8f-ab9e-44d2-b73f-7fdde9b10bb5 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1112883614'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:57:46.576764 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:46.614473 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f0009f8f-ab9e-44d2-b73f-7fdde9b10bb5 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Made reservation on behalf of e55ec79f5db54cacbb98ecafe15a9128 for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:57:46.618557 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f0009f8f-ab9e-44d2-b73f-7fdde9b10bb5 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:46.629438 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f0009f8f-ab9e-44d2-b73f-7fdde9b10bb5 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:46.704308 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f0009f8f-ab9e-44d2-b73f-7fdde9b10bb5 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:46.788906 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f0009f8f-ab9e-44d2-b73f-7fdde9b10bb5 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:46.818052 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f0009f8f-ab9e-44d2-b73f-7fdde9b10bb5 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 312} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:57:46.820731 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device de14b9c1-e0ff-4adc-982a-590708805995 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:57:46.828117 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0009f8f-ab9e-44d2-b73f-7fdde9b10bb5 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Pushing event updated for resources: {'SecurityGroup': ['ID=7cccfc23-47fc-4891-a74a-1822922233a9,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:57:46.832793 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f0009f8f-ab9e-44d2-b73f-7fdde9b10bb5 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:46.833139 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-f0009f8f-ab9e-44d2-b73f-7fdde9b10bb5 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Added segment 86a78ca8-eed0-4e64-b526-703b84bd00f9 of type vlan for network 23a1cc12-0a26-4ec6-87a6-8bfb5940c9da Nov 09 04:57:46.840758 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] No Port match for: de14b9c1-e0ff-4adc-982a-590708805995 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:57:46.841017 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device de14b9c1-e0ff-4adc-982a-590708805995 not bound to the agent host hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:57:46.873746 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f0009f8f-ab9e-44d2-b73f-7fdde9b10bb5 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:46.951663 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f0009f8f-ab9e-44d2-b73f-7fdde9b10bb5 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:46.962744 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f0009f8f-ab9e-44d2-b73f-7fdde9b10bb5 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:46.962744 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f0009f8f-ab9e-44d2-b73f-7fdde9b10bb5 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:46.975190 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:47.021127 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0009f8f-ab9e-44d2-b73f-7fdde9b10bb5 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Pushing event updated for resources: {'Network': ['ID=23a1cc12-0a26-4ec6-87a6-8bfb5940c9da,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:57:47.031136 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 23a1cc12-0a26-4ec6-87a6-8bfb5940c9da details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:57:47.057500 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-f0009f8f-ab9e-44d2-b73f-7fdde9b10bb5 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 0.6784809 Nov 09 04:57:50.300492 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 35584) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:57:50.306109 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-ee985dfa-8014-4733-a7bc-8d79bffd168d tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Request body: {'subnet': {'network_id': '23a1cc12-0a26-4ec6-87a6-8bfb5940c9da', 'cidr': '2001:db8:0:ffff::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:ffff::1'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:57:50.491483 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ee985dfa-8014-4733-a7bc-8d79bffd168d tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Made reservation on behalf of e55ec79f5db54cacbb98ecafe15a9128 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:57:50.495072 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ee985dfa-8014-4733-a7bc-8d79bffd168d tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:50.765873 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ee985dfa-8014-4733-a7bc-8d79bffd168d tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:50.824713 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee985dfa-8014-4733-a7bc-8d79bffd168d tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Pushing event updated for resources: {'Subnet': ['ID=92e65bd6-175d-4443-9f6d-fb7b4ec7f89d,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:57:50.833231 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ee985dfa-8014-4733-a7bc-8d79bffd168d tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Checking segment: {'id': '86a78ca8-eed0-4e64-b526-703b84bd00f9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 312, 'network_id': '23a1cc12-0a26-4ec6-87a6-8bfb5940c9da'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:57:50.833589 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ee985dfa-8014-4733-a7bc-8d79bffd168d tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Network hostable DHCP agents. Network: 23a1cc12-0a26-4ec6-87a6-8bfb5940c9da, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:57:50.914042 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ee985dfa-8014-4733-a7bc-8d79bffd168d tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Network 23a1cc12-0a26-4ec6-87a6-8bfb5940c9da is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:57:51.002755 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-ee985dfa-8014-4733-a7bc-8d79bffd168d tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 23a1cc12-0a26-4ec6-87a6-8bfb5940c9da) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:57:51.007273 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ee985dfa-8014-4733-a7bc-8d79bffd168d tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:51.007854 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ee985dfa-8014-4733-a7bc-8d79bffd168d tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:51.014846 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-15021293-c2fa-44df-ab97-b0d6e3060c5e None None] Network 23a1cc12-0a26-4ec6-87a6-8bfb5940c9da requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:57:51.091342 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-ee985dfa-8014-4733-a7bc-8d79bffd168d tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.7893915 Nov 09 04:57:51.094512 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 35586) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:57:51.099569 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-ed53b81c-3789-428b-8976-1f333ab314ab tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-369927931'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:57:51.160351 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c7c54c3d-fcb7-4bce-8c70-8339ad076eba None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-23a1cc12-0a26-4ec6-87a6-8bfb5940c9da', 'network_id': '23a1cc12-0a26-4ec6-87a6-8bfb5940c9da', 'tenant_id': 'e55ec79f5db54cacbb98ecafe15a9128', 'fixed_ips': [{'subnet_id': '92e65bd6-175d-4443-9f6d-fb7b4ec7f89d'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:57:51.161201 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c7c54c3d-fcb7-4bce-8c70-8339ad076eba None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:51.185773 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ed53b81c-3789-428b-8976-1f333ab314ab tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Made reservation on behalf of e55ec79f5db54cacbb98ecafe15a9128 for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:57:51.189394 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ed53b81c-3789-428b-8976-1f333ab314ab tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:51.214858 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ed53b81c-3789-428b-8976-1f333ab314ab tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 338} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:57:51.223835 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ed53b81c-3789-428b-8976-1f333ab314ab tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:51.224357 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-ed53b81c-3789-428b-8976-1f333ab314ab tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Added segment 7cf6d593-c190-469d-8dde-39ec2ec72072 of type vlan for network c5ff9a0b-5251-4f0e-8ce7-dc82cd1c9fb4 Nov 09 04:57:51.263718 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ed53b81c-3789-428b-8976-1f333ab314ab tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:51.301294 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-c7c54c3d-fcb7-4bce-8c70-8339ad076eba None None] Allocated IP 2001:db8:0:ffff::2 (23a1cc12-0a26-4ec6-87a6-8bfb5940c9da/92e65bd6-175d-4443-9f6d-fb7b4ec7f89d/e3aa4845-32bf-4f88-89b1-6fbb49902f73) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:57:51.348633 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ed53b81c-3789-428b-8976-1f333ab314ab tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:51.354299 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ed53b81c-3789-428b-8976-1f333ab314ab tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:51.357779 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ed53b81c-3789-428b-8976-1f333ab314ab tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:51.447280 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c7c54c3d-fcb7-4bce-8c70-8339ad076eba None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:51.503229 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c7c54c3d-fcb7-4bce-8c70-8339ad076eba None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:51.539381 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c7c54c3d-fcb7-4bce-8c70-8339ad076eba None None] Network 23a1cc12-0a26-4ec6-87a6-8bfb5940c9da is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:57:51.542315 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-c7c54c3d-fcb7-4bce-8c70-8339ad076eba None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:57:51.546451 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c7c54c3d-fcb7-4bce-8c70-8339ad076eba None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:57:51.561040 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7c54c3d-fcb7-4bce-8c70-8339ad076eba None None] Pushing event updated for resources: {'Port': ['ID=e3aa4845-32bf-4f88-89b1-6fbb49902f73,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:57:51.611093 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-c7c54c3d-fcb7-4bce-8c70-8339ad076eba None None] Attempting to bind port e3aa4845-32bf-4f88-89b1-6fbb49902f73 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:57:51.611633 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-c7c54c3d-fcb7-4bce-8c70-8339ad076eba None None] Attempting to bind port e3aa4845-32bf-4f88-89b1-6fbb49902f73 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '86a78ca8-eed0-4e64-b526-703b84bd00f9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 312, 'network_id': '23a1cc12-0a26-4ec6-87a6-8bfb5940c9da'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:57:51.612000 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c7c54c3d-fcb7-4bce-8c70-8339ad076eba None None] Attempting to bind port e3aa4845-32bf-4f88-89b1-6fbb49902f73 on network 23a1cc12-0a26-4ec6-87a6-8bfb5940c9da {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:57:51.617041 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c7c54c3d-fcb7-4bce-8c70-8339ad076eba None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 57, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:57:51.617412 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c7c54c3d-fcb7-4bce-8c70-8339ad076eba None None] Checking segment: {'id': '86a78ca8-eed0-4e64-b526-703b84bd00f9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 312, 'network_id': '23a1cc12-0a26-4ec6-87a6-8bfb5940c9da'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:57:51.617807 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c7c54c3d-fcb7-4bce-8c70-8339ad076eba None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:51.618195 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c7c54c3d-fcb7-4bce-8c70-8339ad076eba None None] Bound using segment: {'id': '86a78ca8-eed0-4e64-b526-703b84bd00f9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 312, 'network_id': '23a1cc12-0a26-4ec6-87a6-8bfb5940c9da'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:57:51.618676 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-c7c54c3d-fcb7-4bce-8c70-8339ad076eba None None] Bound port: e3aa4845-32bf-4f88-89b1-6fbb49902f73, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '86a78ca8-eed0-4e64-b526-703b84bd00f9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 312, 'network_id': '23a1cc12-0a26-4ec6-87a6-8bfb5940c9da'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:57:51.619053 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c7c54c3d-fcb7-4bce-8c70-8339ad076eba None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:51.685634 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-c7c54c3d-fcb7-4bce-8c70-8339ad076eba None None] For port e3aa4845-32bf-4f88-89b1-6fbb49902f73, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:57:51.688684 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-c7c54c3d-fcb7-4bce-8c70-8339ad076eba None None] For port e3aa4845-32bf-4f88-89b1-6fbb49902f73, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=e3aa4845-32bf-4f88-89b1-6fbb49902f73,segment=NetworkSegment(86a78ca8-eed0-4e64-b526-703b84bd00f9),segment_id=86a78ca8-eed0-4e64-b526-703b84bd00f9)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:57:51.702451 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed53b81c-3789-428b-8976-1f333ab314ab tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Pushing event updated for resources: {'Network': ['ID=c5ff9a0b-5251-4f0e-8ce7-dc82cd1c9fb4,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:57:51.713008 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network c5ff9a0b-5251-4f0e-8ce7-dc82cd1c9fb4 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:57:51.762456 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-ed53b81c-3789-428b-8976-1f333ab314ab tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 783 time: 0.6668465 Nov 09 04:57:51.766806 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 35588) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:57:51.772278 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-5cc94dbb-bc8b-4134-8455-e26b7b3e0a0f tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Request body: {'subnet': {'network_id': 'c5ff9a0b-5251-4f0e-8ce7-dc82cd1c9fb4', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'enable_dhcp': True, 'host_routes': [{'destination': '2001::/64', 'nexthop': '2003::1'}], 'dns_nameservers': ['2001:4860:4860::8844', '2001:4860:4860::8888']}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:57:51.772970 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c7c54c3d-fcb7-4bce-8c70-8339ad076eba None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:51.856296 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7c54c3d-fcb7-4bce-8c70-8339ad076eba None None] Pushing event updated for resources: {'Port': ['ID=e3aa4845-32bf-4f88-89b1-6fbb49902f73,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:57:52.003320 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5cc94dbb-bc8b-4134-8455-e26b7b3e0a0f tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Made reservation on behalf of e55ec79f5db54cacbb98ecafe15a9128 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:57:52.007047 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5cc94dbb-bc8b-4134-8455-e26b7b3e0a0f tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:52.109899 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device e3aa4845-32bf-4f88-89b1-6fbb49902f73 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:57:52.159256 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port e3aa4845-32bf-4f88-89b1-6fbb49902f73 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:57:52.159621 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:52.235099 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:52.270462 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port e3aa4845-32bf-4f88-89b1-6fbb49902f73, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=e3aa4845-32bf-4f88-89b1-6fbb49902f73,segment=NetworkSegment(86a78ca8-eed0-4e64-b526-703b84bd00f9),segment_id=86a78ca8-eed0-4e64-b526-703b84bd00f9)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:57:52.280356 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5cc94dbb-bc8b-4134-8455-e26b7b3e0a0f tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:52.342264 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5cc94dbb-bc8b-4134-8455-e26b7b3e0a0f tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Pushing event updated for resources: {'Subnet': ['ID=00031a89-bf66-4943-9b3c-0e3d32652582,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:57:52.348519 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:52.352973 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5cc94dbb-bc8b-4134-8455-e26b7b3e0a0f tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Checking segment: {'id': '7cf6d593-c190-469d-8dde-39ec2ec72072', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 338, 'network_id': 'c5ff9a0b-5251-4f0e-8ce7-dc82cd1c9fb4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:57:52.353449 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5cc94dbb-bc8b-4134-8455-e26b7b3e0a0f tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Network hostable DHCP agents. Network: c5ff9a0b-5251-4f0e-8ce7-dc82cd1c9fb4, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:57:52.395065 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=e3aa4845-32bf-4f88-89b1-6fbb49902f73,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:57:52.446070 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5cc94dbb-bc8b-4134-8455-e26b7b3e0a0f tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Network c5ff9a0b-5251-4f0e-8ce7-dc82cd1c9fb4 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:57:52.520133 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-5cc94dbb-bc8b-4134-8455-e26b7b3e0a0f tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, c5ff9a0b-5251-4f0e-8ce7-dc82cd1c9fb4) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:57:52.524641 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5cc94dbb-bc8b-4134-8455-e26b7b3e0a0f tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:52.525232 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5cc94dbb-bc8b-4134-8455-e26b7b3e0a0f tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:52.529353 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-291cb77f-a2fe-465a-b7ba-69b0f8c7dff5 None None] Network c5ff9a0b-5251-4f0e-8ce7-dc82cd1c9fb4 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:57:52.617547 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 35590) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:57:52.618137 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-5cc94dbb-bc8b-4134-8455-e26b7b3e0a0f tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 913 time: 0.8497672 Nov 09 04:57:52.691280 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5e349b11-aa0f-4460-a056-30f79e97865d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-c5ff9a0b-5251-4f0e-8ce7-dc82cd1c9fb4', 'network_id': 'c5ff9a0b-5251-4f0e-8ce7-dc82cd1c9fb4', 'tenant_id': 'e55ec79f5db54cacbb98ecafe15a9128', 'fixed_ips': [{'subnet_id': '00031a89-bf66-4943-9b3c-0e3d32652582'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:57:52.695705 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5e349b11-aa0f-4460-a056-30f79e97865d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:52.727394 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e35102d4-9dbe-4548-ad02-0c2b31cd3fa6 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:52.762229 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-306867dd-7ddd-4fbd-b999-f31827fff660 None None] Network 23a1cc12-0a26-4ec6-87a6-8bfb5940c9da requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:57:52.806982 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e35102d4-9dbe-4548-ad02-0c2b31cd3fa6 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:52.902609 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-5e349b11-aa0f-4460-a056-30f79e97865d None None] Allocated IP 2001:db8::2 (c5ff9a0b-5251-4f0e-8ce7-dc82cd1c9fb4/00031a89-bf66-4943-9b3c-0e3d32652582/47fcd4e0-0dfd-4fa6-9f55-e4749a8898bf) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:57:52.906741 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-5a27ce2a-29e8-4bdc-84a6-fb6f9dbe0443 None None] Provisioning complete for port e3aa4845-32bf-4f88-89b1-6fbb49902f73 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:57:52.907105 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5a27ce2a-29e8-4bdc-84a6-fb6f9dbe0443 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:53.309980 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5e349b11-aa0f-4460-a056-30f79e97865d None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:53.443102 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5e349b11-aa0f-4460-a056-30f79e97865d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:53.456113 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:57:53.490748 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5e349b11-aa0f-4460-a056-30f79e97865d None None] Network c5ff9a0b-5251-4f0e-8ce7-dc82cd1c9fb4 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:57:53.496797 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-5e349b11-aa0f-4460-a056-30f79e97865d None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:57:53.500266 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5e349b11-aa0f-4460-a056-30f79e97865d None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:57:53.503770 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e349b11-aa0f-4460-a056-30f79e97865d None None] Pushing event updated for resources: {'Port': ['ID=47fcd4e0-0dfd-4fa6-9f55-e4749a8898bf,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:57:53.515641 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-bf2781f8-f8c2-420d-8582-89cbefcd5a2d None None] Provisioning complete for port e3aa4845-32bf-4f88-89b1-6fbb49902f73 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:57:53.516008 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-bf2781f8-f8c2-420d-8582-89cbefcd5a2d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:53.535035 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e35102d4-9dbe-4548-ad02-0c2b31cd3fa6 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:53.568490 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e35102d4-9dbe-4548-ad02-0c2b31cd3fa6 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Pushing event deleted for resources: {'Subnet': ['ID=00031a89-bf66-4943-9b3c-0e3d32652582,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:57:53.584512 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-5e349b11-aa0f-4460-a056-30f79e97865d None None] Attempting to bind port 47fcd4e0-0dfd-4fa6-9f55-e4749a8898bf on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:57:53.584876 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-5e349b11-aa0f-4460-a056-30f79e97865d None None] Attempting to bind port 47fcd4e0-0dfd-4fa6-9f55-e4749a8898bf by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '7cf6d593-c190-469d-8dde-39ec2ec72072', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 338, 'network_id': 'c5ff9a0b-5251-4f0e-8ce7-dc82cd1c9fb4'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:57:53.585234 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5e349b11-aa0f-4460-a056-30f79e97865d None None] Attempting to bind port 47fcd4e0-0dfd-4fa6-9f55-e4749a8898bf on network c5ff9a0b-5251-4f0e-8ce7-dc82cd1c9fb4 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:57:53.592157 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5e349b11-aa0f-4460-a056-30f79e97865d None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 57, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:57:53.592526 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5e349b11-aa0f-4460-a056-30f79e97865d None None] Checking segment: {'id': '7cf6d593-c190-469d-8dde-39ec2ec72072', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 338, 'network_id': 'c5ff9a0b-5251-4f0e-8ce7-dc82cd1c9fb4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:57:53.592920 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5e349b11-aa0f-4460-a056-30f79e97865d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:53.593307 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5e349b11-aa0f-4460-a056-30f79e97865d None None] Bound using segment: {'id': '7cf6d593-c190-469d-8dde-39ec2ec72072', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 338, 'network_id': 'c5ff9a0b-5251-4f0e-8ce7-dc82cd1c9fb4'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:57:53.593761 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-5e349b11-aa0f-4460-a056-30f79e97865d None None] Bound port: 47fcd4e0-0dfd-4fa6-9f55-e4749a8898bf, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7cf6d593-c190-469d-8dde-39ec2ec72072', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 338, 'network_id': 'c5ff9a0b-5251-4f0e-8ce7-dc82cd1c9fb4'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:57:53.594131 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5e349b11-aa0f-4460-a056-30f79e97865d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:53.625297 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e35102d4-9dbe-4548-ad02-0c2b31cd3fa6 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:53.644905 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-e35102d4-9dbe-4548-ad02-0c2b31cd3fa6 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c5ff9a0b-5251-4f0e-8ce7-dc82cd1c9fb4']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:57:53.653950 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-e35102d4-9dbe-4548-ad02-0c2b31cd3fa6 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '7cf6d593-c190-469d-8dde-39ec2ec72072') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:57:53.654240 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-e35102d4-9dbe-4548-ad02-0c2b31cd3fa6 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '7cf6d593-c190-469d-8dde-39ec2ec72072') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:57:53.663991 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e35102d4-9dbe-4548-ad02-0c2b31cd3fa6 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:53.676870 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e35102d4-9dbe-4548-ad02-0c2b31cd3fa6 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:53.683364 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e35102d4-9dbe-4548-ad02-0c2b31cd3fa6 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Releasing vlan 338 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:57:53.683764 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e35102d4-9dbe-4548-ad02-0c2b31cd3fa6 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:53.686912 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:57:53.686912 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:57:53.686912 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:57:53.686912 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:57:53.686912 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:57:53.686912 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:57:53.686912 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:57:53.686912 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:57:53.686912 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:57:53.686912 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:57:53.686912 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:57:53.686912 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:57:53.686912 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:57:53.686912 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:57:53.686912 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:57:53.686912 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:57:53.686912 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:57:53.686912 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:57:53.686912 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:57:53.686912 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:57:53.686912 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:57:53.686912 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:57:53.686912 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:57:53.686912 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:57:53.686912 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:57:53.686912 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:57:53.686912 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:57:53.686912 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:57:53.686912 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:57:53.686912 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:57:53.686912 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:57:53.686912 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:57:53.694949 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-5e349b11-aa0f-4460-a056-30f79e97865d None None] For port 47fcd4e0-0dfd-4fa6-9f55-e4749a8898bf, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:57:53.743623 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-5e349b11-aa0f-4460-a056-30f79e97865d None None] For port 47fcd4e0-0dfd-4fa6-9f55-e4749a8898bf, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=47fcd4e0-0dfd-4fa6-9f55-e4749a8898bf,segment=NetworkSegment(7cf6d593-c190-469d-8dde-39ec2ec72072),segment_id=7cf6d593-c190-469d-8dde-39ec2ec72072)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:57:53.777149 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.db.api [None req-e35102d4-9dbe-4548-ad02-0c2b31cd3fa6 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Nov 09 04:57:53.777149 dv-neutron-816802-2-hyperv neutron-server[102162]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Nov 09 04:57:53.777149 dv-neutron-816802-2-hyperv neutron-server[102162]: [parameters: {'id': 'c5ff9a0b-5251-4f0e-8ce7-dc82cd1c9fb4'}] Nov 09 04:57:53.777149 dv-neutron-816802-2-hyperv neutron-server[102162]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=102162) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:57:53.777550 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG oslo_db.api [None req-e35102d4-9dbe-4548-ad02-0c2b31cd3fa6 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:57:53.820843 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5e349b11-aa0f-4460-a056-30f79e97865d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:53.897325 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e349b11-aa0f-4460-a056-30f79e97865d None None] Pushing event updated for resources: {'Port': ['ID=47fcd4e0-0dfd-4fa6-9f55-e4749a8898bf,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:57:53.906941 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b4653bc7-bb47-4193-bef0-0795e79977d7 None None] Network c5ff9a0b-5251-4f0e-8ce7-dc82cd1c9fb4 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:57:54.026494 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b0244da9-087f-43a3-b79c-ad6b6824f9b9 None None] get_active_networks_info from dv-neutron-816802-2-hyperv {{(pid=102163) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}} Nov 09 04:57:54.049780 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device e3aa4845-32bf-4f88-89b1-6fbb49902f73 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:57:54.134031 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b0244da9-087f-43a3-b79c-ad6b6824f9b9 None None] Resources bound (agent type, host, resource id): {{(pid=102163) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 09 04:57:54.136924 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port e3aa4845-32bf-4f88-89b1-6fbb49902f73 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:57:54.137290 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:54.278755 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e35102d4-9dbe-4548-ad02-0c2b31cd3fa6 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:54.331497 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-e35102d4-9dbe-4548-ad02-0c2b31cd3fa6 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Deleting port 47fcd4e0-0dfd-4fa6-9f55-e4749a8898bf {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:57:54.331828 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e35102d4-9dbe-4548-ad02-0c2b31cd3fa6 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:54.393126 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-e35102d4-9dbe-4548-ad02-0c2b31cd3fa6 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] For port 47fcd4e0-0dfd-4fa6-9f55-e4749a8898bf, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=47fcd4e0-0dfd-4fa6-9f55-e4749a8898bf,segment=NetworkSegment(7cf6d593-c190-469d-8dde-39ec2ec72072),segment_id=7cf6d593-c190-469d-8dde-39ec2ec72072)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:57:54.393485 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e35102d4-9dbe-4548-ad02-0c2b31cd3fa6 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:54.410283 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-e35102d4-9dbe-4548-ad02-0c2b31cd3fa6 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Calling delete_port for 47fcd4e0-0dfd-4fa6-9f55-e4749a8898bf owned by network:dhcp {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:57:54.573840 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e35102d4-9dbe-4548-ad02-0c2b31cd3fa6 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:54.601086 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e35102d4-9dbe-4548-ad02-0c2b31cd3fa6 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Pushing event deleted for resources: {'Port': ['ID=47fcd4e0-0dfd-4fa6-9f55-e4749a8898bf,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:57:54.603339 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e35102d4-9dbe-4548-ad02-0c2b31cd3fa6 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] No DVR routers for this DVR port 47fcd4e0-0dfd-4fa6-9f55-e4749a8898bf on host dv-neutron-816802-2-hyperv {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:57:54.612787 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e35102d4-9dbe-4548-ad02-0c2b31cd3fa6 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:57:54.613140 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e35102d4-9dbe-4548-ad02-0c2b31cd3fa6 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:57:54.613476 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e35102d4-9dbe-4548-ad02-0c2b31cd3fa6 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:57:54.613810 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e35102d4-9dbe-4548-ad02-0c2b31cd3fa6 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:57:54.614137 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e35102d4-9dbe-4548-ad02-0c2b31cd3fa6 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:57:54.614488 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e35102d4-9dbe-4548-ad02-0c2b31cd3fa6 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:57:54.614807 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e35102d4-9dbe-4548-ad02-0c2b31cd3fa6 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:57:54.615234 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e35102d4-9dbe-4548-ad02-0c2b31cd3fa6 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:57:54.615555 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e35102d4-9dbe-4548-ad02-0c2b31cd3fa6 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:57:54.615872 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e35102d4-9dbe-4548-ad02-0c2b31cd3fa6 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:57:54.616200 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e35102d4-9dbe-4548-ad02-0c2b31cd3fa6 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:57:54.616507 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e35102d4-9dbe-4548-ad02-0c2b31cd3fa6 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:57:54.691536 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e35102d4-9dbe-4548-ad02-0c2b31cd3fa6 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:54.718745 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-e35102d4-9dbe-4548-ad02-0c2b31cd3fa6 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c5ff9a0b-5251-4f0e-8ce7-dc82cd1c9fb4']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:57:54.728014 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-e35102d4-9dbe-4548-ad02-0c2b31cd3fa6 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '7cf6d593-c190-469d-8dde-39ec2ec72072') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:57:54.728309 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-e35102d4-9dbe-4548-ad02-0c2b31cd3fa6 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '7cf6d593-c190-469d-8dde-39ec2ec72072') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:57:54.737457 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e35102d4-9dbe-4548-ad02-0c2b31cd3fa6 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:54.750793 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e35102d4-9dbe-4548-ad02-0c2b31cd3fa6 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:54.756930 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e35102d4-9dbe-4548-ad02-0c2b31cd3fa6 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Releasing vlan 338 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:57:54.757298 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e35102d4-9dbe-4548-ad02-0c2b31cd3fa6 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:54.760184 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:57:54.760184 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:57:54.760184 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:57:54.760184 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:57:54.760184 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:57:54.760184 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:57:54.760184 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:57:54.760184 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:57:54.760184 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:57:54.760184 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:57:54.760184 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:57:54.760184 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:57:54.760184 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:57:54.760184 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:57:54.760184 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:57:54.760184 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:57:54.760184 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:57:54.760184 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:57:54.760184 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:57:54.760184 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:57:54.760184 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:57:54.760184 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:57:54.760184 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:57:54.760184 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:57:54.760184 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:57:54.760184 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:57:54.760184 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:57:54.760184 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:57:54.760184 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:57:54.760184 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:57:54.760184 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:57:54.760184 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:57:54.873374 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e35102d4-9dbe-4548-ad02-0c2b31cd3fa6 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:54.883681 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e35102d4-9dbe-4548-ad02-0c2b31cd3fa6 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:54.883681 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e35102d4-9dbe-4548-ad02-0c2b31cd3fa6 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] 10.222.0.24 "DELETE /v2.0/networks/c5ff9a0b-5251-4f0e-8ce7-dc82cd1c9fb4 HTTP/1.1" status: 204 len: 168 time: 2.2643566 Nov 09 04:57:54.887876 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 35592) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:57:54.893408 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-5a5ee5e1-0fcf-4959-bde5-e8ba12648967 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-632055720'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:57:54.895265 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e35102d4-9dbe-4548-ad02-0c2b31cd3fa6 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Pushing event deleted for resources: {'Network': ['ID=c5ff9a0b-5251-4f0e-8ce7-dc82cd1c9fb4,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:57:54.970544 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5a5ee5e1-0fcf-4959-bde5-e8ba12648967 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Made reservation on behalf of e55ec79f5db54cacbb98ecafe15a9128 for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:57:54.973960 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5a5ee5e1-0fcf-4959-bde5-e8ba12648967 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:54.996791 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5a5ee5e1-0fcf-4959-bde5-e8ba12648967 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 331} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:57:55.005076 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5a5ee5e1-0fcf-4959-bde5-e8ba12648967 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:55.005416 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-5a5ee5e1-0fcf-4959-bde5-e8ba12648967 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Added segment 56f441f7-e70a-4c98-83ac-352b7ceb5dd0 of type vlan for network b19c579a-2030-46c4-82e7-ea556f6abb24 Nov 09 04:57:55.047553 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5a5ee5e1-0fcf-4959-bde5-e8ba12648967 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:55.148162 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5a5ee5e1-0fcf-4959-bde5-e8ba12648967 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:55.153845 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5a5ee5e1-0fcf-4959-bde5-e8ba12648967 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:55.154441 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5a5ee5e1-0fcf-4959-bde5-e8ba12648967 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:55.218196 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a5ee5e1-0fcf-4959-bde5-e8ba12648967 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Pushing event updated for resources: {'Network': ['ID=b19c579a-2030-46c4-82e7-ea556f6abb24,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:57:55.228291 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network b19c579a-2030-46c4-82e7-ea556f6abb24 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:57:55.270620 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-5a5ee5e1-0fcf-4959-bde5-e8ba12648967 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 783 time: 0.3811095 Nov 09 04:57:55.273916 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 35594) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:57:55.278836 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-1555d8dd-8644-473f-84e4-cd592fb47df4 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Request body: {'subnet': {'network_id': 'b19c579a-2030-46c4-82e7-ea556f6abb24', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': None, 'allocation_pools': [{'start': '2001:db8::3', 'end': '2001:db8::7'}]}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:57:55.451209 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1555d8dd-8644-473f-84e4-cd592fb47df4 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Made reservation on behalf of e55ec79f5db54cacbb98ecafe15a9128 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:57:55.454789 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1555d8dd-8644-473f-84e4-cd592fb47df4 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:55.510528 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.ipam_backend_mixin [None req-1555d8dd-8644-473f-84e4-cd592fb47df4 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Performing IP validity checks on allocation pools {{(pid=102161) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:325}} Nov 09 04:57:55.510970 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.ipam_backend_mixin [None req-1555d8dd-8644-473f-84e4-cd592fb47df4 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Checking for overlaps among allocation pools and gateway ip {{(pid=102161) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:346}} Nov 09 04:57:55.685228 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1555d8dd-8644-473f-84e4-cd592fb47df4 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:55.747485 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1555d8dd-8644-473f-84e4-cd592fb47df4 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Pushing event updated for resources: {'Subnet': ['ID=ed964ad8-df5e-4a69-b3d5-311fed2acf17,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:57:55.756674 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1555d8dd-8644-473f-84e4-cd592fb47df4 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Checking segment: {'id': '56f441f7-e70a-4c98-83ac-352b7ceb5dd0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 331, 'network_id': 'b19c579a-2030-46c4-82e7-ea556f6abb24'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:57:55.757061 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1555d8dd-8644-473f-84e4-cd592fb47df4 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Network hostable DHCP agents. Network: b19c579a-2030-46c4-82e7-ea556f6abb24, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:57:55.827640 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1555d8dd-8644-473f-84e4-cd592fb47df4 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Network b19c579a-2030-46c4-82e7-ea556f6abb24 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:57:55.893604 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-1555d8dd-8644-473f-84e4-cd592fb47df4 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, b19c579a-2030-46c4-82e7-ea556f6abb24) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:57:55.897700 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1555d8dd-8644-473f-84e4-cd592fb47df4 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:55.898322 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1555d8dd-8644-473f-84e4-cd592fb47df4 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:55.903444 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2f28c54c-8ed1-4644-b39c-afe5aa5391d6 None None] Network b19c579a-2030-46c4-82e7-ea556f6abb24 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:57:55.971638 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1555d8dd-8644-473f-84e4-cd592fb47df4 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 794 time: 0.6966271 Nov 09 04:57:55.992280 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 35596) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:57:56.048624 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-06cbc1ed-69e6-44cd-aa62-808297eab4f3 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-b19c579a-2030-46c4-82e7-ea556f6abb24', 'network_id': 'b19c579a-2030-46c4-82e7-ea556f6abb24', 'tenant_id': 'e55ec79f5db54cacbb98ecafe15a9128', 'fixed_ips': [{'subnet_id': 'ed964ad8-df5e-4a69-b3d5-311fed2acf17'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:57:56.049757 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-06cbc1ed-69e6-44cd-aa62-808297eab4f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:56.093464 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-88c182cf-e29b-492a-b18c-dd0121b9f8d5 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:56.174554 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-88c182cf-e29b-492a-b18c-dd0121b9f8d5 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:56.207169 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-06cbc1ed-69e6-44cd-aa62-808297eab4f3 None None] Allocated IP 2001:db8::3 (b19c579a-2030-46c4-82e7-ea556f6abb24/ed964ad8-df5e-4a69-b3d5-311fed2acf17/4a7ccf71-eda8-4022-8d5d-11c0b8054453) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:57:56.346714 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-06cbc1ed-69e6-44cd-aa62-808297eab4f3 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:56.443065 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-06cbc1ed-69e6-44cd-aa62-808297eab4f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:56.480276 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-06cbc1ed-69e6-44cd-aa62-808297eab4f3 None None] Network b19c579a-2030-46c4-82e7-ea556f6abb24 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:57:56.484997 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-06cbc1ed-69e6-44cd-aa62-808297eab4f3 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:57:56.488600 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-06cbc1ed-69e6-44cd-aa62-808297eab4f3 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:57:56.495433 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06cbc1ed-69e6-44cd-aa62-808297eab4f3 None None] Pushing event updated for resources: {'Port': ['ID=4a7ccf71-eda8-4022-8d5d-11c0b8054453,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:57:56.511568 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-88c182cf-e29b-492a-b18c-dd0121b9f8d5 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:56.545220 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88c182cf-e29b-492a-b18c-dd0121b9f8d5 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Pushing event deleted for resources: {'Subnet': ['ID=ed964ad8-df5e-4a69-b3d5-311fed2acf17,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:57:56.546271 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-06cbc1ed-69e6-44cd-aa62-808297eab4f3 None None] Attempting to bind port 4a7ccf71-eda8-4022-8d5d-11c0b8054453 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:57:56.546576 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-06cbc1ed-69e6-44cd-aa62-808297eab4f3 None None] Attempting to bind port 4a7ccf71-eda8-4022-8d5d-11c0b8054453 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '56f441f7-e70a-4c98-83ac-352b7ceb5dd0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 331, 'network_id': 'b19c579a-2030-46c4-82e7-ea556f6abb24'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:57:56.546939 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-06cbc1ed-69e6-44cd-aa62-808297eab4f3 None None] Attempting to bind port 4a7ccf71-eda8-4022-8d5d-11c0b8054453 on network b19c579a-2030-46c4-82e7-ea556f6abb24 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:57:56.552115 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-06cbc1ed-69e6-44cd-aa62-808297eab4f3 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 57, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:57:56.552523 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-06cbc1ed-69e6-44cd-aa62-808297eab4f3 None None] Checking segment: {'id': '56f441f7-e70a-4c98-83ac-352b7ceb5dd0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 331, 'network_id': 'b19c579a-2030-46c4-82e7-ea556f6abb24'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:57:56.552922 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-06cbc1ed-69e6-44cd-aa62-808297eab4f3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:56.553313 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-06cbc1ed-69e6-44cd-aa62-808297eab4f3 None None] Bound using segment: {'id': '56f441f7-e70a-4c98-83ac-352b7ceb5dd0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 331, 'network_id': 'b19c579a-2030-46c4-82e7-ea556f6abb24'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:57:56.553846 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-06cbc1ed-69e6-44cd-aa62-808297eab4f3 None None] Bound port: 4a7ccf71-eda8-4022-8d5d-11c0b8054453, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '56f441f7-e70a-4c98-83ac-352b7ceb5dd0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 331, 'network_id': 'b19c579a-2030-46c4-82e7-ea556f6abb24'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:57:56.554229 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-06cbc1ed-69e6-44cd-aa62-808297eab4f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:56.606254 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-88c182cf-e29b-492a-b18c-dd0121b9f8d5 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:56.623980 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-06cbc1ed-69e6-44cd-aa62-808297eab4f3 None None] For port 4a7ccf71-eda8-4022-8d5d-11c0b8054453, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:57:56.626597 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-88c182cf-e29b-492a-b18c-dd0121b9f8d5 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b19c579a-2030-46c4-82e7-ea556f6abb24']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:57:56.627130 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-06cbc1ed-69e6-44cd-aa62-808297eab4f3 None None] For port 4a7ccf71-eda8-4022-8d5d-11c0b8054453, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=4a7ccf71-eda8-4022-8d5d-11c0b8054453,segment=NetworkSegment(56f441f7-e70a-4c98-83ac-352b7ceb5dd0),segment_id=56f441f7-e70a-4c98-83ac-352b7ceb5dd0)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:57:56.636516 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-88c182cf-e29b-492a-b18c-dd0121b9f8d5 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '56f441f7-e70a-4c98-83ac-352b7ceb5dd0') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:57:56.636813 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-88c182cf-e29b-492a-b18c-dd0121b9f8d5 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '56f441f7-e70a-4c98-83ac-352b7ceb5dd0') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:57:56.645853 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-88c182cf-e29b-492a-b18c-dd0121b9f8d5 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:56.706089 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-06cbc1ed-69e6-44cd-aa62-808297eab4f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:56.708598 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-88c182cf-e29b-492a-b18c-dd0121b9f8d5 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:56.718133 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-88c182cf-e29b-492a-b18c-dd0121b9f8d5 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Releasing vlan 331 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:57:56.718792 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-88c182cf-e29b-492a-b18c-dd0121b9f8d5 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:56.723656 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:57:56.723656 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:57:56.723656 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:57:56.723656 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:57:56.723656 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:57:56.723656 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:57:56.723656 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:57:56.723656 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:57:56.723656 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:57:56.723656 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:57:56.723656 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:57:56.723656 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:57:56.723656 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:57:56.723656 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:57:56.723656 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:57:56.723656 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:57:56.723656 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:57:56.723656 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:57:56.723656 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:57:56.723656 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:57:56.723656 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:57:56.723656 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:57:56.723656 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:57:56.723656 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:57:56.723656 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:57:56.723656 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:57:56.723656 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:57:56.723656 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:57:56.723656 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:57:56.723656 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:57:56.723656 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:57:56.723656 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:57:56.828596 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06cbc1ed-69e6-44cd-aa62-808297eab4f3 None None] Pushing event updated for resources: {'Port': ['ID=4a7ccf71-eda8-4022-8d5d-11c0b8054453,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:57:56.847660 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-74baef86-0b2e-43be-85b8-a3224b4aaef3 None None] Network b19c579a-2030-46c4-82e7-ea556f6abb24 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:57:56.868398 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.db.api [None req-88c182cf-e29b-492a-b18c-dd0121b9f8d5 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Nov 09 04:57:56.868398 dv-neutron-816802-2-hyperv neutron-server[102161]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Nov 09 04:57:56.868398 dv-neutron-816802-2-hyperv neutron-server[102161]: [parameters: {'id': 'b19c579a-2030-46c4-82e7-ea556f6abb24'}] Nov 09 04:57:56.868398 dv-neutron-816802-2-hyperv neutron-server[102161]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=102161) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 04:57:56.868848 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG oslo_db.api [None req-88c182cf-e29b-492a-b18c-dd0121b9f8d5 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 04:57:56.968209 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-55c03256-82ea-461c-bc0c-6de208554fa9 None None] get_active_networks_info from dv-neutron-816802-2-hyperv {{(pid=102163) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}} Nov 09 04:57:57.037331 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-55c03256-82ea-461c-bc0c-6de208554fa9 None None] Resources bound (agent type, host, resource id): {{(pid=102163) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 09 04:57:57.370195 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-88c182cf-e29b-492a-b18c-dd0121b9f8d5 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:57.425430 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-88c182cf-e29b-492a-b18c-dd0121b9f8d5 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Deleting port 4a7ccf71-eda8-4022-8d5d-11c0b8054453 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:57:57.425773 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-88c182cf-e29b-492a-b18c-dd0121b9f8d5 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:57.495340 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-88c182cf-e29b-492a-b18c-dd0121b9f8d5 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] For port 4a7ccf71-eda8-4022-8d5d-11c0b8054453, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=4a7ccf71-eda8-4022-8d5d-11c0b8054453,segment=NetworkSegment(56f441f7-e70a-4c98-83ac-352b7ceb5dd0),segment_id=56f441f7-e70a-4c98-83ac-352b7ceb5dd0)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:57:57.495605 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-88c182cf-e29b-492a-b18c-dd0121b9f8d5 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:57.508267 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-88c182cf-e29b-492a-b18c-dd0121b9f8d5 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Calling delete_port for 4a7ccf71-eda8-4022-8d5d-11c0b8054453 owned by network:dhcp {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:57:57.679376 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-88c182cf-e29b-492a-b18c-dd0121b9f8d5 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:57.706714 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88c182cf-e29b-492a-b18c-dd0121b9f8d5 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Pushing event deleted for resources: {'Port': ['ID=4a7ccf71-eda8-4022-8d5d-11c0b8054453,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:57:57.708575 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-88c182cf-e29b-492a-b18c-dd0121b9f8d5 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] No DVR routers for this DVR port 4a7ccf71-eda8-4022-8d5d-11c0b8054453 on host dv-neutron-816802-2-hyperv {{(pid=102161) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:57:57.788363 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-88c182cf-e29b-492a-b18c-dd0121b9f8d5 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:57.808108 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-88c182cf-e29b-492a-b18c-dd0121b9f8d5 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b19c579a-2030-46c4-82e7-ea556f6abb24']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:57:57.817181 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-88c182cf-e29b-492a-b18c-dd0121b9f8d5 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '56f441f7-e70a-4c98-83ac-352b7ceb5dd0') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:57:57.817471 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-88c182cf-e29b-492a-b18c-dd0121b9f8d5 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '56f441f7-e70a-4c98-83ac-352b7ceb5dd0') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:57:57.827343 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-88c182cf-e29b-492a-b18c-dd0121b9f8d5 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:57.839937 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-88c182cf-e29b-492a-b18c-dd0121b9f8d5 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:57.845618 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-88c182cf-e29b-492a-b18c-dd0121b9f8d5 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Releasing vlan 331 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:57:57.845995 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-88c182cf-e29b-492a-b18c-dd0121b9f8d5 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:57.848868 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:57:57.848868 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:57:57.848868 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:57:57.848868 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:57:57.848868 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:57:57.848868 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:57:57.848868 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:57:57.848868 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:57:57.848868 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:57:57.848868 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:57:57.848868 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:57:57.848868 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:57:57.848868 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:57:57.848868 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:57:57.848868 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:57:57.848868 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:57:57.848868 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:57:57.848868 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:57:57.848868 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:57:57.848868 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:57:57.848868 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:57:57.848868 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:57:57.848868 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:57:57.848868 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:57:57.848868 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:57:57.848868 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:57:57.848868 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:57:57.848868 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:57:57.848868 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:57:57.848868 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:57:57.848868 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:57:57.848868 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:57:57.996617 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-88c182cf-e29b-492a-b18c-dd0121b9f8d5 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:58.003449 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-88c182cf-e29b-492a-b18c-dd0121b9f8d5 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:58.007149 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-88c182cf-e29b-492a-b18c-dd0121b9f8d5 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] 10.222.0.24 "DELETE /v2.0/networks/b19c579a-2030-46c4-82e7-ea556f6abb24 HTTP/1.1" status: 204 len: 168 time: 2.0138216 Nov 09 04:57:58.010832 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 35598) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:57:58.015992 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-e0fb59c8-2732-4c0d-b916-66759ed4cb05 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-123959494'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:57:58.018428 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88c182cf-e29b-492a-b18c-dd0121b9f8d5 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Pushing event deleted for resources: {'Network': ['ID=b19c579a-2030-46c4-82e7-ea556f6abb24,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:57:58.119341 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e0fb59c8-2732-4c0d-b916-66759ed4cb05 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Made reservation on behalf of e55ec79f5db54cacbb98ecafe15a9128 for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:57:58.122779 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e0fb59c8-2732-4c0d-b916-66759ed4cb05 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:58.149950 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e0fb59c8-2732-4c0d-b916-66759ed4cb05 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 321} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:57:58.158662 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e0fb59c8-2732-4c0d-b916-66759ed4cb05 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:58.158994 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-e0fb59c8-2732-4c0d-b916-66759ed4cb05 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Added segment ac7ef034-b35e-4c83-a16f-8e369988b0b4 of type vlan for network caf8be65-a82f-4726-a2fb-4a168098a5dc Nov 09 04:57:58.203066 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e0fb59c8-2732-4c0d-b916-66759ed4cb05 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:58.284801 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e0fb59c8-2732-4c0d-b916-66759ed4cb05 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:58.291067 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e0fb59c8-2732-4c0d-b916-66759ed4cb05 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:58.291636 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e0fb59c8-2732-4c0d-b916-66759ed4cb05 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:58.364475 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0fb59c8-2732-4c0d-b916-66759ed4cb05 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Pushing event updated for resources: {'Network': ['ID=caf8be65-a82f-4726-a2fb-4a168098a5dc,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:57:58.374706 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network caf8be65-a82f-4726-a2fb-4a168098a5dc details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:57:58.404158 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e0fb59c8-2732-4c0d-b916-66759ed4cb05 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 783 time: 0.3921311 Nov 09 04:57:58.407076 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 35600) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:57:58.412584 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-dbf8e052-6b34-4730-af6b-a41d7a858812 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Request body: {'subnet': {'network_id': 'caf8be65-a82f-4726-a2fb-4a168098a5dc', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:57:58.564625 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dbf8e052-6b34-4730-af6b-a41d7a858812 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Made reservation on behalf of e55ec79f5db54cacbb98ecafe15a9128 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:57:58.568152 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-dbf8e052-6b34-4730-af6b-a41d7a858812 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:58.850936 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-dbf8e052-6b34-4730-af6b-a41d7a858812 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:58.914013 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbf8e052-6b34-4730-af6b-a41d7a858812 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Pushing event updated for resources: {'Subnet': ['ID=79d5c9fe-c5bc-4606-bfe8-94cfbb54ab3b,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:57:58.918385 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dbf8e052-6b34-4730-af6b-a41d7a858812 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Checking segment: {'id': 'ac7ef034-b35e-4c83-a16f-8e369988b0b4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 321, 'network_id': 'caf8be65-a82f-4726-a2fb-4a168098a5dc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:57:58.918761 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dbf8e052-6b34-4730-af6b-a41d7a858812 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Network hostable DHCP agents. Network: caf8be65-a82f-4726-a2fb-4a168098a5dc, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:57:59.031068 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dbf8e052-6b34-4730-af6b-a41d7a858812 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Network caf8be65-a82f-4726-a2fb-4a168098a5dc is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:57:59.116446 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-dbf8e052-6b34-4730-af6b-a41d7a858812 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, caf8be65-a82f-4726-a2fb-4a168098a5dc) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:57:59.120597 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dbf8e052-6b34-4730-af6b-a41d7a858812 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:59.121182 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-dbf8e052-6b34-4730-af6b-a41d7a858812 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:59.126806 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5251aad6-ecc6-4efb-afd4-718a17d5154e None None] Network caf8be65-a82f-4726-a2fb-4a168098a5dc requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:57:59.205287 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-dbf8e052-6b34-4730-af6b-a41d7a858812 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.7970173 Nov 09 04:57:59.208774 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 35602) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:57:59.215209 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-1105228d-1f3d-4604-8353-bce6d9d846cb tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-42267829'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:57:59.269091 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-283eb055-c319-44e5-a595-e88ffbbace84 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-caf8be65-a82f-4726-a2fb-4a168098a5dc', 'network_id': 'caf8be65-a82f-4726-a2fb-4a168098a5dc', 'tenant_id': 'e55ec79f5db54cacbb98ecafe15a9128', 'fixed_ips': [{'subnet_id': '79d5c9fe-c5bc-4606-bfe8-94cfbb54ab3b'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:57:59.269944 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-283eb055-c319-44e5-a595-e88ffbbace84 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:59.365903 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1105228d-1f3d-4604-8353-bce6d9d846cb tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Made reservation on behalf of e55ec79f5db54cacbb98ecafe15a9128 for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:57:59.369531 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1105228d-1f3d-4604-8353-bce6d9d846cb tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:59.393711 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1105228d-1f3d-4604-8353-bce6d9d846cb tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 305} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:57:59.402752 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1105228d-1f3d-4604-8353-bce6d9d846cb tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:59.407109 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-283eb055-c319-44e5-a595-e88ffbbace84 None None] Allocated IP 2001:db8::2 (caf8be65-a82f-4726-a2fb-4a168098a5dc/79d5c9fe-c5bc-4606-bfe8-94cfbb54ab3b/cbc17f3a-3035-4cad-b69a-e25fd870a1ae) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:57:59.407726 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-1105228d-1f3d-4604-8353-bce6d9d846cb tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Added segment 720dc5b3-51eb-4454-a6b4-f7ee9a8f4de8 of type vlan for network d9e90241-ef0e-4b11-a129-871caf58025d Nov 09 04:57:59.441928 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1105228d-1f3d-4604-8353-bce6d9d846cb tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:59.539750 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1105228d-1f3d-4604-8353-bce6d9d846cb tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:59.545437 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1105228d-1f3d-4604-8353-bce6d9d846cb tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:57:59.546023 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1105228d-1f3d-4604-8353-bce6d9d846cb tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:59.549532 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-283eb055-c319-44e5-a595-e88ffbbace84 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:59.615220 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1105228d-1f3d-4604-8353-bce6d9d846cb tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Pushing event updated for resources: {'Network': ['ID=d9e90241-ef0e-4b11-a129-871caf58025d,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:57:59.623701 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-283eb055-c319-44e5-a595-e88ffbbace84 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:59.628281 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network d9e90241-ef0e-4b11-a129-871caf58025d details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:57:59.650684 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1105228d-1f3d-4604-8353-bce6d9d846cb tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 782 time: 0.4407499 Nov 09 04:57:59.653512 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 35604) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:57:59.658347 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-0a2b6dcd-4902-4060-a3f7-6d5dd6185033 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Request body: {'subnet': {'network_id': 'd9e90241-ef0e-4b11-a129-871caf58025d', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:57:59.714833 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-283eb055-c319-44e5-a595-e88ffbbace84 None None] Network caf8be65-a82f-4726-a2fb-4a168098a5dc is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:57:59.726886 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-283eb055-c319-44e5-a595-e88ffbbace84 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:57:59.732511 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-283eb055-c319-44e5-a595-e88ffbbace84 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:57:59.736519 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-283eb055-c319-44e5-a595-e88ffbbace84 None None] Pushing event updated for resources: {'Port': ['ID=cbc17f3a-3035-4cad-b69a-e25fd870a1ae,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:57:59.787950 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-283eb055-c319-44e5-a595-e88ffbbace84 None None] Attempting to bind port cbc17f3a-3035-4cad-b69a-e25fd870a1ae on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:57:59.788314 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-283eb055-c319-44e5-a595-e88ffbbace84 None None] Attempting to bind port cbc17f3a-3035-4cad-b69a-e25fd870a1ae by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'ac7ef034-b35e-4c83-a16f-8e369988b0b4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 321, 'network_id': 'caf8be65-a82f-4726-a2fb-4a168098a5dc'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:57:59.788678 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-283eb055-c319-44e5-a595-e88ffbbace84 None None] Attempting to bind port cbc17f3a-3035-4cad-b69a-e25fd870a1ae on network caf8be65-a82f-4726-a2fb-4a168098a5dc {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:57:59.796182 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-283eb055-c319-44e5-a595-e88ffbbace84 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 57, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:57:59.796560 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-283eb055-c319-44e5-a595-e88ffbbace84 None None] Checking segment: {'id': 'ac7ef034-b35e-4c83-a16f-8e369988b0b4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 321, 'network_id': 'caf8be65-a82f-4726-a2fb-4a168098a5dc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:57:59.796931 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-283eb055-c319-44e5-a595-e88ffbbace84 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:59.797311 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-283eb055-c319-44e5-a595-e88ffbbace84 None None] Bound using segment: {'id': 'ac7ef034-b35e-4c83-a16f-8e369988b0b4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 321, 'network_id': 'caf8be65-a82f-4726-a2fb-4a168098a5dc'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:57:59.797798 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-283eb055-c319-44e5-a595-e88ffbbace84 None None] Bound port: cbc17f3a-3035-4cad-b69a-e25fd870a1ae, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ac7ef034-b35e-4c83-a16f-8e369988b0b4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 321, 'network_id': 'caf8be65-a82f-4726-a2fb-4a168098a5dc'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:57:59.798163 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-283eb055-c319-44e5-a595-e88ffbbace84 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:59.803097 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0a2b6dcd-4902-4060-a3f7-6d5dd6185033 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Made reservation on behalf of e55ec79f5db54cacbb98ecafe15a9128 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:57:59.806732 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0a2b6dcd-4902-4060-a3f7-6d5dd6185033 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:57:59.863701 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-283eb055-c319-44e5-a595-e88ffbbace84 None None] For port cbc17f3a-3035-4cad-b69a-e25fd870a1ae, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:57:59.867321 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-283eb055-c319-44e5-a595-e88ffbbace84 None None] For port cbc17f3a-3035-4cad-b69a-e25fd870a1ae, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=cbc17f3a-3035-4cad-b69a-e25fd870a1ae,segment=NetworkSegment(ac7ef034-b35e-4c83-a16f-8e369988b0b4),segment_id=ac7ef034-b35e-4c83-a16f-8e369988b0b4)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:57:59.985798 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-283eb055-c319-44e5-a595-e88ffbbace84 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:00.031483 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0a2b6dcd-4902-4060-a3f7-6d5dd6185033 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:00.049390 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-283eb055-c319-44e5-a595-e88ffbbace84 None None] Pushing event updated for resources: {'Port': ['ID=cbc17f3a-3035-4cad-b69a-e25fd870a1ae,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:00.092039 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a2b6dcd-4902-4060-a3f7-6d5dd6185033 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Pushing event updated for resources: {'Subnet': ['ID=fbed3548-0b3a-444f-b704-94cbef04d794,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:00.113174 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0a2b6dcd-4902-4060-a3f7-6d5dd6185033 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Checking segment: {'id': '720dc5b3-51eb-4454-a6b4-f7ee9a8f4de8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 305, 'network_id': 'd9e90241-ef0e-4b11-a129-871caf58025d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:58:00.113540 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0a2b6dcd-4902-4060-a3f7-6d5dd6185033 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Network hostable DHCP agents. Network: d9e90241-ef0e-4b11-a129-871caf58025d, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:58:00.199979 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0a2b6dcd-4902-4060-a3f7-6d5dd6185033 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Network d9e90241-ef0e-4b11-a129-871caf58025d is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:58:00.342183 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-0a2b6dcd-4902-4060-a3f7-6d5dd6185033 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, d9e90241-ef0e-4b11-a129-871caf58025d) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:58:00.346141 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0a2b6dcd-4902-4060-a3f7-6d5dd6185033 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:58:00.346753 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0a2b6dcd-4902-4060-a3f7-6d5dd6185033 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:00.350935 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d11e1392-2424-4982-8dbc-68ff61b01fa1 None None] Network d9e90241-ef0e-4b11-a129-871caf58025d requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:58:00.514252 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-0a2b6dcd-4902-4060-a3f7-6d5dd6185033 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.8596942 Nov 09 04:58:00.516890 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 35606) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:58:00.626957 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-90d68f06-0d54-4345-8426-4566af857c64 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:00.655260 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e4ee5b5e-0c24-4178-bec4-63830013b414 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-d9e90241-ef0e-4b11-a129-871caf58025d', 'network_id': 'd9e90241-ef0e-4b11-a129-871caf58025d', 'tenant_id': 'e55ec79f5db54cacbb98ecafe15a9128', 'fixed_ips': [{'subnet_id': 'fbed3548-0b3a-444f-b704-94cbef04d794'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:58:00.656180 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e4ee5b5e-0c24-4178-bec4-63830013b414 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:00.682008 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-90d68f06-0d54-4345-8426-4566af857c64 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:00.828684 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-90d68f06-0d54-4345-8426-4566af857c64 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:00.860964 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90d68f06-0d54-4345-8426-4566af857c64 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Pushing event deleted for resources: {'Subnet': ['ID=fbed3548-0b3a-444f-b704-94cbef04d794,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server [None req-e4ee5b5e-0c24-4178-bec4-63830013b414 None None] Exception during message handling: neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet fbed3548-0b3a-444f-b704-94cbef04d794: This subnet is being modified by another concurrent operation. Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server raise self.value Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server raise self.value Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server raise self.value Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/quota/resource_registry.py", line 95, in wrapper Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server ret_val = f(_self, context, *args, **kwargs) Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 295, in create_dhcp_port Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server return self._port_action(plugin, context, port, 'create_port') Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 115, in _port_action Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server return p_utils.create_port(plugin, context, port) Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/plugins/utils.py", line 337, in create_port Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server return core_plugin.create_port( Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/common/utils.py", line 694, in inner Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 218, in wrapped Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server raise self.value Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server raise self.value Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server raise self.value Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1485, in create_port Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server result, mech_context = self._create_port_db(context, port) Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1450, in _create_port_db Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server port_db = self.create_port_db(context, port) Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/db_base_plugin_v2.py", line 1460, in create_port_db Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server self.ipam.allocate_ips_for_port_and_store( Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 220, in allocate_ips_for_port_and_store Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server self._safe_rollback(self._ipam_deallocate_ips, context, Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server raise self.value Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 203, in allocate_ips_for_port_and_store Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server ips = self._allocate_ips_for_port(context, port_copy) Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 234, in _allocate_ips_for_port Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server subnets = self._ipam_get_subnets( Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 694, in _ipam_get_subnets Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server subnet.lock_register( Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/models_v2.py", line 55, in lock_register Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server raise exception Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet fbed3548-0b3a-444f-b704-94cbef04d794: This subnet is being modified by another concurrent operation. Nov 09 04:58:00.875383 dv-neutron-816802-2-hyperv neutron-server[102163]: ERROR oslo_messaging.rpc.server Nov 09 04:58:00.899958 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-21b16f5e-9449-4cc6-8194-ddd1225424c0 None None] Network d9e90241-ef0e-4b11-a129-871caf58025d requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:58:00.926589 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-90d68f06-0d54-4345-8426-4566af857c64 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:00.949643 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-90d68f06-0d54-4345-8426-4566af857c64 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d9e90241-ef0e-4b11-a129-871caf58025d']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:58:00.957542 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9c90b86c-e842-422d-9be1-dcd52c87c469 None None] Network caf8be65-a82f-4726-a2fb-4a168098a5dc requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:58:00.960144 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-90d68f06-0d54-4345-8426-4566af857c64 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '720dc5b3-51eb-4454-a6b4-f7ee9a8f4de8') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:58:00.960436 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-90d68f06-0d54-4345-8426-4566af857c64 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '720dc5b3-51eb-4454-a6b4-f7ee9a8f4de8') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:58:00.969675 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-90d68f06-0d54-4345-8426-4566af857c64 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:00.983026 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-90d68f06-0d54-4345-8426-4566af857c64 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:00.989032 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-90d68f06-0d54-4345-8426-4566af857c64 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Releasing vlan 305 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:58:00.989431 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-90d68f06-0d54-4345-8426-4566af857c64 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:00.992472 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 04:58:00.992472 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:58:00.992472 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 04:58:00.992472 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:58:00.992472 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 04:58:00.992472 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:58:00.992472 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 04:58:00.992472 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:58:00.992472 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 04:58:00.992472 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:58:00.992472 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 04:58:00.992472 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:58:00.992472 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 04:58:00.992472 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:58:00.992472 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:58:00.992472 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:58:00.992472 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:58:00.992472 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:58:00.992472 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 04:58:00.992472 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:58:00.992472 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 04:58:00.992472 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:58:00.992472 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:58:00.992472 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:58:00.992472 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 04:58:00.992472 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:58:00.992472 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:58:00.992472 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:58:00.992472 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:58:00.992472 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:58:00.992472 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:58:00.992472 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:58:01.049517 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-1c170b8e-c30e-4d23-8d14-e002b617b795 None None] Provisioning complete for port cbc17f3a-3035-4cad-b69a-e25fd870a1ae triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:58:01.049877 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1c170b8e-c30e-4d23-8d14-e002b617b795 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:01.179990 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-90d68f06-0d54-4345-8426-4566af857c64 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:01.186596 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-90d68f06-0d54-4345-8426-4566af857c64 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:01.190209 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-90d68f06-0d54-4345-8426-4566af857c64 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] 10.222.0.24 "DELETE /v2.0/networks/d9e90241-ef0e-4b11-a129-871caf58025d HTTP/1.1" status: 204 len: 168 time: 0.6723158 Nov 09 04:58:01.193929 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 35608) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:58:01.202311 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90d68f06-0d54-4345-8426-4566af857c64 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Pushing event deleted for resources: {'Network': ['ID=d9e90241-ef0e-4b11-a129-871caf58025d,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:01.214264 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1c170b8e-c30e-4d23-8d14-e002b617b795 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:01.228695 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-ca549bf7-bfb4-4fef-8e51-87283ac75f89 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] GET failed (client error): The resource could not be found. Nov 09 04:58:01.229958 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-ca549bf7-bfb4-4fef-8e51-87283ac75f89 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] 10.222.0.24 "GET /v2.0/subnets/fbed3548-0b3a-444f-b704-94cbef04d794 HTTP/1.1" status: 404 len: 337 time: 0.0348861 Nov 09 04:58:01.232693 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 35610) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:58:01.252288 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-bdb5bdf3-dd66-4532-abd6-fcd7179c8fc0 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] DELETE failed (client error): The resource could not be found. Nov 09 04:58:01.253007 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-bdb5bdf3-dd66-4532-abd6-fcd7179c8fc0 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:58:01.253667 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-1c170b8e-c30e-4d23-8d14-e002b617b795 None None] For port cbc17f3a-3035-4cad-b69a-e25fd870a1ae, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=cbc17f3a-3035-4cad-b69a-e25fd870a1ae,segment=NetworkSegment(ac7ef034-b35e-4c83-a16f-8e369988b0b4),segment_id=ac7ef034-b35e-4c83-a16f-8e369988b0b4)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:58:01.258982 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-bdb5bdf3-dd66-4532-abd6-fcd7179c8fc0 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] 10.222.0.24 "DELETE /v2.0/networks/d9e90241-ef0e-4b11-a129-871caf58025d HTTP/1.1" status: 404 len: 339 time: 0.0236170 Nov 09 04:58:01.260879 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 35612) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:58:01.287204 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-4cf3ffa3-4f0c-4dfc-adfd-fa25c5a08ebc tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] DELETE failed (client error): The resource could not be found. Nov 09 04:58:01.287657 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-4cf3ffa3-4f0c-4dfc-adfd-fa25c5a08ebc tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:58:01.290789 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-4cf3ffa3-4f0c-4dfc-adfd-fa25c5a08ebc tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] 10.222.0.24 "DELETE /v2.0/subnets/fbed3548-0b3a-444f-b704-94cbef04d794 HTTP/1.1" status: 404 len: 337 time: 0.0289946 Nov 09 04:58:01.293362 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 35614) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:58:01.312852 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-d55365b7-d54a-45fa-9e48-7bc854085732 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] DELETE failed (client error): The resource could not be found. Nov 09 04:58:01.313384 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d55365b7-d54a-45fa-9e48-7bc854085732 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:58:01.316986 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-d55365b7-d54a-45fa-9e48-7bc854085732 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] 10.222.0.24 "DELETE /v2.0/networks/d9e90241-ef0e-4b11-a129-871caf58025d HTTP/1.1" status: 404 len: 339 time: 0.0227091 Nov 09 04:58:01.320325 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 35616) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:58:01.371384 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1c170b8e-c30e-4d23-8d14-e002b617b795 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:01.379350 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-0f97429b-39cc-420a-809b-20514b603cb0 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Deleting subnet 79d5c9fe-c5bc-4606-bfe8-94cfbb54ab3b {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:58:01.383265 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0f97429b-39cc-420a-809b-20514b603cb0 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:01.423165 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c170b8e-c30e-4d23-8d14-e002b617b795 None None] Pushing event updated for resources: {'Port': ['ID=cbc17f3a-3035-4cad-b69a-e25fd870a1ae,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:01.425666 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0f97429b-39cc-420a-809b-20514b603cb0 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:01.435671 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-705e453a-f621-4f68-bd12-d43dc84fc333 None None] get_active_networks_info from dv-neutron-816802-2-hyperv {{(pid=102163) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}} Nov 09 04:58:01.508656 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0f97429b-39cc-420a-809b-20514b603cb0 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:01.521591 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e6d413f4-1bd4-4832-a445-e492d3aa2cb5 None None] Provisioning complete for port cbc17f3a-3035-4cad-b69a-e25fd870a1ae triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:58:01.524649 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e6d413f4-1bd4-4832-a445-e492d3aa2cb5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:01.524827 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-705e453a-f621-4f68-bd12-d43dc84fc333 None None] Resources bound (agent type, host, resource id): {{(pid=102163) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 09 04:58:01.665695 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0f97429b-39cc-420a-809b-20514b603cb0 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:01.692785 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f97429b-39cc-420a-809b-20514b603cb0 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Pushing event deleted for resources: {'Subnet': ['ID=79d5c9fe-c5bc-4606-bfe8-94cfbb54ab3b,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:01.697195 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0f97429b-39cc-420a-809b-20514b603cb0 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:01.700433 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-0f97429b-39cc-420a-809b-20514b603cb0 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] 10.222.0.24 "DELETE /v2.0/subnets/79d5c9fe-c5bc-4606-bfe8-94cfbb54ab3b HTTP/1.1" status: 204 len: 168 time: 0.3791847 Nov 09 04:58:01.702898 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 35618) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:58:01.777099 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b59c124c-e4d6-4da7-9636-da596f0a3cf8 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:01.786030 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d2d38df0-7de6-41be-b635-ebc6a88c954f None None] Network caf8be65-a82f-4726-a2fb-4a168098a5dc requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:58:01.840587 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-b59c124c-e4d6-4da7-9636-da596f0a3cf8 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Deleting port cbc17f3a-3035-4cad-b69a-e25fd870a1ae {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:58:01.840929 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b59c124c-e4d6-4da7-9636-da596f0a3cf8 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:01.906802 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-b59c124c-e4d6-4da7-9636-da596f0a3cf8 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] For port cbc17f3a-3035-4cad-b69a-e25fd870a1ae, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=cbc17f3a-3035-4cad-b69a-e25fd870a1ae,segment=NetworkSegment(ac7ef034-b35e-4c83-a16f-8e369988b0b4),segment_id=ac7ef034-b35e-4c83-a16f-8e369988b0b4)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:58:01.907170 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b59c124c-e4d6-4da7-9636-da596f0a3cf8 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:01.920385 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-b59c124c-e4d6-4da7-9636-da596f0a3cf8 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Calling delete_port for cbc17f3a-3035-4cad-b69a-e25fd870a1ae owned by network:dhcp {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:58:01.973289 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c997d967-525e-4d37-90c2-29961cdec6d5 None None] DHCP port deletion for caf8be65-a82f-4726-a2fb-4a168098a5dc request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:58:02.021686 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-c997d967-525e-4d37-90c2-29961cdec6d5 None None] Deleting port cbc17f3a-3035-4cad-b69a-e25fd870a1ae {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:58:02.026506 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c997d967-525e-4d37-90c2-29961cdec6d5 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:02.073511 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b59c124c-e4d6-4da7-9636-da596f0a3cf8 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:02.087364 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-c997d967-525e-4d37-90c2-29961cdec6d5 None None] For port cbc17f3a-3035-4cad-b69a-e25fd870a1ae, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=cbc17f3a-3035-4cad-b69a-e25fd870a1ae,segment=NetworkSegment(ac7ef034-b35e-4c83-a16f-8e369988b0b4),segment_id=ac7ef034-b35e-4c83-a16f-8e369988b0b4)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:58:02.088117 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c997d967-525e-4d37-90c2-29961cdec6d5 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:02.098337 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b59c124c-e4d6-4da7-9636-da596f0a3cf8 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Pushing event deleted for resources: {'Port': ['ID=cbc17f3a-3035-4cad-b69a-e25fd870a1ae,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:02.101250 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-c997d967-525e-4d37-90c2-29961cdec6d5 None None] Calling delete_port for cbc17f3a-3035-4cad-b69a-e25fd870a1ae owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:58:02.103525 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b59c124c-e4d6-4da7-9636-da596f0a3cf8 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] No DVR routers for this DVR port cbc17f3a-3035-4cad-b69a-e25fd870a1ae on host dv-neutron-816802-2-hyperv {{(pid=102161) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:58:02.178377 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c997d967-525e-4d37-90c2-29961cdec6d5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:02.183999 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b59c124c-e4d6-4da7-9636-da596f0a3cf8 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:02.204115 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-b59c124c-e4d6-4da7-9636-da596f0a3cf8 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['caf8be65-a82f-4726-a2fb-4a168098a5dc']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:58:02.204433 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c997d967-525e-4d37-90c2-29961cdec6d5 None None] Pushing event deleted for resources: {'Port': ['ID=cbc17f3a-3035-4cad-b69a-e25fd870a1ae,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:02.210558 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c997d967-525e-4d37-90c2-29961cdec6d5 None None] No DVR routers for this DVR port cbc17f3a-3035-4cad-b69a-e25fd870a1ae on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:58:02.214465 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-b59c124c-e4d6-4da7-9636-da596f0a3cf8 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ac7ef034-b35e-4c83-a16f-8e369988b0b4') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:58:02.214768 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-b59c124c-e4d6-4da7-9636-da596f0a3cf8 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ac7ef034-b35e-4c83-a16f-8e369988b0b4') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:58:02.228483 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b59c124c-e4d6-4da7-9636-da596f0a3cf8 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:02.241138 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b59c124c-e4d6-4da7-9636-da596f0a3cf8 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:02.246829 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b59c124c-e4d6-4da7-9636-da596f0a3cf8 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Releasing vlan 321 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:58:02.247234 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b59c124c-e4d6-4da7-9636-da596f0a3cf8 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:02.250100 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:58:02.250100 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:58:02.250100 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:58:02.250100 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:58:02.250100 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:58:02.250100 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:58:02.250100 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:58:02.250100 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:58:02.250100 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:58:02.250100 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:58:02.250100 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:58:02.250100 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:58:02.250100 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:58:02.250100 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:58:02.250100 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:58:02.250100 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:58:02.250100 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:58:02.250100 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:58:02.250100 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:58:02.250100 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:58:02.250100 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:58:02.250100 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:58:02.250100 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:58:02.250100 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:58:02.250100 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:58:02.250100 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:58:02.250100 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:58:02.250100 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:58:02.250100 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:58:02.250100 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:58:02.250100 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:58:02.250100 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:58:02.459972 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b59c124c-e4d6-4da7-9636-da596f0a3cf8 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:02.466437 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b59c124c-e4d6-4da7-9636-da596f0a3cf8 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:02.473718 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-b59c124c-e4d6-4da7-9636-da596f0a3cf8 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] 10.222.0.24 "DELETE /v2.0/networks/caf8be65-a82f-4726-a2fb-4a168098a5dc HTTP/1.1" status: 204 len: 168 time: 0.7657511 Nov 09 04:58:02.473718 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 35620) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:58:02.489180 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b59c124c-e4d6-4da7-9636-da596f0a3cf8 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Pushing event deleted for resources: {'Network': ['ID=caf8be65-a82f-4726-a2fb-4a168098a5dc,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:02.506638 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-1dd3589e-3236-4c65-bae3-80d551db8be9 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] DELETE failed (client error): The resource could not be found. Nov 09 04:58:02.507088 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-1dd3589e-3236-4c65-bae3-80d551db8be9 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:58:02.510053 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1dd3589e-3236-4c65-bae3-80d551db8be9 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] 10.222.0.24 "DELETE /v2.0/subnets/ed964ad8-df5e-4a69-b3d5-311fed2acf17 HTTP/1.1" status: 404 len: 337 time: 0.0371900 Nov 09 04:58:02.512551 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 35622) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:58:02.534119 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-2c3489b1-4e6a-40a3-a140-6271492fb2d8 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] DELETE failed (client error): The resource could not be found. Nov 09 04:58:02.534664 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2c3489b1-4e6a-40a3-a140-6271492fb2d8 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:58:02.538172 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-2c3489b1-4e6a-40a3-a140-6271492fb2d8 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] 10.222.0.24 "DELETE /v2.0/networks/b19c579a-2030-46c4-82e7-ea556f6abb24 HTTP/1.1" status: 404 len: 339 time: 0.0247185 Nov 09 04:58:02.540616 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 35624) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:58:02.565053 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-99361bf6-52d6-4a1d-8f88-7baa180ed482 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] DELETE failed (client error): The resource could not be found. Nov 09 04:58:02.565495 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-99361bf6-52d6-4a1d-8f88-7baa180ed482 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:58:02.568967 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-99361bf6-52d6-4a1d-8f88-7baa180ed482 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] 10.222.0.24 "DELETE /v2.0/subnets/00031a89-bf66-4943-9b3c-0e3d32652582 HTTP/1.1" status: 404 len: 337 time: 0.0274673 Nov 09 04:58:02.571621 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 35626) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:58:02.588978 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.pecan_wsgi.hooks.translation [None req-ea22400b-4841-4722-abb2-bd9f282177ab tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] DELETE failed (client error): The resource could not be found. Nov 09 04:58:02.589491 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ea22400b-4841-4722-abb2-bd9f282177ab tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=102161) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 09 04:58:02.592390 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-ea22400b-4841-4722-abb2-bd9f282177ab tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] 10.222.0.24 "DELETE /v2.0/networks/c5ff9a0b-5251-4f0e-8ce7-dc82cd1c9fb4 HTTP/1.1" status: 404 len: 339 time: 0.0199089 Nov 09 04:58:02.594537 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 35628) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:58:02.647229 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-8304eb7c-b7d7-490f-bb08-c9b5ecf938dc tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Deleting subnet 92e65bd6-175d-4443-9f6d-fb7b4ec7f89d {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:58:02.650243 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8304eb7c-b7d7-490f-bb08-c9b5ecf938dc tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:02.687667 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8304eb7c-b7d7-490f-bb08-c9b5ecf938dc tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:02.774680 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8304eb7c-b7d7-490f-bb08-c9b5ecf938dc tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:02.936580 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8304eb7c-b7d7-490f-bb08-c9b5ecf938dc tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:02.963691 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8304eb7c-b7d7-490f-bb08-c9b5ecf938dc tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Pushing event deleted for resources: {'Subnet': ['ID=92e65bd6-175d-4443-9f6d-fb7b4ec7f89d,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:02.967503 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8304eb7c-b7d7-490f-bb08-c9b5ecf938dc tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:02.975730 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-8304eb7c-b7d7-490f-bb08-c9b5ecf938dc tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] 10.222.0.24 "DELETE /v2.0/subnets/92e65bd6-175d-4443-9f6d-fb7b4ec7f89d HTTP/1.1" status: 204 len: 168 time: 0.3750579 Nov 09 04:58:02.975730 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 35630) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:58:02.975937 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6d1921ed-9e7d-4e41-aad3-08d029bbc561 None None] Network 23a1cc12-0a26-4ec6-87a6-8bfb5940c9da requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:58:03.057402 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-50e642d8-8241-412b-abdc-f2525d7cab09 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:03.104095 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-50e642d8-8241-412b-abdc-f2525d7cab09 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Deleting port e3aa4845-32bf-4f88-89b1-6fbb49902f73 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:58:03.104432 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-50e642d8-8241-412b-abdc-f2525d7cab09 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:03.141961 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0f05ef3e-4c36-40ce-9471-0438bbbce4ca None None] DHCP port deletion for 23a1cc12-0a26-4ec6-87a6-8bfb5940c9da request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:58:03.170707 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-50e642d8-8241-412b-abdc-f2525d7cab09 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] For port e3aa4845-32bf-4f88-89b1-6fbb49902f73, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=e3aa4845-32bf-4f88-89b1-6fbb49902f73,segment=NetworkSegment(86a78ca8-eed0-4e64-b526-703b84bd00f9),segment_id=86a78ca8-eed0-4e64-b526-703b84bd00f9)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:58:03.171065 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-50e642d8-8241-412b-abdc-f2525d7cab09 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:03.183970 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-50e642d8-8241-412b-abdc-f2525d7cab09 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Calling delete_port for e3aa4845-32bf-4f88-89b1-6fbb49902f73 owned by network:dhcp {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:58:03.187208 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-0f05ef3e-4c36-40ce-9471-0438bbbce4ca None None] Deleting port e3aa4845-32bf-4f88-89b1-6fbb49902f73 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:58:03.187571 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0f05ef3e-4c36-40ce-9471-0438bbbce4ca None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:03.247959 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-0f05ef3e-4c36-40ce-9471-0438bbbce4ca None None] For port e3aa4845-32bf-4f88-89b1-6fbb49902f73, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=e3aa4845-32bf-4f88-89b1-6fbb49902f73,segment=NetworkSegment(86a78ca8-eed0-4e64-b526-703b84bd00f9),segment_id=86a78ca8-eed0-4e64-b526-703b84bd00f9)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:58:03.248346 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0f05ef3e-4c36-40ce-9471-0438bbbce4ca None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:03.260326 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-0f05ef3e-4c36-40ce-9471-0438bbbce4ca None None] Calling delete_port for e3aa4845-32bf-4f88-89b1-6fbb49902f73 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:58:03.461975 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-50e642d8-8241-412b-abdc-f2525d7cab09 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:03.467539 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0f05ef3e-4c36-40ce-9471-0438bbbce4ca None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:03.488516 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-50e642d8-8241-412b-abdc-f2525d7cab09 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] No DVR routers for this DVR port e3aa4845-32bf-4f88-89b1-6fbb49902f73 on host dv-neutron-816802-2-hyperv {{(pid=102161) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:58:03.492312 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f05ef3e-4c36-40ce-9471-0438bbbce4ca None None] Pushing event deleted for resources: {'Port': ['ID=e3aa4845-32bf-4f88-89b1-6fbb49902f73,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:03.495376 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50e642d8-8241-412b-abdc-f2525d7cab09 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Pushing event deleted for resources: {'Port': ['ID=e3aa4845-32bf-4f88-89b1-6fbb49902f73,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:03.495931 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0f05ef3e-4c36-40ce-9471-0438bbbce4ca None None] No DVR routers for this DVR port e3aa4845-32bf-4f88-89b1-6fbb49902f73 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:58:03.574000 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-50e642d8-8241-412b-abdc-f2525d7cab09 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:03.593779 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-50e642d8-8241-412b-abdc-f2525d7cab09 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['23a1cc12-0a26-4ec6-87a6-8bfb5940c9da']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:58:03.602812 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-50e642d8-8241-412b-abdc-f2525d7cab09 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '86a78ca8-eed0-4e64-b526-703b84bd00f9') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:58:03.603113 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-50e642d8-8241-412b-abdc-f2525d7cab09 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '86a78ca8-eed0-4e64-b526-703b84bd00f9') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:58:03.612600 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-50e642d8-8241-412b-abdc-f2525d7cab09 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:03.625317 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-50e642d8-8241-412b-abdc-f2525d7cab09 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:03.631592 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-50e642d8-8241-412b-abdc-f2525d7cab09 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Releasing vlan 312 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:58:03.631969 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-50e642d8-8241-412b-abdc-f2525d7cab09 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:03.634899 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:58:03.634899 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:58:03.634899 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:58:03.634899 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:58:03.634899 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:58:03.634899 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:58:03.634899 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:58:03.634899 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:58:03.634899 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:58:03.634899 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:58:03.634899 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:58:03.634899 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:58:03.634899 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:58:03.634899 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:58:03.634899 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:58:03.634899 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:58:03.634899 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:58:03.634899 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:58:03.634899 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:58:03.634899 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:58:03.634899 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:58:03.634899 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:58:03.634899 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:58:03.634899 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:58:03.634899 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:58:03.634899 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:58:03.634899 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:58:03.634899 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:58:03.634899 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:58:03.634899 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:58:03.634899 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:58:03.634899 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:58:03.819569 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-50e642d8-8241-412b-abdc-f2525d7cab09 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:03.826280 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-50e642d8-8241-412b-abdc-f2525d7cab09 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:03.829381 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-50e642d8-8241-412b-abdc-f2525d7cab09 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] 10.222.0.24 "DELETE /v2.0/networks/23a1cc12-0a26-4ec6-87a6-8bfb5940c9da HTTP/1.1" status: 204 len: 168 time: 0.8554468 Nov 09 04:58:03.840550 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50e642d8-8241-412b-abdc-f2525d7cab09 tempest-NetworksIpV6Test-930917776 tempest-NetworksIpV6Test-930917776-project] Pushing event deleted for resources: {'Network': ['ID=23a1cc12-0a26-4ec6-87a6-8bfb5940c9da,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:04.037284 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device e3aa4845-32bf-4f88-89b1-6fbb49902f73 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:58:04.058125 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: e3aa4845-32bf-4f88-89b1-6fbb49902f73 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:58:04.058508 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device e3aa4845-32bf-4f88-89b1-6fbb49902f73 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:58:04.423216 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 35636) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:58:04.549418 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-ff668699-ebd0-45d9-b13a-4b1c26c7fe33 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=e55ec79f5db54cacbb98ecafe15a9128&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1250474 Nov 09 04:58:04.551915 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 35640) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:58:04.597299 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-998321a1-e6ee-4ab3-bd6e-582836dd1105 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:04.618000 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-998321a1-e6ee-4ab3-bd6e-582836dd1105 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:04.825187 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-998321a1-e6ee-4ab3-bd6e-582836dd1105 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:04.835477 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-998321a1-e6ee-4ab3-bd6e-582836dd1105 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:04.835477 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-998321a1-e6ee-4ab3-bd6e-582836dd1105 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/7cccfc23-47fc-4891-a74a-1822922233a9 HTTP/1.1" status: 204 len: 168 time: 0.2762060 Nov 09 04:58:04.837359 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-998321a1-e6ee-4ab3-bd6e-582836dd1105 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7cccfc23-47fc-4891-a74a-1822922233a9,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:04.844367 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-998321a1-e6ee-4ab3-bd6e-582836dd1105 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:58:04.844711 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-998321a1-e6ee-4ab3-bd6e-582836dd1105 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:58:04.845047 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-998321a1-e6ee-4ab3-bd6e-582836dd1105 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:58:04.845378 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-998321a1-e6ee-4ab3-bd6e-582836dd1105 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:58:04.845705 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-998321a1-e6ee-4ab3-bd6e-582836dd1105 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:58:04.846031 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-998321a1-e6ee-4ab3-bd6e-582836dd1105 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:58:04.846492 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-998321a1-e6ee-4ab3-bd6e-582836dd1105 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:58:04.846724 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-998321a1-e6ee-4ab3-bd6e-582836dd1105 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:58:04.847044 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-998321a1-e6ee-4ab3-bd6e-582836dd1105 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:58:04.847379 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-998321a1-e6ee-4ab3-bd6e-582836dd1105 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:58:04.847685 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-998321a1-e6ee-4ab3-bd6e-582836dd1105 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:58:04.847993 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-998321a1-e6ee-4ab3-bd6e-582836dd1105 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:58:06.111477 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 35662) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:58:06.203113 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-f5ecf188-2952-4c1f-90e8-63ebb49ec768 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Request body: {'router': {'name': 'tempest-RoutersNegativeTest-router-729587840', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:58:06.413640 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f5ecf188-2952-4c1f-90e8-63ebb49ec768 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:06.414638 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f5ecf188-2952-4c1f-90e8-63ebb49ec768 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:06.466829 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f5ecf188-2952-4c1f-90e8-63ebb49ec768 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:06.587909 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f5ecf188-2952-4c1f-90e8-63ebb49ec768 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:06.758748 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f5ecf188-2952-4c1f-90e8-63ebb49ec768 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:06.759900 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-f5ecf188-2952-4c1f-90e8-63ebb49ec768 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 707 time: 0.6474071 Nov 09 04:58:06.762630 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 35666) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:58:06.767239 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-c11284e0-a641-412a-8511-b844b2033acd tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Request body: {'network': {'name': 'tempest-RoutersNegativeTest-test-network-552382723'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:58:06.890481 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c11284e0-a641-412a-8511-b844b2033acd tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Made reservation on behalf of c85a35e3d69142b781fc92d665157e22 for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:58:06.893887 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c11284e0-a641-412a-8511-b844b2033acd tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:06.902557 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c11284e0-a641-412a-8511-b844b2033acd tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:06.972927 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c11284e0-a641-412a-8511-b844b2033acd tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:07.095939 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c11284e0-a641-412a-8511-b844b2033acd tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:07.122267 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c11284e0-a641-412a-8511-b844b2033acd tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 313} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:58:07.132142 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c11284e0-a641-412a-8511-b844b2033acd tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d52fc4dc-366f-465c-b3e6-0aaf7406be13,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:07.136696 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c11284e0-a641-412a-8511-b844b2033acd tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:07.137033 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-c11284e0-a641-412a-8511-b844b2033acd tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Added segment 728e2ee1-bb41-4509-b4ad-72a45405292b of type vlan for network 5d3e7be1-398c-4f8c-abc7-6b6613c7a390 Nov 09 04:58:07.175241 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c11284e0-a641-412a-8511-b844b2033acd tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:07.327786 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c11284e0-a641-412a-8511-b844b2033acd tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:07.333423 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c11284e0-a641-412a-8511-b844b2033acd tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:58:07.339566 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c11284e0-a641-412a-8511-b844b2033acd tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:07.396884 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c11284e0-a641-412a-8511-b844b2033acd tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Pushing event updated for resources: {'Network': ['ID=5d3e7be1-398c-4f8c-abc7-6b6613c7a390,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:07.407131 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 5d3e7be1-398c-4f8c-abc7-6b6613c7a390 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:58:07.533000 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-c11284e0-a641-412a-8511-b844b2033acd tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 786 time: 0.7693694 Nov 09 04:58:07.535771 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 35668) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:58:07.541064 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-60b7fc6a-070a-43e4-9203-16ee3ec784f6 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Request body: {'subnet': {'network_id': '5d3e7be1-398c-4f8c-abc7-6b6613c7a390', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:58:07.790932 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-60b7fc6a-070a-43e4-9203-16ee3ec784f6 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Made reservation on behalf of c85a35e3d69142b781fc92d665157e22 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:58:07.794524 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-60b7fc6a-070a-43e4-9203-16ee3ec784f6 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:08.333936 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-60b7fc6a-070a-43e4-9203-16ee3ec784f6 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:08.393342 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60b7fc6a-070a-43e4-9203-16ee3ec784f6 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Pushing event updated for resources: {'Subnet': ['ID=509afd50-2475-4ead-b704-2ec1e14ed3c9,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:08.400420 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-60b7fc6a-070a-43e4-9203-16ee3ec784f6 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Checking segment: {'id': '728e2ee1-bb41-4509-b4ad-72a45405292b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 313, 'network_id': '5d3e7be1-398c-4f8c-abc7-6b6613c7a390'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:58:08.400550 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-60b7fc6a-070a-43e4-9203-16ee3ec784f6 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Network hostable DHCP agents. Network: 5d3e7be1-398c-4f8c-abc7-6b6613c7a390, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:58:08.510243 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-60b7fc6a-070a-43e4-9203-16ee3ec784f6 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Network 5d3e7be1-398c-4f8c-abc7-6b6613c7a390 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:58:08.639048 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-60b7fc6a-070a-43e4-9203-16ee3ec784f6 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 5d3e7be1-398c-4f8c-abc7-6b6613c7a390) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:58:08.643187 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-60b7fc6a-070a-43e4-9203-16ee3ec784f6 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:58:08.643786 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-60b7fc6a-070a-43e4-9203-16ee3ec784f6 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:08.648501 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1c1fc7f0-d103-479f-b7db-0e6d2511b0bb None None] Network 5d3e7be1-398c-4f8c-abc7-6b6613c7a390 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:58:08.794043 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-322adb79-0ebe-4973-8a50-00b551aefabe None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-5d3e7be1-398c-4f8c-abc7-6b6613c7a390', 'network_id': '5d3e7be1-398c-4f8c-abc7-6b6613c7a390', 'tenant_id': 'c85a35e3d69142b781fc92d665157e22', 'fixed_ips': [{'subnet_id': '509afd50-2475-4ead-b704-2ec1e14ed3c9'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:58:08.794925 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-322adb79-0ebe-4973-8a50-00b551aefabe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:08.813492 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-60b7fc6a-070a-43e4-9203-16ee3ec784f6 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.2760630 Nov 09 04:58:08.818508 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 35670) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:58:08.824068 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-7fb84793-f0be-454d-a813-560483ffa34e tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Request body: {'network': {'name': 'tempest-RoutersNegativeTest-test-network-680788007'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:58:08.924727 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7fb84793-f0be-454d-a813-560483ffa34e tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Made reservation on behalf of c85a35e3d69142b781fc92d665157e22 for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:58:08.929547 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7fb84793-f0be-454d-a813-560483ffa34e tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:08.931254 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-322adb79-0ebe-4973-8a50-00b551aefabe None None] Allocated IP 172.20.0.2 (5d3e7be1-398c-4f8c-abc7-6b6613c7a390/509afd50-2475-4ead-b704-2ec1e14ed3c9/e100053b-c828-45ae-b77e-1c1849b71cde) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:58:08.956551 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7fb84793-f0be-454d-a813-560483ffa34e tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 340} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:58:08.969828 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7fb84793-f0be-454d-a813-560483ffa34e tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:08.970390 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-7fb84793-f0be-454d-a813-560483ffa34e tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Added segment 16e42065-1c61-44bf-8010-8ac428936444 of type vlan for network cd17c1ec-3ca3-4ffd-8817-84c369cd791e Nov 09 04:58:09.032482 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7fb84793-f0be-454d-a813-560483ffa34e tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:09.111593 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-322adb79-0ebe-4973-8a50-00b551aefabe None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:09.216494 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7fb84793-f0be-454d-a813-560483ffa34e tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:09.222147 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7fb84793-f0be-454d-a813-560483ffa34e tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:58:09.222765 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7fb84793-f0be-454d-a813-560483ffa34e tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:09.267825 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-322adb79-0ebe-4973-8a50-00b551aefabe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:09.290588 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fb84793-f0be-454d-a813-560483ffa34e tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Pushing event updated for resources: {'Network': ['ID=cd17c1ec-3ca3-4ffd-8817-84c369cd791e,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:09.302549 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network cd17c1ec-3ca3-4ffd-8817-84c369cd791e details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:58:09.329981 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-322adb79-0ebe-4973-8a50-00b551aefabe None None] Network 5d3e7be1-398c-4f8c-abc7-6b6613c7a390 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:58:09.336187 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-322adb79-0ebe-4973-8a50-00b551aefabe None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:58:09.339423 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-322adb79-0ebe-4973-8a50-00b551aefabe None None] Pushing event updated for resources: {'Port': ['ID=e100053b-c828-45ae-b77e-1c1849b71cde,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:09.405021 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-7fb84793-f0be-454d-a813-560483ffa34e tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 786 time: 0.5854378 Nov 09 04:58:09.407730 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 35672) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:58:09.413163 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-fdde2199-5c18-4b64-9504-8f49445a9000 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Request body: {'subnet': {'network_id': 'cd17c1ec-3ca3-4ffd-8817-84c369cd791e', 'cidr': '172.21.0.0/28', 'ip_version': 4, 'gateway_ip': '172.21.0.1'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:58:09.511991 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-322adb79-0ebe-4973-8a50-00b551aefabe None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:58:09.574643 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-322adb79-0ebe-4973-8a50-00b551aefabe None None] Attempting to bind port e100053b-c828-45ae-b77e-1c1849b71cde on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:58:09.576509 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-322adb79-0ebe-4973-8a50-00b551aefabe None None] Attempting to bind port e100053b-c828-45ae-b77e-1c1849b71cde by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '728e2ee1-bb41-4509-b4ad-72a45405292b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 313, 'network_id': '5d3e7be1-398c-4f8c-abc7-6b6613c7a390'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:58:09.576509 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-322adb79-0ebe-4973-8a50-00b551aefabe None None] Attempting to bind port e100053b-c828-45ae-b77e-1c1849b71cde on network 5d3e7be1-398c-4f8c-abc7-6b6613c7a390 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:58:09.580242 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-322adb79-0ebe-4973-8a50-00b551aefabe None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 57, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:58:09.580613 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-322adb79-0ebe-4973-8a50-00b551aefabe None None] Checking segment: {'id': '728e2ee1-bb41-4509-b4ad-72a45405292b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 313, 'network_id': '5d3e7be1-398c-4f8c-abc7-6b6613c7a390'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:58:09.581008 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-322adb79-0ebe-4973-8a50-00b551aefabe None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:09.581395 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-322adb79-0ebe-4973-8a50-00b551aefabe None None] Bound using segment: {'id': '728e2ee1-bb41-4509-b4ad-72a45405292b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 313, 'network_id': '5d3e7be1-398c-4f8c-abc7-6b6613c7a390'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:58:09.581858 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-322adb79-0ebe-4973-8a50-00b551aefabe None None] Bound port: e100053b-c828-45ae-b77e-1c1849b71cde, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '728e2ee1-bb41-4509-b4ad-72a45405292b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 313, 'network_id': '5d3e7be1-398c-4f8c-abc7-6b6613c7a390'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:58:09.582237 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-322adb79-0ebe-4973-8a50-00b551aefabe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:09.633056 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fdde2199-5c18-4b64-9504-8f49445a9000 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Made reservation on behalf of c85a35e3d69142b781fc92d665157e22 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:58:09.636645 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-fdde2199-5c18-4b64-9504-8f49445a9000 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:09.642150 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-322adb79-0ebe-4973-8a50-00b551aefabe None None] For port e100053b-c828-45ae-b77e-1c1849b71cde, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:58:09.645893 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-322adb79-0ebe-4973-8a50-00b551aefabe None None] For port e100053b-c828-45ae-b77e-1c1849b71cde, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=e100053b-c828-45ae-b77e-1c1849b71cde,segment=NetworkSegment(728e2ee1-bb41-4509-b4ad-72a45405292b),segment_id=728e2ee1-bb41-4509-b4ad-72a45405292b)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:58:09.779584 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-322adb79-0ebe-4973-8a50-00b551aefabe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:09.839346 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-322adb79-0ebe-4973-8a50-00b551aefabe None None] Pushing event updated for resources: {'Port': ['ID=e100053b-c828-45ae-b77e-1c1849b71cde,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:09.913564 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-fdde2199-5c18-4b64-9504-8f49445a9000 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:09.985929 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdde2199-5c18-4b64-9504-8f49445a9000 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Pushing event updated for resources: {'Subnet': ['ID=62bb0d8e-0be5-460b-9a7f-c7b18f37af28,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:09.995728 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fdde2199-5c18-4b64-9504-8f49445a9000 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Checking segment: {'id': '16e42065-1c61-44bf-8010-8ac428936444', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'cd17c1ec-3ca3-4ffd-8817-84c369cd791e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:58:09.996047 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fdde2199-5c18-4b64-9504-8f49445a9000 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Network hostable DHCP agents. Network: cd17c1ec-3ca3-4ffd-8817-84c369cd791e, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:58:10.089999 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device e100053b-c828-45ae-b77e-1c1849b71cde up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:58:10.136023 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fdde2199-5c18-4b64-9504-8f49445a9000 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Network cd17c1ec-3ca3-4ffd-8817-84c369cd791e is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:58:10.138594 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port e100053b-c828-45ae-b77e-1c1849b71cde triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:58:10.138972 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:10.213668 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:10.248252 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port e100053b-c828-45ae-b77e-1c1849b71cde, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=e100053b-c828-45ae-b77e-1c1849b71cde,segment=NetworkSegment(728e2ee1-bb41-4509-b4ad-72a45405292b),segment_id=728e2ee1-bb41-4509-b4ad-72a45405292b)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:58:10.250198 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-fdde2199-5c18-4b64-9504-8f49445a9000 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, cd17c1ec-3ca3-4ffd-8817-84c369cd791e) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:58:10.254548 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fdde2199-5c18-4b64-9504-8f49445a9000 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:58:10.259595 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-fdde2199-5c18-4b64-9504-8f49445a9000 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:10.263038 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ba32cb3f-f1a6-4a7b-b5d7-c7a4b1c74ed5 None None] Network cd17c1ec-3ca3-4ffd-8817-84c369cd791e requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:58:10.356789 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:10.384516 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-fdde2199-5c18-4b64-9504-8f49445a9000 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.9756260 Nov 09 04:58:10.387258 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 35674) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:58:10.392534 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-440886e7-7e9b-4dbc-848a-dbd753f14f51 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Request body: {'router': {'external_gateway_info': {'network_id': 'cd17c1ec-3ca3-4ffd-8817-84c369cd791e'}}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:58:10.437253 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=e100053b-c828-45ae-b77e-1c1849b71cde,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:10.441350 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6ce90525-60a6-491d-b5e7-1cd34cec0ba1 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-cd17c1ec-3ca3-4ffd-8817-84c369cd791e', 'network_id': 'cd17c1ec-3ca3-4ffd-8817-84c369cd791e', 'tenant_id': 'c85a35e3d69142b781fc92d665157e22', 'fixed_ips': [{'subnet_id': '62bb0d8e-0be5-460b-9a7f-c7b18f37af28'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:58:10.442431 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6ce90525-60a6-491d-b5e7-1cd34cec0ba1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:10.589780 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-6ce90525-60a6-491d-b5e7-1cd34cec0ba1 None None] Allocated IP 172.21.0.2 (cd17c1ec-3ca3-4ffd-8817-84c369cd791e/62bb0d8e-0be5-460b-9a7f-c7b18f37af28/8ac9b913-b4aa-4528-ba92-19617055875e) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:58:10.617644 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-440886e7-7e9b-4dbc-848a-dbd753f14f51 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:10.735519 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6ce90525-60a6-491d-b5e7-1cd34cec0ba1 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:10.754830 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9f6d6d9e-1cd0-47dd-8079-8b35aee0ff86 None None] Network 5d3e7be1-398c-4f8c-abc7-6b6613c7a390 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:58:10.804858 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.api.v2.resource [None req-440886e7-7e9b-4dbc-848a-dbd753f14f51 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] update failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 09 04:58:10.805909 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-440886e7-7e9b-4dbc-848a-dbd753f14f51 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] 10.222.0.24 "PUT /v2.0/routers/d5196b39-99a1-456f-ac36-ed6427dde929 HTTP/1.1" status: 400 len: 364 time: 0.4175217 Nov 09 04:58:10.811852 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 35676) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:58:10.847747 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6ce90525-60a6-491d-b5e7-1cd34cec0ba1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:10.864667 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-7be85bdf-ec94-4b57-b39c-75090dd65559 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Deleting subnet 62bb0d8e-0be5-460b-9a7f-c7b18f37af28 {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:58:10.867770 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7be85bdf-ec94-4b57-b39c-75090dd65559 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:10.908625 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7be85bdf-ec94-4b57-b39c-75090dd65559 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:10.909826 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-d366180f-acce-4a15-967f-80929ec994a3 None None] Provisioning complete for port e100053b-c828-45ae-b77e-1c1849b71cde triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:58:10.910196 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d366180f-acce-4a15-967f-80929ec994a3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:10.934073 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6ce90525-60a6-491d-b5e7-1cd34cec0ba1 None None] Network cd17c1ec-3ca3-4ffd-8817-84c369cd791e is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:58:10.955267 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-6ce90525-60a6-491d-b5e7-1cd34cec0ba1 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:58:10.956977 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ce90525-60a6-491d-b5e7-1cd34cec0ba1 None None] Pushing event updated for resources: {'Port': ['ID=8ac9b913-b4aa-4528-ba92-19617055875e,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:10.959706 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ce90525-60a6-491d-b5e7-1cd34cec0ba1 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:58:10.996565 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7be85bdf-ec94-4b57-b39c-75090dd65559 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:11.056108 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-6ce90525-60a6-491d-b5e7-1cd34cec0ba1 None None] Attempting to bind port 8ac9b913-b4aa-4528-ba92-19617055875e on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:58:11.056471 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-6ce90525-60a6-491d-b5e7-1cd34cec0ba1 None None] Attempting to bind port 8ac9b913-b4aa-4528-ba92-19617055875e by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '16e42065-1c61-44bf-8010-8ac428936444', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'cd17c1ec-3ca3-4ffd-8817-84c369cd791e'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:58:11.056833 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6ce90525-60a6-491d-b5e7-1cd34cec0ba1 None None] Attempting to bind port 8ac9b913-b4aa-4528-ba92-19617055875e on network cd17c1ec-3ca3-4ffd-8817-84c369cd791e {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:58:11.082592 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6ce90525-60a6-491d-b5e7-1cd34cec0ba1 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 57, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:58:11.083478 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6ce90525-60a6-491d-b5e7-1cd34cec0ba1 None None] Checking segment: {'id': '16e42065-1c61-44bf-8010-8ac428936444', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'cd17c1ec-3ca3-4ffd-8817-84c369cd791e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:58:11.083879 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6ce90525-60a6-491d-b5e7-1cd34cec0ba1 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:11.084269 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6ce90525-60a6-491d-b5e7-1cd34cec0ba1 None None] Bound using segment: {'id': '16e42065-1c61-44bf-8010-8ac428936444', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'cd17c1ec-3ca3-4ffd-8817-84c369cd791e'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:58:11.084749 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-6ce90525-60a6-491d-b5e7-1cd34cec0ba1 None None] Bound port: 8ac9b913-b4aa-4528-ba92-19617055875e, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '16e42065-1c61-44bf-8010-8ac428936444', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': 'cd17c1ec-3ca3-4ffd-8817-84c369cd791e'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:58:11.085128 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6ce90525-60a6-491d-b5e7-1cd34cec0ba1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:11.128367 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7be85bdf-ec94-4b57-b39c-75090dd65559 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:11.157008 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7be85bdf-ec94-4b57-b39c-75090dd65559 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Pushing event deleted for resources: {'Subnet': ['ID=62bb0d8e-0be5-460b-9a7f-c7b18f37af28,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:11.160517 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-6ce90525-60a6-491d-b5e7-1cd34cec0ba1 None None] For port 8ac9b913-b4aa-4528-ba92-19617055875e, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:58:11.160846 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7be85bdf-ec94-4b57-b39c-75090dd65559 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:11.164367 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-7be85bdf-ec94-4b57-b39c-75090dd65559 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] 10.222.0.24 "DELETE /v2.0/subnets/62bb0d8e-0be5-460b-9a7f-c7b18f37af28 HTTP/1.1" status: 204 len: 168 time: 0.3513505 Nov 09 04:58:11.165142 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-6ce90525-60a6-491d-b5e7-1cd34cec0ba1 None None] For port 8ac9b913-b4aa-4528-ba92-19617055875e, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=8ac9b913-b4aa-4528-ba92-19617055875e,segment=NetworkSegment(16e42065-1c61-44bf-8010-8ac428936444),segment_id=16e42065-1c61-44bf-8010-8ac428936444)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:58:11.166769 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 35678) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:58:11.242175 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6ce90525-60a6-491d-b5e7-1cd34cec0ba1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:11.250183 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6c851325-968b-4e72-af6a-4f58019ef440 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:11.307470 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-6c851325-968b-4e72-af6a-4f58019ef440 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Deleting port 8ac9b913-b4aa-4528-ba92-19617055875e {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:58:11.308072 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6c851325-968b-4e72-af6a-4f58019ef440 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:11.315224 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ce90525-60a6-491d-b5e7-1cd34cec0ba1 None None] Pushing event updated for resources: {'Port': ['ID=8ac9b913-b4aa-4528-ba92-19617055875e,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:11.332253 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-73109b6f-c988-4a93-92a9-01f35f17ff7f None None] Provisioning complete for port e100053b-c828-45ae-b77e-1c1849b71cde triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:58:11.333168 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-73109b6f-c988-4a93-92a9-01f35f17ff7f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:11.376376 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-6c851325-968b-4e72-af6a-4f58019ef440 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] For port 8ac9b913-b4aa-4528-ba92-19617055875e, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=8ac9b913-b4aa-4528-ba92-19617055875e,segment=NetworkSegment(16e42065-1c61-44bf-8010-8ac428936444),segment_id=16e42065-1c61-44bf-8010-8ac428936444)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:58:11.376698 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6c851325-968b-4e72-af6a-4f58019ef440 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:11.394740 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-6c851325-968b-4e72-af6a-4f58019ef440 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Calling delete_port for 8ac9b913-b4aa-4528-ba92-19617055875e owned by network:dhcp {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:58:11.400558 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-2be3d8d2-fbe3-475b-ad84-207e1c5cc675 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:11.550604 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6c851325-968b-4e72-af6a-4f58019ef440 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:11.578930 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c851325-968b-4e72-af6a-4f58019ef440 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Pushing event deleted for resources: {'Port': ['ID=8ac9b913-b4aa-4528-ba92-19617055875e,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:11.582781 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6c851325-968b-4e72-af6a-4f58019ef440 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] No DVR routers for this DVR port 8ac9b913-b4aa-4528-ba92-19617055875e on host dv-neutron-816802-2-hyperv {{(pid=102161) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:58:11.673727 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6c851325-968b-4e72-af6a-4f58019ef440 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:11.683646 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-6c851325-968b-4e72-af6a-4f58019ef440 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['cd17c1ec-3ca3-4ffd-8817-84c369cd791e']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:58:11.692639 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-6c851325-968b-4e72-af6a-4f58019ef440 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '16e42065-1c61-44bf-8010-8ac428936444') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:58:11.692929 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-6c851325-968b-4e72-af6a-4f58019ef440 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '16e42065-1c61-44bf-8010-8ac428936444') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:58:11.702530 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6c851325-968b-4e72-af6a-4f58019ef440 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:11.715623 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6c851325-968b-4e72-af6a-4f58019ef440 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:11.722036 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6c851325-968b-4e72-af6a-4f58019ef440 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Releasing vlan 340 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:58:11.722463 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6c851325-968b-4e72-af6a-4f58019ef440 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:11.726010 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:58:11.726010 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:58:11.726010 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:58:11.726010 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:58:11.726010 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:58:11.726010 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:58:11.726010 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:58:11.726010 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:58:11.726010 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:58:11.726010 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:58:11.726010 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:58:11.726010 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:58:11.726010 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:58:11.726010 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:58:11.726010 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:58:11.726010 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:58:11.726010 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:58:11.726010 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:58:11.726010 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:58:11.726010 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:58:11.726010 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:58:11.726010 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:58:11.726010 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:58:11.726010 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:58:11.726010 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:58:11.726010 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:58:11.726010 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:58:11.726010 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:58:11.726010 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:58:11.726010 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:58:11.726010 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:58:11.726010 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:58:11.859216 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6c851325-968b-4e72-af6a-4f58019ef440 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:11.866801 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6c851325-968b-4e72-af6a-4f58019ef440 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:11.870870 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-6c851325-968b-4e72-af6a-4f58019ef440 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] 10.222.0.24 "DELETE /v2.0/networks/cd17c1ec-3ca3-4ffd-8817-84c369cd791e HTTP/1.1" status: 204 len: 168 time: 0.7021399 Nov 09 04:58:11.872697 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 35680) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:58:11.883165 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c851325-968b-4e72-af6a-4f58019ef440 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Pushing event deleted for resources: {'Network': ['ID=cd17c1ec-3ca3-4ffd-8817-84c369cd791e,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:11.933582 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-24efbc49-cca4-4443-bef6-a66d921c0a5d tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Deleting subnet 509afd50-2475-4ead-b704-2ec1e14ed3c9 {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 04:58:11.937064 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-24efbc49-cca4-4443-bef6-a66d921c0a5d tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:11.978548 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-24efbc49-cca4-4443-bef6-a66d921c0a5d tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:12.068388 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device e100053b-c828-45ae-b77e-1c1849b71cde up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:58:12.069820 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-24efbc49-cca4-4443-bef6-a66d921c0a5d tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:12.124246 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port e100053b-c828-45ae-b77e-1c1849b71cde triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:58:12.124612 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:12.185091 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-24efbc49-cca4-4443-bef6-a66d921c0a5d tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:12.216233 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24efbc49-cca4-4443-bef6-a66d921c0a5d tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Pushing event deleted for resources: {'Subnet': ['ID=509afd50-2475-4ead-b704-2ec1e14ed3c9,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:12.220092 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-24efbc49-cca4-4443-bef6-a66d921c0a5d tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:12.223979 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-24efbc49-cca4-4443-bef6-a66d921c0a5d tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] 10.222.0.24 "DELETE /v2.0/subnets/509afd50-2475-4ead-b704-2ec1e14ed3c9 HTTP/1.1" status: 204 len: 168 time: 0.3496056 Nov 09 04:58:12.226560 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 35682) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:58:12.232205 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bfeb6855-3efb-464f-846f-90ca907c27f5 None None] Network 5d3e7be1-398c-4f8c-abc7-6b6613c7a390 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:58:12.281090 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-4a354065-1047-4ee0-b090-6795e26291c4 None None] Could not find standard attr ID for object 8ac9b913-b4aa-4528-ba92-19617055875e. {{(pid=102163) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 09 04:58:12.289723 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f47c2b04-b92c-4863-992b-43ee8c1ae544 None None] DHCP port deletion for cd17c1ec-3ca3-4ffd-8817-84c369cd791e request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:58:12.304392 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d63f84b4-5b04-46ec-8281-1038b15ce0aa tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:12.325144 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ece67e8c-e8fe-4cee-b564-7e017cbe19c9 None None] Network cd17c1ec-3ca3-4ffd-8817-84c369cd791e requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:58:12.358905 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-d63f84b4-5b04-46ec-8281-1038b15ce0aa tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Deleting port e100053b-c828-45ae-b77e-1c1849b71cde {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:58:12.359247 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d63f84b4-5b04-46ec-8281-1038b15ce0aa tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:12.360393 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ece67e8c-e8fe-4cee-b564-7e017cbe19c9 None None] Network cd17c1ec-3ca3-4ffd-8817-84c369cd791e could not be found, it might have been deleted concurrently. {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:225}} Nov 09 04:58:12.427643 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-d63f84b4-5b04-46ec-8281-1038b15ce0aa tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] For port e100053b-c828-45ae-b77e-1c1849b71cde, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=e100053b-c828-45ae-b77e-1c1849b71cde,segment=NetworkSegment(728e2ee1-bb41-4509-b4ad-72a45405292b),segment_id=728e2ee1-bb41-4509-b4ad-72a45405292b)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:58:12.428009 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d63f84b4-5b04-46ec-8281-1038b15ce0aa tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:12.438848 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:12.440466 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-d63f84b4-5b04-46ec-8281-1038b15ce0aa tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Calling delete_port for e100053b-c828-45ae-b77e-1c1849b71cde owned by network:dhcp {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:58:12.459087 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-38c0fa54-2a0f-4470-a8be-069982f911a2 None None] DHCP port deletion for 5d3e7be1-398c-4f8c-abc7-6b6613c7a390 request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 04:58:12.505383 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-38c0fa54-2a0f-4470-a8be-069982f911a2 None None] Deleting port e100053b-c828-45ae-b77e-1c1849b71cde {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:58:12.505750 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-38c0fa54-2a0f-4470-a8be-069982f911a2 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:12.569398 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-38c0fa54-2a0f-4470-a8be-069982f911a2 None None] For port e100053b-c828-45ae-b77e-1c1849b71cde, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=e100053b-c828-45ae-b77e-1c1849b71cde,segment=NetworkSegment(728e2ee1-bb41-4509-b4ad-72a45405292b),segment_id=728e2ee1-bb41-4509-b4ad-72a45405292b)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:58:12.569788 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-38c0fa54-2a0f-4470-a8be-069982f911a2 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:12.582564 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-38c0fa54-2a0f-4470-a8be-069982f911a2 None None] Calling delete_port for e100053b-c828-45ae-b77e-1c1849b71cde owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:58:12.610150 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d63f84b4-5b04-46ec-8281-1038b15ce0aa tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:12.639422 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d63f84b4-5b04-46ec-8281-1038b15ce0aa tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Pushing event deleted for resources: {'Port': ['ID=e100053b-c828-45ae-b77e-1c1849b71cde,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:12.644046 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d63f84b4-5b04-46ec-8281-1038b15ce0aa tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] No DVR routers for this DVR port e100053b-c828-45ae-b77e-1c1849b71cde on host dv-neutron-816802-2-hyperv {{(pid=102161) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:58:12.655469 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-38c0fa54-2a0f-4470-a8be-069982f911a2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:12.680059 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38c0fa54-2a0f-4470-a8be-069982f911a2 None None] Pushing event deleted for resources: {'Port': ['ID=e100053b-c828-45ae-b77e-1c1849b71cde,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:12.683628 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-38c0fa54-2a0f-4470-a8be-069982f911a2 None None] No DVR routers for this DVR port e100053b-c828-45ae-b77e-1c1849b71cde on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:58:12.726459 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d63f84b4-5b04-46ec-8281-1038b15ce0aa tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:12.747003 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-d63f84b4-5b04-46ec-8281-1038b15ce0aa tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5d3e7be1-398c-4f8c-abc7-6b6613c7a390']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:58:12.756693 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-d63f84b4-5b04-46ec-8281-1038b15ce0aa tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '728e2ee1-bb41-4509-b4ad-72a45405292b') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:58:12.756987 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-d63f84b4-5b04-46ec-8281-1038b15ce0aa tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '728e2ee1-bb41-4509-b4ad-72a45405292b') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:58:12.770593 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d63f84b4-5b04-46ec-8281-1038b15ce0aa tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:12.783134 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d63f84b4-5b04-46ec-8281-1038b15ce0aa tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:12.788754 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d63f84b4-5b04-46ec-8281-1038b15ce0aa tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Releasing vlan 313 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 04:58:12.789127 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d63f84b4-5b04-46ec-8281-1038b15ce0aa tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:12.794146 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 04:58:12.794146 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 04:58:12.794146 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 04:58:12.794146 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 04:58:12.794146 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 04:58:12.794146 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 04:58:12.794146 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 04:58:12.794146 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 04:58:12.794146 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 04:58:12.794146 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 04:58:12.794146 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 04:58:12.794146 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 04:58:12.794146 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 04:58:12.794146 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 04:58:12.794146 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 04:58:12.794146 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 04:58:12.794146 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 04:58:12.794146 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 04:58:12.794146 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 04:58:12.794146 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 04:58:12.794146 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 04:58:12.794146 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 04:58:12.794146 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 04:58:12.794146 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 04:58:12.794146 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 04:58:12.794146 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 04:58:12.794146 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 04:58:12.794146 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 04:58:12.794146 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 04:58:12.794146 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 04:58:12.794146 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 04:58:12.794146 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 04:58:12.922126 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d63f84b4-5b04-46ec-8281-1038b15ce0aa tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:12.929426 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d63f84b4-5b04-46ec-8281-1038b15ce0aa tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:12.932647 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-d63f84b4-5b04-46ec-8281-1038b15ce0aa tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] 10.222.0.24 "DELETE /v2.0/networks/5d3e7be1-398c-4f8c-abc7-6b6613c7a390 HTTP/1.1" status: 204 len: 168 time: 0.7047956 Nov 09 04:58:12.935937 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 35684) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:58:12.947420 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d63f84b4-5b04-46ec-8281-1038b15ce0aa tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Pushing event deleted for resources: {'Network': ['ID=5d3e7be1-398c-4f8c-abc7-6b6613c7a390,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:12.963715 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-ffc9ae70-0afd-45df-9f9e-7c7714bc9d6d tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] 10.222.0.24 "GET /v2.0/ports?device_id=d5196b39-99a1-456f-ac36-ed6427dde929 HTTP/1.1" status: 200 len: 205 time: 0.0266488 Nov 09 04:58:12.967710 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 35686) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:58:13.039474 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9a64c558-809e-4ed8-b1d3-4b4db17b8cc9 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks [] for router, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:13.191387 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9a64c558-809e-4ed8-b1d3-4b4db17b8cc9 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:13.193488 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9a64c558-809e-4ed8-b1d3-4b4db17b8cc9 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:13.304556 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9a64c558-809e-4ed8-b1d3-4b4db17b8cc9 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:13.305068 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9a64c558-809e-4ed8-b1d3-4b4db17b8cc9 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Fanout notify agent at l3_agent the message router_deleted on router d5196b39-99a1-456f-ac36-ed6427dde929 {{(pid=102162) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 04:58:13.311970 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9a64c558-809e-4ed8-b1d3-4b4db17b8cc9 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:13.314814 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-9a64c558-809e-4ed8-b1d3-4b4db17b8cc9 tempest-RoutersNegativeTest-953037415 tempest-RoutersNegativeTest-953037415-project] 10.222.0.24 "DELETE /v2.0/routers/d5196b39-99a1-456f-ac36-ed6427dde929 HTTP/1.1" status: 204 len: 168 time: 0.3461676 Nov 09 04:58:13.707062 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c41440a2-2d2c-4708-919e-3bcb59fb9e19 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:13.759013 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 35692) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:58:13.890943 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-10cdde45-4024-4da4-b1cd-eff95fb61c4c admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=c85a35e3d69142b781fc92d665157e22&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1307864 Nov 09 04:58:13.893272 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 35696) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:58:13.938554 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-efb2bb28-5599-4f42-a412-116787a9390f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:13.960185 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-efb2bb28-5599-4f42-a412-116787a9390f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:14.052997 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 8ac9b913-b4aa-4528-ba92-19617055875e no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:58:14.076658 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 8ac9b913-b4aa-4528-ba92-19617055875e {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:58:14.076930 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 8ac9b913-b4aa-4528-ba92-19617055875e not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:58:14.077340 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device e100053b-c828-45ae-b77e-1c1849b71cde no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:58:14.087604 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-efb2bb28-5599-4f42-a412-116787a9390f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:14.090302 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-efb2bb28-5599-4f42-a412-116787a9390f admin admin] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:14.091461 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-efb2bb28-5599-4f42-a412-116787a9390f admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/d52fc4dc-366f-465c-b3e6-0aaf7406be13 HTTP/1.1" status: 204 len: 168 time: 0.1973047 Nov 09 04:58:14.096331 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: e100053b-c828-45ae-b77e-1c1849b71cde {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:58:14.097647 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device e100053b-c828-45ae-b77e-1c1849b71cde not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:58:14.099435 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-efb2bb28-5599-4f42-a412-116787a9390f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d52fc4dc-366f-465c-b3e6-0aaf7406be13,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:15.190077 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 35718) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:58:15.239263 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:15.287619 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-6d3b1ffd-8d27-4d9a-8499-02e1b667affa admin admin] Request body: {'network': {'name': 'tempest-TestEncryptedCinderVolumes-389564536-network', 'tenant_id': '7a7a505be3334ab3b14ba7506d59802d'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:58:15.433214 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6d3b1ffd-8d27-4d9a-8499-02e1b667affa admin admin] Made reservation on behalf of 7a7a505be3334ab3b14ba7506d59802d for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:58:15.435666 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6d3b1ffd-8d27-4d9a-8499-02e1b667affa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:15.444428 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6d3b1ffd-8d27-4d9a-8499-02e1b667affa admin admin] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:15.516220 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6d3b1ffd-8d27-4d9a-8499-02e1b667affa admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:15.633326 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6d3b1ffd-8d27-4d9a-8499-02e1b667affa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:15.657755 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6d3b1ffd-8d27-4d9a-8499-02e1b667affa admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 336} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:58:15.667036 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d3b1ffd-8d27-4d9a-8499-02e1b667affa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=38ad7e09-c43f-42df-a8ec-4b9fe996949f,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:15.671488 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6d3b1ffd-8d27-4d9a-8499-02e1b667affa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:15.671818 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-6d3b1ffd-8d27-4d9a-8499-02e1b667affa admin admin] Added segment be836a59-b961-4a22-8321-d34bfacbfc89 of type vlan for network fccebd84-efb7-429a-baa9-bc8330d63138 Nov 09 04:58:15.713280 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6d3b1ffd-8d27-4d9a-8499-02e1b667affa admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:16.259003 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6d3b1ffd-8d27-4d9a-8499-02e1b667affa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:16.259915 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6d3b1ffd-8d27-4d9a-8499-02e1b667affa admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:58:16.260505 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6d3b1ffd-8d27-4d9a-8499-02e1b667affa admin admin] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:16.316339 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d3b1ffd-8d27-4d9a-8499-02e1b667affa admin admin] Pushing event updated for resources: {'Network': ['ID=fccebd84-efb7-429a-baa9-bc8330d63138,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:16.325845 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network fccebd84-efb7-429a-baa9-bc8330d63138 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:58:16.395911 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-6d3b1ffd-8d27-4d9a-8499-02e1b667affa admin admin] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 889 time: 1.2042062 Nov 09 04:58:16.398740 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 35722) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:58:16.403313 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-7c6e1a28-bd85-48c7-a94f-8fd18605dac3 admin admin] Request body: {'subnet': {'network_id': 'fccebd84-efb7-429a-baa9-bc8330d63138', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestEncryptedCinderVolumes-389564536-subnet', 'tenant_id': '7a7a505be3334ab3b14ba7506d59802d', 'ip_version': 4}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:58:16.578657 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7c6e1a28-bd85-48c7-a94f-8fd18605dac3 admin admin] Made reservation on behalf of 7a7a505be3334ab3b14ba7506d59802d for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:58:16.580949 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7c6e1a28-bd85-48c7-a94f-8fd18605dac3 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:16.604234 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:16.790522 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7c6e1a28-bd85-48c7-a94f-8fd18605dac3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:16.845459 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c6e1a28-bd85-48c7-a94f-8fd18605dac3 admin admin] Pushing event updated for resources: {'Subnet': ['ID=f0cd2ee2-fde7-47c0-bf41-7e97bc17cff8,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:16.853745 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7c6e1a28-bd85-48c7-a94f-8fd18605dac3 admin admin] Checking segment: {'id': 'be836a59-b961-4a22-8321-d34bfacbfc89', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': 'fccebd84-efb7-429a-baa9-bc8330d63138'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:58:16.854094 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7c6e1a28-bd85-48c7-a94f-8fd18605dac3 admin admin] Network hostable DHCP agents. Network: fccebd84-efb7-429a-baa9-bc8330d63138, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:58:16.938904 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7c6e1a28-bd85-48c7-a94f-8fd18605dac3 admin admin] Network fccebd84-efb7-429a-baa9-bc8330d63138 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:58:16.970272 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:17.038280 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-7c6e1a28-bd85-48c7-a94f-8fd18605dac3 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, fccebd84-efb7-429a-baa9-bc8330d63138) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:58:17.042300 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7c6e1a28-bd85-48c7-a94f-8fd18605dac3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:58:17.042922 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7c6e1a28-bd85-48c7-a94f-8fd18605dac3 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:17.046531 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5264b0ac-e724-4447-811f-4c63d19de1e9 None None] Network fccebd84-efb7-429a-baa9-bc8330d63138 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:58:17.135914 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-7c6e1a28-bd85-48c7-a94f-8fd18605dac3 admin admin] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 0.7360549 Nov 09 04:58:17.138479 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 35724) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:58:17.143389 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-0a1399d1-b4cc-41c1-b7a2-b14eae1d5843 admin admin] Request body: {'router': {'name': 'tempest-TestEncryptedCinderVolumes-389564536-router', 'tenant_id': '7a7a505be3334ab3b14ba7506d59802d', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:58:17.185938 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c556ae62-0feb-446d-8adb-8ea24daf4c91 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-fccebd84-efb7-429a-baa9-bc8330d63138', 'network_id': 'fccebd84-efb7-429a-baa9-bc8330d63138', 'tenant_id': '7a7a505be3334ab3b14ba7506d59802d', 'fixed_ips': [{'subnet_id': 'f0cd2ee2-fde7-47c0-bf41-7e97bc17cff8'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:58:17.186827 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c556ae62-0feb-446d-8adb-8ea24daf4c91 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:17.253391 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0a1399d1-b4cc-41c1-b7a2-b14eae1d5843 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:17.254459 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0a1399d1-b4cc-41c1-b7a2-b14eae1d5843 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:17.307745 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0a1399d1-b4cc-41c1-b7a2-b14eae1d5843 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:17.320442 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-c556ae62-0feb-446d-8adb-8ea24daf4c91 None None] Allocated IP 172.20.0.2 (fccebd84-efb7-429a-baa9-bc8330d63138/f0cd2ee2-fde7-47c0-bf41-7e97bc17cff8/dbb20c30-ca89-42ca-b822-3e371439c571) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:58:17.502812 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c556ae62-0feb-446d-8adb-8ea24daf4c91 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:17.516654 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0a1399d1-b4cc-41c1-b7a2-b14eae1d5843 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:17.601540 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c556ae62-0feb-446d-8adb-8ea24daf4c91 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:17.641575 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c556ae62-0feb-446d-8adb-8ea24daf4c91 None None] Network fccebd84-efb7-429a-baa9-bc8330d63138 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:58:17.647022 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-c556ae62-0feb-446d-8adb-8ea24daf4c91 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:58:17.658183 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c556ae62-0feb-446d-8adb-8ea24daf4c91 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:58:17.659132 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c556ae62-0feb-446d-8adb-8ea24daf4c91 None None] Pushing event updated for resources: {'Port': ['ID=dbb20c30-ca89-42ca-b822-3e371439c571,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:17.711512 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-c556ae62-0feb-446d-8adb-8ea24daf4c91 None None] Attempting to bind port dbb20c30-ca89-42ca-b822-3e371439c571 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:58:17.711872 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-c556ae62-0feb-446d-8adb-8ea24daf4c91 None None] Attempting to bind port dbb20c30-ca89-42ca-b822-3e371439c571 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'be836a59-b961-4a22-8321-d34bfacbfc89', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': 'fccebd84-efb7-429a-baa9-bc8330d63138'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:58:17.712230 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c556ae62-0feb-446d-8adb-8ea24daf4c91 None None] Attempting to bind port dbb20c30-ca89-42ca-b822-3e371439c571 on network fccebd84-efb7-429a-baa9-bc8330d63138 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:58:17.726338 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c556ae62-0feb-446d-8adb-8ea24daf4c91 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 58, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:58:17.726338 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c556ae62-0feb-446d-8adb-8ea24daf4c91 None None] Checking segment: {'id': 'be836a59-b961-4a22-8321-d34bfacbfc89', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': 'fccebd84-efb7-429a-baa9-bc8330d63138'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:58:17.726338 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c556ae62-0feb-446d-8adb-8ea24daf4c91 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:17.726338 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c556ae62-0feb-446d-8adb-8ea24daf4c91 None None] Bound using segment: {'id': 'be836a59-b961-4a22-8321-d34bfacbfc89', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': 'fccebd84-efb7-429a-baa9-bc8330d63138'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:58:17.726338 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-c556ae62-0feb-446d-8adb-8ea24daf4c91 None None] Bound port: dbb20c30-ca89-42ca-b822-3e371439c571, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'be836a59-b961-4a22-8321-d34bfacbfc89', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': 'fccebd84-efb7-429a-baa9-bc8330d63138'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:58:17.726338 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c556ae62-0feb-446d-8adb-8ea24daf4c91 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:17.779923 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-c556ae62-0feb-446d-8adb-8ea24daf4c91 None None] For port dbb20c30-ca89-42ca-b822-3e371439c571, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:58:17.782998 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-c556ae62-0feb-446d-8adb-8ea24daf4c91 None None] For port dbb20c30-ca89-42ca-b822-3e371439c571, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=dbb20c30-ca89-42ca-b822-3e371439c571,segment=NetworkSegment(be836a59-b961-4a22-8321-d34bfacbfc89),segment_id=be836a59-b961-4a22-8321-d34bfacbfc89)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:58:17.822218 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0a1399d1-b4cc-41c1-b7a2-b14eae1d5843 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:17.840780 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0a1399d1-b4cc-41c1-b7a2-b14eae1d5843 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:17.862066 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c556ae62-0feb-446d-8adb-8ea24daf4c91 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:17.930059 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c556ae62-0feb-446d-8adb-8ea24daf4c91 None None] Pushing event updated for resources: {'Port': ['ID=dbb20c30-ca89-42ca-b822-3e371439c571,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:17.949374 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-0a1399d1-b4cc-41c1-b7a2-b14eae1d5843 admin admin] Allocated IP 172.26.0.144 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/e047caaa-2c99-4fed-adde-3ce05d586db6) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:58:18.072330 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0a1399d1-b4cc-41c1-b7a2-b14eae1d5843 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:18.162259 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0a1399d1-b4cc-41c1-b7a2-b14eae1d5843 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:18.203650 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0a1399d1-b4cc-41c1-b7a2-b14eae1d5843 admin admin] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:58:18.206603 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-0a1399d1-b4cc-41c1-b7a2-b14eae1d5843 admin admin] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:58:18.211496 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0a1399d1-b4cc-41c1-b7a2-b14eae1d5843 admin admin] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:58:18.214530 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a1399d1-b4cc-41c1-b7a2-b14eae1d5843 admin admin] Pushing event updated for resources: {'Port': ['ID=e047caaa-2c99-4fed-adde-3ce05d586db6,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:18.525841 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0a1399d1-b4cc-41c1-b7a2-b14eae1d5843 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:18.731703 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0a1399d1-b4cc-41c1-b7a2-b14eae1d5843 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:18.779035 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-578c22c4-6d00-49b0-a8d2-cc9b43d1852b None None] Network fccebd84-efb7-429a-baa9-bc8330d63138 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:58:18.866151 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-b526fcd7-f602-40b5-87af-711814378442 None None] Provisioning complete for port dbb20c30-ca89-42ca-b822-3e371439c571 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:58:18.866459 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b526fcd7-f602-40b5-87af-711814378442 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:18.947535 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0a1399d1-b4cc-41c1-b7a2-b14eae1d5843 admin admin] Router ec949f32-500d-4daa-9463-8a606200ee0a is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102162) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:58:19.056804 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0a1399d1-b4cc-41c1-b7a2-b14eae1d5843 admin admin] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:58:19.070534 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e3156d4b-be63-4b9d-bf64-b2e10fd3ace3 None None] Sync routers for ids ['ec949f32-500d-4daa-9463-8a606200ee0a'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:58:19.097992 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e3156d4b-be63-4b9d-bf64-b2e10fd3ace3 None None] Routers {'ec949f32-500d-4daa-9463-8a606200ee0a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:58:19.098687 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-e3156d4b-be63-4b9d-bf64-b2e10fd3ace3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:58:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['ec949f32-500d-4daa-9463-8a606200ee0a'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:58:19.161324 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0a1399d1-b4cc-41c1-b7a2-b14eae1d5843 admin admin] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:19.162531 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-0a1399d1-b4cc-41c1-b7a2-b14eae1d5843 admin admin] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 928 time: 2.0230477 Nov 09 04:58:19.165247 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 35726) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:58:19.236484 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b526fcd7-f602-40b5-87af-711814378442 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:19.273911 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-e3156d4b-be63-4b9d-bf64-b2e10fd3ace3 None None] Set router ec949f32-500d-4daa-9463-8a606200ee0a gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:58:19.346920 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-b526fcd7-f602-40b5-87af-711814378442 None None] For port dbb20c30-ca89-42ca-b822-3e371439c571, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=dbb20c30-ca89-42ca-b822-3e371439c571,segment=NetworkSegment(be836a59-b961-4a22-8321-d34bfacbfc89),segment_id=be836a59-b961-4a22-8321-d34bfacbfc89)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:58:19.445425 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b526fcd7-f602-40b5-87af-711814378442 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:19.505754 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b526fcd7-f602-40b5-87af-711814378442 None None] Pushing event updated for resources: {'Port': ['ID=dbb20c30-ca89-42ca-b822-3e371439c571,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:19.513757 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-e3156d4b-be63-4b9d-bf64-b2e10fd3ace3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ec949f32-500d-4daa-9463-8a606200ee0a', 'name': 'tempest-TestEncryptedCinderVolumes-389564536-router', 'tenant_id': '7a7a505be3334ab3b14ba7506d59802d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.144'}], 'enable_snat': True}, 'gw_port_id': 'e047caaa-2c99-4fed-adde-3ce05d586db6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:58:17Z', 'updated_at': '2021-11-09T04:58:18Z', 'revision_number': 3, 'project_id': '7a7a505be3334ab3b14ba7506d59802d', 'gw_port': {'id': 'e047caaa-2c99-4fed-adde-3ce05d586db6', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:90:1b:b1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ec949f32-500d-4daa-9463-8a606200ee0a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1641, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.144', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:58:17Z', 'updated_at': '2021-11-09T04:58:17Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:58:19.517188 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b526fcd7-f602-40b5-87af-711814378442 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:58:19.517536 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b526fcd7-f602-40b5-87af-711814378442 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:58:19.517874 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b526fcd7-f602-40b5-87af-711814378442 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:58:19.518206 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b526fcd7-f602-40b5-87af-711814378442 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:58:19.518562 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b526fcd7-f602-40b5-87af-711814378442 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:58:19.518892 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b526fcd7-f602-40b5-87af-711814378442 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:58:19.519217 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b526fcd7-f602-40b5-87af-711814378442 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:58:19.519544 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b526fcd7-f602-40b5-87af-711814378442 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:58:19.519886 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b526fcd7-f602-40b5-87af-711814378442 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:58:19.520192 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b526fcd7-f602-40b5-87af-711814378442 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:58:19.520559 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b526fcd7-f602-40b5-87af-711814378442 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:58:19.520876 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b526fcd7-f602-40b5-87af-711814378442 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:58:19.551275 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e3156d4b-be63-4b9d-bf64-b2e10fd3ace3 None None] Checking router: ec949f32-500d-4daa-9463-8a606200ee0a for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:58:19.552085 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e3156d4b-be63-4b9d-bf64-b2e10fd3ace3 None None] Updating router ec949f32-500d-4daa-9463-8a606200ee0a port e047caaa-2c99-4fed-adde-3ce05d586db6 binding host dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 04:58:19.584495 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e3156d4b-be63-4b9d-bf64-b2e10fd3ace3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:19.588400 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-669f2da6-ec8f-4f21-9205-5642d4df89cd None None] Provisioning complete for port dbb20c30-ca89-42ca-b822-3e371439c571 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:58:19.588756 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-669f2da6-ec8f-4f21-9205-5642d4df89cd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:19.589801 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5a89ca32-dcb0-48cd-b6fc-1db3436bf341 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:19.811980 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-5a89ca32-dcb0-48cd-b6fc-1db3436bf341 admin admin] Allocated IP 172.20.0.1 (fccebd84-efb7-429a-baa9-bc8330d63138/f0cd2ee2-fde7-47c0-bf41-7e97bc17cff8/7b539bb4-5b78-4d71-803e-0556d1aa8da8) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:58:19.894839 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e3156d4b-be63-4b9d-bf64-b2e10fd3ace3 None None] Publish callbacks [] for port, precommit_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:19.919929 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5a89ca32-dcb0-48cd-b6fc-1db3436bf341 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:19.952788 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e3156d4b-be63-4b9d-bf64-b2e10fd3ace3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:20.000261 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5a89ca32-dcb0-48cd-b6fc-1db3436bf341 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:20.004630 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-e3156d4b-be63-4b9d-bf64-b2e10fd3ace3 None None] Attempting to bind port e047caaa-2c99-4fed-adde-3ce05d586db6 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:58:20.005010 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-e3156d4b-be63-4b9d-bf64-b2e10fd3ace3 None None] Attempting to bind port e047caaa-2c99-4fed-adde-3ce05d586db6 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:58:20.005450 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e3156d4b-be63-4b9d-bf64-b2e10fd3ace3 None None] Attempting to bind port e047caaa-2c99-4fed-adde-3ce05d586db6 on network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:58:20.007288 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34d2e301-7ae2-4373-8b56-ccc1bd873640 None None] Pushing event updated for resources: {'Port': ['ID=e047caaa-2c99-4fed-adde-3ce05d586db6,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:20.012821 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e3156d4b-be63-4b9d-bf64-b2e10fd3ace3 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 58, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:58:20.013186 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e3156d4b-be63-4b9d-bf64-b2e10fd3ace3 None None] Checking segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:58:20.013588 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e3156d4b-be63-4b9d-bf64-b2e10fd3ace3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:20.013975 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e3156d4b-be63-4b9d-bf64-b2e10fd3ace3 None None] Bound using segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:58:20.014471 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-e3156d4b-be63-4b9d-bf64-b2e10fd3ace3 None None] Bound port: e047caaa-2c99-4fed-adde-3ce05d586db6, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:58:20.015141 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e3156d4b-be63-4b9d-bf64-b2e10fd3ace3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:20.040209 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5a89ca32-dcb0-48cd-b6fc-1db3436bf341 admin admin] Network fccebd84-efb7-429a-baa9-bc8330d63138 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:58:20.043113 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-5a89ca32-dcb0-48cd-b6fc-1db3436bf341 admin admin] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:58:20.049239 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5a89ca32-dcb0-48cd-b6fc-1db3436bf341 admin admin] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:58:20.075958 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a89ca32-dcb0-48cd-b6fc-1db3436bf341 admin admin] Pushing event updated for resources: {'Port': ['ID=7b539bb4-5b78-4d71-803e-0556d1aa8da8,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:20.085952 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e3156d4b-be63-4b9d-bf64-b2e10fd3ace3 None None] For port e047caaa-2c99-4fed-adde-3ce05d586db6, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:58:20.092861 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e3156d4b-be63-4b9d-bf64-b2e10fd3ace3 None None] For port e047caaa-2c99-4fed-adde-3ce05d586db6, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=e047caaa-2c99-4fed-adde-3ce05d586db6,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:58:20.106926 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5a89ca32-dcb0-48cd-b6fc-1db3436bf341 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:20.111214 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device dbb20c30-ca89-42ca-b822-3e371439c571 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:58:20.163109 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e3156d4b-be63-4b9d-bf64-b2e10fd3ace3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:20.194455 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port dbb20c30-ca89-42ca-b822-3e371439c571 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:58:20.195026 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:20.260347 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e3156d4b-be63-4b9d-bf64-b2e10fd3ace3 None None] Routers {'ec949f32-500d-4daa-9463-8a606200ee0a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:58:20.260971 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-e3156d4b-be63-4b9d-bf64-b2e10fd3ace3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:58:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['ec949f32-500d-4daa-9463-8a606200ee0a'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:58:20.263564 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34d2e301-7ae2-4373-8b56-ccc1bd873640 None None] Pushing event updated for resources: {'Port': ['ID=e047caaa-2c99-4fed-adde-3ce05d586db6,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:20.382728 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-908f9bb8-3e1a-45d0-b2aa-edce1f1d17d5 None None] Provisioning complete for port 7b539bb4-5b78-4d71-803e-0556d1aa8da8 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:58:20.382994 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-908f9bb8-3e1a-45d0-b2aa-edce1f1d17d5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:20.431989 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-e3156d4b-be63-4b9d-bf64-b2e10fd3ace3 None None] Set router ec949f32-500d-4daa-9463-8a606200ee0a gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:58:20.482217 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5a89ca32-dcb0-48cd-b6fc-1db3436bf341 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:20.494174 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-908f9bb8-3e1a-45d0-b2aa-edce1f1d17d5 None None] Port 7b539bb4-5b78-4d71-803e-0556d1aa8da8 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:58:20.626945 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-e3156d4b-be63-4b9d-bf64-b2e10fd3ace3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ec949f32-500d-4daa-9463-8a606200ee0a', 'name': 'tempest-TestEncryptedCinderVolumes-389564536-router', 'tenant_id': '7a7a505be3334ab3b14ba7506d59802d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.144'}], 'enable_snat': True}, 'gw_port_id': 'e047caaa-2c99-4fed-adde-3ce05d586db6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:58:17Z', 'updated_at': '2021-11-09T04:58:18Z', 'revision_number': 3, 'project_id': '7a7a505be3334ab3b14ba7506d59802d', 'gw_port': {'id': 'e047caaa-2c99-4fed-adde-3ce05d586db6', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:90:1b:b1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ec949f32-500d-4daa-9463-8a606200ee0a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1641, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.144', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:58:17Z', 'updated_at': '2021-11-09T04:58:20Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:58:20.656748 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5a89ca32-dcb0-48cd-b6fc-1db3436bf341 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:20.658506 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e3156d4b-be63-4b9d-bf64-b2e10fd3ace3 None None] The sync data for ids ['ec949f32-500d-4daa-9463-8a606200ee0a'] in dv-neutron-816802-2-hyperv is: [{'id': 'ec949f32-500d-4daa-9463-8a606200ee0a', 'name': 'tempest-TestEncryptedCinderVolumes-389564536-router', 'tenant_id': '7a7a505be3334ab3b14ba7506d59802d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.144'}], 'enable_snat': True}, 'gw_port_id': 'e047caaa-2c99-4fed-adde-3ce05d586db6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:58:17Z', 'updated_at': '2021-11-09T04:58:18Z', 'revision_number': 3, 'project_id': '7a7a505be3334ab3b14ba7506d59802d', 'gw_port': {'id': 'e047caaa-2c99-4fed-adde-3ce05d586db6', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:90:1b:b1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ec949f32-500d-4daa-9463-8a606200ee0a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1641, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.144', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:58:17Z', 'updated_at': '2021-11-09T04:58:20Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:58:20.778605 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5a89ca32-dcb0-48cd-b6fc-1db3436bf341 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:20.849105 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a89ca32-dcb0-48cd-b6fc-1db3436bf341 admin admin] Pushing event updated for resources: {'Port': ['ID=7b539bb4-5b78-4d71-803e-0556d1aa8da8,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:20.856473 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5a89ca32-dcb0-48cd-b6fc-1db3436bf341 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:20.976215 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5a89ca32-dcb0-48cd-b6fc-1db3436bf341 admin admin] Network fccebd84-efb7-429a-baa9-bc8330d63138 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:58:20.977435 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-5a89ca32-dcb0-48cd-b6fc-1db3436bf341 admin admin] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:58:21.218159 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-b0e04893-7a85-4a95-a1cd-83c5a36a014c None None] Provisioning complete for port 7b539bb4-5b78-4d71-803e-0556d1aa8da8 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:58:21.218787 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b0e04893-7a85-4a95-a1cd-83c5a36a014c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:21.254964 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-b0e04893-7a85-4a95-a1cd-83c5a36a014c None None] Port 7b539bb4-5b78-4d71-803e-0556d1aa8da8 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:58:21.464631 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5a89ca32-dcb0-48cd-b6fc-1db3436bf341 admin admin] Router ec949f32-500d-4daa-9463-8a606200ee0a has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:58:21.568508 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5a89ca32-dcb0-48cd-b6fc-1db3436bf341 admin admin] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:58:21.573731 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-5a89ca32-dcb0-48cd-b6fc-1db3436bf341 admin admin] 10.222.0.24 "PUT /v2.0/routers/ec949f32-500d-4daa-9463-8a606200ee0a/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.4075398 Nov 09 04:58:22.075288 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device e047caaa-2c99-4fed-adde-3ce05d586db6 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:58:22.124572 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port e047caaa-2c99-4fed-adde-3ce05d586db6 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:58:22.124938 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:22.185285 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-59f5df03-1666-4ee3-8594-d27996bd9f2d None None] Sync routers for ids ['ec949f32-500d-4daa-9463-8a606200ee0a'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:58:22.195988 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-59f5df03-1666-4ee3-8594-d27996bd9f2d None None] Routers {'ec949f32-500d-4daa-9463-8a606200ee0a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:58:22.196598 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-59f5df03-1666-4ee3-8594-d27996bd9f2d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:58:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['ec949f32-500d-4daa-9463-8a606200ee0a'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:58:22.204820 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:22.224857 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port e047caaa-2c99-4fed-adde-3ce05d586db6, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=e047caaa-2c99-4fed-adde-3ce05d586db6,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:58:22.304938 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-59f5df03-1666-4ee3-8594-d27996bd9f2d None None] Set router ec949f32-500d-4daa-9463-8a606200ee0a gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:58:22.347487 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 35742) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:58:22.353012 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-6daa3da5-b661-4477-8782-12d34568a72d admin admin] Request body: {'network': {'name': 'tempest-TestEncryptedCinderVolumes-648135690-network', 'tenant_id': 'b5e6af7f8d2f4eb088b2468c61ba0da9'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:58:22.362330 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:22.413949 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=e047caaa-2c99-4fed-adde-3ce05d586db6,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:22.481715 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6daa3da5-b661-4477-8782-12d34568a72d admin admin] Made reservation on behalf of b5e6af7f8d2f4eb088b2468c61ba0da9 for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:58:22.484194 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6daa3da5-b661-4477-8782-12d34568a72d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:22.493847 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6daa3da5-b661-4477-8782-12d34568a72d admin admin] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:22.568633 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6daa3da5-b661-4477-8782-12d34568a72d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:22.593976 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-59f5df03-1666-4ee3-8594-d27996bd9f2d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ec949f32-500d-4daa-9463-8a606200ee0a', 'name': 'tempest-TestEncryptedCinderVolumes-389564536-router', 'tenant_id': '7a7a505be3334ab3b14ba7506d59802d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.144'}], 'enable_snat': True}, 'gw_port_id': 'e047caaa-2c99-4fed-adde-3ce05d586db6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:58:17Z', 'updated_at': '2021-11-09T04:58:20Z', 'revision_number': 4, 'project_id': '7a7a505be3334ab3b14ba7506d59802d', 'gw_port': {'id': 'e047caaa-2c99-4fed-adde-3ce05d586db6', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:90:1b:b1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ec949f32-500d-4daa-9463-8a606200ee0a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1641, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.144', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:58:17Z', 'updated_at': '2021-11-09T04:58:20Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '7b539bb4-5b78-4d71-803e-0556d1aa8da8', 'name': '', 'network_id': 'fccebd84-efb7-429a-baa9-bc8330d63138', 'tenant_id': '7a7a505be3334ab3b14ba7506d59802d', 'mac_address': 'fa:16:3e:59:2d:e4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ec949f32-500d-4daa-9463-8a606200ee0a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1642, 'fixed_ips': [{'subnet_id': 'f0cd2ee2-fde7-47c0-bf41-7e97bc17cff8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:58:19Z', 'updated_at': '2021-11-09T04:58:20Z', 'revision_number': 2, 'project_id': '7a7a505be3334ab3b14ba7506d59802d', 'subnets': [{'id': 'f0cd2ee2-fde7-47c0-bf41-7e97bc17cff8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:58:22.619951 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-59f5df03-1666-4ee3-8594-d27996bd9f2d None None] Checking router: ec949f32-500d-4daa-9463-8a606200ee0a for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:58:22.620296 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-59f5df03-1666-4ee3-8594-d27996bd9f2d None None] Updating router ec949f32-500d-4daa-9463-8a606200ee0a port 7b539bb4-5b78-4d71-803e-0556d1aa8da8 binding host dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 04:58:22.647164 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-59f5df03-1666-4ee3-8594-d27996bd9f2d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:22.672659 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6daa3da5-b661-4477-8782-12d34568a72d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:22.697477 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6daa3da5-b661-4477-8782-12d34568a72d admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 305} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 04:58:22.707139 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6daa3da5-b661-4477-8782-12d34568a72d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a1bbd5ba-7082-4a6d-9263-8f5abd861a5a,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:22.712419 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6daa3da5-b661-4477-8782-12d34568a72d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:22.712691 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-6daa3da5-b661-4477-8782-12d34568a72d admin admin] Added segment 1e97e40d-a8b1-455b-bcdd-f98ceb5b4e55 of type vlan for network ad4e0f1a-ae6b-4246-89ee-e51e6f860d5f Nov 09 04:58:22.754649 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6daa3da5-b661-4477-8782-12d34568a72d admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:22.841607 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6daa3da5-b661-4477-8782-12d34568a72d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:22.842648 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6daa3da5-b661-4477-8782-12d34568a72d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:58:22.843230 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6daa3da5-b661-4477-8782-12d34568a72d admin admin] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:22.908137 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-59f5df03-1666-4ee3-8594-d27996bd9f2d None None] Publish callbacks [] for port, precommit_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:22.910305 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6daa3da5-b661-4477-8782-12d34568a72d admin admin] Pushing event updated for resources: {'Network': ['ID=ad4e0f1a-ae6b-4246-89ee-e51e6f860d5f,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:22.920505 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network ad4e0f1a-ae6b-4246-89ee-e51e6f860d5f details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 04:58:22.938812 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-6daa3da5-b661-4477-8782-12d34568a72d admin admin] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 889 time: 0.5897079 Nov 09 04:58:22.941412 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 35744) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:58:22.947220 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-db333ce5-fe85-4a24-9d69-c98723ccd088 admin admin] Request body: {'subnet': {'network_id': 'ad4e0f1a-ae6b-4246-89ee-e51e6f860d5f', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestEncryptedCinderVolumes-648135690-subnet', 'tenant_id': 'b5e6af7f8d2f4eb088b2468c61ba0da9', 'ip_version': 4}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:58:22.972949 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-59f5df03-1666-4ee3-8594-d27996bd9f2d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:23.029935 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b081e46-eaaa-4732-8d0e-2fb427b88627 None None] Pushing event updated for resources: {'Port': ['ID=7b539bb4-5b78-4d71-803e-0556d1aa8da8,revision_number=3']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:23.036051 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-db333ce5-fe85-4a24-9d69-c98723ccd088 admin admin] Made reservation on behalf of b5e6af7f8d2f4eb088b2468c61ba0da9 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:58:23.039077 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-db333ce5-fe85-4a24-9d69-c98723ccd088 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:23.055355 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b081e46-eaaa-4732-8d0e-2fb427b88627 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:58:23.056030 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b081e46-eaaa-4732-8d0e-2fb427b88627 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:58:23.056545 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b081e46-eaaa-4732-8d0e-2fb427b88627 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:58:23.057045 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b081e46-eaaa-4732-8d0e-2fb427b88627 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:58:23.057562 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b081e46-eaaa-4732-8d0e-2fb427b88627 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:58:23.058036 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b081e46-eaaa-4732-8d0e-2fb427b88627 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:58:23.058549 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b081e46-eaaa-4732-8d0e-2fb427b88627 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:58:23.059196 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b081e46-eaaa-4732-8d0e-2fb427b88627 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:58:23.059675 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b081e46-eaaa-4732-8d0e-2fb427b88627 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:58:23.060149 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b081e46-eaaa-4732-8d0e-2fb427b88627 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:58:23.060619 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b081e46-eaaa-4732-8d0e-2fb427b88627 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:58:23.061088 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b081e46-eaaa-4732-8d0e-2fb427b88627 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:58:23.097544 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-59f5df03-1666-4ee3-8594-d27996bd9f2d None None] Attempting to bind port 7b539bb4-5b78-4d71-803e-0556d1aa8da8 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:58:23.098211 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-59f5df03-1666-4ee3-8594-d27996bd9f2d None None] Attempting to bind port 7b539bb4-5b78-4d71-803e-0556d1aa8da8 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'be836a59-b961-4a22-8321-d34bfacbfc89', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': 'fccebd84-efb7-429a-baa9-bc8330d63138'}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:58:23.098776 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59f5df03-1666-4ee3-8594-d27996bd9f2d None None] Attempting to bind port 7b539bb4-5b78-4d71-803e-0556d1aa8da8 on network fccebd84-efb7-429a-baa9-bc8330d63138 {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:58:23.104943 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59f5df03-1666-4ee3-8594-d27996bd9f2d None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 58, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:58:23.105621 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59f5df03-1666-4ee3-8594-d27996bd9f2d None None] Checking segment: {'id': 'be836a59-b961-4a22-8321-d34bfacbfc89', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': 'fccebd84-efb7-429a-baa9-bc8330d63138'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102164) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:58:23.106179 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-59f5df03-1666-4ee3-8594-d27996bd9f2d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:23.106747 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59f5df03-1666-4ee3-8594-d27996bd9f2d None None] Bound using segment: {'id': 'be836a59-b961-4a22-8321-d34bfacbfc89', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': 'fccebd84-efb7-429a-baa9-bc8330d63138'} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:58:23.107390 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-59f5df03-1666-4ee3-8594-d27996bd9f2d None None] Bound port: 7b539bb4-5b78-4d71-803e-0556d1aa8da8, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'be836a59-b961-4a22-8321-d34bfacbfc89', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': 'fccebd84-efb7-429a-baa9-bc8330d63138'}}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:58:23.107937 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-59f5df03-1666-4ee3-8594-d27996bd9f2d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:23.188243 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-59f5df03-1666-4ee3-8594-d27996bd9f2d None None] For port 7b539bb4-5b78-4d71-803e-0556d1aa8da8, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102164) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:58:23.191639 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-59f5df03-1666-4ee3-8594-d27996bd9f2d None None] For port 7b539bb4-5b78-4d71-803e-0556d1aa8da8, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=7b539bb4-5b78-4d71-803e-0556d1aa8da8,segment=NetworkSegment(be836a59-b961-4a22-8321-d34bfacbfc89),segment_id=be836a59-b961-4a22-8321-d34bfacbfc89)] {{(pid=102164) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:58:23.267532 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-59f5df03-1666-4ee3-8594-d27996bd9f2d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:23.294346 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-3c54a222-d6e7-4b28-8f09-7587c2988cb3 None None] Provisioning complete for port 7b539bb4-5b78-4d71-803e-0556d1aa8da8 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:58:23.295004 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3c54a222-d6e7-4b28-8f09-7587c2988cb3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:23.320850 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-db333ce5-fe85-4a24-9d69-c98723ccd088 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:23.341108 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-59f5df03-1666-4ee3-8594-d27996bd9f2d None None] Routers {'ec949f32-500d-4daa-9463-8a606200ee0a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:58:23.341955 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-59f5df03-1666-4ee3-8594-d27996bd9f2d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:58:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['ec949f32-500d-4daa-9463-8a606200ee0a'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:58:23.377309 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3c54a222-d6e7-4b28-8f09-7587c2988cb3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:23.383783 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b081e46-eaaa-4732-8d0e-2fb427b88627 None None] Pushing event updated for resources: {'Port': ['ID=7b539bb4-5b78-4d71-803e-0556d1aa8da8,revision_number=4']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:23.405100 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db333ce5-fe85-4a24-9d69-c98723ccd088 admin admin] Pushing event updated for resources: {'Subnet': ['ID=1ffa6a42-d392-423f-81d8-d1b418f2edd3,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:23.407408 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-db333ce5-fe85-4a24-9d69-c98723ccd088 admin admin] Checking segment: {'id': '1e97e40d-a8b1-455b-bcdd-f98ceb5b4e55', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 305, 'network_id': 'ad4e0f1a-ae6b-4246-89ee-e51e6f860d5f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:58:23.408263 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-db333ce5-fe85-4a24-9d69-c98723ccd088 admin admin] Network hostable DHCP agents. Network: ad4e0f1a-ae6b-4246-89ee-e51e6f860d5f, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 04:58:23.411750 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-3c54a222-d6e7-4b28-8f09-7587c2988cb3 None None] For port 7b539bb4-5b78-4d71-803e-0556d1aa8da8, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=7b539bb4-5b78-4d71-803e-0556d1aa8da8,segment=NetworkSegment(be836a59-b961-4a22-8321-d34bfacbfc89),segment_id=be836a59-b961-4a22-8321-d34bfacbfc89)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:58:23.462583 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-59f5df03-1666-4ee3-8594-d27996bd9f2d None None] Set router ec949f32-500d-4daa-9463-8a606200ee0a gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:58:23.501195 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3c54a222-d6e7-4b28-8f09-7587c2988cb3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:23.530175 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-db333ce5-fe85-4a24-9d69-c98723ccd088 admin admin] Network ad4e0f1a-ae6b-4246-89ee-e51e6f860d5f is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 04:58:23.564519 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c54a222-d6e7-4b28-8f09-7587c2988cb3 None None] Pushing event updated for resources: {'Port': ['ID=7b539bb4-5b78-4d71-803e-0556d1aa8da8,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:23.621755 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e10e5b20-4d2b-44bf-a1ca-c1c2e204c4f9 None None] Provisioning complete for port 7b539bb4-5b78-4d71-803e-0556d1aa8da8 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:58:23.622043 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e10e5b20-4d2b-44bf-a1ca-c1c2e204c4f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:23.630071 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-db333ce5-fe85-4a24-9d69-c98723ccd088 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, ad4e0f1a-ae6b-4246-89ee-e51e6f860d5f) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:58:23.634216 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-db333ce5-fe85-4a24-9d69-c98723ccd088 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:58:23.634838 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-db333ce5-fe85-4a24-9d69-c98723ccd088 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:23.644011 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-172740fd-54b7-4ac6-bff6-8617c7ef081b None None] Network ad4e0f1a-ae6b-4246-89ee-e51e6f860d5f requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:58:23.680189 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-59f5df03-1666-4ee3-8594-d27996bd9f2d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ec949f32-500d-4daa-9463-8a606200ee0a', 'name': 'tempest-TestEncryptedCinderVolumes-389564536-router', 'tenant_id': '7a7a505be3334ab3b14ba7506d59802d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.144'}], 'enable_snat': True}, 'gw_port_id': 'e047caaa-2c99-4fed-adde-3ce05d586db6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:58:17Z', 'updated_at': '2021-11-09T04:58:20Z', 'revision_number': 4, 'project_id': '7a7a505be3334ab3b14ba7506d59802d', 'gw_port': {'id': 'e047caaa-2c99-4fed-adde-3ce05d586db6', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:90:1b:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec949f32-500d-4daa-9463-8a606200ee0a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1641, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.144', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:58:17Z', 'updated_at': '2021-11-09T04:58:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '7b539bb4-5b78-4d71-803e-0556d1aa8da8', 'name': '', 'network_id': 'fccebd84-efb7-429a-baa9-bc8330d63138', 'tenant_id': '7a7a505be3334ab3b14ba7506d59802d', 'mac_address': 'fa:16:3e:59:2d:e4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ec949f32-500d-4daa-9463-8a606200ee0a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1642, 'fixed_ips': [{'subnet_id': 'f0cd2ee2-fde7-47c0-bf41-7e97bc17cff8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:58:19Z', 'updated_at': '2021-11-09T04:58:23Z', 'revision_number': 4, 'project_id': '7a7a505be3334ab3b14ba7506d59802d', 'subnets': [{'id': 'f0cd2ee2-fde7-47c0-bf41-7e97bc17cff8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:58:23.707001 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-59f5df03-1666-4ee3-8594-d27996bd9f2d None None] The sync data for ids ['ec949f32-500d-4daa-9463-8a606200ee0a'] in dv-neutron-816802-2-hyperv is: [{'id': 'ec949f32-500d-4daa-9463-8a606200ee0a', 'name': 'tempest-TestEncryptedCinderVolumes-389564536-router', 'tenant_id': '7a7a505be3334ab3b14ba7506d59802d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.144'}], 'enable_snat': True}, 'gw_port_id': 'e047caaa-2c99-4fed-adde-3ce05d586db6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:58:17Z', 'updated_at': '2021-11-09T04:58:20Z', 'revision_number': 4, 'project_id': '7a7a505be3334ab3b14ba7506d59802d', 'gw_port': {'id': 'e047caaa-2c99-4fed-adde-3ce05d586db6', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:90:1b:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec949f32-500d-4daa-9463-8a606200ee0a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1641, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.144', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:58:17Z', 'updated_at': '2021-11-09T04:58:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '7b539bb4-5b78-4d71-803e-0556d1aa8da8', 'name': '', 'network_id': 'fccebd84-efb7-429a-baa9-bc8330d63138', 'tenant_id': '7a7a505be3334ab3b14ba7506d59802d', 'mac_address': 'fa:16:3e:59:2d:e4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ec949f32-500d-4daa-9463-8a606200ee0a', 'device_owner': 'network:router_interface', 'standard_attr_id': 1642, 'fixed_ips': [{'subnet_id': 'f0cd2ee2-fde7-47c0-bf41-7e97bc17cff8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:58:19Z', 'updated_at': '2021-11-09T04:58:23Z', 'revision_number': 4, 'project_id': '7a7a505be3334ab3b14ba7506d59802d', 'subnets': [{'id': 'f0cd2ee2-fde7-47c0-bf41-7e97bc17cff8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:58:23.745192 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-db333ce5-fe85-4a24-9d69-c98723ccd088 admin admin] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 0.8008127 Nov 09 04:58:23.746961 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 35746) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:58:23.767106 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-01ac5b58-2eeb-45fa-8288-cbc2ec0e791e admin admin] Request body: {'router': {'name': 'tempest-TestEncryptedCinderVolumes-648135690-router', 'tenant_id': 'b5e6af7f8d2f4eb088b2468c61ba0da9', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:58:23.848661 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b3247761-8e39-436b-89f7-d3c1d891ee03 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-ad4e0f1a-ae6b-4246-89ee-e51e6f860d5f', 'network_id': 'ad4e0f1a-ae6b-4246-89ee-e51e6f860d5f', 'tenant_id': 'b5e6af7f8d2f4eb088b2468c61ba0da9', 'fixed_ips': [{'subnet_id': '1ffa6a42-d392-423f-81d8-d1b418f2edd3'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 04:58:23.849563 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b3247761-8e39-436b-89f7-d3c1d891ee03 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:23.878709 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-01ac5b58-2eeb-45fa-8288-cbc2ec0e791e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:23.880222 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-01ac5b58-2eeb-45fa-8288-cbc2ec0e791e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:23.942376 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-01ac5b58-2eeb-45fa-8288-cbc2ec0e791e admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:23.996732 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-b3247761-8e39-436b-89f7-d3c1d891ee03 None None] Allocated IP 172.20.0.2 (ad4e0f1a-ae6b-4246-89ee-e51e6f860d5f/1ffa6a42-d392-423f-81d8-d1b418f2edd3/1c292a08-52af-486b-93ad-ef7271793878) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:58:24.153770 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device e047caaa-2c99-4fed-adde-3ce05d586db6 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:58:24.172997 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-01ac5b58-2eeb-45fa-8288-cbc2ec0e791e admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:24.189647 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b3247761-8e39-436b-89f7-d3c1d891ee03 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:24.220013 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port e047caaa-2c99-4fed-adde-3ce05d586db6 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:58:24.220013 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:24.287127 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b3247761-8e39-436b-89f7-d3c1d891ee03 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:24.345412 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 7b539bb4-5b78-4d71-803e-0556d1aa8da8 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:58:24.352699 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b3247761-8e39-436b-89f7-d3c1d891ee03 None None] Network ad4e0f1a-ae6b-4246-89ee-e51e6f860d5f is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:58:24.376477 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-b3247761-8e39-436b-89f7-d3c1d891ee03 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:58:24.380268 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b3247761-8e39-436b-89f7-d3c1d891ee03 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:58:24.383867 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3247761-8e39-436b-89f7-d3c1d891ee03 None None] Pushing event updated for resources: {'Port': ['ID=1c292a08-52af-486b-93ad-ef7271793878,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:24.449346 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-b3247761-8e39-436b-89f7-d3c1d891ee03 None None] Attempting to bind port 1c292a08-52af-486b-93ad-ef7271793878 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:58:24.449784 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-b3247761-8e39-436b-89f7-d3c1d891ee03 None None] Attempting to bind port 1c292a08-52af-486b-93ad-ef7271793878 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '1e97e40d-a8b1-455b-bcdd-f98ceb5b4e55', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 305, 'network_id': 'ad4e0f1a-ae6b-4246-89ee-e51e6f860d5f'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:58:24.450067 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b3247761-8e39-436b-89f7-d3c1d891ee03 None None] Attempting to bind port 1c292a08-52af-486b-93ad-ef7271793878 on network ad4e0f1a-ae6b-4246-89ee-e51e6f860d5f {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:58:24.451212 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-01ac5b58-2eeb-45fa-8288-cbc2ec0e791e admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:24.459096 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b3247761-8e39-436b-89f7-d3c1d891ee03 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 58, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:58:24.459463 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b3247761-8e39-436b-89f7-d3c1d891ee03 None None] Checking segment: {'id': '1e97e40d-a8b1-455b-bcdd-f98ceb5b4e55', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 305, 'network_id': 'ad4e0f1a-ae6b-4246-89ee-e51e6f860d5f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:58:24.459856 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b3247761-8e39-436b-89f7-d3c1d891ee03 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:24.460240 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b3247761-8e39-436b-89f7-d3c1d891ee03 None None] Bound using segment: {'id': '1e97e40d-a8b1-455b-bcdd-f98ceb5b4e55', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 305, 'network_id': 'ad4e0f1a-ae6b-4246-89ee-e51e6f860d5f'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:58:24.460706 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-b3247761-8e39-436b-89f7-d3c1d891ee03 None None] Bound port: 1c292a08-52af-486b-93ad-ef7271793878, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1e97e40d-a8b1-455b-bcdd-f98ceb5b4e55', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 305, 'network_id': 'ad4e0f1a-ae6b-4246-89ee-e51e6f860d5f'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:58:24.461084 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b3247761-8e39-436b-89f7-d3c1d891ee03 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:24.471168 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-01ac5b58-2eeb-45fa-8288-cbc2ec0e791e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:24.471709 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 7b539bb4-5b78-4d71-803e-0556d1aa8da8 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:58:24.472077 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:24.559408 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-b3247761-8e39-436b-89f7-d3c1d891ee03 None None] For port 1c292a08-52af-486b-93ad-ef7271793878, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:58:24.562945 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-b3247761-8e39-436b-89f7-d3c1d891ee03 None None] For port 1c292a08-52af-486b-93ad-ef7271793878, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=1c292a08-52af-486b-93ad-ef7271793878,segment=NetworkSegment(1e97e40d-a8b1-455b-bcdd-f98ceb5b4e55),segment_id=1e97e40d-a8b1-455b-bcdd-f98ceb5b4e55)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:58:24.588296 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-01ac5b58-2eeb-45fa-8288-cbc2ec0e791e admin admin] Allocated IP 172.26.0.28 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/3127d65b-3577-4146-8acc-b6c5e7737f90) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:58:24.646330 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b3247761-8e39-436b-89f7-d3c1d891ee03 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:24.698038 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-01ac5b58-2eeb-45fa-8288-cbc2ec0e791e admin admin] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:24.708712 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3247761-8e39-436b-89f7-d3c1d891ee03 None None] Pushing event updated for resources: {'Port': ['ID=1c292a08-52af-486b-93ad-ef7271793878,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:24.807585 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-01ac5b58-2eeb-45fa-8288-cbc2ec0e791e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:24.847716 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-01ac5b58-2eeb-45fa-8288-cbc2ec0e791e admin admin] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:58:24.851432 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-01ac5b58-2eeb-45fa-8288-cbc2ec0e791e admin admin] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:58:24.854770 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-01ac5b58-2eeb-45fa-8288-cbc2ec0e791e admin admin] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:58:24.906575 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01ac5b58-2eeb-45fa-8288-cbc2ec0e791e admin admin] Pushing event updated for resources: {'Port': ['ID=3127d65b-3577-4146-8acc-b6c5e7737f90,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:25.184560 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-01ac5b58-2eeb-45fa-8288-cbc2ec0e791e admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:25.379765 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-01ac5b58-2eeb-45fa-8288-cbc2ec0e791e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:25.571499 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-efca065b-ba50-4e7b-bc3b-9236b00fbb0f None None] Network ad4e0f1a-ae6b-4246-89ee-e51e6f860d5f requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 04:58:25.601159 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-01ac5b58-2eeb-45fa-8288-cbc2ec0e791e admin admin] Router ea6f2352-326d-4546-a5df-32d8e062c537 is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102162) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 04:58:25.680582 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-8d27e292-74c7-4dbb-a7a8-c2924f84d49a None None] Provisioning complete for port 1c292a08-52af-486b-93ad-ef7271793878 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:58:25.680852 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8d27e292-74c7-4dbb-a7a8-c2924f84d49a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:25.709161 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-01ac5b58-2eeb-45fa-8288-cbc2ec0e791e admin admin] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:58:25.737442 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8dda1b5a-1475-425f-9400-597ba8e03297 None None] Sync routers for ids ['ea6f2352-326d-4546-a5df-32d8e062c537'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:58:25.759221 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8dda1b5a-1475-425f-9400-597ba8e03297 None None] Routers {'ea6f2352-326d-4546-a5df-32d8e062c537'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:58:25.759823 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-8dda1b5a-1475-425f-9400-597ba8e03297 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:58:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['ea6f2352-326d-4546-a5df-32d8e062c537'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:58:25.809466 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-01ac5b58-2eeb-45fa-8288-cbc2ec0e791e admin admin] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:25.810911 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-01ac5b58-2eeb-45fa-8288-cbc2ec0e791e admin admin] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 927 time: 2.0602324 Nov 09 04:58:25.813759 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 35748) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:58:25.878997 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8d27e292-74c7-4dbb-a7a8-c2924f84d49a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:25.912986 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-8dda1b5a-1475-425f-9400-597ba8e03297 None None] Set router ea6f2352-326d-4546-a5df-32d8e062c537 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:58:25.981153 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-8d27e292-74c7-4dbb-a7a8-c2924f84d49a None None] For port 1c292a08-52af-486b-93ad-ef7271793878, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=1c292a08-52af-486b-93ad-ef7271793878,segment=NetworkSegment(1e97e40d-a8b1-455b-bcdd-f98ceb5b4e55),segment_id=1e97e40d-a8b1-455b-bcdd-f98ceb5b4e55)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:58:26.049570 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8d27e292-74c7-4dbb-a7a8-c2924f84d49a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:26.131842 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d27e292-74c7-4dbb-a7a8-c2924f84d49a None None] Pushing event updated for resources: {'Port': ['ID=1c292a08-52af-486b-93ad-ef7271793878,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:26.136269 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 1c292a08-52af-486b-93ad-ef7271793878 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:58:26.195324 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-130371a3-6df1-42b2-86a5-a99ed60e332d None None] Provisioning complete for port 1c292a08-52af-486b-93ad-ef7271793878 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:58:26.195591 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-130371a3-6df1-42b2-86a5-a99ed60e332d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:26.228179 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-8dda1b5a-1475-425f-9400-597ba8e03297 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ea6f2352-326d-4546-a5df-32d8e062c537', 'name': 'tempest-TestEncryptedCinderVolumes-648135690-router', 'tenant_id': 'b5e6af7f8d2f4eb088b2468c61ba0da9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.28'}], 'enable_snat': True}, 'gw_port_id': '3127d65b-3577-4146-8acc-b6c5e7737f90', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:58:23Z', 'updated_at': '2021-11-09T04:58:25Z', 'revision_number': 3, 'project_id': 'b5e6af7f8d2f4eb088b2468c61ba0da9', 'gw_port': {'id': '3127d65b-3577-4146-8acc-b6c5e7737f90', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:9e:82:48', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ea6f2352-326d-4546-a5df-32d8e062c537', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1653, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.28', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:58:24Z', 'updated_at': '2021-11-09T04:58:24Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:58:26.261423 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5e61b6e6-d17a-4e83-9736-1a65f5439392 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:26.265193 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8dda1b5a-1475-425f-9400-597ba8e03297 None None] Checking router: ea6f2352-326d-4546-a5df-32d8e062c537 for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:58:26.265539 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8dda1b5a-1475-425f-9400-597ba8e03297 None None] Updating router ea6f2352-326d-4546-a5df-32d8e062c537 port 3127d65b-3577-4146-8acc-b6c5e7737f90 binding host dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 04:58:26.286991 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 1c292a08-52af-486b-93ad-ef7271793878 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:58:26.287354 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:26.316451 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8dda1b5a-1475-425f-9400-597ba8e03297 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:26.418042 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-5e61b6e6-d17a-4e83-9736-1a65f5439392 admin admin] Allocated IP 172.20.0.1 (ad4e0f1a-ae6b-4246-89ee-e51e6f860d5f/1ffa6a42-d392-423f-81d8-d1b418f2edd3/d3a80ac0-37b0-46ba-9114-29f5cbf94393) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:58:26.522336 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5e61b6e6-d17a-4e83-9736-1a65f5439392 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:26.627322 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5e61b6e6-d17a-4e83-9736-1a65f5439392 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:26.667170 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5e61b6e6-d17a-4e83-9736-1a65f5439392 admin admin] Network ad4e0f1a-ae6b-4246-89ee-e51e6f860d5f is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:58:26.672149 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-5e61b6e6-d17a-4e83-9736-1a65f5439392 admin admin] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:58:26.675802 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5e61b6e6-d17a-4e83-9736-1a65f5439392 admin admin] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:58:26.806160 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8dda1b5a-1475-425f-9400-597ba8e03297 None None] Publish callbacks [] for port, precommit_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:26.898997 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8dda1b5a-1475-425f-9400-597ba8e03297 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:26.950527 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-2b275c9a-0324-432a-8587-ed11c5bd5365 None None] Provisioning complete for port d3a80ac0-37b0-46ba-9114-29f5cbf94393 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:58:26.950941 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-2b275c9a-0324-432a-8587-ed11c5bd5365 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:26.971071 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e61b6e6-d17a-4e83-9736-1a65f5439392 admin admin] Pushing event updated for resources: {'Port': ['ID=d3a80ac0-37b0-46ba-9114-29f5cbf94393,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:26.987905 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5e61b6e6-d17a-4e83-9736-1a65f5439392 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:26.990439 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-8dda1b5a-1475-425f-9400-597ba8e03297 None None] Attempting to bind port 3127d65b-3577-4146-8acc-b6c5e7737f90 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:58:26.990806 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-8dda1b5a-1475-425f-9400-597ba8e03297 None None] Attempting to bind port 3127d65b-3577-4146-8acc-b6c5e7737f90 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:58:26.991260 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8dda1b5a-1475-425f-9400-597ba8e03297 None None] Attempting to bind port 3127d65b-3577-4146-8acc-b6c5e7737f90 on network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:58:26.993102 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-780c7f02-5bfa-4680-88e9-60ed6e078364 None None] Pushing event updated for resources: {'Port': ['ID=3127d65b-3577-4146-8acc-b6c5e7737f90,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:27.006200 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8dda1b5a-1475-425f-9400-597ba8e03297 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 58, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:58:27.006664 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8dda1b5a-1475-425f-9400-597ba8e03297 None None] Checking segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:58:27.007060 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8dda1b5a-1475-425f-9400-597ba8e03297 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:27.007441 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8dda1b5a-1475-425f-9400-597ba8e03297 None None] Bound using segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:58:27.007906 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-8dda1b5a-1475-425f-9400-597ba8e03297 None None] Bound port: 3127d65b-3577-4146-8acc-b6c5e7737f90, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:58:27.008281 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8dda1b5a-1475-425f-9400-597ba8e03297 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:27.030456 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-2b275c9a-0324-432a-8587-ed11c5bd5365 None None] Port d3a80ac0-37b0-46ba-9114-29f5cbf94393 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:58:27.061050 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-8dda1b5a-1475-425f-9400-597ba8e03297 None None] For port 3127d65b-3577-4146-8acc-b6c5e7737f90, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:58:27.064190 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-8dda1b5a-1475-425f-9400-597ba8e03297 None None] For port 3127d65b-3577-4146-8acc-b6c5e7737f90, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=3127d65b-3577-4146-8acc-b6c5e7737f90,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:58:27.144522 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8dda1b5a-1475-425f-9400-597ba8e03297 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:27.186885 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5e61b6e6-d17a-4e83-9736-1a65f5439392 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:27.202733 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8dda1b5a-1475-425f-9400-597ba8e03297 None None] Routers {'ea6f2352-326d-4546-a5df-32d8e062c537'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:58:27.203360 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-8dda1b5a-1475-425f-9400-597ba8e03297 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:58:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['ea6f2352-326d-4546-a5df-32d8e062c537'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:58:27.208077 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-780c7f02-5bfa-4680-88e9-60ed6e078364 None None] Pushing event updated for resources: {'Port': ['ID=3127d65b-3577-4146-8acc-b6c5e7737f90,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:27.314955 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-8dda1b5a-1475-425f-9400-597ba8e03297 None None] Set router ea6f2352-326d-4546-a5df-32d8e062c537 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:58:27.353163 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5e61b6e6-d17a-4e83-9736-1a65f5439392 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:27.432401 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5e61b6e6-d17a-4e83-9736-1a65f5439392 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:27.499609 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5e61b6e6-d17a-4e83-9736-1a65f5439392 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:27.501464 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e61b6e6-d17a-4e83-9736-1a65f5439392 admin admin] Pushing event updated for resources: {'Port': ['ID=d3a80ac0-37b0-46ba-9114-29f5cbf94393,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:27.511905 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-8dda1b5a-1475-425f-9400-597ba8e03297 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ea6f2352-326d-4546-a5df-32d8e062c537', 'name': 'tempest-TestEncryptedCinderVolumes-648135690-router', 'tenant_id': 'b5e6af7f8d2f4eb088b2468c61ba0da9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.28'}], 'enable_snat': True}, 'gw_port_id': '3127d65b-3577-4146-8acc-b6c5e7737f90', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:58:23Z', 'updated_at': '2021-11-09T04:58:27Z', 'revision_number': 4, 'project_id': 'b5e6af7f8d2f4eb088b2468c61ba0da9', 'gw_port': {'id': '3127d65b-3577-4146-8acc-b6c5e7737f90', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:9e:82:48', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ea6f2352-326d-4546-a5df-32d8e062c537', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1653, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.28', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:58:24Z', 'updated_at': '2021-11-09T04:58:27Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'd3a80ac0-37b0-46ba-9114-29f5cbf94393', 'name': '', 'network_id': 'ad4e0f1a-ae6b-4246-89ee-e51e6f860d5f', 'tenant_id': 'b5e6af7f8d2f4eb088b2468c61ba0da9', 'mac_address': 'fa:16:3e:be:c3:b3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ea6f2352-326d-4546-a5df-32d8e062c537', 'device_owner': 'network:router_interface', 'standard_attr_id': 1654, 'fixed_ips': [{'subnet_id': '1ffa6a42-d392-423f-81d8-d1b418f2edd3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:58:26Z', 'updated_at': '2021-11-09T04:58:26Z', 'revision_number': 1, 'project_id': 'b5e6af7f8d2f4eb088b2468c61ba0da9', 'subnets': [{'id': '1ffa6a42-d392-423f-81d8-d1b418f2edd3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:58:27.538710 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8dda1b5a-1475-425f-9400-597ba8e03297 None None] The sync data for ids ['ea6f2352-326d-4546-a5df-32d8e062c537'] in dv-neutron-816802-2-hyperv is: [{'id': 'ea6f2352-326d-4546-a5df-32d8e062c537', 'name': 'tempest-TestEncryptedCinderVolumes-648135690-router', 'tenant_id': 'b5e6af7f8d2f4eb088b2468c61ba0da9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.28'}], 'enable_snat': True}, 'gw_port_id': '3127d65b-3577-4146-8acc-b6c5e7737f90', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:58:23Z', 'updated_at': '2021-11-09T04:58:27Z', 'revision_number': 4, 'project_id': 'b5e6af7f8d2f4eb088b2468c61ba0da9', 'gw_port': {'id': '3127d65b-3577-4146-8acc-b6c5e7737f90', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:9e:82:48', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ea6f2352-326d-4546-a5df-32d8e062c537', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1653, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.28', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:58:24Z', 'updated_at': '2021-11-09T04:58:27Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'd3a80ac0-37b0-46ba-9114-29f5cbf94393', 'name': '', 'network_id': 'ad4e0f1a-ae6b-4246-89ee-e51e6f860d5f', 'tenant_id': 'b5e6af7f8d2f4eb088b2468c61ba0da9', 'mac_address': 'fa:16:3e:be:c3:b3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ea6f2352-326d-4546-a5df-32d8e062c537', 'device_owner': 'network:router_interface', 'standard_attr_id': 1654, 'fixed_ips': [{'subnet_id': '1ffa6a42-d392-423f-81d8-d1b418f2edd3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:58:26Z', 'updated_at': '2021-11-09T04:58:26Z', 'revision_number': 1, 'project_id': 'b5e6af7f8d2f4eb088b2468c61ba0da9', 'subnets': [{'id': '1ffa6a42-d392-423f-81d8-d1b418f2edd3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:58:27.600290 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5e61b6e6-d17a-4e83-9736-1a65f5439392 admin admin] Network ad4e0f1a-ae6b-4246-89ee-e51e6f860d5f is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:58:27.601780 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-5e61b6e6-d17a-4e83-9736-1a65f5439392 admin admin] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:58:27.739916 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5e61b6e6-d17a-4e83-9736-1a65f5439392 admin admin] Router ea6f2352-326d-4546-a5df-32d8e062c537 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 04:58:27.870838 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-6e7d5812-6ea8-48b2-aea2-1909315d3a90 None None] Provisioning complete for port d3a80ac0-37b0-46ba-9114-29f5cbf94393 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:58:27.871331 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6e7d5812-6ea8-48b2-aea2-1909315d3a90 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:27.871746 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5e61b6e6-d17a-4e83-9736-1a65f5439392 admin admin] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 04:58:27.885708 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-5e61b6e6-d17a-4e83-9736-1a65f5439392 admin admin] 10.222.0.24 "PUT /v2.0/routers/ea6f2352-326d-4546-a5df-32d8e062c537/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.0634303 Nov 09 04:58:27.908860 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-6e7d5812-6ea8-48b2-aea2-1909315d3a90 None None] Port d3a80ac0-37b0-46ba-9114-29f5cbf94393 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:58:28.076505 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 1c292a08-52af-486b-93ad-ef7271793878 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:58:28.131476 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 1c292a08-52af-486b-93ad-ef7271793878 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:58:28.131847 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:29.830813 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffab542f-ec8d-4ead-8d55-a2ce867c8307 req-ce99a35d-6af9-4a51-8e51-d003fbe4292a tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:58:29.832848 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ffab542f-ec8d-4ead-8d55-a2ce867c8307 req-ce99a35d-6af9-4a51-8e51-d003fbe4292a tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/networks?id=fccebd84-efb7-429a-baa9-bc8330d63138 HTTP/1.1" status: 200 len: 816 time: 0.1050074 Nov 09 04:58:29.847474 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ffab542f-ec8d-4ead-8d55-a2ce867c8307 req-8323afde-ac3f-44f9-93de-c5ca5d7a39b5 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/quotas/7a7a505be3334ab3b14ba7506d59802d HTTP/1.1" status: 200 len: 375 time: 0.0088232 Nov 09 04:58:29.897568 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ffab542f-ec8d-4ead-8d55-a2ce867c8307 req-fd8e3b54-1ef8-455a-bb90-42dc5a2698dc tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/ports?tenant_id=7a7a505be3334ab3b14ba7506d59802d&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0448966 Nov 09 04:58:30.074170 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 3127d65b-3577-4146-8acc-b6c5e7737f90 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:58:30.085153 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ffab542f-ec8d-4ead-8d55-a2ce867c8307 req-693b8841-9d77-4824-ade9-2e6e7c90b6f9 service neutron] 10.222.0.24 "GET /v2.0/networks/fccebd84-efb7-429a-baa9-bc8330d63138?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1753035 Nov 09 04:58:30.120308 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 3127d65b-3577-4146-8acc-b6c5e7737f90 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:58:30.120669 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:30.173063 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ffab542f-ec8d-4ead-8d55-a2ce867c8307 req-78323dee-1727-4b2b-949e-571e5c290d52 service neutron] 10.222.0.24 "GET /v2.0/networks/fccebd84-efb7-429a-baa9-bc8330d63138?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0815830 Nov 09 04:58:30.199515 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:30.219879 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 3127d65b-3577-4146-8acc-b6c5e7737f90, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=3127d65b-3577-4146-8acc-b6c5e7737f90,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:58:30.335417 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:30.381824 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=3127d65b-3577-4146-8acc-b6c5e7737f90,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:30.455877 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:58:30.456471 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d5d6605b-e9e5-45d9-8125-05d21a1fda82 req-ec8916ad-7134-4dcf-9082-d7337ffbf149 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/ports?device_id=72029a2a-bec9-4104-9851-08be6b385945 HTTP/1.1" status: 200 len: 210 time: 0.0277746 Nov 09 04:58:30.803009 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1bd7c5a0-386d-4a1d-bfbc-f0a0c52ced55 None None] Sync routers for ids ['ea6f2352-326d-4546-a5df-32d8e062c537'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 04:58:30.812965 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1bd7c5a0-386d-4a1d-bfbc-f0a0c52ced55 None None] Routers {'ea6f2352-326d-4546-a5df-32d8e062c537'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:58:30.813576 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-1bd7c5a0-386d-4a1d-bfbc-f0a0c52ced55 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:58:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['ea6f2352-326d-4546-a5df-32d8e062c537'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:58:30.920011 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-1bd7c5a0-386d-4a1d-bfbc-f0a0c52ced55 None None] Set router ea6f2352-326d-4546-a5df-32d8e062c537 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:58:31.123537 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-1bd7c5a0-386d-4a1d-bfbc-f0a0c52ced55 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ea6f2352-326d-4546-a5df-32d8e062c537', 'name': 'tempest-TestEncryptedCinderVolumes-648135690-router', 'tenant_id': 'b5e6af7f8d2f4eb088b2468c61ba0da9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.28'}], 'enable_snat': True}, 'gw_port_id': '3127d65b-3577-4146-8acc-b6c5e7737f90', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:58:23Z', 'updated_at': '2021-11-09T04:58:27Z', 'revision_number': 4, 'project_id': 'b5e6af7f8d2f4eb088b2468c61ba0da9', 'gw_port': {'id': '3127d65b-3577-4146-8acc-b6c5e7737f90', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:9e:82:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ea6f2352-326d-4546-a5df-32d8e062c537', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1653, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.28', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:58:24Z', 'updated_at': '2021-11-09T04:58:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'd3a80ac0-37b0-46ba-9114-29f5cbf94393', 'name': '', 'network_id': 'ad4e0f1a-ae6b-4246-89ee-e51e6f860d5f', 'tenant_id': 'b5e6af7f8d2f4eb088b2468c61ba0da9', 'mac_address': 'fa:16:3e:be:c3:b3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ea6f2352-326d-4546-a5df-32d8e062c537', 'device_owner': 'network:router_interface', 'standard_attr_id': 1654, 'fixed_ips': [{'subnet_id': '1ffa6a42-d392-423f-81d8-d1b418f2edd3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:58:26Z', 'updated_at': '2021-11-09T04:58:27Z', 'revision_number': 2, 'project_id': 'b5e6af7f8d2f4eb088b2468c61ba0da9', 'subnets': [{'id': '1ffa6a42-d392-423f-81d8-d1b418f2edd3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:58:31.149412 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1bd7c5a0-386d-4a1d-bfbc-f0a0c52ced55 None None] Checking router: ea6f2352-326d-4546-a5df-32d8e062c537 for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 04:58:31.149700 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1bd7c5a0-386d-4a1d-bfbc-f0a0c52ced55 None None] Updating router ea6f2352-326d-4546-a5df-32d8e062c537 port d3a80ac0-37b0-46ba-9114-29f5cbf94393 binding host dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 04:58:31.173233 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-1bd7c5a0-386d-4a1d-bfbc-f0a0c52ced55 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:31.440566 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-1bd7c5a0-386d-4a1d-bfbc-f0a0c52ced55 None None] Publish callbacks [] for port, precommit_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:31.539118 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5fa9fc25-f32f-4dba-a645-854d785ab758 req-12062551-389a-4dd2-8a62-7e49c3e2ca1a tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/ports?device_id=72029a2a-bec9-4104-9851-08be6b385945 HTTP/1.1" status: 200 len: 210 time: 0.0299952 Nov 09 04:58:31.604276 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-1bd7c5a0-386d-4a1d-bfbc-f0a0c52ced55 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:31.652430 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-746eddee-9288-4d5f-aa99-d3e288595581 None None] Pushing event updated for resources: {'Port': ['ID=d3a80ac0-37b0-46ba-9114-29f5cbf94393,revision_number=3']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:31.705455 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-1bd7c5a0-386d-4a1d-bfbc-f0a0c52ced55 None None] Attempting to bind port d3a80ac0-37b0-46ba-9114-29f5cbf94393 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:58:31.705819 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-1bd7c5a0-386d-4a1d-bfbc-f0a0c52ced55 None None] Attempting to bind port d3a80ac0-37b0-46ba-9114-29f5cbf94393 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '1e97e40d-a8b1-455b-bcdd-f98ceb5b4e55', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 305, 'network_id': 'ad4e0f1a-ae6b-4246-89ee-e51e6f860d5f'}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:58:31.706173 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1bd7c5a0-386d-4a1d-bfbc-f0a0c52ced55 None None] Attempting to bind port d3a80ac0-37b0-46ba-9114-29f5cbf94393 on network ad4e0f1a-ae6b-4246-89ee-e51e6f860d5f {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:58:31.711242 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1bd7c5a0-386d-4a1d-bfbc-f0a0c52ced55 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 58, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:58:31.711745 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1bd7c5a0-386d-4a1d-bfbc-f0a0c52ced55 None None] Checking segment: {'id': '1e97e40d-a8b1-455b-bcdd-f98ceb5b4e55', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 305, 'network_id': 'ad4e0f1a-ae6b-4246-89ee-e51e6f860d5f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102164) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:58:31.712000 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-1bd7c5a0-386d-4a1d-bfbc-f0a0c52ced55 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:31.712385 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1bd7c5a0-386d-4a1d-bfbc-f0a0c52ced55 None None] Bound using segment: {'id': '1e97e40d-a8b1-455b-bcdd-f98ceb5b4e55', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 305, 'network_id': 'ad4e0f1a-ae6b-4246-89ee-e51e6f860d5f'} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:58:31.712841 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-1bd7c5a0-386d-4a1d-bfbc-f0a0c52ced55 None None] Bound port: d3a80ac0-37b0-46ba-9114-29f5cbf94393, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1e97e40d-a8b1-455b-bcdd-f98ceb5b4e55', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 305, 'network_id': 'ad4e0f1a-ae6b-4246-89ee-e51e6f860d5f'}}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:58:31.713214 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-1bd7c5a0-386d-4a1d-bfbc-f0a0c52ced55 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:31.780902 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-1bd7c5a0-386d-4a1d-bfbc-f0a0c52ced55 None None] For port d3a80ac0-37b0-46ba-9114-29f5cbf94393, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102164) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:58:31.784163 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-1bd7c5a0-386d-4a1d-bfbc-f0a0c52ced55 None None] For port d3a80ac0-37b0-46ba-9114-29f5cbf94393, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=d3a80ac0-37b0-46ba-9114-29f5cbf94393,segment=NetworkSegment(1e97e40d-a8b1-455b-bcdd-f98ceb5b4e55),segment_id=1e97e40d-a8b1-455b-bcdd-f98ceb5b4e55)] {{(pid=102164) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:58:31.861196 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-a307f541-5645-47db-bc1c-2824b024398a None None] Provisioning complete for port d3a80ac0-37b0-46ba-9114-29f5cbf94393 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:58:31.861896 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a307f541-5645-47db-bc1c-2824b024398a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:31.899634 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-a307f541-5645-47db-bc1c-2824b024398a None None] Port d3a80ac0-37b0-46ba-9114-29f5cbf94393 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:58:32.007215 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-1bd7c5a0-386d-4a1d-bfbc-f0a0c52ced55 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:32.056759 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1bd7c5a0-386d-4a1d-bfbc-f0a0c52ced55 None None] Routers {'ea6f2352-326d-4546-a5df-32d8e062c537'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 04:58:32.057396 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-1bd7c5a0-386d-4a1d-bfbc-f0a0c52ced55 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:58:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['ea6f2352-326d-4546-a5df-32d8e062c537'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:58:32.070911 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 3127d65b-3577-4146-8acc-b6c5e7737f90 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:58:32.104237 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-746eddee-9288-4d5f-aa99-d3e288595581 None None] Pushing event updated for resources: {'Port': ['ID=d3a80ac0-37b0-46ba-9114-29f5cbf94393,revision_number=4']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:32.124403 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 3127d65b-3577-4146-8acc-b6c5e7737f90 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:58:32.125286 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:32.273541 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-1bd7c5a0-386d-4a1d-bfbc-f0a0c52ced55 None None] Set router ea6f2352-326d-4546-a5df-32d8e062c537 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 04:58:32.319799 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-02e113b7-fc22-46b6-aa75-9eff22bad010 None None] Provisioning complete for port d3a80ac0-37b0-46ba-9114-29f5cbf94393 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:58:32.320424 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-02e113b7-fc22-46b6-aa75-9eff22bad010 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:32.399263 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-02e113b7-fc22-46b6-aa75-9eff22bad010 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:32.432603 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-02e113b7-fc22-46b6-aa75-9eff22bad010 None None] For port d3a80ac0-37b0-46ba-9114-29f5cbf94393, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=d3a80ac0-37b0-46ba-9114-29f5cbf94393,segment=NetworkSegment(1e97e40d-a8b1-455b-bcdd-f98ceb5b4e55),segment_id=1e97e40d-a8b1-455b-bcdd-f98ceb5b4e55)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:58:32.470004 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-1bd7c5a0-386d-4a1d-bfbc-f0a0c52ced55 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ea6f2352-326d-4546-a5df-32d8e062c537', 'name': 'tempest-TestEncryptedCinderVolumes-648135690-router', 'tenant_id': 'b5e6af7f8d2f4eb088b2468c61ba0da9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.28'}], 'enable_snat': True}, 'gw_port_id': '3127d65b-3577-4146-8acc-b6c5e7737f90', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:58:23Z', 'updated_at': '2021-11-09T04:58:27Z', 'revision_number': 4, 'project_id': 'b5e6af7f8d2f4eb088b2468c61ba0da9', 'gw_port': {'id': '3127d65b-3577-4146-8acc-b6c5e7737f90', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:9e:82:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ea6f2352-326d-4546-a5df-32d8e062c537', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1653, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.28', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:58:24Z', 'updated_at': '2021-11-09T04:58:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'd3a80ac0-37b0-46ba-9114-29f5cbf94393', 'name': '', 'network_id': 'ad4e0f1a-ae6b-4246-89ee-e51e6f860d5f', 'tenant_id': 'b5e6af7f8d2f4eb088b2468c61ba0da9', 'mac_address': 'fa:16:3e:be:c3:b3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ea6f2352-326d-4546-a5df-32d8e062c537', 'device_owner': 'network:router_interface', 'standard_attr_id': 1654, 'fixed_ips': [{'subnet_id': '1ffa6a42-d392-423f-81d8-d1b418f2edd3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:58:26Z', 'updated_at': '2021-11-09T04:58:31Z', 'revision_number': 4, 'project_id': 'b5e6af7f8d2f4eb088b2468c61ba0da9', 'subnets': [{'id': '1ffa6a42-d392-423f-81d8-d1b418f2edd3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 04:58:32.499705 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1bd7c5a0-386d-4a1d-bfbc-f0a0c52ced55 None None] The sync data for ids ['ea6f2352-326d-4546-a5df-32d8e062c537'] in dv-neutron-816802-2-hyperv is: [{'id': 'ea6f2352-326d-4546-a5df-32d8e062c537', 'name': 'tempest-TestEncryptedCinderVolumes-648135690-router', 'tenant_id': 'b5e6af7f8d2f4eb088b2468c61ba0da9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.28'}], 'enable_snat': True}, 'gw_port_id': '3127d65b-3577-4146-8acc-b6c5e7737f90', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:58:23Z', 'updated_at': '2021-11-09T04:58:27Z', 'revision_number': 4, 'project_id': 'b5e6af7f8d2f4eb088b2468c61ba0da9', 'gw_port': {'id': '3127d65b-3577-4146-8acc-b6c5e7737f90', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:9e:82:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ea6f2352-326d-4546-a5df-32d8e062c537', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1653, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.28', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:58:24Z', 'updated_at': '2021-11-09T04:58:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'd3a80ac0-37b0-46ba-9114-29f5cbf94393', 'name': '', 'network_id': 'ad4e0f1a-ae6b-4246-89ee-e51e6f860d5f', 'tenant_id': 'b5e6af7f8d2f4eb088b2468c61ba0da9', 'mac_address': 'fa:16:3e:be:c3:b3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ea6f2352-326d-4546-a5df-32d8e062c537', 'device_owner': 'network:router_interface', 'standard_attr_id': 1654, 'fixed_ips': [{'subnet_id': '1ffa6a42-d392-423f-81d8-d1b418f2edd3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:58:26Z', 'updated_at': '2021-11-09T04:58:31Z', 'revision_number': 4, 'project_id': 'b5e6af7f8d2f4eb088b2468c61ba0da9', 'subnets': [{'id': '1ffa6a42-d392-423f-81d8-d1b418f2edd3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 04:58:32.541609 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-02e113b7-fc22-46b6-aa75-9eff22bad010 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:32.595398 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02e113b7-fc22-46b6-aa75-9eff22bad010 None None] Pushing event updated for resources: {'Port': ['ID=d3a80ac0-37b0-46ba-9114-29f5cbf94393,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:32.645833 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-9e9979c7-1a52-4874-8b26-0c192d95524c req-31861c76-a966-4587-9aa1-5cdf8bd0e927 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/ports?device_id=72029a2a-bec9-4104-9851-08be6b385945 HTTP/1.1" status: 200 len: 210 time: 0.0335138 Nov 09 04:58:33.529742 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffab542f-ec8d-4ead-8d55-a2ce867c8307 req-882c8da2-e1a2-4f92-b7ea-e840c300cd9e tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:58:33.531203 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ffab542f-ec8d-4ead-8d55-a2ce867c8307 req-882c8da2-e1a2-4f92-b7ea-e840c300cd9e tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.26 "GET /v2.0/networks?id=fccebd84-efb7-429a-baa9-bc8330d63138 HTTP/1.1" status: 200 len: 816 time: 0.1712277 Nov 09 04:58:33.549488 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-ffab542f-ec8d-4ead-8d55-a2ce867c8307 req-6ff7d932-c1ee-42b2-95c8-6274184f571d tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Request body: {'port': {'device_id': '72029a2a-bec9-4104-9851-08be6b385945', 'network_id': 'fccebd84-efb7-429a-baa9-bc8330d63138', 'admin_state_up': True, 'tenant_id': '7a7a505be3334ab3b14ba7506d59802d'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:58:33.744223 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-28ab149e-428b-4b8c-946a-5372a4fe5b97 req-bf6d99d8-ff06-4c67-9801-81d5fdaaeb80 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/ports?device_id=72029a2a-bec9-4104-9851-08be6b385945 HTTP/1.1" status: 200 len: 210 time: 0.0265067 Nov 09 04:58:33.760853 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ffab542f-ec8d-4ead-8d55-a2ce867c8307 req-6ff7d932-c1ee-42b2-95c8-6274184f571d tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Made reservation on behalf of 7a7a505be3334ab3b14ba7506d59802d for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:58:33.764576 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-ffab542f-ec8d-4ead-8d55-a2ce867c8307 req-6ff7d932-c1ee-42b2-95c8-6274184f571d tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:33.893302 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [req-ffab542f-ec8d-4ead-8d55-a2ce867c8307 req-6ff7d932-c1ee-42b2-95c8-6274184f571d tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Allocated IP 172.20.0.5 (fccebd84-efb7-429a-baa9-bc8330d63138/f0cd2ee2-fde7-47c0-bf41-7e97bc17cff8/019b5836-92b2-46a9-b759-bc76db1e523c) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:58:34.047276 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-ffab542f-ec8d-4ead-8d55-a2ce867c8307 req-6ff7d932-c1ee-42b2-95c8-6274184f571d tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:34.093622 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device d3a80ac0-37b0-46ba-9114-29f5cbf94393 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:58:34.143718 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port d3a80ac0-37b0-46ba-9114-29f5cbf94393 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:58:34.144057 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:34.144197 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-ffab542f-ec8d-4ead-8d55-a2ce867c8307 req-6ff7d932-c1ee-42b2-95c8-6274184f571d tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:34.192943 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ffab542f-ec8d-4ead-8d55-a2ce867c8307 req-6ff7d932-c1ee-42b2-95c8-6274184f571d tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Network fccebd84-efb7-429a-baa9-bc8330d63138 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:58:34.200335 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [req-ffab542f-ec8d-4ead-8d55-a2ce867c8307 req-6ff7d932-c1ee-42b2-95c8-6274184f571d tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:58:34.203264 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-ffab542f-ec8d-4ead-8d55-a2ce867c8307 req-6ff7d932-c1ee-42b2-95c8-6274184f571d tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:58:34.231155 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ff7d932-c1ee-42b2-95c8-6274184f571d tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Pushing event updated for resources: {'Port': ['ID=019b5836-92b2-46a9-b759-bc76db1e523c,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:34.263707 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffab542f-ec8d-4ead-8d55-a2ce867c8307 req-6ff7d932-c1ee-42b2-95c8-6274184f571d tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:58:34.264429 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-ffab542f-ec8d-4ead-8d55-a2ce867c8307 req-6ff7d932-c1ee-42b2-95c8-6274184f571d tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:34.335919 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ffab542f-ec8d-4ead-8d55-a2ce867c8307 req-6ff7d932-c1ee-42b2-95c8-6274184f571d tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.26 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7902617 Nov 09 04:58:34.351514 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-ffab542f-ec8d-4ead-8d55-a2ce867c8307 req-5379b861-c2e6-43f4-97f8-7a6640eef424 service neutron] Request body: {'port': {'device_id': '72029a2a-bec9-4104-9851-08be6b385945', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:58:34.405237 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-ffab542f-ec8d-4ead-8d55-a2ce867c8307 req-5379b861-c2e6-43f4-97f8-7a6640eef424 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:34.472398 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-5de0d26b-098d-4296-af2f-f0bd28d239ba None None] Provisioning complete for port 019b5836-92b2-46a9-b759-bc76db1e523c triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:58:34.473235 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5de0d26b-098d-4296-af2f-f0bd28d239ba None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:34.506727 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-5de0d26b-098d-4296-af2f-f0bd28d239ba None None] Port 019b5836-92b2-46a9-b759-bc76db1e523c cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:58:34.666493 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [req-ffab542f-ec8d-4ead-8d55-a2ce867c8307 req-5379b861-c2e6-43f4-97f8-7a6640eef424 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 019b5836-92b2-46a9-b759-bc76db1e523c {{(pid=102162) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:58:34.673577 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-ffab542f-ec8d-4ead-8d55-a2ce867c8307 req-5379b861-c2e6-43f4-97f8-7a6640eef424 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:34.685500 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.provisioning_blocks [req-ffab542f-ec8d-4ead-8d55-a2ce867c8307 req-5379b861-c2e6-43f4-97f8-7a6640eef424 service neutron] Transition to ACTIVE for port object 019b5836-92b2-46a9-b759-bc76db1e523c will not be triggered until provisioned by entity L2. {{(pid=102162) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 09 04:58:34.809223 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-ffab542f-ec8d-4ead-8d55-a2ce867c8307 req-5379b861-c2e6-43f4-97f8-7a6640eef424 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:34.860447 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddc3a007-7553-4d81-b828-d13549b1b23d req-72688804-91ee-493e-a937-b7fd67d1d75d tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:58:34.862337 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ddc3a007-7553-4d81-b828-d13549b1b23d req-72688804-91ee-493e-a937-b7fd67d1d75d tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/ports?device_id=72029a2a-bec9-4104-9851-08be6b385945 HTTP/1.1" status: 200 len: 943 time: 0.0519557 Nov 09 04:58:34.883008 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5379b861-c2e6-43f4-97f8-7a6640eef424 service neutron] Pushing event updated for resources: {'Port': ['ID=019b5836-92b2-46a9-b759-bc76db1e523c,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:34.929843 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ddc3a007-7553-4d81-b828-d13549b1b23d req-ccae5c47-cb50-489c-907d-f67d217e9f4e tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/security-groups?id=38ad7e09-c43f-42df-a8ec-4b9fe996949f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0575688 Nov 09 04:58:34.939920 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-ffab542f-ec8d-4ead-8d55-a2ce867c8307 req-5379b861-c2e6-43f4-97f8-7a6640eef424 service neutron] Attempting to bind port 019b5836-92b2-46a9-b759-bc76db1e523c on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:58:34.940257 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-ffab542f-ec8d-4ead-8d55-a2ce867c8307 req-5379b861-c2e6-43f4-97f8-7a6640eef424 service neutron] Attempting to bind port 019b5836-92b2-46a9-b759-bc76db1e523c by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'be836a59-b961-4a22-8321-d34bfacbfc89', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': 'fccebd84-efb7-429a-baa9-bc8330d63138'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:58:34.940584 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ffab542f-ec8d-4ead-8d55-a2ce867c8307 req-5379b861-c2e6-43f4-97f8-7a6640eef424 service neutron] Attempting to bind port 019b5836-92b2-46a9-b759-bc76db1e523c on network fccebd84-efb7-429a-baa9-bc8330d63138 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:58:34.950606 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ffab542f-ec8d-4ead-8d55-a2ce867c8307 req-5379b861-c2e6-43f4-97f8-7a6640eef424 service neutron] Port 019b5836-92b2-46a9-b759-bc76db1e523c on network fccebd84-efb7-429a-baa9-bc8330d63138 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:58:34.950606 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ffab542f-ec8d-4ead-8d55-a2ce867c8307 req-5379b861-c2e6-43f4-97f8-7a6640eef424 service neutron] Attempting to bind port 019b5836-92b2-46a9-b759-bc76db1e523c on network fccebd84-efb7-429a-baa9-bc8330d63138 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:58:34.954496 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ffab542f-ec8d-4ead-8d55-a2ce867c8307 req-5379b861-c2e6-43f4-97f8-7a6640eef424 service neutron] Checking agent: {'id': '7d36b884-4ad2-4878-9464-bf647030b544', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'started_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 58, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:58:34.954835 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ffab542f-ec8d-4ead-8d55-a2ce867c8307 req-5379b861-c2e6-43f4-97f8-7a6640eef424 service neutron] Checking segment: {'id': 'be836a59-b961-4a22-8321-d34bfacbfc89', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': 'fccebd84-efb7-429a-baa9-bc8330d63138'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:58:34.955218 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ffab542f-ec8d-4ead-8d55-a2ce867c8307 req-5379b861-c2e6-43f4-97f8-7a6640eef424 service neutron] Bound using segment: {'id': 'be836a59-b961-4a22-8321-d34bfacbfc89', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': 'fccebd84-efb7-429a-baa9-bc8330d63138'} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:58:34.955674 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-ffab542f-ec8d-4ead-8d55-a2ce867c8307 req-5379b861-c2e6-43f4-97f8-7a6640eef424 service neutron] Bound port: 019b5836-92b2-46a9-b759-bc76db1e523c, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'be836a59-b961-4a22-8321-d34bfacbfc89', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': 'fccebd84-efb7-429a-baa9-bc8330d63138'}}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:58:34.956024 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-ffab542f-ec8d-4ead-8d55-a2ce867c8307 req-5379b861-c2e6-43f4-97f8-7a6640eef424 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:35.022285 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-ffab542f-ec8d-4ead-8d55-a2ce867c8307 req-5379b861-c2e6-43f4-97f8-7a6640eef424 service neutron] For port 019b5836-92b2-46a9-b759-bc76db1e523c, host hv-neutron-8168, cleared binding levels {{(pid=102162) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:58:35.025459 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-ffab542f-ec8d-4ead-8d55-a2ce867c8307 req-5379b861-c2e6-43f4-97f8-7a6640eef424 service neutron] For port 019b5836-92b2-46a9-b759-bc76db1e523c, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=019b5836-92b2-46a9-b759-bc76db1e523c,segment=NetworkSegment(be836a59-b961-4a22-8321-d34bfacbfc89),segment_id=be836a59-b961-4a22-8321-d34bfacbfc89)] {{(pid=102162) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:58:35.090118 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-ffab542f-ec8d-4ead-8d55-a2ce867c8307 req-5379b861-c2e6-43f4-97f8-7a6640eef424 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:35.126376 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffab542f-ec8d-4ead-8d55-a2ce867c8307 req-5379b861-c2e6-43f4-97f8-7a6640eef424 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:58:35.127068 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-ffab542f-ec8d-4ead-8d55-a2ce867c8307 req-5379b861-c2e6-43f4-97f8-7a6640eef424 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:35.128667 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ffab542f-ec8d-4ead-8d55-a2ce867c8307 req-5379b861-c2e6-43f4-97f8-7a6640eef424 service neutron] 10.222.0.26 "PUT /v2.0/ports/019b5836-92b2-46a9-b759-bc76db1e523c HTTP/1.1" status: 200 len: 1093 time: 0.7823641 Nov 09 04:58:35.129180 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '72029a2a-bec9-4104-9851-08be6b385945', 'tag': '019b5836-92b2-46a9-b759-bc76db1e523c'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:58:35.131556 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7b8b4eb9-0d04-483e-ae75-183f94987165" -d '{"events": [{"name": "network-changed", "server_uuid": "72029a2a-bec9-4104-9851-08be6b385945", "tag": "019b5836-92b2-46a9-b759-bc76db1e523c"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:58:35.156945 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5379b861-c2e6-43f4-97f8-7a6640eef424 service neutron] Pushing event updated for resources: {'Port': ['ID=019b5836-92b2-46a9-b759-bc76db1e523c,revision_number=3']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:35.179695 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:58:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-80865c22-52a1-46d8-abd2-88f15222b0c0 x-openstack-request-id: req-80865c22-52a1-46d8-abd2-88f15222b0c0 {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:58:35.179695 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "72029a2a-bec9-4104-9851-08be6b385945", "tag": "019b5836-92b2-46a9-b759-bc76db1e523c", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:58:35.179695 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-80865c22-52a1-46d8-abd2-88f15222b0c0 {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:58:35.179695 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '72029a2a-bec9-4104-9851-08be6b385945', 'tag': '019b5836-92b2-46a9-b759-bc76db1e523c', 'status': 'completed', 'code': 200} Nov 09 04:58:35.239975 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b8b4eb9-0d04-483e-ae75-183f94987165 req-c0dd3941-d67a-4b01-a913-51352208f5ae service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:58:35.241499 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7b8b4eb9-0d04-483e-ae75-183f94987165 req-c0dd3941-d67a-4b01-a913-51352208f5ae service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=7a7a505be3334ab3b14ba7506d59802d&device_id=72029a2a-bec9-4104-9851-08be6b385945 HTTP/1.1" status: 200 len: 1096 time: 0.0430245 Nov 09 04:58:35.346064 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b8b4eb9-0d04-483e-ae75-183f94987165 req-91c6d84e-accc-4f35-91fe-6fdf02b1e300 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:58:35.347607 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7b8b4eb9-0d04-483e-ae75-183f94987165 req-91c6d84e-accc-4f35-91fe-6fdf02b1e300 service neutron] 10.222.0.26 "GET /v2.0/networks?tenant_id=7a7a505be3334ab3b14ba7506d59802d&shared=False HTTP/1.1" status: 200 len: 917 time: 0.0973525 Nov 09 04:58:35.446832 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b8b4eb9-0d04-483e-ae75-183f94987165 req-8e5fa9de-f3bd-4d5d-8e12-789162a91b72 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:58:35.448193 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7b8b4eb9-0d04-483e-ae75-183f94987165 req-8e5fa9de-f3bd-4d5d-8e12-789162a91b72 service neutron] 10.222.0.26 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0917480 Nov 09 04:58:35.521425 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffab542f-ec8d-4ead-8d55-a2ce867c8307 req-f55ab63a-75c5-4352-9d86-6f93011237a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:58:35.522992 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ffab542f-ec8d-4ead-8d55-a2ce867c8307 req-f55ab63a-75c5-4352-9d86-6f93011237a4 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=7a7a505be3334ab3b14ba7506d59802d&device_id=72029a2a-bec9-4104-9851-08be6b385945 HTTP/1.1" status: 200 len: 1096 time: 0.0402858 Nov 09 04:58:35.565224 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ffab542f-ec8d-4ead-8d55-a2ce867c8307 req-49393d34-707e-499f-86de-e17b6b4c0e8a service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=019b5836-92b2-46a9-b759-bc76db1e523c HTTP/1.1" status: 200 len: 217 time: 0.0340321 Nov 09 04:58:35.621104 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffab542f-ec8d-4ead-8d55-a2ce867c8307 req-cacd8817-1a2b-4d99-a216-a62cc56cbbf7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:58:35.622574 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ffab542f-ec8d-4ead-8d55-a2ce867c8307 req-cacd8817-1a2b-4d99-a216-a62cc56cbbf7 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=f0cd2ee2-fde7-47c0-bf41-7e97bc17cff8 HTTP/1.1" status: 200 len: 855 time: 0.0458746 Nov 09 04:58:35.675027 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffab542f-ec8d-4ead-8d55-a2ce867c8307 req-08d368fb-210b-48a3-9754-1aa7515e7113 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:58:35.676596 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ffab542f-ec8d-4ead-8d55-a2ce867c8307 req-08d368fb-210b-48a3-9754-1aa7515e7113 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=fccebd84-efb7-429a-baa9-bc8330d63138&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0459361 Nov 09 04:58:35.767777 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ffab542f-ec8d-4ead-8d55-a2ce867c8307 req-78a56c27-1e12-4f2d-b576-0722a8ee327e service neutron] 10.222.0.26 "GET /v2.0/networks/fccebd84-efb7-429a-baa9-bc8330d63138?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0839400 Nov 09 04:58:35.859387 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ffab542f-ec8d-4ead-8d55-a2ce867c8307 req-a15580de-3f9c-4b66-8e96-228e3d8bd5a9 service neutron] 10.222.0.26 "GET /v2.0/networks/fccebd84-efb7-429a-baa9-bc8330d63138?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0848165 Nov 09 04:58:36.044306 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5352a426-bffd-4ccd-baa0-e64a68fe5c49 req-00867a6b-ed6e-496e-b94c-fe768e357f99 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:58:36.045708 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-5352a426-bffd-4ccd-baa0-e64a68fe5c49 req-00867a6b-ed6e-496e-b94c-fe768e357f99 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/ports?device_id=72029a2a-bec9-4104-9851-08be6b385945 HTTP/1.1" status: 200 len: 943 time: 0.0499818 Nov 09 04:58:36.097109 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-5352a426-bffd-4ccd-baa0-e64a68fe5c49 req-398f6844-117a-427a-9045-e9fd316b4b86 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/security-groups?id=38ad7e09-c43f-42df-a8ec-4b9fe996949f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0445609 Nov 09 04:58:37.212360 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3c075e7-cb0c-4888-89e1-fb1d4343ed70 req-6aab9354-045c-4aa7-b22b-033a35d0ec88 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:58:37.213736 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d3c075e7-cb0c-4888-89e1-fb1d4343ed70 req-6aab9354-045c-4aa7-b22b-033a35d0ec88 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/ports?device_id=72029a2a-bec9-4104-9851-08be6b385945 HTTP/1.1" status: 200 len: 943 time: 0.0485742 Nov 09 04:58:37.258731 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d3c075e7-cb0c-4888-89e1-fb1d4343ed70 req-3098b60d-30cf-4f97-adba-fb877e9ffaf4 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/security-groups?id=38ad7e09-c43f-42df-a8ec-4b9fe996949f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389202 Nov 09 04:58:38.371068 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6aceaee0-b7f2-465d-996b-c4bd3fb5b8e2 req-8112672c-4552-4ba9-a471-4a646ea3c83d tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:58:38.372518 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-6aceaee0-b7f2-465d-996b-c4bd3fb5b8e2 req-8112672c-4552-4ba9-a471-4a646ea3c83d tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/ports?device_id=72029a2a-bec9-4104-9851-08be6b385945 HTTP/1.1" status: 200 len: 943 time: 0.0481029 Nov 09 04:58:38.423023 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-6aceaee0-b7f2-465d-996b-c4bd3fb5b8e2 req-39e657c6-9be8-4269-93f6-742c76afa04f tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/security-groups?id=38ad7e09-c43f-42df-a8ec-4b9fe996949f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0444229 Nov 09 04:58:38.989272 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 019b5836-92b2-46a9-b759-bc76db1e523c details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=102163) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 09 04:58:39.079589 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 019b5836-92b2-46a9-b759-bc76db1e523c, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=019b5836-92b2-46a9-b759-bc76db1e523c,segment=NetworkSegment(be836a59-b961-4a22-8321-d34bfacbfc89),segment_id=be836a59-b961-4a22-8321-d34bfacbfc89)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:58:39.090666 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Returning: {'device': '019b5836-92b2-46a9-b759-bc76db1e523c', 'network_id': 'fccebd84-efb7-429a-baa9-bc8330d63138', 'port_id': '019b5836-92b2-46a9-b759-bc76db1e523c', 'mac_address': 'fa:16:3e:52:78:28', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 336, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f0cd2ee2-fde7-47c0-bf41-7e97bc17cff8', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102163) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 09 04:58:39.128998 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:39.140961 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 019b5836-92b2-46a9-b759-bc76db1e523c {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:58:39.160275 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 019b5836-92b2-46a9-b759-bc76db1e523c, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=019b5836-92b2-46a9-b759-bc76db1e523c,segment=NetworkSegment(be836a59-b961-4a22-8321-d34bfacbfc89),segment_id=be836a59-b961-4a22-8321-d34bfacbfc89)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:58:39.249099 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:39.295294 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=019b5836-92b2-46a9-b759-bc76db1e523c,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:39.487269 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['019b5836-92b2-46a9-b759-bc76db1e523c'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 04:58:39.540056 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b9392e2-02b8-4eb7-8a95-b4a9fff4561a req-5d1915f1-6603-4804-9869-66cfd1cb545a tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:58:39.541530 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5b9392e2-02b8-4eb7-8a95-b4a9fff4561a req-5d1915f1-6603-4804-9869-66cfd1cb545a tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/ports?device_id=72029a2a-bec9-4104-9851-08be6b385945 HTTP/1.1" status: 200 len: 944 time: 0.0519361 Nov 09 04:58:39.588078 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5b9392e2-02b8-4eb7-8a95-b4a9fff4561a req-d9d48f69-1d34-4903-ad29-74ecd9881b3d tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/security-groups?id=38ad7e09-c43f-42df-a8ec-4b9fe996949f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403728 Nov 09 04:58:40.700506 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79266194-487a-4bbe-a828-5d512c7029c1 req-d29ec9c9-7633-44bb-a73f-9454729ab93e tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:58:40.701943 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-79266194-487a-4bbe-a828-5d512c7029c1 req-d29ec9c9-7633-44bb-a73f-9454729ab93e tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/ports?device_id=72029a2a-bec9-4104-9851-08be6b385945 HTTP/1.1" status: 200 len: 944 time: 0.0478401 Nov 09 04:58:40.746819 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-79266194-487a-4bbe-a828-5d512c7029c1 req-8d93f05c-3bce-4b7f-9079-30995d552755 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/security-groups?id=38ad7e09-c43f-42df-a8ec-4b9fe996949f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391159 Nov 09 04:58:41.056651 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 019b5836-92b2-46a9-b759-bc76db1e523c up at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:58:41.168704 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning for port 019b5836-92b2-46a9-b759-bc76db1e523c completed by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 09 04:58:41.172454 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning complete for port 019b5836-92b2-46a9-b759-bc76db1e523c triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:58:41.172846 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:41.250622 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:41.276057 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '72029a2a-bec9-4104-9851-08be6b385945', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '019b5836-92b2-46a9-b759-bc76db1e523c'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:58:41.278282 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9f16c171-02f0-449e-9e0d-33a7827bbf7c" -d '{"events": [{"server_uuid": "72029a2a-bec9-4104-9851-08be6b385945", "name": "network-vif-plugged", "status": "completed", "tag": "019b5836-92b2-46a9-b759-bc76db1e523c"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:58:41.297054 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 019b5836-92b2-46a9-b759-bc76db1e523c, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=019b5836-92b2-46a9-b759-bc76db1e523c,segment=NetworkSegment(be836a59-b961-4a22-8321-d34bfacbfc89),segment_id=be836a59-b961-4a22-8321-d34bfacbfc89)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:58:41.314044 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:58:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f7f05db2-d8f1-4aa3-b03a-8288e19a10c5 x-openstack-request-id: req-f7f05db2-d8f1-4aa3-b03a-8288e19a10c5 {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:58:41.314320 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "72029a2a-bec9-4104-9851-08be6b385945", "name": "network-vif-plugged", "status": "completed", "tag": "019b5836-92b2-46a9-b759-bc76db1e523c", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:58:41.319768 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-f7f05db2-d8f1-4aa3-b03a-8288e19a10c5 {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:58:41.319768 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '72029a2a-bec9-4104-9851-08be6b385945', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '019b5836-92b2-46a9-b759-bc76db1e523c', 'code': 200} Nov 09 04:58:41.380301 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-95d6739b-2f08-4f77-9121-9e421fae1ba9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:41.403437 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:41.450695 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=019b5836-92b2-46a9-b759-bc76db1e523c,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:58:41.637135 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f22216ce-3ce6-4865-99ae-a9e3719a214a req-acb8d5bd-ed28-4f98-96ca-511f336945b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:58:41.638653 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f22216ce-3ce6-4865-99ae-a9e3719a214a req-acb8d5bd-ed28-4f98-96ca-511f336945b7 service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=72029a2a-bec9-4104-9851-08be6b385945 HTTP/1.1" status: 200 len: 1098 time: 0.0389745 Nov 09 04:58:41.682213 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f22216ce-3ce6-4865-99ae-a9e3719a214a req-861ef680-055d-4a36-bf0f-e64df1733f06 service neutron] 10.222.0.26 "GET /v2.0/security-groups?id=38ad7e09-c43f-42df-a8ec-4b9fe996949f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0355399 Nov 09 04:58:41.867346 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d4fc998-1473-4602-baac-dd6723f111fd req-6e5eb6c4-4ac9-40c4-b2f5-73b5e31e4776 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:58:41.868794 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-6d4fc998-1473-4602-baac-dd6723f111fd req-6e5eb6c4-4ac9-40c4-b2f5-73b5e31e4776 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/ports?device_id=72029a2a-bec9-4104-9851-08be6b385945 HTTP/1.1" status: 200 len: 945 time: 0.0519929 Nov 09 04:58:41.916093 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-6d4fc998-1473-4602-baac-dd6723f111fd req-523cd1c2-c62d-4dba-ae07-0e4103b1b809 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/security-groups?id=38ad7e09-c43f-42df-a8ec-4b9fe996949f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415068 Nov 09 04:58:42.397400 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:43.032064 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f58f3f9f-88cf-44da-aade-efc38c5e4f6b req-a0fcedc8-f110-4050-ad57-948ad662acde tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:58:43.033568 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f58f3f9f-88cf-44da-aade-efc38c5e4f6b req-a0fcedc8-f110-4050-ad57-948ad662acde tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/ports?device_id=72029a2a-bec9-4104-9851-08be6b385945 HTTP/1.1" status: 200 len: 945 time: 0.0492079 Nov 09 04:58:43.085239 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f58f3f9f-88cf-44da-aade-efc38c5e4f6b req-1cad4180-8d9f-475e-b869-8df8e0221512 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/security-groups?id=38ad7e09-c43f-42df-a8ec-4b9fe996949f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0450830 Nov 09 04:58:43.198139 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a1fbe3c-1254-4e59-a493-dc8941d0eea1 req-12d0d8e4-cd7e-461a-8980-8e50bfbe34a6 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:58:43.199539 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-4a1fbe3c-1254-4e59-a493-dc8941d0eea1 req-12d0d8e4-cd7e-461a-8980-8e50bfbe34a6 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/ports?device_id=72029a2a-bec9-4104-9851-08be6b385945 HTTP/1.1" status: 200 len: 945 time: 0.0490348 Nov 09 04:58:43.247831 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-4a1fbe3c-1254-4e59-a493-dc8941d0eea1 req-ad7be911-97be-410d-845e-973828e9b927 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/security-groups?id=38ad7e09-c43f-42df-a8ec-4b9fe996949f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423508 Nov 09 04:58:43.724099 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1ccea859-d2a3-4286-982e-1cf302dfb22c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:45.217777 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:46.589230 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:58:46.989377 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:59:07.455285 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:59:11.346158 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a3c8162-8732-423b-9aff-5354edb96fe1 req-4ecdcdcf-4ab2-469c-95ab-179262117028 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:59:11.347636 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9a3c8162-8732-423b-9aff-5354edb96fe1 req-4ecdcdcf-4ab2-469c-95ab-179262117028 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/ports?device_id=72029a2a-bec9-4104-9851-08be6b385945 HTTP/1.1" status: 200 len: 945 time: 0.0541801 Nov 09 04:59:11.364700 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c1aa9ab0-2b44-4fa6-933c-460f80c8e0e9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:59:11.396697 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9a3c8162-8732-423b-9aff-5354edb96fe1 req-82ee7c81-62a2-4a28-96d1-e3b7586103c1 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/security-groups?id=38ad7e09-c43f-42df-a8ec-4b9fe996949f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431185 Nov 09 04:59:12.437055 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:59:12.517822 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1bfea3a-b255-4fd1-9c52-5acdb13118c6 req-d826ece2-1b41-40b3-b2ea-9d1a4d61f435 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:59:12.519843 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c1bfea3a-b255-4fd1-9c52-5acdb13118c6 req-d826ece2-1b41-40b3-b2ea-9d1a4d61f435 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/ports?device_id=72029a2a-bec9-4104-9851-08be6b385945 HTTP/1.1" status: 200 len: 945 time: 0.0534215 Nov 09 04:59:12.566235 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c1bfea3a-b255-4fd1-9c52-5acdb13118c6 req-7da222d9-4308-4f03-8f4b-d7ab4de43562 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/security-groups?id=38ad7e09-c43f-42df-a8ec-4b9fe996949f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410142 Nov 09 04:59:12.846097 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79e04311-30c4-4906-96de-39a750f201de req-50eeb2da-e152-4daa-ab40-1dcf573c0ca4 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:59:12.847579 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-79e04311-30c4-4906-96de-39a750f201de req-50eeb2da-e152-4daa-ab40-1dcf573c0ca4 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.26 "GET /v2.0/ports?device_id=72029a2a-bec9-4104-9851-08be6b385945 HTTP/1.1" status: 200 len: 945 time: 0.0479300 Nov 09 04:59:12.940090 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-79e04311-30c4-4906-96de-39a750f201de req-71916e0c-39f5-422d-920c-11a7a509a386 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Deleting port 019b5836-92b2-46a9-b759-bc76db1e523c {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:59:12.940428 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-79e04311-30c4-4906-96de-39a750f201de req-71916e0c-39f5-422d-920c-11a7a509a386 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:59:13.026287 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-79e04311-30c4-4906-96de-39a750f201de req-71916e0c-39f5-422d-920c-11a7a509a386 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] For port 019b5836-92b2-46a9-b759-bc76db1e523c, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=019b5836-92b2-46a9-b759-bc76db1e523c,segment=NetworkSegment(be836a59-b961-4a22-8321-d34bfacbfc89),segment_id=be836a59-b961-4a22-8321-d34bfacbfc89)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:59:13.026677 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-79e04311-30c4-4906-96de-39a750f201de req-71916e0c-39f5-422d-920c-11a7a509a386 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:59:13.039631 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-79e04311-30c4-4906-96de-39a750f201de req-71916e0c-39f5-422d-920c-11a7a509a386 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Calling delete_port for 019b5836-92b2-46a9-b759-bc76db1e523c owned by compute:nova {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:59:13.244907 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-79e04311-30c4-4906-96de-39a750f201de req-71916e0c-39f5-422d-920c-11a7a509a386 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:59:13.256957 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['019b5836-92b2-46a9-b759-bc76db1e523c'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 04:59:13.273002 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71916e0c-39f5-422d-920c-11a7a509a386 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Pushing event deleted for resources: {'Port': ['ID=019b5836-92b2-46a9-b759-bc76db1e523c,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:59:13.286649 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71916e0c-39f5-422d-920c-11a7a509a386 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:59:13.287010 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71916e0c-39f5-422d-920c-11a7a509a386 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:59:13.287342 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71916e0c-39f5-422d-920c-11a7a509a386 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:59:13.287687 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71916e0c-39f5-422d-920c-11a7a509a386 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:59:13.288023 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71916e0c-39f5-422d-920c-11a7a509a386 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:59:13.288357 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71916e0c-39f5-422d-920c-11a7a509a386 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:59:13.288685 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71916e0c-39f5-422d-920c-11a7a509a386 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:59:13.289012 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71916e0c-39f5-422d-920c-11a7a509a386 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:59:13.289358 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71916e0c-39f5-422d-920c-11a7a509a386 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:59:13.289683 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71916e0c-39f5-422d-920c-11a7a509a386 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:59:13.290011 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71916e0c-39f5-422d-920c-11a7a509a386 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:59:13.290334 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71916e0c-39f5-422d-920c-11a7a509a386 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:59:13.328191 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-79e04311-30c4-4906-96de-39a750f201de req-71916e0c-39f5-422d-920c-11a7a509a386 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] No DVR routers for this DVR port 019b5836-92b2-46a9-b759-bc76db1e523c on host hv-neutron-8168 {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:59:13.330809 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-79e04311-30c4-4906-96de-39a750f201de req-71916e0c-39f5-422d-920c-11a7a509a386 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:59:13.334987 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-79e04311-30c4-4906-96de-39a750f201de req-71916e0c-39f5-422d-920c-11a7a509a386 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.26 "DELETE /v2.0/ports/019b5836-92b2-46a9-b759-bc76db1e523c HTTP/1.1" status: 204 len: 173 time: 0.4803610 Nov 09 04:59:13.334987 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '72029a2a-bec9-4104-9851-08be6b385945', 'name': 'network-vif-deleted', 'tag': '019b5836-92b2-46a9-b759-bc76db1e523c'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:59:13.336883 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-47b1b998-0a9c-4b08-bfd0-14ad1ffb5cf6" -d '{"events": [{"server_uuid": "72029a2a-bec9-4104-9851-08be6b385945", "name": "network-vif-deleted", "tag": "019b5836-92b2-46a9-b759-bc76db1e523c"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:59:13.374154 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:59:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-405b4711-0d59-47aa-84da-5d44fae5471b x-openstack-request-id: req-405b4711-0d59-47aa-84da-5d44fae5471b {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:59:13.374467 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "72029a2a-bec9-4104-9851-08be6b385945", "name": "network-vif-deleted", "tag": "019b5836-92b2-46a9-b759-bc76db1e523c", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:59:13.374718 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-405b4711-0d59-47aa-84da-5d44fae5471b {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:59:13.375159 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '72029a2a-bec9-4104-9851-08be6b385945', 'name': 'network-vif-deleted', 'tag': '019b5836-92b2-46a9-b759-bc76db1e523c', 'status': 'completed', 'code': 200} Nov 09 04:59:13.665447 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-7c8a6711-be6d-49ea-9d84-9b595e250624 req-752e209e-866d-4c4f-93a6-d8c7f3d95a05 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/ports?device_id=72029a2a-bec9-4104-9851-08be6b385945 HTTP/1.1" status: 200 len: 210 time: 0.0285852 Nov 09 04:59:13.725295 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-cfd00182-0373-47ea-b59d-805ef7060bf4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:59:15.221983 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:59:15.577336 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a85608f6-386e-4a87-9144-ad01a44803c3 req-e70ac662-ad13-4558-abdb-5e973a75b3a6 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:59:15.578811 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-a85608f6-386e-4a87-9144-ad01a44803c3 req-e70ac662-ad13-4558-abdb-5e973a75b3a6 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/networks?id=fccebd84-efb7-429a-baa9-bc8330d63138 HTTP/1.1" status: 200 len: 816 time: 0.1028256 Nov 09 04:59:15.594005 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-a85608f6-386e-4a87-9144-ad01a44803c3 req-9b2799b8-5b00-45f8-8076-1fa8c67bd0c8 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/quotas/7a7a505be3334ab3b14ba7506d59802d HTTP/1.1" status: 200 len: 375 time: 0.0088177 Nov 09 04:59:15.645126 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-a85608f6-386e-4a87-9144-ad01a44803c3 req-7c16b9fd-5dfd-4e72-a1fb-f50a7bf8c135 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/ports?tenant_id=7a7a505be3334ab3b14ba7506d59802d&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0457816 Nov 09 04:59:15.740289 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-a85608f6-386e-4a87-9144-ad01a44803c3 req-ea1b0e0a-f7e1-44f8-b3ef-35796e6bc39c service neutron] 10.222.0.24 "GET /v2.0/networks/fccebd84-efb7-429a-baa9-bc8330d63138?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0838947 Nov 09 04:59:15.827433 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-a85608f6-386e-4a87-9144-ad01a44803c3 req-a29b51aa-d4f4-4965-ae4c-f4eb05644d31 service neutron] 10.222.0.24 "GET /v2.0/networks/fccebd84-efb7-429a-baa9-bc8330d63138?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0811145 Nov 09 04:59:16.137476 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4576ca66-1a90-41b7-9c99-205a83ada33a req-53d0696a-b544-4d24-8c90-bf9891ac8adb tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/ports?device_id=c7aeaba5-39a9-47ce-abc0-03dd0d8db2f9 HTTP/1.1" status: 200 len: 210 time: 0.0255294 Nov 09 04:59:16.581964 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:59:17.024480 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:59:17.230410 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-57628b1f-a820-45fc-ae07-1feeda8ab93e req-21e86e60-cc60-448a-8db9-fdc319f92c9f tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/ports?device_id=c7aeaba5-39a9-47ce-abc0-03dd0d8db2f9 HTTP/1.1" status: 200 len: 210 time: 0.0277915 Nov 09 04:59:17.270133 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 019b5836-92b2-46a9-b759-bc76db1e523c no longer exists at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:59:17.292503 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] No Port match for: 019b5836-92b2-46a9-b759-bc76db1e523c {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:59:17.292756 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 019b5836-92b2-46a9-b759-bc76db1e523c not bound to the agent host hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:59:18.326503 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1a495aae-c9d1-4509-a6f5-5ee19f844722 req-456d8d9d-d71e-4091-8cd2-ee4219be199d tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/ports?device_id=c7aeaba5-39a9-47ce-abc0-03dd0d8db2f9 HTTP/1.1" status: 200 len: 210 time: 0.0265265 Nov 09 04:59:18.432752 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a85608f6-386e-4a87-9144-ad01a44803c3 req-d4ae04cc-6c7b-4dcd-9013-ce8f42ef7ed6 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:59:18.434159 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a85608f6-386e-4a87-9144-ad01a44803c3 req-d4ae04cc-6c7b-4dcd-9013-ce8f42ef7ed6 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.26 "GET /v2.0/networks?id=fccebd84-efb7-429a-baa9-bc8330d63138 HTTP/1.1" status: 200 len: 816 time: 0.1027751 Nov 09 04:59:18.447834 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-a85608f6-386e-4a87-9144-ad01a44803c3 req-db82f4f5-adb5-455f-8990-68ab236a5313 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Request body: {'port': {'device_id': 'c7aeaba5-39a9-47ce-abc0-03dd0d8db2f9', 'network_id': 'fccebd84-efb7-429a-baa9-bc8330d63138', 'admin_state_up': True, 'tenant_id': '7a7a505be3334ab3b14ba7506d59802d'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:59:18.638915 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a85608f6-386e-4a87-9144-ad01a44803c3 req-db82f4f5-adb5-455f-8990-68ab236a5313 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Made reservation on behalf of 7a7a505be3334ab3b14ba7506d59802d for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 04:59:18.643067 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-a85608f6-386e-4a87-9144-ad01a44803c3 req-db82f4f5-adb5-455f-8990-68ab236a5313 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:59:18.767559 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [req-a85608f6-386e-4a87-9144-ad01a44803c3 req-db82f4f5-adb5-455f-8990-68ab236a5313 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Allocated IP 172.20.0.12 (fccebd84-efb7-429a-baa9-bc8330d63138/f0cd2ee2-fde7-47c0-bf41-7e97bc17cff8/15f2b50d-efd0-4576-8d2d-9072640eb4ac) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 04:59:18.913235 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-a85608f6-386e-4a87-9144-ad01a44803c3 req-db82f4f5-adb5-455f-8990-68ab236a5313 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:59:19.076610 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-a85608f6-386e-4a87-9144-ad01a44803c3 req-db82f4f5-adb5-455f-8990-68ab236a5313 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:59:19.118281 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a85608f6-386e-4a87-9144-ad01a44803c3 req-db82f4f5-adb5-455f-8990-68ab236a5313 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Network fccebd84-efb7-429a-baa9-bc8330d63138 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 04:59:19.123198 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [req-a85608f6-386e-4a87-9144-ad01a44803c3 req-db82f4f5-adb5-455f-8990-68ab236a5313 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 04:59:19.126972 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-a85608f6-386e-4a87-9144-ad01a44803c3 req-db82f4f5-adb5-455f-8990-68ab236a5313 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 04:59:19.133180 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db82f4f5-adb5-455f-8990-68ab236a5313 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Pushing event updated for resources: {'Port': ['ID=15f2b50d-efd0-4576-8d2d-9072640eb4ac,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:59:19.179808 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a85608f6-386e-4a87-9144-ad01a44803c3 req-db82f4f5-adb5-455f-8990-68ab236a5313 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:59:19.180336 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-a85608f6-386e-4a87-9144-ad01a44803c3 req-db82f4f5-adb5-455f-8990-68ab236a5313 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:59:19.321778 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a85608f6-386e-4a87-9144-ad01a44803c3 req-db82f4f5-adb5-455f-8990-68ab236a5313 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.26 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.8777707 Nov 09 04:59:19.329799 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e51fdacd-d993-4263-bfb8-062c2d11e23a None None] Provisioning complete for port 15f2b50d-efd0-4576-8d2d-9072640eb4ac triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:59:19.330282 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e51fdacd-d993-4263-bfb8-062c2d11e23a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:59:19.333175 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [req-a85608f6-386e-4a87-9144-ad01a44803c3 req-2a39b457-970f-4c91-883b-fdd8c183cdb7 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] http://10.222.0.24:9696/v2.0/extensions returned with HTTP 200 {{(pid=102162) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 04:59:19.334148 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a85608f6-386e-4a87-9144-ad01a44803c3 req-2a39b457-970f-4c91-883b-fdd8c183cdb7 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.26 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0052695 Nov 09 04:59:19.365591 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e51fdacd-d993-4263-bfb8-062c2d11e23a None None] Port 15f2b50d-efd0-4576-8d2d-9072640eb4ac cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 04:59:19.392032 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-a85608f6-386e-4a87-9144-ad01a44803c3 req-8c155776-5082-4ada-8d0d-af42d392786c service neutron] Request body: {'port': {'device_id': 'c7aeaba5-39a9-47ce-abc0-03dd0d8db2f9', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 04:59:19.448765 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-a85608f6-386e-4a87-9144-ad01a44803c3 req-8c155776-5082-4ada-8d0d-af42d392786c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:59:19.448981 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a86a16c2-0952-4bc0-9fc8-9ef45cdecd84 req-ba605ae7-fec1-48f3-bc70-db63b7417ec4 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:59:19.450233 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-a86a16c2-0952-4bc0-9fc8-9ef45cdecd84 req-ba605ae7-fec1-48f3-bc70-db63b7417ec4 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/ports?device_id=c7aeaba5-39a9-47ce-abc0-03dd0d8db2f9 HTTP/1.1" status: 200 len: 932 time: 0.0523920 Nov 09 04:59:19.497183 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-a86a16c2-0952-4bc0-9fc8-9ef45cdecd84 req-b9d88a2d-56a6-4852-ab19-91f2746f7e17 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/security-groups?id=38ad7e09-c43f-42df-a8ec-4b9fe996949f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400710 Nov 09 04:59:19.944664 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [req-a85608f6-386e-4a87-9144-ad01a44803c3 req-8c155776-5082-4ada-8d0d-af42d392786c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 15f2b50d-efd0-4576-8d2d-9072640eb4ac {{(pid=102162) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:59:19.951853 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-a85608f6-386e-4a87-9144-ad01a44803c3 req-8c155776-5082-4ada-8d0d-af42d392786c service neutron] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:59:19.963821 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.provisioning_blocks [req-a85608f6-386e-4a87-9144-ad01a44803c3 req-8c155776-5082-4ada-8d0d-af42d392786c service neutron] Transition to ACTIVE for port object 15f2b50d-efd0-4576-8d2d-9072640eb4ac will not be triggered until provisioned by entity L2. {{(pid=102162) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 09 04:59:20.036184 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-a85608f6-386e-4a87-9144-ad01a44803c3 req-8c155776-5082-4ada-8d0d-af42d392786c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:59:20.086418 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c155776-5082-4ada-8d0d-af42d392786c service neutron] Pushing event updated for resources: {'Port': ['ID=15f2b50d-efd0-4576-8d2d-9072640eb4ac,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:59:20.159433 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-a85608f6-386e-4a87-9144-ad01a44803c3 req-8c155776-5082-4ada-8d0d-af42d392786c service neutron] Attempting to bind port 15f2b50d-efd0-4576-8d2d-9072640eb4ac on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 04:59:20.166429 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-a85608f6-386e-4a87-9144-ad01a44803c3 req-8c155776-5082-4ada-8d0d-af42d392786c service neutron] Attempting to bind port 15f2b50d-efd0-4576-8d2d-9072640eb4ac by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'be836a59-b961-4a22-8321-d34bfacbfc89', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': 'fccebd84-efb7-429a-baa9-bc8330d63138'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 04:59:20.166429 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a85608f6-386e-4a87-9144-ad01a44803c3 req-8c155776-5082-4ada-8d0d-af42d392786c service neutron] Attempting to bind port 15f2b50d-efd0-4576-8d2d-9072640eb4ac on network fccebd84-efb7-429a-baa9-bc8330d63138 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:59:20.166429 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a85608f6-386e-4a87-9144-ad01a44803c3 req-8c155776-5082-4ada-8d0d-af42d392786c service neutron] Port 15f2b50d-efd0-4576-8d2d-9072640eb4ac on network fccebd84-efb7-429a-baa9-bc8330d63138 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 04:59:20.166429 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a85608f6-386e-4a87-9144-ad01a44803c3 req-8c155776-5082-4ada-8d0d-af42d392786c service neutron] Attempting to bind port 15f2b50d-efd0-4576-8d2d-9072640eb4ac on network fccebd84-efb7-429a-baa9-bc8330d63138 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 04:59:20.169845 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a85608f6-386e-4a87-9144-ad01a44803c3 req-8c155776-5082-4ada-8d0d-af42d392786c service neutron] Checking agent: {'id': '7d36b884-4ad2-4878-9464-bf647030b544', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'started_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 59, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 04:59:20.170253 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a85608f6-386e-4a87-9144-ad01a44803c3 req-8c155776-5082-4ada-8d0d-af42d392786c service neutron] Checking segment: {'id': 'be836a59-b961-4a22-8321-d34bfacbfc89', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': 'fccebd84-efb7-429a-baa9-bc8330d63138'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 04:59:20.170793 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a85608f6-386e-4a87-9144-ad01a44803c3 req-8c155776-5082-4ada-8d0d-af42d392786c service neutron] Bound using segment: {'id': 'be836a59-b961-4a22-8321-d34bfacbfc89', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': 'fccebd84-efb7-429a-baa9-bc8330d63138'} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 04:59:20.171289 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-a85608f6-386e-4a87-9144-ad01a44803c3 req-8c155776-5082-4ada-8d0d-af42d392786c service neutron] Bound port: 15f2b50d-efd0-4576-8d2d-9072640eb4ac, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'be836a59-b961-4a22-8321-d34bfacbfc89', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': 'fccebd84-efb7-429a-baa9-bc8330d63138'}}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 04:59:20.171633 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-a85608f6-386e-4a87-9144-ad01a44803c3 req-8c155776-5082-4ada-8d0d-af42d392786c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:59:20.247657 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-a85608f6-386e-4a87-9144-ad01a44803c3 req-8c155776-5082-4ada-8d0d-af42d392786c service neutron] For port 15f2b50d-efd0-4576-8d2d-9072640eb4ac, host hv-neutron-8168, cleared binding levels {{(pid=102162) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 04:59:20.250589 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-a85608f6-386e-4a87-9144-ad01a44803c3 req-8c155776-5082-4ada-8d0d-af42d392786c service neutron] For port 15f2b50d-efd0-4576-8d2d-9072640eb4ac, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=15f2b50d-efd0-4576-8d2d-9072640eb4ac,segment=NetworkSegment(be836a59-b961-4a22-8321-d34bfacbfc89),segment_id=be836a59-b961-4a22-8321-d34bfacbfc89)] {{(pid=102162) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 04:59:20.311341 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-a85608f6-386e-4a87-9144-ad01a44803c3 req-8c155776-5082-4ada-8d0d-af42d392786c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:59:20.345192 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a85608f6-386e-4a87-9144-ad01a44803c3 req-8c155776-5082-4ada-8d0d-af42d392786c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:59:20.345881 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-a85608f6-386e-4a87-9144-ad01a44803c3 req-8c155776-5082-4ada-8d0d-af42d392786c service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:59:20.347192 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a85608f6-386e-4a87-9144-ad01a44803c3 req-8c155776-5082-4ada-8d0d-af42d392786c service neutron] 10.222.0.26 "PUT /v2.0/ports/15f2b50d-efd0-4576-8d2d-9072640eb4ac HTTP/1.1" status: 200 len: 1094 time: 1.0052924 Nov 09 04:59:20.347631 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c7aeaba5-39a9-47ce-abc0-03dd0d8db2f9', 'tag': '15f2b50d-efd0-4576-8d2d-9072640eb4ac'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:59:20.349880 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-17ac2c95-6af8-4a08-a2c9-90beb882033c" -d '{"events": [{"name": "network-changed", "server_uuid": "c7aeaba5-39a9-47ce-abc0-03dd0d8db2f9", "tag": "15f2b50d-efd0-4576-8d2d-9072640eb4ac"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:59:20.380101 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c155776-5082-4ada-8d0d-af42d392786c service neutron] Pushing event updated for resources: {'Port': ['ID=15f2b50d-efd0-4576-8d2d-9072640eb4ac,revision_number=3']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:59:20.387663 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 04:59:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-654140ab-e7df-4e9a-a4cf-87bb3e042b31 x-openstack-request-id: req-654140ab-e7df-4e9a-a4cf-87bb3e042b31 {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:59:20.387962 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c7aeaba5-39a9-47ce-abc0-03dd0d8db2f9", "tag": "15f2b50d-efd0-4576-8d2d-9072640eb4ac", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:59:20.388216 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-654140ab-e7df-4e9a-a4cf-87bb3e042b31 {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:59:20.388643 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c7aeaba5-39a9-47ce-abc0-03dd0d8db2f9', 'tag': '15f2b50d-efd0-4576-8d2d-9072640eb4ac', 'status': 'completed', 'code': 200} Nov 09 04:59:20.457735 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17ac2c95-6af8-4a08-a2c9-90beb882033c req-05f9f3b1-cbb9-4ae7-8aaa-1502b338491d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:59:20.459286 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-17ac2c95-6af8-4a08-a2c9-90beb882033c req-05f9f3b1-cbb9-4ae7-8aaa-1502b338491d service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=7a7a505be3334ab3b14ba7506d59802d&device_id=c7aeaba5-39a9-47ce-abc0-03dd0d8db2f9 HTTP/1.1" status: 200 len: 1097 time: 0.0472898 Nov 09 04:59:20.562910 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17ac2c95-6af8-4a08-a2c9-90beb882033c req-03a45736-5053-4903-b37c-d4853434be86 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:59:20.564417 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-17ac2c95-6af8-4a08-a2c9-90beb882033c req-03a45736-5053-4903-b37c-d4853434be86 service neutron] 10.222.0.26 "GET /v2.0/networks?tenant_id=7a7a505be3334ab3b14ba7506d59802d&shared=False HTTP/1.1" status: 200 len: 917 time: 0.0967853 Nov 09 04:59:20.615429 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0dadf1e6-ac72-48a6-aa96-5302a3b6219a req-39e06f15-d811-4a5e-a7a2-52c638bfd670 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:59:20.616949 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-0dadf1e6-ac72-48a6-aa96-5302a3b6219a req-39e06f15-d811-4a5e-a7a2-52c638bfd670 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/ports?device_id=c7aeaba5-39a9-47ce-abc0-03dd0d8db2f9 HTTP/1.1" status: 200 len: 944 time: 0.0511093 Nov 09 04:59:20.663988 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-0dadf1e6-ac72-48a6-aa96-5302a3b6219a req-4ab916a2-171b-4706-a1ab-c36c2b5e0d3d tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/security-groups?id=38ad7e09-c43f-42df-a8ec-4b9fe996949f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409725 Nov 09 04:59:20.664440 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17ac2c95-6af8-4a08-a2c9-90beb882033c req-bab1d3ff-936a-48fd-96d3-ca8ee95fefe0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:59:20.665930 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-17ac2c95-6af8-4a08-a2c9-90beb882033c req-bab1d3ff-936a-48fd-96d3-ca8ee95fefe0 service neutron] 10.222.0.26 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0941122 Nov 09 04:59:20.740889 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a85608f6-386e-4a87-9144-ad01a44803c3 req-ab148157-ff9f-4a7e-95d6-ea518351e6c2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:59:20.742377 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a85608f6-386e-4a87-9144-ad01a44803c3 req-ab148157-ff9f-4a7e-95d6-ea518351e6c2 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=7a7a505be3334ab3b14ba7506d59802d&device_id=c7aeaba5-39a9-47ce-abc0-03dd0d8db2f9 HTTP/1.1" status: 200 len: 1097 time: 0.0400245 Nov 09 04:59:20.788233 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a85608f6-386e-4a87-9144-ad01a44803c3 req-b44f8fa0-81c9-4719-a733-fc32f5e18165 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=15f2b50d-efd0-4576-8d2d-9072640eb4ac HTTP/1.1" status: 200 len: 217 time: 0.0370839 Nov 09 04:59:20.836110 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a85608f6-386e-4a87-9144-ad01a44803c3 req-92d6e1e8-b7f4-4b2e-a7cf-6a4a1ad5d494 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:59:20.837508 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a85608f6-386e-4a87-9144-ad01a44803c3 req-92d6e1e8-b7f4-4b2e-a7cf-6a4a1ad5d494 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=f0cd2ee2-fde7-47c0-bf41-7e97bc17cff8 HTTP/1.1" status: 200 len: 855 time: 0.0426435 Nov 09 04:59:20.882614 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a85608f6-386e-4a87-9144-ad01a44803c3 req-a2853c96-3663-42aa-8911-e6da0546a960 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:59:20.884115 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a85608f6-386e-4a87-9144-ad01a44803c3 req-a2853c96-3663-42aa-8911-e6da0546a960 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=fccebd84-efb7-429a-baa9-bc8330d63138&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0399032 Nov 09 04:59:20.976783 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a85608f6-386e-4a87-9144-ad01a44803c3 req-98b80c24-a691-4e5e-857f-4d9d593bd386 service neutron] 10.222.0.26 "GET /v2.0/networks/fccebd84-efb7-429a-baa9-bc8330d63138?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0844412 Nov 09 04:59:21.063433 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a85608f6-386e-4a87-9144-ad01a44803c3 req-2651dd10-58ba-44f8-84d6-52436f3eaab4 service neutron] 10.222.0.26 "GET /v2.0/networks/fccebd84-efb7-429a-baa9-bc8330d63138?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0797901 Nov 09 04:59:21.779263 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d65724f9-21b1-4a0e-8a22-7d07720c4bb3 req-750bb83d-5458-40d0-a615-dad5e26097da tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:59:21.780771 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d65724f9-21b1-4a0e-8a22-7d07720c4bb3 req-750bb83d-5458-40d0-a615-dad5e26097da tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/ports?device_id=c7aeaba5-39a9-47ce-abc0-03dd0d8db2f9 HTTP/1.1" status: 200 len: 944 time: 0.0489547 Nov 09 04:59:21.831745 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d65724f9-21b1-4a0e-8a22-7d07720c4bb3 req-0c7ae115-3503-4b07-84df-aa82294e7418 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/security-groups?id=38ad7e09-c43f-42df-a8ec-4b9fe996949f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0449986 Nov 09 04:59:22.945437 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46326283-27bb-43e6-b150-d5033e47dee9 req-1d25d20b-66d2-423b-9ed3-8a4afc5d976d tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:59:22.946959 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-46326283-27bb-43e6-b150-d5033e47dee9 req-1d25d20b-66d2-423b-9ed3-8a4afc5d976d tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/ports?device_id=c7aeaba5-39a9-47ce-abc0-03dd0d8db2f9 HTTP/1.1" status: 200 len: 944 time: 0.0481744 Nov 09 04:59:22.997389 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-46326283-27bb-43e6-b150-d5033e47dee9 req-9e8e0aa0-d6a5-4bde-ba34-4e5ea23e99a1 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/security-groups?id=38ad7e09-c43f-42df-a8ec-4b9fe996949f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0445588 Nov 09 04:59:23.300976 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 15f2b50d-efd0-4576-8d2d-9072640eb4ac details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=102163) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 09 04:59:23.391003 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 15f2b50d-efd0-4576-8d2d-9072640eb4ac, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=15f2b50d-efd0-4576-8d2d-9072640eb4ac,segment=NetworkSegment(be836a59-b961-4a22-8321-d34bfacbfc89),segment_id=be836a59-b961-4a22-8321-d34bfacbfc89)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:59:23.402457 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Returning: {'device': '15f2b50d-efd0-4576-8d2d-9072640eb4ac', 'network_id': 'fccebd84-efb7-429a-baa9-bc8330d63138', 'port_id': '15f2b50d-efd0-4576-8d2d-9072640eb4ac', 'mac_address': 'fa:16:3e:71:d5:d9', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 336, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f0cd2ee2-fde7-47c0-bf41-7e97bc17cff8', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102163) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 09 04:59:23.440483 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:59:23.452579 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 15f2b50d-efd0-4576-8d2d-9072640eb4ac {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 04:59:23.471765 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 15f2b50d-efd0-4576-8d2d-9072640eb4ac, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=15f2b50d-efd0-4576-8d2d-9072640eb4ac,segment=NetworkSegment(be836a59-b961-4a22-8321-d34bfacbfc89),segment_id=be836a59-b961-4a22-8321-d34bfacbfc89)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:59:23.572927 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:59:23.618278 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=15f2b50d-efd0-4576-8d2d-9072640eb4ac,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:59:23.625056 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:59:23.625404 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:59:23.626259 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:59:23.626617 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:59:23.626947 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:59:23.627286 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:59:23.627602 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:59:23.627926 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:59:23.628242 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:59:23.628565 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:59:23.628880 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:59:23.629194 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 04:59:23.764541 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['15f2b50d-efd0-4576-8d2d-9072640eb4ac'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 04:59:24.108848 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-048bf09b-bbc4-4caa-9b32-51b4cde51c7b req-41305d02-d2e3-4f53-9318-966e23cbf0ca tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:59:24.110808 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-048bf09b-bbc4-4caa-9b32-51b4cde51c7b req-41305d02-d2e3-4f53-9318-966e23cbf0ca tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/ports?device_id=c7aeaba5-39a9-47ce-abc0-03dd0d8db2f9 HTTP/1.1" status: 200 len: 945 time: 0.0481441 Nov 09 04:59:24.160563 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-048bf09b-bbc4-4caa-9b32-51b4cde51c7b req-58ccd95b-265e-49d0-b35a-a59e0e8c489d tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/security-groups?id=38ad7e09-c43f-42df-a8ec-4b9fe996949f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402691 Nov 09 04:59:25.273770 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3441339-610d-4b62-a3a9-eb6fe4e29a91 req-3ef900d3-2f91-4669-a150-ef1442dfff3e tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:59:25.275290 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-a3441339-610d-4b62-a3a9-eb6fe4e29a91 req-3ef900d3-2f91-4669-a150-ef1442dfff3e tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/ports?device_id=c7aeaba5-39a9-47ce-abc0-03dd0d8db2f9 HTTP/1.1" status: 200 len: 945 time: 0.0523295 Nov 09 04:59:25.299857 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 15f2b50d-efd0-4576-8d2d-9072640eb4ac up at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 04:59:25.321842 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-a3441339-610d-4b62-a3a9-eb6fe4e29a91 req-09340607-c1b4-45ff-a272-55e49b9b8af5 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/security-groups?id=38ad7e09-c43f-42df-a8ec-4b9fe996949f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407403 Nov 09 04:59:25.515513 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning for port 15f2b50d-efd0-4576-8d2d-9072640eb4ac completed by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 09 04:59:25.519341 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning complete for port 15f2b50d-efd0-4576-8d2d-9072640eb4ac triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 04:59:25.519708 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:59:25.596076 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:59:25.617991 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c7aeaba5-39a9-47ce-abc0-03dd0d8db2f9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '15f2b50d-efd0-4576-8d2d-9072640eb4ac'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:59:25.620246 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8b5f1896-f176-4311-bca8-ea40de383d43" -d '{"events": [{"server_uuid": "c7aeaba5-39a9-47ce-abc0-03dd0d8db2f9", "name": "network-vif-plugged", "status": "completed", "tag": "15f2b50d-efd0-4576-8d2d-9072640eb4ac"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:59:25.632742 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 15f2b50d-efd0-4576-8d2d-9072640eb4ac, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=15f2b50d-efd0-4576-8d2d-9072640eb4ac,segment=NetworkSegment(be836a59-b961-4a22-8321-d34bfacbfc89),segment_id=be836a59-b961-4a22-8321-d34bfacbfc89)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:59:25.656751 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:59:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-415c22b1-d9bd-4f69-ade0-9491e0111f5b x-openstack-request-id: req-415c22b1-d9bd-4f69-ade0-9491e0111f5b {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:59:25.657051 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c7aeaba5-39a9-47ce-abc0-03dd0d8db2f9", "name": "network-vif-plugged", "status": "completed", "tag": "15f2b50d-efd0-4576-8d2d-9072640eb4ac", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:59:25.657273 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-415c22b1-d9bd-4f69-ade0-9491e0111f5b {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:59:25.658085 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c7aeaba5-39a9-47ce-abc0-03dd0d8db2f9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '15f2b50d-efd0-4576-8d2d-9072640eb4ac', 'code': 200} Nov 09 04:59:25.741576 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:59:25.787110 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=15f2b50d-efd0-4576-8d2d-9072640eb4ac,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:59:26.107585 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f78e6be-b729-44a6-81e7-db2689783577 req-966b9705-953e-4669-9aa8-5a89de99b0e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:59:26.108961 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7f78e6be-b729-44a6-81e7-db2689783577 req-966b9705-953e-4669-9aa8-5a89de99b0e8 service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=c7aeaba5-39a9-47ce-abc0-03dd0d8db2f9 HTTP/1.1" status: 200 len: 1099 time: 0.0392215 Nov 09 04:59:26.153396 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7f78e6be-b729-44a6-81e7-db2689783577 req-b1c7f613-0d0b-464d-813c-4d5308b333ac service neutron] 10.222.0.26 "GET /v2.0/security-groups?id=38ad7e09-c43f-42df-a8ec-4b9fe996949f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0367849 Nov 09 04:59:26.433615 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8fe31ee-14c7-4288-baf2-ce6df3d5ebc7 req-68f8fd53-a9d7-4de0-af66-19c8a768af72 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:59:26.435095 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-a8fe31ee-14c7-4288-baf2-ce6df3d5ebc7 req-68f8fd53-a9d7-4de0-af66-19c8a768af72 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/ports?device_id=c7aeaba5-39a9-47ce-abc0-03dd0d8db2f9 HTTP/1.1" status: 200 len: 946 time: 0.0478809 Nov 09 04:59:26.480969 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-a8fe31ee-14c7-4288-baf2-ce6df3d5ebc7 req-ebdd1425-6775-4c9a-afa4-26003e72980e tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/security-groups?id=38ad7e09-c43f-42df-a8ec-4b9fe996949f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400820 Nov 09 04:59:27.598135 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96664875-c1a0-42ea-b494-45073a8890dd req-372e68ce-37e4-44c1-86a0-215c4cef348d tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:59:27.599644 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-96664875-c1a0-42ea-b494-45073a8890dd req-372e68ce-37e4-44c1-86a0-215c4cef348d tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/ports?device_id=c7aeaba5-39a9-47ce-abc0-03dd0d8db2f9 HTTP/1.1" status: 200 len: 946 time: 0.0514283 Nov 09 04:59:27.646078 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-96664875-c1a0-42ea-b494-45073a8890dd req-a805dbce-3404-44cf-9f68-11b47687e4fe tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/security-groups?id=38ad7e09-c43f-42df-a8ec-4b9fe996949f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405111 Nov 09 04:59:27.773241 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9dbd0b49-2d77-48fc-9cb2-3bbfcea670e2 req-6ce116bb-def9-4d4f-8758-4d70eb77494f tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:59:27.774821 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-9dbd0b49-2d77-48fc-9cb2-3bbfcea670e2 req-6ce116bb-def9-4d4f-8758-4d70eb77494f tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/ports?device_id=c7aeaba5-39a9-47ce-abc0-03dd0d8db2f9 HTTP/1.1" status: 200 len: 946 time: 0.0517747 Nov 09 04:59:27.821154 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-9dbd0b49-2d77-48fc-9cb2-3bbfcea670e2 req-1cf0e537-7790-4788-b44d-007f9dc8e05b tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/security-groups?id=38ad7e09-c43f-42df-a8ec-4b9fe996949f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404730 Nov 09 04:59:41.409643 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-136d100b-34ad-4596-8f1d-6bd1e668815f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:59:42.477700 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:59:43.824081 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f8cb27b4-15c4-4080-92a5-9c9c54586c27 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:59:44.453586 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 04:59:45.226612 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:59:46.583827 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:59:46.980571 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:59:54.982384 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-689422bf-050f-4fc3-bf7b-3c52206f0a64 req-96968ecb-8fef-40b7-a132-a743c4017f44 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:59:54.984725 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-689422bf-050f-4fc3-bf7b-3c52206f0a64 req-96968ecb-8fef-40b7-a132-a743c4017f44 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/ports?device_id=c7aeaba5-39a9-47ce-abc0-03dd0d8db2f9 HTTP/1.1" status: 200 len: 946 time: 0.0522497 Nov 09 04:59:55.034500 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-689422bf-050f-4fc3-bf7b-3c52206f0a64 req-c6935863-2598-44ff-8425-35c0e068a064 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/security-groups?id=38ad7e09-c43f-42df-a8ec-4b9fe996949f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434299 Nov 09 04:59:56.148629 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ece6bfb-50e3-45ba-a92f-c04e10c82216 req-cedcef3c-1261-4528-b5c3-5a482e84dc4c tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:59:56.150002 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-1ece6bfb-50e3-45ba-a92f-c04e10c82216 req-cedcef3c-1261-4528-b5c3-5a482e84dc4c tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/ports?device_id=c7aeaba5-39a9-47ce-abc0-03dd0d8db2f9 HTTP/1.1" status: 200 len: 946 time: 0.0481858 Nov 09 04:59:56.195979 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-1ece6bfb-50e3-45ba-a92f-c04e10c82216 req-b2d7f571-c942-4548-993c-517b01d95ba6 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/security-groups?id=38ad7e09-c43f-42df-a8ec-4b9fe996949f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393932 Nov 09 04:59:56.539560 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0dcef6a6-2c65-487e-9714-25c5e2288bc2 req-78a8079e-e5a9-4ff2-b781-cbf5788d17d9 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 04:59:56.540992 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-0dcef6a6-2c65-487e-9714-25c5e2288bc2 req-78a8079e-e5a9-4ff2-b781-cbf5788d17d9 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.26 "GET /v2.0/ports?device_id=c7aeaba5-39a9-47ce-abc0-03dd0d8db2f9 HTTP/1.1" status: 200 len: 946 time: 0.0510051 Nov 09 04:59:56.627784 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-0dcef6a6-2c65-487e-9714-25c5e2288bc2 req-c88d26c1-f67a-4035-af5b-8de1ef380a4c tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Deleting port 15f2b50d-efd0-4576-8d2d-9072640eb4ac {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:59:56.628121 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-0dcef6a6-2c65-487e-9714-25c5e2288bc2 req-c88d26c1-f67a-4035-af5b-8de1ef380a4c tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:59:56.718543 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-0dcef6a6-2c65-487e-9714-25c5e2288bc2 req-c88d26c1-f67a-4035-af5b-8de1ef380a4c tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] For port 15f2b50d-efd0-4576-8d2d-9072640eb4ac, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=15f2b50d-efd0-4576-8d2d-9072640eb4ac,segment=NetworkSegment(be836a59-b961-4a22-8321-d34bfacbfc89),segment_id=be836a59-b961-4a22-8321-d34bfacbfc89)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:59:56.718900 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-0dcef6a6-2c65-487e-9714-25c5e2288bc2 req-c88d26c1-f67a-4035-af5b-8de1ef380a4c tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:59:56.731049 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-0dcef6a6-2c65-487e-9714-25c5e2288bc2 req-c88d26c1-f67a-4035-af5b-8de1ef380a4c tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Calling delete_port for 15f2b50d-efd0-4576-8d2d-9072640eb4ac owned by compute:nova {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:59:56.928884 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-0dcef6a6-2c65-487e-9714-25c5e2288bc2 req-c88d26c1-f67a-4035-af5b-8de1ef380a4c tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:59:56.941414 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['15f2b50d-efd0-4576-8d2d-9072640eb4ac'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 04:59:56.963300 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c88d26c1-f67a-4035-af5b-8de1ef380a4c tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Pushing event deleted for resources: {'Port': ['ID=15f2b50d-efd0-4576-8d2d-9072640eb4ac,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:59:57.005347 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-0dcef6a6-2c65-487e-9714-25c5e2288bc2 req-c88d26c1-f67a-4035-af5b-8de1ef380a4c tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] No DVR routers for this DVR port 15f2b50d-efd0-4576-8d2d-9072640eb4ac on host hv-neutron-8168 {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 04:59:57.008067 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-0dcef6a6-2c65-487e-9714-25c5e2288bc2 req-c88d26c1-f67a-4035-af5b-8de1ef380a4c tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:59:57.011700 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-0dcef6a6-2c65-487e-9714-25c5e2288bc2 req-c88d26c1-f67a-4035-af5b-8de1ef380a4c tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.26 "DELETE /v2.0/ports/15f2b50d-efd0-4576-8d2d-9072640eb4ac HTTP/1.1" status: 204 len: 173 time: 0.4640036 Nov 09 04:59:57.012776 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c7aeaba5-39a9-47ce-abc0-03dd0d8db2f9', 'name': 'network-vif-deleted', 'tag': '15f2b50d-efd0-4576-8d2d-9072640eb4ac'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 04:59:57.014432 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ba389177-b82b-4ad2-804f-a09146b5c7b9" -d '{"events": [{"server_uuid": "c7aeaba5-39a9-47ce-abc0-03dd0d8db2f9", "name": "network-vif-deleted", "tag": "15f2b50d-efd0-4576-8d2d-9072640eb4ac"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 04:59:57.108408 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 04:59:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e67f6cb6-a72c-4dc8-b453-1ad593e79fcd x-openstack-request-id: req-e67f6cb6-a72c-4dc8-b453-1ad593e79fcd {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 04:59:57.108772 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c7aeaba5-39a9-47ce-abc0-03dd0d8db2f9", "name": "network-vif-deleted", "tag": "15f2b50d-efd0-4576-8d2d-9072640eb4ac", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 04:59:57.109104 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-e67f6cb6-a72c-4dc8-b453-1ad593e79fcd {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 04:59:57.109500 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c7aeaba5-39a9-47ce-abc0-03dd0d8db2f9', 'name': 'network-vif-deleted', 'tag': '15f2b50d-efd0-4576-8d2d-9072640eb4ac', 'status': 'completed', 'code': 200} Nov 09 04:59:57.298288 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d74d52d3-bddd-4507-83e3-c231433e5011 req-c742b86d-b459-42d4-a04b-0d0865ec24e8 tempest-TestEncryptedCinderVolumes-502294184 tempest-TestEncryptedCinderVolumes-502294184-project] 10.222.0.24 "GET /v2.0/ports?device_id=c7aeaba5-39a9-47ce-abc0-03dd0d8db2f9 HTTP/1.1" status: 200 len: 210 time: 0.0301940 Nov 09 04:59:58.459375 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 36098) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 04:59:58.859167 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3306bc55-04b6-4de8-b0c6-2b5d3a46da84 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:59:59.139646 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-3306bc55-04b6-4de8-b0c6-2b5d3a46da84 admin admin] Deleting port 7b539bb4-5b78-4d71-803e-0556d1aa8da8 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 04:59:59.139899 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3306bc55-04b6-4de8-b0c6-2b5d3a46da84 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:59:59.213834 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-3306bc55-04b6-4de8-b0c6-2b5d3a46da84 admin admin] For port 7b539bb4-5b78-4d71-803e-0556d1aa8da8, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=7b539bb4-5b78-4d71-803e-0556d1aa8da8,segment=NetworkSegment(be836a59-b961-4a22-8321-d34bfacbfc89),segment_id=be836a59-b961-4a22-8321-d34bfacbfc89)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 04:59:59.214195 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3306bc55-04b6-4de8-b0c6-2b5d3a46da84 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:59:59.233102 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-3306bc55-04b6-4de8-b0c6-2b5d3a46da84 admin admin] Calling delete_port for 7b539bb4-5b78-4d71-803e-0556d1aa8da8 owned by network:router_interface {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 04:59:59.477388 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3306bc55-04b6-4de8-b0c6-2b5d3a46da84 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:59:59.508026 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3306bc55-04b6-4de8-b0c6-2b5d3a46da84 admin admin] Pushing event deleted for resources: {'Port': ['ID=7b539bb4-5b78-4d71-803e-0556d1aa8da8,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 04:59:59.508942 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 15f2b50d-efd0-4576-8d2d-9072640eb4ac no longer exists at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 04:59:59.530931 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] No Port match for: 15f2b50d-efd0-4576-8d2d-9072640eb4ac {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 04:59:59.531273 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 15f2b50d-efd0-4576-8d2d-9072640eb4ac not bound to the agent host hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 04:59:59.668302 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3306bc55-04b6-4de8-b0c6-2b5d3a46da84 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 04:59:59.877895 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3306bc55-04b6-4de8-b0c6-2b5d3a46da84 admin admin] Router ec949f32-500d-4daa-9463-8a606200ee0a has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 05:00:00.226090 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3306bc55-04b6-4de8-b0c6-2b5d3a46da84 admin admin] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 05:00:00.231802 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-3306bc55-04b6-4de8-b0c6-2b5d3a46da84 admin admin] 10.222.0.24 "PUT /v2.0/routers/ec949f32-500d-4daa-9463-8a606200ee0a/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7705932 Nov 09 05:00:00.234413 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 36100) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:00:00.235406 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-435e3522-177d-4972-a7f5-90b8b08135bb None None] Sync routers for ids ['ec949f32-500d-4daa-9463-8a606200ee0a'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 05:00:00.245309 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-435e3522-177d-4972-a7f5-90b8b08135bb None None] Routers {'ec949f32-500d-4daa-9463-8a606200ee0a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:00:00.245919 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-435e3522-177d-4972-a7f5-90b8b08135bb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:59:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['ec949f32-500d-4daa-9463-8a606200ee0a'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:00:00.335701 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c496344e-395c-45bc-b844-6e043d41d711 admin admin] Publish callbacks [] for router, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:00.346681 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-435e3522-177d-4972-a7f5-90b8b08135bb None None] Set router ec949f32-500d-4daa-9463-8a606200ee0a gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:00:00.441395 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c496344e-395c-45bc-b844-6e043d41d711 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:00.598601 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-c496344e-395c-45bc-b844-6e043d41d711 admin admin] Deleting port e047caaa-2c99-4fed-adde-3ce05d586db6 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:00:00.599332 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c496344e-395c-45bc-b844-6e043d41d711 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:00.665719 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-435e3522-177d-4972-a7f5-90b8b08135bb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ec949f32-500d-4daa-9463-8a606200ee0a', 'name': 'tempest-TestEncryptedCinderVolumes-389564536-router', 'tenant_id': '7a7a505be3334ab3b14ba7506d59802d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.144'}], 'enable_snat': True}, 'gw_port_id': 'e047caaa-2c99-4fed-adde-3ce05d586db6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:58:17Z', 'updated_at': '2021-11-09T04:59:59Z', 'revision_number': 5, 'project_id': '7a7a505be3334ab3b14ba7506d59802d', 'gw_port': {'id': 'e047caaa-2c99-4fed-adde-3ce05d586db6', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:90:1b:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec949f32-500d-4daa-9463-8a606200ee0a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1641, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.144', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:58:17Z', 'updated_at': '2021-11-09T04:58:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:00:00.676216 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-c496344e-395c-45bc-b844-6e043d41d711 admin admin] For port e047caaa-2c99-4fed-adde-3ce05d586db6, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=e047caaa-2c99-4fed-adde-3ce05d586db6,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:00:00.676578 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c496344e-395c-45bc-b844-6e043d41d711 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:00.688994 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-c496344e-395c-45bc-b844-6e043d41d711 admin admin] Calling delete_port for e047caaa-2c99-4fed-adde-3ce05d586db6 owned by network:router_gateway {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:00:00.691092 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-435e3522-177d-4972-a7f5-90b8b08135bb None None] Checking router: ec949f32-500d-4daa-9463-8a606200ee0a for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 05:00:00.699332 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-435e3522-177d-4972-a7f5-90b8b08135bb None None] Routers {'ec949f32-500d-4daa-9463-8a606200ee0a'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:00:00.699923 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-435e3522-177d-4972-a7f5-90b8b08135bb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:59:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['ec949f32-500d-4daa-9463-8a606200ee0a'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:00:00.784778 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-435e3522-177d-4972-a7f5-90b8b08135bb None None] Set router ec949f32-500d-4daa-9463-8a606200ee0a gateway port host: None {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:00:00.838623 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-435e3522-177d-4972-a7f5-90b8b08135bb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ec949f32-500d-4daa-9463-8a606200ee0a', 'name': 'tempest-TestEncryptedCinderVolumes-389564536-router', 'tenant_id': '7a7a505be3334ab3b14ba7506d59802d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:58:17Z', 'updated_at': '2021-11-09T05:00:00Z', 'revision_number': 6, 'project_id': '7a7a505be3334ab3b14ba7506d59802d', 'gw_port_host': None}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:00:00.865008 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-435e3522-177d-4972-a7f5-90b8b08135bb None None] The sync data for ids ['ec949f32-500d-4daa-9463-8a606200ee0a'] in dv-neutron-816802-2-hyperv is: [{'id': 'ec949f32-500d-4daa-9463-8a606200ee0a', 'name': 'tempest-TestEncryptedCinderVolumes-389564536-router', 'tenant_id': '7a7a505be3334ab3b14ba7506d59802d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:58:17Z', 'updated_at': '2021-11-09T05:00:00Z', 'revision_number': 6, 'project_id': '7a7a505be3334ab3b14ba7506d59802d', 'gw_port_host': None}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 05:00:00.948810 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c496344e-395c-45bc-b844-6e043d41d711 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:00.978910 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c496344e-395c-45bc-b844-6e043d41d711 admin admin] Pushing event deleted for resources: {'Port': ['ID=e047caaa-2c99-4fed-adde-3ce05d586db6,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:00:01.036729 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c496344e-395c-45bc-b844-6e043d41d711 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-466373'] for router_gateway, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:01.122534 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c496344e-395c-45bc-b844-6e043d41d711 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:01.125066 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c496344e-395c-45bc-b844-6e043d41d711 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:01.266440 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c496344e-395c-45bc-b844-6e043d41d711 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:01.267079 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c496344e-395c-45bc-b844-6e043d41d711 admin admin] Fanout notify agent at l3_agent the message router_deleted on router ec949f32-500d-4daa-9463-8a606200ee0a {{(pid=102162) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 05:00:01.271360 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c496344e-395c-45bc-b844-6e043d41d711 admin admin] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:01.272533 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-c496344e-395c-45bc-b844-6e043d41d711 admin admin] 10.222.0.24 "DELETE /v2.0/routers/ec949f32-500d-4daa-9463-8a606200ee0a HTTP/1.1" status: 204 len: 168 time: 1.0371604 Nov 09 05:00:01.275396 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36102) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:00:01.319851 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-28da357f-bdcf-46e1-bcc6-a64c87176c88 admin admin] Deleting subnet f0cd2ee2-fde7-47c0-bf41-7e97bc17cff8 {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 05:00:01.322823 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-28da357f-bdcf-46e1-bcc6-a64c87176c88 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:01.355655 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-28da357f-bdcf-46e1-bcc6-a64c87176c88 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:01.434803 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-28da357f-bdcf-46e1-bcc6-a64c87176c88 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:01.549113 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-28da357f-bdcf-46e1-bcc6-a64c87176c88 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:01.575005 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28da357f-bdcf-46e1-bcc6-a64c87176c88 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=f0cd2ee2-fde7-47c0-bf41-7e97bc17cff8,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:00:01.583952 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28da357f-bdcf-46e1-bcc6-a64c87176c88 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:00:01.584406 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28da357f-bdcf-46e1-bcc6-a64c87176c88 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:00:01.584656 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28da357f-bdcf-46e1-bcc6-a64c87176c88 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:00:01.584841 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-026a2646-1ae6-49b3-a59d-64b568c1acdc None None] Network fccebd84-efb7-429a-baa9-bc8330d63138 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 05:00:01.584992 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28da357f-bdcf-46e1-bcc6-a64c87176c88 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:00:01.585318 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28da357f-bdcf-46e1-bcc6-a64c87176c88 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:00:01.585646 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28da357f-bdcf-46e1-bcc6-a64c87176c88 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:00:01.585971 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28da357f-bdcf-46e1-bcc6-a64c87176c88 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:00:01.586299 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28da357f-bdcf-46e1-bcc6-a64c87176c88 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:00:01.586647 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28da357f-bdcf-46e1-bcc6-a64c87176c88 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:00:01.586969 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28da357f-bdcf-46e1-bcc6-a64c87176c88 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:00:01.587288 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28da357f-bdcf-46e1-bcc6-a64c87176c88 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:00:01.587606 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28da357f-bdcf-46e1-bcc6-a64c87176c88 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:00:01.590591 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-28da357f-bdcf-46e1-bcc6-a64c87176c88 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:01.594779 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-28da357f-bdcf-46e1-bcc6-a64c87176c88 admin admin] 10.222.0.24 "DELETE /v2.0/subnets/f0cd2ee2-fde7-47c0-bf41-7e97bc17cff8 HTTP/1.1" status: 204 len: 168 time: 0.3168383 Nov 09 05:00:01.596458 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36104) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:00:01.668586 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d9e1bdbb-fa46-4c7b-97b9-39333667c5ef admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:01.724678 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-d9e1bdbb-fa46-4c7b-97b9-39333667c5ef admin admin] Deleting port dbb20c30-ca89-42ca-b822-3e371439c571 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:00:01.725260 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d9e1bdbb-fa46-4c7b-97b9-39333667c5ef admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:01.780879 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-334c7241-3f40-4a7d-a1ab-2bda1864bc21 None None] DHCP port deletion for fccebd84-efb7-429a-baa9-bc8330d63138 request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 05:00:01.795692 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-d9e1bdbb-fa46-4c7b-97b9-39333667c5ef admin admin] For port dbb20c30-ca89-42ca-b822-3e371439c571, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=dbb20c30-ca89-42ca-b822-3e371439c571,segment=NetworkSegment(be836a59-b961-4a22-8321-d34bfacbfc89),segment_id=be836a59-b961-4a22-8321-d34bfacbfc89)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:00:01.796121 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d9e1bdbb-fa46-4c7b-97b9-39333667c5ef admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:01.810477 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-d9e1bdbb-fa46-4c7b-97b9-39333667c5ef admin admin] Calling delete_port for dbb20c30-ca89-42ca-b822-3e371439c571 owned by network:dhcp {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:00:01.831465 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-334c7241-3f40-4a7d-a1ab-2bda1864bc21 None None] Deleting port dbb20c30-ca89-42ca-b822-3e371439c571 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:00:01.831842 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-334c7241-3f40-4a7d-a1ab-2bda1864bc21 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:01.908604 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-334c7241-3f40-4a7d-a1ab-2bda1864bc21 None None] For port dbb20c30-ca89-42ca-b822-3e371439c571, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=dbb20c30-ca89-42ca-b822-3e371439c571,segment=NetworkSegment(be836a59-b961-4a22-8321-d34bfacbfc89),segment_id=be836a59-b961-4a22-8321-d34bfacbfc89)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:00:01.909028 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-334c7241-3f40-4a7d-a1ab-2bda1864bc21 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:01.921752 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-334c7241-3f40-4a7d-a1ab-2bda1864bc21 None None] Calling delete_port for dbb20c30-ca89-42ca-b822-3e371439c571 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:00:01.969022 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d9e1bdbb-fa46-4c7b-97b9-39333667c5ef admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:01.988994 dv-neutron-816802-2-hyperv neutron-server[102163]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 05:00:01.988994 dv-neutron-816802-2-hyperv neutron-server[102163]: self.session.flush() Nov 09 05:00:01.988994 dv-neutron-816802-2-hyperv neutron-server[102163]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 05:00:01.988994 dv-neutron-816802-2-hyperv neutron-server[102163]: self.session.flush() Nov 09 05:00:01.988994 dv-neutron-816802-2-hyperv neutron-server[102163]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 05:00:01.988994 dv-neutron-816802-2-hyperv neutron-server[102163]: self.session.flush() Nov 09 05:00:01.988994 dv-neutron-816802-2-hyperv neutron-server[102163]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 05:00:01.988994 dv-neutron-816802-2-hyperv neutron-server[102163]: self.session.flush() Nov 09 05:00:01.988994 dv-neutron-816802-2-hyperv neutron-server[102163]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 05:00:01.988994 dv-neutron-816802-2-hyperv neutron-server[102163]: self.session.flush() Nov 09 05:00:01.988994 dv-neutron-816802-2-hyperv neutron-server[102163]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 05:00:01.988994 dv-neutron-816802-2-hyperv neutron-server[102163]: self.session.flush() Nov 09 05:00:01.988994 dv-neutron-816802-2-hyperv neutron-server[102163]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 05:00:01.988994 dv-neutron-816802-2-hyperv neutron-server[102163]: self.session.flush() Nov 09 05:00:01.988994 dv-neutron-816802-2-hyperv neutron-server[102163]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 05:00:01.988994 dv-neutron-816802-2-hyperv neutron-server[102163]: self.session.flush() Nov 09 05:00:01.988994 dv-neutron-816802-2-hyperv neutron-server[102163]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 05:00:01.988994 dv-neutron-816802-2-hyperv neutron-server[102163]: self.session.flush() Nov 09 05:00:01.988994 dv-neutron-816802-2-hyperv neutron-server[102163]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 05:00:01.988994 dv-neutron-816802-2-hyperv neutron-server[102163]: self.session.flush() Nov 09 05:00:01.988994 dv-neutron-816802-2-hyperv neutron-server[102163]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 05:00:01.988994 dv-neutron-816802-2-hyperv neutron-server[102163]: self.session.flush() Nov 09 05:00:01.988994 dv-neutron-816802-2-hyperv neutron-server[102163]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 05:00:01.988994 dv-neutron-816802-2-hyperv neutron-server[102163]: self.session.flush() Nov 09 05:00:01.988994 dv-neutron-816802-2-hyperv neutron-server[102163]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 05:00:01.988994 dv-neutron-816802-2-hyperv neutron-server[102163]: self.session.flush() Nov 09 05:00:01.988994 dv-neutron-816802-2-hyperv neutron-server[102163]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 05:00:01.988994 dv-neutron-816802-2-hyperv neutron-server[102163]: self.session.flush() Nov 09 05:00:01.988994 dv-neutron-816802-2-hyperv neutron-server[102163]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 05:00:01.988994 dv-neutron-816802-2-hyperv neutron-server[102163]: self.session.flush() Nov 09 05:00:01.988994 dv-neutron-816802-2-hyperv neutron-server[102163]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 05:00:01.988994 dv-neutron-816802-2-hyperv neutron-server[102163]: self.session.flush() Nov 09 05:00:01.988994 dv-neutron-816802-2-hyperv neutron-server[102163]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 05:00:01.988994 dv-neutron-816802-2-hyperv neutron-server[102163]: self.session.flush() Nov 09 05:00:01.988994 dv-neutron-816802-2-hyperv neutron-server[102163]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 05:00:01.988994 dv-neutron-816802-2-hyperv neutron-server[102163]: self.session.flush() Nov 09 05:00:01.988994 dv-neutron-816802-2-hyperv neutron-server[102163]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 05:00:01.988994 dv-neutron-816802-2-hyperv neutron-server[102163]: self.session.flush() Nov 09 05:00:01.988994 dv-neutron-816802-2-hyperv neutron-server[102163]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 05:00:01.988994 dv-neutron-816802-2-hyperv neutron-server[102163]: self.session.flush() Nov 09 05:00:01.988994 dv-neutron-816802-2-hyperv neutron-server[102163]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 05:00:01.988994 dv-neutron-816802-2-hyperv neutron-server[102163]: self.session.flush() Nov 09 05:00:01.988994 dv-neutron-816802-2-hyperv neutron-server[102163]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 05:00:01.988994 dv-neutron-816802-2-hyperv neutron-server[102163]: self.session.flush() Nov 09 05:00:01.988994 dv-neutron-816802-2-hyperv neutron-server[102163]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 05:00:01.988994 dv-neutron-816802-2-hyperv neutron-server[102163]: self.session.flush() Nov 09 05:00:01.988994 dv-neutron-816802-2-hyperv neutron-server[102163]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 05:00:01.988994 dv-neutron-816802-2-hyperv neutron-server[102163]: self.session.flush() Nov 09 05:00:01.988994 dv-neutron-816802-2-hyperv neutron-server[102163]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 05:00:01.988994 dv-neutron-816802-2-hyperv neutron-server[102163]: self.session.flush() Nov 09 05:00:01.988994 dv-neutron-816802-2-hyperv neutron-server[102163]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 05:00:01.988994 dv-neutron-816802-2-hyperv neutron-server[102163]: self.session.flush() Nov 09 05:00:01.988994 dv-neutron-816802-2-hyperv neutron-server[102163]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 05:00:01.988994 dv-neutron-816802-2-hyperv neutron-server[102163]: self.session.flush() Nov 09 05:00:01.995177 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-334c7241-3f40-4a7d-a1ab-2bda1864bc21 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:01.995329 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9e1bdbb-fa46-4c7b-97b9-39333667c5ef admin admin] Pushing event deleted for resources: {'Port': ['ID=dbb20c30-ca89-42ca-b822-3e371439c571,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:00:01.999006 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d9e1bdbb-fa46-4c7b-97b9-39333667c5ef admin admin] No DVR routers for this DVR port dbb20c30-ca89-42ca-b822-3e371439c571 on host dv-neutron-816802-2-hyperv {{(pid=102161) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 05:00:02.023281 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-334c7241-3f40-4a7d-a1ab-2bda1864bc21 None None] Pushing event deleted for resources: {'Port': ['ID=dbb20c30-ca89-42ca-b822-3e371439c571,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:00:02.026803 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-334c7241-3f40-4a7d-a1ab-2bda1864bc21 None None] No DVR routers for this DVR port dbb20c30-ca89-42ca-b822-3e371439c571 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 05:00:02.074191 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d9e1bdbb-fa46-4c7b-97b9-39333667c5ef admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:02.095904 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-d9e1bdbb-fa46-4c7b-97b9-39333667c5ef admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['fccebd84-efb7-429a-baa9-bc8330d63138']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:00:02.100195 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device e047caaa-2c99-4fed-adde-3ce05d586db6 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 05:00:02.107007 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-d9e1bdbb-fa46-4c7b-97b9-39333667c5ef admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'be836a59-b961-4a22-8321-d34bfacbfc89') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:00:02.107295 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-d9e1bdbb-fa46-4c7b-97b9-39333667c5ef admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'be836a59-b961-4a22-8321-d34bfacbfc89') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:00:02.117292 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d9e1bdbb-fa46-4c7b-97b9-39333667c5ef admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:02.120328 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: e047caaa-2c99-4fed-adde-3ce05d586db6 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 05:00:02.120851 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device e047caaa-2c99-4fed-adde-3ce05d586db6 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 05:00:02.121270 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device dbb20c30-ca89-42ca-b822-3e371439c571 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 05:00:02.132237 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d9e1bdbb-fa46-4c7b-97b9-39333667c5ef admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:02.138052 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d9e1bdbb-fa46-4c7b-97b9-39333667c5ef admin admin] Releasing vlan 336 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 05:00:02.138463 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d9e1bdbb-fa46-4c7b-97b9-39333667c5ef admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:02.140359 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: dbb20c30-ca89-42ca-b822-3e371439c571 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 05:00:02.140616 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 05:00:02.140616 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 05:00:02.140616 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 05:00:02.140616 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 05:00:02.140616 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 05:00:02.140616 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 05:00:02.140616 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 05:00:02.140616 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 05:00:02.140616 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 05:00:02.140616 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 05:00:02.140616 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 05:00:02.140616 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 05:00:02.140616 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 05:00:02.140616 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 05:00:02.140616 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 05:00:02.140616 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 05:00:02.140616 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 05:00:02.140616 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 05:00:02.140616 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 05:00:02.140616 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 05:00:02.140616 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 05:00:02.140616 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 05:00:02.140616 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 05:00:02.140616 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 05:00:02.140616 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 05:00:02.140616 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 05:00:02.140616 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 05:00:02.140616 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 05:00:02.140616 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 05:00:02.140616 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 05:00:02.140616 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 05:00:02.140616 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 05:00:02.148104 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device dbb20c30-ca89-42ca-b822-3e371439c571 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 05:00:02.148104 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 7b539bb4-5b78-4d71-803e-0556d1aa8da8 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 05:00:02.159502 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 7b539bb4-5b78-4d71-803e-0556d1aa8da8 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 05:00:02.159842 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 7b539bb4-5b78-4d71-803e-0556d1aa8da8 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 05:00:02.288631 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d9e1bdbb-fa46-4c7b-97b9-39333667c5ef admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:02.294046 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d9e1bdbb-fa46-4c7b-97b9-39333667c5ef admin admin] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:02.297984 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-d9e1bdbb-fa46-4c7b-97b9-39333667c5ef admin admin] 10.222.0.24 "DELETE /v2.0/networks/fccebd84-efb7-429a-baa9-bc8330d63138 HTTP/1.1" status: 204 len: 168 time: 0.7004035 Nov 09 05:00:02.300921 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 36106) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:00:02.308191 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9e1bdbb-fa46-4c7b-97b9-39333667c5ef admin admin] Pushing event deleted for resources: {'Network': ['ID=fccebd84-efb7-429a-baa9-bc8330d63138,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:00:02.639550 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f6955fb9-8ac0-41bf-941e-3fb58d9e445e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:02.881170 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-f6955fb9-8ac0-41bf-941e-3fb58d9e445e admin admin] Deleting port d3a80ac0-37b0-46ba-9114-29f5cbf94393 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:00:02.881504 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f6955fb9-8ac0-41bf-941e-3fb58d9e445e admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:02.957846 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-f6955fb9-8ac0-41bf-941e-3fb58d9e445e admin admin] For port d3a80ac0-37b0-46ba-9114-29f5cbf94393, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=d3a80ac0-37b0-46ba-9114-29f5cbf94393,segment=NetworkSegment(1e97e40d-a8b1-455b-bcdd-f98ceb5b4e55),segment_id=1e97e40d-a8b1-455b-bcdd-f98ceb5b4e55)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:00:02.958113 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f6955fb9-8ac0-41bf-941e-3fb58d9e445e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:02.971029 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-f6955fb9-8ac0-41bf-941e-3fb58d9e445e admin admin] Calling delete_port for d3a80ac0-37b0-46ba-9114-29f5cbf94393 owned by network:router_interface {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:00:03.254416 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f6955fb9-8ac0-41bf-941e-3fb58d9e445e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:03.290109 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6955fb9-8ac0-41bf-941e-3fb58d9e445e admin admin] Pushing event deleted for resources: {'Port': ['ID=d3a80ac0-37b0-46ba-9114-29f5cbf94393,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:00:03.449214 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f6955fb9-8ac0-41bf-941e-3fb58d9e445e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:03.671288 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f6955fb9-8ac0-41bf-941e-3fb58d9e445e admin admin] Router ea6f2352-326d-4546-a5df-32d8e062c537 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 05:00:03.775327 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f6955fb9-8ac0-41bf-941e-3fb58d9e445e admin admin] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 05:00:03.783042 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-f6955fb9-8ac0-41bf-941e-3fb58d9e445e admin admin] 10.222.0.24 "PUT /v2.0/routers/ea6f2352-326d-4546-a5df-32d8e062c537/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4810123 Nov 09 05:00:03.783490 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36108) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:00:03.784435 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-484e3c2f-92de-404a-b204-82341b4b8c06 None None] Sync routers for ids ['ea6f2352-326d-4546-a5df-32d8e062c537'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 05:00:03.794719 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-484e3c2f-92de-404a-b204-82341b4b8c06 None None] Routers {'ea6f2352-326d-4546-a5df-32d8e062c537'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:00:03.796024 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-484e3c2f-92de-404a-b204-82341b4b8c06 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:59:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['ea6f2352-326d-4546-a5df-32d8e062c537'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:00:03.895290 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-fd6d90eb-044a-4a7e-aafb-b50375ff7883 admin admin] Publish callbacks [] for router, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:03.906244 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-484e3c2f-92de-404a-b204-82341b4b8c06 None None] Set router ea6f2352-326d-4546-a5df-32d8e062c537 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:00:03.995651 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-fd6d90eb-044a-4a7e-aafb-b50375ff7883 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:04.083034 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-484e3c2f-92de-404a-b204-82341b4b8c06 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ea6f2352-326d-4546-a5df-32d8e062c537', 'name': 'tempest-TestEncryptedCinderVolumes-648135690-router', 'tenant_id': 'b5e6af7f8d2f4eb088b2468c61ba0da9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.28'}], 'enable_snat': True}, 'gw_port_id': '3127d65b-3577-4146-8acc-b6c5e7737f90', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:58:23Z', 'updated_at': '2021-11-09T05:00:03Z', 'revision_number': 5, 'project_id': 'b5e6af7f8d2f4eb088b2468c61ba0da9', 'gw_port': {'id': '3127d65b-3577-4146-8acc-b6c5e7737f90', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:9e:82:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ea6f2352-326d-4546-a5df-32d8e062c537', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1653, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.28', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T04:58:24Z', 'updated_at': '2021-11-09T04:58:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:00:04.110104 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-484e3c2f-92de-404a-b204-82341b4b8c06 None None] Checking router: ea6f2352-326d-4546-a5df-32d8e062c537 for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 05:00:04.118172 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-484e3c2f-92de-404a-b204-82341b4b8c06 None None] Routers {'ea6f2352-326d-4546-a5df-32d8e062c537'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:00:04.126508 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-484e3c2f-92de-404a-b204-82341b4b8c06 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:59:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['ea6f2352-326d-4546-a5df-32d8e062c537'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:00:04.163624 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-fd6d90eb-044a-4a7e-aafb-b50375ff7883 admin admin] Deleting port 3127d65b-3577-4146-8acc-b6c5e7737f90 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:00:04.163960 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-fd6d90eb-044a-4a7e-aafb-b50375ff7883 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:04.211213 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-484e3c2f-92de-404a-b204-82341b4b8c06 None None] Set router ea6f2352-326d-4546-a5df-32d8e062c537 gateway port host: None {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:00:04.268658 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-fd6d90eb-044a-4a7e-aafb-b50375ff7883 admin admin] For port 3127d65b-3577-4146-8acc-b6c5e7737f90, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=3127d65b-3577-4146-8acc-b6c5e7737f90,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:00:04.268658 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-fd6d90eb-044a-4a7e-aafb-b50375ff7883 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:04.269062 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-484e3c2f-92de-404a-b204-82341b4b8c06 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ea6f2352-326d-4546-a5df-32d8e062c537', 'name': 'tempest-TestEncryptedCinderVolumes-648135690-router', 'tenant_id': 'b5e6af7f8d2f4eb088b2468c61ba0da9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:58:23Z', 'updated_at': '2021-11-09T05:00:03Z', 'revision_number': 6, 'project_id': 'b5e6af7f8d2f4eb088b2468c61ba0da9', 'gw_port_host': None}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:00:04.272419 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-fd6d90eb-044a-4a7e-aafb-b50375ff7883 admin admin] Calling delete_port for 3127d65b-3577-4146-8acc-b6c5e7737f90 owned by network:router_gateway {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:00:04.298656 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-484e3c2f-92de-404a-b204-82341b4b8c06 None None] The sync data for ids ['ea6f2352-326d-4546-a5df-32d8e062c537'] in dv-neutron-816802-2-hyperv is: [{'id': 'ea6f2352-326d-4546-a5df-32d8e062c537', 'name': 'tempest-TestEncryptedCinderVolumes-648135690-router', 'tenant_id': 'b5e6af7f8d2f4eb088b2468c61ba0da9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T04:58:23Z', 'updated_at': '2021-11-09T05:00:03Z', 'revision_number': 6, 'project_id': 'b5e6af7f8d2f4eb088b2468c61ba0da9', 'gw_port_host': None}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 05:00:04.526445 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-fd6d90eb-044a-4a7e-aafb-b50375ff7883 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:04.553988 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd6d90eb-044a-4a7e-aafb-b50375ff7883 admin admin] Pushing event deleted for resources: {'Port': ['ID=3127d65b-3577-4146-8acc-b6c5e7737f90,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:00:04.615663 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-fd6d90eb-044a-4a7e-aafb-b50375ff7883 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-466373'] for router_gateway, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:04.982345 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-fd6d90eb-044a-4a7e-aafb-b50375ff7883 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:04.984851 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-fd6d90eb-044a-4a7e-aafb-b50375ff7883 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:05.134258 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-fd6d90eb-044a-4a7e-aafb-b50375ff7883 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:05.134913 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fd6d90eb-044a-4a7e-aafb-b50375ff7883 admin admin] Fanout notify agent at l3_agent the message router_deleted on router ea6f2352-326d-4546-a5df-32d8e062c537 {{(pid=102161) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 05:00:05.139722 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-fd6d90eb-044a-4a7e-aafb-b50375ff7883 admin admin] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:05.140902 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-fd6d90eb-044a-4a7e-aafb-b50375ff7883 admin admin] 10.222.0.24 "DELETE /v2.0/routers/ea6f2352-326d-4546-a5df-32d8e062c537 HTTP/1.1" status: 204 len: 168 time: 1.3564286 Nov 09 05:00:05.143353 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36110) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:00:05.186515 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-1527e307-6725-4a31-9e8d-ae282a5f1070 admin admin] Deleting subnet 1ffa6a42-d392-423f-81d8-d1b418f2edd3 {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 05:00:05.191910 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1527e307-6725-4a31-9e8d-ae282a5f1070 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:05.228137 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1527e307-6725-4a31-9e8d-ae282a5f1070 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:05.309350 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1527e307-6725-4a31-9e8d-ae282a5f1070 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:05.452216 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1527e307-6725-4a31-9e8d-ae282a5f1070 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:05.477959 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1527e307-6725-4a31-9e8d-ae282a5f1070 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=1ffa6a42-d392-423f-81d8-d1b418f2edd3,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:00:05.484057 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1527e307-6725-4a31-9e8d-ae282a5f1070 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:05.484057 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1527e307-6725-4a31-9e8d-ae282a5f1070 admin admin] 10.222.0.24 "DELETE /v2.0/subnets/1ffa6a42-d392-423f-81d8-d1b418f2edd3 HTTP/1.1" status: 204 len: 168 time: 0.3392556 Nov 09 05:00:05.486086 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36112) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:00:05.486320 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d403cc1c-3a75-45f7-a201-b4adaddd6805 None None] Network ad4e0f1a-ae6b-4246-89ee-e51e6f860d5f requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 05:00:05.557940 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d0e83287-e49d-471b-a67b-4d7383217015 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:05.610127 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-d0e83287-e49d-471b-a67b-4d7383217015 admin admin] Deleting port 1c292a08-52af-486b-93ad-ef7271793878 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:00:05.610493 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d0e83287-e49d-471b-a67b-4d7383217015 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:05.653411 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-69b62801-85e7-4409-a34a-e13a513ee293 None None] DHCP port deletion for ad4e0f1a-ae6b-4246-89ee-e51e6f860d5f request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 05:00:05.676945 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-d0e83287-e49d-471b-a67b-4d7383217015 admin admin] For port 1c292a08-52af-486b-93ad-ef7271793878, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=1c292a08-52af-486b-93ad-ef7271793878,segment=NetworkSegment(1e97e40d-a8b1-455b-bcdd-f98ceb5b4e55),segment_id=1e97e40d-a8b1-455b-bcdd-f98ceb5b4e55)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:00:05.677294 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d0e83287-e49d-471b-a67b-4d7383217015 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:05.689431 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-d0e83287-e49d-471b-a67b-4d7383217015 admin admin] Calling delete_port for 1c292a08-52af-486b-93ad-ef7271793878 owned by network:dhcp {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:00:05.700460 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-69b62801-85e7-4409-a34a-e13a513ee293 None None] Deleting port 1c292a08-52af-486b-93ad-ef7271793878 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:00:05.700829 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-69b62801-85e7-4409-a34a-e13a513ee293 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:05.771222 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-69b62801-85e7-4409-a34a-e13a513ee293 None None] For port 1c292a08-52af-486b-93ad-ef7271793878, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=1c292a08-52af-486b-93ad-ef7271793878,segment=NetworkSegment(1e97e40d-a8b1-455b-bcdd-f98ceb5b4e55),segment_id=1e97e40d-a8b1-455b-bcdd-f98ceb5b4e55)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:00:05.771222 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-69b62801-85e7-4409-a34a-e13a513ee293 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:05.777049 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-69b62801-85e7-4409-a34a-e13a513ee293 None None] Calling delete_port for 1c292a08-52af-486b-93ad-ef7271793878 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:00:05.906313 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d0e83287-e49d-471b-a67b-4d7383217015 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:05.912363 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-69b62801-85e7-4409-a34a-e13a513ee293 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:05.932431 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0e83287-e49d-471b-a67b-4d7383217015 admin admin] Pushing event deleted for resources: {'Port': ['ID=1c292a08-52af-486b-93ad-ef7271793878,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:00:05.934231 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d0e83287-e49d-471b-a67b-4d7383217015 admin admin] No DVR routers for this DVR port 1c292a08-52af-486b-93ad-ef7271793878 on host dv-neutron-816802-2-hyperv {{(pid=102161) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 05:00:05.938920 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69b62801-85e7-4409-a34a-e13a513ee293 None None] Pushing event deleted for resources: {'Port': ['ID=1c292a08-52af-486b-93ad-ef7271793878,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:00:05.946457 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-69b62801-85e7-4409-a34a-e13a513ee293 None None] No DVR routers for this DVR port 1c292a08-52af-486b-93ad-ef7271793878 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 05:00:06.006820 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d0e83287-e49d-471b-a67b-4d7383217015 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:06.026632 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-d0e83287-e49d-471b-a67b-4d7383217015 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ad4e0f1a-ae6b-4246-89ee-e51e6f860d5f']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:00:06.036168 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-d0e83287-e49d-471b-a67b-4d7383217015 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1e97e40d-a8b1-455b-bcdd-f98ceb5b4e55') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:00:06.037862 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-d0e83287-e49d-471b-a67b-4d7383217015 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1e97e40d-a8b1-455b-bcdd-f98ceb5b4e55') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:00:06.045592 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d0e83287-e49d-471b-a67b-4d7383217015 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:06.058570 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d0e83287-e49d-471b-a67b-4d7383217015 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:06.064856 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d0e83287-e49d-471b-a67b-4d7383217015 admin admin] Releasing vlan 305 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 05:00:06.065243 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d0e83287-e49d-471b-a67b-4d7383217015 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:06.066979 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 05:00:06.066979 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 05:00:06.066979 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 05:00:06.066979 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 05:00:06.066979 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 05:00:06.066979 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 05:00:06.066979 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 05:00:06.066979 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 05:00:06.066979 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 05:00:06.066979 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 05:00:06.066979 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 05:00:06.066979 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 05:00:06.066979 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 05:00:06.066979 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 05:00:06.066979 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 05:00:06.066979 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 05:00:06.066979 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 05:00:06.066979 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 05:00:06.066979 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 05:00:06.066979 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 05:00:06.066979 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 05:00:06.066979 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 05:00:06.066979 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 05:00:06.066979 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 05:00:06.066979 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 05:00:06.066979 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 05:00:06.066979 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 05:00:06.066979 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 05:00:06.066979 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 05:00:06.066979 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 05:00:06.066979 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 05:00:06.066979 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 05:00:06.103007 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 1c292a08-52af-486b-93ad-ef7271793878 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 05:00:06.123488 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 1c292a08-52af-486b-93ad-ef7271793878 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 05:00:06.123838 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 1c292a08-52af-486b-93ad-ef7271793878 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 05:00:06.124257 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device d3a80ac0-37b0-46ba-9114-29f5cbf94393 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 05:00:06.143153 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: d3a80ac0-37b0-46ba-9114-29f5cbf94393 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 05:00:06.143499 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device d3a80ac0-37b0-46ba-9114-29f5cbf94393 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 05:00:06.143952 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 3127d65b-3577-4146-8acc-b6c5e7737f90 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 05:00:06.162436 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 3127d65b-3577-4146-8acc-b6c5e7737f90 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 05:00:06.162772 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 3127d65b-3577-4146-8acc-b6c5e7737f90 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 05:00:06.208292 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d0e83287-e49d-471b-a67b-4d7383217015 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:06.213695 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d0e83287-e49d-471b-a67b-4d7383217015 admin admin] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:06.217446 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-d0e83287-e49d-471b-a67b-4d7383217015 admin admin] 10.222.0.24 "DELETE /v2.0/networks/ad4e0f1a-ae6b-4246-89ee-e51e6f860d5f HTTP/1.1" status: 204 len: 168 time: 0.7298908 Nov 09 05:00:06.228047 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0e83287-e49d-471b-a67b-4d7383217015 admin admin] Pushing event deleted for resources: {'Network': ['ID=ad4e0f1a-ae6b-4246-89ee-e51e6f860d5f,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:00:06.920192 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36116) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:00:06.959188 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-40b4bddb-5ec4-4c0f-a19a-e6f4ff4d9e5d admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=7a7a505be3334ab3b14ba7506d59802d&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0377796 Nov 09 05:00:06.961556 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36118) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:00:07.007163 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-858778c1-5e6c-422a-917a-c8409835f3d2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:07.026873 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-858778c1-5e6c-422a-917a-c8409835f3d2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:07.168227 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-858778c1-5e6c-422a-917a-c8409835f3d2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:07.171443 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-858778c1-5e6c-422a-917a-c8409835f3d2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:07.172610 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-858778c1-5e6c-422a-917a-c8409835f3d2 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/38ad7e09-c43f-42df-a8ec-4b9fe996949f HTTP/1.1" status: 204 len: 168 time: 0.2101607 Nov 09 05:00:07.180875 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-858778c1-5e6c-422a-917a-c8409835f3d2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=38ad7e09-c43f-42df-a8ec-4b9fe996949f,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:00:08.030175 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36124) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:00:08.070286 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-7ae4bf95-40fc-4b7c-93fb-304e4ee8bf5f admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=b5e6af7f8d2f4eb088b2468c61ba0da9&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0385005 Nov 09 05:00:08.072730 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36126) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:00:08.121050 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3609a3e2-8fe2-4739-8240-b3fcc4f533ec admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:08.141986 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3609a3e2-8fe2-4739-8240-b3fcc4f533ec admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:08.274270 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3609a3e2-8fe2-4739-8240-b3fcc4f533ec admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:08.276943 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-3609a3e2-8fe2-4739-8240-b3fcc4f533ec admin admin] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:08.278084 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-3609a3e2-8fe2-4739-8240-b3fcc4f533ec admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/a1bbd5ba-7082-4a6d-9263-8f5abd861a5a HTTP/1.1" status: 204 len: 168 time: 0.2044587 Nov 09 05:00:08.288279 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3609a3e2-8fe2-4739-8240-b3fcc4f533ec admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a1bbd5ba-7082-4a6d-9263-8f5abd861a5a,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:00:09.485921 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36148) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:00:09.579445 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-5c6b0e40-f065-4377-bca9-a54191a5dc97 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-1252630362-network', 'tenant_id': '6342064e2f4e4d17a45b74d8725885ef'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:00:09.713806 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5c6b0e40-f065-4377-bca9-a54191a5dc97 admin admin] Made reservation on behalf of 6342064e2f4e4d17a45b74d8725885ef for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 05:00:09.716102 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5c6b0e40-f065-4377-bca9-a54191a5dc97 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:09.724445 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5c6b0e40-f065-4377-bca9-a54191a5dc97 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:09.793447 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5c6b0e40-f065-4377-bca9-a54191a5dc97 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:09.879459 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5c6b0e40-f065-4377-bca9-a54191a5dc97 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:09.903282 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5c6b0e40-f065-4377-bca9-a54191a5dc97 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 311} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 05:00:09.912635 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c6b0e40-f065-4377-bca9-a54191a5dc97 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cd821237-9f21-4bf9-9e32-fce1986821ee,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:00:09.917196 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5c6b0e40-f065-4377-bca9-a54191a5dc97 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:09.917534 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-5c6b0e40-f065-4377-bca9-a54191a5dc97 admin admin] Added segment 794d91f6-937c-4e26-8ecc-34550b214f4a of type vlan for network 00c105ea-e093-47a8-a669-bbdd36caea7e Nov 09 05:00:09.956385 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5c6b0e40-f065-4377-bca9-a54191a5dc97 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:10.056846 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5c6b0e40-f065-4377-bca9-a54191a5dc97 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:10.057796 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5c6b0e40-f065-4377-bca9-a54191a5dc97 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:00:10.058395 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5c6b0e40-f065-4377-bca9-a54191a5dc97 admin admin] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:10.118647 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c6b0e40-f065-4377-bca9-a54191a5dc97 admin admin] Pushing event updated for resources: {'Network': ['ID=00c105ea-e093-47a8-a669-bbdd36caea7e,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:00:10.127799 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 00c105ea-e093-47a8-a669-bbdd36caea7e details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 05:00:10.179840 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-5c6b0e40-f065-4377-bca9-a54191a5dc97 admin admin] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.6927795 Nov 09 05:00:10.182640 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36152) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:00:10.188779 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-0960f5be-9dd9-4c84-9582-395da519e972 admin admin] Request body: {'subnet': {'network_id': '00c105ea-e093-47a8-a669-bbdd36caea7e', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-1252630362-subnet', 'tenant_id': '6342064e2f4e4d17a45b74d8725885ef', 'ip_version': 4}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:00:10.354109 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0960f5be-9dd9-4c84-9582-395da519e972 admin admin] Made reservation on behalf of 6342064e2f4e4d17a45b74d8725885ef for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 05:00:10.356548 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0960f5be-9dd9-4c84-9582-395da519e972 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:10.594087 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0960f5be-9dd9-4c84-9582-395da519e972 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:10.641902 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0960f5be-9dd9-4c84-9582-395da519e972 admin admin] Pushing event updated for resources: {'Subnet': ['ID=15c42388-61b6-40bb-be5b-e0929ebd3465,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:00:10.656863 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0960f5be-9dd9-4c84-9582-395da519e972 admin admin] Checking segment: {'id': '794d91f6-937c-4e26-8ecc-34550b214f4a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 311, 'network_id': '00c105ea-e093-47a8-a669-bbdd36caea7e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 05:00:10.657218 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0960f5be-9dd9-4c84-9582-395da519e972 admin admin] Network hostable DHCP agents. Network: 00c105ea-e093-47a8-a669-bbdd36caea7e, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 05:00:10.767686 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0960f5be-9dd9-4c84-9582-395da519e972 admin admin] Network 00c105ea-e093-47a8-a669-bbdd36caea7e is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 05:00:10.918387 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-0960f5be-9dd9-4c84-9582-395da519e972 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 00c105ea-e093-47a8-a669-bbdd36caea7e) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:00:10.920853 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0960f5be-9dd9-4c84-9582-395da519e972 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:00:10.921441 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0960f5be-9dd9-4c84-9582-395da519e972 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:10.926210 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-651dbeb0-bedd-4430-8ac9-6e2952f2dcdc None None] Network 00c105ea-e093-47a8-a669-bbdd36caea7e requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 05:00:11.007506 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-0960f5be-9dd9-4c84-9582-395da519e972 admin admin] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.8213649 Nov 09 05:00:11.007726 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36154) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:00:11.011922 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-4bc1faea-e0e3-4f36-84cf-4970503a5365 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-1252630362-router', 'tenant_id': '6342064e2f4e4d17a45b74d8725885ef', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:00:11.065690 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-016db2ae-0a98-4fc7-88bc-a3297f3f950d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-00c105ea-e093-47a8-a669-bbdd36caea7e', 'network_id': '00c105ea-e093-47a8-a669-bbdd36caea7e', 'tenant_id': '6342064e2f4e4d17a45b74d8725885ef', 'fixed_ips': [{'subnet_id': '15c42388-61b6-40bb-be5b-e0929ebd3465'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 05:00:11.066600 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-016db2ae-0a98-4fc7-88bc-a3297f3f950d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:11.120594 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4bc1faea-e0e3-4f36-84cf-4970503a5365 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:11.121799 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4bc1faea-e0e3-4f36-84cf-4970503a5365 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:11.176062 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4bc1faea-e0e3-4f36-84cf-4970503a5365 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:11.198339 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-016db2ae-0a98-4fc7-88bc-a3297f3f950d None None] Allocated IP 172.20.0.2 (00c105ea-e093-47a8-a669-bbdd36caea7e/15c42388-61b6-40bb-be5b-e0929ebd3465/6a95e148-2072-45a9-9503-b388ed9e2ef8) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 05:00:11.348853 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-016db2ae-0a98-4fc7-88bc-a3297f3f950d None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:11.401601 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4bc1faea-e0e3-4f36-84cf-4970503a5365 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:11.422631 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-40090e9d-7f3c-4ec6-b6a1-8412fb2afaa7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:11.465225 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-016db2ae-0a98-4fc7-88bc-a3297f3f950d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:11.500958 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-016db2ae-0a98-4fc7-88bc-a3297f3f950d None None] Network 00c105ea-e093-47a8-a669-bbdd36caea7e is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:00:11.503631 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-016db2ae-0a98-4fc7-88bc-a3297f3f950d None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:00:11.508868 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-016db2ae-0a98-4fc7-88bc-a3297f3f950d None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 05:00:11.519026 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-016db2ae-0a98-4fc7-88bc-a3297f3f950d None None] Pushing event updated for resources: {'Port': ['ID=6a95e148-2072-45a9-9503-b388ed9e2ef8,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:00:11.568168 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-016db2ae-0a98-4fc7-88bc-a3297f3f950d None None] Attempting to bind port 6a95e148-2072-45a9-9503-b388ed9e2ef8 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 05:00:11.569067 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-016db2ae-0a98-4fc7-88bc-a3297f3f950d None None] Attempting to bind port 6a95e148-2072-45a9-9503-b388ed9e2ef8 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '794d91f6-937c-4e26-8ecc-34550b214f4a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 311, 'network_id': '00c105ea-e093-47a8-a669-bbdd36caea7e'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 05:00:11.569447 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-016db2ae-0a98-4fc7-88bc-a3297f3f950d None None] Attempting to bind port 6a95e148-2072-45a9-9503-b388ed9e2ef8 on network 00c105ea-e093-47a8-a669-bbdd36caea7e {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 05:00:11.574780 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-016db2ae-0a98-4fc7-88bc-a3297f3f950d None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 59, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 05:00:11.576681 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-016db2ae-0a98-4fc7-88bc-a3297f3f950d None None] Checking segment: {'id': '794d91f6-937c-4e26-8ecc-34550b214f4a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 311, 'network_id': '00c105ea-e093-47a8-a669-bbdd36caea7e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 05:00:11.576681 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-016db2ae-0a98-4fc7-88bc-a3297f3f950d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:11.576681 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-016db2ae-0a98-4fc7-88bc-a3297f3f950d None None] Bound using segment: {'id': '794d91f6-937c-4e26-8ecc-34550b214f4a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 311, 'network_id': '00c105ea-e093-47a8-a669-bbdd36caea7e'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 05:00:11.577057 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-016db2ae-0a98-4fc7-88bc-a3297f3f950d None None] Bound port: 6a95e148-2072-45a9-9503-b388ed9e2ef8, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '794d91f6-937c-4e26-8ecc-34550b214f4a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 311, 'network_id': '00c105ea-e093-47a8-a669-bbdd36caea7e'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 05:00:11.577439 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-016db2ae-0a98-4fc7-88bc-a3297f3f950d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:11.643146 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-016db2ae-0a98-4fc7-88bc-a3297f3f950d None None] For port 6a95e148-2072-45a9-9503-b388ed9e2ef8, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 05:00:11.646204 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-016db2ae-0a98-4fc7-88bc-a3297f3f950d None None] For port 6a95e148-2072-45a9-9503-b388ed9e2ef8, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=6a95e148-2072-45a9-9503-b388ed9e2ef8,segment=NetworkSegment(794d91f6-937c-4e26-8ecc-34550b214f4a),segment_id=794d91f6-937c-4e26-8ecc-34550b214f4a)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 05:00:11.737960 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-016db2ae-0a98-4fc7-88bc-a3297f3f950d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:11.746522 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4bc1faea-e0e3-4f36-84cf-4970503a5365 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:11.766581 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4bc1faea-e0e3-4f36-84cf-4970503a5365 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:11.796060 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-016db2ae-0a98-4fc7-88bc-a3297f3f950d None None] Pushing event updated for resources: {'Port': ['ID=6a95e148-2072-45a9-9503-b388ed9e2ef8,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:00:11.876576 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-4bc1faea-e0e3-4f36-84cf-4970503a5365 admin admin] Allocated IP 172.26.0.148 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/71172a82-2f01-4a5b-bd07-bfe538c2ae92) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 05:00:11.994713 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4bc1faea-e0e3-4f36-84cf-4970503a5365 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:12.125515 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 6a95e148-2072-45a9-9503-b388ed9e2ef8 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:00:12.143030 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4bc1faea-e0e3-4f36-84cf-4970503a5365 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:12.173665 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 6a95e148-2072-45a9-9503-b388ed9e2ef8 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:00:12.173954 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:12.183057 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4bc1faea-e0e3-4f36-84cf-4970503a5365 admin admin] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:00:12.189918 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-4bc1faea-e0e3-4f36-84cf-4970503a5365 admin admin] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:00:12.193891 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4bc1faea-e0e3-4f36-84cf-4970503a5365 admin admin] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 05:00:12.216343 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bc1faea-e0e3-4f36-84cf-4970503a5365 admin admin] Pushing event updated for resources: {'Port': ['ID=71172a82-2f01-4a5b-bd07-bfe538c2ae92,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:00:12.261726 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:12.293152 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 6a95e148-2072-45a9-9503-b388ed9e2ef8, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=6a95e148-2072-45a9-9503-b388ed9e2ef8,segment=NetworkSegment(794d91f6-937c-4e26-8ecc-34550b214f4a),segment_id=794d91f6-937c-4e26-8ecc-34550b214f4a)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:00:12.439863 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:12.486181 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:12.491004 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=6a95e148-2072-45a9-9503-b388ed9e2ef8,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:00:12.581373 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4bc1faea-e0e3-4f36-84cf-4970503a5365 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:12.635320 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-534c68ec-9fa3-4a78-a287-d35db85d966b None None] Network 00c105ea-e093-47a8-a669-bbdd36caea7e requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 05:00:12.757997 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-8f9f13e8-f95e-45d7-93e7-8042e217853c None None] Provisioning complete for port 6a95e148-2072-45a9-9503-b388ed9e2ef8 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:00:12.758439 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8f9f13e8-f95e-45d7-93e7-8042e217853c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:12.777833 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4bc1faea-e0e3-4f36-84cf-4970503a5365 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:13.008109 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4bc1faea-e0e3-4f36-84cf-4970503a5365 admin admin] Router 7e9d55e0-0100-4ebc-9667-a18ace6d8557 is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102161) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 05:00:13.083156 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-88b077c2-a431-4c13-b654-5f2e2678fdb1 None None] Provisioning complete for port 6a95e148-2072-45a9-9503-b388ed9e2ef8 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:00:13.083436 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-88b077c2-a431-4c13-b654-5f2e2678fdb1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:13.112766 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4bc1faea-e0e3-4f36-84cf-4970503a5365 admin admin] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 05:00:13.123403 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8815c3f0-c567-4827-b8f4-e382a4978994 None None] Sync routers for ids ['7e9d55e0-0100-4ebc-9667-a18ace6d8557'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 05:00:13.136995 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8815c3f0-c567-4827-b8f4-e382a4978994 None None] Routers {'7e9d55e0-0100-4ebc-9667-a18ace6d8557'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:00:13.137609 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-8815c3f0-c567-4827-b8f4-e382a4978994 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T04:59:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['7e9d55e0-0100-4ebc-9667-a18ace6d8557'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:00:13.193548 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-4bc1faea-e0e3-4f36-84cf-4970503a5365 admin admin] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:13.194874 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-4bc1faea-e0e3-4f36-84cf-4970503a5365 admin admin] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 927 time: 2.1862607 Nov 09 05:00:13.197662 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36156) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:00:13.270657 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-8815c3f0-c567-4827-b8f4-e382a4978994 None None] Set router 7e9d55e0-0100-4ebc-9667-a18ace6d8557 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:00:13.597253 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-8815c3f0-c567-4827-b8f4-e382a4978994 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7e9d55e0-0100-4ebc-9667-a18ace6d8557', 'name': 'tempest-TestMinimumBasicScenario-1252630362-router', 'tenant_id': '6342064e2f4e4d17a45b74d8725885ef', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.148'}], 'enable_snat': True}, 'gw_port_id': '71172a82-2f01-4a5b-bd07-bfe538c2ae92', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:00:11Z', 'updated_at': '2021-11-09T05:00:12Z', 'revision_number': 3, 'project_id': '6342064e2f4e4d17a45b74d8725885ef', 'gw_port': {'id': '71172a82-2f01-4a5b-bd07-bfe538c2ae92', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:38:f6:39', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7e9d55e0-0100-4ebc-9667-a18ace6d8557', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1667, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:00:11Z', 'updated_at': '2021-11-09T05:00:11Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:00:13.629512 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-fe992b81-e5f9-40c4-8301-10b89a5609c6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:13.635669 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8815c3f0-c567-4827-b8f4-e382a4978994 None None] Checking router: 7e9d55e0-0100-4ebc-9667-a18ace6d8557 for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 05:00:13.636015 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8815c3f0-c567-4827-b8f4-e382a4978994 None None] Updating router 7e9d55e0-0100-4ebc-9667-a18ace6d8557 port 71172a82-2f01-4a5b-bd07-bfe538c2ae92 binding host dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 05:00:13.670396 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8815c3f0-c567-4827-b8f4-e382a4978994 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:13.782769 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-fe992b81-e5f9-40c4-8301-10b89a5609c6 admin admin] Allocated IP 172.20.0.1 (00c105ea-e093-47a8-a669-bbdd36caea7e/15c42388-61b6-40bb-be5b-e0929ebd3465/940c1a94-9aed-4b5a-b999-df6f009eebec) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 05:00:13.788676 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-02e932a8-2e57-4c48-b644-cad9e311f5b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:13.885855 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-fe992b81-e5f9-40c4-8301-10b89a5609c6 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:13.921360 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8815c3f0-c567-4827-b8f4-e382a4978994 None None] Publish callbacks [] for port, precommit_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:13.985139 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-fe992b81-e5f9-40c4-8301-10b89a5609c6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:14.002091 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8815c3f0-c567-4827-b8f4-e382a4978994 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:14.022721 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fe992b81-e5f9-40c4-8301-10b89a5609c6 admin admin] Network 00c105ea-e093-47a8-a669-bbdd36caea7e is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:00:14.027430 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-fe992b81-e5f9-40c4-8301-10b89a5609c6 admin admin] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:00:14.030998 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fe992b81-e5f9-40c4-8301-10b89a5609c6 admin admin] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 05:00:14.057867 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-8815c3f0-c567-4827-b8f4-e382a4978994 None None] Attempting to bind port 71172a82-2f01-4a5b-bd07-bfe538c2ae92 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 05:00:14.058147 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-8815c3f0-c567-4827-b8f4-e382a4978994 None None] Attempting to bind port 71172a82-2f01-4a5b-bd07-bfe538c2ae92 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 05:00:14.058531 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8815c3f0-c567-4827-b8f4-e382a4978994 None None] Attempting to bind port 71172a82-2f01-4a5b-bd07-bfe538c2ae92 on network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 05:00:14.065259 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8815c3f0-c567-4827-b8f4-e382a4978994 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 4, 59, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 05:00:14.065641 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8815c3f0-c567-4827-b8f4-e382a4978994 None None] Checking segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 05:00:14.066038 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8815c3f0-c567-4827-b8f4-e382a4978994 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:14.066443 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8815c3f0-c567-4827-b8f4-e382a4978994 None None] Bound using segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 05:00:14.066911 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-8815c3f0-c567-4827-b8f4-e382a4978994 None None] Bound port: 71172a82-2f01-4a5b-bd07-bfe538c2ae92, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 05:00:14.067285 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8815c3f0-c567-4827-b8f4-e382a4978994 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:14.069189 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46c8d3f7-8a00-45b0-9275-3484586cb90b None None] Pushing event updated for resources: {'Port': ['ID=71172a82-2f01-4a5b-bd07-bfe538c2ae92,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:00:14.129072 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 6a95e148-2072-45a9-9503-b388ed9e2ef8 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:00:14.164673 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-8815c3f0-c567-4827-b8f4-e382a4978994 None None] For port 71172a82-2f01-4a5b-bd07-bfe538c2ae92, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 05:00:14.186283 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-8815c3f0-c567-4827-b8f4-e382a4978994 None None] For port 71172a82-2f01-4a5b-bd07-bfe538c2ae92, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=71172a82-2f01-4a5b-bd07-bfe538c2ae92,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 05:00:14.200293 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 6a95e148-2072-45a9-9503-b388ed9e2ef8 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:00:14.201207 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:14.286094 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8815c3f0-c567-4827-b8f4-e382a4978994 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:14.355713 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe992b81-e5f9-40c4-8301-10b89a5609c6 admin admin] Pushing event updated for resources: {'Port': ['ID=940c1a94-9aed-4b5a-b999-df6f009eebec,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:00:14.373205 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8815c3f0-c567-4827-b8f4-e382a4978994 None None] Routers {'7e9d55e0-0100-4ebc-9667-a18ace6d8557'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:00:14.373415 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-fe992b81-e5f9-40c4-8301-10b89a5609c6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:14.373834 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-8815c3f0-c567-4827-b8f4-e382a4978994 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:00:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['7e9d55e0-0100-4ebc-9667-a18ace6d8557'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:00:14.378931 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-1f29b4f2-7581-43e0-90d5-746e7ee2dd22 None None] Provisioning complete for port 940c1a94-9aed-4b5a-b999-df6f009eebec triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:00:14.379292 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1f29b4f2-7581-43e0-90d5-746e7ee2dd22 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:14.411502 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46c8d3f7-8a00-45b0-9275-3484586cb90b None None] Pushing event updated for resources: {'Port': ['ID=71172a82-2f01-4a5b-bd07-bfe538c2ae92,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:00:14.460065 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-1f29b4f2-7581-43e0-90d5-746e7ee2dd22 None None] Port 940c1a94-9aed-4b5a-b999-df6f009eebec cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 05:00:14.510223 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-8815c3f0-c567-4827-b8f4-e382a4978994 None None] Set router 7e9d55e0-0100-4ebc-9667-a18ace6d8557 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:00:14.602841 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-fe992b81-e5f9-40c4-8301-10b89a5609c6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:14.684543 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-8815c3f0-c567-4827-b8f4-e382a4978994 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7e9d55e0-0100-4ebc-9667-a18ace6d8557', 'name': 'tempest-TestMinimumBasicScenario-1252630362-router', 'tenant_id': '6342064e2f4e4d17a45b74d8725885ef', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.148'}], 'enable_snat': True}, 'gw_port_id': '71172a82-2f01-4a5b-bd07-bfe538c2ae92', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:00:11Z', 'updated_at': '2021-11-09T05:00:12Z', 'revision_number': 3, 'project_id': '6342064e2f4e4d17a45b74d8725885ef', 'gw_port': {'id': '71172a82-2f01-4a5b-bd07-bfe538c2ae92', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:38:f6:39', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7e9d55e0-0100-4ebc-9667-a18ace6d8557', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1667, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:00:11Z', 'updated_at': '2021-11-09T05:00:14Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:00:14.714634 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8815c3f0-c567-4827-b8f4-e382a4978994 None None] The sync data for ids ['7e9d55e0-0100-4ebc-9667-a18ace6d8557'] in dv-neutron-816802-2-hyperv is: [{'id': '7e9d55e0-0100-4ebc-9667-a18ace6d8557', 'name': 'tempest-TestMinimumBasicScenario-1252630362-router', 'tenant_id': '6342064e2f4e4d17a45b74d8725885ef', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.148'}], 'enable_snat': True}, 'gw_port_id': '71172a82-2f01-4a5b-bd07-bfe538c2ae92', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:00:11Z', 'updated_at': '2021-11-09T05:00:12Z', 'revision_number': 3, 'project_id': '6342064e2f4e4d17a45b74d8725885ef', 'gw_port': {'id': '71172a82-2f01-4a5b-bd07-bfe538c2ae92', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:38:f6:39', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7e9d55e0-0100-4ebc-9667-a18ace6d8557', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1667, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:00:11Z', 'updated_at': '2021-11-09T05:00:14Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 05:00:14.765925 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-fe992b81-e5f9-40c4-8301-10b89a5609c6 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:14.871496 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-fe992b81-e5f9-40c4-8301-10b89a5609c6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:14.953564 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-fe992b81-e5f9-40c4-8301-10b89a5609c6 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:14.955406 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe992b81-e5f9-40c4-8301-10b89a5609c6 admin admin] Pushing event updated for resources: {'Port': ['ID=940c1a94-9aed-4b5a-b999-df6f009eebec,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:00:15.053356 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fe992b81-e5f9-40c4-8301-10b89a5609c6 admin admin] Network 00c105ea-e093-47a8-a669-bbdd36caea7e is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:00:15.054868 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-fe992b81-e5f9-40c4-8301-10b89a5609c6 admin admin] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:00:15.180748 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fe992b81-e5f9-40c4-8301-10b89a5609c6 admin admin] Router 7e9d55e0-0100-4ebc-9667-a18ace6d8557 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 05:00:15.223316 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:15.284647 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-842e0d14-1bcb-4433-ae1c-9995a038e7a1 None None] Provisioning complete for port 940c1a94-9aed-4b5a-b999-df6f009eebec triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:00:15.285014 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-842e0d14-1bcb-4433-ae1c-9995a038e7a1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:15.319370 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fe992b81-e5f9-40c4-8301-10b89a5609c6 admin admin] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 05:00:15.320052 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-842e0d14-1bcb-4433-ae1c-9995a038e7a1 None None] Port 940c1a94-9aed-4b5a-b999-df6f009eebec cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 05:00:15.325238 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-fe992b81-e5f9-40c4-8301-10b89a5609c6 admin admin] 10.222.0.24 "PUT /v2.0/routers/7e9d55e0-0100-4ebc-9667-a18ace6d8557/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.1262693 Nov 09 05:00:16.084572 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 36172) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:00:16.092877 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-e349afe8-7856-41bf-9323-84aaa774e1e1 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-834123603-network', 'tenant_id': 'b4616cd401a642fa991081a387f60221'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:00:16.145157 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 71172a82-2f01-4a5b-bd07-bfe538c2ae92 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:00:16.194735 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 71172a82-2f01-4a5b-bd07-bfe538c2ae92 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:00:16.195104 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:16.228566 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e349afe8-7856-41bf-9323-84aaa774e1e1 admin admin] Made reservation on behalf of b4616cd401a642fa991081a387f60221 for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 05:00:16.230938 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e349afe8-7856-41bf-9323-84aaa774e1e1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:16.242179 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e349afe8-7856-41bf-9323-84aaa774e1e1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:16.269673 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7befc618-fa13-4ff8-891b-7d46c1bcd3aa None None] Sync routers for ids ['7e9d55e0-0100-4ebc-9667-a18ace6d8557'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 05:00:16.277131 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:16.280832 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7befc618-fa13-4ff8-891b-7d46c1bcd3aa None None] Routers {'7e9d55e0-0100-4ebc-9667-a18ace6d8557'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:00:16.281553 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-7befc618-fa13-4ff8-891b-7d46c1bcd3aa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:00:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['7e9d55e0-0100-4ebc-9667-a18ace6d8557'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:00:16.299473 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 71172a82-2f01-4a5b-bd07-bfe538c2ae92, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=71172a82-2f01-4a5b-bd07-bfe538c2ae92,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:00:16.325861 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e349afe8-7856-41bf-9323-84aaa774e1e1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:16.386162 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-7befc618-fa13-4ff8-891b-7d46c1bcd3aa None None] Set router 7e9d55e0-0100-4ebc-9667-a18ace6d8557 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:00:16.388930 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:16.430692 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e349afe8-7856-41bf-9323-84aaa774e1e1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:16.436643 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=71172a82-2f01-4a5b-bd07-bfe538c2ae92,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:00:16.453503 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e349afe8-7856-41bf-9323-84aaa774e1e1 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 304} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 05:00:16.468481 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e349afe8-7856-41bf-9323-84aaa774e1e1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fabcc4cf-0a4f-487a-8a8a-485b7221d091,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:00:16.473591 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e349afe8-7856-41bf-9323-84aaa774e1e1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:16.473940 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-e349afe8-7856-41bf-9323-84aaa774e1e1 admin admin] Added segment 738caf23-8b9f-4d17-8ee7-de5d5eb9911b of type vlan for network b387818b-6e37-4702-9eba-91b6a2816fc6 Nov 09 05:00:16.486690 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e349afe8-7856-41bf-9323-84aaa774e1e1 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:00:16.487014 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e349afe8-7856-41bf-9323-84aaa774e1e1 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:00:16.487341 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e349afe8-7856-41bf-9323-84aaa774e1e1 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:00:16.487675 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e349afe8-7856-41bf-9323-84aaa774e1e1 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:00:16.488011 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e349afe8-7856-41bf-9323-84aaa774e1e1 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:00:16.488341 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e349afe8-7856-41bf-9323-84aaa774e1e1 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:00:16.488667 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e349afe8-7856-41bf-9323-84aaa774e1e1 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:00:16.489184 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e349afe8-7856-41bf-9323-84aaa774e1e1 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:00:16.489514 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e349afe8-7856-41bf-9323-84aaa774e1e1 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:00:16.489997 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e349afe8-7856-41bf-9323-84aaa774e1e1 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:00:16.490332 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e349afe8-7856-41bf-9323-84aaa774e1e1 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:00:16.490684 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e349afe8-7856-41bf-9323-84aaa774e1e1 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:00:16.529651 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e349afe8-7856-41bf-9323-84aaa774e1e1 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:16.601958 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:16.642136 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e349afe8-7856-41bf-9323-84aaa774e1e1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:16.643160 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e349afe8-7856-41bf-9323-84aaa774e1e1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:00:16.643737 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e349afe8-7856-41bf-9323-84aaa774e1e1 admin admin] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:16.679010 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-7befc618-fa13-4ff8-891b-7d46c1bcd3aa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7e9d55e0-0100-4ebc-9667-a18ace6d8557', 'name': 'tempest-TestMinimumBasicScenario-1252630362-router', 'tenant_id': '6342064e2f4e4d17a45b74d8725885ef', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.148'}], 'enable_snat': True}, 'gw_port_id': '71172a82-2f01-4a5b-bd07-bfe538c2ae92', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:00:11Z', 'updated_at': '2021-11-09T05:00:14Z', 'revision_number': 4, 'project_id': '6342064e2f4e4d17a45b74d8725885ef', 'gw_port': {'id': '71172a82-2f01-4a5b-bd07-bfe538c2ae92', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:38:f6:39', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7e9d55e0-0100-4ebc-9667-a18ace6d8557', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1667, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:00:11Z', 'updated_at': '2021-11-09T05:00:14Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '940c1a94-9aed-4b5a-b999-df6f009eebec', 'name': '', 'network_id': '00c105ea-e093-47a8-a669-bbdd36caea7e', 'tenant_id': '6342064e2f4e4d17a45b74d8725885ef', 'mac_address': 'fa:16:3e:bd:a6:eb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7e9d55e0-0100-4ebc-9667-a18ace6d8557', 'device_owner': 'network:router_interface', 'standard_attr_id': 1668, 'fixed_ips': [{'subnet_id': '15c42388-61b6-40bb-be5b-e0929ebd3465', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:00:13Z', 'updated_at': '2021-11-09T05:00:14Z', 'revision_number': 2, 'project_id': '6342064e2f4e4d17a45b74d8725885ef', 'subnets': [{'id': '15c42388-61b6-40bb-be5b-e0929ebd3465', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:00:16.705945 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e349afe8-7856-41bf-9323-84aaa774e1e1 admin admin] Pushing event updated for resources: {'Network': ['ID=b387818b-6e37-4702-9eba-91b6a2816fc6,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:00:16.709074 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7befc618-fa13-4ff8-891b-7d46c1bcd3aa None None] Checking router: 7e9d55e0-0100-4ebc-9667-a18ace6d8557 for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 05:00:16.709424 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7befc618-fa13-4ff8-891b-7d46c1bcd3aa None None] Updating router 7e9d55e0-0100-4ebc-9667-a18ace6d8557 port 940c1a94-9aed-4b5a-b999-df6f009eebec binding host dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 05:00:16.715872 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network b387818b-6e37-4702-9eba-91b6a2816fc6 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 05:00:16.734184 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-7befc618-fa13-4ff8-891b-7d46c1bcd3aa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:16.759094 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e349afe8-7856-41bf-9323-84aaa774e1e1 admin admin] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.6701152 Nov 09 05:00:16.761710 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 36174) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:00:16.767020 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-471c6304-d97d-4ac6-b556-ab0fd2fc0f8e admin admin] Request body: {'subnet': {'network_id': 'b387818b-6e37-4702-9eba-91b6a2816fc6', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-834123603-subnet', 'tenant_id': 'b4616cd401a642fa991081a387f60221', 'ip_version': 4}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:00:16.862687 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-471c6304-d97d-4ac6-b556-ab0fd2fc0f8e admin admin] Made reservation on behalf of b4616cd401a642fa991081a387f60221 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 05:00:16.865829 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-471c6304-d97d-4ac6-b556-ab0fd2fc0f8e admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:17.000147 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-7befc618-fa13-4ff8-891b-7d46c1bcd3aa None None] Publish callbacks [] for port, precommit_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:17.001873 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:17.122345 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-7befc618-fa13-4ff8-891b-7d46c1bcd3aa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:17.176451 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed2439f7-bcb7-488a-84a2-62069a1cec11 None None] Pushing event updated for resources: {'Port': ['ID=940c1a94-9aed-4b5a-b999-df6f009eebec,revision_number=3']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:00:17.188599 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-471c6304-d97d-4ac6-b556-ab0fd2fc0f8e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:17.199419 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed2439f7-bcb7-488a-84a2-62069a1cec11 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:00:17.199777 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed2439f7-bcb7-488a-84a2-62069a1cec11 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:00:17.204590 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed2439f7-bcb7-488a-84a2-62069a1cec11 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:00:17.204590 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed2439f7-bcb7-488a-84a2-62069a1cec11 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:00:17.204590 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed2439f7-bcb7-488a-84a2-62069a1cec11 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:00:17.204590 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed2439f7-bcb7-488a-84a2-62069a1cec11 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:00:17.204590 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed2439f7-bcb7-488a-84a2-62069a1cec11 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:00:17.204590 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed2439f7-bcb7-488a-84a2-62069a1cec11 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:00:17.204590 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed2439f7-bcb7-488a-84a2-62069a1cec11 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:00:17.204590 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed2439f7-bcb7-488a-84a2-62069a1cec11 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:00:17.204590 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed2439f7-bcb7-488a-84a2-62069a1cec11 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:00:17.204590 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed2439f7-bcb7-488a-84a2-62069a1cec11 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:00:17.235112 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-7befc618-fa13-4ff8-891b-7d46c1bcd3aa None None] Attempting to bind port 940c1a94-9aed-4b5a-b999-df6f009eebec on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 05:00:17.235759 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-7befc618-fa13-4ff8-891b-7d46c1bcd3aa None None] Attempting to bind port 940c1a94-9aed-4b5a-b999-df6f009eebec by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '794d91f6-937c-4e26-8ecc-34550b214f4a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 311, 'network_id': '00c105ea-e093-47a8-a669-bbdd36caea7e'}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 05:00:17.236122 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7befc618-fa13-4ff8-891b-7d46c1bcd3aa None None] Attempting to bind port 940c1a94-9aed-4b5a-b999-df6f009eebec on network 00c105ea-e093-47a8-a669-bbdd36caea7e {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 05:00:17.242689 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7befc618-fa13-4ff8-891b-7d46c1bcd3aa None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 5, 0, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 05:00:17.243109 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7befc618-fa13-4ff8-891b-7d46c1bcd3aa None None] Checking segment: {'id': '794d91f6-937c-4e26-8ecc-34550b214f4a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 311, 'network_id': '00c105ea-e093-47a8-a669-bbdd36caea7e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102164) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 05:00:17.243602 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-7befc618-fa13-4ff8-891b-7d46c1bcd3aa None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:17.243881 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7befc618-fa13-4ff8-891b-7d46c1bcd3aa None None] Bound using segment: {'id': '794d91f6-937c-4e26-8ecc-34550b214f4a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 311, 'network_id': '00c105ea-e093-47a8-a669-bbdd36caea7e'} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 05:00:17.244540 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-7befc618-fa13-4ff8-891b-7d46c1bcd3aa None None] Bound port: 940c1a94-9aed-4b5a-b999-df6f009eebec, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '794d91f6-937c-4e26-8ecc-34550b214f4a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 311, 'network_id': '00c105ea-e093-47a8-a669-bbdd36caea7e'}}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 05:00:17.244924 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-7befc618-fa13-4ff8-891b-7d46c1bcd3aa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:17.257442 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-471c6304-d97d-4ac6-b556-ab0fd2fc0f8e admin admin] Pushing event updated for resources: {'Subnet': ['ID=bffccedc-bf62-4420-b9fb-ed0e7ecf094d,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:00:17.269087 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-471c6304-d97d-4ac6-b556-ab0fd2fc0f8e admin admin] Checking segment: {'id': '738caf23-8b9f-4d17-8ee7-de5d5eb9911b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 304, 'network_id': 'b387818b-6e37-4702-9eba-91b6a2816fc6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 05:00:17.269456 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-471c6304-d97d-4ac6-b556-ab0fd2fc0f8e admin admin] Network hostable DHCP agents. Network: b387818b-6e37-4702-9eba-91b6a2816fc6, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 05:00:17.313752 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-7befc618-fa13-4ff8-891b-7d46c1bcd3aa None None] For port 940c1a94-9aed-4b5a-b999-df6f009eebec, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102164) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 05:00:17.317336 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-7befc618-fa13-4ff8-891b-7d46c1bcd3aa None None] For port 940c1a94-9aed-4b5a-b999-df6f009eebec, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=940c1a94-9aed-4b5a-b999-df6f009eebec,segment=NetworkSegment(794d91f6-937c-4e26-8ecc-34550b214f4a),segment_id=794d91f6-937c-4e26-8ecc-34550b214f4a)] {{(pid=102164) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 05:00:17.399738 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-471c6304-d97d-4ac6-b556-ab0fd2fc0f8e admin admin] Network b387818b-6e37-4702-9eba-91b6a2816fc6 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 05:00:17.442351 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-7befc618-fa13-4ff8-891b-7d46c1bcd3aa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:17.465400 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-b4d187a4-c28b-45b3-93ab-4b2f1908af4a None None] Provisioning complete for port 940c1a94-9aed-4b5a-b999-df6f009eebec triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:00:17.466555 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b4d187a4-c28b-45b3-93ab-4b2f1908af4a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:17.494910 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7befc618-fa13-4ff8-891b-7d46c1bcd3aa None None] Routers {'7e9d55e0-0100-4ebc-9667-a18ace6d8557'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:00:17.495929 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-7befc618-fa13-4ff8-891b-7d46c1bcd3aa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:00:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['7e9d55e0-0100-4ebc-9667-a18ace6d8557'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:00:17.527998 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-471c6304-d97d-4ac6-b556-ab0fd2fc0f8e admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, b387818b-6e37-4702-9eba-91b6a2816fc6) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:00:17.532723 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-471c6304-d97d-4ac6-b556-ab0fd2fc0f8e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:00:17.533305 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-471c6304-d97d-4ac6-b556-ab0fd2fc0f8e admin admin] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:17.543359 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b6411f40-38b0-4d73-8b6b-c115ca2d300c None None] Network b387818b-6e37-4702-9eba-91b6a2816fc6 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 05:00:17.555027 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed2439f7-bcb7-488a-84a2-62069a1cec11 None None] Pushing event updated for resources: {'Port': ['ID=940c1a94-9aed-4b5a-b999-df6f009eebec,revision_number=4']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:00:17.633675 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-7befc618-fa13-4ff8-891b-7d46c1bcd3aa None None] Set router 7e9d55e0-0100-4ebc-9667-a18ace6d8557 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:00:17.639706 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-471c6304-d97d-4ac6-b556-ab0fd2fc0f8e admin admin] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 0.8768528 Nov 09 05:00:17.642127 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 36176) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:00:17.649397 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-399e52bd-798a-4b87-9245-86ce1fdde9de admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-834123603-router', 'tenant_id': 'b4616cd401a642fa991081a387f60221', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:00:17.661537 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b4d187a4-c28b-45b3-93ab-4b2f1908af4a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:17.748620 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-b4d187a4-c28b-45b3-93ab-4b2f1908af4a None None] For port 940c1a94-9aed-4b5a-b999-df6f009eebec, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=940c1a94-9aed-4b5a-b999-df6f009eebec,segment=NetworkSegment(794d91f6-937c-4e26-8ecc-34550b214f4a),segment_id=794d91f6-937c-4e26-8ecc-34550b214f4a)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:00:17.788254 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-54ba0d24-e7e8-4a1e-bf65-58449a89f2f8 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-b387818b-6e37-4702-9eba-91b6a2816fc6', 'network_id': 'b387818b-6e37-4702-9eba-91b6a2816fc6', 'tenant_id': 'b4616cd401a642fa991081a387f60221', 'fixed_ips': [{'subnet_id': 'bffccedc-bf62-4420-b9fb-ed0e7ecf094d'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 05:00:17.789116 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-54ba0d24-e7e8-4a1e-bf65-58449a89f2f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:17.794909 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-399e52bd-798a-4b87-9245-86ce1fdde9de admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:17.796215 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-399e52bd-798a-4b87-9245-86ce1fdde9de admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:17.845150 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-7befc618-fa13-4ff8-891b-7d46c1bcd3aa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7e9d55e0-0100-4ebc-9667-a18ace6d8557', 'name': 'tempest-TestMinimumBasicScenario-1252630362-router', 'tenant_id': '6342064e2f4e4d17a45b74d8725885ef', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.148'}], 'enable_snat': True}, 'gw_port_id': '71172a82-2f01-4a5b-bd07-bfe538c2ae92', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:00:11Z', 'updated_at': '2021-11-09T05:00:14Z', 'revision_number': 4, 'project_id': '6342064e2f4e4d17a45b74d8725885ef', 'gw_port': {'id': '71172a82-2f01-4a5b-bd07-bfe538c2ae92', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:38:f6:39', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e9d55e0-0100-4ebc-9667-a18ace6d8557', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1667, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:00:11Z', 'updated_at': '2021-11-09T05:00:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '940c1a94-9aed-4b5a-b999-df6f009eebec', 'name': '', 'network_id': '00c105ea-e093-47a8-a669-bbdd36caea7e', 'tenant_id': '6342064e2f4e4d17a45b74d8725885ef', 'mac_address': 'fa:16:3e:bd:a6:eb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7e9d55e0-0100-4ebc-9667-a18ace6d8557', 'device_owner': 'network:router_interface', 'standard_attr_id': 1668, 'fixed_ips': [{'subnet_id': '15c42388-61b6-40bb-be5b-e0929ebd3465', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:00:13Z', 'updated_at': '2021-11-09T05:00:17Z', 'revision_number': 4, 'project_id': '6342064e2f4e4d17a45b74d8725885ef', 'subnets': [{'id': '15c42388-61b6-40bb-be5b-e0929ebd3465', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:00:17.851825 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-399e52bd-798a-4b87-9245-86ce1fdde9de admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:17.859616 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b4d187a4-c28b-45b3-93ab-4b2f1908af4a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:17.873133 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7befc618-fa13-4ff8-891b-7d46c1bcd3aa None None] The sync data for ids ['7e9d55e0-0100-4ebc-9667-a18ace6d8557'] in dv-neutron-816802-2-hyperv is: [{'id': '7e9d55e0-0100-4ebc-9667-a18ace6d8557', 'name': 'tempest-TestMinimumBasicScenario-1252630362-router', 'tenant_id': '6342064e2f4e4d17a45b74d8725885ef', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.148'}], 'enable_snat': True}, 'gw_port_id': '71172a82-2f01-4a5b-bd07-bfe538c2ae92', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:00:11Z', 'updated_at': '2021-11-09T05:00:14Z', 'revision_number': 4, 'project_id': '6342064e2f4e4d17a45b74d8725885ef', 'gw_port': {'id': '71172a82-2f01-4a5b-bd07-bfe538c2ae92', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:38:f6:39', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e9d55e0-0100-4ebc-9667-a18ace6d8557', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1667, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:00:11Z', 'updated_at': '2021-11-09T05:00:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '940c1a94-9aed-4b5a-b999-df6f009eebec', 'name': '', 'network_id': '00c105ea-e093-47a8-a669-bbdd36caea7e', 'tenant_id': '6342064e2f4e4d17a45b74d8725885ef', 'mac_address': 'fa:16:3e:bd:a6:eb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7e9d55e0-0100-4ebc-9667-a18ace6d8557', 'device_owner': 'network:router_interface', 'standard_attr_id': 1668, 'fixed_ips': [{'subnet_id': '15c42388-61b6-40bb-be5b-e0929ebd3465', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:00:13Z', 'updated_at': '2021-11-09T05:00:17Z', 'revision_number': 4, 'project_id': '6342064e2f4e4d17a45b74d8725885ef', 'subnets': [{'id': '15c42388-61b6-40bb-be5b-e0929ebd3465', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 05:00:18.100386 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-399e52bd-798a-4b87-9245-86ce1fdde9de admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:18.139508 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-7072a5fd-fb60-40b6-a886-a75cc8f01b8b None None] Provisioning complete for port 940c1a94-9aed-4b5a-b999-df6f009eebec triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:00:18.139880 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7072a5fd-fb60-40b6-a886-a75cc8f01b8b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:18.169353 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4d187a4-c28b-45b3-93ab-4b2f1908af4a None None] Pushing event updated for resources: {'Port': ['ID=940c1a94-9aed-4b5a-b999-df6f009eebec,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:00:18.174297 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-54ba0d24-e7e8-4a1e-bf65-58449a89f2f8 None None] Allocated IP 172.20.0.2 (b387818b-6e37-4702-9eba-91b6a2816fc6/bffccedc-bf62-4420-b9fb-ed0e7ecf094d/b594387c-32e4-4340-8ed4-bc4d05554235) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 05:00:18.228446 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 71172a82-2f01-4a5b-bd07-bfe538c2ae92 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:00:18.401907 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 71172a82-2f01-4a5b-bd07-bfe538c2ae92 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:00:18.402274 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:18.476122 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-54ba0d24-e7e8-4a1e-bf65-58449a89f2f8 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:18.524319 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 940c1a94-9aed-4b5a-b999-df6f009eebec up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:00:18.579994 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 940c1a94-9aed-4b5a-b999-df6f009eebec triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:00:18.580541 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:18.601289 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-54ba0d24-e7e8-4a1e-bf65-58449a89f2f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:18.663889 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-54ba0d24-e7e8-4a1e-bf65-58449a89f2f8 None None] Network b387818b-6e37-4702-9eba-91b6a2816fc6 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:00:18.665521 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-399e52bd-798a-4b87-9245-86ce1fdde9de admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:18.674688 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-54ba0d24-e7e8-4a1e-bf65-58449a89f2f8 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:00:18.679521 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-54ba0d24-e7e8-4a1e-bf65-58449a89f2f8 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 05:00:18.685874 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54ba0d24-e7e8-4a1e-bf65-58449a89f2f8 None None] Pushing event updated for resources: {'Port': ['ID=b594387c-32e4-4340-8ed4-bc4d05554235,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:00:18.687138 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-399e52bd-798a-4b87-9245-86ce1fdde9de admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:18.788853 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-54ba0d24-e7e8-4a1e-bf65-58449a89f2f8 None None] Attempting to bind port b594387c-32e4-4340-8ed4-bc4d05554235 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 05:00:18.789238 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-54ba0d24-e7e8-4a1e-bf65-58449a89f2f8 None None] Attempting to bind port b594387c-32e4-4340-8ed4-bc4d05554235 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '738caf23-8b9f-4d17-8ee7-de5d5eb9911b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 304, 'network_id': 'b387818b-6e37-4702-9eba-91b6a2816fc6'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 05:00:18.789608 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-54ba0d24-e7e8-4a1e-bf65-58449a89f2f8 None None] Attempting to bind port b594387c-32e4-4340-8ed4-bc4d05554235 on network b387818b-6e37-4702-9eba-91b6a2816fc6 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 05:00:18.800548 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-54ba0d24-e7e8-4a1e-bf65-58449a89f2f8 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 5, 0, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 05:00:18.800926 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-54ba0d24-e7e8-4a1e-bf65-58449a89f2f8 None None] Checking segment: {'id': '738caf23-8b9f-4d17-8ee7-de5d5eb9911b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 304, 'network_id': 'b387818b-6e37-4702-9eba-91b6a2816fc6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 05:00:18.801328 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-54ba0d24-e7e8-4a1e-bf65-58449a89f2f8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:18.810958 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-54ba0d24-e7e8-4a1e-bf65-58449a89f2f8 None None] Bound using segment: {'id': '738caf23-8b9f-4d17-8ee7-de5d5eb9911b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 304, 'network_id': 'b387818b-6e37-4702-9eba-91b6a2816fc6'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 05:00:18.810958 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-54ba0d24-e7e8-4a1e-bf65-58449a89f2f8 None None] Bound port: b594387c-32e4-4340-8ed4-bc4d05554235, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '738caf23-8b9f-4d17-8ee7-de5d5eb9911b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 304, 'network_id': 'b387818b-6e37-4702-9eba-91b6a2816fc6'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 05:00:18.810958 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-54ba0d24-e7e8-4a1e-bf65-58449a89f2f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:18.814699 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-399e52bd-798a-4b87-9245-86ce1fdde9de admin admin] Allocated IP 172.26.0.82 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/df811dcb-d68b-49ad-91cb-0d21711c9980) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 05:00:18.875541 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-54ba0d24-e7e8-4a1e-bf65-58449a89f2f8 None None] For port b594387c-32e4-4340-8ed4-bc4d05554235, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 05:00:18.878944 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-54ba0d24-e7e8-4a1e-bf65-58449a89f2f8 None None] For port b594387c-32e4-4340-8ed4-bc4d05554235, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=b594387c-32e4-4340-8ed4-bc4d05554235,segment=NetworkSegment(738caf23-8b9f-4d17-8ee7-de5d5eb9911b),segment_id=738caf23-8b9f-4d17-8ee7-de5d5eb9911b)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 05:00:18.929658 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-399e52bd-798a-4b87-9245-86ce1fdde9de admin admin] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:18.996688 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-54ba0d24-e7e8-4a1e-bf65-58449a89f2f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:19.047445 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-399e52bd-798a-4b87-9245-86ce1fdde9de admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:19.061353 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54ba0d24-e7e8-4a1e-bf65-58449a89f2f8 None None] Pushing event updated for resources: {'Port': ['ID=b594387c-32e4-4340-8ed4-bc4d05554235,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:00:19.090504 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-399e52bd-798a-4b87-9245-86ce1fdde9de admin admin] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:00:19.098050 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-399e52bd-798a-4b87-9245-86ce1fdde9de admin admin] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:00:19.101933 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-399e52bd-798a-4b87-9245-86ce1fdde9de admin admin] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 05:00:19.139504 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-399e52bd-798a-4b87-9245-86ce1fdde9de admin admin] Pushing event updated for resources: {'Port': ['ID=df811dcb-d68b-49ad-91cb-0d21711c9980,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:00:19.557591 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-399e52bd-798a-4b87-9245-86ce1fdde9de admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:19.766944 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-399e52bd-798a-4b87-9245-86ce1fdde9de admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:19.963045 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-770efec1-5bca-4ea5-bb22-562bae970341 None None] Network b387818b-6e37-4702-9eba-91b6a2816fc6 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 05:00:20.005775 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-399e52bd-798a-4b87-9245-86ce1fdde9de admin admin] Router eaafe462-aab0-4eb9-ad19-8d94cfbfa3b5 is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102162) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 05:00:20.036231 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-9bc34f88-a0aa-4577-a43e-43a84737f448 None None] Provisioning complete for port b594387c-32e4-4340-8ed4-bc4d05554235 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:00:20.036773 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9bc34f88-a0aa-4577-a43e-43a84737f448 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:20.122097 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-399e52bd-798a-4b87-9245-86ce1fdde9de admin admin] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 05:00:20.138063 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bd73aa34-9821-407c-9c72-ba1d3e51da90 None None] Sync routers for ids ['eaafe462-aab0-4eb9-ad19-8d94cfbfa3b5'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 05:00:20.182022 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bd73aa34-9821-407c-9c72-ba1d3e51da90 None None] Routers {'eaafe462-aab0-4eb9-ad19-8d94cfbfa3b5'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:00:20.182659 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-bd73aa34-9821-407c-9c72-ba1d3e51da90 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:00:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['eaafe462-aab0-4eb9-ad19-8d94cfbfa3b5'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:00:20.207906 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device b594387c-32e4-4340-8ed4-bc4d05554235 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:00:20.213444 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-399e52bd-798a-4b87-9245-86ce1fdde9de admin admin] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:20.215015 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-399e52bd-798a-4b87-9245-86ce1fdde9de admin admin] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 925 time: 2.5706389 Nov 09 05:00:20.218263 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 36178) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:00:20.246942 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9bc34f88-a0aa-4577-a43e-43a84737f448 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:20.359324 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-9bc34f88-a0aa-4577-a43e-43a84737f448 None None] For port b594387c-32e4-4340-8ed4-bc4d05554235, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=b594387c-32e4-4340-8ed4-bc4d05554235,segment=NetworkSegment(738caf23-8b9f-4d17-8ee7-de5d5eb9911b),segment_id=738caf23-8b9f-4d17-8ee7-de5d5eb9911b)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:00:20.389554 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-bd73aa34-9821-407c-9c72-ba1d3e51da90 None None] Set router eaafe462-aab0-4eb9-ad19-8d94cfbfa3b5 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:00:20.391608 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port b594387c-32e4-4340-8ed4-bc4d05554235 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:00:20.391851 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:20.463174 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9bc34f88-a0aa-4577-a43e-43a84737f448 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:20.591338 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bc34f88-a0aa-4577-a43e-43a84737f448 None None] Pushing event updated for resources: {'Port': ['ID=b594387c-32e4-4340-8ed4-bc4d05554235,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:00:20.619452 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-d969eda7-6aa5-4d99-b372-dcf4e164b1b6 None None] Provisioning complete for port b594387c-32e4-4340-8ed4-bc4d05554235 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:00:20.619823 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d969eda7-6aa5-4d99-b372-dcf4e164b1b6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:20.655120 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-03ce42b1-5840-45a5-b2a3-7b70fcb9dcbb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:20.710948 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 940c1a94-9aed-4b5a-b999-df6f009eebec up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:00:20.802216 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-bd73aa34-9821-407c-9c72-ba1d3e51da90 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eaafe462-aab0-4eb9-ad19-8d94cfbfa3b5', 'name': 'tempest-TestMinimumBasicScenario-834123603-router', 'tenant_id': 'b4616cd401a642fa991081a387f60221', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.82'}], 'enable_snat': True}, 'gw_port_id': 'df811dcb-d68b-49ad-91cb-0d21711c9980', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:00:17Z', 'updated_at': '2021-11-09T05:00:19Z', 'revision_number': 3, 'project_id': 'b4616cd401a642fa991081a387f60221', 'gw_port': {'id': 'df811dcb-d68b-49ad-91cb-0d21711c9980', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:02:b6:97', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eaafe462-aab0-4eb9-ad19-8d94cfbfa3b5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1679, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.82', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:00:18Z', 'updated_at': '2021-11-09T05:00:18Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:00:20.808833 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-03ce42b1-5840-45a5-b2a3-7b70fcb9dcbb admin admin] Allocated IP 172.20.0.1 (b387818b-6e37-4702-9eba-91b6a2816fc6/bffccedc-bf62-4420-b9fb-ed0e7ecf094d/425a6f17-f8fe-4b37-acbe-e4d444d82fdf) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 05:00:20.833667 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bd73aa34-9821-407c-9c72-ba1d3e51da90 None None] Checking router: eaafe462-aab0-4eb9-ad19-8d94cfbfa3b5 for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 05:00:20.834020 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bd73aa34-9821-407c-9c72-ba1d3e51da90 None None] Updating router eaafe462-aab0-4eb9-ad19-8d94cfbfa3b5 port df811dcb-d68b-49ad-91cb-0d21711c9980 binding host dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 05:00:20.855409 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 940c1a94-9aed-4b5a-b999-df6f009eebec triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:00:20.855780 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:20.880317 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-bd73aa34-9821-407c-9c72-ba1d3e51da90 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:20.911171 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-03ce42b1-5840-45a5-b2a3-7b70fcb9dcbb admin admin] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:21.030896 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-03ce42b1-5840-45a5-b2a3-7b70fcb9dcbb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:21.070133 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-03ce42b1-5840-45a5-b2a3-7b70fcb9dcbb admin admin] Network b387818b-6e37-4702-9eba-91b6a2816fc6 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:00:21.076538 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-03ce42b1-5840-45a5-b2a3-7b70fcb9dcbb admin admin] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:00:21.080946 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-03ce42b1-5840-45a5-b2a3-7b70fcb9dcbb admin admin] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 05:00:21.084214 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03ce42b1-5840-45a5-b2a3-7b70fcb9dcbb admin admin] Pushing event updated for resources: {'Port': ['ID=425a6f17-f8fe-4b37-acbe-e4d444d82fdf,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:00:21.127066 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-03ce42b1-5840-45a5-b2a3-7b70fcb9dcbb admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:21.178039 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-bd73aa34-9821-407c-9c72-ba1d3e51da90 None None] Publish callbacks [] for port, precommit_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:21.281870 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-bd73aa34-9821-407c-9c72-ba1d3e51da90 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:21.340126 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-bd73aa34-9821-407c-9c72-ba1d3e51da90 None None] Attempting to bind port df811dcb-d68b-49ad-91cb-0d21711c9980 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 05:00:21.341034 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-bd73aa34-9821-407c-9c72-ba1d3e51da90 None None] Attempting to bind port df811dcb-d68b-49ad-91cb-0d21711c9980 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 05:00:21.341400 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bd73aa34-9821-407c-9c72-ba1d3e51da90 None None] Attempting to bind port df811dcb-d68b-49ad-91cb-0d21711c9980 on network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 05:00:21.344771 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1286756-719e-41e5-ae8f-15739de3d1d4 None None] Pushing event updated for resources: {'Port': ['ID=df811dcb-d68b-49ad-91cb-0d21711c9980,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:00:21.345520 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-03ce42b1-5840-45a5-b2a3-7b70fcb9dcbb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:21.350637 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bd73aa34-9821-407c-9c72-ba1d3e51da90 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 5, 0, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 05:00:21.351008 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bd73aa34-9821-407c-9c72-ba1d3e51da90 None None] Checking segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 05:00:21.351398 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-bd73aa34-9821-407c-9c72-ba1d3e51da90 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:21.351773 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bd73aa34-9821-407c-9c72-ba1d3e51da90 None None] Bound using segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 05:00:21.352240 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-bd73aa34-9821-407c-9c72-ba1d3e51da90 None None] Bound port: df811dcb-d68b-49ad-91cb-0d21711c9980, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 05:00:21.352609 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-bd73aa34-9821-407c-9c72-ba1d3e51da90 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:21.380110 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-1ad18436-4697-4cac-bd43-e10a117f96a0 None None] Provisioning complete for port 425a6f17-f8fe-4b37-acbe-e4d444d82fdf triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:00:21.380408 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1ad18436-4697-4cac-bd43-e10a117f96a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:21.433768 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-1ad18436-4697-4cac-bd43-e10a117f96a0 None None] Port 425a6f17-f8fe-4b37-acbe-e4d444d82fdf cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 05:00:21.435505 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-bd73aa34-9821-407c-9c72-ba1d3e51da90 None None] For port df811dcb-d68b-49ad-91cb-0d21711c9980, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 05:00:21.446742 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-bd73aa34-9821-407c-9c72-ba1d3e51da90 None None] For port df811dcb-d68b-49ad-91cb-0d21711c9980, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=df811dcb-d68b-49ad-91cb-0d21711c9980,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 05:00:21.456738 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 05:00:21.506056 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-03ce42b1-5840-45a5-b2a3-7b70fcb9dcbb admin admin] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:21.531454 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-bd73aa34-9821-407c-9c72-ba1d3e51da90 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:21.585780 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bd73aa34-9821-407c-9c72-ba1d3e51da90 None None] Routers {'eaafe462-aab0-4eb9-ad19-8d94cfbfa3b5'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:00:21.586416 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-bd73aa34-9821-407c-9c72-ba1d3e51da90 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:00:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['eaafe462-aab0-4eb9-ad19-8d94cfbfa3b5'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:00:21.608190 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-03ce42b1-5840-45a5-b2a3-7b70fcb9dcbb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:21.679248 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03ce42b1-5840-45a5-b2a3-7b70fcb9dcbb admin admin] Pushing event updated for resources: {'Port': ['ID=425a6f17-f8fe-4b37-acbe-e4d444d82fdf,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:00:21.681635 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-03ce42b1-5840-45a5-b2a3-7b70fcb9dcbb admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:21.773670 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-03ce42b1-5840-45a5-b2a3-7b70fcb9dcbb admin admin] Network b387818b-6e37-4702-9eba-91b6a2816fc6 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:00:21.775146 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-03ce42b1-5840-45a5-b2a3-7b70fcb9dcbb admin admin] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:00:21.775392 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1286756-719e-41e5-ae8f-15739de3d1d4 None None] Pushing event updated for resources: {'Port': ['ID=df811dcb-d68b-49ad-91cb-0d21711c9980,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:00:21.852779 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-bd73aa34-9821-407c-9c72-ba1d3e51da90 None None] Set router eaafe462-aab0-4eb9-ad19-8d94cfbfa3b5 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:00:21.903139 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-03ce42b1-5840-45a5-b2a3-7b70fcb9dcbb admin admin] Router eaafe462-aab0-4eb9-ad19-8d94cfbfa3b5 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 05:00:22.017177 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-03ce42b1-5840-45a5-b2a3-7b70fcb9dcbb admin admin] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 05:00:22.022162 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-03ce42b1-5840-45a5-b2a3-7b70fcb9dcbb admin admin] 10.222.0.24 "PUT /v2.0/routers/eaafe462-aab0-4eb9-ad19-8d94cfbfa3b5/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8029020 Nov 09 05:00:22.066052 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-a5797926-6234-447a-b798-ce8d5216ea79 None None] Provisioning complete for port 425a6f17-f8fe-4b37-acbe-e4d444d82fdf triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:00:22.066378 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a5797926-6234-447a-b798-ce8d5216ea79 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:22.108560 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-a5797926-6234-447a-b798-ce8d5216ea79 None None] Port 425a6f17-f8fe-4b37-acbe-e4d444d82fdf cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 05:00:22.117385 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-bd73aa34-9821-407c-9c72-ba1d3e51da90 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eaafe462-aab0-4eb9-ad19-8d94cfbfa3b5', 'name': 'tempest-TestMinimumBasicScenario-834123603-router', 'tenant_id': 'b4616cd401a642fa991081a387f60221', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.82'}], 'enable_snat': True}, 'gw_port_id': 'df811dcb-d68b-49ad-91cb-0d21711c9980', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:00:17Z', 'updated_at': '2021-11-09T05:00:21Z', 'revision_number': 4, 'project_id': 'b4616cd401a642fa991081a387f60221', 'gw_port': {'id': 'df811dcb-d68b-49ad-91cb-0d21711c9980', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:02:b6:97', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eaafe462-aab0-4eb9-ad19-8d94cfbfa3b5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1679, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.82', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:00:18Z', 'updated_at': '2021-11-09T05:00:21Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '425a6f17-f8fe-4b37-acbe-e4d444d82fdf', 'name': '', 'network_id': 'b387818b-6e37-4702-9eba-91b6a2816fc6', 'tenant_id': 'b4616cd401a642fa991081a387f60221', 'mac_address': 'fa:16:3e:89:43:15', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eaafe462-aab0-4eb9-ad19-8d94cfbfa3b5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1680, 'fixed_ips': [{'subnet_id': 'bffccedc-bf62-4420-b9fb-ed0e7ecf094d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:00:20Z', 'updated_at': '2021-11-09T05:00:20Z', 'revision_number': 1, 'project_id': 'b4616cd401a642fa991081a387f60221', 'subnets': [{'id': 'bffccedc-bf62-4420-b9fb-ed0e7ecf094d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:00:22.121624 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device b594387c-32e4-4340-8ed4-bc4d05554235 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:00:22.171249 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bd73aa34-9821-407c-9c72-ba1d3e51da90 None None] The sync data for ids ['eaafe462-aab0-4eb9-ad19-8d94cfbfa3b5'] in dv-neutron-816802-2-hyperv is: [{'id': 'eaafe462-aab0-4eb9-ad19-8d94cfbfa3b5', 'name': 'tempest-TestMinimumBasicScenario-834123603-router', 'tenant_id': 'b4616cd401a642fa991081a387f60221', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.82'}], 'enable_snat': True}, 'gw_port_id': 'df811dcb-d68b-49ad-91cb-0d21711c9980', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:00:17Z', 'updated_at': '2021-11-09T05:00:21Z', 'revision_number': 4, 'project_id': 'b4616cd401a642fa991081a387f60221', 'gw_port': {'id': 'df811dcb-d68b-49ad-91cb-0d21711c9980', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:02:b6:97', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eaafe462-aab0-4eb9-ad19-8d94cfbfa3b5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1679, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.82', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:00:18Z', 'updated_at': '2021-11-09T05:00:21Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '425a6f17-f8fe-4b37-acbe-e4d444d82fdf', 'name': '', 'network_id': 'b387818b-6e37-4702-9eba-91b6a2816fc6', 'tenant_id': 'b4616cd401a642fa991081a387f60221', 'mac_address': 'fa:16:3e:89:43:15', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eaafe462-aab0-4eb9-ad19-8d94cfbfa3b5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1680, 'fixed_ips': [{'subnet_id': 'bffccedc-bf62-4420-b9fb-ed0e7ecf094d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:00:20Z', 'updated_at': '2021-11-09T05:00:20Z', 'revision_number': 1, 'project_id': 'b4616cd401a642fa991081a387f60221', 'subnets': [{'id': 'bffccedc-bf62-4420-b9fb-ed0e7ecf094d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 05:00:22.200676 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port b594387c-32e4-4340-8ed4-bc4d05554235 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:00:22.201322 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:24.156909 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device df811dcb-d68b-49ad-91cb-0d21711c9980 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:00:24.213121 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port df811dcb-d68b-49ad-91cb-0d21711c9980 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:00:24.213408 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:24.300150 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:24.322080 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port df811dcb-d68b-49ad-91cb-0d21711c9980, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=df811dcb-d68b-49ad-91cb-0d21711c9980,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:00:24.393857 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:24.455143 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=df811dcb-d68b-49ad-91cb-0d21711c9980,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:00:24.462404 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:00:24.462762 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:00:24.463100 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:00:24.463431 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:00:24.463762 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:00:24.464097 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:00:24.464427 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:00:24.464848 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:00:24.465177 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:00:24.466030 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:00:24.466367 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:00:24.466693 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:00:25.505045 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ec5da091-5707-4241-9be3-dab2509d2e5a None None] Sync routers for ids ['eaafe462-aab0-4eb9-ad19-8d94cfbfa3b5'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 05:00:25.515646 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ec5da091-5707-4241-9be3-dab2509d2e5a None None] Routers {'eaafe462-aab0-4eb9-ad19-8d94cfbfa3b5'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:00:25.516273 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-ec5da091-5707-4241-9be3-dab2509d2e5a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:00:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['eaafe462-aab0-4eb9-ad19-8d94cfbfa3b5'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:00:25.627352 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-ec5da091-5707-4241-9be3-dab2509d2e5a None None] Set router eaafe462-aab0-4eb9-ad19-8d94cfbfa3b5 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:00:25.832407 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-ec5da091-5707-4241-9be3-dab2509d2e5a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eaafe462-aab0-4eb9-ad19-8d94cfbfa3b5', 'name': 'tempest-TestMinimumBasicScenario-834123603-router', 'tenant_id': 'b4616cd401a642fa991081a387f60221', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.82'}], 'enable_snat': True}, 'gw_port_id': 'df811dcb-d68b-49ad-91cb-0d21711c9980', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:00:17Z', 'updated_at': '2021-11-09T05:00:21Z', 'revision_number': 4, 'project_id': 'b4616cd401a642fa991081a387f60221', 'gw_port': {'id': 'df811dcb-d68b-49ad-91cb-0d21711c9980', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:02:b6:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eaafe462-aab0-4eb9-ad19-8d94cfbfa3b5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1679, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.82', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:00:18Z', 'updated_at': '2021-11-09T05:00:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '425a6f17-f8fe-4b37-acbe-e4d444d82fdf', 'name': '', 'network_id': 'b387818b-6e37-4702-9eba-91b6a2816fc6', 'tenant_id': 'b4616cd401a642fa991081a387f60221', 'mac_address': 'fa:16:3e:89:43:15', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eaafe462-aab0-4eb9-ad19-8d94cfbfa3b5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1680, 'fixed_ips': [{'subnet_id': 'bffccedc-bf62-4420-b9fb-ed0e7ecf094d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:00:20Z', 'updated_at': '2021-11-09T05:00:21Z', 'revision_number': 2, 'project_id': 'b4616cd401a642fa991081a387f60221', 'subnets': [{'id': 'bffccedc-bf62-4420-b9fb-ed0e7ecf094d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:00:25.858833 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ec5da091-5707-4241-9be3-dab2509d2e5a None None] Checking router: eaafe462-aab0-4eb9-ad19-8d94cfbfa3b5 for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 05:00:25.859179 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ec5da091-5707-4241-9be3-dab2509d2e5a None None] Updating router eaafe462-aab0-4eb9-ad19-8d94cfbfa3b5 port 425a6f17-f8fe-4b37-acbe-e4d444d82fdf binding host dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 05:00:25.886614 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-ec5da091-5707-4241-9be3-dab2509d2e5a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:26.128568 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device df811dcb-d68b-49ad-91cb-0d21711c9980 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:00:26.177887 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port df811dcb-d68b-49ad-91cb-0d21711c9980 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:00:26.178249 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:26.234523 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-ec5da091-5707-4241-9be3-dab2509d2e5a None None] Publish callbacks [] for port, precommit_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:26.549602 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-ec5da091-5707-4241-9be3-dab2509d2e5a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:26.620398 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65358bb7-483d-4f06-b635-538fdd0d5b21 None None] Pushing event updated for resources: {'Port': ['ID=425a6f17-f8fe-4b37-acbe-e4d444d82fdf,revision_number=3']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:00:26.656188 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-ec5da091-5707-4241-9be3-dab2509d2e5a None None] Attempting to bind port 425a6f17-f8fe-4b37-acbe-e4d444d82fdf on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 05:00:26.656188 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-ec5da091-5707-4241-9be3-dab2509d2e5a None None] Attempting to bind port 425a6f17-f8fe-4b37-acbe-e4d444d82fdf by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '738caf23-8b9f-4d17-8ee7-de5d5eb9911b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 304, 'network_id': 'b387818b-6e37-4702-9eba-91b6a2816fc6'}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 05:00:26.656188 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ec5da091-5707-4241-9be3-dab2509d2e5a None None] Attempting to bind port 425a6f17-f8fe-4b37-acbe-e4d444d82fdf on network b387818b-6e37-4702-9eba-91b6a2816fc6 {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 05:00:26.660712 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ec5da091-5707-4241-9be3-dab2509d2e5a None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 5, 0, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 05:00:26.661277 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ec5da091-5707-4241-9be3-dab2509d2e5a None None] Checking segment: {'id': '738caf23-8b9f-4d17-8ee7-de5d5eb9911b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 304, 'network_id': 'b387818b-6e37-4702-9eba-91b6a2816fc6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102164) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 05:00:26.661915 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-ec5da091-5707-4241-9be3-dab2509d2e5a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:26.662501 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ec5da091-5707-4241-9be3-dab2509d2e5a None None] Bound using segment: {'id': '738caf23-8b9f-4d17-8ee7-de5d5eb9911b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 304, 'network_id': 'b387818b-6e37-4702-9eba-91b6a2816fc6'} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 05:00:26.663118 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-ec5da091-5707-4241-9be3-dab2509d2e5a None None] Bound port: 425a6f17-f8fe-4b37-acbe-e4d444d82fdf, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '738caf23-8b9f-4d17-8ee7-de5d5eb9911b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 304, 'network_id': 'b387818b-6e37-4702-9eba-91b6a2816fc6'}}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 05:00:26.663496 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-ec5da091-5707-4241-9be3-dab2509d2e5a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:26.737151 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-ec5da091-5707-4241-9be3-dab2509d2e5a None None] For port 425a6f17-f8fe-4b37-acbe-e4d444d82fdf, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102164) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 05:00:26.741245 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-ec5da091-5707-4241-9be3-dab2509d2e5a None None] For port 425a6f17-f8fe-4b37-acbe-e4d444d82fdf, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=425a6f17-f8fe-4b37-acbe-e4d444d82fdf,segment=NetworkSegment(738caf23-8b9f-4d17-8ee7-de5d5eb9911b),segment_id=738caf23-8b9f-4d17-8ee7-de5d5eb9911b)] {{(pid=102164) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 05:00:26.858715 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-be6bd2dd-ef4a-4ff4-a298-5cc2175cdd7a None None] Provisioning complete for port 425a6f17-f8fe-4b37-acbe-e4d444d82fdf triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:00:26.859002 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-be6bd2dd-ef4a-4ff4-a298-5cc2175cdd7a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:26.859271 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-ec5da091-5707-4241-9be3-dab2509d2e5a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:26.929927 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ec5da091-5707-4241-9be3-dab2509d2e5a None None] Routers {'eaafe462-aab0-4eb9-ad19-8d94cfbfa3b5'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:00:26.930585 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-ec5da091-5707-4241-9be3-dab2509d2e5a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:00:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['eaafe462-aab0-4eb9-ad19-8d94cfbfa3b5'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:00:26.941516 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65358bb7-483d-4f06-b635-538fdd0d5b21 None None] Pushing event updated for resources: {'Port': ['ID=425a6f17-f8fe-4b37-acbe-e4d444d82fdf,revision_number=4']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:00:26.960601 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-be6bd2dd-ef4a-4ff4-a298-5cc2175cdd7a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:27.006594 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-be6bd2dd-ef4a-4ff4-a298-5cc2175cdd7a None None] For port 425a6f17-f8fe-4b37-acbe-e4d444d82fdf, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=425a6f17-f8fe-4b37-acbe-e4d444d82fdf,segment=NetworkSegment(738caf23-8b9f-4d17-8ee7-de5d5eb9911b),segment_id=738caf23-8b9f-4d17-8ee7-de5d5eb9911b)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:00:27.080090 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-ec5da091-5707-4241-9be3-dab2509d2e5a None None] Set router eaafe462-aab0-4eb9-ad19-8d94cfbfa3b5 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:00:27.110702 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-be6bd2dd-ef4a-4ff4-a298-5cc2175cdd7a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:27.176294 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be6bd2dd-ef4a-4ff4-a298-5cc2175cdd7a None None] Pushing event updated for resources: {'Port': ['ID=425a6f17-f8fe-4b37-acbe-e4d444d82fdf,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:00:27.247060 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-c83d73f8-1866-4fae-ae37-538fc8e8f59b None None] Provisioning complete for port 425a6f17-f8fe-4b37-acbe-e4d444d82fdf triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:00:27.247682 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c83d73f8-1866-4fae-ae37-538fc8e8f59b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:27.331734 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-ec5da091-5707-4241-9be3-dab2509d2e5a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eaafe462-aab0-4eb9-ad19-8d94cfbfa3b5', 'name': 'tempest-TestMinimumBasicScenario-834123603-router', 'tenant_id': 'b4616cd401a642fa991081a387f60221', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.82'}], 'enable_snat': True}, 'gw_port_id': 'df811dcb-d68b-49ad-91cb-0d21711c9980', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:00:17Z', 'updated_at': '2021-11-09T05:00:21Z', 'revision_number': 4, 'project_id': 'b4616cd401a642fa991081a387f60221', 'gw_port': {'id': 'df811dcb-d68b-49ad-91cb-0d21711c9980', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:02:b6:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eaafe462-aab0-4eb9-ad19-8d94cfbfa3b5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1679, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.82', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:00:18Z', 'updated_at': '2021-11-09T05:00:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '425a6f17-f8fe-4b37-acbe-e4d444d82fdf', 'name': '', 'network_id': 'b387818b-6e37-4702-9eba-91b6a2816fc6', 'tenant_id': 'b4616cd401a642fa991081a387f60221', 'mac_address': 'fa:16:3e:89:43:15', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eaafe462-aab0-4eb9-ad19-8d94cfbfa3b5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1680, 'fixed_ips': [{'subnet_id': 'bffccedc-bf62-4420-b9fb-ed0e7ecf094d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:00:20Z', 'updated_at': '2021-11-09T05:00:26Z', 'revision_number': 4, 'project_id': 'b4616cd401a642fa991081a387f60221', 'subnets': [{'id': 'bffccedc-bf62-4420-b9fb-ed0e7ecf094d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:00:27.366682 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ec5da091-5707-4241-9be3-dab2509d2e5a None None] The sync data for ids ['eaafe462-aab0-4eb9-ad19-8d94cfbfa3b5'] in dv-neutron-816802-2-hyperv is: [{'id': 'eaafe462-aab0-4eb9-ad19-8d94cfbfa3b5', 'name': 'tempest-TestMinimumBasicScenario-834123603-router', 'tenant_id': 'b4616cd401a642fa991081a387f60221', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.82'}], 'enable_snat': True}, 'gw_port_id': 'df811dcb-d68b-49ad-91cb-0d21711c9980', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:00:17Z', 'updated_at': '2021-11-09T05:00:21Z', 'revision_number': 4, 'project_id': 'b4616cd401a642fa991081a387f60221', 'gw_port': {'id': 'df811dcb-d68b-49ad-91cb-0d21711c9980', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:02:b6:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eaafe462-aab0-4eb9-ad19-8d94cfbfa3b5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1679, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.82', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:00:18Z', 'updated_at': '2021-11-09T05:00:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '425a6f17-f8fe-4b37-acbe-e4d444d82fdf', 'name': '', 'network_id': 'b387818b-6e37-4702-9eba-91b6a2816fc6', 'tenant_id': 'b4616cd401a642fa991081a387f60221', 'mac_address': 'fa:16:3e:89:43:15', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eaafe462-aab0-4eb9-ad19-8d94cfbfa3b5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1680, 'fixed_ips': [{'subnet_id': 'bffccedc-bf62-4420-b9fb-ed0e7ecf094d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:00:20Z', 'updated_at': '2021-11-09T05:00:26Z', 'revision_number': 4, 'project_id': 'b4616cd401a642fa991081a387f60221', 'subnets': [{'id': 'bffccedc-bf62-4420-b9fb-ed0e7ecf094d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 05:00:28.153578 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 425a6f17-f8fe-4b37-acbe-e4d444d82fdf up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:00:28.213077 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 425a6f17-f8fe-4b37-acbe-e4d444d82fdf triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:00:28.213736 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:35.039841 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b8165de-e799-49e4-98cb-f881d996bb5d req-9f44dd78-a07b-43a4-80ee-a389f474264d tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:00:35.041293 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-7b8165de-e799-49e4-98cb-f881d996bb5d req-9f44dd78-a07b-43a4-80ee-a389f474264d tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/networks?id=00c105ea-e093-47a8-a669-bbdd36caea7e HTTP/1.1" status: 200 len: 815 time: 0.1002007 Nov 09 05:00:35.055936 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-7b8165de-e799-49e4-98cb-f881d996bb5d req-004011c1-2a6b-4132-963a-5438f0c57b68 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/quotas/6342064e2f4e4d17a45b74d8725885ef HTTP/1.1" status: 200 len: 375 time: 0.0088644 Nov 09 05:00:35.120820 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-7b8165de-e799-49e4-98cb-f881d996bb5d req-16c56963-03b5-42ef-a4c6-852db2cdb781 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/ports?tenant_id=6342064e2f4e4d17a45b74d8725885ef&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0588055 Nov 09 05:00:35.213646 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-7b8165de-e799-49e4-98cb-f881d996bb5d req-660e9519-8708-417e-be10-76a6c4665b90 service neutron] 10.222.0.24 "GET /v2.0/networks/00c105ea-e093-47a8-a669-bbdd36caea7e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0809183 Nov 09 05:00:35.306794 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-7b8165de-e799-49e4-98cb-f881d996bb5d req-048d7c66-e0af-4015-8953-dfd8927f8114 service neutron] 10.222.0.24 "GET /v2.0/networks/00c105ea-e093-47a8-a669-bbdd36caea7e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0870514 Nov 09 05:00:35.712482 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-02cbf453-8d63-4235-9917-b17895a2edf9 req-296f1a1f-cde8-4cd1-8011-564f68611da4 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/ports?device_id=2e2a9f7f-1211-4850-9f58-b0faa9b49d89 HTTP/1.1" status: 200 len: 210 time: 0.0265336 Nov 09 05:00:36.788164 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f97f5930-f632-4d6a-93da-c279488eaa7c req-d735d7ab-a602-4d36-a254-364eca8cf843 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/ports?device_id=2e2a9f7f-1211-4850-9f58-b0faa9b49d89 HTTP/1.1" status: 200 len: 210 time: 0.0257790 Nov 09 05:00:37.884035 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e8fc647d-1145-4165-8b6b-c25645e6e15c req-f2443356-dfeb-4e00-a2f3-27f56d7a7096 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/ports?device_id=2e2a9f7f-1211-4850-9f58-b0faa9b49d89 HTTP/1.1" status: 200 len: 210 time: 0.0294116 Nov 09 05:00:38.590375 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b8165de-e799-49e4-98cb-f881d996bb5d req-47eba16f-4904-407a-9549-73a7bdb09e25 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:00:38.591832 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7b8165de-e799-49e4-98cb-f881d996bb5d req-47eba16f-4904-407a-9549-73a7bdb09e25 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.26 "GET /v2.0/networks?id=00c105ea-e093-47a8-a669-bbdd36caea7e HTTP/1.1" status: 200 len: 815 time: 0.1015921 Nov 09 05:00:38.606053 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-7b8165de-e799-49e4-98cb-f881d996bb5d req-ad82539d-3a95-4cbb-829d-3c1590a3d116 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Request body: {'port': {'device_id': '2e2a9f7f-1211-4850-9f58-b0faa9b49d89', 'network_id': '00c105ea-e093-47a8-a669-bbdd36caea7e', 'admin_state_up': True, 'tenant_id': '6342064e2f4e4d17a45b74d8725885ef'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:00:38.847263 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-7b8165de-e799-49e4-98cb-f881d996bb5d req-ad82539d-3a95-4cbb-829d-3c1590a3d116 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Made reservation on behalf of 6342064e2f4e4d17a45b74d8725885ef for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 05:00:38.850819 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-7b8165de-e799-49e4-98cb-f881d996bb5d req-ad82539d-3a95-4cbb-829d-3c1590a3d116 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:38.975057 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [req-7b8165de-e799-49e4-98cb-f881d996bb5d req-ad82539d-3a95-4cbb-829d-3c1590a3d116 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Allocated IP 172.20.0.12 (00c105ea-e093-47a8-a669-bbdd36caea7e/15c42388-61b6-40bb-be5b-e0929ebd3465/4e404c06-7b40-4d6d-9833-b4408206f4fb) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 05:00:38.979891 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-6e1e3edc-5e32-4cf4-9c1e-b4aa3e7dd6fb req-8bab4711-6875-42db-b0d3-1e7ccab071a0 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/ports?device_id=2e2a9f7f-1211-4850-9f58-b0faa9b49d89 HTTP/1.1" status: 200 len: 210 time: 0.0282226 Nov 09 05:00:39.122643 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-7b8165de-e799-49e4-98cb-f881d996bb5d req-ad82539d-3a95-4cbb-829d-3c1590a3d116 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:39.269012 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-7b8165de-e799-49e4-98cb-f881d996bb5d req-ad82539d-3a95-4cbb-829d-3c1590a3d116 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:39.309138 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-7b8165de-e799-49e4-98cb-f881d996bb5d req-ad82539d-3a95-4cbb-829d-3c1590a3d116 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Network 00c105ea-e093-47a8-a669-bbdd36caea7e is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:00:39.312121 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [req-7b8165de-e799-49e4-98cb-f881d996bb5d req-ad82539d-3a95-4cbb-829d-3c1590a3d116 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:00:39.319190 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-7b8165de-e799-49e4-98cb-f881d996bb5d req-ad82539d-3a95-4cbb-829d-3c1590a3d116 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 05:00:39.350820 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad82539d-3a95-4cbb-829d-3c1590a3d116 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Pushing event updated for resources: {'Port': ['ID=4e404c06-7b40-4d6d-9833-b4408206f4fb,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:00:39.377384 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b8165de-e799-49e4-98cb-f881d996bb5d req-ad82539d-3a95-4cbb-829d-3c1590a3d116 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:00:39.378035 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-7b8165de-e799-49e4-98cb-f881d996bb5d req-ad82539d-3a95-4cbb-829d-3c1590a3d116 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:39.519377 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7b8165de-e799-49e4-98cb-f881d996bb5d req-ad82539d-3a95-4cbb-829d-3c1590a3d116 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.26 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.9148941 Nov 09 05:00:39.556010 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-ad1070ab-e4bf-4034-87a3-b6f38de8618e None None] Provisioning complete for port 4e404c06-7b40-4d6d-9833-b4408206f4fb triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:00:39.557044 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ad1070ab-e4bf-4034-87a3-b6f38de8618e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:39.596450 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-ad1070ab-e4bf-4034-87a3-b6f38de8618e None None] Port 4e404c06-7b40-4d6d-9833-b4408206f4fb cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 05:00:40.105155 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8c506b9-236e-42dc-8d1f-bfcf74ff67fe req-bb717bcf-8787-40c5-b798-d101fef45467 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:00:40.107156 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a8c506b9-236e-42dc-8d1f-bfcf74ff67fe req-bb717bcf-8787-40c5-b798-d101fef45467 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/ports?device_id=2e2a9f7f-1211-4850-9f58-b0faa9b49d89 HTTP/1.1" status: 200 len: 932 time: 0.0519538 Nov 09 05:00:40.154951 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a8c506b9-236e-42dc-8d1f-bfcf74ff67fe req-38f7b6f7-3b59-4919-ac86-47ab94702e84 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/security-groups?id=cd821237-9f21-4bf9-9e32-fce1986821ee&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411208 Nov 09 05:00:41.271881 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00f40bc5-fae4-4a8c-8157-835d50e443a3 req-8932e43d-4ddf-4975-aa33-adfcc5c6172e tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:00:41.274111 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-00f40bc5-fae4-4a8c-8157-835d50e443a3 req-8932e43d-4ddf-4975-aa33-adfcc5c6172e tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/ports?device_id=2e2a9f7f-1211-4850-9f58-b0faa9b49d89 HTTP/1.1" status: 200 len: 932 time: 0.0513141 Nov 09 05:00:41.325774 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-00f40bc5-fae4-4a8c-8157-835d50e443a3 req-4afe9cd6-d03d-4263-929b-817215a6d116 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/security-groups?id=cd821237-9f21-4bf9-9e32-fce1986821ee&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0456326 Nov 09 05:00:41.362242 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6fe99ab3-f518-4dc8-bb60-6eba9a73ed34 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:42.448519 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a08dcf9-c479-47e6-8917-e39ba2733fa4 req-80228cb5-ea6f-4139-82c5-ac1f7bb5a7e4 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:00:42.450067 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9a08dcf9-c479-47e6-8917-e39ba2733fa4 req-80228cb5-ea6f-4139-82c5-ac1f7bb5a7e4 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/ports?device_id=2e2a9f7f-1211-4850-9f58-b0faa9b49d89 HTTP/1.1" status: 200 len: 932 time: 0.0499260 Nov 09 05:00:42.470288 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:42.499684 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9a08dcf9-c479-47e6-8917-e39ba2733fa4 req-51b08b3e-8611-415d-8461-76052581e280 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/security-groups?id=cd821237-9f21-4bf9-9e32-fce1986821ee&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433657 Nov 09 05:00:43.630106 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13f86755-a0fb-409a-8444-792a1a541e19 req-a30aa692-84e0-4667-8c73-41abf6f48c7e tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:00:43.631650 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-13f86755-a0fb-409a-8444-792a1a541e19 req-a30aa692-84e0-4667-8c73-41abf6f48c7e tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/ports?device_id=2e2a9f7f-1211-4850-9f58-b0faa9b49d89 HTTP/1.1" status: 200 len: 932 time: 0.0554135 Nov 09 05:00:43.684026 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-13f86755-a0fb-409a-8444-792a1a541e19 req-2adbb930-d9a6-479e-a77b-2d7a0afb1b07 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/security-groups?id=cd821237-9f21-4bf9-9e32-fce1986821ee&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0448911 Nov 09 05:00:43.865489 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-aaf63cb5-a6ba-4d40-ad2d-4917446ca287 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:44.820147 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-424a620d-7448-4c49-8b91-84736cc45b97 req-e224256b-975a-4f04-af98-9122e2be3da3 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:00:44.821833 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-424a620d-7448-4c49-8b91-84736cc45b97 req-e224256b-975a-4f04-af98-9122e2be3da3 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/ports?device_id=2e2a9f7f-1211-4850-9f58-b0faa9b49d89 HTTP/1.1" status: 200 len: 932 time: 0.0516381 Nov 09 05:00:44.870565 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-424a620d-7448-4c49-8b91-84736cc45b97 req-32a1a174-7f8d-4c41-a309-7b0e7d7ae1ee tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/security-groups?id=cd821237-9f21-4bf9-9e32-fce1986821ee&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425324 Nov 09 05:00:45.215772 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:45.988430 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-136c4d50-7918-4baf-bede-999987e22642 req-2d1758a1-5124-41e0-84cc-dbc4b40f661d tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:00:45.989904 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-136c4d50-7918-4baf-bede-999987e22642 req-2d1758a1-5124-41e0-84cc-dbc4b40f661d tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/ports?device_id=2e2a9f7f-1211-4850-9f58-b0faa9b49d89 HTTP/1.1" status: 200 len: 932 time: 0.0491059 Nov 09 05:00:46.039006 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-136c4d50-7918-4baf-bede-999987e22642 req-7520e125-cb46-4c85-9804-c45bf185ae2f tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/security-groups?id=cd821237-9f21-4bf9-9e32-fce1986821ee&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429482 Nov 09 05:00:46.669197 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:47.027713 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:47.166400 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f73a9d3e-e327-473e-8b38-66daf22ef44f req-d4dc32fd-4aba-42f8-80ea-2010fcee6730 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:00:47.168022 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f73a9d3e-e327-473e-8b38-66daf22ef44f req-d4dc32fd-4aba-42f8-80ea-2010fcee6730 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/ports?device_id=2e2a9f7f-1211-4850-9f58-b0faa9b49d89 HTTP/1.1" status: 200 len: 932 time: 0.0631580 Nov 09 05:00:47.215548 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f73a9d3e-e327-473e-8b38-66daf22ef44f req-7c589bf3-327b-4323-9253-a7ed522e016e tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/security-groups?id=cd821237-9f21-4bf9-9e32-fce1986821ee&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413184 Nov 09 05:00:48.337842 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-464858dc-f3c5-4ce1-b2ef-2cd36ee0aa31 req-bccd03a2-8b24-42a7-b260-5aa6c6d83dbd tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:00:48.339499 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-464858dc-f3c5-4ce1-b2ef-2cd36ee0aa31 req-bccd03a2-8b24-42a7-b260-5aa6c6d83dbd tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/ports?device_id=2e2a9f7f-1211-4850-9f58-b0faa9b49d89 HTTP/1.1" status: 200 len: 932 time: 0.0554988 Nov 09 05:00:48.388638 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-464858dc-f3c5-4ce1-b2ef-2cd36ee0aa31 req-7d84ecdc-1bb9-452e-983f-c2db18cf1a51 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/security-groups?id=cd821237-9f21-4bf9-9e32-fce1986821ee&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433395 Nov 09 05:00:49.508963 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6661884a-5d0a-4b8d-8c9c-25a9cbbb3b76 req-678f6cac-3b3a-45cb-be32-f8325579bf85 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:00:49.510425 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6661884a-5d0a-4b8d-8c9c-25a9cbbb3b76 req-678f6cac-3b3a-45cb-be32-f8325579bf85 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/ports?device_id=2e2a9f7f-1211-4850-9f58-b0faa9b49d89 HTTP/1.1" status: 200 len: 932 time: 0.0508153 Nov 09 05:00:49.562713 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6661884a-5d0a-4b8d-8c9c-25a9cbbb3b76 req-fcdb1617-e0ac-4448-9535-07d1d143dcd3 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/security-groups?id=cd821237-9f21-4bf9-9e32-fce1986821ee&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0462909 Nov 09 05:00:50.686629 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e8b849e-60e1-4261-afaf-1c115ee6fdf2 req-a91aac9f-0089-46ae-be88-494068fb5e42 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:00:50.688021 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-9e8b849e-60e1-4261-afaf-1c115ee6fdf2 req-a91aac9f-0089-46ae-be88-494068fb5e42 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/ports?device_id=2e2a9f7f-1211-4850-9f58-b0faa9b49d89 HTTP/1.1" status: 200 len: 932 time: 0.0491872 Nov 09 05:00:50.733983 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-9e8b849e-60e1-4261-afaf-1c115ee6fdf2 req-69383d80-485e-4f22-a2e7-bc4e65198e4b tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/security-groups?id=cd821237-9f21-4bf9-9e32-fce1986821ee&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391402 Nov 09 05:00:51.032748 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-7b8165de-e799-49e4-98cb-f881d996bb5d req-2638d750-1645-427c-bcaf-e4a48bc8c703 service neutron] Request body: {'port': {'device_id': '2e2a9f7f-1211-4850-9f58-b0faa9b49d89', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:00:51.084227 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-7b8165de-e799-49e4-98cb-f881d996bb5d req-2638d750-1645-427c-bcaf-e4a48bc8c703 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:51.586981 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [req-7b8165de-e799-49e4-98cb-f881d996bb5d req-2638d750-1645-427c-bcaf-e4a48bc8c703 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4e404c06-7b40-4d6d-9833-b4408206f4fb {{(pid=102162) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 05:00:51.594137 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-7b8165de-e799-49e4-98cb-f881d996bb5d req-2638d750-1645-427c-bcaf-e4a48bc8c703 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:51.605888 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.provisioning_blocks [req-7b8165de-e799-49e4-98cb-f881d996bb5d req-2638d750-1645-427c-bcaf-e4a48bc8c703 service neutron] Transition to ACTIVE for port object 4e404c06-7b40-4d6d-9833-b4408206f4fb will not be triggered until provisioned by entity L2. {{(pid=102162) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 09 05:00:51.674178 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-7b8165de-e799-49e4-98cb-f881d996bb5d req-2638d750-1645-427c-bcaf-e4a48bc8c703 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:51.752269 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2638d750-1645-427c-bcaf-e4a48bc8c703 service neutron] Pushing event updated for resources: {'Port': ['ID=4e404c06-7b40-4d6d-9833-b4408206f4fb,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:00:51.794545 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-7b8165de-e799-49e4-98cb-f881d996bb5d req-2638d750-1645-427c-bcaf-e4a48bc8c703 service neutron] Attempting to bind port 4e404c06-7b40-4d6d-9833-b4408206f4fb on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 05:00:51.794874 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-7b8165de-e799-49e4-98cb-f881d996bb5d req-2638d750-1645-427c-bcaf-e4a48bc8c703 service neutron] Attempting to bind port 4e404c06-7b40-4d6d-9833-b4408206f4fb by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '794d91f6-937c-4e26-8ecc-34550b214f4a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 311, 'network_id': '00c105ea-e093-47a8-a669-bbdd36caea7e'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 05:00:51.795194 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7b8165de-e799-49e4-98cb-f881d996bb5d req-2638d750-1645-427c-bcaf-e4a48bc8c703 service neutron] Attempting to bind port 4e404c06-7b40-4d6d-9833-b4408206f4fb on network 00c105ea-e093-47a8-a669-bbdd36caea7e {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 05:00:51.799488 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7b8165de-e799-49e4-98cb-f881d996bb5d req-2638d750-1645-427c-bcaf-e4a48bc8c703 service neutron] Port 4e404c06-7b40-4d6d-9833-b4408206f4fb on network 00c105ea-e093-47a8-a669-bbdd36caea7e not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 05:00:51.799800 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7b8165de-e799-49e4-98cb-f881d996bb5d req-2638d750-1645-427c-bcaf-e4a48bc8c703 service neutron] Attempting to bind port 4e404c06-7b40-4d6d-9833-b4408206f4fb on network 00c105ea-e093-47a8-a669-bbdd36caea7e {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 05:00:51.814590 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7b8165de-e799-49e4-98cb-f881d996bb5d req-2638d750-1645-427c-bcaf-e4a48bc8c703 service neutron] Checking agent: {'id': '7d36b884-4ad2-4878-9464-bf647030b544', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'started_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 5, 0, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 05:00:51.815037 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7b8165de-e799-49e4-98cb-f881d996bb5d req-2638d750-1645-427c-bcaf-e4a48bc8c703 service neutron] Checking segment: {'id': '794d91f6-937c-4e26-8ecc-34550b214f4a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 311, 'network_id': '00c105ea-e093-47a8-a669-bbdd36caea7e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 05:00:51.815420 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7b8165de-e799-49e4-98cb-f881d996bb5d req-2638d750-1645-427c-bcaf-e4a48bc8c703 service neutron] Bound using segment: {'id': '794d91f6-937c-4e26-8ecc-34550b214f4a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 311, 'network_id': '00c105ea-e093-47a8-a669-bbdd36caea7e'} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 05:00:51.815861 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-7b8165de-e799-49e4-98cb-f881d996bb5d req-2638d750-1645-427c-bcaf-e4a48bc8c703 service neutron] Bound port: 4e404c06-7b40-4d6d-9833-b4408206f4fb, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '794d91f6-937c-4e26-8ecc-34550b214f4a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 311, 'network_id': '00c105ea-e093-47a8-a669-bbdd36caea7e'}}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 05:00:51.816210 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-7b8165de-e799-49e4-98cb-f881d996bb5d req-2638d750-1645-427c-bcaf-e4a48bc8c703 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:51.892936 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-759bf6dc-925c-4c89-8bff-7865b9c87472 req-382bf5bb-7630-4fac-9829-54341918f193 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:00:51.894648 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-759bf6dc-925c-4c89-8bff-7865b9c87472 req-382bf5bb-7630-4fac-9829-54341918f193 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/ports?device_id=2e2a9f7f-1211-4850-9f58-b0faa9b49d89 HTTP/1.1" status: 200 len: 944 time: 0.0918641 Nov 09 05:00:51.930715 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-7b8165de-e799-49e4-98cb-f881d996bb5d req-2638d750-1645-427c-bcaf-e4a48bc8c703 service neutron] For port 4e404c06-7b40-4d6d-9833-b4408206f4fb, host hv-neutron-8168, cleared binding levels {{(pid=102162) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 05:00:51.949683 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-7b8165de-e799-49e4-98cb-f881d996bb5d req-2638d750-1645-427c-bcaf-e4a48bc8c703 service neutron] For port 4e404c06-7b40-4d6d-9833-b4408206f4fb, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=4e404c06-7b40-4d6d-9833-b4408206f4fb,segment=NetworkSegment(794d91f6-937c-4e26-8ecc-34550b214f4a),segment_id=794d91f6-937c-4e26-8ecc-34550b214f4a)] {{(pid=102162) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 05:00:51.966175 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-759bf6dc-925c-4c89-8bff-7865b9c87472 req-abef2975-0f37-4c40-b66a-c1a577040816 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/security-groups?id=cd821237-9f21-4bf9-9e32-fce1986821ee&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0641143 Nov 09 05:00:52.029332 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-7b8165de-e799-49e4-98cb-f881d996bb5d req-2638d750-1645-427c-bcaf-e4a48bc8c703 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:52.060796 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b8165de-e799-49e4-98cb-f881d996bb5d req-2638d750-1645-427c-bcaf-e4a48bc8c703 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:00:52.061391 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-7b8165de-e799-49e4-98cb-f881d996bb5d req-2638d750-1645-427c-bcaf-e4a48bc8c703 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:52.063073 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7b8165de-e799-49e4-98cb-f881d996bb5d req-2638d750-1645-427c-bcaf-e4a48bc8c703 service neutron] 10.222.0.26 "PUT /v2.0/ports/4e404c06-7b40-4d6d-9833-b4408206f4fb HTTP/1.1" status: 200 len: 1094 time: 1.0344229 Nov 09 05:00:52.065024 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2e2a9f7f-1211-4850-9f58-b0faa9b49d89', 'tag': '4e404c06-7b40-4d6d-9833-b4408206f4fb'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:00:52.068900 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5c7f548e-f671-4d93-8d82-374f762ba51f" -d '{"events": [{"name": "network-changed", "server_uuid": "2e2a9f7f-1211-4850-9f58-b0faa9b49d89", "tag": "4e404c06-7b40-4d6d-9833-b4408206f4fb"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:00:52.095506 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2638d750-1645-427c-bcaf-e4a48bc8c703 service neutron] Pushing event updated for resources: {'Port': ['ID=4e404c06-7b40-4d6d-9833-b4408206f4fb,revision_number=3']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:00:52.113086 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 05:00:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e752e396-042c-4f22-aaa2-97afcba0c8aa x-openstack-request-id: req-e752e396-042c-4f22-aaa2-97afcba0c8aa {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:00:52.119690 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2e2a9f7f-1211-4850-9f58-b0faa9b49d89", "tag": "4e404c06-7b40-4d6d-9833-b4408206f4fb", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:00:52.119690 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-e752e396-042c-4f22-aaa2-97afcba0c8aa {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:00:52.119690 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2e2a9f7f-1211-4850-9f58-b0faa9b49d89', 'tag': '4e404c06-7b40-4d6d-9833-b4408206f4fb', 'status': 'completed', 'code': 200} Nov 09 05:00:52.179192 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c7f548e-f671-4d93-8d82-374f762ba51f req-682a5c3d-e50e-44b3-9040-be8a94a4f72a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:00:52.180675 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5c7f548e-f671-4d93-8d82-374f762ba51f req-682a5c3d-e50e-44b3-9040-be8a94a4f72a service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=6342064e2f4e4d17a45b74d8725885ef&device_id=2e2a9f7f-1211-4850-9f58-b0faa9b49d89 HTTP/1.1" status: 200 len: 1097 time: 0.0465322 Nov 09 05:00:52.280755 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c7f548e-f671-4d93-8d82-374f762ba51f req-d3b139dc-79d5-4c53-b59b-6a428386a122 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:00:52.282216 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5c7f548e-f671-4d93-8d82-374f762ba51f req-d3b139dc-79d5-4c53-b59b-6a428386a122 service neutron] 10.222.0.26 "GET /v2.0/networks?tenant_id=6342064e2f4e4d17a45b74d8725885ef&shared=False HTTP/1.1" status: 200 len: 916 time: 0.0934560 Nov 09 05:00:52.378282 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c7f548e-f671-4d93-8d82-374f762ba51f req-689ccb67-1392-430c-b39e-6c5d869c3c76 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:00:52.379715 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5c7f548e-f671-4d93-8d82-374f762ba51f req-689ccb67-1392-430c-b39e-6c5d869c3c76 service neutron] 10.222.0.26 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0908999 Nov 09 05:00:52.456290 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b8165de-e799-49e4-98cb-f881d996bb5d req-1c0edeab-d2dc-43a4-9e37-6dcefb878b00 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:00:52.457740 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7b8165de-e799-49e4-98cb-f881d996bb5d req-1c0edeab-d2dc-43a4-9e37-6dcefb878b00 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=6342064e2f4e4d17a45b74d8725885ef&device_id=2e2a9f7f-1211-4850-9f58-b0faa9b49d89 HTTP/1.1" status: 200 len: 1097 time: 0.0400889 Nov 09 05:00:52.502330 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7b8165de-e799-49e4-98cb-f881d996bb5d req-178e119b-040a-4d27-9a7a-6f72c133fc28 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=4e404c06-7b40-4d6d-9833-b4408206f4fb HTTP/1.1" status: 200 len: 217 time: 0.0361392 Nov 09 05:00:52.549356 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b8165de-e799-49e4-98cb-f881d996bb5d req-6cfa5602-4169-44be-b97c-8be76f625eb1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:00:52.550767 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7b8165de-e799-49e4-98cb-f881d996bb5d req-6cfa5602-4169-44be-b97c-8be76f625eb1 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=15c42388-61b6-40bb-be5b-e0929ebd3465 HTTP/1.1" status: 200 len: 854 time: 0.0417910 Nov 09 05:00:52.594293 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b8165de-e799-49e4-98cb-f881d996bb5d req-9c28c418-f017-4e9a-9d20-549c2d7da70d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:00:52.595776 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7b8165de-e799-49e4-98cb-f881d996bb5d req-9c28c418-f017-4e9a-9d20-549c2d7da70d service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=00c105ea-e093-47a8-a669-bbdd36caea7e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0382347 Nov 09 05:00:52.687812 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7b8165de-e799-49e4-98cb-f881d996bb5d req-0597c1ac-787b-496e-9b19-31eda739bf08 service neutron] 10.222.0.26 "GET /v2.0/networks/00c105ea-e093-47a8-a669-bbdd36caea7e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0848026 Nov 09 05:00:52.774049 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7b8165de-e799-49e4-98cb-f881d996bb5d req-f5efc556-0650-48c0-b802-619717bd45cf service neutron] 10.222.0.26 "GET /v2.0/networks/00c105ea-e093-47a8-a669-bbdd36caea7e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0791910 Nov 09 05:00:53.077312 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fce21f4f-d353-4470-822b-e0cb4c12a1ff req-d54d0e02-3a0b-4ea1-b773-a5891696befe tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:00:53.078775 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fce21f4f-d353-4470-822b-e0cb4c12a1ff req-d54d0e02-3a0b-4ea1-b773-a5891696befe tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/ports?device_id=2e2a9f7f-1211-4850-9f58-b0faa9b49d89 HTTP/1.1" status: 200 len: 944 time: 0.0478013 Nov 09 05:00:53.128545 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fce21f4f-d353-4470-822b-e0cb4c12a1ff req-f3488c40-be7a-4172-bb41-7a890b5b3ca7 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/security-groups?id=cd821237-9f21-4bf9-9e32-fce1986821ee&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433657 Nov 09 05:00:54.241223 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6091e66-ca91-497e-890d-2a76077efc32 req-02116e6e-b644-42f1-8e99-72ba6d19d223 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:00:54.242698 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c6091e66-ca91-497e-890d-2a76077efc32 req-02116e6e-b644-42f1-8e99-72ba6d19d223 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/ports?device_id=2e2a9f7f-1211-4850-9f58-b0faa9b49d89 HTTP/1.1" status: 200 len: 944 time: 0.0480878 Nov 09 05:00:54.291393 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c6091e66-ca91-497e-890d-2a76077efc32 req-62b5f957-0f06-4e2b-b2ca-808c7691a520 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/security-groups?id=cd821237-9f21-4bf9-9e32-fce1986821ee&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429332 Nov 09 05:00:55.402828 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc11f5a5-dfd2-4e28-833f-ef3d38feff64 req-36e7b098-f2a7-452c-a799-8f9b228ced8d tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:00:55.404274 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fc11f5a5-dfd2-4e28-833f-ef3d38feff64 req-36e7b098-f2a7-452c-a799-8f9b228ced8d tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/ports?device_id=2e2a9f7f-1211-4850-9f58-b0faa9b49d89 HTTP/1.1" status: 200 len: 944 time: 0.0476646 Nov 09 05:00:55.450037 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fc11f5a5-dfd2-4e28-833f-ef3d38feff64 req-b6517fda-d79d-452e-a9e3-119f3cd77be4 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/security-groups?id=cd821237-9f21-4bf9-9e32-fce1986821ee&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399997 Nov 09 05:00:55.735766 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 4e404c06-7b40-4d6d-9833-b4408206f4fb details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=102163) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 09 05:00:55.825778 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 4e404c06-7b40-4d6d-9833-b4408206f4fb, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=4e404c06-7b40-4d6d-9833-b4408206f4fb,segment=NetworkSegment(794d91f6-937c-4e26-8ecc-34550b214f4a),segment_id=794d91f6-937c-4e26-8ecc-34550b214f4a)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:00:55.837209 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Returning: {'device': '4e404c06-7b40-4d6d-9833-b4408206f4fb', 'network_id': '00c105ea-e093-47a8-a669-bbdd36caea7e', 'port_id': '4e404c06-7b40-4d6d-9833-b4408206f4fb', 'mac_address': 'fa:16:3e:74:4c:c3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 311, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '15c42388-61b6-40bb-be5b-e0929ebd3465', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102163) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 09 05:00:55.875430 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:55.888828 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4e404c06-7b40-4d6d-9833-b4408206f4fb {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 05:00:55.907838 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 4e404c06-7b40-4d6d-9833-b4408206f4fb, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=4e404c06-7b40-4d6d-9833-b4408206f4fb,segment=NetworkSegment(794d91f6-937c-4e26-8ecc-34550b214f4a),segment_id=794d91f6-937c-4e26-8ecc-34550b214f4a)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:00:55.974919 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:56.020410 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=4e404c06-7b40-4d6d-9833-b4408206f4fb,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:00:56.189986 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['4e404c06-7b40-4d6d-9833-b4408206f4fb'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 05:00:56.560351 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95570ebd-f622-4b74-bbe5-08a3afcc23ff req-d7ad1216-8830-48f9-8a32-256b7a384780 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:00:56.565088 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-95570ebd-f622-4b74-bbe5-08a3afcc23ff req-d7ad1216-8830-48f9-8a32-256b7a384780 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/ports?device_id=2e2a9f7f-1211-4850-9f58-b0faa9b49d89 HTTP/1.1" status: 200 len: 945 time: 0.0478785 Nov 09 05:00:56.607788 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-95570ebd-f622-4b74-bbe5-08a3afcc23ff req-dcb820cc-1023-4ff4-93f4-2eb23b8f3cc5 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/security-groups?id=cd821237-9f21-4bf9-9e32-fce1986821ee&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398505 Nov 09 05:00:57.722446 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53303027-a8ff-4c56-a2d7-5031b797a25b req-1818fcc7-8f6e-4c56-a65b-8a478833ed81 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:00:57.723934 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-53303027-a8ff-4c56-a2d7-5031b797a25b req-1818fcc7-8f6e-4c56-a65b-8a478833ed81 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/ports?device_id=2e2a9f7f-1211-4850-9f58-b0faa9b49d89 HTTP/1.1" status: 200 len: 945 time: 0.0499685 Nov 09 05:00:57.757144 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 4e404c06-7b40-4d6d-9833-b4408206f4fb up at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:00:57.773294 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-53303027-a8ff-4c56-a2d7-5031b797a25b req-26635d2c-3d1f-4aa2-a6c5-942b8f5599bb tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/security-groups?id=cd821237-9f21-4bf9-9e32-fce1986821ee&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424776 Nov 09 05:00:57.880008 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning for port 4e404c06-7b40-4d6d-9833-b4408206f4fb completed by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 09 05:00:57.884686 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning complete for port 4e404c06-7b40-4d6d-9833-b4408206f4fb triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:00:57.885053 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:57.967848 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:57.989510 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2e2a9f7f-1211-4850-9f58-b0faa9b49d89', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4e404c06-7b40-4d6d-9833-b4408206f4fb'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:00:57.991787 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b0bd784a-c737-47f0-8fe4-96eace816aa0" -d '{"events": [{"server_uuid": "2e2a9f7f-1211-4850-9f58-b0faa9b49d89", "name": "network-vif-plugged", "status": "completed", "tag": "4e404c06-7b40-4d6d-9833-b4408206f4fb"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:00:58.005547 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 4e404c06-7b40-4d6d-9833-b4408206f4fb, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=4e404c06-7b40-4d6d-9833-b4408206f4fb,segment=NetworkSegment(794d91f6-937c-4e26-8ecc-34550b214f4a),segment_id=794d91f6-937c-4e26-8ecc-34550b214f4a)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:00:58.034044 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 05:00:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1a0c8ed2-97c2-47c3-9fe8-329f4919cbec x-openstack-request-id: req-1a0c8ed2-97c2-47c3-9fe8-329f4919cbec {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:00:58.034044 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2e2a9f7f-1211-4850-9f58-b0faa9b49d89", "name": "network-vif-plugged", "status": "completed", "tag": "4e404c06-7b40-4d6d-9833-b4408206f4fb", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:00:58.034044 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-1a0c8ed2-97c2-47c3-9fe8-329f4919cbec {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:00:58.034044 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2e2a9f7f-1211-4850-9f58-b0faa9b49d89', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4e404c06-7b40-4d6d-9833-b4408206f4fb', 'code': 200} Nov 09 05:00:58.080222 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:00:58.127070 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=4e404c06-7b40-4d6d-9833-b4408206f4fb,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:00:58.399847 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a983ce29-f4eb-4a67-b376-bb46057ba874 req-95147448-e7e4-4765-925f-5b125017bf85 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:00:58.401226 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a983ce29-f4eb-4a67-b376-bb46057ba874 req-95147448-e7e4-4765-925f-5b125017bf85 service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=2e2a9f7f-1211-4850-9f58-b0faa9b49d89 HTTP/1.1" status: 200 len: 1099 time: 0.0425889 Nov 09 05:00:58.443737 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a983ce29-f4eb-4a67-b376-bb46057ba874 req-18c46eb7-9115-41a2-ab3d-f69ae7bd4cae service neutron] 10.222.0.26 "GET /v2.0/security-groups?id=cd821237-9f21-4bf9-9e32-fce1986821ee&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0357826 Nov 09 05:00:58.454741 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 05:00:58.887992 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32e5cada-ab48-481f-a3ca-01a3309b2e97 req-13f25dcd-bca8-4963-8083-c3e30eade1ce tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:00:58.889470 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-32e5cada-ab48-481f-a3ca-01a3309b2e97 req-13f25dcd-bca8-4963-8083-c3e30eade1ce tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/ports?device_id=2e2a9f7f-1211-4850-9f58-b0faa9b49d89 HTTP/1.1" status: 200 len: 946 time: 0.0489111 Nov 09 05:00:58.935219 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-32e5cada-ab48-481f-a3ca-01a3309b2e97 req-41f6bf14-40f4-4161-b799-f6d0937c9851 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/security-groups?id=cd821237-9f21-4bf9-9e32-fce1986821ee&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398257 Nov 09 05:01:00.051828 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cf533da-0db2-47ae-b7f9-c7a3a764bd60 req-821e0b1a-010a-4a3f-bd26-fdb1aecd1720 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:01:00.053333 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-1cf533da-0db2-47ae-b7f9-c7a3a764bd60 req-821e0b1a-010a-4a3f-bd26-fdb1aecd1720 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/ports?device_id=2e2a9f7f-1211-4850-9f58-b0faa9b49d89 HTTP/1.1" status: 200 len: 946 time: 0.0504527 Nov 09 05:01:00.099464 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-1cf533da-0db2-47ae-b7f9-c7a3a764bd60 req-04d297f1-c8f3-4f12-b768-26f0c98d9bdd tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/security-groups?id=cd821237-9f21-4bf9-9e32-fce1986821ee&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396855 Nov 09 05:01:00.213626 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90c96af4-c1da-4ac6-a3d5-b252b4561138 req-c2aa43ce-5022-4285-9107-a25a9245565a tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:01:00.215074 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-90c96af4-c1da-4ac6-a3d5-b252b4561138 req-c2aa43ce-5022-4285-9107-a25a9245565a tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/ports?device_id=2e2a9f7f-1211-4850-9f58-b0faa9b49d89 HTTP/1.1" status: 200 len: 946 time: 0.0523474 Nov 09 05:01:00.261052 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-90c96af4-c1da-4ac6-a3d5-b252b4561138 req-682ff4c0-210e-46ed-93f2-ff50b77c70f8 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/security-groups?id=cd821237-9f21-4bf9-9e32-fce1986821ee&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401137 Nov 09 05:01:00.568874 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c1f866a-b580-4d19-9b47-dab1687db7c3 req-329e2451-472b-4419-9848-cb72ec08ab46 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:01:00.570325 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-0c1f866a-b580-4d19-9b47-dab1687db7c3 req-329e2451-472b-4419-9848-cb72ec08ab46 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/ports?device_id=2e2a9f7f-1211-4850-9f58-b0faa9b49d89 HTTP/1.1" status: 200 len: 946 time: 0.0476446 Nov 09 05:01:00.616070 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-0c1f866a-b580-4d19-9b47-dab1687db7c3 req-94a769c0-e213-455d-b1c4-15b6cf378fd6 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/security-groups?id=cd821237-9f21-4bf9-9e32-fce1986821ee&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399911 Nov 09 05:01:11.399551 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f4a1e336-86b0-4f12-a0ea-c99bfd4bc82f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:01:12.410794 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:01:13.763278 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-fd25ff30-d724-47dc-ba2c-3fd72094dd48 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:01:15.227838 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:01:16.673564 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:01:17.060331 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:01:17.795925 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d7be458-c7ef-45ed-8e5b-7e0c82eedabf req-341e2a4b-e972-4983-ba1b-d7abc6ae107b tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:01:17.799874 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8d7be458-c7ef-45ed-8e5b-7e0c82eedabf req-341e2a4b-e972-4983-ba1b-d7abc6ae107b tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/ports?device_id=2e2a9f7f-1211-4850-9f58-b0faa9b49d89 HTTP/1.1" status: 200 len: 946 time: 0.0468378 Nov 09 05:01:17.847930 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8d7be458-c7ef-45ed-8e5b-7e0c82eedabf req-d16c0606-1235-4f96-888c-ca6e617b4d16 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/security-groups?id=cd821237-9f21-4bf9-9e32-fce1986821ee&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0445139 Nov 09 05:01:17.870230 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 36402) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:01:17.999024 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fa7fe354-4c02-4410-931c-237821193bb2 tempest-TestMinimumBasicScenario-292859112 tempest-TestMinimumBasicScenario-292859112-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:01:18.000538 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-fa7fe354-4c02-4410-931c-237821193bb2 tempest-TestMinimumBasicScenario-292859112 tempest-TestMinimumBasicScenario-292859112-project-admin] 10.222.0.24 "GET /v2.0/ports?device_id=2e2a9f7f-1211-4850-9f58-b0faa9b49d89 HTTP/1.1" status: 200 len: 1094 time: 0.1286657 Nov 09 05:01:18.003480 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 36406) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:01:18.007698 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-bd1fff11-383a-4170-a486-777e1f8a790f tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Request body: {'floatingip': {'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'port_id': '4e404c06-7b40-4d6d-9833-b4408206f4fb', 'tenant_id': '6342064e2f4e4d17a45b74d8725885ef', 'fixed_ip_address': '172.20.0.12'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:01:18.096603 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bd1fff11-383a-4170-a486-777e1f8a790f tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks [] for floatingip, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:01:18.191254 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bd1fff11-383a-4170-a486-777e1f8a790f tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:01:18.293824 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-bd1fff11-383a-4170-a486-777e1f8a790f tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Allocated IP 172.26.0.213 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/f83967d0-517d-4257-8c57-542b9e1391a9) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 05:01:18.401135 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bd1fff11-383a-4170-a486-777e1f8a790f tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:01:18.525000 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bd1fff11-383a-4170-a486-777e1f8a790f tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:01:18.562175 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bd1fff11-383a-4170-a486-777e1f8a790f tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:01:18.567266 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-bd1fff11-383a-4170-a486-777e1f8a790f tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:01:18.570849 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bd1fff11-383a-4170-a486-777e1f8a790f tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 05:01:18.576748 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd1fff11-383a-4170-a486-777e1f8a790f tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Pushing event updated for resources: {'Port': ['ID=f83967d0-517d-4257-8c57-542b9e1391a9,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:01:18.603872 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd1fff11-383a-4170-a486-777e1f8a790f tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:01:18.604222 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd1fff11-383a-4170-a486-777e1f8a790f tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:01:18.604569 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd1fff11-383a-4170-a486-777e1f8a790f tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:01:18.604907 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd1fff11-383a-4170-a486-777e1f8a790f tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:01:18.605241 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd1fff11-383a-4170-a486-777e1f8a790f tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:01:18.605572 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd1fff11-383a-4170-a486-777e1f8a790f tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:01:18.605899 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd1fff11-383a-4170-a486-777e1f8a790f tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:01:18.606226 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd1fff11-383a-4170-a486-777e1f8a790f tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:01:18.606579 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd1fff11-383a-4170-a486-777e1f8a790f tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:01:18.606905 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd1fff11-383a-4170-a486-777e1f8a790f tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:01:18.607228 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd1fff11-383a-4170-a486-777e1f8a790f tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:01:18.607554 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd1fff11-383a-4170-a486-777e1f8a790f tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:01:19.040162 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bd1fff11-383a-4170-a486-777e1f8a790f tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:01:19.177227 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bd1fff11-383a-4170-a486-777e1f8a790f tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:01:19.322728 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4e313b28-a6f4-4f54-9aa6-a810bed3aa51 req-1c5bcb00-4ba1-4285-8119-d09db280cf7f service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=2e2a9f7f-1211-4850-9f58-b0faa9b49d89&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0820451 Nov 09 05:01:19.352739 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bd1fff11-383a-4170-a486-777e1f8a790f tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:01:19.405765 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e313b28-a6f4-4f54-9aa6-a810bed3aa51 req-048b156c-01a1-49db-8552-a3f0e480ac6e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:01:19.407247 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4e313b28-a6f4-4f54-9aa6-a810bed3aa51 req-048b156c-01a1-49db-8552-a3f0e480ac6e service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=6342064e2f4e4d17a45b74d8725885ef&device_id=2e2a9f7f-1211-4850-9f58-b0faa9b49d89 HTTP/1.1" status: 200 len: 1099 time: 0.0421722 Nov 09 05:01:19.436886 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bd1fff11-383a-4170-a486-777e1f8a790f tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:01:19.561817 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd1fff11-383a-4170-a486-777e1f8a790f tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Pushing event updated for resources: {'Port': ['ID=f83967d0-517d-4257-8c57-542b9e1391a9,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:01:19.578930 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e313b28-a6f4-4f54-9aa6-a810bed3aa51 req-29c52762-4285-4364-839c-8560551b363f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:01:19.580388 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4e313b28-a6f4-4f54-9aa6-a810bed3aa51 req-29c52762-4285-4364-839c-8560551b363f service neutron] 10.222.0.26 "GET /v2.0/networks?id=00c105ea-e093-47a8-a669-bbdd36caea7e HTTP/1.1" status: 200 len: 916 time: 0.1526611 Nov 09 05:01:19.583169 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bd1fff11-383a-4170-a486-777e1f8a790f tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:01:19.716509 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4e313b28-a6f4-4f54-9aa6-a810bed3aa51 req-fb7a2068-225f-4649-9980-096f9be01817 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=4e404c06-7b40-4d6d-9833-b4408206f4fb HTTP/1.1" status: 200 len: 1000 time: 0.1015296 Nov 09 05:01:19.756844 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.l3_db [None req-bd1fff11-383a-4170-a486-777e1f8a790f tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Floating IP e799c9a8-ab2e-4a76-8e76-174e4157a93f associated. External IP: 172.26.0.213, port: 4e404c06-7b40-4d6d-9833-b4408206f4fb. Nov 09 05:01:19.811780 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e313b28-a6f4-4f54-9aa6-a810bed3aa51 req-f6e3cf37-a16c-4d3d-bc32-118b34e3d083 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:01:19.813208 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4e313b28-a6f4-4f54-9aa6-a810bed3aa51 req-f6e3cf37-a16c-4d3d-bc32-118b34e3d083 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=15c42388-61b6-40bb-be5b-e0929ebd3465 HTTP/1.1" status: 200 len: 854 time: 0.0881879 Nov 09 05:01:20.160743 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e313b28-a6f4-4f54-9aa6-a810bed3aa51 req-0f3fce16-50df-48a0-b0bd-c307de79d4a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:01:20.162204 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4e313b28-a6f4-4f54-9aa6-a810bed3aa51 req-0f3fce16-50df-48a0-b0bd-c307de79d4a5 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=00c105ea-e093-47a8-a669-bbdd36caea7e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.3196762 Nov 09 05:01:20.328073 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4e313b28-a6f4-4f54-9aa6-a810bed3aa51 req-6bcd9e65-6811-47e6-b2e5-c423270b46f0 service neutron] 10.222.0.26 "GET /v2.0/networks/00c105ea-e093-47a8-a669-bbdd36caea7e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1332285 Nov 09 05:01:20.331757 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bd1fff11-383a-4170-a486-777e1f8a790f tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Router 7e9d55e0-0100-4ebc-9667-a18ace6d8557 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 05:01:20.508128 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4e313b28-a6f4-4f54-9aa6-a810bed3aa51 req-e2e9c1fe-5153-4097-bf05-0f0aa38217cc service neutron] 10.222.0.26 "GET /v2.0/networks/00c105ea-e093-47a8-a669-bbdd36caea7e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1717765 Nov 09 05:01:20.515493 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bd1fff11-383a-4170-a486-777e1f8a790f tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 05:01:20.525053 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6998be59-f2af-4df2-897c-183a73decabd None None] Sync routers for ids ['7e9d55e0-0100-4ebc-9667-a18ace6d8557'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 05:01:20.534312 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6998be59-f2af-4df2-897c-183a73decabd None None] Routers {'7e9d55e0-0100-4ebc-9667-a18ace6d8557'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:01:20.538143 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-6998be59-f2af-4df2-897c-183a73decabd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:01:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['7e9d55e0-0100-4ebc-9667-a18ace6d8557'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:01:20.638651 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-6998be59-f2af-4df2-897c-183a73decabd None None] Set router 7e9d55e0-0100-4ebc-9667-a18ace6d8557 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:01:20.721130 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-bd1fff11-383a-4170-a486-777e1f8a790f tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:01:20.749014 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-bd1fff11-383a-4170-a486-777e1f8a790f tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 2.7443514 Nov 09 05:01:20.749610 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2e2a9f7f-1211-4850-9f58-b0faa9b49d89', 'tag': '4e404c06-7b40-4d6d-9833-b4408206f4fb'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:01:20.751790 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36408) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:01:20.752327 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2665f84e-a434-431d-8ada-672975b145a0" -d '{"events": [{"name": "network-changed", "server_uuid": "2e2a9f7f-1211-4850-9f58-b0faa9b49d89", "tag": "4e404c06-7b40-4d6d-9833-b4408206f4fb"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:01:20.763403 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-088886cb-5ca8-4c0f-ab35-d22bb2edfa9e tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1852030682', 'description': 'tempest-secgroup-smoke-1852030682 description', 'project_id': '6342064e2f4e4d17a45b74d8725885ef'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:01:20.800759 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 05:01:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-47fe8c33-cd12-432b-9b44-8d8eb90f4ec2 x-openstack-request-id: req-47fe8c33-cd12-432b-9b44-8d8eb90f4ec2 {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:01:20.800759 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2e2a9f7f-1211-4850-9f58-b0faa9b49d89", "tag": "4e404c06-7b40-4d6d-9833-b4408206f4fb", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:01:20.800759 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-47fe8c33-cd12-432b-9b44-8d8eb90f4ec2 {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:01:20.800759 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2e2a9f7f-1211-4850-9f58-b0faa9b49d89', 'tag': '4e404c06-7b40-4d6d-9833-b4408206f4fb', 'status': 'completed', 'code': 200} Nov 09 05:01:20.862054 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2665f84e-a434-431d-8ada-672975b145a0 req-cc73ebfb-0b1c-46f1-8dbb-40d0c0816651 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:01:20.863573 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2665f84e-a434-431d-8ada-672975b145a0 req-cc73ebfb-0b1c-46f1-8dbb-40d0c0816651 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=6342064e2f4e4d17a45b74d8725885ef&device_id=2e2a9f7f-1211-4850-9f58-b0faa9b49d89 HTTP/1.1" status: 200 len: 1099 time: 0.0410438 Nov 09 05:01:20.888137 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-6998be59-f2af-4df2-897c-183a73decabd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7e9d55e0-0100-4ebc-9667-a18ace6d8557', 'name': 'tempest-TestMinimumBasicScenario-1252630362-router', 'tenant_id': '6342064e2f4e4d17a45b74d8725885ef', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.148'}], 'enable_snat': True}, 'gw_port_id': '71172a82-2f01-4a5b-bd07-bfe538c2ae92', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:00:11Z', 'updated_at': '2021-11-09T05:00:14Z', 'revision_number': 4, 'project_id': '6342064e2f4e4d17a45b74d8725885ef', 'gw_port': {'id': '71172a82-2f01-4a5b-bd07-bfe538c2ae92', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:38:f6:39', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e9d55e0-0100-4ebc-9667-a18ace6d8557', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1667, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:00:11Z', 'updated_at': '2021-11-09T05:00:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': 'e799c9a8-ab2e-4a76-8e76-174e4157a93f', 'tenant_id': '6342064e2f4e4d17a45b74d8725885ef', 'floating_ip_address': '172.26.0.213', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '7e9d55e0-0100-4ebc-9667-a18ace6d8557', 'port_id': '4e404c06-7b40-4d6d-9833-b4408206f4fb', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 1683, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '00c105ea-e093-47a8-a669-bbdd36caea7e', 'mac_address': 'fa:16:3e:74:4c:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2e2a9f7f-1211-4850-9f58-b0faa9b49d89', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T05:01:18Z', 'updated_at': '2021-11-09T05:01:18Z', 'revision_number': 0, 'project_id': '6342064e2f4e4d17a45b74d8725885ef', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '940c1a94-9aed-4b5a-b999-df6f009eebec', 'name': '', 'network_id': '00c105ea-e093-47a8-a669-bbdd36caea7e', 'tenant_id': '6342064e2f4e4d17a45b74d8725885ef', 'mac_address': 'fa:16:3e:bd:a6:eb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e9d55e0-0100-4ebc-9667-a18ace6d8557', 'device_owner': 'network:router_interface', 'standard_attr_id': 1668, 'fixed_ips': [{'subnet_id': '15c42388-61b6-40bb-be5b-e0929ebd3465', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:00:13Z', 'updated_at': '2021-11-09T05:00:17Z', 'revision_number': 5, 'project_id': '6342064e2f4e4d17a45b74d8725885ef', 'subnets': [{'id': '15c42388-61b6-40bb-be5b-e0929ebd3465', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:01:20.897293 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-088886cb-5ca8-4c0f-ab35-d22bb2edfa9e tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:01:20.914758 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6998be59-f2af-4df2-897c-183a73decabd None None] Checking router: 7e9d55e0-0100-4ebc-9667-a18ace6d8557 for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 05:01:20.923909 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6998be59-f2af-4df2-897c-183a73decabd None None] Routers {'7e9d55e0-0100-4ebc-9667-a18ace6d8557'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:01:20.924514 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-6998be59-f2af-4df2-897c-183a73decabd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:01:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['7e9d55e0-0100-4ebc-9667-a18ace6d8557'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:01:20.963204 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2665f84e-a434-431d-8ada-672975b145a0 req-2768283d-8cbe-42ff-b92a-297774111cd8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:01:20.964493 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2665f84e-a434-431d-8ada-672975b145a0 req-2768283d-8cbe-42ff-b92a-297774111cd8 service neutron] 10.222.0.26 "GET /v2.0/networks?id=00c105ea-e093-47a8-a669-bbdd36caea7e HTTP/1.1" status: 200 len: 916 time: 0.0925717 Nov 09 05:01:20.966073 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-088886cb-5ca8-4c0f-ab35-d22bb2edfa9e tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:01:21.030479 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2665f84e-a434-431d-8ada-672975b145a0 req-17a4edce-ce3f-434c-8004-18d848e1c042 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=4e404c06-7b40-4d6d-9833-b4408206f4fb HTTP/1.1" status: 200 len: 1000 time: 0.0583761 Nov 09 05:01:21.032164 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-6998be59-f2af-4df2-897c-183a73decabd None None] Set router 7e9d55e0-0100-4ebc-9667-a18ace6d8557 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:01:21.061473 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-088886cb-5ca8-4c0f-ab35-d22bb2edfa9e tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:01:21.086811 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2665f84e-a434-431d-8ada-672975b145a0 req-f155d8bb-bcd0-458f-9143-c2944e7107f5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:01:21.088449 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2665f84e-a434-431d-8ada-672975b145a0 req-f155d8bb-bcd0-458f-9143-c2944e7107f5 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=15c42388-61b6-40bb-be5b-e0929ebd3465 HTTP/1.1" status: 200 len: 854 time: 0.0511029 Nov 09 05:01:21.095271 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-088886cb-5ca8-4c0f-ab35-d22bb2edfa9e tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Pushing event updated for resources: {'SecurityGroup': ['ID=90c83969-f27e-474e-a1a6-640e0adba0d9,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:01:21.104012 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-088886cb-5ca8-4c0f-ab35-d22bb2edfa9e tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:01:21.104249 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-088886cb-5ca8-4c0f-ab35-d22bb2edfa9e tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:01:21.104628 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-088886cb-5ca8-4c0f-ab35-d22bb2edfa9e tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:01:21.105508 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-088886cb-5ca8-4c0f-ab35-d22bb2edfa9e tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:01:21.105844 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-088886cb-5ca8-4c0f-ab35-d22bb2edfa9e tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:01:21.106399 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-088886cb-5ca8-4c0f-ab35-d22bb2edfa9e tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:01:21.106728 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-088886cb-5ca8-4c0f-ab35-d22bb2edfa9e tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:01:21.107054 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-088886cb-5ca8-4c0f-ab35-d22bb2edfa9e tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:01:21.107379 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-088886cb-5ca8-4c0f-ab35-d22bb2edfa9e tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:01:21.107701 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-088886cb-5ca8-4c0f-ab35-d22bb2edfa9e tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:01:21.108027 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-088886cb-5ca8-4c0f-ab35-d22bb2edfa9e tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:01:21.108345 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-088886cb-5ca8-4c0f-ab35-d22bb2edfa9e tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:01:21.149431 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2665f84e-a434-431d-8ada-672975b145a0 req-6aff3109-400a-435d-8814-2bb9dac35761 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:01:21.151727 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2665f84e-a434-431d-8ada-672975b145a0 req-6aff3109-400a-435d-8814-2bb9dac35761 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=00c105ea-e093-47a8-a669-bbdd36caea7e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0555046 Nov 09 05:01:21.206887 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-088886cb-5ca8-4c0f-ab35-d22bb2edfa9e tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:01:21.208146 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-088886cb-5ca8-4c0f-ab35-d22bb2edfa9e tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.4506052 Nov 09 05:01:21.211334 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36412) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:01:21.216367 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-c084abea-814b-4157-a5d4-d226701d9b44 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Request body: {'security_group_rule': {'security_group_id': '90c83969-f27e-474e-a1a6-640e0adba0d9', 'project_id': '6342064e2f4e4d17a45b74d8725885ef', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:01:21.247049 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2665f84e-a434-431d-8ada-672975b145a0 req-4711143c-b140-441a-80f1-a5a235e295b1 service neutron] 10.222.0.26 "GET /v2.0/networks/00c105ea-e093-47a8-a669-bbdd36caea7e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0878065 Nov 09 05:01:21.272107 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-6998be59-f2af-4df2-897c-183a73decabd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7e9d55e0-0100-4ebc-9667-a18ace6d8557', 'name': 'tempest-TestMinimumBasicScenario-1252630362-router', 'tenant_id': '6342064e2f4e4d17a45b74d8725885ef', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.148'}], 'enable_snat': True}, 'gw_port_id': '71172a82-2f01-4a5b-bd07-bfe538c2ae92', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:00:11Z', 'updated_at': '2021-11-09T05:00:14Z', 'revision_number': 4, 'project_id': '6342064e2f4e4d17a45b74d8725885ef', 'gw_port': {'id': '71172a82-2f01-4a5b-bd07-bfe538c2ae92', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:38:f6:39', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e9d55e0-0100-4ebc-9667-a18ace6d8557', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1667, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:00:11Z', 'updated_at': '2021-11-09T05:00:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': 'e799c9a8-ab2e-4a76-8e76-174e4157a93f', 'tenant_id': '6342064e2f4e4d17a45b74d8725885ef', 'floating_ip_address': '172.26.0.213', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '7e9d55e0-0100-4ebc-9667-a18ace6d8557', 'port_id': '4e404c06-7b40-4d6d-9833-b4408206f4fb', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 1683, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '00c105ea-e093-47a8-a669-bbdd36caea7e', 'mac_address': 'fa:16:3e:74:4c:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2e2a9f7f-1211-4850-9f58-b0faa9b49d89', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T05:01:18Z', 'updated_at': '2021-11-09T05:01:18Z', 'revision_number': 0, 'project_id': '6342064e2f4e4d17a45b74d8725885ef', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '940c1a94-9aed-4b5a-b999-df6f009eebec', 'name': '', 'network_id': '00c105ea-e093-47a8-a669-bbdd36caea7e', 'tenant_id': '6342064e2f4e4d17a45b74d8725885ef', 'mac_address': 'fa:16:3e:bd:a6:eb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e9d55e0-0100-4ebc-9667-a18ace6d8557', 'device_owner': 'network:router_interface', 'standard_attr_id': 1668, 'fixed_ips': [{'subnet_id': '15c42388-61b6-40bb-be5b-e0929ebd3465', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:00:13Z', 'updated_at': '2021-11-09T05:00:17Z', 'revision_number': 5, 'project_id': '6342064e2f4e4d17a45b74d8725885ef', 'subnets': [{'id': '15c42388-61b6-40bb-be5b-e0929ebd3465', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:01:21.299212 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6998be59-f2af-4df2-897c-183a73decabd None None] The sync data for ids ['7e9d55e0-0100-4ebc-9667-a18ace6d8557'] in dv-neutron-816802-2-hyperv is: [{'id': '7e9d55e0-0100-4ebc-9667-a18ace6d8557', 'name': 'tempest-TestMinimumBasicScenario-1252630362-router', 'tenant_id': '6342064e2f4e4d17a45b74d8725885ef', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.148'}], 'enable_snat': True}, 'gw_port_id': '71172a82-2f01-4a5b-bd07-bfe538c2ae92', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:00:11Z', 'updated_at': '2021-11-09T05:00:14Z', 'revision_number': 4, 'project_id': '6342064e2f4e4d17a45b74d8725885ef', 'gw_port': {'id': '71172a82-2f01-4a5b-bd07-bfe538c2ae92', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:38:f6:39', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e9d55e0-0100-4ebc-9667-a18ace6d8557', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1667, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:00:11Z', 'updated_at': '2021-11-09T05:00:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': 'e799c9a8-ab2e-4a76-8e76-174e4157a93f', 'tenant_id': '6342064e2f4e4d17a45b74d8725885ef', 'floating_ip_address': '172.26.0.213', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '7e9d55e0-0100-4ebc-9667-a18ace6d8557', 'port_id': '4e404c06-7b40-4d6d-9833-b4408206f4fb', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 1683, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '00c105ea-e093-47a8-a669-bbdd36caea7e', 'mac_address': 'fa:16:3e:74:4c:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2e2a9f7f-1211-4850-9f58-b0faa9b49d89', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T05:01:18Z', 'updated_at': '2021-11-09T05:01:18Z', 'revision_number': 0, 'project_id': '6342064e2f4e4d17a45b74d8725885ef', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '940c1a94-9aed-4b5a-b999-df6f009eebec', 'name': '', 'network_id': '00c105ea-e093-47a8-a669-bbdd36caea7e', 'tenant_id': '6342064e2f4e4d17a45b74d8725885ef', 'mac_address': 'fa:16:3e:bd:a6:eb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e9d55e0-0100-4ebc-9667-a18ace6d8557', 'device_owner': 'network:router_interface', 'standard_attr_id': 1668, 'fixed_ips': [{'subnet_id': '15c42388-61b6-40bb-be5b-e0929ebd3465', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:00:13Z', 'updated_at': '2021-11-09T05:00:17Z', 'revision_number': 5, 'project_id': '6342064e2f4e4d17a45b74d8725885ef', 'subnets': [{'id': '15c42388-61b6-40bb-be5b-e0929ebd3465', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 05:01:21.308992 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c084abea-814b-4157-a5d4-d226701d9b44 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:01:21.347329 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2665f84e-a434-431d-8ada-672975b145a0 req-6666806c-8850-4a1f-98dc-7f0537e51b11 service neutron] 10.222.0.26 "GET /v2.0/networks/00c105ea-e093-47a8-a669-bbdd36caea7e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0916204 Nov 09 05:01:21.381174 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c084abea-814b-4157-a5d4-d226701d9b44 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:01:21.471521 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c084abea-814b-4157-a5d4-d226701d9b44 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:01:21.491078 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c084abea-814b-4157-a5d4-d226701d9b44 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b7fc1f36-bf97-4cc8-bb80-b5f0fe918de2,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:01:21.517614 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-04ad62a2-c7c4-4b5b-9b69-e6c563d03b6f None None] New status for floating IP e799c9a8-ab2e-4a76-8e76-174e4157a93f: ACTIVE {{(pid=102164) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 05:01:21.601391 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c084abea-814b-4157-a5d4-d226701d9b44 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:01:21.602569 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-c084abea-814b-4157-a5d4-d226701d9b44 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3902171 Nov 09 05:01:21.605462 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36414) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:01:21.609995 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-a6dd984b-f9b0-494b-b5f5-36a8fe82787c tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Request body: {'security_group_rule': {'security_group_id': '90c83969-f27e-474e-a1a6-640e0adba0d9', 'project_id': '6342064e2f4e4d17a45b74d8725885ef', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:01:21.719415 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a6dd984b-f9b0-494b-b5f5-36a8fe82787c tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:01:21.779471 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a6dd984b-f9b0-494b-b5f5-36a8fe82787c tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:01:21.947525 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a6dd984b-f9b0-494b-b5f5-36a8fe82787c tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:01:21.966269 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6dd984b-f9b0-494b-b5f5-36a8fe82787c tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=09b91e6f-4a8f-4baf-96f4-074918d9310a,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:01:22.092955 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a6dd984b-f9b0-494b-b5f5-36a8fe82787c tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:01:22.094201 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a6dd984b-f9b0-494b-b5f5-36a8fe82787c tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.4877012 Nov 09 05:01:22.096731 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36416) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:01:22.101028 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-ee4c0b62-babf-4f49-9317-3fda7d44a9c7 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Request body: {'security_group_rule': {'security_group_id': '90c83969-f27e-474e-a1a6-640e0adba0d9', 'project_id': '6342064e2f4e4d17a45b74d8725885ef', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:01:22.249636 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ee4c0b62-babf-4f49-9317-3fda7d44a9c7 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:01:22.306165 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ee4c0b62-babf-4f49-9317-3fda7d44a9c7 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:01:22.398660 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ee4c0b62-babf-4f49-9317-3fda7d44a9c7 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:01:22.415820 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee4c0b62-babf-4f49-9317-3fda7d44a9c7 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=25a2ba1d-15ca-4c94-bdee-d354f7ddb03b,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:01:22.544670 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ee4c0b62-babf-4f49-9317-3fda7d44a9c7 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:01:22.545876 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-ee4c0b62-babf-4f49-9317-3fda7d44a9c7 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.4482400 Nov 09 05:01:22.548606 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36418) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:01:22.553062 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-dd4daaaf-1b36-4548-8c8c-8c3e6f87cfc7 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Request body: {'security_group_rule': {'security_group_id': '90c83969-f27e-474e-a1a6-640e0adba0d9', 'project_id': '6342064e2f4e4d17a45b74d8725885ef', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:01:22.701136 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dd4daaaf-1b36-4548-8c8c-8c3e6f87cfc7 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:01:22.757306 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dd4daaaf-1b36-4548-8c8c-8c3e6f87cfc7 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:01:22.850716 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dd4daaaf-1b36-4548-8c8c-8c3e6f87cfc7 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:01:22.869712 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd4daaaf-1b36-4548-8c8c-8c3e6f87cfc7 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=be6a1d70-5bea-4b65-bef3-411240773157,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:01:22.972944 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dd4daaaf-1b36-4548-8c8c-8c3e6f87cfc7 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:01:22.981216 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-dd4daaaf-1b36-4548-8c8c-8c3e6f87cfc7 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.4245794 Nov 09 05:01:22.981216 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36420) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:01:22.981672 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-b5a6a3c0-0f6a-44a5-b384-b54fbc91bebc tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Request body: {'security_group_rule': {'security_group_id': '90c83969-f27e-474e-a1a6-640e0adba0d9', 'project_id': '6342064e2f4e4d17a45b74d8725885ef', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:01:23.118828 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.securitygroups_db [None req-b5a6a3c0-0f6a-44a5-b384-b54fbc91bebc tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Project 6342064e2f4e4d17a45b74d8725885ef added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 09 05:01:23.123701 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b5a6a3c0-0f6a-44a5-b384-b54fbc91bebc tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:01:23.179647 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b5a6a3c0-0f6a-44a5-b384-b54fbc91bebc tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:01:23.290525 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b5a6a3c0-0f6a-44a5-b384-b54fbc91bebc tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:01:23.309337 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5a6a3c0-0f6a-44a5-b384-b54fbc91bebc tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2b1df20c-e9f3-46e1-b3de-25846ba9a617,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:01:23.395431 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b5a6a3c0-0f6a-44a5-b384-b54fbc91bebc tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:01:23.396592 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-b5a6a3c0-0f6a-44a5-b384-b54fbc91bebc tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.4189548 Nov 09 05:01:23.399290 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36422) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:01:23.404328 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-741c16f3-7d3b-4531-a1b1-dfce3497eae6 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Request body: {'security_group_rule': {'security_group_id': '90c83969-f27e-474e-a1a6-640e0adba0d9', 'project_id': '6342064e2f4e4d17a45b74d8725885ef', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:01:23.576320 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.securitygroups_db [None req-741c16f3-7d3b-4531-a1b1-dfce3497eae6 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Project 6342064e2f4e4d17a45b74d8725885ef added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 09 05:01:23.581410 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-741c16f3-7d3b-4531-a1b1-dfce3497eae6 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:01:23.641339 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-741c16f3-7d3b-4531-a1b1-dfce3497eae6 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:01:23.770574 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-741c16f3-7d3b-4531-a1b1-dfce3497eae6 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:01:23.788502 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-741c16f3-7d3b-4531-a1b1-dfce3497eae6 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d0adb400-3a3f-4d65-a165-3e4ab1760948,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:01:23.993216 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-741c16f3-7d3b-4531-a1b1-dfce3497eae6 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:01:23.994484 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-741c16f3-7d3b-4531-a1b1-dfce3497eae6 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.5942085 Nov 09 05:01:24.092546 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ebd73229-5909-46c3-996b-e2ade35ad3be req-51d47757-fd69-4bb8-a21c-459b88b29bfb tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1852030682&fields=id&tenant_id=6342064e2f4e4d17a45b74d8725885ef HTTP/1.1" status: 200 len: 267 time: 0.0539405 Nov 09 05:01:24.145974 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebd73229-5909-46c3-996b-e2ade35ad3be req-d31b695e-afa1-4af4-9d36-02c6cf5b214d tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:01:24.147426 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ebd73229-5909-46c3-996b-e2ade35ad3be req-d31b695e-afa1-4af4-9d36-02c6cf5b214d tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/ports?device_id=2e2a9f7f-1211-4850-9f58-b0faa9b49d89 HTTP/1.1" status: 200 len: 946 time: 0.0478792 Nov 09 05:01:24.158031 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-ebd73229-5909-46c3-996b-e2ade35ad3be req-9e31b5aa-b696-4bc3-a50d-620801c8179e tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Request body: {'port': {'security_groups': ['cd821237-9f21-4bf9-9e32-fce1986821ee', '90c83969-f27e-474e-a1a6-640e0adba0d9']}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:01:24.222183 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-ebd73229-5909-46c3-996b-e2ade35ad3be req-9e31b5aa-b696-4bc3-a50d-620801c8179e tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:01:24.400721 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-ebd73229-5909-46c3-996b-e2ade35ad3be req-9e31b5aa-b696-4bc3-a50d-620801c8179e tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] For port 4e404c06-7b40-4d6d-9833-b4408206f4fb, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=4e404c06-7b40-4d6d-9833-b4408206f4fb,segment=NetworkSegment(794d91f6-937c-4e26-8ecc-34550b214f4a),segment_id=794d91f6-937c-4e26-8ecc-34550b214f4a)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:01:24.429424 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-ebd73229-5909-46c3-996b-e2ade35ad3be req-9e31b5aa-b696-4bc3-a50d-620801c8179e tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:01:24.524410 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-ebd73229-5909-46c3-996b-e2ade35ad3be req-9e31b5aa-b696-4bc3-a50d-620801c8179e tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:01:24.537952 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['4e404c06-7b40-4d6d-9833-b4408206f4fb'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 05:01:24.580969 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebd73229-5909-46c3-996b-e2ade35ad3be req-9e31b5aa-b696-4bc3-a50d-620801c8179e tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:01:24.580969 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-ebd73229-5909-46c3-996b-e2ade35ad3be req-9e31b5aa-b696-4bc3-a50d-620801c8179e tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:01:24.580969 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ebd73229-5909-46c3-996b-e2ade35ad3be req-9e31b5aa-b696-4bc3-a50d-620801c8179e tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "PUT /v2.0/ports/4e404c06-7b40-4d6d-9833-b4408206f4fb HTTP/1.1" status: 200 len: 982 time: 0.4175687 Nov 09 05:01:24.580969 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2e2a9f7f-1211-4850-9f58-b0faa9b49d89', 'tag': '4e404c06-7b40-4d6d-9833-b4408206f4fb'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:01:24.580969 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e9ca23be-b0de-4846-9ef9-5809080d2b98" -d '{"events": [{"name": "network-changed", "server_uuid": "2e2a9f7f-1211-4850-9f58-b0faa9b49d89", "tag": "4e404c06-7b40-4d6d-9833-b4408206f4fb"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:01:24.613698 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e31b5aa-b696-4bc3-a50d-620801c8179e tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Pushing event updated for resources: {'Port': ['ID=4e404c06-7b40-4d6d-9833-b4408206f4fb,revision_number=6']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:01:24.626434 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 05:01:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c0cae699-3720-4ac7-bce5-da5605ffc736 x-openstack-request-id: req-c0cae699-3720-4ac7-bce5-da5605ffc736 {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:01:24.626731 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2e2a9f7f-1211-4850-9f58-b0faa9b49d89", "tag": "4e404c06-7b40-4d6d-9833-b4408206f4fb", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:01:24.626980 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-c0cae699-3720-4ac7-bce5-da5605ffc736 {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:01:24.627382 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2e2a9f7f-1211-4850-9f58-b0faa9b49d89', 'tag': '4e404c06-7b40-4d6d-9833-b4408206f4fb', 'status': 'completed', 'code': 200} Nov 09 05:01:24.666577 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['4e404c06-7b40-4d6d-9833-b4408206f4fb'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 05:01:24.703497 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d5d0f2b-5767-4218-a667-906603c04c38 req-37ae3fcd-a455-4b7e-89fa-615b2220473b tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:01:24.711144 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-3d5d0f2b-5767-4218-a667-906603c04c38 req-37ae3fcd-a455-4b7e-89fa-615b2220473b tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/ports?device_id=2e2a9f7f-1211-4850-9f58-b0faa9b49d89 HTTP/1.1" status: 200 len: 985 time: 0.0638149 Nov 09 05:01:24.711382 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9ca23be-b0de-4846-9ef9-5809080d2b98 req-9f19debc-702b-4d00-bf45-eed5c22f24d9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:01:24.713551 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e9ca23be-b0de-4846-9ef9-5809080d2b98 req-9f19debc-702b-4d00-bf45-eed5c22f24d9 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=6342064e2f4e4d17a45b74d8725885ef&device_id=2e2a9f7f-1211-4850-9f58-b0faa9b49d89 HTTP/1.1" status: 200 len: 1138 time: 0.0614707 Nov 09 05:01:24.785789 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-3d5d0f2b-5767-4218-a667-906603c04c38 req-32dc74b7-64e2-4fe2-96f1-a53c7bee5e65 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/security-groups?id=90c83969-f27e-474e-a1a6-640e0adba0d9&id=cd821237-9f21-4bf9-9e32-fce1986821ee&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0733497 Nov 09 05:01:24.832639 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9ca23be-b0de-4846-9ef9-5809080d2b98 req-d303bfb2-8528-4f50-af38-35692cb69240 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:01:24.834221 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e9ca23be-b0de-4846-9ef9-5809080d2b98 req-d303bfb2-8528-4f50-af38-35692cb69240 service neutron] 10.222.0.26 "GET /v2.0/networks?id=00c105ea-e093-47a8-a669-bbdd36caea7e HTTP/1.1" status: 200 len: 916 time: 0.1114855 Nov 09 05:01:24.890864 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-40a6d97b-f8b3-40b5-b912-5afabc6be103 None None] Provisioning complete for port 4e404c06-7b40-4d6d-9833-b4408206f4fb triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:01:24.891226 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-40a6d97b-f8b3-40b5-b912-5afabc6be103 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:01:24.905387 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e9ca23be-b0de-4846-9ef9-5809080d2b98 req-fd04bf6d-1157-42f1-afc1-1139a13f231b service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=4e404c06-7b40-4d6d-9833-b4408206f4fb HTTP/1.1" status: 200 len: 1002 time: 0.0629272 Nov 09 05:01:24.953936 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9ca23be-b0de-4846-9ef9-5809080d2b98 req-22ae25a3-7281-47cd-9134-742669becdb0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:01:24.955320 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e9ca23be-b0de-4846-9ef9-5809080d2b98 req-22ae25a3-7281-47cd-9134-742669becdb0 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=15c42388-61b6-40bb-be5b-e0929ebd3465 HTTP/1.1" status: 200 len: 854 time: 0.0428550 Nov 09 05:01:25.001639 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9ca23be-b0de-4846-9ef9-5809080d2b98 req-aa0d8d44-3247-4d4f-9055-9b6b08d7031e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:01:25.003282 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e9ca23be-b0de-4846-9ef9-5809080d2b98 req-aa0d8d44-3247-4d4f-9055-9b6b08d7031e service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=00c105ea-e093-47a8-a669-bbdd36caea7e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0399401 Nov 09 05:01:25.097260 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e9ca23be-b0de-4846-9ef9-5809080d2b98 req-cfc8fdbc-a79c-4f54-a61c-35f746c2ba6a service neutron] 10.222.0.26 "GET /v2.0/networks/00c105ea-e093-47a8-a669-bbdd36caea7e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0862238 Nov 09 05:01:25.186181 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e9ca23be-b0de-4846-9ef9-5809080d2b98 req-3151a979-6646-415a-8a6a-5453adecee50 service neutron] 10.222.0.26 "GET /v2.0/networks/00c105ea-e093-47a8-a669-bbdd36caea7e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0821669 Nov 09 05:01:32.691331 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed0495e8-84e6-4783-8b6c-02ffaf7aabac req-a6d57a34-858d-4806-9c5d-6729f46f54cc tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:01:32.693056 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ed0495e8-84e6-4783-8b6c-02ffaf7aabac req-a6d57a34-858d-4806-9c5d-6729f46f54cc tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/ports?device_id=2e2a9f7f-1211-4850-9f58-b0faa9b49d89 HTTP/1.1" status: 200 len: 985 time: 0.0530970 Nov 09 05:01:32.754600 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ed0495e8-84e6-4783-8b6c-02ffaf7aabac req-dd767a3c-9b9b-44b3-b06e-21fdd258ce9f tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/security-groups?id=90c83969-f27e-474e-a1a6-640e0adba0d9&id=cd821237-9f21-4bf9-9e32-fce1986821ee&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0550983 Nov 09 05:01:32.772445 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fe311aa-5c02-46d8-9d7a-f8cc706607a3 req-4acdc65c-677c-4b03-964d-ac63a5182072 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:01:32.773995 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1fe311aa-5c02-46d8-9d7a-f8cc706607a3 req-4acdc65c-677c-4b03-964d-ac63a5182072 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=6342064e2f4e4d17a45b74d8725885ef&device_id=2e2a9f7f-1211-4850-9f58-b0faa9b49d89 HTTP/1.1" status: 200 len: 1138 time: 0.0410383 Nov 09 05:01:32.867819 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fe311aa-5c02-46d8-9d7a-f8cc706607a3 req-145c71eb-05ab-4c57-9372-a9c3e0207c4c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:01:32.869218 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1fe311aa-5c02-46d8-9d7a-f8cc706607a3 req-145c71eb-05ab-4c57-9372-a9c3e0207c4c service neutron] 10.222.0.26 "GET /v2.0/networks?id=00c105ea-e093-47a8-a669-bbdd36caea7e HTTP/1.1" status: 200 len: 916 time: 0.0872276 Nov 09 05:01:32.939069 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1fe311aa-5c02-46d8-9d7a-f8cc706607a3 req-d9e8631b-e0d6-4580-936a-7f439e913a37 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=4e404c06-7b40-4d6d-9833-b4408206f4fb HTTP/1.1" status: 200 len: 1002 time: 0.0617352 Nov 09 05:01:32.988735 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fe311aa-5c02-46d8-9d7a-f8cc706607a3 req-98eea568-3dce-49e8-89a8-4f125a213ce5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:01:32.990160 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1fe311aa-5c02-46d8-9d7a-f8cc706607a3 req-98eea568-3dce-49e8-89a8-4f125a213ce5 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=15c42388-61b6-40bb-be5b-e0929ebd3465 HTTP/1.1" status: 200 len: 854 time: 0.0438352 Nov 09 05:01:33.035221 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fe311aa-5c02-46d8-9d7a-f8cc706607a3 req-6b61a8bb-7f2f-4d06-8096-9f85bca4ee9d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:01:33.036676 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1fe311aa-5c02-46d8-9d7a-f8cc706607a3 req-6b61a8bb-7f2f-4d06-8096-9f85bca4ee9d service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=00c105ea-e093-47a8-a669-bbdd36caea7e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0389247 Nov 09 05:01:33.128082 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1fe311aa-5c02-46d8-9d7a-f8cc706607a3 req-11ac7a9d-cccb-43f3-8f7d-d6eab693621f service neutron] 10.222.0.26 "GET /v2.0/networks/00c105ea-e093-47a8-a669-bbdd36caea7e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0824864 Nov 09 05:01:33.218863 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1fe311aa-5c02-46d8-9d7a-f8cc706607a3 req-5a029dce-9178-4825-9288-0ebc488d2765 service neutron] 10.222.0.26 "GET /v2.0/networks/00c105ea-e093-47a8-a669-bbdd36caea7e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0817144 Nov 09 05:01:33.875170 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-daf05984-b711-416e-a8de-4bc1506b8492 req-99c3bb9d-d4fb-45ef-946f-9ffeee6f5c1a tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:01:33.876651 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-daf05984-b711-416e-a8de-4bc1506b8492 req-99c3bb9d-d4fb-45ef-946f-9ffeee6f5c1a tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/ports?device_id=2e2a9f7f-1211-4850-9f58-b0faa9b49d89 HTTP/1.1" status: 200 len: 985 time: 0.0494921 Nov 09 05:01:33.942021 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-daf05984-b711-416e-a8de-4bc1506b8492 req-3b272f38-25c8-49bf-8603-2849de9c4212 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/security-groups?id=90c83969-f27e-474e-a1a6-640e0adba0d9&id=cd821237-9f21-4bf9-9e32-fce1986821ee&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0575421 Nov 09 05:01:35.056275 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9a6f838-159f-401b-9a22-2298f886c2f6 req-b0665e94-8ce5-4527-97e1-93f994a1cc33 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:01:35.057769 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b9a6f838-159f-401b-9a22-2298f886c2f6 req-b0665e94-8ce5-4527-97e1-93f994a1cc33 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/ports?device_id=2e2a9f7f-1211-4850-9f58-b0faa9b49d89 HTTP/1.1" status: 200 len: 985 time: 0.0482082 Nov 09 05:01:35.117081 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b9a6f838-159f-401b-9a22-2298f886c2f6 req-efa424f9-1f4c-4ddc-b2a6-8ec31847539c tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/security-groups?id=90c83969-f27e-474e-a1a6-640e0adba0d9&id=cd821237-9f21-4bf9-9e32-fce1986821ee&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0529277 Nov 09 05:01:35.453857 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 05:01:36.234153 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07f721e1-a1b7-46e8-b473-2d3870675468 req-b52ff83b-f1f8-4cb2-a440-4fac5923a89b tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:01:36.235640 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-07f721e1-a1b7-46e8-b473-2d3870675468 req-b52ff83b-f1f8-4cb2-a440-4fac5923a89b tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/ports?device_id=2e2a9f7f-1211-4850-9f58-b0faa9b49d89 HTTP/1.1" status: 200 len: 985 time: 0.0488155 Nov 09 05:01:36.294237 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-07f721e1-a1b7-46e8-b473-2d3870675468 req-4f9520b0-3aea-49d0-bcfc-e253bcb552ec tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/security-groups?id=90c83969-f27e-474e-a1a6-640e0adba0d9&id=cd821237-9f21-4bf9-9e32-fce1986821ee&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0525610 Nov 09 05:01:37.407228 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d44278de-6c19-47b4-8f9b-50cf0a23ad53 req-8b0ffe3e-d4cf-4831-b72b-8b73c5294716 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:01:37.408721 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d44278de-6c19-47b4-8f9b-50cf0a23ad53 req-8b0ffe3e-d4cf-4831-b72b-8b73c5294716 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/ports?device_id=2e2a9f7f-1211-4850-9f58-b0faa9b49d89 HTTP/1.1" status: 200 len: 985 time: 0.0482011 Nov 09 05:01:37.472858 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d44278de-6c19-47b4-8f9b-50cf0a23ad53 req-863c5872-8adc-4841-b065-19e37ee2edf8 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/security-groups?id=90c83969-f27e-474e-a1a6-640e0adba0d9&id=cd821237-9f21-4bf9-9e32-fce1986821ee&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0572612 Nov 09 05:01:38.587032 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37a2825a-3354-47d1-8b75-12e1e53eaa23 req-3d95b0b9-d256-4871-af35-f7de689a70f9 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:01:38.588502 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-37a2825a-3354-47d1-8b75-12e1e53eaa23 req-3d95b0b9-d256-4871-af35-f7de689a70f9 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/ports?device_id=2e2a9f7f-1211-4850-9f58-b0faa9b49d89 HTTP/1.1" status: 200 len: 985 time: 0.0491335 Nov 09 05:01:38.646895 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-37a2825a-3354-47d1-8b75-12e1e53eaa23 req-38620f65-c1e1-4825-a341-d60f3fc65a97 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/security-groups?id=90c83969-f27e-474e-a1a6-640e0adba0d9&id=cd821237-9f21-4bf9-9e32-fce1986821ee&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0523674 Nov 09 05:01:39.760152 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a963786-73d2-48ac-bc85-28e69bd4fe78 req-abed6e2c-f063-4932-b406-48a48836b064 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:01:39.761611 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-7a963786-73d2-48ac-bc85-28e69bd4fe78 req-abed6e2c-f063-4932-b406-48a48836b064 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/ports?device_id=2e2a9f7f-1211-4850-9f58-b0faa9b49d89 HTTP/1.1" status: 200 len: 985 time: 0.0482368 Nov 09 05:01:39.820308 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-7a963786-73d2-48ac-bc85-28e69bd4fe78 req-02458dac-e0e5-47b9-aba3-395a29676cc9 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/security-groups?id=90c83969-f27e-474e-a1a6-640e0adba0d9&id=cd821237-9f21-4bf9-9e32-fce1986821ee&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0523114 Nov 09 05:01:40.935382 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eee064e8-a5ca-4688-b13f-b3c60e8e78bb req-2d18fe26-995b-4b2a-a3bb-684d645cd104 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:01:40.936824 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-eee064e8-a5ca-4688-b13f-b3c60e8e78bb req-2d18fe26-995b-4b2a-a3bb-684d645cd104 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/ports?device_id=2e2a9f7f-1211-4850-9f58-b0faa9b49d89 HTTP/1.1" status: 200 len: 985 time: 0.0516403 Nov 09 05:01:40.994348 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-eee064e8-a5ca-4688-b13f-b3c60e8e78bb req-b60dd0a4-569a-4c4e-bb2c-eb5ff8770b2c tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/security-groups?id=90c83969-f27e-474e-a1a6-640e0adba0d9&id=cd821237-9f21-4bf9-9e32-fce1986821ee&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0513778 Nov 09 05:01:41.363737 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-16634809-f586-4caa-864d-5491490a7bce None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:01:42.111514 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffa6bf86-dafd-47dc-9103-3e6f2640a459 req-ec3d39fd-6e29-45cf-b482-3b7fb59bc6a6 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:01:42.112977 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ffa6bf86-dafd-47dc-9103-3e6f2640a459 req-ec3d39fd-6e29-45cf-b482-3b7fb59bc6a6 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/ports?device_id=2e2a9f7f-1211-4850-9f58-b0faa9b49d89 HTTP/1.1" status: 200 len: 985 time: 0.0483727 Nov 09 05:01:42.172381 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ffa6bf86-dafd-47dc-9103-3e6f2640a459 req-b8d39675-a18b-4689-9f4c-807a688e501b tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/security-groups?id=90c83969-f27e-474e-a1a6-640e0adba0d9&id=cd821237-9f21-4bf9-9e32-fce1986821ee&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0533528 Nov 09 05:01:42.449777 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:01:43.286132 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e92e5a3f-80b3-4d36-9e22-b8845a31540d req-7e98e1e6-8ab5-4199-bbe6-a41db28a0700 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:01:43.287649 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e92e5a3f-80b3-4d36-9e22-b8845a31540d req-7e98e1e6-8ab5-4199-bbe6-a41db28a0700 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/ports?device_id=2e2a9f7f-1211-4850-9f58-b0faa9b49d89 HTTP/1.1" status: 200 len: 985 time: 0.0488229 Nov 09 05:01:43.347016 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e92e5a3f-80b3-4d36-9e22-b8845a31540d req-8ef614f9-0663-4391-b644-c68b0fcc25f0 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/security-groups?id=90c83969-f27e-474e-a1a6-640e0adba0d9&id=cd821237-9f21-4bf9-9e32-fce1986821ee&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0532920 Nov 09 05:01:43.773902 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-33f1c6bc-c43e-4145-8da0-9abca4068273 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:01:44.472075 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4517907d-86cf-4c8d-b9a5-7a7816f95793 req-d1a6ae81-af6f-4cc4-8134-30ef118bd9cd tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:01:44.473608 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-4517907d-86cf-4c8d-b9a5-7a7816f95793 req-d1a6ae81-af6f-4cc4-8134-30ef118bd9cd tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/ports?device_id=2e2a9f7f-1211-4850-9f58-b0faa9b49d89 HTTP/1.1" status: 200 len: 985 time: 0.0559301 Nov 09 05:01:44.534163 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-4517907d-86cf-4c8d-b9a5-7a7816f95793 req-33696cce-8d1f-45f8-bd4c-95f20d1cd9fc tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/security-groups?id=90c83969-f27e-474e-a1a6-640e0adba0d9&id=cd821237-9f21-4bf9-9e32-fce1986821ee&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0544827 Nov 09 05:01:45.289070 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:01:45.650404 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e614fc33-d781-4181-9e7c-d65253068985 req-75ca3b65-e7de-4337-b8fd-d9e0b9807964 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:01:45.651852 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e614fc33-d781-4181-9e7c-d65253068985 req-75ca3b65-e7de-4337-b8fd-d9e0b9807964 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/ports?device_id=2e2a9f7f-1211-4850-9f58-b0faa9b49d89 HTTP/1.1" status: 200 len: 985 time: 0.0508459 Nov 09 05:01:45.710080 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e614fc33-d781-4181-9e7c-d65253068985 req-acb15c21-1c6c-4aec-afe2-c19ab3b854ac tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/security-groups?id=90c83969-f27e-474e-a1a6-640e0adba0d9&id=cd821237-9f21-4bf9-9e32-fce1986821ee&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0515816 Nov 09 05:01:46.584318 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:01:46.969168 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:11.349167 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-46f15720-dd87-47ae-9aac-df46799fefb9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:12.452626 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 05:02:12.469359 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:13.705570 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d07b20bd-1fcc-4c88-b2d7-52478e205e2c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:14.799547 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-23390fa7-afb8-475e-8ef5-5f6ab029f53e req-3b455073-3703-48cd-98d1-14cadddbdfe0 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1852030682&fields=id&tenant_id=6342064e2f4e4d17a45b74d8725885ef HTTP/1.1" status: 200 len: 267 time: 0.0431247 Nov 09 05:02:14.851708 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23390fa7-afb8-475e-8ef5-5f6ab029f53e req-15f91b9f-3dba-46b0-9a0d-16af7f311a24 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:02:14.853158 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-23390fa7-afb8-475e-8ef5-5f6ab029f53e req-15f91b9f-3dba-46b0-9a0d-16af7f311a24 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/ports?device_id=2e2a9f7f-1211-4850-9f58-b0faa9b49d89 HTTP/1.1" status: 200 len: 985 time: 0.0482109 Nov 09 05:02:14.863869 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [req-23390fa7-afb8-475e-8ef5-5f6ab029f53e req-dfe55795-e9a1-45e3-95d9-ebfad5ddfd15 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Request body: {'port': {'security_groups': ['cd821237-9f21-4bf9-9e32-fce1986821ee']}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:02:14.930777 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [req-23390fa7-afb8-475e-8ef5-5f6ab029f53e req-dfe55795-e9a1-45e3-95d9-ebfad5ddfd15 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:15.100077 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [req-23390fa7-afb8-475e-8ef5-5f6ab029f53e req-dfe55795-e9a1-45e3-95d9-ebfad5ddfd15 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] For port 4e404c06-7b40-4d6d-9833-b4408206f4fb, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=4e404c06-7b40-4d6d-9833-b4408206f4fb,segment=NetworkSegment(794d91f6-937c-4e26-8ecc-34550b214f4a),segment_id=794d91f6-937c-4e26-8ecc-34550b214f4a)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:02:15.127758 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [req-23390fa7-afb8-475e-8ef5-5f6ab029f53e req-dfe55795-e9a1-45e3-95d9-ebfad5ddfd15 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:15.200449 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [req-23390fa7-afb8-475e-8ef5-5f6ab029f53e req-dfe55795-e9a1-45e3-95d9-ebfad5ddfd15 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:15.212546 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['4e404c06-7b40-4d6d-9833-b4408206f4fb'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 05:02:15.240308 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:15.241363 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23390fa7-afb8-475e-8ef5-5f6ab029f53e req-dfe55795-e9a1-45e3-95d9-ebfad5ddfd15 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:02:15.241972 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [req-23390fa7-afb8-475e-8ef5-5f6ab029f53e req-dfe55795-e9a1-45e3-95d9-ebfad5ddfd15 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:15.243329 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-23390fa7-afb8-475e-8ef5-5f6ab029f53e req-dfe55795-e9a1-45e3-95d9-ebfad5ddfd15 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "PUT /v2.0/ports/4e404c06-7b40-4d6d-9833-b4408206f4fb HTTP/1.1" status: 200 len: 943 time: 0.3839109 Nov 09 05:02:15.245796 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2e2a9f7f-1211-4850-9f58-b0faa9b49d89', 'tag': '4e404c06-7b40-4d6d-9833-b4408206f4fb'}] {{(pid=102161) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:02:15.248145 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}99dfdda0def497b4372884ef2eb87f06b1e425c8eba5ceda5f64bbab037a07d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4a24dbb7-515d-4223-bc3d-3fff29246e2f" -d '{"events": [{"name": "network-changed", "server_uuid": "2e2a9f7f-1211-4850-9f58-b0faa9b49d89", "tag": "4e404c06-7b40-4d6d-9833-b4408206f4fb"}]}' {{(pid=102161) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:02:15.253524 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 36484) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:02:15.297917 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfe55795-e9a1-45e3-95d9-ebfad5ddfd15 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Pushing event updated for resources: {'Port': ['ID=4e404c06-7b40-4d6d-9833-b4408206f4fb,revision_number=7']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:02:15.318493 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-089a23cd-fa11-485b-98d0-3352a3e4928e tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:15.351450 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-089a23cd-fa11-485b-98d0-3352a3e4928e tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:15.358728 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['4e404c06-7b40-4d6d-9833-b4408206f4fb'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 05:02:15.507896 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 05:02:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b17d0a35-71dd-4a8f-897f-31d5bbb3a849 x-openstack-request-id: req-b17d0a35-71dd-4a8f-897f-31d5bbb3a849 {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:02:15.508243 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2e2a9f7f-1211-4850-9f58-b0faa9b49d89", "tag": "4e404c06-7b40-4d6d-9833-b4408206f4fb", "status": "completed", "code": 200}]} {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:02:15.508636 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-b17d0a35-71dd-4a8f-897f-31d5bbb3a849 {{(pid=102161) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:02:15.508893 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2e2a9f7f-1211-4850-9f58-b0faa9b49d89', 'tag': '4e404c06-7b40-4d6d-9833-b4408206f4fb', 'status': 'completed', 'code': 200} Nov 09 05:02:15.522749 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-089a23cd-fa11-485b-98d0-3352a3e4928e tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:15.525613 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-089a23cd-fa11-485b-98d0-3352a3e4928e tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:15.526781 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-089a23cd-fa11-485b-98d0-3352a3e4928e tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "DELETE /v2.0/security-groups/90c83969-f27e-474e-a1a6-640e0adba0d9 HTTP/1.1" status: 204 len: 168 time: 0.2716923 Nov 09 05:02:15.529478 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36488) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:02:15.544349 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-089a23cd-fa11-485b-98d0-3352a3e4928e tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=90c83969-f27e-474e-a1a6-640e0adba0d9,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:02:15.586992 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-fe834bbb-0bce-43e3-809b-9b57d3f743c4 None None] Provisioning complete for port 4e404c06-7b40-4d6d-9833-b4408206f4fb triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:02:15.587362 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-fe834bbb-0bce-43e3-809b-9b57d3f743c4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:15.587863 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a24dbb7-515d-4223-bc3d-3fff29246e2f req-e12b8aeb-2cc4-4c2d-99fe-d4a2d1a436d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:02:15.590403 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4a24dbb7-515d-4223-bc3d-3fff29246e2f req-e12b8aeb-2cc4-4c2d-99fe-d4a2d1a436d5 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=6342064e2f4e4d17a45b74d8725885ef&device_id=2e2a9f7f-1211-4850-9f58-b0faa9b49d89 HTTP/1.1" status: 200 len: 1099 time: 0.0580080 Nov 09 05:02:15.686279 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a24dbb7-515d-4223-bc3d-3fff29246e2f req-e1df9a86-d04a-4601-8775-479695ba92f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:02:15.687785 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4a24dbb7-515d-4223-bc3d-3fff29246e2f req-e1df9a86-d04a-4601-8775-479695ba92f1 service neutron] 10.222.0.26 "GET /v2.0/networks?id=00c105ea-e093-47a8-a669-bbdd36caea7e HTTP/1.1" status: 200 len: 916 time: 0.0895257 Nov 09 05:02:15.696935 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-193d1381-d90e-436e-8028-3a6c639da387 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Deleting port f83967d0-517d-4257-8c57-542b9e1391a9 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:02:15.697270 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-193d1381-d90e-436e-8028-3a6c639da387 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:15.752709 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4a24dbb7-515d-4223-bc3d-3fff29246e2f req-36652e05-2f80-4612-9fd3-df610d49dbd1 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=4e404c06-7b40-4d6d-9833-b4408206f4fb HTTP/1.1" status: 200 len: 1002 time: 0.0573828 Nov 09 05:02:15.770557 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-193d1381-d90e-436e-8028-3a6c639da387 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:15.770888 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-193d1381-d90e-436e-8028-3a6c639da387 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:15.783003 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-193d1381-d90e-436e-8028-3a6c639da387 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Calling delete_port for f83967d0-517d-4257-8c57-542b9e1391a9 owned by network:floatingip {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:02:15.804596 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a24dbb7-515d-4223-bc3d-3fff29246e2f req-0f6eccac-2740-4ae2-9e37-9205d9cc07ef service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:02:15.806248 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4a24dbb7-515d-4223-bc3d-3fff29246e2f req-0f6eccac-2740-4ae2-9e37-9205d9cc07ef service neutron] 10.222.0.26 "GET /v2.0/subnets?id=15c42388-61b6-40bb-be5b-e0929ebd3465 HTTP/1.1" status: 200 len: 854 time: 0.0469196 Nov 09 05:02:15.851014 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a24dbb7-515d-4223-bc3d-3fff29246e2f req-5e877469-674f-4800-a6fa-ff23d9d94fa4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:02:15.852484 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4a24dbb7-515d-4223-bc3d-3fff29246e2f req-5e877469-674f-4800-a6fa-ff23d9d94fa4 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=00c105ea-e093-47a8-a669-bbdd36caea7e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0394571 Nov 09 05:02:15.946811 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4a24dbb7-515d-4223-bc3d-3fff29246e2f req-c399cef1-f42f-4342-a4ee-1e53177dbf1f service neutron] 10.222.0.26 "GET /v2.0/networks/00c105ea-e093-47a8-a669-bbdd36caea7e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0867965 Nov 09 05:02:16.036540 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4a24dbb7-515d-4223-bc3d-3fff29246e2f req-d072e602-f3a9-49b6-bb0a-b3ec10908cd3 service neutron] 10.222.0.26 "GET /v2.0/networks/00c105ea-e093-47a8-a669-bbdd36caea7e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0816612 Nov 09 05:02:16.058239 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-193d1381-d90e-436e-8028-3a6c639da387 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:16.085133 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-193d1381-d90e-436e-8028-3a6c639da387 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Pushing event deleted for resources: {'Port': ['ID=f83967d0-517d-4257-8c57-542b9e1391a9,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:02:16.143821 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-193d1381-d90e-436e-8028-3a6c639da387 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks [] for floatingip, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:16.144378 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.l3_db [None req-193d1381-d90e-436e-8028-3a6c639da387 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Floating IP e799c9a8-ab2e-4a76-8e76-174e4157a93f disassociated (deleted). External IP: 172.26.0.213, port: 4e404c06-7b40-4d6d-9833-b4408206f4fb. Nov 09 05:02:16.348284 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-193d1381-d90e-436e-8028-3a6c639da387 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Router 7e9d55e0-0100-4ebc-9667-a18ace6d8557 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 05:02:16.451839 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-193d1381-d90e-436e-8028-3a6c639da387 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 05:02:16.457188 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-193d1381-d90e-436e-8028-3a6c639da387 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:16.461509 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9da33b64-789e-4eee-8ef6-526f994d8834 None None] Sync routers for ids ['7e9d55e0-0100-4ebc-9667-a18ace6d8557'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 05:02:16.471485 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9da33b64-789e-4eee-8ef6-526f994d8834 None None] Routers {'7e9d55e0-0100-4ebc-9667-a18ace6d8557'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:02:16.472091 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-9da33b64-789e-4eee-8ef6-526f994d8834 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:02:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['7e9d55e0-0100-4ebc-9667-a18ace6d8557'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:02:16.483529 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-193d1381-d90e-436e-8028-3a6c639da387 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "DELETE /v2.0/floatingips/e799c9a8-ab2e-4a76-8e76-174e4157a93f HTTP/1.1" status: 204 len: 168 time: 0.9529653 Nov 09 05:02:16.593886 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-9da33b64-789e-4eee-8ef6-526f994d8834 None None] Set router 7e9d55e0-0100-4ebc-9667-a18ace6d8557 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:02:16.620946 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:16.786476 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-9da33b64-789e-4eee-8ef6-526f994d8834 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7e9d55e0-0100-4ebc-9667-a18ace6d8557', 'name': 'tempest-TestMinimumBasicScenario-1252630362-router', 'tenant_id': '6342064e2f4e4d17a45b74d8725885ef', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.148'}], 'enable_snat': True}, 'gw_port_id': '71172a82-2f01-4a5b-bd07-bfe538c2ae92', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:00:11Z', 'updated_at': '2021-11-09T05:00:14Z', 'revision_number': 4, 'project_id': '6342064e2f4e4d17a45b74d8725885ef', 'gw_port': {'id': '71172a82-2f01-4a5b-bd07-bfe538c2ae92', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:38:f6:39', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e9d55e0-0100-4ebc-9667-a18ace6d8557', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1667, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:00:11Z', 'updated_at': '2021-11-09T05:00:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '940c1a94-9aed-4b5a-b999-df6f009eebec', 'name': '', 'network_id': '00c105ea-e093-47a8-a669-bbdd36caea7e', 'tenant_id': '6342064e2f4e4d17a45b74d8725885ef', 'mac_address': 'fa:16:3e:bd:a6:eb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e9d55e0-0100-4ebc-9667-a18ace6d8557', 'device_owner': 'network:router_interface', 'standard_attr_id': 1668, 'fixed_ips': [{'subnet_id': '15c42388-61b6-40bb-be5b-e0929ebd3465', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:00:13Z', 'updated_at': '2021-11-09T05:00:17Z', 'revision_number': 5, 'project_id': '6342064e2f4e4d17a45b74d8725885ef', 'subnets': [{'id': '15c42388-61b6-40bb-be5b-e0929ebd3465', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:02:16.811370 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9da33b64-789e-4eee-8ef6-526f994d8834 None None] Checking router: 7e9d55e0-0100-4ebc-9667-a18ace6d8557 for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 05:02:16.820328 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9da33b64-789e-4eee-8ef6-526f994d8834 None None] Routers {'7e9d55e0-0100-4ebc-9667-a18ace6d8557'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:02:16.820920 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-9da33b64-789e-4eee-8ef6-526f994d8834 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:02:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['7e9d55e0-0100-4ebc-9667-a18ace6d8557'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:02:16.935967 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-9da33b64-789e-4eee-8ef6-526f994d8834 None None] Set router 7e9d55e0-0100-4ebc-9667-a18ace6d8557 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:02:17.111536 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:17.137910 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-9da33b64-789e-4eee-8ef6-526f994d8834 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7e9d55e0-0100-4ebc-9667-a18ace6d8557', 'name': 'tempest-TestMinimumBasicScenario-1252630362-router', 'tenant_id': '6342064e2f4e4d17a45b74d8725885ef', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.148'}], 'enable_snat': True}, 'gw_port_id': '71172a82-2f01-4a5b-bd07-bfe538c2ae92', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:00:11Z', 'updated_at': '2021-11-09T05:00:14Z', 'revision_number': 4, 'project_id': '6342064e2f4e4d17a45b74d8725885ef', 'gw_port': {'id': '71172a82-2f01-4a5b-bd07-bfe538c2ae92', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:38:f6:39', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e9d55e0-0100-4ebc-9667-a18ace6d8557', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1667, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:00:11Z', 'updated_at': '2021-11-09T05:00:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '940c1a94-9aed-4b5a-b999-df6f009eebec', 'name': '', 'network_id': '00c105ea-e093-47a8-a669-bbdd36caea7e', 'tenant_id': '6342064e2f4e4d17a45b74d8725885ef', 'mac_address': 'fa:16:3e:bd:a6:eb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e9d55e0-0100-4ebc-9667-a18ace6d8557', 'device_owner': 'network:router_interface', 'standard_attr_id': 1668, 'fixed_ips': [{'subnet_id': '15c42388-61b6-40bb-be5b-e0929ebd3465', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:00:13Z', 'updated_at': '2021-11-09T05:00:17Z', 'revision_number': 5, 'project_id': '6342064e2f4e4d17a45b74d8725885ef', 'subnets': [{'id': '15c42388-61b6-40bb-be5b-e0929ebd3465', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:02:17.163112 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9da33b64-789e-4eee-8ef6-526f994d8834 None None] The sync data for ids ['7e9d55e0-0100-4ebc-9667-a18ace6d8557'] in dv-neutron-816802-2-hyperv is: [{'id': '7e9d55e0-0100-4ebc-9667-a18ace6d8557', 'name': 'tempest-TestMinimumBasicScenario-1252630362-router', 'tenant_id': '6342064e2f4e4d17a45b74d8725885ef', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.148'}], 'enable_snat': True}, 'gw_port_id': '71172a82-2f01-4a5b-bd07-bfe538c2ae92', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:00:11Z', 'updated_at': '2021-11-09T05:00:14Z', 'revision_number': 4, 'project_id': '6342064e2f4e4d17a45b74d8725885ef', 'gw_port': {'id': '71172a82-2f01-4a5b-bd07-bfe538c2ae92', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:38:f6:39', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e9d55e0-0100-4ebc-9667-a18ace6d8557', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1667, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:00:11Z', 'updated_at': '2021-11-09T05:00:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '940c1a94-9aed-4b5a-b999-df6f009eebec', 'name': '', 'network_id': '00c105ea-e093-47a8-a669-bbdd36caea7e', 'tenant_id': '6342064e2f4e4d17a45b74d8725885ef', 'mac_address': 'fa:16:3e:bd:a6:eb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e9d55e0-0100-4ebc-9667-a18ace6d8557', 'device_owner': 'network:router_interface', 'standard_attr_id': 1668, 'fixed_ips': [{'subnet_id': '15c42388-61b6-40bb-be5b-e0929ebd3465', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:00:13Z', 'updated_at': '2021-11-09T05:00:17Z', 'revision_number': 5, 'project_id': '6342064e2f4e4d17a45b74d8725885ef', 'subnets': [{'id': '15c42388-61b6-40bb-be5b-e0929ebd3465', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 05:02:17.375427 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b8fa1961-fa4a-44df-8fc4-1e7689a4e485 None None] New status for floating IP e799c9a8-ab2e-4a76-8e76-174e4157a93f: DOWN {{(pid=102164) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 05:02:17.514546 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2e2a9f7f-1211-4850-9f58-b0faa9b49d89', 'tag': '4e404c06-7b40-4d6d-9833-b4408206f4fb'}] {{(pid=102161) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:02:17.514546 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}99dfdda0def497b4372884ef2eb87f06b1e425c8eba5ceda5f64bbab037a07d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-66cef1bb-49a9-4a31-b9be-37e6d31dd7ad" -d '{"events": [{"name": "network-changed", "server_uuid": "2e2a9f7f-1211-4850-9f58-b0faa9b49d89", "tag": "4e404c06-7b40-4d6d-9833-b4408206f4fb"}]}' {{(pid=102161) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:02:17.553761 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 05:02:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c3bbc697-f84e-4a48-95bc-b5df4fabd09c x-openstack-request-id: req-c3bbc697-f84e-4a48-95bc-b5df4fabd09c {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:02:17.553761 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2e2a9f7f-1211-4850-9f58-b0faa9b49d89", "tag": "4e404c06-7b40-4d6d-9833-b4408206f4fb", "status": "completed", "code": 200}]} {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:02:17.553761 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-c3bbc697-f84e-4a48-95bc-b5df4fabd09c {{(pid=102161) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:02:17.553761 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2e2a9f7f-1211-4850-9f58-b0faa9b49d89', 'tag': '4e404c06-7b40-4d6d-9833-b4408206f4fb', 'status': 'completed', 'code': 200} Nov 09 05:02:17.611942 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66cef1bb-49a9-4a31-b9be-37e6d31dd7ad req-928ddda6-7211-4495-a335-7a571e2d3e9c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:02:17.673727 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-66cef1bb-49a9-4a31-b9be-37e6d31dd7ad req-928ddda6-7211-4495-a335-7a571e2d3e9c service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=6342064e2f4e4d17a45b74d8725885ef&device_id=2e2a9f7f-1211-4850-9f58-b0faa9b49d89 HTTP/1.1" status: 200 len: 1099 time: 0.0411270 Nov 09 05:02:17.704666 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66cef1bb-49a9-4a31-b9be-37e6d31dd7ad req-19fcd0f3-3535-487b-aadd-3f7f2dc04357 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:02:17.706116 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-66cef1bb-49a9-4a31-b9be-37e6d31dd7ad req-19fcd0f3-3535-487b-aadd-3f7f2dc04357 service neutron] 10.222.0.26 "GET /v2.0/networks?id=00c105ea-e093-47a8-a669-bbdd36caea7e HTTP/1.1" status: 200 len: 916 time: 0.0860655 Nov 09 05:02:17.749875 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-66cef1bb-49a9-4a31-b9be-37e6d31dd7ad req-7814e492-b303-4621-8571-72fefd9d0a24 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=4e404c06-7b40-4d6d-9833-b4408206f4fb HTTP/1.1" status: 200 len: 217 time: 0.0367119 Nov 09 05:02:17.804823 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66cef1bb-49a9-4a31-b9be-37e6d31dd7ad req-f70259be-2635-47ec-9d38-3bbe8d2d1991 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:02:17.806338 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-66cef1bb-49a9-4a31-b9be-37e6d31dd7ad req-f70259be-2635-47ec-9d38-3bbe8d2d1991 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=15c42388-61b6-40bb-be5b-e0929ebd3465 HTTP/1.1" status: 200 len: 854 time: 0.0496051 Nov 09 05:02:17.857011 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66cef1bb-49a9-4a31-b9be-37e6d31dd7ad req-9e749769-6bb3-4bee-9e92-c6c41b90908e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:02:17.858513 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-66cef1bb-49a9-4a31-b9be-37e6d31dd7ad req-9e749769-6bb3-4bee-9e92-c6c41b90908e service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=00c105ea-e093-47a8-a669-bbdd36caea7e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0447500 Nov 09 05:02:17.949235 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-66cef1bb-49a9-4a31-b9be-37e6d31dd7ad req-1c2fc856-ace5-4092-bc8b-c2431a391be1 service neutron] 10.222.0.26 "GET /v2.0/networks/00c105ea-e093-47a8-a669-bbdd36caea7e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0838902 Nov 09 05:02:18.043387 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-66cef1bb-49a9-4a31-b9be-37e6d31dd7ad req-5980c724-fe89-4844-962a-9738c0a3e4b9 service neutron] 10.222.0.26 "GET /v2.0/networks/00c105ea-e093-47a8-a669-bbdd36caea7e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0862465 Nov 09 05:02:19.260254 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e5b72a66-97f8-4f9a-87bf-64f0c2c761d9 req-1b85afe9-4a16-47f8-a50a-519ae98493bb service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=2e2a9f7f-1211-4850-9f58-b0faa9b49d89&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0385101 Nov 09 05:02:19.345664 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5b72a66-97f8-4f9a-87bf-64f0c2c761d9 req-495203da-5d80-4b16-9c40-fe58322de7e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:02:19.347244 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e5b72a66-97f8-4f9a-87bf-64f0c2c761d9 req-495203da-5d80-4b16-9c40-fe58322de7e0 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=6342064e2f4e4d17a45b74d8725885ef&device_id=2e2a9f7f-1211-4850-9f58-b0faa9b49d89 HTTP/1.1" status: 200 len: 1099 time: 0.0460830 Nov 09 05:02:19.452877 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5b72a66-97f8-4f9a-87bf-64f0c2c761d9 req-210a98de-e4d2-4d11-9bd1-0244aa15daf7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:02:19.454407 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e5b72a66-97f8-4f9a-87bf-64f0c2c761d9 req-210a98de-e4d2-4d11-9bd1-0244aa15daf7 service neutron] 10.222.0.26 "GET /v2.0/networks?id=00c105ea-e093-47a8-a669-bbdd36caea7e HTTP/1.1" status: 200 len: 916 time: 0.0872507 Nov 09 05:02:19.498682 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e5b72a66-97f8-4f9a-87bf-64f0c2c761d9 req-432c19cb-a904-453b-ae66-05c2aba61b8c service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=4e404c06-7b40-4d6d-9833-b4408206f4fb HTTP/1.1" status: 200 len: 217 time: 0.0374453 Nov 09 05:02:19.546458 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5b72a66-97f8-4f9a-87bf-64f0c2c761d9 req-2e6b1398-c74d-46ce-8ba5-1e0d13a4002d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:02:19.549078 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e5b72a66-97f8-4f9a-87bf-64f0c2c761d9 req-2e6b1398-c74d-46ce-8ba5-1e0d13a4002d service neutron] 10.222.0.26 "GET /v2.0/subnets?id=15c42388-61b6-40bb-be5b-e0929ebd3465 HTTP/1.1" status: 200 len: 854 time: 0.0442197 Nov 09 05:02:19.593582 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5b72a66-97f8-4f9a-87bf-64f0c2c761d9 req-5e077d91-5104-472f-bfa8-1a480971e2e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:02:19.595672 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e5b72a66-97f8-4f9a-87bf-64f0c2c761d9 req-5e077d91-5104-472f-bfa8-1a480971e2e7 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=00c105ea-e093-47a8-a669-bbdd36caea7e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0401566 Nov 09 05:02:19.966940 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e5b72a66-97f8-4f9a-87bf-64f0c2c761d9 req-7ecd5706-7112-4d34-8764-2998227d7c9b service neutron] 10.222.0.26 "GET /v2.0/networks/00c105ea-e093-47a8-a669-bbdd36caea7e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3636661 Nov 09 05:02:20.063911 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e5b72a66-97f8-4f9a-87bf-64f0c2c761d9 req-7541623a-db87-49bb-ab93-97db6bfcdfe6 service neutron] 10.222.0.26 "GET /v2.0/networks/00c105ea-e093-47a8-a669-bbdd36caea7e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0897079 Nov 09 05:02:26.049963 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b134f07-724e-4725-b99c-15749253c830 req-59d518d7-bbb7-4ff1-b872-ce88880c3c7f tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:02:26.051473 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-0b134f07-724e-4725-b99c-15749253c830 req-59d518d7-bbb7-4ff1-b872-ce88880c3c7f tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/ports?device_id=2e2a9f7f-1211-4850-9f58-b0faa9b49d89 HTTP/1.1" status: 200 len: 946 time: 0.0553246 Nov 09 05:02:26.101372 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-0b134f07-724e-4725-b99c-15749253c830 req-e38d3566-4c0a-4064-a527-4ec091a448af tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/security-groups?id=cd821237-9f21-4bf9-9e32-fce1986821ee&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438807 Nov 09 05:02:27.218457 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d102cd50-2a1b-4fc2-9087-8be69689093d req-91aa2d05-2f30-44a1-a644-92f52b11a3ac tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:02:27.219938 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d102cd50-2a1b-4fc2-9087-8be69689093d req-91aa2d05-2f30-44a1-a644-92f52b11a3ac tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/ports?device_id=2e2a9f7f-1211-4850-9f58-b0faa9b49d89 HTTP/1.1" status: 200 len: 946 time: 0.0483203 Nov 09 05:02:27.269055 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d102cd50-2a1b-4fc2-9087-8be69689093d req-b2cc80d9-fd39-452d-9b6e-360e9741ccd6 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/security-groups?id=cd821237-9f21-4bf9-9e32-fce1986821ee&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433512 Nov 09 05:02:27.701922 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d85e3de-ddd6-4799-bc85-686049f76fa5 req-c27a8244-52ea-4a44-aaf9-fc417d8ec7e8 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:02:27.703383 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1d85e3de-ddd6-4799-bc85-686049f76fa5 req-c27a8244-52ea-4a44-aaf9-fc417d8ec7e8 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.26 "GET /v2.0/ports?device_id=2e2a9f7f-1211-4850-9f58-b0faa9b49d89 HTTP/1.1" status: 200 len: 946 time: 0.0474501 Nov 09 05:02:27.789954 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-1d85e3de-ddd6-4799-bc85-686049f76fa5 req-60524b4a-81c7-46fe-9a4b-de0098aafc84 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Deleting port 4e404c06-7b40-4d6d-9833-b4408206f4fb {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:02:27.790289 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-1d85e3de-ddd6-4799-bc85-686049f76fa5 req-60524b4a-81c7-46fe-9a4b-de0098aafc84 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:27.882066 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-1d85e3de-ddd6-4799-bc85-686049f76fa5 req-60524b4a-81c7-46fe-9a4b-de0098aafc84 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] For port 4e404c06-7b40-4d6d-9833-b4408206f4fb, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=4e404c06-7b40-4d6d-9833-b4408206f4fb,segment=NetworkSegment(794d91f6-937c-4e26-8ecc-34550b214f4a),segment_id=794d91f6-937c-4e26-8ecc-34550b214f4a)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:02:27.882451 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-1d85e3de-ddd6-4799-bc85-686049f76fa5 req-60524b4a-81c7-46fe-9a4b-de0098aafc84 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:27.895839 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-1d85e3de-ddd6-4799-bc85-686049f76fa5 req-60524b4a-81c7-46fe-9a4b-de0098aafc84 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Calling delete_port for 4e404c06-7b40-4d6d-9833-b4408206f4fb owned by compute:nova {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:02:28.080047 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-1d85e3de-ddd6-4799-bc85-686049f76fa5 req-60524b4a-81c7-46fe-9a4b-de0098aafc84 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:28.091392 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['4e404c06-7b40-4d6d-9833-b4408206f4fb'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 05:02:28.107202 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60524b4a-81c7-46fe-9a4b-de0098aafc84 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Pushing event deleted for resources: {'Port': ['ID=4e404c06-7b40-4d6d-9833-b4408206f4fb,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:02:28.123133 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60524b4a-81c7-46fe-9a4b-de0098aafc84 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:02:28.123484 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60524b4a-81c7-46fe-9a4b-de0098aafc84 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:02:28.123868 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60524b4a-81c7-46fe-9a4b-de0098aafc84 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:02:28.124189 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60524b4a-81c7-46fe-9a4b-de0098aafc84 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:02:28.124522 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60524b4a-81c7-46fe-9a4b-de0098aafc84 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:02:28.125432 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60524b4a-81c7-46fe-9a4b-de0098aafc84 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:02:28.125770 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60524b4a-81c7-46fe-9a4b-de0098aafc84 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:02:28.126100 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60524b4a-81c7-46fe-9a4b-de0098aafc84 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:02:28.126449 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60524b4a-81c7-46fe-9a4b-de0098aafc84 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:02:28.126773 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60524b4a-81c7-46fe-9a4b-de0098aafc84 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:02:28.127096 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60524b4a-81c7-46fe-9a4b-de0098aafc84 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:02:28.127431 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60524b4a-81c7-46fe-9a4b-de0098aafc84 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:02:28.161519 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-1d85e3de-ddd6-4799-bc85-686049f76fa5 req-60524b4a-81c7-46fe-9a4b-de0098aafc84 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] No DVR routers for this DVR port 4e404c06-7b40-4d6d-9833-b4408206f4fb on host hv-neutron-8168 {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 05:02:28.163936 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-1d85e3de-ddd6-4799-bc85-686049f76fa5 req-60524b4a-81c7-46fe-9a4b-de0098aafc84 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:28.167184 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1d85e3de-ddd6-4799-bc85-686049f76fa5 req-60524b4a-81c7-46fe-9a4b-de0098aafc84 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.26 "DELETE /v2.0/ports/4e404c06-7b40-4d6d-9833-b4408206f4fb HTTP/1.1" status: 204 len: 173 time: 0.4580686 Nov 09 05:02:28.167615 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2e2a9f7f-1211-4850-9f58-b0faa9b49d89', 'name': 'network-vif-deleted', 'tag': '4e404c06-7b40-4d6d-9833-b4408206f4fb'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:02:28.169817 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7fa035c6-3940-48db-b92d-7e80125f4204" -d '{"events": [{"server_uuid": "2e2a9f7f-1211-4850-9f58-b0faa9b49d89", "name": "network-vif-deleted", "tag": "4e404c06-7b40-4d6d-9833-b4408206f4fb"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:02:28.205864 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 05:02:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-69e5f786-fa86-421d-bc95-f1488a3a129e x-openstack-request-id: req-69e5f786-fa86-421d-bc95-f1488a3a129e {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:02:28.206457 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2e2a9f7f-1211-4850-9f58-b0faa9b49d89", "name": "network-vif-deleted", "tag": "4e404c06-7b40-4d6d-9833-b4408206f4fb", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:02:28.206457 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-69e5f786-fa86-421d-bc95-f1488a3a129e {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:02:28.206834 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2e2a9f7f-1211-4850-9f58-b0faa9b49d89', 'name': 'network-vif-deleted', 'tag': '4e404c06-7b40-4d6d-9833-b4408206f4fb', 'status': 'completed', 'code': 200} Nov 09 05:02:28.361960 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-78ff3398-40fd-4abd-90ab-9f3f1d24eb00 req-d4b899f8-59a8-4488-85c3-d64065786721 tempest-TestMinimumBasicScenario-598842457 tempest-TestMinimumBasicScenario-598842457-project] 10.222.0.24 "GET /v2.0/ports?device_id=2e2a9f7f-1211-4850-9f58-b0faa9b49d89 HTTP/1.1" status: 200 len: 210 time: 0.0260272 Nov 09 05:02:30.802331 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36588) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:02:31.133278 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-072e25c7-4ec9-4b5f-86c2-88eb8f1979a6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:31.641573 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-072e25c7-4ec9-4b5f-86c2-88eb8f1979a6 admin admin] Deleting port 940c1a94-9aed-4b5a-b999-df6f009eebec {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:02:31.641905 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-072e25c7-4ec9-4b5f-86c2-88eb8f1979a6 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:31.719476 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-072e25c7-4ec9-4b5f-86c2-88eb8f1979a6 admin admin] For port 940c1a94-9aed-4b5a-b999-df6f009eebec, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=940c1a94-9aed-4b5a-b999-df6f009eebec,segment=NetworkSegment(794d91f6-937c-4e26-8ecc-34550b214f4a),segment_id=794d91f6-937c-4e26-8ecc-34550b214f4a)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:02:31.719826 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-072e25c7-4ec9-4b5f-86c2-88eb8f1979a6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:31.732121 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-072e25c7-4ec9-4b5f-86c2-88eb8f1979a6 admin admin] Calling delete_port for 940c1a94-9aed-4b5a-b999-df6f009eebec owned by network:router_interface {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:02:31.971676 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-072e25c7-4ec9-4b5f-86c2-88eb8f1979a6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:31.995611 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-072e25c7-4ec9-4b5f-86c2-88eb8f1979a6 admin admin] Pushing event deleted for resources: {'Port': ['ID=940c1a94-9aed-4b5a-b999-df6f009eebec,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:02:32.011292 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-072e25c7-4ec9-4b5f-86c2-88eb8f1979a6 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:02:32.011292 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-072e25c7-4ec9-4b5f-86c2-88eb8f1979a6 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:02:32.011292 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-072e25c7-4ec9-4b5f-86c2-88eb8f1979a6 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:02:32.011292 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-072e25c7-4ec9-4b5f-86c2-88eb8f1979a6 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:02:32.011292 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-072e25c7-4ec9-4b5f-86c2-88eb8f1979a6 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:02:32.011292 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-072e25c7-4ec9-4b5f-86c2-88eb8f1979a6 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:02:32.011292 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-072e25c7-4ec9-4b5f-86c2-88eb8f1979a6 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:02:32.011292 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-072e25c7-4ec9-4b5f-86c2-88eb8f1979a6 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:02:32.011932 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-072e25c7-4ec9-4b5f-86c2-88eb8f1979a6 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:02:32.011932 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-072e25c7-4ec9-4b5f-86c2-88eb8f1979a6 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:02:32.012146 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-072e25c7-4ec9-4b5f-86c2-88eb8f1979a6 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:02:32.012465 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-072e25c7-4ec9-4b5f-86c2-88eb8f1979a6 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:02:32.173274 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-072e25c7-4ec9-4b5f-86c2-88eb8f1979a6 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:32.223343 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 4e404c06-7b40-4d6d-9833-b4408206f4fb no longer exists at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 05:02:32.243687 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] No Port match for: 4e404c06-7b40-4d6d-9833-b4408206f4fb {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 05:02:32.244012 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 4e404c06-7b40-4d6d-9833-b4408206f4fb not bound to the agent host hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 05:02:32.383621 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-072e25c7-4ec9-4b5f-86c2-88eb8f1979a6 admin admin] Router 7e9d55e0-0100-4ebc-9667-a18ace6d8557 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 05:02:32.487239 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-072e25c7-4ec9-4b5f-86c2-88eb8f1979a6 admin admin] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 05:02:32.492195 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-072e25c7-4ec9-4b5f-86c2-88eb8f1979a6 admin admin] 10.222.0.24 "PUT /v2.0/routers/7e9d55e0-0100-4ebc-9667-a18ace6d8557/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6888304 Nov 09 05:02:32.494943 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36590) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:02:32.496751 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bebd7656-9f83-43b6-8516-6b8606686082 None None] Sync routers for ids ['7e9d55e0-0100-4ebc-9667-a18ace6d8557'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 05:02:32.506981 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bebd7656-9f83-43b6-8516-6b8606686082 None None] Routers {'7e9d55e0-0100-4ebc-9667-a18ace6d8557'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:02:32.507609 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-bebd7656-9f83-43b6-8516-6b8606686082 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:02:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['7e9d55e0-0100-4ebc-9667-a18ace6d8557'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:02:32.597162 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d0daa22f-e559-436b-8d14-af3f0c1d2c33 admin admin] Publish callbacks [] for router, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:32.610220 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-bebd7656-9f83-43b6-8516-6b8606686082 None None] Set router 7e9d55e0-0100-4ebc-9667-a18ace6d8557 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:02:32.697628 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d0daa22f-e559-436b-8d14-af3f0c1d2c33 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:32.784543 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-bebd7656-9f83-43b6-8516-6b8606686082 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7e9d55e0-0100-4ebc-9667-a18ace6d8557', 'name': 'tempest-TestMinimumBasicScenario-1252630362-router', 'tenant_id': '6342064e2f4e4d17a45b74d8725885ef', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.148'}], 'enable_snat': True}, 'gw_port_id': '71172a82-2f01-4a5b-bd07-bfe538c2ae92', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:00:11Z', 'updated_at': '2021-11-09T05:02:31Z', 'revision_number': 5, 'project_id': '6342064e2f4e4d17a45b74d8725885ef', 'gw_port': {'id': '71172a82-2f01-4a5b-bd07-bfe538c2ae92', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:38:f6:39', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e9d55e0-0100-4ebc-9667-a18ace6d8557', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1667, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:00:11Z', 'updated_at': '2021-11-09T05:00:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:02:32.809797 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bebd7656-9f83-43b6-8516-6b8606686082 None None] Checking router: 7e9d55e0-0100-4ebc-9667-a18ace6d8557 for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 05:02:32.818065 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bebd7656-9f83-43b6-8516-6b8606686082 None None] Routers {'7e9d55e0-0100-4ebc-9667-a18ace6d8557'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:02:32.818695 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-bebd7656-9f83-43b6-8516-6b8606686082 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:02:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['7e9d55e0-0100-4ebc-9667-a18ace6d8557'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:02:32.843908 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-d0daa22f-e559-436b-8d14-af3f0c1d2c33 admin admin] Deleting port 71172a82-2f01-4a5b-bd07-bfe538c2ae92 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:02:32.844248 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d0daa22f-e559-436b-8d14-af3f0c1d2c33 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:32.907042 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-bebd7656-9f83-43b6-8516-6b8606686082 None None] Set router 7e9d55e0-0100-4ebc-9667-a18ace6d8557 gateway port host: None {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:02:32.927353 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-d0daa22f-e559-436b-8d14-af3f0c1d2c33 admin admin] For port 71172a82-2f01-4a5b-bd07-bfe538c2ae92, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=71172a82-2f01-4a5b-bd07-bfe538c2ae92,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:02:32.929223 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d0daa22f-e559-436b-8d14-af3f0c1d2c33 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:32.941036 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-d0daa22f-e559-436b-8d14-af3f0c1d2c33 admin admin] Calling delete_port for 71172a82-2f01-4a5b-bd07-bfe538c2ae92 owned by network:router_gateway {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:02:32.957932 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-bebd7656-9f83-43b6-8516-6b8606686082 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7e9d55e0-0100-4ebc-9667-a18ace6d8557', 'name': 'tempest-TestMinimumBasicScenario-1252630362-router', 'tenant_id': '6342064e2f4e4d17a45b74d8725885ef', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:00:11Z', 'updated_at': '2021-11-09T05:02:32Z', 'revision_number': 6, 'project_id': '6342064e2f4e4d17a45b74d8725885ef', 'gw_port_host': None}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:02:32.985656 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bebd7656-9f83-43b6-8516-6b8606686082 None None] The sync data for ids ['7e9d55e0-0100-4ebc-9667-a18ace6d8557'] in dv-neutron-816802-2-hyperv is: [{'id': '7e9d55e0-0100-4ebc-9667-a18ace6d8557', 'name': 'tempest-TestMinimumBasicScenario-1252630362-router', 'tenant_id': '6342064e2f4e4d17a45b74d8725885ef', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:00:11Z', 'updated_at': '2021-11-09T05:02:32Z', 'revision_number': 6, 'project_id': '6342064e2f4e4d17a45b74d8725885ef', 'gw_port_host': None}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 05:02:33.167334 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d0daa22f-e559-436b-8d14-af3f0c1d2c33 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:33.193763 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0daa22f-e559-436b-8d14-af3f0c1d2c33 admin admin] Pushing event deleted for resources: {'Port': ['ID=71172a82-2f01-4a5b-bd07-bfe538c2ae92,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:02:33.251112 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d0daa22f-e559-436b-8d14-af3f0c1d2c33 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-466373'] for router_gateway, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:33.340609 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d0daa22f-e559-436b-8d14-af3f0c1d2c33 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:33.342754 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d0daa22f-e559-436b-8d14-af3f0c1d2c33 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:33.459019 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d0daa22f-e559-436b-8d14-af3f0c1d2c33 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:33.459495 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d0daa22f-e559-436b-8d14-af3f0c1d2c33 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 7e9d55e0-0100-4ebc-9667-a18ace6d8557 {{(pid=102161) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 05:02:33.463719 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d0daa22f-e559-436b-8d14-af3f0c1d2c33 admin admin] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:33.464980 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-d0daa22f-e559-436b-8d14-af3f0c1d2c33 admin admin] 10.222.0.24 "DELETE /v2.0/routers/7e9d55e0-0100-4ebc-9667-a18ace6d8557 HTTP/1.1" status: 204 len: 168 time: 0.9691098 Nov 09 05:02:33.467637 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36592) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:02:33.511945 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-79e7f172-873c-491e-9869-322739f2a708 admin admin] Deleting subnet 15c42388-61b6-40bb-be5b-e0929ebd3465 {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 05:02:33.514940 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-79e7f172-873c-491e-9869-322739f2a708 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:33.549533 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-79e7f172-873c-491e-9869-322739f2a708 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:33.628820 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-79e7f172-873c-491e-9869-322739f2a708 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:33.761985 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-79e7f172-873c-491e-9869-322739f2a708 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:33.788489 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79e7f172-873c-491e-9869-322739f2a708 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=15c42388-61b6-40bb-be5b-e0929ebd3465,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:02:33.792630 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-79e7f172-873c-491e-9869-322739f2a708 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:33.796043 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-79e7f172-873c-491e-9869-322739f2a708 admin admin] 10.222.0.24 "DELETE /v2.0/subnets/15c42388-61b6-40bb-be5b-e0929ebd3465 HTTP/1.1" status: 204 len: 168 time: 0.3274844 Nov 09 05:02:33.799134 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9a392521-e5b0-4ab3-bd8f-40091c64f14b None None] Network 00c105ea-e093-47a8-a669-bbdd36caea7e requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 05:02:33.799612 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36594) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:02:33.875988 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6c814cd8-b6b8-45ca-a1de-6d5e20511a17 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:33.941658 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-6c814cd8-b6b8-45ca-a1de-6d5e20511a17 admin admin] Deleting port 6a95e148-2072-45a9-9503-b388ed9e2ef8 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:02:33.941992 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6c814cd8-b6b8-45ca-a1de-6d5e20511a17 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:34.010933 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-6c814cd8-b6b8-45ca-a1de-6d5e20511a17 admin admin] For port 6a95e148-2072-45a9-9503-b388ed9e2ef8, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=6a95e148-2072-45a9-9503-b388ed9e2ef8,segment=NetworkSegment(794d91f6-937c-4e26-8ecc-34550b214f4a),segment_id=794d91f6-937c-4e26-8ecc-34550b214f4a)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:02:34.011291 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6c814cd8-b6b8-45ca-a1de-6d5e20511a17 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:34.012820 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9fbce1df-8381-4711-aa08-1a44ec16b4bd None None] DHCP port deletion for 00c105ea-e093-47a8-a669-bbdd36caea7e request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 05:02:34.028558 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-6c814cd8-b6b8-45ca-a1de-6d5e20511a17 admin admin] Calling delete_port for 6a95e148-2072-45a9-9503-b388ed9e2ef8 owned by network:dhcp {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:02:34.059294 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-9fbce1df-8381-4711-aa08-1a44ec16b4bd None None] Deleting port 6a95e148-2072-45a9-9503-b388ed9e2ef8 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:02:34.059663 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9fbce1df-8381-4711-aa08-1a44ec16b4bd None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:34.130975 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-9fbce1df-8381-4711-aa08-1a44ec16b4bd None None] For port 6a95e148-2072-45a9-9503-b388ed9e2ef8, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=6a95e148-2072-45a9-9503-b388ed9e2ef8,segment=NetworkSegment(794d91f6-937c-4e26-8ecc-34550b214f4a),segment_id=794d91f6-937c-4e26-8ecc-34550b214f4a)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:02:34.130975 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9fbce1df-8381-4711-aa08-1a44ec16b4bd None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:34.219737 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6c814cd8-b6b8-45ca-a1de-6d5e20511a17 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:34.245386 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c814cd8-b6b8-45ca-a1de-6d5e20511a17 admin admin] Pushing event deleted for resources: {'Port': ['ID=6a95e148-2072-45a9-9503-b388ed9e2ef8,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:02:34.251872 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6c814cd8-b6b8-45ca-a1de-6d5e20511a17 admin admin] No DVR routers for this DVR port 6a95e148-2072-45a9-9503-b388ed9e2ef8 on host dv-neutron-816802-2-hyperv {{(pid=102161) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 05:02:34.282451 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 71172a82-2f01-4a5b-bd07-bfe538c2ae92 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 05:02:34.286387 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-9fbce1df-8381-4711-aa08-1a44ec16b4bd None None] Calling delete_port for 6a95e148-2072-45a9-9503-b388ed9e2ef8 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:02:34.305774 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 71172a82-2f01-4a5b-bd07-bfe538c2ae92 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 05:02:34.306112 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 71172a82-2f01-4a5b-bd07-bfe538c2ae92 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 05:02:34.306542 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 940c1a94-9aed-4b5a-b999-df6f009eebec no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 05:02:34.327548 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6c814cd8-b6b8-45ca-a1de-6d5e20511a17 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:34.330429 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 940c1a94-9aed-4b5a-b999-df6f009eebec {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 05:02:34.330764 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 940c1a94-9aed-4b5a-b999-df6f009eebec not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 05:02:34.331168 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 6a95e148-2072-45a9-9503-b388ed9e2ef8 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 05:02:34.348544 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-6c814cd8-b6b8-45ca-a1de-6d5e20511a17 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['00c105ea-e093-47a8-a669-bbdd36caea7e']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:02:34.357887 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-6c814cd8-b6b8-45ca-a1de-6d5e20511a17 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '794d91f6-937c-4e26-8ecc-34550b214f4a') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:02:34.358178 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-6c814cd8-b6b8-45ca-a1de-6d5e20511a17 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '794d91f6-937c-4e26-8ecc-34550b214f4a') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:02:34.367438 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6c814cd8-b6b8-45ca-a1de-6d5e20511a17 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:34.378666 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 6a95e148-2072-45a9-9503-b388ed9e2ef8 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 05:02:34.379010 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 6a95e148-2072-45a9-9503-b388ed9e2ef8 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 05:02:34.380466 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6c814cd8-b6b8-45ca-a1de-6d5e20511a17 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:34.386937 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6c814cd8-b6b8-45ca-a1de-6d5e20511a17 admin admin] Releasing vlan 311 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 05:02:34.387374 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6c814cd8-b6b8-45ca-a1de-6d5e20511a17 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:34.389168 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 05:02:34.389168 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 05:02:34.389168 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 05:02:34.389168 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 05:02:34.389168 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 05:02:34.389168 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 05:02:34.389168 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 05:02:34.389168 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 05:02:34.389168 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 05:02:34.389168 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 05:02:34.389168 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 05:02:34.389168 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 05:02:34.389168 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 05:02:34.389168 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 05:02:34.389168 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 05:02:34.389168 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 05:02:34.389168 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 05:02:34.389168 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 05:02:34.389168 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 05:02:34.389168 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 05:02:34.389168 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 05:02:34.389168 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 05:02:34.389168 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 05:02:34.389168 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 05:02:34.389168 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 05:02:34.389168 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 05:02:34.389168 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 05:02:34.389168 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 05:02:34.389168 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 05:02:34.389168 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 05:02:34.389168 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 05:02:34.389168 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 05:02:34.412874 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9fbce1df-8381-4711-aa08-1a44ec16b4bd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:34.436478 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fbce1df-8381-4711-aa08-1a44ec16b4bd None None] Pushing event deleted for resources: {'Port': ['ID=6a95e148-2072-45a9-9503-b388ed9e2ef8,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:02:34.441799 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9fbce1df-8381-4711-aa08-1a44ec16b4bd None None] No DVR routers for this DVR port 6a95e148-2072-45a9-9503-b388ed9e2ef8 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 05:02:34.448285 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fbce1df-8381-4711-aa08-1a44ec16b4bd None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:02:34.450835 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fbce1df-8381-4711-aa08-1a44ec16b4bd None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:02:34.450835 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fbce1df-8381-4711-aa08-1a44ec16b4bd None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:02:34.450835 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fbce1df-8381-4711-aa08-1a44ec16b4bd None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:02:34.450835 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fbce1df-8381-4711-aa08-1a44ec16b4bd None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:02:34.450835 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fbce1df-8381-4711-aa08-1a44ec16b4bd None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:02:34.450835 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fbce1df-8381-4711-aa08-1a44ec16b4bd None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:02:34.450835 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fbce1df-8381-4711-aa08-1a44ec16b4bd None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:02:34.450835 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fbce1df-8381-4711-aa08-1a44ec16b4bd None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:02:34.452197 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fbce1df-8381-4711-aa08-1a44ec16b4bd None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:02:34.452197 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fbce1df-8381-4711-aa08-1a44ec16b4bd None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:02:34.452197 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fbce1df-8381-4711-aa08-1a44ec16b4bd None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:02:34.519855 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6c814cd8-b6b8-45ca-a1de-6d5e20511a17 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:34.526053 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6c814cd8-b6b8-45ca-a1de-6d5e20511a17 admin admin] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:34.529314 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-6c814cd8-b6b8-45ca-a1de-6d5e20511a17 admin admin] 10.222.0.24 "DELETE /v2.0/networks/00c105ea-e093-47a8-a669-bbdd36caea7e HTTP/1.1" status: 204 len: 168 time: 0.7291543 Nov 09 05:02:34.532415 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 36596) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:02:34.538619 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c814cd8-b6b8-45ca-a1de-6d5e20511a17 admin admin] Pushing event deleted for resources: {'Network': ['ID=00c105ea-e093-47a8-a669-bbdd36caea7e,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:02:34.869577 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-923d9c2e-065b-4947-9a09-0d9679ba173b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:35.115991 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-923d9c2e-065b-4947-9a09-0d9679ba173b admin admin] Deleting port 425a6f17-f8fe-4b37-acbe-e4d444d82fdf {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:02:35.116327 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-923d9c2e-065b-4947-9a09-0d9679ba173b admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:35.192436 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-923d9c2e-065b-4947-9a09-0d9679ba173b admin admin] For port 425a6f17-f8fe-4b37-acbe-e4d444d82fdf, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=425a6f17-f8fe-4b37-acbe-e4d444d82fdf,segment=NetworkSegment(738caf23-8b9f-4d17-8ee7-de5d5eb9911b),segment_id=738caf23-8b9f-4d17-8ee7-de5d5eb9911b)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:02:35.192711 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-923d9c2e-065b-4947-9a09-0d9679ba173b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:35.207532 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-923d9c2e-065b-4947-9a09-0d9679ba173b admin admin] Calling delete_port for 425a6f17-f8fe-4b37-acbe-e4d444d82fdf owned by network:router_interface {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:02:35.468913 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-923d9c2e-065b-4947-9a09-0d9679ba173b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:35.497775 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-923d9c2e-065b-4947-9a09-0d9679ba173b admin admin] Pushing event deleted for resources: {'Port': ['ID=425a6f17-f8fe-4b37-acbe-e4d444d82fdf,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:02:35.664267 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-923d9c2e-065b-4947-9a09-0d9679ba173b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:35.875148 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-923d9c2e-065b-4947-9a09-0d9679ba173b admin admin] Router eaafe462-aab0-4eb9-ad19-8d94cfbfa3b5 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 05:02:35.980861 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-923d9c2e-065b-4947-9a09-0d9679ba173b admin admin] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 05:02:35.985839 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-923d9c2e-065b-4947-9a09-0d9679ba173b admin admin] 10.222.0.24 "PUT /v2.0/routers/eaafe462-aab0-4eb9-ad19-8d94cfbfa3b5/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4524059 Nov 09 05:02:35.988492 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 36598) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:02:35.989641 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7b48a918-9544-4496-8de8-edc57044ac47 None None] Sync routers for ids ['eaafe462-aab0-4eb9-ad19-8d94cfbfa3b5'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 05:02:35.999668 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7b48a918-9544-4496-8de8-edc57044ac47 None None] Routers {'eaafe462-aab0-4eb9-ad19-8d94cfbfa3b5'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:02:36.000355 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-7b48a918-9544-4496-8de8-edc57044ac47 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:02:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['eaafe462-aab0-4eb9-ad19-8d94cfbfa3b5'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:02:36.090644 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-566f6527-ca50-4ea2-8c29-deff315c95cb admin admin] Publish callbacks [] for router, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:36.104367 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-7b48a918-9544-4496-8de8-edc57044ac47 None None] Set router eaafe462-aab0-4eb9-ad19-8d94cfbfa3b5 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:02:36.195853 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-566f6527-ca50-4ea2-8c29-deff315c95cb admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:36.286776 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-7b48a918-9544-4496-8de8-edc57044ac47 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eaafe462-aab0-4eb9-ad19-8d94cfbfa3b5', 'name': 'tempest-TestMinimumBasicScenario-834123603-router', 'tenant_id': 'b4616cd401a642fa991081a387f60221', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.82'}], 'enable_snat': True}, 'gw_port_id': 'df811dcb-d68b-49ad-91cb-0d21711c9980', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:00:17Z', 'updated_at': '2021-11-09T05:02:35Z', 'revision_number': 5, 'project_id': 'b4616cd401a642fa991081a387f60221', 'gw_port': {'id': 'df811dcb-d68b-49ad-91cb-0d21711c9980', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:02:b6:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eaafe462-aab0-4eb9-ad19-8d94cfbfa3b5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1679, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.82', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:00:18Z', 'updated_at': '2021-11-09T05:00:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:02:36.311363 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-566f6527-ca50-4ea2-8c29-deff315c95cb admin admin] Deleting port df811dcb-d68b-49ad-91cb-0d21711c9980 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:02:36.311708 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-566f6527-ca50-4ea2-8c29-deff315c95cb admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:36.312442 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7b48a918-9544-4496-8de8-edc57044ac47 None None] Checking router: eaafe462-aab0-4eb9-ad19-8d94cfbfa3b5 for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 05:02:36.321206 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7b48a918-9544-4496-8de8-edc57044ac47 None None] Routers {'eaafe462-aab0-4eb9-ad19-8d94cfbfa3b5'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:02:36.321795 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-7b48a918-9544-4496-8de8-edc57044ac47 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:02:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['eaafe462-aab0-4eb9-ad19-8d94cfbfa3b5'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:02:36.389337 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-566f6527-ca50-4ea2-8c29-deff315c95cb admin admin] For port df811dcb-d68b-49ad-91cb-0d21711c9980, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=df811dcb-d68b-49ad-91cb-0d21711c9980,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:02:36.389627 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-566f6527-ca50-4ea2-8c29-deff315c95cb admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:36.403292 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-566f6527-ca50-4ea2-8c29-deff315c95cb admin admin] Calling delete_port for df811dcb-d68b-49ad-91cb-0d21711c9980 owned by network:router_gateway {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:02:36.493517 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-7b48a918-9544-4496-8de8-edc57044ac47 None None] Set router eaafe462-aab0-4eb9-ad19-8d94cfbfa3b5 gateway port host: None {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:02:36.542896 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-7b48a918-9544-4496-8de8-edc57044ac47 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eaafe462-aab0-4eb9-ad19-8d94cfbfa3b5', 'name': 'tempest-TestMinimumBasicScenario-834123603-router', 'tenant_id': 'b4616cd401a642fa991081a387f60221', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:00:17Z', 'updated_at': '2021-11-09T05:02:36Z', 'revision_number': 6, 'project_id': 'b4616cd401a642fa991081a387f60221', 'gw_port_host': None}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:02:36.572798 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7b48a918-9544-4496-8de8-edc57044ac47 None None] The sync data for ids ['eaafe462-aab0-4eb9-ad19-8d94cfbfa3b5'] in dv-neutron-816802-2-hyperv is: [{'id': 'eaafe462-aab0-4eb9-ad19-8d94cfbfa3b5', 'name': 'tempest-TestMinimumBasicScenario-834123603-router', 'tenant_id': 'b4616cd401a642fa991081a387f60221', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:00:17Z', 'updated_at': '2021-11-09T05:02:36Z', 'revision_number': 6, 'project_id': 'b4616cd401a642fa991081a387f60221', 'gw_port_host': None}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 05:02:36.636184 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-566f6527-ca50-4ea2-8c29-deff315c95cb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:36.661226 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-566f6527-ca50-4ea2-8c29-deff315c95cb admin admin] Pushing event deleted for resources: {'Port': ['ID=df811dcb-d68b-49ad-91cb-0d21711c9980,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:02:36.727886 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-566f6527-ca50-4ea2-8c29-deff315c95cb admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-466373'] for router_gateway, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:36.816090 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-566f6527-ca50-4ea2-8c29-deff315c95cb admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:36.818192 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-566f6527-ca50-4ea2-8c29-deff315c95cb admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:36.915974 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-566f6527-ca50-4ea2-8c29-deff315c95cb admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:36.916436 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-566f6527-ca50-4ea2-8c29-deff315c95cb admin admin] Fanout notify agent at l3_agent the message router_deleted on router eaafe462-aab0-4eb9-ad19-8d94cfbfa3b5 {{(pid=102162) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 05:02:36.920992 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-566f6527-ca50-4ea2-8c29-deff315c95cb admin admin] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:36.922152 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-566f6527-ca50-4ea2-8c29-deff315c95cb admin admin] 10.222.0.24 "DELETE /v2.0/routers/eaafe462-aab0-4eb9-ad19-8d94cfbfa3b5 HTTP/1.1" status: 204 len: 168 time: 0.9327469 Nov 09 05:02:36.925446 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36600) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:02:36.977049 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-6f5bb198-fc8a-4e64-963a-371cd91228b2 admin admin] Deleting subnet bffccedc-bf62-4420-b9fb-ed0e7ecf094d {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 05:02:36.980283 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6f5bb198-fc8a-4e64-963a-371cd91228b2 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:37.014927 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6f5bb198-fc8a-4e64-963a-371cd91228b2 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:37.089105 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6f5bb198-fc8a-4e64-963a-371cd91228b2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:37.213695 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6f5bb198-fc8a-4e64-963a-371cd91228b2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:37.241389 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f5bb198-fc8a-4e64-963a-371cd91228b2 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=bffccedc-bf62-4420-b9fb-ed0e7ecf094d,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:02:37.243350 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-6f5bb198-fc8a-4e64-963a-371cd91228b2 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:37.246636 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-6f5bb198-fc8a-4e64-963a-371cd91228b2 admin admin] 10.222.0.24 "DELETE /v2.0/subnets/bffccedc-bf62-4420-b9fb-ed0e7ecf094d HTTP/1.1" status: 204 len: 168 time: 0.3201301 Nov 09 05:02:37.250376 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-125a210e-8a95-4a4a-8898-b700ba33321c None None] Network b387818b-6e37-4702-9eba-91b6a2816fc6 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 05:02:37.250964 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36602) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:02:37.319492 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7e946763-936c-41ce-bb81-7c61c34ed328 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:37.375096 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-7e946763-936c-41ce-bb81-7c61c34ed328 admin admin] Deleting port b594387c-32e4-4340-8ed4-bc4d05554235 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:02:37.375440 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7e946763-936c-41ce-bb81-7c61c34ed328 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:37.437620 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9ea40f0d-aae8-4e90-8074-2dea9c8045f9 None None] DHCP port deletion for b387818b-6e37-4702-9eba-91b6a2816fc6 request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 05:02:37.453332 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-7e946763-936c-41ce-bb81-7c61c34ed328 admin admin] For port b594387c-32e4-4340-8ed4-bc4d05554235, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=b594387c-32e4-4340-8ed4-bc4d05554235,segment=NetworkSegment(738caf23-8b9f-4d17-8ee7-de5d5eb9911b),segment_id=738caf23-8b9f-4d17-8ee7-de5d5eb9911b)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:02:37.454102 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7e946763-936c-41ce-bb81-7c61c34ed328 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:37.475961 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-7e946763-936c-41ce-bb81-7c61c34ed328 admin admin] Calling delete_port for b594387c-32e4-4340-8ed4-bc4d05554235 owned by network:dhcp {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:02:37.507311 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-9ea40f0d-aae8-4e90-8074-2dea9c8045f9 None None] Deleting port b594387c-32e4-4340-8ed4-bc4d05554235 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:02:37.507678 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9ea40f0d-aae8-4e90-8074-2dea9c8045f9 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:37.576426 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-9ea40f0d-aae8-4e90-8074-2dea9c8045f9 None None] For port b594387c-32e4-4340-8ed4-bc4d05554235, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=b594387c-32e4-4340-8ed4-bc4d05554235,segment=NetworkSegment(738caf23-8b9f-4d17-8ee7-de5d5eb9911b),segment_id=738caf23-8b9f-4d17-8ee7-de5d5eb9911b)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:02:37.576819 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9ea40f0d-aae8-4e90-8074-2dea9c8045f9 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:37.592788 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-9ea40f0d-aae8-4e90-8074-2dea9c8045f9 None None] Calling delete_port for b594387c-32e4-4340-8ed4-bc4d05554235 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:02:37.639547 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7e946763-936c-41ce-bb81-7c61c34ed328 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:37.668856 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9ea40f0d-aae8-4e90-8074-2dea9c8045f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:37.673726 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7e946763-936c-41ce-bb81-7c61c34ed328 admin admin] No DVR routers for this DVR port b594387c-32e4-4340-8ed4-bc4d05554235 on host dv-neutron-816802-2-hyperv {{(pid=102161) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 05:02:37.677863 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e946763-936c-41ce-bb81-7c61c34ed328 admin admin] Pushing event deleted for resources: {'Port': ['ID=b594387c-32e4-4340-8ed4-bc4d05554235,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:02:37.694611 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ea40f0d-aae8-4e90-8074-2dea9c8045f9 None None] Pushing event deleted for resources: {'Port': ['ID=b594387c-32e4-4340-8ed4-bc4d05554235,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:02:37.698153 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9ea40f0d-aae8-4e90-8074-2dea9c8045f9 None None] No DVR routers for this DVR port b594387c-32e4-4340-8ed4-bc4d05554235 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 05:02:37.749049 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7e946763-936c-41ce-bb81-7c61c34ed328 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:37.769934 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-7e946763-936c-41ce-bb81-7c61c34ed328 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b387818b-6e37-4702-9eba-91b6a2816fc6']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:02:37.779093 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-7e946763-936c-41ce-bb81-7c61c34ed328 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '738caf23-8b9f-4d17-8ee7-de5d5eb9911b') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:02:37.779393 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-7e946763-936c-41ce-bb81-7c61c34ed328 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '738caf23-8b9f-4d17-8ee7-de5d5eb9911b') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:02:37.792325 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7e946763-936c-41ce-bb81-7c61c34ed328 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:37.805493 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7e946763-936c-41ce-bb81-7c61c34ed328 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:37.811318 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7e946763-936c-41ce-bb81-7c61c34ed328 admin admin] Releasing vlan 304 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 05:02:37.816502 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7e946763-936c-41ce-bb81-7c61c34ed328 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:37.816502 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 05:02:37.816502 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 05:02:37.816502 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 05:02:37.816502 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 05:02:37.816502 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 05:02:37.816502 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 05:02:37.816502 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 05:02:37.816502 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 05:02:37.816502 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 05:02:37.816502 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 05:02:37.816502 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 05:02:37.816502 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 05:02:37.816502 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 05:02:37.816502 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 05:02:37.816502 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 05:02:37.816502 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 05:02:37.816502 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 05:02:37.816502 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 05:02:37.816502 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 05:02:37.816502 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 05:02:37.816502 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 05:02:37.816502 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 05:02:37.816502 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 05:02:37.816502 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 05:02:37.816502 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 05:02:37.816502 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 05:02:37.816502 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 05:02:37.816502 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 05:02:37.816502 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 05:02:37.816502 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 05:02:37.816502 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 05:02:37.816502 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 05:02:37.944719 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7e946763-936c-41ce-bb81-7c61c34ed328 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:37.949462 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7e946763-936c-41ce-bb81-7c61c34ed328 admin admin] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:37.952768 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-7e946763-936c-41ce-bb81-7c61c34ed328 admin admin] 10.222.0.24 "DELETE /v2.0/networks/b387818b-6e37-4702-9eba-91b6a2816fc6 HTTP/1.1" status: 204 len: 168 time: 0.7027018 Nov 09 05:02:37.965599 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e946763-936c-41ce-bb81-7c61c34ed328 admin admin] Pushing event deleted for resources: {'Network': ['ID=b387818b-6e37-4702-9eba-91b6a2816fc6,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:02:38.179978 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device b594387c-32e4-4340-8ed4-bc4d05554235 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 05:02:38.203271 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: b594387c-32e4-4340-8ed4-bc4d05554235 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 05:02:38.203607 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device b594387c-32e4-4340-8ed4-bc4d05554235 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 05:02:38.204016 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device df811dcb-d68b-49ad-91cb-0d21711c9980 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 05:02:38.223725 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: df811dcb-d68b-49ad-91cb-0d21711c9980 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 05:02:38.224061 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device df811dcb-d68b-49ad-91cb-0d21711c9980 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 05:02:38.224481 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 425a6f17-f8fe-4b37-acbe-e4d444d82fdf no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 05:02:38.245924 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 425a6f17-f8fe-4b37-acbe-e4d444d82fdf {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 05:02:38.246270 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 425a6f17-f8fe-4b37-acbe-e4d444d82fdf not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 05:02:38.324925 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36606) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:02:38.364193 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a6816fc6-03d6-4a9c-b1be-7d406f9ae90a admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=6342064e2f4e4d17a45b74d8725885ef&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0380812 Nov 09 05:02:38.366610 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36608) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:02:38.411198 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a6e6d32f-86ae-4f7a-a507-3c193ad153c8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:38.435855 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a6e6d32f-86ae-4f7a-a507-3c193ad153c8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:38.555905 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a6e6d32f-86ae-4f7a-a507-3c193ad153c8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:38.559722 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a6e6d32f-86ae-4f7a-a507-3c193ad153c8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:38.560939 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a6e6d32f-86ae-4f7a-a507-3c193ad153c8 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/cd821237-9f21-4bf9-9e32-fce1986821ee HTTP/1.1" status: 204 len: 168 time: 0.1933994 Nov 09 05:02:38.570478 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6e6d32f-86ae-4f7a-a507-3c193ad153c8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cd821237-9f21-4bf9-9e32-fce1986821ee,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:02:39.249676 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36614) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:02:39.289080 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-8ac8e6ad-096a-4a14-9704-afaa827bb144 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=b4616cd401a642fa991081a387f60221&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0382845 Nov 09 05:02:39.291540 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36616) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:02:39.336961 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9903ced7-9a4f-4436-add1-dd8aa5ff44ec admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:39.357250 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9903ced7-9a4f-4436-add1-dd8aa5ff44ec admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:39.475477 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9903ced7-9a4f-4436-add1-dd8aa5ff44ec admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:39.477978 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9903ced7-9a4f-4436-add1-dd8aa5ff44ec admin admin] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:39.479129 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-9903ced7-9a4f-4436-add1-dd8aa5ff44ec admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/fabcc4cf-0a4f-487a-8a8a-485b7221d091 HTTP/1.1" status: 204 len: 168 time: 0.1867249 Nov 09 05:02:39.487811 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9903ced7-9a4f-4436-add1-dd8aa5ff44ec admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fabcc4cf-0a4f-487a-8a8a-485b7221d091,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:02:41.343982 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8e3aceab-a92e-4ef6-81c7-66169b459574 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:41.855950 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36656) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:02:41.860614 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-f794a6d5-21f0-452a-b164-bf269b87e959 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1326205803', 'description': 'tempest-secgroup-smoke-1326205803 description', 'project_id': '8ac3eab68bd34485af7ddc3417853b28'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:02:42.007431 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f794a6d5-21f0-452a-b164-bf269b87e959 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:42.015548 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f794a6d5-21f0-452a-b164-bf269b87e959 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:42.090142 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f794a6d5-21f0-452a-b164-bf269b87e959 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:42.161030 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f794a6d5-21f0-452a-b164-bf269b87e959 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:42.194901 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f794a6d5-21f0-452a-b164-bf269b87e959 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'SecurityGroup': ['ID=07d4b291-c99a-49a3-b3a8-943a6c9c4013,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:02:42.234131 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f794a6d5-21f0-452a-b164-bf269b87e959 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:42.315778 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f794a6d5-21f0-452a-b164-bf269b87e959 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:42.343543 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f794a6d5-21f0-452a-b164-bf269b87e959 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'SecurityGroup': ['ID=072bd602-b45e-4156-a831-2cb9a9e0ed3a,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:02:42.432087 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f794a6d5-21f0-452a-b164-bf269b87e959 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:42.433360 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-f794a6d5-21f0-452a-b164-bf269b87e959 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.5763781 Nov 09 05:02:42.436210 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36658) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:02:42.442087 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-5e368468-adaf-4c96-a8f5-cd7ba8e36cfc tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'security_group_rule': {'security_group_id': '072bd602-b45e-4156-a831-2cb9a9e0ed3a', 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:02:42.458557 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:42.552540 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5e368468-adaf-4c96-a8f5-cd7ba8e36cfc tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:42.605952 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5e368468-adaf-4c96-a8f5-cd7ba8e36cfc tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:42.692261 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5e368468-adaf-4c96-a8f5-cd7ba8e36cfc tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:42.711446 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e368468-adaf-4c96-a8f5-cd7ba8e36cfc tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=cb924a4a-09fa-4fe4-8d05-3e52ac449246,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:02:42.779970 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5e368468-adaf-4c96-a8f5-cd7ba8e36cfc tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:42.781144 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-5e368468-adaf-4c96-a8f5-cd7ba8e36cfc tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3440392 Nov 09 05:02:42.783835 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36660) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:02:42.788097 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-5212b6c5-bef0-40b3-8e60-450d8f88c6c9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'security_group_rule': {'security_group_id': '072bd602-b45e-4156-a831-2cb9a9e0ed3a', 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:02:42.874178 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5212b6c5-bef0-40b3-8e60-450d8f88c6c9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:42.928032 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5212b6c5-bef0-40b3-8e60-450d8f88c6c9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:43.029843 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5212b6c5-bef0-40b3-8e60-450d8f88c6c9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:43.047239 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5212b6c5-bef0-40b3-8e60-450d8f88c6c9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8e045d04-8ecb-460d-93db-c7f44436ca21,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:02:43.117258 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5212b6c5-bef0-40b3-8e60-450d8f88c6c9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:43.118481 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-5212b6c5-bef0-40b3-8e60-450d8f88c6c9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.3337142 Nov 09 05:02:43.121206 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36662) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:02:43.125541 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-7b5329f3-bc69-46b9-9662-3ef67b871d3e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'security_group_rule': {'security_group_id': '072bd602-b45e-4156-a831-2cb9a9e0ed3a', 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:02:43.216791 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7b5329f3-bc69-46b9-9662-3ef67b871d3e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:43.275614 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7b5329f3-bc69-46b9-9662-3ef67b871d3e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:43.349632 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7b5329f3-bc69-46b9-9662-3ef67b871d3e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:43.366895 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b5329f3-bc69-46b9-9662-3ef67b871d3e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=869381b3-98dd-462b-9d61-4e276195f91d,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:02:43.437086 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7b5329f3-bc69-46b9-9662-3ef67b871d3e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:43.438223 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-7b5329f3-bc69-46b9-9662-3ef67b871d3e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3161123 Nov 09 05:02:43.441128 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36664) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:02:43.445445 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-59548d72-48a5-4ba5-8353-56904612022e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'security_group_rule': {'security_group_id': '072bd602-b45e-4156-a831-2cb9a9e0ed3a', 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:02:43.537119 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-59548d72-48a5-4ba5-8353-56904612022e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:43.592267 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-59548d72-48a5-4ba5-8353-56904612022e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:43.663796 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-59548d72-48a5-4ba5-8353-56904612022e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:43.682463 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59548d72-48a5-4ba5-8353-56904612022e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=cb69671e-97e1-4c64-8e21-b7b4c8697143,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:02:43.720929 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4ef47673-4182-44bf-9a94-992f8e2e5402 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:43.750140 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-59548d72-48a5-4ba5-8353-56904612022e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:43.751490 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-59548d72-48a5-4ba5-8353-56904612022e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3094180 Nov 09 05:02:43.754188 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36666) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:02:43.758551 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-8c0dcb18-b6fc-4868-8349-d2b07080e345 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'security_group_rule': {'security_group_id': '072bd602-b45e-4156-a831-2cb9a9e0ed3a', 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:02:43.841042 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.securitygroups_db [None req-8c0dcb18-b6fc-4868-8349-d2b07080e345 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Project 8ac3eab68bd34485af7ddc3417853b28 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 09 05:02:43.845860 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8c0dcb18-b6fc-4868-8349-d2b07080e345 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:43.902597 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8c0dcb18-b6fc-4868-8349-d2b07080e345 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:43.993793 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8c0dcb18-b6fc-4868-8349-d2b07080e345 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:44.012054 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c0dcb18-b6fc-4868-8349-d2b07080e345 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a1459f9e-1c6a-4c1e-9c45-66bbdb6d3cd4,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:02:44.084101 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8c0dcb18-b6fc-4868-8349-d2b07080e345 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:44.085300 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-8c0dcb18-b6fc-4868-8349-d2b07080e345 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.3301866 Nov 09 05:02:44.088362 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36668) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:02:44.092598 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-46499298-9ec2-4072-92b9-039ed43eb96a tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'security_group_rule': {'security_group_id': '072bd602-b45e-4156-a831-2cb9a9e0ed3a', 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:02:44.218418 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.securitygroups_db [None req-46499298-9ec2-4072-92b9-039ed43eb96a tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Project 8ac3eab68bd34485af7ddc3417853b28 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 09 05:02:44.223291 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-46499298-9ec2-4072-92b9-039ed43eb96a tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:44.282797 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-46499298-9ec2-4072-92b9-039ed43eb96a tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:44.388043 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-46499298-9ec2-4072-92b9-039ed43eb96a tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:44.405962 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46499298-9ec2-4072-92b9-039ed43eb96a tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0a306637-5636-4bf5-b214-061c44b41f65,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:02:44.489230 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-46499298-9ec2-4072-92b9-039ed43eb96a tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:44.490467 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-46499298-9ec2-4072-92b9-039ed43eb96a tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.4011943 Nov 09 05:02:44.493396 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36670) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:02:44.498207 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-aa49cad9-672e-48e0-bb38-e93b4619df01 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'network': {'name': 'tempest-network-smoke--1131966567', 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'port_security_enabled': True}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:02:44.593693 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-aa49cad9-672e-48e0-bb38-e93b4619df01 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Made reservation on behalf of 8ac3eab68bd34485af7ddc3417853b28 for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 05:02:44.597132 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-aa49cad9-672e-48e0-bb38-e93b4619df01 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:44.619825 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-aa49cad9-672e-48e0-bb38-e93b4619df01 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 336} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 05:02:44.628225 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-aa49cad9-672e-48e0-bb38-e93b4619df01 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:44.628560 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-aa49cad9-672e-48e0-bb38-e93b4619df01 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Added segment e5bca6a2-17ea-4ff0-8af7-dc2717016f87 of type vlan for network e6d0e278-6b66-4438-954b-591e77b9717d Nov 09 05:02:44.666707 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-aa49cad9-672e-48e0-bb38-e93b4619df01 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:44.776329 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-aa49cad9-672e-48e0-bb38-e93b4619df01 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:44.781934 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aa49cad9-672e-48e0-bb38-e93b4619df01 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:02:44.784035 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-aa49cad9-672e-48e0-bb38-e93b4619df01 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:44.847966 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa49cad9-672e-48e0-bb38-e93b4619df01 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'Network': ['ID=e6d0e278-6b66-4438-954b-591e77b9717d,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:02:44.858558 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network e6d0e278-6b66-4438-954b-591e77b9717d details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 05:02:44.895852 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-aa49cad9-672e-48e0-bb38-e93b4619df01 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.4014468 Nov 09 05:02:44.898718 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36672) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:02:44.904549 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-8095ebbb-0242-44e5-b36a-f1d2b67b9817 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'router': {'name': 'tempest-TestNetworkAdvancedServerOps-router-86155025', 'admin_state_up': True, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:02:45.022990 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8095ebbb-0242-44e5-b36a-f1d2b67b9817 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:45.024075 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8095ebbb-0242-44e5-b36a-f1d2b67b9817 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:45.073420 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8095ebbb-0242-44e5-b36a-f1d2b67b9817 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:45.200940 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:45.295997 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8095ebbb-0242-44e5-b36a-f1d2b67b9817 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:45.535560 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8095ebbb-0242-44e5-b36a-f1d2b67b9817 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for router_gateway, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:45.557591 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8095ebbb-0242-44e5-b36a-f1d2b67b9817 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:45.656661 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-8095ebbb-0242-44e5-b36a-f1d2b67b9817 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Allocated IP 172.26.0.223 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/8658c0af-8b24-4ca6-954a-776ea8725321) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 05:02:45.759382 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8095ebbb-0242-44e5-b36a-f1d2b67b9817 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:45.859117 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8095ebbb-0242-44e5-b36a-f1d2b67b9817 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:45.898328 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8095ebbb-0242-44e5-b36a-f1d2b67b9817 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:02:45.905457 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-8095ebbb-0242-44e5-b36a-f1d2b67b9817 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:02:45.910057 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8095ebbb-0242-44e5-b36a-f1d2b67b9817 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 05:02:45.913369 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8095ebbb-0242-44e5-b36a-f1d2b67b9817 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'Port': ['ID=8658c0af-8b24-4ca6-954a-776ea8725321,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:02:46.235172 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8095ebbb-0242-44e5-b36a-f1d2b67b9817 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for router_gateway, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:46.582203 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:46.703603 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8095ebbb-0242-44e5-b36a-f1d2b67b9817 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:46.875538 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8095ebbb-0242-44e5-b36a-f1d2b67b9817 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Router 19d0b855-419d-49a2-be7f-62683e5ccead is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102161) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 05:02:46.981789 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8095ebbb-0242-44e5-b36a-f1d2b67b9817 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 05:02:46.991412 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6db3251c-6da4-4645-a293-0c20d89b67de None None] Sync routers for ids ['19d0b855-419d-49a2-be7f-62683e5ccead'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 05:02:47.000433 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6db3251c-6da4-4645-a293-0c20d89b67de None None] Routers {'19d0b855-419d-49a2-be7f-62683e5ccead'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:02:47.001045 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-6db3251c-6da4-4645-a293-0c20d89b67de None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:02:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['19d0b855-419d-49a2-be7f-62683e5ccead'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:02:47.035786 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:47.060127 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8095ebbb-0242-44e5-b36a-f1d2b67b9817 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:47.064437 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-8095ebbb-0242-44e5-b36a-f1d2b67b9817 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 894 time: 2.1616731 Nov 09 05:02:47.064591 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36674) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:02:47.106024 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-6db3251c-6da4-4645-a293-0c20d89b67de None None] Set router 19d0b855-419d-49a2-be7f-62683e5ccead gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:02:47.183445 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-f76b3b3c-0e46-4756-be48-220f22f1d961 tempest-TestNetworkAdvancedServerOps-1212315804 tempest-TestNetworkAdvancedServerOps-1212315804-project-admin] 10.222.0.24 "GET /v2.0/subnets?project_id=8ac3eab68bd34485af7ddc3417853b28&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.1175156 Nov 09 05:02:47.186134 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36678) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:02:47.273890 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e835ee27-9c83-4833-894a-24bc5320107c tempest-TestNetworkAdvancedServerOps-1212315804 tempest-TestNetworkAdvancedServerOps-1212315804-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:02:47.275407 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-e835ee27-9c83-4833-894a-24bc5320107c tempest-TestNetworkAdvancedServerOps-1212315804 tempest-TestNetworkAdvancedServerOps-1212315804-project-admin] 10.222.0.24 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.0883479 Nov 09 05:02:47.278158 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36680) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:02:47.281590 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-6db3251c-6da4-4645-a293-0c20d89b67de None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '19d0b855-419d-49a2-be7f-62683e5ccead', 'name': 'tempest-TestNetworkAdvancedServerOps-router-86155025', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.223'}], 'enable_snat': True}, 'gw_port_id': '8658c0af-8b24-4ca6-954a-776ea8725321', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:02:45Z', 'updated_at': '2021-11-09T05:02:46Z', 'revision_number': 3, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': '8658c0af-8b24-4ca6-954a-776ea8725321', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:79:a1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '19d0b855-419d-49a2-be7f-62683e5ccead', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1710, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.223', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:02:45Z', 'updated_at': '2021-11-09T05:02:45Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:02:47.305578 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-087d53a8-afc3-421c-b8c4-de92449353be tempest-TestNetworkAdvancedServerOps-1212315804 tempest-TestNetworkAdvancedServerOps-1212315804-project-admin] 10.222.0.24 "GET /v2.0/subnets?network_id=2b6725f5-ebfe-485a-8f42-ccb5a241ddb5&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0263591 Nov 09 05:02:47.307679 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6db3251c-6da4-4645-a293-0c20d89b67de None None] Checking router: 19d0b855-419d-49a2-be7f-62683e5ccead for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 05:02:47.308119 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6db3251c-6da4-4645-a293-0c20d89b67de None None] Updating router 19d0b855-419d-49a2-be7f-62683e5ccead port 8658c0af-8b24-4ca6-954a-776ea8725321 binding host dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 05:02:47.308521 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36682) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:02:47.313507 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-a31710ba-7ccb-45c3-ae2a-40c9c503feae tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-528324791', 'network_id': 'e6d0e278-6b66-4438-954b-591e77b9717d', 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:02:47.336678 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6db3251c-6da4-4645-a293-0c20d89b67de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:47.492503 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a31710ba-7ccb-45c3-ae2a-40c9c503feae tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Made reservation on behalf of 8ac3eab68bd34485af7ddc3417853b28 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 05:02:47.496422 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a31710ba-7ccb-45c3-ae2a-40c9c503feae tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:47.578861 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6db3251c-6da4-4645-a293-0c20d89b67de None None] Publish callbacks [] for port, precommit_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:47.658141 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6db3251c-6da4-4645-a293-0c20d89b67de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:47.709675 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-6db3251c-6da4-4645-a293-0c20d89b67de None None] Attempting to bind port 8658c0af-8b24-4ca6-954a-776ea8725321 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 05:02:47.710033 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-6db3251c-6da4-4645-a293-0c20d89b67de None None] Attempting to bind port 8658c0af-8b24-4ca6-954a-776ea8725321 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 05:02:47.710418 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6db3251c-6da4-4645-a293-0c20d89b67de None None] Attempting to bind port 8658c0af-8b24-4ca6-954a-776ea8725321 on network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 05:02:47.717124 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-463282dd-9f39-436f-80a9-f9246e49c2d7 None None] Pushing event updated for resources: {'Port': ['ID=8658c0af-8b24-4ca6-954a-776ea8725321,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:02:47.720752 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6db3251c-6da4-4645-a293-0c20d89b67de None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 5, 2, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 05:02:47.721147 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6db3251c-6da4-4645-a293-0c20d89b67de None None] Checking segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 05:02:47.721544 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6db3251c-6da4-4645-a293-0c20d89b67de None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:47.721970 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6db3251c-6da4-4645-a293-0c20d89b67de None None] Bound using segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 05:02:47.722472 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-6db3251c-6da4-4645-a293-0c20d89b67de None None] Bound port: 8658c0af-8b24-4ca6-954a-776ea8725321, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 05:02:47.722849 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6db3251c-6da4-4645-a293-0c20d89b67de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:47.775125 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-6db3251c-6da4-4645-a293-0c20d89b67de None None] For port 8658c0af-8b24-4ca6-954a-776ea8725321, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 05:02:47.777136 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a31710ba-7ccb-45c3-ae2a-40c9c503feae tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:47.778069 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-6db3251c-6da4-4645-a293-0c20d89b67de None None] For port 8658c0af-8b24-4ca6-954a-776ea8725321, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=8658c0af-8b24-4ca6-954a-776ea8725321,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 05:02:47.838898 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a31710ba-7ccb-45c3-ae2a-40c9c503feae tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'Subnet': ['ID=4f2a77d5-99c4-4ea5-9dd3-8953e768f315,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:02:47.849403 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a31710ba-7ccb-45c3-ae2a-40c9c503feae tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Checking segment: {'id': 'e5bca6a2-17ea-4ff0-8af7-dc2717016f87', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': 'e6d0e278-6b66-4438-954b-591e77b9717d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 05:02:47.849760 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a31710ba-7ccb-45c3-ae2a-40c9c503feae tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Network hostable DHCP agents. Network: e6d0e278-6b66-4438-954b-591e77b9717d, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 05:02:47.858711 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6db3251c-6da4-4645-a293-0c20d89b67de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:47.913167 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6db3251c-6da4-4645-a293-0c20d89b67de None None] Routers {'19d0b855-419d-49a2-be7f-62683e5ccead'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:02:47.913769 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-6db3251c-6da4-4645-a293-0c20d89b67de None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:02:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['19d0b855-419d-49a2-be7f-62683e5ccead'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:02:47.950507 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a31710ba-7ccb-45c3-ae2a-40c9c503feae tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Network e6d0e278-6b66-4438-954b-591e77b9717d is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 05:02:47.951323 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-463282dd-9f39-436f-80a9-f9246e49c2d7 None None] Pushing event updated for resources: {'Port': ['ID=8658c0af-8b24-4ca6-954a-776ea8725321,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:02:48.023448 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-6db3251c-6da4-4645-a293-0c20d89b67de None None] Set router 19d0b855-419d-49a2-be7f-62683e5ccead gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:02:48.040839 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-a31710ba-7ccb-45c3-ae2a-40c9c503feae tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, e6d0e278-6b66-4438-954b-591e77b9717d) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:02:48.044838 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a31710ba-7ccb-45c3-ae2a-40c9c503feae tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:02:48.045432 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a31710ba-7ccb-45c3-ae2a-40c9c503feae tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:48.078865 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6d6ada30-be4c-456e-b7d8-a1a020dae40c None None] Network e6d0e278-6b66-4438-954b-591e77b9717d requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 05:02:48.138977 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a31710ba-7ccb-45c3-ae2a-40c9c503feae tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 831 time: 0.8262427 Nov 09 05:02:48.143137 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 36684) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:02:48.456085 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-74118491-26c7-4d1c-b103-f63c642bf802 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-e6d0e278-6b66-4438-954b-591e77b9717d', 'network_id': 'e6d0e278-6b66-4438-954b-591e77b9717d', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'fixed_ips': [{'subnet_id': '4f2a77d5-99c4-4ea5-9dd3-8953e768f315'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 05:02:48.456944 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-74118491-26c7-4d1c-b103-f63c642bf802 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:48.476822 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-6db3251c-6da4-4645-a293-0c20d89b67de None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '19d0b855-419d-49a2-be7f-62683e5ccead', 'name': 'tempest-TestNetworkAdvancedServerOps-router-86155025', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.223'}], 'enable_snat': True}, 'gw_port_id': '8658c0af-8b24-4ca6-954a-776ea8725321', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:02:45Z', 'updated_at': '2021-11-09T05:02:46Z', 'revision_number': 3, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': '8658c0af-8b24-4ca6-954a-776ea8725321', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:79:a1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '19d0b855-419d-49a2-be7f-62683e5ccead', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1710, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.223', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:02:45Z', 'updated_at': '2021-11-09T05:02:47Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:02:48.507301 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6db3251c-6da4-4645-a293-0c20d89b67de None None] The sync data for ids ['19d0b855-419d-49a2-be7f-62683e5ccead'] in dv-neutron-816802-2-hyperv is: [{'id': '19d0b855-419d-49a2-be7f-62683e5ccead', 'name': 'tempest-TestNetworkAdvancedServerOps-router-86155025', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.223'}], 'enable_snat': True}, 'gw_port_id': '8658c0af-8b24-4ca6-954a-776ea8725321', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:02:45Z', 'updated_at': '2021-11-09T05:02:46Z', 'revision_number': 3, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': '8658c0af-8b24-4ca6-954a-776ea8725321', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:79:a1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '19d0b855-419d-49a2-be7f-62683e5ccead', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1710, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.223', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:02:45Z', 'updated_at': '2021-11-09T05:02:47Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 05:02:48.631994 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-74118491-26c7-4d1c-b103-f63c642bf802 None None] Allocated IP 172.20.0.2 (e6d0e278-6b66-4438-954b-591e77b9717d/4f2a77d5-99c4-4ea5-9dd3-8953e768f315/475fb0cf-286d-4084-82c3-16361e5547a9) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 05:02:48.795837 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-74118491-26c7-4d1c-b103-f63c642bf802 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:48.882578 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-74118491-26c7-4d1c-b103-f63c642bf802 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:48.929430 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-74118491-26c7-4d1c-b103-f63c642bf802 None None] Network e6d0e278-6b66-4438-954b-591e77b9717d is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:02:48.936407 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-74118491-26c7-4d1c-b103-f63c642bf802 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:02:48.940797 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-74118491-26c7-4d1c-b103-f63c642bf802 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 05:02:48.948757 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74118491-26c7-4d1c-b103-f63c642bf802 None None] Pushing event updated for resources: {'Port': ['ID=475fb0cf-286d-4084-82c3-16361e5547a9,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:02:48.957814 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3d897a63-2e79-4a9f-9abc-8e2a504fd14d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:49.005384 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-74118491-26c7-4d1c-b103-f63c642bf802 None None] Attempting to bind port 475fb0cf-286d-4084-82c3-16361e5547a9 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 05:02:49.005844 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-74118491-26c7-4d1c-b103-f63c642bf802 None None] Attempting to bind port 475fb0cf-286d-4084-82c3-16361e5547a9 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'e5bca6a2-17ea-4ff0-8af7-dc2717016f87', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': 'e6d0e278-6b66-4438-954b-591e77b9717d'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 05:02:49.006278 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-74118491-26c7-4d1c-b103-f63c642bf802 None None] Attempting to bind port 475fb0cf-286d-4084-82c3-16361e5547a9 on network e6d0e278-6b66-4438-954b-591e77b9717d {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 05:02:49.011804 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-74118491-26c7-4d1c-b103-f63c642bf802 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 5, 2, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 05:02:49.012267 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-74118491-26c7-4d1c-b103-f63c642bf802 None None] Checking segment: {'id': 'e5bca6a2-17ea-4ff0-8af7-dc2717016f87', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': 'e6d0e278-6b66-4438-954b-591e77b9717d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 05:02:49.012734 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-74118491-26c7-4d1c-b103-f63c642bf802 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:49.013121 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-74118491-26c7-4d1c-b103-f63c642bf802 None None] Bound using segment: {'id': 'e5bca6a2-17ea-4ff0-8af7-dc2717016f87', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': 'e6d0e278-6b66-4438-954b-591e77b9717d'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 05:02:49.013587 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-74118491-26c7-4d1c-b103-f63c642bf802 None None] Bound port: 475fb0cf-286d-4084-82c3-16361e5547a9, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e5bca6a2-17ea-4ff0-8af7-dc2717016f87', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': 'e6d0e278-6b66-4438-954b-591e77b9717d'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 05:02:49.013965 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-74118491-26c7-4d1c-b103-f63c642bf802 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:49.080713 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-74118491-26c7-4d1c-b103-f63c642bf802 None None] For port 475fb0cf-286d-4084-82c3-16361e5547a9, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 05:02:49.085249 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-74118491-26c7-4d1c-b103-f63c642bf802 None None] For port 475fb0cf-286d-4084-82c3-16361e5547a9, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=475fb0cf-286d-4084-82c3-16361e5547a9,segment=NetworkSegment(e5bca6a2-17ea-4ff0-8af7-dc2717016f87),segment_id=e5bca6a2-17ea-4ff0-8af7-dc2717016f87)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 05:02:49.174844 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-74118491-26c7-4d1c-b103-f63c642bf802 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:49.242167 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74118491-26c7-4d1c-b103-f63c642bf802 None None] Pushing event updated for resources: {'Port': ['ID=475fb0cf-286d-4084-82c3-16361e5547a9,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:02:49.309076 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-3d897a63-2e79-4a9f-9abc-8e2a504fd14d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Allocated IP 172.20.0.1 (e6d0e278-6b66-4438-954b-591e77b9717d/4f2a77d5-99c4-4ea5-9dd3-8953e768f315/4b497baa-4c0e-4e33-8d3c-5902b0a8997f) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 05:02:49.441003 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3d897a63-2e79-4a9f-9abc-8e2a504fd14d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:49.457141 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 05:02:49.544233 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3d897a63-2e79-4a9f-9abc-8e2a504fd14d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:49.585746 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3d897a63-2e79-4a9f-9abc-8e2a504fd14d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Network e6d0e278-6b66-4438-954b-591e77b9717d is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:02:49.590687 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-3d897a63-2e79-4a9f-9abc-8e2a504fd14d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:02:49.593312 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3d897a63-2e79-4a9f-9abc-8e2a504fd14d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 05:02:49.618979 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d897a63-2e79-4a9f-9abc-8e2a504fd14d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'Port': ['ID=4b497baa-4c0e-4e33-8d3c-5902b0a8997f,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:02:49.641038 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3d897a63-2e79-4a9f-9abc-8e2a504fd14d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:49.850887 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3d897a63-2e79-4a9f-9abc-8e2a504fd14d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:50.124023 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3d897a63-2e79-4a9f-9abc-8e2a504fd14d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:50.183773 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3d897a63-2e79-4a9f-9abc-8e2a504fd14d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:50.242147 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 8658c0af-8b24-4ca6-954a-776ea8725321 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:02:50.260027 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d897a63-2e79-4a9f-9abc-8e2a504fd14d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'Port': ['ID=4b497baa-4c0e-4e33-8d3c-5902b0a8997f,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:02:50.264372 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3d897a63-2e79-4a9f-9abc-8e2a504fd14d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:50.295010 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 8658c0af-8b24-4ca6-954a-776ea8725321 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:02:50.295371 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:50.369764 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3d897a63-2e79-4a9f-9abc-8e2a504fd14d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Network e6d0e278-6b66-4438-954b-591e77b9717d is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:02:50.375322 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-3d897a63-2e79-4a9f-9abc-8e2a504fd14d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:02:50.380435 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:50.405203 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 8658c0af-8b24-4ca6-954a-776ea8725321, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=8658c0af-8b24-4ca6-954a-776ea8725321,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:02:50.475144 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:50.475939 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 475fb0cf-286d-4084-82c3-16361e5547a9 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:02:50.500728 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3d897a63-2e79-4a9f-9abc-8e2a504fd14d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Router 19d0b855-419d-49a2-be7f-62683e5ccead has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 05:02:50.572550 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=8658c0af-8b24-4ca6-954a-776ea8725321,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:02:50.576118 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 475fb0cf-286d-4084-82c3-16361e5547a9 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:02:50.576428 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:50.631444 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3d897a63-2e79-4a9f-9abc-8e2a504fd14d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 05:02:50.636750 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-3d897a63-2e79-4a9f-9abc-8e2a504fd14d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "PUT /v2.0/routers/19d0b855-419d-49a2-be7f-62683e5ccead/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.4963589 Nov 09 05:02:50.643623 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f2e21779-a148-440b-bffe-0b95c0dc9524 None None] Network e6d0e278-6b66-4438-954b-591e77b9717d requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 05:02:50.649189 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1e735ecf-5a8f-433c-a458-1f6c1e6a2105 None None] Sync routers for ids ['19d0b855-419d-49a2-be7f-62683e5ccead'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 05:02:50.659275 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1e735ecf-5a8f-433c-a458-1f6c1e6a2105 None None] Routers {'19d0b855-419d-49a2-be7f-62683e5ccead'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:02:50.659893 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-1e735ecf-5a8f-433c-a458-1f6c1e6a2105 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:02:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['19d0b855-419d-49a2-be7f-62683e5ccead'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:02:50.728294 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:50.760993 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-2635e7e7-6dcf-4147-9404-07f8084aaf87 None None] Provisioning complete for port 475fb0cf-286d-4084-82c3-16361e5547a9 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:02:50.761358 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-2635e7e7-6dcf-4147-9404-07f8084aaf87 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:50.782656 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-1e735ecf-5a8f-433c-a458-1f6c1e6a2105 None None] Set router 19d0b855-419d-49a2-be7f-62683e5ccead gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:02:50.800698 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-46a250e5-89b9-4ad1-98f8-620794fb92ed req-7cd4644b-e2d5-4e15-9217-b95460e5b31e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1326205803&fields=id&tenant_id=8ac3eab68bd34485af7ddc3417853b28 HTTP/1.1" status: 200 len: 267 time: 0.0479236 Nov 09 05:02:50.816224 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 475fb0cf-286d-4084-82c3-16361e5547a9, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=475fb0cf-286d-4084-82c3-16361e5547a9,segment=NetworkSegment(e5bca6a2-17ea-4ff0-8af7-dc2717016f87),segment_id=e5bca6a2-17ea-4ff0-8af7-dc2717016f87)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:02:50.889988 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:50.926987 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46a250e5-89b9-4ad1-98f8-620794fb92ed req-dab2c97d-b4f8-41e8-8289-3fc156f138cc tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:02:50.928503 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-46a250e5-89b9-4ad1-98f8-620794fb92ed req-dab2c97d-b4f8-41e8-8289-3fc156f138cc tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/networks?id=e6d0e278-6b66-4438-954b-591e77b9717d HTTP/1.1" status: 200 len: 797 time: 0.1186497 Nov 09 05:02:50.950953 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-46a250e5-89b9-4ad1-98f8-620794fb92ed req-ab969e40-3ba8-491d-a81d-be6df5b50429 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/quotas/8ac3eab68bd34485af7ddc3417853b28 HTTP/1.1" status: 200 len: 375 time: 0.0114076 Nov 09 05:02:50.956443 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-2635e7e7-6dcf-4147-9404-07f8084aaf87 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:50.986716 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=475fb0cf-286d-4084-82c3-16361e5547a9,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:02:51.003329 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-1e735ecf-5a8f-433c-a458-1f6c1e6a2105 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '19d0b855-419d-49a2-be7f-62683e5ccead', 'name': 'tempest-TestNetworkAdvancedServerOps-router-86155025', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.223'}], 'enable_snat': True}, 'gw_port_id': '8658c0af-8b24-4ca6-954a-776ea8725321', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:02:45Z', 'updated_at': '2021-11-09T05:02:49Z', 'revision_number': 4, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': '8658c0af-8b24-4ca6-954a-776ea8725321', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:79:a1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '19d0b855-419d-49a2-be7f-62683e5ccead', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1710, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.223', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:02:45Z', 'updated_at': '2021-11-09T05:02:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '4b497baa-4c0e-4e33-8d3c-5902b0a8997f', 'name': '', 'network_id': 'e6d0e278-6b66-4438-954b-591e77b9717d', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'mac_address': 'fa:16:3e:57:01:26', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '19d0b855-419d-49a2-be7f-62683e5ccead', 'device_owner': 'network:router_interface', 'standard_attr_id': 1713, 'fixed_ips': [{'subnet_id': '4f2a77d5-99c4-4ea5-9dd3-8953e768f315', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:02:49Z', 'updated_at': '2021-11-09T05:02:50Z', 'revision_number': 2, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'subnets': [{'id': '4f2a77d5-99c4-4ea5-9dd3-8953e768f315', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:02:51.029739 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-46a250e5-89b9-4ad1-98f8-620794fb92ed req-ef0db724-d178-4601-8ae4-27617e0fe3cc tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?tenant_id=8ac3eab68bd34485af7ddc3417853b28&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0696499 Nov 09 05:02:51.040454 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1e735ecf-5a8f-433c-a458-1f6c1e6a2105 None None] Checking router: 19d0b855-419d-49a2-be7f-62683e5ccead for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 05:02:51.040806 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1e735ecf-5a8f-433c-a458-1f6c1e6a2105 None None] Updating router 19d0b855-419d-49a2-be7f-62683e5ccead port 4b497baa-4c0e-4e33-8d3c-5902b0a8997f binding host dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 05:02:51.051998 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.db.api [None req-2635e7e7-6dcf-4147-9404-07f8084aaf87 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=102163) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 05:02:51.052343 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG oslo_db.api [None req-2635e7e7-6dcf-4147-9404-07f8084aaf87 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 05:02:51.066687 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-1e735ecf-5a8f-433c-a458-1f6c1e6a2105 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:51.137867 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-46a250e5-89b9-4ad1-98f8-620794fb92ed req-6b23dd78-4cd0-41e0-8813-38e87a5f7158 service neutron] 10.222.0.24 "GET /v2.0/networks/e6d0e278-6b66-4438-954b-591e77b9717d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0929213 Nov 09 05:02:51.239826 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-46a250e5-89b9-4ad1-98f8-620794fb92ed req-615b7932-c4d6-4b09-9a7a-78552633ca9c service neutron] 10.222.0.24 "GET /v2.0/networks/e6d0e278-6b66-4438-954b-591e77b9717d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0954094 Nov 09 05:02:51.348440 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-1e735ecf-5a8f-433c-a458-1f6c1e6a2105 None None] Publish callbacks [] for port, precommit_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:51.492478 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-1e735ecf-5a8f-433c-a458-1f6c1e6a2105 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:51.544034 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d94e05dd-a646-4693-bd34-16e1605ae36a None None] Pushing event updated for resources: {'Port': ['ID=4b497baa-4c0e-4e33-8d3c-5902b0a8997f,revision_number=3']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:02:51.567697 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d94e05dd-a646-4693-bd34-16e1605ae36a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:02:51.568042 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d94e05dd-a646-4693-bd34-16e1605ae36a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:02:51.568375 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d94e05dd-a646-4693-bd34-16e1605ae36a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:02:51.568704 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d94e05dd-a646-4693-bd34-16e1605ae36a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:02:51.569030 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d94e05dd-a646-4693-bd34-16e1605ae36a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:02:51.569350 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d94e05dd-a646-4693-bd34-16e1605ae36a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:02:51.569703 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d94e05dd-a646-4693-bd34-16e1605ae36a None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:02:51.570072 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d94e05dd-a646-4693-bd34-16e1605ae36a None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:02:51.570285 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d94e05dd-a646-4693-bd34-16e1605ae36a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:02:51.570695 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d94e05dd-a646-4693-bd34-16e1605ae36a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:02:51.570924 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d94e05dd-a646-4693-bd34-16e1605ae36a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:02:51.571235 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d94e05dd-a646-4693-bd34-16e1605ae36a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:02:51.609669 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-1e735ecf-5a8f-433c-a458-1f6c1e6a2105 None None] Attempting to bind port 4b497baa-4c0e-4e33-8d3c-5902b0a8997f on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 05:02:51.610102 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-1e735ecf-5a8f-433c-a458-1f6c1e6a2105 None None] Attempting to bind port 4b497baa-4c0e-4e33-8d3c-5902b0a8997f by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'e5bca6a2-17ea-4ff0-8af7-dc2717016f87', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': 'e6d0e278-6b66-4438-954b-591e77b9717d'}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 05:02:51.610499 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1e735ecf-5a8f-433c-a458-1f6c1e6a2105 None None] Attempting to bind port 4b497baa-4c0e-4e33-8d3c-5902b0a8997f on network e6d0e278-6b66-4438-954b-591e77b9717d {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 05:02:51.616307 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1e735ecf-5a8f-433c-a458-1f6c1e6a2105 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 5, 2, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 05:02:51.616675 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1e735ecf-5a8f-433c-a458-1f6c1e6a2105 None None] Checking segment: {'id': 'e5bca6a2-17ea-4ff0-8af7-dc2717016f87', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': 'e6d0e278-6b66-4438-954b-591e77b9717d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102164) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 05:02:51.617067 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-1e735ecf-5a8f-433c-a458-1f6c1e6a2105 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:51.617452 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1e735ecf-5a8f-433c-a458-1f6c1e6a2105 None None] Bound using segment: {'id': 'e5bca6a2-17ea-4ff0-8af7-dc2717016f87', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': 'e6d0e278-6b66-4438-954b-591e77b9717d'} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 05:02:51.617910 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-1e735ecf-5a8f-433c-a458-1f6c1e6a2105 None None] Bound port: 4b497baa-4c0e-4e33-8d3c-5902b0a8997f, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e5bca6a2-17ea-4ff0-8af7-dc2717016f87', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': 'e6d0e278-6b66-4438-954b-591e77b9717d'}}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 05:02:51.618281 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-1e735ecf-5a8f-433c-a458-1f6c1e6a2105 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:51.680967 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-1e735ecf-5a8f-433c-a458-1f6c1e6a2105 None None] For port 4b497baa-4c0e-4e33-8d3c-5902b0a8997f, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102164) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 05:02:51.684309 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-1e735ecf-5a8f-433c-a458-1f6c1e6a2105 None None] For port 4b497baa-4c0e-4e33-8d3c-5902b0a8997f, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=4b497baa-4c0e-4e33-8d3c-5902b0a8997f,segment=NetworkSegment(e5bca6a2-17ea-4ff0-8af7-dc2717016f87),segment_id=e5bca6a2-17ea-4ff0-8af7-dc2717016f87)] {{(pid=102164) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 05:02:51.717470 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-48422630-4041-4787-8d23-7e1fd0051127 None None] Provisioning complete for port 4b497baa-4c0e-4e33-8d3c-5902b0a8997f triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:02:51.718032 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-48422630-4041-4787-8d23-7e1fd0051127 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:51.752646 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-48422630-4041-4787-8d23-7e1fd0051127 None None] Port 4b497baa-4c0e-4e33-8d3c-5902b0a8997f cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 05:02:51.762547 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-48422630-4041-4787-8d23-7e1fd0051127 None None] Provisioning complete for port 475fb0cf-286d-4084-82c3-16361e5547a9 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:02:51.762941 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-48422630-4041-4787-8d23-7e1fd0051127 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:51.765155 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-1e735ecf-5a8f-433c-a458-1f6c1e6a2105 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:51.823947 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1e735ecf-5a8f-433c-a458-1f6c1e6a2105 None None] Routers {'19d0b855-419d-49a2-be7f-62683e5ccead'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:02:51.824585 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-1e735ecf-5a8f-433c-a458-1f6c1e6a2105 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:02:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['19d0b855-419d-49a2-be7f-62683e5ccead'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:02:51.860607 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d94e05dd-a646-4693-bd34-16e1605ae36a None None] Pushing event updated for resources: {'Port': ['ID=4b497baa-4c0e-4e33-8d3c-5902b0a8997f,revision_number=4']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:02:51.944650 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-1e735ecf-5a8f-433c-a458-1f6c1e6a2105 None None] Set router 19d0b855-419d-49a2-be7f-62683e5ccead gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:02:51.972110 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-008f3698-9230-4bfb-a98b-2c94cf195f56 None None] Provisioning complete for port 4b497baa-4c0e-4e33-8d3c-5902b0a8997f triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:02:51.972479 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-008f3698-9230-4bfb-a98b-2c94cf195f56 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:52.056177 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-008f3698-9230-4bfb-a98b-2c94cf195f56 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:52.088018 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-008f3698-9230-4bfb-a98b-2c94cf195f56 None None] For port 4b497baa-4c0e-4e33-8d3c-5902b0a8997f, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=4b497baa-4c0e-4e33-8d3c-5902b0a8997f,segment=NetworkSegment(e5bca6a2-17ea-4ff0-8af7-dc2717016f87),segment_id=e5bca6a2-17ea-4ff0-8af7-dc2717016f87)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:02:52.145878 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-1e735ecf-5a8f-433c-a458-1f6c1e6a2105 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '19d0b855-419d-49a2-be7f-62683e5ccead', 'name': 'tempest-TestNetworkAdvancedServerOps-router-86155025', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.223'}], 'enable_snat': True}, 'gw_port_id': '8658c0af-8b24-4ca6-954a-776ea8725321', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:02:45Z', 'updated_at': '2021-11-09T05:02:49Z', 'revision_number': 4, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': '8658c0af-8b24-4ca6-954a-776ea8725321', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:79:a1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '19d0b855-419d-49a2-be7f-62683e5ccead', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1710, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.223', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:02:45Z', 'updated_at': '2021-11-09T05:02:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '4b497baa-4c0e-4e33-8d3c-5902b0a8997f', 'name': '', 'network_id': 'e6d0e278-6b66-4438-954b-591e77b9717d', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'mac_address': 'fa:16:3e:57:01:26', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '19d0b855-419d-49a2-be7f-62683e5ccead', 'device_owner': 'network:router_interface', 'standard_attr_id': 1713, 'fixed_ips': [{'subnet_id': '4f2a77d5-99c4-4ea5-9dd3-8953e768f315', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:02:49Z', 'updated_at': '2021-11-09T05:02:51Z', 'revision_number': 4, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'subnets': [{'id': '4f2a77d5-99c4-4ea5-9dd3-8953e768f315', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:02:52.155759 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-008f3698-9230-4bfb-a98b-2c94cf195f56 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:52.172174 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1e735ecf-5a8f-433c-a458-1f6c1e6a2105 None None] The sync data for ids ['19d0b855-419d-49a2-be7f-62683e5ccead'] in dv-neutron-816802-2-hyperv is: [{'id': '19d0b855-419d-49a2-be7f-62683e5ccead', 'name': 'tempest-TestNetworkAdvancedServerOps-router-86155025', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.223'}], 'enable_snat': True}, 'gw_port_id': '8658c0af-8b24-4ca6-954a-776ea8725321', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:02:45Z', 'updated_at': '2021-11-09T05:02:49Z', 'revision_number': 4, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': '8658c0af-8b24-4ca6-954a-776ea8725321', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:79:a1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '19d0b855-419d-49a2-be7f-62683e5ccead', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1710, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.223', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:02:45Z', 'updated_at': '2021-11-09T05:02:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '4b497baa-4c0e-4e33-8d3c-5902b0a8997f', 'name': '', 'network_id': 'e6d0e278-6b66-4438-954b-591e77b9717d', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'mac_address': 'fa:16:3e:57:01:26', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '19d0b855-419d-49a2-be7f-62683e5ccead', 'device_owner': 'network:router_interface', 'standard_attr_id': 1713, 'fixed_ips': [{'subnet_id': '4f2a77d5-99c4-4ea5-9dd3-8953e768f315', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:02:49Z', 'updated_at': '2021-11-09T05:02:51Z', 'revision_number': 4, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'subnets': [{'id': '4f2a77d5-99c4-4ea5-9dd3-8953e768f315', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 05:02:52.196698 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 8658c0af-8b24-4ca6-954a-776ea8725321 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:02:52.239571 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-008f3698-9230-4bfb-a98b-2c94cf195f56 None None] Pushing event updated for resources: {'Port': ['ID=4b497baa-4c0e-4e33-8d3c-5902b0a8997f,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:02:52.261981 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 8658c0af-8b24-4ca6-954a-776ea8725321 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:02:52.262350 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:52.317176 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-b60374e8-50da-427c-b906-01f8a66beadf None None] Provisioning complete for port 4b497baa-4c0e-4e33-8d3c-5902b0a8997f triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:02:52.317544 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b60374e8-50da-427c-b906-01f8a66beadf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:52.391611 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 475fb0cf-286d-4084-82c3-16361e5547a9 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:02:52.506300 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 475fb0cf-286d-4084-82c3-16361e5547a9 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:02:52.506782 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:52.553363 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-8f52bdfb-073a-41f4-8d3d-d7031f930417 req-6e174c03-2828-4db0-a5a2-9dffc1238a86 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=421b5eb5-ae33-482f-a2fb-e14691f2fd50 HTTP/1.1" status: 200 len: 210 time: 0.0284803 Nov 09 05:02:53.631187 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c5172eb5-8488-4560-bfae-eebfda8ca340 req-43708d93-6ee1-464c-ac9c-0d5ccc3109e0 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=421b5eb5-ae33-482f-a2fb-e14691f2fd50 HTTP/1.1" status: 200 len: 210 time: 0.0258980 Nov 09 05:02:54.203937 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 4b497baa-4c0e-4e33-8d3c-5902b0a8997f up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:02:54.251110 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 4b497baa-4c0e-4e33-8d3c-5902b0a8997f triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:02:54.251470 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:54.725104 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-1b76adbf-113c-4cb4-8568-2d4273ab7540 req-1089b245-daa8-4000-a796-1a2c8a189b2b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=421b5eb5-ae33-482f-a2fb-e14691f2fd50 HTTP/1.1" status: 200 len: 210 time: 0.0266898 Nov 09 05:02:55.108900 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46a250e5-89b9-4ad1-98f8-620794fb92ed req-845ce03f-9b5a-49fe-aea1-501beff58d2c tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:02:55.110314 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-46a250e5-89b9-4ad1-98f8-620794fb92ed req-845ce03f-9b5a-49fe-aea1-501beff58d2c tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.26 "GET /v2.0/networks?id=e6d0e278-6b66-4438-954b-591e77b9717d HTTP/1.1" status: 200 len: 797 time: 0.1012480 Nov 09 05:02:55.190888 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-46a250e5-89b9-4ad1-98f8-620794fb92ed req-c9714db9-e948-4452-a1fa-35e63dfea9a6 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.26 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=8ac3eab68bd34485af7ddc3417853b28 HTTP/1.1" status: 200 len: 380 time: 0.0696332 Nov 09 05:02:55.199898 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-46a250e5-89b9-4ad1-98f8-620794fb92ed req-b2ba2437-5d82-40d7-b4e8-f7b114428675 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'port': {'device_id': '421b5eb5-ae33-482f-a2fb-e14691f2fd50', 'network_id': 'e6d0e278-6b66-4438-954b-591e77b9717d', 'admin_state_up': True, 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'security_groups': ['072bd602-b45e-4156-a831-2cb9a9e0ed3a']}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:02:55.389068 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-46a250e5-89b9-4ad1-98f8-620794fb92ed req-b2ba2437-5d82-40d7-b4e8-f7b114428675 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Made reservation on behalf of 8ac3eab68bd34485af7ddc3417853b28 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 05:02:55.392626 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-46a250e5-89b9-4ad1-98f8-620794fb92ed req-b2ba2437-5d82-40d7-b4e8-f7b114428675 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:55.530224 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [req-46a250e5-89b9-4ad1-98f8-620794fb92ed req-b2ba2437-5d82-40d7-b4e8-f7b114428675 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Allocated IP 172.20.0.4 (e6d0e278-6b66-4438-954b-591e77b9717d/4f2a77d5-99c4-4ea5-9dd3-8953e768f315/de10d0ea-35cf-47f1-9911-29480b4aabbc) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 05:02:55.665081 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-46a250e5-89b9-4ad1-98f8-620794fb92ed req-b2ba2437-5d82-40d7-b4e8-f7b114428675 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:55.784083 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-46a250e5-89b9-4ad1-98f8-620794fb92ed req-b2ba2437-5d82-40d7-b4e8-f7b114428675 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:55.846084 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-46a250e5-89b9-4ad1-98f8-620794fb92ed req-b2ba2437-5d82-40d7-b4e8-f7b114428675 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Network e6d0e278-6b66-4438-954b-591e77b9717d is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:02:55.855101 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [req-46a250e5-89b9-4ad1-98f8-620794fb92ed req-b2ba2437-5d82-40d7-b4e8-f7b114428675 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:02:55.859562 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-46a250e5-89b9-4ad1-98f8-620794fb92ed req-b2ba2437-5d82-40d7-b4e8-f7b114428675 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 05:02:55.889322 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2ba2437-5d82-40d7-b4e8-f7b114428675 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'Port': ['ID=de10d0ea-35cf-47f1-9911-29480b4aabbc,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:02:55.920924 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e30cb20-60bf-488d-9227-b267f298e296 req-191b7b71-9ab4-4877-8b25-885d5116ef2d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:02:55.922536 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4e30cb20-60bf-488d-9227-b267f298e296 req-191b7b71-9ab4-4877-8b25-885d5116ef2d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=421b5eb5-ae33-482f-a2fb-e14691f2fd50 HTTP/1.1" status: 200 len: 931 time: 0.1312797 Nov 09 05:02:55.944569 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46a250e5-89b9-4ad1-98f8-620794fb92ed req-b2ba2437-5d82-40d7-b4e8-f7b114428675 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:02:55.945209 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-46a250e5-89b9-4ad1-98f8-620794fb92ed req-b2ba2437-5d82-40d7-b4e8-f7b114428675 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:55.992766 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4e30cb20-60bf-488d-9227-b267f298e296 req-16e0d214-b111-43d8-9dd3-b6b339c4647e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=072bd602-b45e-4156-a831-2cb9a9e0ed3a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0637436 Nov 09 05:02:56.117145 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-46a250e5-89b9-4ad1-98f8-620794fb92ed req-b2ba2437-5d82-40d7-b4e8-f7b114428675 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.26 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.9208643 Nov 09 05:02:56.130517 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-46a250e5-89b9-4ad1-98f8-620794fb92ed req-276a5c1b-f6be-49d3-8232-7b7112673238 service neutron] Request body: {'port': {'device_id': '421b5eb5-ae33-482f-a2fb-e14691f2fd50', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:02:56.138466 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-0b6fef80-3c95-4e44-bb63-f83499defcb6 None None] Provisioning complete for port de10d0ea-35cf-47f1-9911-29480b4aabbc triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:02:56.138940 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0b6fef80-3c95-4e44-bb63-f83499defcb6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:56.172080 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-0b6fef80-3c95-4e44-bb63-f83499defcb6 None None] Port de10d0ea-35cf-47f1-9911-29480b4aabbc cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 05:02:56.184694 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-46a250e5-89b9-4ad1-98f8-620794fb92ed req-276a5c1b-f6be-49d3-8232-7b7112673238 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:56.438664 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [req-46a250e5-89b9-4ad1-98f8-620794fb92ed req-276a5c1b-f6be-49d3-8232-7b7112673238 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id de10d0ea-35cf-47f1-9911-29480b4aabbc {{(pid=102162) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 05:02:56.445953 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-46a250e5-89b9-4ad1-98f8-620794fb92ed req-276a5c1b-f6be-49d3-8232-7b7112673238 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:56.457941 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.provisioning_blocks [req-46a250e5-89b9-4ad1-98f8-620794fb92ed req-276a5c1b-f6be-49d3-8232-7b7112673238 service neutron] Transition to ACTIVE for port object de10d0ea-35cf-47f1-9911-29480b4aabbc will not be triggered until provisioned by entity L2. {{(pid=102162) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 09 05:02:56.536603 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-46a250e5-89b9-4ad1-98f8-620794fb92ed req-276a5c1b-f6be-49d3-8232-7b7112673238 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:56.603268 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-276a5c1b-f6be-49d3-8232-7b7112673238 service neutron] Pushing event updated for resources: {'Port': ['ID=de10d0ea-35cf-47f1-9911-29480b4aabbc,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:02:56.660115 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-46a250e5-89b9-4ad1-98f8-620794fb92ed req-276a5c1b-f6be-49d3-8232-7b7112673238 service neutron] Attempting to bind port de10d0ea-35cf-47f1-9911-29480b4aabbc on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 05:02:56.660513 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-46a250e5-89b9-4ad1-98f8-620794fb92ed req-276a5c1b-f6be-49d3-8232-7b7112673238 service neutron] Attempting to bind port de10d0ea-35cf-47f1-9911-29480b4aabbc by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'e5bca6a2-17ea-4ff0-8af7-dc2717016f87', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': 'e6d0e278-6b66-4438-954b-591e77b9717d'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 05:02:56.661325 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-46a250e5-89b9-4ad1-98f8-620794fb92ed req-276a5c1b-f6be-49d3-8232-7b7112673238 service neutron] Attempting to bind port de10d0ea-35cf-47f1-9911-29480b4aabbc on network e6d0e278-6b66-4438-954b-591e77b9717d {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 05:02:56.665834 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-46a250e5-89b9-4ad1-98f8-620794fb92ed req-276a5c1b-f6be-49d3-8232-7b7112673238 service neutron] Port de10d0ea-35cf-47f1-9911-29480b4aabbc on network e6d0e278-6b66-4438-954b-591e77b9717d not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 05:02:56.666152 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-46a250e5-89b9-4ad1-98f8-620794fb92ed req-276a5c1b-f6be-49d3-8232-7b7112673238 service neutron] Attempting to bind port de10d0ea-35cf-47f1-9911-29480b4aabbc on network e6d0e278-6b66-4438-954b-591e77b9717d {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 05:02:56.671046 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-46a250e5-89b9-4ad1-98f8-620794fb92ed req-276a5c1b-f6be-49d3-8232-7b7112673238 service neutron] Checking agent: {'id': '7d36b884-4ad2-4878-9464-bf647030b544', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'started_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 5, 2, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 05:02:56.671385 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-46a250e5-89b9-4ad1-98f8-620794fb92ed req-276a5c1b-f6be-49d3-8232-7b7112673238 service neutron] Checking segment: {'id': 'e5bca6a2-17ea-4ff0-8af7-dc2717016f87', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': 'e6d0e278-6b66-4438-954b-591e77b9717d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 05:02:56.671762 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-46a250e5-89b9-4ad1-98f8-620794fb92ed req-276a5c1b-f6be-49d3-8232-7b7112673238 service neutron] Bound using segment: {'id': 'e5bca6a2-17ea-4ff0-8af7-dc2717016f87', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': 'e6d0e278-6b66-4438-954b-591e77b9717d'} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 05:02:56.672182 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-46a250e5-89b9-4ad1-98f8-620794fb92ed req-276a5c1b-f6be-49d3-8232-7b7112673238 service neutron] Bound port: de10d0ea-35cf-47f1-9911-29480b4aabbc, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e5bca6a2-17ea-4ff0-8af7-dc2717016f87', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': 'e6d0e278-6b66-4438-954b-591e77b9717d'}}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 05:02:56.672531 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-46a250e5-89b9-4ad1-98f8-620794fb92ed req-276a5c1b-f6be-49d3-8232-7b7112673238 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:56.738177 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-46a250e5-89b9-4ad1-98f8-620794fb92ed req-276a5c1b-f6be-49d3-8232-7b7112673238 service neutron] For port de10d0ea-35cf-47f1-9911-29480b4aabbc, host hv-neutron-8168, cleared binding levels {{(pid=102162) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 05:02:56.741274 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-46a250e5-89b9-4ad1-98f8-620794fb92ed req-276a5c1b-f6be-49d3-8232-7b7112673238 service neutron] For port de10d0ea-35cf-47f1-9911-29480b4aabbc, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=de10d0ea-35cf-47f1-9911-29480b4aabbc,segment=NetworkSegment(e5bca6a2-17ea-4ff0-8af7-dc2717016f87),segment_id=e5bca6a2-17ea-4ff0-8af7-dc2717016f87)] {{(pid=102162) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 05:02:56.851062 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-46a250e5-89b9-4ad1-98f8-620794fb92ed req-276a5c1b-f6be-49d3-8232-7b7112673238 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:56.885677 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46a250e5-89b9-4ad1-98f8-620794fb92ed req-276a5c1b-f6be-49d3-8232-7b7112673238 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:02:56.887296 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-46a250e5-89b9-4ad1-98f8-620794fb92ed req-276a5c1b-f6be-49d3-8232-7b7112673238 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:02:56.888707 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-46a250e5-89b9-4ad1-98f8-620794fb92ed req-276a5c1b-f6be-49d3-8232-7b7112673238 service neutron] 10.222.0.26 "PUT /v2.0/ports/de10d0ea-35cf-47f1-9911-29480b4aabbc HTTP/1.1" status: 200 len: 1093 time: 0.7635210 Nov 09 05:02:56.891480 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '421b5eb5-ae33-482f-a2fb-e14691f2fd50', 'tag': 'de10d0ea-35cf-47f1-9911-29480b4aabbc'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:02:56.896463 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1e0326e9-cc1a-445b-ba34-33471ca4c9bd" -d '{"events": [{"name": "network-changed", "server_uuid": "421b5eb5-ae33-482f-a2fb-e14691f2fd50", "tag": "de10d0ea-35cf-47f1-9911-29480b4aabbc"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:02:56.926075 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-276a5c1b-f6be-49d3-8232-7b7112673238 service neutron] Pushing event updated for resources: {'Port': ['ID=de10d0ea-35cf-47f1-9911-29480b4aabbc,revision_number=3']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:02:56.937934 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 05:02:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-64e2c1bd-6465-4e16-a4ba-2fdbb525c216 x-openstack-request-id: req-64e2c1bd-6465-4e16-a4ba-2fdbb525c216 {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:02:56.938228 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "421b5eb5-ae33-482f-a2fb-e14691f2fd50", "tag": "de10d0ea-35cf-47f1-9911-29480b4aabbc", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:02:56.938557 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-64e2c1bd-6465-4e16-a4ba-2fdbb525c216 {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:02:56.938955 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '421b5eb5-ae33-482f-a2fb-e14691f2fd50', 'tag': 'de10d0ea-35cf-47f1-9911-29480b4aabbc', 'status': 'completed', 'code': 200} Nov 09 05:02:57.007651 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e0326e9-cc1a-445b-ba34-33471ca4c9bd req-d58350cf-e3e1-4e5b-b99a-a638f910f85b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:02:57.009377 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1e0326e9-cc1a-445b-ba34-33471ca4c9bd req-d58350cf-e3e1-4e5b-b99a-a638f910f85b service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=8ac3eab68bd34485af7ddc3417853b28&device_id=421b5eb5-ae33-482f-a2fb-e14691f2fd50 HTTP/1.1" status: 200 len: 1096 time: 0.0476317 Nov 09 05:02:57.166048 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-975b8d23-9318-44ab-a181-535dbd61600e req-322a8df9-9dd6-4101-9757-f35b8a50276a tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:02:57.167514 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-975b8d23-9318-44ab-a181-535dbd61600e req-322a8df9-9dd6-4101-9757-f35b8a50276a tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=421b5eb5-ae33-482f-a2fb-e14691f2fd50 HTTP/1.1" status: 200 len: 943 time: 0.0740490 Nov 09 05:02:57.168692 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e0326e9-cc1a-445b-ba34-33471ca4c9bd req-e858e1fb-dc2c-4e18-8f56-ef152d9b45a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:02:57.169990 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1e0326e9-cc1a-445b-ba34-33471ca4c9bd req-e858e1fb-dc2c-4e18-8f56-ef152d9b45a5 service neutron] 10.222.0.26 "GET /v2.0/networks?tenant_id=8ac3eab68bd34485af7ddc3417853b28&shared=False HTTP/1.1" status: 200 len: 898 time: 0.1518204 Nov 09 05:02:57.561658 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-975b8d23-9318-44ab-a181-535dbd61600e req-18e18e5b-b75d-4a3e-b602-76b415341953 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=072bd602-b45e-4156-a831-2cb9a9e0ed3a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3878798 Nov 09 05:02:57.591438 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e0326e9-cc1a-445b-ba34-33471ca4c9bd req-537a22c7-a518-4056-80de-f6d6d0d4c9b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:02:57.592959 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1e0326e9-cc1a-445b-ba34-33471ca4c9bd req-537a22c7-a518-4056-80de-f6d6d0d4c9b2 service neutron] 10.222.0.26 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.4133718 Nov 09 05:02:57.674343 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46a250e5-89b9-4ad1-98f8-620794fb92ed req-cb192f5e-cd67-4ae7-90a3-1446a44485cd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:02:57.675802 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-46a250e5-89b9-4ad1-98f8-620794fb92ed req-cb192f5e-cd67-4ae7-90a3-1446a44485cd service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=8ac3eab68bd34485af7ddc3417853b28&device_id=421b5eb5-ae33-482f-a2fb-e14691f2fd50 HTTP/1.1" status: 200 len: 1096 time: 0.0410514 Nov 09 05:02:57.720974 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-46a250e5-89b9-4ad1-98f8-620794fb92ed req-3850e45a-01d0-4423-b6ae-1a46706890e2 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=de10d0ea-35cf-47f1-9911-29480b4aabbc HTTP/1.1" status: 200 len: 217 time: 0.0375831 Nov 09 05:02:57.773508 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46a250e5-89b9-4ad1-98f8-620794fb92ed req-26297560-9584-427b-9314-de0b94b7da17 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:02:57.777346 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-46a250e5-89b9-4ad1-98f8-620794fb92ed req-26297560-9584-427b-9314-de0b94b7da17 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=4f2a77d5-99c4-4ea5-9dd3-8953e768f315 HTTP/1.1" status: 200 len: 834 time: 0.0440996 Nov 09 05:02:57.820827 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46a250e5-89b9-4ad1-98f8-620794fb92ed req-fb46b9b3-db2a-4949-bb0a-48cd17d763b4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:02:57.822282 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-46a250e5-89b9-4ad1-98f8-620794fb92ed req-fb46b9b3-db2a-4949-bb0a-48cd17d763b4 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=e6d0e278-6b66-4438-954b-591e77b9717d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0397801 Nov 09 05:02:57.914818 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-46a250e5-89b9-4ad1-98f8-620794fb92ed req-3278a5b7-8bf6-49ad-ae95-4d437873aaeb service neutron] 10.222.0.26 "GET /v2.0/networks/e6d0e278-6b66-4438-954b-591e77b9717d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0844610 Nov 09 05:02:58.005709 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-46a250e5-89b9-4ad1-98f8-620794fb92ed req-b02d4602-8a42-4d5f-b0ae-ac2446c4cc55 service neutron] 10.222.0.26 "GET /v2.0/networks/e6d0e278-6b66-4438-954b-591e77b9717d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0836637 Nov 09 05:02:58.674136 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d294d617-494a-45b1-b199-425a7a5de7c0 req-73256496-08cb-4e51-9b83-d9d18daedf20 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:02:58.675606 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d294d617-494a-45b1-b199-425a7a5de7c0 req-73256496-08cb-4e51-9b83-d9d18daedf20 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=421b5eb5-ae33-482f-a2fb-e14691f2fd50 HTTP/1.1" status: 200 len: 943 time: 0.0476215 Nov 09 05:02:58.723827 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d294d617-494a-45b1-b199-425a7a5de7c0 req-1b894b2a-a8c0-48ac-a29a-9ab29aab4d42 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=072bd602-b45e-4156-a831-2cb9a9e0ed3a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419354 Nov 09 05:02:59.839174 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e04a01d-a674-46ca-b07d-03fa8babbae8 req-6f512911-777c-4d12-9b27-2606b3b8ce36 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:02:59.840534 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1e04a01d-a674-46ca-b07d-03fa8babbae8 req-6f512911-777c-4d12-9b27-2606b3b8ce36 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=421b5eb5-ae33-482f-a2fb-e14691f2fd50 HTTP/1.1" status: 200 len: 943 time: 0.0518548 Nov 09 05:02:59.888317 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1e04a01d-a674-46ca-b07d-03fa8babbae8 req-3ffff14e-dd2c-4a50-988c-66252916ab60 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=072bd602-b45e-4156-a831-2cb9a9e0ed3a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419664 Nov 09 05:03:00.344706 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device de10d0ea-35cf-47f1-9911-29480b4aabbc details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=102163) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 09 05:03:00.435454 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port de10d0ea-35cf-47f1-9911-29480b4aabbc, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=de10d0ea-35cf-47f1-9911-29480b4aabbc,segment=NetworkSegment(e5bca6a2-17ea-4ff0-8af7-dc2717016f87),segment_id=e5bca6a2-17ea-4ff0-8af7-dc2717016f87)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:03:00.446891 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Returning: {'device': 'de10d0ea-35cf-47f1-9911-29480b4aabbc', 'network_id': 'e6d0e278-6b66-4438-954b-591e77b9717d', 'port_id': 'de10d0ea-35cf-47f1-9911-29480b4aabbc', 'mac_address': 'fa:16:3e:b2:3f:81', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 336, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4f2a77d5-99c4-4ea5-9dd3-8953e768f315', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102163) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 09 05:03:00.484343 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:00.497311 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id de10d0ea-35cf-47f1-9911-29480b4aabbc {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 05:03:00.516654 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port de10d0ea-35cf-47f1-9911-29480b4aabbc, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=de10d0ea-35cf-47f1-9911-29480b4aabbc,segment=NetworkSegment(e5bca6a2-17ea-4ff0-8af7-dc2717016f87),segment_id=e5bca6a2-17ea-4ff0-8af7-dc2717016f87)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:03:00.611832 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:00.657269 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=de10d0ea-35cf-47f1-9911-29480b4aabbc,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:03:00.855574 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['de10d0ea-35cf-47f1-9911-29480b4aabbc'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 05:03:01.006056 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8be802e8-c395-41a4-9cc7-274c1473b59d req-138050b5-f797-49c8-af97-2bff9ab26e55 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:03:01.007553 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-8be802e8-c395-41a4-9cc7-274c1473b59d req-138050b5-f797-49c8-af97-2bff9ab26e55 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=421b5eb5-ae33-482f-a2fb-e14691f2fd50 HTTP/1.1" status: 200 len: 944 time: 0.0514865 Nov 09 05:03:01.055760 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-8be802e8-c395-41a4-9cc7-274c1473b59d req-65fe76f4-db51-438d-aeb8-2a4213bc0d49 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=072bd602-b45e-4156-a831-2cb9a9e0ed3a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421481 Nov 09 05:03:02.167943 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-968f4f40-2609-43a6-9289-3edd5a21fe5e req-8d591fbb-9f43-4b44-b45b-a28e7e94f7a3 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:03:02.169395 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-968f4f40-2609-43a6-9289-3edd5a21fe5e req-8d591fbb-9f43-4b44-b45b-a28e7e94f7a3 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=421b5eb5-ae33-482f-a2fb-e14691f2fd50 HTTP/1.1" status: 200 len: 944 time: 0.0474789 Nov 09 05:03:02.216571 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-968f4f40-2609-43a6-9289-3edd5a21fe5e req-00425395-4e02-4f3a-b915-9bf888dee231 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=072bd602-b45e-4156-a831-2cb9a9e0ed3a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0413342 Nov 09 05:03:02.361376 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device de10d0ea-35cf-47f1-9911-29480b4aabbc up at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:03:02.480043 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning for port de10d0ea-35cf-47f1-9911-29480b4aabbc completed by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 09 05:03:02.483684 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning complete for port de10d0ea-35cf-47f1-9911-29480b4aabbc triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:03:02.484054 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:02.558492 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:02.579736 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '421b5eb5-ae33-482f-a2fb-e14691f2fd50', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'de10d0ea-35cf-47f1-9911-29480b4aabbc'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:03:02.581947 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9e30f65a-4c2c-4649-a8cc-647bfa0f1901" -d '{"events": [{"server_uuid": "421b5eb5-ae33-482f-a2fb-e14691f2fd50", "name": "network-vif-plugged", "status": "completed", "tag": "de10d0ea-35cf-47f1-9911-29480b4aabbc"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:03:02.595515 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port de10d0ea-35cf-47f1-9911-29480b4aabbc, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=de10d0ea-35cf-47f1-9911-29480b4aabbc,segment=NetworkSegment(e5bca6a2-17ea-4ff0-8af7-dc2717016f87),segment_id=e5bca6a2-17ea-4ff0-8af7-dc2717016f87)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:03:02.670175 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 05:03:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-77e3442e-87a5-423c-9d67-c65be0687f05 x-openstack-request-id: req-77e3442e-87a5-423c-9d67-c65be0687f05 {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:03:02.670498 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "421b5eb5-ae33-482f-a2fb-e14691f2fd50", "name": "network-vif-plugged", "status": "completed", "tag": "de10d0ea-35cf-47f1-9911-29480b4aabbc", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:03:02.670753 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-77e3442e-87a5-423c-9d67-c65be0687f05 {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:03:02.671150 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '421b5eb5-ae33-482f-a2fb-e14691f2fd50', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'de10d0ea-35cf-47f1-9911-29480b4aabbc', 'code': 200} Nov 09 05:03:02.690403 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:02.737351 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=de10d0ea-35cf-47f1-9911-29480b4aabbc,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:03:03.067052 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bc7b401-bbe0-4fd7-aeff-eb3f7d252a81 req-082120fb-e98f-44f8-91b6-d29eea86cf93 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:03:03.068578 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7bc7b401-bbe0-4fd7-aeff-eb3f7d252a81 req-082120fb-e98f-44f8-91b6-d29eea86cf93 service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=421b5eb5-ae33-482f-a2fb-e14691f2fd50 HTTP/1.1" status: 200 len: 1098 time: 0.1042283 Nov 09 05:03:03.117250 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7bc7b401-bbe0-4fd7-aeff-eb3f7d252a81 req-1c92b4c6-3fd8-4772-ad14-95c17c260e17 service neutron] 10.222.0.26 "GET /v2.0/security-groups?id=072bd602-b45e-4156-a831-2cb9a9e0ed3a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0413966 Nov 09 05:03:03.327346 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22ee2207-6772-4ea9-b689-4aad81afffc6 req-438ce70a-2e71-4833-937d-248689505f95 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:03:03.328802 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-22ee2207-6772-4ea9-b689-4aad81afffc6 req-438ce70a-2e71-4833-937d-248689505f95 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=421b5eb5-ae33-482f-a2fb-e14691f2fd50 HTTP/1.1" status: 200 len: 945 time: 0.0474026 Nov 09 05:03:03.376330 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-22ee2207-6772-4ea9-b689-4aad81afffc6 req-594215f8-8a17-4ee1-8513-5573e84f1582 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=072bd602-b45e-4156-a831-2cb9a9e0ed3a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412626 Nov 09 05:03:04.488748 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a10f586-129e-4a77-be5d-bc098ecf9c50 req-d8a19c81-a523-4cce-8427-53bb34581cd1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:03:04.490191 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-6a10f586-129e-4a77-be5d-bc098ecf9c50 req-d8a19c81-a523-4cce-8427-53bb34581cd1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=421b5eb5-ae33-482f-a2fb-e14691f2fd50 HTTP/1.1" status: 200 len: 945 time: 0.0472786 Nov 09 05:03:04.537807 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-6a10f586-129e-4a77-be5d-bc098ecf9c50 req-26c698b4-58b9-4801-aa6c-f81ed3136554 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=072bd602-b45e-4156-a831-2cb9a9e0ed3a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410910 Nov 09 05:03:04.651180 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c39035a5-eded-497d-9e7e-7e45197c5946 req-517801f1-2a59-4e72-82e8-eb6d061c3ebe tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:03:04.652661 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c39035a5-eded-497d-9e7e-7e45197c5946 req-517801f1-2a59-4e72-82e8-eb6d061c3ebe tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=421b5eb5-ae33-482f-a2fb-e14691f2fd50 HTTP/1.1" status: 200 len: 945 time: 0.0480735 Nov 09 05:03:04.701230 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c39035a5-eded-497d-9e7e-7e45197c5946 req-2c90f0d7-9a1a-4d11-ac29-54e4241cd5ab tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=072bd602-b45e-4156-a831-2cb9a9e0ed3a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425537 Nov 09 05:03:04.722483 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 36746) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:03:04.763979 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fcab7dd6-c3bf-4a54-9b38-4a08d54e1f40 tempest-TestNetworkAdvancedServerOps-1212315804 tempest-TestNetworkAdvancedServerOps-1212315804-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:03:04.765437 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-fcab7dd6-c3bf-4a54-9b38-4a08d54e1f40 tempest-TestNetworkAdvancedServerOps-1212315804 tempest-TestNetworkAdvancedServerOps-1212315804-project-admin] 10.222.0.24 "GET /v2.0/ports?device_id=421b5eb5-ae33-482f-a2fb-e14691f2fd50 HTTP/1.1" status: 200 len: 1093 time: 0.0420086 Nov 09 05:03:04.768244 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 36748) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:03:04.773167 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-59147f82-cc6b-4c0f-a038-049f7347b213 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'floatingip': {'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'port_id': 'de10d0ea-35cf-47f1-9911-29480b4aabbc', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'fixed_ip_address': '172.20.0.4'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:03:04.850202 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-59147f82-cc6b-4c0f-a038-049f7347b213 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for floatingip, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:04.943707 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-59147f82-cc6b-4c0f-a038-049f7347b213 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:05.045988 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-59147f82-cc6b-4c0f-a038-049f7347b213 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Allocated IP 172.26.0.180 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/cb6fa1dd-3e89-4cf1-9803-9481c62b01ab) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 05:03:05.142413 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-59147f82-cc6b-4c0f-a038-049f7347b213 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:05.228848 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-59147f82-cc6b-4c0f-a038-049f7347b213 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:05.267829 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-59147f82-cc6b-4c0f-a038-049f7347b213 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:03:05.270659 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-59147f82-cc6b-4c0f-a038-049f7347b213 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:03:05.276820 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-59147f82-cc6b-4c0f-a038-049f7347b213 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 05:03:05.299904 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59147f82-cc6b-4c0f-a038-049f7347b213 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'Port': ['ID=cb6fa1dd-3e89-4cf1-9803-9481c62b01ab,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:03:05.619803 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-59147f82-cc6b-4c0f-a038-049f7347b213 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:05.753761 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-59147f82-cc6b-4c0f-a038-049f7347b213 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:05.903554 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-59147f82-cc6b-4c0f-a038-049f7347b213 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:05.965869 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-59147f82-cc6b-4c0f-a038-049f7347b213 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:06.030670 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59147f82-cc6b-4c0f-a038-049f7347b213 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'Port': ['ID=cb6fa1dd-3e89-4cf1-9803-9481c62b01ab,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:03:06.043165 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-59147f82-cc6b-4c0f-a038-049f7347b213 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:06.143399 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.l3_db [None req-59147f82-cc6b-4c0f-a038-049f7347b213 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Floating IP ac1692ea-92aa-4c4d-9568-dcfd5eab2b3f associated. External IP: 172.26.0.180, port: de10d0ea-35cf-47f1-9911-29480b4aabbc. Nov 09 05:03:06.349245 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-59147f82-cc6b-4c0f-a038-049f7347b213 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Router 19d0b855-419d-49a2-be7f-62683e5ccead has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 05:03:06.455942 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-59147f82-cc6b-4c0f-a038-049f7347b213 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 05:03:06.466667 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c07e64b7-dc49-435d-a288-53f41cb0af51 None None] Sync routers for ids ['19d0b855-419d-49a2-be7f-62683e5ccead'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 05:03:06.475460 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c07e64b7-dc49-435d-a288-53f41cb0af51 None None] Routers {'19d0b855-419d-49a2-be7f-62683e5ccead'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:03:06.476641 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-c07e64b7-dc49-435d-a288-53f41cb0af51 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:02:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['19d0b855-419d-49a2-be7f-62683e5ccead'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:03:06.551158 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-59147f82-cc6b-4c0f-a038-049f7347b213 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:06.580070 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-59147f82-cc6b-4c0f-a038-049f7347b213 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.8108211 Nov 09 05:03:06.580674 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '421b5eb5-ae33-482f-a2fb-e14691f2fd50', 'tag': 'de10d0ea-35cf-47f1-9911-29480b4aabbc'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:03:06.583010 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-231456fa-7aaf-40c1-9f2b-d13a88cc4f99" -d '{"events": [{"name": "network-changed", "server_uuid": "421b5eb5-ae33-482f-a2fb-e14691f2fd50", "tag": "de10d0ea-35cf-47f1-9911-29480b4aabbc"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:03:06.625802 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 05:03:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-58b9747d-5419-4516-a468-d9642a4e11ae x-openstack-request-id: req-58b9747d-5419-4516-a468-d9642a4e11ae {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:03:06.626122 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "421b5eb5-ae33-482f-a2fb-e14691f2fd50", "tag": "de10d0ea-35cf-47f1-9911-29480b4aabbc", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:03:06.626418 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-58b9747d-5419-4516-a468-d9642a4e11ae {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:03:06.626838 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '421b5eb5-ae33-482f-a2fb-e14691f2fd50', 'tag': 'de10d0ea-35cf-47f1-9911-29480b4aabbc', 'status': 'completed', 'code': 200} Nov 09 05:03:06.691463 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25a07427-5cfd-4203-8664-841af8c50c80 req-dde04e29-e841-4df6-8955-6d2263a3d493 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:03:06.693210 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-25a07427-5cfd-4203-8664-841af8c50c80 req-dde04e29-e841-4df6-8955-6d2263a3d493 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=421b5eb5-ae33-482f-a2fb-e14691f2fd50 HTTP/1.1" status: 200 len: 945 time: 0.0542564 Nov 09 05:03:06.698750 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-231456fa-7aaf-40c1-9f2b-d13a88cc4f99 req-9c45f370-b0a3-4387-adbb-e815d971136a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:03:06.700393 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-231456fa-7aaf-40c1-9f2b-d13a88cc4f99 req-9c45f370-b0a3-4387-adbb-e815d971136a service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=8ac3eab68bd34485af7ddc3417853b28&device_id=421b5eb5-ae33-482f-a2fb-e14691f2fd50 HTTP/1.1" status: 200 len: 1098 time: 0.0434566 Nov 09 05:03:06.740372 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-c07e64b7-dc49-435d-a288-53f41cb0af51 None None] Set router 19d0b855-419d-49a2-be7f-62683e5ccead gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:03:06.745168 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-25a07427-5cfd-4203-8664-841af8c50c80 req-779e0cd6-0fbd-43a1-b877-5a21af6f651b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=072bd602-b45e-4156-a831-2cb9a9e0ed3a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0450225 Nov 09 05:03:06.773202 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 36754) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:03:06.852840 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-231456fa-7aaf-40c1-9f2b-d13a88cc4f99 req-222ce116-a6ba-4860-a9a8-5d8f890fed77 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:03:06.854353 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-231456fa-7aaf-40c1-9f2b-d13a88cc4f99 req-222ce116-a6ba-4860-a9a8-5d8f890fed77 service neutron] 10.222.0.26 "GET /v2.0/networks?id=e6d0e278-6b66-4438-954b-591e77b9717d HTTP/1.1" status: 200 len: 898 time: 0.1471040 Nov 09 05:03:06.857506 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-cede052f-a1f3-4700-8fa8-ce1c9a88c551 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/floatingips/ac1692ea-92aa-4c4d-9568-dcfd5eab2b3f HTTP/1.1" status: 200 len: 991 time: 0.0832951 Nov 09 05:03:06.925323 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-231456fa-7aaf-40c1-9f2b-d13a88cc4f99 req-7842e9ed-9ea6-4a2c-b8d2-0cd157955195 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=de10d0ea-35cf-47f1-9911-29480b4aabbc HTTP/1.1" status: 200 len: 999 time: 0.0615735 Nov 09 05:03:06.966592 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-c07e64b7-dc49-435d-a288-53f41cb0af51 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '19d0b855-419d-49a2-be7f-62683e5ccead', 'name': 'tempest-TestNetworkAdvancedServerOps-router-86155025', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.223'}], 'enable_snat': True}, 'gw_port_id': '8658c0af-8b24-4ca6-954a-776ea8725321', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:02:45Z', 'updated_at': '2021-11-09T05:02:49Z', 'revision_number': 4, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': '8658c0af-8b24-4ca6-954a-776ea8725321', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:79:a1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '19d0b855-419d-49a2-be7f-62683e5ccead', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1710, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.223', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:02:45Z', 'updated_at': '2021-11-09T05:02:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': 'ac1692ea-92aa-4c4d-9568-dcfd5eab2b3f', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'floating_ip_address': '172.26.0.180', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '19d0b855-419d-49a2-be7f-62683e5ccead', 'port_id': 'de10d0ea-35cf-47f1-9911-29480b4aabbc', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 1716, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e6d0e278-6b66-4438-954b-591e77b9717d', 'mac_address': 'fa:16:3e:b2:3f:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '421b5eb5-ae33-482f-a2fb-e14691f2fd50', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T05:03:05Z', 'updated_at': '2021-11-09T05:03:05Z', 'revision_number': 0, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4b497baa-4c0e-4e33-8d3c-5902b0a8997f', 'name': '', 'network_id': 'e6d0e278-6b66-4438-954b-591e77b9717d', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'mac_address': 'fa:16:3e:57:01:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '19d0b855-419d-49a2-be7f-62683e5ccead', 'device_owner': 'network:router_interface', 'standard_attr_id': 1713, 'fixed_ips': [{'subnet_id': '4f2a77d5-99c4-4ea5-9dd3-8953e768f315', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:02:49Z', 'updated_at': '2021-11-09T05:02:52Z', 'revision_number': 5, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'subnets': [{'id': '4f2a77d5-99c4-4ea5-9dd3-8953e768f315', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:03:06.973633 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-231456fa-7aaf-40c1-9f2b-d13a88cc4f99 req-ec9bceec-854e-40b7-8f42-c3bdfb49ea38 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:03:06.975163 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-231456fa-7aaf-40c1-9f2b-d13a88cc4f99 req-ec9bceec-854e-40b7-8f42-c3bdfb49ea38 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=4f2a77d5-99c4-4ea5-9dd3-8953e768f315 HTTP/1.1" status: 200 len: 834 time: 0.0434811 Nov 09 05:03:06.993676 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c07e64b7-dc49-435d-a288-53f41cb0af51 None None] Checking router: 19d0b855-419d-49a2-be7f-62683e5ccead for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 05:03:07.001949 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c07e64b7-dc49-435d-a288-53f41cb0af51 None None] Routers {'19d0b855-419d-49a2-be7f-62683e5ccead'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:03:07.002592 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-c07e64b7-dc49-435d-a288-53f41cb0af51 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:02:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['19d0b855-419d-49a2-be7f-62683e5ccead'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:03:07.020481 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-231456fa-7aaf-40c1-9f2b-d13a88cc4f99 req-5e7c4d96-a722-4df5-9e5a-6f6df1339d72 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:03:07.022009 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-231456fa-7aaf-40c1-9f2b-d13a88cc4f99 req-5e7c4d96-a722-4df5-9e5a-6f6df1339d72 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=e6d0e278-6b66-4438-954b-591e77b9717d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0403514 Nov 09 05:03:07.107901 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-c07e64b7-dc49-435d-a288-53f41cb0af51 None None] Set router 19d0b855-419d-49a2-be7f-62683e5ccead gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:03:07.114024 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-231456fa-7aaf-40c1-9f2b-d13a88cc4f99 req-c5f11894-7a3b-4338-9ec0-454467a4abc7 service neutron] 10.222.0.26 "GET /v2.0/networks/e6d0e278-6b66-4438-954b-591e77b9717d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0850146 Nov 09 05:03:07.202200 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-231456fa-7aaf-40c1-9f2b-d13a88cc4f99 req-d4597cf3-6088-4111-9fa1-58bf7193c292 service neutron] 10.222.0.26 "GET /v2.0/networks/e6d0e278-6b66-4438-954b-591e77b9717d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0816185 Nov 09 05:03:07.331631 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-c07e64b7-dc49-435d-a288-53f41cb0af51 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '19d0b855-419d-49a2-be7f-62683e5ccead', 'name': 'tempest-TestNetworkAdvancedServerOps-router-86155025', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.223'}], 'enable_snat': True}, 'gw_port_id': '8658c0af-8b24-4ca6-954a-776ea8725321', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:02:45Z', 'updated_at': '2021-11-09T05:02:49Z', 'revision_number': 4, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': '8658c0af-8b24-4ca6-954a-776ea8725321', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:79:a1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '19d0b855-419d-49a2-be7f-62683e5ccead', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1710, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.223', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:02:45Z', 'updated_at': '2021-11-09T05:02:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': 'ac1692ea-92aa-4c4d-9568-dcfd5eab2b3f', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'floating_ip_address': '172.26.0.180', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '19d0b855-419d-49a2-be7f-62683e5ccead', 'port_id': 'de10d0ea-35cf-47f1-9911-29480b4aabbc', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 1716, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e6d0e278-6b66-4438-954b-591e77b9717d', 'mac_address': 'fa:16:3e:b2:3f:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '421b5eb5-ae33-482f-a2fb-e14691f2fd50', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T05:03:05Z', 'updated_at': '2021-11-09T05:03:05Z', 'revision_number': 0, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4b497baa-4c0e-4e33-8d3c-5902b0a8997f', 'name': '', 'network_id': 'e6d0e278-6b66-4438-954b-591e77b9717d', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'mac_address': 'fa:16:3e:57:01:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '19d0b855-419d-49a2-be7f-62683e5ccead', 'device_owner': 'network:router_interface', 'standard_attr_id': 1713, 'fixed_ips': [{'subnet_id': '4f2a77d5-99c4-4ea5-9dd3-8953e768f315', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:02:49Z', 'updated_at': '2021-11-09T05:02:52Z', 'revision_number': 5, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'subnets': [{'id': '4f2a77d5-99c4-4ea5-9dd3-8953e768f315', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:03:07.357118 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c07e64b7-dc49-435d-a288-53f41cb0af51 None None] The sync data for ids ['19d0b855-419d-49a2-be7f-62683e5ccead'] in dv-neutron-816802-2-hyperv is: [{'id': '19d0b855-419d-49a2-be7f-62683e5ccead', 'name': 'tempest-TestNetworkAdvancedServerOps-router-86155025', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.223'}], 'enable_snat': True}, 'gw_port_id': '8658c0af-8b24-4ca6-954a-776ea8725321', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:02:45Z', 'updated_at': '2021-11-09T05:02:49Z', 'revision_number': 4, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': '8658c0af-8b24-4ca6-954a-776ea8725321', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:79:a1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '19d0b855-419d-49a2-be7f-62683e5ccead', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1710, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.223', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:02:45Z', 'updated_at': '2021-11-09T05:02:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': 'ac1692ea-92aa-4c4d-9568-dcfd5eab2b3f', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'floating_ip_address': '172.26.0.180', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '19d0b855-419d-49a2-be7f-62683e5ccead', 'port_id': 'de10d0ea-35cf-47f1-9911-29480b4aabbc', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 1716, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e6d0e278-6b66-4438-954b-591e77b9717d', 'mac_address': 'fa:16:3e:b2:3f:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '421b5eb5-ae33-482f-a2fb-e14691f2fd50', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T05:03:05Z', 'updated_at': '2021-11-09T05:03:05Z', 'revision_number': 0, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4b497baa-4c0e-4e33-8d3c-5902b0a8997f', 'name': '', 'network_id': 'e6d0e278-6b66-4438-954b-591e77b9717d', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'mac_address': 'fa:16:3e:57:01:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '19d0b855-419d-49a2-be7f-62683e5ccead', 'device_owner': 'network:router_interface', 'standard_attr_id': 1713, 'fixed_ips': [{'subnet_id': '4f2a77d5-99c4-4ea5-9dd3-8953e768f315', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:02:49Z', 'updated_at': '2021-11-09T05:02:52Z', 'revision_number': 5, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'subnets': [{'id': '4f2a77d5-99c4-4ea5-9dd3-8953e768f315', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 05:03:07.549011 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3eb8a749-a634-473e-84a9-b51ad6ea0a54 None None] New status for floating IP ac1692ea-92aa-4c4d-9568-dcfd5eab2b3f: ACTIVE {{(pid=102164) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 05:03:07.860731 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36756) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:03:07.922526 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-24d9700e-ab03-4cf8-b482-19f9e02a1643 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/floatingips/ac1692ea-92aa-4c4d-9568-dcfd5eab2b3f HTTP/1.1" status: 200 len: 993 time: 0.0606234 Nov 09 05:03:11.417005 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-51eb628e-ff82-46cf-bd32-62fbad1dc849 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:12.496965 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:13.696741 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ed9fb926-7ad6-4a6a-8085-f5169264724e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:15.211007 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:16.599576 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:16.988137 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:19.268555 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c24800a6-b51f-40c5-9407-f8d2f5682853 req-11943c16-1ae2-434b-b4db-ceaee21961a1 service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=421b5eb5-ae33-482f-a2fb-e14691f2fd50&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0435996 Nov 09 05:03:19.348212 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c24800a6-b51f-40c5-9407-f8d2f5682853 req-cdd3464a-590b-4f31-894c-093e2ac1331c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:03:19.349659 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c24800a6-b51f-40c5-9407-f8d2f5682853 req-cdd3464a-590b-4f31-894c-093e2ac1331c service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=8ac3eab68bd34485af7ddc3417853b28&device_id=421b5eb5-ae33-482f-a2fb-e14691f2fd50 HTTP/1.1" status: 200 len: 1098 time: 0.0405002 Nov 09 05:03:19.450801 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c24800a6-b51f-40c5-9407-f8d2f5682853 req-5f92c655-8905-4c0d-a915-173d0c8435a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:03:19.452210 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c24800a6-b51f-40c5-9407-f8d2f5682853 req-5f92c655-8905-4c0d-a915-173d0c8435a2 service neutron] 10.222.0.26 "GET /v2.0/networks?id=e6d0e278-6b66-4438-954b-591e77b9717d HTTP/1.1" status: 200 len: 898 time: 0.0844657 Nov 09 05:03:19.515788 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c24800a6-b51f-40c5-9407-f8d2f5682853 req-d73ed667-0d0b-44a7-9a4d-222541b7279c service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=de10d0ea-35cf-47f1-9911-29480b4aabbc HTTP/1.1" status: 200 len: 1001 time: 0.0566308 Nov 09 05:03:19.562963 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c24800a6-b51f-40c5-9407-f8d2f5682853 req-c459d834-dea5-41a7-b966-873a770378e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:03:19.564277 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c24800a6-b51f-40c5-9407-f8d2f5682853 req-c459d834-dea5-41a7-b966-873a770378e4 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=4f2a77d5-99c4-4ea5-9dd3-8953e768f315 HTTP/1.1" status: 200 len: 834 time: 0.0420783 Nov 09 05:03:19.612291 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c24800a6-b51f-40c5-9407-f8d2f5682853 req-eb10d841-9c84-4c1a-a2f1-95b13b87c959 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:03:19.613727 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c24800a6-b51f-40c5-9407-f8d2f5682853 req-eb10d841-9c84-4c1a-a2f1-95b13b87c959 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=e6d0e278-6b66-4438-954b-591e77b9717d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0416145 Nov 09 05:03:19.704640 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c24800a6-b51f-40c5-9407-f8d2f5682853 req-6804962a-9922-43e6-89ea-24a161a2fcfa service neutron] 10.222.0.26 "GET /v2.0/networks/e6d0e278-6b66-4438-954b-591e77b9717d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0793498 Nov 09 05:03:19.795889 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c24800a6-b51f-40c5-9407-f8d2f5682853 req-711ffdc0-9fad-4a40-b35a-7fcaffe9952e service neutron] 10.222.0.26 "GET /v2.0/networks/e6d0e278-6b66-4438-954b-591e77b9717d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0836380 Nov 09 05:03:26.457254 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 05:03:41.353591 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-38cc550a-deb0-43f4-a8cc-fa4a41d953a2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:41.416871 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c7a0429-5375-4eac-b7ae-e7660516668e req-2de8b0b8-e945-432d-8b6d-36b1f5d5c050 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:03:41.418267 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6c7a0429-5375-4eac-b7ae-e7660516668e req-2de8b0b8-e945-432d-8b6d-36b1f5d5c050 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=421b5eb5-ae33-482f-a2fb-e14691f2fd50 HTTP/1.1" status: 200 len: 945 time: 0.0549502 Nov 09 05:03:41.467217 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6c7a0429-5375-4eac-b7ae-e7660516668e req-037bf2f3-c975-4c49-a54b-d9844d1c9b2f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=072bd602-b45e-4156-a831-2cb9a9e0ed3a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429599 Nov 09 05:03:42.444393 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:42.585525 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12f21554-7b24-4beb-aa4b-3880a208927d req-0b77405c-41a9-4ba8-a82a-eb8aea81581e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:03:42.587603 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-12f21554-7b24-4beb-aa4b-3880a208927d req-0b77405c-41a9-4ba8-a82a-eb8aea81581e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=421b5eb5-ae33-482f-a2fb-e14691f2fd50 HTTP/1.1" status: 200 len: 945 time: 0.0519397 Nov 09 05:03:42.635578 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-12f21554-7b24-4beb-aa4b-3880a208927d req-15c27743-3da1-463c-b6bd-85a147adb29a tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=072bd602-b45e-4156-a831-2cb9a9e0ed3a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421538 Nov 09 05:03:42.657574 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36776) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:03:42.716515 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-ea7fd8aa-e8c8-4fb4-829b-214196e6a7f3 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/floatingips/ac1692ea-92aa-4c4d-9568-dcfd5eab2b3f HTTP/1.1" status: 200 len: 993 time: 0.0576608 Nov 09 05:03:43.747280 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5dfb3cd3-57c4-4597-b6b1-c4041a85ea43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:44.112019 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3a8d81b-f4f3-4d51-88ac-5cc23f6e2cf0 req-6647fa96-4020-49ea-ba2a-ba1fc8db996c tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:03:44.113488 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c3a8d81b-f4f3-4d51-88ac-5cc23f6e2cf0 req-6647fa96-4020-49ea-ba2a-ba1fc8db996c tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=421b5eb5-ae33-482f-a2fb-e14691f2fd50 HTTP/1.1" status: 200 len: 945 time: 0.0482881 Nov 09 05:03:44.173733 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c3a8d81b-f4f3-4d51-88ac-5cc23f6e2cf0 req-78dc1b71-68d6-488f-87f6-39c5759885a5 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=072bd602-b45e-4156-a831-2cb9a9e0ed3a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0515361 Nov 09 05:03:45.296491 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84acf62f-aa7e-4bb1-860a-cb827e6a5e0d req-90551072-361d-4c2f-8e26-dbf424a88599 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:03:45.298011 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-84acf62f-aa7e-4bb1-860a-cb827e6a5e0d req-90551072-361d-4c2f-8e26-dbf424a88599 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=421b5eb5-ae33-482f-a2fb-e14691f2fd50 HTTP/1.1" status: 200 len: 945 time: 0.0541203 Nov 09 05:03:45.330167 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:45.346064 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-84acf62f-aa7e-4bb1-860a-cb827e6a5e0d req-7968cd4c-49d3-4d9b-b39a-9cd27664f91a tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=072bd602-b45e-4156-a831-2cb9a9e0ed3a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422630 Nov 09 05:03:45.368392 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36788) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:03:45.426802 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1e13f0ac-d453-4fa0-b09f-96c6f4180c7e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/floatingips/ac1692ea-92aa-4c4d-9568-dcfd5eab2b3f HTTP/1.1" status: 200 len: 993 time: 0.0572355 Nov 09 05:03:45.664801 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36794) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:03:45.819938 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-142fc55d-efc6-4a36-9f50-fe05e3967bd2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Deleting port cb6fa1dd-3e89-4cf1-9803-9481c62b01ab {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:03:45.820818 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-142fc55d-efc6-4a36-9f50-fe05e3967bd2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:45.893153 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-142fc55d-efc6-4a36-9f50-fe05e3967bd2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:45.893473 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-142fc55d-efc6-4a36-9f50-fe05e3967bd2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:45.905071 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-142fc55d-efc6-4a36-9f50-fe05e3967bd2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Calling delete_port for cb6fa1dd-3e89-4cf1-9803-9481c62b01ab owned by network:floatingip {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:03:46.105712 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-142fc55d-efc6-4a36-9f50-fe05e3967bd2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:46.132312 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-142fc55d-efc6-4a36-9f50-fe05e3967bd2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event deleted for resources: {'Port': ['ID=cb6fa1dd-3e89-4cf1-9803-9481c62b01ab,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:03:46.160013 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-142fc55d-efc6-4a36-9f50-fe05e3967bd2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:03:46.160367 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-142fc55d-efc6-4a36-9f50-fe05e3967bd2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:03:46.160715 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-142fc55d-efc6-4a36-9f50-fe05e3967bd2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:03:46.161061 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-142fc55d-efc6-4a36-9f50-fe05e3967bd2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:03:46.161400 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-142fc55d-efc6-4a36-9f50-fe05e3967bd2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:03:46.161738 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-142fc55d-efc6-4a36-9f50-fe05e3967bd2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:03:46.162071 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-142fc55d-efc6-4a36-9f50-fe05e3967bd2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:03:46.162422 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-142fc55d-efc6-4a36-9f50-fe05e3967bd2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:03:46.162770 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-142fc55d-efc6-4a36-9f50-fe05e3967bd2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:03:46.163097 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-142fc55d-efc6-4a36-9f50-fe05e3967bd2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:03:46.163629 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-142fc55d-efc6-4a36-9f50-fe05e3967bd2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:03:46.163797 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-142fc55d-efc6-4a36-9f50-fe05e3967bd2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:03:46.207628 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-142fc55d-efc6-4a36-9f50-fe05e3967bd2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for floatingip, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:46.207961 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.l3_db [None req-142fc55d-efc6-4a36-9f50-fe05e3967bd2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Floating IP ac1692ea-92aa-4c4d-9568-dcfd5eab2b3f disassociated (deleted). External IP: 172.26.0.180, port: de10d0ea-35cf-47f1-9911-29480b4aabbc. Nov 09 05:03:46.406964 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-142fc55d-efc6-4a36-9f50-fe05e3967bd2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Router 19d0b855-419d-49a2-be7f-62683e5ccead has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 05:03:46.532306 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-142fc55d-efc6-4a36-9f50-fe05e3967bd2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 05:03:46.538032 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-142fc55d-efc6-4a36-9f50-fe05e3967bd2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:46.542377 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-efb03f3e-067a-40a6-b794-c68a203d0e0e None None] Sync routers for ids ['19d0b855-419d-49a2-be7f-62683e5ccead'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 05:03:46.552623 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-efb03f3e-067a-40a6-b794-c68a203d0e0e None None] Routers {'19d0b855-419d-49a2-be7f-62683e5ccead'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:03:46.553228 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-efb03f3e-067a-40a6-b794-c68a203d0e0e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:03:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['19d0b855-419d-49a2-be7f-62683e5ccead'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:03:46.574437 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-142fc55d-efc6-4a36-9f50-fe05e3967bd2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "DELETE /v2.0/floatingips/ac1692ea-92aa-4c4d-9568-dcfd5eab2b3f HTTP/1.1" status: 204 len: 168 time: 0.9083784 Nov 09 05:03:46.574958 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '421b5eb5-ae33-482f-a2fb-e14691f2fd50', 'tag': 'de10d0ea-35cf-47f1-9911-29480b4aabbc'}] {{(pid=102161) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:03:46.577369 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}99dfdda0def497b4372884ef2eb87f06b1e425c8eba5ceda5f64bbab037a07d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fb9250b3-5fd2-4b37-8199-0e70a9ba706e" -d '{"events": [{"name": "network-changed", "server_uuid": "421b5eb5-ae33-482f-a2fb-e14691f2fd50", "tag": "de10d0ea-35cf-47f1-9911-29480b4aabbc"}]}' {{(pid=102161) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:03:46.590405 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:46.622019 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 05:03:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e90354f8-15a3-4221-af12-3f83322acb44 x-openstack-request-id: req-e90354f8-15a3-4221-af12-3f83322acb44 {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:03:46.622402 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "421b5eb5-ae33-482f-a2fb-e14691f2fd50", "tag": "de10d0ea-35cf-47f1-9911-29480b4aabbc", "status": "completed", "code": 200}]} {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:03:46.622669 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-e90354f8-15a3-4221-af12-3f83322acb44 {{(pid=102161) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:03:46.623079 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '421b5eb5-ae33-482f-a2fb-e14691f2fd50', 'tag': 'de10d0ea-35cf-47f1-9911-29480b4aabbc', 'status': 'completed', 'code': 200} Nov 09 05:03:46.666472 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-efb03f3e-067a-40a6-b794-c68a203d0e0e None None] Set router 19d0b855-419d-49a2-be7f-62683e5ccead gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:03:46.688489 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb9250b3-5fd2-4b37-8199-0e70a9ba706e req-2a9b3e19-e137-4fe7-827d-9d708b613630 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:03:46.690239 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fb9250b3-5fd2-4b37-8199-0e70a9ba706e req-2a9b3e19-e137-4fe7-827d-9d708b613630 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=8ac3eab68bd34485af7ddc3417853b28&device_id=421b5eb5-ae33-482f-a2fb-e14691f2fd50 HTTP/1.1" status: 200 len: 1098 time: 0.0425584 Nov 09 05:03:46.779845 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb9250b3-5fd2-4b37-8199-0e70a9ba706e req-23dc704f-9bfe-46a6-8d81-a3f229b3b039 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:03:46.781305 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fb9250b3-5fd2-4b37-8199-0e70a9ba706e req-23dc704f-9bfe-46a6-8d81-a3f229b3b039 service neutron] 10.222.0.26 "GET /v2.0/networks?id=e6d0e278-6b66-4438-954b-591e77b9717d HTTP/1.1" status: 200 len: 898 time: 0.0840037 Nov 09 05:03:46.830088 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fb9250b3-5fd2-4b37-8199-0e70a9ba706e req-1ec25716-1d8f-48c1-90b6-89b44a4c0077 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=de10d0ea-35cf-47f1-9911-29480b4aabbc HTTP/1.1" status: 200 len: 217 time: 0.0420682 Nov 09 05:03:46.864893 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-efb03f3e-067a-40a6-b794-c68a203d0e0e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '19d0b855-419d-49a2-be7f-62683e5ccead', 'name': 'tempest-TestNetworkAdvancedServerOps-router-86155025', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.223'}], 'enable_snat': True}, 'gw_port_id': '8658c0af-8b24-4ca6-954a-776ea8725321', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:02:45Z', 'updated_at': '2021-11-09T05:02:49Z', 'revision_number': 4, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': '8658c0af-8b24-4ca6-954a-776ea8725321', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:79:a1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '19d0b855-419d-49a2-be7f-62683e5ccead', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1710, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.223', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:02:45Z', 'updated_at': '2021-11-09T05:02:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '4b497baa-4c0e-4e33-8d3c-5902b0a8997f', 'name': '', 'network_id': 'e6d0e278-6b66-4438-954b-591e77b9717d', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'mac_address': 'fa:16:3e:57:01:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '19d0b855-419d-49a2-be7f-62683e5ccead', 'device_owner': 'network:router_interface', 'standard_attr_id': 1713, 'fixed_ips': [{'subnet_id': '4f2a77d5-99c4-4ea5-9dd3-8953e768f315', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:02:49Z', 'updated_at': '2021-11-09T05:02:52Z', 'revision_number': 5, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'subnets': [{'id': '4f2a77d5-99c4-4ea5-9dd3-8953e768f315', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:03:46.890906 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-efb03f3e-067a-40a6-b794-c68a203d0e0e None None] Checking router: 19d0b855-419d-49a2-be7f-62683e5ccead for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 05:03:46.893039 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb9250b3-5fd2-4b37-8199-0e70a9ba706e req-4e8e8a18-b322-46bc-b332-4ddbaa1bcf6c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:03:46.894594 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fb9250b3-5fd2-4b37-8199-0e70a9ba706e req-4e8e8a18-b322-46bc-b332-4ddbaa1bcf6c service neutron] 10.222.0.26 "GET /v2.0/subnets?id=4f2a77d5-99c4-4ea5-9dd3-8953e768f315 HTTP/1.1" status: 200 len: 834 time: 0.0576437 Nov 09 05:03:46.900664 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-efb03f3e-067a-40a6-b794-c68a203d0e0e None None] Routers {'19d0b855-419d-49a2-be7f-62683e5ccead'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:03:46.901298 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-efb03f3e-067a-40a6-b794-c68a203d0e0e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:03:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['19d0b855-419d-49a2-be7f-62683e5ccead'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:03:46.958104 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb9250b3-5fd2-4b37-8199-0e70a9ba706e req-52099c20-5a9a-4871-88ed-06cbdfd04564 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:03:46.959522 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fb9250b3-5fd2-4b37-8199-0e70a9ba706e req-52099c20-5a9a-4871-88ed-06cbdfd04564 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=e6d0e278-6b66-4438-954b-591e77b9717d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0576856 Nov 09 05:03:47.016066 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-efb03f3e-067a-40a6-b794-c68a203d0e0e None None] Set router 19d0b855-419d-49a2-be7f-62683e5ccead gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:03:47.017856 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:47.051746 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d77c2940-e30d-4968-99e7-c28ab298dbd4 req-9210024c-f403-42b4-8026-1f06ad6876fa tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:03:47.053262 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d77c2940-e30d-4968-99e7-c28ab298dbd4 req-9210024c-f403-42b4-8026-1f06ad6876fa tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=421b5eb5-ae33-482f-a2fb-e14691f2fd50 HTTP/1.1" status: 200 len: 945 time: 0.1089759 Nov 09 05:03:47.097003 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fb9250b3-5fd2-4b37-8199-0e70a9ba706e req-f2569624-f49c-4b05-a4a6-fd01952fe1e0 service neutron] 10.222.0.26 "GET /v2.0/networks/e6d0e278-6b66-4438-954b-591e77b9717d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1235201 Nov 09 05:03:47.141140 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d77c2940-e30d-4968-99e7-c28ab298dbd4 req-6adf14a5-009a-4f22-96dc-a4b824059de9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=072bd602-b45e-4156-a831-2cb9a9e0ed3a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0796683 Nov 09 05:03:47.208473 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fb9250b3-5fd2-4b37-8199-0e70a9ba706e req-7183034a-1fed-403b-a4df-9902ed188c06 service neutron] 10.222.0.26 "GET /v2.0/networks/e6d0e278-6b66-4438-954b-591e77b9717d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1010938 Nov 09 05:03:47.221842 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-efb03f3e-067a-40a6-b794-c68a203d0e0e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '19d0b855-419d-49a2-be7f-62683e5ccead', 'name': 'tempest-TestNetworkAdvancedServerOps-router-86155025', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.223'}], 'enable_snat': True}, 'gw_port_id': '8658c0af-8b24-4ca6-954a-776ea8725321', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:02:45Z', 'updated_at': '2021-11-09T05:02:49Z', 'revision_number': 4, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': '8658c0af-8b24-4ca6-954a-776ea8725321', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:79:a1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '19d0b855-419d-49a2-be7f-62683e5ccead', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1710, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.223', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:02:45Z', 'updated_at': '2021-11-09T05:02:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '4b497baa-4c0e-4e33-8d3c-5902b0a8997f', 'name': '', 'network_id': 'e6d0e278-6b66-4438-954b-591e77b9717d', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'mac_address': 'fa:16:3e:57:01:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '19d0b855-419d-49a2-be7f-62683e5ccead', 'device_owner': 'network:router_interface', 'standard_attr_id': 1713, 'fixed_ips': [{'subnet_id': '4f2a77d5-99c4-4ea5-9dd3-8953e768f315', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:02:49Z', 'updated_at': '2021-11-09T05:02:52Z', 'revision_number': 5, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'subnets': [{'id': '4f2a77d5-99c4-4ea5-9dd3-8953e768f315', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:03:47.248572 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-efb03f3e-067a-40a6-b794-c68a203d0e0e None None] The sync data for ids ['19d0b855-419d-49a2-be7f-62683e5ccead'] in dv-neutron-816802-2-hyperv is: [{'id': '19d0b855-419d-49a2-be7f-62683e5ccead', 'name': 'tempest-TestNetworkAdvancedServerOps-router-86155025', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.223'}], 'enable_snat': True}, 'gw_port_id': '8658c0af-8b24-4ca6-954a-776ea8725321', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:02:45Z', 'updated_at': '2021-11-09T05:02:49Z', 'revision_number': 4, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': '8658c0af-8b24-4ca6-954a-776ea8725321', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:79:a1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '19d0b855-419d-49a2-be7f-62683e5ccead', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1710, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.223', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:02:45Z', 'updated_at': '2021-11-09T05:02:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '4b497baa-4c0e-4e33-8d3c-5902b0a8997f', 'name': '', 'network_id': 'e6d0e278-6b66-4438-954b-591e77b9717d', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'mac_address': 'fa:16:3e:57:01:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '19d0b855-419d-49a2-be7f-62683e5ccead', 'device_owner': 'network:router_interface', 'standard_attr_id': 1713, 'fixed_ips': [{'subnet_id': '4f2a77d5-99c4-4ea5-9dd3-8953e768f315', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:02:49Z', 'updated_at': '2021-11-09T05:02:52Z', 'revision_number': 5, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'subnets': [{'id': '4f2a77d5-99c4-4ea5-9dd3-8953e768f315', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 05:03:47.468244 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-37b70c5c-c677-44f4-828f-88050c655c09 None None] New status for floating IP ac1692ea-92aa-4c4d-9568-dcfd5eab2b3f: DOWN {{(pid=102164) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 05:03:48.433138 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e225ed2-307b-4a12-bda5-2374161c500c req-9cafb000-20db-47cf-929f-b642235eeefb tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:03:48.434564 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-5e225ed2-307b-4a12-bda5-2374161c500c req-9cafb000-20db-47cf-929f-b642235eeefb tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=421b5eb5-ae33-482f-a2fb-e14691f2fd50 HTTP/1.1" status: 200 len: 945 time: 0.0486414 Nov 09 05:03:48.483376 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-5e225ed2-307b-4a12-bda5-2374161c500c req-7a407335-29ac-4f6c-8569-78badacaee04 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=072bd602-b45e-4156-a831-2cb9a9e0ed3a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423951 Nov 09 05:03:48.522232 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca90d24d-1b76-4a04-85c7-866ef5d7c1d7 req-f68dcf86-ce70-441b-8ffa-efeb4e85cc7c tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:03:48.524362 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ca90d24d-1b76-4a04-85c7-866ef5d7c1d7 req-f68dcf86-ce70-441b-8ffa-efeb4e85cc7c tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.26 "GET /v2.0/ports?device_id=421b5eb5-ae33-482f-a2fb-e14691f2fd50 HTTP/1.1" status: 200 len: 945 time: 0.0484726 Nov 09 05:03:48.608790 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-ca90d24d-1b76-4a04-85c7-866ef5d7c1d7 req-741c0f19-0e76-4501-9433-d3716481052d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Deleting port de10d0ea-35cf-47f1-9911-29480b4aabbc {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:03:48.609119 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-ca90d24d-1b76-4a04-85c7-866ef5d7c1d7 req-741c0f19-0e76-4501-9433-d3716481052d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:48.697439 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-ca90d24d-1b76-4a04-85c7-866ef5d7c1d7 req-741c0f19-0e76-4501-9433-d3716481052d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] For port de10d0ea-35cf-47f1-9911-29480b4aabbc, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=de10d0ea-35cf-47f1-9911-29480b4aabbc,segment=NetworkSegment(e5bca6a2-17ea-4ff0-8af7-dc2717016f87),segment_id=e5bca6a2-17ea-4ff0-8af7-dc2717016f87)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:03:48.697714 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-ca90d24d-1b76-4a04-85c7-866ef5d7c1d7 req-741c0f19-0e76-4501-9433-d3716481052d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:48.710204 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-ca90d24d-1b76-4a04-85c7-866ef5d7c1d7 req-741c0f19-0e76-4501-9433-d3716481052d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Calling delete_port for de10d0ea-35cf-47f1-9911-29480b4aabbc owned by compute:nova {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:03:48.901668 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-ca90d24d-1b76-4a04-85c7-866ef5d7c1d7 req-741c0f19-0e76-4501-9433-d3716481052d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:48.930621 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-741c0f19-0e76-4501-9433-d3716481052d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event deleted for resources: {'Port': ['ID=de10d0ea-35cf-47f1-9911-29480b4aabbc,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:03:48.943055 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-741c0f19-0e76-4501-9433-d3716481052d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:03:48.943055 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-741c0f19-0e76-4501-9433-d3716481052d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:03:48.943366 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-741c0f19-0e76-4501-9433-d3716481052d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:03:48.943685 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-741c0f19-0e76-4501-9433-d3716481052d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:03:48.943973 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-741c0f19-0e76-4501-9433-d3716481052d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:03:48.944352 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-741c0f19-0e76-4501-9433-d3716481052d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:03:48.944674 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-741c0f19-0e76-4501-9433-d3716481052d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:03:48.945046 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-741c0f19-0e76-4501-9433-d3716481052d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:03:48.945890 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-741c0f19-0e76-4501-9433-d3716481052d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:03:48.946211 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-741c0f19-0e76-4501-9433-d3716481052d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:03:48.946549 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-741c0f19-0e76-4501-9433-d3716481052d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:03:48.951092 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-741c0f19-0e76-4501-9433-d3716481052d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:03:48.979078 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-ca90d24d-1b76-4a04-85c7-866ef5d7c1d7 req-741c0f19-0e76-4501-9433-d3716481052d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] No DVR routers for this DVR port de10d0ea-35cf-47f1-9911-29480b4aabbc on host hv-neutron-8168 {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 05:03:48.981502 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-ca90d24d-1b76-4a04-85c7-866ef5d7c1d7 req-741c0f19-0e76-4501-9433-d3716481052d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:48.984917 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ca90d24d-1b76-4a04-85c7-866ef5d7c1d7 req-741c0f19-0e76-4501-9433-d3716481052d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.26 "DELETE /v2.0/ports/de10d0ea-35cf-47f1-9911-29480b4aabbc HTTP/1.1" status: 204 len: 173 time: 0.4544508 Nov 09 05:03:48.985350 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '421b5eb5-ae33-482f-a2fb-e14691f2fd50', 'name': 'network-vif-deleted', 'tag': 'de10d0ea-35cf-47f1-9911-29480b4aabbc'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:03:48.987651 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dce0aefc-aac3-4e56-ac05-bf8a825ff63f" -d '{"events": [{"server_uuid": "421b5eb5-ae33-482f-a2fb-e14691f2fd50", "name": "network-vif-deleted", "tag": "de10d0ea-35cf-47f1-9911-29480b4aabbc"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:03:49.023879 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 05:03:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-181d27a9-4936-4509-816c-62294c1b7066 x-openstack-request-id: req-181d27a9-4936-4509-816c-62294c1b7066 {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:03:49.024174 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "421b5eb5-ae33-482f-a2fb-e14691f2fd50", "name": "network-vif-deleted", "tag": "de10d0ea-35cf-47f1-9911-29480b4aabbc", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:03:49.024430 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-181d27a9-4936-4509-816c-62294c1b7066 {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:03:49.024831 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '421b5eb5-ae33-482f-a2fb-e14691f2fd50', 'name': 'network-vif-deleted', 'tag': 'de10d0ea-35cf-47f1-9911-29480b4aabbc', 'status': 'completed', 'code': 200} Nov 09 05:03:49.592244 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-15c58f8b-ee87-4f72-b400-e4d8e13ee710 req-b8241b65-60ea-4aed-b38d-f7231ec3e29a tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=421b5eb5-ae33-482f-a2fb-e14691f2fd50 HTTP/1.1" status: 200 len: 210 time: 0.0264318 Nov 09 05:03:50.646397 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36816) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:03:50.994608 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8efcc0fb-4bf1-4164-bf23-ca830648203e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:51.245655 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-8efcc0fb-4bf1-4164-bf23-ca830648203e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Deleting port 4b497baa-4c0e-4e33-8d3c-5902b0a8997f {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:03:51.245906 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8efcc0fb-4bf1-4164-bf23-ca830648203e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:51.333076 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-8efcc0fb-4bf1-4164-bf23-ca830648203e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] For port 4b497baa-4c0e-4e33-8d3c-5902b0a8997f, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=4b497baa-4c0e-4e33-8d3c-5902b0a8997f,segment=NetworkSegment(e5bca6a2-17ea-4ff0-8af7-dc2717016f87),segment_id=e5bca6a2-17ea-4ff0-8af7-dc2717016f87)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:03:51.333432 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8efcc0fb-4bf1-4164-bf23-ca830648203e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:51.345698 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-8efcc0fb-4bf1-4164-bf23-ca830648203e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Calling delete_port for 4b497baa-4c0e-4e33-8d3c-5902b0a8997f owned by network:router_interface {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:03:51.569757 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8efcc0fb-4bf1-4164-bf23-ca830648203e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:51.600160 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8efcc0fb-4bf1-4164-bf23-ca830648203e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event deleted for resources: {'Port': ['ID=4b497baa-4c0e-4e33-8d3c-5902b0a8997f,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:03:51.768277 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8efcc0fb-4bf1-4164-bf23-ca830648203e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:52.272515 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8efcc0fb-4bf1-4164-bf23-ca830648203e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Router 19d0b855-419d-49a2-be7f-62683e5ccead has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 05:03:52.375035 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8efcc0fb-4bf1-4164-bf23-ca830648203e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 05:03:52.379961 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-8efcc0fb-4bf1-4164-bf23-ca830648203e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "PUT /v2.0/routers/19d0b855-419d-49a2-be7f-62683e5ccead/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7325554 Nov 09 05:03:52.383413 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 36818) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:03:52.385397 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2c0489a2-7a63-483c-9c0c-b3cec5148233 None None] Sync routers for ids ['19d0b855-419d-49a2-be7f-62683e5ccead'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 05:03:52.395394 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2c0489a2-7a63-483c-9c0c-b3cec5148233 None None] Routers {'19d0b855-419d-49a2-be7f-62683e5ccead'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:03:52.396004 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-2c0489a2-7a63-483c-9c0c-b3cec5148233 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:03:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['19d0b855-419d-49a2-be7f-62683e5ccead'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:03:52.437286 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-1c6df6de-1f18-474f-bf40-50bd6b11e809 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Deleting subnet 4f2a77d5-99c4-4ea5-9dd3-8953e768f315 {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 05:03:52.440750 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1c6df6de-1f18-474f-bf40-50bd6b11e809 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:52.485111 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1c6df6de-1f18-474f-bf40-50bd6b11e809 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:52.502566 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-2c0489a2-7a63-483c-9c0c-b3cec5148233 None None] Set router 19d0b855-419d-49a2-be7f-62683e5ccead gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:03:52.566236 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1c6df6de-1f18-474f-bf40-50bd6b11e809 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:52.577072 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device de10d0ea-35cf-47f1-9911-29480b4aabbc no longer exists at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 05:03:52.690946 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1c6df6de-1f18-474f-bf40-50bd6b11e809 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:52.773043 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] No Port match for: de10d0ea-35cf-47f1-9911-29480b4aabbc {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 05:03:52.773410 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device de10d0ea-35cf-47f1-9911-29480b4aabbc not bound to the agent host hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 05:03:52.858026 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-2c0489a2-7a63-483c-9c0c-b3cec5148233 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '19d0b855-419d-49a2-be7f-62683e5ccead', 'name': 'tempest-TestNetworkAdvancedServerOps-router-86155025', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.223'}], 'enable_snat': True}, 'gw_port_id': '8658c0af-8b24-4ca6-954a-776ea8725321', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:02:45Z', 'updated_at': '2021-11-09T05:03:51Z', 'revision_number': 5, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': '8658c0af-8b24-4ca6-954a-776ea8725321', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:79:a1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '19d0b855-419d-49a2-be7f-62683e5ccead', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1710, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.223', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:02:45Z', 'updated_at': '2021-11-09T05:02:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:03:52.885848 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2c0489a2-7a63-483c-9c0c-b3cec5148233 None None] Checking router: 19d0b855-419d-49a2-be7f-62683e5ccead for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 05:03:52.894596 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2c0489a2-7a63-483c-9c0c-b3cec5148233 None None] Routers {'19d0b855-419d-49a2-be7f-62683e5ccead'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:03:52.895218 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-2c0489a2-7a63-483c-9c0c-b3cec5148233 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:03:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['19d0b855-419d-49a2-be7f-62683e5ccead'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:03:53.001341 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-2c0489a2-7a63-483c-9c0c-b3cec5148233 None None] Set router 19d0b855-419d-49a2-be7f-62683e5ccead gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:03:53.006607 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c6df6de-1f18-474f-bf40-50bd6b11e809 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event deleted for resources: {'Subnet': ['ID=4f2a77d5-99c4-4ea5-9dd3-8953e768f315,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:03:53.010193 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1c6df6de-1f18-474f-bf40-50bd6b11e809 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:53.015810 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-1c6df6de-1f18-474f-bf40-50bd6b11e809 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "DELETE /v2.0/subnets/4f2a77d5-99c4-4ea5-9dd3-8953e768f315 HTTP/1.1" status: 204 len: 168 time: 0.6289990 Nov 09 05:03:53.016183 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36820) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:03:53.055951 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8f3cd1c4-87a7-43d0-9cfa-04e52af21449 None None] Network e6d0e278-6b66-4438-954b-591e77b9717d requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 05:03:53.124485 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c4d20314-f97f-4166-9df5-ef3206bdbe00 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for router, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:53.227217 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c4d20314-f97f-4166-9df5-ef3206bdbe00 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for router_gateway, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:53.277559 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-2c0489a2-7a63-483c-9c0c-b3cec5148233 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '19d0b855-419d-49a2-be7f-62683e5ccead', 'name': 'tempest-TestNetworkAdvancedServerOps-router-86155025', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.223'}], 'enable_snat': True}, 'gw_port_id': '8658c0af-8b24-4ca6-954a-776ea8725321', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:02:45Z', 'updated_at': '2021-11-09T05:03:51Z', 'revision_number': 5, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': '8658c0af-8b24-4ca6-954a-776ea8725321', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:79:a1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '19d0b855-419d-49a2-be7f-62683e5ccead', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1710, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.223', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:02:45Z', 'updated_at': '2021-11-09T05:02:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:03:53.304125 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2c0489a2-7a63-483c-9c0c-b3cec5148233 None None] The sync data for ids ['19d0b855-419d-49a2-be7f-62683e5ccead'] in dv-neutron-816802-2-hyperv is: [{'id': '19d0b855-419d-49a2-be7f-62683e5ccead', 'name': 'tempest-TestNetworkAdvancedServerOps-router-86155025', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.223'}], 'enable_snat': True}, 'gw_port_id': '8658c0af-8b24-4ca6-954a-776ea8725321', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:02:45Z', 'updated_at': '2021-11-09T05:03:51Z', 'revision_number': 5, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': '8658c0af-8b24-4ca6-954a-776ea8725321', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:79:a1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '19d0b855-419d-49a2-be7f-62683e5ccead', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1710, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.223', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:02:45Z', 'updated_at': '2021-11-09T05:02:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 05:03:53.332829 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7859b455-33dd-4272-b8bd-608691569ac3 None None] DHCP port deletion for e6d0e278-6b66-4438-954b-591e77b9717d request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 05:03:53.358300 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-c4d20314-f97f-4166-9df5-ef3206bdbe00 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Deleting port 8658c0af-8b24-4ca6-954a-776ea8725321 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:03:53.358674 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c4d20314-f97f-4166-9df5-ef3206bdbe00 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:53.383032 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-7859b455-33dd-4272-b8bd-608691569ac3 None None] Deleting port 475fb0cf-286d-4084-82c3-16361e5547a9 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:03:53.383396 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7859b455-33dd-4272-b8bd-608691569ac3 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:53.435224 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-c4d20314-f97f-4166-9df5-ef3206bdbe00 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] For port 8658c0af-8b24-4ca6-954a-776ea8725321, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=8658c0af-8b24-4ca6-954a-776ea8725321,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:03:53.435588 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c4d20314-f97f-4166-9df5-ef3206bdbe00 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:53.446695 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-7859b455-33dd-4272-b8bd-608691569ac3 None None] For port 475fb0cf-286d-4084-82c3-16361e5547a9, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=475fb0cf-286d-4084-82c3-16361e5547a9,segment=NetworkSegment(e5bca6a2-17ea-4ff0-8af7-dc2717016f87),segment_id=e5bca6a2-17ea-4ff0-8af7-dc2717016f87)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:03:53.447243 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7859b455-33dd-4272-b8bd-608691569ac3 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:53.448177 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-c4d20314-f97f-4166-9df5-ef3206bdbe00 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Calling delete_port for 8658c0af-8b24-4ca6-954a-776ea8725321 owned by network:router_gateway {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:03:53.460293 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-7859b455-33dd-4272-b8bd-608691569ac3 None None] Calling delete_port for 475fb0cf-286d-4084-82c3-16361e5547a9 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:03:53.638267 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7859b455-33dd-4272-b8bd-608691569ac3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:53.665037 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7859b455-33dd-4272-b8bd-608691569ac3 None None] Pushing event deleted for resources: {'Port': ['ID=475fb0cf-286d-4084-82c3-16361e5547a9,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:03:53.666887 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c4d20314-f97f-4166-9df5-ef3206bdbe00 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:53.670231 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7859b455-33dd-4272-b8bd-608691569ac3 None None] No DVR routers for this DVR port 475fb0cf-286d-4084-82c3-16361e5547a9 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 05:03:53.687066 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7859b455-33dd-4272-b8bd-608691569ac3 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:03:53.692013 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7859b455-33dd-4272-b8bd-608691569ac3 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:03:53.692013 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7859b455-33dd-4272-b8bd-608691569ac3 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:03:53.692013 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7859b455-33dd-4272-b8bd-608691569ac3 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:03:53.692013 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7859b455-33dd-4272-b8bd-608691569ac3 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:03:53.692013 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7859b455-33dd-4272-b8bd-608691569ac3 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:03:53.692013 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7859b455-33dd-4272-b8bd-608691569ac3 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:03:53.692013 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7859b455-33dd-4272-b8bd-608691569ac3 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:03:53.692013 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7859b455-33dd-4272-b8bd-608691569ac3 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:03:53.692013 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7859b455-33dd-4272-b8bd-608691569ac3 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:03:53.692013 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7859b455-33dd-4272-b8bd-608691569ac3 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:03:53.692013 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7859b455-33dd-4272-b8bd-608691569ac3 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:03:53.700039 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4d20314-f97f-4166-9df5-ef3206bdbe00 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event deleted for resources: {'Port': ['ID=8658c0af-8b24-4ca6-954a-776ea8725321,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:03:53.768200 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c4d20314-f97f-4166-9df5-ef3206bdbe00 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-466373'] for router_gateway, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:53.861738 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c4d20314-f97f-4166-9df5-ef3206bdbe00 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:53.863819 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c4d20314-f97f-4166-9df5-ef3206bdbe00 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:53.992627 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c4d20314-f97f-4166-9df5-ef3206bdbe00 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:53.993225 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c4d20314-f97f-4166-9df5-ef3206bdbe00 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Fanout notify agent at l3_agent the message router_deleted on router 19d0b855-419d-49a2-be7f-62683e5ccead {{(pid=102161) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 05:03:54.000189 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c4d20314-f97f-4166-9df5-ef3206bdbe00 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:54.001283 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-c4d20314-f97f-4166-9df5-ef3206bdbe00 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "DELETE /v2.0/routers/19d0b855-419d-49a2-be7f-62683e5ccead HTTP/1.1" status: 204 len: 168 time: 0.9841259 Nov 09 05:03:54.004154 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 36822) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:03:54.082686 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9b5d1674-d275-4f8e-bc01-0c71fa3205f7 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:54.169864 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9b5d1674-d275-4f8e-bc01-0c71fa3205f7 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:54.191492 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-9b5d1674-d275-4f8e-bc01-0c71fa3205f7 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e6d0e278-6b66-4438-954b-591e77b9717d']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:03:54.201083 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-9b5d1674-d275-4f8e-bc01-0c71fa3205f7 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e5bca6a2-17ea-4ff0-8af7-dc2717016f87') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:03:54.201352 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-9b5d1674-d275-4f8e-bc01-0c71fa3205f7 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e5bca6a2-17ea-4ff0-8af7-dc2717016f87') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:03:54.210684 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9b5d1674-d275-4f8e-bc01-0c71fa3205f7 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:54.223638 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9b5d1674-d275-4f8e-bc01-0c71fa3205f7 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:54.229388 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9b5d1674-d275-4f8e-bc01-0c71fa3205f7 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Releasing vlan 336 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 05:03:54.229765 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9b5d1674-d275-4f8e-bc01-0c71fa3205f7 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:54.232685 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 05:03:54.232685 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 05:03:54.232685 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 05:03:54.232685 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 05:03:54.232685 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 05:03:54.232685 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 05:03:54.232685 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 05:03:54.232685 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 05:03:54.232685 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 05:03:54.232685 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 05:03:54.232685 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 05:03:54.232685 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 05:03:54.232685 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 05:03:54.232685 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 05:03:54.232685 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 05:03:54.232685 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 05:03:54.232685 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 05:03:54.232685 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 05:03:54.232685 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 05:03:54.232685 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 05:03:54.232685 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 05:03:54.232685 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 05:03:54.232685 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 05:03:54.232685 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 05:03:54.232685 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 05:03:54.232685 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 05:03:54.232685 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 05:03:54.232685 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 05:03:54.232685 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 05:03:54.232685 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 05:03:54.232685 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 05:03:54.232685 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 05:03:54.375562 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9b5d1674-d275-4f8e-bc01-0c71fa3205f7 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:54.383195 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9b5d1674-d275-4f8e-bc01-0c71fa3205f7 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:54.386053 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-9b5d1674-d275-4f8e-bc01-0c71fa3205f7 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "DELETE /v2.0/networks/e6d0e278-6b66-4438-954b-591e77b9717d HTTP/1.1" status: 204 len: 168 time: 0.3808448 Nov 09 05:03:54.388888 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36824) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:03:54.397298 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b5d1674-d275-4f8e-bc01-0c71fa3205f7 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event deleted for resources: {'Network': ['ID=e6d0e278-6b66-4438-954b-591e77b9717d,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:03:54.469692 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 8658c0af-8b24-4ca6-954a-776ea8725321 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 05:03:54.473343 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ba08064e-bd66-4ed2-ae8c-bcc423c0da6a tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:54.501818 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ba08064e-bd66-4ed2-ae8c-bcc423c0da6a tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:54.506967 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 8658c0af-8b24-4ca6-954a-776ea8725321 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 05:03:54.507603 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 8658c0af-8b24-4ca6-954a-776ea8725321 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 05:03:54.508294 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 475fb0cf-286d-4084-82c3-16361e5547a9 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 05:03:54.534767 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 475fb0cf-286d-4084-82c3-16361e5547a9 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 05:03:54.535472 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 475fb0cf-286d-4084-82c3-16361e5547a9 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 05:03:54.535835 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 4b497baa-4c0e-4e33-8d3c-5902b0a8997f no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 05:03:54.556765 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 4b497baa-4c0e-4e33-8d3c-5902b0a8997f {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 05:03:54.557160 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 4b497baa-4c0e-4e33-8d3c-5902b0a8997f not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 05:03:54.620872 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ba08064e-bd66-4ed2-ae8c-bcc423c0da6a tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:54.623490 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-ba08064e-bd66-4ed2-ae8c-bcc423c0da6a tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:54.625327 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-ba08064e-bd66-4ed2-ae8c-bcc423c0da6a tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "DELETE /v2.0/security-groups/072bd602-b45e-4156-a831-2cb9a9e0ed3a HTTP/1.1" status: 204 len: 168 time: 0.2347136 Nov 09 05:03:54.633921 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba08064e-bd66-4ed2-ae8c-bcc423c0da6a tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=072bd602-b45e-4156-a831-2cb9a9e0ed3a,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:03:55.065177 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 36830) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:03:55.069825 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-0f00c553-4326-444a-8df8-e05d92dc0fa0 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1673430514', 'description': 'tempest-secgroup-smoke-1673430514 description', 'project_id': '8ac3eab68bd34485af7ddc3417853b28'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:03:55.169566 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0f00c553-4326-444a-8df8-e05d92dc0fa0 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:55.239929 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0f00c553-4326-444a-8df8-e05d92dc0fa0 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:55.299502 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0f00c553-4326-444a-8df8-e05d92dc0fa0 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:55.328446 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f00c553-4326-444a-8df8-e05d92dc0fa0 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'SecurityGroup': ['ID=1cf96a5c-2f90-45b2-850e-3b6b8d385bbd,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:03:55.387534 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0f00c553-4326-444a-8df8-e05d92dc0fa0 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:55.388799 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-0f00c553-4326-444a-8df8-e05d92dc0fa0 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.3226168 Nov 09 05:03:55.391616 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 36832) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:03:55.395897 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-25fd3812-7bcc-472d-afe1-e4e8c1772ff5 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'security_group_rule': {'security_group_id': '1cf96a5c-2f90-45b2-850e-3b6b8d385bbd', 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:03:55.478990 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-25fd3812-7bcc-472d-afe1-e4e8c1772ff5 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:55.531489 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-25fd3812-7bcc-472d-afe1-e4e8c1772ff5 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:55.569555 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-25fd3812-7bcc-472d-afe1-e4e8c1772ff5 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:55.587499 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25fd3812-7bcc-472d-afe1-e4e8c1772ff5 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c95efb0c-8948-47d0-a1d0-16086eebb4a7,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:03:55.634870 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-25fd3812-7bcc-472d-afe1-e4e8c1772ff5 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:55.636045 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-25fd3812-7bcc-472d-afe1-e4e8c1772ff5 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2435277 Nov 09 05:03:55.638712 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 36834) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:03:55.642905 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-24159954-e0bd-4c3e-b981-782eff606a35 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'security_group_rule': {'security_group_id': '1cf96a5c-2f90-45b2-850e-3b6b8d385bbd', 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:03:55.726734 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-24159954-e0bd-4c3e-b981-782eff606a35 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:55.790333 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-24159954-e0bd-4c3e-b981-782eff606a35 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:55.854895 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-24159954-e0bd-4c3e-b981-782eff606a35 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:55.871975 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24159954-e0bd-4c3e-b981-782eff606a35 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d0130887-2f91-4704-952c-58cc159a0b47,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:03:55.925607 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-24159954-e0bd-4c3e-b981-782eff606a35 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:55.926857 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-24159954-e0bd-4c3e-b981-782eff606a35 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.2872424 Nov 09 05:03:55.929478 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 36836) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:03:55.934402 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-a19c7e24-719b-4d5d-b497-1b96a031e43b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'security_group_rule': {'security_group_id': '1cf96a5c-2f90-45b2-850e-3b6b8d385bbd', 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:03:56.025545 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a19c7e24-719b-4d5d-b497-1b96a031e43b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:56.081078 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a19c7e24-719b-4d5d-b497-1b96a031e43b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:56.152309 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a19c7e24-719b-4d5d-b497-1b96a031e43b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:56.169476 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a19c7e24-719b-4d5d-b497-1b96a031e43b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=738f2fa8-6091-4efe-932a-d9467e4fb6be,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:03:56.249830 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a19c7e24-719b-4d5d-b497-1b96a031e43b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:56.251091 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a19c7e24-719b-4d5d-b497-1b96a031e43b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3200424 Nov 09 05:03:56.253793 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 36838) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:03:56.258193 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-9293a6ba-e39a-4eb6-b0b4-3e7a6363e629 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'security_group_rule': {'security_group_id': '1cf96a5c-2f90-45b2-850e-3b6b8d385bbd', 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:03:56.355791 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9293a6ba-e39a-4eb6-b0b4-3e7a6363e629 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:56.409416 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9293a6ba-e39a-4eb6-b0b4-3e7a6363e629 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:56.471805 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9293a6ba-e39a-4eb6-b0b4-3e7a6363e629 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:56.488858 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9293a6ba-e39a-4eb6-b0b4-3e7a6363e629 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0683f26b-5bde-463d-afcb-f8aa286e376b,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:03:56.552696 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-9293a6ba-e39a-4eb6-b0b4-3e7a6363e629 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:56.553946 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-9293a6ba-e39a-4eb6-b0b4-3e7a6363e629 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.2991068 Nov 09 05:03:56.556658 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 36840) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:03:56.561114 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-3c715f6c-83b8-47de-89f7-7b9decf4422f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'security_group_rule': {'security_group_id': '1cf96a5c-2f90-45b2-850e-3b6b8d385bbd', 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:03:56.653602 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.securitygroups_db [None req-3c715f6c-83b8-47de-89f7-7b9decf4422f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Project 8ac3eab68bd34485af7ddc3417853b28 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 09 05:03:56.658582 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3c715f6c-83b8-47de-89f7-7b9decf4422f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:56.717619 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3c715f6c-83b8-47de-89f7-7b9decf4422f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:56.786629 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3c715f6c-83b8-47de-89f7-7b9decf4422f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:56.804042 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c715f6c-83b8-47de-89f7-7b9decf4422f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8b07da3d-bcec-40ca-87d6-2509bc058aea,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:03:56.878784 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3c715f6c-83b8-47de-89f7-7b9decf4422f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:56.882618 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-3c715f6c-83b8-47de-89f7-7b9decf4422f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.3224261 Nov 09 05:03:56.882770 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 36842) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:03:56.887823 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-a0766770-7700-43fc-8d38-e3ebc20cf9a2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'security_group_rule': {'security_group_id': '1cf96a5c-2f90-45b2-850e-3b6b8d385bbd', 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:03:56.985357 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.securitygroups_db [None req-a0766770-7700-43fc-8d38-e3ebc20cf9a2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Project 8ac3eab68bd34485af7ddc3417853b28 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 09 05:03:56.990645 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a0766770-7700-43fc-8d38-e3ebc20cf9a2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:57.048522 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a0766770-7700-43fc-8d38-e3ebc20cf9a2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:57.116631 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a0766770-7700-43fc-8d38-e3ebc20cf9a2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:57.134795 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0766770-7700-43fc-8d38-e3ebc20cf9a2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=69d03b10-4652-4c1f-8798-5ea27dd92dcd,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:03:57.222143 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a0766770-7700-43fc-8d38-e3ebc20cf9a2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:57.223400 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a0766770-7700-43fc-8d38-e3ebc20cf9a2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.3391070 Nov 09 05:03:57.226198 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 36844) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:03:57.231146 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-c946ae61-cd31-45ab-9766-34a194bedbf7 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'network': {'name': 'tempest-network-smoke--74904300', 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'port_security_enabled': True}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:03:57.316896 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c946ae61-cd31-45ab-9766-34a194bedbf7 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Made reservation on behalf of 8ac3eab68bd34485af7ddc3417853b28 for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 05:03:57.320341 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c946ae61-cd31-45ab-9766-34a194bedbf7 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:57.343676 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c946ae61-cd31-45ab-9766-34a194bedbf7 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 344} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 05:03:57.353357 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c946ae61-cd31-45ab-9766-34a194bedbf7 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:57.353748 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-c946ae61-cd31-45ab-9766-34a194bedbf7 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Added segment d82b4232-13d0-4050-bf58-c5e9ea713dd3 of type vlan for network 7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3 Nov 09 05:03:57.396169 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c946ae61-cd31-45ab-9766-34a194bedbf7 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:57.495171 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c946ae61-cd31-45ab-9766-34a194bedbf7 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:57.500784 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c946ae61-cd31-45ab-9766-34a194bedbf7 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:03:57.501363 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c946ae61-cd31-45ab-9766-34a194bedbf7 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:57.569691 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c946ae61-cd31-45ab-9766-34a194bedbf7 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'Network': ['ID=7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:03:57.580591 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 05:03:57.606645 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-c946ae61-cd31-45ab-9766-34a194bedbf7 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 767 time: 0.3793070 Nov 09 05:03:57.609271 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 36846) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:03:57.614102 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-a748cc30-7589-4dc9-8250-1d73676798fc tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'router': {'name': 'tempest-TestNetworkAdvancedServerOps-router-1648817839', 'admin_state_up': True, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:03:57.705512 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a748cc30-7589-4dc9-8250-1d73676798fc tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:57.706624 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a748cc30-7589-4dc9-8250-1d73676798fc tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:57.761643 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a748cc30-7589-4dc9-8250-1d73676798fc tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:57.956380 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a748cc30-7589-4dc9-8250-1d73676798fc tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:58.190607 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a748cc30-7589-4dc9-8250-1d73676798fc tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for router_gateway, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:58.209410 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a748cc30-7589-4dc9-8250-1d73676798fc tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:58.314166 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-a748cc30-7589-4dc9-8250-1d73676798fc tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Allocated IP 172.26.0.213 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/f0aedb4e-bdd3-4b77-b881-acdf25762d73) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 05:03:58.416329 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a748cc30-7589-4dc9-8250-1d73676798fc tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:58.506732 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a748cc30-7589-4dc9-8250-1d73676798fc tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:58.543579 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a748cc30-7589-4dc9-8250-1d73676798fc tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:03:58.548191 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-a748cc30-7589-4dc9-8250-1d73676798fc tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:03:58.551663 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a748cc30-7589-4dc9-8250-1d73676798fc tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 05:03:58.558009 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a748cc30-7589-4dc9-8250-1d73676798fc tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'Port': ['ID=f0aedb4e-bdd3-4b77-b881-acdf25762d73,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:03:58.907296 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a748cc30-7589-4dc9-8250-1d73676798fc tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for router_gateway, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:59.098214 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a748cc30-7589-4dc9-8250-1d73676798fc tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:59.289030 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a748cc30-7589-4dc9-8250-1d73676798fc tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Router 4b35f811-d243-43fb-b6b0-2ebfa884259d is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102162) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 05:03:59.389708 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a748cc30-7589-4dc9-8250-1d73676798fc tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 05:03:59.399351 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e5b89c2d-21cb-480d-86ca-952dbb9a1232 None None] Sync routers for ids ['4b35f811-d243-43fb-b6b0-2ebfa884259d'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 05:03:59.408929 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e5b89c2d-21cb-480d-86ca-952dbb9a1232 None None] Routers {'4b35f811-d243-43fb-b6b0-2ebfa884259d'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:03:59.409515 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-e5b89c2d-21cb-480d-86ca-952dbb9a1232 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:03:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['4b35f811-d243-43fb-b6b0-2ebfa884259d'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:03:59.480619 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a748cc30-7589-4dc9-8250-1d73676798fc tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:59.481974 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a748cc30-7589-4dc9-8250-1d73676798fc tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 896 time: 1.8714974 Nov 09 05:03:59.485059 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 36848) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:03:59.518814 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-e5b89c2d-21cb-480d-86ca-952dbb9a1232 None None] Set router 4b35f811-d243-43fb-b6b0-2ebfa884259d gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:03:59.519958 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-0acb2d99-a56d-4f99-aa7c-cd61169f1789 tempest-TestNetworkAdvancedServerOps-1212315804 tempest-TestNetworkAdvancedServerOps-1212315804-project-admin] 10.222.0.24 "GET /v2.0/subnets?project_id=8ac3eab68bd34485af7ddc3417853b28&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0338352 Nov 09 05:03:59.522696 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 36850) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:03:59.684714 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b7274846-2e39-4a4c-89bb-d48f503c38ec tempest-TestNetworkAdvancedServerOps-1212315804 tempest-TestNetworkAdvancedServerOps-1212315804-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:03:59.686144 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-b7274846-2e39-4a4c-89bb-d48f503c38ec tempest-TestNetworkAdvancedServerOps-1212315804 tempest-TestNetworkAdvancedServerOps-1212315804-project-admin] 10.222.0.24 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.1617830 Nov 09 05:03:59.689201 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 36852) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:03:59.703589 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-e5b89c2d-21cb-480d-86ca-952dbb9a1232 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4b35f811-d243-43fb-b6b0-2ebfa884259d', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1648817839', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.213'}], 'enable_snat': True}, 'gw_port_id': 'f0aedb4e-bdd3-4b77-b881-acdf25762d73', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:03:57Z', 'updated_at': '2021-11-09T05:03:58Z', 'revision_number': 3, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': 'f0aedb4e-bdd3-4b77-b881-acdf25762d73', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:1d:52:de', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4b35f811-d243-43fb-b6b0-2ebfa884259d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1729, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:03:58Z', 'updated_at': '2021-11-09T05:03:58Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:03:59.727390 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-fbf779dd-83bb-4764-99ac-cdcb33284cb3 tempest-TestNetworkAdvancedServerOps-1212315804 tempest-TestNetworkAdvancedServerOps-1212315804-project-admin] 10.222.0.24 "GET /v2.0/subnets?network_id=2b6725f5-ebfe-485a-8f42-ccb5a241ddb5&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0370860 Nov 09 05:03:59.729777 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 36854) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:03:59.730874 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e5b89c2d-21cb-480d-86ca-952dbb9a1232 None None] Checking router: 4b35f811-d243-43fb-b6b0-2ebfa884259d for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 05:03:59.731220 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e5b89c2d-21cb-480d-86ca-952dbb9a1232 None None] Updating router 4b35f811-d243-43fb-b6b0-2ebfa884259d port f0aedb4e-bdd3-4b77-b881-acdf25762d73 binding host dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 05:03:59.734454 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-ec0f58eb-a87b-4cd9-8af0-0c960bced7fd tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-863335769', 'network_id': '7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3', 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:03:59.759006 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-e5b89c2d-21cb-480d-86ca-952dbb9a1232 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:59.877645 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ec0f58eb-a87b-4cd9-8af0-0c960bced7fd tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Made reservation on behalf of 8ac3eab68bd34485af7ddc3417853b28 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 05:03:59.881249 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ec0f58eb-a87b-4cd9-8af0-0c960bced7fd tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:03:59.997368 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-e5b89c2d-21cb-480d-86ca-952dbb9a1232 None None] Publish callbacks [] for port, precommit_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:00.053434 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-e5b89c2d-21cb-480d-86ca-952dbb9a1232 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:00.104373 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-e5b89c2d-21cb-480d-86ca-952dbb9a1232 None None] Attempting to bind port f0aedb4e-bdd3-4b77-b881-acdf25762d73 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 05:04:00.104731 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-e5b89c2d-21cb-480d-86ca-952dbb9a1232 None None] Attempting to bind port f0aedb4e-bdd3-4b77-b881-acdf25762d73 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 05:04:00.105082 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e5b89c2d-21cb-480d-86ca-952dbb9a1232 None None] Attempting to bind port f0aedb4e-bdd3-4b77-b881-acdf25762d73 on network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 05:04:00.106961 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d56a0d2-6c08-40b9-9d66-19201d55cd1b None None] Pushing event updated for resources: {'Port': ['ID=f0aedb4e-bdd3-4b77-b881-acdf25762d73,revision_number=2']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:04:00.115789 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d56a0d2-6c08-40b9-9d66-19201d55cd1b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:04:00.116124 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d56a0d2-6c08-40b9-9d66-19201d55cd1b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:04:00.116454 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d56a0d2-6c08-40b9-9d66-19201d55cd1b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:04:00.116777 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d56a0d2-6c08-40b9-9d66-19201d55cd1b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:04:00.117096 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d56a0d2-6c08-40b9-9d66-19201d55cd1b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:04:00.118103 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d56a0d2-6c08-40b9-9d66-19201d55cd1b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:04:00.118456 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d56a0d2-6c08-40b9-9d66-19201d55cd1b None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:04:00.118779 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d56a0d2-6c08-40b9-9d66-19201d55cd1b None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:04:00.119099 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d56a0d2-6c08-40b9-9d66-19201d55cd1b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:04:00.119412 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d56a0d2-6c08-40b9-9d66-19201d55cd1b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:04:00.119716 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d56a0d2-6c08-40b9-9d66-19201d55cd1b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:04:00.120029 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d56a0d2-6c08-40b9-9d66-19201d55cd1b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:04:00.123083 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e5b89c2d-21cb-480d-86ca-952dbb9a1232 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 5, 3, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 05:04:00.123439 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e5b89c2d-21cb-480d-86ca-952dbb9a1232 None None] Checking segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102164) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 05:04:00.123820 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-e5b89c2d-21cb-480d-86ca-952dbb9a1232 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:00.124188 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e5b89c2d-21cb-480d-86ca-952dbb9a1232 None None] Bound using segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 05:04:00.124640 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-e5b89c2d-21cb-480d-86ca-952dbb9a1232 None None] Bound port: f0aedb4e-bdd3-4b77-b881-acdf25762d73, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 05:04:00.125006 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-e5b89c2d-21cb-480d-86ca-952dbb9a1232 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:00.129819 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ec0f58eb-a87b-4cd9-8af0-0c960bced7fd tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:00.178645 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-e5b89c2d-21cb-480d-86ca-952dbb9a1232 None None] For port f0aedb4e-bdd3-4b77-b881-acdf25762d73, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102164) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 05:04:00.182167 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-e5b89c2d-21cb-480d-86ca-952dbb9a1232 None None] For port f0aedb4e-bdd3-4b77-b881-acdf25762d73, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=f0aedb4e-bdd3-4b77-b881-acdf25762d73,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102164) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 05:04:00.188542 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec0f58eb-a87b-4cd9-8af0-0c960bced7fd tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'Subnet': ['ID=4ab2834b-d379-46c6-93c2-dabc443d001d,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:04:00.204008 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ec0f58eb-a87b-4cd9-8af0-0c960bced7fd tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Checking segment: {'id': 'd82b4232-13d0-4050-bf58-c5e9ea713dd3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 344, 'network_id': '7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 05:04:00.204359 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ec0f58eb-a87b-4cd9-8af0-0c960bced7fd tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Network hostable DHCP agents. Network: 7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 05:04:00.255670 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-e5b89c2d-21cb-480d-86ca-952dbb9a1232 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:00.283726 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ec0f58eb-a87b-4cd9-8af0-0c960bced7fd tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Network 7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 05:04:00.308834 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e5b89c2d-21cb-480d-86ca-952dbb9a1232 None None] Routers {'4b35f811-d243-43fb-b6b0-2ebfa884259d'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:04:00.309435 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-e5b89c2d-21cb-480d-86ca-952dbb9a1232 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:03:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['4b35f811-d243-43fb-b6b0-2ebfa884259d'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:04:00.343354 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d56a0d2-6c08-40b9-9d66-19201d55cd1b None None] Pushing event updated for resources: {'Port': ['ID=f0aedb4e-bdd3-4b77-b881-acdf25762d73,revision_number=3']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:04:00.352247 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-ec0f58eb-a87b-4cd9-8af0-0c960bced7fd tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:04:00.356357 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ec0f58eb-a87b-4cd9-8af0-0c960bced7fd tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:04:00.357292 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ec0f58eb-a87b-4cd9-8af0-0c960bced7fd tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:00.363641 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-48bd4db6-f4c8-4c96-85ce-efbee0de3142 None None] Network 7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 05:04:00.418530 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-e5b89c2d-21cb-480d-86ca-952dbb9a1232 None None] Set router 4b35f811-d243-43fb-b6b0-2ebfa884259d gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:04:00.446758 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-ec0f58eb-a87b-4cd9-8af0-0c960bced7fd tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 831 time: 0.7158287 Nov 09 05:04:00.450451 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36856) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:04:00.508636 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-60a071e0-0b40-4d2d-af6b-f3d3bf6238a8 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3', 'network_id': '7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'fixed_ips': [{'subnet_id': '4ab2834b-d379-46c6-93c2-dabc443d001d'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 05:04:00.509434 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-60a071e0-0b40-4d2d-af6b-f3d3bf6238a8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:00.599716 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-e5b89c2d-21cb-480d-86ca-952dbb9a1232 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4b35f811-d243-43fb-b6b0-2ebfa884259d', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1648817839', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.213'}], 'enable_snat': True}, 'gw_port_id': 'f0aedb4e-bdd3-4b77-b881-acdf25762d73', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:03:57Z', 'updated_at': '2021-11-09T05:03:58Z', 'revision_number': 3, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': 'f0aedb4e-bdd3-4b77-b881-acdf25762d73', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:1d:52:de', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4b35f811-d243-43fb-b6b0-2ebfa884259d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1729, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:03:58Z', 'updated_at': '2021-11-09T05:04:00Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:04:00.631055 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e5b89c2d-21cb-480d-86ca-952dbb9a1232 None None] The sync data for ids ['4b35f811-d243-43fb-b6b0-2ebfa884259d'] in dv-neutron-816802-2-hyperv is: [{'id': '4b35f811-d243-43fb-b6b0-2ebfa884259d', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1648817839', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.213'}], 'enable_snat': True}, 'gw_port_id': 'f0aedb4e-bdd3-4b77-b881-acdf25762d73', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:03:57Z', 'updated_at': '2021-11-09T05:03:58Z', 'revision_number': 3, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': 'f0aedb4e-bdd3-4b77-b881-acdf25762d73', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:1d:52:de', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4b35f811-d243-43fb-b6b0-2ebfa884259d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1729, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:03:58Z', 'updated_at': '2021-11-09T05:04:00Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 05:04:00.661056 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-60a071e0-0b40-4d2d-af6b-f3d3bf6238a8 None None] Allocated IP 172.20.0.2 (7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3/4ab2834b-d379-46c6-93c2-dabc443d001d/8e5aa90c-5cfb-4e47-a577-e3d2e8c4eccc) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 05:04:00.807752 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-60a071e0-0b40-4d2d-af6b-f3d3bf6238a8 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:00.872674 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-60a071e0-0b40-4d2d-af6b-f3d3bf6238a8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:00.913049 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9f28ea39-9fe5-48d8-880c-122a48b087b1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:00.919302 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-60a071e0-0b40-4d2d-af6b-f3d3bf6238a8 None None] Network 7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:04:00.924347 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-60a071e0-0b40-4d2d-af6b-f3d3bf6238a8 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:04:00.927895 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-60a071e0-0b40-4d2d-af6b-f3d3bf6238a8 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 05:04:00.935249 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60a071e0-0b40-4d2d-af6b-f3d3bf6238a8 None None] Pushing event updated for resources: {'Port': ['ID=8e5aa90c-5cfb-4e47-a577-e3d2e8c4eccc,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:04:00.988172 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-60a071e0-0b40-4d2d-af6b-f3d3bf6238a8 None None] Attempting to bind port 8e5aa90c-5cfb-4e47-a577-e3d2e8c4eccc on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 05:04:00.988530 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-60a071e0-0b40-4d2d-af6b-f3d3bf6238a8 None None] Attempting to bind port 8e5aa90c-5cfb-4e47-a577-e3d2e8c4eccc by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'd82b4232-13d0-4050-bf58-c5e9ea713dd3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 344, 'network_id': '7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 05:04:00.989052 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-60a071e0-0b40-4d2d-af6b-f3d3bf6238a8 None None] Attempting to bind port 8e5aa90c-5cfb-4e47-a577-e3d2e8c4eccc on network 7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 05:04:00.994511 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-60a071e0-0b40-4d2d-af6b-f3d3bf6238a8 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 5, 3, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 05:04:00.995066 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-60a071e0-0b40-4d2d-af6b-f3d3bf6238a8 None None] Checking segment: {'id': 'd82b4232-13d0-4050-bf58-c5e9ea713dd3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 344, 'network_id': '7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 05:04:00.995453 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-60a071e0-0b40-4d2d-af6b-f3d3bf6238a8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:00.995836 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-60a071e0-0b40-4d2d-af6b-f3d3bf6238a8 None None] Bound using segment: {'id': 'd82b4232-13d0-4050-bf58-c5e9ea713dd3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 344, 'network_id': '7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 05:04:00.996303 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-60a071e0-0b40-4d2d-af6b-f3d3bf6238a8 None None] Bound port: 8e5aa90c-5cfb-4e47-a577-e3d2e8c4eccc, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd82b4232-13d0-4050-bf58-c5e9ea713dd3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 344, 'network_id': '7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 05:04:00.996679 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-60a071e0-0b40-4d2d-af6b-f3d3bf6238a8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:01.061554 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-60a071e0-0b40-4d2d-af6b-f3d3bf6238a8 None None] For port 8e5aa90c-5cfb-4e47-a577-e3d2e8c4eccc, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 05:04:01.065087 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-60a071e0-0b40-4d2d-af6b-f3d3bf6238a8 None None] For port 8e5aa90c-5cfb-4e47-a577-e3d2e8c4eccc, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=8e5aa90c-5cfb-4e47-a577-e3d2e8c4eccc,segment=NetworkSegment(d82b4232-13d0-4050-bf58-c5e9ea713dd3),segment_id=d82b4232-13d0-4050-bf58-c5e9ea713dd3)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 05:04:01.152648 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-60a071e0-0b40-4d2d-af6b-f3d3bf6238a8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:01.212574 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-9f28ea39-9fe5-48d8-880c-122a48b087b1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Allocated IP 172.20.0.1 (7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3/4ab2834b-d379-46c6-93c2-dabc443d001d/f19da394-f686-40f7-890e-11ac9d902c14) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 05:04:01.220815 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60a071e0-0b40-4d2d-af6b-f3d3bf6238a8 None None] Pushing event updated for resources: {'Port': ['ID=8e5aa90c-5cfb-4e47-a577-e3d2e8c4eccc,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:04:01.347012 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9f28ea39-9fe5-48d8-880c-122a48b087b1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:01.444009 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9f28ea39-9fe5-48d8-880c-122a48b087b1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:01.490937 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9f28ea39-9fe5-48d8-880c-122a48b087b1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Network 7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:04:01.494896 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-9f28ea39-9fe5-48d8-880c-122a48b087b1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:04:01.499420 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9f28ea39-9fe5-48d8-880c-122a48b087b1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 05:04:01.504268 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f28ea39-9fe5-48d8-880c-122a48b087b1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'Port': ['ID=f19da394-f686-40f7-890e-11ac9d902c14,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:04:01.547515 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9f28ea39-9fe5-48d8-880c-122a48b087b1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:01.726263 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9f28ea39-9fe5-48d8-880c-122a48b087b1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:02.006007 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9f28ea39-9fe5-48d8-880c-122a48b087b1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:02.099641 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9f28ea39-9fe5-48d8-880c-122a48b087b1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:02.144767 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3d6f1cc4-96f0-40e7-a0b2-7df708caa128 None None] Network 7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 05:04:02.175583 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f28ea39-9fe5-48d8-880c-122a48b087b1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'Port': ['ID=f19da394-f686-40f7-890e-11ac9d902c14,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:04:02.180831 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9f28ea39-9fe5-48d8-880c-122a48b087b1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:02.262982 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-eeec75c6-dcb8-4a69-9913-537a53a726d5 None None] Provisioning complete for port 8e5aa90c-5cfb-4e47-a577-e3d2e8c4eccc triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:04:02.263343 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-eeec75c6-dcb8-4a69-9913-537a53a726d5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:02.301975 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 8e5aa90c-5cfb-4e47-a577-e3d2e8c4eccc up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:04:02.306712 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9f28ea39-9fe5-48d8-880c-122a48b087b1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Network 7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:04:02.308464 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-9f28ea39-9fe5-48d8-880c-122a48b087b1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:04:02.424611 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-eeec75c6-dcb8-4a69-9913-537a53a726d5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:02.427645 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 8e5aa90c-5cfb-4e47-a577-e3d2e8c4eccc triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:04:02.428057 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:02.431635 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9f28ea39-9fe5-48d8-880c-122a48b087b1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Router 4b35f811-d243-43fb-b6b0-2ebfa884259d has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 05:04:02.490554 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-eeec75c6-dcb8-4a69-9913-537a53a726d5 None None] For port 8e5aa90c-5cfb-4e47-a577-e3d2e8c4eccc, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=8e5aa90c-5cfb-4e47-a577-e3d2e8c4eccc,segment=NetworkSegment(d82b4232-13d0-4050-bf58-c5e9ea713dd3),segment_id=d82b4232-13d0-4050-bf58-c5e9ea713dd3)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:04:02.543705 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:02.549737 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9f28ea39-9fe5-48d8-880c-122a48b087b1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 05:04:02.566233 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-9f28ea39-9fe5-48d8-880c-122a48b087b1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "PUT /v2.0/routers/4b35f811-d243-43fb-b6b0-2ebfa884259d/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.1145957 Nov 09 05:04:02.567372 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-eeec75c6-dcb8-4a69-9913-537a53a726d5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:02.656488 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eeec75c6-dcb8-4a69-9913-537a53a726d5 None None] Pushing event updated for resources: {'Port': ['ID=8e5aa90c-5cfb-4e47-a577-e3d2e8c4eccc,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:04:02.659142 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.db.api [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=102163) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 05:04:02.659474 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG oslo_db.api [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 05:04:02.693322 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-6b68a449-8f12-40d1-8786-f829ff129674 None None] Provisioning complete for port 8e5aa90c-5cfb-4e47-a577-e3d2e8c4eccc triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:04:02.693690 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6b68a449-8f12-40d1-8786-f829ff129674 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:02.737611 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-43deb4de-aad2-478e-aa57-7ccccd657bf9 req-470f1821-9e01-43fb-b3ce-832ddb71c974 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1673430514&fields=id&tenant_id=8ac3eab68bd34485af7ddc3417853b28 HTTP/1.1" status: 200 len: 267 time: 0.0531638 Nov 09 05:04:02.777436 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b2d11ecf-afb0-4b80-9996-9747c1d2e179 None None] Sync routers for ids ['4b35f811-d243-43fb-b6b0-2ebfa884259d'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 05:04:02.793383 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b2d11ecf-afb0-4b80-9996-9747c1d2e179 None None] Routers {'4b35f811-d243-43fb-b6b0-2ebfa884259d'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:04:02.794004 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-b2d11ecf-afb0-4b80-9996-9747c1d2e179 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:03:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['4b35f811-d243-43fb-b6b0-2ebfa884259d'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:04:02.836380 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-6b68a449-8f12-40d1-8786-f829ff129674 None None] Provisioning complete for port f19da394-f686-40f7-890e-11ac9d902c14 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:04:02.836758 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6b68a449-8f12-40d1-8786-f829ff129674 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:03.071302 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-6b68a449-8f12-40d1-8786-f829ff129674 None None] Port f19da394-f686-40f7-890e-11ac9d902c14 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 05:04:03.098727 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-b2d11ecf-afb0-4b80-9996-9747c1d2e179 None None] Set router 4b35f811-d243-43fb-b6b0-2ebfa884259d gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:04:03.155698 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43deb4de-aad2-478e-aa57-7ccccd657bf9 req-0679288b-d544-43af-9156-e8e3b94944d5 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:04:03.157095 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-43deb4de-aad2-478e-aa57-7ccccd657bf9 req-0679288b-d544-43af-9156-e8e3b94944d5 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/networks?id=7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3 HTTP/1.1" status: 200 len: 795 time: 0.4103239 Nov 09 05:04:03.172573 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-43deb4de-aad2-478e-aa57-7ccccd657bf9 req-56d23346-ac79-498f-8e78-f45f480aab09 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/quotas/8ac3eab68bd34485af7ddc3417853b28 HTTP/1.1" status: 200 len: 375 time: 0.0094962 Nov 09 05:04:03.223271 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-43deb4de-aad2-478e-aa57-7ccccd657bf9 req-ca94be74-ef5c-493c-99d6-c7c1d7c85e56 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?tenant_id=8ac3eab68bd34485af7ddc3417853b28&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0446706 Nov 09 05:04:03.260651 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device f0aedb4e-bdd3-4b77-b881-acdf25762d73 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:04:03.268360 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-148ab1dd-7ca0-43ac-aea1-320e59944a5d None None] Provisioning complete for port f19da394-f686-40f7-890e-11ac9d902c14 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:04:03.268732 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-148ab1dd-7ca0-43ac-aea1-320e59944a5d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:03.303225 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [req-43deb4de-aad2-478e-aa57-7ccccd657bf9 req-74afcee6-95b6-46aa-be7e-fefe3b533913 service neutron] http://10.222.0.24:9696/v2.0/extensions returned with HTTP 200 {{(pid=102161) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 05:04:03.304255 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-43deb4de-aad2-478e-aa57-7ccccd657bf9 req-74afcee6-95b6-46aa-be7e-fefe3b533913 service neutron] 10.222.0.24 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0694075 Nov 09 05:04:03.370094 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-148ab1dd-7ca0-43ac-aea1-320e59944a5d None None] Port f19da394-f686-40f7-890e-11ac9d902c14 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 05:04:03.395587 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port f0aedb4e-bdd3-4b77-b881-acdf25762d73 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:04:03.395961 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:03.396501 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-43deb4de-aad2-478e-aa57-7ccccd657bf9 req-6cb89107-154c-4323-a400-f3ceeae15254 service neutron] 10.222.0.24 "GET /v2.0/networks/7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0855401 Nov 09 05:04:03.436802 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-b2d11ecf-afb0-4b80-9996-9747c1d2e179 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4b35f811-d243-43fb-b6b0-2ebfa884259d', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1648817839', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.213'}], 'enable_snat': True}, 'gw_port_id': 'f0aedb4e-bdd3-4b77-b881-acdf25762d73', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:03:57Z', 'updated_at': '2021-11-09T05:04:01Z', 'revision_number': 4, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': 'f0aedb4e-bdd3-4b77-b881-acdf25762d73', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:1d:52:de', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4b35f811-d243-43fb-b6b0-2ebfa884259d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1729, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:03:58Z', 'updated_at': '2021-11-09T05:04:00Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'f19da394-f686-40f7-890e-11ac9d902c14', 'name': '', 'network_id': '7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'mac_address': 'fa:16:3e:19:ac:02', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4b35f811-d243-43fb-b6b0-2ebfa884259d', 'device_owner': 'network:router_interface', 'standard_attr_id': 1732, 'fixed_ips': [{'subnet_id': '4ab2834b-d379-46c6-93c2-dabc443d001d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:04:01Z', 'updated_at': '2021-11-09T05:04:01Z', 'revision_number': 2, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'subnets': [{'id': '4ab2834b-d379-46c6-93c2-dabc443d001d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:04:03.455040 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 05:04:03.468305 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b2d11ecf-afb0-4b80-9996-9747c1d2e179 None None] Checking router: 4b35f811-d243-43fb-b6b0-2ebfa884259d for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 05:04:03.468664 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b2d11ecf-afb0-4b80-9996-9747c1d2e179 None None] Updating router 4b35f811-d243-43fb-b6b0-2ebfa884259d port f19da394-f686-40f7-890e-11ac9d902c14 binding host dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 05:04:03.486775 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-43deb4de-aad2-478e-aa57-7ccccd657bf9 req-e963c6f5-90fe-498f-a199-7d36fd813537 service neutron] 10.222.0.24 "GET /v2.0/networks/7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0830257 Nov 09 05:04:03.517621 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b2d11ecf-afb0-4b80-9996-9747c1d2e179 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:03.541094 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:03.583462 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port f0aedb4e-bdd3-4b77-b881-acdf25762d73, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=f0aedb4e-bdd3-4b77-b881-acdf25762d73,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:04:03.650641 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:03.720234 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-df1a380c-d214-4f41-aa10-b8e76ee1840f req-02cfc870-c3f7-48a0-99af-f9f804703828 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=69146330-5c29-48a5-8047-3e8d83d64a0e HTTP/1.1" status: 200 len: 210 time: 0.0289564 Nov 09 05:04:03.759631 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=f0aedb4e-bdd3-4b77-b881-acdf25762d73,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:04:03.858497 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b2d11ecf-afb0-4b80-9996-9747c1d2e179 None None] Publish callbacks [] for port, precommit_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:03.945874 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b2d11ecf-afb0-4b80-9996-9747c1d2e179 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:03.995025 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46354f8b-572a-4544-9a8b-ed171560762d None None] Pushing event updated for resources: {'Port': ['ID=f19da394-f686-40f7-890e-11ac9d902c14,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:04:04.048106 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-b2d11ecf-afb0-4b80-9996-9747c1d2e179 None None] Attempting to bind port f19da394-f686-40f7-890e-11ac9d902c14 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 05:04:04.048560 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-b2d11ecf-afb0-4b80-9996-9747c1d2e179 None None] Attempting to bind port f19da394-f686-40f7-890e-11ac9d902c14 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'd82b4232-13d0-4050-bf58-c5e9ea713dd3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 344, 'network_id': '7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 05:04:04.048997 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b2d11ecf-afb0-4b80-9996-9747c1d2e179 None None] Attempting to bind port f19da394-f686-40f7-890e-11ac9d902c14 on network 7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 05:04:04.054134 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b2d11ecf-afb0-4b80-9996-9747c1d2e179 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 5, 3, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 05:04:04.055080 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b2d11ecf-afb0-4b80-9996-9747c1d2e179 None None] Checking segment: {'id': 'd82b4232-13d0-4050-bf58-c5e9ea713dd3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 344, 'network_id': '7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 05:04:04.055482 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b2d11ecf-afb0-4b80-9996-9747c1d2e179 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:04.055868 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b2d11ecf-afb0-4b80-9996-9747c1d2e179 None None] Bound using segment: {'id': 'd82b4232-13d0-4050-bf58-c5e9ea713dd3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 344, 'network_id': '7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 05:04:04.056329 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-b2d11ecf-afb0-4b80-9996-9747c1d2e179 None None] Bound port: f19da394-f686-40f7-890e-11ac9d902c14, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd82b4232-13d0-4050-bf58-c5e9ea713dd3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 344, 'network_id': '7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 05:04:04.056704 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b2d11ecf-afb0-4b80-9996-9747c1d2e179 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:04.125867 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-b2d11ecf-afb0-4b80-9996-9747c1d2e179 None None] For port f19da394-f686-40f7-890e-11ac9d902c14, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 05:04:04.129140 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-b2d11ecf-afb0-4b80-9996-9747c1d2e179 None None] For port f19da394-f686-40f7-890e-11ac9d902c14, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=f19da394-f686-40f7-890e-11ac9d902c14,segment=NetworkSegment(d82b4232-13d0-4050-bf58-c5e9ea713dd3),segment_id=d82b4232-13d0-4050-bf58-c5e9ea713dd3)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 05:04:04.212438 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b2d11ecf-afb0-4b80-9996-9747c1d2e179 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:04.251661 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 8e5aa90c-5cfb-4e47-a577-e3d2e8c4eccc up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:04:04.318928 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b2d11ecf-afb0-4b80-9996-9747c1d2e179 None None] Routers {'4b35f811-d243-43fb-b6b0-2ebfa884259d'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:04:04.319566 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-b2d11ecf-afb0-4b80-9996-9747c1d2e179 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:03:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['4b35f811-d243-43fb-b6b0-2ebfa884259d'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:04:04.363729 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46354f8b-572a-4544-9a8b-ed171560762d None None] Pushing event updated for resources: {'Port': ['ID=f19da394-f686-40f7-890e-11ac9d902c14,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:04:04.428910 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 8e5aa90c-5cfb-4e47-a577-e3d2e8c4eccc triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:04:04.429338 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:04.465020 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-cca7c7d3-2b54-4b35-8162-a7d2f2f76998 None None] Provisioning complete for port f19da394-f686-40f7-890e-11ac9d902c14 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:04:04.465310 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-cca7c7d3-2b54-4b35-8162-a7d2f2f76998 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:04.506452 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-b2d11ecf-afb0-4b80-9996-9747c1d2e179 None None] Set router 4b35f811-d243-43fb-b6b0-2ebfa884259d gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:04:04.741942 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device f0aedb4e-bdd3-4b77-b881-acdf25762d73 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:04:04.776576 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-cca7c7d3-2b54-4b35-8162-a7d2f2f76998 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:04.815477 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-110a309b-6373-4a22-a82b-9fb14156b207 req-3b744abd-bbbf-4285-8d0a-e67696f0132f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=69146330-5c29-48a5-8047-3e8d83d64a0e HTTP/1.1" status: 200 len: 210 time: 0.0276210 Nov 09 05:04:04.856083 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-cca7c7d3-2b54-4b35-8162-a7d2f2f76998 None None] For port f19da394-f686-40f7-890e-11ac9d902c14, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=f19da394-f686-40f7-890e-11ac9d902c14,segment=NetworkSegment(d82b4232-13d0-4050-bf58-c5e9ea713dd3),segment_id=d82b4232-13d0-4050-bf58-c5e9ea713dd3)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:04:04.869827 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port f0aedb4e-bdd3-4b77-b881-acdf25762d73 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:04:04.870200 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:04.915343 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-cca7c7d3-2b54-4b35-8162-a7d2f2f76998 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:04.922703 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-b2d11ecf-afb0-4b80-9996-9747c1d2e179 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4b35f811-d243-43fb-b6b0-2ebfa884259d', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1648817839', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.213'}], 'enable_snat': True}, 'gw_port_id': 'f0aedb4e-bdd3-4b77-b881-acdf25762d73', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:03:57Z', 'updated_at': '2021-11-09T05:04:01Z', 'revision_number': 4, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': 'f0aedb4e-bdd3-4b77-b881-acdf25762d73', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:1d:52:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b35f811-d243-43fb-b6b0-2ebfa884259d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1729, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:03:58Z', 'updated_at': '2021-11-09T05:04:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'f19da394-f686-40f7-890e-11ac9d902c14', 'name': '', 'network_id': '7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'mac_address': 'fa:16:3e:19:ac:02', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4b35f811-d243-43fb-b6b0-2ebfa884259d', 'device_owner': 'network:router_interface', 'standard_attr_id': 1732, 'fixed_ips': [{'subnet_id': '4ab2834b-d379-46c6-93c2-dabc443d001d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:04:01Z', 'updated_at': '2021-11-09T05:04:04Z', 'revision_number': 4, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'subnets': [{'id': '4ab2834b-d379-46c6-93c2-dabc443d001d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:04:04.971941 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b2d11ecf-afb0-4b80-9996-9747c1d2e179 None None] The sync data for ids ['4b35f811-d243-43fb-b6b0-2ebfa884259d'] in dv-neutron-816802-2-hyperv is: [{'id': '4b35f811-d243-43fb-b6b0-2ebfa884259d', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1648817839', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.213'}], 'enable_snat': True}, 'gw_port_id': 'f0aedb4e-bdd3-4b77-b881-acdf25762d73', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:03:57Z', 'updated_at': '2021-11-09T05:04:01Z', 'revision_number': 4, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': 'f0aedb4e-bdd3-4b77-b881-acdf25762d73', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:1d:52:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b35f811-d243-43fb-b6b0-2ebfa884259d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1729, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:03:58Z', 'updated_at': '2021-11-09T05:04:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'f19da394-f686-40f7-890e-11ac9d902c14', 'name': '', 'network_id': '7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'mac_address': 'fa:16:3e:19:ac:02', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4b35f811-d243-43fb-b6b0-2ebfa884259d', 'device_owner': 'network:router_interface', 'standard_attr_id': 1732, 'fixed_ips': [{'subnet_id': '4ab2834b-d379-46c6-93c2-dabc443d001d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:04:01Z', 'updated_at': '2021-11-09T05:04:04Z', 'revision_number': 4, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'subnets': [{'id': '4ab2834b-d379-46c6-93c2-dabc443d001d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 05:04:05.035909 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cca7c7d3-2b54-4b35-8162-a7d2f2f76998 None None] Pushing event updated for resources: {'Port': ['ID=f19da394-f686-40f7-890e-11ac9d902c14,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:04:05.057319 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-475db92e-d974-478e-b38f-2cc2731cdffd None None] Provisioning complete for port f19da394-f686-40f7-890e-11ac9d902c14 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:04:05.057682 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-475db92e-d974-478e-b38f-2cc2731cdffd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:05.592209 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43deb4de-aad2-478e-aa57-7ccccd657bf9 req-00bf997f-ae93-46bf-b845-959b29c71253 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:04:05.594460 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-43deb4de-aad2-478e-aa57-7ccccd657bf9 req-00bf997f-ae93-46bf-b845-959b29c71253 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.26 "GET /v2.0/networks?id=7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3 HTTP/1.1" status: 200 len: 795 time: 0.1080041 Nov 09 05:04:05.669919 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-43deb4de-aad2-478e-aa57-7ccccd657bf9 req-cacfd654-b35a-4381-92ec-7a29137eb407 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.26 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=8ac3eab68bd34485af7ddc3417853b28 HTTP/1.1" status: 200 len: 380 time: 0.0656199 Nov 09 05:04:05.680759 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-43deb4de-aad2-478e-aa57-7ccccd657bf9 req-36906fce-4fb9-4b7d-98cf-654001e11197 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'port': {'device_id': '69146330-5c29-48a5-8047-3e8d83d64a0e', 'network_id': '7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3', 'admin_state_up': True, 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'security_groups': ['1cf96a5c-2f90-45b2-850e-3b6b8d385bbd']}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:04:05.866813 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-43deb4de-aad2-478e-aa57-7ccccd657bf9 req-36906fce-4fb9-4b7d-98cf-654001e11197 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Made reservation on behalf of 8ac3eab68bd34485af7ddc3417853b28 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 05:04:05.875278 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-43deb4de-aad2-478e-aa57-7ccccd657bf9 req-36906fce-4fb9-4b7d-98cf-654001e11197 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:05.920333 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-243f728b-22e5-4f01-be0b-849ed21c0313 req-a950215f-7964-4567-9d91-515ac85c8a1d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=69146330-5c29-48a5-8047-3e8d83d64a0e HTTP/1.1" status: 200 len: 210 time: 0.0316765 Nov 09 05:04:06.034828 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [req-43deb4de-aad2-478e-aa57-7ccccd657bf9 req-36906fce-4fb9-4b7d-98cf-654001e11197 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Allocated IP 172.20.0.8 (7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3/4ab2834b-d379-46c6-93c2-dabc443d001d/f4f26d5e-838f-4398-acda-1c9fb08b903b) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 05:04:06.174026 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-43deb4de-aad2-478e-aa57-7ccccd657bf9 req-36906fce-4fb9-4b7d-98cf-654001e11197 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:06.244040 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device f19da394-f686-40f7-890e-11ac9d902c14 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:04:06.266537 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-43deb4de-aad2-478e-aa57-7ccccd657bf9 req-36906fce-4fb9-4b7d-98cf-654001e11197 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:06.292027 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port f19da394-f686-40f7-890e-11ac9d902c14 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:04:06.292395 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:06.308812 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-43deb4de-aad2-478e-aa57-7ccccd657bf9 req-36906fce-4fb9-4b7d-98cf-654001e11197 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Network 7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:04:06.312508 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [req-43deb4de-aad2-478e-aa57-7ccccd657bf9 req-36906fce-4fb9-4b7d-98cf-654001e11197 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:04:06.316454 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-43deb4de-aad2-478e-aa57-7ccccd657bf9 req-36906fce-4fb9-4b7d-98cf-654001e11197 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 05:04:06.353091 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36906fce-4fb9-4b7d-98cf-654001e11197 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'Port': ['ID=f4f26d5e-838f-4398-acda-1c9fb08b903b,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:04:06.377845 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43deb4de-aad2-478e-aa57-7ccccd657bf9 req-36906fce-4fb9-4b7d-98cf-654001e11197 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:04:06.378509 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-43deb4de-aad2-478e-aa57-7ccccd657bf9 req-36906fce-4fb9-4b7d-98cf-654001e11197 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:06.452507 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-43deb4de-aad2-478e-aa57-7ccccd657bf9 req-36906fce-4fb9-4b7d-98cf-654001e11197 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.26 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7760198 Nov 09 05:04:06.465769 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-43deb4de-aad2-478e-aa57-7ccccd657bf9 req-371b0bae-42cf-4792-a3a2-f0c7067bf5ad service neutron] Request body: {'port': {'device_id': '69146330-5c29-48a5-8047-3e8d83d64a0e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:04:06.521055 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-43deb4de-aad2-478e-aa57-7ccccd657bf9 req-371b0bae-42cf-4792-a3a2-f0c7067bf5ad service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:06.578829 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-77904cf2-d6a4-4832-b478-e3eeedd81dd5 None None] Provisioning complete for port f4f26d5e-838f-4398-acda-1c9fb08b903b triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:04:06.579124 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-77904cf2-d6a4-4832-b478-e3eeedd81dd5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:06.612124 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-77904cf2-d6a4-4832-b478-e3eeedd81dd5 None None] Port f4f26d5e-838f-4398-acda-1c9fb08b903b cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 05:04:06.771777 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [req-43deb4de-aad2-478e-aa57-7ccccd657bf9 req-371b0bae-42cf-4792-a3a2-f0c7067bf5ad service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f4f26d5e-838f-4398-acda-1c9fb08b903b {{(pid=102162) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 05:04:06.779501 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-43deb4de-aad2-478e-aa57-7ccccd657bf9 req-371b0bae-42cf-4792-a3a2-f0c7067bf5ad service neutron] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:06.790810 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.provisioning_blocks [req-43deb4de-aad2-478e-aa57-7ccccd657bf9 req-371b0bae-42cf-4792-a3a2-f0c7067bf5ad service neutron] Transition to ACTIVE for port object f4f26d5e-838f-4398-acda-1c9fb08b903b will not be triggered until provisioned by entity L2. {{(pid=102162) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 09 05:04:06.848454 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-43deb4de-aad2-478e-aa57-7ccccd657bf9 req-371b0bae-42cf-4792-a3a2-f0c7067bf5ad service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:06.899764 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-371b0bae-42cf-4792-a3a2-f0c7067bf5ad service neutron] Pushing event updated for resources: {'Port': ['ID=f4f26d5e-838f-4398-acda-1c9fb08b903b,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:04:06.971681 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-43deb4de-aad2-478e-aa57-7ccccd657bf9 req-371b0bae-42cf-4792-a3a2-f0c7067bf5ad service neutron] Attempting to bind port f4f26d5e-838f-4398-acda-1c9fb08b903b on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 05:04:06.972092 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-43deb4de-aad2-478e-aa57-7ccccd657bf9 req-371b0bae-42cf-4792-a3a2-f0c7067bf5ad service neutron] Attempting to bind port f4f26d5e-838f-4398-acda-1c9fb08b903b by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'd82b4232-13d0-4050-bf58-c5e9ea713dd3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 344, 'network_id': '7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 05:04:06.972481 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-43deb4de-aad2-478e-aa57-7ccccd657bf9 req-371b0bae-42cf-4792-a3a2-f0c7067bf5ad service neutron] Attempting to bind port f4f26d5e-838f-4398-acda-1c9fb08b903b on network 7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 05:04:06.977194 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-43deb4de-aad2-478e-aa57-7ccccd657bf9 req-371b0bae-42cf-4792-a3a2-f0c7067bf5ad service neutron] Port f4f26d5e-838f-4398-acda-1c9fb08b903b on network 7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 05:04:06.977589 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-43deb4de-aad2-478e-aa57-7ccccd657bf9 req-371b0bae-42cf-4792-a3a2-f0c7067bf5ad service neutron] Attempting to bind port f4f26d5e-838f-4398-acda-1c9fb08b903b on network 7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 05:04:06.982735 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-43deb4de-aad2-478e-aa57-7ccccd657bf9 req-371b0bae-42cf-4792-a3a2-f0c7067bf5ad service neutron] Checking agent: {'id': '7d36b884-4ad2-4878-9464-bf647030b544', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'started_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 5, 3, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 05:04:06.983142 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-43deb4de-aad2-478e-aa57-7ccccd657bf9 req-371b0bae-42cf-4792-a3a2-f0c7067bf5ad service neutron] Checking segment: {'id': 'd82b4232-13d0-4050-bf58-c5e9ea713dd3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 344, 'network_id': '7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 05:04:06.983584 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-43deb4de-aad2-478e-aa57-7ccccd657bf9 req-371b0bae-42cf-4792-a3a2-f0c7067bf5ad service neutron] Bound using segment: {'id': 'd82b4232-13d0-4050-bf58-c5e9ea713dd3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 344, 'network_id': '7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3'} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 05:04:06.984074 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-43deb4de-aad2-478e-aa57-7ccccd657bf9 req-371b0bae-42cf-4792-a3a2-f0c7067bf5ad service neutron] Bound port: f4f26d5e-838f-4398-acda-1c9fb08b903b, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd82b4232-13d0-4050-bf58-c5e9ea713dd3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 344, 'network_id': '7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3'}}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 05:04:06.984430 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-43deb4de-aad2-478e-aa57-7ccccd657bf9 req-371b0bae-42cf-4792-a3a2-f0c7067bf5ad service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:07.047114 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0d9e74f-fe81-4739-af06-ed1d863b449f req-2a4841a3-c436-4f53-a95c-1d4d9f7cdbe1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:04:07.048661 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-e0d9e74f-fe81-4739-af06-ed1d863b449f req-2a4841a3-c436-4f53-a95c-1d4d9f7cdbe1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=69146330-5c29-48a5-8047-3e8d83d64a0e HTTP/1.1" status: 200 len: 943 time: 0.0544288 Nov 09 05:04:07.052320 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-43deb4de-aad2-478e-aa57-7ccccd657bf9 req-371b0bae-42cf-4792-a3a2-f0c7067bf5ad service neutron] For port f4f26d5e-838f-4398-acda-1c9fb08b903b, host hv-neutron-8168, cleared binding levels {{(pid=102162) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 05:04:07.056010 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-43deb4de-aad2-478e-aa57-7ccccd657bf9 req-371b0bae-42cf-4792-a3a2-f0c7067bf5ad service neutron] For port f4f26d5e-838f-4398-acda-1c9fb08b903b, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=f4f26d5e-838f-4398-acda-1c9fb08b903b,segment=NetworkSegment(d82b4232-13d0-4050-bf58-c5e9ea713dd3),segment_id=d82b4232-13d0-4050-bf58-c5e9ea713dd3)] {{(pid=102162) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 05:04:07.098683 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-e0d9e74f-fe81-4739-af06-ed1d863b449f req-5344e46b-c31e-4477-ba49-84fdacec90a9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=1cf96a5c-2f90-45b2-850e-3b6b8d385bbd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430355 Nov 09 05:04:07.155404 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-43deb4de-aad2-478e-aa57-7ccccd657bf9 req-371b0bae-42cf-4792-a3a2-f0c7067bf5ad service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:07.184486 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43deb4de-aad2-478e-aa57-7ccccd657bf9 req-371b0bae-42cf-4792-a3a2-f0c7067bf5ad service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:04:07.185090 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-43deb4de-aad2-478e-aa57-7ccccd657bf9 req-371b0bae-42cf-4792-a3a2-f0c7067bf5ad service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:07.186472 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-43deb4de-aad2-478e-aa57-7ccccd657bf9 req-371b0bae-42cf-4792-a3a2-f0c7067bf5ad service neutron] 10.222.0.26 "PUT /v2.0/ports/f4f26d5e-838f-4398-acda-1c9fb08b903b HTTP/1.1" status: 200 len: 1093 time: 0.7255335 Nov 09 05:04:07.186916 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '69146330-5c29-48a5-8047-3e8d83d64a0e', 'tag': 'f4f26d5e-838f-4398-acda-1c9fb08b903b'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:04:07.189401 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bb067403-2e97-4283-beeb-79d7c66dcc00" -d '{"events": [{"name": "network-changed", "server_uuid": "69146330-5c29-48a5-8047-3e8d83d64a0e", "tag": "f4f26d5e-838f-4398-acda-1c9fb08b903b"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:04:07.216256 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-371b0bae-42cf-4792-a3a2-f0c7067bf5ad service neutron] Pushing event updated for resources: {'Port': ['ID=f4f26d5e-838f-4398-acda-1c9fb08b903b,revision_number=3']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:04:07.237940 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 05:04:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f8d421e5-197b-48cb-8cfb-2023f7340a7e x-openstack-request-id: req-f8d421e5-197b-48cb-8cfb-2023f7340a7e {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:04:07.238241 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "69146330-5c29-48a5-8047-3e8d83d64a0e", "tag": "f4f26d5e-838f-4398-acda-1c9fb08b903b", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:04:07.238563 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-f8d421e5-197b-48cb-8cfb-2023f7340a7e {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:04:07.238978 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '69146330-5c29-48a5-8047-3e8d83d64a0e', 'tag': 'f4f26d5e-838f-4398-acda-1c9fb08b903b', 'status': 'completed', 'code': 200} Nov 09 05:04:07.309120 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb067403-2e97-4283-beeb-79d7c66dcc00 req-2832b559-c0cc-4106-baf1-4eac7cef2ecb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:04:07.310680 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-bb067403-2e97-4283-beeb-79d7c66dcc00 req-2832b559-c0cc-4106-baf1-4eac7cef2ecb service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=8ac3eab68bd34485af7ddc3417853b28&device_id=69146330-5c29-48a5-8047-3e8d83d64a0e HTTP/1.1" status: 200 len: 1096 time: 0.0475452 Nov 09 05:04:07.414685 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb067403-2e97-4283-beeb-79d7c66dcc00 req-2edb97bb-cdcd-4595-9248-b5ab1b3435f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:04:07.416139 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-bb067403-2e97-4283-beeb-79d7c66dcc00 req-2edb97bb-cdcd-4595-9248-b5ab1b3435f2 service neutron] 10.222.0.26 "GET /v2.0/networks?tenant_id=8ac3eab68bd34485af7ddc3417853b28&shared=False HTTP/1.1" status: 200 len: 896 time: 0.0971420 Nov 09 05:04:07.797140 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb067403-2e97-4283-beeb-79d7c66dcc00 req-6cc78f58-3017-4efb-a2be-58da4d37fd56 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:04:07.798597 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-bb067403-2e97-4283-beeb-79d7c66dcc00 req-6cc78f58-3017-4efb-a2be-58da4d37fd56 service neutron] 10.222.0.26 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.3748901 Nov 09 05:04:07.871801 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43deb4de-aad2-478e-aa57-7ccccd657bf9 req-bfec8612-5515-47c9-b24f-d33b2c56a5d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:04:07.873231 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-43deb4de-aad2-478e-aa57-7ccccd657bf9 req-bfec8612-5515-47c9-b24f-d33b2c56a5d4 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=8ac3eab68bd34485af7ddc3417853b28&device_id=69146330-5c29-48a5-8047-3e8d83d64a0e HTTP/1.1" status: 200 len: 1096 time: 0.0394313 Nov 09 05:04:07.914501 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-43deb4de-aad2-478e-aa57-7ccccd657bf9 req-04156268-d5bc-437b-9656-0842be1e4614 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=f4f26d5e-838f-4398-acda-1c9fb08b903b HTTP/1.1" status: 200 len: 217 time: 0.0330200 Nov 09 05:04:07.969390 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43deb4de-aad2-478e-aa57-7ccccd657bf9 req-3c066890-fd25-4640-8ec9-bb8bd039a841 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:04:07.970750 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-43deb4de-aad2-478e-aa57-7ccccd657bf9 req-3c066890-fd25-4640-8ec9-bb8bd039a841 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=4ab2834b-d379-46c6-93c2-dabc443d001d HTTP/1.1" status: 200 len: 834 time: 0.0498252 Nov 09 05:04:08.015432 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43deb4de-aad2-478e-aa57-7ccccd657bf9 req-8d073d1b-ce36-4fe2-8c92-a855864aaae8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:04:08.016876 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-43deb4de-aad2-478e-aa57-7ccccd657bf9 req-8d073d1b-ce36-4fe2-8c92-a855864aaae8 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0385373 Nov 09 05:04:08.103207 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-43deb4de-aad2-478e-aa57-7ccccd657bf9 req-ec44682c-f30a-4e75-be15-50d42f7e7efe service neutron] 10.222.0.26 "GET /v2.0/networks/7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0786819 Nov 09 05:04:08.196036 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-43deb4de-aad2-478e-aa57-7ccccd657bf9 req-c4700665-0a70-4f48-9642-fe07ddfc84d0 service neutron] 10.222.0.26 "GET /v2.0/networks/7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0860889 Nov 09 05:04:08.212442 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8052ae2c-db08-459c-82ab-e56951e78116 req-0a787126-2ae7-4ac4-867b-0f75c640497a tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:04:08.215204 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-8052ae2c-db08-459c-82ab-e56951e78116 req-0a787126-2ae7-4ac4-867b-0f75c640497a tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=69146330-5c29-48a5-8047-3e8d83d64a0e HTTP/1.1" status: 200 len: 943 time: 0.0500462 Nov 09 05:04:08.262283 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-8052ae2c-db08-459c-82ab-e56951e78116 req-618314e8-1526-4c21-8c1d-1250cf83e8db tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=1cf96a5c-2f90-45b2-850e-3b6b8d385bbd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423667 Nov 09 05:04:09.381163 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-688d6551-2d47-4b6b-aed9-6872e9d31309 req-a66d1d35-80af-4c9d-ba74-f895cebfce21 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:04:09.382634 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-688d6551-2d47-4b6b-aed9-6872e9d31309 req-a66d1d35-80af-4c9d-ba74-f895cebfce21 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=69146330-5c29-48a5-8047-3e8d83d64a0e HTTP/1.1" status: 200 len: 943 time: 0.0482183 Nov 09 05:04:09.430640 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-688d6551-2d47-4b6b-aed9-6872e9d31309 req-c2cdb6bd-a540-4913-9f17-fb4991987204 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=1cf96a5c-2f90-45b2-850e-3b6b8d385bbd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420320 Nov 09 05:04:10.543860 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1844fdca-fad3-419f-89e5-c9193210a23f req-c10c57fe-82b2-4e85-a03d-08e0aaa17df6 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:04:10.545315 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-1844fdca-fad3-419f-89e5-c9193210a23f req-c10c57fe-82b2-4e85-a03d-08e0aaa17df6 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=69146330-5c29-48a5-8047-3e8d83d64a0e HTTP/1.1" status: 200 len: 943 time: 0.0477107 Nov 09 05:04:10.598150 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-1844fdca-fad3-419f-89e5-c9193210a23f req-66728a30-7813-40b6-b974-545552901216 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=1cf96a5c-2f90-45b2-850e-3b6b8d385bbd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0469584 Nov 09 05:04:10.669738 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device f4f26d5e-838f-4398-acda-1c9fb08b903b details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=102163) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 09 05:04:10.766938 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port f4f26d5e-838f-4398-acda-1c9fb08b903b, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=f4f26d5e-838f-4398-acda-1c9fb08b903b,segment=NetworkSegment(d82b4232-13d0-4050-bf58-c5e9ea713dd3),segment_id=d82b4232-13d0-4050-bf58-c5e9ea713dd3)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:04:10.777601 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Returning: {'device': 'f4f26d5e-838f-4398-acda-1c9fb08b903b', 'network_id': '7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3', 'port_id': 'f4f26d5e-838f-4398-acda-1c9fb08b903b', 'mac_address': 'fa:16:3e:a2:15:a6', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 344, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4ab2834b-d379-46c6-93c2-dabc443d001d', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102163) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 09 05:04:10.812619 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:10.825420 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f4f26d5e-838f-4398-acda-1c9fb08b903b {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 05:04:10.843235 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port f4f26d5e-838f-4398-acda-1c9fb08b903b, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=f4f26d5e-838f-4398-acda-1c9fb08b903b,segment=NetworkSegment(d82b4232-13d0-4050-bf58-c5e9ea713dd3),segment_id=d82b4232-13d0-4050-bf58-c5e9ea713dd3)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:04:10.917308 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:10.968555 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=f4f26d5e-838f-4398-acda-1c9fb08b903b,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:04:11.126805 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['f4f26d5e-838f-4398-acda-1c9fb08b903b'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 05:04:11.498210 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c4e27c9e-6eef-46b1-ab66-c26ebb984114 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:11.716226 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78ba3276-6bfe-4640-a676-c84c16148b01 req-5717a9cc-2638-4bde-be98-1c3ab6d48f61 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:04:11.717688 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-78ba3276-6bfe-4640-a676-c84c16148b01 req-5717a9cc-2638-4bde-be98-1c3ab6d48f61 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=69146330-5c29-48a5-8047-3e8d83d64a0e HTTP/1.1" status: 200 len: 944 time: 0.0517550 Nov 09 05:04:11.765696 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-78ba3276-6bfe-4640-a676-c84c16148b01 req-6e28db10-7083-4a14-bed6-f8e6845bc732 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=1cf96a5c-2f90-45b2-850e-3b6b8d385bbd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420408 Nov 09 05:04:12.441745 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:12.682576 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device f4f26d5e-838f-4398-acda-1c9fb08b903b up at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:04:12.813222 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning for port f4f26d5e-838f-4398-acda-1c9fb08b903b completed by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 09 05:04:12.817367 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning complete for port f4f26d5e-838f-4398-acda-1c9fb08b903b triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:04:12.817735 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:12.877194 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1b6a1e3-ccd0-4559-972d-1fc9be4796f3 req-f0380413-362d-4a4f-9e63-fb96e24b1dca tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:04:12.878742 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b1b6a1e3-ccd0-4559-972d-1fc9be4796f3 req-f0380413-362d-4a4f-9e63-fb96e24b1dca tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=69146330-5c29-48a5-8047-3e8d83d64a0e HTTP/1.1" status: 200 len: 944 time: 0.0484765 Nov 09 05:04:12.897576 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:12.919245 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '69146330-5c29-48a5-8047-3e8d83d64a0e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f4f26d5e-838f-4398-acda-1c9fb08b903b'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:04:12.921603 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f80bfb12-53f3-4dfb-a715-52570657b719" -d '{"events": [{"server_uuid": "69146330-5c29-48a5-8047-3e8d83d64a0e", "name": "network-vif-plugged", "status": "completed", "tag": "f4f26d5e-838f-4398-acda-1c9fb08b903b"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:04:12.932742 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b1b6a1e3-ccd0-4559-972d-1fc9be4796f3 req-c20a6029-bf17-442c-aa4c-eaceefdaead4 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=1cf96a5c-2f90-45b2-850e-3b6b8d385bbd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0472543 Nov 09 05:04:12.934584 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port f4f26d5e-838f-4398-acda-1c9fb08b903b, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=f4f26d5e-838f-4398-acda-1c9fb08b903b,segment=NetworkSegment(d82b4232-13d0-4050-bf58-c5e9ea713dd3),segment_id=d82b4232-13d0-4050-bf58-c5e9ea713dd3)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:04:12.961702 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 05:04:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8b1a3936-65f7-4424-89b7-6f97acb267b0 x-openstack-request-id: req-8b1a3936-65f7-4424-89b7-6f97acb267b0 {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:04:12.961995 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "69146330-5c29-48a5-8047-3e8d83d64a0e", "name": "network-vif-plugged", "status": "completed", "tag": "f4f26d5e-838f-4398-acda-1c9fb08b903b", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:04:12.962252 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-8b1a3936-65f7-4424-89b7-6f97acb267b0 {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:04:12.962708 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '69146330-5c29-48a5-8047-3e8d83d64a0e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f4f26d5e-838f-4398-acda-1c9fb08b903b', 'code': 200} Nov 09 05:04:13.020309 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:13.067528 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=f4f26d5e-838f-4398-acda-1c9fb08b903b,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:04:13.262745 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ac6f929-6fae-4c15-a172-f0c15d3ddefc req-e8691bfd-6bb7-42b0-a02b-d8d197ff5c5c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:04:13.264565 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5ac6f929-6fae-4c15-a172-f0c15d3ddefc req-e8691bfd-6bb7-42b0-a02b-d8d197ff5c5c service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=69146330-5c29-48a5-8047-3e8d83d64a0e HTTP/1.1" status: 200 len: 1098 time: 0.0404868 Nov 09 05:04:13.310325 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5ac6f929-6fae-4c15-a172-f0c15d3ddefc req-ccbdbb85-0f4e-4b4e-9276-91623598e657 service neutron] 10.222.0.26 "GET /v2.0/security-groups?id=1cf96a5c-2f90-45b2-850e-3b6b8d385bbd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0389166 Nov 09 05:04:13.734066 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b9b6fab7-07f7-4f06-ad80-08c99ce5b4c4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:14.048621 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c922bb9f-c569-4e3b-9f14-33dae04a9a5d req-5eda69dd-d322-48d3-adfb-e37444bffdc7 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:04:14.050207 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c922bb9f-c569-4e3b-9f14-33dae04a9a5d req-5eda69dd-d322-48d3-adfb-e37444bffdc7 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=69146330-5c29-48a5-8047-3e8d83d64a0e HTTP/1.1" status: 200 len: 945 time: 0.0489910 Nov 09 05:04:14.099304 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c922bb9f-c569-4e3b-9f14-33dae04a9a5d req-f3d4f026-2fc4-4461-a8c0-eb7969dbd7be tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=1cf96a5c-2f90-45b2-850e-3b6b8d385bbd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430772 Nov 09 05:04:15.217568 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24dfaaed-e3a7-446c-b11b-0aadea95a32c req-5bbe54b2-d0d4-41d6-86f6-b68ab28d86ad tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:04:15.219128 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-24dfaaed-e3a7-446c-b11b-0aadea95a32c req-5bbe54b2-d0d4-41d6-86f6-b68ab28d86ad tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=69146330-5c29-48a5-8047-3e8d83d64a0e HTTP/1.1" status: 200 len: 945 time: 0.0525308 Nov 09 05:04:15.236998 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:15.268399 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-24dfaaed-e3a7-446c-b11b-0aadea95a32c req-9c835a64-a53e-48b7-84ca-15fcea79d3da tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=1cf96a5c-2f90-45b2-850e-3b6b8d385bbd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431414 Nov 09 05:04:15.384876 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-034f2663-031b-4e62-96d8-7f1b90defd86 req-2293e8af-ecfd-45fb-958f-57563b4e5acb tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:04:15.386396 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-034f2663-031b-4e62-96d8-7f1b90defd86 req-2293e8af-ecfd-45fb-958f-57563b4e5acb tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=69146330-5c29-48a5-8047-3e8d83d64a0e HTTP/1.1" status: 200 len: 945 time: 0.0524530 Nov 09 05:04:15.434197 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-034f2663-031b-4e62-96d8-7f1b90defd86 req-bbc470d1-5047-4d7e-8f87-023f3709da94 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=1cf96a5c-2f90-45b2-850e-3b6b8d385bbd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418804 Nov 09 05:04:15.455071 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36916) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:04:15.493788 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-13be316c-939d-4217-b102-55f8c9a0907a tempest-TestNetworkAdvancedServerOps-1212315804 tempest-TestNetworkAdvancedServerOps-1212315804-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:04:15.495328 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-13be316c-939d-4217-b102-55f8c9a0907a tempest-TestNetworkAdvancedServerOps-1212315804 tempest-TestNetworkAdvancedServerOps-1212315804-project-admin] 10.222.0.24 "GET /v2.0/ports?device_id=69146330-5c29-48a5-8047-3e8d83d64a0e HTTP/1.1" status: 200 len: 1093 time: 0.0392907 Nov 09 05:04:15.497982 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36918) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:04:15.502148 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-22c5a868-1095-49ed-8fb4-0f126053e664 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'floatingip': {'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'port_id': 'f4f26d5e-838f-4398-acda-1c9fb08b903b', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'fixed_ip_address': '172.20.0.8'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:04:15.591512 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-22c5a868-1095-49ed-8fb4-0f126053e664 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for floatingip, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:15.689013 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-22c5a868-1095-49ed-8fb4-0f126053e664 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:15.786347 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-22c5a868-1095-49ed-8fb4-0f126053e664 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Allocated IP 172.26.0.95 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/f098332a-a056-4fbc-94d6-b15f9892256e) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 05:04:15.888846 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-22c5a868-1095-49ed-8fb4-0f126053e664 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:15.985076 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-22c5a868-1095-49ed-8fb4-0f126053e664 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:16.023612 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-22c5a868-1095-49ed-8fb4-0f126053e664 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:04:16.028339 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-22c5a868-1095-49ed-8fb4-0f126053e664 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:04:16.031875 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-22c5a868-1095-49ed-8fb4-0f126053e664 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 05:04:16.037191 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22c5a868-1095-49ed-8fb4-0f126053e664 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'Port': ['ID=f098332a-a056-4fbc-94d6-b15f9892256e,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:04:16.406558 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-22c5a868-1095-49ed-8fb4-0f126053e664 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:16.530850 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-22c5a868-1095-49ed-8fb4-0f126053e664 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:16.596866 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:16.678011 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-22c5a868-1095-49ed-8fb4-0f126053e664 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:16.716821 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-22c5a868-1095-49ed-8fb4-0f126053e664 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:16.784308 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22c5a868-1095-49ed-8fb4-0f126053e664 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'Port': ['ID=f098332a-a056-4fbc-94d6-b15f9892256e,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:04:16.795497 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-22c5a868-1095-49ed-8fb4-0f126053e664 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:16.893334 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.l3_db [None req-22c5a868-1095-49ed-8fb4-0f126053e664 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Floating IP e5338ba7-e021-479a-a2a2-c4305b90fa8a associated. External IP: 172.26.0.95, port: f4f26d5e-838f-4398-acda-1c9fb08b903b. Nov 09 05:04:16.962590 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:17.096303 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-22c5a868-1095-49ed-8fb4-0f126053e664 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Router 4b35f811-d243-43fb-b6b0-2ebfa884259d has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 05:04:17.198907 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-22c5a868-1095-49ed-8fb4-0f126053e664 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 05:04:17.208257 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4d21ff17-4653-43c0-ab93-1d2a90c108ab None None] Sync routers for ids ['4b35f811-d243-43fb-b6b0-2ebfa884259d'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 05:04:17.217879 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4d21ff17-4653-43c0-ab93-1d2a90c108ab None None] Routers {'4b35f811-d243-43fb-b6b0-2ebfa884259d'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:04:17.218485 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-4d21ff17-4653-43c0-ab93-1d2a90c108ab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:04:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['4b35f811-d243-43fb-b6b0-2ebfa884259d'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:04:17.283502 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-22c5a868-1095-49ed-8fb4-0f126053e664 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:17.314074 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-22c5a868-1095-49ed-8fb4-0f126053e664 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 1.8147867 Nov 09 05:04:17.314858 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '69146330-5c29-48a5-8047-3e8d83d64a0e', 'tag': 'f4f26d5e-838f-4398-acda-1c9fb08b903b'}] {{(pid=102161) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:04:17.317037 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}99dfdda0def497b4372884ef2eb87f06b1e425c8eba5ceda5f64bbab037a07d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ef4ed4c6-4231-4e6e-afa0-00300d75e82e" -d '{"events": [{"name": "network-changed", "server_uuid": "69146330-5c29-48a5-8047-3e8d83d64a0e", "tag": "f4f26d5e-838f-4398-acda-1c9fb08b903b"}]}' {{(pid=102161) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:04:17.321828 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-4d21ff17-4653-43c0-ab93-1d2a90c108ab None None] Set router 4b35f811-d243-43fb-b6b0-2ebfa884259d gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:04:17.353471 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 05:04:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-af967b0a-2323-4a13-9d3f-53204a42b389 x-openstack-request-id: req-af967b0a-2323-4a13-9d3f-53204a42b389 {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:04:17.354541 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "69146330-5c29-48a5-8047-3e8d83d64a0e", "tag": "f4f26d5e-838f-4398-acda-1c9fb08b903b", "status": "completed", "code": 200}]} {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:04:17.354541 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-af967b0a-2323-4a13-9d3f-53204a42b389 {{(pid=102161) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:04:17.354790 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '69146330-5c29-48a5-8047-3e8d83d64a0e', 'tag': 'f4f26d5e-838f-4398-acda-1c9fb08b903b', 'status': 'completed', 'code': 200} Nov 09 05:04:17.444350 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21370630-35eb-402a-9e0a-3646d168cd0c req-1f01a115-0a10-4e89-95a6-5bf37c93fb99 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:04:17.445947 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-21370630-35eb-402a-9e0a-3646d168cd0c req-1f01a115-0a10-4e89-95a6-5bf37c93fb99 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=69146330-5c29-48a5-8047-3e8d83d64a0e HTTP/1.1" status: 200 len: 945 time: 0.0796106 Nov 09 05:04:17.462265 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef4ed4c6-4231-4e6e-afa0-00300d75e82e req-723bd3b1-7db0-46d5-b2d7-fca3348bc216 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:04:17.465173 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ef4ed4c6-4231-4e6e-afa0-00300d75e82e req-723bd3b1-7db0-46d5-b2d7-fca3348bc216 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=8ac3eab68bd34485af7ddc3417853b28&device_id=69146330-5c29-48a5-8047-3e8d83d64a0e HTTP/1.1" status: 200 len: 1098 time: 0.0695100 Nov 09 05:04:17.578066 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-4d21ff17-4653-43c0-ab93-1d2a90c108ab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4b35f811-d243-43fb-b6b0-2ebfa884259d', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1648817839', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.213'}], 'enable_snat': True}, 'gw_port_id': 'f0aedb4e-bdd3-4b77-b881-acdf25762d73', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:03:57Z', 'updated_at': '2021-11-09T05:04:01Z', 'revision_number': 4, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': 'f0aedb4e-bdd3-4b77-b881-acdf25762d73', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:1d:52:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b35f811-d243-43fb-b6b0-2ebfa884259d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1729, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:03:58Z', 'updated_at': '2021-11-09T05:04:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': 'e5338ba7-e021-479a-a2a2-c4305b90fa8a', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'floating_ip_address': '172.26.0.95', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '4b35f811-d243-43fb-b6b0-2ebfa884259d', 'port_id': 'f4f26d5e-838f-4398-acda-1c9fb08b903b', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 1735, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3', 'mac_address': 'fa:16:3e:a2:15:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '69146330-5c29-48a5-8047-3e8d83d64a0e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T05:04:16Z', 'updated_at': '2021-11-09T05:04:16Z', 'revision_number': 0, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f19da394-f686-40f7-890e-11ac9d902c14', 'name': '', 'network_id': '7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'mac_address': 'fa:16:3e:19:ac:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b35f811-d243-43fb-b6b0-2ebfa884259d', 'device_owner': 'network:router_interface', 'standard_attr_id': 1732, 'fixed_ips': [{'subnet_id': '4ab2834b-d379-46c6-93c2-dabc443d001d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:04:01Z', 'updated_at': '2021-11-09T05:04:04Z', 'revision_number': 5, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'subnets': [{'id': '4ab2834b-d379-46c6-93c2-dabc443d001d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:04:17.585885 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-21370630-35eb-402a-9e0a-3646d168cd0c req-9e0a676b-8e6e-47b1-b0f5-e466a1f7324e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=1cf96a5c-2f90-45b2-850e-3b6b8d385bbd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1320720 Nov 09 05:04:17.595535 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef4ed4c6-4231-4e6e-afa0-00300d75e82e req-d968e275-6d58-4d2e-8d94-6b5e738f0acb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:04:17.597223 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ef4ed4c6-4231-4e6e-afa0-00300d75e82e req-d968e275-6d58-4d2e-8d94-6b5e738f0acb service neutron] 10.222.0.26 "GET /v2.0/networks?id=7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3 HTTP/1.1" status: 200 len: 896 time: 0.1240039 Nov 09 05:04:17.605341 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4d21ff17-4653-43c0-ab93-1d2a90c108ab None None] Checking router: 4b35f811-d243-43fb-b6b0-2ebfa884259d for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 05:04:17.608432 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36924) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:04:17.613770 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4d21ff17-4653-43c0-ab93-1d2a90c108ab None None] Routers {'4b35f811-d243-43fb-b6b0-2ebfa884259d'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:04:17.614397 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-4d21ff17-4653-43c0-ab93-1d2a90c108ab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:04:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['4b35f811-d243-43fb-b6b0-2ebfa884259d'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:04:17.666891 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ef4ed4c6-4231-4e6e-afa0-00300d75e82e req-2b19a471-8742-4792-94d6-af7873e665de service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=f4f26d5e-838f-4398-acda-1c9fb08b903b HTTP/1.1" status: 200 len: 998 time: 0.0629697 Nov 09 05:04:17.677002 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-b044d69c-70a4-4bba-afaf-2188c1149a49 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/floatingips/e5338ba7-e021-479a-a2a2-c4305b90fa8a HTTP/1.1" status: 200 len: 990 time: 0.0673757 Nov 09 05:04:17.723277 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-4d21ff17-4653-43c0-ab93-1d2a90c108ab None None] Set router 4b35f811-d243-43fb-b6b0-2ebfa884259d gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:04:17.723584 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef4ed4c6-4231-4e6e-afa0-00300d75e82e req-eeb9b6b5-a5db-469e-a4f5-4d07a671b52a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:04:17.725760 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ef4ed4c6-4231-4e6e-afa0-00300d75e82e req-eeb9b6b5-a5db-469e-a4f5-4d07a671b52a service neutron] 10.222.0.26 "GET /v2.0/subnets?id=4ab2834b-d379-46c6-93c2-dabc443d001d HTTP/1.1" status: 200 len: 834 time: 0.0524578 Nov 09 05:04:17.771159 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef4ed4c6-4231-4e6e-afa0-00300d75e82e req-afd4f714-a1c4-4cf4-965b-730eb86b1f0e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:04:17.773205 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ef4ed4c6-4231-4e6e-afa0-00300d75e82e req-afd4f714-a1c4-4cf4-965b-730eb86b1f0e service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0404258 Nov 09 05:04:17.864930 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ef4ed4c6-4231-4e6e-afa0-00300d75e82e req-8ce732e5-c48a-4197-8061-53fcfc49aa64 service neutron] 10.222.0.26 "GET /v2.0/networks/7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0852590 Nov 09 05:04:17.939807 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-4d21ff17-4653-43c0-ab93-1d2a90c108ab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4b35f811-d243-43fb-b6b0-2ebfa884259d', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1648817839', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.213'}], 'enable_snat': True}, 'gw_port_id': 'f0aedb4e-bdd3-4b77-b881-acdf25762d73', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:03:57Z', 'updated_at': '2021-11-09T05:04:01Z', 'revision_number': 4, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': 'f0aedb4e-bdd3-4b77-b881-acdf25762d73', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:1d:52:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b35f811-d243-43fb-b6b0-2ebfa884259d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1729, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:03:58Z', 'updated_at': '2021-11-09T05:04:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': 'e5338ba7-e021-479a-a2a2-c4305b90fa8a', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'floating_ip_address': '172.26.0.95', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '4b35f811-d243-43fb-b6b0-2ebfa884259d', 'port_id': 'f4f26d5e-838f-4398-acda-1c9fb08b903b', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 1735, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3', 'mac_address': 'fa:16:3e:a2:15:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '69146330-5c29-48a5-8047-3e8d83d64a0e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T05:04:16Z', 'updated_at': '2021-11-09T05:04:16Z', 'revision_number': 0, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f19da394-f686-40f7-890e-11ac9d902c14', 'name': '', 'network_id': '7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'mac_address': 'fa:16:3e:19:ac:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b35f811-d243-43fb-b6b0-2ebfa884259d', 'device_owner': 'network:router_interface', 'standard_attr_id': 1732, 'fixed_ips': [{'subnet_id': '4ab2834b-d379-46c6-93c2-dabc443d001d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:04:01Z', 'updated_at': '2021-11-09T05:04:04Z', 'revision_number': 5, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'subnets': [{'id': '4ab2834b-d379-46c6-93c2-dabc443d001d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:04:17.954047 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ef4ed4c6-4231-4e6e-afa0-00300d75e82e req-d948aaf1-dbe1-4784-bb34-b91e6d5cf904 service neutron] 10.222.0.26 "GET /v2.0/networks/7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0824451 Nov 09 05:04:17.969629 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4d21ff17-4653-43c0-ab93-1d2a90c108ab None None] The sync data for ids ['4b35f811-d243-43fb-b6b0-2ebfa884259d'] in dv-neutron-816802-2-hyperv is: [{'id': '4b35f811-d243-43fb-b6b0-2ebfa884259d', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1648817839', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.213'}], 'enable_snat': True}, 'gw_port_id': 'f0aedb4e-bdd3-4b77-b881-acdf25762d73', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:03:57Z', 'updated_at': '2021-11-09T05:04:01Z', 'revision_number': 4, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': 'f0aedb4e-bdd3-4b77-b881-acdf25762d73', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:1d:52:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b35f811-d243-43fb-b6b0-2ebfa884259d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1729, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:03:58Z', 'updated_at': '2021-11-09T05:04:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': 'e5338ba7-e021-479a-a2a2-c4305b90fa8a', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'floating_ip_address': '172.26.0.95', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '4b35f811-d243-43fb-b6b0-2ebfa884259d', 'port_id': 'f4f26d5e-838f-4398-acda-1c9fb08b903b', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 1735, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3', 'mac_address': 'fa:16:3e:a2:15:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '69146330-5c29-48a5-8047-3e8d83d64a0e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T05:04:16Z', 'updated_at': '2021-11-09T05:04:16Z', 'revision_number': 0, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f19da394-f686-40f7-890e-11ac9d902c14', 'name': '', 'network_id': '7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'mac_address': 'fa:16:3e:19:ac:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b35f811-d243-43fb-b6b0-2ebfa884259d', 'device_owner': 'network:router_interface', 'standard_attr_id': 1732, 'fixed_ips': [{'subnet_id': '4ab2834b-d379-46c6-93c2-dabc443d001d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:04:01Z', 'updated_at': '2021-11-09T05:04:04Z', 'revision_number': 5, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'subnets': [{'id': '4ab2834b-d379-46c6-93c2-dabc443d001d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 05:04:18.160146 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-df59b171-1460-4bbc-b943-b3a8fcf8ecc8 None None] New status for floating IP e5338ba7-e021-479a-a2a2-c4305b90fa8a: ACTIVE {{(pid=102163) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 05:04:18.680853 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36926) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:04:18.744531 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-40ed7d2b-542a-45b7-b606-9169dde11858 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/floatingips/e5338ba7-e021-479a-a2a2-c4305b90fa8a HTTP/1.1" status: 200 len: 992 time: 0.0625775 Nov 09 05:04:19.319871 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3c892222-55dc-4e66-a53e-110ce5abbd3d req-7271650b-2b41-4a00-ac60-4c5350d870fb service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=69146330-5c29-48a5-8047-3e8d83d64a0e&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0840991 Nov 09 05:04:19.411121 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c892222-55dc-4e66-a53e-110ce5abbd3d req-0926a813-3ec1-4dea-ba4a-f2c8310fb2dc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:04:19.412574 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3c892222-55dc-4e66-a53e-110ce5abbd3d req-0926a813-3ec1-4dea-ba4a-f2c8310fb2dc service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=8ac3eab68bd34485af7ddc3417853b28&device_id=69146330-5c29-48a5-8047-3e8d83d64a0e HTTP/1.1" status: 200 len: 1098 time: 0.0442107 Nov 09 05:04:19.512406 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c892222-55dc-4e66-a53e-110ce5abbd3d req-5068ceb8-d161-42ea-a5b8-72be899540d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:04:19.513756 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3c892222-55dc-4e66-a53e-110ce5abbd3d req-5068ceb8-d161-42ea-a5b8-72be899540d5 service neutron] 10.222.0.26 "GET /v2.0/networks?id=7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3 HTTP/1.1" status: 200 len: 896 time: 0.0829129 Nov 09 05:04:19.583193 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3c892222-55dc-4e66-a53e-110ce5abbd3d req-6f63b5fe-4e46-4952-8c1f-cf2ab7d333f9 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=f4f26d5e-838f-4398-acda-1c9fb08b903b HTTP/1.1" status: 200 len: 1000 time: 0.0616913 Nov 09 05:04:19.630677 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c892222-55dc-4e66-a53e-110ce5abbd3d req-980c450a-831e-412b-b0a9-d39f8acf29de service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:04:19.632642 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3c892222-55dc-4e66-a53e-110ce5abbd3d req-980c450a-831e-412b-b0a9-d39f8acf29de service neutron] 10.222.0.26 "GET /v2.0/subnets?id=4ab2834b-d379-46c6-93c2-dabc443d001d HTTP/1.1" status: 200 len: 834 time: 0.0427935 Nov 09 05:04:19.688943 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c892222-55dc-4e66-a53e-110ce5abbd3d req-d826f235-60a6-4732-82da-03d73522c958 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:04:19.690389 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3c892222-55dc-4e66-a53e-110ce5abbd3d req-d826f235-60a6-4732-82da-03d73522c958 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0382512 Nov 09 05:04:19.780817 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3c892222-55dc-4e66-a53e-110ce5abbd3d req-cf898824-ffde-403c-bb4c-a6613e77009d service neutron] 10.222.0.26 "GET /v2.0/networks/7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0834179 Nov 09 05:04:19.868589 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3c892222-55dc-4e66-a53e-110ce5abbd3d req-f77b42a6-e7e0-4363-84ec-24ad29cf9421 service neutron] 10.222.0.26 "GET /v2.0/networks/7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0807791 Nov 09 05:04:40.453662 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 05:04:41.344696 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6208fcde-2c2b-4d35-a4df-3954b5cd5506 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:42.430504 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:43.715774 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f8a0402c-2b3d-428e-ab66-ba8deeac37d8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:45.218243 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:46.606887 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:46.977523 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:04:47.733095 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-781f6581-11ff-4fa8-9da5-9be6654d6c14 req-5659d02c-23cf-422c-99b3-ea659dbbe2b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:04:47.734756 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-781f6581-11ff-4fa8-9da5-9be6654d6c14 req-5659d02c-23cf-422c-99b3-ea659dbbe2b1 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=8ac3eab68bd34485af7ddc3417853b28&device_id=69146330-5c29-48a5-8047-3e8d83d64a0e HTTP/1.1" status: 200 len: 1098 time: 0.0474513 Nov 09 05:04:47.759321 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2569790-34e2-42a2-b4e4-2e7568f1cfa1 req-f1863a64-85cd-4c9a-b505-68f7cedfe64f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:04:47.760802 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d2569790-34e2-42a2-b4e4-2e7568f1cfa1 req-f1863a64-85cd-4c9a-b505-68f7cedfe64f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=69146330-5c29-48a5-8047-3e8d83d64a0e HTTP/1.1" status: 200 len: 945 time: 0.1327612 Nov 09 05:04:47.809054 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d2569790-34e2-42a2-b4e4-2e7568f1cfa1 req-faf64fa1-b883-4749-af33-1fea72ec6e12 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=1cf96a5c-2f90-45b2-850e-3b6b8d385bbd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421972 Nov 09 05:04:47.825813 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-781f6581-11ff-4fa8-9da5-9be6654d6c14 req-bf9a8060-361a-45af-a430-9294ba8a10aa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:04:47.827314 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-781f6581-11ff-4fa8-9da5-9be6654d6c14 req-bf9a8060-361a-45af-a430-9294ba8a10aa service neutron] 10.222.0.26 "GET /v2.0/networks?id=7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3 HTTP/1.1" status: 200 len: 896 time: 0.0852864 Nov 09 05:04:47.897289 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-781f6581-11ff-4fa8-9da5-9be6654d6c14 req-398ae252-798d-4b6f-835d-2273d1cb7ee6 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=f4f26d5e-838f-4398-acda-1c9fb08b903b HTTP/1.1" status: 200 len: 1000 time: 0.0625343 Nov 09 05:04:47.946341 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-781f6581-11ff-4fa8-9da5-9be6654d6c14 req-3f0e70cb-0537-43d3-ac21-940471eb8653 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:04:47.947779 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-781f6581-11ff-4fa8-9da5-9be6654d6c14 req-3f0e70cb-0537-43d3-ac21-940471eb8653 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=4ab2834b-d379-46c6-93c2-dabc443d001d HTTP/1.1" status: 200 len: 834 time: 0.0426354 Nov 09 05:04:47.993358 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-781f6581-11ff-4fa8-9da5-9be6654d6c14 req-fcfc7ee5-133f-4fa7-8c54-55aff9f812b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:04:47.994848 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-781f6581-11ff-4fa8-9da5-9be6654d6c14 req-fcfc7ee5-133f-4fa7-8c54-55aff9f812b7 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0386872 Nov 09 05:04:48.087022 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-781f6581-11ff-4fa8-9da5-9be6654d6c14 req-29114717-8077-4b36-84ec-65e8f1c1412b service neutron] 10.222.0.26 "GET /v2.0/networks/7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0836449 Nov 09 05:04:48.193128 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-781f6581-11ff-4fa8-9da5-9be6654d6c14 req-e2b796f6-ab67-40c8-8008-08694ca7fc48 service neutron] 10.222.0.26 "GET /v2.0/networks/7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0974262 Nov 09 05:04:48.977377 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cdf4267-7135-4008-aaef-66c1d5a7dc4f req-a7268c54-2932-46f1-9603-233af09b196e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:04:48.978871 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8cdf4267-7135-4008-aaef-66c1d5a7dc4f req-a7268c54-2932-46f1-9603-233af09b196e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=69146330-5c29-48a5-8047-3e8d83d64a0e HTTP/1.1" status: 200 len: 945 time: 0.1017869 Nov 09 05:04:49.027470 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8cdf4267-7135-4008-aaef-66c1d5a7dc4f req-9c080759-ecde-4660-ac9e-bb4c104ed327 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=1cf96a5c-2f90-45b2-850e-3b6b8d385bbd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427289 Nov 09 05:04:50.142662 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9dc685be-171c-47f1-b032-e8a389fb2f8e req-16672ed9-4d11-44e0-8a90-66ccff5066d2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:04:50.144035 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-9dc685be-171c-47f1-b032-e8a389fb2f8e req-16672ed9-4d11-44e0-8a90-66ccff5066d2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=69146330-5c29-48a5-8047-3e8d83d64a0e HTTP/1.1" status: 200 len: 945 time: 0.0511925 Nov 09 05:04:50.192151 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-9dc685be-171c-47f1-b032-e8a389fb2f8e req-965be126-c8b6-430f-a2ae-e99eee0a235a tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=1cf96a5c-2f90-45b2-850e-3b6b8d385bbd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422316 Nov 09 05:04:51.304787 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb398471-44cc-4064-88ab-60250a1b32c7 req-7885bd1b-ce63-4752-86b2-f454b9d04f8e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:04:51.306246 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-eb398471-44cc-4064-88ab-60250a1b32c7 req-7885bd1b-ce63-4752-86b2-f454b9d04f8e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=69146330-5c29-48a5-8047-3e8d83d64a0e HTTP/1.1" status: 200 len: 945 time: 0.0476699 Nov 09 05:04:51.355620 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-eb398471-44cc-4064-88ab-60250a1b32c7 req-db9314fb-b32f-4c32-bdc0-6fabcd5e7728 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=1cf96a5c-2f90-45b2-850e-3b6b8d385bbd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428305 Nov 09 05:04:52.474159 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef1e1c76-c8a1-41e6-ba29-43b89e1053c0 req-7f8faaa1-ae7a-4b9d-ad39-a7432e364523 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:04:52.475559 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ef1e1c76-c8a1-41e6-ba29-43b89e1053c0 req-7f8faaa1-ae7a-4b9d-ad39-a7432e364523 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=69146330-5c29-48a5-8047-3e8d83d64a0e HTTP/1.1" status: 200 len: 945 time: 0.0531251 Nov 09 05:04:52.523179 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ef1e1c76-c8a1-41e6-ba29-43b89e1053c0 req-3092036e-d803-4755-a2d2-5e1b130988af tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=1cf96a5c-2f90-45b2-850e-3b6b8d385bbd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0413034 Nov 09 05:04:53.636651 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3a4c421-ed07-4b56-99cc-25a2fa7a1947 req-b374bcfe-d023-438e-b4e1-21ca81042ae3 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:04:53.638086 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f3a4c421-ed07-4b56-99cc-25a2fa7a1947 req-b374bcfe-d023-438e-b4e1-21ca81042ae3 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=69146330-5c29-48a5-8047-3e8d83d64a0e HTTP/1.1" status: 200 len: 945 time: 0.0469306 Nov 09 05:04:53.689300 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f3a4c421-ed07-4b56-99cc-25a2fa7a1947 req-a69d24aa-3357-41bb-995e-bccea9ccec4c tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=1cf96a5c-2f90-45b2-850e-3b6b8d385bbd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0454922 Nov 09 05:04:54.800217 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-884e61cb-c6a3-464d-80be-85a81b785fd3 req-d7ae4401-4ef5-45a2-bcdb-16ae128937f5 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:04:54.801677 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-884e61cb-c6a3-464d-80be-85a81b785fd3 req-d7ae4401-4ef5-45a2-bcdb-16ae128937f5 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=69146330-5c29-48a5-8047-3e8d83d64a0e HTTP/1.1" status: 200 len: 945 time: 0.0462470 Nov 09 05:04:54.852667 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-884e61cb-c6a3-464d-80be-85a81b785fd3 req-c39d2673-db37-4415-9c6b-ba5ac6e1ea87 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=1cf96a5c-2f90-45b2-850e-3b6b8d385bbd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0445271 Nov 09 05:04:55.965217 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d50d49d-6d96-4790-a1dc-f548f7cc6d3b req-d2e365b0-28a0-4858-adaf-763aa380b57f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:04:55.966699 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-0d50d49d-6d96-4790-a1dc-f548f7cc6d3b req-d2e365b0-28a0-4858-adaf-763aa380b57f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=69146330-5c29-48a5-8047-3e8d83d64a0e HTTP/1.1" status: 200 len: 945 time: 0.0475695 Nov 09 05:04:56.014315 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-0d50d49d-6d96-4790-a1dc-f548f7cc6d3b req-f3bb4fd5-6c13-4a9f-becb-5ab32242b303 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=1cf96a5c-2f90-45b2-850e-3b6b8d385bbd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418334 Nov 09 05:04:57.131842 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d94dbe08-1a60-4402-8657-56976fba7f9b req-6e11e4dc-ceb7-4319-b5d0-797bd75dd284 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:04:57.133315 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d94dbe08-1a60-4402-8657-56976fba7f9b req-6e11e4dc-ceb7-4319-b5d0-797bd75dd284 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=69146330-5c29-48a5-8047-3e8d83d64a0e HTTP/1.1" status: 200 len: 945 time: 0.0531330 Nov 09 05:04:57.181445 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d94dbe08-1a60-4402-8657-56976fba7f9b req-4d8dd7c2-94e2-4eec-ab45-465a850b9b77 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=1cf96a5c-2f90-45b2-850e-3b6b8d385bbd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420685 Nov 09 05:04:58.293264 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c014386b-4dad-4293-a946-86c7745679ef req-5e0d02ab-a746-424e-a3f8-7dd401b6351f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:04:58.294662 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c014386b-4dad-4293-a946-86c7745679ef req-5e0d02ab-a746-424e-a3f8-7dd401b6351f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=69146330-5c29-48a5-8047-3e8d83d64a0e HTTP/1.1" status: 200 len: 945 time: 0.0478175 Nov 09 05:04:58.343460 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c014386b-4dad-4293-a946-86c7745679ef req-27990868-5ad4-4aa6-a111-d4c1ce9c9ef5 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=1cf96a5c-2f90-45b2-850e-3b6b8d385bbd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429780 Nov 09 05:04:59.457207 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74a2aa91-8d5e-44d1-ad29-824138845fd2 req-829a6ac0-6cf9-49f3-8583-8cce081bb67e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:04:59.459606 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-74a2aa91-8d5e-44d1-ad29-824138845fd2 req-829a6ac0-6cf9-49f3-8583-8cce081bb67e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=69146330-5c29-48a5-8047-3e8d83d64a0e HTTP/1.1" status: 200 len: 945 time: 0.0505109 Nov 09 05:04:59.509811 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-74a2aa91-8d5e-44d1-ad29-824138845fd2 req-ce7020e8-b74d-43d6-bd9f-2437b4e8e768 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=1cf96a5c-2f90-45b2-850e-3b6b8d385bbd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417006 Nov 09 05:04:59.532427 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36966) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:04:59.594275 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-62051fe9-8d73-487e-85c0-229f9e11d1a3 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/floatingips/e5338ba7-e021-479a-a2a2-c4305b90fa8a HTTP/1.1" status: 200 len: 992 time: 0.0607738 Nov 09 05:05:11.348989 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-fd658cd4-a324-418b-b7fa-8c30bab5a3e3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:12.530990 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:13.691201 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1b4f744d-d6ed-4759-b9ed-fd251d044ac9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:15.223317 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:16.629268 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:17.023812 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:17.452399 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 05:05:21.281589 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7eaf5fd7-ee43-40de-aaf1-06e0d789272d req-6f333520-5ee2-451e-afc3-fed847d13437 service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=69146330-5c29-48a5-8047-3e8d83d64a0e&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0432825 Nov 09 05:05:21.368340 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7eaf5fd7-ee43-40de-aaf1-06e0d789272d req-c49aef1d-0b5f-43dc-8376-d203f7ccf319 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:05:21.369799 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7eaf5fd7-ee43-40de-aaf1-06e0d789272d req-c49aef1d-0b5f-43dc-8376-d203f7ccf319 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=8ac3eab68bd34485af7ddc3417853b28&device_id=69146330-5c29-48a5-8047-3e8d83d64a0e HTTP/1.1" status: 200 len: 1098 time: 0.0394022 Nov 09 05:05:21.472800 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7eaf5fd7-ee43-40de-aaf1-06e0d789272d req-032380a7-1d88-4dfe-8470-304cbd797434 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:05:21.474245 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7eaf5fd7-ee43-40de-aaf1-06e0d789272d req-032380a7-1d88-4dfe-8470-304cbd797434 service neutron] 10.222.0.26 "GET /v2.0/networks?id=7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3 HTTP/1.1" status: 200 len: 896 time: 0.0839918 Nov 09 05:05:21.543182 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7eaf5fd7-ee43-40de-aaf1-06e0d789272d req-ae1fda94-5ba0-4b96-ba61-525bd5191e5c service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=f4f26d5e-838f-4398-acda-1c9fb08b903b HTTP/1.1" status: 200 len: 1000 time: 0.0608468 Nov 09 05:05:21.593792 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7eaf5fd7-ee43-40de-aaf1-06e0d789272d req-1030469c-b2d3-49f8-b8c7-037d43da8ad9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:05:21.595481 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7eaf5fd7-ee43-40de-aaf1-06e0d789272d req-1030469c-b2d3-49f8-b8c7-037d43da8ad9 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=4ab2834b-d379-46c6-93c2-dabc443d001d HTTP/1.1" status: 200 len: 834 time: 0.0445352 Nov 09 05:05:21.640263 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7eaf5fd7-ee43-40de-aaf1-06e0d789272d req-52939a00-13d5-4b0d-b3f6-53c42084032b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:05:21.641787 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7eaf5fd7-ee43-40de-aaf1-06e0d789272d req-52939a00-13d5-4b0d-b3f6-53c42084032b service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0393920 Nov 09 05:05:21.733996 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7eaf5fd7-ee43-40de-aaf1-06e0d789272d req-59229088-0ab2-44d6-85db-6a33e241df6a service neutron] 10.222.0.26 "GET /v2.0/networks/7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0850844 Nov 09 05:05:21.827294 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7eaf5fd7-ee43-40de-aaf1-06e0d789272d req-00a3dcf9-9da3-41e5-9324-0f8e58a48749 service neutron] 10.222.0.26 "GET /v2.0/networks/7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0846319 Nov 09 05:05:30.008325 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 36986) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:05:30.161129 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-17dc4107-6fd6-4275-8e7c-ea979a450764 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Deleting port f098332a-a056-4fbc-94d6-b15f9892256e {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:05:30.161382 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-17dc4107-6fd6-4275-8e7c-ea979a450764 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:30.237325 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-17dc4107-6fd6-4275-8e7c-ea979a450764 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:30.237647 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-17dc4107-6fd6-4275-8e7c-ea979a450764 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:30.248907 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-17dc4107-6fd6-4275-8e7c-ea979a450764 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Calling delete_port for f098332a-a056-4fbc-94d6-b15f9892256e owned by network:floatingip {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:05:30.443239 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-17dc4107-6fd6-4275-8e7c-ea979a450764 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:30.468504 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17dc4107-6fd6-4275-8e7c-ea979a450764 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event deleted for resources: {'Port': ['ID=f098332a-a056-4fbc-94d6-b15f9892256e,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:05:30.480646 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17dc4107-6fd6-4275-8e7c-ea979a450764 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:05:30.481115 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17dc4107-6fd6-4275-8e7c-ea979a450764 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:05:30.481469 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17dc4107-6fd6-4275-8e7c-ea979a450764 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:05:30.481845 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17dc4107-6fd6-4275-8e7c-ea979a450764 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:05:30.482189 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17dc4107-6fd6-4275-8e7c-ea979a450764 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:05:30.482578 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17dc4107-6fd6-4275-8e7c-ea979a450764 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:05:30.482915 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17dc4107-6fd6-4275-8e7c-ea979a450764 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:05:30.483247 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17dc4107-6fd6-4275-8e7c-ea979a450764 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:05:30.483578 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17dc4107-6fd6-4275-8e7c-ea979a450764 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:05:30.483910 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17dc4107-6fd6-4275-8e7c-ea979a450764 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:05:30.484239 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17dc4107-6fd6-4275-8e7c-ea979a450764 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:05:30.484567 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17dc4107-6fd6-4275-8e7c-ea979a450764 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:05:30.536683 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-17dc4107-6fd6-4275-8e7c-ea979a450764 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for floatingip, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:30.537015 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.l3_db [None req-17dc4107-6fd6-4275-8e7c-ea979a450764 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Floating IP e5338ba7-e021-479a-a2a2-c4305b90fa8a disassociated (deleted). External IP: 172.26.0.95, port: f4f26d5e-838f-4398-acda-1c9fb08b903b. Nov 09 05:05:31.019648 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-17dc4107-6fd6-4275-8e7c-ea979a450764 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Router 4b35f811-d243-43fb-b6b0-2ebfa884259d has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 05:05:31.124127 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-17dc4107-6fd6-4275-8e7c-ea979a450764 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 05:05:31.128929 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-17dc4107-6fd6-4275-8e7c-ea979a450764 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:31.134088 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d845868c-e4cf-4efc-b59f-a4094dbbc716 None None] Sync routers for ids ['4b35f811-d243-43fb-b6b0-2ebfa884259d'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 05:05:31.143063 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d845868c-e4cf-4efc-b59f-a4094dbbc716 None None] Routers {'4b35f811-d243-43fb-b6b0-2ebfa884259d'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:05:31.143610 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-d845868c-e4cf-4efc-b59f-a4094dbbc716 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:05:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['4b35f811-d243-43fb-b6b0-2ebfa884259d'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:05:31.154434 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-17dc4107-6fd6-4275-8e7c-ea979a450764 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "DELETE /v2.0/floatingips/e5338ba7-e021-479a-a2a2-c4305b90fa8a HTTP/1.1" status: 204 len: 168 time: 1.1450276 Nov 09 05:05:31.155020 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '69146330-5c29-48a5-8047-3e8d83d64a0e', 'tag': 'f4f26d5e-838f-4398-acda-1c9fb08b903b'}] {{(pid=102161) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:05:31.157759 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}99dfdda0def497b4372884ef2eb87f06b1e425c8eba5ceda5f64bbab037a07d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fe6fb408-e15e-476c-9b20-d11735cebeab" -d '{"events": [{"name": "network-changed", "server_uuid": "69146330-5c29-48a5-8047-3e8d83d64a0e", "tag": "f4f26d5e-838f-4398-acda-1c9fb08b903b"}]}' {{(pid=102161) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:05:31.195786 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 05:05:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1b474f3b-1767-41a4-9ab3-40c4a014e056 x-openstack-request-id: req-1b474f3b-1767-41a4-9ab3-40c4a014e056 {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:05:31.196071 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "69146330-5c29-48a5-8047-3e8d83d64a0e", "tag": "f4f26d5e-838f-4398-acda-1c9fb08b903b", "status": "completed", "code": 200}]} {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:05:31.196322 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-1b474f3b-1767-41a4-9ab3-40c4a014e056 {{(pid=102161) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:05:31.196726 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '69146330-5c29-48a5-8047-3e8d83d64a0e', 'tag': 'f4f26d5e-838f-4398-acda-1c9fb08b903b', 'status': 'completed', 'code': 200} Nov 09 05:05:31.251404 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-d845868c-e4cf-4efc-b59f-a4094dbbc716 None None] Set router 4b35f811-d243-43fb-b6b0-2ebfa884259d gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:05:31.259546 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe6fb408-e15e-476c-9b20-d11735cebeab req-19a3aa3e-4991-4f8b-82a8-e15daa5ec06a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:05:31.261321 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fe6fb408-e15e-476c-9b20-d11735cebeab req-19a3aa3e-4991-4f8b-82a8-e15daa5ec06a service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=8ac3eab68bd34485af7ddc3417853b28&device_id=69146330-5c29-48a5-8047-3e8d83d64a0e HTTP/1.1" status: 200 len: 1098 time: 0.0415583 Nov 09 05:05:31.355196 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe6fb408-e15e-476c-9b20-d11735cebeab req-90befde8-e70d-4608-ab76-313e5934de1c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:05:31.356704 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fe6fb408-e15e-476c-9b20-d11735cebeab req-90befde8-e70d-4608-ab76-313e5934de1c service neutron] 10.222.0.26 "GET /v2.0/networks?id=7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3 HTTP/1.1" status: 200 len: 896 time: 0.0884855 Nov 09 05:05:31.404479 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fe6fb408-e15e-476c-9b20-d11735cebeab req-4c8a3a66-1d0b-47a9-8f29-f44518f44ba6 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=f4f26d5e-838f-4398-acda-1c9fb08b903b HTTP/1.1" status: 200 len: 217 time: 0.0396724 Nov 09 05:05:31.448331 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-d845868c-e4cf-4efc-b59f-a4094dbbc716 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4b35f811-d243-43fb-b6b0-2ebfa884259d', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1648817839', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.213'}], 'enable_snat': True}, 'gw_port_id': 'f0aedb4e-bdd3-4b77-b881-acdf25762d73', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:03:57Z', 'updated_at': '2021-11-09T05:04:01Z', 'revision_number': 4, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': 'f0aedb4e-bdd3-4b77-b881-acdf25762d73', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:1d:52:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b35f811-d243-43fb-b6b0-2ebfa884259d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1729, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:03:58Z', 'updated_at': '2021-11-09T05:04:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'f19da394-f686-40f7-890e-11ac9d902c14', 'name': '', 'network_id': '7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'mac_address': 'fa:16:3e:19:ac:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b35f811-d243-43fb-b6b0-2ebfa884259d', 'device_owner': 'network:router_interface', 'standard_attr_id': 1732, 'fixed_ips': [{'subnet_id': '4ab2834b-d379-46c6-93c2-dabc443d001d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:04:01Z', 'updated_at': '2021-11-09T05:04:04Z', 'revision_number': 5, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'subnets': [{'id': '4ab2834b-d379-46c6-93c2-dabc443d001d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:05:31.456084 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe6fb408-e15e-476c-9b20-d11735cebeab req-6904f43a-014b-482d-a192-552382e0a87f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:05:31.457599 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fe6fb408-e15e-476c-9b20-d11735cebeab req-6904f43a-014b-482d-a192-552382e0a87f service neutron] 10.222.0.26 "GET /v2.0/subnets?id=4ab2834b-d379-46c6-93c2-dabc443d001d HTTP/1.1" status: 200 len: 834 time: 0.0452645 Nov 09 05:05:31.479106 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d845868c-e4cf-4efc-b59f-a4094dbbc716 None None] Checking router: 4b35f811-d243-43fb-b6b0-2ebfa884259d for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 05:05:31.487438 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d845868c-e4cf-4efc-b59f-a4094dbbc716 None None] Routers {'4b35f811-d243-43fb-b6b0-2ebfa884259d'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:05:31.488042 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-d845868c-e4cf-4efc-b59f-a4094dbbc716 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:05:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['4b35f811-d243-43fb-b6b0-2ebfa884259d'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:05:31.505448 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe6fb408-e15e-476c-9b20-d11735cebeab req-b38b936e-5ba1-485c-bc2b-d2d2546f7648 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:05:31.507037 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fe6fb408-e15e-476c-9b20-d11735cebeab req-b38b936e-5ba1-485c-bc2b-d2d2546f7648 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0420289 Nov 09 05:05:31.634713 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fe6fb408-e15e-476c-9b20-d11735cebeab req-0ccb34c7-4970-4253-b743-ae13225096dd service neutron] 10.222.0.26 "GET /v2.0/networks/7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1194699 Nov 09 05:05:31.643038 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ede5bdd-3f8d-4f67-82f5-f136495410ac req-7a8f4afc-165e-45f4-b40c-7fb64b4884a6 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:05:31.644488 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6ede5bdd-3f8d-4f67-82f5-f136495410ac req-7a8f4afc-165e-45f4-b40c-7fb64b4884a6 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=69146330-5c29-48a5-8047-3e8d83d64a0e HTTP/1.1" status: 200 len: 945 time: 0.1021850 Nov 09 05:05:31.683384 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-d845868c-e4cf-4efc-b59f-a4094dbbc716 None None] Set router 4b35f811-d243-43fb-b6b0-2ebfa884259d gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:05:31.752675 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6ede5bdd-3f8d-4f67-82f5-f136495410ac req-cb8c3968-7651-45e0-98e8-4c8786f9f15e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=1cf96a5c-2f90-45b2-850e-3b6b8d385bbd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0999858 Nov 09 05:05:31.768811 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fe6fb408-e15e-476c-9b20-d11735cebeab req-bf10a540-f0c9-4ab6-8095-8974fa4c7d5e service neutron] 10.222.0.26 "GET /v2.0/networks/7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1233926 Nov 09 05:05:31.876223 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-d845868c-e4cf-4efc-b59f-a4094dbbc716 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4b35f811-d243-43fb-b6b0-2ebfa884259d', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1648817839', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.213'}], 'enable_snat': True}, 'gw_port_id': 'f0aedb4e-bdd3-4b77-b881-acdf25762d73', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:03:57Z', 'updated_at': '2021-11-09T05:04:01Z', 'revision_number': 4, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': 'f0aedb4e-bdd3-4b77-b881-acdf25762d73', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:1d:52:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b35f811-d243-43fb-b6b0-2ebfa884259d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1729, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:03:58Z', 'updated_at': '2021-11-09T05:04:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'f19da394-f686-40f7-890e-11ac9d902c14', 'name': '', 'network_id': '7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'mac_address': 'fa:16:3e:19:ac:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b35f811-d243-43fb-b6b0-2ebfa884259d', 'device_owner': 'network:router_interface', 'standard_attr_id': 1732, 'fixed_ips': [{'subnet_id': '4ab2834b-d379-46c6-93c2-dabc443d001d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:04:01Z', 'updated_at': '2021-11-09T05:04:04Z', 'revision_number': 5, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'subnets': [{'id': '4ab2834b-d379-46c6-93c2-dabc443d001d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:05:31.902090 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d845868c-e4cf-4efc-b59f-a4094dbbc716 None None] The sync data for ids ['4b35f811-d243-43fb-b6b0-2ebfa884259d'] in dv-neutron-816802-2-hyperv is: [{'id': '4b35f811-d243-43fb-b6b0-2ebfa884259d', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1648817839', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.213'}], 'enable_snat': True}, 'gw_port_id': 'f0aedb4e-bdd3-4b77-b881-acdf25762d73', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:03:57Z', 'updated_at': '2021-11-09T05:04:01Z', 'revision_number': 4, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': 'f0aedb4e-bdd3-4b77-b881-acdf25762d73', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:1d:52:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b35f811-d243-43fb-b6b0-2ebfa884259d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1729, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:03:58Z', 'updated_at': '2021-11-09T05:04:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'f19da394-f686-40f7-890e-11ac9d902c14', 'name': '', 'network_id': '7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'mac_address': 'fa:16:3e:19:ac:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b35f811-d243-43fb-b6b0-2ebfa884259d', 'device_owner': 'network:router_interface', 'standard_attr_id': 1732, 'fixed_ips': [{'subnet_id': '4ab2834b-d379-46c6-93c2-dabc443d001d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:04:01Z', 'updated_at': '2021-11-09T05:04:04Z', 'revision_number': 5, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'subnets': [{'id': '4ab2834b-d379-46c6-93c2-dabc443d001d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 05:05:32.115828 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7a0bc2b5-eb4d-4353-a344-02e3f779de5f None None] New status for floating IP e5338ba7-e021-479a-a2a2-c4305b90fa8a: DOWN {{(pid=102163) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 05:05:32.871215 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61e5b93a-dbad-4a73-a733-1e13d3caaac3 req-53529ebf-5e89-4e4e-ba51-4b9e547fae60 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:05:32.872655 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-61e5b93a-dbad-4a73-a733-1e13d3caaac3 req-53529ebf-5e89-4e4e-ba51-4b9e547fae60 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=69146330-5c29-48a5-8047-3e8d83d64a0e HTTP/1.1" status: 200 len: 945 time: 0.0491958 Nov 09 05:05:32.925210 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-61e5b93a-dbad-4a73-a733-1e13d3caaac3 req-2a915f08-4ee9-493e-bf0c-96c281b39835 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=1cf96a5c-2f90-45b2-850e-3b6b8d385bbd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0467288 Nov 09 05:05:33.049384 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2aa01326-db29-4764-b793-d429abf9d31d req-7c018fc5-79e8-45c9-b44d-a91d2f32cada tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:05:33.050766 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2aa01326-db29-4764-b793-d429abf9d31d req-7c018fc5-79e8-45c9-b44d-a91d2f32cada tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.26 "GET /v2.0/ports?device_id=69146330-5c29-48a5-8047-3e8d83d64a0e HTTP/1.1" status: 200 len: 945 time: 0.0477369 Nov 09 05:05:33.139890 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-2aa01326-db29-4764-b793-d429abf9d31d req-20713bfd-20dd-4bf8-9dab-d6c628a207f1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Deleting port f4f26d5e-838f-4398-acda-1c9fb08b903b {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:05:33.140220 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-2aa01326-db29-4764-b793-d429abf9d31d req-20713bfd-20dd-4bf8-9dab-d6c628a207f1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:33.225951 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-2aa01326-db29-4764-b793-d429abf9d31d req-20713bfd-20dd-4bf8-9dab-d6c628a207f1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] For port f4f26d5e-838f-4398-acda-1c9fb08b903b, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=f4f26d5e-838f-4398-acda-1c9fb08b903b,segment=NetworkSegment(d82b4232-13d0-4050-bf58-c5e9ea713dd3),segment_id=d82b4232-13d0-4050-bf58-c5e9ea713dd3)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:05:33.226308 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-2aa01326-db29-4764-b793-d429abf9d31d req-20713bfd-20dd-4bf8-9dab-d6c628a207f1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:33.238571 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-2aa01326-db29-4764-b793-d429abf9d31d req-20713bfd-20dd-4bf8-9dab-d6c628a207f1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Calling delete_port for f4f26d5e-838f-4398-acda-1c9fb08b903b owned by compute:nova {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:05:33.448768 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-2aa01326-db29-4764-b793-d429abf9d31d req-20713bfd-20dd-4bf8-9dab-d6c628a207f1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:33.476545 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20713bfd-20dd-4bf8-9dab-d6c628a207f1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event deleted for resources: {'Port': ['ID=f4f26d5e-838f-4398-acda-1c9fb08b903b,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:05:33.500870 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20713bfd-20dd-4bf8-9dab-d6c628a207f1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:05:33.501217 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20713bfd-20dd-4bf8-9dab-d6c628a207f1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:05:33.501557 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20713bfd-20dd-4bf8-9dab-d6c628a207f1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:05:33.501887 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20713bfd-20dd-4bf8-9dab-d6c628a207f1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:05:33.502216 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20713bfd-20dd-4bf8-9dab-d6c628a207f1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:05:33.502567 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20713bfd-20dd-4bf8-9dab-d6c628a207f1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:05:33.502893 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20713bfd-20dd-4bf8-9dab-d6c628a207f1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:05:33.503212 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20713bfd-20dd-4bf8-9dab-d6c628a207f1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:05:33.503532 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20713bfd-20dd-4bf8-9dab-d6c628a207f1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:05:33.503849 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20713bfd-20dd-4bf8-9dab-d6c628a207f1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:05:33.504192 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20713bfd-20dd-4bf8-9dab-d6c628a207f1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:05:33.504564 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20713bfd-20dd-4bf8-9dab-d6c628a207f1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:05:33.525604 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-2aa01326-db29-4764-b793-d429abf9d31d req-20713bfd-20dd-4bf8-9dab-d6c628a207f1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] No DVR routers for this DVR port f4f26d5e-838f-4398-acda-1c9fb08b903b on host hv-neutron-8168 {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 05:05:33.527920 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-2aa01326-db29-4764-b793-d429abf9d31d req-20713bfd-20dd-4bf8-9dab-d6c628a207f1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:33.531269 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2aa01326-db29-4764-b793-d429abf9d31d req-20713bfd-20dd-4bf8-9dab-d6c628a207f1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.26 "DELETE /v2.0/ports/f4f26d5e-838f-4398-acda-1c9fb08b903b HTTP/1.1" status: 204 len: 173 time: 0.4739513 Nov 09 05:05:33.531689 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '69146330-5c29-48a5-8047-3e8d83d64a0e', 'name': 'network-vif-deleted', 'tag': 'f4f26d5e-838f-4398-acda-1c9fb08b903b'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:05:33.533926 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ef2150c7-e08e-42cd-94cc-a885c94c61c7" -d '{"events": [{"server_uuid": "69146330-5c29-48a5-8047-3e8d83d64a0e", "name": "network-vif-deleted", "tag": "f4f26d5e-838f-4398-acda-1c9fb08b903b"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:05:33.624788 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 05:05:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-db3cce69-5117-45b6-98f1-b08e8b8bd49c x-openstack-request-id: req-db3cce69-5117-45b6-98f1-b08e8b8bd49c {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:05:33.625680 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "69146330-5c29-48a5-8047-3e8d83d64a0e", "name": "network-vif-deleted", "tag": "f4f26d5e-838f-4398-acda-1c9fb08b903b", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:05:33.625933 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-db3cce69-5117-45b6-98f1-b08e8b8bd49c {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:05:33.626332 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '69146330-5c29-48a5-8047-3e8d83d64a0e', 'name': 'network-vif-deleted', 'tag': 'f4f26d5e-838f-4398-acda-1c9fb08b903b', 'status': 'completed', 'code': 200} Nov 09 05:05:34.028456 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-dba5db1b-3110-4e26-8f70-ab1f2e56b456 req-5334033f-cab6-444b-a69c-988b6383595f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=69146330-5c29-48a5-8047-3e8d83d64a0e HTTP/1.1" status: 200 len: 210 time: 0.0254953 Nov 09 05:05:35.084359 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 37008) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:05:35.432509 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5e283658-cc8e-40f9-af26-9a9ccee07a7f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:35.675428 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-5e283658-cc8e-40f9-af26-9a9ccee07a7f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Deleting port f19da394-f686-40f7-890e-11ac9d902c14 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:05:35.676004 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5e283658-cc8e-40f9-af26-9a9ccee07a7f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:35.764359 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-5e283658-cc8e-40f9-af26-9a9ccee07a7f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] For port f19da394-f686-40f7-890e-11ac9d902c14, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=f19da394-f686-40f7-890e-11ac9d902c14,segment=NetworkSegment(d82b4232-13d0-4050-bf58-c5e9ea713dd3),segment_id=d82b4232-13d0-4050-bf58-c5e9ea713dd3)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:05:35.764630 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5e283658-cc8e-40f9-af26-9a9ccee07a7f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:35.776854 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-5e283658-cc8e-40f9-af26-9a9ccee07a7f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Calling delete_port for f19da394-f686-40f7-890e-11ac9d902c14 owned by network:router_interface {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:05:36.088537 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5e283658-cc8e-40f9-af26-9a9ccee07a7f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:36.116416 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e283658-cc8e-40f9-af26-9a9ccee07a7f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event deleted for resources: {'Port': ['ID=f19da394-f686-40f7-890e-11ac9d902c14,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:05:36.298849 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-5e283658-cc8e-40f9-af26-9a9ccee07a7f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:36.504542 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5e283658-cc8e-40f9-af26-9a9ccee07a7f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Router 4b35f811-d243-43fb-b6b0-2ebfa884259d has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 05:05:36.612319 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5e283658-cc8e-40f9-af26-9a9ccee07a7f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 05:05:36.618903 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-5e283658-cc8e-40f9-af26-9a9ccee07a7f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "PUT /v2.0/routers/4b35f811-d243-43fb-b6b0-2ebfa884259d/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5319316 Nov 09 05:05:36.620090 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 37010) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:05:36.622377 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-57a60800-87b9-471b-b26e-a3fcd983828d None None] Sync routers for ids ['4b35f811-d243-43fb-b6b0-2ebfa884259d'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 05:05:36.632275 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-57a60800-87b9-471b-b26e-a3fcd983828d None None] Routers {'4b35f811-d243-43fb-b6b0-2ebfa884259d'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:05:36.632896 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-57a60800-87b9-471b-b26e-a3fcd983828d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:05:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['4b35f811-d243-43fb-b6b0-2ebfa884259d'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:05:36.675159 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-e5ea1e68-45cb-4ae7-ae21-0af9792ce225 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Deleting subnet 4ab2834b-d379-46c6-93c2-dabc443d001d {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 05:05:36.678267 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e5ea1e68-45cb-4ae7-ae21-0af9792ce225 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:36.717938 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e5ea1e68-45cb-4ae7-ae21-0af9792ce225 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:36.746586 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-57a60800-87b9-471b-b26e-a3fcd983828d None None] Set router 4b35f811-d243-43fb-b6b0-2ebfa884259d gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:05:36.798642 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e5ea1e68-45cb-4ae7-ae21-0af9792ce225 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:36.911974 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e5ea1e68-45cb-4ae7-ae21-0af9792ce225 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:36.930968 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-57a60800-87b9-471b-b26e-a3fcd983828d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4b35f811-d243-43fb-b6b0-2ebfa884259d', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1648817839', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.213'}], 'enable_snat': True}, 'gw_port_id': 'f0aedb4e-bdd3-4b77-b881-acdf25762d73', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:03:57Z', 'updated_at': '2021-11-09T05:05:35Z', 'revision_number': 5, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': 'f0aedb4e-bdd3-4b77-b881-acdf25762d73', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:1d:52:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b35f811-d243-43fb-b6b0-2ebfa884259d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1729, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:03:58Z', 'updated_at': '2021-11-09T05:04:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:05:36.940338 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5ea1e68-45cb-4ae7-ae21-0af9792ce225 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event deleted for resources: {'Subnet': ['ID=4ab2834b-d379-46c6-93c2-dabc443d001d,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:05:36.944490 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e5ea1e68-45cb-4ae7-ae21-0af9792ce225 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:36.947705 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-e5ea1e68-45cb-4ae7-ae21-0af9792ce225 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "DELETE /v2.0/subnets/4ab2834b-d379-46c6-93c2-dabc443d001d HTTP/1.1" status: 204 len: 168 time: 0.3264918 Nov 09 05:05:36.951993 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 37012) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:05:36.953196 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2fd30807-3480-422c-986d-206493f5de81 None None] Network 7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 05:05:36.961032 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-57a60800-87b9-471b-b26e-a3fcd983828d None None] Checking router: 4b35f811-d243-43fb-b6b0-2ebfa884259d for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 05:05:36.969877 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-57a60800-87b9-471b-b26e-a3fcd983828d None None] Routers {'4b35f811-d243-43fb-b6b0-2ebfa884259d'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:05:36.970629 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-57a60800-87b9-471b-b26e-a3fcd983828d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:05:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['4b35f811-d243-43fb-b6b0-2ebfa884259d'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:05:37.019415 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device f4f26d5e-838f-4398-acda-1c9fb08b903b no longer exists at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 05:05:37.061783 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c1816eb7-6228-4fb0-9ae0-b187fc47a14a tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for router, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:37.062296 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] No Port match for: f4f26d5e-838f-4398-acda-1c9fb08b903b {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 05:05:37.062910 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device f4f26d5e-838f-4398-acda-1c9fb08b903b not bound to the agent host hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 05:05:37.079064 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-57a60800-87b9-471b-b26e-a3fcd983828d None None] Set router 4b35f811-d243-43fb-b6b0-2ebfa884259d gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:05:37.164267 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-07ef899c-551f-4b2c-bcc9-631d0395a1af None None] DHCP port deletion for 7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3 request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 05:05:37.169506 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c1816eb7-6228-4fb0-9ae0-b187fc47a14a tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for router_gateway, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:37.212076 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-07ef899c-551f-4b2c-bcc9-631d0395a1af None None] Deleting port 8e5aa90c-5cfb-4e47-a577-e3d2e8c4eccc {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:05:37.212530 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-07ef899c-551f-4b2c-bcc9-631d0395a1af None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:37.261360 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-57a60800-87b9-471b-b26e-a3fcd983828d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4b35f811-d243-43fb-b6b0-2ebfa884259d', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1648817839', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.213'}], 'enable_snat': True}, 'gw_port_id': 'f0aedb4e-bdd3-4b77-b881-acdf25762d73', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:03:57Z', 'updated_at': '2021-11-09T05:05:35Z', 'revision_number': 5, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': 'f0aedb4e-bdd3-4b77-b881-acdf25762d73', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:1d:52:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b35f811-d243-43fb-b6b0-2ebfa884259d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1729, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:03:58Z', 'updated_at': '2021-11-09T05:04:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:05:37.281593 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-07ef899c-551f-4b2c-bcc9-631d0395a1af None None] For port 8e5aa90c-5cfb-4e47-a577-e3d2e8c4eccc, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=8e5aa90c-5cfb-4e47-a577-e3d2e8c4eccc,segment=NetworkSegment(d82b4232-13d0-4050-bf58-c5e9ea713dd3),segment_id=d82b4232-13d0-4050-bf58-c5e9ea713dd3)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:05:37.282554 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-07ef899c-551f-4b2c-bcc9-631d0395a1af None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:37.290330 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-c1816eb7-6228-4fb0-9ae0-b187fc47a14a tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Deleting port f0aedb4e-bdd3-4b77-b881-acdf25762d73 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:05:37.290700 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c1816eb7-6228-4fb0-9ae0-b187fc47a14a tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:37.293319 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-57a60800-87b9-471b-b26e-a3fcd983828d None None] The sync data for ids ['4b35f811-d243-43fb-b6b0-2ebfa884259d'] in dv-neutron-816802-2-hyperv is: [{'id': '4b35f811-d243-43fb-b6b0-2ebfa884259d', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1648817839', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.213'}], 'enable_snat': True}, 'gw_port_id': 'f0aedb4e-bdd3-4b77-b881-acdf25762d73', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:03:57Z', 'updated_at': '2021-11-09T05:05:35Z', 'revision_number': 5, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': 'f0aedb4e-bdd3-4b77-b881-acdf25762d73', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:1d:52:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b35f811-d243-43fb-b6b0-2ebfa884259d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1729, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:03:58Z', 'updated_at': '2021-11-09T05:04:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 05:05:37.302703 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-07ef899c-551f-4b2c-bcc9-631d0395a1af None None] Calling delete_port for 8e5aa90c-5cfb-4e47-a577-e3d2e8c4eccc owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:05:37.381780 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-c1816eb7-6228-4fb0-9ae0-b187fc47a14a tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] For port f0aedb4e-bdd3-4b77-b881-acdf25762d73, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=f0aedb4e-bdd3-4b77-b881-acdf25762d73,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:05:37.382139 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c1816eb7-6228-4fb0-9ae0-b187fc47a14a tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:37.401180 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-c1816eb7-6228-4fb0-9ae0-b187fc47a14a tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Calling delete_port for f0aedb4e-bdd3-4b77-b881-acdf25762d73 owned by network:router_gateway {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:05:37.478473 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-07ef899c-551f-4b2c-bcc9-631d0395a1af None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:37.509213 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07ef899c-551f-4b2c-bcc9-631d0395a1af None None] Pushing event deleted for resources: {'Port': ['ID=8e5aa90c-5cfb-4e47-a577-e3d2e8c4eccc,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:05:37.517807 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-07ef899c-551f-4b2c-bcc9-631d0395a1af None None] No DVR routers for this DVR port 8e5aa90c-5cfb-4e47-a577-e3d2e8c4eccc on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 05:05:37.519870 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07ef899c-551f-4b2c-bcc9-631d0395a1af None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:05:37.520209 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07ef899c-551f-4b2c-bcc9-631d0395a1af None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:05:37.520537 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07ef899c-551f-4b2c-bcc9-631d0395a1af None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:05:37.520862 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07ef899c-551f-4b2c-bcc9-631d0395a1af None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:05:37.521187 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07ef899c-551f-4b2c-bcc9-631d0395a1af None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:05:37.521542 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07ef899c-551f-4b2c-bcc9-631d0395a1af None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:05:37.521994 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07ef899c-551f-4b2c-bcc9-631d0395a1af None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:05:37.522210 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07ef899c-551f-4b2c-bcc9-631d0395a1af None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:05:37.522589 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07ef899c-551f-4b2c-bcc9-631d0395a1af None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:05:37.522966 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07ef899c-551f-4b2c-bcc9-631d0395a1af None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:05:37.523286 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07ef899c-551f-4b2c-bcc9-631d0395a1af None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:05:37.523658 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07ef899c-551f-4b2c-bcc9-631d0395a1af None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:05:37.621525 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c1816eb7-6228-4fb0-9ae0-b187fc47a14a tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:37.652796 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1816eb7-6228-4fb0-9ae0-b187fc47a14a tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event deleted for resources: {'Port': ['ID=f0aedb4e-bdd3-4b77-b881-acdf25762d73,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:05:37.716526 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c1816eb7-6228-4fb0-9ae0-b187fc47a14a tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-466373'] for router_gateway, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:37.809667 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c1816eb7-6228-4fb0-9ae0-b187fc47a14a tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:37.811801 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c1816eb7-6228-4fb0-9ae0-b187fc47a14a tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:37.912283 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c1816eb7-6228-4fb0-9ae0-b187fc47a14a tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:37.912819 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c1816eb7-6228-4fb0-9ae0-b187fc47a14a tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Fanout notify agent at l3_agent the message router_deleted on router 4b35f811-d243-43fb-b6b0-2ebfa884259d {{(pid=102161) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 05:05:37.919618 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c1816eb7-6228-4fb0-9ae0-b187fc47a14a tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:37.923227 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-c1816eb7-6228-4fb0-9ae0-b187fc47a14a tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "DELETE /v2.0/routers/4b35f811-d243-43fb-b6b0-2ebfa884259d HTTP/1.1" status: 204 len: 168 time: 0.9675624 Nov 09 05:05:37.923463 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 37014) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:05:38.007078 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cbe5e729-5c8b-4d04-8f39-553574d4b562 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:38.100017 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cbe5e729-5c8b-4d04-8f39-553574d4b562 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:38.120027 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-cbe5e729-5c8b-4d04-8f39-553574d4b562 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:05:38.129588 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-cbe5e729-5c8b-4d04-8f39-553574d4b562 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd82b4232-13d0-4050-bf58-c5e9ea713dd3') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:05:38.129889 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-cbe5e729-5c8b-4d04-8f39-553574d4b562 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd82b4232-13d0-4050-bf58-c5e9ea713dd3') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:05:38.139162 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cbe5e729-5c8b-4d04-8f39-553574d4b562 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:38.151680 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cbe5e729-5c8b-4d04-8f39-553574d4b562 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:38.157374 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-cbe5e729-5c8b-4d04-8f39-553574d4b562 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Releasing vlan 344 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 05:05:38.157757 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cbe5e729-5c8b-4d04-8f39-553574d4b562 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:38.160672 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 05:05:38.160672 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 05:05:38.160672 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 05:05:38.160672 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 05:05:38.160672 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 05:05:38.160672 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 05:05:38.160672 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 05:05:38.160672 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 05:05:38.160672 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 05:05:38.160672 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 05:05:38.160672 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 05:05:38.160672 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 05:05:38.160672 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 05:05:38.160672 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 05:05:38.160672 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 05:05:38.160672 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 05:05:38.160672 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 05:05:38.160672 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 05:05:38.160672 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 05:05:38.160672 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 05:05:38.160672 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 05:05:38.160672 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 05:05:38.160672 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 05:05:38.160672 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 05:05:38.160672 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 05:05:38.160672 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 05:05:38.160672 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 05:05:38.160672 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 05:05:38.160672 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 05:05:38.160672 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 05:05:38.160672 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 05:05:38.160672 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 05:05:38.266650 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cbe5e729-5c8b-4d04-8f39-553574d4b562 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:38.273777 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cbe5e729-5c8b-4d04-8f39-553574d4b562 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:38.276288 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-cbe5e729-5c8b-4d04-8f39-553574d4b562 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "DELETE /v2.0/networks/7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3 HTTP/1.1" status: 204 len: 168 time: 0.3518989 Nov 09 05:05:38.279097 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 37016) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:05:38.287226 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbe5e729-5c8b-4d04-8f39-553574d4b562 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event deleted for resources: {'Network': ['ID=7b0e6ea8-a2ea-4111-8c85-5d69c963f6d3,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:05:38.348323 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6b8ee044-e4ac-40c8-bb2e-7b0d07bc3cb6 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:38.374055 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device f19da394-f686-40f7-890e-11ac9d902c14 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 05:05:38.377739 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6b8ee044-e4ac-40c8-bb2e-7b0d07bc3cb6 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:38.397776 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: f19da394-f686-40f7-890e-11ac9d902c14 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 05:05:38.398044 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device f19da394-f686-40f7-890e-11ac9d902c14 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 05:05:38.398487 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 8e5aa90c-5cfb-4e47-a577-e3d2e8c4eccc no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 05:05:38.416504 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 8e5aa90c-5cfb-4e47-a577-e3d2e8c4eccc {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 05:05:38.416842 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 8e5aa90c-5cfb-4e47-a577-e3d2e8c4eccc not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 05:05:38.417251 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device f0aedb4e-bdd3-4b77-b881-acdf25762d73 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 05:05:38.435736 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: f0aedb4e-bdd3-4b77-b881-acdf25762d73 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 05:05:38.436077 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device f0aedb4e-bdd3-4b77-b881-acdf25762d73 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 05:05:38.495809 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6b8ee044-e4ac-40c8-bb2e-7b0d07bc3cb6 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:38.498537 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6b8ee044-e4ac-40c8-bb2e-7b0d07bc3cb6 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:38.499697 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-6b8ee044-e4ac-40c8-bb2e-7b0d07bc3cb6 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "DELETE /v2.0/security-groups/1cf96a5c-2f90-45b2-850e-3b6b8d385bbd HTTP/1.1" status: 204 len: 168 time: 0.2196248 Nov 09 05:05:38.509343 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b8ee044-e4ac-40c8-bb2e-7b0d07bc3cb6 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=1cf96a5c-2f90-45b2-850e-3b6b8d385bbd,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:05:38.825654 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 37022) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:05:38.830776 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-e90c7e8f-a547-449b-a9c8-5d8b36757d66 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-91458487', 'description': 'tempest-secgroup-smoke-91458487 description', 'project_id': '8ac3eab68bd34485af7ddc3417853b28'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:05:38.906851 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e90c7e8f-a547-449b-a9c8-5d8b36757d66 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:38.971346 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e90c7e8f-a547-449b-a9c8-5d8b36757d66 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:39.032810 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e90c7e8f-a547-449b-a9c8-5d8b36757d66 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:39.060392 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e90c7e8f-a547-449b-a9c8-5d8b36757d66 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'SecurityGroup': ['ID=a10dfbe7-94bf-4308-8c2b-b051bc84e309,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:05:39.114189 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e90c7e8f-a547-449b-a9c8-5d8b36757d66 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:39.115438 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e90c7e8f-a547-449b-a9c8-5d8b36757d66 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1809 time: 0.2888017 Nov 09 05:05:39.118534 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 37024) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:05:39.122767 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-461e7a4a-be42-470a-a778-7adedc6bda17 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'security_group_rule': {'security_group_id': 'a10dfbe7-94bf-4308-8c2b-b051bc84e309', 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:05:39.213952 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-461e7a4a-be42-470a-a778-7adedc6bda17 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:39.267764 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-461e7a4a-be42-470a-a778-7adedc6bda17 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:39.346975 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-461e7a4a-be42-470a-a778-7adedc6bda17 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:39.366960 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-461e7a4a-be42-470a-a778-7adedc6bda17 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d8b4b22a-8a5f-4328-be28-dc2ec883df02,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:05:39.417534 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-461e7a4a-be42-470a-a778-7adedc6bda17 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:39.418731 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-461e7a4a-be42-470a-a778-7adedc6bda17 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2992828 Nov 09 05:05:39.421530 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 37026) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:05:39.425747 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-537fca20-8547-47fd-91ad-c308d79ea827 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'security_group_rule': {'security_group_id': 'a10dfbe7-94bf-4308-8c2b-b051bc84e309', 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:05:39.493793 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-537fca20-8547-47fd-91ad-c308d79ea827 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:39.547444 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-537fca20-8547-47fd-91ad-c308d79ea827 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:39.586887 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-537fca20-8547-47fd-91ad-c308d79ea827 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:39.601186 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-537fca20-8547-47fd-91ad-c308d79ea827 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6f411509-4fe6-4d6e-8ffe-952c5b26b0ba,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:05:39.663214 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-537fca20-8547-47fd-91ad-c308d79ea827 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:39.664417 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-537fca20-8547-47fd-91ad-c308d79ea827 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.2419937 Nov 09 05:05:39.667178 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 37028) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:05:39.671405 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-0aa7828d-0998-4851-b93d-a80e3c1d82cf tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'security_group_rule': {'security_group_id': 'a10dfbe7-94bf-4308-8c2b-b051bc84e309', 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:05:39.767523 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0aa7828d-0998-4851-b93d-a80e3c1d82cf tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:39.822746 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0aa7828d-0998-4851-b93d-a80e3c1d82cf tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:39.888614 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0aa7828d-0998-4851-b93d-a80e3c1d82cf tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:39.905574 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0aa7828d-0998-4851-b93d-a80e3c1d82cf tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=216c4bde-357c-44b4-8ed9-efe0c98f3d63,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:05:39.982670 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0aa7828d-0998-4851-b93d-a80e3c1d82cf tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:39.983889 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-0aa7828d-0998-4851-b93d-a80e3c1d82cf tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3157997 Nov 09 05:05:39.987179 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 37030) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:05:39.991427 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-f0c8f126-4627-45b2-9032-89ef4ddf1be8 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'security_group_rule': {'security_group_id': 'a10dfbe7-94bf-4308-8c2b-b051bc84e309', 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:05:40.070485 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f0c8f126-4627-45b2-9032-89ef4ddf1be8 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:40.125733 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f0c8f126-4627-45b2-9032-89ef4ddf1be8 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:40.227050 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f0c8f126-4627-45b2-9032-89ef4ddf1be8 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:40.245974 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0c8f126-4627-45b2-9032-89ef4ddf1be8 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6bfeaf0f-8aa9-4a57-91a4-dee5982217ec,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:05:40.308044 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f0c8f126-4627-45b2-9032-89ef4ddf1be8 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:40.309251 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-f0c8f126-4627-45b2-9032-89ef4ddf1be8 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3211458 Nov 09 05:05:40.312061 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 37032) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:05:40.316343 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-4129f952-e2f6-4eb7-a3cb-72401762d003 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'security_group_rule': {'security_group_id': 'a10dfbe7-94bf-4308-8c2b-b051bc84e309', 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:05:40.414580 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.securitygroups_db [None req-4129f952-e2f6-4eb7-a3cb-72401762d003 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Project 8ac3eab68bd34485af7ddc3417853b28 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 09 05:05:40.419383 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4129f952-e2f6-4eb7-a3cb-72401762d003 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:40.477935 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4129f952-e2f6-4eb7-a3cb-72401762d003 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:40.546709 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4129f952-e2f6-4eb7-a3cb-72401762d003 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:40.565349 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4129f952-e2f6-4eb7-a3cb-72401762d003 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=795ba228-fe2a-4cbf-87ff-f0a1318f5567,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:05:40.639916 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4129f952-e2f6-4eb7-a3cb-72401762d003 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:40.641326 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-4129f952-e2f6-4eb7-a3cb-72401762d003 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.3281548 Nov 09 05:05:40.644306 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 37034) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:05:40.648604 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-68407721-ff7b-46ff-ba42-4593a269584f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'security_group_rule': {'security_group_id': 'a10dfbe7-94bf-4308-8c2b-b051bc84e309', 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:05:40.758203 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.securitygroups_db [None req-68407721-ff7b-46ff-ba42-4593a269584f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Project 8ac3eab68bd34485af7ddc3417853b28 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 09 05:05:40.763169 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-68407721-ff7b-46ff-ba42-4593a269584f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:40.820058 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-68407721-ff7b-46ff-ba42-4593a269584f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:40.896029 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-68407721-ff7b-46ff-ba42-4593a269584f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:40.913560 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68407721-ff7b-46ff-ba42-4593a269584f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=bab8aedb-6cd1-4213-8dd1-bd58558635c8,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:05:41.000596 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-68407721-ff7b-46ff-ba42-4593a269584f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:41.001802 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-68407721-ff7b-46ff-ba42-4593a269584f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.3565636 Nov 09 05:05:41.005100 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 37036) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:05:41.009957 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-f5845ba0-f20e-4dc6-ab02-19400f32d5a5 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'network': {'name': 'tempest-network-smoke--961208696', 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'port_security_enabled': True}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:05:41.101190 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f5845ba0-f20e-4dc6-ab02-19400f32d5a5 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Made reservation on behalf of 8ac3eab68bd34485af7ddc3417853b28 for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 05:05:41.104585 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f5845ba0-f20e-4dc6-ab02-19400f32d5a5 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:41.126941 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f5845ba0-f20e-4dc6-ab02-19400f32d5a5 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 304} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 05:05:41.135698 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f5845ba0-f20e-4dc6-ab02-19400f32d5a5 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:41.136038 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-f5845ba0-f20e-4dc6-ab02-19400f32d5a5 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Added segment 04920539-e2ad-49d5-b0a6-718337b9e8b0 of type vlan for network 16dfc543-c13b-401a-892d-806436f2c384 Nov 09 05:05:41.173109 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f5845ba0-f20e-4dc6-ab02-19400f32d5a5 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:41.255576 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f5845ba0-f20e-4dc6-ab02-19400f32d5a5 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:41.261052 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f5845ba0-f20e-4dc6-ab02-19400f32d5a5 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:05:41.261600 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f5845ba0-f20e-4dc6-ab02-19400f32d5a5 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:41.325563 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5845ba0-f20e-4dc6-ab02-19400f32d5a5 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'Network': ['ID=16dfc543-c13b-401a-892d-806436f2c384,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:05:41.335642 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 16dfc543-c13b-401a-892d-806436f2c384 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 05:05:41.367184 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-f5845ba0-f20e-4dc6-ab02-19400f32d5a5 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.3610749 Nov 09 05:05:41.369931 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 37038) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:05:41.374470 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-f5210033-8b26-4898-af87-96a307dcfada tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'router': {'name': 'tempest-TestNetworkAdvancedServerOps-router-1210987163', 'admin_state_up': True, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:05:41.410473 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-28728c99-378d-4958-9862-53cb76d0405e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:41.467565 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f5210033-8b26-4898-af87-96a307dcfada tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:41.468652 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f5210033-8b26-4898-af87-96a307dcfada tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:41.520437 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f5210033-8b26-4898-af87-96a307dcfada tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:41.691618 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f5210033-8b26-4898-af87-96a307dcfada tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:41.926206 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f5210033-8b26-4898-af87-96a307dcfada tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for router_gateway, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:41.944490 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f5210033-8b26-4898-af87-96a307dcfada tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:42.042639 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-f5210033-8b26-4898-af87-96a307dcfada tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Allocated IP 172.26.0.120 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/6777983c-53b7-4614-a4e7-3ad9e839bfeb) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 05:05:42.142709 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f5210033-8b26-4898-af87-96a307dcfada tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:42.215826 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f5210033-8b26-4898-af87-96a307dcfada tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:42.256196 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f5210033-8b26-4898-af87-96a307dcfada tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:05:42.261272 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-f5210033-8b26-4898-af87-96a307dcfada tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:05:42.264913 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f5210033-8b26-4898-af87-96a307dcfada tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 05:05:42.271136 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5210033-8b26-4898-af87-96a307dcfada tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'Port': ['ID=6777983c-53b7-4614-a4e7-3ad9e839bfeb,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:05:42.462037 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:42.644566 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f5210033-8b26-4898-af87-96a307dcfada tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for router_gateway, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:43.134933 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f5210033-8b26-4898-af87-96a307dcfada tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:43.323852 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f5210033-8b26-4898-af87-96a307dcfada tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Router d4c935be-c982-4fcb-af39-2fc3ae9f8314 is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102162) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 05:05:43.426783 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f5210033-8b26-4898-af87-96a307dcfada tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 05:05:43.436492 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4c45c441-9c59-41ff-b149-c32c51fd3408 None None] Sync routers for ids ['d4c935be-c982-4fcb-af39-2fc3ae9f8314'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 05:05:43.446903 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4c45c441-9c59-41ff-b149-c32c51fd3408 None None] Routers {'d4c935be-c982-4fcb-af39-2fc3ae9f8314'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:05:43.453485 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-4c45c441-9c59-41ff-b149-c32c51fd3408 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:05:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['d4c935be-c982-4fcb-af39-2fc3ae9f8314'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:05:43.515040 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f5210033-8b26-4898-af87-96a307dcfada tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:43.516287 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-f5210033-8b26-4898-af87-96a307dcfada tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 896 time: 2.1453564 Nov 09 05:05:43.519540 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 37040) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:05:43.548127 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-2478f600-a102-4fde-a712-96223d09c2d7 tempest-TestNetworkAdvancedServerOps-1212315804 tempest-TestNetworkAdvancedServerOps-1212315804-project-admin] 10.222.0.24 "GET /v2.0/subnets?project_id=8ac3eab68bd34485af7ddc3417853b28&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0268641 Nov 09 05:05:43.549559 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-4c45c441-9c59-41ff-b149-c32c51fd3408 None None] Set router d4c935be-c982-4fcb-af39-2fc3ae9f8314 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:05:43.550688 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 37042) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:05:43.640465 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4f9adf0c-b0d6-4cdf-b054-86617d28aca8 tempest-TestNetworkAdvancedServerOps-1212315804 tempest-TestNetworkAdvancedServerOps-1212315804-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:05:43.641970 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-4f9adf0c-b0d6-4cdf-b054-86617d28aca8 tempest-TestNetworkAdvancedServerOps-1212315804 tempest-TestNetworkAdvancedServerOps-1212315804-project-admin] 10.222.0.24 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.0902264 Nov 09 05:05:43.644752 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 37044) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:05:43.671773 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a0918033-6764-469c-8e9f-e4d079e2f28f tempest-TestNetworkAdvancedServerOps-1212315804 tempest-TestNetworkAdvancedServerOps-1212315804-project-admin] 10.222.0.24 "GET /v2.0/subnets?network_id=2b6725f5-ebfe-485a-8f42-ccb5a241ddb5&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0254753 Nov 09 05:05:43.674457 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 37046) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:05:43.679377 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-8889d008-f7dd-46ae-aae4-690b55aa41f7 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-1384805771', 'network_id': '16dfc543-c13b-401a-892d-806436f2c384', 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:05:43.725192 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-23e5361f-eb2e-4ded-9843-b7bc79ed1bc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:43.744457 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-4c45c441-9c59-41ff-b149-c32c51fd3408 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd4c935be-c982-4fcb-af39-2fc3ae9f8314', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1210987163', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.120'}], 'enable_snat': True}, 'gw_port_id': '6777983c-53b7-4614-a4e7-3ad9e839bfeb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:05:41Z', 'updated_at': '2021-11-09T05:05:42Z', 'revision_number': 3, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': '6777983c-53b7-4614-a4e7-3ad9e839bfeb', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:07:ee', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd4c935be-c982-4fcb-af39-2fc3ae9f8314', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1748, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:05:41Z', 'updated_at': '2021-11-09T05:05:42Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:05:43.771144 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4c45c441-9c59-41ff-b149-c32c51fd3408 None None] Checking router: d4c935be-c982-4fcb-af39-2fc3ae9f8314 for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 05:05:43.771476 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4c45c441-9c59-41ff-b149-c32c51fd3408 None None] Updating router d4c935be-c982-4fcb-af39-2fc3ae9f8314 port 6777983c-53b7-4614-a4e7-3ad9e839bfeb binding host dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 05:05:43.794864 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4c45c441-9c59-41ff-b149-c32c51fd3408 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:43.827647 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8889d008-f7dd-46ae-aae4-690b55aa41f7 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Made reservation on behalf of 8ac3eab68bd34485af7ddc3417853b28 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 05:05:43.831208 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8889d008-f7dd-46ae-aae4-690b55aa41f7 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:44.041299 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4c45c441-9c59-41ff-b149-c32c51fd3408 None None] Publish callbacks [] for port, precommit_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:44.085137 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8889d008-f7dd-46ae-aae4-690b55aa41f7 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:44.114005 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4c45c441-9c59-41ff-b149-c32c51fd3408 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:44.150686 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8889d008-f7dd-46ae-aae4-690b55aa41f7 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'Subnet': ['ID=3735bbb3-0479-4b6b-8df7-645fb895c926,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:05:44.152698 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8889d008-f7dd-46ae-aae4-690b55aa41f7 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Checking segment: {'id': '04920539-e2ad-49d5-b0a6-718337b9e8b0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 304, 'network_id': '16dfc543-c13b-401a-892d-806436f2c384'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 05:05:44.153062 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8889d008-f7dd-46ae-aae4-690b55aa41f7 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Network hostable DHCP agents. Network: 16dfc543-c13b-401a-892d-806436f2c384, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 05:05:44.164436 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-4c45c441-9c59-41ff-b149-c32c51fd3408 None None] Attempting to bind port 6777983c-53b7-4614-a4e7-3ad9e839bfeb on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 05:05:44.164797 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-4c45c441-9c59-41ff-b149-c32c51fd3408 None None] Attempting to bind port 6777983c-53b7-4614-a4e7-3ad9e839bfeb by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 05:05:44.165154 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c45c441-9c59-41ff-b149-c32c51fd3408 None None] Attempting to bind port 6777983c-53b7-4614-a4e7-3ad9e839bfeb on network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 05:05:44.172028 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a86411f9-b45d-48a3-883f-cf272b4cc05e None None] Pushing event updated for resources: {'Port': ['ID=6777983c-53b7-4614-a4e7-3ad9e839bfeb,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:05:44.176615 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c45c441-9c59-41ff-b149-c32c51fd3408 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 5, 5, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 05:05:44.176850 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c45c441-9c59-41ff-b149-c32c51fd3408 None None] Checking segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 05:05:44.177236 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4c45c441-9c59-41ff-b149-c32c51fd3408 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:44.177607 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c45c441-9c59-41ff-b149-c32c51fd3408 None None] Bound using segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 05:05:44.178063 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-4c45c441-9c59-41ff-b149-c32c51fd3408 None None] Bound port: 6777983c-53b7-4614-a4e7-3ad9e839bfeb, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 05:05:44.178452 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4c45c441-9c59-41ff-b149-c32c51fd3408 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:44.227529 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-4c45c441-9c59-41ff-b149-c32c51fd3408 None None] For port 6777983c-53b7-4614-a4e7-3ad9e839bfeb, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 05:05:44.230491 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-4c45c441-9c59-41ff-b149-c32c51fd3408 None None] For port 6777983c-53b7-4614-a4e7-3ad9e839bfeb, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=6777983c-53b7-4614-a4e7-3ad9e839bfeb,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 05:05:44.245109 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8889d008-f7dd-46ae-aae4-690b55aa41f7 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Network 16dfc543-c13b-401a-892d-806436f2c384 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 05:05:44.296854 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4c45c441-9c59-41ff-b149-c32c51fd3408 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:44.324619 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-8889d008-f7dd-46ae-aae4-690b55aa41f7 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 16dfc543-c13b-401a-892d-806436f2c384) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:05:44.329115 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8889d008-f7dd-46ae-aae4-690b55aa41f7 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:05:44.329740 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8889d008-f7dd-46ae-aae4-690b55aa41f7 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:44.340981 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-de3ec25d-4da3-468f-bc30-3af3e2ba4e7b None None] Network 16dfc543-c13b-401a-892d-806436f2c384 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 05:05:44.402164 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4c45c441-9c59-41ff-b149-c32c51fd3408 None None] Routers {'d4c935be-c982-4fcb-af39-2fc3ae9f8314'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:05:44.402816 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-4c45c441-9c59-41ff-b149-c32c51fd3408 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:05:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['d4c935be-c982-4fcb-af39-2fc3ae9f8314'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:05:44.404543 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a86411f9-b45d-48a3-883f-cf272b4cc05e None None] Pushing event updated for resources: {'Port': ['ID=6777983c-53b7-4614-a4e7-3ad9e839bfeb,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:05:44.408722 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-8889d008-f7dd-46ae-aae4-690b55aa41f7 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 832 time: 0.7327309 Nov 09 05:05:44.411455 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 37048) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:05:44.704078 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-4c45c441-9c59-41ff-b149-c32c51fd3408 None None] Set router d4c935be-c982-4fcb-af39-2fc3ae9f8314 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:05:44.824052 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-df1db5f7-0e25-4628-8091-f542c70ec948 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-16dfc543-c13b-401a-892d-806436f2c384', 'network_id': '16dfc543-c13b-401a-892d-806436f2c384', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'fixed_ips': [{'subnet_id': '3735bbb3-0479-4b6b-8df7-645fb895c926'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 05:05:44.824894 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-df1db5f7-0e25-4628-8091-f542c70ec948 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:44.844481 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e284f4f9-03cf-491d-a186-7bea04cfb8ff tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:45.010513 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-df1db5f7-0e25-4628-8091-f542c70ec948 None None] Allocated IP 172.20.0.2 (16dfc543-c13b-401a-892d-806436f2c384/3735bbb3-0479-4b6b-8df7-645fb895c926/9fce31a6-0e9b-4e31-9c48-25ee625d9dd4) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 05:05:45.022970 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-4c45c441-9c59-41ff-b149-c32c51fd3408 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd4c935be-c982-4fcb-af39-2fc3ae9f8314', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1210987163', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.120'}], 'enable_snat': True}, 'gw_port_id': '6777983c-53b7-4614-a4e7-3ad9e839bfeb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:05:41Z', 'updated_at': '2021-11-09T05:05:42Z', 'revision_number': 3, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': '6777983c-53b7-4614-a4e7-3ad9e839bfeb', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:07:ee', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd4c935be-c982-4fcb-af39-2fc3ae9f8314', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1748, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:05:41Z', 'updated_at': '2021-11-09T05:05:44Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:05:45.052801 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4c45c441-9c59-41ff-b149-c32c51fd3408 None None] The sync data for ids ['d4c935be-c982-4fcb-af39-2fc3ae9f8314'] in dv-neutron-816802-2-hyperv is: [{'id': 'd4c935be-c982-4fcb-af39-2fc3ae9f8314', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1210987163', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.120'}], 'enable_snat': True}, 'gw_port_id': '6777983c-53b7-4614-a4e7-3ad9e839bfeb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:05:41Z', 'updated_at': '2021-11-09T05:05:42Z', 'revision_number': 3, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': '6777983c-53b7-4614-a4e7-3ad9e839bfeb', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:07:ee', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd4c935be-c982-4fcb-af39-2fc3ae9f8314', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1748, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:05:41Z', 'updated_at': '2021-11-09T05:05:44Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 05:05:45.197233 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-df1db5f7-0e25-4628-8091-f542c70ec948 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:45.244976 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:45.295947 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-df1db5f7-0e25-4628-8091-f542c70ec948 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:45.320116 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-df1db5f7-0e25-4628-8091-f542c70ec948 None None] Network 16dfc543-c13b-401a-892d-806436f2c384 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:05:45.327341 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-df1db5f7-0e25-4628-8091-f542c70ec948 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:05:45.332167 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-e284f4f9-03cf-491d-a186-7bea04cfb8ff tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Allocated IP 172.20.0.1 (16dfc543-c13b-401a-892d-806436f2c384/3735bbb3-0479-4b6b-8df7-645fb895c926/6d945935-f6f2-44ff-8105-51e1ec0f31f1) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 05:05:45.335029 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-df1db5f7-0e25-4628-8091-f542c70ec948 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 05:05:45.340763 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df1db5f7-0e25-4628-8091-f542c70ec948 None None] Pushing event updated for resources: {'Port': ['ID=9fce31a6-0e9b-4e31-9c48-25ee625d9dd4,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:05:45.399695 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-df1db5f7-0e25-4628-8091-f542c70ec948 None None] Attempting to bind port 9fce31a6-0e9b-4e31-9c48-25ee625d9dd4 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 05:05:45.400056 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-df1db5f7-0e25-4628-8091-f542c70ec948 None None] Attempting to bind port 9fce31a6-0e9b-4e31-9c48-25ee625d9dd4 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '04920539-e2ad-49d5-b0a6-718337b9e8b0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 304, 'network_id': '16dfc543-c13b-401a-892d-806436f2c384'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 05:05:45.400417 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-df1db5f7-0e25-4628-8091-f542c70ec948 None None] Attempting to bind port 9fce31a6-0e9b-4e31-9c48-25ee625d9dd4 on network 16dfc543-c13b-401a-892d-806436f2c384 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 05:05:45.405886 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-df1db5f7-0e25-4628-8091-f542c70ec948 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 5, 5, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 05:05:45.406251 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-df1db5f7-0e25-4628-8091-f542c70ec948 None None] Checking segment: {'id': '04920539-e2ad-49d5-b0a6-718337b9e8b0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 304, 'network_id': '16dfc543-c13b-401a-892d-806436f2c384'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 05:05:45.406679 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-df1db5f7-0e25-4628-8091-f542c70ec948 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:45.407063 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-df1db5f7-0e25-4628-8091-f542c70ec948 None None] Bound using segment: {'id': '04920539-e2ad-49d5-b0a6-718337b9e8b0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 304, 'network_id': '16dfc543-c13b-401a-892d-806436f2c384'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 05:05:45.407527 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-df1db5f7-0e25-4628-8091-f542c70ec948 None None] Bound port: 9fce31a6-0e9b-4e31-9c48-25ee625d9dd4, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '04920539-e2ad-49d5-b0a6-718337b9e8b0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 304, 'network_id': '16dfc543-c13b-401a-892d-806436f2c384'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 05:05:45.407898 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-df1db5f7-0e25-4628-8091-f542c70ec948 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:45.467120 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e284f4f9-03cf-491d-a186-7bea04cfb8ff tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:45.481590 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-df1db5f7-0e25-4628-8091-f542c70ec948 None None] For port 9fce31a6-0e9b-4e31-9c48-25ee625d9dd4, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 05:05:45.484701 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-df1db5f7-0e25-4628-8091-f542c70ec948 None None] For port 9fce31a6-0e9b-4e31-9c48-25ee625d9dd4, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=9fce31a6-0e9b-4e31-9c48-25ee625d9dd4,segment=NetworkSegment(04920539-e2ad-49d5-b0a6-718337b9e8b0),segment_id=04920539-e2ad-49d5-b0a6-718337b9e8b0)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 05:05:45.542993 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-df1db5f7-0e25-4628-8091-f542c70ec948 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:45.565680 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e284f4f9-03cf-491d-a186-7bea04cfb8ff tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:45.610612 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df1db5f7-0e25-4628-8091-f542c70ec948 None None] Pushing event updated for resources: {'Port': ['ID=9fce31a6-0e9b-4e31-9c48-25ee625d9dd4,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:05:45.617054 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e284f4f9-03cf-491d-a186-7bea04cfb8ff tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Network 16dfc543-c13b-401a-892d-806436f2c384 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:05:45.622663 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-e284f4f9-03cf-491d-a186-7bea04cfb8ff tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:05:45.625153 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e284f4f9-03cf-491d-a186-7bea04cfb8ff tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 05:05:45.656743 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e284f4f9-03cf-491d-a186-7bea04cfb8ff tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'Port': ['ID=6d945935-f6f2-44ff-8105-51e1ec0f31f1,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:05:45.683821 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e284f4f9-03cf-491d-a186-7bea04cfb8ff tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:45.918912 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e284f4f9-03cf-491d-a186-7bea04cfb8ff tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:46.191379 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e284f4f9-03cf-491d-a186-7bea04cfb8ff tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:46.262877 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e284f4f9-03cf-491d-a186-7bea04cfb8ff tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:46.333284 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 9fce31a6-0e9b-4e31-9c48-25ee625d9dd4 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:05:46.351550 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e284f4f9-03cf-491d-a186-7bea04cfb8ff tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'Port': ['ID=6d945935-f6f2-44ff-8105-51e1ec0f31f1,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:05:46.354168 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e284f4f9-03cf-491d-a186-7bea04cfb8ff tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:46.390545 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 9fce31a6-0e9b-4e31-9c48-25ee625d9dd4 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:05:46.391176 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:46.452139 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e284f4f9-03cf-491d-a186-7bea04cfb8ff tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Network 16dfc543-c13b-401a-892d-806436f2c384 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:05:46.453965 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-e284f4f9-03cf-491d-a186-7bea04cfb8ff tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:05:46.474782 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:46.509630 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 9fce31a6-0e9b-4e31-9c48-25ee625d9dd4, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=9fce31a6-0e9b-4e31-9c48-25ee625d9dd4,segment=NetworkSegment(04920539-e2ad-49d5-b0a6-718337b9e8b0),segment_id=04920539-e2ad-49d5-b0a6-718337b9e8b0)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:05:46.569694 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3af3822a-e6ce-4bfd-bb0f-2d8ac7bf3e51 None None] Network 16dfc543-c13b-401a-892d-806436f2c384 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 05:05:46.574171 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:46.574981 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 6777983c-53b7-4614-a4e7-3ad9e839bfeb up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:05:46.580739 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e284f4f9-03cf-491d-a186-7bea04cfb8ff tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Router d4c935be-c982-4fcb-af39-2fc3ae9f8314 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 05:05:46.644000 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:46.696021 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e284f4f9-03cf-491d-a186-7bea04cfb8ff tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 05:05:46.700899 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e284f4f9-03cf-491d-a186-7bea04cfb8ff tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "PUT /v2.0/routers/d4c935be-c982-4fcb-af39-2fc3ae9f8314/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.2884042 Nov 09 05:05:46.721740 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-575032ec-04db-4bf2-9039-7d107bdc0268 None None] Provisioning complete for port 9fce31a6-0e9b-4e31-9c48-25ee625d9dd4 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:05:46.722108 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-575032ec-04db-4bf2-9039-7d107bdc0268 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:46.726054 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=9fce31a6-0e9b-4e31-9c48-25ee625d9dd4,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:05:46.808652 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 6777983c-53b7-4614-a4e7-3ad9e839bfeb triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:05:46.809028 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:46.864967 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-3fef24cf-0a5c-4d92-9db7-fe1924bc9cc3 req-3f566765-3352-4e51-9db3-b9a5f758cdae tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-91458487&fields=id&tenant_id=8ac3eab68bd34485af7ddc3417853b28 HTTP/1.1" status: 200 len: 267 time: 0.0493810 Nov 09 05:05:46.975455 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fef24cf-0a5c-4d92-9db7-fe1924bc9cc3 req-ad2b0793-a7e4-471d-b640-a7762f3c8b3b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:05:46.980821 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:46.982453 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-3fef24cf-0a5c-4d92-9db7-fe1924bc9cc3 req-ad2b0793-a7e4-471d-b640-a7762f3c8b3b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/networks?id=16dfc543-c13b-401a-892d-806436f2c384 HTTP/1.1" status: 200 len: 796 time: 0.1103315 Nov 09 05:05:46.993463 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-3fef24cf-0a5c-4d92-9db7-fe1924bc9cc3 req-1c5affed-7e86-4390-8930-892879e96e9b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/quotas/8ac3eab68bd34485af7ddc3417853b28 HTTP/1.1" status: 200 len: 375 time: 0.0101826 Nov 09 05:05:47.012959 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 6777983c-53b7-4614-a4e7-3ad9e839bfeb, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=6777983c-53b7-4614-a4e7-3ad9e839bfeb,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:05:47.028238 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:47.052720 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-3fef24cf-0a5c-4d92-9db7-fe1924bc9cc3 req-e896623b-98f2-4f4a-8bd0-20a29ce37030 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?tenant_id=8ac3eab68bd34485af7ddc3417853b28&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0489781 Nov 09 05:05:47.102127 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:47.157990 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=6777983c-53b7-4614-a4e7-3ad9e839bfeb,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:05:47.165937 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-3fef24cf-0a5c-4d92-9db7-fe1924bc9cc3 req-07f81f00-20e3-4479-b4bd-257626b33d92 service neutron] 10.222.0.24 "GET /v2.0/networks/16dfc543-c13b-401a-892d-806436f2c384?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1007867 Nov 09 05:05:47.173363 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-19cee0a2-faeb-4bf9-9baa-c2c7f942302d None None] Sync routers for ids ['d4c935be-c982-4fcb-af39-2fc3ae9f8314'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 05:05:47.185326 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-19cee0a2-faeb-4bf9-9baa-c2c7f942302d None None] Routers {'d4c935be-c982-4fcb-af39-2fc3ae9f8314'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:05:47.186028 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-19cee0a2-faeb-4bf9-9baa-c2c7f942302d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:05:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['d4c935be-c982-4fcb-af39-2fc3ae9f8314'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:05:47.256894 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-94b7b972-ffb2-4091-8fdf-c5f8950176d7 None None] Provisioning complete for port 9fce31a6-0e9b-4e31-9c48-25ee625d9dd4 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:05:47.257403 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-94b7b972-ffb2-4091-8fdf-c5f8950176d7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:47.271806 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-3fef24cf-0a5c-4d92-9db7-fe1924bc9cc3 req-a225c22f-1130-4a62-b961-65d9068c3e14 service neutron] 10.222.0.24 "GET /v2.0/networks/16dfc543-c13b-401a-892d-806436f2c384?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0995629 Nov 09 05:05:47.309120 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-19cee0a2-faeb-4bf9-9baa-c2c7f942302d None None] Set router d4c935be-c982-4fcb-af39-2fc3ae9f8314 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:05:47.361780 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-94b7b972-ffb2-4091-8fdf-c5f8950176d7 None None] Provisioning complete for port 6d945935-f6f2-44ff-8105-51e1ec0f31f1 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:05:47.362295 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-94b7b972-ffb2-4091-8fdf-c5f8950176d7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:47.405392 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-94b7b972-ffb2-4091-8fdf-c5f8950176d7 None None] Port 6d945935-f6f2-44ff-8105-51e1ec0f31f1 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 05:05:47.516233 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-19cee0a2-faeb-4bf9-9baa-c2c7f942302d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd4c935be-c982-4fcb-af39-2fc3ae9f8314', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1210987163', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.120'}], 'enable_snat': True}, 'gw_port_id': '6777983c-53b7-4614-a4e7-3ad9e839bfeb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:05:41Z', 'updated_at': '2021-11-09T05:05:45Z', 'revision_number': 4, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': '6777983c-53b7-4614-a4e7-3ad9e839bfeb', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:07:ee', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd4c935be-c982-4fcb-af39-2fc3ae9f8314', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1748, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:05:41Z', 'updated_at': '2021-11-09T05:05:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '6d945935-f6f2-44ff-8105-51e1ec0f31f1', 'name': '', 'network_id': '16dfc543-c13b-401a-892d-806436f2c384', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'mac_address': 'fa:16:3e:3f:21:b8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd4c935be-c982-4fcb-af39-2fc3ae9f8314', 'device_owner': 'network:router_interface', 'standard_attr_id': 1751, 'fixed_ips': [{'subnet_id': '3735bbb3-0479-4b6b-8df7-645fb895c926', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:05:44Z', 'updated_at': '2021-11-09T05:05:46Z', 'revision_number': 2, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'subnets': [{'id': '3735bbb3-0479-4b6b-8df7-645fb895c926', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:05:47.529246 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-0ab05da2-a492-48cf-8c01-468d82776270 None None] Provisioning complete for port 6d945935-f6f2-44ff-8105-51e1ec0f31f1 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:05:47.529782 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0ab05da2-a492-48cf-8c01-468d82776270 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:47.535325 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7b176ec8-99d4-4196-b67e-aa9297690b0a req-7113df4e-7ffe-42b3-a812-1431cfb2e79c tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=ae343e88-84a9-4629-9c45-ff6312e10860 HTTP/1.1" status: 200 len: 210 time: 0.0432522 Nov 09 05:05:47.547799 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-19cee0a2-faeb-4bf9-9baa-c2c7f942302d None None] Checking router: d4c935be-c982-4fcb-af39-2fc3ae9f8314 for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 05:05:47.548161 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-19cee0a2-faeb-4bf9-9baa-c2c7f942302d None None] Updating router d4c935be-c982-4fcb-af39-2fc3ae9f8314 port 6d945935-f6f2-44ff-8105-51e1ec0f31f1 binding host dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 05:05:47.574272 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-19cee0a2-faeb-4bf9-9baa-c2c7f942302d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:47.590966 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-0ab05da2-a492-48cf-8c01-468d82776270 None None] Port 6d945935-f6f2-44ff-8105-51e1ec0f31f1 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 05:05:47.820246 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-66ded345-cf2c-4e27-af41-6d66928e20f1 None None] Provisioning complete for port 6d945935-f6f2-44ff-8105-51e1ec0f31f1 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:05:47.820840 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-66ded345-cf2c-4e27-af41-6d66928e20f1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:47.853907 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-66ded345-cf2c-4e27-af41-6d66928e20f1 None None] Port 6d945935-f6f2-44ff-8105-51e1ec0f31f1 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 05:05:47.930006 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-19cee0a2-faeb-4bf9-9baa-c2c7f942302d None None] Publish callbacks [] for port, precommit_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:47.987902 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-19cee0a2-faeb-4bf9-9baa-c2c7f942302d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:48.038383 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82b71c8f-b1f3-4f0f-93c6-8ca33bc72f26 None None] Pushing event updated for resources: {'Port': ['ID=6d945935-f6f2-44ff-8105-51e1ec0f31f1,revision_number=3']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:05:48.063404 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82b71c8f-b1f3-4f0f-93c6-8ca33bc72f26 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:05:48.063747 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82b71c8f-b1f3-4f0f-93c6-8ca33bc72f26 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:05:48.064082 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82b71c8f-b1f3-4f0f-93c6-8ca33bc72f26 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:05:48.064632 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82b71c8f-b1f3-4f0f-93c6-8ca33bc72f26 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:05:48.064754 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82b71c8f-b1f3-4f0f-93c6-8ca33bc72f26 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:05:48.065039 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82b71c8f-b1f3-4f0f-93c6-8ca33bc72f26 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:05:48.065362 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82b71c8f-b1f3-4f0f-93c6-8ca33bc72f26 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:05:48.065686 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82b71c8f-b1f3-4f0f-93c6-8ca33bc72f26 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:05:48.066004 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82b71c8f-b1f3-4f0f-93c6-8ca33bc72f26 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:05:48.066319 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82b71c8f-b1f3-4f0f-93c6-8ca33bc72f26 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:05:48.066658 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82b71c8f-b1f3-4f0f-93c6-8ca33bc72f26 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:05:48.066993 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82b71c8f-b1f3-4f0f-93c6-8ca33bc72f26 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:05:48.100798 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-19cee0a2-faeb-4bf9-9baa-c2c7f942302d None None] Attempting to bind port 6d945935-f6f2-44ff-8105-51e1ec0f31f1 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 05:05:48.101165 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-19cee0a2-faeb-4bf9-9baa-c2c7f942302d None None] Attempting to bind port 6d945935-f6f2-44ff-8105-51e1ec0f31f1 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '04920539-e2ad-49d5-b0a6-718337b9e8b0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 304, 'network_id': '16dfc543-c13b-401a-892d-806436f2c384'}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 05:05:48.101527 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-19cee0a2-faeb-4bf9-9baa-c2c7f942302d None None] Attempting to bind port 6d945935-f6f2-44ff-8105-51e1ec0f31f1 on network 16dfc543-c13b-401a-892d-806436f2c384 {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 05:05:48.106917 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-19cee0a2-faeb-4bf9-9baa-c2c7f942302d None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 5, 5, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 05:05:48.114845 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-19cee0a2-faeb-4bf9-9baa-c2c7f942302d None None] Checking segment: {'id': '04920539-e2ad-49d5-b0a6-718337b9e8b0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 304, 'network_id': '16dfc543-c13b-401a-892d-806436f2c384'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102164) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 05:05:48.114845 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-19cee0a2-faeb-4bf9-9baa-c2c7f942302d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:48.114845 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-19cee0a2-faeb-4bf9-9baa-c2c7f942302d None None] Bound using segment: {'id': '04920539-e2ad-49d5-b0a6-718337b9e8b0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 304, 'network_id': '16dfc543-c13b-401a-892d-806436f2c384'} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 05:05:48.114845 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-19cee0a2-faeb-4bf9-9baa-c2c7f942302d None None] Bound port: 6d945935-f6f2-44ff-8105-51e1ec0f31f1, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '04920539-e2ad-49d5-b0a6-718337b9e8b0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 304, 'network_id': '16dfc543-c13b-401a-892d-806436f2c384'}}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 05:05:48.114845 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-19cee0a2-faeb-4bf9-9baa-c2c7f942302d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:48.173081 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-19cee0a2-faeb-4bf9-9baa-c2c7f942302d None None] For port 6d945935-f6f2-44ff-8105-51e1ec0f31f1, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102164) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 05:05:48.177201 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-19cee0a2-faeb-4bf9-9baa-c2c7f942302d None None] For port 6d945935-f6f2-44ff-8105-51e1ec0f31f1, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=6d945935-f6f2-44ff-8105-51e1ec0f31f1,segment=NetworkSegment(04920539-e2ad-49d5-b0a6-718337b9e8b0),segment_id=04920539-e2ad-49d5-b0a6-718337b9e8b0)] {{(pid=102164) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 05:05:48.239032 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-19cee0a2-faeb-4bf9-9baa-c2c7f942302d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:48.296847 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-f0bddbfb-b11c-4b14-abc6-77d3156082be None None] Provisioning complete for port 6d945935-f6f2-44ff-8105-51e1ec0f31f1 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:05:48.297161 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f0bddbfb-b11c-4b14-abc6-77d3156082be None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:48.302792 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-19cee0a2-faeb-4bf9-9baa-c2c7f942302d None None] Routers {'d4c935be-c982-4fcb-af39-2fc3ae9f8314'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:05:48.303426 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-19cee0a2-faeb-4bf9-9baa-c2c7f942302d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:05:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['d4c935be-c982-4fcb-af39-2fc3ae9f8314'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:05:48.305308 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82b71c8f-b1f3-4f0f-93c6-8ca33bc72f26 None None] Pushing event updated for resources: {'Port': ['ID=6d945935-f6f2-44ff-8105-51e1ec0f31f1,revision_number=4']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:05:48.323200 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 9fce31a6-0e9b-4e31-9c48-25ee625d9dd4 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:05:48.423572 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-19cee0a2-faeb-4bf9-9baa-c2c7f942302d None None] Set router d4c935be-c982-4fcb-af39-2fc3ae9f8314 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:05:48.427668 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f0bddbfb-b11c-4b14-abc6-77d3156082be None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:48.429579 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 9fce31a6-0e9b-4e31-9c48-25ee625d9dd4 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:05:48.429938 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:48.498926 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-f0bddbfb-b11c-4b14-abc6-77d3156082be None None] For port 6d945935-f6f2-44ff-8105-51e1ec0f31f1, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=6d945935-f6f2-44ff-8105-51e1ec0f31f1,segment=NetworkSegment(04920539-e2ad-49d5-b0a6-718337b9e8b0),segment_id=04920539-e2ad-49d5-b0a6-718337b9e8b0)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:05:48.545050 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 6777983c-53b7-4614-a4e7-3ad9e839bfeb up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:05:48.578214 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f0bddbfb-b11c-4b14-abc6-77d3156082be None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:48.635088 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0bddbfb-b11c-4b14-abc6-77d3156082be None None] Pushing event updated for resources: {'Port': ['ID=6d945935-f6f2-44ff-8105-51e1ec0f31f1,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:05:48.639696 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 6777983c-53b7-4614-a4e7-3ad9e839bfeb triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:05:48.640278 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:48.647040 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-19cee0a2-faeb-4bf9-9baa-c2c7f942302d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd4c935be-c982-4fcb-af39-2fc3ae9f8314', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1210987163', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.120'}], 'enable_snat': True}, 'gw_port_id': '6777983c-53b7-4614-a4e7-3ad9e839bfeb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:05:41Z', 'updated_at': '2021-11-09T05:05:45Z', 'revision_number': 4, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': '6777983c-53b7-4614-a4e7-3ad9e839bfeb', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:07:ee', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd4c935be-c982-4fcb-af39-2fc3ae9f8314', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1748, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:05:41Z', 'updated_at': '2021-11-09T05:05:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '6d945935-f6f2-44ff-8105-51e1ec0f31f1', 'name': '', 'network_id': '16dfc543-c13b-401a-892d-806436f2c384', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'mac_address': 'fa:16:3e:3f:21:b8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd4c935be-c982-4fcb-af39-2fc3ae9f8314', 'device_owner': 'network:router_interface', 'standard_attr_id': 1751, 'fixed_ips': [{'subnet_id': '3735bbb3-0479-4b6b-8df7-645fb895c926', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:05:44Z', 'updated_at': '2021-11-09T05:05:48Z', 'revision_number': 4, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'subnets': [{'id': '3735bbb3-0479-4b6b-8df7-645fb895c926', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:05:48.658936 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-6b661dd5-1e9f-47d5-9171-b6d35664f54f req-db3a995f-aa90-463c-af3a-3a75465483e7 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=ae343e88-84a9-4629-9c45-ff6312e10860 HTTP/1.1" status: 200 len: 210 time: 0.0490060 Nov 09 05:05:48.690507 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-19cee0a2-faeb-4bf9-9baa-c2c7f942302d None None] The sync data for ids ['d4c935be-c982-4fcb-af39-2fc3ae9f8314'] in dv-neutron-816802-2-hyperv is: [{'id': 'd4c935be-c982-4fcb-af39-2fc3ae9f8314', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1210987163', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.120'}], 'enable_snat': True}, 'gw_port_id': '6777983c-53b7-4614-a4e7-3ad9e839bfeb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:05:41Z', 'updated_at': '2021-11-09T05:05:45Z', 'revision_number': 4, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': '6777983c-53b7-4614-a4e7-3ad9e839bfeb', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:07:ee', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd4c935be-c982-4fcb-af39-2fc3ae9f8314', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1748, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:05:41Z', 'updated_at': '2021-11-09T05:05:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '6d945935-f6f2-44ff-8105-51e1ec0f31f1', 'name': '', 'network_id': '16dfc543-c13b-401a-892d-806436f2c384', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'mac_address': 'fa:16:3e:3f:21:b8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd4c935be-c982-4fcb-af39-2fc3ae9f8314', 'device_owner': 'network:router_interface', 'standard_attr_id': 1751, 'fixed_ips': [{'subnet_id': '3735bbb3-0479-4b6b-8df7-645fb895c926', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:05:44Z', 'updated_at': '2021-11-09T05:05:48Z', 'revision_number': 4, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'subnets': [{'id': '3735bbb3-0479-4b6b-8df7-645fb895c926', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 05:05:48.706657 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-f312d097-3993-4e02-95a1-fa3a9a563839 None None] Provisioning complete for port 6d945935-f6f2-44ff-8105-51e1ec0f31f1 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:05:48.707395 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f312d097-3993-4e02-95a1-fa3a9a563839 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:49.413646 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fef24cf-0a5c-4d92-9db7-fe1924bc9cc3 req-0d8f6cae-7e81-4ac2-8a38-44250b3c0a22 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:05:49.415206 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3fef24cf-0a5c-4d92-9db7-fe1924bc9cc3 req-0d8f6cae-7e81-4ac2-8a38-44250b3c0a22 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.26 "GET /v2.0/networks?id=16dfc543-c13b-401a-892d-806436f2c384 HTTP/1.1" status: 200 len: 796 time: 0.1204426 Nov 09 05:05:49.484879 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3fef24cf-0a5c-4d92-9db7-fe1924bc9cc3 req-69834ff1-764e-49d7-8822-593562765d37 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.26 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=8ac3eab68bd34485af7ddc3417853b28 HTTP/1.1" status: 200 len: 378 time: 0.0595338 Nov 09 05:05:49.495602 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-3fef24cf-0a5c-4d92-9db7-fe1924bc9cc3 req-62547efa-eb32-46eb-a4fd-6b371ad1546a tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'port': {'device_id': 'ae343e88-84a9-4629-9c45-ff6312e10860', 'network_id': '16dfc543-c13b-401a-892d-806436f2c384', 'admin_state_up': True, 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'security_groups': ['a10dfbe7-94bf-4308-8c2b-b051bc84e309']}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:05:49.697475 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-3fef24cf-0a5c-4d92-9db7-fe1924bc9cc3 req-62547efa-eb32-46eb-a4fd-6b371ad1546a tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Made reservation on behalf of 8ac3eab68bd34485af7ddc3417853b28 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 05:05:49.701226 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-3fef24cf-0a5c-4d92-9db7-fe1924bc9cc3 req-62547efa-eb32-46eb-a4fd-6b371ad1546a tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:49.796931 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e17e0286-2528-45b9-a13d-d0f34ae58801 req-a16308ce-547d-4a12-b30d-bb3277d89759 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=ae343e88-84a9-4629-9c45-ff6312e10860 HTTP/1.1" status: 200 len: 210 time: 0.0617564 Nov 09 05:05:49.876793 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [req-3fef24cf-0a5c-4d92-9db7-fe1924bc9cc3 req-62547efa-eb32-46eb-a4fd-6b371ad1546a tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Allocated IP 172.20.0.3 (16dfc543-c13b-401a-892d-806436f2c384/3735bbb3-0479-4b6b-8df7-645fb895c926/59ddd742-caef-4443-9ccf-f969e1453d45) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 05:05:50.025718 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-3fef24cf-0a5c-4d92-9db7-fe1924bc9cc3 req-62547efa-eb32-46eb-a4fd-6b371ad1546a tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:50.115015 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-3fef24cf-0a5c-4d92-9db7-fe1924bc9cc3 req-62547efa-eb32-46eb-a4fd-6b371ad1546a tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:50.157758 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-3fef24cf-0a5c-4d92-9db7-fe1924bc9cc3 req-62547efa-eb32-46eb-a4fd-6b371ad1546a tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Network 16dfc543-c13b-401a-892d-806436f2c384 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:05:50.160702 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [req-3fef24cf-0a5c-4d92-9db7-fe1924bc9cc3 req-62547efa-eb32-46eb-a4fd-6b371ad1546a tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:05:50.163210 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-3fef24cf-0a5c-4d92-9db7-fe1924bc9cc3 req-62547efa-eb32-46eb-a4fd-6b371ad1546a tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 05:05:50.195380 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62547efa-eb32-46eb-a4fd-6b371ad1546a tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'Port': ['ID=59ddd742-caef-4443-9ccf-f969e1453d45,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:05:50.222334 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fef24cf-0a5c-4d92-9db7-fe1924bc9cc3 req-62547efa-eb32-46eb-a4fd-6b371ad1546a tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:05:50.222894 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-3fef24cf-0a5c-4d92-9db7-fe1924bc9cc3 req-62547efa-eb32-46eb-a4fd-6b371ad1546a tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:50.288895 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3fef24cf-0a5c-4d92-9db7-fe1924bc9cc3 req-62547efa-eb32-46eb-a4fd-6b371ad1546a tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.26 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7972186 Nov 09 05:05:50.304530 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-3fef24cf-0a5c-4d92-9db7-fe1924bc9cc3 req-f7d211c3-631c-44fa-a122-d177f1d18920 service neutron] Request body: {'port': {'device_id': 'ae343e88-84a9-4629-9c45-ff6312e10860', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:05:50.309847 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 6d945935-f6f2-44ff-8105-51e1ec0f31f1 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:05:50.360634 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 6d945935-f6f2-44ff-8105-51e1ec0f31f1 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:05:50.361083 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:50.366021 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-3fef24cf-0a5c-4d92-9db7-fe1924bc9cc3 req-f7d211c3-631c-44fa-a122-d177f1d18920 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:50.402727 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-25e84e4b-1d1d-46cc-a0b8-ca919ab6bd63 None None] Provisioning complete for port 59ddd742-caef-4443-9ccf-f969e1453d45 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:05:50.403072 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-25e84e4b-1d1d-46cc-a0b8-ca919ab6bd63 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:50.444071 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-25e84e4b-1d1d-46cc-a0b8-ca919ab6bd63 None None] Port 59ddd742-caef-4443-9ccf-f969e1453d45 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 05:05:50.618704 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [req-3fef24cf-0a5c-4d92-9db7-fe1924bc9cc3 req-f7d211c3-631c-44fa-a122-d177f1d18920 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 59ddd742-caef-4443-9ccf-f969e1453d45 {{(pid=102162) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 05:05:50.625893 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-3fef24cf-0a5c-4d92-9db7-fe1924bc9cc3 req-f7d211c3-631c-44fa-a122-d177f1d18920 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:50.637451 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.provisioning_blocks [req-3fef24cf-0a5c-4d92-9db7-fe1924bc9cc3 req-f7d211c3-631c-44fa-a122-d177f1d18920 service neutron] Transition to ACTIVE for port object 59ddd742-caef-4443-9ccf-f969e1453d45 will not be triggered until provisioned by entity L2. {{(pid=102162) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 09 05:05:50.742906 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-3fef24cf-0a5c-4d92-9db7-fe1924bc9cc3 req-f7d211c3-631c-44fa-a122-d177f1d18920 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:50.797980 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7d211c3-631c-44fa-a122-d177f1d18920 service neutron] Pushing event updated for resources: {'Port': ['ID=59ddd742-caef-4443-9ccf-f969e1453d45,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:05:50.870334 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-3fef24cf-0a5c-4d92-9db7-fe1924bc9cc3 req-f7d211c3-631c-44fa-a122-d177f1d18920 service neutron] Attempting to bind port 59ddd742-caef-4443-9ccf-f969e1453d45 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 05:05:50.870844 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-3fef24cf-0a5c-4d92-9db7-fe1924bc9cc3 req-f7d211c3-631c-44fa-a122-d177f1d18920 service neutron] Attempting to bind port 59ddd742-caef-4443-9ccf-f969e1453d45 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '04920539-e2ad-49d5-b0a6-718337b9e8b0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 304, 'network_id': '16dfc543-c13b-401a-892d-806436f2c384'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 05:05:50.871275 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3fef24cf-0a5c-4d92-9db7-fe1924bc9cc3 req-f7d211c3-631c-44fa-a122-d177f1d18920 service neutron] Attempting to bind port 59ddd742-caef-4443-9ccf-f969e1453d45 on network 16dfc543-c13b-401a-892d-806436f2c384 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 05:05:50.876168 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3fef24cf-0a5c-4d92-9db7-fe1924bc9cc3 req-f7d211c3-631c-44fa-a122-d177f1d18920 service neutron] Port 59ddd742-caef-4443-9ccf-f969e1453d45 on network 16dfc543-c13b-401a-892d-806436f2c384 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 05:05:50.876665 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3fef24cf-0a5c-4d92-9db7-fe1924bc9cc3 req-f7d211c3-631c-44fa-a122-d177f1d18920 service neutron] Attempting to bind port 59ddd742-caef-4443-9ccf-f969e1453d45 on network 16dfc543-c13b-401a-892d-806436f2c384 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 05:05:50.886491 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3fef24cf-0a5c-4d92-9db7-fe1924bc9cc3 req-f7d211c3-631c-44fa-a122-d177f1d18920 service neutron] Checking agent: {'id': '7d36b884-4ad2-4878-9464-bf647030b544', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'started_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 5, 5, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 05:05:50.886835 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3fef24cf-0a5c-4d92-9db7-fe1924bc9cc3 req-f7d211c3-631c-44fa-a122-d177f1d18920 service neutron] Checking segment: {'id': '04920539-e2ad-49d5-b0a6-718337b9e8b0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 304, 'network_id': '16dfc543-c13b-401a-892d-806436f2c384'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 05:05:50.887362 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3fef24cf-0a5c-4d92-9db7-fe1924bc9cc3 req-f7d211c3-631c-44fa-a122-d177f1d18920 service neutron] Bound using segment: {'id': '04920539-e2ad-49d5-b0a6-718337b9e8b0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 304, 'network_id': '16dfc543-c13b-401a-892d-806436f2c384'} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 05:05:50.887796 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-3fef24cf-0a5c-4d92-9db7-fe1924bc9cc3 req-f7d211c3-631c-44fa-a122-d177f1d18920 service neutron] Bound port: 59ddd742-caef-4443-9ccf-f969e1453d45, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '04920539-e2ad-49d5-b0a6-718337b9e8b0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 304, 'network_id': '16dfc543-c13b-401a-892d-806436f2c384'}}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 05:05:50.888147 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-3fef24cf-0a5c-4d92-9db7-fe1924bc9cc3 req-f7d211c3-631c-44fa-a122-d177f1d18920 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:50.927212 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e44bec06-328d-4459-98e1-b9bea4ceb385 req-f68a8a09-7fb9-4180-9eda-62196e84ce13 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:05:50.928857 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-e44bec06-328d-4459-98e1-b9bea4ceb385 req-f68a8a09-7fb9-4180-9eda-62196e84ce13 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=ae343e88-84a9-4629-9c45-ff6312e10860 HTTP/1.1" status: 200 len: 943 time: 0.0579424 Nov 09 05:05:50.955031 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-3fef24cf-0a5c-4d92-9db7-fe1924bc9cc3 req-f7d211c3-631c-44fa-a122-d177f1d18920 service neutron] For port 59ddd742-caef-4443-9ccf-f969e1453d45, host hv-neutron-8168, cleared binding levels {{(pid=102162) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 05:05:50.958674 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-3fef24cf-0a5c-4d92-9db7-fe1924bc9cc3 req-f7d211c3-631c-44fa-a122-d177f1d18920 service neutron] For port 59ddd742-caef-4443-9ccf-f969e1453d45, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=59ddd742-caef-4443-9ccf-f969e1453d45,segment=NetworkSegment(04920539-e2ad-49d5-b0a6-718337b9e8b0),segment_id=04920539-e2ad-49d5-b0a6-718337b9e8b0)] {{(pid=102162) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 05:05:50.982235 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-e44bec06-328d-4459-98e1-b9bea4ceb385 req-e62fedac-ce24-4642-9171-6d1021d419ca tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=a10dfbe7-94bf-4308-8c2b-b051bc84e309&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0457511 Nov 09 05:05:51.017355 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-3fef24cf-0a5c-4d92-9db7-fe1924bc9cc3 req-f7d211c3-631c-44fa-a122-d177f1d18920 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:51.055058 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fef24cf-0a5c-4d92-9db7-fe1924bc9cc3 req-f7d211c3-631c-44fa-a122-d177f1d18920 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:05:51.055653 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-3fef24cf-0a5c-4d92-9db7-fe1924bc9cc3 req-f7d211c3-631c-44fa-a122-d177f1d18920 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:51.057217 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3fef24cf-0a5c-4d92-9db7-fe1924bc9cc3 req-f7d211c3-631c-44fa-a122-d177f1d18920 service neutron] 10.222.0.26 "PUT /v2.0/ports/59ddd742-caef-4443-9ccf-f969e1453d45 HTTP/1.1" status: 200 len: 1093 time: 0.7597060 Nov 09 05:05:51.057874 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ae343e88-84a9-4629-9c45-ff6312e10860', 'tag': '59ddd742-caef-4443-9ccf-f969e1453d45'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:05:51.059952 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d330e4bb-ee25-48ef-8ce3-7922f631d4d3" -d '{"events": [{"name": "network-changed", "server_uuid": "ae343e88-84a9-4629-9c45-ff6312e10860", "tag": "59ddd742-caef-4443-9ccf-f969e1453d45"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:05:51.090225 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7d211c3-631c-44fa-a122-d177f1d18920 service neutron] Pushing event updated for resources: {'Port': ['ID=59ddd742-caef-4443-9ccf-f969e1453d45,revision_number=3']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:05:51.104495 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 05:05:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-54bdb85d-4cc7-4cfd-bbd0-78e4fa519ce0 x-openstack-request-id: req-54bdb85d-4cc7-4cfd-bbd0-78e4fa519ce0 {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:05:51.104964 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ae343e88-84a9-4629-9c45-ff6312e10860", "tag": "59ddd742-caef-4443-9ccf-f969e1453d45", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:05:51.105227 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-54bdb85d-4cc7-4cfd-bbd0-78e4fa519ce0 {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:05:51.105691 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ae343e88-84a9-4629-9c45-ff6312e10860', 'tag': '59ddd742-caef-4443-9ccf-f969e1453d45', 'status': 'completed', 'code': 200} Nov 09 05:05:51.168801 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d330e4bb-ee25-48ef-8ce3-7922f631d4d3 req-49f8b8fe-2f12-46de-9a39-51a8edd36838 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:05:51.170452 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d330e4bb-ee25-48ef-8ce3-7922f631d4d3 req-49f8b8fe-2f12-46de-9a39-51a8edd36838 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=8ac3eab68bd34485af7ddc3417853b28&device_id=ae343e88-84a9-4629-9c45-ff6312e10860 HTTP/1.1" status: 200 len: 1096 time: 0.0438128 Nov 09 05:05:51.269740 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d330e4bb-ee25-48ef-8ce3-7922f631d4d3 req-59e50213-3a94-4582-a32e-ec398a81f2da service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:05:51.271890 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d330e4bb-ee25-48ef-8ce3-7922f631d4d3 req-59e50213-3a94-4582-a32e-ec398a81f2da service neutron] 10.222.0.26 "GET /v2.0/networks?tenant_id=8ac3eab68bd34485af7ddc3417853b28&shared=False HTTP/1.1" status: 200 len: 897 time: 0.0942223 Nov 09 05:05:51.370210 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d330e4bb-ee25-48ef-8ce3-7922f631d4d3 req-e635545e-cef3-4601-911f-dd08ddf930b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:05:51.371614 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d330e4bb-ee25-48ef-8ce3-7922f631d4d3 req-e635545e-cef3-4601-911f-dd08ddf930b9 service neutron] 10.222.0.26 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0927403 Nov 09 05:05:51.444986 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fef24cf-0a5c-4d92-9db7-fe1924bc9cc3 req-861cb935-efba-4b16-b786-b95dce05c273 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:05:51.446509 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3fef24cf-0a5c-4d92-9db7-fe1924bc9cc3 req-861cb935-efba-4b16-b786-b95dce05c273 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=8ac3eab68bd34485af7ddc3417853b28&device_id=ae343e88-84a9-4629-9c45-ff6312e10860 HTTP/1.1" status: 200 len: 1096 time: 0.0405064 Nov 09 05:05:51.492132 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3fef24cf-0a5c-4d92-9db7-fe1924bc9cc3 req-8b3ac664-e46f-4a1f-aaad-7687ac0764c8 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=59ddd742-caef-4443-9ccf-f969e1453d45 HTTP/1.1" status: 200 len: 217 time: 0.0375416 Nov 09 05:05:51.540214 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fef24cf-0a5c-4d92-9db7-fe1924bc9cc3 req-12706ae1-2aa4-4a68-b15c-0cac72aed104 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:05:51.541590 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3fef24cf-0a5c-4d92-9db7-fe1924bc9cc3 req-12706ae1-2aa4-4a68-b15c-0cac72aed104 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=3735bbb3-0479-4b6b-8df7-645fb895c926 HTTP/1.1" status: 200 len: 835 time: 0.0427969 Nov 09 05:05:51.587035 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fef24cf-0a5c-4d92-9db7-fe1924bc9cc3 req-b9ba5e12-cffb-451c-8343-f1cf5e1ad138 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:05:51.588468 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3fef24cf-0a5c-4d92-9db7-fe1924bc9cc3 req-b9ba5e12-cffb-451c-8343-f1cf5e1ad138 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=16dfc543-c13b-401a-892d-806436f2c384&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0399125 Nov 09 05:05:51.980253 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3fef24cf-0a5c-4d92-9db7-fe1924bc9cc3 req-810566d2-8c8d-4598-a418-d2398ba445b6 service neutron] 10.222.0.26 "GET /v2.0/networks/16dfc543-c13b-401a-892d-806436f2c384?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3817456 Nov 09 05:05:52.069471 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3fef24cf-0a5c-4d92-9db7-fe1924bc9cc3 req-effa2d3b-68aa-413b-aea5-6d878abc44b2 service neutron] 10.222.0.26 "GET /v2.0/networks/16dfc543-c13b-401a-892d-806436f2c384?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0812030 Nov 09 05:05:52.095855 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99a846ef-45e9-4e57-a6c8-447e5fcee8dc req-562b0d2f-9c94-41d0-889a-cd59a1905293 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:05:52.097329 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-99a846ef-45e9-4e57-a6c8-447e5fcee8dc req-562b0d2f-9c94-41d0-889a-cd59a1905293 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=ae343e88-84a9-4629-9c45-ff6312e10860 HTTP/1.1" status: 200 len: 943 time: 0.0482447 Nov 09 05:05:52.146236 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-99a846ef-45e9-4e57-a6c8-447e5fcee8dc req-d5c77a3e-4021-4774-8461-e9705895d16a tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=a10dfbe7-94bf-4308-8c2b-b051bc84e309&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0420213 Nov 09 05:05:53.078675 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 59ddd742-caef-4443-9ccf-f969e1453d45 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=102163) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 09 05:05:53.171473 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 59ddd742-caef-4443-9ccf-f969e1453d45, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=59ddd742-caef-4443-9ccf-f969e1453d45,segment=NetworkSegment(04920539-e2ad-49d5-b0a6-718337b9e8b0),segment_id=04920539-e2ad-49d5-b0a6-718337b9e8b0)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:05:53.183628 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Returning: {'device': '59ddd742-caef-4443-9ccf-f969e1453d45', 'network_id': '16dfc543-c13b-401a-892d-806436f2c384', 'port_id': '59ddd742-caef-4443-9ccf-f969e1453d45', 'mac_address': 'fa:16:3e:6b:a1:e3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 304, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '3735bbb3-0479-4b6b-8df7-645fb895c926', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102163) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 09 05:05:53.219635 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:53.232543 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 59ddd742-caef-4443-9ccf-f969e1453d45 {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 05:05:53.251851 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 59ddd742-caef-4443-9ccf-f969e1453d45, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=59ddd742-caef-4443-9ccf-f969e1453d45,segment=NetworkSegment(04920539-e2ad-49d5-b0a6-718337b9e8b0),segment_id=04920539-e2ad-49d5-b0a6-718337b9e8b0)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:05:53.260552 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-605d2364-1c82-4d85-9afb-cf18fff48b60 req-aadfe7f1-f9b2-4434-bdb0-6b28606b042f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:05:53.267448 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-605d2364-1c82-4d85-9afb-cf18fff48b60 req-aadfe7f1-f9b2-4434-bdb0-6b28606b042f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=ae343e88-84a9-4629-9c45-ff6312e10860 HTTP/1.1" status: 200 len: 943 time: 0.0481963 Nov 09 05:05:53.313285 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-605d2364-1c82-4d85-9afb-cf18fff48b60 req-1ac5a5f4-7c0f-4235-a4dc-23a700324a5b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=a10dfbe7-94bf-4308-8c2b-b051bc84e309&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0453093 Nov 09 05:05:53.320479 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:53.366146 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=59ddd742-caef-4443-9ccf-f969e1453d45,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:05:53.539296 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['59ddd742-caef-4443-9ccf-f969e1453d45'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 05:05:54.428661 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da0c28b5-59e9-4736-ab72-10141fb8bb63 req-7a208df6-e28b-4a5d-a2ec-eae846265842 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:05:54.430086 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-da0c28b5-59e9-4736-ab72-10141fb8bb63 req-7a208df6-e28b-4a5d-a2ec-eae846265842 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=ae343e88-84a9-4629-9c45-ff6312e10860 HTTP/1.1" status: 200 len: 944 time: 0.0507426 Nov 09 05:05:54.451286 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 05:05:54.477338 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-da0c28b5-59e9-4736-ab72-10141fb8bb63 req-92e8a1b8-7939-4394-ab1b-a6d280c7e468 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=a10dfbe7-94bf-4308-8c2b-b051bc84e309&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0413671 Nov 09 05:05:55.090542 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 59ddd742-caef-4443-9ccf-f969e1453d45 up at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:05:55.194815 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning for port 59ddd742-caef-4443-9ccf-f969e1453d45 completed by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 09 05:05:55.198253 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning complete for port 59ddd742-caef-4443-9ccf-f969e1453d45 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:05:55.198639 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:55.271744 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:55.292623 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ae343e88-84a9-4629-9c45-ff6312e10860', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '59ddd742-caef-4443-9ccf-f969e1453d45'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:05:55.294850 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3ee26ecb-414b-40d2-9521-3f13581d2a8f" -d '{"events": [{"server_uuid": "ae343e88-84a9-4629-9c45-ff6312e10860", "name": "network-vif-plugged", "status": "completed", "tag": "59ddd742-caef-4443-9ccf-f969e1453d45"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:05:55.307095 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 59ddd742-caef-4443-9ccf-f969e1453d45, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=59ddd742-caef-4443-9ccf-f969e1453d45,segment=NetworkSegment(04920539-e2ad-49d5-b0a6-718337b9e8b0),segment_id=04920539-e2ad-49d5-b0a6-718337b9e8b0)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:05:55.331899 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 05:05:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ce1a7bed-e49d-4951-a16e-96803cbca1d9 x-openstack-request-id: req-ce1a7bed-e49d-4951-a16e-96803cbca1d9 {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:05:55.332207 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ae343e88-84a9-4629-9c45-ff6312e10860", "name": "network-vif-plugged", "status": "completed", "tag": "59ddd742-caef-4443-9ccf-f969e1453d45", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:05:55.332437 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-ce1a7bed-e49d-4951-a16e-96803cbca1d9 {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:05:55.332829 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ae343e88-84a9-4629-9c45-ff6312e10860', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '59ddd742-caef-4443-9ccf-f969e1453d45', 'code': 200} Nov 09 05:05:55.366769 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:55.416330 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=59ddd742-caef-4443-9ccf-f969e1453d45,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:05:55.589869 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abb11f97-5da8-4ae6-8875-998929239658 req-f1c7b20b-4121-4696-8f4f-4891dc367a39 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:05:55.591444 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-abb11f97-5da8-4ae6-8875-998929239658 req-f1c7b20b-4121-4696-8f4f-4891dc367a39 service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=ae343e88-84a9-4629-9c45-ff6312e10860 HTTP/1.1" status: 200 len: 1098 time: 0.0395436 Nov 09 05:05:55.592629 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f36643f-7ff3-436b-bd3a-04cdec5f86ca req-66869433-1cf3-4dd4-8df1-b0931e1a34aa tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:05:55.594085 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-9f36643f-7ff3-436b-bd3a-04cdec5f86ca req-66869433-1cf3-4dd4-8df1-b0931e1a34aa tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=ae343e88-84a9-4629-9c45-ff6312e10860 HTTP/1.1" status: 200 len: 945 time: 0.0503204 Nov 09 05:05:55.638508 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-abb11f97-5da8-4ae6-8875-998929239658 req-7cdfc8ef-116c-4ef5-bca3-b106b423ac5b service neutron] 10.222.0.26 "GET /v2.0/security-groups?id=a10dfbe7-94bf-4308-8c2b-b051bc84e309&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0396292 Nov 09 05:05:55.643780 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-9f36643f-7ff3-436b-bd3a-04cdec5f86ca req-57e7644d-0f07-4e76-a245-e648e5b16d91 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=a10dfbe7-94bf-4308-8c2b-b051bc84e309&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0434005 Nov 09 05:05:56.764984 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f05af8f-fbfe-4801-88bb-e13bb526ac3b req-6a90fe4e-7ac8-4f5a-9c1c-f4346abf5ef5 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:05:56.766641 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9f05af8f-fbfe-4801-88bb-e13bb526ac3b req-6a90fe4e-7ac8-4f5a-9c1c-f4346abf5ef5 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=ae343e88-84a9-4629-9c45-ff6312e10860 HTTP/1.1" status: 200 len: 945 time: 0.0526142 Nov 09 05:05:56.817636 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9f05af8f-fbfe-4801-88bb-e13bb526ac3b req-bdcd71ca-ae1a-411a-85e5-b716c246cf5b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=a10dfbe7-94bf-4308-8c2b-b051bc84e309&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0442159 Nov 09 05:05:57.936188 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8db54e1a-94ee-492c-b99c-ad0d9901ce22 req-4167c212-28fe-4bbc-939b-6997cb749360 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:05:57.937675 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-8db54e1a-94ee-492c-b99c-ad0d9901ce22 req-4167c212-28fe-4bbc-939b-6997cb749360 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=ae343e88-84a9-4629-9c45-ff6312e10860 HTTP/1.1" status: 200 len: 945 time: 0.0512209 Nov 09 05:05:57.991318 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-8db54e1a-94ee-492c-b99c-ad0d9901ce22 req-e27da6af-346a-43eb-a6c1-8e29a67f060d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=a10dfbe7-94bf-4308-8c2b-b051bc84e309&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0471337 Nov 09 05:05:58.115378 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32690bde-65d9-4468-bccb-607b58a994dc req-8a593a64-2dc8-4015-a669-16160602a3fa tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:05:58.116752 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-32690bde-65d9-4468-bccb-607b58a994dc req-8a593a64-2dc8-4015-a669-16160602a3fa tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=ae343e88-84a9-4629-9c45-ff6312e10860 HTTP/1.1" status: 200 len: 945 time: 0.0522244 Nov 09 05:05:58.164560 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-32690bde-65d9-4468-bccb-607b58a994dc req-0ca4e6af-8027-4ce0-be2e-812c47c63c93 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=a10dfbe7-94bf-4308-8c2b-b051bc84e309&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0420451 Nov 09 05:05:58.185039 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 37104) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:05:58.223432 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d3a88ef9-c9d6-440a-a341-4e47c8bd2eb3 tempest-TestNetworkAdvancedServerOps-1212315804 tempest-TestNetworkAdvancedServerOps-1212315804-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:05:58.224925 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-d3a88ef9-c9d6-440a-a341-4e47c8bd2eb3 tempest-TestNetworkAdvancedServerOps-1212315804 tempest-TestNetworkAdvancedServerOps-1212315804-project-admin] 10.222.0.24 "GET /v2.0/ports?device_id=ae343e88-84a9-4629-9c45-ff6312e10860 HTTP/1.1" status: 200 len: 1093 time: 0.0389090 Nov 09 05:05:58.227668 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 37106) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:05:58.231867 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-68f3a946-f618-4dba-8777-9c29c54dc0db tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'floatingip': {'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'port_id': '59ddd742-caef-4443-9ccf-f969e1453d45', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'fixed_ip_address': '172.20.0.3'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:05:58.304105 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-68f3a946-f618-4dba-8777-9c29c54dc0db tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for floatingip, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:58.407151 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-68f3a946-f618-4dba-8777-9c29c54dc0db tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:58.504198 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-68f3a946-f618-4dba-8777-9c29c54dc0db tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Allocated IP 172.26.0.189 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/641fa773-0d07-4c66-a47b-1430648e8056) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 05:05:58.606247 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-68f3a946-f618-4dba-8777-9c29c54dc0db tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:58.733214 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-68f3a946-f618-4dba-8777-9c29c54dc0db tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:58.768263 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-68f3a946-f618-4dba-8777-9c29c54dc0db tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:05:58.771051 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-68f3a946-f618-4dba-8777-9c29c54dc0db tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:05:58.777200 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-68f3a946-f618-4dba-8777-9c29c54dc0db tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 05:05:58.804257 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68f3a946-f618-4dba-8777-9c29c54dc0db tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'Port': ['ID=641fa773-0d07-4c66-a47b-1430648e8056,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:05:59.148695 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-68f3a946-f618-4dba-8777-9c29c54dc0db tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:59.263309 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-68f3a946-f618-4dba-8777-9c29c54dc0db tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:59.409790 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-68f3a946-f618-4dba-8777-9c29c54dc0db tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:59.469323 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-68f3a946-f618-4dba-8777-9c29c54dc0db tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:59.536992 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68f3a946-f618-4dba-8777-9c29c54dc0db tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'Port': ['ID=641fa773-0d07-4c66-a47b-1430648e8056,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:05:59.550030 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-68f3a946-f618-4dba-8777-9c29c54dc0db tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:05:59.647618 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.l3_db [None req-68f3a946-f618-4dba-8777-9c29c54dc0db tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Floating IP dea9fbba-7f44-4f99-a93a-cca04a117595 associated. External IP: 172.26.0.189, port: 59ddd742-caef-4443-9ccf-f969e1453d45. Nov 09 05:05:59.882317 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-68f3a946-f618-4dba-8777-9c29c54dc0db tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Router d4c935be-c982-4fcb-af39-2fc3ae9f8314 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 05:05:59.983716 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-68f3a946-f618-4dba-8777-9c29c54dc0db tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 05:05:59.993480 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0e108056-2b2e-4eff-8bd2-7a39582dbab1 None None] Sync routers for ids ['d4c935be-c982-4fcb-af39-2fc3ae9f8314'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 05:06:00.003727 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0e108056-2b2e-4eff-8bd2-7a39582dbab1 None None] Routers {'d4c935be-c982-4fcb-af39-2fc3ae9f8314'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:06:00.004350 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-0e108056-2b2e-4eff-8bd2-7a39582dbab1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:05:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['d4c935be-c982-4fcb-af39-2fc3ae9f8314'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:06:00.094771 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-68f3a946-f618-4dba-8777-9c29c54dc0db tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:06:00.108860 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-0e108056-2b2e-4eff-8bd2-7a39582dbab1 None None] Set router d4c935be-c982-4fcb-af39-2fc3ae9f8314 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:06:00.124766 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-68f3a946-f618-4dba-8777-9c29c54dc0db tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.8961020 Nov 09 05:06:00.125385 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ae343e88-84a9-4629-9c45-ff6312e10860', 'tag': '59ddd742-caef-4443-9ccf-f969e1453d45'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:06:00.127641 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ed4cfd97-ad27-4ea3-9ce5-4d2d1c4e0e79" -d '{"events": [{"name": "network-changed", "server_uuid": "ae343e88-84a9-4629-9c45-ff6312e10860", "tag": "59ddd742-caef-4443-9ccf-f969e1453d45"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:06:00.170562 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 05:06:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-50f224cb-a904-4cef-9213-60c18f1ce4b3 x-openstack-request-id: req-50f224cb-a904-4cef-9213-60c18f1ce4b3 {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:06:00.171174 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ae343e88-84a9-4629-9c45-ff6312e10860", "tag": "59ddd742-caef-4443-9ccf-f969e1453d45", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:06:00.171174 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-50f224cb-a904-4cef-9213-60c18f1ce4b3 {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:06:00.171487 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ae343e88-84a9-4629-9c45-ff6312e10860', 'tag': '59ddd742-caef-4443-9ccf-f969e1453d45', 'status': 'completed', 'code': 200} Nov 09 05:06:00.234716 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed4cfd97-ad27-4ea3-9ce5-4d2d1c4e0e79 req-a527e965-ef27-4ad8-a979-4d5cc8fa7f24 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:06:00.235233 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e502d739-39e2-4f37-9c11-3c4edd64d2f5 req-133db8fe-1015-4f3d-bed9-a21be5307323 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:06:00.236213 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ed4cfd97-ad27-4ea3-9ce5-4d2d1c4e0e79 req-a527e965-ef27-4ad8-a979-4d5cc8fa7f24 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=8ac3eab68bd34485af7ddc3417853b28&device_id=ae343e88-84a9-4629-9c45-ff6312e10860 HTTP/1.1" status: 200 len: 1098 time: 0.0414758 Nov 09 05:06:00.237043 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-e502d739-39e2-4f37-9c11-3c4edd64d2f5 req-133db8fe-1015-4f3d-bed9-a21be5307323 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=ae343e88-84a9-4629-9c45-ff6312e10860 HTTP/1.1" status: 200 len: 945 time: 0.0522940 Nov 09 05:06:00.288756 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-e502d739-39e2-4f37-9c11-3c4edd64d2f5 req-083f6b25-1a59-4411-913a-caa09b69a042 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=a10dfbe7-94bf-4308-8c2b-b051bc84e309&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0453379 Nov 09 05:06:00.310336 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 37112) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:06:00.337107 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed4cfd97-ad27-4ea3-9ce5-4d2d1c4e0e79 req-32d45a5c-038f-4ee8-af48-de3740d080dc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:06:00.337888 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-0e108056-2b2e-4eff-8bd2-7a39582dbab1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd4c935be-c982-4fcb-af39-2fc3ae9f8314', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1210987163', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.120'}], 'enable_snat': True}, 'gw_port_id': '6777983c-53b7-4614-a4e7-3ad9e839bfeb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:05:41Z', 'updated_at': '2021-11-09T05:05:45Z', 'revision_number': 4, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': '6777983c-53b7-4614-a4e7-3ad9e839bfeb', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:07:ee', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd4c935be-c982-4fcb-af39-2fc3ae9f8314', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1748, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:05:41Z', 'updated_at': '2021-11-09T05:05:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': 'dea9fbba-7f44-4f99-a93a-cca04a117595', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'floating_ip_address': '172.26.0.189', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': 'd4c935be-c982-4fcb-af39-2fc3ae9f8314', 'port_id': '59ddd742-caef-4443-9ccf-f969e1453d45', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 1754, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '16dfc543-c13b-401a-892d-806436f2c384', 'mac_address': 'fa:16:3e:6b:a1:e3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ae343e88-84a9-4629-9c45-ff6312e10860', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T05:05:59Z', 'updated_at': '2021-11-09T05:05:59Z', 'revision_number': 0, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6d945935-f6f2-44ff-8105-51e1ec0f31f1', 'name': '', 'network_id': '16dfc543-c13b-401a-892d-806436f2c384', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'mac_address': 'fa:16:3e:3f:21:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd4c935be-c982-4fcb-af39-2fc3ae9f8314', 'device_owner': 'network:router_interface', 'standard_attr_id': 1751, 'fixed_ips': [{'subnet_id': '3735bbb3-0479-4b6b-8df7-645fb895c926', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:05:44Z', 'updated_at': '2021-11-09T05:05:48Z', 'revision_number': 5, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'subnets': [{'id': '3735bbb3-0479-4b6b-8df7-645fb895c926', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:06:00.338628 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ed4cfd97-ad27-4ea3-9ce5-4d2d1c4e0e79 req-32d45a5c-038f-4ee8-af48-de3740d080dc service neutron] 10.222.0.26 "GET /v2.0/networks?id=16dfc543-c13b-401a-892d-806436f2c384 HTTP/1.1" status: 200 len: 897 time: 0.0940754 Nov 09 05:06:00.367829 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0e108056-2b2e-4eff-8bd2-7a39582dbab1 None None] Checking router: d4c935be-c982-4fcb-af39-2fc3ae9f8314 for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 05:06:00.376501 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0e108056-2b2e-4eff-8bd2-7a39582dbab1 None None] Routers {'d4c935be-c982-4fcb-af39-2fc3ae9f8314'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:06:00.377123 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-0e108056-2b2e-4eff-8bd2-7a39582dbab1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:05:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['d4c935be-c982-4fcb-af39-2fc3ae9f8314'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:06:00.411588 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ed4cfd97-ad27-4ea3-9ce5-4d2d1c4e0e79 req-5b5ec1eb-284a-44b8-bbb5-fed576887175 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=59ddd742-caef-4443-9ccf-f969e1453d45 HTTP/1.1" status: 200 len: 999 time: 0.0642183 Nov 09 05:06:00.463309 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed4cfd97-ad27-4ea3-9ce5-4d2d1c4e0e79 req-b4d6dd09-db92-4e4b-ad1b-e8e787046fd3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:06:00.464947 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ed4cfd97-ad27-4ea3-9ce5-4d2d1c4e0e79 req-b4d6dd09-db92-4e4b-ad1b-e8e787046fd3 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=3735bbb3-0479-4b6b-8df7-645fb895c926 HTTP/1.1" status: 200 len: 835 time: 0.0462937 Nov 09 05:06:00.486795 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-0e108056-2b2e-4eff-8bd2-7a39582dbab1 None None] Set router d4c935be-c982-4fcb-af39-2fc3ae9f8314 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:06:00.512656 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed4cfd97-ad27-4ea3-9ce5-4d2d1c4e0e79 req-6da652df-97ad-46ff-987a-35815beae7ee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:06:00.514299 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ed4cfd97-ad27-4ea3-9ce5-4d2d1c4e0e79 req-6da652df-97ad-46ff-987a-35815beae7ee service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=16dfc543-c13b-401a-892d-806436f2c384&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0422165 Nov 09 05:06:00.614552 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ed4cfd97-ad27-4ea3-9ce5-4d2d1c4e0e79 req-f891d529-86b6-4e14-ae60-0b19c1538eae service neutron] 10.222.0.26 "GET /v2.0/networks/16dfc543-c13b-401a-892d-806436f2c384?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0927899 Nov 09 05:06:00.666914 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-29d9b273-ad4b-4526-9ab5-2d8b8d9f8d31 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/floatingips/dea9fbba-7f44-4f99-a93a-cca04a117595 HTTP/1.1" status: 200 len: 991 time: 0.3553159 Nov 09 05:06:00.714668 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-0e108056-2b2e-4eff-8bd2-7a39582dbab1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd4c935be-c982-4fcb-af39-2fc3ae9f8314', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1210987163', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.120'}], 'enable_snat': True}, 'gw_port_id': '6777983c-53b7-4614-a4e7-3ad9e839bfeb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:05:41Z', 'updated_at': '2021-11-09T05:05:45Z', 'revision_number': 4, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': '6777983c-53b7-4614-a4e7-3ad9e839bfeb', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:07:ee', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd4c935be-c982-4fcb-af39-2fc3ae9f8314', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1748, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:05:41Z', 'updated_at': '2021-11-09T05:05:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': 'dea9fbba-7f44-4f99-a93a-cca04a117595', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'floating_ip_address': '172.26.0.189', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': 'd4c935be-c982-4fcb-af39-2fc3ae9f8314', 'port_id': '59ddd742-caef-4443-9ccf-f969e1453d45', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 1754, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '16dfc543-c13b-401a-892d-806436f2c384', 'mac_address': 'fa:16:3e:6b:a1:e3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ae343e88-84a9-4629-9c45-ff6312e10860', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T05:05:59Z', 'updated_at': '2021-11-09T05:05:59Z', 'revision_number': 0, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6d945935-f6f2-44ff-8105-51e1ec0f31f1', 'name': '', 'network_id': '16dfc543-c13b-401a-892d-806436f2c384', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'mac_address': 'fa:16:3e:3f:21:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd4c935be-c982-4fcb-af39-2fc3ae9f8314', 'device_owner': 'network:router_interface', 'standard_attr_id': 1751, 'fixed_ips': [{'subnet_id': '3735bbb3-0479-4b6b-8df7-645fb895c926', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:05:44Z', 'updated_at': '2021-11-09T05:05:48Z', 'revision_number': 5, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'subnets': [{'id': '3735bbb3-0479-4b6b-8df7-645fb895c926', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:06:00.715633 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ed4cfd97-ad27-4ea3-9ce5-4d2d1c4e0e79 req-5ed34235-af27-44d1-a7f1-585d0bc6de2b service neutron] 10.222.0.26 "GET /v2.0/networks/16dfc543-c13b-401a-892d-806436f2c384?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0932913 Nov 09 05:06:00.744961 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0e108056-2b2e-4eff-8bd2-7a39582dbab1 None None] The sync data for ids ['d4c935be-c982-4fcb-af39-2fc3ae9f8314'] in dv-neutron-816802-2-hyperv is: [{'id': 'd4c935be-c982-4fcb-af39-2fc3ae9f8314', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1210987163', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.120'}], 'enable_snat': True}, 'gw_port_id': '6777983c-53b7-4614-a4e7-3ad9e839bfeb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:05:41Z', 'updated_at': '2021-11-09T05:05:45Z', 'revision_number': 4, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': '6777983c-53b7-4614-a4e7-3ad9e839bfeb', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:07:ee', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd4c935be-c982-4fcb-af39-2fc3ae9f8314', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1748, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:05:41Z', 'updated_at': '2021-11-09T05:05:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': 'dea9fbba-7f44-4f99-a93a-cca04a117595', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'floating_ip_address': '172.26.0.189', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': 'd4c935be-c982-4fcb-af39-2fc3ae9f8314', 'port_id': '59ddd742-caef-4443-9ccf-f969e1453d45', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 1754, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '16dfc543-c13b-401a-892d-806436f2c384', 'mac_address': 'fa:16:3e:6b:a1:e3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ae343e88-84a9-4629-9c45-ff6312e10860', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T05:05:59Z', 'updated_at': '2021-11-09T05:05:59Z', 'revision_number': 0, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6d945935-f6f2-44ff-8105-51e1ec0f31f1', 'name': '', 'network_id': '16dfc543-c13b-401a-892d-806436f2c384', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'mac_address': 'fa:16:3e:3f:21:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd4c935be-c982-4fcb-af39-2fc3ae9f8314', 'device_owner': 'network:router_interface', 'standard_attr_id': 1751, 'fixed_ips': [{'subnet_id': '3735bbb3-0479-4b6b-8df7-645fb895c926', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:05:44Z', 'updated_at': '2021-11-09T05:05:48Z', 'revision_number': 5, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'subnets': [{'id': '3735bbb3-0479-4b6b-8df7-645fb895c926', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 05:06:00.927900 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0c9817d9-a84b-4da3-bed1-018bafa842e0 None None] New status for floating IP dea9fbba-7f44-4f99-a93a-cca04a117595: ACTIVE {{(pid=102164) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 05:06:01.670140 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 37114) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:06:01.729489 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1f3adbdb-d736-4c45-88e0-142d2de5be5c tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/floatingips/dea9fbba-7f44-4f99-a93a-cca04a117595 HTTP/1.1" status: 200 len: 993 time: 0.0581865 Nov 09 05:06:11.414413 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0ba67024-6c1d-4476-8841-795c40579bff None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:06:12.494049 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:06:13.705465 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f884b89f-3fe4-4304-8e75-8ece5cf98dd8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:06:15.230688 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:06:16.596293 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:06:17.008006 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:06:23.271340 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f4113027-6afd-49bf-863b-684af9f3edb3 req-9642a559-6fbe-4e18-bce0-ecea64949fe7 service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=ae343e88-84a9-4629-9c45-ff6312e10860&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0386248 Nov 09 05:06:23.349831 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4113027-6afd-49bf-863b-684af9f3edb3 req-4c2dd1b6-fe05-4c8d-b2ec-197ab4d2ce35 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:06:23.351296 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f4113027-6afd-49bf-863b-684af9f3edb3 req-4c2dd1b6-fe05-4c8d-b2ec-197ab4d2ce35 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=8ac3eab68bd34485af7ddc3417853b28&device_id=ae343e88-84a9-4629-9c45-ff6312e10860 HTTP/1.1" status: 200 len: 1098 time: 0.0402222 Nov 09 05:06:23.458701 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4113027-6afd-49bf-863b-684af9f3edb3 req-32865493-b9b5-4fcd-8f6a-1f9517e79ecf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:06:23.460151 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f4113027-6afd-49bf-863b-684af9f3edb3 req-32865493-b9b5-4fcd-8f6a-1f9517e79ecf service neutron] 10.222.0.26 "GET /v2.0/networks?id=16dfc543-c13b-401a-892d-806436f2c384 HTTP/1.1" status: 200 len: 897 time: 0.0882277 Nov 09 05:06:23.525454 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f4113027-6afd-49bf-863b-684af9f3edb3 req-38045996-67ee-42c6-87c4-a7871eca94aa service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=59ddd742-caef-4443-9ccf-f969e1453d45 HTTP/1.1" status: 200 len: 1001 time: 0.0562053 Nov 09 05:06:23.573468 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4113027-6afd-49bf-863b-684af9f3edb3 req-d2af5232-578f-410a-a8d0-08f5b835db77 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:06:23.575153 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f4113027-6afd-49bf-863b-684af9f3edb3 req-d2af5232-578f-410a-a8d0-08f5b835db77 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=3735bbb3-0479-4b6b-8df7-645fb895c926 HTTP/1.1" status: 200 len: 835 time: 0.0417836 Nov 09 05:06:23.622708 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4113027-6afd-49bf-863b-684af9f3edb3 req-7a1ea0f8-381b-4645-a23e-0fd64ab587f5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:06:23.624133 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f4113027-6afd-49bf-863b-684af9f3edb3 req-7a1ea0f8-381b-4645-a23e-0fd64ab587f5 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=16dfc543-c13b-401a-892d-806436f2c384&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0415268 Nov 09 05:06:23.710527 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f4113027-6afd-49bf-863b-684af9f3edb3 req-21be1f2a-b117-4fe3-addf-1a60929a48b2 service neutron] 10.222.0.26 "GET /v2.0/networks/16dfc543-c13b-401a-892d-806436f2c384?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0788872 Nov 09 05:06:23.801106 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f4113027-6afd-49bf-863b-684af9f3edb3 req-42ce415f-be97-4c0d-88ba-b37661b58597 service neutron] 10.222.0.26 "GET /v2.0/networks/16dfc543-c13b-401a-892d-806436f2c384?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0829694 Nov 09 05:06:31.450527 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 05:06:32.957466 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [req-4c28778b-3183-4c17-9a8f-43d80f9a6b21 req-013a71c4-28e7-4c47-a75f-c484015755e3 service neutron] http://10.222.0.24:9696/v2.0/extensions returned with HTTP 200 {{(pid=102161) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 05:06:32.958533 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-4c28778b-3183-4c17-9a8f-43d80f9a6b21 req-013a71c4-28e7-4c47-a75f-c484015755e3 service neutron] 10.222.0.24 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0054090 Nov 09 05:06:33.260900 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca65a66a-700c-4e6a-932e-1d3bdd8bc737 req-8c23ac6a-231b-46aa-82c5-734609d66a8e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:06:33.262342 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ca65a66a-700c-4e6a-932e-1d3bdd8bc737 req-8c23ac6a-231b-46aa-82c5-734609d66a8e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=ae343e88-84a9-4629-9c45-ff6312e10860 HTTP/1.1" status: 200 len: 945 time: 0.0479352 Nov 09 05:06:33.310140 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ca65a66a-700c-4e6a-932e-1d3bdd8bc737 req-90ebd071-4fc5-4e66-b461-a177e4760687 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=a10dfbe7-94bf-4308-8c2b-b051bc84e309&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0411990 Nov 09 05:06:33.419692 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 37134) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:06:33.499772 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-23ea2476-61ab-41f5-b6bc-9a34b96e93b6 req-f0d284ca-35b5-4f33-8844-5fa1929c7198 service neutron] 10.222.0.24 "GET /v2.0/ports?device_id=ae343e88-84a9-4629-9c45-ff6312e10860&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0800521 Nov 09 05:06:33.508521 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [req-23ea2476-61ab-41f5-b6bc-9a34b96e93b6 req-bfb949d5-889a-41df-bbd7-be804ba4b1da service neutron] http://10.222.0.24:9696/v2.0/extensions returned with HTTP 200 {{(pid=102161) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 05:06:33.509444 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-23ea2476-61ab-41f5-b6bc-9a34b96e93b6 req-bfb949d5-889a-41df-bbd7-be804ba4b1da service neutron] 10.222.0.24 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0047951 Nov 09 05:06:34.425967 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2c19f19-1fc4-40e3-83fd-a3b0382d144e req-1c98b3a8-5678-4f66-8b10-25a596fe9b6f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:06:34.427437 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c2c19f19-1fc4-40e3-83fd-a3b0382d144e req-1c98b3a8-5678-4f66-8b10-25a596fe9b6f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=ae343e88-84a9-4629-9c45-ff6312e10860 HTTP/1.1" status: 200 len: 945 time: 0.0480773 Nov 09 05:06:34.476097 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c2c19f19-1fc4-40e3-83fd-a3b0382d144e req-043b3157-bff0-4584-8d1e-b6f150d1f816 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=a10dfbe7-94bf-4308-8c2b-b051bc84e309&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0426612 Nov 09 05:06:35.479380 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23ea2476-61ab-41f5-b6bc-9a34b96e93b6 req-80e3984b-3424-402e-bdb0-a677f724a2c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:06:35.480836 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-23ea2476-61ab-41f5-b6bc-9a34b96e93b6 req-80e3984b-3424-402e-bdb0-a677f724a2c8 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=8ac3eab68bd34485af7ddc3417853b28&device_id=ae343e88-84a9-4629-9c45-ff6312e10860 HTTP/1.1" status: 200 len: 1098 time: 0.0395398 Nov 09 05:06:35.605797 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23ea2476-61ab-41f5-b6bc-9a34b96e93b6 req-c70df4f3-f0cd-44c0-9a15-66b8a2120cff service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:06:35.607822 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-23ea2476-61ab-41f5-b6bc-9a34b96e93b6 req-c70df4f3-f0cd-44c0-9a15-66b8a2120cff service neutron] 10.222.0.26 "GET /v2.0/networks?id=16dfc543-c13b-401a-892d-806436f2c384 HTTP/1.1" status: 200 len: 897 time: 0.1178577 Nov 09 05:06:35.615217 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b012595-057e-4f03-8e85-ebcafda65b30 req-647de0af-1c4e-4ee1-949b-fa0a33b5b6a2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:06:35.616554 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-0b012595-057e-4f03-8e85-ebcafda65b30 req-647de0af-1c4e-4ee1-949b-fa0a33b5b6a2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=ae343e88-84a9-4629-9c45-ff6312e10860 HTTP/1.1" status: 200 len: 945 time: 0.0712256 Nov 09 05:06:35.707584 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-23ea2476-61ab-41f5-b6bc-9a34b96e93b6 req-72f8864a-0d12-4b28-b2b5-1f8799ae16e7 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=59ddd742-caef-4443-9ccf-f969e1453d45 HTTP/1.1" status: 200 len: 1001 time: 0.0901015 Nov 09 05:06:35.711473 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-0b012595-057e-4f03-8e85-ebcafda65b30 req-31af1640-dda2-4ed1-a60c-78c2ebfc0d83 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=a10dfbe7-94bf-4308-8c2b-b051bc84e309&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0878625 Nov 09 05:06:35.755889 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23ea2476-61ab-41f5-b6bc-9a34b96e93b6 req-48540a8e-c1e7-4c12-bda7-0b15ce566092 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:06:35.757241 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-23ea2476-61ab-41f5-b6bc-9a34b96e93b6 req-48540a8e-c1e7-4c12-bda7-0b15ce566092 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=3735bbb3-0479-4b6b-8df7-645fb895c926 HTTP/1.1" status: 200 len: 835 time: 0.0428741 Nov 09 05:06:35.801962 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23ea2476-61ab-41f5-b6bc-9a34b96e93b6 req-c3bf5dcc-611b-470f-9768-e74fed7d0828 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:06:35.803503 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-23ea2476-61ab-41f5-b6bc-9a34b96e93b6 req-c3bf5dcc-611b-470f-9768-e74fed7d0828 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=16dfc543-c13b-401a-892d-806436f2c384&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0396190 Nov 09 05:06:35.893234 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-23ea2476-61ab-41f5-b6bc-9a34b96e93b6 req-c209d01e-4393-4221-b81c-9fd15d1f80cf service neutron] 10.222.0.26 "GET /v2.0/networks/16dfc543-c13b-401a-892d-806436f2c384?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0828028 Nov 09 05:06:35.984131 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-23ea2476-61ab-41f5-b6bc-9a34b96e93b6 req-2550fee2-3379-40cf-9924-1cb267a68520 service neutron] 10.222.0.26 "GET /v2.0/networks/16dfc543-c13b-401a-892d-806436f2c384?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0839190 Nov 09 05:06:36.823559 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27582cd9-3a31-4746-985a-93739929ebad req-52adc47d-ab84-48cb-ac08-e773528943b5 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:06:36.825015 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-27582cd9-3a31-4746-985a-93739929ebad req-52adc47d-ab84-48cb-ac08-e773528943b5 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=ae343e88-84a9-4629-9c45-ff6312e10860 HTTP/1.1" status: 200 len: 945 time: 0.0470271 Nov 09 05:06:36.874089 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-27582cd9-3a31-4746-985a-93739929ebad req-34da2e24-bd25-4bec-8648-77b9239de4b5 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=a10dfbe7-94bf-4308-8c2b-b051bc84e309&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0423796 Nov 09 05:06:37.986057 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53617cb2-cecc-4401-8452-5b1b78a8a7db req-5424852a-41c5-411f-87b5-02c4975d2d54 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:06:37.987532 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-53617cb2-cecc-4401-8452-5b1b78a8a7db req-5424852a-41c5-411f-87b5-02c4975d2d54 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=ae343e88-84a9-4629-9c45-ff6312e10860 HTTP/1.1" status: 200 len: 945 time: 0.0480170 Nov 09 05:06:38.035316 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-53617cb2-cecc-4401-8452-5b1b78a8a7db req-adfb61b7-d443-42d6-ba35-c148b5fff719 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=a10dfbe7-94bf-4308-8c2b-b051bc84e309&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0420532 Nov 09 05:06:39.151888 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12f1a2c5-9507-4617-a4f1-b5ed523ef351 req-e3bf6098-c15b-47fa-9216-df8a4c83812b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:06:39.153261 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-12f1a2c5-9507-4617-a4f1-b5ed523ef351 req-e3bf6098-c15b-47fa-9216-df8a4c83812b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=ae343e88-84a9-4629-9c45-ff6312e10860 HTTP/1.1" status: 200 len: 945 time: 0.0520523 Nov 09 05:06:39.200769 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-12f1a2c5-9507-4617-a4f1-b5ed523ef351 req-06c1b4a3-5f98-48e2-9dca-d1c078221ae5 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=a10dfbe7-94bf-4308-8c2b-b051bc84e309&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0409822 Nov 09 05:06:40.313502 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcd537ca-4f21-48aa-b7b7-40d5d831efcb req-4552238c-a259-4e51-ac38-aa87a2d67669 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:06:40.314967 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fcd537ca-4f21-48aa-b7b7-40d5d831efcb req-4552238c-a259-4e51-ac38-aa87a2d67669 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=ae343e88-84a9-4629-9c45-ff6312e10860 HTTP/1.1" status: 200 len: 945 time: 0.0472484 Nov 09 05:06:40.362473 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fcd537ca-4f21-48aa-b7b7-40d5d831efcb req-7538a959-894f-4b20-a875-0f9396767b8c tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=a10dfbe7-94bf-4308-8c2b-b051bc84e309&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0415912 Nov 09 05:06:41.348236 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ef6b638f-59e7-404d-ac9f-1d5709a1a536 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:06:41.475771 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15513278-a27e-47eb-b33f-1b9826d2ea25 req-dee9d9d2-5d33-41a0-a25f-8db73eba239d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:06:41.477234 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-15513278-a27e-47eb-b33f-1b9826d2ea25 req-dee9d9d2-5d33-41a0-a25f-8db73eba239d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=ae343e88-84a9-4629-9c45-ff6312e10860 HTTP/1.1" status: 200 len: 945 time: 0.0484169 Nov 09 05:06:41.524992 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-15513278-a27e-47eb-b33f-1b9826d2ea25 req-86a6ba1a-2c91-4b11-a3d3-9bbace421b1b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=a10dfbe7-94bf-4308-8c2b-b051bc84e309&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0419025 Nov 09 05:06:42.514285 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:06:42.639667 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b53370d-5244-4917-b481-b1a199ada815 req-23701af8-1d89-40e1-ba5c-47df774cf65f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:06:42.641107 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1b53370d-5244-4917-b481-b1a199ada815 req-23701af8-1d89-40e1-ba5c-47df774cf65f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=ae343e88-84a9-4629-9c45-ff6312e10860 HTTP/1.1" status: 200 len: 945 time: 0.0509222 Nov 09 05:06:42.688417 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1b53370d-5244-4917-b481-b1a199ada815 req-c995f545-3626-4eea-b51b-4e02408c9900 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=a10dfbe7-94bf-4308-8c2b-b051bc84e309&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0409787 Nov 09 05:06:43.738051 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8b6dad13-a661-4427-8e45-9deb9caf3fb1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:06:43.808383 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99be9467-d16f-4471-ac51-28297a9d13ee req-362ee05b-c350-495f-a520-3557a7f5741d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:06:43.809822 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-99be9467-d16f-4471-ac51-28297a9d13ee req-362ee05b-c350-495f-a520-3557a7f5741d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=ae343e88-84a9-4629-9c45-ff6312e10860 HTTP/1.1" status: 200 len: 945 time: 0.0521390 Nov 09 05:06:43.858002 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-99be9467-d16f-4471-ac51-28297a9d13ee req-8e836513-a498-4b03-aff1-ba94e54e9ad7 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=a10dfbe7-94bf-4308-8c2b-b051bc84e309&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0416362 Nov 09 05:06:44.970977 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9778653-a4c3-4293-be4f-f717b72ab697 req-68cbe0f0-9f3a-45c8-8450-b4f3b3da8874 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:06:44.972421 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a9778653-a4c3-4293-be4f-f717b72ab697 req-68cbe0f0-9f3a-45c8-8450-b4f3b3da8874 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=ae343e88-84a9-4629-9c45-ff6312e10860 HTTP/1.1" status: 200 len: 945 time: 0.0481985 Nov 09 05:06:45.019782 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a9778653-a4c3-4293-be4f-f717b72ab697 req-d685293d-f78f-4dfc-bac3-91cf0d9cfae2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=a10dfbe7-94bf-4308-8c2b-b051bc84e309&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0416427 Nov 09 05:06:45.234546 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:06:46.133911 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e01fc00-3dfe-4780-88e2-d64430c2d9c7 req-e2552a72-ff09-4f68-8516-41eadaa2217d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:06:46.146285 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-4e01fc00-3dfe-4780-88e2-d64430c2d9c7 req-e2552a72-ff09-4f68-8516-41eadaa2217d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=ae343e88-84a9-4629-9c45-ff6312e10860 HTTP/1.1" status: 200 len: 945 time: 0.0482676 Nov 09 05:06:46.183886 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-4e01fc00-3dfe-4780-88e2-d64430c2d9c7 req-154c16b0-8794-439a-a967-41d12c6f29a4 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=a10dfbe7-94bf-4308-8c2b-b051bc84e309&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0426657 Nov 09 05:06:46.629460 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:06:46.983623 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:06:47.295946 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee9e2073-7dc1-4bff-9adb-3d2d3e80dd18 req-7a4d4b77-b281-4952-b2a4-bede7512520f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:06:47.297398 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ee9e2073-7dc1-4bff-9adb-3d2d3e80dd18 req-7a4d4b77-b281-4952-b2a4-bede7512520f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=ae343e88-84a9-4629-9c45-ff6312e10860 HTTP/1.1" status: 200 len: 945 time: 0.0480275 Nov 09 05:06:47.348771 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ee9e2073-7dc1-4bff-9adb-3d2d3e80dd18 req-0094cb3f-0521-4db2-9751-680e67284260 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=a10dfbe7-94bf-4308-8c2b-b051bc84e309&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0456889 Nov 09 05:06:47.925003 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-23ea2476-61ab-41f5-b6bc-9a34b96e93b6 req-109bbc12-7f99-414e-9e63-0447f55d570c service neutron] 10.222.0.26 "GET /v2.0/ports/59ddd742-caef-4443-9ccf-f969e1453d45/bindings/hv-neutron-8168 HTTP/1.1" status: 200 len: 384 time: 0.0532045 Nov 09 05:06:48.283954 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23ea2476-61ab-41f5-b6bc-9a34b96e93b6 req-ad754192-56bb-402c-8aaf-1950b95b9278 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:06:48.285447 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-23ea2476-61ab-41f5-b6bc-9a34b96e93b6 req-ad754192-56bb-402c-8aaf-1950b95b9278 service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=ae343e88-84a9-4629-9c45-ff6312e10860&tenant_id=8ac3eab68bd34485af7ddc3417853b28 HTTP/1.1" status: 200 len: 1098 time: 0.0403056 Nov 09 05:06:48.344753 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23ea2476-61ab-41f5-b6bc-9a34b96e93b6 req-4998a701-683a-48d2-8c69-ee5abeb9cb67 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:06:48.346897 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-23ea2476-61ab-41f5-b6bc-9a34b96e93b6 req-4998a701-683a-48d2-8c69-ee5abeb9cb67 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=8ac3eab68bd34485af7ddc3417853b28&device_id=ae343e88-84a9-4629-9c45-ff6312e10860 HTTP/1.1" status: 200 len: 1098 time: 0.0389564 Nov 09 05:06:48.440595 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23ea2476-61ab-41f5-b6bc-9a34b96e93b6 req-48f2df8c-7008-4291-b53e-e69832b40b81 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:06:48.442063 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-23ea2476-61ab-41f5-b6bc-9a34b96e93b6 req-48f2df8c-7008-4291-b53e-e69832b40b81 service neutron] 10.222.0.26 "GET /v2.0/networks?id=16dfc543-c13b-401a-892d-806436f2c384 HTTP/1.1" status: 200 len: 897 time: 0.0886562 Nov 09 05:06:48.462445 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fea3de3-d3be-4156-9b4a-1a15d8a77b38 req-e864330c-c8d6-4c6d-bdbd-863b2174b6e6 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:06:48.463949 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-2fea3de3-d3be-4156-9b4a-1a15d8a77b38 req-e864330c-c8d6-4c6d-bdbd-863b2174b6e6 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=ae343e88-84a9-4629-9c45-ff6312e10860 HTTP/1.1" status: 200 len: 945 time: 0.0482128 Nov 09 05:06:48.507293 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-23ea2476-61ab-41f5-b6bc-9a34b96e93b6 req-f0c14237-fcda-45ff-960b-a450b62490ba service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=59ddd742-caef-4443-9ccf-f969e1453d45 HTTP/1.1" status: 200 len: 1001 time: 0.0582788 Nov 09 05:06:48.516545 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-2fea3de3-d3be-4156-9b4a-1a15d8a77b38 req-ec14ca67-d970-4e92-b4ed-b8b4ab4d2974 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=a10dfbe7-94bf-4308-8c2b-b051bc84e309&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0466132 Nov 09 05:06:48.854862 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23ea2476-61ab-41f5-b6bc-9a34b96e93b6 req-bcc6f910-02d8-4207-a09f-5932673343ec service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:06:48.857393 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-23ea2476-61ab-41f5-b6bc-9a34b96e93b6 req-bcc6f910-02d8-4207-a09f-5932673343ec service neutron] 10.222.0.26 "GET /v2.0/subnets?id=3735bbb3-0479-4b6b-8df7-645fb895c926 HTTP/1.1" status: 200 len: 835 time: 0.3436122 Nov 09 05:06:48.902896 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23ea2476-61ab-41f5-b6bc-9a34b96e93b6 req-5945fc2c-8e40-4cbd-9b81-0ccdb5e214f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:06:48.904365 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-23ea2476-61ab-41f5-b6bc-9a34b96e93b6 req-5945fc2c-8e40-4cbd-9b81-0ccdb5e214f9 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=16dfc543-c13b-401a-892d-806436f2c384&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0394716 Nov 09 05:06:48.992962 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-23ea2476-61ab-41f5-b6bc-9a34b96e93b6 req-70851558-6dc3-4877-abf7-b1452ab5db78 service neutron] 10.222.0.26 "GET /v2.0/networks/16dfc543-c13b-401a-892d-806436f2c384?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0813165 Nov 09 05:06:49.083318 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-23ea2476-61ab-41f5-b6bc-9a34b96e93b6 req-a829a326-1211-48e1-b2db-80cd5a588c54 service neutron] 10.222.0.26 "GET /v2.0/networks/16dfc543-c13b-401a-892d-806436f2c384?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0830054 Nov 09 05:06:49.634994 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da64cd08-43e7-46cd-ab29-fd31202efefe req-611eeced-a67d-439a-9a9c-0d4436ca3e84 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:06:49.636361 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-da64cd08-43e7-46cd-ab29-fd31202efefe req-611eeced-a67d-439a-9a9c-0d4436ca3e84 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=ae343e88-84a9-4629-9c45-ff6312e10860 HTTP/1.1" status: 200 len: 945 time: 0.0500009 Nov 09 05:06:49.689847 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-da64cd08-43e7-46cd-ab29-fd31202efefe req-370208d8-8c2a-4f96-ae0a-ad4216e33a37 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=a10dfbe7-94bf-4308-8c2b-b051bc84e309&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0473838 Nov 09 05:06:50.804958 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aea0ce7a-336e-41f4-b1e1-5184f62411b4 req-3d7c5425-0add-4959-84e8-0a6ba7551aec tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:06:50.806445 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-aea0ce7a-336e-41f4-b1e1-5184f62411b4 req-3d7c5425-0add-4959-84e8-0a6ba7551aec tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=ae343e88-84a9-4629-9c45-ff6312e10860 HTTP/1.1" status: 200 len: 945 time: 0.0488920 Nov 09 05:06:50.855882 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-aea0ce7a-336e-41f4-b1e1-5184f62411b4 req-73431c73-874d-40b6-ab49-2d8331207a47 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=a10dfbe7-94bf-4308-8c2b-b051bc84e309&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0434504 Nov 09 05:06:51.367757 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 59ddd742-caef-4443-9ccf-f969e1453d45 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=102163) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 09 05:06:51.369816 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 59ddd742-caef-4443-9ccf-f969e1453d45 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 05:06:51.509111 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:06:51.532686 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 59ddd742-caef-4443-9ccf-f969e1453d45, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=59ddd742-caef-4443-9ccf-f969e1453d45,segment=NetworkSegment(04920539-e2ad-49d5-b0a6-718337b9e8b0),segment_id=04920539-e2ad-49d5-b0a6-718337b9e8b0)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:06:51.553623 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ae343e88-84a9-4629-9c45-ff6312e10860', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '59ddd742-caef-4443-9ccf-f969e1453d45'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:06:51.555869 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6400aa11-c5f9-46aa-849c-fb9e6a216698" -d '{"events": [{"server_uuid": "ae343e88-84a9-4629-9c45-ff6312e10860", "name": "network-vif-unplugged", "status": "completed", "tag": "59ddd742-caef-4443-9ccf-f969e1453d45"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:06:51.569346 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Returning: {'device': '59ddd742-caef-4443-9ccf-f969e1453d45', 'network_id': '16dfc543-c13b-401a-892d-806436f2c384', 'port_id': '59ddd742-caef-4443-9ccf-f969e1453d45', 'mac_address': 'fa:16:3e:6b:a1:e3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 304, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '3735bbb3-0479-4b6b-8df7-645fb895c926', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102163) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 09 05:06:51.571094 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 59ddd742-caef-4443-9ccf-f969e1453d45, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=59ddd742-caef-4443-9ccf-f969e1453d45,segment=NetworkSegment(04920539-e2ad-49d5-b0a6-718337b9e8b0),segment_id=04920539-e2ad-49d5-b0a6-718337b9e8b0)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:06:51.605649 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 09 Nov 2021 05:06:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-94783096-14ef-41c9-8871-099572c99cbd x-openstack-request-id: req-94783096-14ef-41c9-8871-099572c99cbd {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:06:51.605933 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ae343e88-84a9-4629-9c45-ff6312e10860", "name": "network-vif-unplugged", "status": "completed", "tag": "59ddd742-caef-4443-9ccf-f969e1453d45", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:06:51.606312 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-94783096-14ef-41c9-8871-099572c99cbd {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:06:51.606798 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ae343e88-84a9-4629-9c45-ff6312e10860', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '59ddd742-caef-4443-9ccf-f969e1453d45', 'code': 200} Nov 09 05:06:51.608887 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:06:51.621744 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 59ddd742-caef-4443-9ccf-f969e1453d45 {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 05:06:51.636037 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:06:51.708482 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.db.api [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=102163) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 05:06:51.708829 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG oslo_db.api [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 05:06:51.709667 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=59ddd742-caef-4443-9ccf-f969e1453d45,revision_number=6']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:06:51.716447 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:06:51.716789 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:06:51.717124 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:06:51.717452 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:06:51.717776 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:06:51.718102 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:06:51.718444 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:06:51.718766 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:06:51.719085 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:06:51.719400 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:06:51.719713 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:06:51.720024 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:06:51.971778 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f48c8dc0-dcb8-4104-904b-2d47484517bf req-da5e60af-cc18-46a0-9a86-5936c612552b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:06:51.973275 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f48c8dc0-dcb8-4104-904b-2d47484517bf req-da5e60af-cc18-46a0-9a86-5936c612552b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=ae343e88-84a9-4629-9c45-ff6312e10860 HTTP/1.1" status: 200 len: 943 time: 0.0488660 Nov 09 05:06:52.020865 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f48c8dc0-dcb8-4104-904b-2d47484517bf req-7c6fa244-b702-43b4-b144-c1b559d40e45 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=a10dfbe7-94bf-4308-8c2b-b051bc84e309&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0417178 Nov 09 05:06:52.245780 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:06:52.260526 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 59ddd742-caef-4443-9ccf-f969e1453d45 {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 05:06:52.279310 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 59ddd742-caef-4443-9ccf-f969e1453d45, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=59ddd742-caef-4443-9ccf-f969e1453d45,segment=NetworkSegment(04920539-e2ad-49d5-b0a6-718337b9e8b0),segment_id=04920539-e2ad-49d5-b0a6-718337b9e8b0)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:06:52.335590 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2397f4c8-2564-4ade-b4f0-308f98103218 req-502e8a9d-ca3b-42af-a71e-87e7c2455078 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:06:52.337407 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-2397f4c8-2564-4ade-b4f0-308f98103218 req-502e8a9d-ca3b-42af-a71e-87e7c2455078 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=ae343e88-84a9-4629-9c45-ff6312e10860 HTTP/1.1" status: 200 len: 943 time: 0.0572011 Nov 09 05:06:52.367305 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:06:52.388579 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-2397f4c8-2564-4ade-b4f0-308f98103218 req-64146b15-8cc0-4a2b-a106-7d912e0d63d5 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=a10dfbe7-94bf-4308-8c2b-b051bc84e309&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0451930 Nov 09 05:06:52.395518 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-426dbbac-a241-492d-b3d5-6ccd26d17785 req-860980b0-728e-4010-b0a3-bc89d2cfa536 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:06:52.397134 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-426dbbac-a241-492d-b3d5-6ccd26d17785 req-860980b0-728e-4010-b0a3-bc89d2cfa536 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.26 "GET /v2.0/ports?device_id=ae343e88-84a9-4629-9c45-ff6312e10860&tenant_id=8ac3eab68bd34485af7ddc3417853b28&binding%3Ahost_id=hv-neutron-8168 HTTP/1.1" status: 200 len: 943 time: 0.0521240 Nov 09 05:06:52.431386 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['59ddd742-caef-4443-9ccf-f969e1453d45'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 05:06:52.435645 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=59ddd742-caef-4443-9ccf-f969e1453d45,revision_number=7']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:06:52.516053 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-426dbbac-a241-492d-b3d5-6ccd26d17785 req-a40c0cf7-202c-4058-a952-9887c4bd77d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:06:52.518698 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-426dbbac-a241-492d-b3d5-6ccd26d17785 req-a40c0cf7-202c-4058-a952-9887c4bd77d2 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=8ac3eab68bd34485af7ddc3417853b28&device_id=ae343e88-84a9-4629-9c45-ff6312e10860 HTTP/1.1" status: 200 len: 1097 time: 0.0757647 Nov 09 05:06:52.531189 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca94b4eb-79ca-4281-a86a-28733f44c1c9 req-c989042a-75f6-47f8-a917-872d43cd0505 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:06:52.532726 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ca94b4eb-79ca-4281-a86a-28733f44c1c9 req-c989042a-75f6-47f8-a917-872d43cd0505 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=ae343e88-84a9-4629-9c45-ff6312e10860 HTTP/1.1" status: 200 len: 944 time: 0.0643096 Nov 09 05:06:52.640019 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ca94b4eb-79ca-4281-a86a-28733f44c1c9 req-ecf25cf9-9ceb-4313-9f75-96d489a9ebca tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=a10dfbe7-94bf-4308-8c2b-b051bc84e309&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0980916 Nov 09 05:06:52.660967 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-426dbbac-a241-492d-b3d5-6ccd26d17785 req-7f54bb66-f931-47a7-bd89-e1d59335b9d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:06:52.662415 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-426dbbac-a241-492d-b3d5-6ccd26d17785 req-7f54bb66-f931-47a7-bd89-e1d59335b9d0 service neutron] 10.222.0.26 "GET /v2.0/networks?id=16dfc543-c13b-401a-892d-806436f2c384 HTTP/1.1" status: 200 len: 897 time: 0.1287739 Nov 09 05:06:52.731371 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-426dbbac-a241-492d-b3d5-6ccd26d17785 req-fb89f091-9991-4e14-8ef6-6485c0a4fb2a service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=59ddd742-caef-4443-9ccf-f969e1453d45 HTTP/1.1" status: 200 len: 1000 time: 0.0623109 Nov 09 05:06:52.780065 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-426dbbac-a241-492d-b3d5-6ccd26d17785 req-e4a5bcfa-9a2d-4bd8-a517-6896164905d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:06:52.781475 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-426dbbac-a241-492d-b3d5-6ccd26d17785 req-e4a5bcfa-9a2d-4bd8-a517-6896164905d1 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=3735bbb3-0479-4b6b-8df7-645fb895c926 HTTP/1.1" status: 200 len: 835 time: 0.0427041 Nov 09 05:06:52.825698 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-426dbbac-a241-492d-b3d5-6ccd26d17785 req-ba53488f-527d-4c9c-9f40-f78b84883fa5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:06:52.827188 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-426dbbac-a241-492d-b3d5-6ccd26d17785 req-ba53488f-527d-4c9c-9f40-f78b84883fa5 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=16dfc543-c13b-401a-892d-806436f2c384&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0391932 Nov 09 05:06:52.919222 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-426dbbac-a241-492d-b3d5-6ccd26d17785 req-916d6c0e-73eb-4544-baca-ba520e513cc2 service neutron] 10.222.0.26 "GET /v2.0/networks/16dfc543-c13b-401a-892d-806436f2c384?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0842874 Nov 09 05:06:53.008087 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-426dbbac-a241-492d-b3d5-6ccd26d17785 req-4de3c32c-e415-46f1-b931-165ba6c28bd0 service neutron] 10.222.0.26 "GET /v2.0/networks/16dfc543-c13b-401a-892d-806436f2c384?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0810738 Nov 09 05:06:53.382935 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 59ddd742-caef-4443-9ccf-f969e1453d45 up at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:06:53.432776 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning complete for port 59ddd742-caef-4443-9ccf-f969e1453d45 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:06:53.433446 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:06:53.507609 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:06:53.538918 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 59ddd742-caef-4443-9ccf-f969e1453d45, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=59ddd742-caef-4443-9ccf-f969e1453d45,segment=NetworkSegment(04920539-e2ad-49d5-b0a6-718337b9e8b0),segment_id=04920539-e2ad-49d5-b0a6-718337b9e8b0)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:06:53.607486 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ae343e88-84a9-4629-9c45-ff6312e10860', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '59ddd742-caef-4443-9ccf-f969e1453d45'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:06:53.609781 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4d9f97cf-f128-4a04-8c23-849d2f1e4bc6" -d '{"events": [{"server_uuid": "ae343e88-84a9-4629-9c45-ff6312e10860", "name": "network-vif-plugged", "status": "completed", "tag": "59ddd742-caef-4443-9ccf-f969e1453d45"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:06:53.636172 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:06:53.663423 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 05:06:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6971a90d-2189-4650-8c54-09f895253c01 x-openstack-request-id: req-6971a90d-2189-4650-8c54-09f895253c01 {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:06:53.663851 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ae343e88-84a9-4629-9c45-ff6312e10860", "name": "network-vif-plugged", "status": "completed", "tag": "59ddd742-caef-4443-9ccf-f969e1453d45", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:06:53.664068 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-6971a90d-2189-4650-8c54-09f895253c01 {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:06:53.664442 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ae343e88-84a9-4629-9c45-ff6312e10860', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '59ddd742-caef-4443-9ccf-f969e1453d45', 'code': 200} Nov 09 05:06:53.690208 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=59ddd742-caef-4443-9ccf-f969e1453d45,revision_number=8']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:06:53.761860 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89ed2a53-687b-42cb-b843-0d95a07bd0e8 req-495aa764-e7b9-416d-bf14-ea5d639a5ea9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:06:53.763361 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-89ed2a53-687b-42cb-b843-0d95a07bd0e8 req-495aa764-e7b9-416d-bf14-ea5d639a5ea9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=ae343e88-84a9-4629-9c45-ff6312e10860 HTTP/1.1" status: 200 len: 945 time: 0.0523431 Nov 09 05:06:53.813613 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-89ed2a53-687b-42cb-b843-0d95a07bd0e8 req-c6b669ec-e355-4176-be45-5948e1900ebe tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=a10dfbe7-94bf-4308-8c2b-b051bc84e309&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0436938 Nov 09 05:06:54.931481 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca0212a1-8a36-433a-a8e3-24a9c2ffef82 req-351caca5-6858-4f87-9f4a-ffd0914da9f3 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:06:54.932932 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ca0212a1-8a36-433a-a8e3-24a9c2ffef82 req-351caca5-6858-4f87-9f4a-ffd0914da9f3 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=ae343e88-84a9-4629-9c45-ff6312e10860 HTTP/1.1" status: 200 len: 945 time: 0.0487881 Nov 09 05:06:54.980488 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ca0212a1-8a36-433a-a8e3-24a9c2ffef82 req-0e12d633-8da7-4be4-9fa3-c5e7b9807980 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=a10dfbe7-94bf-4308-8c2b-b051bc84e309&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0415714 Nov 09 05:06:55.002283 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 37210) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:06:55.063827 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1171f3b0-40a8-45d5-9a46-767b6a03fecb tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/floatingips/dea9fbba-7f44-4f99-a93a-cca04a117595 HTTP/1.1" status: 200 len: 993 time: 0.0603976 Nov 09 05:07:08.448585 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 05:07:11.357503 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-20cacb8e-eaca-46d7-9070-8042a0b58e6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:12.489093 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:13.706215 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c8f210fe-a2e5-4450-a35a-74cf4c9bf815 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:15.267058 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:16.603750 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:17.003589 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:23.794834 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 37220) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:07:23.947760 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-41eb4d99-b0f1-4b73-9caf-ee1bf73ee2f1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Deleting port 641fa773-0d07-4c66-a47b-1430648e8056 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:07:23.948101 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-41eb4d99-b0f1-4b73-9caf-ee1bf73ee2f1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:24.026583 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-41eb4d99-b0f1-4b73-9caf-ee1bf73ee2f1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:24.026917 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-41eb4d99-b0f1-4b73-9caf-ee1bf73ee2f1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:24.039241 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-41eb4d99-b0f1-4b73-9caf-ee1bf73ee2f1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Calling delete_port for 641fa773-0d07-4c66-a47b-1430648e8056 owned by network:floatingip {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:07:24.244978 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-41eb4d99-b0f1-4b73-9caf-ee1bf73ee2f1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:24.269247 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f63d30ec-dce0-4ed3-ab3b-cb119d35301b req-1e7525f1-4bec-4ea7-a1f4-5ee7f38b72d9 service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=ae343e88-84a9-4629-9c45-ff6312e10860&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0397604 Nov 09 05:07:24.275774 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41eb4d99-b0f1-4b73-9caf-ee1bf73ee2f1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event deleted for resources: {'Port': ['ID=641fa773-0d07-4c66-a47b-1430648e8056,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:07:24.298735 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41eb4d99-b0f1-4b73-9caf-ee1bf73ee2f1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:07:24.299083 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41eb4d99-b0f1-4b73-9caf-ee1bf73ee2f1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:07:24.299426 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41eb4d99-b0f1-4b73-9caf-ee1bf73ee2f1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:07:24.299761 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41eb4d99-b0f1-4b73-9caf-ee1bf73ee2f1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:07:24.300094 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41eb4d99-b0f1-4b73-9caf-ee1bf73ee2f1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:07:24.300420 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41eb4d99-b0f1-4b73-9caf-ee1bf73ee2f1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:07:24.300744 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41eb4d99-b0f1-4b73-9caf-ee1bf73ee2f1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:07:24.301065 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41eb4d99-b0f1-4b73-9caf-ee1bf73ee2f1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:07:24.301843 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41eb4d99-b0f1-4b73-9caf-ee1bf73ee2f1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:07:24.302172 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41eb4d99-b0f1-4b73-9caf-ee1bf73ee2f1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:07:24.302565 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41eb4d99-b0f1-4b73-9caf-ee1bf73ee2f1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:07:24.303065 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41eb4d99-b0f1-4b73-9caf-ee1bf73ee2f1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:07:24.346111 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-41eb4d99-b0f1-4b73-9caf-ee1bf73ee2f1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for floatingip, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:24.349206 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.l3_db [None req-41eb4d99-b0f1-4b73-9caf-ee1bf73ee2f1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Floating IP dea9fbba-7f44-4f99-a93a-cca04a117595 disassociated (deleted). External IP: 172.26.0.189, port: 59ddd742-caef-4443-9ccf-f969e1453d45. Nov 09 05:07:24.349345 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f63d30ec-dce0-4ed3-ab3b-cb119d35301b req-5f1421dc-1aa8-4e83-8825-99f696969f50 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:07:24.350166 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f63d30ec-dce0-4ed3-ab3b-cb119d35301b req-5f1421dc-1aa8-4e83-8825-99f696969f50 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=8ac3eab68bd34485af7ddc3417853b28&device_id=ae343e88-84a9-4629-9c45-ff6312e10860 HTTP/1.1" status: 200 len: 1098 time: 0.0410016 Nov 09 05:07:24.457283 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f63d30ec-dce0-4ed3-ab3b-cb119d35301b req-1faac456-7211-4c73-aff5-b5c7ca5dbae0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:07:24.458791 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f63d30ec-dce0-4ed3-ab3b-cb119d35301b req-1faac456-7211-4c73-aff5-b5c7ca5dbae0 service neutron] 10.222.0.26 "GET /v2.0/networks?id=16dfc543-c13b-401a-892d-806436f2c384 HTTP/1.1" status: 200 len: 897 time: 0.0885947 Nov 09 05:07:24.500887 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f63d30ec-dce0-4ed3-ab3b-cb119d35301b req-844c07d4-fa31-4cd8-9f96-fe3872fe6af1 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=59ddd742-caef-4443-9ccf-f969e1453d45 HTTP/1.1" status: 200 len: 217 time: 0.0339088 Nov 09 05:07:24.550437 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f63d30ec-dce0-4ed3-ab3b-cb119d35301b req-85d9283d-a513-4003-8ada-b8b8669edd39 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:07:24.551897 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f63d30ec-dce0-4ed3-ab3b-cb119d35301b req-85d9283d-a513-4003-8ada-b8b8669edd39 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=3735bbb3-0479-4b6b-8df7-645fb895c926 HTTP/1.1" status: 200 len: 835 time: 0.0441253 Nov 09 05:07:24.552616 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-41eb4d99-b0f1-4b73-9caf-ee1bf73ee2f1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Router d4c935be-c982-4fcb-af39-2fc3ae9f8314 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 05:07:24.641241 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f63d30ec-dce0-4ed3-ab3b-cb119d35301b req-0bbe175d-1701-49d1-847d-945e66102c90 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:07:24.642767 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f63d30ec-dce0-4ed3-ab3b-cb119d35301b req-0bbe175d-1701-49d1-847d-945e66102c90 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=16dfc543-c13b-401a-892d-806436f2c384&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0838737 Nov 09 05:07:24.693580 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-41eb4d99-b0f1-4b73-9caf-ee1bf73ee2f1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 05:07:24.698529 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-41eb4d99-b0f1-4b73-9caf-ee1bf73ee2f1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:24.704486 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9fce2672-5beb-48ef-88b2-9624d6735854 None None] Sync routers for ids ['d4c935be-c982-4fcb-af39-2fc3ae9f8314'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 05:07:24.714545 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9fce2672-5beb-48ef-88b2-9624d6735854 None None] Routers {'d4c935be-c982-4fcb-af39-2fc3ae9f8314'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:07:24.715667 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-9fce2672-5beb-48ef-88b2-9624d6735854 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:07:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['d4c935be-c982-4fcb-af39-2fc3ae9f8314'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:07:24.727912 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-41eb4d99-b0f1-4b73-9caf-ee1bf73ee2f1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "DELETE /v2.0/floatingips/dea9fbba-7f44-4f99-a93a-cca04a117595 HTTP/1.1" status: 204 len: 168 time: 0.9294779 Nov 09 05:07:24.727912 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ae343e88-84a9-4629-9c45-ff6312e10860', 'tag': '59ddd742-caef-4443-9ccf-f969e1453d45'}] {{(pid=102161) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:07:24.734778 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}99dfdda0def497b4372884ef2eb87f06b1e425c8eba5ceda5f64bbab037a07d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6db9c26f-ed5b-47ec-9e59-71ecddb50337" -d '{"events": [{"name": "network-changed", "server_uuid": "ae343e88-84a9-4629-9c45-ff6312e10860", "tag": "59ddd742-caef-4443-9ccf-f969e1453d45"}]}' {{(pid=102161) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:07:24.736614 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f63d30ec-dce0-4ed3-ab3b-cb119d35301b req-c981407a-f668-4bd2-b228-8f754875ced8 service neutron] 10.222.0.26 "GET /v2.0/networks/16dfc543-c13b-401a-892d-806436f2c384?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0862203 Nov 09 05:07:24.836071 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 05:07:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5f59c842-2153-4c8c-8f0d-8b757a43bca8 x-openstack-request-id: req-5f59c842-2153-4c8c-8f0d-8b757a43bca8 {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:07:24.836607 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-9fce2672-5beb-48ef-88b2-9624d6735854 None None] Set router d4c935be-c982-4fcb-af39-2fc3ae9f8314 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:07:24.836709 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ae343e88-84a9-4629-9c45-ff6312e10860", "tag": "59ddd742-caef-4443-9ccf-f969e1453d45", "status": "completed", "code": 200}]} {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:07:24.836709 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-5f59c842-2153-4c8c-8f0d-8b757a43bca8 {{(pid=102161) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:07:24.837582 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ae343e88-84a9-4629-9c45-ff6312e10860', 'tag': '59ddd742-caef-4443-9ccf-f969e1453d45', 'status': 'completed', 'code': 200} Nov 09 05:07:24.853424 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f63d30ec-dce0-4ed3-ab3b-cb119d35301b req-c5a6a909-8a09-4e04-b5f6-79e550e8c4f1 service neutron] 10.222.0.26 "GET /v2.0/networks/16dfc543-c13b-401a-892d-806436f2c384?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1090872 Nov 09 05:07:25.033104 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-9fce2672-5beb-48ef-88b2-9624d6735854 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd4c935be-c982-4fcb-af39-2fc3ae9f8314', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1210987163', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.120'}], 'enable_snat': True}, 'gw_port_id': '6777983c-53b7-4614-a4e7-3ad9e839bfeb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:05:41Z', 'updated_at': '2021-11-09T05:05:45Z', 'revision_number': 4, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': '6777983c-53b7-4614-a4e7-3ad9e839bfeb', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:07:ee', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd4c935be-c982-4fcb-af39-2fc3ae9f8314', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1748, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:05:41Z', 'updated_at': '2021-11-09T05:05:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '6d945935-f6f2-44ff-8105-51e1ec0f31f1', 'name': '', 'network_id': '16dfc543-c13b-401a-892d-806436f2c384', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'mac_address': 'fa:16:3e:3f:21:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd4c935be-c982-4fcb-af39-2fc3ae9f8314', 'device_owner': 'network:router_interface', 'standard_attr_id': 1751, 'fixed_ips': [{'subnet_id': '3735bbb3-0479-4b6b-8df7-645fb895c926', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:05:44Z', 'updated_at': '2021-11-09T05:05:48Z', 'revision_number': 5, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'subnets': [{'id': '3735bbb3-0479-4b6b-8df7-645fb895c926', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:07:25.038607 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6db9c26f-ed5b-47ec-9e59-71ecddb50337 req-0600b76b-07a9-4c33-a496-ce0d177de2e2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:07:25.044205 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6db9c26f-ed5b-47ec-9e59-71ecddb50337 req-0600b76b-07a9-4c33-a496-ce0d177de2e2 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=8ac3eab68bd34485af7ddc3417853b28&device_id=ae343e88-84a9-4629-9c45-ff6312e10860 HTTP/1.1" status: 200 len: 1098 time: 0.0409520 Nov 09 05:07:25.059062 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9fce2672-5beb-48ef-88b2-9624d6735854 None None] Checking router: d4c935be-c982-4fcb-af39-2fc3ae9f8314 for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 05:07:25.068447 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9fce2672-5beb-48ef-88b2-9624d6735854 None None] Routers {'d4c935be-c982-4fcb-af39-2fc3ae9f8314'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:07:25.069050 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-9fce2672-5beb-48ef-88b2-9624d6735854 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:07:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['d4c935be-c982-4fcb-af39-2fc3ae9f8314'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:07:25.141758 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6db9c26f-ed5b-47ec-9e59-71ecddb50337 req-6c6c13a0-8784-4a32-9ba3-f3b27d422b46 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:07:25.143279 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6db9c26f-ed5b-47ec-9e59-71ecddb50337 req-6c6c13a0-8784-4a32-9ba3-f3b27d422b46 service neutron] 10.222.0.26 "GET /v2.0/networks?id=16dfc543-c13b-401a-892d-806436f2c384 HTTP/1.1" status: 200 len: 897 time: 0.0937734 Nov 09 05:07:25.179425 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-9fce2672-5beb-48ef-88b2-9624d6735854 None None] Set router d4c935be-c982-4fcb-af39-2fc3ae9f8314 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:07:25.196604 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6db9c26f-ed5b-47ec-9e59-71ecddb50337 req-a199aa93-a0c6-40a9-a57e-98a96d0cfa2c service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=59ddd742-caef-4443-9ccf-f969e1453d45 HTTP/1.1" status: 200 len: 217 time: 0.0378356 Nov 09 05:07:25.274674 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6db9c26f-ed5b-47ec-9e59-71ecddb50337 req-ae395ff8-9a4a-4393-88a0-efb01e02aa81 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:07:25.276130 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6db9c26f-ed5b-47ec-9e59-71ecddb50337 req-ae395ff8-9a4a-4393-88a0-efb01e02aa81 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=3735bbb3-0479-4b6b-8df7-645fb895c926 HTTP/1.1" status: 200 len: 835 time: 0.0722659 Nov 09 05:07:25.288370 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba253bb7-650a-4304-b0cf-328b1f6e7849 req-0dcc2130-14d2-4895-9162-7d1dd73118b8 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:07:25.289710 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ba253bb7-650a-4304-b0cf-328b1f6e7849 req-0dcc2130-14d2-4895-9162-7d1dd73118b8 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=ae343e88-84a9-4629-9c45-ff6312e10860 HTTP/1.1" status: 200 len: 945 time: 0.0959365 Nov 09 05:07:25.361378 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6db9c26f-ed5b-47ec-9e59-71ecddb50337 req-0a2aa2dd-c853-47ef-ae2d-0bb136b495ef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:07:25.362921 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6db9c26f-ed5b-47ec-9e59-71ecddb50337 req-0a2aa2dd-c853-47ef-ae2d-0bb136b495ef service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=16dfc543-c13b-401a-892d-806436f2c384&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0723491 Nov 09 05:07:25.367887 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ba253bb7-650a-4304-b0cf-328b1f6e7849 req-7baaf7b8-f3e8-4bfd-9857-0e60827c0a9e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=a10dfbe7-94bf-4308-8c2b-b051bc84e309&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0694323 Nov 09 05:07:25.376098 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-9fce2672-5beb-48ef-88b2-9624d6735854 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd4c935be-c982-4fcb-af39-2fc3ae9f8314', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1210987163', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.120'}], 'enable_snat': True}, 'gw_port_id': '6777983c-53b7-4614-a4e7-3ad9e839bfeb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:05:41Z', 'updated_at': '2021-11-09T05:05:45Z', 'revision_number': 4, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': '6777983c-53b7-4614-a4e7-3ad9e839bfeb', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:07:ee', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd4c935be-c982-4fcb-af39-2fc3ae9f8314', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1748, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:05:41Z', 'updated_at': '2021-11-09T05:05:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '6d945935-f6f2-44ff-8105-51e1ec0f31f1', 'name': '', 'network_id': '16dfc543-c13b-401a-892d-806436f2c384', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'mac_address': 'fa:16:3e:3f:21:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd4c935be-c982-4fcb-af39-2fc3ae9f8314', 'device_owner': 'network:router_interface', 'standard_attr_id': 1751, 'fixed_ips': [{'subnet_id': '3735bbb3-0479-4b6b-8df7-645fb895c926', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:05:44Z', 'updated_at': '2021-11-09T05:05:48Z', 'revision_number': 5, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'subnets': [{'id': '3735bbb3-0479-4b6b-8df7-645fb895c926', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:07:25.401802 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9fce2672-5beb-48ef-88b2-9624d6735854 None None] The sync data for ids ['d4c935be-c982-4fcb-af39-2fc3ae9f8314'] in dv-neutron-816802-2-hyperv is: [{'id': 'd4c935be-c982-4fcb-af39-2fc3ae9f8314', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1210987163', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.120'}], 'enable_snat': True}, 'gw_port_id': '6777983c-53b7-4614-a4e7-3ad9e839bfeb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:05:41Z', 'updated_at': '2021-11-09T05:05:45Z', 'revision_number': 4, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': '6777983c-53b7-4614-a4e7-3ad9e839bfeb', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:07:ee', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd4c935be-c982-4fcb-af39-2fc3ae9f8314', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1748, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:05:41Z', 'updated_at': '2021-11-09T05:05:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '6d945935-f6f2-44ff-8105-51e1ec0f31f1', 'name': '', 'network_id': '16dfc543-c13b-401a-892d-806436f2c384', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'mac_address': 'fa:16:3e:3f:21:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd4c935be-c982-4fcb-af39-2fc3ae9f8314', 'device_owner': 'network:router_interface', 'standard_attr_id': 1751, 'fixed_ips': [{'subnet_id': '3735bbb3-0479-4b6b-8df7-645fb895c926', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:05:44Z', 'updated_at': '2021-11-09T05:05:48Z', 'revision_number': 5, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'subnets': [{'id': '3735bbb3-0479-4b6b-8df7-645fb895c926', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 05:07:25.459327 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6db9c26f-ed5b-47ec-9e59-71ecddb50337 req-4abc0d75-b874-417b-bc19-deb9e18fc327 service neutron] 10.222.0.26 "GET /v2.0/networks/16dfc543-c13b-401a-892d-806436f2c384?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0884168 Nov 09 05:07:25.551927 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6db9c26f-ed5b-47ec-9e59-71ecddb50337 req-fbed816a-566a-44e3-8486-9dfd8d333d46 service neutron] 10.222.0.26 "GET /v2.0/networks/16dfc543-c13b-401a-892d-806436f2c384?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0842762 Nov 09 05:07:25.614761 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8406d6d5-438e-44a1-bfeb-c911fba9457b None None] New status for floating IP dea9fbba-7f44-4f99-a93a-cca04a117595: DOWN {{(pid=102164) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 05:07:26.484320 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab091f7a-ab35-4517-9e63-69be31320fb3 req-d68166f7-93e9-4899-a45a-348a43d1a9b6 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:07:26.485773 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ab091f7a-ab35-4517-9e63-69be31320fb3 req-d68166f7-93e9-4899-a45a-348a43d1a9b6 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=ae343e88-84a9-4629-9c45-ff6312e10860 HTTP/1.1" status: 200 len: 945 time: 0.0486054 Nov 09 05:07:26.537317 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ab091f7a-ab35-4517-9e63-69be31320fb3 req-e7930373-a929-43f4-9350-ce63a2b36895 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=a10dfbe7-94bf-4308-8c2b-b051bc84e309&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0456674 Nov 09 05:07:26.882746 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28cc1599-b4e6-4a3a-affd-26e0244dc6aa req-cc002e65-b26e-4e60-8522-38801655c749 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:07:26.884102 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-28cc1599-b4e6-4a3a-affd-26e0244dc6aa req-cc002e65-b26e-4e60-8522-38801655c749 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.26 "GET /v2.0/ports?device_id=ae343e88-84a9-4629-9c45-ff6312e10860 HTTP/1.1" status: 200 len: 945 time: 0.0474594 Nov 09 05:07:26.974728 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-28cc1599-b4e6-4a3a-affd-26e0244dc6aa req-d650279f-0fd0-4d8c-b571-cb723c17775c tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Deleting port 59ddd742-caef-4443-9ccf-f969e1453d45 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:07:26.975059 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-28cc1599-b4e6-4a3a-affd-26e0244dc6aa req-d650279f-0fd0-4d8c-b571-cb723c17775c tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:27.063712 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-28cc1599-b4e6-4a3a-affd-26e0244dc6aa req-d650279f-0fd0-4d8c-b571-cb723c17775c tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] For port 59ddd742-caef-4443-9ccf-f969e1453d45, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=59ddd742-caef-4443-9ccf-f969e1453d45,segment=NetworkSegment(04920539-e2ad-49d5-b0a6-718337b9e8b0),segment_id=04920539-e2ad-49d5-b0a6-718337b9e8b0)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:07:27.064069 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-28cc1599-b4e6-4a3a-affd-26e0244dc6aa req-d650279f-0fd0-4d8c-b571-cb723c17775c tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:27.075737 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-28cc1599-b4e6-4a3a-affd-26e0244dc6aa req-d650279f-0fd0-4d8c-b571-cb723c17775c tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Calling delete_port for 59ddd742-caef-4443-9ccf-f969e1453d45 owned by compute:nova {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:07:27.274622 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-28cc1599-b4e6-4a3a-affd-26e0244dc6aa req-d650279f-0fd0-4d8c-b571-cb723c17775c tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:27.310951 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d650279f-0fd0-4d8c-b571-cb723c17775c tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event deleted for resources: {'Port': ['ID=59ddd742-caef-4443-9ccf-f969e1453d45,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:07:27.340645 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d650279f-0fd0-4d8c-b571-cb723c17775c tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:07:27.341636 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d650279f-0fd0-4d8c-b571-cb723c17775c tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:07:27.341985 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d650279f-0fd0-4d8c-b571-cb723c17775c tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:07:27.343070 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d650279f-0fd0-4d8c-b571-cb723c17775c tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:07:27.343416 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d650279f-0fd0-4d8c-b571-cb723c17775c tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:07:27.343748 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d650279f-0fd0-4d8c-b571-cb723c17775c tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:07:27.344079 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d650279f-0fd0-4d8c-b571-cb723c17775c tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:07:27.344405 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d650279f-0fd0-4d8c-b571-cb723c17775c tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:07:27.344731 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d650279f-0fd0-4d8c-b571-cb723c17775c tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:07:27.345058 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d650279f-0fd0-4d8c-b571-cb723c17775c tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:07:27.345380 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d650279f-0fd0-4d8c-b571-cb723c17775c tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:07:27.345708 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d650279f-0fd0-4d8c-b571-cb723c17775c tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:07:27.367667 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-28cc1599-b4e6-4a3a-affd-26e0244dc6aa req-d650279f-0fd0-4d8c-b571-cb723c17775c tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] No DVR routers for this DVR port 59ddd742-caef-4443-9ccf-f969e1453d45 on host hv-neutron-8168 {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 05:07:27.370130 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-28cc1599-b4e6-4a3a-affd-26e0244dc6aa req-d650279f-0fd0-4d8c-b571-cb723c17775c tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:27.373405 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-28cc1599-b4e6-4a3a-affd-26e0244dc6aa req-d650279f-0fd0-4d8c-b571-cb723c17775c tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.26 "DELETE /v2.0/ports/59ddd742-caef-4443-9ccf-f969e1453d45 HTTP/1.1" status: 204 len: 173 time: 0.4830246 Nov 09 05:07:27.373875 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ae343e88-84a9-4629-9c45-ff6312e10860', 'name': 'network-vif-deleted', 'tag': '59ddd742-caef-4443-9ccf-f969e1453d45'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:07:27.376194 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ea439416-2242-48e3-a464-2052523f61ab" -d '{"events": [{"server_uuid": "ae343e88-84a9-4629-9c45-ff6312e10860", "name": "network-vif-deleted", "tag": "59ddd742-caef-4443-9ccf-f969e1453d45"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:07:27.415461 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 05:07:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-55e62961-b66c-41ba-9c75-421cd0039043 x-openstack-request-id: req-55e62961-b66c-41ba-9c75-421cd0039043 {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:07:27.415461 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ae343e88-84a9-4629-9c45-ff6312e10860", "name": "network-vif-deleted", "tag": "59ddd742-caef-4443-9ccf-f969e1453d45", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:07:27.415461 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-55e62961-b66c-41ba-9c75-421cd0039043 {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:07:27.415461 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ae343e88-84a9-4629-9c45-ff6312e10860', 'name': 'network-vif-deleted', 'tag': '59ddd742-caef-4443-9ccf-f969e1453d45', 'status': 'completed', 'code': 200} Nov 09 05:07:27.631683 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-6079fb61-53d7-474d-a3a6-5a1a69ef0667 req-51e91f85-d6c5-4b6a-8cb9-d30148082735 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=ae343e88-84a9-4629-9c45-ff6312e10860 HTTP/1.1" status: 200 len: 210 time: 0.0268672 Nov 09 05:07:28.690515 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 37240) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:07:29.039020 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bc5b0adf-63c1-4d6c-8f1a-e2b7ea91dc5f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:29.284521 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-bc5b0adf-63c1-4d6c-8f1a-e2b7ea91dc5f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Deleting port 6d945935-f6f2-44ff-8105-51e1ec0f31f1 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:07:29.284854 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bc5b0adf-63c1-4d6c-8f1a-e2b7ea91dc5f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:29.372875 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-bc5b0adf-63c1-4d6c-8f1a-e2b7ea91dc5f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] For port 6d945935-f6f2-44ff-8105-51e1ec0f31f1, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=6d945935-f6f2-44ff-8105-51e1ec0f31f1,segment=NetworkSegment(04920539-e2ad-49d5-b0a6-718337b9e8b0),segment_id=04920539-e2ad-49d5-b0a6-718337b9e8b0)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:07:29.373150 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bc5b0adf-63c1-4d6c-8f1a-e2b7ea91dc5f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:29.385274 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-bc5b0adf-63c1-4d6c-8f1a-e2b7ea91dc5f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Calling delete_port for 6d945935-f6f2-44ff-8105-51e1ec0f31f1 owned by network:router_interface {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:07:29.590022 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 59ddd742-caef-4443-9ccf-f969e1453d45 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 05:07:29.610285 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] No Port match for: 59ddd742-caef-4443-9ccf-f969e1453d45 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 05:07:29.610649 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 59ddd742-caef-4443-9ccf-f969e1453d45 not bound to the agent host hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 05:07:29.720289 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bc5b0adf-63c1-4d6c-8f1a-e2b7ea91dc5f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:29.746150 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc5b0adf-63c1-4d6c-8f1a-e2b7ea91dc5f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event deleted for resources: {'Port': ['ID=6d945935-f6f2-44ff-8105-51e1ec0f31f1,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:07:29.925467 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bc5b0adf-63c1-4d6c-8f1a-e2b7ea91dc5f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:30.128897 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bc5b0adf-63c1-4d6c-8f1a-e2b7ea91dc5f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Router d4c935be-c982-4fcb-af39-2fc3ae9f8314 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 05:07:30.235276 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bc5b0adf-63c1-4d6c-8f1a-e2b7ea91dc5f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 05:07:30.241249 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-bc5b0adf-63c1-4d6c-8f1a-e2b7ea91dc5f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "PUT /v2.0/routers/d4c935be-c982-4fcb-af39-2fc3ae9f8314/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5496848 Nov 09 05:07:30.243281 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 37242) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:07:30.245393 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-65154ae3-4963-4af8-a31d-bcb315b5a70d None None] Sync routers for ids ['d4c935be-c982-4fcb-af39-2fc3ae9f8314'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 05:07:30.255627 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-65154ae3-4963-4af8-a31d-bcb315b5a70d None None] Routers {'d4c935be-c982-4fcb-af39-2fc3ae9f8314'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:07:30.256228 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-65154ae3-4963-4af8-a31d-bcb315b5a70d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:07:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['d4c935be-c982-4fcb-af39-2fc3ae9f8314'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:07:30.298493 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-edde7d57-d21a-40ba-9c42-8d0511c68864 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Deleting subnet 3735bbb3-0479-4b6b-8df7-645fb895c926 {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 05:07:30.302140 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-edde7d57-d21a-40ba-9c42-8d0511c68864 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:30.343451 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-edde7d57-d21a-40ba-9c42-8d0511c68864 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:30.363733 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-65154ae3-4963-4af8-a31d-bcb315b5a70d None None] Set router d4c935be-c982-4fcb-af39-2fc3ae9f8314 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:07:30.428444 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-edde7d57-d21a-40ba-9c42-8d0511c68864 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:30.543112 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-edde7d57-d21a-40ba-9c42-8d0511c68864 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:30.544088 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-65154ae3-4963-4af8-a31d-bcb315b5a70d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd4c935be-c982-4fcb-af39-2fc3ae9f8314', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1210987163', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.120'}], 'enable_snat': True}, 'gw_port_id': '6777983c-53b7-4614-a4e7-3ad9e839bfeb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:05:41Z', 'updated_at': '2021-11-09T05:07:29Z', 'revision_number': 5, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': '6777983c-53b7-4614-a4e7-3ad9e839bfeb', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:07:ee', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd4c935be-c982-4fcb-af39-2fc3ae9f8314', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1748, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:05:41Z', 'updated_at': '2021-11-09T05:05:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:07:30.570659 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-65154ae3-4963-4af8-a31d-bcb315b5a70d None None] Checking router: d4c935be-c982-4fcb-af39-2fc3ae9f8314 for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 05:07:30.570915 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edde7d57-d21a-40ba-9c42-8d0511c68864 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event deleted for resources: {'Subnet': ['ID=3735bbb3-0479-4b6b-8df7-645fb895c926,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:07:30.574583 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-edde7d57-d21a-40ba-9c42-8d0511c68864 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:30.578155 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-edde7d57-d21a-40ba-9c42-8d0511c68864 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "DELETE /v2.0/subnets/3735bbb3-0479-4b6b-8df7-645fb895c926 HTTP/1.1" status: 204 len: 168 time: 0.3334534 Nov 09 05:07:30.580573 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 37244) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:07:30.581853 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4719f89d-6500-4a51-a486-2f54924c44ec None None] Network 16dfc543-c13b-401a-892d-806436f2c384 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 05:07:30.603411 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-65154ae3-4963-4af8-a31d-bcb315b5a70d None None] Routers {'d4c935be-c982-4fcb-af39-2fc3ae9f8314'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:07:30.604071 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-65154ae3-4963-4af8-a31d-bcb315b5a70d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:07:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['d4c935be-c982-4fcb-af39-2fc3ae9f8314'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:07:30.687571 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-aa65691c-902d-48f5-85f3-e628c839d00d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for router, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:30.782981 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-65154ae3-4963-4af8-a31d-bcb315b5a70d None None] Set router d4c935be-c982-4fcb-af39-2fc3ae9f8314 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:07:30.791377 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-aa65691c-902d-48f5-85f3-e628c839d00d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for router_gateway, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:30.911846 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-aa65691c-902d-48f5-85f3-e628c839d00d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Deleting port 6777983c-53b7-4614-a4e7-3ad9e839bfeb {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:07:30.912188 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-aa65691c-902d-48f5-85f3-e628c839d00d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:30.952006 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-27b4b69b-077d-4ddc-a467-d94b3f583926 None None] DHCP port deletion for 16dfc543-c13b-401a-892d-806436f2c384 request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 05:07:30.997446 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-aa65691c-902d-48f5-85f3-e628c839d00d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] For port 6777983c-53b7-4614-a4e7-3ad9e839bfeb, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=6777983c-53b7-4614-a4e7-3ad9e839bfeb,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:07:30.997807 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-aa65691c-902d-48f5-85f3-e628c839d00d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:31.011379 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-aa65691c-902d-48f5-85f3-e628c839d00d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Calling delete_port for 6777983c-53b7-4614-a4e7-3ad9e839bfeb owned by network:router_gateway {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:07:31.162092 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-65154ae3-4963-4af8-a31d-bcb315b5a70d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd4c935be-c982-4fcb-af39-2fc3ae9f8314', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1210987163', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.120'}], 'enable_snat': True}, 'gw_port_id': '6777983c-53b7-4614-a4e7-3ad9e839bfeb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:05:41Z', 'updated_at': '2021-11-09T05:07:29Z', 'revision_number': 5, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': '6777983c-53b7-4614-a4e7-3ad9e839bfeb', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:07:ee', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd4c935be-c982-4fcb-af39-2fc3ae9f8314', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1748, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:05:41Z', 'updated_at': '2021-11-09T05:05:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:07:31.189598 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-65154ae3-4963-4af8-a31d-bcb315b5a70d None None] The sync data for ids ['d4c935be-c982-4fcb-af39-2fc3ae9f8314'] in dv-neutron-816802-2-hyperv is: [{'id': 'd4c935be-c982-4fcb-af39-2fc3ae9f8314', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1210987163', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.120'}], 'enable_snat': True}, 'gw_port_id': '6777983c-53b7-4614-a4e7-3ad9e839bfeb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:05:41Z', 'updated_at': '2021-11-09T05:07:29Z', 'revision_number': 5, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': '6777983c-53b7-4614-a4e7-3ad9e839bfeb', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:07:ee', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd4c935be-c982-4fcb-af39-2fc3ae9f8314', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1748, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:05:41Z', 'updated_at': '2021-11-09T05:05:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 05:07:31.191658 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-27b4b69b-077d-4ddc-a467-d94b3f583926 None None] Deleting port 9fce31a6-0e9b-4e31-9c48-25ee625d9dd4 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:07:31.192021 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-27b4b69b-077d-4ddc-a467-d94b3f583926 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:31.257478 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-aa65691c-902d-48f5-85f3-e628c839d00d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:31.258083 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-27b4b69b-077d-4ddc-a467-d94b3f583926 None None] For port 9fce31a6-0e9b-4e31-9c48-25ee625d9dd4, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=9fce31a6-0e9b-4e31-9c48-25ee625d9dd4,segment=NetworkSegment(04920539-e2ad-49d5-b0a6-718337b9e8b0),segment_id=04920539-e2ad-49d5-b0a6-718337b9e8b0)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:07:31.258346 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-27b4b69b-077d-4ddc-a467-d94b3f583926 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:31.274942 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-27b4b69b-077d-4ddc-a467-d94b3f583926 None None] Calling delete_port for 9fce31a6-0e9b-4e31-9c48-25ee625d9dd4 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:07:31.284147 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa65691c-902d-48f5-85f3-e628c839d00d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event deleted for resources: {'Port': ['ID=6777983c-53b7-4614-a4e7-3ad9e839bfeb,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:07:31.351984 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-aa65691c-902d-48f5-85f3-e628c839d00d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-466373'] for router_gateway, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:31.399989 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-27b4b69b-077d-4ddc-a467-d94b3f583926 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:31.424505 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27b4b69b-077d-4ddc-a467-d94b3f583926 None None] Pushing event deleted for resources: {'Port': ['ID=9fce31a6-0e9b-4e31-9c48-25ee625d9dd4,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:07:31.427991 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-27b4b69b-077d-4ddc-a467-d94b3f583926 None None] No DVR routers for this DVR port 9fce31a6-0e9b-4e31-9c48-25ee625d9dd4 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 05:07:31.439823 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-aa65691c-902d-48f5-85f3-e628c839d00d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:31.442552 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-aa65691c-902d-48f5-85f3-e628c839d00d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:31.531697 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-aa65691c-902d-48f5-85f3-e628c839d00d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:31.532304 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-aa65691c-902d-48f5-85f3-e628c839d00d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Fanout notify agent at l3_agent the message router_deleted on router d4c935be-c982-4fcb-af39-2fc3ae9f8314 {{(pid=102162) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 05:07:31.539439 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-aa65691c-902d-48f5-85f3-e628c839d00d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:31.541718 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-aa65691c-902d-48f5-85f3-e628c839d00d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "DELETE /v2.0/routers/d4c935be-c982-4fcb-af39-2fc3ae9f8314 HTTP/1.1" status: 204 len: 168 time: 0.9590745 Nov 09 05:07:31.543337 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 37246) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:07:31.622539 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-34e48cef-b4ed-4b68-9a4d-daa1bbf3dd08 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:31.714556 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-34e48cef-b4ed-4b68-9a4d-daa1bbf3dd08 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:31.735246 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-34e48cef-b4ed-4b68-9a4d-daa1bbf3dd08 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['16dfc543-c13b-401a-892d-806436f2c384']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:07:31.744792 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-34e48cef-b4ed-4b68-9a4d-daa1bbf3dd08 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '04920539-e2ad-49d5-b0a6-718337b9e8b0') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:07:31.745085 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-34e48cef-b4ed-4b68-9a4d-daa1bbf3dd08 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '04920539-e2ad-49d5-b0a6-718337b9e8b0') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:07:31.755566 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-34e48cef-b4ed-4b68-9a4d-daa1bbf3dd08 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:31.768756 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-34e48cef-b4ed-4b68-9a4d-daa1bbf3dd08 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:31.778847 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-34e48cef-b4ed-4b68-9a4d-daa1bbf3dd08 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Releasing vlan 304 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 05:07:31.778847 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-34e48cef-b4ed-4b68-9a4d-daa1bbf3dd08 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:31.778847 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 05:07:31.778847 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 05:07:31.778847 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 05:07:31.778847 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 05:07:31.778847 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 05:07:31.778847 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 05:07:31.778847 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 05:07:31.778847 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 05:07:31.778847 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 05:07:31.778847 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 05:07:31.778847 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 05:07:31.778847 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 05:07:31.778847 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 05:07:31.778847 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 05:07:31.778847 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 05:07:31.778847 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 05:07:31.778847 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 05:07:31.778847 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 05:07:31.778847 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 05:07:31.778847 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 05:07:31.778847 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 05:07:31.778847 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 05:07:31.778847 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 05:07:31.778847 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 05:07:31.778847 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 05:07:31.778847 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 05:07:31.778847 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 05:07:31.778847 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 05:07:31.778847 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 05:07:31.778847 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 05:07:31.778847 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 05:07:31.778847 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 05:07:31.954088 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-34e48cef-b4ed-4b68-9a4d-daa1bbf3dd08 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:31.961988 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-34e48cef-b4ed-4b68-9a4d-daa1bbf3dd08 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:31.964693 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-34e48cef-b4ed-4b68-9a4d-daa1bbf3dd08 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "DELETE /v2.0/networks/16dfc543-c13b-401a-892d-806436f2c384 HTTP/1.1" status: 204 len: 168 time: 0.4203079 Nov 09 05:07:31.967631 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 37248) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:07:31.975955 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34e48cef-b4ed-4b68-9a4d-daa1bbf3dd08 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event deleted for resources: {'Network': ['ID=16dfc543-c13b-401a-892d-806436f2c384,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:07:32.028995 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-26f59b51-c6b3-48ea-9811-913e2154b97f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:32.053621 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-26f59b51-c6b3-48ea-9811-913e2154b97f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:32.223214 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-26f59b51-c6b3-48ea-9811-913e2154b97f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:32.225895 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-26f59b51-c6b3-48ea-9811-913e2154b97f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:32.227118 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-26f59b51-c6b3-48ea-9811-913e2154b97f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "DELETE /v2.0/security-groups/a10dfbe7-94bf-4308-8c2b-b051bc84e309 HTTP/1.1" status: 204 len: 168 time: 0.2584348 Nov 09 05:07:32.237293 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26f59b51-c6b3-48ea-9811-913e2154b97f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=a10dfbe7-94bf-4308-8c2b-b051bc84e309,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:07:32.326294 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 9fce31a6-0e9b-4e31-9c48-25ee625d9dd4 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 05:07:32.350285 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 9fce31a6-0e9b-4e31-9c48-25ee625d9dd4 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 05:07:32.350847 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 9fce31a6-0e9b-4e31-9c48-25ee625d9dd4 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 05:07:32.351078 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 6d945935-f6f2-44ff-8105-51e1ec0f31f1 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 05:07:32.370639 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 6d945935-f6f2-44ff-8105-51e1ec0f31f1 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 05:07:32.370986 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 6d945935-f6f2-44ff-8105-51e1ec0f31f1 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 05:07:32.371400 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 6777983c-53b7-4614-a4e7-3ad9e839bfeb no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 05:07:32.389909 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 6777983c-53b7-4614-a4e7-3ad9e839bfeb {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 05:07:32.390256 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 6777983c-53b7-4614-a4e7-3ad9e839bfeb not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 05:07:32.729701 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 37254) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:07:32.734232 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-8478239b-8037-400b-993d-7a488998a9c9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-762750551', 'description': 'tempest-secgroup-smoke-762750551 description', 'project_id': '8ac3eab68bd34485af7ddc3417853b28'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:07:32.793820 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8478239b-8037-400b-993d-7a488998a9c9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:32.856810 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8478239b-8037-400b-993d-7a488998a9c9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:32.908397 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8478239b-8037-400b-993d-7a488998a9c9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:32.936296 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8478239b-8037-400b-993d-7a488998a9c9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'SecurityGroup': ['ID=831e738e-2e97-40d0-aedb-a1c162dcf73d,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:07:33.036579 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8478239b-8037-400b-993d-7a488998a9c9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:33.037820 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-8478239b-8037-400b-993d-7a488998a9c9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.3070517 Nov 09 05:07:33.040598 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 37256) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:07:33.044878 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-2049c9ed-e964-4bc2-8534-41ac2c60c60b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'security_group_rule': {'security_group_id': '831e738e-2e97-40d0-aedb-a1c162dcf73d', 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:07:33.176221 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2049c9ed-e964-4bc2-8534-41ac2c60c60b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:33.231893 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2049c9ed-e964-4bc2-8534-41ac2c60c60b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:33.320225 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2049c9ed-e964-4bc2-8534-41ac2c60c60b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:33.340134 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2049c9ed-e964-4bc2-8534-41ac2c60c60b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=607fcb97-0a90-4a68-8524-3e7886d603f5,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:07:33.435821 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2049c9ed-e964-4bc2-8534-41ac2c60c60b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:33.437024 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-2049c9ed-e964-4bc2-8534-41ac2c60c60b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3955138 Nov 09 05:07:33.439672 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 37258) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:07:33.443887 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-e5efd5f4-635d-4df6-bd74-1d72e5d4f5e9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'security_group_rule': {'security_group_id': '831e738e-2e97-40d0-aedb-a1c162dcf73d', 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:07:33.541158 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e5efd5f4-635d-4df6-bd74-1d72e5d4f5e9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:33.693696 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e5efd5f4-635d-4df6-bd74-1d72e5d4f5e9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:33.788634 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e5efd5f4-635d-4df6-bd74-1d72e5d4f5e9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:33.805681 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5efd5f4-635d-4df6-bd74-1d72e5d4f5e9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=93f267a3-202f-492a-a52e-855dffb2e326,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:07:33.904867 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e5efd5f4-635d-4df6-bd74-1d72e5d4f5e9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:33.906089 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-e5efd5f4-635d-4df6-bd74-1d72e5d4f5e9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.4655194 Nov 09 05:07:33.908841 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 37260) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:07:33.913082 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-8ba4bdbb-22cb-4073-a01d-41381df47d91 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'security_group_rule': {'security_group_id': '831e738e-2e97-40d0-aedb-a1c162dcf73d', 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:07:34.010027 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8ba4bdbb-22cb-4073-a01d-41381df47d91 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:34.066030 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8ba4bdbb-22cb-4073-a01d-41381df47d91 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:34.189226 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8ba4bdbb-22cb-4073-a01d-41381df47d91 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:34.206958 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ba4bdbb-22cb-4073-a01d-41381df47d91 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=090af637-53ac-4983-bd69-879aa6e624b5,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:07:34.362456 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8ba4bdbb-22cb-4073-a01d-41381df47d91 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:34.363654 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-8ba4bdbb-22cb-4073-a01d-41381df47d91 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.4539120 Nov 09 05:07:34.366480 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 37262) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:07:34.370662 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-a535c772-a07f-4199-922b-73485ded81f0 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'security_group_rule': {'security_group_id': '831e738e-2e97-40d0-aedb-a1c162dcf73d', 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:07:34.478540 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a535c772-a07f-4199-922b-73485ded81f0 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:34.533232 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a535c772-a07f-4199-922b-73485ded81f0 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:34.612099 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a535c772-a07f-4199-922b-73485ded81f0 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:34.629748 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a535c772-a07f-4199-922b-73485ded81f0 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0cb0e07a-fb1e-47a7-a53e-60c242397cb5,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:07:34.710678 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-a535c772-a07f-4199-922b-73485ded81f0 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:34.711913 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a535c772-a07f-4199-922b-73485ded81f0 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3444958 Nov 09 05:07:34.714666 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 37264) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:07:34.719092 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-f2315565-b3cd-4d54-a68b-bc8b2838ea2f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'security_group_rule': {'security_group_id': '831e738e-2e97-40d0-aedb-a1c162dcf73d', 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:07:34.828649 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.securitygroups_db [None req-f2315565-b3cd-4d54-a68b-bc8b2838ea2f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Project 8ac3eab68bd34485af7ddc3417853b28 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 09 05:07:34.834988 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f2315565-b3cd-4d54-a68b-bc8b2838ea2f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:35.176283 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f2315565-b3cd-4d54-a68b-bc8b2838ea2f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:35.234145 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f2315565-b3cd-4d54-a68b-bc8b2838ea2f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:35.252559 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2315565-b3cd-4d54-a68b-bc8b2838ea2f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9e9fbd6c-c406-4452-9cb0-5db8979ccbda,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:07:35.339739 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f2315565-b3cd-4d54-a68b-bc8b2838ea2f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:35.340999 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-f2315565-b3cd-4d54-a68b-bc8b2838ea2f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.6253772 Nov 09 05:07:35.343808 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 37266) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:07:35.348880 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-77c7ffe0-b42b-4bef-a89b-ac0985a35aa6 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'security_group_rule': {'security_group_id': '831e738e-2e97-40d0-aedb-a1c162dcf73d', 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:07:35.452058 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.securitygroups_db [None req-77c7ffe0-b42b-4bef-a89b-ac0985a35aa6 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Project 8ac3eab68bd34485af7ddc3417853b28 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 09 05:07:35.457587 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-77c7ffe0-b42b-4bef-a89b-ac0985a35aa6 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:35.513300 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-77c7ffe0-b42b-4bef-a89b-ac0985a35aa6 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:35.645830 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-77c7ffe0-b42b-4bef-a89b-ac0985a35aa6 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:35.664147 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77c7ffe0-b42b-4bef-a89b-ac0985a35aa6 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e219bd91-bd01-4966-88a1-72f749b142cf,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:07:35.768067 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-77c7ffe0-b42b-4bef-a89b-ac0985a35aa6 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:35.769398 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-77c7ffe0-b42b-4bef-a89b-ac0985a35aa6 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.4245267 Nov 09 05:07:35.772022 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 37268) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:07:35.776725 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-da7853bf-160f-42c7-9af6-e67dccf051c8 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'network': {'name': 'tempest-network-smoke--823809904', 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'port_security_enabled': True}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:07:35.891504 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-da7853bf-160f-42c7-9af6-e67dccf051c8 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Made reservation on behalf of 8ac3eab68bd34485af7ddc3417853b28 for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 05:07:35.895651 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-da7853bf-160f-42c7-9af6-e67dccf051c8 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:35.917742 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-da7853bf-160f-42c7-9af6-e67dccf051c8 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 324} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 05:07:35.925834 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-da7853bf-160f-42c7-9af6-e67dccf051c8 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:35.926169 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-da7853bf-160f-42c7-9af6-e67dccf051c8 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Added segment 7873d665-dcdc-4807-b36b-1f3dcc6dd977 of type vlan for network 069b3296-503e-4f72-a764-405dcfa9218c Nov 09 05:07:35.972430 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-da7853bf-160f-42c7-9af6-e67dccf051c8 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:36.109067 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-da7853bf-160f-42c7-9af6-e67dccf051c8 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:36.115473 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-da7853bf-160f-42c7-9af6-e67dccf051c8 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:07:36.116191 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-da7853bf-160f-42c7-9af6-e67dccf051c8 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:36.178856 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da7853bf-160f-42c7-9af6-e67dccf051c8 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'Network': ['ID=069b3296-503e-4f72-a764-405dcfa9218c,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:07:36.189198 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 069b3296-503e-4f72-a764-405dcfa9218c details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 05:07:36.243167 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-da7853bf-160f-42c7-9af6-e67dccf051c8 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.4700325 Nov 09 05:07:36.245699 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 37270) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:07:36.250204 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-bd03e484-5df2-4639-a1ab-dd580d1e186f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'router': {'name': 'tempest-TestNetworkAdvancedServerOps-router-44819952', 'admin_state_up': True, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:07:36.343529 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bd03e484-5df2-4639-a1ab-dd580d1e186f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:36.344574 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bd03e484-5df2-4639-a1ab-dd580d1e186f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:36.396036 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bd03e484-5df2-4639-a1ab-dd580d1e186f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:36.579339 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bd03e484-5df2-4639-a1ab-dd580d1e186f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:36.815560 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bd03e484-5df2-4639-a1ab-dd580d1e186f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for router_gateway, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:36.834263 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bd03e484-5df2-4639-a1ab-dd580d1e186f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:36.932085 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-bd03e484-5df2-4639-a1ab-dd580d1e186f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Allocated IP 172.26.0.61 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/7a1c6236-8dbc-4010-8eef-a68a599be703) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 05:07:37.038346 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bd03e484-5df2-4639-a1ab-dd580d1e186f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:37.138034 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bd03e484-5df2-4639-a1ab-dd580d1e186f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:37.174463 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bd03e484-5df2-4639-a1ab-dd580d1e186f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:07:37.179147 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-bd03e484-5df2-4639-a1ab-dd580d1e186f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:07:37.181562 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bd03e484-5df2-4639-a1ab-dd580d1e186f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 05:07:37.212261 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd03e484-5df2-4639-a1ab-dd580d1e186f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'Port': ['ID=7a1c6236-8dbc-4010-8eef-a68a599be703,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:07:37.506734 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bd03e484-5df2-4639-a1ab-dd580d1e186f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for router_gateway, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:37.706562 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bd03e484-5df2-4639-a1ab-dd580d1e186f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:37.932124 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bd03e484-5df2-4639-a1ab-dd580d1e186f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Router ca638ddf-69a9-410d-a6d3-22ae3b936315 is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102161) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 05:07:38.038743 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bd03e484-5df2-4639-a1ab-dd580d1e186f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 05:07:38.049730 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b4a00eaa-037a-4d54-84c0-862464298fd3 None None] Sync routers for ids ['ca638ddf-69a9-410d-a6d3-22ae3b936315'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 05:07:38.059960 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b4a00eaa-037a-4d54-84c0-862464298fd3 None None] Routers {'ca638ddf-69a9-410d-a6d3-22ae3b936315'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:07:38.060564 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-b4a00eaa-037a-4d54-84c0-862464298fd3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:07:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['ca638ddf-69a9-410d-a6d3-22ae3b936315'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:07:38.145847 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bd03e484-5df2-4639-a1ab-dd580d1e186f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:38.147099 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-bd03e484-5df2-4639-a1ab-dd580d1e186f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 893 time: 1.9004831 Nov 09 05:07:38.150202 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 37272) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:07:38.164881 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-b4a00eaa-037a-4d54-84c0-862464298fd3 None None] Set router ca638ddf-69a9-410d-a6d3-22ae3b936315 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:07:38.177603 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-0f73621f-ba4c-48dd-a0be-c0624aba1d2e tempest-TestNetworkAdvancedServerOps-1212315804 tempest-TestNetworkAdvancedServerOps-1212315804-project-admin] 10.222.0.24 "GET /v2.0/subnets?project_id=8ac3eab68bd34485af7ddc3417853b28&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0262663 Nov 09 05:07:38.180157 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 37274) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:07:38.270331 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a1847485-591f-48db-b99b-868b1565dd65 tempest-TestNetworkAdvancedServerOps-1212315804 tempest-TestNetworkAdvancedServerOps-1212315804-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:07:38.271875 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a1847485-591f-48db-b99b-868b1565dd65 tempest-TestNetworkAdvancedServerOps-1212315804 tempest-TestNetworkAdvancedServerOps-1212315804-project-admin] 10.222.0.24 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.0908120 Nov 09 05:07:38.275006 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 37276) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:07:38.304305 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-5a0aa1a9-8dd2-465a-b181-5834ba3829d9 tempest-TestNetworkAdvancedServerOps-1212315804 tempest-TestNetworkAdvancedServerOps-1212315804-project-admin] 10.222.0.24 "GET /v2.0/subnets?network_id=2b6725f5-ebfe-485a-8f42-ccb5a241ddb5&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0258641 Nov 09 05:07:38.304506 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 37278) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:07:38.308914 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-e92f4ae2-ec3c-4101-aa56-117ad7dc2122 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-1389829160', 'network_id': '069b3296-503e-4f72-a764-405dcfa9218c', 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:07:38.342133 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-b4a00eaa-037a-4d54-84c0-862464298fd3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ca638ddf-69a9-410d-a6d3-22ae3b936315', 'name': 'tempest-TestNetworkAdvancedServerOps-router-44819952', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.61'}], 'enable_snat': True}, 'gw_port_id': '7a1c6236-8dbc-4010-8eef-a68a599be703', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:07:36Z', 'updated_at': '2021-11-09T05:07:37Z', 'revision_number': 3, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': '7a1c6236-8dbc-4010-8eef-a68a599be703', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:7a:29:cd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ca638ddf-69a9-410d-a6d3-22ae3b936315', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1767, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.61', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:07:36Z', 'updated_at': '2021-11-09T05:07:36Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:07:38.369171 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b4a00eaa-037a-4d54-84c0-862464298fd3 None None] Checking router: ca638ddf-69a9-410d-a6d3-22ae3b936315 for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 05:07:38.369517 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b4a00eaa-037a-4d54-84c0-862464298fd3 None None] Updating router ca638ddf-69a9-410d-a6d3-22ae3b936315 port 7a1c6236-8dbc-4010-8eef-a68a599be703 binding host dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 05:07:38.392976 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-b4a00eaa-037a-4d54-84c0-862464298fd3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:38.434972 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e92f4ae2-ec3c-4101-aa56-117ad7dc2122 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Made reservation on behalf of 8ac3eab68bd34485af7ddc3417853b28 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 05:07:38.438683 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e92f4ae2-ec3c-4101-aa56-117ad7dc2122 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:38.640663 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-b4a00eaa-037a-4d54-84c0-862464298fd3 None None] Publish callbacks [] for port, precommit_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:38.697662 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e92f4ae2-ec3c-4101-aa56-117ad7dc2122 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:38.726179 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-b4a00eaa-037a-4d54-84c0-862464298fd3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:38.757272 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e92f4ae2-ec3c-4101-aa56-117ad7dc2122 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'Subnet': ['ID=7478814b-170a-4a05-97e1-d47b6c978d7c,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:07:38.769035 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e92f4ae2-ec3c-4101-aa56-117ad7dc2122 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Checking segment: {'id': '7873d665-dcdc-4807-b36b-1f3dcc6dd977', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 324, 'network_id': '069b3296-503e-4f72-a764-405dcfa9218c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 05:07:38.769393 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e92f4ae2-ec3c-4101-aa56-117ad7dc2122 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Network hostable DHCP agents. Network: 069b3296-503e-4f72-a764-405dcfa9218c, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 05:07:38.855940 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-b4a00eaa-037a-4d54-84c0-862464298fd3 None None] Attempting to bind port 7a1c6236-8dbc-4010-8eef-a68a599be703 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 05:07:38.856306 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-b4a00eaa-037a-4d54-84c0-862464298fd3 None None] Attempting to bind port 7a1c6236-8dbc-4010-8eef-a68a599be703 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 05:07:38.856659 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b4a00eaa-037a-4d54-84c0-862464298fd3 None None] Attempting to bind port 7a1c6236-8dbc-4010-8eef-a68a599be703 on network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 05:07:38.863366 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d34110e-3408-4c5d-a177-7788346099e7 None None] Pushing event updated for resources: {'Port': ['ID=7a1c6236-8dbc-4010-8eef-a68a599be703,revision_number=2']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:07:38.869172 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e92f4ae2-ec3c-4101-aa56-117ad7dc2122 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Network 069b3296-503e-4f72-a764-405dcfa9218c is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 05:07:38.869326 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b4a00eaa-037a-4d54-84c0-862464298fd3 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 5, 7, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 05:07:38.869618 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b4a00eaa-037a-4d54-84c0-862464298fd3 None None] Checking segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102164) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 05:07:38.870009 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-b4a00eaa-037a-4d54-84c0-862464298fd3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:38.870421 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b4a00eaa-037a-4d54-84c0-862464298fd3 None None] Bound using segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 05:07:38.870874 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-b4a00eaa-037a-4d54-84c0-862464298fd3 None None] Bound port: 7a1c6236-8dbc-4010-8eef-a68a599be703, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 05:07:38.871249 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-b4a00eaa-037a-4d54-84c0-862464298fd3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:38.874314 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d34110e-3408-4c5d-a177-7788346099e7 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:07:38.874686 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d34110e-3408-4c5d-a177-7788346099e7 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:07:38.875024 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d34110e-3408-4c5d-a177-7788346099e7 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:07:38.875352 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d34110e-3408-4c5d-a177-7788346099e7 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:07:38.875680 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d34110e-3408-4c5d-a177-7788346099e7 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:07:38.876006 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d34110e-3408-4c5d-a177-7788346099e7 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:07:38.876838 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d34110e-3408-4c5d-a177-7788346099e7 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:07:38.877160 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d34110e-3408-4c5d-a177-7788346099e7 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:07:38.877479 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d34110e-3408-4c5d-a177-7788346099e7 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:07:38.877796 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d34110e-3408-4c5d-a177-7788346099e7 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:07:38.878112 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d34110e-3408-4c5d-a177-7788346099e7 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:07:38.878451 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d34110e-3408-4c5d-a177-7788346099e7 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:07:38.928697 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-b4a00eaa-037a-4d54-84c0-862464298fd3 None None] For port 7a1c6236-8dbc-4010-8eef-a68a599be703, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102164) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 05:07:38.931660 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-b4a00eaa-037a-4d54-84c0-862464298fd3 None None] For port 7a1c6236-8dbc-4010-8eef-a68a599be703, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=7a1c6236-8dbc-4010-8eef-a68a599be703,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102164) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 05:07:38.943489 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-e92f4ae2-ec3c-4101-aa56-117ad7dc2122 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 069b3296-503e-4f72-a764-405dcfa9218c) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:07:38.947777 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e92f4ae2-ec3c-4101-aa56-117ad7dc2122 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:07:38.948417 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-e92f4ae2-ec3c-4101-aa56-117ad7dc2122 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:38.952310 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2287f442-9862-46c8-966c-a2c357630587 None None] Network 069b3296-503e-4f72-a764-405dcfa9218c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 05:07:39.040931 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-b4a00eaa-037a-4d54-84c0-862464298fd3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:39.056883 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-e92f4ae2-ec3c-4101-aa56-117ad7dc2122 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 832 time: 0.7497094 Nov 09 05:07:39.057697 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 37280) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:07:39.095309 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d34110e-3408-4c5d-a177-7788346099e7 None None] Pushing event updated for resources: {'Port': ['ID=7a1c6236-8dbc-4010-8eef-a68a599be703,revision_number=3']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:07:39.104914 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-52eed57f-6ebd-44b7-89fd-4d365426095a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-069b3296-503e-4f72-a764-405dcfa9218c', 'network_id': '069b3296-503e-4f72-a764-405dcfa9218c', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'fixed_ips': [{'subnet_id': '7478814b-170a-4a05-97e1-d47b6c978d7c'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 05:07:39.105787 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-52eed57f-6ebd-44b7-89fd-4d365426095a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:39.107362 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b4a00eaa-037a-4d54-84c0-862464298fd3 None None] Routers {'ca638ddf-69a9-410d-a6d3-22ae3b936315'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:07:39.108166 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-b4a00eaa-037a-4d54-84c0-862464298fd3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:07:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['ca638ddf-69a9-410d-a6d3-22ae3b936315'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:07:39.212316 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-b4a00eaa-037a-4d54-84c0-862464298fd3 None None] Set router ca638ddf-69a9-410d-a6d3-22ae3b936315 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:07:39.239965 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-52eed57f-6ebd-44b7-89fd-4d365426095a None None] Allocated IP 172.20.0.2 (069b3296-503e-4f72-a764-405dcfa9218c/7478814b-170a-4a05-97e1-d47b6c978d7c/c8b9bfde-990d-4fdf-ba7a-ca28de24c277) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 05:07:39.395403 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-52eed57f-6ebd-44b7-89fd-4d365426095a None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:39.402916 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-b4a00eaa-037a-4d54-84c0-862464298fd3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ca638ddf-69a9-410d-a6d3-22ae3b936315', 'name': 'tempest-TestNetworkAdvancedServerOps-router-44819952', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.61'}], 'enable_snat': True}, 'gw_port_id': '7a1c6236-8dbc-4010-8eef-a68a599be703', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:07:36Z', 'updated_at': '2021-11-09T05:07:37Z', 'revision_number': 3, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': '7a1c6236-8dbc-4010-8eef-a68a599be703', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:7a:29:cd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ca638ddf-69a9-410d-a6d3-22ae3b936315', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1767, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.61', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:07:36Z', 'updated_at': '2021-11-09T05:07:38Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:07:39.429997 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b4a00eaa-037a-4d54-84c0-862464298fd3 None None] The sync data for ids ['ca638ddf-69a9-410d-a6d3-22ae3b936315'] in dv-neutron-816802-2-hyperv is: [{'id': 'ca638ddf-69a9-410d-a6d3-22ae3b936315', 'name': 'tempest-TestNetworkAdvancedServerOps-router-44819952', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.61'}], 'enable_snat': True}, 'gw_port_id': '7a1c6236-8dbc-4010-8eef-a68a599be703', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:07:36Z', 'updated_at': '2021-11-09T05:07:37Z', 'revision_number': 3, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': '7a1c6236-8dbc-4010-8eef-a68a599be703', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:7a:29:cd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ca638ddf-69a9-410d-a6d3-22ae3b936315', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1767, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.61', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:07:36Z', 'updated_at': '2021-11-09T05:07:38Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 05:07:39.458483 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-52eed57f-6ebd-44b7-89fd-4d365426095a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:39.506178 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-52eed57f-6ebd-44b7-89fd-4d365426095a None None] Network 069b3296-503e-4f72-a764-405dcfa9218c is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:07:39.509077 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-52eed57f-6ebd-44b7-89fd-4d365426095a None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:07:39.513613 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-52eed57f-6ebd-44b7-89fd-4d365426095a None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 05:07:39.516794 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52eed57f-6ebd-44b7-89fd-4d365426095a None None] Pushing event updated for resources: {'Port': ['ID=c8b9bfde-990d-4fdf-ba7a-ca28de24c277,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:07:39.575608 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-52eed57f-6ebd-44b7-89fd-4d365426095a None None] Attempting to bind port c8b9bfde-990d-4fdf-ba7a-ca28de24c277 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 05:07:39.576070 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-52eed57f-6ebd-44b7-89fd-4d365426095a None None] Attempting to bind port c8b9bfde-990d-4fdf-ba7a-ca28de24c277 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '7873d665-dcdc-4807-b36b-1f3dcc6dd977', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 324, 'network_id': '069b3296-503e-4f72-a764-405dcfa9218c'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 05:07:39.576543 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-52eed57f-6ebd-44b7-89fd-4d365426095a None None] Attempting to bind port c8b9bfde-990d-4fdf-ba7a-ca28de24c277 on network 069b3296-503e-4f72-a764-405dcfa9218c {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 05:07:39.582001 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-52eed57f-6ebd-44b7-89fd-4d365426095a None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 5, 7, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 05:07:39.583724 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-52eed57f-6ebd-44b7-89fd-4d365426095a None None] Checking segment: {'id': '7873d665-dcdc-4807-b36b-1f3dcc6dd977', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 324, 'network_id': '069b3296-503e-4f72-a764-405dcfa9218c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 05:07:39.583724 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-52eed57f-6ebd-44b7-89fd-4d365426095a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:39.583724 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-52eed57f-6ebd-44b7-89fd-4d365426095a None None] Bound using segment: {'id': '7873d665-dcdc-4807-b36b-1f3dcc6dd977', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 324, 'network_id': '069b3296-503e-4f72-a764-405dcfa9218c'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 05:07:39.583724 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-52eed57f-6ebd-44b7-89fd-4d365426095a None None] Bound port: c8b9bfde-990d-4fdf-ba7a-ca28de24c277, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7873d665-dcdc-4807-b36b-1f3dcc6dd977', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 324, 'network_id': '069b3296-503e-4f72-a764-405dcfa9218c'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 05:07:39.584572 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-52eed57f-6ebd-44b7-89fd-4d365426095a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:39.675261 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-52eed57f-6ebd-44b7-89fd-4d365426095a None None] For port c8b9bfde-990d-4fdf-ba7a-ca28de24c277, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 05:07:39.678601 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-52eed57f-6ebd-44b7-89fd-4d365426095a None None] For port c8b9bfde-990d-4fdf-ba7a-ca28de24c277, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=c8b9bfde-990d-4fdf-ba7a-ca28de24c277,segment=NetworkSegment(7873d665-dcdc-4807-b36b-1f3dcc6dd977),segment_id=7873d665-dcdc-4807-b36b-1f3dcc6dd977)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 05:07:39.749614 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-52eed57f-6ebd-44b7-89fd-4d365426095a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:39.816680 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52eed57f-6ebd-44b7-89fd-4d365426095a None None] Pushing event updated for resources: {'Port': ['ID=c8b9bfde-990d-4fdf-ba7a-ca28de24c277,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:07:39.875794 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fb910561-b4dd-4de0-9c2a-e2c2856b93f4 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:40.193533 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-fb910561-b4dd-4de0-9c2a-e2c2856b93f4 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Allocated IP 172.20.0.1 (069b3296-503e-4f72-a764-405dcfa9218c/7478814b-170a-4a05-97e1-d47b6c978d7c/2ed6b6d4-e405-45c9-b741-d32ffaab1896) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 05:07:40.317983 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fb910561-b4dd-4de0-9c2a-e2c2856b93f4 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:40.406910 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 7a1c6236-8dbc-4010-8eef-a68a599be703 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:07:40.425046 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fb910561-b4dd-4de0-9c2a-e2c2856b93f4 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:40.458766 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 7a1c6236-8dbc-4010-8eef-a68a599be703 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:07:40.459527 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:40.471687 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fb910561-b4dd-4de0-9c2a-e2c2856b93f4 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Network 069b3296-503e-4f72-a764-405dcfa9218c is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:07:40.477005 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-fb910561-b4dd-4de0-9c2a-e2c2856b93f4 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:07:40.480890 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fb910561-b4dd-4de0-9c2a-e2c2856b93f4 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 05:07:40.505420 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb910561-b4dd-4de0-9c2a-e2c2856b93f4 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'Port': ['ID=2ed6b6d4-e405-45c9-b741-d32ffaab1896,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:07:40.536453 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fb910561-b4dd-4de0-9c2a-e2c2856b93f4 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:40.541324 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:40.563248 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 7a1c6236-8dbc-4010-8eef-a68a599be703, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=7a1c6236-8dbc-4010-8eef-a68a599be703,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:07:40.647066 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:40.648004 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device c8b9bfde-990d-4fdf-ba7a-ca28de24c277 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:07:40.725648 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=7a1c6236-8dbc-4010-8eef-a68a599be703,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:07:40.738871 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port c8b9bfde-990d-4fdf-ba7a-ca28de24c277 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:07:40.739198 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:40.746379 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fb910561-b4dd-4de0-9c2a-e2c2856b93f4 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:40.761297 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1ceea5b4-aeef-4ffc-b178-10b72963de93 None None] Network 069b3296-503e-4f72-a764-405dcfa9218c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 05:07:40.916394 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-be053bdf-8415-4af5-86c9-74a77b1f300c None None] Provisioning complete for port c8b9bfde-990d-4fdf-ba7a-ca28de24c277 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:07:40.916760 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-be053bdf-8415-4af5-86c9-74a77b1f300c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:40.925315 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:41.021438 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port c8b9bfde-990d-4fdf-ba7a-ca28de24c277, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=c8b9bfde-990d-4fdf-ba7a-ca28de24c277,segment=NetworkSegment(7873d665-dcdc-4807-b36b-1f3dcc6dd977),segment_id=7873d665-dcdc-4807-b36b-1f3dcc6dd977)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:07:41.036424 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fb910561-b4dd-4de0-9c2a-e2c2856b93f4 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:41.069534 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-be053bdf-8415-4af5-86c9-74a77b1f300c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:41.088267 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:41.126863 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fb910561-b4dd-4de0-9c2a-e2c2856b93f4 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:41.171913 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.db.api [None req-be053bdf-8415-4af5-86c9-74a77b1f300c None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=102163) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 09 05:07:41.172473 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG oslo_db.api [None req-be053bdf-8415-4af5-86c9-74a77b1f300c None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 09 05:07:41.172863 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=c8b9bfde-990d-4fdf-ba7a-ca28de24c277,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:07:41.212837 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-fb910561-b4dd-4de0-9c2a-e2c2856b93f4 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:41.214612 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb910561-b4dd-4de0-9c2a-e2c2856b93f4 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'Port': ['ID=2ed6b6d4-e405-45c9-b741-d32ffaab1896,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:07:41.313270 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fb910561-b4dd-4de0-9c2a-e2c2856b93f4 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Network 069b3296-503e-4f72-a764-405dcfa9218c is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:07:41.314893 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-fb910561-b4dd-4de0-9c2a-e2c2856b93f4 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:07:41.368557 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-863e8a34-e416-4104-9964-250647c77ec5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:41.444688 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fb910561-b4dd-4de0-9c2a-e2c2856b93f4 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Router ca638ddf-69a9-410d-a6d3-22ae3b936315 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 05:07:41.558581 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fb910561-b4dd-4de0-9c2a-e2c2856b93f4 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 05:07:41.563752 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-fb910561-b4dd-4de0-9c2a-e2c2856b93f4 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "PUT /v2.0/routers/ca638ddf-69a9-410d-a6d3-22ae3b936315/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.5049279 Nov 09 05:07:41.571472 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e382155b-6e45-464f-bef9-9a0af3e228de None None] Sync routers for ids ['ca638ddf-69a9-410d-a6d3-22ae3b936315'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 05:07:41.582804 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e382155b-6e45-464f-bef9-9a0af3e228de None None] Routers {'ca638ddf-69a9-410d-a6d3-22ae3b936315'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:07:41.583471 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-e382155b-6e45-464f-bef9-9a0af3e228de None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:07:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['ca638ddf-69a9-410d-a6d3-22ae3b936315'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:07:41.719772 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-e382155b-6e45-464f-bef9-9a0af3e228de None None] Set router ca638ddf-69a9-410d-a6d3-22ae3b936315 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:07:41.763646 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-aa8b43a3-9fd7-4f04-af6b-b794a6727ec3 req-34ec106d-8f7b-4a7f-8d41-897bc83b7f42 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-762750551&fields=id&tenant_id=8ac3eab68bd34485af7ddc3417853b28 HTTP/1.1" status: 200 len: 267 time: 0.0440207 Nov 09 05:07:41.869983 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa8b43a3-9fd7-4f04-af6b-b794a6727ec3 req-f79ad321-7fb0-4b28-9f7c-41164b066479 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:07:41.871415 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-aa8b43a3-9fd7-4f04-af6b-b794a6727ec3 req-f79ad321-7fb0-4b28-9f7c-41164b066479 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/networks?id=069b3296-503e-4f72-a764-405dcfa9218c HTTP/1.1" status: 200 len: 796 time: 0.1003063 Nov 09 05:07:41.888177 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-aa8b43a3-9fd7-4f04-af6b-b794a6727ec3 req-d120496d-30a4-4afc-9d5b-fed03e2808eb tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/quotas/8ac3eab68bd34485af7ddc3417853b28 HTTP/1.1" status: 200 len: 375 time: 0.0105336 Nov 09 05:07:41.903741 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-b5a1ef85-8e14-4292-835a-09772eb23438 None None] Provisioning complete for port 2ed6b6d4-e405-45c9-b741-d32ffaab1896 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:07:41.904116 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b5a1ef85-8e14-4292-835a-09772eb23438 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:41.942717 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-aa8b43a3-9fd7-4f04-af6b-b794a6727ec3 req-1816d760-acc3-4956-9fa4-d3553db72598 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?tenant_id=8ac3eab68bd34485af7ddc3417853b28&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0479331 Nov 09 05:07:41.944337 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-b5a1ef85-8e14-4292-835a-09772eb23438 None None] Port 2ed6b6d4-e405-45c9-b741-d32ffaab1896 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 05:07:41.965200 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-e382155b-6e45-464f-bef9-9a0af3e228de None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ca638ddf-69a9-410d-a6d3-22ae3b936315', 'name': 'tempest-TestNetworkAdvancedServerOps-router-44819952', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.61'}], 'enable_snat': True}, 'gw_port_id': '7a1c6236-8dbc-4010-8eef-a68a599be703', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:07:36Z', 'updated_at': '2021-11-09T05:07:40Z', 'revision_number': 4, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': '7a1c6236-8dbc-4010-8eef-a68a599be703', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:7a:29:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ca638ddf-69a9-410d-a6d3-22ae3b936315', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1767, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.61', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:07:36Z', 'updated_at': '2021-11-09T05:07:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '2ed6b6d4-e405-45c9-b741-d32ffaab1896', 'name': '', 'network_id': '069b3296-503e-4f72-a764-405dcfa9218c', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'mac_address': 'fa:16:3e:88:af:82', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ca638ddf-69a9-410d-a6d3-22ae3b936315', 'device_owner': 'network:router_interface', 'standard_attr_id': 1770, 'fixed_ips': [{'subnet_id': '7478814b-170a-4a05-97e1-d47b6c978d7c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:07:40Z', 'updated_at': '2021-11-09T05:07:40Z', 'revision_number': 2, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'subnets': [{'id': '7478814b-170a-4a05-97e1-d47b6c978d7c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:07:41.966974 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-b5a1ef85-8e14-4292-835a-09772eb23438 None None] Provisioning complete for port c8b9bfde-990d-4fdf-ba7a-ca28de24c277 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:07:41.967336 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b5a1ef85-8e14-4292-835a-09772eb23438 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:42.012934 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e382155b-6e45-464f-bef9-9a0af3e228de None None] Checking router: ca638ddf-69a9-410d-a6d3-22ae3b936315 for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 05:07:42.013284 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e382155b-6e45-464f-bef9-9a0af3e228de None None] Updating router ca638ddf-69a9-410d-a6d3-22ae3b936315 port 2ed6b6d4-e405-45c9-b741-d32ffaab1896 binding host dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 05:07:42.039398 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-aa8b43a3-9fd7-4f04-af6b-b794a6727ec3 req-e5faab31-2ec0-411e-bc60-76d16659a917 service neutron] 10.222.0.24 "GET /v2.0/networks/069b3296-503e-4f72-a764-405dcfa9218c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0847695 Nov 09 05:07:42.045850 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e382155b-6e45-464f-bef9-9a0af3e228de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:42.132715 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-aa8b43a3-9fd7-4f04-af6b-b794a6727ec3 req-066ee362-bcb0-499b-8107-6b72a6c4fa14 service neutron] 10.222.0.24 "GET /v2.0/networks/069b3296-503e-4f72-a764-405dcfa9218c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0869031 Nov 09 05:07:42.334794 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e382155b-6e45-464f-bef9-9a0af3e228de None None] Publish callbacks [] for port, precommit_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:42.342408 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 7a1c6236-8dbc-4010-8eef-a68a599be703 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:07:42.391797 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 7a1c6236-8dbc-4010-8eef-a68a599be703 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:07:42.393386 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:42.415180 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e382155b-6e45-464f-bef9-9a0af3e228de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:42.419802 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-87031ed2-6069-4f7f-b918-4c5b889f4bd7 req-2aa85de8-430a-489a-8c13-7d9867f00f8a tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=43b80c45-ea9f-47de-a4da-40ef6218498c HTTP/1.1" status: 200 len: 210 time: 0.0271685 Nov 09 05:07:42.490389 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fbeaad3-e58c-48f3-be87-2402839afa60 None None] Pushing event updated for resources: {'Port': ['ID=2ed6b6d4-e405-45c9-b741-d32ffaab1896,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:07:42.691767 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:42.735220 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device c8b9bfde-990d-4fdf-ba7a-ca28de24c277 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:07:42.738305 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-e382155b-6e45-464f-bef9-9a0af3e228de None None] Attempting to bind port 2ed6b6d4-e405-45c9-b741-d32ffaab1896 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 05:07:42.738577 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-e382155b-6e45-464f-bef9-9a0af3e228de None None] Attempting to bind port 2ed6b6d4-e405-45c9-b741-d32ffaab1896 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '7873d665-dcdc-4807-b36b-1f3dcc6dd977', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 324, 'network_id': '069b3296-503e-4f72-a764-405dcfa9218c'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 05:07:42.739011 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e382155b-6e45-464f-bef9-9a0af3e228de None None] Attempting to bind port 2ed6b6d4-e405-45c9-b741-d32ffaab1896 on network 069b3296-503e-4f72-a764-405dcfa9218c {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 05:07:42.742478 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-6b3e0028-0cc2-4d61-a291-b091db70c8ae None None] Provisioning complete for port 2ed6b6d4-e405-45c9-b741-d32ffaab1896 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:07:42.742849 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6b3e0028-0cc2-4d61-a291-b091db70c8ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:42.764195 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e382155b-6e45-464f-bef9-9a0af3e228de None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 5, 7, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 05:07:42.764569 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e382155b-6e45-464f-bef9-9a0af3e228de None None] Checking segment: {'id': '7873d665-dcdc-4807-b36b-1f3dcc6dd977', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 324, 'network_id': '069b3296-503e-4f72-a764-405dcfa9218c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 05:07:42.764964 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e382155b-6e45-464f-bef9-9a0af3e228de None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:42.765359 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e382155b-6e45-464f-bef9-9a0af3e228de None None] Bound using segment: {'id': '7873d665-dcdc-4807-b36b-1f3dcc6dd977', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 324, 'network_id': '069b3296-503e-4f72-a764-405dcfa9218c'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 05:07:42.765832 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-e382155b-6e45-464f-bef9-9a0af3e228de None None] Bound port: 2ed6b6d4-e405-45c9-b741-d32ffaab1896, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7873d665-dcdc-4807-b36b-1f3dcc6dd977', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 324, 'network_id': '069b3296-503e-4f72-a764-405dcfa9218c'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 05:07:42.766207 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e382155b-6e45-464f-bef9-9a0af3e228de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:42.838009 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-6b3e0028-0cc2-4d61-a291-b091db70c8ae None None] Port 2ed6b6d4-e405-45c9-b741-d32ffaab1896 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 05:07:42.870557 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port c8b9bfde-990d-4fdf-ba7a-ca28de24c277 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:07:42.870964 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:42.894674 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e382155b-6e45-464f-bef9-9a0af3e228de None None] For port 2ed6b6d4-e405-45c9-b741-d32ffaab1896, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 05:07:42.912388 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e382155b-6e45-464f-bef9-9a0af3e228de None None] For port 2ed6b6d4-e405-45c9-b741-d32ffaab1896, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=2ed6b6d4-e405-45c9-b741-d32ffaab1896,segment=NetworkSegment(7873d665-dcdc-4807-b36b-1f3dcc6dd977),segment_id=7873d665-dcdc-4807-b36b-1f3dcc6dd977)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 05:07:43.001289 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e382155b-6e45-464f-bef9-9a0af3e228de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:43.056635 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e382155b-6e45-464f-bef9-9a0af3e228de None None] Routers {'ca638ddf-69a9-410d-a6d3-22ae3b936315'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:07:43.057273 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-e382155b-6e45-464f-bef9-9a0af3e228de None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:07:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['ca638ddf-69a9-410d-a6d3-22ae3b936315'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:07:43.062084 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fbeaad3-e58c-48f3-be87-2402839afa60 None None] Pushing event updated for resources: {'Port': ['ID=2ed6b6d4-e405-45c9-b741-d32ffaab1896,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:07:43.170448 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-e382155b-6e45-464f-bef9-9a0af3e228de None None] Set router ca638ddf-69a9-410d-a6d3-22ae3b936315 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:07:43.310708 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-294e4ac0-9eaa-4a32-a1b8-ffd0066bba4b None None] Provisioning complete for port 2ed6b6d4-e405-45c9-b741-d32ffaab1896 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:07:43.310998 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-294e4ac0-9eaa-4a32-a1b8-ffd0066bba4b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:43.440582 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-294e4ac0-9eaa-4a32-a1b8-ffd0066bba4b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:43.469287 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-e382155b-6e45-464f-bef9-9a0af3e228de None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ca638ddf-69a9-410d-a6d3-22ae3b936315', 'name': 'tempest-TestNetworkAdvancedServerOps-router-44819952', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.61'}], 'enable_snat': True}, 'gw_port_id': '7a1c6236-8dbc-4010-8eef-a68a599be703', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:07:36Z', 'updated_at': '2021-11-09T05:07:40Z', 'revision_number': 4, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': '7a1c6236-8dbc-4010-8eef-a68a599be703', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:7a:29:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ca638ddf-69a9-410d-a6d3-22ae3b936315', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1767, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.61', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:07:36Z', 'updated_at': '2021-11-09T05:07:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '2ed6b6d4-e405-45c9-b741-d32ffaab1896', 'name': '', 'network_id': '069b3296-503e-4f72-a764-405dcfa9218c', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'mac_address': 'fa:16:3e:88:af:82', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ca638ddf-69a9-410d-a6d3-22ae3b936315', 'device_owner': 'network:router_interface', 'standard_attr_id': 1770, 'fixed_ips': [{'subnet_id': '7478814b-170a-4a05-97e1-d47b6c978d7c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:07:40Z', 'updated_at': '2021-11-09T05:07:42Z', 'revision_number': 4, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'subnets': [{'id': '7478814b-170a-4a05-97e1-d47b6c978d7c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:07:43.502913 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e382155b-6e45-464f-bef9-9a0af3e228de None None] The sync data for ids ['ca638ddf-69a9-410d-a6d3-22ae3b936315'] in dv-neutron-816802-2-hyperv is: [{'id': 'ca638ddf-69a9-410d-a6d3-22ae3b936315', 'name': 'tempest-TestNetworkAdvancedServerOps-router-44819952', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.61'}], 'enable_snat': True}, 'gw_port_id': '7a1c6236-8dbc-4010-8eef-a68a599be703', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:07:36Z', 'updated_at': '2021-11-09T05:07:40Z', 'revision_number': 4, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': '7a1c6236-8dbc-4010-8eef-a68a599be703', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:7a:29:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ca638ddf-69a9-410d-a6d3-22ae3b936315', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1767, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.61', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:07:36Z', 'updated_at': '2021-11-09T05:07:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '2ed6b6d4-e405-45c9-b741-d32ffaab1896', 'name': '', 'network_id': '069b3296-503e-4f72-a764-405dcfa9218c', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'mac_address': 'fa:16:3e:88:af:82', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ca638ddf-69a9-410d-a6d3-22ae3b936315', 'device_owner': 'network:router_interface', 'standard_attr_id': 1770, 'fixed_ips': [{'subnet_id': '7478814b-170a-4a05-97e1-d47b6c978d7c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:07:40Z', 'updated_at': '2021-11-09T05:07:42Z', 'revision_number': 4, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'subnets': [{'id': '7478814b-170a-4a05-97e1-d47b6c978d7c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 05:07:43.505543 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-294e4ac0-9eaa-4a32-a1b8-ffd0066bba4b None None] For port 2ed6b6d4-e405-45c9-b741-d32ffaab1896, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=2ed6b6d4-e405-45c9-b741-d32ffaab1896,segment=NetworkSegment(7873d665-dcdc-4807-b36b-1f3dcc6dd977),segment_id=7873d665-dcdc-4807-b36b-1f3dcc6dd977)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:07:43.521709 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c828cc8d-f891-41d2-b643-60e631a4763d req-7ea964f9-8519-44e1-a902-bbe9144d1466 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=43b80c45-ea9f-47de-a4da-40ef6218498c HTTP/1.1" status: 200 len: 210 time: 0.0343807 Nov 09 05:07:43.634709 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-294e4ac0-9eaa-4a32-a1b8-ffd0066bba4b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:43.696129 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-294e4ac0-9eaa-4a32-a1b8-ffd0066bba4b None None] Pushing event updated for resources: {'Port': ['ID=2ed6b6d4-e405-45c9-b741-d32ffaab1896,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:07:43.749592 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0a278a2c-ce1d-4fe0-8172-a0f8cc484c96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:44.366531 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 2ed6b6d4-e405-45c9-b741-d32ffaab1896 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:07:44.428169 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 2ed6b6d4-e405-45c9-b741-d32ffaab1896 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:07:44.428834 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:44.449747 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa8b43a3-9fd7-4f04-af6b-b794a6727ec3 req-a472a629-e7bd-42de-a764-e3baada78a1e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:07:44.451416 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-aa8b43a3-9fd7-4f04-af6b-b794a6727ec3 req-a472a629-e7bd-42de-a764-e3baada78a1e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.26 "GET /v2.0/networks?id=069b3296-503e-4f72-a764-405dcfa9218c HTTP/1.1" status: 200 len: 796 time: 0.1199999 Nov 09 05:07:44.523285 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-aa8b43a3-9fd7-4f04-af6b-b794a6727ec3 req-f5dd5800-dfed-4fa2-91df-b589f2e044b2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.26 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=8ac3eab68bd34485af7ddc3417853b28 HTTP/1.1" status: 200 len: 379 time: 0.0591147 Nov 09 05:07:44.530713 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-aa8b43a3-9fd7-4f04-af6b-b794a6727ec3 req-b0bbc50e-76ca-4cdf-ac86-96edf8427e7b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'port': {'device_id': '43b80c45-ea9f-47de-a4da-40ef6218498c', 'network_id': '069b3296-503e-4f72-a764-405dcfa9218c', 'admin_state_up': True, 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'security_groups': ['831e738e-2e97-40d0-aedb-a1c162dcf73d']}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:07:44.627276 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b99e4c20-561f-4895-bb13-810316ab1e20 req-0637edc7-1d4d-43d0-bcce-3dd5ec7571e5 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=43b80c45-ea9f-47de-a4da-40ef6218498c HTTP/1.1" status: 200 len: 210 time: 0.0345349 Nov 09 05:07:44.709492 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-aa8b43a3-9fd7-4f04-af6b-b794a6727ec3 req-b0bbc50e-76ca-4cdf-ac86-96edf8427e7b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Made reservation on behalf of 8ac3eab68bd34485af7ddc3417853b28 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 05:07:44.713520 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-aa8b43a3-9fd7-4f04-af6b-b794a6727ec3 req-b0bbc50e-76ca-4cdf-ac86-96edf8427e7b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:44.839166 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [req-aa8b43a3-9fd7-4f04-af6b-b794a6727ec3 req-b0bbc50e-76ca-4cdf-ac86-96edf8427e7b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Allocated IP 172.20.0.11 (069b3296-503e-4f72-a764-405dcfa9218c/7478814b-170a-4a05-97e1-d47b6c978d7c/207e1e27-b90d-4ea7-a5b2-f6a538eebc54) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 05:07:44.984610 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-aa8b43a3-9fd7-4f04-af6b-b794a6727ec3 req-b0bbc50e-76ca-4cdf-ac86-96edf8427e7b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:45.087198 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-aa8b43a3-9fd7-4f04-af6b-b794a6727ec3 req-b0bbc50e-76ca-4cdf-ac86-96edf8427e7b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:45.129254 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-aa8b43a3-9fd7-4f04-af6b-b794a6727ec3 req-b0bbc50e-76ca-4cdf-ac86-96edf8427e7b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Network 069b3296-503e-4f72-a764-405dcfa9218c is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:07:45.134112 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [req-aa8b43a3-9fd7-4f04-af6b-b794a6727ec3 req-b0bbc50e-76ca-4cdf-ac86-96edf8427e7b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:07:45.137881 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-aa8b43a3-9fd7-4f04-af6b-b794a6727ec3 req-b0bbc50e-76ca-4cdf-ac86-96edf8427e7b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 05:07:45.144630 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0bbc50e-76ca-4cdf-ac86-96edf8427e7b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'Port': ['ID=207e1e27-b90d-4ea7-a5b2-f6a538eebc54,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:07:45.198127 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa8b43a3-9fd7-4f04-af6b-b794a6727ec3 req-b0bbc50e-76ca-4cdf-ac86-96edf8427e7b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:07:45.198786 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-aa8b43a3-9fd7-4f04-af6b-b794a6727ec3 req-b0bbc50e-76ca-4cdf-ac86-96edf8427e7b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:45.247087 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:45.284902 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-aa8b43a3-9fd7-4f04-af6b-b794a6727ec3 req-b0bbc50e-76ca-4cdf-ac86-96edf8427e7b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.26 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7580152 Nov 09 05:07:45.297825 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-aa8b43a3-9fd7-4f04-af6b-b794a6727ec3 req-dbff23a1-6044-4f7f-97ba-d450c096086a service neutron] Request body: {'port': {'device_id': '43b80c45-ea9f-47de-a4da-40ef6218498c', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:07:45.350305 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-aa8b43a3-9fd7-4f04-af6b-b794a6727ec3 req-dbff23a1-6044-4f7f-97ba-d450c096086a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:45.364634 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e1e72333-3e33-4be3-9ed2-cf050e00f3f6 None None] Provisioning complete for port 207e1e27-b90d-4ea7-a5b2-f6a538eebc54 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:07:45.364993 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e1e72333-3e33-4be3-9ed2-cf050e00f3f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:45.397916 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e1e72333-3e33-4be3-9ed2-cf050e00f3f6 None None] Port 207e1e27-b90d-4ea7-a5b2-f6a538eebc54 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 05:07:45.447296 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 05:07:45.608265 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [req-aa8b43a3-9fd7-4f04-af6b-b794a6727ec3 req-dbff23a1-6044-4f7f-97ba-d450c096086a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 207e1e27-b90d-4ea7-a5b2-f6a538eebc54 {{(pid=102162) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 05:07:45.615451 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-aa8b43a3-9fd7-4f04-af6b-b794a6727ec3 req-dbff23a1-6044-4f7f-97ba-d450c096086a service neutron] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:45.627365 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.provisioning_blocks [req-aa8b43a3-9fd7-4f04-af6b-b794a6727ec3 req-dbff23a1-6044-4f7f-97ba-d450c096086a service neutron] Transition to ACTIVE for port object 207e1e27-b90d-4ea7-a5b2-f6a538eebc54 will not be triggered until provisioned by entity L2. {{(pid=102162) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 09 05:07:45.698220 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-aa8b43a3-9fd7-4f04-af6b-b794a6727ec3 req-dbff23a1-6044-4f7f-97ba-d450c096086a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:45.744065 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b60e7ac4-d130-4c41-991e-aef09926e359 req-9b394e80-5e6d-4f2a-8d6f-0361963263a6 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:07:45.747249 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b60e7ac4-d130-4c41-991e-aef09926e359 req-9b394e80-5e6d-4f2a-8d6f-0361963263a6 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=43b80c45-ea9f-47de-a4da-40ef6218498c HTTP/1.1" status: 200 len: 944 time: 0.0509362 Nov 09 05:07:45.754948 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbff23a1-6044-4f7f-97ba-d450c096086a service neutron] Pushing event updated for resources: {'Port': ['ID=207e1e27-b90d-4ea7-a5b2-f6a538eebc54,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:07:45.800199 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b60e7ac4-d130-4c41-991e-aef09926e359 req-93c559b4-b924-4f51-ad46-df440065a56d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=831e738e-2e97-40d0-aedb-a1c162dcf73d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0480645 Nov 09 05:07:45.823783 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-aa8b43a3-9fd7-4f04-af6b-b794a6727ec3 req-dbff23a1-6044-4f7f-97ba-d450c096086a service neutron] Attempting to bind port 207e1e27-b90d-4ea7-a5b2-f6a538eebc54 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 05:07:45.824123 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-aa8b43a3-9fd7-4f04-af6b-b794a6727ec3 req-dbff23a1-6044-4f7f-97ba-d450c096086a service neutron] Attempting to bind port 207e1e27-b90d-4ea7-a5b2-f6a538eebc54 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '7873d665-dcdc-4807-b36b-1f3dcc6dd977', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 324, 'network_id': '069b3296-503e-4f72-a764-405dcfa9218c'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 05:07:45.824449 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aa8b43a3-9fd7-4f04-af6b-b794a6727ec3 req-dbff23a1-6044-4f7f-97ba-d450c096086a service neutron] Attempting to bind port 207e1e27-b90d-4ea7-a5b2-f6a538eebc54 on network 069b3296-503e-4f72-a764-405dcfa9218c {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 05:07:45.831547 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aa8b43a3-9fd7-4f04-af6b-b794a6727ec3 req-dbff23a1-6044-4f7f-97ba-d450c096086a service neutron] Port 207e1e27-b90d-4ea7-a5b2-f6a538eebc54 on network 069b3296-503e-4f72-a764-405dcfa9218c not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 05:07:45.831995 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aa8b43a3-9fd7-4f04-af6b-b794a6727ec3 req-dbff23a1-6044-4f7f-97ba-d450c096086a service neutron] Attempting to bind port 207e1e27-b90d-4ea7-a5b2-f6a538eebc54 on network 069b3296-503e-4f72-a764-405dcfa9218c {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 05:07:45.837527 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aa8b43a3-9fd7-4f04-af6b-b794a6727ec3 req-dbff23a1-6044-4f7f-97ba-d450c096086a service neutron] Checking agent: {'id': '7d36b884-4ad2-4878-9464-bf647030b544', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'started_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 5, 7, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 05:07:45.837859 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aa8b43a3-9fd7-4f04-af6b-b794a6727ec3 req-dbff23a1-6044-4f7f-97ba-d450c096086a service neutron] Checking segment: {'id': '7873d665-dcdc-4807-b36b-1f3dcc6dd977', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 324, 'network_id': '069b3296-503e-4f72-a764-405dcfa9218c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 05:07:45.838239 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aa8b43a3-9fd7-4f04-af6b-b794a6727ec3 req-dbff23a1-6044-4f7f-97ba-d450c096086a service neutron] Bound using segment: {'id': '7873d665-dcdc-4807-b36b-1f3dcc6dd977', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 324, 'network_id': '069b3296-503e-4f72-a764-405dcfa9218c'} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 05:07:45.838689 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-aa8b43a3-9fd7-4f04-af6b-b794a6727ec3 req-dbff23a1-6044-4f7f-97ba-d450c096086a service neutron] Bound port: 207e1e27-b90d-4ea7-a5b2-f6a538eebc54, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '7873d665-dcdc-4807-b36b-1f3dcc6dd977', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 324, 'network_id': '069b3296-503e-4f72-a764-405dcfa9218c'}}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 05:07:45.839041 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-aa8b43a3-9fd7-4f04-af6b-b794a6727ec3 req-dbff23a1-6044-4f7f-97ba-d450c096086a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:45.908759 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-aa8b43a3-9fd7-4f04-af6b-b794a6727ec3 req-dbff23a1-6044-4f7f-97ba-d450c096086a service neutron] For port 207e1e27-b90d-4ea7-a5b2-f6a538eebc54, host hv-neutron-8168, cleared binding levels {{(pid=102162) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 05:07:45.912104 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-aa8b43a3-9fd7-4f04-af6b-b794a6727ec3 req-dbff23a1-6044-4f7f-97ba-d450c096086a service neutron] For port 207e1e27-b90d-4ea7-a5b2-f6a538eebc54, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=207e1e27-b90d-4ea7-a5b2-f6a538eebc54,segment=NetworkSegment(7873d665-dcdc-4807-b36b-1f3dcc6dd977),segment_id=7873d665-dcdc-4807-b36b-1f3dcc6dd977)] {{(pid=102162) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 05:07:45.967701 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-aa8b43a3-9fd7-4f04-af6b-b794a6727ec3 req-dbff23a1-6044-4f7f-97ba-d450c096086a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:46.005986 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa8b43a3-9fd7-4f04-af6b-b794a6727ec3 req-dbff23a1-6044-4f7f-97ba-d450c096086a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:07:46.006592 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-aa8b43a3-9fd7-4f04-af6b-b794a6727ec3 req-dbff23a1-6044-4f7f-97ba-d450c096086a service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:46.008028 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-aa8b43a3-9fd7-4f04-af6b-b794a6727ec3 req-dbff23a1-6044-4f7f-97ba-d450c096086a service neutron] 10.222.0.26 "PUT /v2.0/ports/207e1e27-b90d-4ea7-a5b2-f6a538eebc54 HTTP/1.1" status: 200 len: 1094 time: 0.7146103 Nov 09 05:07:46.008466 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '43b80c45-ea9f-47de-a4da-40ef6218498c', 'tag': '207e1e27-b90d-4ea7-a5b2-f6a538eebc54'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:07:46.010828 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7c520616-88a2-4b37-8bd0-7d0a32d1cc76" -d '{"events": [{"name": "network-changed", "server_uuid": "43b80c45-ea9f-47de-a4da-40ef6218498c", "tag": "207e1e27-b90d-4ea7-a5b2-f6a538eebc54"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:07:46.039975 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbff23a1-6044-4f7f-97ba-d450c096086a service neutron] Pushing event updated for resources: {'Port': ['ID=207e1e27-b90d-4ea7-a5b2-f6a538eebc54,revision_number=3']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:07:46.050749 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 05:07:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6479ae7a-334f-4c05-a694-562468ec7e77 x-openstack-request-id: req-6479ae7a-334f-4c05-a694-562468ec7e77 {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:07:46.051097 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "43b80c45-ea9f-47de-a4da-40ef6218498c", "tag": "207e1e27-b90d-4ea7-a5b2-f6a538eebc54", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:07:46.051281 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-6479ae7a-334f-4c05-a694-562468ec7e77 {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:07:46.051684 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '43b80c45-ea9f-47de-a4da-40ef6218498c', 'tag': '207e1e27-b90d-4ea7-a5b2-f6a538eebc54', 'status': 'completed', 'code': 200} Nov 09 05:07:46.135203 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c520616-88a2-4b37-8bd0-7d0a32d1cc76 req-15084d97-c907-41b7-8dfe-1bb8d883f278 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:07:46.135203 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7c520616-88a2-4b37-8bd0-7d0a32d1cc76 req-15084d97-c907-41b7-8dfe-1bb8d883f278 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=8ac3eab68bd34485af7ddc3417853b28&device_id=43b80c45-ea9f-47de-a4da-40ef6218498c HTTP/1.1" status: 200 len: 1097 time: 0.0452201 Nov 09 05:07:46.229126 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c520616-88a2-4b37-8bd0-7d0a32d1cc76 req-bc0d1585-b5f1-429a-8f06-0ef08c6c7564 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:07:46.230642 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7c520616-88a2-4b37-8bd0-7d0a32d1cc76 req-bc0d1585-b5f1-429a-8f06-0ef08c6c7564 service neutron] 10.222.0.26 "GET /v2.0/networks?tenant_id=8ac3eab68bd34485af7ddc3417853b28&shared=False HTTP/1.1" status: 200 len: 897 time: 0.1052351 Nov 09 05:07:46.323670 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c520616-88a2-4b37-8bd0-7d0a32d1cc76 req-0a67c567-a180-4bd0-8862-55b397c8fc60 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:07:46.325190 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7c520616-88a2-4b37-8bd0-7d0a32d1cc76 req-0a67c567-a180-4bd0-8862-55b397c8fc60 service neutron] 10.222.0.26 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0877233 Nov 09 05:07:46.399466 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa8b43a3-9fd7-4f04-af6b-b794a6727ec3 req-3573d510-11bd-4272-87fa-a4805f0f5b1d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:07:46.400837 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-aa8b43a3-9fd7-4f04-af6b-b794a6727ec3 req-3573d510-11bd-4272-87fa-a4805f0f5b1d service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=8ac3eab68bd34485af7ddc3417853b28&device_id=43b80c45-ea9f-47de-a4da-40ef6218498c HTTP/1.1" status: 200 len: 1097 time: 0.0397131 Nov 09 05:07:46.445870 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-aa8b43a3-9fd7-4f04-af6b-b794a6727ec3 req-2884f3be-e124-4dd2-afac-4ad756620868 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=207e1e27-b90d-4ea7-a5b2-f6a538eebc54 HTTP/1.1" status: 200 len: 217 time: 0.0377469 Nov 09 05:07:46.494375 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa8b43a3-9fd7-4f04-af6b-b794a6727ec3 req-73161bd4-5b6d-45d4-89e8-bfbfb9f2e7b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:07:46.495781 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-aa8b43a3-9fd7-4f04-af6b-b794a6727ec3 req-73161bd4-5b6d-45d4-89e8-bfbfb9f2e7b5 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=7478814b-170a-4a05-97e1-d47b6c978d7c HTTP/1.1" status: 200 len: 835 time: 0.0436947 Nov 09 05:07:46.539934 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa8b43a3-9fd7-4f04-af6b-b794a6727ec3 req-b9dc78bb-c1cc-4283-8c06-96786a783af3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:07:46.541485 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-aa8b43a3-9fd7-4f04-af6b-b794a6727ec3 req-b9dc78bb-c1cc-4283-8c06-96786a783af3 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=069b3296-503e-4f72-a764-405dcfa9218c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0391600 Nov 09 05:07:46.624456 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:46.635969 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-aa8b43a3-9fd7-4f04-af6b-b794a6727ec3 req-bb1d4bb2-31c6-4382-8982-a48ec9c6e55d service neutron] 10.222.0.26 "GET /v2.0/networks/069b3296-503e-4f72-a764-405dcfa9218c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0875785 Nov 09 05:07:46.723658 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-aa8b43a3-9fd7-4f04-af6b-b794a6727ec3 req-c9e81807-8ef5-4475-9b7c-53bb25fc2d64 service neutron] 10.222.0.26 "GET /v2.0/networks/069b3296-503e-4f72-a764-405dcfa9218c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0810573 Nov 09 05:07:46.921617 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85311e03-e94f-41ea-a08c-0272d3f0551b req-6b526113-4a62-4631-ba82-03e2ac9e57e6 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:07:46.923115 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-85311e03-e94f-41ea-a08c-0272d3f0551b req-6b526113-4a62-4631-ba82-03e2ac9e57e6 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=43b80c45-ea9f-47de-a4da-40ef6218498c HTTP/1.1" status: 200 len: 944 time: 0.0533335 Nov 09 05:07:46.970791 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-85311e03-e94f-41ea-a08c-0272d3f0551b req-6508fb20-a6c2-4c79-989d-5ea324702085 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=831e738e-2e97-40d0-aedb-a1c162dcf73d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0416286 Nov 09 05:07:47.046977 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:47.639645 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 207e1e27-b90d-4ea7-a5b2-f6a538eebc54 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=102163) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 09 05:07:47.732821 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 207e1e27-b90d-4ea7-a5b2-f6a538eebc54, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=207e1e27-b90d-4ea7-a5b2-f6a538eebc54,segment=NetworkSegment(7873d665-dcdc-4807-b36b-1f3dcc6dd977),segment_id=7873d665-dcdc-4807-b36b-1f3dcc6dd977)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:07:47.744282 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Returning: {'device': '207e1e27-b90d-4ea7-a5b2-f6a538eebc54', 'network_id': '069b3296-503e-4f72-a764-405dcfa9218c', 'port_id': '207e1e27-b90d-4ea7-a5b2-f6a538eebc54', 'mac_address': 'fa:16:3e:3b:1a:7c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 324, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '7478814b-170a-4a05-97e1-d47b6c978d7c', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102163) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 09 05:07:47.779532 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:47.791906 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 207e1e27-b90d-4ea7-a5b2-f6a538eebc54 {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 05:07:47.811365 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 207e1e27-b90d-4ea7-a5b2-f6a538eebc54, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=207e1e27-b90d-4ea7-a5b2-f6a538eebc54,segment=NetworkSegment(7873d665-dcdc-4807-b36b-1f3dcc6dd977),segment_id=7873d665-dcdc-4807-b36b-1f3dcc6dd977)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:07:47.892981 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:47.942577 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=207e1e27-b90d-4ea7-a5b2-f6a538eebc54,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:07:48.087592 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b06190fb-22f6-4af8-b563-c8f36371fe56 req-753bbe42-1d4d-4617-a0d9-214982c62018 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:07:48.089151 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b06190fb-22f6-4af8-b563-c8f36371fe56 req-753bbe42-1d4d-4617-a0d9-214982c62018 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=43b80c45-ea9f-47de-a4da-40ef6218498c HTTP/1.1" status: 200 len: 945 time: 0.0520875 Nov 09 05:07:48.109700 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['207e1e27-b90d-4ea7-a5b2-f6a538eebc54'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 05:07:48.137420 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b06190fb-22f6-4af8-b563-c8f36371fe56 req-7f1bed5a-948b-48f2-a36b-93f6d3c72ceb tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=831e738e-2e97-40d0-aedb-a1c162dcf73d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0424116 Nov 09 05:07:49.250676 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b084f7db-6f0f-432d-ae12-e9831f851483 req-1cab04a4-cc68-46d9-88ae-d6415875761d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:07:49.252779 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b084f7db-6f0f-432d-ae12-e9831f851483 req-1cab04a4-cc68-46d9-88ae-d6415875761d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=43b80c45-ea9f-47de-a4da-40ef6218498c HTTP/1.1" status: 200 len: 945 time: 0.0488958 Nov 09 05:07:49.300050 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b084f7db-6f0f-432d-ae12-e9831f851483 req-bb26ae24-3631-4bda-b185-42e592a5bd29 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=831e738e-2e97-40d0-aedb-a1c162dcf73d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0420151 Nov 09 05:07:49.639551 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 207e1e27-b90d-4ea7-a5b2-f6a538eebc54 up at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:07:49.727078 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning for port 207e1e27-b90d-4ea7-a5b2-f6a538eebc54 completed by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 09 05:07:49.730775 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning complete for port 207e1e27-b90d-4ea7-a5b2-f6a538eebc54 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:07:49.731085 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:49.804066 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:49.825454 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '43b80c45-ea9f-47de-a4da-40ef6218498c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '207e1e27-b90d-4ea7-a5b2-f6a538eebc54'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:07:49.827724 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dc98be70-5033-4ced-91c2-04e3105121ab" -d '{"events": [{"server_uuid": "43b80c45-ea9f-47de-a4da-40ef6218498c", "name": "network-vif-plugged", "status": "completed", "tag": "207e1e27-b90d-4ea7-a5b2-f6a538eebc54"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:07:49.843122 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 207e1e27-b90d-4ea7-a5b2-f6a538eebc54, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=207e1e27-b90d-4ea7-a5b2-f6a538eebc54,segment=NetworkSegment(7873d665-dcdc-4807-b36b-1f3dcc6dd977),segment_id=7873d665-dcdc-4807-b36b-1f3dcc6dd977)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:07:49.865366 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 05:07:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0ec64954-c2dd-45a5-9d61-4fffaf65bc2c x-openstack-request-id: req-0ec64954-c2dd-45a5-9d61-4fffaf65bc2c {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:07:49.865366 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "43b80c45-ea9f-47de-a4da-40ef6218498c", "name": "network-vif-plugged", "status": "completed", "tag": "207e1e27-b90d-4ea7-a5b2-f6a538eebc54", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:07:49.865366 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-0ec64954-c2dd-45a5-9d61-4fffaf65bc2c {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:07:49.865672 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '43b80c45-ea9f-47de-a4da-40ef6218498c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '207e1e27-b90d-4ea7-a5b2-f6a538eebc54', 'code': 200} Nov 09 05:07:49.910380 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:49.957551 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=207e1e27-b90d-4ea7-a5b2-f6a538eebc54,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:07:50.150986 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1b8aeb4-6cae-4709-a08d-b46e84b888eb req-75dd3501-ec1a-4e5f-add0-8258ac78a247 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:07:50.152574 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d1b8aeb4-6cae-4709-a08d-b46e84b888eb req-75dd3501-ec1a-4e5f-add0-8258ac78a247 service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=43b80c45-ea9f-47de-a4da-40ef6218498c HTTP/1.1" status: 200 len: 1099 time: 0.0387573 Nov 09 05:07:50.198043 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d1b8aeb4-6cae-4709-a08d-b46e84b888eb req-b331b57a-bc44-488a-987f-632f3c257825 service neutron] 10.222.0.26 "GET /v2.0/security-groups?id=831e738e-2e97-40d0-aedb-a1c162dcf73d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0380363 Nov 09 05:07:50.410558 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40a7db3f-8ff7-4744-bcd0-d3b087f2e908 req-f1317706-5e1a-4d08-a7a5-a44077c0cc51 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:07:50.412020 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-40a7db3f-8ff7-4744-bcd0-d3b087f2e908 req-f1317706-5e1a-4d08-a7a5-a44077c0cc51 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=43b80c45-ea9f-47de-a4da-40ef6218498c HTTP/1.1" status: 200 len: 946 time: 0.0472567 Nov 09 05:07:50.464490 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-40a7db3f-8ff7-4744-bcd0-d3b087f2e908 req-50f8d629-b7fa-454c-8c52-6beb618c02df tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=831e738e-2e97-40d0-aedb-a1c162dcf73d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0467346 Nov 09 05:07:51.582656 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0745054-0e1e-43e3-ba31-4ad7c263f04c req-d09e8bf7-aeb2-47c5-b5a9-b2d1f0bef3e1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:07:51.584171 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a0745054-0e1e-43e3-ba31-4ad7c263f04c req-d09e8bf7-aeb2-47c5-b5a9-b2d1f0bef3e1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=43b80c45-ea9f-47de-a4da-40ef6218498c HTTP/1.1" status: 200 len: 946 time: 0.0510194 Nov 09 05:07:51.639687 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a0745054-0e1e-43e3-ba31-4ad7c263f04c req-258edb2b-6fa8-40e8-8093-d82ef6d92500 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=831e738e-2e97-40d0-aedb-a1c162dcf73d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0493267 Nov 09 05:07:51.763776 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51fe5b1e-64cb-48e2-b98f-91c998274ad1 req-b81bbc55-b40d-443b-be26-3d03c8b1a3bc tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:07:51.765171 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-51fe5b1e-64cb-48e2-b98f-91c998274ad1 req-b81bbc55-b40d-443b-be26-3d03c8b1a3bc tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=43b80c45-ea9f-47de-a4da-40ef6218498c HTTP/1.1" status: 200 len: 946 time: 0.0500493 Nov 09 05:07:51.815762 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-51fe5b1e-64cb-48e2-b98f-91c998274ad1 req-183e8413-3658-431b-9852-b88b0be8c8ca tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=831e738e-2e97-40d0-aedb-a1c162dcf73d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0441329 Nov 09 05:07:51.838900 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 37332) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:07:51.921121 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-abf8294f-3496-4086-8eb5-a71c3ecbbdd3 tempest-TestNetworkAdvancedServerOps-1212315804 tempest-TestNetworkAdvancedServerOps-1212315804-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:07:51.922643 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-abf8294f-3496-4086-8eb5-a71c3ecbbdd3 tempest-TestNetworkAdvancedServerOps-1212315804 tempest-TestNetworkAdvancedServerOps-1212315804-project-admin] 10.222.0.24 "GET /v2.0/ports?device_id=43b80c45-ea9f-47de-a4da-40ef6218498c HTTP/1.1" status: 200 len: 1094 time: 0.0827210 Nov 09 05:07:51.925969 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 37336) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:07:51.930248 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-6a5cfeb9-7740-4b93-8883-b24ee020be04 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'floatingip': {'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'port_id': '207e1e27-b90d-4ea7-a5b2-f6a538eebc54', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'fixed_ip_address': '172.20.0.11'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:07:52.019387 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6a5cfeb9-7740-4b93-8883-b24ee020be04 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for floatingip, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:52.111502 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6a5cfeb9-7740-4b93-8883-b24ee020be04 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:52.212819 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-6a5cfeb9-7740-4b93-8883-b24ee020be04 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Allocated IP 172.26.0.6 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/0179be19-50ae-457b-ba57-8f0793cd0e32) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 05:07:52.314210 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6a5cfeb9-7740-4b93-8883-b24ee020be04 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:52.402187 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6a5cfeb9-7740-4b93-8883-b24ee020be04 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:52.437756 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6a5cfeb9-7740-4b93-8883-b24ee020be04 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:07:52.442923 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-6a5cfeb9-7740-4b93-8883-b24ee020be04 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:07:52.446406 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6a5cfeb9-7740-4b93-8883-b24ee020be04 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 05:07:52.452282 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a5cfeb9-7740-4b93-8883-b24ee020be04 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'Port': ['ID=0179be19-50ae-457b-ba57-8f0793cd0e32,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:07:53.096001 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6a5cfeb9-7740-4b93-8883-b24ee020be04 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:53.323581 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6a5cfeb9-7740-4b93-8883-b24ee020be04 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:53.473620 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6a5cfeb9-7740-4b93-8883-b24ee020be04 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:53.522023 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6a5cfeb9-7740-4b93-8883-b24ee020be04 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:53.592924 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a5cfeb9-7740-4b93-8883-b24ee020be04 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'Port': ['ID=0179be19-50ae-457b-ba57-8f0793cd0e32,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:07:53.601578 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6a5cfeb9-7740-4b93-8883-b24ee020be04 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:53.698000 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.l3_db [None req-6a5cfeb9-7740-4b93-8883-b24ee020be04 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Floating IP 26be9d3e-7b47-45b6-99a0-ebe5bd50eb4a associated. External IP: 172.26.0.6, port: 207e1e27-b90d-4ea7-a5b2-f6a538eebc54. Nov 09 05:07:53.895989 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6a5cfeb9-7740-4b93-8883-b24ee020be04 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Router ca638ddf-69a9-410d-a6d3-22ae3b936315 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 05:07:53.999930 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6a5cfeb9-7740-4b93-8883-b24ee020be04 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 05:07:54.010609 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d3859267-4184-48ad-be8f-e278940aca6d None None] Sync routers for ids ['ca638ddf-69a9-410d-a6d3-22ae3b936315'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 05:07:54.019965 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d3859267-4184-48ad-be8f-e278940aca6d None None] Routers {'ca638ddf-69a9-410d-a6d3-22ae3b936315'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:07:54.020566 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-d3859267-4184-48ad-be8f-e278940aca6d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:07:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['ca638ddf-69a9-410d-a6d3-22ae3b936315'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:07:54.095663 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6a5cfeb9-7740-4b93-8883-b24ee020be04 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:07:54.123872 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-d3859267-4184-48ad-be8f-e278940aca6d None None] Set router ca638ddf-69a9-410d-a6d3-22ae3b936315 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:07:54.128939 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-6a5cfeb9-7740-4b93-8883-b24ee020be04 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 2.1989546 Nov 09 05:07:54.128939 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '43b80c45-ea9f-47de-a4da-40ef6218498c', 'tag': '207e1e27-b90d-4ea7-a5b2-f6a538eebc54'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:07:54.129578 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d0ee5777-98f6-4019-8aed-07d9593d7508" -d '{"events": [{"name": "network-changed", "server_uuid": "43b80c45-ea9f-47de-a4da-40ef6218498c", "tag": "207e1e27-b90d-4ea7-a5b2-f6a538eebc54"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:07:54.175238 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 05:07:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-db51ec1d-2a30-4966-9ceb-fe098eb7ebb3 x-openstack-request-id: req-db51ec1d-2a30-4966-9ceb-fe098eb7ebb3 {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:07:54.175757 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "43b80c45-ea9f-47de-a4da-40ef6218498c", "tag": "207e1e27-b90d-4ea7-a5b2-f6a538eebc54", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:07:54.176005 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-db51ec1d-2a30-4966-9ceb-fe098eb7ebb3 {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:07:54.176531 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '43b80c45-ea9f-47de-a4da-40ef6218498c', 'tag': '207e1e27-b90d-4ea7-a5b2-f6a538eebc54', 'status': 'completed', 'code': 200} Nov 09 05:07:54.263131 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fae9e499-6a64-457b-bf38-ea3d6c31b563 req-df937016-f664-4819-9f59-75d39a28cb20 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:07:54.264639 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fae9e499-6a64-457b-bf38-ea3d6c31b563 req-df937016-f664-4819-9f59-75d39a28cb20 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=43b80c45-ea9f-47de-a4da-40ef6218498c HTTP/1.1" status: 200 len: 946 time: 0.0760376 Nov 09 05:07:54.267440 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0ee5777-98f6-4019-8aed-07d9593d7508 req-46a05318-3e92-438c-9b40-6001a4d47843 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:07:54.268871 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d0ee5777-98f6-4019-8aed-07d9593d7508 req-46a05318-3e92-438c-9b40-6001a4d47843 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=8ac3eab68bd34485af7ddc3417853b28&device_id=43b80c45-ea9f-47de-a4da-40ef6218498c HTTP/1.1" status: 200 len: 1099 time: 0.0707293 Nov 09 05:07:54.350215 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-d3859267-4184-48ad-be8f-e278940aca6d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ca638ddf-69a9-410d-a6d3-22ae3b936315', 'name': 'tempest-TestNetworkAdvancedServerOps-router-44819952', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.61'}], 'enable_snat': True}, 'gw_port_id': '7a1c6236-8dbc-4010-8eef-a68a599be703', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:07:36Z', 'updated_at': '2021-11-09T05:07:40Z', 'revision_number': 4, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': '7a1c6236-8dbc-4010-8eef-a68a599be703', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:7a:29:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ca638ddf-69a9-410d-a6d3-22ae3b936315', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1767, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.61', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:07:36Z', 'updated_at': '2021-11-09T05:07:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '26be9d3e-7b47-45b6-99a0-ebe5bd50eb4a', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'floating_ip_address': '172.26.0.6', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': 'ca638ddf-69a9-410d-a6d3-22ae3b936315', 'port_id': '207e1e27-b90d-4ea7-a5b2-f6a538eebc54', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 1773, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '069b3296-503e-4f72-a764-405dcfa9218c', 'mac_address': 'fa:16:3e:3b:1a:7c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '43b80c45-ea9f-47de-a4da-40ef6218498c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T05:07:52Z', 'updated_at': '2021-11-09T05:07:52Z', 'revision_number': 0, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '2ed6b6d4-e405-45c9-b741-d32ffaab1896', 'name': '', 'network_id': '069b3296-503e-4f72-a764-405dcfa9218c', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'mac_address': 'fa:16:3e:88:af:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ca638ddf-69a9-410d-a6d3-22ae3b936315', 'device_owner': 'network:router_interface', 'standard_attr_id': 1770, 'fixed_ips': [{'subnet_id': '7478814b-170a-4a05-97e1-d47b6c978d7c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:07:40Z', 'updated_at': '2021-11-09T05:07:43Z', 'revision_number': 5, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'subnets': [{'id': '7478814b-170a-4a05-97e1-d47b6c978d7c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:07:54.369705 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fae9e499-6a64-457b-bf38-ea3d6c31b563 req-a8eb6513-26a5-4893-b9c0-c36636a332b3 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=831e738e-2e97-40d0-aedb-a1c162dcf73d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0990608 Nov 09 05:07:54.376060 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d3859267-4184-48ad-be8f-e278940aca6d None None] Checking router: ca638ddf-69a9-410d-a6d3-22ae3b936315 for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 05:07:54.385163 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d3859267-4184-48ad-be8f-e278940aca6d None None] Routers {'ca638ddf-69a9-410d-a6d3-22ae3b936315'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:07:54.385772 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-d3859267-4184-48ad-be8f-e278940aca6d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:07:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['ca638ddf-69a9-410d-a6d3-22ae3b936315'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:07:54.392824 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 37342) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:07:54.397879 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0ee5777-98f6-4019-8aed-07d9593d7508 req-a013b1f4-0230-44c0-831f-b261a425c914 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:07:54.399579 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d0ee5777-98f6-4019-8aed-07d9593d7508 req-a013b1f4-0230-44c0-831f-b261a425c914 service neutron] 10.222.0.26 "GET /v2.0/networks?id=069b3296-503e-4f72-a764-405dcfa9218c HTTP/1.1" status: 200 len: 897 time: 0.1223772 Nov 09 05:07:54.461424 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-68e18c6f-c53b-4edf-8107-87677fee60f2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/floatingips/26be9d3e-7b47-45b6-99a0-ebe5bd50eb4a HTTP/1.1" status: 200 len: 990 time: 0.0659482 Nov 09 05:07:54.471763 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d0ee5777-98f6-4019-8aed-07d9593d7508 req-e92e8fc2-7134-4011-bb0d-dcc0170e8a71 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=207e1e27-b90d-4ea7-a5b2-f6a538eebc54 HTTP/1.1" status: 200 len: 998 time: 0.0648770 Nov 09 05:07:54.492751 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-d3859267-4184-48ad-be8f-e278940aca6d None None] Set router ca638ddf-69a9-410d-a6d3-22ae3b936315 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:07:54.524240 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0ee5777-98f6-4019-8aed-07d9593d7508 req-b94376b3-f673-41d4-91b3-45e92ac4e4c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:07:54.525672 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d0ee5777-98f6-4019-8aed-07d9593d7508 req-b94376b3-f673-41d4-91b3-45e92ac4e4c8 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=7478814b-170a-4a05-97e1-d47b6c978d7c HTTP/1.1" status: 200 len: 835 time: 0.0473082 Nov 09 05:07:54.570608 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0ee5777-98f6-4019-8aed-07d9593d7508 req-7bbf19c4-8e6e-4adf-8df1-210dc5f0cf7e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:07:54.572064 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d0ee5777-98f6-4019-8aed-07d9593d7508 req-7bbf19c4-8e6e-4adf-8df1-210dc5f0cf7e service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=069b3296-503e-4f72-a764-405dcfa9218c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0399363 Nov 09 05:07:54.690256 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d0ee5777-98f6-4019-8aed-07d9593d7508 req-a9dfb0ab-cee3-405b-8b83-38a560919a7f service neutron] 10.222.0.26 "GET /v2.0/networks/069b3296-503e-4f72-a764-405dcfa9218c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1111777 Nov 09 05:07:54.740824 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-d3859267-4184-48ad-be8f-e278940aca6d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ca638ddf-69a9-410d-a6d3-22ae3b936315', 'name': 'tempest-TestNetworkAdvancedServerOps-router-44819952', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.61'}], 'enable_snat': True}, 'gw_port_id': '7a1c6236-8dbc-4010-8eef-a68a599be703', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:07:36Z', 'updated_at': '2021-11-09T05:07:40Z', 'revision_number': 4, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': '7a1c6236-8dbc-4010-8eef-a68a599be703', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:7a:29:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ca638ddf-69a9-410d-a6d3-22ae3b936315', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1767, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.61', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:07:36Z', 'updated_at': '2021-11-09T05:07:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '26be9d3e-7b47-45b6-99a0-ebe5bd50eb4a', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'floating_ip_address': '172.26.0.6', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': 'ca638ddf-69a9-410d-a6d3-22ae3b936315', 'port_id': '207e1e27-b90d-4ea7-a5b2-f6a538eebc54', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 1773, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '069b3296-503e-4f72-a764-405dcfa9218c', 'mac_address': 'fa:16:3e:3b:1a:7c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '43b80c45-ea9f-47de-a4da-40ef6218498c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T05:07:52Z', 'updated_at': '2021-11-09T05:07:52Z', 'revision_number': 0, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '2ed6b6d4-e405-45c9-b741-d32ffaab1896', 'name': '', 'network_id': '069b3296-503e-4f72-a764-405dcfa9218c', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'mac_address': 'fa:16:3e:88:af:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ca638ddf-69a9-410d-a6d3-22ae3b936315', 'device_owner': 'network:router_interface', 'standard_attr_id': 1770, 'fixed_ips': [{'subnet_id': '7478814b-170a-4a05-97e1-d47b6c978d7c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:07:40Z', 'updated_at': '2021-11-09T05:07:43Z', 'revision_number': 5, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'subnets': [{'id': '7478814b-170a-4a05-97e1-d47b6c978d7c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:07:54.766565 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d3859267-4184-48ad-be8f-e278940aca6d None None] The sync data for ids ['ca638ddf-69a9-410d-a6d3-22ae3b936315'] in dv-neutron-816802-2-hyperv is: [{'id': 'ca638ddf-69a9-410d-a6d3-22ae3b936315', 'name': 'tempest-TestNetworkAdvancedServerOps-router-44819952', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.61'}], 'enable_snat': True}, 'gw_port_id': '7a1c6236-8dbc-4010-8eef-a68a599be703', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:07:36Z', 'updated_at': '2021-11-09T05:07:40Z', 'revision_number': 4, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': '7a1c6236-8dbc-4010-8eef-a68a599be703', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:7a:29:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ca638ddf-69a9-410d-a6d3-22ae3b936315', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1767, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.61', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:07:36Z', 'updated_at': '2021-11-09T05:07:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '26be9d3e-7b47-45b6-99a0-ebe5bd50eb4a', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'floating_ip_address': '172.26.0.6', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': 'ca638ddf-69a9-410d-a6d3-22ae3b936315', 'port_id': '207e1e27-b90d-4ea7-a5b2-f6a538eebc54', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 1773, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '069b3296-503e-4f72-a764-405dcfa9218c', 'mac_address': 'fa:16:3e:3b:1a:7c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '43b80c45-ea9f-47de-a4da-40ef6218498c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T05:07:52Z', 'updated_at': '2021-11-09T05:07:52Z', 'revision_number': 0, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '2ed6b6d4-e405-45c9-b741-d32ffaab1896', 'name': '', 'network_id': '069b3296-503e-4f72-a764-405dcfa9218c', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'mac_address': 'fa:16:3e:88:af:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ca638ddf-69a9-410d-a6d3-22ae3b936315', 'device_owner': 'network:router_interface', 'standard_attr_id': 1770, 'fixed_ips': [{'subnet_id': '7478814b-170a-4a05-97e1-d47b6c978d7c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:07:40Z', 'updated_at': '2021-11-09T05:07:43Z', 'revision_number': 5, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'subnets': [{'id': '7478814b-170a-4a05-97e1-d47b6c978d7c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 05:07:54.785836 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d0ee5777-98f6-4019-8aed-07d9593d7508 req-fb87123b-8fdc-48f9-8bfc-624f138b9244 service neutron] 10.222.0.26 "GET /v2.0/networks/069b3296-503e-4f72-a764-405dcfa9218c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0891802 Nov 09 05:07:54.961104 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9d35bde6-b968-4679-b885-e5a9c009af3b None None] New status for floating IP 26be9d3e-7b47-45b6-99a0-ebe5bd50eb4a: ACTIVE {{(pid=102163) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 05:07:55.463923 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 37344) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:07:55.523247 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-5e3468fa-6807-4174-b8d4-b85c31b40e5a tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/floatingips/26be9d3e-7b47-45b6-99a0-ebe5bd50eb4a HTTP/1.1" status: 200 len: 992 time: 0.0581851 Nov 09 05:08:09.322755 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [req-3d2e962a-934e-4863-8a96-e9ecf7cccc0d req-c5f35be6-cc1d-42a9-84a5-717600424c7f service neutron] (102162) timed out ('10.222.0.26', 56274) {{(pid=102162) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:820}} Nov 09 05:08:11.380787 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-fa6442ea-6f52-47fb-88de-3c70f4a1f692 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:08:12.575358 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:08:13.837915 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a839a418-7fdc-4606-ab8b-1ea0d6c47f01 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:08:15.238591 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:08:16.604039 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:08:16.987407 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:08:22.446065 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 05:08:26.298387 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-809a391c-6513-4bb6-a611-11af56d9f75a req-afdc8495-a054-4126-bcf8-8a84fd4cdc9b service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=43b80c45-ea9f-47de-a4da-40ef6218498c&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0392170 Nov 09 05:08:26.379255 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-809a391c-6513-4bb6-a611-11af56d9f75a req-c6d6e28c-1293-4e48-a8cc-91ccff9b6486 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:08:26.380707 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-809a391c-6513-4bb6-a611-11af56d9f75a req-c6d6e28c-1293-4e48-a8cc-91ccff9b6486 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=8ac3eab68bd34485af7ddc3417853b28&device_id=43b80c45-ea9f-47de-a4da-40ef6218498c HTTP/1.1" status: 200 len: 1099 time: 0.0399635 Nov 09 05:08:26.492328 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-809a391c-6513-4bb6-a611-11af56d9f75a req-0d84f115-9d44-4b89-8be4-82f58ec6864e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:08:26.493789 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-809a391c-6513-4bb6-a611-11af56d9f75a req-0d84f115-9d44-4b89-8be4-82f58ec6864e service neutron] 10.222.0.26 "GET /v2.0/networks?id=069b3296-503e-4f72-a764-405dcfa9218c HTTP/1.1" status: 200 len: 897 time: 0.0927401 Nov 09 05:08:26.561311 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-809a391c-6513-4bb6-a611-11af56d9f75a req-12a8dc1c-b185-4864-b738-701268826b29 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=207e1e27-b90d-4ea7-a5b2-f6a538eebc54 HTTP/1.1" status: 200 len: 1000 time: 0.0573797 Nov 09 05:08:26.614452 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-809a391c-6513-4bb6-a611-11af56d9f75a req-a681c2c0-41b7-450f-af7b-d4c614af93c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:08:26.615918 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-809a391c-6513-4bb6-a611-11af56d9f75a req-a681c2c0-41b7-450f-af7b-d4c614af93c8 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=7478814b-170a-4a05-97e1-d47b6c978d7c HTTP/1.1" status: 200 len: 835 time: 0.0476959 Nov 09 05:08:26.661715 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-809a391c-6513-4bb6-a611-11af56d9f75a req-b870b4f1-ab2c-4241-8edc-d804d17a0f0f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:08:26.663234 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-809a391c-6513-4bb6-a611-11af56d9f75a req-b870b4f1-ab2c-4241-8edc-d804d17a0f0f service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=069b3296-503e-4f72-a764-405dcfa9218c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0403326 Nov 09 05:08:26.761580 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-809a391c-6513-4bb6-a611-11af56d9f75a req-1e3c72a1-dd2a-4e5d-8d6c-04117b65baa4 service neutron] 10.222.0.26 "GET /v2.0/networks/069b3296-503e-4f72-a764-405dcfa9218c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0895665 Nov 09 05:08:26.853069 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-809a391c-6513-4bb6-a611-11af56d9f75a req-baa27fb0-1360-4860-bbbc-025106e1aa8e service neutron] 10.222.0.26 "GET /v2.0/networks/069b3296-503e-4f72-a764-405dcfa9218c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0816970 Nov 09 05:08:27.002932 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-588bed37-f52e-4942-a6a6-3868eaa1f5ca req-25415260-fa0b-413a-b67e-2721d3f90c03 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:08:27.004479 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-588bed37-f52e-4942-a6a6-3868eaa1f5ca req-25415260-fa0b-413a-b67e-2721d3f90c03 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=43b80c45-ea9f-47de-a4da-40ef6218498c HTTP/1.1" status: 200 len: 946 time: 0.0521822 Nov 09 05:08:27.053026 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-588bed37-f52e-4942-a6a6-3868eaa1f5ca req-728a5b7b-5fdb-4a4e-a6b6-40045921307a tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=831e738e-2e97-40d0-aedb-a1c162dcf73d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0424798 Nov 09 05:08:28.167654 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6036eaa-758d-4c48-945f-4fcc7b8943a4 req-35c169b5-7222-4c4d-b25f-25e13675c8f2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:08:28.169004 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b6036eaa-758d-4c48-945f-4fcc7b8943a4 req-35c169b5-7222-4c4d-b25f-25e13675c8f2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=43b80c45-ea9f-47de-a4da-40ef6218498c HTTP/1.1" status: 200 len: 946 time: 0.0476472 Nov 09 05:08:28.220246 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b6036eaa-758d-4c48-945f-4fcc7b8943a4 req-0eba9445-06dc-4f95-b6fd-21d09ea194d8 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=831e738e-2e97-40d0-aedb-a1c162dcf73d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0455160 Nov 09 05:08:29.336459 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b51a0e8-c6ac-415a-ab0e-e0fc44e47a6c req-42a49233-6e34-491b-b9f2-e4810c7e9863 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:08:29.337936 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-0b51a0e8-c6ac-415a-ab0e-e0fc44e47a6c req-42a49233-6e34-491b-b9f2-e4810c7e9863 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=43b80c45-ea9f-47de-a4da-40ef6218498c HTTP/1.1" status: 200 len: 946 time: 0.0522649 Nov 09 05:08:29.385211 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-0b51a0e8-c6ac-415a-ab0e-e0fc44e47a6c req-8257504e-76a5-4090-83cd-5fbe966636e6 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=831e738e-2e97-40d0-aedb-a1c162dcf73d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0411906 Nov 09 05:08:30.496758 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-470bdc78-67c1-441f-9236-b23061cf7bfb req-79ededec-c950-4f39-abe1-3631d131712c tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:08:30.498205 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-470bdc78-67c1-441f-9236-b23061cf7bfb req-79ededec-c950-4f39-abe1-3631d131712c tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=43b80c45-ea9f-47de-a4da-40ef6218498c HTTP/1.1" status: 200 len: 946 time: 0.0484667 Nov 09 05:08:30.546269 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-470bdc78-67c1-441f-9236-b23061cf7bfb req-31fab6fe-094b-47b9-9ce5-c89cc8ba9566 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=831e738e-2e97-40d0-aedb-a1c162dcf73d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0420504 Nov 09 05:08:31.662639 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5660f119-599c-46a1-b210-5b4b5f8b0a8d req-dbbe1053-12d9-4102-96e9-ade3f59732f9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:08:31.664175 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-5660f119-599c-46a1-b210-5b4b5f8b0a8d req-dbbe1053-12d9-4102-96e9-ade3f59732f9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=43b80c45-ea9f-47de-a4da-40ef6218498c HTTP/1.1" status: 200 len: 946 time: 0.0501473 Nov 09 05:08:31.734709 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-5660f119-599c-46a1-b210-5b4b5f8b0a8d req-06cfaebc-a097-4a7a-aae3-efc3211a475d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=831e738e-2e97-40d0-aedb-a1c162dcf73d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0646415 Nov 09 05:08:32.850221 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0dfbe292-bf3c-4632-a424-db0a9808709b req-e263fdac-2950-4a5a-9ff6-6507ac05e3d4 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:08:32.851708 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-0dfbe292-bf3c-4632-a424-db0a9808709b req-e263fdac-2950-4a5a-9ff6-6507ac05e3d4 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=43b80c45-ea9f-47de-a4da-40ef6218498c HTTP/1.1" status: 200 len: 946 time: 0.0476797 Nov 09 05:08:32.899821 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-0dfbe292-bf3c-4632-a424-db0a9808709b req-fa0e6f6d-4099-4845-923c-d102c03026bc tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=831e738e-2e97-40d0-aedb-a1c162dcf73d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0423317 Nov 09 05:08:34.013038 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c5a75b8-8993-4f6c-974f-3bd498be3003 req-78dc2515-9b69-4f75-b32a-9f4ad3f12186 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:08:34.014518 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-0c5a75b8-8993-4f6c-974f-3bd498be3003 req-78dc2515-9b69-4f75-b32a-9f4ad3f12186 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=43b80c45-ea9f-47de-a4da-40ef6218498c HTTP/1.1" status: 200 len: 946 time: 0.0480058 Nov 09 05:08:34.061901 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-0c5a75b8-8993-4f6c-974f-3bd498be3003 req-bbe2fce1-7011-4bb1-9ae2-b85e65a78b46 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=831e738e-2e97-40d0-aedb-a1c162dcf73d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0415275 Nov 09 05:08:35.178080 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-972943a4-c478-4af3-a8fd-d280a3dccc8d req-a3bd2410-566e-401e-b534-e024b907c7f4 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:08:35.179477 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-972943a4-c478-4af3-a8fd-d280a3dccc8d req-a3bd2410-566e-401e-b534-e024b907c7f4 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=43b80c45-ea9f-47de-a4da-40ef6218498c HTTP/1.1" status: 200 len: 946 time: 0.0518694 Nov 09 05:08:35.227323 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-972943a4-c478-4af3-a8fd-d280a3dccc8d req-6110ddaa-ac41-4835-8327-050590118975 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=831e738e-2e97-40d0-aedb-a1c162dcf73d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0420856 Nov 09 05:08:36.338708 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-238e9541-6886-43c6-8e79-b8ad24e1fda2 req-8485b021-0b75-46b8-b349-0512a318aa41 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:08:36.340178 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-238e9541-6886-43c6-8e79-b8ad24e1fda2 req-8485b021-0b75-46b8-b349-0512a318aa41 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=43b80c45-ea9f-47de-a4da-40ef6218498c HTTP/1.1" status: 200 len: 946 time: 0.0475984 Nov 09 05:08:36.388167 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-238e9541-6886-43c6-8e79-b8ad24e1fda2 req-978b1171-262d-48cc-bc38-e148ca192ab4 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=831e738e-2e97-40d0-aedb-a1c162dcf73d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0418651 Nov 09 05:08:37.501528 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04116fa4-5f04-4479-8fb5-d3da6598a9f6 req-bac40d8f-dcd9-4615-a583-f2fce0cc1989 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:08:37.503044 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-04116fa4-5f04-4479-8fb5-d3da6598a9f6 req-bac40d8f-dcd9-4615-a583-f2fce0cc1989 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=43b80c45-ea9f-47de-a4da-40ef6218498c HTTP/1.1" status: 200 len: 946 time: 0.0487888 Nov 09 05:08:37.552360 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-04116fa4-5f04-4479-8fb5-d3da6598a9f6 req-4555c87d-67d3-4a4c-a85b-465e11b9f177 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=831e738e-2e97-40d0-aedb-a1c162dcf73d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0428147 Nov 09 05:08:38.669033 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da4d1557-21cc-4072-9529-bae09da269ba req-eb6445d0-8c3f-47e4-913f-10be8e02b6e7 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:08:38.670534 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-da4d1557-21cc-4072-9529-bae09da269ba req-eb6445d0-8c3f-47e4-913f-10be8e02b6e7 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=43b80c45-ea9f-47de-a4da-40ef6218498c HTTP/1.1" status: 200 len: 946 time: 0.0522878 Nov 09 05:08:38.719308 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-da4d1557-21cc-4072-9529-bae09da269ba req-806155d6-bdba-471b-9615-e9abb66d5494 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=831e738e-2e97-40d0-aedb-a1c162dcf73d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0428877 Nov 09 05:08:39.832189 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2086f3c-7852-41c6-8815-b8adce0b564f req-989adb24-daf4-4602-953e-ca04183aecd5 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:08:39.833630 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d2086f3c-7852-41c6-8815-b8adce0b564f req-989adb24-daf4-4602-953e-ca04183aecd5 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=43b80c45-ea9f-47de-a4da-40ef6218498c HTTP/1.1" status: 200 len: 946 time: 0.0470245 Nov 09 05:08:39.885719 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d2086f3c-7852-41c6-8815-b8adce0b564f req-cbbdf61d-839b-4444-ba1d-fd56fd5ef73a tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=831e738e-2e97-40d0-aedb-a1c162dcf73d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0456457 Nov 09 05:08:40.999127 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5d21961-3bab-497b-979d-5cbd7c1ebdea req-409d3b8e-3922-46df-8c11-fb679671aeb7 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:08:41.000578 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c5d21961-3bab-497b-979d-5cbd7c1ebdea req-409d3b8e-3922-46df-8c11-fb679671aeb7 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=43b80c45-ea9f-47de-a4da-40ef6218498c HTTP/1.1" status: 200 len: 946 time: 0.0485938 Nov 09 05:08:41.048515 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c5d21961-3bab-497b-979d-5cbd7c1ebdea req-5b93338e-4d92-4fab-8ddf-5a7187f5f5d4 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=831e738e-2e97-40d0-aedb-a1c162dcf73d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0420966 Nov 09 05:08:41.366308 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e96afa4e-ea5a-4ac6-bb79-1c35703acf88 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:08:42.166760 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-943b07c8-8fe8-46bf-b2cb-67d8f61e7778 req-d1c54381-c662-4024-945f-27e699a63104 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:08:42.168117 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-943b07c8-8fe8-46bf-b2cb-67d8f61e7778 req-d1c54381-c662-4024-945f-27e699a63104 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=43b80c45-ea9f-47de-a4da-40ef6218498c HTTP/1.1" status: 200 len: 946 time: 0.0482168 Nov 09 05:08:42.215038 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-943b07c8-8fe8-46bf-b2cb-67d8f61e7778 req-ebdec6ab-dbf0-4c0d-9571-186e5d72f633 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=831e738e-2e97-40d0-aedb-a1c162dcf73d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0411701 Nov 09 05:08:42.560332 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:08:43.327136 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ff1e15c-0fe6-4833-a657-38af5b852374 req-bdffe686-bb83-447c-98ff-b93d6800289e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:08:43.328572 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-8ff1e15c-0fe6-4833-a657-38af5b852374 req-bdffe686-bb83-447c-98ff-b93d6800289e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=43b80c45-ea9f-47de-a4da-40ef6218498c HTTP/1.1" status: 200 len: 946 time: 0.0472744 Nov 09 05:08:43.379869 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-8ff1e15c-0fe6-4833-a657-38af5b852374 req-b02196bd-7f98-41f8-bfc2-456390f244f1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=831e738e-2e97-40d0-aedb-a1c162dcf73d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0454986 Nov 09 05:08:43.401126 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 37392) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:08:43.459544 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-a87242ef-81a2-462b-9a15-420fb399dc76 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/floatingips/26be9d3e-7b47-45b6-99a0-ebe5bd50eb4a HTTP/1.1" status: 200 len: 992 time: 0.0573313 Nov 09 05:08:43.720629 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-924839e2-017b-4173-9332-8da4b85eb4be None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:08:44.921865 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-696d9358-2698-41de-92ae-d745b59446f1 req-ddc9f478-50ae-457b-982a-6b2ccb968f2f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:08:44.923376 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-696d9358-2698-41de-92ae-d745b59446f1 req-ddc9f478-50ae-457b-982a-6b2ccb968f2f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=43b80c45-ea9f-47de-a4da-40ef6218498c HTTP/1.1" status: 200 len: 946 time: 0.0496116 Nov 09 05:08:44.973993 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-696d9358-2698-41de-92ae-d745b59446f1 req-388da30d-3db4-4ed4-9839-70880998c061 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=831e738e-2e97-40d0-aedb-a1c162dcf73d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0434124 Nov 09 05:08:45.016856 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f9e0a2d-bea0-45bd-a4b4-a6c025e754a7 req-4480c86b-3dca-4dd6-96e1-d772350e1931 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:08:45.018316 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3f9e0a2d-bea0-45bd-a4b4-a6c025e754a7 req-4480c86b-3dca-4dd6-96e1-d772350e1931 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=8ac3eab68bd34485af7ddc3417853b28&device_id=43b80c45-ea9f-47de-a4da-40ef6218498c HTTP/1.1" status: 200 len: 1099 time: 0.0432734 Nov 09 05:08:45.113100 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f9e0a2d-bea0-45bd-a4b4-a6c025e754a7 req-1d9b68bb-d7cd-43eb-8692-f116974487ed service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:08:45.114499 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3f9e0a2d-bea0-45bd-a4b4-a6c025e754a7 req-1d9b68bb-d7cd-43eb-8692-f116974487ed service neutron] 10.222.0.26 "GET /v2.0/networks?id=069b3296-503e-4f72-a764-405dcfa9218c HTTP/1.1" status: 200 len: 897 time: 0.0895450 Nov 09 05:08:45.181995 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3f9e0a2d-bea0-45bd-a4b4-a6c025e754a7 req-18159d77-c52b-46a2-ac01-bb04b5c4f883 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=207e1e27-b90d-4ea7-a5b2-f6a538eebc54 HTTP/1.1" status: 200 len: 1000 time: 0.0608456 Nov 09 05:08:45.230691 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f9e0a2d-bea0-45bd-a4b4-a6c025e754a7 req-fe75017c-ba1d-4e06-9a18-a6348811c93f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:08:45.232169 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3f9e0a2d-bea0-45bd-a4b4-a6c025e754a7 req-fe75017c-ba1d-4e06-9a18-a6348811c93f service neutron] 10.222.0.26 "GET /v2.0/subnets?id=7478814b-170a-4a05-97e1-d47b6c978d7c HTTP/1.1" status: 200 len: 835 time: 0.0435417 Nov 09 05:08:45.252429 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:08:45.275941 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f9e0a2d-bea0-45bd-a4b4-a6c025e754a7 req-6f8e2674-68c4-42ff-93de-b731a04e48e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:08:45.277391 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3f9e0a2d-bea0-45bd-a4b4-a6c025e754a7 req-6f8e2674-68c4-42ff-93de-b731a04e48e1 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=069b3296-503e-4f72-a764-405dcfa9218c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0386469 Nov 09 05:08:45.369931 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3f9e0a2d-bea0-45bd-a4b4-a6c025e754a7 req-2cd88703-cbdd-47cf-a7e7-7d1449da9d34 service neutron] 10.222.0.26 "GET /v2.0/networks/069b3296-503e-4f72-a764-405dcfa9218c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0848076 Nov 09 05:08:45.456469 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3f9e0a2d-bea0-45bd-a4b4-a6c025e754a7 req-e29cd28c-186e-4cee-a193-4c0b89ff9bc9 service neutron] 10.222.0.26 "GET /v2.0/networks/069b3296-503e-4f72-a764-405dcfa9218c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0800395 Nov 09 05:08:46.090896 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea53f65f-8a46-44bb-9841-b5898f501602 req-a4d0e6c8-51cc-4776-9cf9-018fccf89817 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:08:46.092635 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ea53f65f-8a46-44bb-9841-b5898f501602 req-a4d0e6c8-51cc-4776-9cf9-018fccf89817 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=43b80c45-ea9f-47de-a4da-40ef6218498c HTTP/1.1" status: 200 len: 946 time: 0.0488036 Nov 09 05:08:46.145626 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ea53f65f-8a46-44bb-9841-b5898f501602 req-aa02fcb1-b3dc-4551-bf47-ef1a81c4c529 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=831e738e-2e97-40d0-aedb-a1c162dcf73d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0469720 Nov 09 05:08:46.167855 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 37404) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:08:46.226178 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-7ffb6b6b-38f3-4b11-82a4-fb9ce0f0954b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/floatingips/26be9d3e-7b47-45b6-99a0-ebe5bd50eb4a HTTP/1.1" status: 200 len: 992 time: 0.0572183 Nov 09 05:08:46.623943 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:08:46.978157 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:08:59.445141 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 05:09:11.363600 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c45a0cc4-3b3a-4192-a491-95bca71f83a1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:12.586137 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:13.734597 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8c140bd7-edb0-4962-aa0d-e8bb9081d613 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:15.254833 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:16.620757 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:17.015495 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:19.005247 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 37418) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:09:19.166460 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-7906b9a4-86fe-4770-ab6b-a47c3dd8dd01 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Deleting port 0179be19-50ae-457b-ba57-8f0793cd0e32 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:09:19.166713 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7906b9a4-86fe-4770-ab6b-a47c3dd8dd01 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:19.245004 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7906b9a4-86fe-4770-ab6b-a47c3dd8dd01 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:19.245325 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7906b9a4-86fe-4770-ab6b-a47c3dd8dd01 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:19.257121 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-7906b9a4-86fe-4770-ab6b-a47c3dd8dd01 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Calling delete_port for 0179be19-50ae-457b-ba57-8f0793cd0e32 owned by network:floatingip {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:09:19.478404 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7906b9a4-86fe-4770-ab6b-a47c3dd8dd01 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:19.502667 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7906b9a4-86fe-4770-ab6b-a47c3dd8dd01 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event deleted for resources: {'Port': ['ID=0179be19-50ae-457b-ba57-8f0793cd0e32,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:09:19.532518 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7906b9a4-86fe-4770-ab6b-a47c3dd8dd01 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:09:19.532860 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7906b9a4-86fe-4770-ab6b-a47c3dd8dd01 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:09:19.533203 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7906b9a4-86fe-4770-ab6b-a47c3dd8dd01 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:09:19.533538 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7906b9a4-86fe-4770-ab6b-a47c3dd8dd01 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:09:19.533909 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7906b9a4-86fe-4770-ab6b-a47c3dd8dd01 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:09:19.534225 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7906b9a4-86fe-4770-ab6b-a47c3dd8dd01 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:09:19.534580 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7906b9a4-86fe-4770-ab6b-a47c3dd8dd01 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:09:19.534904 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7906b9a4-86fe-4770-ab6b-a47c3dd8dd01 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:09:19.535322 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7906b9a4-86fe-4770-ab6b-a47c3dd8dd01 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:09:19.536229 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7906b9a4-86fe-4770-ab6b-a47c3dd8dd01 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:09:19.536552 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7906b9a4-86fe-4770-ab6b-a47c3dd8dd01 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:09:19.536880 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7906b9a4-86fe-4770-ab6b-a47c3dd8dd01 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:09:19.581687 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7906b9a4-86fe-4770-ab6b-a47c3dd8dd01 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for floatingip, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:19.582012 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.l3_db [None req-7906b9a4-86fe-4770-ab6b-a47c3dd8dd01 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Floating IP 26be9d3e-7b47-45b6-99a0-ebe5bd50eb4a disassociated (deleted). External IP: 172.26.0.6, port: 207e1e27-b90d-4ea7-a5b2-f6a538eebc54. Nov 09 05:09:20.055239 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7906b9a4-86fe-4770-ab6b-a47c3dd8dd01 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Router ca638ddf-69a9-410d-a6d3-22ae3b936315 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 05:09:20.157631 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7906b9a4-86fe-4770-ab6b-a47c3dd8dd01 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 05:09:20.162960 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7906b9a4-86fe-4770-ab6b-a47c3dd8dd01 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:20.167866 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8010ac2c-9eba-4e3c-8aef-a739a5095cb1 None None] Sync routers for ids ['ca638ddf-69a9-410d-a6d3-22ae3b936315'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 05:09:20.178669 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8010ac2c-9eba-4e3c-8aef-a739a5095cb1 None None] Routers {'ca638ddf-69a9-410d-a6d3-22ae3b936315'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:09:20.179286 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-8010ac2c-9eba-4e3c-8aef-a739a5095cb1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:09:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['ca638ddf-69a9-410d-a6d3-22ae3b936315'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:09:20.189774 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-7906b9a4-86fe-4770-ab6b-a47c3dd8dd01 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "DELETE /v2.0/floatingips/26be9d3e-7b47-45b6-99a0-ebe5bd50eb4a HTTP/1.1" status: 204 len: 168 time: 1.1834722 Nov 09 05:09:20.190378 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '43b80c45-ea9f-47de-a4da-40ef6218498c', 'tag': '207e1e27-b90d-4ea7-a5b2-f6a538eebc54'}] {{(pid=102161) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:09:20.192633 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}99dfdda0def497b4372884ef2eb87f06b1e425c8eba5ceda5f64bbab037a07d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-70af3783-6630-4652-bfd7-0f427676341c" -d '{"events": [{"name": "network-changed", "server_uuid": "43b80c45-ea9f-47de-a4da-40ef6218498c", "tag": "207e1e27-b90d-4ea7-a5b2-f6a538eebc54"}]}' {{(pid=102161) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:09:20.232813 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 05:09:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f515308b-7e73-4664-8c8d-da78e03e1813 x-openstack-request-id: req-f515308b-7e73-4664-8c8d-da78e03e1813 {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:09:20.233105 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "43b80c45-ea9f-47de-a4da-40ef6218498c", "tag": "207e1e27-b90d-4ea7-a5b2-f6a538eebc54", "status": "completed", "code": 200}]} {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:09:20.233359 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-f515308b-7e73-4664-8c8d-da78e03e1813 {{(pid=102161) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:09:20.233761 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '43b80c45-ea9f-47de-a4da-40ef6218498c', 'tag': '207e1e27-b90d-4ea7-a5b2-f6a538eebc54', 'status': 'completed', 'code': 200} Nov 09 05:09:20.288326 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-8010ac2c-9eba-4e3c-8aef-a739a5095cb1 None None] Set router ca638ddf-69a9-410d-a6d3-22ae3b936315 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:09:20.343157 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70af3783-6630-4652-bfd7-0f427676341c req-705e7ec2-059c-4d86-bc4b-990a6f2b201d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:09:20.344720 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-70af3783-6630-4652-bfd7-0f427676341c req-705e7ec2-059c-4d86-bc4b-990a6f2b201d service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=8ac3eab68bd34485af7ddc3417853b28&device_id=43b80c45-ea9f-47de-a4da-40ef6218498c HTTP/1.1" status: 200 len: 1099 time: 0.0857253 Nov 09 05:09:20.441141 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70af3783-6630-4652-bfd7-0f427676341c req-17c85107-d48c-41d1-8112-d168d47a160d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:09:20.442607 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-70af3783-6630-4652-bfd7-0f427676341c req-17c85107-d48c-41d1-8112-d168d47a160d service neutron] 10.222.0.26 "GET /v2.0/networks?id=069b3296-503e-4f72-a764-405dcfa9218c HTTP/1.1" status: 200 len: 897 time: 0.0892358 Nov 09 05:09:20.488971 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-70af3783-6630-4652-bfd7-0f427676341c req-a5cb5c0b-0269-49ec-bc09-305b4129567c service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=207e1e27-b90d-4ea7-a5b2-f6a538eebc54 HTTP/1.1" status: 200 len: 217 time: 0.0391154 Nov 09 05:09:20.493487 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-8010ac2c-9eba-4e3c-8aef-a739a5095cb1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ca638ddf-69a9-410d-a6d3-22ae3b936315', 'name': 'tempest-TestNetworkAdvancedServerOps-router-44819952', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.61'}], 'enable_snat': True}, 'gw_port_id': '7a1c6236-8dbc-4010-8eef-a68a599be703', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:07:36Z', 'updated_at': '2021-11-09T05:07:40Z', 'revision_number': 4, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': '7a1c6236-8dbc-4010-8eef-a68a599be703', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:7a:29:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ca638ddf-69a9-410d-a6d3-22ae3b936315', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1767, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.61', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:07:36Z', 'updated_at': '2021-11-09T05:07:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '2ed6b6d4-e405-45c9-b741-d32ffaab1896', 'name': '', 'network_id': '069b3296-503e-4f72-a764-405dcfa9218c', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'mac_address': 'fa:16:3e:88:af:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ca638ddf-69a9-410d-a6d3-22ae3b936315', 'device_owner': 'network:router_interface', 'standard_attr_id': 1770, 'fixed_ips': [{'subnet_id': '7478814b-170a-4a05-97e1-d47b6c978d7c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:07:40Z', 'updated_at': '2021-11-09T05:07:43Z', 'revision_number': 5, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'subnets': [{'id': '7478814b-170a-4a05-97e1-d47b6c978d7c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:09:20.520354 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8010ac2c-9eba-4e3c-8aef-a739a5095cb1 None None] Checking router: ca638ddf-69a9-410d-a6d3-22ae3b936315 for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 05:09:20.530660 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8010ac2c-9eba-4e3c-8aef-a739a5095cb1 None None] Routers {'ca638ddf-69a9-410d-a6d3-22ae3b936315'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:09:20.531533 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-8010ac2c-9eba-4e3c-8aef-a739a5095cb1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:09:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['ca638ddf-69a9-410d-a6d3-22ae3b936315'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:09:20.574603 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70af3783-6630-4652-bfd7-0f427676341c req-b7640bc4-0454-4f71-ab6f-4345961d0584 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:09:20.576050 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-70af3783-6630-4652-bfd7-0f427676341c req-b7640bc4-0454-4f71-ab6f-4345961d0584 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=7478814b-170a-4a05-97e1-d47b6c978d7c HTTP/1.1" status: 200 len: 835 time: 0.0792294 Nov 09 05:09:20.599005 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1bb07d8-25a6-477f-9b25-83603c49397f req-ac855842-55c4-48e9-901c-09a54e24b030 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:09:20.600540 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e1bb07d8-25a6-477f-9b25-83603c49397f req-ac855842-55c4-48e9-901c-09a54e24b030 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=43b80c45-ea9f-47de-a4da-40ef6218498c HTTP/1.1" status: 200 len: 946 time: 0.0669944 Nov 09 05:09:20.665635 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70af3783-6630-4652-bfd7-0f427676341c req-17f2b48a-978d-46f2-85e8-ef5c2d42c75c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:09:20.667162 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-70af3783-6630-4652-bfd7-0f427676341c req-17f2b48a-978d-46f2-85e8-ef5c2d42c75c service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=069b3296-503e-4f72-a764-405dcfa9218c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0830407 Nov 09 05:09:20.680661 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [req-70af3783-6630-4652-bfd7-0f427676341c req-801937ae-1fab-4971-b6bf-eeae7b80b335 service neutron] http://10.222.0.24:9696/v2.0/extensions returned with HTTP 200 {{(pid=102162) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 05:09:20.681628 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-70af3783-6630-4652-bfd7-0f427676341c req-801937ae-1fab-4971-b6bf-eeae7b80b335 service neutron] 10.222.0.26 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0051944 Nov 09 05:09:20.686833 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e1bb07d8-25a6-477f-9b25-83603c49397f req-35bc9dda-bcb3-4ccf-b241-b6af36750e4b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=831e738e-2e97-40d0-aedb-a1c162dcf73d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0679696 Nov 09 05:09:20.726678 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-8010ac2c-9eba-4e3c-8aef-a739a5095cb1 None None] Set router ca638ddf-69a9-410d-a6d3-22ae3b936315 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:09:20.777105 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-70af3783-6630-4652-bfd7-0f427676341c req-f86061dc-5887-4699-b415-e9552a0a13f4 service neutron] 10.222.0.26 "GET /v2.0/networks/069b3296-503e-4f72-a764-405dcfa9218c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0875070 Nov 09 05:09:20.870834 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-70af3783-6630-4652-bfd7-0f427676341c req-4a715336-442c-4744-b742-5edd550c3615 service neutron] 10.222.0.26 "GET /v2.0/networks/069b3296-503e-4f72-a764-405dcfa9218c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0862839 Nov 09 05:09:20.920418 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-8010ac2c-9eba-4e3c-8aef-a739a5095cb1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ca638ddf-69a9-410d-a6d3-22ae3b936315', 'name': 'tempest-TestNetworkAdvancedServerOps-router-44819952', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.61'}], 'enable_snat': True}, 'gw_port_id': '7a1c6236-8dbc-4010-8eef-a68a599be703', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:07:36Z', 'updated_at': '2021-11-09T05:07:40Z', 'revision_number': 4, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': '7a1c6236-8dbc-4010-8eef-a68a599be703', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:7a:29:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ca638ddf-69a9-410d-a6d3-22ae3b936315', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1767, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.61', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:07:36Z', 'updated_at': '2021-11-09T05:07:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '2ed6b6d4-e405-45c9-b741-d32ffaab1896', 'name': '', 'network_id': '069b3296-503e-4f72-a764-405dcfa9218c', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'mac_address': 'fa:16:3e:88:af:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ca638ddf-69a9-410d-a6d3-22ae3b936315', 'device_owner': 'network:router_interface', 'standard_attr_id': 1770, 'fixed_ips': [{'subnet_id': '7478814b-170a-4a05-97e1-d47b6c978d7c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:07:40Z', 'updated_at': '2021-11-09T05:07:43Z', 'revision_number': 5, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'subnets': [{'id': '7478814b-170a-4a05-97e1-d47b6c978d7c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:09:20.950729 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8010ac2c-9eba-4e3c-8aef-a739a5095cb1 None None] The sync data for ids ['ca638ddf-69a9-410d-a6d3-22ae3b936315'] in dv-neutron-816802-2-hyperv is: [{'id': 'ca638ddf-69a9-410d-a6d3-22ae3b936315', 'name': 'tempest-TestNetworkAdvancedServerOps-router-44819952', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.61'}], 'enable_snat': True}, 'gw_port_id': '7a1c6236-8dbc-4010-8eef-a68a599be703', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:07:36Z', 'updated_at': '2021-11-09T05:07:40Z', 'revision_number': 4, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': '7a1c6236-8dbc-4010-8eef-a68a599be703', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:7a:29:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ca638ddf-69a9-410d-a6d3-22ae3b936315', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1767, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.61', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:07:36Z', 'updated_at': '2021-11-09T05:07:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '2ed6b6d4-e405-45c9-b741-d32ffaab1896', 'name': '', 'network_id': '069b3296-503e-4f72-a764-405dcfa9218c', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'mac_address': 'fa:16:3e:88:af:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ca638ddf-69a9-410d-a6d3-22ae3b936315', 'device_owner': 'network:router_interface', 'standard_attr_id': 1770, 'fixed_ips': [{'subnet_id': '7478814b-170a-4a05-97e1-d47b6c978d7c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:07:40Z', 'updated_at': '2021-11-09T05:07:43Z', 'revision_number': 5, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'subnets': [{'id': '7478814b-170a-4a05-97e1-d47b6c978d7c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 05:09:21.176506 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5cb74e0b-fd58-4117-a2ee-2eed72fa0eb9 None None] New status for floating IP 26be9d3e-7b47-45b6-99a0-ebe5bd50eb4a: DOWN {{(pid=102163) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 05:09:21.805028 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d46e55db-17fa-4343-93c9-c6a5b52e40ae req-c6892551-a7df-436e-a779-5d596c95e87e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:09:21.806542 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d46e55db-17fa-4343-93c9-c6a5b52e40ae req-c6892551-a7df-436e-a779-5d596c95e87e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=43b80c45-ea9f-47de-a4da-40ef6218498c HTTP/1.1" status: 200 len: 946 time: 0.0483127 Nov 09 05:09:21.855054 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d46e55db-17fa-4343-93c9-c6a5b52e40ae req-0d42dd21-6913-4b5c-b225-66f38dc7d990 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=831e738e-2e97-40d0-aedb-a1c162dcf73d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0426183 Nov 09 05:09:22.082000 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0688c393-2374-4782-8798-9790e450b8e8 req-b3e512ff-8a4e-4a3a-965a-fee562f1d5ae tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:09:22.084156 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-0688c393-2374-4782-8798-9790e450b8e8 req-b3e512ff-8a4e-4a3a-965a-fee562f1d5ae tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.26 "GET /v2.0/ports?device_id=43b80c45-ea9f-47de-a4da-40ef6218498c HTTP/1.1" status: 200 len: 946 time: 0.0485044 Nov 09 05:09:22.169479 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-0688c393-2374-4782-8798-9790e450b8e8 req-7c0c0ba3-7d13-4ef4-bf98-c24368bafec9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Deleting port 207e1e27-b90d-4ea7-a5b2-f6a538eebc54 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:09:22.169810 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-0688c393-2374-4782-8798-9790e450b8e8 req-7c0c0ba3-7d13-4ef4-bf98-c24368bafec9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:22.257618 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-0688c393-2374-4782-8798-9790e450b8e8 req-7c0c0ba3-7d13-4ef4-bf98-c24368bafec9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] For port 207e1e27-b90d-4ea7-a5b2-f6a538eebc54, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=207e1e27-b90d-4ea7-a5b2-f6a538eebc54,segment=NetworkSegment(7873d665-dcdc-4807-b36b-1f3dcc6dd977),segment_id=7873d665-dcdc-4807-b36b-1f3dcc6dd977)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:09:22.257966 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-0688c393-2374-4782-8798-9790e450b8e8 req-7c0c0ba3-7d13-4ef4-bf98-c24368bafec9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:22.270850 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-0688c393-2374-4782-8798-9790e450b8e8 req-7c0c0ba3-7d13-4ef4-bf98-c24368bafec9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Calling delete_port for 207e1e27-b90d-4ea7-a5b2-f6a538eebc54 owned by compute:nova {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:09:22.444089 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-0688c393-2374-4782-8798-9790e450b8e8 req-7c0c0ba3-7d13-4ef4-bf98-c24368bafec9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:22.472838 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c0c0ba3-7d13-4ef4-bf98-c24368bafec9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event deleted for resources: {'Port': ['ID=207e1e27-b90d-4ea7-a5b2-f6a538eebc54,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:09:22.500277 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c0c0ba3-7d13-4ef4-bf98-c24368bafec9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:09:22.500628 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c0c0ba3-7d13-4ef4-bf98-c24368bafec9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:09:22.500974 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c0c0ba3-7d13-4ef4-bf98-c24368bafec9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:09:22.501310 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c0c0ba3-7d13-4ef4-bf98-c24368bafec9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:09:22.501643 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c0c0ba3-7d13-4ef4-bf98-c24368bafec9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:09:22.501977 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c0c0ba3-7d13-4ef4-bf98-c24368bafec9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:09:22.502304 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c0c0ba3-7d13-4ef4-bf98-c24368bafec9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:09:22.502652 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c0c0ba3-7d13-4ef4-bf98-c24368bafec9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:09:22.502977 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c0c0ba3-7d13-4ef4-bf98-c24368bafec9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:09:22.503301 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c0c0ba3-7d13-4ef4-bf98-c24368bafec9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:09:22.503621 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c0c0ba3-7d13-4ef4-bf98-c24368bafec9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:09:22.503943 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c0c0ba3-7d13-4ef4-bf98-c24368bafec9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:09:22.523256 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-0688c393-2374-4782-8798-9790e450b8e8 req-7c0c0ba3-7d13-4ef4-bf98-c24368bafec9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] No DVR routers for this DVR port 207e1e27-b90d-4ea7-a5b2-f6a538eebc54 on host hv-neutron-8168 {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 05:09:22.525739 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-0688c393-2374-4782-8798-9790e450b8e8 req-7c0c0ba3-7d13-4ef4-bf98-c24368bafec9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:22.529214 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-0688c393-2374-4782-8798-9790e450b8e8 req-7c0c0ba3-7d13-4ef4-bf98-c24368bafec9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.26 "DELETE /v2.0/ports/207e1e27-b90d-4ea7-a5b2-f6a538eebc54 HTTP/1.1" status: 204 len: 173 time: 0.4387717 Nov 09 05:09:22.531984 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '43b80c45-ea9f-47de-a4da-40ef6218498c', 'name': 'network-vif-deleted', 'tag': '207e1e27-b90d-4ea7-a5b2-f6a538eebc54'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:09:22.531984 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9323bd83-0e40-4223-bcd3-67dd8e0d7690" -d '{"events": [{"server_uuid": "43b80c45-ea9f-47de-a4da-40ef6218498c", "name": "network-vif-deleted", "tag": "207e1e27-b90d-4ea7-a5b2-f6a538eebc54"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:09:22.566943 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 05:09:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3684a038-a5c1-4ec5-9a87-c7c7b5213a36 x-openstack-request-id: req-3684a038-a5c1-4ec5-9a87-c7c7b5213a36 {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:09:22.567935 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "43b80c45-ea9f-47de-a4da-40ef6218498c", "name": "network-vif-deleted", "tag": "207e1e27-b90d-4ea7-a5b2-f6a538eebc54", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:09:22.568183 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-3684a038-a5c1-4ec5-9a87-c7c7b5213a36 {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:09:22.568627 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '43b80c45-ea9f-47de-a4da-40ef6218498c', 'name': 'network-vif-deleted', 'tag': '207e1e27-b90d-4ea7-a5b2-f6a538eebc54', 'status': 'completed', 'code': 200} Nov 09 05:09:22.962182 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-10d4c12f-774d-40fc-9651-f3abaf5ca47b req-f8498d16-e95d-40a9-a6b0-d89575e13004 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=43b80c45-ea9f-47de-a4da-40ef6218498c HTTP/1.1" status: 200 len: 210 time: 0.0262985 Nov 09 05:09:24.018095 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 37438) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:09:24.370467 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2285a095-82ba-4887-9932-215f610e05bf tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:24.618580 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-2285a095-82ba-4887-9932-215f610e05bf tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Deleting port 2ed6b6d4-e405-45c9-b741-d32ffaab1896 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:09:24.618837 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2285a095-82ba-4887-9932-215f610e05bf tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:24.708925 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-2285a095-82ba-4887-9932-215f610e05bf tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] For port 2ed6b6d4-e405-45c9-b741-d32ffaab1896, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=2ed6b6d4-e405-45c9-b741-d32ffaab1896,segment=NetworkSegment(7873d665-dcdc-4807-b36b-1f3dcc6dd977),segment_id=7873d665-dcdc-4807-b36b-1f3dcc6dd977)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:09:24.709286 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2285a095-82ba-4887-9932-215f610e05bf tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:24.721404 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-2285a095-82ba-4887-9932-215f610e05bf tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Calling delete_port for 2ed6b6d4-e405-45c9-b741-d32ffaab1896 owned by network:router_interface {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:09:24.964479 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2285a095-82ba-4887-9932-215f610e05bf tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:24.991231 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2285a095-82ba-4887-9932-215f610e05bf tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event deleted for resources: {'Port': ['ID=2ed6b6d4-e405-45c9-b741-d32ffaab1896,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:09:25.172161 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2285a095-82ba-4887-9932-215f610e05bf tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:25.384136 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2285a095-82ba-4887-9932-215f610e05bf tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Router ca638ddf-69a9-410d-a6d3-22ae3b936315 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 05:09:25.488196 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2285a095-82ba-4887-9932-215f610e05bf tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 05:09:25.493935 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-2285a095-82ba-4887-9932-215f610e05bf tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "PUT /v2.0/routers/ca638ddf-69a9-410d-a6d3-22ae3b936315/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4747667 Nov 09 05:09:25.495752 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 37440) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:09:25.498464 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b62bf772-9393-47ed-8602-02aaa7baec3a None None] Sync routers for ids ['ca638ddf-69a9-410d-a6d3-22ae3b936315'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 05:09:25.508740 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b62bf772-9393-47ed-8602-02aaa7baec3a None None] Routers {'ca638ddf-69a9-410d-a6d3-22ae3b936315'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:09:25.509360 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-b62bf772-9393-47ed-8602-02aaa7baec3a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:09:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['ca638ddf-69a9-410d-a6d3-22ae3b936315'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:09:25.550663 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-328fa196-25e3-44b1-85a8-56ded4c727c3 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Deleting subnet 7478814b-170a-4a05-97e1-d47b6c978d7c {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 05:09:25.553665 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-328fa196-25e3-44b1-85a8-56ded4c727c3 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:25.597040 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-328fa196-25e3-44b1-85a8-56ded4c727c3 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:25.611820 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-b62bf772-9393-47ed-8602-02aaa7baec3a None None] Set router ca638ddf-69a9-410d-a6d3-22ae3b936315 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:09:25.676525 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-328fa196-25e3-44b1-85a8-56ded4c727c3 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:25.784414 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-b62bf772-9393-47ed-8602-02aaa7baec3a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ca638ddf-69a9-410d-a6d3-22ae3b936315', 'name': 'tempest-TestNetworkAdvancedServerOps-router-44819952', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.61'}], 'enable_snat': True}, 'gw_port_id': '7a1c6236-8dbc-4010-8eef-a68a599be703', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:07:36Z', 'updated_at': '2021-11-09T05:09:24Z', 'revision_number': 5, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': '7a1c6236-8dbc-4010-8eef-a68a599be703', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:7a:29:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ca638ddf-69a9-410d-a6d3-22ae3b936315', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1767, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.61', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:07:36Z', 'updated_at': '2021-11-09T05:07:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:09:25.813889 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b62bf772-9393-47ed-8602-02aaa7baec3a None None] Checking router: ca638ddf-69a9-410d-a6d3-22ae3b936315 for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 05:09:25.822461 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b62bf772-9393-47ed-8602-02aaa7baec3a None None] Routers {'ca638ddf-69a9-410d-a6d3-22ae3b936315'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:09:25.823051 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-b62bf772-9393-47ed-8602-02aaa7baec3a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:09:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['ca638ddf-69a9-410d-a6d3-22ae3b936315'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:09:25.834026 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-328fa196-25e3-44b1-85a8-56ded4c727c3 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:25.866179 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-328fa196-25e3-44b1-85a8-56ded4c727c3 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event deleted for resources: {'Subnet': ['ID=7478814b-170a-4a05-97e1-d47b6c978d7c,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:09:25.868151 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-328fa196-25e3-44b1-85a8-56ded4c727c3 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:25.871688 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-328fa196-25e3-44b1-85a8-56ded4c727c3 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "DELETE /v2.0/subnets/7478814b-170a-4a05-97e1-d47b6c978d7c HTTP/1.1" status: 204 len: 168 time: 0.3746464 Nov 09 05:09:25.873952 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 37442) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:09:25.874665 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-06cb6d18-6764-43ae-bad3-fd9a0b077aaf None None] Network 069b3296-503e-4f72-a764-405dcfa9218c requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 05:09:25.928422 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-b62bf772-9393-47ed-8602-02aaa7baec3a None None] Set router ca638ddf-69a9-410d-a6d3-22ae3b936315 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:09:25.981963 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-238876d4-a461-4ac6-bbac-cd03003fac47 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for router, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:26.028144 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 207e1e27-b90d-4ea7-a5b2-f6a538eebc54 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 05:09:26.047498 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] No Port match for: 207e1e27-b90d-4ea7-a5b2-f6a538eebc54 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 05:09:26.048289 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 207e1e27-b90d-4ea7-a5b2-f6a538eebc54 not bound to the agent host hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 05:09:26.090558 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-238876d4-a461-4ac6-bbac-cd03003fac47 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for router_gateway, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:26.100916 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b3842c2e-e0ad-4d4e-a90b-c04e992e8af8 None None] DHCP port deletion for 069b3296-503e-4f72-a764-405dcfa9218c request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 05:09:26.119481 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-b62bf772-9393-47ed-8602-02aaa7baec3a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ca638ddf-69a9-410d-a6d3-22ae3b936315', 'name': 'tempest-TestNetworkAdvancedServerOps-router-44819952', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.61'}], 'enable_snat': True}, 'gw_port_id': '7a1c6236-8dbc-4010-8eef-a68a599be703', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:07:36Z', 'updated_at': '2021-11-09T05:09:24Z', 'revision_number': 5, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': '7a1c6236-8dbc-4010-8eef-a68a599be703', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:7a:29:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ca638ddf-69a9-410d-a6d3-22ae3b936315', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1767, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.61', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:07:36Z', 'updated_at': '2021-11-09T05:07:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:09:26.148014 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b62bf772-9393-47ed-8602-02aaa7baec3a None None] The sync data for ids ['ca638ddf-69a9-410d-a6d3-22ae3b936315'] in dv-neutron-816802-2-hyperv is: [{'id': 'ca638ddf-69a9-410d-a6d3-22ae3b936315', 'name': 'tempest-TestNetworkAdvancedServerOps-router-44819952', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.61'}], 'enable_snat': True}, 'gw_port_id': '7a1c6236-8dbc-4010-8eef-a68a599be703', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:07:36Z', 'updated_at': '2021-11-09T05:09:24Z', 'revision_number': 5, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': '7a1c6236-8dbc-4010-8eef-a68a599be703', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:7a:29:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ca638ddf-69a9-410d-a6d3-22ae3b936315', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1767, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.61', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:07:36Z', 'updated_at': '2021-11-09T05:07:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 05:09:26.152077 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-b3842c2e-e0ad-4d4e-a90b-c04e992e8af8 None None] Deleting port c8b9bfde-990d-4fdf-ba7a-ca28de24c277 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:09:26.152613 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b3842c2e-e0ad-4d4e-a90b-c04e992e8af8 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:26.196475 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-238876d4-a461-4ac6-bbac-cd03003fac47 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Deleting port 7a1c6236-8dbc-4010-8eef-a68a599be703 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:09:26.197021 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-238876d4-a461-4ac6-bbac-cd03003fac47 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:26.216855 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-b3842c2e-e0ad-4d4e-a90b-c04e992e8af8 None None] For port c8b9bfde-990d-4fdf-ba7a-ca28de24c277, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=c8b9bfde-990d-4fdf-ba7a-ca28de24c277,segment=NetworkSegment(7873d665-dcdc-4807-b36b-1f3dcc6dd977),segment_id=7873d665-dcdc-4807-b36b-1f3dcc6dd977)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:09:26.217248 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b3842c2e-e0ad-4d4e-a90b-c04e992e8af8 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:26.229486 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-b3842c2e-e0ad-4d4e-a90b-c04e992e8af8 None None] Calling delete_port for c8b9bfde-990d-4fdf-ba7a-ca28de24c277 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:09:26.277299 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-238876d4-a461-4ac6-bbac-cd03003fac47 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] For port 7a1c6236-8dbc-4010-8eef-a68a599be703, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=7a1c6236-8dbc-4010-8eef-a68a599be703,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:09:26.277654 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-238876d4-a461-4ac6-bbac-cd03003fac47 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:26.290239 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-238876d4-a461-4ac6-bbac-cd03003fac47 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Calling delete_port for 7a1c6236-8dbc-4010-8eef-a68a599be703 owned by network:router_gateway {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:09:26.358862 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b3842c2e-e0ad-4d4e-a90b-c04e992e8af8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:26.384183 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3842c2e-e0ad-4d4e-a90b-c04e992e8af8 None None] Pushing event deleted for resources: {'Port': ['ID=c8b9bfde-990d-4fdf-ba7a-ca28de24c277,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:09:26.387961 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b3842c2e-e0ad-4d4e-a90b-c04e992e8af8 None None] No DVR routers for this DVR port c8b9bfde-990d-4fdf-ba7a-ca28de24c277 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 05:09:26.395615 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3842c2e-e0ad-4d4e-a90b-c04e992e8af8 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:09:26.395963 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3842c2e-e0ad-4d4e-a90b-c04e992e8af8 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:09:26.397169 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3842c2e-e0ad-4d4e-a90b-c04e992e8af8 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:09:26.397169 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3842c2e-e0ad-4d4e-a90b-c04e992e8af8 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:09:26.397169 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3842c2e-e0ad-4d4e-a90b-c04e992e8af8 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:09:26.397444 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3842c2e-e0ad-4d4e-a90b-c04e992e8af8 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:09:26.397705 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3842c2e-e0ad-4d4e-a90b-c04e992e8af8 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:09:26.398041 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3842c2e-e0ad-4d4e-a90b-c04e992e8af8 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:09:26.398393 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3842c2e-e0ad-4d4e-a90b-c04e992e8af8 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:09:26.398711 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3842c2e-e0ad-4d4e-a90b-c04e992e8af8 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:09:26.399031 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3842c2e-e0ad-4d4e-a90b-c04e992e8af8 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:09:26.399351 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3842c2e-e0ad-4d4e-a90b-c04e992e8af8 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:09:26.536154 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-238876d4-a461-4ac6-bbac-cd03003fac47 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:26.559089 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 2ed6b6d4-e405-45c9-b741-d32ffaab1896 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 05:09:26.564310 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-238876d4-a461-4ac6-bbac-cd03003fac47 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event deleted for resources: {'Port': ['ID=7a1c6236-8dbc-4010-8eef-a68a599be703,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:09:26.580568 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 2ed6b6d4-e405-45c9-b741-d32ffaab1896 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 05:09:26.580952 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 2ed6b6d4-e405-45c9-b741-d32ffaab1896 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 05:09:26.581371 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device c8b9bfde-990d-4fdf-ba7a-ca28de24c277 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 05:09:26.601312 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: c8b9bfde-990d-4fdf-ba7a-ca28de24c277 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 05:09:26.601616 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device c8b9bfde-990d-4fdf-ba7a-ca28de24c277 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 05:09:26.637205 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-238876d4-a461-4ac6-bbac-cd03003fac47 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-466373'] for router_gateway, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:26.729526 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-238876d4-a461-4ac6-bbac-cd03003fac47 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:26.731812 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-238876d4-a461-4ac6-bbac-cd03003fac47 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:26.862023 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-238876d4-a461-4ac6-bbac-cd03003fac47 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:26.862515 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-238876d4-a461-4ac6-bbac-cd03003fac47 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Fanout notify agent at l3_agent the message router_deleted on router ca638ddf-69a9-410d-a6d3-22ae3b936315 {{(pid=102161) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 05:09:26.873302 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-238876d4-a461-4ac6-bbac-cd03003fac47 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:26.873302 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-238876d4-a461-4ac6-bbac-cd03003fac47 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "DELETE /v2.0/routers/ca638ddf-69a9-410d-a6d3-22ae3b936315 HTTP/1.1" status: 204 len: 168 time: 0.9959869 Nov 09 05:09:26.873712 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 37444) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:09:26.956017 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8d1244cd-1272-4262-98d0-eda0511dcbf2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:27.040470 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8d1244cd-1272-4262-98d0-eda0511dcbf2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:27.059597 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-8d1244cd-1272-4262-98d0-eda0511dcbf2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['069b3296-503e-4f72-a764-405dcfa9218c']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:09:27.068476 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-8d1244cd-1272-4262-98d0-eda0511dcbf2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '7873d665-dcdc-4807-b36b-1f3dcc6dd977') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:09:27.068767 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-8d1244cd-1272-4262-98d0-eda0511dcbf2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '7873d665-dcdc-4807-b36b-1f3dcc6dd977') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:09:27.081408 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8d1244cd-1272-4262-98d0-eda0511dcbf2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:27.094415 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8d1244cd-1272-4262-98d0-eda0511dcbf2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:27.101148 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8d1244cd-1272-4262-98d0-eda0511dcbf2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Releasing vlan 324 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 05:09:27.101519 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8d1244cd-1272-4262-98d0-eda0511dcbf2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:27.104427 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 05:09:27.104427 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 05:09:27.104427 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 05:09:27.104427 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 05:09:27.104427 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 05:09:27.104427 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 05:09:27.104427 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 05:09:27.104427 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 05:09:27.104427 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 05:09:27.104427 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 05:09:27.104427 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 05:09:27.104427 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 05:09:27.104427 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 05:09:27.104427 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 05:09:27.104427 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 05:09:27.104427 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 05:09:27.104427 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 05:09:27.104427 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 05:09:27.104427 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 05:09:27.104427 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 05:09:27.104427 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 05:09:27.104427 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 05:09:27.104427 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 05:09:27.104427 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 05:09:27.104427 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 05:09:27.104427 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 05:09:27.104427 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 05:09:27.104427 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 05:09:27.104427 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 05:09:27.104427 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 05:09:27.104427 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 05:09:27.104427 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 05:09:27.256604 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8d1244cd-1272-4262-98d0-eda0511dcbf2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:27.261162 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-8d1244cd-1272-4262-98d0-eda0511dcbf2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:27.264800 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-8d1244cd-1272-4262-98d0-eda0511dcbf2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "DELETE /v2.0/networks/069b3296-503e-4f72-a764-405dcfa9218c HTTP/1.1" status: 204 len: 168 time: 0.3901572 Nov 09 05:09:27.267610 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 37446) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:09:27.279834 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d1244cd-1272-4262-98d0-eda0511dcbf2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event deleted for resources: {'Network': ['ID=069b3296-503e-4f72-a764-405dcfa9218c,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:09:27.336671 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-967214f2-1722-4a2c-aed9-3aaee27dd111 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:27.361136 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-967214f2-1722-4a2c-aed9-3aaee27dd111 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:27.473240 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-967214f2-1722-4a2c-aed9-3aaee27dd111 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:27.476005 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-967214f2-1722-4a2c-aed9-3aaee27dd111 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:27.477159 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-967214f2-1722-4a2c-aed9-3aaee27dd111 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "DELETE /v2.0/security-groups/831e738e-2e97-40d0-aedb-a1c162dcf73d HTTP/1.1" status: 204 len: 168 time: 0.2079141 Nov 09 05:09:27.486718 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-967214f2-1722-4a2c-aed9-3aaee27dd111 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=831e738e-2e97-40d0-aedb-a1c162dcf73d,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:09:27.975508 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 37452) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:09:27.980020 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-1206c715-1f14-49d3-86dd-82841f1b421f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-867507775', 'description': 'tempest-secgroup-smoke-867507775 description', 'project_id': '8ac3eab68bd34485af7ddc3417853b28'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:09:28.062066 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1206c715-1f14-49d3-86dd-82841f1b421f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:28.125982 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1206c715-1f14-49d3-86dd-82841f1b421f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:28.193412 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1206c715-1f14-49d3-86dd-82841f1b421f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:28.223516 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1206c715-1f14-49d3-86dd-82841f1b421f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'SecurityGroup': ['ID=3285a6ac-908a-45d4-a6e2-2d8556bc393d,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:09:28.275281 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1206c715-1f14-49d3-86dd-82841f1b421f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:28.276510 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-1206c715-1f14-49d3-86dd-82841f1b421f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.2999721 Nov 09 05:09:28.279396 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 37454) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:09:28.287491 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-3839d1bf-3f2d-47fa-ab67-f0c3aad4d385 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'security_group_rule': {'security_group_id': '3285a6ac-908a-45d4-a6e2-2d8556bc393d', 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:09:28.370529 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3839d1bf-3f2d-47fa-ab67-f0c3aad4d385 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:28.386047 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 7a1c6236-8dbc-4010-8eef-a68a599be703 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 05:09:28.408346 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 7a1c6236-8dbc-4010-8eef-a68a599be703 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 05:09:28.408769 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 7a1c6236-8dbc-4010-8eef-a68a599be703 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 05:09:28.424616 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3839d1bf-3f2d-47fa-ab67-f0c3aad4d385 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:28.490305 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3839d1bf-3f2d-47fa-ab67-f0c3aad4d385 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:28.507733 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3839d1bf-3f2d-47fa-ab67-f0c3aad4d385 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c11ebb0b-7a5a-43e6-945c-0cf3d5decf17,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:09:28.584354 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3839d1bf-3f2d-47fa-ab67-f0c3aad4d385 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:28.585551 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-3839d1bf-3f2d-47fa-ab67-f0c3aad4d385 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3052449 Nov 09 05:09:28.588252 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 37456) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:09:28.592693 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-340a0915-34c3-44bc-bf24-8bbe58c48be1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'security_group_rule': {'security_group_id': '3285a6ac-908a-45d4-a6e2-2d8556bc393d', 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:09:28.700446 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-340a0915-34c3-44bc-bf24-8bbe58c48be1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:28.757953 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-340a0915-34c3-44bc-bf24-8bbe58c48be1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:28.832982 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-340a0915-34c3-44bc-bf24-8bbe58c48be1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:28.850792 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-340a0915-34c3-44bc-bf24-8bbe58c48be1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6c9ec59b-dca5-438f-b562-d855432bb65c,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:09:28.915574 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-340a0915-34c3-44bc-bf24-8bbe58c48be1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:28.916814 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-340a0915-34c3-44bc-bf24-8bbe58c48be1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.3276119 Nov 09 05:09:28.919529 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 37458) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:09:28.923853 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-ae577715-94a7-4b92-bcae-63a00017eef6 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'security_group_rule': {'security_group_id': '3285a6ac-908a-45d4-a6e2-2d8556bc393d', 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:09:29.020391 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ae577715-94a7-4b92-bcae-63a00017eef6 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:29.078855 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ae577715-94a7-4b92-bcae-63a00017eef6 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:29.175931 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ae577715-94a7-4b92-bcae-63a00017eef6 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:29.193983 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae577715-94a7-4b92-bcae-63a00017eef6 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=82100b90-6a59-492c-ab09-2713b9257891,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:09:29.274950 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-ae577715-94a7-4b92-bcae-63a00017eef6 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:29.276071 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-ae577715-94a7-4b92-bcae-63a00017eef6 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3556011 Nov 09 05:09:29.278779 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 37460) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:09:29.283185 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-68713a1d-b700-42f1-8d4e-fa707c4e710e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'security_group_rule': {'security_group_id': '3285a6ac-908a-45d4-a6e2-2d8556bc393d', 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:09:29.374500 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-68713a1d-b700-42f1-8d4e-fa707c4e710e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:29.428546 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-68713a1d-b700-42f1-8d4e-fa707c4e710e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:29.507833 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-68713a1d-b700-42f1-8d4e-fa707c4e710e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:29.525511 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68713a1d-b700-42f1-8d4e-fa707c4e710e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=782864a5-bd95-441c-8787-04b9158496ea,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:09:29.589546 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-68713a1d-b700-42f1-8d4e-fa707c4e710e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:29.590914 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-68713a1d-b700-42f1-8d4e-fa707c4e710e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3110316 Nov 09 05:09:29.593974 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 37462) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:09:29.598957 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-5aa4ee46-a4c4-4a40-b330-2957dca32dec tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'security_group_rule': {'security_group_id': '3285a6ac-908a-45d4-a6e2-2d8556bc393d', 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:09:29.673134 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.securitygroups_db [None req-5aa4ee46-a4c4-4a40-b330-2957dca32dec tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Project 8ac3eab68bd34485af7ddc3417853b28 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 09 05:09:29.678905 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5aa4ee46-a4c4-4a40-b330-2957dca32dec tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:29.737099 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5aa4ee46-a4c4-4a40-b330-2957dca32dec tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:29.793463 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5aa4ee46-a4c4-4a40-b330-2957dca32dec tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:29.811471 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5aa4ee46-a4c4-4a40-b330-2957dca32dec tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c7558fce-381f-475e-8a40-b22f22db971f,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:09:29.858643 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5aa4ee46-a4c4-4a40-b330-2957dca32dec tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:29.859859 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-5aa4ee46-a4c4-4a40-b330-2957dca32dec tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.2649016 Nov 09 05:09:29.862556 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 37464) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:09:29.867672 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-079fde5e-cebe-4060-8ebe-cad54bb6315c tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'security_group_rule': {'security_group_id': '3285a6ac-908a-45d4-a6e2-2d8556bc393d', 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:09:29.953406 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.securitygroups_db [None req-079fde5e-cebe-4060-8ebe-cad54bb6315c tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Project 8ac3eab68bd34485af7ddc3417853b28 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 09 05:09:29.958353 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-079fde5e-cebe-4060-8ebe-cad54bb6315c tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:30.015072 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-079fde5e-cebe-4060-8ebe-cad54bb6315c tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:30.107599 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-079fde5e-cebe-4060-8ebe-cad54bb6315c tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:30.124095 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-079fde5e-cebe-4060-8ebe-cad54bb6315c tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a3c934f8-8fff-476d-8bfe-81a593788cdd,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:09:30.212724 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-079fde5e-cebe-4060-8ebe-cad54bb6315c tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:30.213967 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-079fde5e-cebe-4060-8ebe-cad54bb6315c tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.3504817 Nov 09 05:09:30.216734 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 37466) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:09:30.221942 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-273913d8-5220-4be8-9e96-d1599d4ab18d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'network': {'name': 'tempest-network-smoke--1435446726', 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'port_security_enabled': True}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:09:30.330537 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-273913d8-5220-4be8-9e96-d1599d4ab18d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Made reservation on behalf of 8ac3eab68bd34485af7ddc3417853b28 for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 05:09:30.334066 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-273913d8-5220-4be8-9e96-d1599d4ab18d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:30.357287 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-273913d8-5220-4be8-9e96-d1599d4ab18d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 340} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 05:09:30.365522 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-273913d8-5220-4be8-9e96-d1599d4ab18d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:30.365802 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-273913d8-5220-4be8-9e96-d1599d4ab18d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Added segment f30d767c-82f3-406c-aba3-6198dd73349f of type vlan for network 164fa49b-4b69-42f2-b13f-78b6ab225c74 Nov 09 05:09:30.403612 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-273913d8-5220-4be8-9e96-d1599d4ab18d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:30.496418 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-273913d8-5220-4be8-9e96-d1599d4ab18d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:30.501938 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-273913d8-5220-4be8-9e96-d1599d4ab18d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:09:30.502538 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-273913d8-5220-4be8-9e96-d1599d4ab18d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:30.568090 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-273913d8-5220-4be8-9e96-d1599d4ab18d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'Network': ['ID=164fa49b-4b69-42f2-b13f-78b6ab225c74,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:09:30.578556 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 164fa49b-4b69-42f2-b13f-78b6ab225c74 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 05:09:30.607533 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-273913d8-5220-4be8-9e96-d1599d4ab18d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.3896956 Nov 09 05:09:30.610164 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 37468) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:09:30.614580 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-0743b073-e1ec-40c4-b07b-b9f1697003af tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'router': {'name': 'tempest-TestNetworkAdvancedServerOps-router-310918215', 'admin_state_up': True, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:09:30.702454 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0743b073-e1ec-40c4-b07b-b9f1697003af tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:30.703499 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0743b073-e1ec-40c4-b07b-b9f1697003af tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:30.755562 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0743b073-e1ec-40c4-b07b-b9f1697003af tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:30.948734 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0743b073-e1ec-40c4-b07b-b9f1697003af tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:31.184132 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0743b073-e1ec-40c4-b07b-b9f1697003af tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for router_gateway, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:31.202096 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0743b073-e1ec-40c4-b07b-b9f1697003af tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:31.298377 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-0743b073-e1ec-40c4-b07b-b9f1697003af tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Allocated IP 172.26.0.122 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/ded5c8d9-110f-4e05-88a7-b8546e75095e) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 05:09:31.397371 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0743b073-e1ec-40c4-b07b-b9f1697003af tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:31.480027 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0743b073-e1ec-40c4-b07b-b9f1697003af tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:31.515765 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0743b073-e1ec-40c4-b07b-b9f1697003af tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:09:31.520367 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-0743b073-e1ec-40c4-b07b-b9f1697003af tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:09:31.524371 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0743b073-e1ec-40c4-b07b-b9f1697003af tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 05:09:31.529558 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0743b073-e1ec-40c4-b07b-b9f1697003af tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'Port': ['ID=ded5c8d9-110f-4e05-88a7-b8546e75095e,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:09:32.149719 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0743b073-e1ec-40c4-b07b-b9f1697003af tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for router_gateway, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:32.336950 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0743b073-e1ec-40c4-b07b-b9f1697003af tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:32.536890 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0743b073-e1ec-40c4-b07b-b9f1697003af tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Router 4cde88b0-a962-472e-95ed-f34b609516f7 is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102162) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 05:09:32.642253 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0743b073-e1ec-40c4-b07b-b9f1697003af tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 05:09:32.652374 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6491cf70-a9eb-4875-a69a-51db447d59b7 None None] Sync routers for ids ['4cde88b0-a962-472e-95ed-f34b609516f7'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 05:09:32.665874 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6491cf70-a9eb-4875-a69a-51db447d59b7 None None] Routers {'4cde88b0-a962-472e-95ed-f34b609516f7'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:09:32.666651 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-6491cf70-a9eb-4875-a69a-51db447d59b7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:09:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['4cde88b0-a962-472e-95ed-f34b609516f7'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:09:32.738724 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0743b073-e1ec-40c4-b07b-b9f1697003af tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:32.742946 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-0743b073-e1ec-40c4-b07b-b9f1697003af tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 895 time: 2.1288104 Nov 09 05:09:32.743144 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 37470) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:09:32.768125 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-6491cf70-a9eb-4875-a69a-51db447d59b7 None None] Set router 4cde88b0-a962-472e-95ed-f34b609516f7 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:09:32.770698 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-66a6637c-c649-41c5-84dd-ecd6b61c391f tempest-TestNetworkAdvancedServerOps-1212315804 tempest-TestNetworkAdvancedServerOps-1212315804-project-admin] 10.222.0.24 "GET /v2.0/subnets?project_id=8ac3eab68bd34485af7ddc3417853b28&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0258884 Nov 09 05:09:32.773246 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 37472) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:09:32.866265 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-94247460-da77-4047-b0b0-9b1cd87d0d2a tempest-TestNetworkAdvancedServerOps-1212315804 tempest-TestNetworkAdvancedServerOps-1212315804-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:09:32.867719 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-94247460-da77-4047-b0b0-9b1cd87d0d2a tempest-TestNetworkAdvancedServerOps-1212315804 tempest-TestNetworkAdvancedServerOps-1212315804-project-admin] 10.222.0.24 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.0935919 Nov 09 05:09:32.870695 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 37474) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:09:32.898690 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-c90b8f6e-ea85-42c3-8a3a-d658827097b6 tempest-TestNetworkAdvancedServerOps-1212315804 tempest-TestNetworkAdvancedServerOps-1212315804-project-admin] 10.222.0.24 "GET /v2.0/subnets?network_id=2b6725f5-ebfe-485a-8f42-ccb5a241ddb5&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0269110 Nov 09 05:09:32.901205 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 37476) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:09:32.905850 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-d9bf46f0-b533-4f15-ac52-dbe762f70d09 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-448703670', 'network_id': '164fa49b-4b69-42f2-b13f-78b6ab225c74', 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:09:32.945446 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-6491cf70-a9eb-4875-a69a-51db447d59b7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4cde88b0-a962-472e-95ed-f34b609516f7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-310918215', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.122'}], 'enable_snat': True}, 'gw_port_id': 'ded5c8d9-110f-4e05-88a7-b8546e75095e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:09:30Z', 'updated_at': '2021-11-09T05:09:31Z', 'revision_number': 3, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': 'ded5c8d9-110f-4e05-88a7-b8546e75095e', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:56:05', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4cde88b0-a962-472e-95ed-f34b609516f7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1786, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:09:31Z', 'updated_at': '2021-11-09T05:09:31Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:09:32.970735 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6491cf70-a9eb-4875-a69a-51db447d59b7 None None] Checking router: 4cde88b0-a962-472e-95ed-f34b609516f7 for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 05:09:32.971082 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6491cf70-a9eb-4875-a69a-51db447d59b7 None None] Updating router 4cde88b0-a962-472e-95ed-f34b609516f7 port ded5c8d9-110f-4e05-88a7-b8546e75095e binding host dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 05:09:32.999349 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6491cf70-a9eb-4875-a69a-51db447d59b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:33.033769 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d9bf46f0-b533-4f15-ac52-dbe762f70d09 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Made reservation on behalf of 8ac3eab68bd34485af7ddc3417853b28 for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 05:09:33.039137 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d9bf46f0-b533-4f15-ac52-dbe762f70d09 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:33.253613 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6491cf70-a9eb-4875-a69a-51db447d59b7 None None] Publish callbacks [] for port, precommit_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:33.267953 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d9bf46f0-b533-4f15-ac52-dbe762f70d09 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:33.313758 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6491cf70-a9eb-4875-a69a-51db447d59b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:33.332600 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9bf46f0-b533-4f15-ac52-dbe762f70d09 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'Subnet': ['ID=b7570448-8728-4002-9b90-aa1aa4f10e83,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:09:33.345318 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d9bf46f0-b533-4f15-ac52-dbe762f70d09 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Checking segment: {'id': 'f30d767c-82f3-406c-aba3-6198dd73349f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': '164fa49b-4b69-42f2-b13f-78b6ab225c74'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 05:09:33.346223 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d9bf46f0-b533-4f15-ac52-dbe762f70d09 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Network hostable DHCP agents. Network: 164fa49b-4b69-42f2-b13f-78b6ab225c74, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 05:09:33.366446 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-6491cf70-a9eb-4875-a69a-51db447d59b7 None None] Attempting to bind port ded5c8d9-110f-4e05-88a7-b8546e75095e on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 05:09:33.366814 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-6491cf70-a9eb-4875-a69a-51db447d59b7 None None] Attempting to bind port ded5c8d9-110f-4e05-88a7-b8546e75095e by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 05:09:33.367178 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6491cf70-a9eb-4875-a69a-51db447d59b7 None None] Attempting to bind port ded5c8d9-110f-4e05-88a7-b8546e75095e on network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 05:09:33.369119 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0834af0e-3185-4a28-ad57-1d62f165c9c4 None None] Pushing event updated for resources: {'Port': ['ID=ded5c8d9-110f-4e05-88a7-b8546e75095e,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:09:33.374425 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6491cf70-a9eb-4875-a69a-51db447d59b7 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 5, 9, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 05:09:33.376164 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6491cf70-a9eb-4875-a69a-51db447d59b7 None None] Checking segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 05:09:33.376164 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6491cf70-a9eb-4875-a69a-51db447d59b7 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:33.376164 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6491cf70-a9eb-4875-a69a-51db447d59b7 None None] Bound using segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 05:09:33.376164 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-6491cf70-a9eb-4875-a69a-51db447d59b7 None None] Bound port: ded5c8d9-110f-4e05-88a7-b8546e75095e, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 05:09:33.376764 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6491cf70-a9eb-4875-a69a-51db447d59b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:33.410919 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d9bf46f0-b533-4f15-ac52-dbe762f70d09 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Network 164fa49b-4b69-42f2-b13f-78b6ab225c74 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 05:09:33.428096 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-6491cf70-a9eb-4875-a69a-51db447d59b7 None None] For port ded5c8d9-110f-4e05-88a7-b8546e75095e, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 05:09:33.431142 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-6491cf70-a9eb-4875-a69a-51db447d59b7 None None] For port ded5c8d9-110f-4e05-88a7-b8546e75095e, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=ded5c8d9-110f-4e05-88a7-b8546e75095e,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 05:09:33.474122 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-d9bf46f0-b533-4f15-ac52-dbe762f70d09 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 164fa49b-4b69-42f2-b13f-78b6ab225c74) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:09:33.478366 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d9bf46f0-b533-4f15-ac52-dbe762f70d09 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:09:33.479120 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d9bf46f0-b533-4f15-ac52-dbe762f70d09 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:33.485890 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-806a247e-bc8b-4ece-bbd4-4b7668780645 None None] Network 164fa49b-4b69-42f2-b13f-78b6ab225c74 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 05:09:33.508121 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6491cf70-a9eb-4875-a69a-51db447d59b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:33.551101 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-d9bf46f0-b533-4f15-ac52-dbe762f70d09 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 831 time: 0.6488812 Nov 09 05:09:33.553869 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 37478) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:09:33.604739 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0834af0e-3185-4a28-ad57-1d62f165c9c4 None None] Pushing event updated for resources: {'Port': ['ID=ded5c8d9-110f-4e05-88a7-b8546e75095e,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:09:33.615847 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6491cf70-a9eb-4875-a69a-51db447d59b7 None None] Routers {'4cde88b0-a962-472e-95ed-f34b609516f7'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:09:33.616458 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-6491cf70-a9eb-4875-a69a-51db447d59b7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:09:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['4cde88b0-a962-472e-95ed-f34b609516f7'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:09:33.764043 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fab4fa13-c2f1-4a8a-a30e-760175d69bd1 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-164fa49b-4b69-42f2-b13f-78b6ab225c74', 'network_id': '164fa49b-4b69-42f2-b13f-78b6ab225c74', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'fixed_ips': [{'subnet_id': 'b7570448-8728-4002-9b90-aa1aa4f10e83'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 05:09:33.764876 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-fab4fa13-c2f1-4a8a-a30e-760175d69bd1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:33.768522 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-6491cf70-a9eb-4875-a69a-51db447d59b7 None None] Set router 4cde88b0-a962-472e-95ed-f34b609516f7 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:09:33.996280 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-18b9ede7-1004-466b-9a58-b2fc2d00a448 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:34.177296 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-fab4fa13-c2f1-4a8a-a30e-760175d69bd1 None None] Allocated IP 172.20.0.2 (164fa49b-4b69-42f2-b13f-78b6ab225c74/b7570448-8728-4002-9b90-aa1aa4f10e83/fe0a5e84-a2cc-4b6a-9ff7-c458650ca05b) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 05:09:34.269692 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-6491cf70-a9eb-4875-a69a-51db447d59b7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4cde88b0-a962-472e-95ed-f34b609516f7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-310918215', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.122'}], 'enable_snat': True}, 'gw_port_id': 'ded5c8d9-110f-4e05-88a7-b8546e75095e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:09:30Z', 'updated_at': '2021-11-09T05:09:31Z', 'revision_number': 3, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': 'ded5c8d9-110f-4e05-88a7-b8546e75095e', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:56:05', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4cde88b0-a962-472e-95ed-f34b609516f7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1786, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:09:31Z', 'updated_at': '2021-11-09T05:09:33Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:09:34.301372 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6491cf70-a9eb-4875-a69a-51db447d59b7 None None] The sync data for ids ['4cde88b0-a962-472e-95ed-f34b609516f7'] in dv-neutron-816802-2-hyperv is: [{'id': '4cde88b0-a962-472e-95ed-f34b609516f7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-310918215', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.122'}], 'enable_snat': True}, 'gw_port_id': 'ded5c8d9-110f-4e05-88a7-b8546e75095e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:09:30Z', 'updated_at': '2021-11-09T05:09:31Z', 'revision_number': 3, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': 'ded5c8d9-110f-4e05-88a7-b8546e75095e', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:56:05', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4cde88b0-a962-472e-95ed-f34b609516f7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1786, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:09:31Z', 'updated_at': '2021-11-09T05:09:33Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 05:09:34.361104 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-fab4fa13-c2f1-4a8a-a30e-760175d69bd1 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:34.434345 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-fab4fa13-c2f1-4a8a-a30e-760175d69bd1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:34.483118 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fab4fa13-c2f1-4a8a-a30e-760175d69bd1 None None] Network 164fa49b-4b69-42f2-b13f-78b6ab225c74 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:09:34.484694 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-18b9ede7-1004-466b-9a58-b2fc2d00a448 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Allocated IP 172.20.0.1 (164fa49b-4b69-42f2-b13f-78b6ab225c74/b7570448-8728-4002-9b90-aa1aa4f10e83/a9a63c2c-d477-4631-8ad4-e24faaa2358a) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 05:09:34.487905 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-fab4fa13-c2f1-4a8a-a30e-760175d69bd1 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:09:34.492704 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fab4fa13-c2f1-4a8a-a30e-760175d69bd1 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 05:09:34.496911 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fab4fa13-c2f1-4a8a-a30e-760175d69bd1 None None] Pushing event updated for resources: {'Port': ['ID=fe0a5e84-a2cc-4b6a-9ff7-c458650ca05b,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:09:34.592850 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-fab4fa13-c2f1-4a8a-a30e-760175d69bd1 None None] Attempting to bind port fe0a5e84-a2cc-4b6a-9ff7-c458650ca05b on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 05:09:34.593365 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-fab4fa13-c2f1-4a8a-a30e-760175d69bd1 None None] Attempting to bind port fe0a5e84-a2cc-4b6a-9ff7-c458650ca05b by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'f30d767c-82f3-406c-aba3-6198dd73349f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': '164fa49b-4b69-42f2-b13f-78b6ab225c74'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 05:09:34.593865 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fab4fa13-c2f1-4a8a-a30e-760175d69bd1 None None] Attempting to bind port fe0a5e84-a2cc-4b6a-9ff7-c458650ca05b on network 164fa49b-4b69-42f2-b13f-78b6ab225c74 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 05:09:34.601180 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fab4fa13-c2f1-4a8a-a30e-760175d69bd1 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 5, 9, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 05:09:34.601648 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fab4fa13-c2f1-4a8a-a30e-760175d69bd1 None None] Checking segment: {'id': 'f30d767c-82f3-406c-aba3-6198dd73349f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': '164fa49b-4b69-42f2-b13f-78b6ab225c74'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 05:09:34.602630 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-fab4fa13-c2f1-4a8a-a30e-760175d69bd1 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:34.602630 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fab4fa13-c2f1-4a8a-a30e-760175d69bd1 None None] Bound using segment: {'id': 'f30d767c-82f3-406c-aba3-6198dd73349f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': '164fa49b-4b69-42f2-b13f-78b6ab225c74'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 05:09:34.603101 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-fab4fa13-c2f1-4a8a-a30e-760175d69bd1 None None] Bound port: fe0a5e84-a2cc-4b6a-9ff7-c458650ca05b, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f30d767c-82f3-406c-aba3-6198dd73349f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': '164fa49b-4b69-42f2-b13f-78b6ab225c74'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 05:09:34.603546 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-fab4fa13-c2f1-4a8a-a30e-760175d69bd1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:34.656673 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-18b9ede7-1004-466b-9a58-b2fc2d00a448 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:34.678920 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-fab4fa13-c2f1-4a8a-a30e-760175d69bd1 None None] For port fe0a5e84-a2cc-4b6a-9ff7-c458650ca05b, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 05:09:34.682569 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-fab4fa13-c2f1-4a8a-a30e-760175d69bd1 None None] For port fe0a5e84-a2cc-4b6a-9ff7-c458650ca05b, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=fe0a5e84-a2cc-4b6a-9ff7-c458650ca05b,segment=NetworkSegment(f30d767c-82f3-406c-aba3-6198dd73349f),segment_id=f30d767c-82f3-406c-aba3-6198dd73349f)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 05:09:34.754191 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-fab4fa13-c2f1-4a8a-a30e-760175d69bd1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:34.777434 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-18b9ede7-1004-466b-9a58-b2fc2d00a448 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:34.825226 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-18b9ede7-1004-466b-9a58-b2fc2d00a448 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Network 164fa49b-4b69-42f2-b13f-78b6ab225c74 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:09:34.826843 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fab4fa13-c2f1-4a8a-a30e-760175d69bd1 None None] Pushing event updated for resources: {'Port': ['ID=fe0a5e84-a2cc-4b6a-9ff7-c458650ca05b,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:09:34.830230 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-18b9ede7-1004-466b-9a58-b2fc2d00a448 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:09:34.833416 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-18b9ede7-1004-466b-9a58-b2fc2d00a448 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 05:09:34.884127 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18b9ede7-1004-466b-9a58-b2fc2d00a448 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'Port': ['ID=a9a63c2c-d477-4631-8ad4-e24faaa2358a,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:09:34.903524 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-18b9ede7-1004-466b-9a58-b2fc2d00a448 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:35.116915 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-18b9ede7-1004-466b-9a58-b2fc2d00a448 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:35.389199 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-18b9ede7-1004-466b-9a58-b2fc2d00a448 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:35.439519 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-18b9ede7-1004-466b-9a58-b2fc2d00a448 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:35.517399 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-18b9ede7-1004-466b-9a58-b2fc2d00a448 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:35.519189 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18b9ede7-1004-466b-9a58-b2fc2d00a448 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'Port': ['ID=a9a63c2c-d477-4631-8ad4-e24faaa2358a,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:09:35.617538 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-18b9ede7-1004-466b-9a58-b2fc2d00a448 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Network 164fa49b-4b69-42f2-b13f-78b6ab225c74 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:09:35.618976 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-18b9ede7-1004-466b-9a58-b2fc2d00a448 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:09:35.728764 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cb149696-d1d9-4a30-b0a8-13ccb002c7e9 None None] Network 164fa49b-4b69-42f2-b13f-78b6ab225c74 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 05:09:35.734991 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-18b9ede7-1004-466b-9a58-b2fc2d00a448 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Router 4cde88b0-a962-472e-95ed-f34b609516f7 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 05:09:35.842915 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-18b9ede7-1004-466b-9a58-b2fc2d00a448 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 05:09:35.844594 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-a25210bc-5533-4cae-b1ff-1418ed3a93bd None None] Provisioning complete for port fe0a5e84-a2cc-4b6a-9ff7-c458650ca05b triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:09:35.845107 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a25210bc-5533-4cae-b1ff-1418ed3a93bd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:35.851773 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-18b9ede7-1004-466b-9a58-b2fc2d00a448 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "PUT /v2.0/routers/4cde88b0-a962-472e-95ed-f34b609516f7/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.2929118 Nov 09 05:09:35.958070 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a25210bc-5533-4cae-b1ff-1418ed3a93bd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:35.999105 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-a25210bc-5533-4cae-b1ff-1418ed3a93bd None None] For port fe0a5e84-a2cc-4b6a-9ff7-c458650ca05b, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=fe0a5e84-a2cc-4b6a-9ff7-c458650ca05b,segment=NetworkSegment(f30d767c-82f3-406c-aba3-6198dd73349f),segment_id=f30d767c-82f3-406c-aba3-6198dd73349f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:09:36.020760 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-19066be1-ac8c-45eb-b74b-6e6cfcbee663 req-bc22eb3f-f548-40cc-89a7-7e1d7e23b1da tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-867507775&fields=id&tenant_id=8ac3eab68bd34485af7ddc3417853b28 HTTP/1.1" status: 200 len: 267 time: 0.0653231 Nov 09 05:09:36.120128 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a25210bc-5533-4cae-b1ff-1418ed3a93bd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:36.138066 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19066be1-ac8c-45eb-b74b-6e6cfcbee663 req-4f67e567-0b87-4df7-99f5-d6703199875e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:09:36.139645 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-19066be1-ac8c-45eb-b74b-6e6cfcbee663 req-4f67e567-0b87-4df7-99f5-d6703199875e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/networks?id=164fa49b-4b69-42f2-b13f-78b6ab225c74 HTTP/1.1" status: 200 len: 797 time: 0.1111851 Nov 09 05:09:36.156797 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-19066be1-ac8c-45eb-b74b-6e6cfcbee663 req-35eca305-eeff-40ca-a3d6-446993a67e7f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/quotas/8ac3eab68bd34485af7ddc3417853b28 HTTP/1.1" status: 200 len: 375 time: 0.0112712 Nov 09 05:09:36.189914 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a25210bc-5533-4cae-b1ff-1418ed3a93bd None None] Pushing event updated for resources: {'Port': ['ID=fe0a5e84-a2cc-4b6a-9ff7-c458650ca05b,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:09:36.215295 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-19066be1-ac8c-45eb-b74b-6e6cfcbee663 req-ebabb2cd-15f9-4bdd-9a41-dc420d9c8cb7 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?tenant_id=8ac3eab68bd34485af7ddc3417853b28&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0522547 Nov 09 05:09:36.243754 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-dc2a87d5-4d42-495b-b382-7002610e120e None None] Provisioning complete for port a9a63c2c-d477-4631-8ad4-e24faaa2358a triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:09:36.244292 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-dc2a87d5-4d42-495b-b382-7002610e120e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:36.281693 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-dc2a87d5-4d42-495b-b382-7002610e120e None None] Port a9a63c2c-d477-4631-8ad4-e24faaa2358a cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 05:09:36.294681 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-dc2a87d5-4d42-495b-b382-7002610e120e None None] Provisioning complete for port fe0a5e84-a2cc-4b6a-9ff7-c458650ca05b triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:09:36.295299 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-dc2a87d5-4d42-495b-b382-7002610e120e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:36.399703 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-19066be1-ac8c-45eb-b74b-6e6cfcbee663 req-2234878d-5ddf-4985-9eaf-f43891446994 service neutron] 10.222.0.24 "GET /v2.0/networks/164fa49b-4b69-42f2-b13f-78b6ab225c74?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1650047 Nov 09 05:09:36.431947 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e9c1be76-2c5d-4b65-99eb-ffbc37b8d05c None None] Sync routers for ids ['4cde88b0-a962-472e-95ed-f34b609516f7'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 05:09:36.446223 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 05:09:36.453197 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e9c1be76-2c5d-4b65-99eb-ffbc37b8d05c None None] Routers {'4cde88b0-a962-472e-95ed-f34b609516f7'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:09:36.454728 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-e9c1be76-2c5d-4b65-99eb-ffbc37b8d05c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:09:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['4cde88b0-a962-472e-95ed-f34b609516f7'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:09:36.491498 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device fe0a5e84-a2cc-4b6a-9ff7-c458650ca05b up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:09:36.496342 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-19066be1-ac8c-45eb-b74b-6e6cfcbee663 req-c36bb11d-6060-45b4-bb02-74356a5fc20c service neutron] 10.222.0.24 "GET /v2.0/networks/164fa49b-4b69-42f2-b13f-78b6ab225c74?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0955033 Nov 09 05:09:36.546151 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-db2aecdd-01b5-4ea9-a165-dc2528f11c93 None None] Provisioning complete for port a9a63c2c-d477-4631-8ad4-e24faaa2358a triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:09:36.546540 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-db2aecdd-01b5-4ea9-a165-dc2528f11c93 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:36.586007 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port fe0a5e84-a2cc-4b6a-9ff7-c458650ca05b triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:09:36.586382 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:36.588025 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-db2aecdd-01b5-4ea9-a165-dc2528f11c93 None None] Port a9a63c2c-d477-4631-8ad4-e24faaa2358a cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 05:09:36.599738 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-e9c1be76-2c5d-4b65-99eb-ffbc37b8d05c None None] Set router 4cde88b0-a962-472e-95ed-f34b609516f7 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:09:36.663920 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device ded5c8d9-110f-4e05-88a7-b8546e75095e up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:09:36.717557 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-1126a2df-c76f-4f64-80f5-088e072eeebc None None] Provisioning complete for port a9a63c2c-d477-4631-8ad4-e24faaa2358a triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:09:36.717923 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1126a2df-c76f-4f64-80f5-088e072eeebc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:36.758609 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port ded5c8d9-110f-4e05-88a7-b8546e75095e triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:09:36.758979 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:36.760598 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-1126a2df-c76f-4f64-80f5-088e072eeebc None None] Port a9a63c2c-d477-4631-8ad4-e24faaa2358a cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 05:09:36.805282 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3bd3bb94-4c3d-46bb-84ff-e1d1363fb3f9 req-6a7cd5d0-cb95-4f88-89ec-b8e955338319 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=69540ec1-495f-4d3b-bfb5-4c2625bd5e6d HTTP/1.1" status: 200 len: 210 time: 0.0362942 Nov 09 05:09:36.833919 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-e9c1be76-2c5d-4b65-99eb-ffbc37b8d05c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4cde88b0-a962-472e-95ed-f34b609516f7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-310918215', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.122'}], 'enable_snat': True}, 'gw_port_id': 'ded5c8d9-110f-4e05-88a7-b8546e75095e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:09:30Z', 'updated_at': '2021-11-09T05:09:35Z', 'revision_number': 4, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': 'ded5c8d9-110f-4e05-88a7-b8546e75095e', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:56:05', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4cde88b0-a962-472e-95ed-f34b609516f7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1786, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:09:31Z', 'updated_at': '2021-11-09T05:09:33Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'a9a63c2c-d477-4631-8ad4-e24faaa2358a', 'name': '', 'network_id': '164fa49b-4b69-42f2-b13f-78b6ab225c74', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'mac_address': 'fa:16:3e:ff:23:9e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4cde88b0-a962-472e-95ed-f34b609516f7', 'device_owner': 'network:router_interface', 'standard_attr_id': 1789, 'fixed_ips': [{'subnet_id': 'b7570448-8728-4002-9b90-aa1aa4f10e83', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:09:34Z', 'updated_at': '2021-11-09T05:09:35Z', 'revision_number': 2, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'subnets': [{'id': 'b7570448-8728-4002-9b90-aa1aa4f10e83', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:09:36.860114 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e9c1be76-2c5d-4b65-99eb-ffbc37b8d05c None None] Checking router: 4cde88b0-a962-472e-95ed-f34b609516f7 for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 05:09:36.860665 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e9c1be76-2c5d-4b65-99eb-ffbc37b8d05c None None] Updating router 4cde88b0-a962-472e-95ed-f34b609516f7 port a9a63c2c-d477-4631-8ad4-e24faaa2358a binding host dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 05:09:36.863437 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:36.884284 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port ded5c8d9-110f-4e05-88a7-b8546e75095e, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=ded5c8d9-110f-4e05-88a7-b8546e75095e,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:09:36.891960 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-e9c1be76-2c5d-4b65-99eb-ffbc37b8d05c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:36.948504 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:36.999713 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=ded5c8d9-110f-4e05-88a7-b8546e75095e,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:09:37.242290 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-e9c1be76-2c5d-4b65-99eb-ffbc37b8d05c None None] Publish callbacks [] for port, precommit_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:37.330908 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-e9c1be76-2c5d-4b65-99eb-ffbc37b8d05c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:37.383843 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8af2f276-dfbf-4ed2-9534-8b524da714b0 None None] Pushing event updated for resources: {'Port': ['ID=a9a63c2c-d477-4631-8ad4-e24faaa2358a,revision_number=3']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:09:37.406854 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8af2f276-dfbf-4ed2-9534-8b524da714b0 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:09:37.407206 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8af2f276-dfbf-4ed2-9534-8b524da714b0 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:09:37.407515 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8af2f276-dfbf-4ed2-9534-8b524da714b0 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:09:37.407842 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8af2f276-dfbf-4ed2-9534-8b524da714b0 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:09:37.408188 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8af2f276-dfbf-4ed2-9534-8b524da714b0 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:09:37.408489 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8af2f276-dfbf-4ed2-9534-8b524da714b0 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:09:37.408811 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8af2f276-dfbf-4ed2-9534-8b524da714b0 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:09:37.409129 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8af2f276-dfbf-4ed2-9534-8b524da714b0 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:09:37.409553 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8af2f276-dfbf-4ed2-9534-8b524da714b0 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:09:37.409769 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8af2f276-dfbf-4ed2-9534-8b524da714b0 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:09:37.410085 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8af2f276-dfbf-4ed2-9534-8b524da714b0 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:09:37.410440 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8af2f276-dfbf-4ed2-9534-8b524da714b0 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:09:37.449596 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-e9c1be76-2c5d-4b65-99eb-ffbc37b8d05c None None] Attempting to bind port a9a63c2c-d477-4631-8ad4-e24faaa2358a on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 05:09:37.450292 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-e9c1be76-2c5d-4b65-99eb-ffbc37b8d05c None None] Attempting to bind port a9a63c2c-d477-4631-8ad4-e24faaa2358a by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'f30d767c-82f3-406c-aba3-6198dd73349f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': '164fa49b-4b69-42f2-b13f-78b6ab225c74'}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 05:09:37.450292 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e9c1be76-2c5d-4b65-99eb-ffbc37b8d05c None None] Attempting to bind port a9a63c2c-d477-4631-8ad4-e24faaa2358a on network 164fa49b-4b69-42f2-b13f-78b6ab225c74 {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 05:09:37.457831 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e9c1be76-2c5d-4b65-99eb-ffbc37b8d05c None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 5, 9, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 05:09:37.458197 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e9c1be76-2c5d-4b65-99eb-ffbc37b8d05c None None] Checking segment: {'id': 'f30d767c-82f3-406c-aba3-6198dd73349f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': '164fa49b-4b69-42f2-b13f-78b6ab225c74'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102164) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 05:09:37.458609 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-e9c1be76-2c5d-4b65-99eb-ffbc37b8d05c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:37.458993 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e9c1be76-2c5d-4b65-99eb-ffbc37b8d05c None None] Bound using segment: {'id': 'f30d767c-82f3-406c-aba3-6198dd73349f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': '164fa49b-4b69-42f2-b13f-78b6ab225c74'} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 05:09:37.460009 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-e9c1be76-2c5d-4b65-99eb-ffbc37b8d05c None None] Bound port: a9a63c2c-d477-4631-8ad4-e24faaa2358a, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f30d767c-82f3-406c-aba3-6198dd73349f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': '164fa49b-4b69-42f2-b13f-78b6ab225c74'}}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 05:09:37.460383 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-e9c1be76-2c5d-4b65-99eb-ffbc37b8d05c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:37.566893 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-e9c1be76-2c5d-4b65-99eb-ffbc37b8d05c None None] For port a9a63c2c-d477-4631-8ad4-e24faaa2358a, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102164) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 05:09:37.580643 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-e9c1be76-2c5d-4b65-99eb-ffbc37b8d05c None None] For port a9a63c2c-d477-4631-8ad4-e24faaa2358a, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=a9a63c2c-d477-4631-8ad4-e24faaa2358a,segment=NetworkSegment(f30d767c-82f3-406c-aba3-6198dd73349f),segment_id=f30d767c-82f3-406c-aba3-6198dd73349f)] {{(pid=102164) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 05:09:37.586055 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-1895dae4-4eff-46f7-945b-03e96613d09c None None] Provisioning complete for port a9a63c2c-d477-4631-8ad4-e24faaa2358a triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:09:37.586393 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1895dae4-4eff-46f7-945b-03e96613d09c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:37.620091 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-1895dae4-4eff-46f7-945b-03e96613d09c None None] Port a9a63c2c-d477-4631-8ad4-e24faaa2358a cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 05:09:37.642180 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-e9c1be76-2c5d-4b65-99eb-ffbc37b8d05c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:37.695916 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e9c1be76-2c5d-4b65-99eb-ffbc37b8d05c None None] Routers {'4cde88b0-a962-472e-95ed-f34b609516f7'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:09:37.696530 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-e9c1be76-2c5d-4b65-99eb-ffbc37b8d05c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:09:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['4cde88b0-a962-472e-95ed-f34b609516f7'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:09:37.749688 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8af2f276-dfbf-4ed2-9534-8b524da714b0 None None] Pushing event updated for resources: {'Port': ['ID=a9a63c2c-d477-4631-8ad4-e24faaa2358a,revision_number=4']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:09:37.822745 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-e9c1be76-2c5d-4b65-99eb-ffbc37b8d05c None None] Set router 4cde88b0-a962-472e-95ed-f34b609516f7 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:09:37.900940 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-7e29d343-e1d4-4b5a-90d3-b2e403fbde59 req-4b1ae781-6f4d-43cb-b5de-1edea4d1d94e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=69540ec1-495f-4d3b-bfb5-4c2625bd5e6d HTTP/1.1" status: 200 len: 210 time: 0.0351191 Nov 09 05:09:37.941621 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-654cff33-20fb-4a03-a83d-911095136909 None None] Provisioning complete for port a9a63c2c-d477-4631-8ad4-e24faaa2358a triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:09:37.942198 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-654cff33-20fb-4a03-a83d-911095136909 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:38.024543 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-654cff33-20fb-4a03-a83d-911095136909 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:38.030176 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-e9c1be76-2c5d-4b65-99eb-ffbc37b8d05c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4cde88b0-a962-472e-95ed-f34b609516f7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-310918215', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.122'}], 'enable_snat': True}, 'gw_port_id': 'ded5c8d9-110f-4e05-88a7-b8546e75095e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:09:30Z', 'updated_at': '2021-11-09T05:09:35Z', 'revision_number': 4, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': 'ded5c8d9-110f-4e05-88a7-b8546e75095e', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:56:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4cde88b0-a962-472e-95ed-f34b609516f7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1786, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:09:31Z', 'updated_at': '2021-11-09T05:09:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'a9a63c2c-d477-4631-8ad4-e24faaa2358a', 'name': '', 'network_id': '164fa49b-4b69-42f2-b13f-78b6ab225c74', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'mac_address': 'fa:16:3e:ff:23:9e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4cde88b0-a962-472e-95ed-f34b609516f7', 'device_owner': 'network:router_interface', 'standard_attr_id': 1789, 'fixed_ips': [{'subnet_id': 'b7570448-8728-4002-9b90-aa1aa4f10e83', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:09:34Z', 'updated_at': '2021-11-09T05:09:37Z', 'revision_number': 4, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'subnets': [{'id': 'b7570448-8728-4002-9b90-aa1aa4f10e83', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:09:38.055731 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-654cff33-20fb-4a03-a83d-911095136909 None None] For port a9a63c2c-d477-4631-8ad4-e24faaa2358a, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=a9a63c2c-d477-4631-8ad4-e24faaa2358a,segment=NetworkSegment(f30d767c-82f3-406c-aba3-6198dd73349f),segment_id=f30d767c-82f3-406c-aba3-6198dd73349f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:09:38.056088 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e9c1be76-2c5d-4b65-99eb-ffbc37b8d05c None None] The sync data for ids ['4cde88b0-a962-472e-95ed-f34b609516f7'] in dv-neutron-816802-2-hyperv is: [{'id': '4cde88b0-a962-472e-95ed-f34b609516f7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-310918215', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.122'}], 'enable_snat': True}, 'gw_port_id': 'ded5c8d9-110f-4e05-88a7-b8546e75095e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:09:30Z', 'updated_at': '2021-11-09T05:09:35Z', 'revision_number': 4, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': 'ded5c8d9-110f-4e05-88a7-b8546e75095e', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:56:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4cde88b0-a962-472e-95ed-f34b609516f7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1786, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:09:31Z', 'updated_at': '2021-11-09T05:09:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'a9a63c2c-d477-4631-8ad4-e24faaa2358a', 'name': '', 'network_id': '164fa49b-4b69-42f2-b13f-78b6ab225c74', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'mac_address': 'fa:16:3e:ff:23:9e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4cde88b0-a962-472e-95ed-f34b609516f7', 'device_owner': 'network:router_interface', 'standard_attr_id': 1789, 'fixed_ips': [{'subnet_id': 'b7570448-8728-4002-9b90-aa1aa4f10e83', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:09:34Z', 'updated_at': '2021-11-09T05:09:37Z', 'revision_number': 4, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'subnets': [{'id': 'b7570448-8728-4002-9b90-aa1aa4f10e83', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 05:09:38.119480 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-654cff33-20fb-4a03-a83d-911095136909 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:38.176260 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-654cff33-20fb-4a03-a83d-911095136909 None None] Pushing event updated for resources: {'Port': ['ID=a9a63c2c-d477-4631-8ad4-e24faaa2358a,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:09:38.501655 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device ded5c8d9-110f-4e05-88a7-b8546e75095e up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:09:38.561478 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port ded5c8d9-110f-4e05-88a7-b8546e75095e triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:09:38.561851 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:38.673101 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device a9a63c2c-d477-4631-8ad4-e24faaa2358a up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:09:38.707922 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19066be1-ac8c-45eb-b74b-6e6cfcbee663 req-533beeb1-c08c-4fa6-88eb-cdf45f6640ee tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:09:38.710282 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-19066be1-ac8c-45eb-b74b-6e6cfcbee663 req-533beeb1-c08c-4fa6-88eb-cdf45f6640ee tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.26 "GET /v2.0/networks?id=164fa49b-4b69-42f2-b13f-78b6ab225c74 HTTP/1.1" status: 200 len: 797 time: 0.1629133 Nov 09 05:09:38.731028 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port a9a63c2c-d477-4631-8ad4-e24faaa2358a triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:09:38.731394 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:38.786407 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-19066be1-ac8c-45eb-b74b-6e6cfcbee663 req-428da658-905b-459d-bfb5-3902f6d874a0 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.26 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=8ac3eab68bd34485af7ddc3417853b28 HTTP/1.1" status: 200 len: 379 time: 0.0657668 Nov 09 05:09:38.797117 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-19066be1-ac8c-45eb-b74b-6e6cfcbee663 req-b3a15c16-202a-47d6-bdab-6e7acaa98039 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'port': {'device_id': '69540ec1-495f-4d3b-bfb5-4c2625bd5e6d', 'network_id': '164fa49b-4b69-42f2-b13f-78b6ab225c74', 'admin_state_up': True, 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'security_groups': ['3285a6ac-908a-45d4-a6e2-2d8556bc393d']}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:09:39.001890 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a91c6f6e-f6a9-4b3a-bc72-240358894c79 req-4fad0644-0449-4510-b9b2-48a1b722c2cc tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=69540ec1-495f-4d3b-bfb5-4c2625bd5e6d HTTP/1.1" status: 200 len: 210 time: 0.0323853 Nov 09 05:09:39.002142 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-19066be1-ac8c-45eb-b74b-6e6cfcbee663 req-b3a15c16-202a-47d6-bdab-6e7acaa98039 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Made reservation on behalf of 8ac3eab68bd34485af7ddc3417853b28 for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 05:09:39.005565 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-19066be1-ac8c-45eb-b74b-6e6cfcbee663 req-b3a15c16-202a-47d6-bdab-6e7acaa98039 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:39.141505 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [req-19066be1-ac8c-45eb-b74b-6e6cfcbee663 req-b3a15c16-202a-47d6-bdab-6e7acaa98039 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Allocated IP 172.20.0.3 (164fa49b-4b69-42f2-b13f-78b6ab225c74/b7570448-8728-4002-9b90-aa1aa4f10e83/39af26ee-c67f-450c-9f93-ef05912ede92) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 05:09:39.288177 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-19066be1-ac8c-45eb-b74b-6e6cfcbee663 req-b3a15c16-202a-47d6-bdab-6e7acaa98039 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:39.360423 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-19066be1-ac8c-45eb-b74b-6e6cfcbee663 req-b3a15c16-202a-47d6-bdab-6e7acaa98039 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:39.401309 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-19066be1-ac8c-45eb-b74b-6e6cfcbee663 req-b3a15c16-202a-47d6-bdab-6e7acaa98039 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Network 164fa49b-4b69-42f2-b13f-78b6ab225c74 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:09:39.406112 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [req-19066be1-ac8c-45eb-b74b-6e6cfcbee663 req-b3a15c16-202a-47d6-bdab-6e7acaa98039 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:09:39.408355 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-19066be1-ac8c-45eb-b74b-6e6cfcbee663 req-b3a15c16-202a-47d6-bdab-6e7acaa98039 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 05:09:39.438594 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3a15c16-202a-47d6-bdab-6e7acaa98039 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'Port': ['ID=39af26ee-c67f-450c-9f93-ef05912ede92,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:09:39.467746 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19066be1-ac8c-45eb-b74b-6e6cfcbee663 req-b3a15c16-202a-47d6-bdab-6e7acaa98039 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:09:39.468366 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-19066be1-ac8c-45eb-b74b-6e6cfcbee663 req-b3a15c16-202a-47d6-bdab-6e7acaa98039 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:39.546120 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-19066be1-ac8c-45eb-b74b-6e6cfcbee663 req-b3a15c16-202a-47d6-bdab-6e7acaa98039 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.26 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7529809 Nov 09 05:09:39.559041 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-19066be1-ac8c-45eb-b74b-6e6cfcbee663 req-1b18e127-6a6e-4752-a618-a0c5f7578810 service neutron] Request body: {'port': {'device_id': '69540ec1-495f-4d3b-bfb5-4c2625bd5e6d', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:09:39.611839 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-19066be1-ac8c-45eb-b74b-6e6cfcbee663 req-1b18e127-6a6e-4752-a618-a0c5f7578810 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:39.649579 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-9e411578-93ab-4b3d-b562-0430b3bfea7f None None] Provisioning complete for port 39af26ee-c67f-450c-9f93-ef05912ede92 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:09:39.650253 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9e411578-93ab-4b3d-b562-0430b3bfea7f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:39.684111 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-9e411578-93ab-4b3d-b562-0430b3bfea7f None None] Port 39af26ee-c67f-450c-9f93-ef05912ede92 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 05:09:40.174987 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [req-19066be1-ac8c-45eb-b74b-6e6cfcbee663 req-1b18e127-6a6e-4752-a618-a0c5f7578810 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 39af26ee-c67f-450c-9f93-ef05912ede92 {{(pid=102162) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 05:09:40.184665 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-19066be1-ac8c-45eb-b74b-6e6cfcbee663 req-1b18e127-6a6e-4752-a618-a0c5f7578810 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:40.197811 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.provisioning_blocks [req-19066be1-ac8c-45eb-b74b-6e6cfcbee663 req-1b18e127-6a6e-4752-a618-a0c5f7578810 service neutron] Transition to ACTIVE for port object 39af26ee-c67f-450c-9f93-ef05912ede92 will not be triggered until provisioned by entity L2. {{(pid=102162) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 09 05:09:40.269219 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-19066be1-ac8c-45eb-b74b-6e6cfcbee663 req-1b18e127-6a6e-4752-a618-a0c5f7578810 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:40.325645 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b18e127-6a6e-4752-a618-a0c5f7578810 service neutron] Pushing event updated for resources: {'Port': ['ID=39af26ee-c67f-450c-9f93-ef05912ede92,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:09:40.395730 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-19066be1-ac8c-45eb-b74b-6e6cfcbee663 req-1b18e127-6a6e-4752-a618-a0c5f7578810 service neutron] Attempting to bind port 39af26ee-c67f-450c-9f93-ef05912ede92 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 05:09:40.396242 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-19066be1-ac8c-45eb-b74b-6e6cfcbee663 req-1b18e127-6a6e-4752-a618-a0c5f7578810 service neutron] Attempting to bind port 39af26ee-c67f-450c-9f93-ef05912ede92 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'f30d767c-82f3-406c-aba3-6198dd73349f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': '164fa49b-4b69-42f2-b13f-78b6ab225c74'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 05:09:40.396623 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-19066be1-ac8c-45eb-b74b-6e6cfcbee663 req-1b18e127-6a6e-4752-a618-a0c5f7578810 service neutron] Attempting to bind port 39af26ee-c67f-450c-9f93-ef05912ede92 on network 164fa49b-4b69-42f2-b13f-78b6ab225c74 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 05:09:40.402921 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-19066be1-ac8c-45eb-b74b-6e6cfcbee663 req-1b18e127-6a6e-4752-a618-a0c5f7578810 service neutron] Port 39af26ee-c67f-450c-9f93-ef05912ede92 on network 164fa49b-4b69-42f2-b13f-78b6ab225c74 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 05:09:40.403367 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-19066be1-ac8c-45eb-b74b-6e6cfcbee663 req-1b18e127-6a6e-4752-a618-a0c5f7578810 service neutron] Attempting to bind port 39af26ee-c67f-450c-9f93-ef05912ede92 on network 164fa49b-4b69-42f2-b13f-78b6ab225c74 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 05:09:40.408880 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-19066be1-ac8c-45eb-b74b-6e6cfcbee663 req-1b18e127-6a6e-4752-a618-a0c5f7578810 service neutron] Checking agent: {'id': '7d36b884-4ad2-4878-9464-bf647030b544', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'started_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 5, 9, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 05:09:40.409365 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-19066be1-ac8c-45eb-b74b-6e6cfcbee663 req-1b18e127-6a6e-4752-a618-a0c5f7578810 service neutron] Checking segment: {'id': 'f30d767c-82f3-406c-aba3-6198dd73349f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': '164fa49b-4b69-42f2-b13f-78b6ab225c74'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 05:09:40.409869 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-19066be1-ac8c-45eb-b74b-6e6cfcbee663 req-1b18e127-6a6e-4752-a618-a0c5f7578810 service neutron] Bound using segment: {'id': 'f30d767c-82f3-406c-aba3-6198dd73349f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': '164fa49b-4b69-42f2-b13f-78b6ab225c74'} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 05:09:40.410413 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-19066be1-ac8c-45eb-b74b-6e6cfcbee663 req-1b18e127-6a6e-4752-a618-a0c5f7578810 service neutron] Bound port: 39af26ee-c67f-450c-9f93-ef05912ede92, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'f30d767c-82f3-406c-aba3-6198dd73349f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': '164fa49b-4b69-42f2-b13f-78b6ab225c74'}}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 05:09:40.410865 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-19066be1-ac8c-45eb-b74b-6e6cfcbee663 req-1b18e127-6a6e-4752-a618-a0c5f7578810 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:40.415083 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9bd8563-632d-4323-87e6-6b663dc9d88d req-9563cc48-66be-490f-8b07-ff744680b3b4 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:09:40.416646 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f9bd8563-632d-4323-87e6-6b663dc9d88d req-9563cc48-66be-490f-8b07-ff744680b3b4 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=69540ec1-495f-4d3b-bfb5-4c2625bd5e6d HTTP/1.1" status: 200 len: 931 time: 0.3445485 Nov 09 05:09:40.468835 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f9bd8563-632d-4323-87e6-6b663dc9d88d req-84d79301-9d96-473d-ba9d-f45fa8340372 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=3285a6ac-908a-45d4-a6e2-2d8556bc393d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0452745 Nov 09 05:09:40.477698 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-19066be1-ac8c-45eb-b74b-6e6cfcbee663 req-1b18e127-6a6e-4752-a618-a0c5f7578810 service neutron] For port 39af26ee-c67f-450c-9f93-ef05912ede92, host hv-neutron-8168, cleared binding levels {{(pid=102162) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 05:09:40.481192 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-19066be1-ac8c-45eb-b74b-6e6cfcbee663 req-1b18e127-6a6e-4752-a618-a0c5f7578810 service neutron] For port 39af26ee-c67f-450c-9f93-ef05912ede92, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=39af26ee-c67f-450c-9f93-ef05912ede92,segment=NetworkSegment(f30d767c-82f3-406c-aba3-6198dd73349f),segment_id=f30d767c-82f3-406c-aba3-6198dd73349f)] {{(pid=102162) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 05:09:40.554800 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-19066be1-ac8c-45eb-b74b-6e6cfcbee663 req-1b18e127-6a6e-4752-a618-a0c5f7578810 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:40.591940 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19066be1-ac8c-45eb-b74b-6e6cfcbee663 req-1b18e127-6a6e-4752-a618-a0c5f7578810 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:09:40.592550 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-19066be1-ac8c-45eb-b74b-6e6cfcbee663 req-1b18e127-6a6e-4752-a618-a0c5f7578810 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:40.593982 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-19066be1-ac8c-45eb-b74b-6e6cfcbee663 req-1b18e127-6a6e-4752-a618-a0c5f7578810 service neutron] 10.222.0.26 "PUT /v2.0/ports/39af26ee-c67f-450c-9f93-ef05912ede92 HTTP/1.1" status: 200 len: 1093 time: 1.0400791 Nov 09 05:09:40.594335 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '69540ec1-495f-4d3b-bfb5-4c2625bd5e6d', 'tag': '39af26ee-c67f-450c-9f93-ef05912ede92'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:09:40.596567 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2007ca48-f72b-4adb-884e-8b96511b045f" -d '{"events": [{"name": "network-changed", "server_uuid": "69540ec1-495f-4d3b-bfb5-4c2625bd5e6d", "tag": "39af26ee-c67f-450c-9f93-ef05912ede92"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:09:40.621325 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b18e127-6a6e-4752-a618-a0c5f7578810 service neutron] Pushing event updated for resources: {'Port': ['ID=39af26ee-c67f-450c-9f93-ef05912ede92,revision_number=3']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:09:40.650171 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 05:09:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2bfb0c52-f860-4b87-97c6-b8a2302768df x-openstack-request-id: req-2bfb0c52-f860-4b87-97c6-b8a2302768df {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:09:40.650691 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "69540ec1-495f-4d3b-bfb5-4c2625bd5e6d", "tag": "39af26ee-c67f-450c-9f93-ef05912ede92", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:09:40.650937 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-2bfb0c52-f860-4b87-97c6-b8a2302768df {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:09:40.651330 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '69540ec1-495f-4d3b-bfb5-4c2625bd5e6d', 'tag': '39af26ee-c67f-450c-9f93-ef05912ede92', 'status': 'completed', 'code': 200} Nov 09 05:09:40.716706 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2007ca48-f72b-4adb-884e-8b96511b045f req-f60d2bda-7d48-4a3e-8b07-c7ef96205eec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:09:40.718218 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2007ca48-f72b-4adb-884e-8b96511b045f req-f60d2bda-7d48-4a3e-8b07-c7ef96205eec service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=8ac3eab68bd34485af7ddc3417853b28&device_id=69540ec1-495f-4d3b-bfb5-4c2625bd5e6d HTTP/1.1" status: 200 len: 1096 time: 0.0440955 Nov 09 05:09:40.822793 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2007ca48-f72b-4adb-884e-8b96511b045f req-6776d690-9c53-41ce-bf76-2fa14b93fdce service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:09:40.824245 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2007ca48-f72b-4adb-884e-8b96511b045f req-6776d690-9c53-41ce-bf76-2fa14b93fdce service neutron] 10.222.0.26 "GET /v2.0/networks?tenant_id=8ac3eab68bd34485af7ddc3417853b28&shared=False HTTP/1.1" status: 200 len: 898 time: 0.0976825 Nov 09 05:09:40.917957 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2007ca48-f72b-4adb-884e-8b96511b045f req-37bbb80e-4cda-43f1-81a8-510f145929d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:09:40.919447 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2007ca48-f72b-4adb-884e-8b96511b045f req-37bbb80e-4cda-43f1-81a8-510f145929d1 service neutron] 10.222.0.26 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0889125 Nov 09 05:09:40.992551 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19066be1-ac8c-45eb-b74b-6e6cfcbee663 req-d1b1f642-590b-45c3-bf49-2474f8f30e8e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:09:40.993941 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-19066be1-ac8c-45eb-b74b-6e6cfcbee663 req-d1b1f642-590b-45c3-bf49-2474f8f30e8e service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=8ac3eab68bd34485af7ddc3417853b28&device_id=69540ec1-495f-4d3b-bfb5-4c2625bd5e6d HTTP/1.1" status: 200 len: 1096 time: 0.0401652 Nov 09 05:09:41.038521 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-19066be1-ac8c-45eb-b74b-6e6cfcbee663 req-2da13638-9446-48c5-a8a0-c6ad0f9deb5b service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=39af26ee-c67f-450c-9f93-ef05912ede92 HTTP/1.1" status: 200 len: 217 time: 0.0367281 Nov 09 05:09:41.086310 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19066be1-ac8c-45eb-b74b-6e6cfcbee663 req-ac848daf-dfc1-4371-8c90-351b4fcd6e81 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:09:41.087815 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-19066be1-ac8c-45eb-b74b-6e6cfcbee663 req-ac848daf-dfc1-4371-8c90-351b4fcd6e81 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=b7570448-8728-4002-9b90-aa1aa4f10e83 HTTP/1.1" status: 200 len: 834 time: 0.0426409 Nov 09 05:09:41.131151 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19066be1-ac8c-45eb-b74b-6e6cfcbee663 req-5f57cb17-0867-453f-bcc4-cbe49b4b064e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:09:41.133142 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-19066be1-ac8c-45eb-b74b-6e6cfcbee663 req-5f57cb17-0867-453f-bcc4-cbe49b4b064e service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=164fa49b-4b69-42f2-b13f-78b6ab225c74&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0385549 Nov 09 05:09:41.224932 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-19066be1-ac8c-45eb-b74b-6e6cfcbee663 req-ffbc697d-8ade-4e0f-a19e-c3a0a38317a7 service neutron] 10.222.0.26 "GET /v2.0/networks/164fa49b-4b69-42f2-b13f-78b6ab225c74?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0848055 Nov 09 05:09:41.313551 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-19066be1-ac8c-45eb-b74b-6e6cfcbee663 req-a69eebac-1acf-4ffe-ae3c-dabd2d072aaa service neutron] 10.222.0.26 "GET /v2.0/networks/164fa49b-4b69-42f2-b13f-78b6ab225c74?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0814266 Nov 09 05:09:41.377037 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e60370eb-3e71-4c14-98cb-7367020cdbc2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:41.583981 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11b43d6e-3009-420d-81f6-fd30d2b50e6b req-a27e46db-6230-46ff-a102-e04f74475a6b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:09:41.585370 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-11b43d6e-3009-420d-81f6-fd30d2b50e6b req-a27e46db-6230-46ff-a102-e04f74475a6b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=69540ec1-495f-4d3b-bfb5-4c2625bd5e6d HTTP/1.1" status: 200 len: 943 time: 0.0484047 Nov 09 05:09:41.633727 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-11b43d6e-3009-420d-81f6-fd30d2b50e6b req-8485b9b2-24c2-45df-8dfe-1b182894450f tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=3285a6ac-908a-45d4-a6e2-2d8556bc393d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0422704 Nov 09 05:09:42.560008 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:42.758618 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73264e97-6896-4747-a4d1-4bdae5e3d594 req-e3545b1a-17f8-4478-8527-4da0a31fc7c6 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:09:42.760083 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-73264e97-6896-4747-a4d1-4bdae5e3d594 req-e3545b1a-17f8-4478-8527-4da0a31fc7c6 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=69540ec1-495f-4d3b-bfb5-4c2625bd5e6d HTTP/1.1" status: 200 len: 943 time: 0.0531635 Nov 09 05:09:42.807099 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-73264e97-6896-4747-a4d1-4bdae5e3d594 req-cc26ee58-47c0-40be-8f71-2ae46c48bb3b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=3285a6ac-908a-45d4-a6e2-2d8556bc393d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0411491 Nov 09 05:09:43.726252 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f0d8ef65-d82e-4728-9c1e-de5ecd14c89e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:43.921767 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dab24fd-9fe7-438e-a16b-2a15b7a84774 req-a6f2958a-f872-4bb0-a52e-1704c3d2abde tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:09:43.923269 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-6dab24fd-9fe7-438e-a16b-2a15b7a84774 req-a6f2958a-f872-4bb0-a52e-1704c3d2abde tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=69540ec1-495f-4d3b-bfb5-4c2625bd5e6d HTTP/1.1" status: 200 len: 943 time: 0.0509763 Nov 09 05:09:43.970134 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-6dab24fd-9fe7-438e-a16b-2a15b7a84774 req-d85260f5-2acf-4692-b3de-9a43f15858c3 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=3285a6ac-908a-45d4-a6e2-2d8556bc393d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0410509 Nov 09 05:09:44.118015 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 39af26ee-c67f-450c-9f93-ef05912ede92 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=102163) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 09 05:09:44.207967 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 39af26ee-c67f-450c-9f93-ef05912ede92, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=39af26ee-c67f-450c-9f93-ef05912ede92,segment=NetworkSegment(f30d767c-82f3-406c-aba3-6198dd73349f),segment_id=f30d767c-82f3-406c-aba3-6198dd73349f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:09:44.219363 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Returning: {'device': '39af26ee-c67f-450c-9f93-ef05912ede92', 'network_id': '164fa49b-4b69-42f2-b13f-78b6ab225c74', 'port_id': '39af26ee-c67f-450c-9f93-ef05912ede92', 'mac_address': 'fa:16:3e:22:a4:c0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 340, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b7570448-8728-4002-9b90-aa1aa4f10e83', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102163) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 09 05:09:44.259341 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:44.271471 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 39af26ee-c67f-450c-9f93-ef05912ede92 {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 05:09:44.291262 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 39af26ee-c67f-450c-9f93-ef05912ede92, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=39af26ee-c67f-450c-9f93-ef05912ede92,segment=NetworkSegment(f30d767c-82f3-406c-aba3-6198dd73349f),segment_id=f30d767c-82f3-406c-aba3-6198dd73349f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:09:44.337680 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:44.384411 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=39af26ee-c67f-450c-9f93-ef05912ede92,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:09:44.543471 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['39af26ee-c67f-450c-9f93-ef05912ede92'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 05:09:45.082531 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2e39d9d-53e2-4cc4-a7f5-4a5ec63239e1 req-59bf414c-47fe-4eea-bf97-9fa922e7345e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:09:45.083999 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e2e39d9d-53e2-4cc4-a7f5-4a5ec63239e1 req-59bf414c-47fe-4eea-bf97-9fa922e7345e tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=69540ec1-495f-4d3b-bfb5-4c2625bd5e6d HTTP/1.1" status: 200 len: 944 time: 0.0477324 Nov 09 05:09:45.131592 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e2e39d9d-53e2-4cc4-a7f5-4a5ec63239e1 req-ea13b3d1-e5e2-40a4-9e64-2d350562bef1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=3285a6ac-908a-45d4-a6e2-2d8556bc393d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0418110 Nov 09 05:09:45.234414 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:46.117573 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 39af26ee-c67f-450c-9f93-ef05912ede92 up at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:09:46.240186 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning for port 39af26ee-c67f-450c-9f93-ef05912ede92 completed by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 09 05:09:46.244093 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning complete for port 39af26ee-c67f-450c-9f93-ef05912ede92 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:09:46.244493 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:46.244775 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e40d8c8-1f2d-4d5b-9611-5f74c9ff35ab req-d2e32fa5-72e1-4c5d-bf16-ca7133c0251c tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:09:46.246249 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-7e40d8c8-1f2d-4d5b-9611-5f74c9ff35ab req-d2e32fa5-72e1-4c5d-bf16-ca7133c0251c tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=69540ec1-495f-4d3b-bfb5-4c2625bd5e6d HTTP/1.1" status: 200 len: 944 time: 0.0484762 Nov 09 05:09:46.296236 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-7e40d8c8-1f2d-4d5b-9611-5f74c9ff35ab req-5461e9d5-c0ae-4198-827d-13128bc3a60a tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=3285a6ac-908a-45d4-a6e2-2d8556bc393d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0437260 Nov 09 05:09:46.327125 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:46.349477 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '69540ec1-495f-4d3b-bfb5-4c2625bd5e6d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '39af26ee-c67f-450c-9f93-ef05912ede92'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:09:46.351744 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d7adec14-f394-40c7-9e09-a9b8c2aaeb52" -d '{"events": [{"server_uuid": "69540ec1-495f-4d3b-bfb5-4c2625bd5e6d", "name": "network-vif-plugged", "status": "completed", "tag": "39af26ee-c67f-450c-9f93-ef05912ede92"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:09:46.364005 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 39af26ee-c67f-450c-9f93-ef05912ede92, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=39af26ee-c67f-450c-9f93-ef05912ede92,segment=NetworkSegment(f30d767c-82f3-406c-aba3-6198dd73349f),segment_id=f30d767c-82f3-406c-aba3-6198dd73349f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:09:46.434835 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:46.439038 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 05:09:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c7671af4-562d-449d-b4cc-796cf8eb7d92 x-openstack-request-id: req-c7671af4-562d-449d-b4cc-796cf8eb7d92 {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:09:46.439345 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "69540ec1-495f-4d3b-bfb5-4c2625bd5e6d", "name": "network-vif-plugged", "status": "completed", "tag": "39af26ee-c67f-450c-9f93-ef05912ede92", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:09:46.439595 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-c7671af4-562d-449d-b4cc-796cf8eb7d92 {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:09:46.439984 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '69540ec1-495f-4d3b-bfb5-4c2625bd5e6d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '39af26ee-c67f-450c-9f93-ef05912ede92', 'code': 200} Nov 09 05:09:46.485786 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=39af26ee-c67f-450c-9f93-ef05912ede92,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:09:46.657916 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:46.759064 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-333befdb-e5d8-4423-9dcd-a1b431235e7e req-fe4b9acc-34d4-403c-a37c-5b94e5c52beb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:09:46.760442 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-333befdb-e5d8-4423-9dcd-a1b431235e7e req-fe4b9acc-34d4-403c-a37c-5b94e5c52beb service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=69540ec1-495f-4d3b-bfb5-4c2625bd5e6d HTTP/1.1" status: 200 len: 1098 time: 0.0399191 Nov 09 05:09:46.810859 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-333befdb-e5d8-4423-9dcd-a1b431235e7e req-b34a3187-6bab-40a3-9099-05003b08d345 service neutron] 10.222.0.26 "GET /v2.0/security-groups?id=3285a6ac-908a-45d4-a6e2-2d8556bc393d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0436389 Nov 09 05:09:46.983353 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:47.408425 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27db0ca6-3df9-429f-b074-82e9197f3d9c req-9efc2fe3-4559-41a3-ad3f-f6aaf530a2bf tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:09:47.409871 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-27db0ca6-3df9-429f-b074-82e9197f3d9c req-9efc2fe3-4559-41a3-ad3f-f6aaf530a2bf tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=69540ec1-495f-4d3b-bfb5-4c2625bd5e6d HTTP/1.1" status: 200 len: 945 time: 0.0471351 Nov 09 05:09:47.462427 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-27db0ca6-3df9-429f-b074-82e9197f3d9c req-aaa8219e-5292-4b77-ba35-c1a29b1251de tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=3285a6ac-908a-45d4-a6e2-2d8556bc393d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0460720 Nov 09 05:09:48.623838 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37f2a03a-fa9d-438d-8049-de9991fb0a33 req-94c6dd4f-e2b4-4dcd-9a17-56a054f72045 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:09:48.625300 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-37f2a03a-fa9d-438d-8049-de9991fb0a33 req-94c6dd4f-e2b4-4dcd-9a17-56a054f72045 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=69540ec1-495f-4d3b-bfb5-4c2625bd5e6d HTTP/1.1" status: 200 len: 945 time: 0.0919485 Nov 09 05:09:48.674511 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-37f2a03a-fa9d-438d-8049-de9991fb0a33 req-e713a294-9a89-4459-af36-96a02b69a729 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=3285a6ac-908a-45d4-a6e2-2d8556bc393d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0432110 Nov 09 05:09:48.839471 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e491c14c-36fe-48d4-8038-0f21c950a3bc req-bfb7b8f7-674b-45a2-8810-2ec8e1790255 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:09:48.840851 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-e491c14c-36fe-48d4-8038-0f21c950a3bc req-bfb7b8f7-674b-45a2-8810-2ec8e1790255 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=69540ec1-495f-4d3b-bfb5-4c2625bd5e6d HTTP/1.1" status: 200 len: 945 time: 0.0966756 Nov 09 05:09:48.888950 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-e491c14c-36fe-48d4-8038-0f21c950a3bc req-60eb56a6-4383-43c1-8642-0bfb47a438fe tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=3285a6ac-908a-45d4-a6e2-2d8556bc393d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0422316 Nov 09 05:09:48.910321 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 37548) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:09:48.951004 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f19a2529-ddd4-4f8a-9af2-cec6612cfdde tempest-TestNetworkAdvancedServerOps-1212315804 tempest-TestNetworkAdvancedServerOps-1212315804-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:09:48.952587 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-f19a2529-ddd4-4f8a-9af2-cec6612cfdde tempest-TestNetworkAdvancedServerOps-1212315804 tempest-TestNetworkAdvancedServerOps-1212315804-project-admin] 10.222.0.24 "GET /v2.0/ports?device_id=69540ec1-495f-4d3b-bfb5-4c2625bd5e6d HTTP/1.1" status: 200 len: 1093 time: 0.0412729 Nov 09 05:09:48.955701 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 37550) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:09:48.960529 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-c909617e-a558-4ccd-87bb-495b3cc0ab7b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Request body: {'floatingip': {'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'port_id': '39af26ee-c67f-450c-9f93-ef05912ede92', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'fixed_ip_address': '172.20.0.3'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:09:49.103579 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c909617e-a558-4ccd-87bb-495b3cc0ab7b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for floatingip, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:49.207935 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c909617e-a558-4ccd-87bb-495b3cc0ab7b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:49.307330 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-c909617e-a558-4ccd-87bb-495b3cc0ab7b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Allocated IP 172.26.0.110 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/30efc217-5383-4476-a096-781420e70b01) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 05:09:49.408756 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c909617e-a558-4ccd-87bb-495b3cc0ab7b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:49.492825 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c909617e-a558-4ccd-87bb-495b3cc0ab7b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:49.531092 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c909617e-a558-4ccd-87bb-495b3cc0ab7b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:09:49.536416 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-c909617e-a558-4ccd-87bb-495b3cc0ab7b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:09:49.539966 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c909617e-a558-4ccd-87bb-495b3cc0ab7b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 05:09:49.561653 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c909617e-a558-4ccd-87bb-495b3cc0ab7b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'Port': ['ID=30efc217-5383-4476-a096-781420e70b01,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:09:49.891339 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c909617e-a558-4ccd-87bb-495b3cc0ab7b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:50.024195 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c909617e-a558-4ccd-87bb-495b3cc0ab7b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:50.168224 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c909617e-a558-4ccd-87bb-495b3cc0ab7b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:50.240517 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c909617e-a558-4ccd-87bb-495b3cc0ab7b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:50.307051 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c909617e-a558-4ccd-87bb-495b3cc0ab7b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event updated for resources: {'Port': ['ID=30efc217-5383-4476-a096-781420e70b01,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:09:50.320143 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c909617e-a558-4ccd-87bb-495b3cc0ab7b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:50.417272 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.l3_db [None req-c909617e-a558-4ccd-87bb-495b3cc0ab7b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Floating IP babf092b-21f6-4ab0-9c91-a0d51ed9580b associated. External IP: 172.26.0.110, port: 39af26ee-c67f-450c-9f93-ef05912ede92. Nov 09 05:09:50.612607 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c909617e-a558-4ccd-87bb-495b3cc0ab7b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Router 4cde88b0-a962-472e-95ed-f34b609516f7 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 05:09:50.716524 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c909617e-a558-4ccd-87bb-495b3cc0ab7b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 05:09:50.726521 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4e92621f-f612-45bf-901c-ff60d171c652 None None] Sync routers for ids ['4cde88b0-a962-472e-95ed-f34b609516f7'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 05:09:50.735244 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4e92621f-f612-45bf-901c-ff60d171c652 None None] Routers {'4cde88b0-a962-472e-95ed-f34b609516f7'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:09:50.735847 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-4e92621f-f612-45bf-901c-ff60d171c652 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:09:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['4cde88b0-a962-472e-95ed-f34b609516f7'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:09:50.791552 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c909617e-a558-4ccd-87bb-495b3cc0ab7b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:09:50.818399 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-c909617e-a558-4ccd-87bb-495b3cc0ab7b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.8614328 Nov 09 05:09:50.818951 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '69540ec1-495f-4d3b-bfb5-4c2625bd5e6d', 'tag': '39af26ee-c67f-450c-9f93-ef05912ede92'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:09:50.821310 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-caa7bd53-d68a-4cb4-9c22-69103c1587fa" -d '{"events": [{"name": "network-changed", "server_uuid": "69540ec1-495f-4d3b-bfb5-4c2625bd5e6d", "tag": "39af26ee-c67f-450c-9f93-ef05912ede92"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:09:50.866666 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 05:09:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7739243a-fe78-48e9-adbd-db0021510fea x-openstack-request-id: req-7739243a-fe78-48e9-adbd-db0021510fea {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:09:50.873276 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "69540ec1-495f-4d3b-bfb5-4c2625bd5e6d", "tag": "39af26ee-c67f-450c-9f93-ef05912ede92", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:09:50.873276 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-7739243a-fe78-48e9-adbd-db0021510fea {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:09:50.873276 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '69540ec1-495f-4d3b-bfb5-4c2625bd5e6d', 'tag': '39af26ee-c67f-450c-9f93-ef05912ede92', 'status': 'completed', 'code': 200} Nov 09 05:09:50.962410 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c8042af-40e7-4fec-b718-196f67da70d4 req-99ab36f4-e901-49d4-8805-5e9e5381cbf7 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:09:50.963984 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8c8042af-40e7-4fec-b718-196f67da70d4 req-99ab36f4-e901-49d4-8805-5e9e5381cbf7 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=69540ec1-495f-4d3b-bfb5-4c2625bd5e6d HTTP/1.1" status: 200 len: 945 time: 0.0840485 Nov 09 05:09:50.966951 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-caa7bd53-d68a-4cb4-9c22-69103c1587fa req-7d39341d-f402-472f-b02f-678fc6c27b36 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:09:50.968333 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-caa7bd53-d68a-4cb4-9c22-69103c1587fa req-7d39341d-f402-472f-b02f-678fc6c27b36 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=8ac3eab68bd34485af7ddc3417853b28&device_id=69540ec1-495f-4d3b-bfb5-4c2625bd5e6d HTTP/1.1" status: 200 len: 1098 time: 0.0756135 Nov 09 05:09:50.991853 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-4e92621f-f612-45bf-901c-ff60d171c652 None None] Set router 4cde88b0-a962-472e-95ed-f34b609516f7 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:09:51.070019 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8c8042af-40e7-4fec-b718-196f67da70d4 req-24ba683c-5d92-4983-81ee-7d1c6ae1c760 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=3285a6ac-908a-45d4-a6e2-2d8556bc393d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0995417 Nov 09 05:09:51.093064 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 37556) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:09:51.093621 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-caa7bd53-d68a-4cb4-9c22-69103c1587fa req-35488c4f-473b-4815-9ae2-de5a75fef546 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:09:51.095009 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-caa7bd53-d68a-4cb4-9c22-69103c1587fa req-35488c4f-473b-4815-9ae2-de5a75fef546 service neutron] 10.222.0.26 "GET /v2.0/networks?id=164fa49b-4b69-42f2-b13f-78b6ab225c74 HTTP/1.1" status: 200 len: 898 time: 0.1177816 Nov 09 05:09:51.158206 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-839a39e3-24b5-47ba-8edb-9ecb4fcaca9c tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/floatingips/babf092b-21f6-4ab0-9c91-a0d51ed9580b HTTP/1.1" status: 200 len: 991 time: 0.0631123 Nov 09 05:09:51.163906 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-caa7bd53-d68a-4cb4-9c22-69103c1587fa req-58e4dc51-8635-43d5-926d-eb7c4058dc7d service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=39af26ee-c67f-450c-9f93-ef05912ede92 HTTP/1.1" status: 200 len: 999 time: 0.0606833 Nov 09 05:09:51.213531 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-caa7bd53-d68a-4cb4-9c22-69103c1587fa req-33e44028-7bd0-4aeb-bf3b-55501ab61a68 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:09:51.215029 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-caa7bd53-d68a-4cb4-9c22-69103c1587fa req-33e44028-7bd0-4aeb-bf3b-55501ab61a68 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=b7570448-8728-4002-9b90-aa1aa4f10e83 HTTP/1.1" status: 200 len: 834 time: 0.0441492 Nov 09 05:09:51.226134 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-4e92621f-f612-45bf-901c-ff60d171c652 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4cde88b0-a962-472e-95ed-f34b609516f7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-310918215', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.122'}], 'enable_snat': True}, 'gw_port_id': 'ded5c8d9-110f-4e05-88a7-b8546e75095e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:09:30Z', 'updated_at': '2021-11-09T05:09:35Z', 'revision_number': 4, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': 'ded5c8d9-110f-4e05-88a7-b8546e75095e', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:56:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4cde88b0-a962-472e-95ed-f34b609516f7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1786, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:09:31Z', 'updated_at': '2021-11-09T05:09:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': 'babf092b-21f6-4ab0-9c91-a0d51ed9580b', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'floating_ip_address': '172.26.0.110', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '4cde88b0-a962-472e-95ed-f34b609516f7', 'port_id': '39af26ee-c67f-450c-9f93-ef05912ede92', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 1792, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '164fa49b-4b69-42f2-b13f-78b6ab225c74', 'mac_address': 'fa:16:3e:22:a4:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '69540ec1-495f-4d3b-bfb5-4c2625bd5e6d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T05:09:49Z', 'updated_at': '2021-11-09T05:09:49Z', 'revision_number': 0, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a9a63c2c-d477-4631-8ad4-e24faaa2358a', 'name': '', 'network_id': '164fa49b-4b69-42f2-b13f-78b6ab225c74', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'mac_address': 'fa:16:3e:ff:23:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4cde88b0-a962-472e-95ed-f34b609516f7', 'device_owner': 'network:router_interface', 'standard_attr_id': 1789, 'fixed_ips': [{'subnet_id': 'b7570448-8728-4002-9b90-aa1aa4f10e83', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:09:34Z', 'updated_at': '2021-11-09T05:09:38Z', 'revision_number': 5, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'subnets': [{'id': 'b7570448-8728-4002-9b90-aa1aa4f10e83', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:09:51.258987 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4e92621f-f612-45bf-901c-ff60d171c652 None None] Checking router: 4cde88b0-a962-472e-95ed-f34b609516f7 for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 05:09:51.264863 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-caa7bd53-d68a-4cb4-9c22-69103c1587fa req-1674e07f-e440-4ce6-ac4f-f0bf7fa7f93b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:09:51.266384 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-caa7bd53-d68a-4cb4-9c22-69103c1587fa req-1674e07f-e440-4ce6-ac4f-f0bf7fa7f93b service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=164fa49b-4b69-42f2-b13f-78b6ab225c74&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0447183 Nov 09 05:09:51.267322 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4e92621f-f612-45bf-901c-ff60d171c652 None None] Routers {'4cde88b0-a962-472e-95ed-f34b609516f7'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:09:51.267918 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-4e92621f-f612-45bf-901c-ff60d171c652 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:09:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['4cde88b0-a962-472e-95ed-f34b609516f7'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:09:51.354030 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-caa7bd53-d68a-4cb4-9c22-69103c1587fa req-547cd52e-5588-4427-bb2e-22bee935880f service neutron] 10.222.0.26 "GET /v2.0/networks/164fa49b-4b69-42f2-b13f-78b6ab225c74?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0802202 Nov 09 05:09:51.372214 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-4e92621f-f612-45bf-901c-ff60d171c652 None None] Set router 4cde88b0-a962-472e-95ed-f34b609516f7 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:09:51.446383 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-caa7bd53-d68a-4cb4-9c22-69103c1587fa req-588e7afe-a15f-4aaf-bdc5-49847ad497fa service neutron] 10.222.0.26 "GET /v2.0/networks/164fa49b-4b69-42f2-b13f-78b6ab225c74?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0857599 Nov 09 05:09:51.593573 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-4e92621f-f612-45bf-901c-ff60d171c652 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4cde88b0-a962-472e-95ed-f34b609516f7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-310918215', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.122'}], 'enable_snat': True}, 'gw_port_id': 'ded5c8d9-110f-4e05-88a7-b8546e75095e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:09:30Z', 'updated_at': '2021-11-09T05:09:35Z', 'revision_number': 4, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': 'ded5c8d9-110f-4e05-88a7-b8546e75095e', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:56:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4cde88b0-a962-472e-95ed-f34b609516f7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1786, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:09:31Z', 'updated_at': '2021-11-09T05:09:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': 'babf092b-21f6-4ab0-9c91-a0d51ed9580b', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'floating_ip_address': '172.26.0.110', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '4cde88b0-a962-472e-95ed-f34b609516f7', 'port_id': '39af26ee-c67f-450c-9f93-ef05912ede92', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 1792, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '164fa49b-4b69-42f2-b13f-78b6ab225c74', 'mac_address': 'fa:16:3e:22:a4:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '69540ec1-495f-4d3b-bfb5-4c2625bd5e6d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T05:09:49Z', 'updated_at': '2021-11-09T05:09:49Z', 'revision_number': 0, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a9a63c2c-d477-4631-8ad4-e24faaa2358a', 'name': '', 'network_id': '164fa49b-4b69-42f2-b13f-78b6ab225c74', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'mac_address': 'fa:16:3e:ff:23:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4cde88b0-a962-472e-95ed-f34b609516f7', 'device_owner': 'network:router_interface', 'standard_attr_id': 1789, 'fixed_ips': [{'subnet_id': 'b7570448-8728-4002-9b90-aa1aa4f10e83', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:09:34Z', 'updated_at': '2021-11-09T05:09:38Z', 'revision_number': 5, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'subnets': [{'id': 'b7570448-8728-4002-9b90-aa1aa4f10e83', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:09:51.620179 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4e92621f-f612-45bf-901c-ff60d171c652 None None] The sync data for ids ['4cde88b0-a962-472e-95ed-f34b609516f7'] in dv-neutron-816802-2-hyperv is: [{'id': '4cde88b0-a962-472e-95ed-f34b609516f7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-310918215', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.122'}], 'enable_snat': True}, 'gw_port_id': 'ded5c8d9-110f-4e05-88a7-b8546e75095e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:09:30Z', 'updated_at': '2021-11-09T05:09:35Z', 'revision_number': 4, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': 'ded5c8d9-110f-4e05-88a7-b8546e75095e', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:56:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4cde88b0-a962-472e-95ed-f34b609516f7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1786, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:09:31Z', 'updated_at': '2021-11-09T05:09:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': 'babf092b-21f6-4ab0-9c91-a0d51ed9580b', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'floating_ip_address': '172.26.0.110', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '4cde88b0-a962-472e-95ed-f34b609516f7', 'port_id': '39af26ee-c67f-450c-9f93-ef05912ede92', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 1792, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '164fa49b-4b69-42f2-b13f-78b6ab225c74', 'mac_address': 'fa:16:3e:22:a4:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '69540ec1-495f-4d3b-bfb5-4c2625bd5e6d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T05:09:49Z', 'updated_at': '2021-11-09T05:09:49Z', 'revision_number': 0, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a9a63c2c-d477-4631-8ad4-e24faaa2358a', 'name': '', 'network_id': '164fa49b-4b69-42f2-b13f-78b6ab225c74', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'mac_address': 'fa:16:3e:ff:23:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4cde88b0-a962-472e-95ed-f34b609516f7', 'device_owner': 'network:router_interface', 'standard_attr_id': 1789, 'fixed_ips': [{'subnet_id': 'b7570448-8728-4002-9b90-aa1aa4f10e83', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:09:34Z', 'updated_at': '2021-11-09T05:09:38Z', 'revision_number': 5, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'subnets': [{'id': 'b7570448-8728-4002-9b90-aa1aa4f10e83', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 05:09:51.814729 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-14504d2f-77ed-46e8-a14d-4a207f1682a8 None None] New status for floating IP babf092b-21f6-4ab0-9c91-a0d51ed9580b: ACTIVE {{(pid=102164) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 05:09:52.161969 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 37558) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:09:52.221124 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-f00d3c21-c95b-4568-a2f1-f66416ff73cc tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/floatingips/babf092b-21f6-4ab0-9c91-a0d51ed9580b HTTP/1.1" status: 200 len: 993 time: 0.0580094 Nov 09 05:10:11.373865 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ec300bde-5cc5-4e74-a98e-bca1ae94cd92 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:12.579364 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:13.446158 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 05:10:13.733840 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-24d2d3c5-f598-4ab6-a59f-c108cbc96754 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:15.305947 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:16.608871 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:16.974091 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:23.805340 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6df09807-567d-4aa9-b676-56106729a283 req-04c42380-e90e-470c-a72a-ec4714366ab6 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:10:23.806904 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-6df09807-567d-4aa9-b676-56106729a283 req-04c42380-e90e-470c-a72a-ec4714366ab6 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=69540ec1-495f-4d3b-bfb5-4c2625bd5e6d HTTP/1.1" status: 200 len: 945 time: 0.0488231 Nov 09 05:10:23.855164 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-6df09807-567d-4aa9-b676-56106729a283 req-9d7cfade-79f4-418b-a7a2-36412ccc8444 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=3285a6ac-908a-45d4-a6e2-2d8556bc393d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0423076 Nov 09 05:10:24.972114 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96421c67-3126-45e0-8e4b-f32dd82d1a84 req-ed9d6f53-27ed-4a13-b464-d0c3f886c838 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:10:24.973599 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-96421c67-3126-45e0-8e4b-f32dd82d1a84 req-ed9d6f53-27ed-4a13-b464-d0c3f886c838 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=69540ec1-495f-4d3b-bfb5-4c2625bd5e6d HTTP/1.1" status: 200 len: 945 time: 0.0486815 Nov 09 05:10:25.022118 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-96421c67-3126-45e0-8e4b-f32dd82d1a84 req-0c3ac7ed-c6d8-4e1a-b5ff-2d5efe1814d2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=3285a6ac-908a-45d4-a6e2-2d8556bc393d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0423765 Nov 09 05:10:25.043391 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 37580) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:10:25.105207 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-f4383072-df72-406e-a993-dd8d22062efc tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/floatingips/babf092b-21f6-4ab0-9c91-a0d51ed9580b HTTP/1.1" status: 200 len: 993 time: 0.0607505 Nov 09 05:10:26.516807 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1a84284-7808-4e8a-a911-2b891b020974 req-4d33fd52-796f-4f52-8c98-e7680b40c832 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:10:26.518283 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b1a84284-7808-4e8a-a911-2b891b020974 req-4d33fd52-796f-4f52-8c98-e7680b40c832 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=69540ec1-495f-4d3b-bfb5-4c2625bd5e6d HTTP/1.1" status: 200 len: 945 time: 0.0484054 Nov 09 05:10:26.567580 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b1a84284-7808-4e8a-a911-2b891b020974 req-c6340579-01ae-411a-accb-cc198c3bf2d0 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=3285a6ac-908a-45d4-a6e2-2d8556bc393d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0426643 Nov 09 05:10:26.584347 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2d96edf-73bc-471a-bbca-09672cdbe255 req-846b2037-d11a-4fe0-a4ce-2527876ade5a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:10:26.585827 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f2d96edf-73bc-471a-bbca-09672cdbe255 req-846b2037-d11a-4fe0-a4ce-2527876ade5a service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=8ac3eab68bd34485af7ddc3417853b28&device_id=69540ec1-495f-4d3b-bfb5-4c2625bd5e6d HTTP/1.1" status: 200 len: 1098 time: 0.0403543 Nov 09 05:10:26.678912 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2d96edf-73bc-471a-bbca-09672cdbe255 req-66fad42e-ad71-43e9-a47f-d7c23e218d2e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:10:26.680352 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f2d96edf-73bc-471a-bbca-09672cdbe255 req-66fad42e-ad71-43e9-a47f-d7c23e218d2e service neutron] 10.222.0.26 "GET /v2.0/networks?id=164fa49b-4b69-42f2-b13f-78b6ab225c74 HTTP/1.1" status: 200 len: 898 time: 0.0858769 Nov 09 05:10:26.743961 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f2d96edf-73bc-471a-bbca-09672cdbe255 req-e574af59-c958-4713-b1ba-8f1346b6e263 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=39af26ee-c67f-450c-9f93-ef05912ede92 HTTP/1.1" status: 200 len: 1001 time: 0.0562463 Nov 09 05:10:26.791204 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2d96edf-73bc-471a-bbca-09672cdbe255 req-3449e6f3-3473-47ba-8c3d-46a08e424e31 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:10:26.792498 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f2d96edf-73bc-471a-bbca-09672cdbe255 req-3449e6f3-3473-47ba-8c3d-46a08e424e31 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=b7570448-8728-4002-9b90-aa1aa4f10e83 HTTP/1.1" status: 200 len: 834 time: 0.0415287 Nov 09 05:10:26.840205 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2d96edf-73bc-471a-bbca-09672cdbe255 req-be59a9e1-5b50-4b9a-ba27-609b758b08df service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:10:26.841704 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f2d96edf-73bc-471a-bbca-09672cdbe255 req-be59a9e1-5b50-4b9a-ba27-609b758b08df service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=164fa49b-4b69-42f2-b13f-78b6ab225c74&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0423644 Nov 09 05:10:26.930818 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f2d96edf-73bc-471a-bbca-09672cdbe255 req-a01f45e2-6f43-4b56-bb87-55f6f687efdb service neutron] 10.222.0.26 "GET /v2.0/networks/164fa49b-4b69-42f2-b13f-78b6ab225c74?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0817909 Nov 09 05:10:27.021742 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f2d96edf-73bc-471a-bbca-09672cdbe255 req-2ffa48c8-86c3-491d-835d-e90dfefc497c service neutron] 10.222.0.26 "GET /v2.0/networks/164fa49b-4b69-42f2-b13f-78b6ab225c74?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0843999 Nov 09 05:10:27.685530 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe798d8d-aa72-44e3-b97f-b3d6d8487c7d req-aac5bbf5-d830-45a4-b2b4-3636f9ec5f31 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:10:27.687047 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fe798d8d-aa72-44e3-b97f-b3d6d8487c7d req-aac5bbf5-d830-45a4-b2b4-3636f9ec5f31 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=69540ec1-495f-4d3b-bfb5-4c2625bd5e6d HTTP/1.1" status: 200 len: 945 time: 0.0495181 Nov 09 05:10:27.736258 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fe798d8d-aa72-44e3-b97f-b3d6d8487c7d req-73015ae9-8b3c-42f5-81e7-9838cedac9bc tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=3285a6ac-908a-45d4-a6e2-2d8556bc393d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0426176 Nov 09 05:10:28.313866 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a343af03-b66b-4490-a711-31335fba19ec req-cc0c6d67-582b-4d29-8a8f-4fec138e5b9d service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=69540ec1-495f-4d3b-bfb5-4c2625bd5e6d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0391927 Nov 09 05:10:28.403633 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a343af03-b66b-4490-a711-31335fba19ec req-ee31ee61-0145-4a07-ac68-6c1d135aad6e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:10:28.405124 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a343af03-b66b-4490-a711-31335fba19ec req-ee31ee61-0145-4a07-ac68-6c1d135aad6e service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=8ac3eab68bd34485af7ddc3417853b28&device_id=69540ec1-495f-4d3b-bfb5-4c2625bd5e6d HTTP/1.1" status: 200 len: 1098 time: 0.0429871 Nov 09 05:10:28.505366 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a343af03-b66b-4490-a711-31335fba19ec req-42f825a9-1504-4673-85c0-05ca119d6db9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:10:28.506846 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a343af03-b66b-4490-a711-31335fba19ec req-42f825a9-1504-4673-85c0-05ca119d6db9 service neutron] 10.222.0.26 "GET /v2.0/networks?id=164fa49b-4b69-42f2-b13f-78b6ab225c74 HTTP/1.1" status: 200 len: 898 time: 0.0826921 Nov 09 05:10:28.575192 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a343af03-b66b-4490-a711-31335fba19ec req-195cd4e4-00a3-417f-8920-247fc1c0ea23 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=39af26ee-c67f-450c-9f93-ef05912ede92 HTTP/1.1" status: 200 len: 1001 time: 0.0604918 Nov 09 05:10:28.625579 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a343af03-b66b-4490-a711-31335fba19ec req-d2749e27-bc1d-4bc9-a3bd-f805d309c554 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:10:28.627165 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a343af03-b66b-4490-a711-31335fba19ec req-d2749e27-bc1d-4bc9-a3bd-f805d309c554 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=b7570448-8728-4002-9b90-aa1aa4f10e83 HTTP/1.1" status: 200 len: 834 time: 0.0455401 Nov 09 05:10:28.671557 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a343af03-b66b-4490-a711-31335fba19ec req-c37c5cb5-7314-4620-826d-58534fe5e2f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:10:28.673062 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a343af03-b66b-4490-a711-31335fba19ec req-c37c5cb5-7314-4620-826d-58534fe5e2f3 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=164fa49b-4b69-42f2-b13f-78b6ab225c74&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0385115 Nov 09 05:10:28.860677 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c097f30-17f9-4cd7-b239-cbe62f425163 req-bf25a970-3318-4e92-892c-87fc6ce66bf2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:10:28.862194 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-2c097f30-17f9-4cd7-b239-cbe62f425163 req-bf25a970-3318-4e92-892c-87fc6ce66bf2 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=69540ec1-495f-4d3b-bfb5-4c2625bd5e6d HTTP/1.1" status: 200 len: 945 time: 0.0561233 Nov 09 05:10:28.914835 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-2c097f30-17f9-4cd7-b239-cbe62f425163 req-8aaa3d40-2c66-4aa8-a7a6-8beacc4775e5 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=3285a6ac-908a-45d4-a6e2-2d8556bc393d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0465035 Nov 09 05:10:28.938753 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 37596) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:10:29.010690 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-36bb1fd1-f032-4542-ad56-528f9ef97f97 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/floatingips/babf092b-21f6-4ab0-9c91-a0d51ed9580b HTTP/1.1" status: 200 len: 993 time: 0.0660546 Nov 09 05:10:29.068957 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a343af03-b66b-4490-a711-31335fba19ec req-3debcae9-eb64-4eea-b8d5-c8a33d283305 service neutron] 10.222.0.26 "GET /v2.0/networks/164fa49b-4b69-42f2-b13f-78b6ab225c74?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3884282 Nov 09 05:10:29.161066 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a343af03-b66b-4490-a711-31335fba19ec req-536de434-5b53-43fe-b95b-7d2181016f22 service neutron] 10.222.0.26 "GET /v2.0/networks/164fa49b-4b69-42f2-b13f-78b6ab225c74?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0824172 Nov 09 05:10:29.240026 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 37602) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:10:29.395626 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-e4a74ef3-de7d-4ff2-b344-bc2568c7bf72 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Deleting port 30efc217-5383-4476-a096-781420e70b01 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:10:29.395957 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e4a74ef3-de7d-4ff2-b344-bc2568c7bf72 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:29.470603 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e4a74ef3-de7d-4ff2-b344-bc2568c7bf72 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:29.470812 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e4a74ef3-de7d-4ff2-b344-bc2568c7bf72 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:29.482810 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-e4a74ef3-de7d-4ff2-b344-bc2568c7bf72 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Calling delete_port for 30efc217-5383-4476-a096-781420e70b01 owned by network:floatingip {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:10:29.700271 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e4a74ef3-de7d-4ff2-b344-bc2568c7bf72 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:29.727190 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4a74ef3-de7d-4ff2-b344-bc2568c7bf72 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event deleted for resources: {'Port': ['ID=30efc217-5383-4476-a096-781420e70b01,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:10:29.750047 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4a74ef3-de7d-4ff2-b344-bc2568c7bf72 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:10:29.750456 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4a74ef3-de7d-4ff2-b344-bc2568c7bf72 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:10:29.750808 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4a74ef3-de7d-4ff2-b344-bc2568c7bf72 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:10:29.751146 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4a74ef3-de7d-4ff2-b344-bc2568c7bf72 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:10:29.751483 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4a74ef3-de7d-4ff2-b344-bc2568c7bf72 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:10:29.751814 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4a74ef3-de7d-4ff2-b344-bc2568c7bf72 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:10:29.752149 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4a74ef3-de7d-4ff2-b344-bc2568c7bf72 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:10:29.752504 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4a74ef3-de7d-4ff2-b344-bc2568c7bf72 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:10:29.752833 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4a74ef3-de7d-4ff2-b344-bc2568c7bf72 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:10:29.753159 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4a74ef3-de7d-4ff2-b344-bc2568c7bf72 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:10:29.753487 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4a74ef3-de7d-4ff2-b344-bc2568c7bf72 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:10:29.753809 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4a74ef3-de7d-4ff2-b344-bc2568c7bf72 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:10:29.796179 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e4a74ef3-de7d-4ff2-b344-bc2568c7bf72 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for floatingip, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:29.796539 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.l3_db [None req-e4a74ef3-de7d-4ff2-b344-bc2568c7bf72 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Floating IP babf092b-21f6-4ab0-9c91-a0d51ed9580b disassociated (deleted). External IP: 172.26.0.110, port: 39af26ee-c67f-450c-9f93-ef05912ede92. Nov 09 05:10:30.001378 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e4a74ef3-de7d-4ff2-b344-bc2568c7bf72 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Router 4cde88b0-a962-472e-95ed-f34b609516f7 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 05:10:30.110697 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e4a74ef3-de7d-4ff2-b344-bc2568c7bf72 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 05:10:30.115755 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e4a74ef3-de7d-4ff2-b344-bc2568c7bf72 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:30.120118 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3f55ff0e-3ab8-4aee-b253-88f811a96108 None None] Sync routers for ids ['4cde88b0-a962-472e-95ed-f34b609516f7'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 05:10:30.128854 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3f55ff0e-3ab8-4aee-b253-88f811a96108 None None] Routers {'4cde88b0-a962-472e-95ed-f34b609516f7'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:10:30.129967 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-3f55ff0e-3ab8-4aee-b253-88f811a96108 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:10:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['4cde88b0-a962-472e-95ed-f34b609516f7'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:10:30.142493 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-e4a74ef3-de7d-4ff2-b344-bc2568c7bf72 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "DELETE /v2.0/floatingips/babf092b-21f6-4ab0-9c91-a0d51ed9580b HTTP/1.1" status: 204 len: 168 time: 0.9013736 Nov 09 05:10:30.143187 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '69540ec1-495f-4d3b-bfb5-4c2625bd5e6d', 'tag': '39af26ee-c67f-450c-9f93-ef05912ede92'}] {{(pid=102161) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:10:30.146117 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}99dfdda0def497b4372884ef2eb87f06b1e425c8eba5ceda5f64bbab037a07d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d90b41ec-0345-411e-8141-2590ecebbbbf" -d '{"events": [{"name": "network-changed", "server_uuid": "69540ec1-495f-4d3b-bfb5-4c2625bd5e6d", "tag": "39af26ee-c67f-450c-9f93-ef05912ede92"}]}' {{(pid=102161) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:10:30.189998 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 05:10:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d5b290e9-b8f2-40cf-a6de-be85d2e1dedd x-openstack-request-id: req-d5b290e9-b8f2-40cf-a6de-be85d2e1dedd {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:10:30.190333 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "69540ec1-495f-4d3b-bfb5-4c2625bd5e6d", "tag": "39af26ee-c67f-450c-9f93-ef05912ede92", "status": "completed", "code": 200}]} {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:10:30.190805 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-d5b290e9-b8f2-40cf-a6de-be85d2e1dedd {{(pid=102161) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:10:30.191301 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '69540ec1-495f-4d3b-bfb5-4c2625bd5e6d', 'tag': '39af26ee-c67f-450c-9f93-ef05912ede92', 'status': 'completed', 'code': 200} Nov 09 05:10:30.236222 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-3f55ff0e-3ab8-4aee-b253-88f811a96108 None None] Set router 4cde88b0-a962-472e-95ed-f34b609516f7 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:10:30.253855 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d90b41ec-0345-411e-8141-2590ecebbbbf req-40d8936f-628d-45b4-8a0b-9083ebc30990 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:10:30.255860 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d90b41ec-0345-411e-8141-2590ecebbbbf req-40d8936f-628d-45b4-8a0b-9083ebc30990 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=8ac3eab68bd34485af7ddc3417853b28&device_id=69540ec1-495f-4d3b-bfb5-4c2625bd5e6d HTTP/1.1" status: 200 len: 1098 time: 0.0423157 Nov 09 05:10:30.352855 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d90b41ec-0345-411e-8141-2590ecebbbbf req-1bd17857-f78d-4342-8d86-a7f4f23ca8e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:10:30.354986 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d90b41ec-0345-411e-8141-2590ecebbbbf req-1bd17857-f78d-4342-8d86-a7f4f23ca8e8 service neutron] 10.222.0.26 "GET /v2.0/networks?id=164fa49b-4b69-42f2-b13f-78b6ab225c74 HTTP/1.1" status: 200 len: 898 time: 0.0914097 Nov 09 05:10:30.400780 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d90b41ec-0345-411e-8141-2590ecebbbbf req-3c07515a-49d3-4d55-b88f-cf0e9e934b2c service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=39af26ee-c67f-450c-9f93-ef05912ede92 HTTP/1.1" status: 200 len: 217 time: 0.0387607 Nov 09 05:10:30.440913 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-3f55ff0e-3ab8-4aee-b253-88f811a96108 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4cde88b0-a962-472e-95ed-f34b609516f7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-310918215', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.122'}], 'enable_snat': True}, 'gw_port_id': 'ded5c8d9-110f-4e05-88a7-b8546e75095e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:09:30Z', 'updated_at': '2021-11-09T05:09:35Z', 'revision_number': 4, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': 'ded5c8d9-110f-4e05-88a7-b8546e75095e', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:56:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4cde88b0-a962-472e-95ed-f34b609516f7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1786, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:09:31Z', 'updated_at': '2021-11-09T05:09:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'a9a63c2c-d477-4631-8ad4-e24faaa2358a', 'name': '', 'network_id': '164fa49b-4b69-42f2-b13f-78b6ab225c74', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'mac_address': 'fa:16:3e:ff:23:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4cde88b0-a962-472e-95ed-f34b609516f7', 'device_owner': 'network:router_interface', 'standard_attr_id': 1789, 'fixed_ips': [{'subnet_id': 'b7570448-8728-4002-9b90-aa1aa4f10e83', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:09:34Z', 'updated_at': '2021-11-09T05:09:38Z', 'revision_number': 5, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'subnets': [{'id': 'b7570448-8728-4002-9b90-aa1aa4f10e83', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:10:30.454150 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d90b41ec-0345-411e-8141-2590ecebbbbf req-67f94bf6-ce02-4dc7-ab9f-e8d2ffb874b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:10:30.458467 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d90b41ec-0345-411e-8141-2590ecebbbbf req-67f94bf6-ce02-4dc7-ab9f-e8d2ffb874b2 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=b7570448-8728-4002-9b90-aa1aa4f10e83 HTTP/1.1" status: 200 len: 834 time: 0.0480034 Nov 09 05:10:30.467771 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3f55ff0e-3ab8-4aee-b253-88f811a96108 None None] Checking router: 4cde88b0-a962-472e-95ed-f34b609516f7 for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 05:10:30.476234 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3f55ff0e-3ab8-4aee-b253-88f811a96108 None None] Routers {'4cde88b0-a962-472e-95ed-f34b609516f7'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:10:30.476836 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-3f55ff0e-3ab8-4aee-b253-88f811a96108 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:10:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['4cde88b0-a962-472e-95ed-f34b609516f7'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:10:30.506493 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d90b41ec-0345-411e-8141-2590ecebbbbf req-65041977-8b87-4341-a64a-f75f82ac3faa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:10:30.508788 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d90b41ec-0345-411e-8141-2590ecebbbbf req-65041977-8b87-4341-a64a-f75f82ac3faa service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=164fa49b-4b69-42f2-b13f-78b6ab225c74&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0451283 Nov 09 05:10:30.586208 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-3f55ff0e-3ab8-4aee-b253-88f811a96108 None None] Set router 4cde88b0-a962-472e-95ed-f34b609516f7 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:10:30.645464 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-569a4feb-ba5f-41e2-90b1-4fccddf9be80 req-c20b0037-b234-452b-b763-3917feeeabf1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:10:30.646946 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-569a4feb-ba5f-41e2-90b1-4fccddf9be80 req-c20b0037-b234-452b-b763-3917feeeabf1 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=69540ec1-495f-4d3b-bfb5-4c2625bd5e6d HTTP/1.1" status: 200 len: 945 time: 0.1045313 Nov 09 05:10:30.650538 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d90b41ec-0345-411e-8141-2590ecebbbbf req-98bf5d2d-d8b0-4350-87ac-e4c20fec737a service neutron] 10.222.0.26 "GET /v2.0/networks/164fa49b-4b69-42f2-b13f-78b6ab225c74?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1261618 Nov 09 05:10:30.751312 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-569a4feb-ba5f-41e2-90b1-4fccddf9be80 req-aa715789-2818-446e-be86-6acdbfe813e6 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=3285a6ac-908a-45d4-a6e2-2d8556bc393d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0982416 Nov 09 05:10:30.777451 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d90b41ec-0345-411e-8141-2590ecebbbbf req-7b1ecbd8-e807-4040-9b92-421c863fc029 service neutron] 10.222.0.26 "GET /v2.0/networks/164fa49b-4b69-42f2-b13f-78b6ab225c74?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1175890 Nov 09 05:10:30.780376 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-3f55ff0e-3ab8-4aee-b253-88f811a96108 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4cde88b0-a962-472e-95ed-f34b609516f7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-310918215', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.122'}], 'enable_snat': True}, 'gw_port_id': 'ded5c8d9-110f-4e05-88a7-b8546e75095e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:09:30Z', 'updated_at': '2021-11-09T05:09:35Z', 'revision_number': 4, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': 'ded5c8d9-110f-4e05-88a7-b8546e75095e', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:56:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4cde88b0-a962-472e-95ed-f34b609516f7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1786, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:09:31Z', 'updated_at': '2021-11-09T05:09:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'a9a63c2c-d477-4631-8ad4-e24faaa2358a', 'name': '', 'network_id': '164fa49b-4b69-42f2-b13f-78b6ab225c74', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'mac_address': 'fa:16:3e:ff:23:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4cde88b0-a962-472e-95ed-f34b609516f7', 'device_owner': 'network:router_interface', 'standard_attr_id': 1789, 'fixed_ips': [{'subnet_id': 'b7570448-8728-4002-9b90-aa1aa4f10e83', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:09:34Z', 'updated_at': '2021-11-09T05:09:38Z', 'revision_number': 5, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'subnets': [{'id': 'b7570448-8728-4002-9b90-aa1aa4f10e83', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:10:30.810613 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3f55ff0e-3ab8-4aee-b253-88f811a96108 None None] The sync data for ids ['4cde88b0-a962-472e-95ed-f34b609516f7'] in dv-neutron-816802-2-hyperv is: [{'id': '4cde88b0-a962-472e-95ed-f34b609516f7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-310918215', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.122'}], 'enable_snat': True}, 'gw_port_id': 'ded5c8d9-110f-4e05-88a7-b8546e75095e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:09:30Z', 'updated_at': '2021-11-09T05:09:35Z', 'revision_number': 4, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': 'ded5c8d9-110f-4e05-88a7-b8546e75095e', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:56:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4cde88b0-a962-472e-95ed-f34b609516f7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1786, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:09:31Z', 'updated_at': '2021-11-09T05:09:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'a9a63c2c-d477-4631-8ad4-e24faaa2358a', 'name': '', 'network_id': '164fa49b-4b69-42f2-b13f-78b6ab225c74', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'mac_address': 'fa:16:3e:ff:23:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4cde88b0-a962-472e-95ed-f34b609516f7', 'device_owner': 'network:router_interface', 'standard_attr_id': 1789, 'fixed_ips': [{'subnet_id': 'b7570448-8728-4002-9b90-aa1aa4f10e83', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:09:34Z', 'updated_at': '2021-11-09T05:09:38Z', 'revision_number': 5, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'subnets': [{'id': 'b7570448-8728-4002-9b90-aa1aa4f10e83', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 05:10:31.019138 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8be996a3-ac3c-4175-8dbe-2283da003a48 None None] New status for floating IP babf092b-21f6-4ab0-9c91-a0d51ed9580b: DOWN {{(pid=102164) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 05:10:31.877688 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12ba1e5d-879c-4e95-af0f-06f180edfcd2 req-e58aa492-3cb0-4b21-ba79-412fe9e3ff7b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:10:31.879195 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-12ba1e5d-879c-4e95-af0f-06f180edfcd2 req-e58aa492-3cb0-4b21-ba79-412fe9e3ff7b tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=69540ec1-495f-4d3b-bfb5-4c2625bd5e6d HTTP/1.1" status: 200 len: 945 time: 0.0533359 Nov 09 05:10:31.931589 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-12ba1e5d-879c-4e95-af0f-06f180edfcd2 req-cce5fe76-6afa-4c6e-92ce-36f9c25a1e01 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/security-groups?id=3285a6ac-908a-45d4-a6e2-2d8556bc393d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0449457 Nov 09 05:10:32.122226 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aacac9af-e1d3-4978-a3b9-cdfd6241f8da req-61eca2ef-3e52-407d-936f-f8472f35f0dd tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:10:32.123582 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-aacac9af-e1d3-4978-a3b9-cdfd6241f8da req-61eca2ef-3e52-407d-936f-f8472f35f0dd tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.26 "GET /v2.0/ports?device_id=69540ec1-495f-4d3b-bfb5-4c2625bd5e6d HTTP/1.1" status: 200 len: 945 time: 0.0478182 Nov 09 05:10:32.208906 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-aacac9af-e1d3-4978-a3b9-cdfd6241f8da req-32e4a7c2-0dbc-4514-8508-7fc55e1ab3af tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Deleting port 39af26ee-c67f-450c-9f93-ef05912ede92 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:10:32.209235 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-aacac9af-e1d3-4978-a3b9-cdfd6241f8da req-32e4a7c2-0dbc-4514-8508-7fc55e1ab3af tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:32.298976 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-aacac9af-e1d3-4978-a3b9-cdfd6241f8da req-32e4a7c2-0dbc-4514-8508-7fc55e1ab3af tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] For port 39af26ee-c67f-450c-9f93-ef05912ede92, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=39af26ee-c67f-450c-9f93-ef05912ede92,segment=NetworkSegment(f30d767c-82f3-406c-aba3-6198dd73349f),segment_id=f30d767c-82f3-406c-aba3-6198dd73349f)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:10:32.299328 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-aacac9af-e1d3-4978-a3b9-cdfd6241f8da req-32e4a7c2-0dbc-4514-8508-7fc55e1ab3af tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:32.311829 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-aacac9af-e1d3-4978-a3b9-cdfd6241f8da req-32e4a7c2-0dbc-4514-8508-7fc55e1ab3af tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Calling delete_port for 39af26ee-c67f-450c-9f93-ef05912ede92 owned by compute:nova {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:10:32.484007 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-aacac9af-e1d3-4978-a3b9-cdfd6241f8da req-32e4a7c2-0dbc-4514-8508-7fc55e1ab3af tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:32.511079 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32e4a7c2-0dbc-4514-8508-7fc55e1ab3af tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event deleted for resources: {'Port': ['ID=39af26ee-c67f-450c-9f93-ef05912ede92,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:10:32.540784 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32e4a7c2-0dbc-4514-8508-7fc55e1ab3af tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:10:32.541134 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32e4a7c2-0dbc-4514-8508-7fc55e1ab3af tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:10:32.541477 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32e4a7c2-0dbc-4514-8508-7fc55e1ab3af tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:10:32.541846 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32e4a7c2-0dbc-4514-8508-7fc55e1ab3af tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:10:32.542181 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32e4a7c2-0dbc-4514-8508-7fc55e1ab3af tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:10:32.542539 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32e4a7c2-0dbc-4514-8508-7fc55e1ab3af tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:10:32.542870 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32e4a7c2-0dbc-4514-8508-7fc55e1ab3af tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:10:32.543195 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32e4a7c2-0dbc-4514-8508-7fc55e1ab3af tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:10:32.543522 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32e4a7c2-0dbc-4514-8508-7fc55e1ab3af tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:10:32.543850 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32e4a7c2-0dbc-4514-8508-7fc55e1ab3af tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:10:32.544173 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32e4a7c2-0dbc-4514-8508-7fc55e1ab3af tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:10:32.544496 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32e4a7c2-0dbc-4514-8508-7fc55e1ab3af tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:10:32.562689 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-aacac9af-e1d3-4978-a3b9-cdfd6241f8da req-32e4a7c2-0dbc-4514-8508-7fc55e1ab3af tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] No DVR routers for this DVR port 39af26ee-c67f-450c-9f93-ef05912ede92 on host hv-neutron-8168 {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 05:10:32.565036 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-aacac9af-e1d3-4978-a3b9-cdfd6241f8da req-32e4a7c2-0dbc-4514-8508-7fc55e1ab3af tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:32.568895 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-aacac9af-e1d3-4978-a3b9-cdfd6241f8da req-32e4a7c2-0dbc-4514-8508-7fc55e1ab3af tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.26 "DELETE /v2.0/ports/39af26ee-c67f-450c-9f93-ef05912ede92 HTTP/1.1" status: 204 len: 173 time: 0.4391766 Nov 09 05:10:32.569325 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '69540ec1-495f-4d3b-bfb5-4c2625bd5e6d', 'name': 'network-vif-deleted', 'tag': '39af26ee-c67f-450c-9f93-ef05912ede92'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:10:32.571719 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c0594f16-97be-4209-8ef9-11d9881e3d5d" -d '{"events": [{"server_uuid": "69540ec1-495f-4d3b-bfb5-4c2625bd5e6d", "name": "network-vif-deleted", "tag": "39af26ee-c67f-450c-9f93-ef05912ede92"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:10:32.608833 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 05:10:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-659b9072-d44d-495e-97d0-68363eb821dd x-openstack-request-id: req-659b9072-d44d-495e-97d0-68363eb821dd {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:10:32.609154 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "69540ec1-495f-4d3b-bfb5-4c2625bd5e6d", "name": "network-vif-deleted", "tag": "39af26ee-c67f-450c-9f93-ef05912ede92", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:10:32.609403 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-659b9072-d44d-495e-97d0-68363eb821dd {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:10:32.609814 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '69540ec1-495f-4d3b-bfb5-4c2625bd5e6d', 'name': 'network-vif-deleted', 'tag': '39af26ee-c67f-450c-9f93-ef05912ede92', 'status': 'completed', 'code': 200} Nov 09 05:10:33.042502 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-294d327f-7dbc-4132-acf9-d75daa634582 req-c161a26e-e0c2-49f6-b232-2a5b62c50f2d tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "GET /v2.0/ports?device_id=69540ec1-495f-4d3b-bfb5-4c2625bd5e6d HTTP/1.1" status: 200 len: 210 time: 0.0266519 Nov 09 05:10:34.099288 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 37618) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:10:34.451381 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e54b2508-7820-40a9-9fce-ae625b3b70d9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:34.699942 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-e54b2508-7820-40a9-9fce-ae625b3b70d9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Deleting port a9a63c2c-d477-4631-8ad4-e24faaa2358a {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:10:34.700203 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e54b2508-7820-40a9-9fce-ae625b3b70d9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:34.785541 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-e54b2508-7820-40a9-9fce-ae625b3b70d9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] For port a9a63c2c-d477-4631-8ad4-e24faaa2358a, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=a9a63c2c-d477-4631-8ad4-e24faaa2358a,segment=NetworkSegment(f30d767c-82f3-406c-aba3-6198dd73349f),segment_id=f30d767c-82f3-406c-aba3-6198dd73349f)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:10:34.785896 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e54b2508-7820-40a9-9fce-ae625b3b70d9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:34.798700 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-e54b2508-7820-40a9-9fce-ae625b3b70d9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Calling delete_port for a9a63c2c-d477-4631-8ad4-e24faaa2358a owned by network:router_interface {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:10:35.078497 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e54b2508-7820-40a9-9fce-ae625b3b70d9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:35.103687 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e54b2508-7820-40a9-9fce-ae625b3b70d9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event deleted for resources: {'Port': ['ID=a9a63c2c-d477-4631-8ad4-e24faaa2358a,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:10:35.281312 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e54b2508-7820-40a9-9fce-ae625b3b70d9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:35.489406 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e54b2508-7820-40a9-9fce-ae625b3b70d9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Router 4cde88b0-a962-472e-95ed-f34b609516f7 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 05:10:35.597271 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e54b2508-7820-40a9-9fce-ae625b3b70d9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 05:10:35.602286 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-e54b2508-7820-40a9-9fce-ae625b3b70d9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "PUT /v2.0/routers/4cde88b0-a962-472e-95ed-f34b609516f7/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5019181 Nov 09 05:10:35.605207 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 37620) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:10:35.607887 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3553999f-632c-4e2c-a41a-ba07f31190b7 None None] Sync routers for ids ['4cde88b0-a962-472e-95ed-f34b609516f7'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 05:10:35.618760 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3553999f-632c-4e2c-a41a-ba07f31190b7 None None] Routers {'4cde88b0-a962-472e-95ed-f34b609516f7'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:10:35.619454 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-3553999f-632c-4e2c-a41a-ba07f31190b7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:10:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['4cde88b0-a962-472e-95ed-f34b609516f7'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:10:35.654798 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-cdd2ad46-7380-467a-93bd-6c153f2eacd9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Deleting subnet b7570448-8728-4002-9b90-aa1aa4f10e83 {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 05:10:35.657807 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cdd2ad46-7380-467a-93bd-6c153f2eacd9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:35.696655 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cdd2ad46-7380-467a-93bd-6c153f2eacd9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:35.721831 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-3553999f-632c-4e2c-a41a-ba07f31190b7 None None] Set router 4cde88b0-a962-472e-95ed-f34b609516f7 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:10:35.779556 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cdd2ad46-7380-467a-93bd-6c153f2eacd9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:35.897577 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-3553999f-632c-4e2c-a41a-ba07f31190b7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4cde88b0-a962-472e-95ed-f34b609516f7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-310918215', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.122'}], 'enable_snat': True}, 'gw_port_id': 'ded5c8d9-110f-4e05-88a7-b8546e75095e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:09:30Z', 'updated_at': '2021-11-09T05:10:34Z', 'revision_number': 5, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': 'ded5c8d9-110f-4e05-88a7-b8546e75095e', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:56:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4cde88b0-a962-472e-95ed-f34b609516f7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1786, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:09:31Z', 'updated_at': '2021-11-09T05:09:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:10:35.927469 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3553999f-632c-4e2c-a41a-ba07f31190b7 None None] Checking router: 4cde88b0-a962-472e-95ed-f34b609516f7 for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 05:10:35.930568 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cdd2ad46-7380-467a-93bd-6c153f2eacd9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:35.936549 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3553999f-632c-4e2c-a41a-ba07f31190b7 None None] Routers {'4cde88b0-a962-472e-95ed-f34b609516f7'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:10:35.937200 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-3553999f-632c-4e2c-a41a-ba07f31190b7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:10:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['4cde88b0-a962-472e-95ed-f34b609516f7'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:10:35.959536 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdd2ad46-7380-467a-93bd-6c153f2eacd9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event deleted for resources: {'Subnet': ['ID=b7570448-8728-4002-9b90-aa1aa4f10e83,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:10:35.961460 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cdd2ad46-7380-467a-93bd-6c153f2eacd9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:35.964682 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-cdd2ad46-7380-467a-93bd-6c153f2eacd9 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "DELETE /v2.0/subnets/b7570448-8728-4002-9b90-aa1aa4f10e83 HTTP/1.1" status: 204 len: 168 time: 0.3585589 Nov 09 05:10:35.969701 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 37622) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:10:35.972375 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1e4bc628-0f25-47f8-833b-83e801777a8f None None] Network 164fa49b-4b69-42f2-b13f-78b6ab225c74 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 05:10:36.302889 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-3553999f-632c-4e2c-a41a-ba07f31190b7 None None] Set router 4cde88b0-a962-472e-95ed-f34b609516f7 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:10:36.358486 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 39af26ee-c67f-450c-9f93-ef05912ede92 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 05:10:36.363110 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9c335502-dceb-4cbf-82cb-0889741893bc tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for router, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:36.401245 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] No Port match for: 39af26ee-c67f-450c-9f93-ef05912ede92 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 05:10:36.401590 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 39af26ee-c67f-450c-9f93-ef05912ede92 not bound to the agent host hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 05:10:36.471108 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9c335502-dceb-4cbf-82cb-0889741893bc tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for router_gateway, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:36.498729 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8789200a-fd78-4df5-8ca4-c6123e6a2e19 None None] DHCP port deletion for 164fa49b-4b69-42f2-b13f-78b6ab225c74 request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 05:10:36.556064 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-3553999f-632c-4e2c-a41a-ba07f31190b7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4cde88b0-a962-472e-95ed-f34b609516f7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-310918215', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.122'}], 'enable_snat': True}, 'gw_port_id': 'ded5c8d9-110f-4e05-88a7-b8546e75095e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:09:30Z', 'updated_at': '2021-11-09T05:10:34Z', 'revision_number': 5, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': 'ded5c8d9-110f-4e05-88a7-b8546e75095e', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:56:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4cde88b0-a962-472e-95ed-f34b609516f7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1786, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:09:31Z', 'updated_at': '2021-11-09T05:09:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:10:36.583803 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3553999f-632c-4e2c-a41a-ba07f31190b7 None None] The sync data for ids ['4cde88b0-a962-472e-95ed-f34b609516f7'] in dv-neutron-816802-2-hyperv is: [{'id': '4cde88b0-a962-472e-95ed-f34b609516f7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-310918215', 'tenant_id': '8ac3eab68bd34485af7ddc3417853b28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.122'}], 'enable_snat': True}, 'gw_port_id': 'ded5c8d9-110f-4e05-88a7-b8546e75095e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:09:30Z', 'updated_at': '2021-11-09T05:10:34Z', 'revision_number': 5, 'project_id': '8ac3eab68bd34485af7ddc3417853b28', 'gw_port': {'id': 'ded5c8d9-110f-4e05-88a7-b8546e75095e', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:56:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4cde88b0-a962-472e-95ed-f34b609516f7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1786, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:09:31Z', 'updated_at': '2021-11-09T05:09:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 05:10:36.587658 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-8789200a-fd78-4df5-8ca4-c6123e6a2e19 None None] Deleting port fe0a5e84-a2cc-4b6a-9ff7-c458650ca05b {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:10:36.590351 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8789200a-fd78-4df5-8ca4-c6123e6a2e19 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:36.607019 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-9c335502-dceb-4cbf-82cb-0889741893bc tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Deleting port ded5c8d9-110f-4e05-88a7-b8546e75095e {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:10:36.607271 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9c335502-dceb-4cbf-82cb-0889741893bc tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:36.651726 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-8789200a-fd78-4df5-8ca4-c6123e6a2e19 None None] For port fe0a5e84-a2cc-4b6a-9ff7-c458650ca05b, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=fe0a5e84-a2cc-4b6a-9ff7-c458650ca05b,segment=NetworkSegment(f30d767c-82f3-406c-aba3-6198dd73349f),segment_id=f30d767c-82f3-406c-aba3-6198dd73349f)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:10:36.652336 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8789200a-fd78-4df5-8ca4-c6123e6a2e19 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:36.664886 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-8789200a-fd78-4df5-8ca4-c6123e6a2e19 None None] Calling delete_port for fe0a5e84-a2cc-4b6a-9ff7-c458650ca05b owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:10:36.693973 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-9c335502-dceb-4cbf-82cb-0889741893bc tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] For port ded5c8d9-110f-4e05-88a7-b8546e75095e, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=ded5c8d9-110f-4e05-88a7-b8546e75095e,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:10:36.694329 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9c335502-dceb-4cbf-82cb-0889741893bc tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:36.706619 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-9c335502-dceb-4cbf-82cb-0889741893bc tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Calling delete_port for ded5c8d9-110f-4e05-88a7-b8546e75095e owned by network:router_gateway {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:10:36.810548 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8789200a-fd78-4df5-8ca4-c6123e6a2e19 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:36.836220 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8789200a-fd78-4df5-8ca4-c6123e6a2e19 None None] Pushing event deleted for resources: {'Port': ['ID=fe0a5e84-a2cc-4b6a-9ff7-c458650ca05b,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:10:36.841908 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8789200a-fd78-4df5-8ca4-c6123e6a2e19 None None] No DVR routers for this DVR port fe0a5e84-a2cc-4b6a-9ff7-c458650ca05b on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 05:10:36.860377 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8789200a-fd78-4df5-8ca4-c6123e6a2e19 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:10:36.860713 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8789200a-fd78-4df5-8ca4-c6123e6a2e19 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:10:36.861180 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8789200a-fd78-4df5-8ca4-c6123e6a2e19 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:10:36.861531 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8789200a-fd78-4df5-8ca4-c6123e6a2e19 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:10:36.861852 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8789200a-fd78-4df5-8ca4-c6123e6a2e19 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:10:36.862184 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8789200a-fd78-4df5-8ca4-c6123e6a2e19 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:10:36.862547 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8789200a-fd78-4df5-8ca4-c6123e6a2e19 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:10:36.862873 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8789200a-fd78-4df5-8ca4-c6123e6a2e19 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:10:36.863201 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8789200a-fd78-4df5-8ca4-c6123e6a2e19 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:10:36.863521 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8789200a-fd78-4df5-8ca4-c6123e6a2e19 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:10:36.863838 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8789200a-fd78-4df5-8ca4-c6123e6a2e19 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:10:36.864158 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8789200a-fd78-4df5-8ca4-c6123e6a2e19 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:10:36.964488 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9c335502-dceb-4cbf-82cb-0889741893bc tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:36.985874 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c335502-dceb-4cbf-82cb-0889741893bc tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event deleted for resources: {'Port': ['ID=ded5c8d9-110f-4e05-88a7-b8546e75095e,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:10:37.070773 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9c335502-dceb-4cbf-82cb-0889741893bc tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-466373'] for router_gateway, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:37.160375 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9c335502-dceb-4cbf-82cb-0889741893bc tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:37.162505 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9c335502-dceb-4cbf-82cb-0889741893bc tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:37.277528 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9c335502-dceb-4cbf-82cb-0889741893bc tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:37.278083 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9c335502-dceb-4cbf-82cb-0889741893bc tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Fanout notify agent at l3_agent the message router_deleted on router 4cde88b0-a962-472e-95ed-f34b609516f7 {{(pid=102161) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 05:10:37.284841 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9c335502-dceb-4cbf-82cb-0889741893bc tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:37.285931 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-9c335502-dceb-4cbf-82cb-0889741893bc tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "DELETE /v2.0/routers/4cde88b0-a962-472e-95ed-f34b609516f7 HTTP/1.1" status: 204 len: 168 time: 1.3177485 Nov 09 05:10:37.288645 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 37624) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:10:37.367700 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2f5949b8-c249-4688-87e4-21afe5432c82 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:37.462948 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2f5949b8-c249-4688-87e4-21afe5432c82 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:37.482166 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-2f5949b8-c249-4688-87e4-21afe5432c82 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['164fa49b-4b69-42f2-b13f-78b6ab225c74']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:10:37.491708 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-2f5949b8-c249-4688-87e4-21afe5432c82 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f30d767c-82f3-406c-aba3-6198dd73349f') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:10:37.493303 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-2f5949b8-c249-4688-87e4-21afe5432c82 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f30d767c-82f3-406c-aba3-6198dd73349f') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:10:37.500920 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2f5949b8-c249-4688-87e4-21afe5432c82 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:37.514330 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2f5949b8-c249-4688-87e4-21afe5432c82 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:37.520115 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2f5949b8-c249-4688-87e4-21afe5432c82 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Releasing vlan 340 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 05:10:37.520487 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2f5949b8-c249-4688-87e4-21afe5432c82 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:37.523522 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 05:10:37.523522 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 05:10:37.523522 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 05:10:37.523522 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 05:10:37.523522 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 05:10:37.523522 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 05:10:37.523522 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 05:10:37.523522 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 05:10:37.523522 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 05:10:37.523522 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 05:10:37.523522 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 05:10:37.523522 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 05:10:37.523522 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 05:10:37.523522 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 05:10:37.523522 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 05:10:37.523522 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 05:10:37.523522 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 05:10:37.523522 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 05:10:37.523522 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 05:10:37.523522 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 05:10:37.523522 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 05:10:37.523522 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 05:10:37.523522 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 05:10:37.523522 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 05:10:37.523522 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 05:10:37.523522 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 05:10:37.523522 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 05:10:37.523522 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 05:10:37.523522 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 05:10:37.523522 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 05:10:37.523522 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 05:10:37.523522 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 05:10:37.644314 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2f5949b8-c249-4688-87e4-21afe5432c82 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:37.648899 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2f5949b8-c249-4688-87e4-21afe5432c82 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:37.655204 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-2f5949b8-c249-4688-87e4-21afe5432c82 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "DELETE /v2.0/networks/164fa49b-4b69-42f2-b13f-78b6ab225c74 HTTP/1.1" status: 204 len: 168 time: 0.3626559 Nov 09 05:10:37.655404 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 37626) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:10:37.667319 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f5949b8-c249-4688-87e4-21afe5432c82 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event deleted for resources: {'Network': ['ID=164fa49b-4b69-42f2-b13f-78b6ab225c74,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:10:37.716122 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-557d6698-9f99-403d-915c-ba00aaf43f04 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:37.749724 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-557d6698-9f99-403d-915c-ba00aaf43f04 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:37.883903 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-557d6698-9f99-403d-915c-ba00aaf43f04 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:37.886630 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-557d6698-9f99-403d-915c-ba00aaf43f04 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:37.887803 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-557d6698-9f99-403d-915c-ba00aaf43f04 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] 10.222.0.24 "DELETE /v2.0/security-groups/3285a6ac-908a-45d4-a6e2-2d8556bc393d HTTP/1.1" status: 204 len: 168 time: 0.2311847 Nov 09 05:10:37.897939 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-557d6698-9f99-403d-915c-ba00aaf43f04 tempest-TestNetworkAdvancedServerOps-411145855 tempest-TestNetworkAdvancedServerOps-411145855-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=3285a6ac-908a-45d4-a6e2-2d8556bc393d,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:10:38.424946 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device fe0a5e84-a2cc-4b6a-9ff7-c458650ca05b no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 05:10:38.439861 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 37638) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:10:38.444745 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: fe0a5e84-a2cc-4b6a-9ff7-c458650ca05b {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 05:10:38.445089 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device fe0a5e84-a2cc-4b6a-9ff7-c458650ca05b not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 05:10:38.445502 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device ded5c8d9-110f-4e05-88a7-b8546e75095e no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 05:10:38.467482 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: ded5c8d9-110f-4e05-88a7-b8546e75095e {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 05:10:38.467818 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device ded5c8d9-110f-4e05-88a7-b8546e75095e not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 05:10:38.468223 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device a9a63c2c-d477-4631-8ad4-e24faaa2358a no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 05:10:38.486380 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: a9a63c2c-d477-4631-8ad4-e24faaa2358a {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 05:10:38.486721 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device a9a63c2c-d477-4631-8ad4-e24faaa2358a not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 05:10:38.568291 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-5703230c-0032-4ef9-810b-4212c2752dcf admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=8ac3eab68bd34485af7ddc3417853b28&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1272385 Nov 09 05:10:38.571235 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 37642) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:10:38.617150 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7bab3961-ef39-4d3f-b6e2-4929095c3d8c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:38.637957 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7bab3961-ef39-4d3f-b6e2-4929095c3d8c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:38.750396 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7bab3961-ef39-4d3f-b6e2-4929095c3d8c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:38.751559 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7bab3961-ef39-4d3f-b6e2-4929095c3d8c admin admin] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:38.755306 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-7bab3961-ef39-4d3f-b6e2-4929095c3d8c admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/07d4b291-c99a-49a3-b3a8-943a6c9c4013 HTTP/1.1" status: 204 len: 168 time: 0.1806276 Nov 09 05:10:38.768999 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bab3961-ef39-4d3f-b6e2-4929095c3d8c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=07d4b291-c99a-49a3-b3a8-943a6c9c4013,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:10:39.315459 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 37648) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:10:39.328316 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-11a6acbb-e930-49c8-9561-29d2d4ecbd08 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:39.403318 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-11a6acbb-e930-49c8-9561-29d2d4ecbd08 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:39.472558 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-11a6acbb-e930-49c8-9561-29d2d4ecbd08 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:39.509230 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-11a6acbb-e930-49c8-9561-29d2d4ecbd08 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=673856ca7bd94858a9dbcaef9772fd79&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1927245 Nov 09 05:10:39.511089 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11a6acbb-e930-49c8-9561-29d2d4ecbd08 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2e56d066-22d5-420b-b58f-94046a81f9b5,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:10:39.511928 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 37650) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:10:39.560190 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d695ddd0-1c3d-4816-ab72-57b751f85a90 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:39.580671 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d695ddd0-1c3d-4816-ab72-57b751f85a90 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:39.735898 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d695ddd0-1c3d-4816-ab72-57b751f85a90 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:39.738460 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d695ddd0-1c3d-4816-ab72-57b751f85a90 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:39.739598 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-d695ddd0-1c3d-4816-ab72-57b751f85a90 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/2e56d066-22d5-420b-b58f-94046a81f9b5 HTTP/1.1" status: 204 len: 168 time: 0.2266903 Nov 09 05:10:39.747252 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d695ddd0-1c3d-4816-ab72-57b751f85a90 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2e56d066-22d5-420b-b58f-94046a81f9b5,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:10:40.745808 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 37672) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:10:40.836889 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-576c12ad-e06b-4184-97c5-a8dcf0e5219a admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-1961526497-network', 'tenant_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:10:40.907066 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-576c12ad-e06b-4184-97c5-a8dcf0e5219a admin admin] Made reservation on behalf of ebd13c4f757b48ab9d14fcf5b3a5325a for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 05:10:40.909394 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-576c12ad-e06b-4184-97c5-a8dcf0e5219a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:40.918723 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-576c12ad-e06b-4184-97c5-a8dcf0e5219a admin admin] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:40.988864 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-576c12ad-e06b-4184-97c5-a8dcf0e5219a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:41.027279 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-576c12ad-e06b-4184-97c5-a8dcf0e5219a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:41.053741 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-576c12ad-e06b-4184-97c5-a8dcf0e5219a admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 326} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 05:10:41.059966 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-576c12ad-e06b-4184-97c5-a8dcf0e5219a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f0574e05-3ad8-44d0-94d2-485f290a43aa,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:10:41.065705 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-576c12ad-e06b-4184-97c5-a8dcf0e5219a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:41.066094 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-576c12ad-e06b-4184-97c5-a8dcf0e5219a admin admin] Added segment 0a75612c-c02a-4294-901e-f7bbf1a2b310 of type vlan for network 41e1a505-f3a3-418f-9229-3880f4333c14 Nov 09 05:10:41.109788 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-576c12ad-e06b-4184-97c5-a8dcf0e5219a admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:41.198542 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-576c12ad-e06b-4184-97c5-a8dcf0e5219a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:41.199418 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-576c12ad-e06b-4184-97c5-a8dcf0e5219a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:10:41.200023 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-576c12ad-e06b-4184-97c5-a8dcf0e5219a admin admin] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:41.258606 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-576c12ad-e06b-4184-97c5-a8dcf0e5219a admin admin] Pushing event updated for resources: {'Network': ['ID=41e1a505-f3a3-418f-9229-3880f4333c14,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:10:41.268029 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 41e1a505-f3a3-418f-9229-3880f4333c14 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 05:10:41.276263 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-576c12ad-e06b-4184-97c5-a8dcf0e5219a admin admin] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.5293674 Nov 09 05:10:41.279209 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 37676) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:10:41.283867 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-0cb68c64-d7ff-4341-a37f-086a16012f20 admin admin] Request body: {'subnet': {'network_id': '41e1a505-f3a3-418f-9229-3880f4333c14', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-1961526497-subnet', 'tenant_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'ip_version': 4}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:10:41.352944 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0cb68c64-d7ff-4341-a37f-086a16012f20 admin admin] Made reservation on behalf of ebd13c4f757b48ab9d14fcf5b3a5325a for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 05:10:41.355634 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0cb68c64-d7ff-4341-a37f-086a16012f20 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:41.399347 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-61a2e25a-bba3-4e14-a7b6-52cbfb36b16a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:41.576038 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0cb68c64-d7ff-4341-a37f-086a16012f20 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:41.640194 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cb68c64-d7ff-4341-a37f-086a16012f20 admin admin] Pushing event updated for resources: {'Subnet': ['ID=abf74659-fa86-43c8-a52c-7b696adbf35a,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:10:41.645347 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0cb68c64-d7ff-4341-a37f-086a16012f20 admin admin] Checking segment: {'id': '0a75612c-c02a-4294-901e-f7bbf1a2b310', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 326, 'network_id': '41e1a505-f3a3-418f-9229-3880f4333c14'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 05:10:41.645780 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0cb68c64-d7ff-4341-a37f-086a16012f20 admin admin] Network hostable DHCP agents. Network: 41e1a505-f3a3-418f-9229-3880f4333c14, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 05:10:41.701452 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0cb68c64-d7ff-4341-a37f-086a16012f20 admin admin] Network 41e1a505-f3a3-418f-9229-3880f4333c14 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 05:10:41.752522 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-0cb68c64-d7ff-4341-a37f-086a16012f20 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 41e1a505-f3a3-418f-9229-3880f4333c14) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:10:41.756607 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0cb68c64-d7ff-4341-a37f-086a16012f20 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:10:41.757190 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0cb68c64-d7ff-4341-a37f-086a16012f20 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:41.761917 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1c7bf090-4176-4fd2-bca0-b7b72612eb9b None None] Network 41e1a505-f3a3-418f-9229-3880f4333c14 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 05:10:41.812781 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-0cb68c64-d7ff-4341-a37f-086a16012f20 admin admin] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.5325003 Nov 09 05:10:41.815516 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 37678) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:10:41.821452 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-e8159003-fef2-459c-9a3f-dd2c91a5e2db admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-1961526497-router', 'tenant_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:10:41.896055 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e8159003-fef2-459c-9a3f-dd2c91a5e2db admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:41.897113 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e8159003-fef2-459c-9a3f-dd2c91a5e2db admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:41.912619 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e976056d-d9cb-4237-a31d-e4b83fc2dad4 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-41e1a505-f3a3-418f-9229-3880f4333c14', 'network_id': '41e1a505-f3a3-418f-9229-3880f4333c14', 'tenant_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'fixed_ips': [{'subnet_id': 'abf74659-fa86-43c8-a52c-7b696adbf35a'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 05:10:41.917362 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e976056d-d9cb-4237-a31d-e4b83fc2dad4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:41.950747 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e8159003-fef2-459c-9a3f-dd2c91a5e2db admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:42.043927 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-e976056d-d9cb-4237-a31d-e4b83fc2dad4 None None] Allocated IP 172.20.0.2 (41e1a505-f3a3-418f-9229-3880f4333c14/abf74659-fa86-43c8-a52c-7b696adbf35a/438646fd-0794-4cd0-aa9b-87b89a08dc7c) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 05:10:42.155076 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e8159003-fef2-459c-9a3f-dd2c91a5e2db admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:42.177195 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e976056d-d9cb-4237-a31d-e4b83fc2dad4 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:42.261557 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e976056d-d9cb-4237-a31d-e4b83fc2dad4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:42.301730 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e976056d-d9cb-4237-a31d-e4b83fc2dad4 None None] Network 41e1a505-f3a3-418f-9229-3880f4333c14 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:10:42.307025 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-e976056d-d9cb-4237-a31d-e4b83fc2dad4 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:10:42.309403 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e976056d-d9cb-4237-a31d-e4b83fc2dad4 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 05:10:42.321076 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e976056d-d9cb-4237-a31d-e4b83fc2dad4 None None] Pushing event updated for resources: {'Port': ['ID=438646fd-0794-4cd0-aa9b-87b89a08dc7c,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:10:42.366827 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-e976056d-d9cb-4237-a31d-e4b83fc2dad4 None None] Attempting to bind port 438646fd-0794-4cd0-aa9b-87b89a08dc7c on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 05:10:42.368170 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-e976056d-d9cb-4237-a31d-e4b83fc2dad4 None None] Attempting to bind port 438646fd-0794-4cd0-aa9b-87b89a08dc7c by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '0a75612c-c02a-4294-901e-f7bbf1a2b310', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 326, 'network_id': '41e1a505-f3a3-418f-9229-3880f4333c14'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 05:10:42.368170 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e976056d-d9cb-4237-a31d-e4b83fc2dad4 None None] Attempting to bind port 438646fd-0794-4cd0-aa9b-87b89a08dc7c on network 41e1a505-f3a3-418f-9229-3880f4333c14 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 05:10:42.372736 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e976056d-d9cb-4237-a31d-e4b83fc2dad4 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 5, 10, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 05:10:42.373106 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e976056d-d9cb-4237-a31d-e4b83fc2dad4 None None] Checking segment: {'id': '0a75612c-c02a-4294-901e-f7bbf1a2b310', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 326, 'network_id': '41e1a505-f3a3-418f-9229-3880f4333c14'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 05:10:42.373510 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e976056d-d9cb-4237-a31d-e4b83fc2dad4 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:42.373906 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e976056d-d9cb-4237-a31d-e4b83fc2dad4 None None] Bound using segment: {'id': '0a75612c-c02a-4294-901e-f7bbf1a2b310', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 326, 'network_id': '41e1a505-f3a3-418f-9229-3880f4333c14'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 05:10:42.374323 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-e976056d-d9cb-4237-a31d-e4b83fc2dad4 None None] Bound port: 438646fd-0794-4cd0-aa9b-87b89a08dc7c, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0a75612c-c02a-4294-901e-f7bbf1a2b310', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 326, 'network_id': '41e1a505-f3a3-418f-9229-3880f4333c14'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 05:10:42.374717 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e976056d-d9cb-4237-a31d-e4b83fc2dad4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:42.420450 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e8159003-fef2-459c-9a3f-dd2c91a5e2db admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:42.434599 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e976056d-d9cb-4237-a31d-e4b83fc2dad4 None None] For port 438646fd-0794-4cd0-aa9b-87b89a08dc7c, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 05:10:42.437717 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e976056d-d9cb-4237-a31d-e4b83fc2dad4 None None] For port 438646fd-0794-4cd0-aa9b-87b89a08dc7c, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=438646fd-0794-4cd0-aa9b-87b89a08dc7c,segment=NetworkSegment(0a75612c-c02a-4294-901e-f7bbf1a2b310),segment_id=0a75612c-c02a-4294-901e-f7bbf1a2b310)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 05:10:42.442706 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e8159003-fef2-459c-9a3f-dd2c91a5e2db admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:42.519337 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e976056d-d9cb-4237-a31d-e4b83fc2dad4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:42.684841 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-e8159003-fef2-459c-9a3f-dd2c91a5e2db admin admin] Allocated IP 172.26.0.251 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/5204f9e0-7d71-4dee-997d-b68078c7a10f) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 05:10:42.684962 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e976056d-d9cb-4237-a31d-e4b83fc2dad4 None None] Pushing event updated for resources: {'Port': ['ID=438646fd-0794-4cd0-aa9b-87b89a08dc7c,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:10:42.685086 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e8159003-fef2-459c-9a3f-dd2c91a5e2db admin admin] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:42.685783 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:42.765780 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e8159003-fef2-459c-9a3f-dd2c91a5e2db admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:42.809353 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e8159003-fef2-459c-9a3f-dd2c91a5e2db admin admin] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:10:42.812389 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-e8159003-fef2-459c-9a3f-dd2c91a5e2db admin admin] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:10:42.816977 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e8159003-fef2-459c-9a3f-dd2c91a5e2db admin admin] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 05:10:42.821214 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8159003-fef2-459c-9a3f-dd2c91a5e2db admin admin] Pushing event updated for resources: {'Port': ['ID=5204f9e0-7d71-4dee-997d-b68078c7a10f,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:10:43.120273 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e8159003-fef2-459c-9a3f-dd2c91a5e2db admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:43.318058 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e8159003-fef2-459c-9a3f-dd2c91a5e2db admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:43.422831 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-81f80684-c800-48ec-b04c-c5e9bd3c8201 None None] Network 41e1a505-f3a3-418f-9229-3880f4333c14 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 05:10:43.518689 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e8159003-fef2-459c-9a3f-dd2c91a5e2db admin admin] Router 4119e421-6cb1-4924-9967-18e73a4eeae3 is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102161) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 05:10:43.547116 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-0adfc33a-465b-4c20-ab63-51d8e8a4cc4a None None] Provisioning complete for port 438646fd-0794-4cd0-aa9b-87b89a08dc7c triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:10:43.547471 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0adfc33a-465b-4c20-ab63-51d8e8a4cc4a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:43.632273 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e8159003-fef2-459c-9a3f-dd2c91a5e2db admin admin] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 05:10:43.646626 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e175a9a2-bc0f-4720-9ba4-4471140235d2 None None] Sync routers for ids ['4119e421-6cb1-4924-9967-18e73a4eeae3'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 05:10:43.660505 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e175a9a2-bc0f-4720-9ba4-4471140235d2 None None] Routers {'4119e421-6cb1-4924-9967-18e73a4eeae3'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:10:43.661035 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-e175a9a2-bc0f-4720-9ba4-4471140235d2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:10:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['4119e421-6cb1-4924-9967-18e73a4eeae3'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:10:43.663080 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0adfc33a-465b-4c20-ab63-51d8e8a4cc4a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:43.704597 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-0adfc33a-465b-4c20-ab63-51d8e8a4cc4a None None] For port 438646fd-0794-4cd0-aa9b-87b89a08dc7c, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=438646fd-0794-4cd0-aa9b-87b89a08dc7c,segment=NetworkSegment(0a75612c-c02a-4294-901e-f7bbf1a2b310),segment_id=0a75612c-c02a-4294-901e-f7bbf1a2b310)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:10:43.720254 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-e8159003-fef2-459c-9a3f-dd2c91a5e2db admin admin] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:43.721526 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-e8159003-fef2-459c-9a3f-dd2c91a5e2db admin admin] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 921 time: 1.9051180 Nov 09 05:10:43.724870 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 37680) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:10:43.753720 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e228f9fe-fb9b-4421-a153-cdb51af67f95 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:43.775361 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-e175a9a2-bc0f-4720-9ba4-4471140235d2 None None] Set router 4119e421-6cb1-4924-9967-18e73a4eeae3 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:10:43.815702 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0adfc33a-465b-4c20-ab63-51d8e8a4cc4a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:43.866335 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0adfc33a-465b-4c20-ab63-51d8e8a4cc4a None None] Pushing event updated for resources: {'Port': ['ID=438646fd-0794-4cd0-aa9b-87b89a08dc7c,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:10:43.936320 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-3ebbb000-455a-4efe-bf48-9a44309ad700 None None] Provisioning complete for port 438646fd-0794-4cd0-aa9b-87b89a08dc7c triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:10:43.936752 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3ebbb000-455a-4efe-bf48-9a44309ad700 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:44.052775 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-e175a9a2-bc0f-4720-9ba4-4471140235d2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'name': 'tempest-TestShelveInstance-1961526497-router', 'tenant_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.251'}], 'enable_snat': True}, 'gw_port_id': '5204f9e0-7d71-4dee-997d-b68078c7a10f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:10:41Z', 'updated_at': '2021-11-09T05:10:42Z', 'revision_number': 3, 'project_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'gw_port': {'id': '5204f9e0-7d71-4dee-997d-b68078c7a10f', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:88:c0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1808, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.251', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:10:42Z', 'updated_at': '2021-11-09T05:10:42Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:10:44.093269 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e175a9a2-bc0f-4720-9ba4-4471140235d2 None None] Checking router: 4119e421-6cb1-4924-9967-18e73a4eeae3 for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 05:10:44.093610 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e175a9a2-bc0f-4720-9ba4-4471140235d2 None None] Updating router 4119e421-6cb1-4924-9967-18e73a4eeae3 port 5204f9e0-7d71-4dee-997d-b68078c7a10f binding host dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 05:10:44.118386 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-e175a9a2-bc0f-4720-9ba4-4471140235d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:44.163450 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-da5e5b6d-df9e-4087-b418-7b49285a7426 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:44.314681 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-da5e5b6d-df9e-4087-b418-7b49285a7426 admin admin] Allocated IP 172.20.0.1 (41e1a505-f3a3-418f-9229-3880f4333c14/abf74659-fa86-43c8-a52c-7b696adbf35a/165314fc-453c-4fef-bf42-9efd260d1493) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 05:10:44.360960 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-e175a9a2-bc0f-4720-9ba4-4471140235d2 None None] Publish callbacks [] for port, precommit_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:44.418869 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-da5e5b6d-df9e-4087-b418-7b49285a7426 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:44.439024 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-e175a9a2-bc0f-4720-9ba4-4471140235d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:44.469896 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 438646fd-0794-4cd0-aa9b-87b89a08dc7c up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:10:44.475818 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [req-a564c9db-782a-4d36-92c5-fd3b44124fe9 req-63e12349-1288-4064-82ef-c4b1f1072d3d service neutron] (102162) timed out ('10.222.0.24', 33672) {{(pid=102162) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:820}} Nov 09 05:10:44.495403 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-e175a9a2-bc0f-4720-9ba4-4471140235d2 None None] Attempting to bind port 5204f9e0-7d71-4dee-997d-b68078c7a10f on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 05:10:44.495765 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-e175a9a2-bc0f-4720-9ba4-4471140235d2 None None] Attempting to bind port 5204f9e0-7d71-4dee-997d-b68078c7a10f by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 05:10:44.496123 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e175a9a2-bc0f-4720-9ba4-4471140235d2 None None] Attempting to bind port 5204f9e0-7d71-4dee-997d-b68078c7a10f on network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 05:10:44.504826 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e175a9a2-bc0f-4720-9ba4-4471140235d2 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 5, 10, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 05:10:44.505745 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e175a9a2-bc0f-4720-9ba4-4471140235d2 None None] Checking segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102164) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 05:10:44.505745 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-e175a9a2-bc0f-4720-9ba4-4471140235d2 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:44.506034 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e175a9a2-bc0f-4720-9ba4-4471140235d2 None None] Bound using segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 05:10:44.506437 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-e175a9a2-bc0f-4720-9ba4-4471140235d2 None None] Bound port: 5204f9e0-7d71-4dee-997d-b68078c7a10f, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 05:10:44.506814 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-e175a9a2-bc0f-4720-9ba4-4471140235d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:44.509620 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59a17709-986a-401f-82b7-ea83fac373df None None] Pushing event updated for resources: {'Port': ['ID=5204f9e0-7d71-4dee-997d-b68078c7a10f,revision_number=2']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:10:44.521198 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 438646fd-0794-4cd0-aa9b-87b89a08dc7c triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:10:44.521563 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:44.525575 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-da5e5b6d-df9e-4087-b418-7b49285a7426 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:44.538028 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59a17709-986a-401f-82b7-ea83fac373df None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:10:44.538386 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59a17709-986a-401f-82b7-ea83fac373df None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:10:44.538748 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59a17709-986a-401f-82b7-ea83fac373df None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:10:44.539085 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59a17709-986a-401f-82b7-ea83fac373df None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:10:44.539424 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59a17709-986a-401f-82b7-ea83fac373df None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:10:44.539741 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59a17709-986a-401f-82b7-ea83fac373df None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:10:44.540064 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59a17709-986a-401f-82b7-ea83fac373df None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:10:44.540387 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59a17709-986a-401f-82b7-ea83fac373df None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:10:44.540769 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59a17709-986a-401f-82b7-ea83fac373df None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:10:44.541073 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59a17709-986a-401f-82b7-ea83fac373df None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:10:44.541388 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59a17709-986a-401f-82b7-ea83fac373df None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:10:44.541718 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59a17709-986a-401f-82b7-ea83fac373df None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:10:44.564630 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-da5e5b6d-df9e-4087-b418-7b49285a7426 admin admin] Network 41e1a505-f3a3-418f-9229-3880f4333c14 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:10:44.569904 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-da5e5b6d-df9e-4087-b418-7b49285a7426 admin admin] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:10:44.574501 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-da5e5b6d-df9e-4087-b418-7b49285a7426 admin admin] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 05:10:44.578190 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-e175a9a2-bc0f-4720-9ba4-4471140235d2 None None] For port 5204f9e0-7d71-4dee-997d-b68078c7a10f, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102164) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 05:10:44.591967 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-e175a9a2-bc0f-4720-9ba4-4471140235d2 None None] For port 5204f9e0-7d71-4dee-997d-b68078c7a10f, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=5204f9e0-7d71-4dee-997d-b68078c7a10f,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102164) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 05:10:44.603605 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da5e5b6d-df9e-4087-b418-7b49285a7426 admin admin] Pushing event updated for resources: {'Port': ['ID=165314fc-453c-4fef-bf42-9efd260d1493,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:10:44.623779 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-da5e5b6d-df9e-4087-b418-7b49285a7426 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:44.656730 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-e175a9a2-bc0f-4720-9ba4-4471140235d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:44.720195 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e175a9a2-bc0f-4720-9ba4-4471140235d2 None None] Routers {'4119e421-6cb1-4924-9967-18e73a4eeae3'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:10:44.720817 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-e175a9a2-bc0f-4720-9ba4-4471140235d2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:10:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['4119e421-6cb1-4924-9967-18e73a4eeae3'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:10:44.767742 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59a17709-986a-401f-82b7-ea83fac373df None None] Pushing event updated for resources: {'Port': ['ID=5204f9e0-7d71-4dee-997d-b68078c7a10f,revision_number=3']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:10:44.801416 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-da5e5b6d-df9e-4087-b418-7b49285a7426 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:44.840437 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-f96e3914-81b2-41b6-b55b-5c1c9a6371cd None None] Provisioning complete for port 165314fc-453c-4fef-bf42-9efd260d1493 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:10:44.840437 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f96e3914-81b2-41b6-b55b-5c1c9a6371cd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:44.842047 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-e175a9a2-bc0f-4720-9ba4-4471140235d2 None None] Set router 4119e421-6cb1-4924-9967-18e73a4eeae3 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:10:44.876293 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-f96e3914-81b2-41b6-b55b-5c1c9a6371cd None None] Port 165314fc-453c-4fef-bf42-9efd260d1493 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 05:10:44.966590 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-da5e5b6d-df9e-4087-b418-7b49285a7426 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:45.022197 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-e175a9a2-bc0f-4720-9ba4-4471140235d2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'name': 'tempest-TestShelveInstance-1961526497-router', 'tenant_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.251'}], 'enable_snat': True}, 'gw_port_id': '5204f9e0-7d71-4dee-997d-b68078c7a10f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:10:41Z', 'updated_at': '2021-11-09T05:10:42Z', 'revision_number': 3, 'project_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'gw_port': {'id': '5204f9e0-7d71-4dee-997d-b68078c7a10f', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:88:c0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1808, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.251', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:10:42Z', 'updated_at': '2021-11-09T05:10:44Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:10:45.045353 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-da5e5b6d-df9e-4087-b418-7b49285a7426 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:45.048251 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e175a9a2-bc0f-4720-9ba4-4471140235d2 None None] The sync data for ids ['4119e421-6cb1-4924-9967-18e73a4eeae3'] in dv-neutron-816802-2-hyperv is: [{'id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'name': 'tempest-TestShelveInstance-1961526497-router', 'tenant_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.251'}], 'enable_snat': True}, 'gw_port_id': '5204f9e0-7d71-4dee-997d-b68078c7a10f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:10:41Z', 'updated_at': '2021-11-09T05:10:42Z', 'revision_number': 3, 'project_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'gw_port': {'id': '5204f9e0-7d71-4dee-997d-b68078c7a10f', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:88:c0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1808, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.251', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:10:42Z', 'updated_at': '2021-11-09T05:10:44Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 05:10:45.116333 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-da5e5b6d-df9e-4087-b418-7b49285a7426 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:45.118836 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da5e5b6d-df9e-4087-b418-7b49285a7426 admin admin] Pushing event updated for resources: {'Port': ['ID=165314fc-453c-4fef-bf42-9efd260d1493,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:10:45.208922 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-da5e5b6d-df9e-4087-b418-7b49285a7426 admin admin] Network 41e1a505-f3a3-418f-9229-3880f4333c14 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:10:45.210475 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-da5e5b6d-df9e-4087-b418-7b49285a7426 admin admin] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:10:45.276157 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:45.364791 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-da5e5b6d-df9e-4087-b418-7b49285a7426 admin admin] Router 4119e421-6cb1-4924-9967-18e73a4eeae3 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 05:10:45.484470 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-da5e5b6d-df9e-4087-b418-7b49285a7426 admin admin] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 05:10:45.490264 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-da5e5b6d-df9e-4087-b418-7b49285a7426 admin admin] 10.222.0.24 "PUT /v2.0/routers/4119e421-6cb1-4924-9967-18e73a4eeae3/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7644682 Nov 09 05:10:45.497156 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-dcaa2249-1df4-4b40-94ff-19c01fd1437a None None] Provisioning complete for port 165314fc-453c-4fef-bf42-9efd260d1493 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:10:45.497644 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-dcaa2249-1df4-4b40-94ff-19c01fd1437a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:45.533508 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-dcaa2249-1df4-4b40-94ff-19c01fd1437a None None] Port 165314fc-453c-4fef-bf42-9efd260d1493 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 05:10:46.182316 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 37696) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:10:46.187688 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-5b89a51b-671a-4f88-995a-28575b9e0d34 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-1268500813-network', 'tenant_id': 'e2046a90eaa74271a16949e08ce6507e'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:10:46.251300 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5b89a51b-671a-4f88-995a-28575b9e0d34 admin admin] Made reservation on behalf of e2046a90eaa74271a16949e08ce6507e for: {'network': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 05:10:46.254215 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5b89a51b-671a-4f88-995a-28575b9e0d34 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:46.265538 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5b89a51b-671a-4f88-995a-28575b9e0d34 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:46.341093 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5b89a51b-671a-4f88-995a-28575b9e0d34 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:46.415549 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5b89a51b-671a-4f88-995a-28575b9e0d34 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:46.440961 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5b89a51b-671a-4f88-995a-28575b9e0d34 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 310} {{(pid=102162) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 05:10:46.453626 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b89a51b-671a-4f88-995a-28575b9e0d34 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8bbda0e9-121d-4188-8ec8-e65e6ac9b8d4,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:10:46.459679 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5b89a51b-671a-4f88-995a-28575b9e0d34 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:46.459862 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 5204f9e0-7d71-4dee-997d-b68078c7a10f up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:10:46.460101 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.segments_db [None req-5b89a51b-671a-4f88-995a-28575b9e0d34 admin admin] Added segment 427bac9b-3a53-470d-af69-12c1d54ff678 of type vlan for network af03aad1-f784-4a70-ae82-2bede3b275e0 Nov 09 05:10:46.504476 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5b89a51b-671a-4f88-995a-28575b9e0d34 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:46.509878 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 5204f9e0-7d71-4dee-997d-b68078c7a10f triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:10:46.510391 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:46.585205 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ff73c745-6160-4696-970d-d2aea13d0711 None None] Sync routers for ids ['4119e421-6cb1-4924-9967-18e73a4eeae3'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 05:10:46.593385 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5b89a51b-671a-4f88-995a-28575b9e0d34 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:46.594490 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5b89a51b-671a-4f88-995a-28575b9e0d34 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:10:46.595104 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5b89a51b-671a-4f88-995a-28575b9e0d34 admin admin] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:46.612412 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:46.617962 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ff73c745-6160-4696-970d-d2aea13d0711 None None] Routers {'4119e421-6cb1-4924-9967-18e73a4eeae3'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:10:46.618587 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-ff73c745-6160-4696-970d-d2aea13d0711 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:10:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['4119e421-6cb1-4924-9967-18e73a4eeae3'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:10:46.652961 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b89a51b-671a-4f88-995a-28575b9e0d34 admin admin] Pushing event updated for resources: {'Network': ['ID=af03aad1-f784-4a70-ae82-2bede3b275e0,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:10:46.668413 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network af03aad1-f784-4a70-ae82-2bede3b275e0 details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 05:10:46.671449 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 5204f9e0-7d71-4dee-997d-b68078c7a10f, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=5204f9e0-7d71-4dee-997d-b68078c7a10f,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:10:46.699469 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:46.710340 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-5b89a51b-671a-4f88-995a-28575b9e0d34 admin admin] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.5268035 Nov 09 05:10:46.713134 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 37698) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:10:46.717958 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-6bbd9637-a517-43ab-bbd9-a210f23c29b0 admin admin] Request body: {'subnet': {'network_id': 'af03aad1-f784-4a70-ae82-2bede3b275e0', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-1268500813-subnet', 'tenant_id': 'e2046a90eaa74271a16949e08ce6507e', 'ip_version': 4}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:10:46.758887 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:46.805835 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6bbd9637-a517-43ab-bbd9-a210f23c29b0 admin admin] Made reservation on behalf of e2046a90eaa74271a16949e08ce6507e for: {'subnet': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 05:10:46.808274 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6bbd9637-a517-43ab-bbd9-a210f23c29b0 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5794344'] for subnet, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:46.986237 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-ff73c745-6160-4696-970d-d2aea13d0711 None None] Set router 4119e421-6cb1-4924-9967-18e73a4eeae3 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:10:47.024858 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=5204f9e0-7d71-4dee-997d-b68078c7a10f,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:10:47.045502 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6bbd9637-a517-43ab-bbd9-a210f23c29b0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5729813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5794770'] for subnet, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:47.069174 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:47.098787 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bbd9637-a517-43ab-bbd9-a210f23c29b0 admin admin] Pushing event updated for resources: {'Subnet': ['ID=abdf4487-51ee-478e-8096-167f92236ef6,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:10:47.110928 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6bbd9637-a517-43ab-bbd9-a210f23c29b0 admin admin] Checking segment: {'id': '427bac9b-3a53-470d-af69-12c1d54ff678', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': 'af03aad1-f784-4a70-ae82-2bede3b275e0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 05:10:47.111284 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6bbd9637-a517-43ab-bbd9-a210f23c29b0 admin admin] Network hostable DHCP agents. Network: af03aad1-f784-4a70-ae82-2bede3b275e0, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102162) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 05:10:47.165697 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6bbd9637-a517-43ab-bbd9-a210f23c29b0 admin admin] Network af03aad1-f784-4a70-ae82-2bede3b275e0 is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102162) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 05:10:47.197127 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-ff73c745-6160-4696-970d-d2aea13d0711 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'name': 'tempest-TestShelveInstance-1961526497-router', 'tenant_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.251'}], 'enable_snat': True}, 'gw_port_id': '5204f9e0-7d71-4dee-997d-b68078c7a10f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:10:41Z', 'updated_at': '2021-11-09T05:10:44Z', 'revision_number': 4, 'project_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'gw_port': {'id': '5204f9e0-7d71-4dee-997d-b68078c7a10f', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:88:c0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1808, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.251', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:10:42Z', 'updated_at': '2021-11-09T05:10:44Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '165314fc-453c-4fef-bf42-9efd260d1493', 'name': '', 'network_id': '41e1a505-f3a3-418f-9229-3880f4333c14', 'tenant_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'mac_address': 'fa:16:3e:7d:79:b9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'device_owner': 'network:router_interface', 'standard_attr_id': 1809, 'fixed_ips': [{'subnet_id': 'abf74659-fa86-43c8-a52c-7b696adbf35a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:10:44Z', 'updated_at': '2021-11-09T05:10:44Z', 'revision_number': 2, 'project_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'subnets': [{'id': 'abf74659-fa86-43c8-a52c-7b696adbf35a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:10:47.228466 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ff73c745-6160-4696-970d-d2aea13d0711 None None] Checking router: 4119e421-6cb1-4924-9967-18e73a4eeae3 for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 05:10:47.228738 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ff73c745-6160-4696-970d-d2aea13d0711 None None] Updating router 4119e421-6cb1-4924-9967-18e73a4eeae3 port 165314fc-453c-4fef-bf42-9efd260d1493 binding host dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 05:10:47.239171 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-6bbd9637-a517-43ab-bbd9-a210f23c29b0 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, af03aad1-f784-4a70-ae82-2bede3b275e0) {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:10:47.243196 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6bbd9637-a517-43ab-bbd9-a210f23c29b0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:10:47.243851 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6bbd9637-a517-43ab-bbd9-a210f23c29b0 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:47.249670 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7e398f21-3e58-4db0-a61a-85311d731118 None None] Network af03aad1-f784-4a70-ae82-2bede3b275e0 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 05:10:47.277486 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ff73c745-6160-4696-970d-d2aea13d0711 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:47.323232 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-6bbd9637-a517-43ab-bbd9-a210f23c29b0 admin admin] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.6090336 Nov 09 05:10:47.325844 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 37700) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:10:47.330533 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-0ae794b7-8cea-4405-b0fa-a402f58c8070 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-1268500813-router', 'tenant_id': 'e2046a90eaa74271a16949e08ce6507e', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:10:47.417066 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0ae794b7-8cea-4405-b0fa-a402f58c8070 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:47.418129 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0ae794b7-8cea-4405-b0fa-a402f58c8070 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:47.474672 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0ae794b7-8cea-4405-b0fa-a402f58c8070 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:47.531590 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f28a0e92-fa67-4fad-a817-4ea1898200d5 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-af03aad1-f784-4a70-ae82-2bede3b275e0', 'network_id': 'af03aad1-f784-4a70-ae82-2bede3b275e0', 'tenant_id': 'e2046a90eaa74271a16949e08ce6507e', 'fixed_ips': [{'subnet_id': 'abdf4487-51ee-478e-8096-167f92236ef6'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 05:10:47.532428 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f28a0e92-fa67-4fad-a817-4ea1898200d5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:47.662967 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0ae794b7-8cea-4405-b0fa-a402f58c8070 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:47.735056 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-f28a0e92-fa67-4fad-a817-4ea1898200d5 None None] Allocated IP 172.20.0.2 (af03aad1-f784-4a70-ae82-2bede3b275e0/abdf4487-51ee-478e-8096-167f92236ef6/b318b080-2cb9-40a5-b57c-6a6647fba455) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 05:10:47.743226 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ff73c745-6160-4696-970d-d2aea13d0711 None None] Publish callbacks [] for port, precommit_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:47.819909 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ff73c745-6160-4696-970d-d2aea13d0711 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:47.910564 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87069510-3078-4792-8213-b39abdce77fe None None] Pushing event updated for resources: {'Port': ['ID=165314fc-453c-4fef-bf42-9efd260d1493,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:10:47.963480 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f28a0e92-fa67-4fad-a817-4ea1898200d5 None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:47.967085 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0ae794b7-8cea-4405-b0fa-a402f58c8070 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:47.978720 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-ff73c745-6160-4696-970d-d2aea13d0711 None None] Attempting to bind port 165314fc-453c-4fef-bf42-9efd260d1493 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 05:10:47.979090 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-ff73c745-6160-4696-970d-d2aea13d0711 None None] Attempting to bind port 165314fc-453c-4fef-bf42-9efd260d1493 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '0a75612c-c02a-4294-901e-f7bbf1a2b310', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 326, 'network_id': '41e1a505-f3a3-418f-9229-3880f4333c14'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 05:10:47.979707 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ff73c745-6160-4696-970d-d2aea13d0711 None None] Attempting to bind port 165314fc-453c-4fef-bf42-9efd260d1493 on network 41e1a505-f3a3-418f-9229-3880f4333c14 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 05:10:47.985205 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ff73c745-6160-4696-970d-d2aea13d0711 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 5, 10, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 05:10:47.985576 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ff73c745-6160-4696-970d-d2aea13d0711 None None] Checking segment: {'id': '0a75612c-c02a-4294-901e-f7bbf1a2b310', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 326, 'network_id': '41e1a505-f3a3-418f-9229-3880f4333c14'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 05:10:47.985978 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ff73c745-6160-4696-970d-d2aea13d0711 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:47.986397 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ff73c745-6160-4696-970d-d2aea13d0711 None None] Bound using segment: {'id': '0a75612c-c02a-4294-901e-f7bbf1a2b310', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 326, 'network_id': '41e1a505-f3a3-418f-9229-3880f4333c14'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 05:10:47.986859 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-ff73c745-6160-4696-970d-d2aea13d0711 None None] Bound port: 165314fc-453c-4fef-bf42-9efd260d1493, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0a75612c-c02a-4294-901e-f7bbf1a2b310', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 326, 'network_id': '41e1a505-f3a3-418f-9229-3880f4333c14'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 05:10:47.987233 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ff73c745-6160-4696-970d-d2aea13d0711 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:47.989813 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0ae794b7-8cea-4405-b0fa-a402f58c8070 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:48.047558 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f28a0e92-fa67-4fad-a817-4ea1898200d5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:48.083266 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-ff73c745-6160-4696-970d-d2aea13d0711 None None] For port 165314fc-453c-4fef-bf42-9efd260d1493, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 05:10:48.106878 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f28a0e92-fa67-4fad-a817-4ea1898200d5 None None] Network af03aad1-f784-4a70-ae82-2bede3b275e0 is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:10:48.107403 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-0ae794b7-8cea-4405-b0fa-a402f58c8070 admin admin] Allocated IP 172.26.0.224 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/0a66f250-0e46-4c8e-90c9-9004293b7728) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 05:10:48.110067 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-ff73c745-6160-4696-970d-d2aea13d0711 None None] For port 165314fc-453c-4fef-bf42-9efd260d1493, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=165314fc-453c-4fef-bf42-9efd260d1493,segment=NetworkSegment(0a75612c-c02a-4294-901e-f7bbf1a2b310),segment_id=0a75612c-c02a-4294-901e-f7bbf1a2b310)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 05:10:48.113984 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-f28a0e92-fa67-4fad-a817-4ea1898200d5 None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:10:48.116026 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f28a0e92-fa67-4fad-a817-4ea1898200d5 None None] Pushing event updated for resources: {'Port': ['ID=b318b080-2cb9-40a5-b57c-6a6647fba455,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:10:48.118919 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f28a0e92-fa67-4fad-a817-4ea1898200d5 None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 05:10:48.179033 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ff73c745-6160-4696-970d-d2aea13d0711 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:48.183472 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-f28a0e92-fa67-4fad-a817-4ea1898200d5 None None] Attempting to bind port b318b080-2cb9-40a5-b57c-6a6647fba455 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 05:10:48.183830 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-f28a0e92-fa67-4fad-a817-4ea1898200d5 None None] Attempting to bind port b318b080-2cb9-40a5-b57c-6a6647fba455 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '427bac9b-3a53-470d-af69-12c1d54ff678', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': 'af03aad1-f784-4a70-ae82-2bede3b275e0'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 05:10:48.184185 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f28a0e92-fa67-4fad-a817-4ea1898200d5 None None] Attempting to bind port b318b080-2cb9-40a5-b57c-6a6647fba455 on network af03aad1-f784-4a70-ae82-2bede3b275e0 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 05:10:48.217636 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f28a0e92-fa67-4fad-a817-4ea1898200d5 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 5, 10, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 05:10:48.217999 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f28a0e92-fa67-4fad-a817-4ea1898200d5 None None] Checking segment: {'id': '427bac9b-3a53-470d-af69-12c1d54ff678', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': 'af03aad1-f784-4a70-ae82-2bede3b275e0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 05:10:48.218426 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f28a0e92-fa67-4fad-a817-4ea1898200d5 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:48.218814 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f28a0e92-fa67-4fad-a817-4ea1898200d5 None None] Bound using segment: {'id': '427bac9b-3a53-470d-af69-12c1d54ff678', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': 'af03aad1-f784-4a70-ae82-2bede3b275e0'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 05:10:48.219289 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-f28a0e92-fa67-4fad-a817-4ea1898200d5 None None] Bound port: b318b080-2cb9-40a5-b57c-6a6647fba455, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '427bac9b-3a53-470d-af69-12c1d54ff678', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': 'af03aad1-f784-4a70-ae82-2bede3b275e0'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 05:10:48.219665 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f28a0e92-fa67-4fad-a817-4ea1898200d5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:48.223568 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-cf90e355-3d70-4072-897d-b4eee0ac1d3a None None] Provisioning complete for port 165314fc-453c-4fef-bf42-9efd260d1493 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:10:48.223924 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-cf90e355-3d70-4072-897d-b4eee0ac1d3a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:48.313917 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87069510-3078-4792-8213-b39abdce77fe None None] Pushing event updated for resources: {'Port': ['ID=165314fc-453c-4fef-bf42-9efd260d1493,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:10:48.327691 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ff73c745-6160-4696-970d-d2aea13d0711 None None] Routers {'4119e421-6cb1-4924-9967-18e73a4eeae3'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:10:48.327691 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-ff73c745-6160-4696-970d-d2aea13d0711 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:10:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['4119e421-6cb1-4924-9967-18e73a4eeae3'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:10:48.415761 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-f28a0e92-fa67-4fad-a817-4ea1898200d5 None None] For port b318b080-2cb9-40a5-b57c-6a6647fba455, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 05:10:48.460725 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-f28a0e92-fa67-4fad-a817-4ea1898200d5 None None] For port b318b080-2cb9-40a5-b57c-6a6647fba455, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=b318b080-2cb9-40a5-b57c-6a6647fba455,segment=NetworkSegment(427bac9b-3a53-470d-af69-12c1d54ff678),segment_id=427bac9b-3a53-470d-af69-12c1d54ff678)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 05:10:48.484381 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 5204f9e0-7d71-4dee-997d-b68078c7a10f up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:10:48.510744 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0ae794b7-8cea-4405-b0fa-a402f58c8070 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:48.538807 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-cf90e355-3d70-4072-897d-b4eee0ac1d3a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:48.561346 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-ff73c745-6160-4696-970d-d2aea13d0711 None None] Set router 4119e421-6cb1-4924-9967-18e73a4eeae3 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:10:48.564798 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f28a0e92-fa67-4fad-a817-4ea1898200d5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:48.611252 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0ae794b7-8cea-4405-b0fa-a402f58c8070 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:48.647961 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0ae794b7-8cea-4405-b0fa-a402f58c8070 admin admin] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:10:48.651404 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-0ae794b7-8cea-4405-b0fa-a402f58c8070 admin admin] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:10:48.661933 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0ae794b7-8cea-4405-b0fa-a402f58c8070 admin admin] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 05:10:48.687404 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ae794b7-8cea-4405-b0fa-a402f58c8070 admin admin] Pushing event updated for resources: {'Port': ['ID=0a66f250-0e46-4c8e-90c9-9004293b7728,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:10:48.874378 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-cf90e355-3d70-4072-897d-b4eee0ac1d3a None None] For port 165314fc-453c-4fef-bf42-9efd260d1493, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=165314fc-453c-4fef-bf42-9efd260d1493,segment=NetworkSegment(0a75612c-c02a-4294-901e-f7bbf1a2b310),segment_id=0a75612c-c02a-4294-901e-f7bbf1a2b310)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:10:48.892399 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f28a0e92-fa67-4fad-a817-4ea1898200d5 None None] Pushing event updated for resources: {'Port': ['ID=b318b080-2cb9-40a5-b57c-6a6647fba455,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:10:48.920341 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 5204f9e0-7d71-4dee-997d-b68078c7a10f triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:10:48.920710 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:48.980901 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-cf90e355-3d70-4072-897d-b4eee0ac1d3a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:49.051009 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0ae794b7-8cea-4405-b0fa-a402f58c8070 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:49.109278 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf90e355-3d70-4072-897d-b4eee0ac1d3a None None] Pushing event updated for resources: {'Port': ['ID=165314fc-453c-4fef-bf42-9efd260d1493,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:10:49.141933 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e9bc125d-40a4-4982-958a-33218bf4bc75 None None] Provisioning complete for port 165314fc-453c-4fef-bf42-9efd260d1493 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:10:49.146714 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e9bc125d-40a4-4982-958a-33218bf4bc75 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:49.195017 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-ff73c745-6160-4696-970d-d2aea13d0711 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'name': 'tempest-TestShelveInstance-1961526497-router', 'tenant_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.251'}], 'enable_snat': True}, 'gw_port_id': '5204f9e0-7d71-4dee-997d-b68078c7a10f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:10:41Z', 'updated_at': '2021-11-09T05:10:44Z', 'revision_number': 4, 'project_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'gw_port': {'id': '5204f9e0-7d71-4dee-997d-b68078c7a10f', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:88:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1808, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.251', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:10:42Z', 'updated_at': '2021-11-09T05:10:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '165314fc-453c-4fef-bf42-9efd260d1493', 'name': '', 'network_id': '41e1a505-f3a3-418f-9229-3880f4333c14', 'tenant_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'mac_address': 'fa:16:3e:7d:79:b9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'device_owner': 'network:router_interface', 'standard_attr_id': 1809, 'fixed_ips': [{'subnet_id': 'abf74659-fa86-43c8-a52c-7b696adbf35a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:10:44Z', 'updated_at': '2021-11-09T05:10:48Z', 'revision_number': 4, 'project_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'subnets': [{'id': 'abf74659-fa86-43c8-a52c-7b696adbf35a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:10:49.226623 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ff73c745-6160-4696-970d-d2aea13d0711 None None] The sync data for ids ['4119e421-6cb1-4924-9967-18e73a4eeae3'] in dv-neutron-816802-2-hyperv is: [{'id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'name': 'tempest-TestShelveInstance-1961526497-router', 'tenant_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.251'}], 'enable_snat': True}, 'gw_port_id': '5204f9e0-7d71-4dee-997d-b68078c7a10f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:10:41Z', 'updated_at': '2021-11-09T05:10:44Z', 'revision_number': 4, 'project_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'gw_port': {'id': '5204f9e0-7d71-4dee-997d-b68078c7a10f', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:88:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1808, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.251', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:10:42Z', 'updated_at': '2021-11-09T05:10:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '165314fc-453c-4fef-bf42-9efd260d1493', 'name': '', 'network_id': '41e1a505-f3a3-418f-9229-3880f4333c14', 'tenant_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'mac_address': 'fa:16:3e:7d:79:b9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'device_owner': 'network:router_interface', 'standard_attr_id': 1809, 'fixed_ips': [{'subnet_id': 'abf74659-fa86-43c8-a52c-7b696adbf35a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:10:44Z', 'updated_at': '2021-11-09T05:10:48Z', 'revision_number': 4, 'project_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'subnets': [{'id': 'abf74659-fa86-43c8-a52c-7b696adbf35a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 05:10:49.308432 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0ae794b7-8cea-4405-b0fa-a402f58c8070 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:49.548108 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0ae794b7-8cea-4405-b0fa-a402f58c8070 admin admin] Router 91dd8d79-6212-4914-b31e-8b09f14ad8bd is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102161) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 05:10:49.647641 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c358aa36-cbd4-4b4a-8e2e-59ec7305b29b None None] Network af03aad1-f784-4a70-ae82-2bede3b275e0 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 05:10:49.664952 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0ae794b7-8cea-4405-b0fa-a402f58c8070 admin admin] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 05:10:49.677420 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-047decb6-7dcc-4083-8018-e6092cb3600a None None] Sync routers for ids ['91dd8d79-6212-4914-b31e-8b09f14ad8bd'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 05:10:49.688099 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-047decb6-7dcc-4083-8018-e6092cb3600a None None] Routers {'91dd8d79-6212-4914-b31e-8b09f14ad8bd'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:10:49.688916 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-047decb6-7dcc-4083-8018-e6092cb3600a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:10:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['91dd8d79-6212-4914-b31e-8b09f14ad8bd'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:10:49.733492 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-0ae794b7-8cea-4405-b0fa-a402f58c8070 admin admin] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:49.737586 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-0ae794b7-8cea-4405-b0fa-a402f58c8070 admin admin] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 921 time: 2.4080787 Nov 09 05:10:49.738386 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 37702) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:10:49.738753 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-19716398-3174-4764-b5ce-fe60af2a6335 None None] Provisioning complete for port b318b080-2cb9-40a5-b57c-6a6647fba455 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:10:49.739124 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-19716398-3174-4764-b5ce-fe60af2a6335 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:49.825240 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-047decb6-7dcc-4083-8018-e6092cb3600a None None] Set router 91dd8d79-6212-4914-b31e-8b09f14ad8bd gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:10:49.935901 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-19716398-3174-4764-b5ce-fe60af2a6335 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:50.005153 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-19716398-3174-4764-b5ce-fe60af2a6335 None None] For port b318b080-2cb9-40a5-b57c-6a6647fba455, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=b318b080-2cb9-40a5-b57c-6a6647fba455,segment=NetworkSegment(427bac9b-3a53-470d-af69-12c1d54ff678),segment_id=427bac9b-3a53-470d-af69-12c1d54ff678)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:10:50.038099 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-047decb6-7dcc-4083-8018-e6092cb3600a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '91dd8d79-6212-4914-b31e-8b09f14ad8bd', 'name': 'tempest-TestShelveInstance-1268500813-router', 'tenant_id': 'e2046a90eaa74271a16949e08ce6507e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.224'}], 'enable_snat': True}, 'gw_port_id': '0a66f250-0e46-4c8e-90c9-9004293b7728', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:10:47Z', 'updated_at': '2021-11-09T05:10:48Z', 'revision_number': 3, 'project_id': 'e2046a90eaa74271a16949e08ce6507e', 'gw_port': {'id': '0a66f250-0e46-4c8e-90c9-9004293b7728', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:b5:e4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '91dd8d79-6212-4914-b31e-8b09f14ad8bd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1820, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:10:47Z', 'updated_at': '2021-11-09T05:10:48Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:10:50.077178 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-047decb6-7dcc-4083-8018-e6092cb3600a None None] Checking router: 91dd8d79-6212-4914-b31e-8b09f14ad8bd for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 05:10:50.077661 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-047decb6-7dcc-4083-8018-e6092cb3600a None None] Updating router 91dd8d79-6212-4914-b31e-8b09f14ad8bd port 0a66f250-0e46-4c8e-90c9-9004293b7728 binding host dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 05:10:50.079715 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-19716398-3174-4764-b5ce-fe60af2a6335 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:50.110882 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-047decb6-7dcc-4083-8018-e6092cb3600a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:50.169480 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19716398-3174-4764-b5ce-fe60af2a6335 None None] Pushing event updated for resources: {'Port': ['ID=b318b080-2cb9-40a5-b57c-6a6647fba455,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:10:50.200467 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-ab6a01e9-f8be-424a-a9dd-1edbcaa7cb93 None None] Provisioning complete for port b318b080-2cb9-40a5-b57c-6a6647fba455 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:10:50.201274 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ab6a01e9-f8be-424a-a9dd-1edbcaa7cb93 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:50.307490 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-876b56b3-ab9d-4baf-95bc-d9c331f6e68a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:50.414423 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-047decb6-7dcc-4083-8018-e6092cb3600a None None] Publish callbacks [] for port, precommit_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:50.448710 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 05:10:50.508799 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-876b56b3-ab9d-4baf-95bc-d9c331f6e68a admin admin] Allocated IP 172.20.0.1 (af03aad1-f784-4a70-ae82-2bede3b275e0/abdf4487-51ee-478e-8096-167f92236ef6/98221fb7-a97e-48d8-8c23-9a65ee0ff9bb) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 05:10:50.519380 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device b318b080-2cb9-40a5-b57c-6a6647fba455 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:10:50.528219 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-047decb6-7dcc-4083-8018-e6092cb3600a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:50.577151 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port b318b080-2cb9-40a5-b57c-6a6647fba455 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:10:50.577517 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:50.590368 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-047decb6-7dcc-4083-8018-e6092cb3600a None None] Attempting to bind port 0a66f250-0e46-4c8e-90c9-9004293b7728 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 05:10:50.590736 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-047decb6-7dcc-4083-8018-e6092cb3600a None None] Attempting to bind port 0a66f250-0e46-4c8e-90c9-9004293b7728 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 05:10:50.591087 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-047decb6-7dcc-4083-8018-e6092cb3600a None None] Attempting to bind port 0a66f250-0e46-4c8e-90c9-9004293b7728 on network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 05:10:50.600080 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22eb37ec-f33a-4d84-8578-e8c99834414c None None] Pushing event updated for resources: {'Port': ['ID=0a66f250-0e46-4c8e-90c9-9004293b7728,revision_number=2']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:10:50.604306 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-047decb6-7dcc-4083-8018-e6092cb3600a None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 5, 10, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 05:10:50.604936 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-047decb6-7dcc-4083-8018-e6092cb3600a None None] Checking segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102164) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 05:10:50.605626 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-047decb6-7dcc-4083-8018-e6092cb3600a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:50.606001 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-047decb6-7dcc-4083-8018-e6092cb3600a None None] Bound using segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 05:10:50.606490 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-047decb6-7dcc-4083-8018-e6092cb3600a None None] Bound port: 0a66f250-0e46-4c8e-90c9-9004293b7728, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 05:10:50.606862 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-047decb6-7dcc-4083-8018-e6092cb3600a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:50.630069 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-876b56b3-ab9d-4baf-95bc-d9c331f6e68a admin admin] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:50.659307 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 165314fc-453c-4fef-bf42-9efd260d1493 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:10:50.660617 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-047decb6-7dcc-4083-8018-e6092cb3600a None None] For port 0a66f250-0e46-4c8e-90c9-9004293b7728, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102164) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 05:10:50.663695 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-047decb6-7dcc-4083-8018-e6092cb3600a None None] For port 0a66f250-0e46-4c8e-90c9-9004293b7728, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=0a66f250-0e46-4c8e-90c9-9004293b7728,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102164) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 05:10:50.704659 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 165314fc-453c-4fef-bf42-9efd260d1493 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:10:50.705030 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:50.727987 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-876b56b3-ab9d-4baf-95bc-d9c331f6e68a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:50.736945 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-047decb6-7dcc-4083-8018-e6092cb3600a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:50.767930 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-876b56b3-ab9d-4baf-95bc-d9c331f6e68a admin admin] Network af03aad1-f784-4a70-ae82-2bede3b275e0 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:10:50.775336 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-876b56b3-ab9d-4baf-95bc-d9c331f6e68a admin admin] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:10:50.779759 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-876b56b3-ab9d-4baf-95bc-d9c331f6e68a admin admin] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 05:10:50.782855 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-876b56b3-ab9d-4baf-95bc-d9c331f6e68a admin admin] Pushing event updated for resources: {'Port': ['ID=98221fb7-a97e-48d8-8c23-9a65ee0ff9bb,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:10:50.797154 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-047decb6-7dcc-4083-8018-e6092cb3600a None None] Routers {'91dd8d79-6212-4914-b31e-8b09f14ad8bd'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:10:50.797858 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-047decb6-7dcc-4083-8018-e6092cb3600a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:10:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['91dd8d79-6212-4914-b31e-8b09f14ad8bd'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:10:50.819469 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-876b56b3-ab9d-4baf-95bc-d9c331f6e68a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:50.938742 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22eb37ec-f33a-4d84-8578-e8c99834414c None None] Pushing event updated for resources: {'Port': ['ID=0a66f250-0e46-4c8e-90c9-9004293b7728,revision_number=3']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:10:51.006862 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-047decb6-7dcc-4083-8018-e6092cb3600a None None] Set router 91dd8d79-6212-4914-b31e-8b09f14ad8bd gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:10:51.023646 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-876b56b3-ab9d-4baf-95bc-d9c331f6e68a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:51.029829 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-9abd58fc-b2a7-4cbf-98fe-262b7e91b463 None None] Provisioning complete for port 98221fb7-a97e-48d8-8c23-9a65ee0ff9bb triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:10:51.030195 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9abd58fc-b2a7-4cbf-98fe-262b7e91b463 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:51.077963 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-9abd58fc-b2a7-4cbf-98fe-262b7e91b463 None None] Port 98221fb7-a97e-48d8-8c23-9a65ee0ff9bb cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 05:10:51.190980 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-876b56b3-ab9d-4baf-95bc-d9c331f6e68a admin admin] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:51.192056 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-047decb6-7dcc-4083-8018-e6092cb3600a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '91dd8d79-6212-4914-b31e-8b09f14ad8bd', 'name': 'tempest-TestShelveInstance-1268500813-router', 'tenant_id': 'e2046a90eaa74271a16949e08ce6507e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.224'}], 'enable_snat': True}, 'gw_port_id': '0a66f250-0e46-4c8e-90c9-9004293b7728', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:10:47Z', 'updated_at': '2021-11-09T05:10:48Z', 'revision_number': 3, 'project_id': 'e2046a90eaa74271a16949e08ce6507e', 'gw_port': {'id': '0a66f250-0e46-4c8e-90c9-9004293b7728', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:b5:e4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '91dd8d79-6212-4914-b31e-8b09f14ad8bd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1820, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:10:47Z', 'updated_at': '2021-11-09T05:10:50Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:10:51.217434 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-047decb6-7dcc-4083-8018-e6092cb3600a None None] The sync data for ids ['91dd8d79-6212-4914-b31e-8b09f14ad8bd'] in dv-neutron-816802-2-hyperv is: [{'id': '91dd8d79-6212-4914-b31e-8b09f14ad8bd', 'name': 'tempest-TestShelveInstance-1268500813-router', 'tenant_id': 'e2046a90eaa74271a16949e08ce6507e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.224'}], 'enable_snat': True}, 'gw_port_id': '0a66f250-0e46-4c8e-90c9-9004293b7728', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:10:47Z', 'updated_at': '2021-11-09T05:10:48Z', 'revision_number': 3, 'project_id': 'e2046a90eaa74271a16949e08ce6507e', 'gw_port': {'id': '0a66f250-0e46-4c8e-90c9-9004293b7728', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:b5:e4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '91dd8d79-6212-4914-b31e-8b09f14ad8bd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1820, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:10:47Z', 'updated_at': '2021-11-09T05:10:50Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 05:10:51.256581 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-876b56b3-ab9d-4baf-95bc-d9c331f6e68a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:51.325992 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-876b56b3-ab9d-4baf-95bc-d9c331f6e68a admin admin] Pushing event updated for resources: {'Port': ['ID=98221fb7-a97e-48d8-8c23-9a65ee0ff9bb,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:10:51.328394 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-876b56b3-ab9d-4baf-95bc-d9c331f6e68a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:51.437911 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-876b56b3-ab9d-4baf-95bc-d9c331f6e68a admin admin] Network af03aad1-f784-4a70-ae82-2bede3b275e0 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:10:51.440293 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-876b56b3-ab9d-4baf-95bc-d9c331f6e68a admin admin] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:10:51.572308 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-876b56b3-ab9d-4baf-95bc-d9c331f6e68a admin admin] Router 91dd8d79-6212-4914-b31e-8b09f14ad8bd has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 05:10:51.698066 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-876b56b3-ab9d-4baf-95bc-d9c331f6e68a admin admin] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 05:10:51.703202 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-876b56b3-ab9d-4baf-95bc-d9c331f6e68a admin admin] 10.222.0.24 "PUT /v2.0/routers/91dd8d79-6212-4914-b31e-8b09f14ad8bd/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.9641604 Nov 09 05:10:51.705715 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-f335e5a7-f94d-45e3-830b-5235caa9701f None None] Provisioning complete for port 98221fb7-a97e-48d8-8c23-9a65ee0ff9bb triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:10:51.706845 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f335e5a7-f94d-45e3-830b-5235caa9701f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:51.743337 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-f335e5a7-f94d-45e3-830b-5235caa9701f None None] Port 98221fb7-a97e-48d8-8c23-9a65ee0ff9bb cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 05:10:52.463007 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 0a66f250-0e46-4c8e-90c9-9004293b7728 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:10:52.483533 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 37710) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:10:52.488147 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-482e4dff-7ffc-44ca-b75c-a4eace72a306 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-948931925', 'description': 'tempest-secgroup-smoke-948931925 description', 'project_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:10:52.513416 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 0a66f250-0e46-4c8e-90c9-9004293b7728 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:10:52.513844 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:52.554615 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-482e4dff-7ffc-44ca-b75c-a4eace72a306 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:52.595072 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:52.617884 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 0a66f250-0e46-4c8e-90c9-9004293b7728, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=0a66f250-0e46-4c8e-90c9-9004293b7728,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:10:52.623743 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-482e4dff-7ffc-44ca-b75c-a4eace72a306 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:52.665430 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:52.690388 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-482e4dff-7ffc-44ca-b75c-a4eace72a306 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:52.690659 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7c23dabe-3e24-4c53-9e88-5c84d5d825f6 None None] Sync routers for ids ['91dd8d79-6212-4914-b31e-8b09f14ad8bd'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 05:10:52.718663 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7c23dabe-3e24-4c53-9e88-5c84d5d825f6 None None] Routers {'91dd8d79-6212-4914-b31e-8b09f14ad8bd'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:10:52.719380 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-7c23dabe-3e24-4c53-9e88-5c84d5d825f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:10:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['91dd8d79-6212-4914-b31e-8b09f14ad8bd'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:10:52.723631 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-482e4dff-7ffc-44ca-b75c-a4eace72a306 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f6e88f2d-5816-42d2-b751-48bf5e018795,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:10:52.763218 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=0a66f250-0e46-4c8e-90c9-9004293b7728,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:10:52.790969 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-482e4dff-7ffc-44ca-b75c-a4eace72a306 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:52.792258 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-482e4dff-7ffc-44ca-b75c-a4eace72a306 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.3077197 Nov 09 05:10:52.795279 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 37712) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:10:52.799563 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-1e17a7e3-66b8-49ef-bd4f-9f42bf37dc21 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Request body: {'security_group_rule': {'security_group_id': 'f6e88f2d-5816-42d2-b751-48bf5e018795', 'project_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:10:52.832271 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-7c23dabe-3e24-4c53-9e88-5c84d5d825f6 None None] Set router 91dd8d79-6212-4914-b31e-8b09f14ad8bd gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:10:52.896217 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1e17a7e3-66b8-49ef-bd4f-9f42bf37dc21 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:52.950771 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1e17a7e3-66b8-49ef-bd4f-9f42bf37dc21 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:53.028176 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-7c23dabe-3e24-4c53-9e88-5c84d5d825f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '91dd8d79-6212-4914-b31e-8b09f14ad8bd', 'name': 'tempest-TestShelveInstance-1268500813-router', 'tenant_id': 'e2046a90eaa74271a16949e08ce6507e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.224'}], 'enable_snat': True}, 'gw_port_id': '0a66f250-0e46-4c8e-90c9-9004293b7728', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:10:47Z', 'updated_at': '2021-11-09T05:10:50Z', 'revision_number': 4, 'project_id': 'e2046a90eaa74271a16949e08ce6507e', 'gw_port': {'id': '0a66f250-0e46-4c8e-90c9-9004293b7728', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:b5:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '91dd8d79-6212-4914-b31e-8b09f14ad8bd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1820, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:10:47Z', 'updated_at': '2021-11-09T05:10:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '98221fb7-a97e-48d8-8c23-9a65ee0ff9bb', 'name': '', 'network_id': 'af03aad1-f784-4a70-ae82-2bede3b275e0', 'tenant_id': 'e2046a90eaa74271a16949e08ce6507e', 'mac_address': 'fa:16:3e:fb:fb:bf', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '91dd8d79-6212-4914-b31e-8b09f14ad8bd', 'device_owner': 'network:router_interface', 'standard_attr_id': 1821, 'fixed_ips': [{'subnet_id': 'abdf4487-51ee-478e-8096-167f92236ef6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:10:50Z', 'updated_at': '2021-11-09T05:10:51Z', 'revision_number': 2, 'project_id': 'e2046a90eaa74271a16949e08ce6507e', 'subnets': [{'id': 'abdf4487-51ee-478e-8096-167f92236ef6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:10:53.033762 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1e17a7e3-66b8-49ef-bd4f-9f42bf37dc21 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:53.052890 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e17a7e3-66b8-49ef-bd4f-9f42bf37dc21 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=49166fd9-6dc2-414a-b505-4951a1fa8ac3,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:10:53.057737 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7c23dabe-3e24-4c53-9e88-5c84d5d825f6 None None] Checking router: 91dd8d79-6212-4914-b31e-8b09f14ad8bd for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 05:10:53.058201 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7c23dabe-3e24-4c53-9e88-5c84d5d825f6 None None] Updating router 91dd8d79-6212-4914-b31e-8b09f14ad8bd port 98221fb7-a97e-48d8-8c23-9a65ee0ff9bb binding host dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 05:10:53.081778 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7c23dabe-3e24-4c53-9e88-5c84d5d825f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:53.121464 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-1e17a7e3-66b8-49ef-bd4f-9f42bf37dc21 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:53.122778 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-1e17a7e3-66b8-49ef-bd4f-9f42bf37dc21 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3265574 Nov 09 05:10:53.125474 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 37714) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:10:53.129760 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-67306ae4-9a33-40de-9480-b81708eea509 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Request body: {'security_group_rule': {'security_group_id': 'f6e88f2d-5816-42d2-b751-48bf5e018795', 'project_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:10:53.210029 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-67306ae4-9a33-40de-9480-b81708eea509 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:53.265251 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-67306ae4-9a33-40de-9480-b81708eea509 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:53.325239 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-67306ae4-9a33-40de-9480-b81708eea509 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:53.339101 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7c23dabe-3e24-4c53-9e88-5c84d5d825f6 None None] Publish callbacks [] for port, precommit_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:53.345017 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67306ae4-9a33-40de-9480-b81708eea509 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=048bf2e6-7814-4b63-bac8-82cf57cbc98a,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:10:53.388030 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7c23dabe-3e24-4c53-9e88-5c84d5d825f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:53.420239 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-67306ae4-9a33-40de-9480-b81708eea509 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:53.421235 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-67306ae4-9a33-40de-9480-b81708eea509 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.2948451 Nov 09 05:10:53.424055 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 37716) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:10:53.429038 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-1d1a059f-4ec7-4fac-999d-d9d15cb8052f tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Request body: {'security_group_rule': {'security_group_id': 'f6e88f2d-5816-42d2-b751-48bf5e018795', 'project_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:10:53.436511 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90cab5a2-e50c-4163-8df7-695ea3f9419e None None] Pushing event updated for resources: {'Port': ['ID=98221fb7-a97e-48d8-8c23-9a65ee0ff9bb,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:10:53.496804 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-7c23dabe-3e24-4c53-9e88-5c84d5d825f6 None None] Attempting to bind port 98221fb7-a97e-48d8-8c23-9a65ee0ff9bb on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 05:10:53.497169 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-7c23dabe-3e24-4c53-9e88-5c84d5d825f6 None None] Attempting to bind port 98221fb7-a97e-48d8-8c23-9a65ee0ff9bb by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '427bac9b-3a53-470d-af69-12c1d54ff678', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': 'af03aad1-f784-4a70-ae82-2bede3b275e0'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 05:10:53.497526 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7c23dabe-3e24-4c53-9e88-5c84d5d825f6 None None] Attempting to bind port 98221fb7-a97e-48d8-8c23-9a65ee0ff9bb on network af03aad1-f784-4a70-ae82-2bede3b275e0 {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 05:10:53.502703 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7c23dabe-3e24-4c53-9e88-5c84d5d825f6 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 5, 10, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 05:10:53.503070 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7c23dabe-3e24-4c53-9e88-5c84d5d825f6 None None] Checking segment: {'id': '427bac9b-3a53-470d-af69-12c1d54ff678', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': 'af03aad1-f784-4a70-ae82-2bede3b275e0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 05:10:53.503470 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7c23dabe-3e24-4c53-9e88-5c84d5d825f6 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:53.503858 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7c23dabe-3e24-4c53-9e88-5c84d5d825f6 None None] Bound using segment: {'id': '427bac9b-3a53-470d-af69-12c1d54ff678', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': 'af03aad1-f784-4a70-ae82-2bede3b275e0'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 05:10:53.504322 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-7c23dabe-3e24-4c53-9e88-5c84d5d825f6 None None] Bound port: 98221fb7-a97e-48d8-8c23-9a65ee0ff9bb, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '427bac9b-3a53-470d-af69-12c1d54ff678', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 310, 'network_id': 'af03aad1-f784-4a70-ae82-2bede3b275e0'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 05:10:53.504698 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7c23dabe-3e24-4c53-9e88-5c84d5d825f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:53.547687 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1d1a059f-4ec7-4fac-999d-d9d15cb8052f tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:53.577801 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-7c23dabe-3e24-4c53-9e88-5c84d5d825f6 None None] For port 98221fb7-a97e-48d8-8c23-9a65ee0ff9bb, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 05:10:53.581346 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-7c23dabe-3e24-4c53-9e88-5c84d5d825f6 None None] For port 98221fb7-a97e-48d8-8c23-9a65ee0ff9bb, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=98221fb7-a97e-48d8-8c23-9a65ee0ff9bb,segment=NetworkSegment(427bac9b-3a53-470d-af69-12c1d54ff678),segment_id=427bac9b-3a53-470d-af69-12c1d54ff678)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 05:10:53.610075 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1d1a059f-4ec7-4fac-999d-d9d15cb8052f tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:53.656568 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7c23dabe-3e24-4c53-9e88-5c84d5d825f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:53.690376 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1d1a059f-4ec7-4fac-999d-d9d15cb8052f tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:53.707784 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d1a059f-4ec7-4fac-999d-d9d15cb8052f tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=da0cafb4-85c7-4fa5-92b0-a6b695bcc9ed,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:10:53.712487 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-1e8f9697-b89d-496f-9927-0a0ad1128db2 None None] Provisioning complete for port 98221fb7-a97e-48d8-8c23-9a65ee0ff9bb triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:10:53.712853 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1e8f9697-b89d-496f-9927-0a0ad1128db2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:53.746962 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7c23dabe-3e24-4c53-9e88-5c84d5d825f6 None None] Routers {'91dd8d79-6212-4914-b31e-8b09f14ad8bd'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:10:53.747645 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-7c23dabe-3e24-4c53-9e88-5c84d5d825f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:10:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['91dd8d79-6212-4914-b31e-8b09f14ad8bd'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:10:53.751909 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90cab5a2-e50c-4163-8df7-695ea3f9419e None None] Pushing event updated for resources: {'Port': ['ID=98221fb7-a97e-48d8-8c23-9a65ee0ff9bb,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:10:53.779032 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1d1a059f-4ec7-4fac-999d-d9d15cb8052f tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:53.784377 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1d1a059f-4ec7-4fac-999d-d9d15cb8052f tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3549466 Nov 09 05:10:53.784514 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 37718) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:10:53.788379 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-b02f9363-4267-43b4-add8-4c24eca07fb7 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Request body: {'security_group_rule': {'security_group_id': 'f6e88f2d-5816-42d2-b751-48bf5e018795', 'project_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:10:53.887344 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b02f9363-4267-43b4-add8-4c24eca07fb7 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:53.950899 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b02f9363-4267-43b4-add8-4c24eca07fb7 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:54.000055 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b02f9363-4267-43b4-add8-4c24eca07fb7 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:54.020714 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b02f9363-4267-43b4-add8-4c24eca07fb7 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=04759374-6373-4112-b51d-627980796350,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:10:54.066046 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-7c23dabe-3e24-4c53-9e88-5c84d5d825f6 None None] Set router 91dd8d79-6212-4914-b31e-8b09f14ad8bd gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:10:54.093237 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1e8f9697-b89d-496f-9927-0a0ad1128db2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:54.093419 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b02f9363-4267-43b4-add8-4c24eca07fb7 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:54.094719 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-b02f9363-4267-43b4-add8-4c24eca07fb7 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3099241 Nov 09 05:10:54.097484 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 37720) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:10:54.102433 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-0f95bdfb-c038-4583-b67d-e799f680453c tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Request body: {'security_group_rule': {'security_group_id': 'f6e88f2d-5816-42d2-b751-48bf5e018795', 'project_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:10:54.181671 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-1e8f9697-b89d-496f-9927-0a0ad1128db2 None None] For port 98221fb7-a97e-48d8-8c23-9a65ee0ff9bb, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=98221fb7-a97e-48d8-8c23-9a65ee0ff9bb,segment=NetworkSegment(427bac9b-3a53-470d-af69-12c1d54ff678),segment_id=427bac9b-3a53-470d-af69-12c1d54ff678)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:10:54.205651 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.securitygroups_db [None req-0f95bdfb-c038-4583-b67d-e799f680453c tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Project ebd13c4f757b48ab9d14fcf5b3a5325a added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 09 05:10:54.210773 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0f95bdfb-c038-4583-b67d-e799f680453c tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:54.263182 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1e8f9697-b89d-496f-9927-0a0ad1128db2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:54.269823 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0f95bdfb-c038-4583-b67d-e799f680453c tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:54.319949 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e8f9697-b89d-496f-9927-0a0ad1128db2 None None] Pushing event updated for resources: {'Port': ['ID=98221fb7-a97e-48d8-8c23-9a65ee0ff9bb,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:10:54.330972 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-7c23dabe-3e24-4c53-9e88-5c84d5d825f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '91dd8d79-6212-4914-b31e-8b09f14ad8bd', 'name': 'tempest-TestShelveInstance-1268500813-router', 'tenant_id': 'e2046a90eaa74271a16949e08ce6507e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.224'}], 'enable_snat': True}, 'gw_port_id': '0a66f250-0e46-4c8e-90c9-9004293b7728', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:10:47Z', 'updated_at': '2021-11-09T05:10:50Z', 'revision_number': 4, 'project_id': 'e2046a90eaa74271a16949e08ce6507e', 'gw_port': {'id': '0a66f250-0e46-4c8e-90c9-9004293b7728', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:b5:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '91dd8d79-6212-4914-b31e-8b09f14ad8bd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1820, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:10:47Z', 'updated_at': '2021-11-09T05:10:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '98221fb7-a97e-48d8-8c23-9a65ee0ff9bb', 'name': '', 'network_id': 'af03aad1-f784-4a70-ae82-2bede3b275e0', 'tenant_id': 'e2046a90eaa74271a16949e08ce6507e', 'mac_address': 'fa:16:3e:fb:fb:bf', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '91dd8d79-6212-4914-b31e-8b09f14ad8bd', 'device_owner': 'network:router_interface', 'standard_attr_id': 1821, 'fixed_ips': [{'subnet_id': 'abdf4487-51ee-478e-8096-167f92236ef6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:10:50Z', 'updated_at': '2021-11-09T05:10:53Z', 'revision_number': 4, 'project_id': 'e2046a90eaa74271a16949e08ce6507e', 'subnets': [{'id': 'abdf4487-51ee-478e-8096-167f92236ef6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:10:54.342390 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0f95bdfb-c038-4583-b67d-e799f680453c tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:54.360801 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f95bdfb-c038-4583-b67d-e799f680453c tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d0ac7b7b-7c3e-4b44-8a37-6309c889a4cd,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:10:54.362536 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7c23dabe-3e24-4c53-9e88-5c84d5d825f6 None None] The sync data for ids ['91dd8d79-6212-4914-b31e-8b09f14ad8bd'] in dv-neutron-816802-2-hyperv is: [{'id': '91dd8d79-6212-4914-b31e-8b09f14ad8bd', 'name': 'tempest-TestShelveInstance-1268500813-router', 'tenant_id': 'e2046a90eaa74271a16949e08ce6507e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.224'}], 'enable_snat': True}, 'gw_port_id': '0a66f250-0e46-4c8e-90c9-9004293b7728', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:10:47Z', 'updated_at': '2021-11-09T05:10:50Z', 'revision_number': 4, 'project_id': 'e2046a90eaa74271a16949e08ce6507e', 'gw_port': {'id': '0a66f250-0e46-4c8e-90c9-9004293b7728', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:b5:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '91dd8d79-6212-4914-b31e-8b09f14ad8bd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1820, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:10:47Z', 'updated_at': '2021-11-09T05:10:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '98221fb7-a97e-48d8-8c23-9a65ee0ff9bb', 'name': '', 'network_id': 'af03aad1-f784-4a70-ae82-2bede3b275e0', 'tenant_id': 'e2046a90eaa74271a16949e08ce6507e', 'mac_address': 'fa:16:3e:fb:fb:bf', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '91dd8d79-6212-4914-b31e-8b09f14ad8bd', 'device_owner': 'network:router_interface', 'standard_attr_id': 1821, 'fixed_ips': [{'subnet_id': 'abdf4487-51ee-478e-8096-167f92236ef6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:10:50Z', 'updated_at': '2021-11-09T05:10:53Z', 'revision_number': 4, 'project_id': 'e2046a90eaa74271a16949e08ce6507e', 'subnets': [{'id': 'abdf4487-51ee-478e-8096-167f92236ef6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 05:10:54.383078 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-a8d5b8d6-cd55-474c-a1dd-74621e204824 None None] Provisioning complete for port 98221fb7-a97e-48d8-8c23-9a65ee0ff9bb triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:10:54.383611 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a8d5b8d6-cd55-474c-a1dd-74621e204824 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:54.441790 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0f95bdfb-c038-4583-b67d-e799f680453c tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:54.443078 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-0f95bdfb-c038-4583-b67d-e799f680453c tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.3446679 Nov 09 05:10:54.445769 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 37722) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:10:54.450095 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-142c8e48-705f-4b82-a692-24f7c5c83df5 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Request body: {'security_group_rule': {'security_group_id': 'f6e88f2d-5816-42d2-b751-48bf5e018795', 'project_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:10:54.496972 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 0a66f250-0e46-4c8e-90c9-9004293b7728 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:10:54.532154 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.securitygroups_db [None req-142c8e48-705f-4b82-a692-24f7c5c83df5 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Project ebd13c4f757b48ab9d14fcf5b3a5325a added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 09 05:10:54.540724 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-142c8e48-705f-4b82-a692-24f7c5c83df5 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:54.550038 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 0a66f250-0e46-4c8e-90c9-9004293b7728 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:10:54.550557 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:54.603668 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-142c8e48-705f-4b82-a692-24f7c5c83df5 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:54.680104 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-142c8e48-705f-4b82-a692-24f7c5c83df5 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:54.698766 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-142c8e48-705f-4b82-a692-24f7c5c83df5 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a8b713d8-387b-48f3-9c8b-781992b1f420,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:10:54.767904 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-142c8e48-705f-4b82-a692-24f7c5c83df5 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:54.769472 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-142c8e48-705f-4b82-a692-24f7c5c83df5 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.3227761 Nov 09 05:10:54.923519 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-27bb84ff-ba98-4fd7-abb0-0e947bee4e2d req-32375103-4c1c-4183-9185-ebf1225a06a9 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-948931925&fields=id&tenant_id=ebd13c4f757b48ab9d14fcf5b3a5325a HTTP/1.1" status: 200 len: 267 time: 0.0457792 Nov 09 05:10:55.031204 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27bb84ff-ba98-4fd7-abb0-0e947bee4e2d req-34784335-04b0-4329-bb24-d2cc5d235d40 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:10:55.032752 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-27bb84ff-ba98-4fd7-abb0-0e947bee4e2d req-34784335-04b0-4329-bb24-d2cc5d235d40 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/networks?id=41e1a505-f3a3-418f-9229-3880f4333c14 HTTP/1.1" status: 200 len: 809 time: 0.1018484 Nov 09 05:10:55.047966 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-27bb84ff-ba98-4fd7-abb0-0e947bee4e2d req-862a9f94-b756-495c-b70f-0a0cab9d22ba tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/quotas/ebd13c4f757b48ab9d14fcf5b3a5325a HTTP/1.1" status: 200 len: 375 time: 0.0093303 Nov 09 05:10:55.099538 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-27bb84ff-ba98-4fd7-abb0-0e947bee4e2d req-69e4ab66-d41c-42da-ba6d-33c9265138cc tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?tenant_id=ebd13c4f757b48ab9d14fcf5b3a5325a&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0465260 Nov 09 05:10:55.199021 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-27bb84ff-ba98-4fd7-abb0-0e947bee4e2d req-7c8cd255-5298-4cf3-92dd-da661f69461f service neutron] 10.222.0.24 "GET /v2.0/networks/41e1a505-f3a3-418f-9229-3880f4333c14?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0874255 Nov 09 05:10:55.285712 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-27bb84ff-ba98-4fd7-abb0-0e947bee4e2d req-1a33a767-1846-49e5-a46f-b2b2ec3e8ac8 service neutron] 10.222.0.24 "GET /v2.0/networks/41e1a505-f3a3-418f-9229-3880f4333c14?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0807788 Nov 09 05:10:55.524094 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-60ff384f-849a-4cf7-b8e6-92a2886948da req-acf48762-63f5-4049-b771-66a46613abdb tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 210 time: 0.0256360 Nov 09 05:10:56.457504 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 98221fb7-a97e-48d8-8c23-9a65ee0ff9bb up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:10:56.506377 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 98221fb7-a97e-48d8-8c23-9a65ee0ff9bb triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:10:56.509166 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:56.624907 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-56b51bce-5907-41f8-bd0f-b05800109c27 req-07751b02-b9fa-496f-894b-a29e4602fe99 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 210 time: 0.0314910 Nov 09 05:10:57.394194 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27bb84ff-ba98-4fd7-abb0-0e947bee4e2d req-ba875f0d-f752-4cec-8d18-81c327e4c6f9 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:10:57.395416 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-27bb84ff-ba98-4fd7-abb0-0e947bee4e2d req-ba875f0d-f752-4cec-8d18-81c327e4c6f9 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.26 "GET /v2.0/networks?id=41e1a505-f3a3-418f-9229-3880f4333c14 HTTP/1.1" status: 200 len: 809 time: 0.1118569 Nov 09 05:10:57.459714 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-27bb84ff-ba98-4fd7-abb0-0e947bee4e2d req-e2cd6369-afa0-4100-83a0-f76bb21d8c47 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.26 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=ebd13c4f757b48ab9d14fcf5b3a5325a HTTP/1.1" status: 200 len: 379 time: 0.0555418 Nov 09 05:10:57.474171 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-27bb84ff-ba98-4fd7-abb0-0e947bee4e2d req-122751a2-650b-4e97-aafc-357103803823 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Request body: {'port': {'device_id': '8ceaef36-6e08-4613-a259-762c2dca1575', 'network_id': '41e1a505-f3a3-418f-9229-3880f4333c14', 'admin_state_up': True, 'tenant_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'security_groups': ['f6e88f2d-5816-42d2-b751-48bf5e018795']}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:10:57.650845 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-27bb84ff-ba98-4fd7-abb0-0e947bee4e2d req-122751a2-650b-4e97-aafc-357103803823 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Made reservation on behalf of ebd13c4f757b48ab9d14fcf5b3a5325a for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 05:10:57.654598 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-27bb84ff-ba98-4fd7-abb0-0e947bee4e2d req-122751a2-650b-4e97-aafc-357103803823 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:57.743412 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-0da60db6-6d34-4607-8ae6-9704cdf190b3 req-9826ccab-3e13-47ac-bd13-299a18e05de9 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 210 time: 0.0322087 Nov 09 05:10:57.809796 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [req-27bb84ff-ba98-4fd7-abb0-0e947bee4e2d req-122751a2-650b-4e97-aafc-357103803823 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Allocated IP 172.20.0.10 (41e1a505-f3a3-418f-9229-3880f4333c14/abf74659-fa86-43c8-a52c-7b696adbf35a/02cd91e1-0812-4268-baef-d530f7b74b74) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 05:10:57.943864 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-27bb84ff-ba98-4fd7-abb0-0e947bee4e2d req-122751a2-650b-4e97-aafc-357103803823 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:58.028440 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-27bb84ff-ba98-4fd7-abb0-0e947bee4e2d req-122751a2-650b-4e97-aafc-357103803823 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:58.074205 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-27bb84ff-ba98-4fd7-abb0-0e947bee4e2d req-122751a2-650b-4e97-aafc-357103803823 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Network 41e1a505-f3a3-418f-9229-3880f4333c14 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:10:58.077476 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [req-27bb84ff-ba98-4fd7-abb0-0e947bee4e2d req-122751a2-650b-4e97-aafc-357103803823 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:10:58.082985 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-27bb84ff-ba98-4fd7-abb0-0e947bee4e2d req-122751a2-650b-4e97-aafc-357103803823 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 05:10:58.323275 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-6bf42a6c-84b7-4fd4-a44a-3e9b8002ac82 None None] Provisioning complete for port 02cd91e1-0812-4268-baef-d530f7b74b74 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:10:58.323798 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6bf42a6c-84b7-4fd4-a44a-3e9b8002ac82 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:58.358147 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-6bf42a6c-84b7-4fd4-a44a-3e9b8002ac82 None None] Port 02cd91e1-0812-4268-baef-d530f7b74b74 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 05:10:58.410327 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-122751a2-650b-4e97-aafc-357103803823 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Pushing event updated for resources: {'Port': ['ID=02cd91e1-0812-4268-baef-d530f7b74b74,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:10:58.434796 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27bb84ff-ba98-4fd7-abb0-0e947bee4e2d req-122751a2-650b-4e97-aafc-357103803823 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:10:58.435385 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-27bb84ff-ba98-4fd7-abb0-0e947bee4e2d req-122751a2-650b-4e97-aafc-357103803823 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:58.533863 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-27bb84ff-ba98-4fd7-abb0-0e947bee4e2d req-122751a2-650b-4e97-aafc-357103803823 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.26 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.0679200 Nov 09 05:10:58.546469 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-27bb84ff-ba98-4fd7-abb0-0e947bee4e2d req-36dd81f8-2c0d-40b0-8208-b7b45499bd09 service neutron] Request body: {'port': {'device_id': '8ceaef36-6e08-4613-a259-762c2dca1575', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:10:58.598240 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-27bb84ff-ba98-4fd7-abb0-0e947bee4e2d req-36dd81f8-2c0d-40b0-8208-b7b45499bd09 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:58.852703 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [req-27bb84ff-ba98-4fd7-abb0-0e947bee4e2d req-36dd81f8-2c0d-40b0-8208-b7b45499bd09 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 02cd91e1-0812-4268-baef-d530f7b74b74 {{(pid=102162) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 05:10:58.860637 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-27bb84ff-ba98-4fd7-abb0-0e947bee4e2d req-36dd81f8-2c0d-40b0-8208-b7b45499bd09 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:58.862621 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fbeb6cc-9e7d-4ace-acba-1919e617a51c req-85626b31-a72f-42a1-9ec9-0a7e356800cd tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:10:58.864118 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-1fbeb6cc-9e7d-4ace-acba-1919e617a51c req-85626b31-a72f-42a1-9ec9-0a7e356800cd tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 932 time: 0.0491037 Nov 09 05:10:58.873113 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.provisioning_blocks [req-27bb84ff-ba98-4fd7-abb0-0e947bee4e2d req-36dd81f8-2c0d-40b0-8208-b7b45499bd09 service neutron] Transition to ACTIVE for port object 02cd91e1-0812-4268-baef-d530f7b74b74 will not be triggered until provisioned by entity L2. {{(pid=102162) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 09 05:10:58.915658 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-1fbeb6cc-9e7d-4ace-acba-1919e617a51c req-42e56009-7b8c-437d-8e63-ebc0047fd21d tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0449269 Nov 09 05:10:58.942891 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-27bb84ff-ba98-4fd7-abb0-0e947bee4e2d req-36dd81f8-2c0d-40b0-8208-b7b45499bd09 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:58.993961 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36dd81f8-2c0d-40b0-8208-b7b45499bd09 service neutron] Pushing event updated for resources: {'Port': ['ID=02cd91e1-0812-4268-baef-d530f7b74b74,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:10:59.064898 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-27bb84ff-ba98-4fd7-abb0-0e947bee4e2d req-36dd81f8-2c0d-40b0-8208-b7b45499bd09 service neutron] Attempting to bind port 02cd91e1-0812-4268-baef-d530f7b74b74 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 05:10:59.065229 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-27bb84ff-ba98-4fd7-abb0-0e947bee4e2d req-36dd81f8-2c0d-40b0-8208-b7b45499bd09 service neutron] Attempting to bind port 02cd91e1-0812-4268-baef-d530f7b74b74 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '0a75612c-c02a-4294-901e-f7bbf1a2b310', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 326, 'network_id': '41e1a505-f3a3-418f-9229-3880f4333c14'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 05:10:59.065554 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-27bb84ff-ba98-4fd7-abb0-0e947bee4e2d req-36dd81f8-2c0d-40b0-8208-b7b45499bd09 service neutron] Attempting to bind port 02cd91e1-0812-4268-baef-d530f7b74b74 on network 41e1a505-f3a3-418f-9229-3880f4333c14 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 05:10:59.069933 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-27bb84ff-ba98-4fd7-abb0-0e947bee4e2d req-36dd81f8-2c0d-40b0-8208-b7b45499bd09 service neutron] Port 02cd91e1-0812-4268-baef-d530f7b74b74 on network 41e1a505-f3a3-418f-9229-3880f4333c14 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 05:10:59.070247 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-27bb84ff-ba98-4fd7-abb0-0e947bee4e2d req-36dd81f8-2c0d-40b0-8208-b7b45499bd09 service neutron] Attempting to bind port 02cd91e1-0812-4268-baef-d530f7b74b74 on network 41e1a505-f3a3-418f-9229-3880f4333c14 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 05:10:59.075781 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-27bb84ff-ba98-4fd7-abb0-0e947bee4e2d req-36dd81f8-2c0d-40b0-8208-b7b45499bd09 service neutron] Checking agent: {'id': '7d36b884-4ad2-4878-9464-bf647030b544', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'started_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 5, 10, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 05:10:59.076109 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-27bb84ff-ba98-4fd7-abb0-0e947bee4e2d req-36dd81f8-2c0d-40b0-8208-b7b45499bd09 service neutron] Checking segment: {'id': '0a75612c-c02a-4294-901e-f7bbf1a2b310', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 326, 'network_id': '41e1a505-f3a3-418f-9229-3880f4333c14'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 05:10:59.076487 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-27bb84ff-ba98-4fd7-abb0-0e947bee4e2d req-36dd81f8-2c0d-40b0-8208-b7b45499bd09 service neutron] Bound using segment: {'id': '0a75612c-c02a-4294-901e-f7bbf1a2b310', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 326, 'network_id': '41e1a505-f3a3-418f-9229-3880f4333c14'} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 05:10:59.076906 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-27bb84ff-ba98-4fd7-abb0-0e947bee4e2d req-36dd81f8-2c0d-40b0-8208-b7b45499bd09 service neutron] Bound port: 02cd91e1-0812-4268-baef-d530f7b74b74, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '0a75612c-c02a-4294-901e-f7bbf1a2b310', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 326, 'network_id': '41e1a505-f3a3-418f-9229-3880f4333c14'}}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 05:10:59.077254 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-27bb84ff-ba98-4fd7-abb0-0e947bee4e2d req-36dd81f8-2c0d-40b0-8208-b7b45499bd09 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:59.142301 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-27bb84ff-ba98-4fd7-abb0-0e947bee4e2d req-36dd81f8-2c0d-40b0-8208-b7b45499bd09 service neutron] For port 02cd91e1-0812-4268-baef-d530f7b74b74, host hv-neutron-8168, cleared binding levels {{(pid=102162) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 05:10:59.145321 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-27bb84ff-ba98-4fd7-abb0-0e947bee4e2d req-36dd81f8-2c0d-40b0-8208-b7b45499bd09 service neutron] For port 02cd91e1-0812-4268-baef-d530f7b74b74, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=02cd91e1-0812-4268-baef-d530f7b74b74,segment=NetworkSegment(0a75612c-c02a-4294-901e-f7bbf1a2b310),segment_id=0a75612c-c02a-4294-901e-f7bbf1a2b310)] {{(pid=102162) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 05:10:59.245943 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-27bb84ff-ba98-4fd7-abb0-0e947bee4e2d req-36dd81f8-2c0d-40b0-8208-b7b45499bd09 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:59.279465 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27bb84ff-ba98-4fd7-abb0-0e947bee4e2d req-36dd81f8-2c0d-40b0-8208-b7b45499bd09 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:10:59.280073 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-27bb84ff-ba98-4fd7-abb0-0e947bee4e2d req-36dd81f8-2c0d-40b0-8208-b7b45499bd09 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:10:59.281500 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-27bb84ff-ba98-4fd7-abb0-0e947bee4e2d req-36dd81f8-2c0d-40b0-8208-b7b45499bd09 service neutron] 10.222.0.26 "PUT /v2.0/ports/02cd91e1-0812-4268-baef-d530f7b74b74 HTTP/1.1" status: 200 len: 1094 time: 0.7390094 Nov 09 05:10:59.281931 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8ceaef36-6e08-4613-a259-762c2dca1575', 'tag': '02cd91e1-0812-4268-baef-d530f7b74b74'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:10:59.284192 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f2a7d425-201a-47c9-a97d-729fdeb0e3c2" -d '{"events": [{"name": "network-changed", "server_uuid": "8ceaef36-6e08-4613-a259-762c2dca1575", "tag": "02cd91e1-0812-4268-baef-d530f7b74b74"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:10:59.309547 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36dd81f8-2c0d-40b0-8208-b7b45499bd09 service neutron] Pushing event updated for resources: {'Port': ['ID=02cd91e1-0812-4268-baef-d530f7b74b74,revision_number=3']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:10:59.404682 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 05:10:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-30cd625a-5684-43c2-8511-3eb981cda775 x-openstack-request-id: req-30cd625a-5684-43c2-8511-3eb981cda775 {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:10:59.404990 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8ceaef36-6e08-4613-a259-762c2dca1575", "tag": "02cd91e1-0812-4268-baef-d530f7b74b74", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:10:59.405294 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-30cd625a-5684-43c2-8511-3eb981cda775 {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:10:59.405706 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8ceaef36-6e08-4613-a259-762c2dca1575', 'tag': '02cd91e1-0812-4268-baef-d530f7b74b74', 'status': 'completed', 'code': 200} Nov 09 05:10:59.422309 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27bb84ff-ba98-4fd7-abb0-0e947bee4e2d req-c7bddc31-b65f-48f6-973e-df06c0f82a51 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:10:59.423862 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-27bb84ff-ba98-4fd7-abb0-0e947bee4e2d req-c7bddc31-b65f-48f6-973e-df06c0f82a51 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=ebd13c4f757b48ab9d14fcf5b3a5325a&device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 1097 time: 0.0452213 Nov 09 05:10:59.469234 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-27bb84ff-ba98-4fd7-abb0-0e947bee4e2d req-19e19b4d-5488-48a0-927f-82ad45644cdd service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=02cd91e1-0812-4268-baef-d530f7b74b74 HTTP/1.1" status: 200 len: 217 time: 0.0373926 Nov 09 05:10:59.528077 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27bb84ff-ba98-4fd7-abb0-0e947bee4e2d req-93d31e3a-fbef-4776-acc9-1b7af4669790 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:10:59.529456 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-27bb84ff-ba98-4fd7-abb0-0e947bee4e2d req-93d31e3a-fbef-4776-acc9-1b7af4669790 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=abf74659-fa86-43c8-a52c-7b696adbf35a HTTP/1.1" status: 200 len: 848 time: 0.0530319 Nov 09 05:10:59.574484 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27bb84ff-ba98-4fd7-abb0-0e947bee4e2d req-1fe33bf9-380b-4262-8789-5f05f082c96e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:10:59.575885 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-27bb84ff-ba98-4fd7-abb0-0e947bee4e2d req-1fe33bf9-380b-4262-8789-5f05f082c96e service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=41e1a505-f3a3-418f-9229-3880f4333c14&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0399332 Nov 09 05:10:59.668737 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-27bb84ff-ba98-4fd7-abb0-0e947bee4e2d req-a35247fd-e350-46af-bdd0-329aea9b804d service neutron] 10.222.0.26 "GET /v2.0/networks/41e1a505-f3a3-418f-9229-3880f4333c14?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0854387 Nov 09 05:10:59.754902 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-27bb84ff-ba98-4fd7-abb0-0e947bee4e2d req-79acf37d-8a14-4799-89e1-ed649440223b service neutron] 10.222.0.26 "GET /v2.0/networks/41e1a505-f3a3-418f-9229-3880f4333c14?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0791862 Nov 09 05:10:59.923220 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2a7d425-201a-47c9-a97d-729fdeb0e3c2 req-962e647e-c9b9-4ed3-99d5-440578f448f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:10:59.924777 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f2a7d425-201a-47c9-a97d-729fdeb0e3c2 req-962e647e-c9b9-4ed3-99d5-440578f448f2 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=ebd13c4f757b48ab9d14fcf5b3a5325a&device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 1097 time: 0.0485187 Nov 09 05:11:00.015980 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2a7d425-201a-47c9-a97d-729fdeb0e3c2 req-f9698272-b227-422a-9148-b9c620c2f566 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:11:00.017503 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f2a7d425-201a-47c9-a97d-729fdeb0e3c2 req-f9698272-b227-422a-9148-b9c620c2f566 service neutron] 10.222.0.26 "GET /v2.0/networks?id=41e1a505-f3a3-418f-9229-3880f4333c14 HTTP/1.1" status: 200 len: 910 time: 0.0857513 Nov 09 05:11:00.030542 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-260ad9f1-49a1-4551-8e3a-830e279e432a req-9a1c6b3c-bb15-428a-b859-49ee4ab0deb2 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:11:00.032024 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-260ad9f1-49a1-4551-8e3a-830e279e432a req-9a1c6b3c-bb15-428a-b859-49ee4ab0deb2 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 944 time: 0.0488074 Nov 09 05:11:00.062698 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f2a7d425-201a-47c9-a97d-729fdeb0e3c2 req-29ca05db-73e9-4c2f-9b2c-c981655649e7 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=02cd91e1-0812-4268-baef-d530f7b74b74 HTTP/1.1" status: 200 len: 217 time: 0.0373003 Nov 09 05:11:00.079873 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-260ad9f1-49a1-4551-8e3a-830e279e432a req-9edc5902-fde1-41bc-b4e0-18e753ac6823 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0420175 Nov 09 05:11:00.112880 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2a7d425-201a-47c9-a97d-729fdeb0e3c2 req-1b0ee604-4efb-4ba9-9a90-40f2b24b8bf0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:11:00.114328 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f2a7d425-201a-47c9-a97d-729fdeb0e3c2 req-1b0ee604-4efb-4ba9-9a90-40f2b24b8bf0 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=abf74659-fa86-43c8-a52c-7b696adbf35a HTTP/1.1" status: 200 len: 848 time: 0.0438788 Nov 09 05:11:00.160745 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2a7d425-201a-47c9-a97d-729fdeb0e3c2 req-e9c0223e-09fc-48cd-84a0-6d268afd6e93 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:11:00.162136 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f2a7d425-201a-47c9-a97d-729fdeb0e3c2 req-e9c0223e-09fc-48cd-84a0-6d268afd6e93 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=41e1a505-f3a3-418f-9229-3880f4333c14&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0396636 Nov 09 05:11:00.253679 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f2a7d425-201a-47c9-a97d-729fdeb0e3c2 req-17d2b9dd-18d1-4489-8e79-8f9af8dedcc1 service neutron] 10.222.0.26 "GET /v2.0/networks/41e1a505-f3a3-418f-9229-3880f4333c14?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0834014 Nov 09 05:11:00.343668 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f2a7d425-201a-47c9-a97d-729fdeb0e3c2 req-a0d6295f-dc8d-42c0-a47f-87583982931a service neutron] 10.222.0.26 "GET /v2.0/networks/41e1a505-f3a3-418f-9229-3880f4333c14?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0806804 Nov 09 05:11:01.195035 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51c34514-ca95-47df-b8bf-4bce928ebf7d req-bfdf5751-2dbd-4418-b07c-49c7cb084020 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:11:01.196508 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-51c34514-ca95-47df-b8bf-4bce928ebf7d req-bfdf5751-2dbd-4418-b07c-49c7cb084020 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 944 time: 0.0489697 Nov 09 05:11:01.251197 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-51c34514-ca95-47df-b8bf-4bce928ebf7d req-c18a3224-14e8-4fec-b4b6-0394560aa74f tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0470595 Nov 09 05:11:02.370674 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9736e39a-2631-4757-9b4d-b285d25a4b6b req-d69a1e6d-7574-4185-b444-05a73dd4f12e tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:11:02.372158 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-9736e39a-2631-4757-9b4d-b285d25a4b6b req-d69a1e6d-7574-4185-b444-05a73dd4f12e tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 944 time: 0.0563056 Nov 09 05:11:02.419463 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-9736e39a-2631-4757-9b4d-b285d25a4b6b req-9b37e921-8716-4e35-bd48-7e01b326751e tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0414703 Nov 09 05:11:02.441817 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 02cd91e1-0812-4268-baef-d530f7b74b74 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=102163) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 09 05:11:02.531424 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 02cd91e1-0812-4268-baef-d530f7b74b74, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=02cd91e1-0812-4268-baef-d530f7b74b74,segment=NetworkSegment(0a75612c-c02a-4294-901e-f7bbf1a2b310),segment_id=0a75612c-c02a-4294-901e-f7bbf1a2b310)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:11:02.542913 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Returning: {'device': '02cd91e1-0812-4268-baef-d530f7b74b74', 'network_id': '41e1a505-f3a3-418f-9229-3880f4333c14', 'port_id': '02cd91e1-0812-4268-baef-d530f7b74b74', 'mac_address': 'fa:16:3e:e9:f6:c6', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 326, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'abf74659-fa86-43c8-a52c-7b696adbf35a', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102163) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 09 05:11:02.577648 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:11:02.593235 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 02cd91e1-0812-4268-baef-d530f7b74b74 {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 05:11:02.612296 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 02cd91e1-0812-4268-baef-d530f7b74b74, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=02cd91e1-0812-4268-baef-d530f7b74b74,segment=NetworkSegment(0a75612c-c02a-4294-901e-f7bbf1a2b310),segment_id=0a75612c-c02a-4294-901e-f7bbf1a2b310)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:11:02.663007 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:11:02.707456 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=02cd91e1-0812-4268-baef-d530f7b74b74,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:11:02.867645 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['02cd91e1-0812-4268-baef-d530f7b74b74'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 05:11:03.537800 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-057f41a5-5179-4370-bc93-dd5a5ac71703 req-17089759-e444-4bfb-8a4d-8c4f19065808 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:11:03.539297 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-057f41a5-5179-4370-bc93-dd5a5ac71703 req-17089759-e444-4bfb-8a4d-8c4f19065808 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 945 time: 0.0546238 Nov 09 05:11:03.587219 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-057f41a5-5179-4370-bc93-dd5a5ac71703 req-6809118e-5908-49d8-871f-63bbf16a7b2f tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0421417 Nov 09 05:11:04.468122 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 02cd91e1-0812-4268-baef-d530f7b74b74 up at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:11:04.599377 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning for port 02cd91e1-0812-4268-baef-d530f7b74b74 completed by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 09 05:11:04.603140 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning complete for port 02cd91e1-0812-4268-baef-d530f7b74b74 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:11:04.603502 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:11:04.681465 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:11:04.700715 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf1321c4-0c0b-4b83-8077-24e583a9aeee req-c7bfa71d-dc35-445d-9d5c-36529b1c0fd7 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:11:04.702260 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-bf1321c4-0c0b-4b83-8077-24e583a9aeee req-c7bfa71d-dc35-445d-9d5c-36529b1c0fd7 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 945 time: 0.0485518 Nov 09 05:11:04.704013 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8ceaef36-6e08-4613-a259-762c2dca1575', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '02cd91e1-0812-4268-baef-d530f7b74b74'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:11:04.706231 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ff622f43-1556-480e-bb72-7b8ea67d1468" -d '{"events": [{"server_uuid": "8ceaef36-6e08-4613-a259-762c2dca1575", "name": "network-vif-plugged", "status": "completed", "tag": "02cd91e1-0812-4268-baef-d530f7b74b74"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:11:04.719767 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 02cd91e1-0812-4268-baef-d530f7b74b74, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=02cd91e1-0812-4268-baef-d530f7b74b74,segment=NetworkSegment(0a75612c-c02a-4294-901e-f7bbf1a2b310),segment_id=0a75612c-c02a-4294-901e-f7bbf1a2b310)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:11:04.742603 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 05:11:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-50a77a9d-cc5e-4659-bf48-060824a80178 x-openstack-request-id: req-50a77a9d-cc5e-4659-bf48-060824a80178 {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:11:04.742893 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8ceaef36-6e08-4613-a259-762c2dca1575", "name": "network-vif-plugged", "status": "completed", "tag": "02cd91e1-0812-4268-baef-d530f7b74b74", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:11:04.743133 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-50a77a9d-cc5e-4659-bf48-060824a80178 {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:11:04.743592 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8ceaef36-6e08-4613-a259-762c2dca1575', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '02cd91e1-0812-4268-baef-d530f7b74b74', 'code': 200} Nov 09 05:11:04.755530 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-bf1321c4-0c0b-4b83-8077-24e583a9aeee req-353452fd-ad12-4256-ad1c-dfcc0dd695b4 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0469911 Nov 09 05:11:04.794912 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:11:04.848424 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=02cd91e1-0812-4268-baef-d530f7b74b74,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:11:05.089257 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3be182f-de4b-4a2e-b46f-029420f00475 req-d836fbba-6459-44b8-8ca9-17d252f19b6e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:11:05.090848 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a3be182f-de4b-4a2e-b46f-029420f00475 req-d836fbba-6459-44b8-8ca9-17d252f19b6e service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 1099 time: 0.0407615 Nov 09 05:11:05.137013 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a3be182f-de4b-4a2e-b46f-029420f00475 req-7b42d150-5f73-499c-9ad9-c5dde086e6fe service neutron] 10.222.0.26 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0384934 Nov 09 05:11:05.878816 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-defbe0b7-8f66-4c93-bcf8-88ad31a1b60f req-baa5e54f-5d18-4f2a-97fb-938f2a381788 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:11:05.880420 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-defbe0b7-8f66-4c93-bcf8-88ad31a1b60f req-baa5e54f-5d18-4f2a-97fb-938f2a381788 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 946 time: 0.0542731 Nov 09 05:11:05.931527 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-defbe0b7-8f66-4c93-bcf8-88ad31a1b60f req-a4bc2c4a-f770-409e-8f4b-81519f672d51 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0435042 Nov 09 05:11:07.049024 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d43edb82-5794-4572-8f27-4432e144e496 req-38876d75-92c2-4b2b-b580-a9024280d789 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:11:07.050542 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d43edb82-5794-4572-8f27-4432e144e496 req-38876d75-92c2-4b2b-b580-a9024280d789 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 946 time: 0.0506499 Nov 09 05:11:07.097908 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d43edb82-5794-4572-8f27-4432e144e496 req-bc8e9c53-e9d6-4eae-9836-96a89bbb9e0d tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0415204 Nov 09 05:11:07.212245 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ce5db84-f6a3-45da-8986-0586417caa0d req-b3be3c13-a9ae-46b0-9e7e-e3ba9335423d tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:11:07.214217 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9ce5db84-f6a3-45da-8986-0586417caa0d req-b3be3c13-a9ae-46b0-9e7e-e3ba9335423d tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 946 time: 0.0482731 Nov 09 05:11:07.261992 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9ce5db84-f6a3-45da-8986-0586417caa0d req-35fad016-894a-4d75-836f-9f6692840ac5 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0420978 Nov 09 05:11:07.284079 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 37782) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:11:07.412971 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a8b19722-c1b5-4bfa-b6cd-365570435c54 tempest-TestShelveInstance-1993639401 tempest-TestShelveInstance-1993639401-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:11:07.414412 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a8b19722-c1b5-4bfa-b6cd-365570435c54 tempest-TestShelveInstance-1993639401 tempest-TestShelveInstance-1993639401-project-admin] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 1094 time: 0.1293631 Nov 09 05:11:07.417898 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 37786) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:11:07.422038 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-324915c1-02b2-4359-9e3e-355a6dabe45f tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Request body: {'floatingip': {'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'port_id': '02cd91e1-0812-4268-baef-d530f7b74b74', 'tenant_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'fixed_ip_address': '172.20.0.10'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:11:07.537859 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-324915c1-02b2-4359-9e3e-355a6dabe45f tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for floatingip, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:11:07.631754 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-324915c1-02b2-4359-9e3e-355a6dabe45f tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:11:07.736095 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-324915c1-02b2-4359-9e3e-355a6dabe45f tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Allocated IP 172.26.0.60 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/d6ea95f5-b6fd-4fa9-a1f9-57520b3d7865) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 05:11:07.833340 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-324915c1-02b2-4359-9e3e-355a6dabe45f tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:11:07.926482 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-324915c1-02b2-4359-9e3e-355a6dabe45f tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:11:07.964182 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-324915c1-02b2-4359-9e3e-355a6dabe45f tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:11:07.973564 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-324915c1-02b2-4359-9e3e-355a6dabe45f tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:11:07.976193 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-324915c1-02b2-4359-9e3e-355a6dabe45f tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 05:11:08.002221 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-324915c1-02b2-4359-9e3e-355a6dabe45f tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Pushing event updated for resources: {'Port': ['ID=d6ea95f5-b6fd-4fa9-a1f9-57520b3d7865,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:11:08.320051 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-324915c1-02b2-4359-9e3e-355a6dabe45f tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:11:08.419415 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-324915c1-02b2-4359-9e3e-355a6dabe45f tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:11:08.564340 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-324915c1-02b2-4359-9e3e-355a6dabe45f tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:11:08.611760 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-324915c1-02b2-4359-9e3e-355a6dabe45f tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:11:08.674463 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-324915c1-02b2-4359-9e3e-355a6dabe45f tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Pushing event updated for resources: {'Port': ['ID=d6ea95f5-b6fd-4fa9-a1f9-57520b3d7865,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:11:08.687848 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-324915c1-02b2-4359-9e3e-355a6dabe45f tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:11:08.784254 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.l3_db [None req-324915c1-02b2-4359-9e3e-355a6dabe45f tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Floating IP 75e873bc-2011-4c40-ad91-c8b04f7a4e85 associated. External IP: 172.26.0.60, port: 02cd91e1-0812-4268-baef-d530f7b74b74. Nov 09 05:11:08.990312 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-324915c1-02b2-4359-9e3e-355a6dabe45f tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Router 4119e421-6cb1-4924-9967-18e73a4eeae3 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 05:11:09.102074 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-324915c1-02b2-4359-9e3e-355a6dabe45f tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 05:11:09.111565 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-083bbb74-61da-45b9-9e67-c47362835a91 None None] Sync routers for ids ['4119e421-6cb1-4924-9967-18e73a4eeae3'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 05:11:09.121296 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-083bbb74-61da-45b9-9e67-c47362835a91 None None] Routers {'4119e421-6cb1-4924-9967-18e73a4eeae3'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:11:09.133158 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-083bbb74-61da-45b9-9e67-c47362835a91 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:10:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['4119e421-6cb1-4924-9967-18e73a4eeae3'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:11:09.180320 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-324915c1-02b2-4359-9e3e-355a6dabe45f tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:11:09.207306 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-324915c1-02b2-4359-9e3e-355a6dabe45f tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.7883866 Nov 09 05:11:09.207892 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8ceaef36-6e08-4613-a259-762c2dca1575', 'tag': '02cd91e1-0812-4268-baef-d530f7b74b74'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:11:09.210153 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-11c8b67a-1b63-4bbb-a0a2-7d743a7bf6c9" -d '{"events": [{"name": "network-changed", "server_uuid": "8ceaef36-6e08-4613-a259-762c2dca1575", "tag": "02cd91e1-0812-4268-baef-d530f7b74b74"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:11:09.227498 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-083bbb74-61da-45b9-9e67-c47362835a91 None None] Set router 4119e421-6cb1-4924-9967-18e73a4eeae3 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:11:09.247351 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 05:11:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1ea812aa-694f-42ac-855a-098cb7dd5e34 x-openstack-request-id: req-1ea812aa-694f-42ac-855a-098cb7dd5e34 {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:11:09.247724 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8ceaef36-6e08-4613-a259-762c2dca1575", "tag": "02cd91e1-0812-4268-baef-d530f7b74b74", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:11:09.248037 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-1ea812aa-694f-42ac-855a-098cb7dd5e34 {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:11:09.248545 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8ceaef36-6e08-4613-a259-762c2dca1575', 'tag': '02cd91e1-0812-4268-baef-d530f7b74b74', 'status': 'completed', 'code': 200} Nov 09 05:11:09.312901 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11c8b67a-1b63-4bbb-a0a2-7d743a7bf6c9 req-ecc7ea6f-bbec-4d9a-aa58-6919e3c61224 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:11:09.314458 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-11c8b67a-1b63-4bbb-a0a2-7d743a7bf6c9 req-ecc7ea6f-bbec-4d9a-aa58-6919e3c61224 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=ebd13c4f757b48ab9d14fcf5b3a5325a&device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 1099 time: 0.0419662 Nov 09 05:11:09.407673 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11c8b67a-1b63-4bbb-a0a2-7d743a7bf6c9 req-42b20bcc-0b1d-439c-b346-61cf30b22804 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:11:09.409157 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-11c8b67a-1b63-4bbb-a0a2-7d743a7bf6c9 req-42b20bcc-0b1d-439c-b346-61cf30b22804 service neutron] 10.222.0.26 "GET /v2.0/networks?id=41e1a505-f3a3-418f-9229-3880f4333c14 HTTP/1.1" status: 200 len: 910 time: 0.0880013 Nov 09 05:11:09.450000 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-083bbb74-61da-45b9-9e67-c47362835a91 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'name': 'tempest-TestShelveInstance-1961526497-router', 'tenant_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.251'}], 'enable_snat': True}, 'gw_port_id': '5204f9e0-7d71-4dee-997d-b68078c7a10f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:10:41Z', 'updated_at': '2021-11-09T05:10:44Z', 'revision_number': 4, 'project_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'gw_port': {'id': '5204f9e0-7d71-4dee-997d-b68078c7a10f', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:88:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1808, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.251', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:10:42Z', 'updated_at': '2021-11-09T05:10:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '75e873bc-2011-4c40-ad91-c8b04f7a4e85', 'tenant_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'floating_ip_address': '172.26.0.60', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'port_id': '02cd91e1-0812-4268-baef-d530f7b74b74', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 1833, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '41e1a505-f3a3-418f-9229-3880f4333c14', 'mac_address': 'fa:16:3e:e9:f6:c6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8ceaef36-6e08-4613-a259-762c2dca1575', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T05:11:08Z', 'updated_at': '2021-11-09T05:11:08Z', 'revision_number': 0, 'project_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '165314fc-453c-4fef-bf42-9efd260d1493', 'name': '', 'network_id': '41e1a505-f3a3-418f-9229-3880f4333c14', 'tenant_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'mac_address': 'fa:16:3e:7d:79:b9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'device_owner': 'network:router_interface', 'standard_attr_id': 1809, 'fixed_ips': [{'subnet_id': 'abf74659-fa86-43c8-a52c-7b696adbf35a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:10:44Z', 'updated_at': '2021-11-09T05:10:48Z', 'revision_number': 5, 'project_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'subnets': [{'id': 'abf74659-fa86-43c8-a52c-7b696adbf35a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:11:09.472282 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-11c8b67a-1b63-4bbb-a0a2-7d743a7bf6c9 req-18cac711-f431-4e2c-9dca-be9dace377af service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=02cd91e1-0812-4268-baef-d530f7b74b74 HTTP/1.1" status: 200 len: 999 time: 0.0565753 Nov 09 05:11:09.475460 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-083bbb74-61da-45b9-9e67-c47362835a91 None None] Checking router: 4119e421-6cb1-4924-9967-18e73a4eeae3 for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 05:11:09.483813 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-083bbb74-61da-45b9-9e67-c47362835a91 None None] Routers {'4119e421-6cb1-4924-9967-18e73a4eeae3'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:11:09.484407 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-083bbb74-61da-45b9-9e67-c47362835a91 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:10:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['4119e421-6cb1-4924-9967-18e73a4eeae3'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:11:09.524782 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11c8b67a-1b63-4bbb-a0a2-7d743a7bf6c9 req-58198ac6-695d-4ee4-ac43-3e0ae0df189c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:11:09.526595 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-11c8b67a-1b63-4bbb-a0a2-7d743a7bf6c9 req-58198ac6-695d-4ee4-ac43-3e0ae0df189c service neutron] 10.222.0.26 "GET /v2.0/subnets?id=abf74659-fa86-43c8-a52c-7b696adbf35a HTTP/1.1" status: 200 len: 848 time: 0.0477951 Nov 09 05:11:09.575359 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11c8b67a-1b63-4bbb-a0a2-7d743a7bf6c9 req-6d51ecd9-dab0-4731-9f20-2366026697a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:11:09.576840 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-11c8b67a-1b63-4bbb-a0a2-7d743a7bf6c9 req-6d51ecd9-dab0-4731-9f20-2366026697a4 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=41e1a505-f3a3-418f-9229-3880f4333c14&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0437202 Nov 09 05:11:09.592539 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-083bbb74-61da-45b9-9e67-c47362835a91 None None] Set router 4119e421-6cb1-4924-9967-18e73a4eeae3 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:11:09.667205 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-11c8b67a-1b63-4bbb-a0a2-7d743a7bf6c9 req-b1193855-7486-4bcc-9791-78bfc01e2d60 service neutron] 10.222.0.26 "GET /v2.0/networks/41e1a505-f3a3-418f-9229-3880f4333c14?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0828123 Nov 09 05:11:09.760977 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-11c8b67a-1b63-4bbb-a0a2-7d743a7bf6c9 req-b981bfbb-57b0-412e-98a5-79c70980fe44 service neutron] 10.222.0.26 "GET /v2.0/networks/41e1a505-f3a3-418f-9229-3880f4333c14?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0865479 Nov 09 05:11:09.810338 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-083bbb74-61da-45b9-9e67-c47362835a91 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'name': 'tempest-TestShelveInstance-1961526497-router', 'tenant_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.251'}], 'enable_snat': True}, 'gw_port_id': '5204f9e0-7d71-4dee-997d-b68078c7a10f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:10:41Z', 'updated_at': '2021-11-09T05:10:44Z', 'revision_number': 4, 'project_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'gw_port': {'id': '5204f9e0-7d71-4dee-997d-b68078c7a10f', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:88:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1808, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.251', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:10:42Z', 'updated_at': '2021-11-09T05:10:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '75e873bc-2011-4c40-ad91-c8b04f7a4e85', 'tenant_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'floating_ip_address': '172.26.0.60', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'port_id': '02cd91e1-0812-4268-baef-d530f7b74b74', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 1833, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '41e1a505-f3a3-418f-9229-3880f4333c14', 'mac_address': 'fa:16:3e:e9:f6:c6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8ceaef36-6e08-4613-a259-762c2dca1575', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T05:11:08Z', 'updated_at': '2021-11-09T05:11:08Z', 'revision_number': 0, 'project_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '165314fc-453c-4fef-bf42-9efd260d1493', 'name': '', 'network_id': '41e1a505-f3a3-418f-9229-3880f4333c14', 'tenant_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'mac_address': 'fa:16:3e:7d:79:b9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'device_owner': 'network:router_interface', 'standard_attr_id': 1809, 'fixed_ips': [{'subnet_id': 'abf74659-fa86-43c8-a52c-7b696adbf35a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:10:44Z', 'updated_at': '2021-11-09T05:10:48Z', 'revision_number': 5, 'project_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'subnets': [{'id': 'abf74659-fa86-43c8-a52c-7b696adbf35a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:11:09.838690 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-083bbb74-61da-45b9-9e67-c47362835a91 None None] The sync data for ids ['4119e421-6cb1-4924-9967-18e73a4eeae3'] in dv-neutron-816802-2-hyperv is: [{'id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'name': 'tempest-TestShelveInstance-1961526497-router', 'tenant_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.251'}], 'enable_snat': True}, 'gw_port_id': '5204f9e0-7d71-4dee-997d-b68078c7a10f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:10:41Z', 'updated_at': '2021-11-09T05:10:44Z', 'revision_number': 4, 'project_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'gw_port': {'id': '5204f9e0-7d71-4dee-997d-b68078c7a10f', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:88:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1808, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.251', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:10:42Z', 'updated_at': '2021-11-09T05:10:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '75e873bc-2011-4c40-ad91-c8b04f7a4e85', 'tenant_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'floating_ip_address': '172.26.0.60', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'port_id': '02cd91e1-0812-4268-baef-d530f7b74b74', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 1833, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '41e1a505-f3a3-418f-9229-3880f4333c14', 'mac_address': 'fa:16:3e:e9:f6:c6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8ceaef36-6e08-4613-a259-762c2dca1575', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T05:11:08Z', 'updated_at': '2021-11-09T05:11:08Z', 'revision_number': 0, 'project_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '165314fc-453c-4fef-bf42-9efd260d1493', 'name': '', 'network_id': '41e1a505-f3a3-418f-9229-3880f4333c14', 'tenant_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'mac_address': 'fa:16:3e:7d:79:b9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'device_owner': 'network:router_interface', 'standard_attr_id': 1809, 'fixed_ips': [{'subnet_id': 'abf74659-fa86-43c8-a52c-7b696adbf35a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:10:44Z', 'updated_at': '2021-11-09T05:10:48Z', 'revision_number': 5, 'project_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'subnets': [{'id': 'abf74659-fa86-43c8-a52c-7b696adbf35a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 05:11:10.017942 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b1a6ea42-0d40-46b7-8475-b021015d4ff6 None None] New status for floating IP 75e873bc-2011-4c40-ad91-c8b04f7a4e85: ACTIVE {{(pid=102163) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 05:11:11.355436 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b7a1aafc-66a5-4836-b385-58ec75083016 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:11:12.589546 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:11:13.732417 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f0015fa7-ffd2-4128-9ce2-fd01b6ceaa4d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:11:15.274627 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:11:16.634207 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:11:16.995398 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:11:27.447059 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 05:11:30.311046 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5b2dc83a-1289-448a-8c6b-b22809937330 req-1d78a569-f2ba-41f3-9490-b7639fba95ef service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0387518 Nov 09 05:11:30.391018 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b2dc83a-1289-448a-8c6b-b22809937330 req-76ee7f36-e92d-44a5-8747-701067631923 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:11:30.392472 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5b2dc83a-1289-448a-8c6b-b22809937330 req-76ee7f36-e92d-44a5-8747-701067631923 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=ebd13c4f757b48ab9d14fcf5b3a5325a&device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 1099 time: 0.0399899 Nov 09 05:11:30.497422 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b2dc83a-1289-448a-8c6b-b22809937330 req-6f9e0e93-6206-4ab0-aae4-cbb1302252db service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:11:30.499397 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5b2dc83a-1289-448a-8c6b-b22809937330 req-6f9e0e93-6206-4ab0-aae4-cbb1302252db service neutron] 10.222.0.26 "GET /v2.0/networks?id=41e1a505-f3a3-418f-9229-3880f4333c14 HTTP/1.1" status: 200 len: 910 time: 0.0865886 Nov 09 05:11:30.564407 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5b2dc83a-1289-448a-8c6b-b22809937330 req-f6954c11-fb15-454f-abb6-37bd50658473 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=02cd91e1-0812-4268-baef-d530f7b74b74 HTTP/1.1" status: 200 len: 1001 time: 0.0576196 Nov 09 05:11:30.617084 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b2dc83a-1289-448a-8c6b-b22809937330 req-297211e0-c54b-485e-9152-f3470a6ace9e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:11:30.618520 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5b2dc83a-1289-448a-8c6b-b22809937330 req-297211e0-c54b-485e-9152-f3470a6ace9e service neutron] 10.222.0.26 "GET /v2.0/subnets?id=abf74659-fa86-43c8-a52c-7b696adbf35a HTTP/1.1" status: 200 len: 848 time: 0.0467610 Nov 09 05:11:30.662585 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b2dc83a-1289-448a-8c6b-b22809937330 req-7f671be3-636e-4f27-8fdd-bf28dd52ae8e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:11:30.663998 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5b2dc83a-1289-448a-8c6b-b22809937330 req-7f671be3-636e-4f27-8fdd-bf28dd52ae8e service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=41e1a505-f3a3-418f-9229-3880f4333c14&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0379739 Nov 09 05:11:30.753763 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5b2dc83a-1289-448a-8c6b-b22809937330 req-c0405d3a-0a3c-43a3-acf9-b5ad74537a47 service neutron] 10.222.0.26 "GET /v2.0/networks/41e1a505-f3a3-418f-9229-3880f4333c14?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0818713 Nov 09 05:11:30.839613 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5b2dc83a-1289-448a-8c6b-b22809937330 req-9484bc1a-5c75-46ab-9ba8-ea709c931153 service neutron] 10.222.0.26 "GET /v2.0/networks/41e1a505-f3a3-418f-9229-3880f4333c14?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0782223 Nov 09 05:11:41.362402 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7f9daf0f-60e9-4e77-a35f-38bb85e1ba88 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:11:42.585436 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:11:43.715783 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-76699bd3-470b-4357-8695-257ff8587d79 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:11:45.264310 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:11:46.637225 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:11:46.996245 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:12:04.448618 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 05:12:11.364514 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b59063a6-069c-49ed-8d22-e14810d31271 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:12:12.609992 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:12:13.708123 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4cd3dce1-91fa-4cfe-8953-06a2bddcc59c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:12:15.284580 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:12:16.627333 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:12:17.010514 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:12:31.299485 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-89f71eac-6dc0-4a60-8a59-50d55111bc1e req-d8890aba-19f6-42c8-bc47-eba2150ad003 service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0384700 Nov 09 05:12:31.676237 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89f71eac-6dc0-4a60-8a59-50d55111bc1e req-bc30a5f5-c4ef-4316-a203-d6f1de96b404 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:12:31.677614 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-89f71eac-6dc0-4a60-8a59-50d55111bc1e req-bc30a5f5-c4ef-4316-a203-d6f1de96b404 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=ebd13c4f757b48ab9d14fcf5b3a5325a&device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 1099 time: 0.3338397 Nov 09 05:12:31.785734 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89f71eac-6dc0-4a60-8a59-50d55111bc1e req-52715837-f6b5-4af7-a4d1-740753cd4e26 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:12:31.787246 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-89f71eac-6dc0-4a60-8a59-50d55111bc1e req-52715837-f6b5-4af7-a4d1-740753cd4e26 service neutron] 10.222.0.26 "GET /v2.0/networks?id=41e1a505-f3a3-418f-9229-3880f4333c14 HTTP/1.1" status: 200 len: 910 time: 0.0877283 Nov 09 05:12:31.857869 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-89f71eac-6dc0-4a60-8a59-50d55111bc1e req-7b10e319-b87c-45ec-bf21-4268651b4e8e service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=02cd91e1-0812-4268-baef-d530f7b74b74 HTTP/1.1" status: 200 len: 1001 time: 0.0638707 Nov 09 05:12:31.907578 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89f71eac-6dc0-4a60-8a59-50d55111bc1e req-ed3a8c9e-36dd-4009-8cfd-8182fcf3d260 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:12:31.909012 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-89f71eac-6dc0-4a60-8a59-50d55111bc1e req-ed3a8c9e-36dd-4009-8cfd-8182fcf3d260 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=abf74659-fa86-43c8-a52c-7b696adbf35a HTTP/1.1" status: 200 len: 848 time: 0.0435746 Nov 09 05:12:31.953998 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89f71eac-6dc0-4a60-8a59-50d55111bc1e req-bc26eb59-5a90-4b6c-92e8-c1598688d38a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:12:31.955417 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-89f71eac-6dc0-4a60-8a59-50d55111bc1e req-bc26eb59-5a90-4b6c-92e8-c1598688d38a service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=41e1a505-f3a3-418f-9229-3880f4333c14&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0397274 Nov 09 05:12:32.046294 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-89f71eac-6dc0-4a60-8a59-50d55111bc1e req-7c520c51-8fcb-4d39-ae58-a4adc6bd1cb5 service neutron] 10.222.0.26 "GET /v2.0/networks/41e1a505-f3a3-418f-9229-3880f4333c14?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0840616 Nov 09 05:12:32.135204 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-89f71eac-6dc0-4a60-8a59-50d55111bc1e req-69ab054a-b1b0-48c7-a5dd-1f6e18b79130 service neutron] 10.222.0.26 "GET /v2.0/networks/41e1a505-f3a3-418f-9229-3880f4333c14?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0817614 Nov 09 05:12:41.371796 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-10fa7a67-6f4f-4296-a289-087a5f30bb30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:12:41.447343 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 05:12:42.640740 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:12:43.764506 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-fedbf9cc-675b-4be1-9e3e-282ccdc58969 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:12:45.284899 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:12:46.633657 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:12:47.006594 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:13:04.842798 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40068fbf-26c5-483a-9194-107924667c2a req-aff17782-8f32-4abe-a451-3b21cddbe519 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:04.844405 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-40068fbf-26c5-483a-9194-107924667c2a req-aff17782-8f32-4abe-a451-3b21cddbe519 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 946 time: 0.0514431 Nov 09 05:13:04.896506 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-40068fbf-26c5-483a-9194-107924667c2a req-c5b5ccb4-f920-412b-8001-a8e7ced428ec tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0455618 Nov 09 05:13:06.016399 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5eecd770-e099-4955-bcea-435f179a4a87 req-55c90f9a-1216-408c-a66f-cab950a3f102 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:06.017866 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5eecd770-e099-4955-bcea-435f179a4a87 req-55c90f9a-1216-408c-a66f-cab950a3f102 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 946 time: 0.0531301 Nov 09 05:13:06.065299 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5eecd770-e099-4955-bcea-435f179a4a87 req-620c22ab-708e-4b7e-ae01-1082ba0e3328 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0414891 Nov 09 05:13:07.190588 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68e2b864-0d9c-492e-b281-7b726673decf req-986e588b-e958-4d44-ba98-32b09d8255c1 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:07.191945 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-68e2b864-0d9c-492e-b281-7b726673decf req-986e588b-e958-4d44-ba98-32b09d8255c1 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 946 time: 0.0472517 Nov 09 05:13:07.239300 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-68e2b864-0d9c-492e-b281-7b726673decf req-c4226d2b-be8c-41fd-a9d6-2b690e2ae393 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0415063 Nov 09 05:13:08.351760 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5164dd6-b80d-42e8-a902-422d35cd4cfa req-ef5cbd3f-6540-4045-80b0-63da293397d3 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:08.353244 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e5164dd6-b80d-42e8-a902-422d35cd4cfa req-ef5cbd3f-6540-4045-80b0-63da293397d3 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 946 time: 0.0476148 Nov 09 05:13:08.401367 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e5164dd6-b80d-42e8-a902-422d35cd4cfa req-b1d8d12e-a6fb-4817-87d4-f9a844ac9033 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0417914 Nov 09 05:13:09.517897 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e204fde-1749-41bc-bac9-728bbb661524 req-c6868246-ce2a-4e90-aca5-344f4c045a98 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:09.519374 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-6e204fde-1749-41bc-bac9-728bbb661524 req-c6868246-ce2a-4e90-aca5-344f4c045a98 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 946 time: 0.0518706 Nov 09 05:13:09.566408 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-6e204fde-1749-41bc-bac9-728bbb661524 req-b5402049-6383-4b55-89ff-ca975f87bd2c tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0411222 Nov 09 05:13:10.680039 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a819c94-57b0-44c1-bb1f-6990abbb2cb2 req-e4e9dc9a-831e-498e-88e7-f2bddbe07b15 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:10.681494 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9a819c94-57b0-44c1-bb1f-6990abbb2cb2 req-e4e9dc9a-831e-498e-88e7-f2bddbe07b15 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 946 time: 0.0475700 Nov 09 05:13:10.733131 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9a819c94-57b0-44c1-bb1f-6990abbb2cb2 req-96ac4e8b-9d7a-43a0-a219-7ae5bc466a80 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0451088 Nov 09 05:13:11.350308 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e78e5f1f-b0ae-4c9b-93af-da3fd3767ac6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:13:11.846078 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7127a3de-a3b8-4e2d-b566-af2f5a0cfe41 req-07796ef1-bef2-469b-a0c4-55a42e84d987 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:11.847557 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-7127a3de-a3b8-4e2d-b566-af2f5a0cfe41 req-07796ef1-bef2-469b-a0c4-55a42e84d987 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 946 time: 0.0477934 Nov 09 05:13:11.896116 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-7127a3de-a3b8-4e2d-b566-af2f5a0cfe41 req-fea12d1f-d0c5-4b31-b8dd-a97070edea4b tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0426757 Nov 09 05:13:12.613078 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:13:13.008109 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9aa8cd1-1d2a-4e77-bb1a-183316f8c259 req-d9946f3c-d538-4b69-8f04-a44be9409ff2 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:13.009562 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d9aa8cd1-1d2a-4e77-bb1a-183316f8c259 req-d9946f3c-d538-4b69-8f04-a44be9409ff2 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 946 time: 0.0483904 Nov 09 05:13:13.058732 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d9aa8cd1-1d2a-4e77-bb1a-183316f8c259 req-055cf35a-edf3-424f-844f-21d4476327ac tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0423014 Nov 09 05:13:13.721696 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-58b181ef-3310-4ab4-a866-d6d694fc16d8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:13:14.174593 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db4064fa-6770-4f9a-be7c-d5d2e47cc48f req-b831ea8d-ca42-4153-9b26-70aeba6133ca tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:14.176082 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-db4064fa-6770-4f9a-be7c-d5d2e47cc48f req-b831ea8d-ca42-4153-9b26-70aeba6133ca tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 946 time: 0.0519133 Nov 09 05:13:14.225191 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-db4064fa-6770-4f9a-be7c-d5d2e47cc48f req-20a1b088-d29b-41e7-8317-9d8713178023 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0432551 Nov 09 05:13:15.259094 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:13:15.339113 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2b7076d-cba5-477a-bc6b-c687fd113822 req-df7da6ba-a5c9-485d-94a6-ed596fa45041 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:15.341209 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e2b7076d-cba5-477a-bc6b-c687fd113822 req-df7da6ba-a5c9-485d-94a6-ed596fa45041 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 946 time: 0.0493677 Nov 09 05:13:15.391946 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e2b7076d-cba5-477a-bc6b-c687fd113822 req-d318aa4e-3dba-46d8-ab0f-6d1968919060 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0446939 Nov 09 05:13:16.507261 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0146b834-88b5-4138-b77b-27fa8099962c req-d671a9d3-0c48-4855-8d43-ee96bb380942 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:16.508702 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-0146b834-88b5-4138-b77b-27fa8099962c req-d671a9d3-0c48-4855-8d43-ee96bb380942 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 946 time: 0.0479198 Nov 09 05:13:16.556053 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-0146b834-88b5-4138-b77b-27fa8099962c req-90d240d5-fb75-42c4-b002-e33957708d8b tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0410438 Nov 09 05:13:16.652086 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:13:16.923048 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 02cd91e1-0812-4268-baef-d530f7b74b74 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=102163) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 09 05:13:17.028711 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 02cd91e1-0812-4268-baef-d530f7b74b74, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=02cd91e1-0812-4268-baef-d530f7b74b74,segment=NetworkSegment(0a75612c-c02a-4294-901e-f7bbf1a2b310),segment_id=0a75612c-c02a-4294-901e-f7bbf1a2b310)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:13:17.039439 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Returning: {'device': '02cd91e1-0812-4268-baef-d530f7b74b74', 'network_id': '41e1a505-f3a3-418f-9229-3880f4333c14', 'port_id': '02cd91e1-0812-4268-baef-d530f7b74b74', 'mac_address': 'fa:16:3e:e9:f6:c6', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 326, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'abf74659-fa86-43c8-a52c-7b696adbf35a', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102163) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 09 05:13:17.076592 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:13:17.088664 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 02cd91e1-0812-4268-baef-d530f7b74b74 {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 05:13:17.108586 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 02cd91e1-0812-4268-baef-d530f7b74b74, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=02cd91e1-0812-4268-baef-d530f7b74b74,segment=NetworkSegment(0a75612c-c02a-4294-901e-f7bbf1a2b310),segment_id=0a75612c-c02a-4294-901e-f7bbf1a2b310)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:13:17.115040 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:13:17.166847 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:13:17.220286 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=02cd91e1-0812-4268-baef-d530f7b74b74,revision_number=6']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:13:17.227419 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:13:17.227802 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:13:17.228161 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:13:17.228498 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:13:17.228827 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:13:17.229153 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:13:17.229476 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:13:17.229798 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:13:17.230122 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:13:17.230478 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:13:17.230785 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:13:17.231101 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:13:17.242947 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['02cd91e1-0812-4268-baef-d530f7b74b74'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 05:13:17.674995 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8cb1d2e-7edf-44a3-bd90-72e2e0b699fe req-a7c0b086-0cb8-4e43-835f-8036d0b4ad1f tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:17.676451 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c8cb1d2e-7edf-44a3-bd90-72e2e0b699fe req-a7c0b086-0cb8-4e43-835f-8036d0b4ad1f tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 945 time: 0.0524142 Nov 09 05:13:17.729328 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c8cb1d2e-7edf-44a3-bd90-72e2e0b699fe req-0e2d9500-0865-4dfd-864e-485fb38aa3ec tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0467038 Nov 09 05:13:18.452700 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 05:13:18.854915 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d3b5fa7-4ad7-46ca-892b-545461c764e8 req-f8cdf9f3-eec3-4373-b5ee-1778bccde98d tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:18.860540 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-7d3b5fa7-4ad7-46ca-892b-545461c764e8 req-f8cdf9f3-eec3-4373-b5ee-1778bccde98d tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 945 time: 0.0540307 Nov 09 05:13:18.915303 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-7d3b5fa7-4ad7-46ca-892b-545461c764e8 req-e52acdc1-b5c7-4daa-9c6e-b5beaaa97da8 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0506203 Nov 09 05:13:18.927551 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 02cd91e1-0812-4268-baef-d530f7b74b74 up at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:13:18.977826 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning complete for port 02cd91e1-0812-4268-baef-d530f7b74b74 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:13:18.978295 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:13:19.063624 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:13:19.089214 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8ceaef36-6e08-4613-a259-762c2dca1575', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '02cd91e1-0812-4268-baef-d530f7b74b74'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:13:19.091710 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0fd21ed1-9017-4202-b633-4eaaffcb9f1f" -d '{"events": [{"server_uuid": "8ceaef36-6e08-4613-a259-762c2dca1575", "name": "network-vif-plugged", "status": "completed", "tag": "02cd91e1-0812-4268-baef-d530f7b74b74"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:13:19.113959 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 02cd91e1-0812-4268-baef-d530f7b74b74, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=02cd91e1-0812-4268-baef-d530f7b74b74,segment=NetworkSegment(0a75612c-c02a-4294-901e-f7bbf1a2b310),segment_id=0a75612c-c02a-4294-901e-f7bbf1a2b310)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:13:19.134298 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 05:13:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3da4cafe-efc9-41ac-a114-793dd73c8047 x-openstack-request-id: req-3da4cafe-efc9-41ac-a114-793dd73c8047 {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:13:19.134622 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8ceaef36-6e08-4613-a259-762c2dca1575", "name": "network-vif-plugged", "status": "completed", "tag": "02cd91e1-0812-4268-baef-d530f7b74b74", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:13:19.134877 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-3da4cafe-efc9-41ac-a114-793dd73c8047 {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:13:19.135276 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8ceaef36-6e08-4613-a259-762c2dca1575', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '02cd91e1-0812-4268-baef-d530f7b74b74', 'code': 200} Nov 09 05:13:19.179495 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:13:19.232830 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=02cd91e1-0812-4268-baef-d530f7b74b74,revision_number=7']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:13:20.048644 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-090707d3-7288-4959-9f00-7eee2890b571 req-2b3c4054-9e1b-4774-bcd4-41e88f9d3de7 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:20.050951 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-090707d3-7288-4959-9f00-7eee2890b571 req-2b3c4054-9e1b-4774-bcd4-41e88f9d3de7 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 946 time: 0.0568590 Nov 09 05:13:20.103667 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-090707d3-7288-4959-9f00-7eee2890b571 req-a4ad506e-6e70-479e-984e-2c4032b87b99 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0463924 Nov 09 05:13:21.237627 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7243dbc7-7fec-409d-b8ee-d181dfb896a3 req-e94f98d6-7ec4-4d7f-a848-7e33f67f013b tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:21.239166 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7243dbc7-7fec-409d-b8ee-d181dfb896a3 req-e94f98d6-7ec4-4d7f-a848-7e33f67f013b tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 946 time: 0.0580232 Nov 09 05:13:21.290963 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7243dbc7-7fec-409d-b8ee-d181dfb896a3 req-b27b5f87-b072-483c-bbb2-0a1d268f8485 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0456071 Nov 09 05:13:22.430005 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f90bfd9-3b4f-44e9-9118-1334f0faf8c0 req-df510fe3-8937-4abb-89f6-7bbf97731b02 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:22.431771 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-3f90bfd9-3b4f-44e9-9118-1334f0faf8c0 req-df510fe3-8937-4abb-89f6-7bbf97731b02 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 946 time: 0.0556424 Nov 09 05:13:22.484684 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-3f90bfd9-3b4f-44e9-9118-1334f0faf8c0 req-72206db9-f46f-4178-8433-5e0c84d7899f tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0446734 Nov 09 05:13:23.609385 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fed69a9a-233a-4abd-bef6-19138f19356b req-3ae5e23b-842f-49a5-bf3f-87563e5be4ab tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:23.611060 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fed69a9a-233a-4abd-bef6-19138f19356b req-3ae5e23b-842f-49a5-bf3f-87563e5be4ab tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 946 time: 0.0541756 Nov 09 05:13:23.666350 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fed69a9a-233a-4abd-bef6-19138f19356b req-24719997-9ade-4d06-a4f1-49f5112a2c27 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0493207 Nov 09 05:13:24.803432 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-221aa389-d834-4f7a-8724-068e92da5dea req-bb1557b7-ed4a-4bce-a7cf-739ce64e7f7d tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:24.813476 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-221aa389-d834-4f7a-8724-068e92da5dea req-bb1557b7-ed4a-4bce-a7cf-739ce64e7f7d tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 946 time: 0.0587873 Nov 09 05:13:24.868997 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-221aa389-d834-4f7a-8724-068e92da5dea req-09e41f72-70ce-4e5c-83a7-c85432b19fe9 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0574925 Nov 09 05:13:25.987403 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2dfa0acf-bebb-4f03-9e95-4937a7d1a19e req-8f9cb40d-195b-4759-8759-6db91259aff1 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:25.990674 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2dfa0acf-bebb-4f03-9e95-4937a7d1a19e req-8f9cb40d-195b-4759-8759-6db91259aff1 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 946 time: 0.0544553 Nov 09 05:13:26.054173 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2dfa0acf-bebb-4f03-9e95-4937a7d1a19e req-8ec38196-63f7-4162-8f80-9be73d1bb7cd tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0575967 Nov 09 05:13:27.178265 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d5fd969-70e5-480c-900b-c6653e60a6a3 req-aa3605ab-b0b8-4c75-aa2a-a7361dc76266 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:27.179214 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-5d5fd969-70e5-480c-900b-c6653e60a6a3 req-aa3605ab-b0b8-4c75-aa2a-a7361dc76266 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 946 time: 0.0561080 Nov 09 05:13:27.227816 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-5d5fd969-70e5-480c-900b-c6653e60a6a3 req-feea8e7b-f713-4729-96c3-654e1430090b tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0426722 Nov 09 05:13:28.343128 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cb0fefe-16dc-417b-a85b-7a874ce84a1b req-8fe8ca07-88c4-4c80-b62f-264de16fa7e2 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:28.344689 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2cb0fefe-16dc-417b-a85b-7a874ce84a1b req-8fe8ca07-88c4-4c80-b62f-264de16fa7e2 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 946 time: 0.0499518 Nov 09 05:13:28.395225 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2cb0fefe-16dc-417b-a85b-7a874ce84a1b req-28e83f51-d4ae-4a17-98a8-4ce5df03a5da tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0447619 Nov 09 05:13:29.116561 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41c72ed1-096d-41ee-87df-3f031ae33335 req-fa84e5c6-72ac-4c5d-a440-43dfd364da1e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:29.118318 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-41c72ed1-096d-41ee-87df-3f031ae33335 req-fa84e5c6-72ac-4c5d-a440-43dfd364da1e service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=ebd13c4f757b48ab9d14fcf5b3a5325a&device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 1099 time: 0.0463455 Nov 09 05:13:29.205544 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41c72ed1-096d-41ee-87df-3f031ae33335 req-b856cbc6-b39a-4f4f-a0bf-62dd48e26fac service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:29.206929 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-41c72ed1-096d-41ee-87df-3f031ae33335 req-b856cbc6-b39a-4f4f-a0bf-62dd48e26fac service neutron] 10.222.0.26 "GET /v2.0/networks?id=41e1a505-f3a3-418f-9229-3880f4333c14 HTTP/1.1" status: 200 len: 910 time: 0.0820131 Nov 09 05:13:29.276286 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-41c72ed1-096d-41ee-87df-3f031ae33335 req-f60c3029-fed1-41cd-96d8-0f611aaac64e service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=02cd91e1-0812-4268-baef-d530f7b74b74 HTTP/1.1" status: 200 len: 1001 time: 0.0618618 Nov 09 05:13:29.324319 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41c72ed1-096d-41ee-87df-3f031ae33335 req-7c2cebc9-1f62-4d88-bcfd-cdea0f4ceec3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:29.326242 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-41c72ed1-096d-41ee-87df-3f031ae33335 req-7c2cebc9-1f62-4d88-bcfd-cdea0f4ceec3 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=abf74659-fa86-43c8-a52c-7b696adbf35a HTTP/1.1" status: 200 len: 848 time: 0.0424964 Nov 09 05:13:29.371221 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41c72ed1-096d-41ee-87df-3f031ae33335 req-6a8e5166-6afc-45b8-890c-fb49d1893109 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:29.372693 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-41c72ed1-096d-41ee-87df-3f031ae33335 req-6a8e5166-6afc-45b8-890c-fb49d1893109 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=41e1a505-f3a3-418f-9229-3880f4333c14&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0386968 Nov 09 05:13:29.466475 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-41c72ed1-096d-41ee-87df-3f031ae33335 req-137fe9a3-3183-4dcb-bfbf-e1d522773348 service neutron] 10.222.0.26 "GET /v2.0/networks/41e1a505-f3a3-418f-9229-3880f4333c14?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0857739 Nov 09 05:13:29.507958 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b689006d-10e4-4a66-87c4-3130558bba37 req-8e6fc974-6648-4e6a-ab7a-20ebdec0bc7e tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:29.509456 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b689006d-10e4-4a66-87c4-3130558bba37 req-8e6fc974-6648-4e6a-ab7a-20ebdec0bc7e tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 946 time: 0.0475726 Nov 09 05:13:29.556489 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-41c72ed1-096d-41ee-87df-3f031ae33335 req-5a7c85ed-148e-46f7-a23e-314c0b6c7b46 service neutron] 10.222.0.26 "GET /v2.0/networks/41e1a505-f3a3-418f-9229-3880f4333c14?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0821910 Nov 09 05:13:29.561586 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b689006d-10e4-4a66-87c4-3130558bba37 req-13dfb91c-48be-47aa-940b-83154685da13 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0458488 Nov 09 05:13:30.678492 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8b39db7-e569-41d1-9ce9-5a195beb6e15 req-ddea8d12-0e25-4fc4-9982-e02003d9a6c0 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:30.679962 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e8b39db7-e569-41d1-9ce9-5a195beb6e15 req-ddea8d12-0e25-4fc4-9982-e02003d9a6c0 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 946 time: 0.0525105 Nov 09 05:13:30.726942 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e8b39db7-e569-41d1-9ce9-5a195beb6e15 req-43ada6d0-1d0c-481a-8c52-262a05db960a tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0412107 Nov 09 05:13:31.332231 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0b5b187-0a4f-4b59-8b71-03f051506495 req-d0371e59-02f0-489e-a355-701d33ad1edf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:31.333638 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a0b5b187-0a4f-4b59-8b71-03f051506495 req-d0371e59-02f0-489e-a355-701d33ad1edf service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=ebd13c4f757b48ab9d14fcf5b3a5325a&device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 1099 time: 0.0410783 Nov 09 05:13:31.440030 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0b5b187-0a4f-4b59-8b71-03f051506495 req-eeb5503a-7e0c-48dd-8573-4f24e42736a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:31.441502 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a0b5b187-0a4f-4b59-8b71-03f051506495 req-eeb5503a-7e0c-48dd-8573-4f24e42736a1 service neutron] 10.222.0.26 "GET /v2.0/networks?id=41e1a505-f3a3-418f-9229-3880f4333c14 HTTP/1.1" status: 200 len: 910 time: 0.0882385 Nov 09 05:13:31.507662 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a0b5b187-0a4f-4b59-8b71-03f051506495 req-2d52f2e2-222a-4354-accb-95fd36b4d02f service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=02cd91e1-0812-4268-baef-d530f7b74b74 HTTP/1.1" status: 200 len: 1001 time: 0.0567710 Nov 09 05:13:31.555345 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0b5b187-0a4f-4b59-8b71-03f051506495 req-fb053075-01d9-43ab-a9df-a04fcbac18eb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:31.556699 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a0b5b187-0a4f-4b59-8b71-03f051506495 req-fb053075-01d9-43ab-a9df-a04fcbac18eb service neutron] 10.222.0.26 "GET /v2.0/subnets?id=abf74659-fa86-43c8-a52c-7b696adbf35a HTTP/1.1" status: 200 len: 848 time: 0.0416467 Nov 09 05:13:31.603784 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0b5b187-0a4f-4b59-8b71-03f051506495 req-e00e8fba-cf9d-420b-b225-c9bb083dca5a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:31.605171 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a0b5b187-0a4f-4b59-8b71-03f051506495 req-e00e8fba-cf9d-420b-b225-c9bb083dca5a service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=41e1a505-f3a3-418f-9229-3880f4333c14&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0411839 Nov 09 05:13:31.695329 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a0b5b187-0a4f-4b59-8b71-03f051506495 req-81d90279-b4cd-4f47-b77d-615991e0bf94 service neutron] 10.222.0.26 "GET /v2.0/networks/41e1a505-f3a3-418f-9229-3880f4333c14?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0822470 Nov 09 05:13:31.793342 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a0b5b187-0a4f-4b59-8b71-03f051506495 req-20906a72-d178-4fff-90d1-e19388c804ca service neutron] 10.222.0.26 "GET /v2.0/networks/41e1a505-f3a3-418f-9229-3880f4333c14?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0890777 Nov 09 05:13:31.842481 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38ad9c95-7cdb-4d15-a59d-ce65945836a7 req-cfafb070-6b7b-4dc1-a869-87a5efeaccd2 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:31.844077 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-38ad9c95-7cdb-4d15-a59d-ce65945836a7 req-cfafb070-6b7b-4dc1-a869-87a5efeaccd2 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 946 time: 0.0490837 Nov 09 05:13:31.895190 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-38ad9c95-7cdb-4d15-a59d-ce65945836a7 req-4daf6ed0-1ad0-4e23-b6e7-e74432b8ff8e tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0451741 Nov 09 05:13:32.005194 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [req-5fe3401d-435a-4e43-a1f8-5aabc0eb3735 req-4d0ab630-f1e1-4973-916d-dd4254fdfd18 service neutron] http://10.222.0.24:9696/v2.0/extensions returned with HTTP 200 {{(pid=102162) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 05:13:32.006225 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5fe3401d-435a-4e43-a1f8-5aabc0eb3735 req-4d0ab630-f1e1-4973-916d-dd4254fdfd18 service neutron] 10.222.0.24 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0483818 Nov 09 05:13:32.359619 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b976734a-5aff-4fbb-8ea8-dee8b07e778f req-aaadc87a-93a2-4f48-8157-ccbe05d8596a tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:32.360532 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b976734a-5aff-4fbb-8ea8-dee8b07e778f req-aaadc87a-93a2-4f48-8157-ccbe05d8596a tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 946 time: 0.0493298 Nov 09 05:13:32.417405 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b976734a-5aff-4fbb-8ea8-dee8b07e778f req-2c875ae5-3da9-4c5b-941f-65240b71eab2 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0508201 Nov 09 05:13:32.786919 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-497cfb3a-0451-4df8-bf3e-4c45d9061e4f req-a1fbf753-44c8-4406-8eec-483c3dfce7a3 service neutron] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0836756 Nov 09 05:13:33.008421 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 02cd91e1-0812-4268-baef-d530f7b74b74 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 05:13:33.085988 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:13:33.107972 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8ceaef36-6e08-4613-a259-762c2dca1575', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '02cd91e1-0812-4268-baef-d530f7b74b74'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:13:33.110182 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2f964fa4-a9da-4b59-961a-9f0b0ef9dd80" -d '{"events": [{"server_uuid": "8ceaef36-6e08-4613-a259-762c2dca1575", "name": "network-vif-unplugged", "status": "completed", "tag": "02cd91e1-0812-4268-baef-d530f7b74b74"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:13:33.122850 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 02cd91e1-0812-4268-baef-d530f7b74b74, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=02cd91e1-0812-4268-baef-d530f7b74b74,segment=NetworkSegment(0a75612c-c02a-4294-901e-f7bbf1a2b310),segment_id=0a75612c-c02a-4294-901e-f7bbf1a2b310)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:13:33.142232 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Tue, 09 Nov 2021 05:13:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-06075dc7-ce15-40c8-90f3-cea16c1b439f x-openstack-request-id: req-06075dc7-ce15-40c8-90f3-cea16c1b439f {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:13:33.142668 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8ceaef36-6e08-4613-a259-762c2dca1575", "name": "network-vif-unplugged", "status": "failed", "tag": "02cd91e1-0812-4268-baef-d530f7b74b74", "code": 422}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:13:33.143047 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-06075dc7-ce15-40c8-90f3-cea16c1b439f {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:13:33.143574 dv-neutron-816802-2-hyperv neutron-server[102163]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': '8ceaef36-6e08-4613-a259-762c2dca1575', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': '02cd91e1-0812-4268-baef-d530f7b74b74', 'code': 422} returned with failed status Nov 09 05:13:33.203129 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:13:33.251854 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=02cd91e1-0812-4268-baef-d530f7b74b74,revision_number=8']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:13:33.531171 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bba2824-48a7-4b34-b370-24407acde1b0 req-7b8713f0-14ce-4c35-b965-2fa07f377d3b tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:33.532639 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-3bba2824-48a7-4b34-b370-24407acde1b0 req-7b8713f0-14ce-4c35-b965-2fa07f377d3b tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 944 time: 0.0481768 Nov 09 05:13:33.583675 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-3bba2824-48a7-4b34-b370-24407acde1b0 req-5951e868-8926-4be7-acb3-c28fe4e531ed tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0446827 Nov 09 05:13:34.141820 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-497cfb3a-0451-4df8-bf3e-4c45d9061e4f req-86e9acb0-8a26-4e7a-9694-3448315f43fa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:34.143214 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-497cfb3a-0451-4df8-bf3e-4c45d9061e4f req-86e9acb0-8a26-4e7a-9694-3448315f43fa service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575&tenant_id=ebd13c4f757b48ab9d14fcf5b3a5325a HTTP/1.1" status: 200 len: 1097 time: 0.0403159 Nov 09 05:13:34.203730 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-497cfb3a-0451-4df8-bf3e-4c45d9061e4f req-5e49faf2-45f5-4118-a483-4adec1db9718 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:34.205279 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-497cfb3a-0451-4df8-bf3e-4c45d9061e4f req-5e49faf2-45f5-4118-a483-4adec1db9718 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=ebd13c4f757b48ab9d14fcf5b3a5325a&device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 1097 time: 0.0397019 Nov 09 05:13:34.298836 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-497cfb3a-0451-4df8-bf3e-4c45d9061e4f req-d4d00a62-d20b-40af-aec5-f2e29e511daf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:34.300417 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-497cfb3a-0451-4df8-bf3e-4c45d9061e4f req-d4d00a62-d20b-40af-aec5-f2e29e511daf service neutron] 10.222.0.26 "GET /v2.0/networks?id=41e1a505-f3a3-418f-9229-3880f4333c14 HTTP/1.1" status: 200 len: 910 time: 0.0880709 Nov 09 05:13:34.363928 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-497cfb3a-0451-4df8-bf3e-4c45d9061e4f req-efb0717d-b1e6-41e4-9770-4c2ef03a9bf5 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=02cd91e1-0812-4268-baef-d530f7b74b74 HTTP/1.1" status: 200 len: 999 time: 0.0565250 Nov 09 05:13:34.416077 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-497cfb3a-0451-4df8-bf3e-4c45d9061e4f req-2bce9750-e0bb-4a80-a1b1-17ed83b79e93 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:34.417403 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-497cfb3a-0451-4df8-bf3e-4c45d9061e4f req-2bce9750-e0bb-4a80-a1b1-17ed83b79e93 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=abf74659-fa86-43c8-a52c-7b696adbf35a HTTP/1.1" status: 200 len: 848 time: 0.0464218 Nov 09 05:13:34.463151 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-497cfb3a-0451-4df8-bf3e-4c45d9061e4f req-ed341b13-25cf-482f-8eb7-3f0ac090f1e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:34.464362 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-497cfb3a-0451-4df8-bf3e-4c45d9061e4f req-ed341b13-25cf-482f-8eb7-3f0ac090f1e7 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=41e1a505-f3a3-418f-9229-3880f4333c14&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0399222 Nov 09 05:13:34.552872 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-497cfb3a-0451-4df8-bf3e-4c45d9061e4f req-81418b7c-6728-4e57-8b48-6f9508589d06 service neutron] 10.222.0.26 "GET /v2.0/networks/41e1a505-f3a3-418f-9229-3880f4333c14?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0801826 Nov 09 05:13:34.646711 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-497cfb3a-0451-4df8-bf3e-4c45d9061e4f req-eeaa5272-5d45-4bc4-93a4-8b1e04c42294 service neutron] 10.222.0.26 "GET /v2.0/networks/41e1a505-f3a3-418f-9229-3880f4333c14?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0856779 Nov 09 05:13:34.697373 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bea74703-8c68-47bd-8a60-7d997b264284 req-fd3b5416-577f-4738-b190-22fb854ca4d0 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:34.698819 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-bea74703-8c68-47bd-8a60-7d997b264284 req-fd3b5416-577f-4738-b190-22fb854ca4d0 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 944 time: 0.0488756 Nov 09 05:13:34.748937 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-bea74703-8c68-47bd-8a60-7d997b264284 req-e6aa61b8-7cf7-475b-a806-898165a3992c tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0438077 Nov 09 05:13:35.867025 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87fb4218-49b6-4a3b-8e1f-3405f51f87af req-49571db8-65df-4620-906b-a544ce9b0099 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:35.868745 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-87fb4218-49b6-4a3b-8e1f-3405f51f87af req-49571db8-65df-4620-906b-a544ce9b0099 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 944 time: 0.0488183 Nov 09 05:13:35.920958 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-87fb4218-49b6-4a3b-8e1f-3405f51f87af req-50200b76-4739-4514-ae99-72619370c8e7 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0462389 Nov 09 05:13:37.039916 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb87495e-9640-449f-b07b-60e5e3bd1414 req-e910a6e4-f4fe-4fb8-ad66-4301af718080 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:37.042186 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-eb87495e-9640-449f-b07b-60e5e3bd1414 req-e910a6e4-f4fe-4fb8-ad66-4301af718080 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 944 time: 0.0548658 Nov 09 05:13:37.107759 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-eb87495e-9640-449f-b07b-60e5e3bd1414 req-a3147f32-ad47-43c7-883c-3e73797b649e tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0587325 Nov 09 05:13:38.226092 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bd1b4a3-8fab-478d-910c-8bda8b4b1a60 req-c5162ed1-957f-4933-91f7-03ae8607cd9f tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:38.227604 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-1bd1b4a3-8fab-478d-910c-8bda8b4b1a60 req-c5162ed1-957f-4933-91f7-03ae8607cd9f tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 944 time: 0.0476382 Nov 09 05:13:38.283911 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-1bd1b4a3-8fab-478d-910c-8bda8b4b1a60 req-29b867c5-5d9c-44f8-a8eb-ec08c49be7f5 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0472014 Nov 09 05:13:39.409919 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97ba5622-e89b-466a-9a0a-5ded6fa8c243 req-325af00e-1650-4b84-ade3-17d0c13d3503 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:39.411613 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-97ba5622-e89b-466a-9a0a-5ded6fa8c243 req-325af00e-1650-4b84-ade3-17d0c13d3503 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 944 time: 0.0553839 Nov 09 05:13:39.462657 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-97ba5622-e89b-466a-9a0a-5ded6fa8c243 req-f0d10758-e5f5-4563-b6da-644357ae0cea tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0448689 Nov 09 05:13:40.584326 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe4f32f4-ee13-47d9-869f-d75e3c4704a0 req-26edce40-bd19-4878-bc18-04865eb75199 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:40.591538 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-fe4f32f4-ee13-47d9-869f-d75e3c4704a0 req-26edce40-bd19-4878-bc18-04865eb75199 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 944 time: 0.0596986 Nov 09 05:13:40.636345 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-fe4f32f4-ee13-47d9-869f-d75e3c4704a0 req-67480b65-88d6-4dab-8c50-218752cbab25 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0439465 Nov 09 05:13:41.352209 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9594345a-8ffb-45eb-a920-52993292c3e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:13:41.755306 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d40b2dc-12b5-41e2-96d1-db8150375f3d req-dbf64ff9-570f-4104-9738-4467562f8d37 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:41.755306 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9d40b2dc-12b5-41e2-96d1-db8150375f3d req-dbf64ff9-570f-4104-9738-4467562f8d37 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 944 time: 0.0480034 Nov 09 05:13:41.812349 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9d40b2dc-12b5-41e2-96d1-db8150375f3d req-e2401d82-c2ab-49f5-be1b-116c3c598138 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0535855 Nov 09 05:13:42.865267 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:13:42.938384 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05acb0f2-9ff1-4ba5-817d-8bb443de152e req-bb377c0f-cd86-4f9f-a2ea-4c878a4b8a00 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:42.938384 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-05acb0f2-9ff1-4ba5-817d-8bb443de152e req-bb377c0f-cd86-4f9f-a2ea-4c878a4b8a00 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 944 time: 0.0517793 Nov 09 05:13:43.002931 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-05acb0f2-9ff1-4ba5-817d-8bb443de152e req-9a7d7519-1457-433a-a4af-ae3972bf75fa tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0608695 Nov 09 05:13:43.735545 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-cb26151a-bc90-41f6-b0be-c4e25337777a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:13:44.125522 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea0cdc1b-8784-46b8-99fd-db7b53cb9f5e req-8ae7a755-2d36-4f02-831e-641d8e612b32 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:44.127037 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ea0cdc1b-8784-46b8-99fd-db7b53cb9f5e req-8ae7a755-2d36-4f02-831e-641d8e612b32 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 944 time: 0.0538630 Nov 09 05:13:44.175131 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ea0cdc1b-8784-46b8-99fd-db7b53cb9f5e req-f3f83445-4250-4808-8a49-1ff12ca14e8c tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0422826 Nov 09 05:13:45.318449 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e44f7b9b-44f3-4a1f-bad1-58b44de45ef0 req-828b8d1d-bedb-4926-a615-9210a4a8581b tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:45.320764 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-e44f7b9b-44f3-4a1f-bad1-58b44de45ef0 req-828b8d1d-bedb-4926-a615-9210a4a8581b tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 944 time: 0.0563161 Nov 09 05:13:45.377308 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-e44f7b9b-44f3-4a1f-bad1-58b44de45ef0 req-d8d0f93b-9d26-45c1-b779-d935f47d8cce tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0500004 Nov 09 05:13:45.484239 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:13:46.496175 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccbc6b8e-1657-4fbd-a354-24ffd1a4b6b7 req-58197913-36ab-40b3-ad57-f5b7c302c623 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:46.497761 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ccbc6b8e-1657-4fbd-a354-24ffd1a4b6b7 req-58197913-36ab-40b3-ad57-f5b7c302c623 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 944 time: 0.0542376 Nov 09 05:13:46.548406 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-ccbc6b8e-1657-4fbd-a354-24ffd1a4b6b7 req-692722ea-3e3c-4480-b202-d9019cca6f34 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0439332 Nov 09 05:13:46.678186 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:13:47.002115 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:13:47.664571 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6570a6e-e74f-498b-85a7-bb942257db93 req-07b28737-46e2-4a1e-b410-1dc58576a559 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:47.666017 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-a6570a6e-e74f-498b-85a7-bb942257db93 req-07b28737-46e2-4a1e-b410-1dc58576a559 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 944 time: 0.0479560 Nov 09 05:13:47.718290 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-a6570a6e-e74f-498b-85a7-bb942257db93 req-90d32dc0-ea59-46f8-bb7d-69f5273c12ba tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0458302 Nov 09 05:13:48.834673 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92d48762-ca10-4762-abe6-299c2b48f846 req-a6732fae-56d8-4118-986e-0d21d5a32c8d tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:48.836112 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-92d48762-ca10-4762-abe6-299c2b48f846 req-a6732fae-56d8-4118-986e-0d21d5a32c8d tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 944 time: 0.0518525 Nov 09 05:13:48.885252 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-92d48762-ca10-4762-abe6-299c2b48f846 req-03cc9d77-7a11-45c1-8654-6861da8b1b66 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0428739 Nov 09 05:13:49.087577 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 02cd91e1-0812-4268-baef-d530f7b74b74 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=102163) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 09 05:13:49.180480 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 02cd91e1-0812-4268-baef-d530f7b74b74, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=02cd91e1-0812-4268-baef-d530f7b74b74,segment=NetworkSegment(0a75612c-c02a-4294-901e-f7bbf1a2b310),segment_id=0a75612c-c02a-4294-901e-f7bbf1a2b310)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:13:49.191333 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Returning: {'device': '02cd91e1-0812-4268-baef-d530f7b74b74', 'network_id': '41e1a505-f3a3-418f-9229-3880f4333c14', 'port_id': '02cd91e1-0812-4268-baef-d530f7b74b74', 'mac_address': 'fa:16:3e:e9:f6:c6', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 326, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'abf74659-fa86-43c8-a52c-7b696adbf35a', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102163) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 09 05:13:49.227165 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:13:49.239864 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 02cd91e1-0812-4268-baef-d530f7b74b74 {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 05:13:49.262208 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 02cd91e1-0812-4268-baef-d530f7b74b74, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=02cd91e1-0812-4268-baef-d530f7b74b74,segment=NetworkSegment(0a75612c-c02a-4294-901e-f7bbf1a2b310),segment_id=0a75612c-c02a-4294-901e-f7bbf1a2b310)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:13:49.329357 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:13:49.376809 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=02cd91e1-0812-4268-baef-d530f7b74b74,revision_number=9']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:13:49.574044 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['02cd91e1-0812-4268-baef-d530f7b74b74'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 05:13:50.002512 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7509581c-9363-4112-b74a-41b9099753b5 req-894a2049-97b5-4214-9407-76cf544e02ef tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:50.004879 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-7509581c-9363-4112-b74a-41b9099753b5 req-894a2049-97b5-4214-9407-76cf544e02ef tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 945 time: 0.0474203 Nov 09 05:13:50.051589 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-7509581c-9363-4112-b74a-41b9099753b5 req-8b113e84-0470-4c5a-84fb-f21bf1078b75 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0417814 Nov 09 05:13:51.086328 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 02cd91e1-0812-4268-baef-d530f7b74b74 up at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:13:51.133173 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning complete for port 02cd91e1-0812-4268-baef-d530f7b74b74 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:13:51.133533 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:13:51.167111 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af66c144-33de-414b-8535-6dd7d6d47be1 req-9924fc24-62ba-4fca-b1a3-163712e9d341 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:51.168529 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-af66c144-33de-414b-8535-6dd7d6d47be1 req-9924fc24-62ba-4fca-b1a3-163712e9d341 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 945 time: 0.0491025 Nov 09 05:13:51.216877 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-af66c144-33de-414b-8535-6dd7d6d47be1 req-f0702334-2d73-4ebd-830d-af95f06f5747 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0425365 Nov 09 05:13:51.354103 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:13:51.377920 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8ceaef36-6e08-4613-a259-762c2dca1575', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '02cd91e1-0812-4268-baef-d530f7b74b74'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:13:51.380157 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bd9aa552-73d4-43d9-8f3b-35f24fc7d92a" -d '{"events": [{"server_uuid": "8ceaef36-6e08-4613-a259-762c2dca1575", "name": "network-vif-plugged", "status": "completed", "tag": "02cd91e1-0812-4268-baef-d530f7b74b74"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:13:51.392660 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 02cd91e1-0812-4268-baef-d530f7b74b74, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=02cd91e1-0812-4268-baef-d530f7b74b74,segment=NetworkSegment(0a75612c-c02a-4294-901e-f7bbf1a2b310),segment_id=0a75612c-c02a-4294-901e-f7bbf1a2b310)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:13:51.483923 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:13:51.529902 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=02cd91e1-0812-4268-baef-d530f7b74b74,revision_number=10']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:13:52.330704 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5039a58b-8e82-49d5-a60c-271e02183855 req-5a51e18c-a491-415f-b9fb-65ea912e6cef tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:52.332195 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5039a58b-8e82-49d5-a60c-271e02183855 req-5a51e18c-a491-415f-b9fb-65ea912e6cef tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 947 time: 0.0483046 Nov 09 05:13:52.384672 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5039a58b-8e82-49d5-a60c-271e02183855 req-96f751fa-10fa-4846-80dd-be8bf363c0c6 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0466802 Nov 09 05:13:52.432563 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 05:13:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0bae3dc2-f455-47d7-85fc-6bbe5e43a451 x-openstack-request-id: req-0bae3dc2-f455-47d7-85fc-6bbe5e43a451 {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:13:52.433034 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8ceaef36-6e08-4613-a259-762c2dca1575", "name": "network-vif-plugged", "status": "completed", "tag": "02cd91e1-0812-4268-baef-d530f7b74b74", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:13:52.433145 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-0bae3dc2-f455-47d7-85fc-6bbe5e43a451 {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:13:52.433478 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8ceaef36-6e08-4613-a259-762c2dca1575', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '02cd91e1-0812-4268-baef-d530f7b74b74', 'code': 200} Nov 09 05:13:52.773881 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2910beef-888f-40a4-9eb2-dd9ec2fbd7b5 req-46eafb88-83d0-44e7-a8d6-afbae8b7ad08 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:52.775361 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2910beef-888f-40a4-9eb2-dd9ec2fbd7b5 req-46eafb88-83d0-44e7-a8d6-afbae8b7ad08 service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 1100 time: 0.0390313 Nov 09 05:13:52.819285 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2910beef-888f-40a4-9eb2-dd9ec2fbd7b5 req-80c7ff8e-1098-4c5b-ac0f-b91f42430141 service neutron] 10.222.0.26 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0368814 Nov 09 05:13:53.498120 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09a8bbf6-846a-46ac-a656-daa7f675b365 req-35c4ed3b-f4f5-4a34-b814-58b3184ee4b0 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:53.500345 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-09a8bbf6-846a-46ac-a656-daa7f675b365 req-35c4ed3b-f4f5-4a34-b814-58b3184ee4b0 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 947 time: 0.0505607 Nov 09 05:13:53.547768 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-09a8bbf6-846a-46ac-a656-daa7f675b365 req-2617aff6-9e44-4048-b354-67397c82490d tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0416420 Nov 09 05:13:54.665088 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce344ca6-1d3e-497b-beb5-2eb2da12b45f req-8d907285-e392-4b38-9f33-43294937b52e tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:54.666605 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ce344ca6-1d3e-497b-beb5-2eb2da12b45f req-8d907285-e392-4b38-9f33-43294937b52e tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 947 time: 0.0491440 Nov 09 05:13:54.715241 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ce344ca6-1d3e-497b-beb5-2eb2da12b45f req-02e518cf-f40b-497d-b1a1-fd92fcb0f232 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0425284 Nov 09 05:13:55.451151 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 05:13:55.833077 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16e23e39-31f7-489b-89ec-23d5e08612fe req-55170032-10ef-4b53-84cf-137401496ce5 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:13:55.834617 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-16e23e39-31f7-489b-89ec-23d5e08612fe req-55170032-10ef-4b53-84cf-137401496ce5 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 947 time: 0.0512383 Nov 09 05:13:55.886026 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-16e23e39-31f7-489b-89ec-23d5e08612fe req-1b2914c4-43d8-483f-9273-e4022db7179e tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0453248 Nov 09 05:14:11.404476 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b7f4621d-6656-4992-9dba-08a528c313ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:14:12.639350 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:14:13.705613 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-bcfe5f20-3239-4565-95fd-92c509141624 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:14:15.273362 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:14:16.661752 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:14:17.010427 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:14:31.364720 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-bc4212a3-d51a-4e15-87b1-35f02157c7d9 req-bd6cb21c-ff90-46ad-b68f-18f7deb77b10 service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1006837 Nov 09 05:14:31.443142 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc4212a3-d51a-4e15-87b1-35f02157c7d9 req-3575541a-c41e-492e-b75f-8239477b921a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:14:31.445212 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-bc4212a3-d51a-4e15-87b1-35f02157c7d9 req-3575541a-c41e-492e-b75f-8239477b921a service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=ebd13c4f757b48ab9d14fcf5b3a5325a&device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 1100 time: 0.0387607 Nov 09 05:14:31.548439 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc4212a3-d51a-4e15-87b1-35f02157c7d9 req-00ff9d1d-492b-4760-a2c4-2084cda0267f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:14:31.549770 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-bc4212a3-d51a-4e15-87b1-35f02157c7d9 req-00ff9d1d-492b-4760-a2c4-2084cda0267f service neutron] 10.222.0.26 "GET /v2.0/networks?id=41e1a505-f3a3-418f-9229-3880f4333c14 HTTP/1.1" status: 200 len: 910 time: 0.0847993 Nov 09 05:14:31.612507 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-bc4212a3-d51a-4e15-87b1-35f02157c7d9 req-69dfc440-6032-4a0b-a859-e3e2c3082654 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=02cd91e1-0812-4268-baef-d530f7b74b74 HTTP/1.1" status: 200 len: 1001 time: 0.0550392 Nov 09 05:14:31.665200 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc4212a3-d51a-4e15-87b1-35f02157c7d9 req-aee5bd40-ec7f-4c5d-8ccf-e70994092750 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:14:31.666646 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-bc4212a3-d51a-4e15-87b1-35f02157c7d9 req-aee5bd40-ec7f-4c5d-8ccf-e70994092750 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=abf74659-fa86-43c8-a52c-7b696adbf35a HTTP/1.1" status: 200 len: 848 time: 0.0464973 Nov 09 05:14:31.709880 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc4212a3-d51a-4e15-87b1-35f02157c7d9 req-c9af1739-eb87-4deb-b971-055d7aa5b063 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:14:31.711433 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-bc4212a3-d51a-4e15-87b1-35f02157c7d9 req-c9af1739-eb87-4deb-b971-055d7aa5b063 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=41e1a505-f3a3-418f-9229-3880f4333c14&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0381250 Nov 09 05:14:31.801571 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-bc4212a3-d51a-4e15-87b1-35f02157c7d9 req-91f529dd-5799-4f6a-a5d3-96c1f734698b service neutron] 10.222.0.26 "GET /v2.0/networks/41e1a505-f3a3-418f-9229-3880f4333c14?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0828519 Nov 09 05:14:31.894483 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-bc4212a3-d51a-4e15-87b1-35f02157c7d9 req-b57b9fc4-0c9a-474f-a9d1-1a2b8f0414a6 service neutron] 10.222.0.26 "GET /v2.0/networks/41e1a505-f3a3-418f-9229-3880f4333c14?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0849609 Nov 09 05:14:32.450581 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 05:14:41.405856 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c798f350-6f12-4fd1-a0da-4e82eaff616f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:14:42.640054 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:14:43.714325 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ed0990e7-b322-43fb-9b68-8abec758188c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:14:45.289915 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:14:46.655657 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:14:47.015381 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:05.538891 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 38110) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:15:05.704289 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-c54ffc85-65bf-492a-a07c-69748a2ca9e0 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Deleting port d6ea95f5-b6fd-4fa9-a1f9-57520b3d7865 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:15:05.704617 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c54ffc85-65bf-492a-a07c-69748a2ca9e0 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:06.056065 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c54ffc85-65bf-492a-a07c-69748a2ca9e0 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:06.056385 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c54ffc85-65bf-492a-a07c-69748a2ca9e0 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:06.068123 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-c54ffc85-65bf-492a-a07c-69748a2ca9e0 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Calling delete_port for d6ea95f5-b6fd-4fa9-a1f9-57520b3d7865 owned by network:floatingip {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:15:06.269748 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c54ffc85-65bf-492a-a07c-69748a2ca9e0 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:06.295950 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c54ffc85-65bf-492a-a07c-69748a2ca9e0 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Pushing event deleted for resources: {'Port': ['ID=d6ea95f5-b6fd-4fa9-a1f9-57520b3d7865,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:15:06.318258 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c54ffc85-65bf-492a-a07c-69748a2ca9e0 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:15:06.318631 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c54ffc85-65bf-492a-a07c-69748a2ca9e0 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:15:06.318974 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c54ffc85-65bf-492a-a07c-69748a2ca9e0 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:15:06.319305 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c54ffc85-65bf-492a-a07c-69748a2ca9e0 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:15:06.319636 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c54ffc85-65bf-492a-a07c-69748a2ca9e0 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:15:06.319964 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c54ffc85-65bf-492a-a07c-69748a2ca9e0 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:15:06.320311 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c54ffc85-65bf-492a-a07c-69748a2ca9e0 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:15:06.320726 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c54ffc85-65bf-492a-a07c-69748a2ca9e0 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:15:06.321053 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c54ffc85-65bf-492a-a07c-69748a2ca9e0 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:15:06.321380 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c54ffc85-65bf-492a-a07c-69748a2ca9e0 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:15:06.321720 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c54ffc85-65bf-492a-a07c-69748a2ca9e0 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:15:06.322038 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c54ffc85-65bf-492a-a07c-69748a2ca9e0 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:15:06.366849 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c54ffc85-65bf-492a-a07c-69748a2ca9e0 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for floatingip, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:06.367177 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.l3_db [None req-c54ffc85-65bf-492a-a07c-69748a2ca9e0 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Floating IP 75e873bc-2011-4c40-ad91-c8b04f7a4e85 disassociated (deleted). External IP: 172.26.0.60, port: 02cd91e1-0812-4268-baef-d530f7b74b74. Nov 09 05:15:06.570219 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c54ffc85-65bf-492a-a07c-69748a2ca9e0 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Router 4119e421-6cb1-4924-9967-18e73a4eeae3 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 05:15:06.674232 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c54ffc85-65bf-492a-a07c-69748a2ca9e0 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 05:15:06.678950 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-c54ffc85-65bf-492a-a07c-69748a2ca9e0 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:06.683962 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4bad0510-fe41-484d-8e29-ee81552db466 None None] Sync routers for ids ['4119e421-6cb1-4924-9967-18e73a4eeae3'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 05:15:06.693449 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4bad0510-fe41-484d-8e29-ee81552db466 None None] Routers {'4119e421-6cb1-4924-9967-18e73a4eeae3'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:15:06.694045 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-4bad0510-fe41-484d-8e29-ee81552db466 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:14:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['4119e421-6cb1-4924-9967-18e73a4eeae3'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:15:06.705546 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-c54ffc85-65bf-492a-a07c-69748a2ca9e0 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "DELETE /v2.0/floatingips/75e873bc-2011-4c40-ad91-c8b04f7a4e85 HTTP/1.1" status: 204 len: 168 time: 1.1655848 Nov 09 05:15:06.706243 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8ceaef36-6e08-4613-a259-762c2dca1575', 'tag': '02cd91e1-0812-4268-baef-d530f7b74b74'}] {{(pid=102161) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:15:06.708669 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}99dfdda0def497b4372884ef2eb87f06b1e425c8eba5ceda5f64bbab037a07d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7ccab5dd-f955-4f99-b6ef-bc4a84334f63" -d '{"events": [{"name": "network-changed", "server_uuid": "8ceaef36-6e08-4613-a259-762c2dca1575", "tag": "02cd91e1-0812-4268-baef-d530f7b74b74"}]}' {{(pid=102161) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:15:06.912276 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-4bad0510-fe41-484d-8e29-ee81552db466 None None] Set router 4119e421-6cb1-4924-9967-18e73a4eeae3 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:15:07.018111 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 05:15:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-23affa90-5476-442c-ac8e-9d6a8d9a6e7b x-openstack-request-id: req-23affa90-5476-442c-ac8e-9d6a8d9a6e7b {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:15:07.018111 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8ceaef36-6e08-4613-a259-762c2dca1575", "tag": "02cd91e1-0812-4268-baef-d530f7b74b74", "status": "completed", "code": 200}]} {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:15:07.018111 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-23affa90-5476-442c-ac8e-9d6a8d9a6e7b {{(pid=102161) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:15:07.018111 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8ceaef36-6e08-4613-a259-762c2dca1575', 'tag': '02cd91e1-0812-4268-baef-d530f7b74b74', 'status': 'completed', 'code': 200} Nov 09 05:15:07.079835 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ccab5dd-f955-4f99-b6ef-bc4a84334f63 req-e060ddfe-473e-4916-804d-d559453da65d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:15:07.081338 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7ccab5dd-f955-4f99-b6ef-bc4a84334f63 req-e060ddfe-473e-4916-804d-d559453da65d service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=ebd13c4f757b48ab9d14fcf5b3a5325a&device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 1100 time: 0.0457251 Nov 09 05:15:07.119160 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-4bad0510-fe41-484d-8e29-ee81552db466 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'name': 'tempest-TestShelveInstance-1961526497-router', 'tenant_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.251'}], 'enable_snat': True}, 'gw_port_id': '5204f9e0-7d71-4dee-997d-b68078c7a10f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:10:41Z', 'updated_at': '2021-11-09T05:10:44Z', 'revision_number': 4, 'project_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'gw_port': {'id': '5204f9e0-7d71-4dee-997d-b68078c7a10f', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:88:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1808, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.251', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:10:42Z', 'updated_at': '2021-11-09T05:10:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '165314fc-453c-4fef-bf42-9efd260d1493', 'name': '', 'network_id': '41e1a505-f3a3-418f-9229-3880f4333c14', 'tenant_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'mac_address': 'fa:16:3e:7d:79:b9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'device_owner': 'network:router_interface', 'standard_attr_id': 1809, 'fixed_ips': [{'subnet_id': 'abf74659-fa86-43c8-a52c-7b696adbf35a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:10:44Z', 'updated_at': '2021-11-09T05:10:48Z', 'revision_number': 5, 'project_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'subnets': [{'id': 'abf74659-fa86-43c8-a52c-7b696adbf35a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:15:07.145961 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4bad0510-fe41-484d-8e29-ee81552db466 None None] Checking router: 4119e421-6cb1-4924-9967-18e73a4eeae3 for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 05:15:07.154246 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4bad0510-fe41-484d-8e29-ee81552db466 None None] Routers {'4119e421-6cb1-4924-9967-18e73a4eeae3'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:15:07.154862 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-4bad0510-fe41-484d-8e29-ee81552db466 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:14:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['4119e421-6cb1-4924-9967-18e73a4eeae3'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:15:07.220868 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c46af84e-acc6-4820-a9f9-2c6487414297 req-d3f04772-bb92-4b28-9eae-6890fae8a4f4 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:15:07.222314 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c46af84e-acc6-4820-a9f9-2c6487414297 req-d3f04772-bb92-4b28-9eae-6890fae8a4f4 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 947 time: 0.1338301 Nov 09 05:15:07.223264 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ccab5dd-f955-4f99-b6ef-bc4a84334f63 req-00c5a372-2e26-495b-b07a-40ee7f52159e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:15:07.224552 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7ccab5dd-f955-4f99-b6ef-bc4a84334f63 req-00c5a372-2e26-495b-b07a-40ee7f52159e service neutron] 10.222.0.26 "GET /v2.0/networks?id=41e1a505-f3a3-418f-9229-3880f4333c14 HTTP/1.1" status: 200 len: 910 time: 0.1308336 Nov 09 05:15:07.260061 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-4bad0510-fe41-484d-8e29-ee81552db466 None None] Set router 4119e421-6cb1-4924-9967-18e73a4eeae3 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:15:07.283448 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7ccab5dd-f955-4f99-b6ef-bc4a84334f63 req-7dc1e28f-c6ac-44ad-b9a3-1be99fe685f4 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=02cd91e1-0812-4268-baef-d530f7b74b74 HTTP/1.1" status: 200 len: 217 time: 0.0485501 Nov 09 05:15:07.333614 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c46af84e-acc6-4820-a9f9-2c6487414297 req-9dfe8b77-2dd5-49dc-8312-475311446537 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1050198 Nov 09 05:15:07.349053 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ccab5dd-f955-4f99-b6ef-bc4a84334f63 req-e73adf36-d164-4b60-9117-ec5f3f7c9dfb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:15:07.350522 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7ccab5dd-f955-4f99-b6ef-bc4a84334f63 req-e73adf36-d164-4b60-9117-ec5f3f7c9dfb service neutron] 10.222.0.26 "GET /v2.0/subnets?id=abf74659-fa86-43c8-a52c-7b696adbf35a HTTP/1.1" status: 200 len: 848 time: 0.0574722 Nov 09 05:15:07.400762 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ccab5dd-f955-4f99-b6ef-bc4a84334f63 req-949a1c4c-64e6-4a38-a979-82b50fe21faa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:15:07.402758 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7ccab5dd-f955-4f99-b6ef-bc4a84334f63 req-949a1c4c-64e6-4a38-a979-82b50fe21faa service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=41e1a505-f3a3-418f-9229-3880f4333c14&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0407035 Nov 09 05:15:07.460485 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-4bad0510-fe41-484d-8e29-ee81552db466 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'name': 'tempest-TestShelveInstance-1961526497-router', 'tenant_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.251'}], 'enable_snat': True}, 'gw_port_id': '5204f9e0-7d71-4dee-997d-b68078c7a10f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:10:41Z', 'updated_at': '2021-11-09T05:10:44Z', 'revision_number': 4, 'project_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'gw_port': {'id': '5204f9e0-7d71-4dee-997d-b68078c7a10f', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:88:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1808, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.251', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:10:42Z', 'updated_at': '2021-11-09T05:10:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '165314fc-453c-4fef-bf42-9efd260d1493', 'name': '', 'network_id': '41e1a505-f3a3-418f-9229-3880f4333c14', 'tenant_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'mac_address': 'fa:16:3e:7d:79:b9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'device_owner': 'network:router_interface', 'standard_attr_id': 1809, 'fixed_ips': [{'subnet_id': 'abf74659-fa86-43c8-a52c-7b696adbf35a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:10:44Z', 'updated_at': '2021-11-09T05:10:48Z', 'revision_number': 5, 'project_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'subnets': [{'id': 'abf74659-fa86-43c8-a52c-7b696adbf35a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:15:07.487772 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4bad0510-fe41-484d-8e29-ee81552db466 None None] The sync data for ids ['4119e421-6cb1-4924-9967-18e73a4eeae3'] in dv-neutron-816802-2-hyperv is: [{'id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'name': 'tempest-TestShelveInstance-1961526497-router', 'tenant_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.251'}], 'enable_snat': True}, 'gw_port_id': '5204f9e0-7d71-4dee-997d-b68078c7a10f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:10:41Z', 'updated_at': '2021-11-09T05:10:44Z', 'revision_number': 4, 'project_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'gw_port': {'id': '5204f9e0-7d71-4dee-997d-b68078c7a10f', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:88:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1808, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.251', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:10:42Z', 'updated_at': '2021-11-09T05:10:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '165314fc-453c-4fef-bf42-9efd260d1493', 'name': '', 'network_id': '41e1a505-f3a3-418f-9229-3880f4333c14', 'tenant_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'mac_address': 'fa:16:3e:7d:79:b9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'device_owner': 'network:router_interface', 'standard_attr_id': 1809, 'fixed_ips': [{'subnet_id': 'abf74659-fa86-43c8-a52c-7b696adbf35a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:10:44Z', 'updated_at': '2021-11-09T05:10:48Z', 'revision_number': 5, 'project_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'subnets': [{'id': 'abf74659-fa86-43c8-a52c-7b696adbf35a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 05:15:07.501833 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7ccab5dd-f955-4f99-b6ef-bc4a84334f63 req-d60ecee8-d8b7-4b1f-bb23-ee4e3f5f4118 service neutron] 10.222.0.26 "GET /v2.0/networks/41e1a505-f3a3-418f-9229-3880f4333c14?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0897725 Nov 09 05:15:07.595385 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7ccab5dd-f955-4f99-b6ef-bc4a84334f63 req-2a620c23-8123-4b27-912c-9cf06524f2b8 service neutron] 10.222.0.26 "GET /v2.0/networks/41e1a505-f3a3-418f-9229-3880f4333c14?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0847635 Nov 09 05:15:07.705591 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2b9c42c9-1737-461d-97fa-b16b5ea32522 None None] New status for floating IP 75e873bc-2011-4c40-ad91-c8b04f7a4e85: DOWN {{(pid=102163) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 05:15:08.458691 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0fa4f40-11ea-47f5-8892-469fb1bf0ebf req-b6540e40-3e96-4358-a99a-d79b2d810dfa tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:15:08.460176 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c0fa4f40-11ea-47f5-8892-469fb1bf0ebf req-b6540e40-3e96-4358-a99a-d79b2d810dfa tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.26 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 947 time: 0.0530283 Nov 09 05:15:08.503197 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-982ea324-1ed7-42ca-b343-3e146e47e1f1 req-73d8438f-36df-458b-b57c-9ee7adf9926c tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:15:08.504829 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-982ea324-1ed7-42ca-b343-3e146e47e1f1 req-73d8438f-36df-458b-b57c-9ee7adf9926c tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 947 time: 0.1004801 Nov 09 05:15:08.549239 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-c0fa4f40-11ea-47f5-8892-469fb1bf0ebf req-1e9cfaaa-3c63-4e3c-8241-b5da7112b0eb tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Deleting port 02cd91e1-0812-4268-baef-d530f7b74b74 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:15:08.549577 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-c0fa4f40-11ea-47f5-8892-469fb1bf0ebf req-1e9cfaaa-3c63-4e3c-8241-b5da7112b0eb tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:08.558142 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-982ea324-1ed7-42ca-b343-3e146e47e1f1 req-b5a5e044-f111-4434-a855-e968b8445271 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=f6e88f2d-5816-42d2-b751-48bf5e018795&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0468848 Nov 09 05:15:08.638917 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-c0fa4f40-11ea-47f5-8892-469fb1bf0ebf req-1e9cfaaa-3c63-4e3c-8241-b5da7112b0eb tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] For port 02cd91e1-0812-4268-baef-d530f7b74b74, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=02cd91e1-0812-4268-baef-d530f7b74b74,segment=NetworkSegment(0a75612c-c02a-4294-901e-f7bbf1a2b310),segment_id=0a75612c-c02a-4294-901e-f7bbf1a2b310)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:15:08.639192 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-c0fa4f40-11ea-47f5-8892-469fb1bf0ebf req-1e9cfaaa-3c63-4e3c-8241-b5da7112b0eb tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:08.651455 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-c0fa4f40-11ea-47f5-8892-469fb1bf0ebf req-1e9cfaaa-3c63-4e3c-8241-b5da7112b0eb tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Calling delete_port for 02cd91e1-0812-4268-baef-d530f7b74b74 owned by compute:nova {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:15:08.824118 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-c0fa4f40-11ea-47f5-8892-469fb1bf0ebf req-1e9cfaaa-3c63-4e3c-8241-b5da7112b0eb tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:08.856060 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e9cfaaa-3c63-4e3c-8241-b5da7112b0eb tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Pushing event deleted for resources: {'Port': ['ID=02cd91e1-0812-4268-baef-d530f7b74b74,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:15:08.882400 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e9cfaaa-3c63-4e3c-8241-b5da7112b0eb tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:15:08.882755 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e9cfaaa-3c63-4e3c-8241-b5da7112b0eb tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:15:08.883088 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e9cfaaa-3c63-4e3c-8241-b5da7112b0eb tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:15:08.883417 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e9cfaaa-3c63-4e3c-8241-b5da7112b0eb tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:15:08.883744 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e9cfaaa-3c63-4e3c-8241-b5da7112b0eb tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:15:08.884072 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e9cfaaa-3c63-4e3c-8241-b5da7112b0eb tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:15:08.884392 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e9cfaaa-3c63-4e3c-8241-b5da7112b0eb tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:15:08.884712 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e9cfaaa-3c63-4e3c-8241-b5da7112b0eb tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:15:08.885324 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e9cfaaa-3c63-4e3c-8241-b5da7112b0eb tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:15:08.885324 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e9cfaaa-3c63-4e3c-8241-b5da7112b0eb tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:15:08.885641 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e9cfaaa-3c63-4e3c-8241-b5da7112b0eb tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:15:08.885967 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e9cfaaa-3c63-4e3c-8241-b5da7112b0eb tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:15:08.905319 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-c0fa4f40-11ea-47f5-8892-469fb1bf0ebf req-1e9cfaaa-3c63-4e3c-8241-b5da7112b0eb tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] No DVR routers for this DVR port 02cd91e1-0812-4268-baef-d530f7b74b74 on host hv-neutron-8168 {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 05:15:08.909876 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-c0fa4f40-11ea-47f5-8892-469fb1bf0ebf req-1e9cfaaa-3c63-4e3c-8241-b5da7112b0eb tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:08.910989 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c0fa4f40-11ea-47f5-8892-469fb1bf0ebf req-1e9cfaaa-3c63-4e3c-8241-b5da7112b0eb tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.26 "DELETE /v2.0/ports/02cd91e1-0812-4268-baef-d530f7b74b74 HTTP/1.1" status: 204 len: 173 time: 0.4443722 Nov 09 05:15:08.911421 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8ceaef36-6e08-4613-a259-762c2dca1575', 'name': 'network-vif-deleted', 'tag': '02cd91e1-0812-4268-baef-d530f7b74b74'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:15:08.913623 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-97d192cb-e33a-4b74-aefb-61a7cf75f2a5" -d '{"events": [{"server_uuid": "8ceaef36-6e08-4613-a259-762c2dca1575", "name": "network-vif-deleted", "tag": "02cd91e1-0812-4268-baef-d530f7b74b74"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:15:08.949126 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 05:15:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-97321e2a-3602-4907-bd5b-798315accb81 x-openstack-request-id: req-97321e2a-3602-4907-bd5b-798315accb81 {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:15:08.949423 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8ceaef36-6e08-4613-a259-762c2dca1575", "name": "network-vif-deleted", "tag": "02cd91e1-0812-4268-baef-d530f7b74b74", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:15:08.949693 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-97321e2a-3602-4907-bd5b-798315accb81 {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:15:08.950089 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8ceaef36-6e08-4613-a259-762c2dca1575', 'name': 'network-vif-deleted', 'tag': '02cd91e1-0812-4268-baef-d530f7b74b74', 'status': 'completed', 'code': 200} Nov 09 05:15:09.450235 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 05:15:09.666475 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-d601f3e9-0939-440c-ad7f-2f225ad36d75 req-027c7693-b88f-45d2-8c0e-36995cd56929 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=8ceaef36-6e08-4613-a259-762c2dca1575 HTTP/1.1" status: 200 len: 210 time: 0.0268519 Nov 09 05:15:10.722306 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 38140) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:15:10.780723 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-fb66ef7b-ef5f-4b60-a153-1ca15e5d8a8e tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:10.805080 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-fb66ef7b-ef5f-4b60-a153-1ca15e5d8a8e tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:10.921519 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-fb66ef7b-ef5f-4b60-a153-1ca15e5d8a8e tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:10.924194 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-fb66ef7b-ef5f-4b60-a153-1ca15e5d8a8e tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:10.925372 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-fb66ef7b-ef5f-4b60-a153-1ca15e5d8a8e tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "DELETE /v2.0/security-groups/f6e88f2d-5816-42d2-b751-48bf5e018795 HTTP/1.1" status: 204 len: 168 time: 0.2020497 Nov 09 05:15:10.934422 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb66ef7b-ef5f-4b60-a153-1ca15e5d8a8e tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=f6e88f2d-5816-42d2-b751-48bf5e018795,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:15:11.294580 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 38146) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:15:11.299228 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-afb35103-5903-4b1d-b6df-81320648d404 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1802679933', 'description': 'tempest-secgroup-smoke-1802679933 description', 'project_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:15:11.416833 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5f2a3036-202d-4eec-9f05-9c295264abf1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:11.439729 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-afb35103-5903-4b1d-b6df-81320648d404 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for security_group, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:11.504308 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-afb35103-5903-4b1d-b6df-81320648d404 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for security_group, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:11.590000 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-afb35103-5903-4b1d-b6df-81320648d404 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:11.621835 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afb35103-5903-4b1d-b6df-81320648d404 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Pushing event updated for resources: {'SecurityGroup': ['ID=a91c2c29-9e77-40ac-b633-1eb86d1c611c,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:15:11.671883 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-afb35103-5903-4b1d-b6df-81320648d404 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:11.673095 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-afb35103-5903-4b1d-b6df-81320648d404 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.3775156 Nov 09 05:15:11.675931 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 38148) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:15:11.681073 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-5bedc7c9-373d-4a16-8a53-3f97bf943b13 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Request body: {'security_group_rule': {'security_group_id': 'a91c2c29-9e77-40ac-b633-1eb86d1c611c', 'project_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:15:11.792625 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5bedc7c9-373d-4a16-8a53-3f97bf943b13 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:11.848999 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5bedc7c9-373d-4a16-8a53-3f97bf943b13 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:11.915677 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5bedc7c9-373d-4a16-8a53-3f97bf943b13 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:11.934098 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bedc7c9-373d-4a16-8a53-3f97bf943b13 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d3acb10f-edb9-4e31-a679-c7f4639a64e6,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:15:12.009298 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-5bedc7c9-373d-4a16-8a53-3f97bf943b13 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:12.010548 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-5bedc7c9-373d-4a16-8a53-3f97bf943b13 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3336577 Nov 09 05:15:12.013199 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 38150) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:15:12.017543 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-f7844bb2-8382-4940-b65e-79a050aac8d1 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Request body: {'security_group_rule': {'security_group_id': 'a91c2c29-9e77-40ac-b633-1eb86d1c611c', 'project_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:15:12.126319 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f7844bb2-8382-4940-b65e-79a050aac8d1 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:12.180116 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f7844bb2-8382-4940-b65e-79a050aac8d1 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:12.258762 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f7844bb2-8382-4940-b65e-79a050aac8d1 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:12.276980 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7844bb2-8382-4940-b65e-79a050aac8d1 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3b55680a-0194-496a-9170-241247971c00,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:15:12.334844 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-f7844bb2-8382-4940-b65e-79a050aac8d1 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:12.336044 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-f7844bb2-8382-4940-b65e-79a050aac8d1 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.3218942 Nov 09 05:15:12.338650 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 38152) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:15:12.343449 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-8afb6594-808a-4155-be79-a85626c074fa tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Request body: {'security_group_rule': {'security_group_id': 'a91c2c29-9e77-40ac-b633-1eb86d1c611c', 'project_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:15:12.432956 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8afb6594-808a-4155-be79-a85626c074fa tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:12.487184 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8afb6594-808a-4155-be79-a85626c074fa tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:12.559605 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8afb6594-808a-4155-be79-a85626c074fa tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:12.582042 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8afb6594-808a-4155-be79-a85626c074fa tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=269d32b6-516b-447d-ab36-a5d6e13c3500,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:15:12.652682 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8afb6594-808a-4155-be79-a85626c074fa tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:12.653881 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-8afb6594-808a-4155-be79-a85626c074fa tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3137548 Nov 09 05:15:12.656548 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 38154) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:15:12.665415 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-7ea90340-a69b-4ba6-a4c8-b68c72437dda tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Request body: {'security_group_rule': {'security_group_id': 'a91c2c29-9e77-40ac-b633-1eb86d1c611c', 'project_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:15:12.684985 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:12.747359 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7ea90340-a69b-4ba6-a4c8-b68c72437dda tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:12.811731 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7ea90340-a69b-4ba6-a4c8-b68c72437dda tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:12.890853 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7ea90340-a69b-4ba6-a4c8-b68c72437dda tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:12.908665 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ea90340-a69b-4ba6-a4c8-b68c72437dda tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4a20ac6b-4086-436c-b59e-a5dc241dd230,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:15:12.991798 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7ea90340-a69b-4ba6-a4c8-b68c72437dda tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:12.992987 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-7ea90340-a69b-4ba6-a4c8-b68c72437dda tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3355398 Nov 09 05:15:12.996294 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 38156) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:15:13.000730 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-d56adb1b-e186-432b-95d1-f8815e37f01a tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Request body: {'security_group_rule': {'security_group_id': 'a91c2c29-9e77-40ac-b633-1eb86d1c611c', 'project_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:15:13.092690 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.securitygroups_db [None req-d56adb1b-e186-432b-95d1-f8815e37f01a tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Project ebd13c4f757b48ab9d14fcf5b3a5325a added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 09 05:15:13.097592 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d56adb1b-e186-432b-95d1-f8815e37f01a tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:13.153576 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d56adb1b-e186-432b-95d1-f8815e37f01a tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:13.224640 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d56adb1b-e186-432b-95d1-f8815e37f01a tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:13.241637 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d56adb1b-e186-432b-95d1-f8815e37f01a tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=bdc6baaa-67db-4fd7-ad9b-f3b9dbe0126d,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:15:13.306595 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-d56adb1b-e186-432b-95d1-f8815e37f01a tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:13.307786 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-d56adb1b-e186-432b-95d1-f8815e37f01a tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.3105993 Nov 09 05:15:13.310510 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 38158) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:15:13.315953 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-7b263ef5-213c-4ee2-bc48-7f5fd0e217cd tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Request body: {'security_group_rule': {'security_group_id': 'a91c2c29-9e77-40ac-b633-1eb86d1c611c', 'project_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:15:13.390404 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.securitygroups_db [None req-7b263ef5-213c-4ee2-bc48-7f5fd0e217cd tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Project ebd13c4f757b48ab9d14fcf5b3a5325a added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 09 05:15:13.395464 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7b263ef5-213c-4ee2-bc48-7f5fd0e217cd tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:13.452244 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7b263ef5-213c-4ee2-bc48-7f5fd0e217cd tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:13.515551 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7b263ef5-213c-4ee2-bc48-7f5fd0e217cd tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:13.532512 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b263ef5-213c-4ee2-bc48-7f5fd0e217cd tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8d495769-f617-4172-bfc5-f9e858f72db2,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:15:13.556311 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 02cd91e1-0812-4268-baef-d530f7b74b74 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 05:15:13.575780 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] No Port match for: 02cd91e1-0812-4268-baef-d530f7b74b74 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 05:15:13.580921 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 02cd91e1-0812-4268-baef-d530f7b74b74 not bound to the agent host hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 05:15:13.597605 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7b263ef5-213c-4ee2-bc48-7f5fd0e217cd tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:13.598836 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-7b263ef5-213c-4ee2-bc48-7f5fd0e217cd tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.2874267 Nov 09 05:15:13.710612 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-90aee5d0-f54d-4b41-84a6-2db85cbcec19 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:15.281382 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:16.659014 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:17.013340 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:39.630814 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b44254b9-ca73-4f19-9219-32d00120b5dd req-801826cc-9734-438c-8fde-18801a501f92 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1802679933&fields=id&tenant_id=ebd13c4f757b48ab9d14fcf5b3a5325a HTTP/1.1" status: 200 len: 267 time: 0.0472403 Nov 09 05:15:39.733774 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b44254b9-ca73-4f19-9219-32d00120b5dd req-f1d11e27-3002-421d-9a01-20818a4bffbb tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:15:39.735153 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b44254b9-ca73-4f19-9219-32d00120b5dd req-f1d11e27-3002-421d-9a01-20818a4bffbb tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/networks?id=41e1a505-f3a3-418f-9229-3880f4333c14 HTTP/1.1" status: 200 len: 809 time: 0.0977335 Nov 09 05:15:39.750086 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b44254b9-ca73-4f19-9219-32d00120b5dd req-df416a29-45aa-4a78-9b9a-2767ac0732cf tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/quotas/ebd13c4f757b48ab9d14fcf5b3a5325a HTTP/1.1" status: 200 len: 375 time: 0.0087001 Nov 09 05:15:39.799048 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b44254b9-ca73-4f19-9219-32d00120b5dd req-7dbfcefe-a51f-48b1-b2da-e7fcfc6f8054 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?tenant_id=ebd13c4f757b48ab9d14fcf5b3a5325a&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0430007 Nov 09 05:15:39.854691 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [req-b44254b9-ca73-4f19-9219-32d00120b5dd req-c54d36b5-b2b0-4314-9cc5-c826e610f435 service neutron] http://10.222.0.24:9696/v2.0/extensions returned with HTTP 200 {{(pid=102161) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 05:15:39.855668 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b44254b9-ca73-4f19-9219-32d00120b5dd req-c54d36b5-b2b0-4314-9cc5-c826e610f435 service neutron] 10.222.0.24 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0455313 Nov 09 05:15:39.959596 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b44254b9-ca73-4f19-9219-32d00120b5dd req-7e32cbb9-1285-462b-9d8b-b6c713a956ef service neutron] 10.222.0.24 "GET /v2.0/networks/41e1a505-f3a3-418f-9229-3880f4333c14?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0976965 Nov 09 05:15:40.049334 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b44254b9-ca73-4f19-9219-32d00120b5dd req-6f723806-eb97-4bf2-9fcf-4923687fbb19 service neutron] 10.222.0.24 "GET /v2.0/networks/41e1a505-f3a3-418f-9229-3880f4333c14?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0874667 Nov 09 05:15:40.604520 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b1f19c9b-423d-4e23-9416-445331e0c0fc req-e5b82897-b762-40dd-8869-e9cbf3483c4f tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 210 time: 0.0299199 Nov 09 05:15:41.373838 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c77f5594-6600-4e37-99d7-f5a11385825d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:41.696346 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-0f6f4e4d-abd6-4396-a547-588f34536e29 req-fe246a03-6474-4ca9-a9d6-ee5b329f2bc0 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 210 time: 0.0264704 Nov 09 05:15:42.376591 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b44254b9-ca73-4f19-9219-32d00120b5dd req-5a6b1127-5df3-47da-8eb6-1bedb830cddf tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:15:42.378056 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b44254b9-ca73-4f19-9219-32d00120b5dd req-5a6b1127-5df3-47da-8eb6-1bedb830cddf tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.26 "GET /v2.0/networks?id=41e1a505-f3a3-418f-9229-3880f4333c14 HTTP/1.1" status: 200 len: 809 time: 0.1052740 Nov 09 05:15:42.496179 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b44254b9-ca73-4f19-9219-32d00120b5dd req-126e68bd-6e19-4fa6-b0e0-8f4e23a27697 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.26 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=ebd13c4f757b48ab9d14fcf5b3a5325a HTTP/1.1" status: 200 len: 380 time: 0.1087461 Nov 09 05:15:42.511806 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-b44254b9-ca73-4f19-9219-32d00120b5dd req-dae669bf-8ef6-415c-838d-3bebd3bac113 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Request body: {'port': {'device_id': '95295fb2-238e-4b98-b4c7-082b0868082d', 'network_id': '41e1a505-f3a3-418f-9229-3880f4333c14', 'admin_state_up': True, 'tenant_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'security_groups': ['a91c2c29-9e77-40ac-b633-1eb86d1c611c']}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:15:42.652421 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:42.731996 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b44254b9-ca73-4f19-9219-32d00120b5dd req-dae669bf-8ef6-415c-838d-3bebd3bac113 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Made reservation on behalf of ebd13c4f757b48ab9d14fcf5b3a5325a for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 05:15:42.735522 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-b44254b9-ca73-4f19-9219-32d00120b5dd req-dae669bf-8ef6-415c-838d-3bebd3bac113 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:42.815001 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5de0b799-49ad-4a10-9ac2-e94c4ace69ab req-3e240eae-a1fe-4b13-9083-dac4b0038645 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 210 time: 0.0504184 Nov 09 05:15:42.900536 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [req-b44254b9-ca73-4f19-9219-32d00120b5dd req-dae669bf-8ef6-415c-838d-3bebd3bac113 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Allocated IP 172.20.0.9 (41e1a505-f3a3-418f-9229-3880f4333c14/abf74659-fa86-43c8-a52c-7b696adbf35a/201106f8-ad57-43ba-8183-8f7ecbe69722) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 05:15:43.045609 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-b44254b9-ca73-4f19-9219-32d00120b5dd req-dae669bf-8ef6-415c-838d-3bebd3bac113 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:43.151453 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-b44254b9-ca73-4f19-9219-32d00120b5dd req-dae669bf-8ef6-415c-838d-3bebd3bac113 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:43.195949 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b44254b9-ca73-4f19-9219-32d00120b5dd req-dae669bf-8ef6-415c-838d-3bebd3bac113 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Network 41e1a505-f3a3-418f-9229-3880f4333c14 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:15:43.198996 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [req-b44254b9-ca73-4f19-9219-32d00120b5dd req-dae669bf-8ef6-415c-838d-3bebd3bac113 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:15:43.205464 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-b44254b9-ca73-4f19-9219-32d00120b5dd req-dae669bf-8ef6-415c-838d-3bebd3bac113 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 05:15:43.232112 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dae669bf-8ef6-415c-838d-3bebd3bac113 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Pushing event updated for resources: {'Port': ['ID=201106f8-ad57-43ba-8183-8f7ecbe69722,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:15:43.273181 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b44254b9-ca73-4f19-9219-32d00120b5dd req-dae669bf-8ef6-415c-838d-3bebd3bac113 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:15:43.273936 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-b44254b9-ca73-4f19-9219-32d00120b5dd req-dae669bf-8ef6-415c-838d-3bebd3bac113 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:43.416655 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b44254b9-ca73-4f19-9219-32d00120b5dd req-dae669bf-8ef6-415c-838d-3bebd3bac113 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.26 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.9085758 Nov 09 05:15:43.429582 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-b44254b9-ca73-4f19-9219-32d00120b5dd req-ef0cc468-a925-4804-9c9b-7c561d2ecd6e service neutron] Request body: {'port': {'device_id': '95295fb2-238e-4b98-b4c7-082b0868082d', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:15:43.436087 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-2ea5b48c-0a17-4069-b696-8ea128d72b43 None None] Provisioning complete for port 201106f8-ad57-43ba-8183-8f7ecbe69722 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:15:43.436459 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-2ea5b48c-0a17-4069-b696-8ea128d72b43 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:43.475679 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-2ea5b48c-0a17-4069-b696-8ea128d72b43 None None] Port 201106f8-ad57-43ba-8183-8f7ecbe69722 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 05:15:43.484238 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-b44254b9-ca73-4f19-9219-32d00120b5dd req-ef0cc468-a925-4804-9c9b-7c561d2ecd6e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:43.714995 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-48db7593-7d62-4a08-9848-ddf0b6f189ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:43.944442 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bc751ca-c3b1-4799-a584-f10881695fb5 req-b2116418-3c60-4bdc-9d5d-af0609d24ae2 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:15:43.945974 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-2bc751ca-c3b1-4799-a584-f10881695fb5 req-b2116418-3c60-4bdc-9d5d-af0609d24ae2 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 931 time: 0.0531797 Nov 09 05:15:44.000192 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-2bc751ca-c3b1-4799-a584-f10881695fb5 req-a0b71cec-b939-4087-8f6f-a2ec0282bde4 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=a91c2c29-9e77-40ac-b633-1eb86d1c611c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0474284 Nov 09 05:15:44.068051 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [req-b44254b9-ca73-4f19-9219-32d00120b5dd req-ef0cc468-a925-4804-9c9b-7c561d2ecd6e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 201106f8-ad57-43ba-8183-8f7ecbe69722 {{(pid=102162) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 05:15:44.075888 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-b44254b9-ca73-4f19-9219-32d00120b5dd req-ef0cc468-a925-4804-9c9b-7c561d2ecd6e service neutron] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:44.089153 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.provisioning_blocks [req-b44254b9-ca73-4f19-9219-32d00120b5dd req-ef0cc468-a925-4804-9c9b-7c561d2ecd6e service neutron] Transition to ACTIVE for port object 201106f8-ad57-43ba-8183-8f7ecbe69722 will not be triggered until provisioned by entity L2. {{(pid=102162) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 09 05:15:44.157048 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-b44254b9-ca73-4f19-9219-32d00120b5dd req-ef0cc468-a925-4804-9c9b-7c561d2ecd6e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:44.224886 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef0cc468-a925-4804-9c9b-7c561d2ecd6e service neutron] Pushing event updated for resources: {'Port': ['ID=201106f8-ad57-43ba-8183-8f7ecbe69722,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:15:44.290038 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-b44254b9-ca73-4f19-9219-32d00120b5dd req-ef0cc468-a925-4804-9c9b-7c561d2ecd6e service neutron] Attempting to bind port 201106f8-ad57-43ba-8183-8f7ecbe69722 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 05:15:44.290650 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-b44254b9-ca73-4f19-9219-32d00120b5dd req-ef0cc468-a925-4804-9c9b-7c561d2ecd6e service neutron] Attempting to bind port 201106f8-ad57-43ba-8183-8f7ecbe69722 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '0a75612c-c02a-4294-901e-f7bbf1a2b310', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 326, 'network_id': '41e1a505-f3a3-418f-9229-3880f4333c14'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 05:15:44.291183 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b44254b9-ca73-4f19-9219-32d00120b5dd req-ef0cc468-a925-4804-9c9b-7c561d2ecd6e service neutron] Attempting to bind port 201106f8-ad57-43ba-8183-8f7ecbe69722 on network 41e1a505-f3a3-418f-9229-3880f4333c14 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 05:15:44.297727 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b44254b9-ca73-4f19-9219-32d00120b5dd req-ef0cc468-a925-4804-9c9b-7c561d2ecd6e service neutron] Port 201106f8-ad57-43ba-8183-8f7ecbe69722 on network 41e1a505-f3a3-418f-9229-3880f4333c14 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 05:15:44.298287 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b44254b9-ca73-4f19-9219-32d00120b5dd req-ef0cc468-a925-4804-9c9b-7c561d2ecd6e service neutron] Attempting to bind port 201106f8-ad57-43ba-8183-8f7ecbe69722 on network 41e1a505-f3a3-418f-9229-3880f4333c14 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 05:15:44.305980 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b44254b9-ca73-4f19-9219-32d00120b5dd req-ef0cc468-a925-4804-9c9b-7c561d2ecd6e service neutron] Checking agent: {'id': '7d36b884-4ad2-4878-9464-bf647030b544', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'started_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 5, 15, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 05:15:44.306456 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b44254b9-ca73-4f19-9219-32d00120b5dd req-ef0cc468-a925-4804-9c9b-7c561d2ecd6e service neutron] Checking segment: {'id': '0a75612c-c02a-4294-901e-f7bbf1a2b310', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 326, 'network_id': '41e1a505-f3a3-418f-9229-3880f4333c14'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 05:15:44.307001 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b44254b9-ca73-4f19-9219-32d00120b5dd req-ef0cc468-a925-4804-9c9b-7c561d2ecd6e service neutron] Bound using segment: {'id': '0a75612c-c02a-4294-901e-f7bbf1a2b310', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 326, 'network_id': '41e1a505-f3a3-418f-9229-3880f4333c14'} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 05:15:44.307630 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-b44254b9-ca73-4f19-9219-32d00120b5dd req-ef0cc468-a925-4804-9c9b-7c561d2ecd6e service neutron] Bound port: 201106f8-ad57-43ba-8183-8f7ecbe69722, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '0a75612c-c02a-4294-901e-f7bbf1a2b310', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 326, 'network_id': '41e1a505-f3a3-418f-9229-3880f4333c14'}}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 05:15:44.308250 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-b44254b9-ca73-4f19-9219-32d00120b5dd req-ef0cc468-a925-4804-9c9b-7c561d2ecd6e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:44.381318 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-b44254b9-ca73-4f19-9219-32d00120b5dd req-ef0cc468-a925-4804-9c9b-7c561d2ecd6e service neutron] For port 201106f8-ad57-43ba-8183-8f7ecbe69722, host hv-neutron-8168, cleared binding levels {{(pid=102162) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 05:15:44.384331 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-b44254b9-ca73-4f19-9219-32d00120b5dd req-ef0cc468-a925-4804-9c9b-7c561d2ecd6e service neutron] For port 201106f8-ad57-43ba-8183-8f7ecbe69722, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=201106f8-ad57-43ba-8183-8f7ecbe69722,segment=NetworkSegment(0a75612c-c02a-4294-901e-f7bbf1a2b310),segment_id=0a75612c-c02a-4294-901e-f7bbf1a2b310)] {{(pid=102162) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 05:15:44.475573 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-b44254b9-ca73-4f19-9219-32d00120b5dd req-ef0cc468-a925-4804-9c9b-7c561d2ecd6e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:44.510427 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b44254b9-ca73-4f19-9219-32d00120b5dd req-ef0cc468-a925-4804-9c9b-7c561d2ecd6e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:15:44.511043 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-b44254b9-ca73-4f19-9219-32d00120b5dd req-ef0cc468-a925-4804-9c9b-7c561d2ecd6e service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:44.512404 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b44254b9-ca73-4f19-9219-32d00120b5dd req-ef0cc468-a925-4804-9c9b-7c561d2ecd6e service neutron] 10.222.0.26 "PUT /v2.0/ports/201106f8-ad57-43ba-8183-8f7ecbe69722 HTTP/1.1" status: 200 len: 1093 time: 1.0870109 Nov 09 05:15:44.512838 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '95295fb2-238e-4b98-b4c7-082b0868082d', 'tag': '201106f8-ad57-43ba-8183-8f7ecbe69722'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:15:44.515090 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-52ad27a7-330b-4a6d-bc5f-657d9f85e8ce" -d '{"events": [{"name": "network-changed", "server_uuid": "95295fb2-238e-4b98-b4c7-082b0868082d", "tag": "201106f8-ad57-43ba-8183-8f7ecbe69722"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:15:44.555309 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef0cc468-a925-4804-9c9b-7c561d2ecd6e service neutron] Pushing event updated for resources: {'Port': ['ID=201106f8-ad57-43ba-8183-8f7ecbe69722,revision_number=3']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:15:44.558935 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 05:15:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1e86ccba-6246-4cd5-b277-4f8caf49cd23 x-openstack-request-id: req-1e86ccba-6246-4cd5-b277-4f8caf49cd23 {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:15:44.559235 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "95295fb2-238e-4b98-b4c7-082b0868082d", "tag": "201106f8-ad57-43ba-8183-8f7ecbe69722", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:15:44.559482 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-1e86ccba-6246-4cd5-b277-4f8caf49cd23 {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:15:44.559867 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '95295fb2-238e-4b98-b4c7-082b0868082d', 'tag': '201106f8-ad57-43ba-8183-8f7ecbe69722', 'status': 'completed', 'code': 200} Nov 09 05:15:44.637059 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52ad27a7-330b-4a6d-bc5f-657d9f85e8ce req-59dd2d45-08fd-4af7-9df9-1346cb2da7e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:15:44.638717 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-52ad27a7-330b-4a6d-bc5f-657d9f85e8ce req-59dd2d45-08fd-4af7-9df9-1346cb2da7e1 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=ebd13c4f757b48ab9d14fcf5b3a5325a&device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 1096 time: 0.0565357 Nov 09 05:15:44.751014 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52ad27a7-330b-4a6d-bc5f-657d9f85e8ce req-1918c699-cada-4ea7-82a2-6a88c558bb51 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:15:44.752522 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-52ad27a7-330b-4a6d-bc5f-657d9f85e8ce req-1918c699-cada-4ea7-82a2-6a88c558bb51 service neutron] 10.222.0.26 "GET /v2.0/networks?tenant_id=ebd13c4f757b48ab9d14fcf5b3a5325a&shared=False HTTP/1.1" status: 200 len: 910 time: 0.1014259 Nov 09 05:15:44.853383 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52ad27a7-330b-4a6d-bc5f-657d9f85e8ce req-f4d72f85-e0ab-4ce0-8ceb-07bc9c79d20d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:15:44.854897 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-52ad27a7-330b-4a6d-bc5f-657d9f85e8ce req-f4d72f85-e0ab-4ce0-8ceb-07bc9c79d20d service neutron] 10.222.0.26 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0958142 Nov 09 05:15:44.936826 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b44254b9-ca73-4f19-9219-32d00120b5dd req-7db7fb42-87f5-4839-ab7b-4185031e8a19 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:15:44.938121 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b44254b9-ca73-4f19-9219-32d00120b5dd req-7db7fb42-87f5-4839-ab7b-4185031e8a19 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=ebd13c4f757b48ab9d14fcf5b3a5325a&device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 1096 time: 0.0431933 Nov 09 05:15:44.980388 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b44254b9-ca73-4f19-9219-32d00120b5dd req-21d73b0d-c719-4420-8001-c101f40e08ef service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=201106f8-ad57-43ba-8183-8f7ecbe69722 HTTP/1.1" status: 200 len: 217 time: 0.0343876 Nov 09 05:15:45.034433 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b44254b9-ca73-4f19-9219-32d00120b5dd req-9576ef8a-7e25-4c00-ae07-3a4c7883e029 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:15:45.036494 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b44254b9-ca73-4f19-9219-32d00120b5dd req-9576ef8a-7e25-4c00-ae07-3a4c7883e029 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=abf74659-fa86-43c8-a52c-7b696adbf35a HTTP/1.1" status: 200 len: 848 time: 0.0484157 Nov 09 05:15:45.082810 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b44254b9-ca73-4f19-9219-32d00120b5dd req-d891875b-0f62-4c85-9bd0-939299431838 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:15:45.084400 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b44254b9-ca73-4f19-9219-32d00120b5dd req-d891875b-0f62-4c85-9bd0-939299431838 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=41e1a505-f3a3-418f-9229-3880f4333c14&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0412431 Nov 09 05:15:45.122825 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f443251-5c0c-42cc-a12d-72e1b430560c req-6ba8f0de-ffe0-4377-9c1c-978b3882b914 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:15:45.124506 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-7f443251-5c0c-42cc-a12d-72e1b430560c req-6ba8f0de-ffe0-4377-9c1c-978b3882b914 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 943 time: 0.0507925 Nov 09 05:15:45.177234 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b44254b9-ca73-4f19-9219-32d00120b5dd req-09f12618-1760-4cb3-aa96-cd978245820c service neutron] 10.222.0.26 "GET /v2.0/networks/41e1a505-f3a3-418f-9229-3880f4333c14?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0853083 Nov 09 05:15:45.179937 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-7f443251-5c0c-42cc-a12d-72e1b430560c req-afe119fd-b8cb-4cab-9a66-d9f28ecd72df tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=a91c2c29-9e77-40ac-b633-1eb86d1c611c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0485113 Nov 09 05:15:45.272089 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:45.272675 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b44254b9-ca73-4f19-9219-32d00120b5dd req-7cdd5b1d-f8e2-4d80-8747-fc9e47d46592 service neutron] 10.222.0.26 "GET /v2.0/networks/41e1a505-f3a3-418f-9229-3880f4333c14?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0884273 Nov 09 05:15:46.296857 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4480f85-9246-4ed5-8f34-e8a93694cee5 req-0aea2773-3a6a-446b-a38c-37b2c64acb67 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:15:46.298328 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d4480f85-9246-4ed5-8f34-e8a93694cee5 req-0aea2773-3a6a-446b-a38c-37b2c64acb67 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 943 time: 0.0493603 Nov 09 05:15:46.346513 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d4480f85-9246-4ed5-8f34-e8a93694cee5 req-f50f4192-76df-4148-9b3e-d11aa78ea1fb tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=a91c2c29-9e77-40ac-b633-1eb86d1c611c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416176 Nov 09 05:15:46.448905 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 05:15:46.671420 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:47.008217 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:47.463706 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-997e83d3-3351-4665-b5f2-dab1c56b95ad req-621c6e23-c9c0-4fea-96e5-56b3f9ca5e2d tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:15:47.466453 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-997e83d3-3351-4665-b5f2-dab1c56b95ad req-621c6e23-c9c0-4fea-96e5-56b3f9ca5e2d tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 943 time: 0.0501461 Nov 09 05:15:47.514689 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-997e83d3-3351-4665-b5f2-dab1c56b95ad req-8877fa05-593a-4621-9bd4-3047d69fd3ee tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=a91c2c29-9e77-40ac-b633-1eb86d1c611c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435719 Nov 09 05:15:48.632897 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86f0d312-2b61-40af-942e-b0efc0432716 req-a846e520-1648-42fd-8ca4-3b59799621bc tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:15:48.634337 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-86f0d312-2b61-40af-942e-b0efc0432716 req-a846e520-1648-42fd-8ca4-3b59799621bc tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 943 time: 0.0527058 Nov 09 05:15:48.681473 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-86f0d312-2b61-40af-942e-b0efc0432716 req-f2c1614d-b8de-453e-924b-c64972f5763b tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=a91c2c29-9e77-40ac-b633-1eb86d1c611c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411575 Nov 09 05:15:49.803599 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-254bb197-0b37-4ff3-8486-33f133c820a9 req-5fdbca49-e97f-4e56-b52a-86a8dfb559c2 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:15:49.805066 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-254bb197-0b37-4ff3-8486-33f133c820a9 req-5fdbca49-e97f-4e56-b52a-86a8dfb559c2 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 943 time: 0.0478106 Nov 09 05:15:49.853327 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-254bb197-0b37-4ff3-8486-33f133c820a9 req-aec09b35-87f8-4f0a-b948-26d42551054e tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=a91c2c29-9e77-40ac-b633-1eb86d1c611c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424447 Nov 09 05:15:51.014167 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5f1e404-f417-4bc6-84ee-0508d6e73dfd req-f66ea890-1d22-4372-bba1-c98daab54810 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:15:51.015645 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d5f1e404-f417-4bc6-84ee-0508d6e73dfd req-f66ea890-1d22-4372-bba1-c98daab54810 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 943 time: 0.0478742 Nov 09 05:15:51.064090 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d5f1e404-f417-4bc6-84ee-0508d6e73dfd req-eb35376b-7e18-42db-b78a-92ae7e834d53 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=a91c2c29-9e77-40ac-b633-1eb86d1c611c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426943 Nov 09 05:15:52.181283 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6085e2c1-2b16-4282-9b5a-67e1fb08204a req-b14a4328-3d57-40d0-9c98-89988ff0d70c tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:15:52.182655 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-6085e2c1-2b16-4282-9b5a-67e1fb08204a req-b14a4328-3d57-40d0-9c98-89988ff0d70c tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 943 time: 0.0524178 Nov 09 05:15:52.230203 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-6085e2c1-2b16-4282-9b5a-67e1fb08204a req-8856c048-56cf-478d-b31e-3d63dd246f81 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=a91c2c29-9e77-40ac-b633-1eb86d1c611c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417514 Nov 09 05:15:53.342217 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdffc327-a98a-4c0d-83a9-20b6fb3a6b91 req-50ccf808-173c-4e49-8d87-ffb818ff9c4d tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:15:53.344287 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fdffc327-a98a-4c0d-83a9-20b6fb3a6b91 req-50ccf808-173c-4e49-8d87-ffb818ff9c4d tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 943 time: 0.0490198 Nov 09 05:15:53.396943 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fdffc327-a98a-4c0d-83a9-20b6fb3a6b91 req-21824cb0-4b32-47ba-a0ad-c2848417e06d tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=a91c2c29-9e77-40ac-b633-1eb86d1c611c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0467968 Nov 09 05:15:54.510974 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e40e262a-b7d5-45c4-ac79-a0190255a53c req-361f86bb-ce6a-4e4a-83b2-ccb027584709 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:15:54.512459 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-e40e262a-b7d5-45c4-ac79-a0190255a53c req-361f86bb-ce6a-4e4a-83b2-ccb027584709 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 943 time: 0.0492046 Nov 09 05:15:54.560583 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-e40e262a-b7d5-45c4-ac79-a0190255a53c req-48852765-10c2-4492-af8c-c0dde19f05f3 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=a91c2c29-9e77-40ac-b633-1eb86d1c611c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422983 Nov 09 05:15:55.678159 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f25177fc-8fcf-4abe-823f-f7af61650f62 req-356c604d-63bf-4323-89b7-3da9605a397c tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:15:55.680318 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f25177fc-8fcf-4abe-823f-f7af61650f62 req-356c604d-63bf-4323-89b7-3da9605a397c tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 943 time: 0.0552044 Nov 09 05:15:55.721423 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 201106f8-ad57-43ba-8183-8f7ecbe69722 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=102163) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 09 05:15:55.728472 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f25177fc-8fcf-4abe-823f-f7af61650f62 req-2ff22d32-c085-4a77-8e1f-7ec08dc96af6 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=a91c2c29-9e77-40ac-b633-1eb86d1c611c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424461 Nov 09 05:15:55.811744 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 201106f8-ad57-43ba-8183-8f7ecbe69722, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=201106f8-ad57-43ba-8183-8f7ecbe69722,segment=NetworkSegment(0a75612c-c02a-4294-901e-f7bbf1a2b310),segment_id=0a75612c-c02a-4294-901e-f7bbf1a2b310)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:15:55.822884 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Returning: {'device': '201106f8-ad57-43ba-8183-8f7ecbe69722', 'network_id': '41e1a505-f3a3-418f-9229-3880f4333c14', 'port_id': '201106f8-ad57-43ba-8183-8f7ecbe69722', 'mac_address': 'fa:16:3e:b7:43:61', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 326, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'abf74659-fa86-43c8-a52c-7b696adbf35a', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102163) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 09 05:15:55.861491 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:55.873242 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 201106f8-ad57-43ba-8183-8f7ecbe69722 {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 05:15:55.892765 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 201106f8-ad57-43ba-8183-8f7ecbe69722, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=201106f8-ad57-43ba-8183-8f7ecbe69722,segment=NetworkSegment(0a75612c-c02a-4294-901e-f7bbf1a2b310),segment_id=0a75612c-c02a-4294-901e-f7bbf1a2b310)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:15:55.968632 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:56.015936 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=201106f8-ad57-43ba-8183-8f7ecbe69722,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:15:56.023455 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:15:56.023806 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:15:56.024148 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:15:56.024484 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:15:56.024814 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:15:56.025151 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:15:56.025505 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:15:56.025833 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:15:56.026158 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:15:56.026516 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:15:56.026842 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:15:56.027161 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:15:56.176759 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['201106f8-ad57-43ba-8183-8f7ecbe69722'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 05:15:56.844713 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9917be9a-e4d9-4f8e-b240-a39abe332b0e req-c2658f66-a884-4537-8f6b-4cbafd72a9b6 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:15:56.846245 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-9917be9a-e4d9-4f8e-b240-a39abe332b0e req-c2658f66-a884-4537-8f6b-4cbafd72a9b6 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 944 time: 0.0489984 Nov 09 05:15:56.901520 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-9917be9a-e4d9-4f8e-b240-a39abe332b0e req-0eb0ce77-be82-42c9-bd4a-ccc2ce325512 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=a91c2c29-9e77-40ac-b633-1eb86d1c611c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0493405 Nov 09 05:15:57.736922 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 201106f8-ad57-43ba-8183-8f7ecbe69722 up at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:15:57.854129 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning for port 201106f8-ad57-43ba-8183-8f7ecbe69722 completed by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 09 05:15:57.858242 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning complete for port 201106f8-ad57-43ba-8183-8f7ecbe69722 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:15:57.858640 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:57.938668 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:57.964405 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '95295fb2-238e-4b98-b4c7-082b0868082d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '201106f8-ad57-43ba-8183-8f7ecbe69722'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:15:57.967148 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9e046e3a-e4d0-47ce-9a9f-d03729950281" -d '{"events": [{"server_uuid": "95295fb2-238e-4b98-b4c7-082b0868082d", "name": "network-vif-plugged", "status": "completed", "tag": "201106f8-ad57-43ba-8183-8f7ecbe69722"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:15:57.981300 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 201106f8-ad57-43ba-8183-8f7ecbe69722, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=201106f8-ad57-43ba-8183-8f7ecbe69722,segment=NetworkSegment(0a75612c-c02a-4294-901e-f7bbf1a2b310),segment_id=0a75612c-c02a-4294-901e-f7bbf1a2b310)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:15:58.024389 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dc33f7a-fda1-4dac-ba26-0b1e4deea704 req-3df93b78-0812-47d4-87aa-725e28a7839d tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:15:58.026025 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3dc33f7a-fda1-4dac-ba26-0b1e4deea704 req-3df93b78-0812-47d4-87aa-725e28a7839d tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 944 time: 0.0539224 Nov 09 05:15:58.063500 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:15:58.081671 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3dc33f7a-fda1-4dac-ba26-0b1e4deea704 req-31e11de7-0e3d-4919-b9b9-769a2063bd88 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=a91c2c29-9e77-40ac-b633-1eb86d1c611c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0478227 Nov 09 05:15:58.089061 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 05:15:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fcf6595e-f06c-4dc2-8e9e-0e3c6a3b3f2e x-openstack-request-id: req-fcf6595e-f06c-4dc2-8e9e-0e3c6a3b3f2e {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:15:58.089483 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "95295fb2-238e-4b98-b4c7-082b0868082d", "name": "network-vif-plugged", "status": "completed", "tag": "201106f8-ad57-43ba-8183-8f7ecbe69722", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:15:58.089738 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-fcf6595e-f06c-4dc2-8e9e-0e3c6a3b3f2e {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:15:58.090133 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '95295fb2-238e-4b98-b4c7-082b0868082d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '201106f8-ad57-43ba-8183-8f7ecbe69722', 'code': 200} Nov 09 05:15:58.115630 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=201106f8-ad57-43ba-8183-8f7ecbe69722,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:15:58.345378 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f327cf64-8bee-436c-bf31-3804b3aee073 req-0ea6bdee-989e-48c8-8583-1d19ce161336 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:15:58.346910 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f327cf64-8bee-436c-bf31-3804b3aee073 req-0ea6bdee-989e-48c8-8583-1d19ce161336 service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 1098 time: 0.0436683 Nov 09 05:15:58.400170 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-f327cf64-8bee-436c-bf31-3804b3aee073 req-1c5a88f0-ddb1-429d-87f7-b297dc73867d service neutron] 10.222.0.26 "GET /v2.0/security-groups?id=a91c2c29-9e77-40ac-b633-1eb86d1c611c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0452342 Nov 09 05:15:59.198917 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fc80989-a063-4783-ab97-2e322ff71a70 req-2f219fba-605a-413d-bbb8-54959e5ed88e tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:15:59.200319 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-8fc80989-a063-4783-ab97-2e322ff71a70 req-2f219fba-605a-413d-bbb8-54959e5ed88e tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 945 time: 0.0479763 Nov 09 05:15:59.248481 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-8fc80989-a063-4783-ab97-2e322ff71a70 req-05f16162-2fbb-418e-abd2-a2deae83fae1 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=a91c2c29-9e77-40ac-b633-1eb86d1c611c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423765 Nov 09 05:16:00.361561 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dc9ac12-508b-4d45-a3d0-156a5aab6183 req-4e98bda1-911d-4dbe-b8df-22f6146ee742 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:16:00.363072 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6dc9ac12-508b-4d45-a3d0-156a5aab6183 req-4e98bda1-911d-4dbe-b8df-22f6146ee742 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 945 time: 0.0478005 Nov 09 05:16:00.418029 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6dc9ac12-508b-4d45-a3d0-156a5aab6183 req-e577eb81-1764-4fff-8506-7aafc26b3106 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=a91c2c29-9e77-40ac-b633-1eb86d1c611c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0483665 Nov 09 05:16:00.533622 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3886c0c-637b-4b10-a025-bc735f98b765 req-b6d5ac03-9818-4edb-bc22-3a620a866a16 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:16:00.535075 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b3886c0c-637b-4b10-a025-bc735f98b765 req-b6d5ac03-9818-4edb-bc22-3a620a866a16 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 945 time: 0.0512125 Nov 09 05:16:00.588042 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b3886c0c-637b-4b10-a025-bc735f98b765 req-46da9e58-7764-489b-b943-07bf054dd09b tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=a91c2c29-9e77-40ac-b633-1eb86d1c611c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0457606 Nov 09 05:16:00.609840 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 38388) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:16:00.649054 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9a0a82ac-aa2b-475d-a6a3-8c04914dd7ec tempest-TestShelveInstance-1993639401 tempest-TestShelveInstance-1993639401-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:16:00.650603 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-9a0a82ac-aa2b-475d-a6a3-8c04914dd7ec tempest-TestShelveInstance-1993639401 tempest-TestShelveInstance-1993639401-project-admin] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 1093 time: 0.0396371 Nov 09 05:16:00.653356 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 38390) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:16:00.657561 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-6154dfc3-248b-471a-b81d-3b7f3ecfc079 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Request body: {'floatingip': {'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'port_id': '201106f8-ad57-43ba-8183-8f7ecbe69722', 'tenant_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'fixed_ip_address': '172.20.0.9'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:16:00.729398 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6154dfc3-248b-471a-b81d-3b7f3ecfc079 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for floatingip, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:16:00.828925 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6154dfc3-248b-471a-b81d-3b7f3ecfc079 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:16:00.936453 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [None req-6154dfc3-248b-471a-b81d-3b7f3ecfc079 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Allocated IP 172.26.0.204 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/1d0362a0-1066-4737-8fb0-b6ed9113e3a0) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 05:16:01.036383 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6154dfc3-248b-471a-b81d-3b7f3ecfc079 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:16:01.126926 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6154dfc3-248b-471a-b81d-3b7f3ecfc079 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:16:01.161455 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6154dfc3-248b-471a-b81d-3b7f3ecfc079 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:16:01.164688 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [None req-6154dfc3-248b-471a-b81d-3b7f3ecfc079 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:16:01.171334 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6154dfc3-248b-471a-b81d-3b7f3ecfc079 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 05:16:01.198374 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6154dfc3-248b-471a-b81d-3b7f3ecfc079 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Pushing event updated for resources: {'Port': ['ID=1d0362a0-1066-4737-8fb0-b6ed9113e3a0,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:16:01.520390 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6154dfc3-248b-471a-b81d-3b7f3ecfc079 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:16:01.649377 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6154dfc3-248b-471a-b81d-3b7f3ecfc079 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:16:01.793378 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6154dfc3-248b-471a-b81d-3b7f3ecfc079 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:16:01.852149 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6154dfc3-248b-471a-b81d-3b7f3ecfc079 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:16:01.921917 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6154dfc3-248b-471a-b81d-3b7f3ecfc079 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Pushing event updated for resources: {'Port': ['ID=1d0362a0-1066-4737-8fb0-b6ed9113e3a0,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:16:01.933237 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6154dfc3-248b-471a-b81d-3b7f3ecfc079 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:16:02.031847 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.l3_db [None req-6154dfc3-248b-471a-b81d-3b7f3ecfc079 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Floating IP cd038838-5000-416e-af85-0add2246a286 associated. External IP: 172.26.0.204, port: 201106f8-ad57-43ba-8183-8f7ecbe69722. Nov 09 05:16:02.232948 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6154dfc3-248b-471a-b81d-3b7f3ecfc079 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Router 4119e421-6cb1-4924-9967-18e73a4eeae3 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 05:16:02.338036 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6154dfc3-248b-471a-b81d-3b7f3ecfc079 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 05:16:02.347798 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-602d6da4-6ad0-4f11-9d4e-1a67b4028434 None None] Sync routers for ids ['4119e421-6cb1-4924-9967-18e73a4eeae3'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 05:16:02.356826 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-602d6da4-6ad0-4f11-9d4e-1a67b4028434 None None] Routers {'4119e421-6cb1-4924-9967-18e73a4eeae3'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:16:02.357429 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-602d6da4-6ad0-4f11-9d4e-1a67b4028434 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:15:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['4119e421-6cb1-4924-9967-18e73a4eeae3'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:16:02.462059 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-602d6da4-6ad0-4f11-9d4e-1a67b4028434 None None] Set router 4119e421-6cb1-4924-9967-18e73a4eeae3 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:16:02.492051 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-6154dfc3-248b-471a-b81d-3b7f3ecfc079 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:16:02.518780 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-6154dfc3-248b-471a-b81d-3b7f3ecfc079 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.8643191 Nov 09 05:16:02.519377 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '95295fb2-238e-4b98-b4c7-082b0868082d', 'tag': '201106f8-ad57-43ba-8183-8f7ecbe69722'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:16:02.521635 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3cacb051-e467-49cf-a435-d9e976594b5c" -d '{"events": [{"name": "network-changed", "server_uuid": "95295fb2-238e-4b98-b4c7-082b0868082d", "tag": "201106f8-ad57-43ba-8183-8f7ecbe69722"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:16:02.612398 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 05:16:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-25f5d908-a10b-4cd3-ac83-bb9e51abc49d x-openstack-request-id: req-25f5d908-a10b-4cd3-ac83-bb9e51abc49d {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:16:02.612688 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "95295fb2-238e-4b98-b4c7-082b0868082d", "tag": "201106f8-ad57-43ba-8183-8f7ecbe69722", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:16:02.612942 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-25f5d908-a10b-4cd3-ac83-bb9e51abc49d {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:16:02.613346 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '95295fb2-238e-4b98-b4c7-082b0868082d', 'tag': '201106f8-ad57-43ba-8183-8f7ecbe69722', 'status': 'completed', 'code': 200} Nov 09 05:16:02.674207 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cacb051-e467-49cf-a435-d9e976594b5c req-850822bb-ca0f-4803-865b-a6ecbc69b3df service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:16:02.675717 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3cacb051-e467-49cf-a435-d9e976594b5c req-850822bb-ca0f-4803-865b-a6ecbc69b3df service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=ebd13c4f757b48ab9d14fcf5b3a5325a&device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 1098 time: 0.0402803 Nov 09 05:16:02.690925 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-602d6da4-6ad0-4f11-9d4e-1a67b4028434 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'name': 'tempest-TestShelveInstance-1961526497-router', 'tenant_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.251'}], 'enable_snat': True}, 'gw_port_id': '5204f9e0-7d71-4dee-997d-b68078c7a10f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:10:41Z', 'updated_at': '2021-11-09T05:10:44Z', 'revision_number': 4, 'project_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'gw_port': {'id': '5204f9e0-7d71-4dee-997d-b68078c7a10f', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:88:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1808, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.251', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:10:42Z', 'updated_at': '2021-11-09T05:10:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': 'cd038838-5000-416e-af85-0add2246a286', 'tenant_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'floating_ip_address': '172.26.0.204', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'port_id': '201106f8-ad57-43ba-8183-8f7ecbe69722', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 1845, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '41e1a505-f3a3-418f-9229-3880f4333c14', 'mac_address': 'fa:16:3e:b7:43:61', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '95295fb2-238e-4b98-b4c7-082b0868082d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T05:16:01Z', 'updated_at': '2021-11-09T05:16:01Z', 'revision_number': 0, 'project_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '165314fc-453c-4fef-bf42-9efd260d1493', 'name': '', 'network_id': '41e1a505-f3a3-418f-9229-3880f4333c14', 'tenant_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'mac_address': 'fa:16:3e:7d:79:b9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'device_owner': 'network:router_interface', 'standard_attr_id': 1809, 'fixed_ips': [{'subnet_id': 'abf74659-fa86-43c8-a52c-7b696adbf35a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:10:44Z', 'updated_at': '2021-11-09T05:10:48Z', 'revision_number': 5, 'project_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'subnets': [{'id': 'abf74659-fa86-43c8-a52c-7b696adbf35a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:16:02.716187 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-602d6da4-6ad0-4f11-9d4e-1a67b4028434 None None] Checking router: 4119e421-6cb1-4924-9967-18e73a4eeae3 for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 05:16:02.724339 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-602d6da4-6ad0-4f11-9d4e-1a67b4028434 None None] Routers {'4119e421-6cb1-4924-9967-18e73a4eeae3'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:16:02.724967 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-602d6da4-6ad0-4f11-9d4e-1a67b4028434 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:15:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['4119e421-6cb1-4924-9967-18e73a4eeae3'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:16:02.767978 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cacb051-e467-49cf-a435-d9e976594b5c req-2bad237d-8750-47b3-a208-295eb855e401 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:16:02.769437 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3cacb051-e467-49cf-a435-d9e976594b5c req-2bad237d-8750-47b3-a208-295eb855e401 service neutron] 10.222.0.26 "GET /v2.0/networks?id=41e1a505-f3a3-418f-9229-3880f4333c14 HTTP/1.1" status: 200 len: 910 time: 0.0869098 Nov 09 05:16:02.829604 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-602d6da4-6ad0-4f11-9d4e-1a67b4028434 None None] Set router 4119e421-6cb1-4924-9967-18e73a4eeae3 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:16:02.834249 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3cacb051-e467-49cf-a435-d9e976594b5c req-e68e3cc2-43b6-43d9-8646-982e07e7bf6a service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=201106f8-ad57-43ba-8183-8f7ecbe69722 HTTP/1.1" status: 200 len: 999 time: 0.0577605 Nov 09 05:16:02.883559 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cacb051-e467-49cf-a435-d9e976594b5c req-a34a13c0-1243-47e6-ad00-9d04a318ab1b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:16:02.885025 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3cacb051-e467-49cf-a435-d9e976594b5c req-a34a13c0-1243-47e6-ad00-9d04a318ab1b service neutron] 10.222.0.26 "GET /v2.0/subnets?id=abf74659-fa86-43c8-a52c-7b696adbf35a HTTP/1.1" status: 200 len: 848 time: 0.0442257 Nov 09 05:16:02.936422 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cacb051-e467-49cf-a435-d9e976594b5c req-de8cdc07-7b3e-4024-9085-5e60daa8adb8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:16:02.937957 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3cacb051-e467-49cf-a435-d9e976594b5c req-de8cdc07-7b3e-4024-9085-5e60daa8adb8 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=41e1a505-f3a3-418f-9229-3880f4333c14&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0458205 Nov 09 05:16:03.032518 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3cacb051-e467-49cf-a435-d9e976594b5c req-573a2282-4f67-4daa-8032-7186c266909c service neutron] 10.222.0.26 "GET /v2.0/networks/41e1a505-f3a3-418f-9229-3880f4333c14?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0865905 Nov 09 05:16:03.135456 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3cacb051-e467-49cf-a435-d9e976594b5c req-1891ec89-5e8e-4006-aab6-361dd63ed0cc service neutron] 10.222.0.26 "GET /v2.0/networks/41e1a505-f3a3-418f-9229-3880f4333c14?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0960231 Nov 09 05:16:03.145535 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-602d6da4-6ad0-4f11-9d4e-1a67b4028434 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'name': 'tempest-TestShelveInstance-1961526497-router', 'tenant_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.251'}], 'enable_snat': True}, 'gw_port_id': '5204f9e0-7d71-4dee-997d-b68078c7a10f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:10:41Z', 'updated_at': '2021-11-09T05:10:44Z', 'revision_number': 4, 'project_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'gw_port': {'id': '5204f9e0-7d71-4dee-997d-b68078c7a10f', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:88:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1808, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.251', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:10:42Z', 'updated_at': '2021-11-09T05:10:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': 'cd038838-5000-416e-af85-0add2246a286', 'tenant_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'floating_ip_address': '172.26.0.204', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'port_id': '201106f8-ad57-43ba-8183-8f7ecbe69722', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 1845, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '41e1a505-f3a3-418f-9229-3880f4333c14', 'mac_address': 'fa:16:3e:b7:43:61', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '95295fb2-238e-4b98-b4c7-082b0868082d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T05:16:01Z', 'updated_at': '2021-11-09T05:16:01Z', 'revision_number': 0, 'project_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '165314fc-453c-4fef-bf42-9efd260d1493', 'name': '', 'network_id': '41e1a505-f3a3-418f-9229-3880f4333c14', 'tenant_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'mac_address': 'fa:16:3e:7d:79:b9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'device_owner': 'network:router_interface', 'standard_attr_id': 1809, 'fixed_ips': [{'subnet_id': 'abf74659-fa86-43c8-a52c-7b696adbf35a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:10:44Z', 'updated_at': '2021-11-09T05:10:48Z', 'revision_number': 5, 'project_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'subnets': [{'id': 'abf74659-fa86-43c8-a52c-7b696adbf35a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:16:03.174608 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-602d6da4-6ad0-4f11-9d4e-1a67b4028434 None None] The sync data for ids ['4119e421-6cb1-4924-9967-18e73a4eeae3'] in dv-neutron-816802-2-hyperv is: [{'id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'name': 'tempest-TestShelveInstance-1961526497-router', 'tenant_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.251'}], 'enable_snat': True}, 'gw_port_id': '5204f9e0-7d71-4dee-997d-b68078c7a10f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:10:41Z', 'updated_at': '2021-11-09T05:10:44Z', 'revision_number': 4, 'project_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'gw_port': {'id': '5204f9e0-7d71-4dee-997d-b68078c7a10f', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:88:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1808, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.251', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:10:42Z', 'updated_at': '2021-11-09T05:10:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': 'cd038838-5000-416e-af85-0add2246a286', 'tenant_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'floating_ip_address': '172.26.0.204', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'port_id': '201106f8-ad57-43ba-8183-8f7ecbe69722', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 1845, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '41e1a505-f3a3-418f-9229-3880f4333c14', 'mac_address': 'fa:16:3e:b7:43:61', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '95295fb2-238e-4b98-b4c7-082b0868082d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T05:16:01Z', 'updated_at': '2021-11-09T05:16:01Z', 'revision_number': 0, 'project_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '165314fc-453c-4fef-bf42-9efd260d1493', 'name': '', 'network_id': '41e1a505-f3a3-418f-9229-3880f4333c14', 'tenant_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'mac_address': 'fa:16:3e:7d:79:b9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'device_owner': 'network:router_interface', 'standard_attr_id': 1809, 'fixed_ips': [{'subnet_id': 'abf74659-fa86-43c8-a52c-7b696adbf35a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:10:44Z', 'updated_at': '2021-11-09T05:10:48Z', 'revision_number': 5, 'project_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'subnets': [{'id': 'abf74659-fa86-43c8-a52c-7b696adbf35a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 05:16:03.357527 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9501a3a7-a01f-4672-8056-d4aac09336f7 None None] New status for floating IP cd038838-5000-416e-af85-0add2246a286: ACTIVE {{(pid=102163) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 05:16:11.357764 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4d88a7c0-3f3b-4536-b3e1-3f32c8a81176 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:16:12.652847 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:16:13.729536 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-be2b3435-71c5-4c3f-8ceb-a942a2c5dd0f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:16:15.269689 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:16:16.649556 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:16:16.998035 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:16:23.448541 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 05:16:31.310341 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d9efea7c-b016-4d96-bf56-2c16baa9d0a3 req-9145a5f5-dd2d-418c-a6a0-fd4501736073 service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0407388 Nov 09 05:16:31.391939 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9efea7c-b016-4d96-bf56-2c16baa9d0a3 req-f8069cf7-fdf4-4207-8797-4aef21920192 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:16:31.393461 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d9efea7c-b016-4d96-bf56-2c16baa9d0a3 req-f8069cf7-fdf4-4207-8797-4aef21920192 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=ebd13c4f757b48ab9d14fcf5b3a5325a&device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 1098 time: 0.0412576 Nov 09 05:16:31.501175 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9efea7c-b016-4d96-bf56-2c16baa9d0a3 req-a3454acf-3878-489a-be6e-3e31676176d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:16:31.502670 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d9efea7c-b016-4d96-bf56-2c16baa9d0a3 req-a3454acf-3878-489a-be6e-3e31676176d8 service neutron] 10.222.0.26 "GET /v2.0/networks?id=41e1a505-f3a3-418f-9229-3880f4333c14 HTTP/1.1" status: 200 len: 910 time: 0.0896642 Nov 09 05:16:31.568968 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d9efea7c-b016-4d96-bf56-2c16baa9d0a3 req-2ee3237e-ce72-49cd-ae93-ba8519ab45dd service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=201106f8-ad57-43ba-8183-8f7ecbe69722 HTTP/1.1" status: 200 len: 1001 time: 0.0584376 Nov 09 05:16:31.621286 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9efea7c-b016-4d96-bf56-2c16baa9d0a3 req-89a08c06-0d20-46ef-be4e-64b0e598e70b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:16:31.622725 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d9efea7c-b016-4d96-bf56-2c16baa9d0a3 req-89a08c06-0d20-46ef-be4e-64b0e598e70b service neutron] 10.222.0.26 "GET /v2.0/subnets?id=abf74659-fa86-43c8-a52c-7b696adbf35a HTTP/1.1" status: 200 len: 848 time: 0.0467649 Nov 09 05:16:31.667982 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9efea7c-b016-4d96-bf56-2c16baa9d0a3 req-36f6299b-eb7b-4d67-bafa-d317313f107e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:16:31.669445 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d9efea7c-b016-4d96-bf56-2c16baa9d0a3 req-36f6299b-eb7b-4d67-bafa-d317313f107e service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=41e1a505-f3a3-418f-9229-3880f4333c14&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0398664 Nov 09 05:16:31.757462 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d9efea7c-b016-4d96-bf56-2c16baa9d0a3 req-b146a759-4a89-4c39-9e04-c69a219566e6 service neutron] 10.222.0.26 "GET /v2.0/networks/41e1a505-f3a3-418f-9229-3880f4333c14?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0805542 Nov 09 05:16:31.849274 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d9efea7c-b016-4d96-bf56-2c16baa9d0a3 req-5e7a8eb1-3394-43cc-a82b-2d9be480a8e6 service neutron] 10.222.0.26 "GET /v2.0/networks/41e1a505-f3a3-418f-9229-3880f4333c14?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0847464 Nov 09 05:16:41.392448 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-41e5a3b7-e571-4cd7-a1f9-88c629625d07 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:16:42.644630 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:16:43.735991 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a0dce3df-dcef-48f8-9c48-f90a186ae8fb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:16:45.310216 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:16:46.672907 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:16:47.036204 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:17:00.456714 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 05:17:11.370804 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4880a311-4954-4519-8029-68835d6c5dbc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:17:12.665567 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:17:13.710694 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7eb2ac34-b6fe-4baa-bda1-f2c71e16c0fd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:17:15.304963 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:17:16.665405 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:17:16.985406 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:17:33.324717 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-babad758-e607-4f52-a0f6-42be3f6dc1d5 req-255eb3db-5dcf-47fa-bcc0-3fc763dff7ee service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0400193 Nov 09 05:17:33.404358 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-babad758-e607-4f52-a0f6-42be3f6dc1d5 req-be69126d-4ed1-486b-b9ee-685126259c6f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:17:33.405816 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-babad758-e607-4f52-a0f6-42be3f6dc1d5 req-be69126d-4ed1-486b-b9ee-685126259c6f service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=ebd13c4f757b48ab9d14fcf5b3a5325a&device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 1098 time: 0.0403407 Nov 09 05:17:33.799415 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-babad758-e607-4f52-a0f6-42be3f6dc1d5 req-3ac4ced2-055c-4ec8-9662-ac93e6c9baae service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:17:33.800860 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-babad758-e607-4f52-a0f6-42be3f6dc1d5 req-3ac4ced2-055c-4ec8-9662-ac93e6c9baae service neutron] 10.222.0.26 "GET /v2.0/networks?id=41e1a505-f3a3-418f-9229-3880f4333c14 HTTP/1.1" status: 200 len: 910 time: 0.3761573 Nov 09 05:17:33.865379 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-babad758-e607-4f52-a0f6-42be3f6dc1d5 req-ff744825-01f9-471c-99ba-409ff7bf5113 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=201106f8-ad57-43ba-8183-8f7ecbe69722 HTTP/1.1" status: 200 len: 1001 time: 0.0563104 Nov 09 05:17:33.918623 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-babad758-e607-4f52-a0f6-42be3f6dc1d5 req-28edc301-0451-4919-ad36-e08f2f72991b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:17:33.920083 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-babad758-e607-4f52-a0f6-42be3f6dc1d5 req-28edc301-0451-4919-ad36-e08f2f72991b service neutron] 10.222.0.26 "GET /v2.0/subnets?id=abf74659-fa86-43c8-a52c-7b696adbf35a HTTP/1.1" status: 200 len: 848 time: 0.0467217 Nov 09 05:17:33.965331 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-babad758-e607-4f52-a0f6-42be3f6dc1d5 req-6b0a968b-e588-4909-9823-0969c4696ea2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:17:33.966818 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-babad758-e607-4f52-a0f6-42be3f6dc1d5 req-6b0a968b-e588-4909-9823-0969c4696ea2 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=41e1a505-f3a3-418f-9229-3880f4333c14&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0389414 Nov 09 05:17:34.057626 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-babad758-e607-4f52-a0f6-42be3f6dc1d5 req-0e882eff-4882-4806-b159-aba684aa0af9 service neutron] 10.222.0.26 "GET /v2.0/networks/41e1a505-f3a3-418f-9229-3880f4333c14?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0824561 Nov 09 05:17:34.151100 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-babad758-e607-4f52-a0f6-42be3f6dc1d5 req-196d5e2e-dd75-4769-bc64-d2417581c09c service neutron] 10.222.0.26 "GET /v2.0/networks/41e1a505-f3a3-418f-9229-3880f4333c14?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0860868 Nov 09 05:17:37.450133 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 05:17:41.371210 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3130c9c9-cefc-46fe-9dcd-9a22d5f2bd1a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:17:42.657234 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:17:43.743061 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0a5176b0-5e7f-4150-99c9-8e8d4e09179e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:17:45.306030 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:17:46.660239 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:17:46.997402 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:18:11.375731 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f3ab6635-c2f8-4216-acbe-54a45ed188ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:18:12.664065 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:18:13.720822 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7625224b-63d2-47bf-9ba6-c2493a0082cd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:18:14.450114 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 05:18:15.294990 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:18:16.697971 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:18:16.997947 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:18:29.023199 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f689edd-43c4-423e-9308-6a4c1d3ba98f req-26bcd7a5-c934-41d0-ad3b-ae2d01b64281 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:18:29.024671 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1f689edd-43c4-423e-9308-6a4c1d3ba98f req-26bcd7a5-c934-41d0-ad3b-ae2d01b64281 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 945 time: 0.0498879 Nov 09 05:18:29.076751 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1f689edd-43c4-423e-9308-6a4c1d3ba98f req-058d1ac3-f737-4439-94c3-8b415eceae1e tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=a91c2c29-9e77-40ac-b633-1eb86d1c611c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0461826 Nov 09 05:18:30.211201 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25fc5622-d8c7-4034-b510-7c104f5be851 req-18ad4c91-9180-4ab2-af58-5f69bd160742 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:18:30.212070 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-25fc5622-d8c7-4034-b510-7c104f5be851 req-18ad4c91-9180-4ab2-af58-5f69bd160742 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 945 time: 0.0487487 Nov 09 05:18:30.260013 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-25fc5622-d8c7-4034-b510-7c104f5be851 req-0534c756-f5ea-4818-bc97-d42a87bccf70 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=a91c2c29-9e77-40ac-b633-1eb86d1c611c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421615 Nov 09 05:18:31.387810 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e42fa90-2f2a-473a-af93-2039520d3bb5 req-3a3fcfd0-158a-41a6-87e0-9c3d4156eb25 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:18:31.389268 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1e42fa90-2f2a-473a-af93-2039520d3bb5 req-3a3fcfd0-158a-41a6-87e0-9c3d4156eb25 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 945 time: 0.0487027 Nov 09 05:18:31.437568 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1e42fa90-2f2a-473a-af93-2039520d3bb5 req-63351971-89a0-4f21-9645-3b044b1d5f24 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=a91c2c29-9e77-40ac-b633-1eb86d1c611c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425417 Nov 09 05:18:32.550424 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df0fe701-9352-42b2-adec-a0bb1f60c5fe req-c5088fcf-639c-459c-a54a-d4e60c5f4cec tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:18:32.551890 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-df0fe701-9352-42b2-adec-a0bb1f60c5fe req-c5088fcf-639c-459c-a54a-d4e60c5f4cec tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 945 time: 0.0497429 Nov 09 05:18:32.598845 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-df0fe701-9352-42b2-adec-a0bb1f60c5fe req-891910a2-d655-474e-b9cd-01f10c2c64b2 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=a91c2c29-9e77-40ac-b633-1eb86d1c611c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0405855 Nov 09 05:18:33.713705 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b36f8e24-94b0-485c-9f5e-2f3b65847503 req-42961745-b8aa-4304-bc6d-664f5f0b0197 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:18:33.715204 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b36f8e24-94b0-485c-9f5e-2f3b65847503 req-42961745-b8aa-4304-bc6d-664f5f0b0197 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 945 time: 0.0484016 Nov 09 05:18:33.765360 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b36f8e24-94b0-485c-9f5e-2f3b65847503 req-40afa7dc-52a1-46b2-a7be-5b032a8a3687 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=a91c2c29-9e77-40ac-b633-1eb86d1c611c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0444279 Nov 09 05:18:34.348022 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9750085-56af-4f81-be2d-39a4e2e664c8 req-ebc32d0f-d086-419c-b982-a552f17768bc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:18:34.349478 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d9750085-56af-4f81-be2d-39a4e2e664c8 req-ebc32d0f-d086-419c-b982-a552f17768bc service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=ebd13c4f757b48ab9d14fcf5b3a5325a&device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 1098 time: 0.0428028 Nov 09 05:18:34.449712 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9750085-56af-4f81-be2d-39a4e2e664c8 req-6bb4083f-c588-4fc1-a48c-b49ec8856729 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:18:34.451216 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d9750085-56af-4f81-be2d-39a4e2e664c8 req-6bb4083f-c588-4fc1-a48c-b49ec8856729 service neutron] 10.222.0.26 "GET /v2.0/networks?id=41e1a505-f3a3-418f-9229-3880f4333c14 HTTP/1.1" status: 200 len: 910 time: 0.0824637 Nov 09 05:18:34.520277 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d9750085-56af-4f81-be2d-39a4e2e664c8 req-88149d9c-655e-4257-acf5-66d250920ba2 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=201106f8-ad57-43ba-8183-8f7ecbe69722 HTTP/1.1" status: 200 len: 1001 time: 0.0602942 Nov 09 05:18:34.567458 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9750085-56af-4f81-be2d-39a4e2e664c8 req-d3e35272-8589-4a5e-917a-d93c6999cdbc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:18:34.568859 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d9750085-56af-4f81-be2d-39a4e2e664c8 req-d3e35272-8589-4a5e-917a-d93c6999cdbc service neutron] 10.222.0.26 "GET /v2.0/subnets?id=abf74659-fa86-43c8-a52c-7b696adbf35a HTTP/1.1" status: 200 len: 848 time: 0.0419590 Nov 09 05:18:34.613414 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9750085-56af-4f81-be2d-39a4e2e664c8 req-e93ba776-15d6-4237-88f4-94d30573d498 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:18:34.614822 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d9750085-56af-4f81-be2d-39a4e2e664c8 req-e93ba776-15d6-4237-88f4-94d30573d498 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=41e1a505-f3a3-418f-9229-3880f4333c14&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0388818 Nov 09 05:18:34.707194 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d9750085-56af-4f81-be2d-39a4e2e664c8 req-6644a290-030c-4527-846c-086bf6bd1bae service neutron] 10.222.0.26 "GET /v2.0/networks/41e1a505-f3a3-418f-9229-3880f4333c14?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0840297 Nov 09 05:18:34.795189 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d9750085-56af-4f81-be2d-39a4e2e664c8 req-bfe73d23-a91e-41e2-8fa1-746ce6d3c09b service neutron] 10.222.0.26 "GET /v2.0/networks/41e1a505-f3a3-418f-9229-3880f4333c14?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0813572 Nov 09 05:18:34.883330 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f6f4d4b-baf7-44f1-b5df-2b49e115d94e req-687a8955-212d-4ad6-b97b-6141ab2cfbd5 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:18:34.884977 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-2f6f4d4b-baf7-44f1-b5df-2b49e115d94e req-687a8955-212d-4ad6-b97b-6141ab2cfbd5 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 945 time: 0.0519652 Nov 09 05:18:34.933465 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-2f6f4d4b-baf7-44f1-b5df-2b49e115d94e req-0a729644-a966-498d-b776-1eb4dba3613e tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=a91c2c29-9e77-40ac-b633-1eb86d1c611c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425248 Nov 09 05:18:36.050182 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f4bfbb4-6f74-4f15-beaa-8ebf336423ce req-6afc8913-df05-4229-b890-ce9b9ec152ee tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:18:36.053353 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9f4bfbb4-6f74-4f15-beaa-8ebf336423ce req-6afc8913-df05-4229-b890-ce9b9ec152ee tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 945 time: 0.0530508 Nov 09 05:18:36.100846 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9f4bfbb4-6f74-4f15-beaa-8ebf336423ce req-7090d241-870f-4223-9cc6-8374061bac30 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=a91c2c29-9e77-40ac-b633-1eb86d1c611c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427577 Nov 09 05:18:37.213140 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e365d39f-65b4-4954-8810-a3ae5cd331b2 req-27831880-33b3-4c75-89d6-bf619efa6ea0 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:18:37.214618 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-e365d39f-65b4-4954-8810-a3ae5cd331b2 req-27831880-33b3-4c75-89d6-bf619efa6ea0 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 945 time: 0.0478764 Nov 09 05:18:37.262934 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-e365d39f-65b4-4954-8810-a3ae5cd331b2 req-6950deb0-51a2-43e5-8a5b-0724fc30eea4 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=a91c2c29-9e77-40ac-b633-1eb86d1c611c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424783 Nov 09 05:18:38.373144 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85014bae-2420-446f-991e-124c1c5ecc93 req-e819d502-ef72-4a93-8ea1-c20095c9b017 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:18:38.374646 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-85014bae-2420-446f-991e-124c1c5ecc93 req-e819d502-ef72-4a93-8ea1-c20095c9b017 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 945 time: 0.0473235 Nov 09 05:18:38.421978 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-85014bae-2420-446f-991e-124c1c5ecc93 req-3bc5e08b-861e-4299-b325-e4de0260db38 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=a91c2c29-9e77-40ac-b633-1eb86d1c611c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416393 Nov 09 05:18:39.210263 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b67788f-c47b-4bbb-9673-245861cf7425 req-8d2430bb-dca4-48a0-9843-070c96efe31f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:18:39.210263 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1b67788f-c47b-4bbb-9673-245861cf7425 req-8d2430bb-dca4-48a0-9843-070c96efe31f service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=ebd13c4f757b48ab9d14fcf5b3a5325a&device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 1098 time: 0.0397553 Nov 09 05:18:39.296800 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b67788f-c47b-4bbb-9673-245861cf7425 req-b3afacf4-1fee-4c89-87a6-2b0b32e6ec3b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:18:39.298214 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1b67788f-c47b-4bbb-9673-245861cf7425 req-b3afacf4-1fee-4c89-87a6-2b0b32e6ec3b service neutron] 10.222.0.26 "GET /v2.0/networks?id=41e1a505-f3a3-418f-9229-3880f4333c14 HTTP/1.1" status: 200 len: 910 time: 0.0870283 Nov 09 05:18:39.368601 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1b67788f-c47b-4bbb-9673-245861cf7425 req-822151e5-a2eb-4900-8382-74dcacf65cd4 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=201106f8-ad57-43ba-8183-8f7ecbe69722 HTTP/1.1" status: 200 len: 1001 time: 0.0632877 Nov 09 05:18:39.423367 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b67788f-c47b-4bbb-9673-245861cf7425 req-df2a1509-906f-4c3c-bc99-561769d9a3d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:18:39.424789 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1b67788f-c47b-4bbb-9673-245861cf7425 req-df2a1509-906f-4c3c-bc99-561769d9a3d4 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=abf74659-fa86-43c8-a52c-7b696adbf35a HTTP/1.1" status: 200 len: 848 time: 0.0487983 Nov 09 05:18:39.470157 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b67788f-c47b-4bbb-9673-245861cf7425 req-d0b90ed3-babf-4586-aa2e-41d0f9395597 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:18:39.471620 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1b67788f-c47b-4bbb-9673-245861cf7425 req-d0b90ed3-babf-4586-aa2e-41d0f9395597 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=41e1a505-f3a3-418f-9229-3880f4333c14&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0398567 Nov 09 05:18:39.540382 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4187db8-8946-41e9-97dc-02ad523afd47 req-0df7aac8-fb3a-4b32-a466-bf503c7c8db7 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:18:39.541869 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-a4187db8-8946-41e9-97dc-02ad523afd47 req-0df7aac8-fb3a-4b32-a466-bf503c7c8db7 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 945 time: 0.0527666 Nov 09 05:18:39.565370 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1b67788f-c47b-4bbb-9673-245861cf7425 req-2f4f5410-6ec6-4a53-b5eb-f42f6e3fb74e service neutron] 10.222.0.26 "GET /v2.0/networks/41e1a505-f3a3-418f-9229-3880f4333c14?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0866849 Nov 09 05:18:39.590220 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-a4187db8-8946-41e9-97dc-02ad523afd47 req-4cf82b7a-86f3-4447-b6cc-25b18ae2a8aa tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=a91c2c29-9e77-40ac-b633-1eb86d1c611c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424809 Nov 09 05:18:39.654035 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1b67788f-c47b-4bbb-9673-245861cf7425 req-c134bcbe-6a74-4c59-b5b2-8409263cd762 service neutron] 10.222.0.26 "GET /v2.0/networks/41e1a505-f3a3-418f-9229-3880f4333c14?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0819275 Nov 09 05:18:40.706917 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5125bc05-2193-4335-84de-4be45ec98f2e req-0895320b-3687-48af-a029-501ecbdb83fc tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:18:40.713793 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5125bc05-2193-4335-84de-4be45ec98f2e req-0895320b-3687-48af-a029-501ecbdb83fc tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 945 time: 0.0500348 Nov 09 05:18:40.763042 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5125bc05-2193-4335-84de-4be45ec98f2e req-b292b328-8f1e-43df-9290-0993de12f13d tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=a91c2c29-9e77-40ac-b633-1eb86d1c611c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0485239 Nov 09 05:18:41.381490 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c26cf838-5d68-4b83-8976-4d1c6f735e6e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:18:41.885110 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d44fb75-2be8-46be-8e5f-b151985cbfaf req-e7ee9a1a-b31e-43e9-b84d-d37cd1831438 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:18:41.886726 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-9d44fb75-2be8-46be-8e5f-b151985cbfaf req-e7ee9a1a-b31e-43e9-b84d-d37cd1831438 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 945 time: 0.0546417 Nov 09 05:18:41.936234 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-9d44fb75-2be8-46be-8e5f-b151985cbfaf req-f769bd58-64b8-48bd-baed-546dfbc210be tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=a91c2c29-9e77-40ac-b633-1eb86d1c611c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433600 Nov 09 05:18:42.693117 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:18:43.054007 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e3fbe05-e6e0-4ce2-ad74-a013fb49dc2c req-cdef3f3c-fbbe-4f74-9eb2-dc0275829e07 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:18:43.056132 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7e3fbe05-e6e0-4ce2-ad74-a013fb49dc2c req-cdef3f3c-fbbe-4f74-9eb2-dc0275829e07 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 945 time: 0.0502887 Nov 09 05:18:43.105436 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7e3fbe05-e6e0-4ce2-ad74-a013fb49dc2c req-936dfa5e-8331-440b-b6ee-731a6a03b1ca tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=a91c2c29-9e77-40ac-b633-1eb86d1c611c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433719 Nov 09 05:18:43.727990 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-fa0a02d8-19e9-41c2-898d-d99b8b6cbff5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:18:44.218250 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eabbd7b4-9eaa-4331-b5f7-b6a095ca31b5 req-253f8d89-0b42-42a6-b155-1e650f932769 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:18:44.219756 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-eabbd7b4-9eaa-4331-b5f7-b6a095ca31b5 req-253f8d89-0b42-42a6-b155-1e650f932769 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 945 time: 0.0485058 Nov 09 05:18:44.272470 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-eabbd7b4-9eaa-4331-b5f7-b6a095ca31b5 req-fbbbd086-548a-43e6-b933-6a403e52e33e tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=a91c2c29-9e77-40ac-b633-1eb86d1c611c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0466876 Nov 09 05:18:44.598631 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 201106f8-ad57-43ba-8183-8f7ecbe69722 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 05:18:44.610573 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8495ee80-33ae-4ee3-bdee-4b70e456d1d8 req-62451751-377a-45a8-998b-621e80ad1cb0 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:18:44.612088 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-8495ee80-33ae-4ee3-bdee-4b70e456d1d8 req-62451751-377a-45a8-998b-621e80ad1cb0 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 945 time: 0.0484943 Nov 09 05:18:44.669019 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-8495ee80-33ae-4ee3-bdee-4b70e456d1d8 req-8c5af31e-b7f7-48ab-a234-07067d33fdf4 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=a91c2c29-9e77-40ac-b633-1eb86d1c611c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0501733 Nov 09 05:18:44.682467 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:18:44.705425 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '95295fb2-238e-4b98-b4c7-082b0868082d', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '201106f8-ad57-43ba-8183-8f7ecbe69722'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:18:44.707574 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4d1451fa-3666-477b-a0e3-4a47e214390f" -d '{"events": [{"server_uuid": "95295fb2-238e-4b98-b4c7-082b0868082d", "name": "network-vif-unplugged", "status": "completed", "tag": "201106f8-ad57-43ba-8183-8f7ecbe69722"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:18:44.719839 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 201106f8-ad57-43ba-8183-8f7ecbe69722, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=201106f8-ad57-43ba-8183-8f7ecbe69722,segment=NetworkSegment(0a75612c-c02a-4294-901e-f7bbf1a2b310),segment_id=0a75612c-c02a-4294-901e-f7bbf1a2b310)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:18:44.748165 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Tue, 09 Nov 2021 05:18:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d2adde4c-fa50-4b03-8cff-f788c6d993ff x-openstack-request-id: req-d2adde4c-fa50-4b03-8cff-f788c6d993ff {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:18:44.748165 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "95295fb2-238e-4b98-b4c7-082b0868082d", "name": "network-vif-unplugged", "status": "failed", "tag": "201106f8-ad57-43ba-8183-8f7ecbe69722", "code": 422}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:18:44.748165 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-d2adde4c-fa50-4b03-8cff-f788c6d993ff {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:18:44.748165 dv-neutron-816802-2-hyperv neutron-server[102163]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': '95295fb2-238e-4b98-b4c7-082b0868082d', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': '201106f8-ad57-43ba-8183-8f7ecbe69722', 'code': 422} returned with failed status Nov 09 05:18:44.778615 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-1fe9a108-4753-40dd-8c65-7841c445104f req-61cb0ab8-5dfa-45f0-b6f8-cefe13cef639 service neutron] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1344159 Nov 09 05:18:44.787628 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [req-1fe9a108-4753-40dd-8c65-7841c445104f req-3981c6dd-6edb-49d5-8007-1eb08a431bed service neutron] http://10.222.0.24:9696/v2.0/extensions returned with HTTP 200 {{(pid=102161) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 05:18:44.787765 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:18:44.788571 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-1fe9a108-4753-40dd-8c65-7841c445104f req-3981c6dd-6edb-49d5-8007-1eb08a431bed service neutron] 10.222.0.24 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0049148 Nov 09 05:18:44.839748 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=201106f8-ad57-43ba-8183-8f7ecbe69722,revision_number=6']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:18:44.846615 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:18:44.850127 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:18:44.850127 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:18:44.850127 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:18:44.850127 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:18:44.850127 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:18:44.850127 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:18:44.850127 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:18:44.850127 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:18:44.850127 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:18:44.850127 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:18:44.850127 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:18:45.347197 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:18:45.783575 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf11a20d-ba31-4707-8b51-ffd494e30582 req-156cb022-b784-4966-9d80-4369e93899cb tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:18:45.785022 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-cf11a20d-ba31-4707-8b51-ffd494e30582 req-156cb022-b784-4966-9d80-4369e93899cb tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 943 time: 0.0490782 Nov 09 05:18:45.836303 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-cf11a20d-ba31-4707-8b51-ffd494e30582 req-ae1391f9-3fbc-475c-8d03-cc26ef4a296e tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=a91c2c29-9e77-40ac-b633-1eb86d1c611c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0454094 Nov 09 05:18:46.678582 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:18:46.952697 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59a4d452-dba8-4a40-a26c-44f9c32842e1 req-af3f4087-40fb-4073-a13b-e5f2d176dd59 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:18:46.954206 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-59a4d452-dba8-4a40-a26c-44f9c32842e1 req-af3f4087-40fb-4073-a13b-e5f2d176dd59 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 943 time: 0.0522428 Nov 09 05:18:46.987211 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:18:47.006693 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-59a4d452-dba8-4a40-a26c-44f9c32842e1 req-de255de1-263b-499a-8115-214b81773bd7 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=a91c2c29-9e77-40ac-b633-1eb86d1c611c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0462496 Nov 09 05:18:48.121192 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-308e78b3-4fd8-48a0-abc0-cc66c1e13337 req-b6139f3b-6726-4c5c-9b72-9f853f0fcab5 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:18:48.122705 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-308e78b3-4fd8-48a0-abc0-cc66c1e13337 req-b6139f3b-6726-4c5c-9b72-9f853f0fcab5 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 943 time: 0.0496216 Nov 09 05:18:48.171795 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-308e78b3-4fd8-48a0-abc0-cc66c1e13337 req-00314f9a-ded2-4cdc-9c9e-0098b6d5b736 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=a91c2c29-9e77-40ac-b633-1eb86d1c611c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429742 Nov 09 05:18:49.290291 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fee818f-b3be-4b44-b989-2317fc04a298 req-69597c30-6dad-42b5-a0e9-44bf7148dbf9 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:18:49.291783 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5fee818f-b3be-4b44-b989-2317fc04a298 req-69597c30-6dad-42b5-a0e9-44bf7148dbf9 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 943 time: 0.0529742 Nov 09 05:18:49.357211 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5fee818f-b3be-4b44-b989-2317fc04a298 req-fea3161f-810e-40de-a7c3-86ee887bb87a tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=a91c2c29-9e77-40ac-b633-1eb86d1c611c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0594208 Nov 09 05:18:50.475034 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26e1a534-1b0c-472d-9b3e-9e1b876326cf req-70deac30-f197-4802-b721-ee2816bcfbdc tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:18:50.477031 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-26e1a534-1b0c-472d-9b3e-9e1b876326cf req-70deac30-f197-4802-b721-ee2816bcfbdc tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 943 time: 0.0482314 Nov 09 05:18:50.525514 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-26e1a534-1b0c-472d-9b3e-9e1b876326cf req-3230cc32-0866-40f2-8d7d-8e06e8f42e92 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=a91c2c29-9e77-40ac-b633-1eb86d1c611c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424340 Nov 09 05:18:51.450025 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 05:18:51.642623 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d7eb7c6-3a1a-4aa8-b54e-ac6e34e22c04 req-b8609376-f213-4591-b401-6a55c71fbeab tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:18:51.644165 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5d7eb7c6-3a1a-4aa8-b54e-ac6e34e22c04 req-b8609376-f213-4591-b401-6a55c71fbeab tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 943 time: 0.0510573 Nov 09 05:18:51.693556 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5d7eb7c6-3a1a-4aa8-b54e-ac6e34e22c04 req-c98a8b9d-c5f0-454a-b511-a7381312adeb tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=a91c2c29-9e77-40ac-b633-1eb86d1c611c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428839 Nov 09 05:18:52.811751 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3de93db4-ea2a-4d71-86f1-2bbfbfb21ca9 req-6ff38706-96d3-4ad3-b252-0ef552db3073 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:18:52.813237 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-3de93db4-ea2a-4d71-86f1-2bbfbfb21ca9 req-6ff38706-96d3-4ad3-b252-0ef552db3073 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 943 time: 0.0525341 Nov 09 05:18:52.862419 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-3de93db4-ea2a-4d71-86f1-2bbfbfb21ca9 req-a225ef5f-57fd-4562-97b4-e8232c5581a0 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=a91c2c29-9e77-40ac-b633-1eb86d1c611c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429413 Nov 09 05:18:53.517877 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fe9a108-4753-40dd-8c65-7841c445104f req-48ffd55e-4fad-41d8-8de7-15c72b797d1a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:18:53.519351 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1fe9a108-4753-40dd-8c65-7841c445104f req-48ffd55e-4fad-41d8-8de7-15c72b797d1a service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d&tenant_id=ebd13c4f757b48ab9d14fcf5b3a5325a HTTP/1.1" status: 200 len: 1096 time: 0.0396051 Nov 09 05:18:53.582711 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fe9a108-4753-40dd-8c65-7841c445104f req-fabaeeec-5773-4fee-9229-60041498576b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:18:53.584161 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1fe9a108-4753-40dd-8c65-7841c445104f req-fabaeeec-5773-4fee-9229-60041498576b service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=ebd13c4f757b48ab9d14fcf5b3a5325a&device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 1096 time: 0.0431755 Nov 09 05:18:53.672539 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fe9a108-4753-40dd-8c65-7841c445104f req-40f53457-0279-4555-a606-7316f0b7b7bd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:18:53.673969 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1fe9a108-4753-40dd-8c65-7841c445104f req-40f53457-0279-4555-a606-7316f0b7b7bd service neutron] 10.222.0.26 "GET /v2.0/networks?id=41e1a505-f3a3-418f-9229-3880f4333c14 HTTP/1.1" status: 200 len: 910 time: 0.0826566 Nov 09 05:18:53.741160 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1fe9a108-4753-40dd-8c65-7841c445104f req-21723a10-6c12-418c-adea-37424f20da6c service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=201106f8-ad57-43ba-8183-8f7ecbe69722 HTTP/1.1" status: 200 len: 999 time: 0.0601206 Nov 09 05:18:53.788988 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fe9a108-4753-40dd-8c65-7841c445104f req-463e6895-92cf-454b-9cc9-6a5cfbdc38d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:18:53.790297 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1fe9a108-4753-40dd-8c65-7841c445104f req-463e6895-92cf-454b-9cc9-6a5cfbdc38d8 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=abf74659-fa86-43c8-a52c-7b696adbf35a HTTP/1.1" status: 200 len: 848 time: 0.0418983 Nov 09 05:18:53.833962 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fe9a108-4753-40dd-8c65-7841c445104f req-f035c74f-c31a-42f9-9cf5-d82dc543240e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:18:53.835407 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1fe9a108-4753-40dd-8c65-7841c445104f req-f035c74f-c31a-42f9-9cf5-d82dc543240e service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=41e1a505-f3a3-418f-9229-3880f4333c14&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0381498 Nov 09 05:18:53.927833 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1fe9a108-4753-40dd-8c65-7841c445104f req-ab52283a-891b-40a6-ba4c-39ef55c58513 service neutron] 10.222.0.26 "GET /v2.0/networks/41e1a505-f3a3-418f-9229-3880f4333c14?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0849869 Nov 09 05:18:54.045083 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94df6e78-7434-4c08-b02c-3bc0f592efb3 req-e1de3be3-b714-4e9d-b38e-74b635fdc7b3 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:18:54.046559 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-94df6e78-7434-4c08-b02c-3bc0f592efb3 req-e1de3be3-b714-4e9d-b38e-74b635fdc7b3 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 943 time: 0.1170595 Nov 09 05:18:54.078614 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-1fe9a108-4753-40dd-8c65-7841c445104f req-74c9fb77-7107-4be3-a07e-0886aea29764 service neutron] 10.222.0.26 "GET /v2.0/networks/41e1a505-f3a3-418f-9229-3880f4333c14?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1409252 Nov 09 05:18:54.108523 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-94df6e78-7434-4c08-b02c-3bc0f592efb3 req-962b3d97-ebd5-4de5-9a7a-774565fbe7bc tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=a91c2c29-9e77-40ac-b633-1eb86d1c611c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0550625 Nov 09 05:18:55.219953 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85362170-381e-4ccc-b608-985b184ec4c7 req-14fed9a3-ef70-4874-8517-bd96be90c6a4 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:18:55.221408 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-85362170-381e-4ccc-b608-985b184ec4c7 req-14fed9a3-ef70-4874-8517-bd96be90c6a4 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 943 time: 0.0476043 Nov 09 05:18:55.269592 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-85362170-381e-4ccc-b608-985b184ec4c7 req-0e744df6-e343-471d-ab88-004697f5089a tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=a91c2c29-9e77-40ac-b633-1eb86d1c611c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424404 Nov 09 05:18:56.379942 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e5cc83c-443e-47b7-9c84-aa93a6e0a148 req-37caf1ad-f898-43eb-bd54-c0a61bb639ac tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:18:56.381378 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8e5cc83c-443e-47b7-9c84-aa93a6e0a148 req-37caf1ad-f898-43eb-bd54-c0a61bb639ac tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 943 time: 0.0473096 Nov 09 05:18:56.430097 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8e5cc83c-443e-47b7-9c84-aa93a6e0a148 req-84a1497a-2fe8-4c98-9aab-eadd23f32371 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=a91c2c29-9e77-40ac-b633-1eb86d1c611c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421691 Nov 09 05:18:57.554489 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8aceff2c-251b-4838-ac0b-f569d2cd01bf req-c144bfbf-ad7e-4368-9f4d-c13ea15c07a8 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:18:57.556153 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-8aceff2c-251b-4838-ac0b-f569d2cd01bf req-c144bfbf-ad7e-4368-9f4d-c13ea15c07a8 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 943 time: 0.0557239 Nov 09 05:18:57.627387 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-8aceff2c-251b-4838-ac0b-f569d2cd01bf req-70abbf8f-8338-45d1-82fa-2f9d42b46cc5 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=a91c2c29-9e77-40ac-b633-1eb86d1c611c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0633810 Nov 09 05:18:58.740367 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25de5f11-5405-4e68-b0f4-a52f9ab7605a req-97dbff2b-d186-4feb-97c5-fecce4a87c95 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:18:58.741808 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-25de5f11-5405-4e68-b0f4-a52f9ab7605a req-97dbff2b-d186-4feb-97c5-fecce4a87c95 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 943 time: 0.0515778 Nov 09 05:18:58.789745 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-25de5f11-5405-4e68-b0f4-a52f9ab7605a req-d61d3cd2-3dc1-43ec-9cfe-7a01d6670364 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=a91c2c29-9e77-40ac-b633-1eb86d1c611c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421615 Nov 09 05:18:59.901231 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18edd1bb-ad20-44f2-a710-8d3494e5beb5 req-5d7868c7-90a6-4da4-a177-ad1c80c74ea0 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:18:59.902759 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-18edd1bb-ad20-44f2-a710-8d3494e5beb5 req-5d7868c7-90a6-4da4-a177-ad1c80c74ea0 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 943 time: 0.0493567 Nov 09 05:18:59.951201 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-18edd1bb-ad20-44f2-a710-8d3494e5beb5 req-a11951b8-8dd4-4ce7-9116-8d41ab7b4531 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=a91c2c29-9e77-40ac-b633-1eb86d1c611c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425625 Nov 09 05:19:00.661416 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 201106f8-ad57-43ba-8183-8f7ecbe69722 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=102163) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 09 05:19:00.752987 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 201106f8-ad57-43ba-8183-8f7ecbe69722, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=201106f8-ad57-43ba-8183-8f7ecbe69722,segment=NetworkSegment(0a75612c-c02a-4294-901e-f7bbf1a2b310),segment_id=0a75612c-c02a-4294-901e-f7bbf1a2b310)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:19:00.764450 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Returning: {'device': '201106f8-ad57-43ba-8183-8f7ecbe69722', 'network_id': '41e1a505-f3a3-418f-9229-3880f4333c14', 'port_id': '201106f8-ad57-43ba-8183-8f7ecbe69722', 'mac_address': 'fa:16:3e:b7:43:61', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 326, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'abf74659-fa86-43c8-a52c-7b696adbf35a', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102163) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 09 05:19:00.798510 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:19:00.810761 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 201106f8-ad57-43ba-8183-8f7ecbe69722 {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 05:19:00.829432 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 201106f8-ad57-43ba-8183-8f7ecbe69722, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=201106f8-ad57-43ba-8183-8f7ecbe69722,segment=NetworkSegment(0a75612c-c02a-4294-901e-f7bbf1a2b310),segment_id=0a75612c-c02a-4294-901e-f7bbf1a2b310)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:19:00.885806 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:19:00.929828 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=201106f8-ad57-43ba-8183-8f7ecbe69722,revision_number=7']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:19:01.065072 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55e1f952-0bf2-4d35-8b02-641cab395718 req-bf0e4f55-f1ee-46c5-bcda-2c9915543f6b tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:19:01.066576 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-55e1f952-0bf2-4d35-8b02-641cab395718 req-bf0e4f55-f1ee-46c5-bcda-2c9915543f6b tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 944 time: 0.0493302 Nov 09 05:19:01.115723 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-55e1f952-0bf2-4d35-8b02-641cab395718 req-d266cb0a-8f04-4217-9cfe-408456093660 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=a91c2c29-9e77-40ac-b633-1eb86d1c611c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426779 Nov 09 05:19:01.128128 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['201106f8-ad57-43ba-8183-8f7ecbe69722'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 05:19:02.227292 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4b07332-a01a-4489-a92e-e32cda91088c req-3084996b-4d59-4836-930d-f2b8cc2ca3eb tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:19:02.228810 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b4b07332-a01a-4489-a92e-e32cda91088c req-3084996b-4d59-4836-930d-f2b8cc2ca3eb tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 944 time: 0.0482094 Nov 09 05:19:02.281955 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-b4b07332-a01a-4489-a92e-e32cda91088c req-04366914-e833-43e7-a473-74de7904d8b2 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=a91c2c29-9e77-40ac-b633-1eb86d1c611c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0473516 Nov 09 05:19:02.671274 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 201106f8-ad57-43ba-8183-8f7ecbe69722 up at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:19:02.724937 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning complete for port 201106f8-ad57-43ba-8183-8f7ecbe69722 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:19:02.725457 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:19:02.804769 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:19:02.826918 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '95295fb2-238e-4b98-b4c7-082b0868082d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '201106f8-ad57-43ba-8183-8f7ecbe69722'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:19:02.829123 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5b755080-7d9a-4a96-ac8d-8fa9f7980238" -d '{"events": [{"server_uuid": "95295fb2-238e-4b98-b4c7-082b0868082d", "name": "network-vif-plugged", "status": "completed", "tag": "201106f8-ad57-43ba-8183-8f7ecbe69722"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:19:02.843464 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 201106f8-ad57-43ba-8183-8f7ecbe69722, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=201106f8-ad57-43ba-8183-8f7ecbe69722,segment=NetworkSegment(0a75612c-c02a-4294-901e-f7bbf1a2b310),segment_id=0a75612c-c02a-4294-901e-f7bbf1a2b310)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:19:02.867924 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 05:19:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9ad924d0-6647-4ddd-a9aa-21b8651be985 x-openstack-request-id: req-9ad924d0-6647-4ddd-a9aa-21b8651be985 {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:19:02.867924 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "95295fb2-238e-4b98-b4c7-082b0868082d", "name": "network-vif-plugged", "status": "completed", "tag": "201106f8-ad57-43ba-8183-8f7ecbe69722", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:19:02.867924 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-9ad924d0-6647-4ddd-a9aa-21b8651be985 {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:19:02.867924 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '95295fb2-238e-4b98-b4c7-082b0868082d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '201106f8-ad57-43ba-8183-8f7ecbe69722', 'code': 200} Nov 09 05:19:02.941749 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:19:02.992371 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=201106f8-ad57-43ba-8183-8f7ecbe69722,revision_number=8']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:19:03.125790 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc80cb13-762e-4d62-b623-9e07dc93c206 req-b925b2b8-e597-4c75-b467-79a56e08a151 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:19:03.127313 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-bc80cb13-762e-4d62-b623-9e07dc93c206 req-b925b2b8-e597-4c75-b467-79a56e08a151 service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 1098 time: 0.0396416 Nov 09 05:19:03.177234 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-bc80cb13-762e-4d62-b623-9e07dc93c206 req-8143392d-b22c-4254-a2b2-7f9f73b1fb2a service neutron] 10.222.0.26 "GET /v2.0/security-groups?id=a91c2c29-9e77-40ac-b633-1eb86d1c611c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424128 Nov 09 05:19:03.394266 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab9573bf-fa8f-4a59-aab7-9558eb98806f req-910b2364-eafd-4034-a160-80ef5a630006 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:19:03.395748 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ab9573bf-fa8f-4a59-aab7-9558eb98806f req-910b2364-eafd-4034-a160-80ef5a630006 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 945 time: 0.0482876 Nov 09 05:19:03.443286 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-ab9573bf-fa8f-4a59-aab7-9558eb98806f req-605d5fc0-c8c2-46d6-b334-7b6d9fbfc7b2 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=a91c2c29-9e77-40ac-b633-1eb86d1c611c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410380 Nov 09 05:19:04.557895 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47352a1a-5350-4b19-b85f-243460c2dc43 req-f97ad64a-f6a2-4879-8462-4034dfb581e7 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:19:04.559372 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-47352a1a-5350-4b19-b85f-243460c2dc43 req-f97ad64a-f6a2-4879-8462-4034dfb581e7 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 945 time: 0.0479567 Nov 09 05:19:04.607327 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-47352a1a-5350-4b19-b85f-243460c2dc43 req-2b163ac6-8189-4943-9c4f-42047674d278 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=a91c2c29-9e77-40ac-b633-1eb86d1c611c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422213 Nov 09 05:19:11.385026 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d1bff27f-8e0f-48c6-aa97-84916c7fe3da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:19:12.728319 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:19:13.710936 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0352b535-ca21-476b-b352-c48b76277b95 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:19:15.305195 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:19:16.704884 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:19:16.985125 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:19:28.449474 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 05:19:35.407919 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-aaa252b7-9e58-4e31-837b-3278c81ce6ef req-2c33f629-3ae5-439c-b299-fdd0c03da499 service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1203077 Nov 09 05:19:35.489726 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aaa252b7-9e58-4e31-837b-3278c81ce6ef req-761b470c-c2ea-4442-bb68-ec09a2ed8659 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:19:35.491227 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-aaa252b7-9e58-4e31-837b-3278c81ce6ef req-761b470c-c2ea-4442-bb68-ec09a2ed8659 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=ebd13c4f757b48ab9d14fcf5b3a5325a&device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 1098 time: 0.0394533 Nov 09 05:19:35.595538 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aaa252b7-9e58-4e31-837b-3278c81ce6ef req-22a889be-c5f0-441f-8914-5aec799e823b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:19:35.596912 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-aaa252b7-9e58-4e31-837b-3278c81ce6ef req-22a889be-c5f0-441f-8914-5aec799e823b service neutron] 10.222.0.26 "GET /v2.0/networks?id=41e1a505-f3a3-418f-9229-3880f4333c14 HTTP/1.1" status: 200 len: 910 time: 0.0869205 Nov 09 05:19:35.664518 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-aaa252b7-9e58-4e31-837b-3278c81ce6ef req-88314f10-2f11-423d-aa8a-d65a48a4c1f6 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=201106f8-ad57-43ba-8183-8f7ecbe69722 HTTP/1.1" status: 200 len: 1001 time: 0.0605471 Nov 09 05:19:35.712442 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aaa252b7-9e58-4e31-837b-3278c81ce6ef req-a4aec356-dee2-45fa-9d9e-dbcad1c55f73 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:19:35.713832 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-aaa252b7-9e58-4e31-837b-3278c81ce6ef req-a4aec356-dee2-45fa-9d9e-dbcad1c55f73 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=abf74659-fa86-43c8-a52c-7b696adbf35a HTTP/1.1" status: 200 len: 848 time: 0.0422940 Nov 09 05:19:35.758661 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aaa252b7-9e58-4e31-837b-3278c81ce6ef req-13612640-a7dd-4054-9ee9-0122c974ab1c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:19:35.760116 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-aaa252b7-9e58-4e31-837b-3278c81ce6ef req-13612640-a7dd-4054-9ee9-0122c974ab1c service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=41e1a505-f3a3-418f-9229-3880f4333c14&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0396922 Nov 09 05:19:35.772772 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [req-aaa252b7-9e58-4e31-837b-3278c81ce6ef req-953c3457-b9ed-4d91-a869-f1984ca95aaf service neutron] http://10.222.0.24:9696/v2.0/extensions returned with HTTP 200 {{(pid=102162) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 09 05:19:35.773679 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-aaa252b7-9e58-4e31-837b-3278c81ce6ef req-953c3457-b9ed-4d91-a869-f1984ca95aaf service neutron] 10.222.0.26 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0048223 Nov 09 05:19:35.864875 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-aaa252b7-9e58-4e31-837b-3278c81ce6ef req-ca58a20a-37fc-4b5d-a194-d523f46e5086 service neutron] 10.222.0.26 "GET /v2.0/networks/41e1a505-f3a3-418f-9229-3880f4333c14?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0839331 Nov 09 05:19:35.951868 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-aaa252b7-9e58-4e31-837b-3278c81ce6ef req-dd1a56ab-c315-498e-b77d-0f9dc7afa28d service neutron] 10.222.0.26 "GET /v2.0/networks/41e1a505-f3a3-418f-9229-3880f4333c14?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0799558 Nov 09 05:19:41.379872 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0933c5f1-1ea0-4bcb-bf99-222d763c6b39 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:19:42.725798 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:19:43.747874 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-f17654ac-4be0-49b4-9e16-6b25e796b0bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:19:45.330481 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:19:46.679068 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:19:47.008554 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:05.448823 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 05:20:11.379931 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5776976a-b940-4a06-8424-1ac135491e84 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:12.689050 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:13.719812 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-94db3b87-6f59-4ab5-b323-abf7d7f51256 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:15.322961 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:16.718182 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:16.986284 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:36.333879 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-011294cd-9c73-4946-bf11-ef4988b29678 req-1e962fd2-2455-48e5-82b1-7d0360325eba service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0463879 Nov 09 05:20:36.420784 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-011294cd-9c73-4946-bf11-ef4988b29678 req-f1f59f15-b69f-4556-89b9-0ee9ff2fe38c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:20:36.422915 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-011294cd-9c73-4946-bf11-ef4988b29678 req-f1f59f15-b69f-4556-89b9-0ee9ff2fe38c service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=ebd13c4f757b48ab9d14fcf5b3a5325a&device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 1098 time: 0.0458584 Nov 09 05:20:36.521980 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-011294cd-9c73-4946-bf11-ef4988b29678 req-8a38e1aa-d75d-4682-ab7b-2fdf2514a916 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:20:36.523440 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-011294cd-9c73-4946-bf11-ef4988b29678 req-8a38e1aa-d75d-4682-ab7b-2fdf2514a916 service neutron] 10.222.0.26 "GET /v2.0/networks?id=41e1a505-f3a3-418f-9229-3880f4333c14 HTTP/1.1" status: 200 len: 910 time: 0.0819447 Nov 09 05:20:36.591456 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-011294cd-9c73-4946-bf11-ef4988b29678 req-836bd9b2-9fa6-475d-85e7-4f016d97e279 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=201106f8-ad57-43ba-8183-8f7ecbe69722 HTTP/1.1" status: 200 len: 1001 time: 0.0591953 Nov 09 05:20:36.643014 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-011294cd-9c73-4946-bf11-ef4988b29678 req-cb3b8891-f1c4-4dc4-b0f0-92eb3452dd47 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:20:36.644458 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-011294cd-9c73-4946-bf11-ef4988b29678 req-cb3b8891-f1c4-4dc4-b0f0-92eb3452dd47 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=abf74659-fa86-43c8-a52c-7b696adbf35a HTTP/1.1" status: 200 len: 848 time: 0.0466056 Nov 09 05:20:36.690909 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-011294cd-9c73-4946-bf11-ef4988b29678 req-14ff66a1-ed63-4c6c-ae7d-d0d9815ba799 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:20:36.692421 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-011294cd-9c73-4946-bf11-ef4988b29678 req-14ff66a1-ed63-4c6c-ae7d-d0d9815ba799 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=41e1a505-f3a3-418f-9229-3880f4333c14&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0407405 Nov 09 05:20:36.783173 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-011294cd-9c73-4946-bf11-ef4988b29678 req-6a065ba9-203c-4446-a260-91da44b0c8f9 service neutron] 10.222.0.26 "GET /v2.0/networks/41e1a505-f3a3-418f-9229-3880f4333c14?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0837262 Nov 09 05:20:36.868676 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-011294cd-9c73-4946-bf11-ef4988b29678 req-2ed7fced-f464-4a94-b229-bd06ce3c7adc service neutron] 10.222.0.26 "GET /v2.0/networks/41e1a505-f3a3-418f-9229-3880f4333c14?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0782166 Nov 09 05:20:40.902389 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 38580) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:20:41.053802 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-85dab520-055c-4e68-958d-45fcd518742d tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Deleting port 1d0362a0-1066-4737-8fb0-b6ed9113e3a0 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:20:41.054138 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-85dab520-055c-4e68-958d-45fcd518742d tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:41.130786 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-85dab520-055c-4e68-958d-45fcd518742d tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:41.131112 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-85dab520-055c-4e68-958d-45fcd518742d tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:41.144716 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-85dab520-055c-4e68-958d-45fcd518742d tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Calling delete_port for 1d0362a0-1066-4737-8fb0-b6ed9113e3a0 owned by network:floatingip {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:20:41.417227 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-824f34c5-08ad-4caa-a8d5-7a44d329a5de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:41.429006 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-85dab520-055c-4e68-958d-45fcd518742d tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:41.454665 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85dab520-055c-4e68-958d-45fcd518742d tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Pushing event deleted for resources: {'Port': ['ID=1d0362a0-1066-4737-8fb0-b6ed9113e3a0,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:20:41.480544 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85dab520-055c-4e68-958d-45fcd518742d tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:20:41.480889 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85dab520-055c-4e68-958d-45fcd518742d tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:20:41.481224 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85dab520-055c-4e68-958d-45fcd518742d tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:20:41.481557 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85dab520-055c-4e68-958d-45fcd518742d tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:20:41.481885 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85dab520-055c-4e68-958d-45fcd518742d tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:20:41.482211 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85dab520-055c-4e68-958d-45fcd518742d tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:20:41.482569 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85dab520-055c-4e68-958d-45fcd518742d tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:20:41.482892 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85dab520-055c-4e68-958d-45fcd518742d tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:20:41.483218 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85dab520-055c-4e68-958d-45fcd518742d tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:20:41.483537 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85dab520-055c-4e68-958d-45fcd518742d tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:20:41.484348 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85dab520-055c-4e68-958d-45fcd518742d tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:20:41.484672 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85dab520-055c-4e68-958d-45fcd518742d tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:20:41.526063 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-85dab520-055c-4e68-958d-45fcd518742d tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for floatingip, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:41.526409 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.l3_db [None req-85dab520-055c-4e68-958d-45fcd518742d tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Floating IP cd038838-5000-416e-af85-0add2246a286 disassociated (deleted). External IP: 172.26.0.204, port: 201106f8-ad57-43ba-8183-8f7ecbe69722. Nov 09 05:20:41.732751 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-85dab520-055c-4e68-958d-45fcd518742d tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Router 4119e421-6cb1-4924-9967-18e73a4eeae3 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 05:20:42.138509 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-85dab520-055c-4e68-958d-45fcd518742d tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 05:20:42.144275 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-85dab520-055c-4e68-958d-45fcd518742d tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:42.149744 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cc0eecce-5b5e-4120-88b2-e96c01fc28fb None None] Sync routers for ids ['4119e421-6cb1-4924-9967-18e73a4eeae3'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 05:20:42.161980 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cc0eecce-5b5e-4120-88b2-e96c01fc28fb None None] Routers {'4119e421-6cb1-4924-9967-18e73a4eeae3'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:20:42.162605 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-cc0eecce-5b5e-4120-88b2-e96c01fc28fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:20:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['4119e421-6cb1-4924-9967-18e73a4eeae3'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:20:42.171346 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-85dab520-055c-4e68-958d-45fcd518742d tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "DELETE /v2.0/floatingips/cd038838-5000-416e-af85-0add2246a286 HTTP/1.1" status: 204 len: 168 time: 1.2678628 Nov 09 05:20:42.171941 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '95295fb2-238e-4b98-b4c7-082b0868082d', 'tag': '201106f8-ad57-43ba-8183-8f7ecbe69722'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:20:42.174194 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b060379e-7729-48b3-ac3a-d0c0eadec941" -d '{"events": [{"name": "network-changed", "server_uuid": "95295fb2-238e-4b98-b4c7-082b0868082d", "tag": "201106f8-ad57-43ba-8183-8f7ecbe69722"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:20:42.211596 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 05:20:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e319d158-5a4d-45e2-a7ba-5cde08fc5abf x-openstack-request-id: req-e319d158-5a4d-45e2-a7ba-5cde08fc5abf {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:20:42.211888 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "95295fb2-238e-4b98-b4c7-082b0868082d", "tag": "201106f8-ad57-43ba-8183-8f7ecbe69722", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:20:42.212137 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-e319d158-5a4d-45e2-a7ba-5cde08fc5abf {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:20:42.212534 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '95295fb2-238e-4b98-b4c7-082b0868082d', 'tag': '201106f8-ad57-43ba-8183-8f7ecbe69722', 'status': 'completed', 'code': 200} Nov 09 05:20:42.275253 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-cc0eecce-5b5e-4120-88b2-e96c01fc28fb None None] Set router 4119e421-6cb1-4924-9967-18e73a4eeae3 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:20:42.277503 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b060379e-7729-48b3-ac3a-d0c0eadec941 req-fafbaec1-6953-4f7f-b984-859feacdd6d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:20:42.279082 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b060379e-7729-48b3-ac3a-d0c0eadec941 req-fafbaec1-6953-4f7f-b984-859feacdd6d1 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=ebd13c4f757b48ab9d14fcf5b3a5325a&device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 1098 time: 0.0425477 Nov 09 05:20:42.373732 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b060379e-7729-48b3-ac3a-d0c0eadec941 req-5f0c3e76-29db-4ae8-b2c2-8d68674dc381 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:20:42.375341 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b060379e-7729-48b3-ac3a-d0c0eadec941 req-5f0c3e76-29db-4ae8-b2c2-8d68674dc381 service neutron] 10.222.0.26 "GET /v2.0/networks?id=41e1a505-f3a3-418f-9229-3880f4333c14 HTTP/1.1" status: 200 len: 910 time: 0.0888987 Nov 09 05:20:42.422939 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b060379e-7729-48b3-ac3a-d0c0eadec941 req-0d572bee-c0e0-46f5-ae4c-349e5f287203 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=201106f8-ad57-43ba-8183-8f7ecbe69722 HTTP/1.1" status: 200 len: 217 time: 0.0400808 Nov 09 05:20:42.462372 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 05:20:42.477264 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b060379e-7729-48b3-ac3a-d0c0eadec941 req-3ec3fe26-8ddc-4596-ae31-676917f7ad0c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:20:42.479442 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b060379e-7729-48b3-ac3a-d0c0eadec941 req-3ec3fe26-8ddc-4596-ae31-676917f7ad0c service neutron] 10.222.0.26 "GET /v2.0/subnets?id=abf74659-fa86-43c8-a52c-7b696adbf35a HTTP/1.1" status: 200 len: 848 time: 0.0493801 Nov 09 05:20:42.488240 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-cc0eecce-5b5e-4120-88b2-e96c01fc28fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'name': 'tempest-TestShelveInstance-1961526497-router', 'tenant_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.251'}], 'enable_snat': True}, 'gw_port_id': '5204f9e0-7d71-4dee-997d-b68078c7a10f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:10:41Z', 'updated_at': '2021-11-09T05:10:44Z', 'revision_number': 4, 'project_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'gw_port': {'id': '5204f9e0-7d71-4dee-997d-b68078c7a10f', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:88:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1808, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.251', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:10:42Z', 'updated_at': '2021-11-09T05:10:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '165314fc-453c-4fef-bf42-9efd260d1493', 'name': '', 'network_id': '41e1a505-f3a3-418f-9229-3880f4333c14', 'tenant_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'mac_address': 'fa:16:3e:7d:79:b9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'device_owner': 'network:router_interface', 'standard_attr_id': 1809, 'fixed_ips': [{'subnet_id': 'abf74659-fa86-43c8-a52c-7b696adbf35a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:10:44Z', 'updated_at': '2021-11-09T05:10:48Z', 'revision_number': 5, 'project_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'subnets': [{'id': 'abf74659-fa86-43c8-a52c-7b696adbf35a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:20:42.517838 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cc0eecce-5b5e-4120-88b2-e96c01fc28fb None None] Checking router: 4119e421-6cb1-4924-9967-18e73a4eeae3 for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 05:20:42.527787 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cc0eecce-5b5e-4120-88b2-e96c01fc28fb None None] Routers {'4119e421-6cb1-4924-9967-18e73a4eeae3'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:20:42.528830 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-cc0eecce-5b5e-4120-88b2-e96c01fc28fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:20:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['4119e421-6cb1-4924-9967-18e73a4eeae3'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:20:42.550305 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b060379e-7729-48b3-ac3a-d0c0eadec941 req-2fa6b5af-fd11-4888-b972-7ae2f4d1305d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:20:42.552013 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b060379e-7729-48b3-ac3a-d0c0eadec941 req-2fa6b5af-fd11-4888-b972-7ae2f4d1305d service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=41e1a505-f3a3-418f-9229-3880f4333c14&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0586224 Nov 09 05:20:42.656042 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-cc0eecce-5b5e-4120-88b2-e96c01fc28fb None None] Set router 4119e421-6cb1-4924-9967-18e73a4eeae3 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:20:42.679531 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dcb7f2a-bbee-4dca-bc23-051a2491cf78 req-884b2aa1-5b6c-480c-81e1-b68e1928a5b6 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:20:42.680973 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3dcb7f2a-bbee-4dca-bc23-051a2491cf78 req-884b2aa1-5b6c-480c-81e1-b68e1928a5b6 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 945 time: 0.1526659 Nov 09 05:20:42.707314 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:42.715445 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b060379e-7729-48b3-ac3a-d0c0eadec941 req-b258fedb-4dba-41a3-b184-828e0597fd7d service neutron] 10.222.0.26 "GET /v2.0/networks/41e1a505-f3a3-418f-9229-3880f4333c14?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1502826 Nov 09 05:20:42.770442 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3dcb7f2a-bbee-4dca-bc23-051a2491cf78 req-4ca015fe-5c8b-46e7-b345-f9f2e0840eb2 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=a91c2c29-9e77-40ac-b633-1eb86d1c611c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0823126 Nov 09 05:20:42.826861 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-b060379e-7729-48b3-ac3a-d0c0eadec941 req-ec5e2cc8-128d-41ac-b0a2-8bc093e426c2 service neutron] 10.222.0.26 "GET /v2.0/networks/41e1a505-f3a3-418f-9229-3880f4333c14?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0987484 Nov 09 05:20:42.855267 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-cc0eecce-5b5e-4120-88b2-e96c01fc28fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'name': 'tempest-TestShelveInstance-1961526497-router', 'tenant_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.251'}], 'enable_snat': True}, 'gw_port_id': '5204f9e0-7d71-4dee-997d-b68078c7a10f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:10:41Z', 'updated_at': '2021-11-09T05:10:44Z', 'revision_number': 4, 'project_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'gw_port': {'id': '5204f9e0-7d71-4dee-997d-b68078c7a10f', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:88:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1808, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.251', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:10:42Z', 'updated_at': '2021-11-09T05:10:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '165314fc-453c-4fef-bf42-9efd260d1493', 'name': '', 'network_id': '41e1a505-f3a3-418f-9229-3880f4333c14', 'tenant_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'mac_address': 'fa:16:3e:7d:79:b9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'device_owner': 'network:router_interface', 'standard_attr_id': 1809, 'fixed_ips': [{'subnet_id': 'abf74659-fa86-43c8-a52c-7b696adbf35a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:10:44Z', 'updated_at': '2021-11-09T05:10:48Z', 'revision_number': 5, 'project_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'subnets': [{'id': 'abf74659-fa86-43c8-a52c-7b696adbf35a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:20:42.885994 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cc0eecce-5b5e-4120-88b2-e96c01fc28fb None None] The sync data for ids ['4119e421-6cb1-4924-9967-18e73a4eeae3'] in dv-neutron-816802-2-hyperv is: [{'id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'name': 'tempest-TestShelveInstance-1961526497-router', 'tenant_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.251'}], 'enable_snat': True}, 'gw_port_id': '5204f9e0-7d71-4dee-997d-b68078c7a10f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:10:41Z', 'updated_at': '2021-11-09T05:10:44Z', 'revision_number': 4, 'project_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'gw_port': {'id': '5204f9e0-7d71-4dee-997d-b68078c7a10f', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:88:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1808, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.251', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:10:42Z', 'updated_at': '2021-11-09T05:10:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '165314fc-453c-4fef-bf42-9efd260d1493', 'name': '', 'network_id': '41e1a505-f3a3-418f-9229-3880f4333c14', 'tenant_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'mac_address': 'fa:16:3e:7d:79:b9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'device_owner': 'network:router_interface', 'standard_attr_id': 1809, 'fixed_ips': [{'subnet_id': 'abf74659-fa86-43c8-a52c-7b696adbf35a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:10:44Z', 'updated_at': '2021-11-09T05:10:48Z', 'revision_number': 5, 'project_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'subnets': [{'id': 'abf74659-fa86-43c8-a52c-7b696adbf35a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 05:20:43.094883 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ef8c3492-5695-440b-a77d-9a98c63114eb None None] New status for floating IP cd038838-5000-416e-af85-0add2246a286: DOWN {{(pid=102163) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 05:20:43.737056 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8033d765-0159-4927-8365-28eab1d2208a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:43.933531 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be47e82d-9127-4a82-bdda-5cb31de646af req-4584085c-67ff-4926-a9f2-d5d5e7c046e7 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:20:43.935039 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-be47e82d-9127-4a82-bdda-5cb31de646af req-4584085c-67ff-4926-a9f2-d5d5e7c046e7 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 945 time: 0.0960124 Nov 09 05:20:43.983440 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-be47e82d-9127-4a82-bdda-5cb31de646af req-59c8d51e-b149-4eba-b64a-f7fa3237d139 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/security-groups?id=a91c2c29-9e77-40ac-b633-1eb86d1c611c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424445 Nov 09 05:20:44.080775 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe4facd7-d9a1-41af-ac20-47ba101969b0 req-de4144b4-5803-45b8-a076-3a591d3ce824 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:20:44.082210 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fe4facd7-d9a1-41af-ac20-47ba101969b0 req-de4144b4-5803-45b8-a076-3a591d3ce824 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.26 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 945 time: 0.0474458 Nov 09 05:20:44.176729 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-fe4facd7-d9a1-41af-ac20-47ba101969b0 req-1c7aba89-d7dd-4d10-8561-29cc2b3dd8af tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Deleting port 201106f8-ad57-43ba-8183-8f7ecbe69722 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:20:44.177064 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-fe4facd7-d9a1-41af-ac20-47ba101969b0 req-1c7aba89-d7dd-4d10-8561-29cc2b3dd8af tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:44.262029 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-fe4facd7-d9a1-41af-ac20-47ba101969b0 req-1c7aba89-d7dd-4d10-8561-29cc2b3dd8af tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] For port 201106f8-ad57-43ba-8183-8f7ecbe69722, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=201106f8-ad57-43ba-8183-8f7ecbe69722,segment=NetworkSegment(0a75612c-c02a-4294-901e-f7bbf1a2b310),segment_id=0a75612c-c02a-4294-901e-f7bbf1a2b310)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:20:44.262307 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-fe4facd7-d9a1-41af-ac20-47ba101969b0 req-1c7aba89-d7dd-4d10-8561-29cc2b3dd8af tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:44.275791 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-fe4facd7-d9a1-41af-ac20-47ba101969b0 req-1c7aba89-d7dd-4d10-8561-29cc2b3dd8af tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Calling delete_port for 201106f8-ad57-43ba-8183-8f7ecbe69722 owned by compute:nova {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:20:44.472267 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-fe4facd7-d9a1-41af-ac20-47ba101969b0 req-1c7aba89-d7dd-4d10-8561-29cc2b3dd8af tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:44.499881 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c7aba89-d7dd-4d10-8561-29cc2b3dd8af tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Pushing event deleted for resources: {'Port': ['ID=201106f8-ad57-43ba-8183-8f7ecbe69722,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:20:44.563820 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-fe4facd7-d9a1-41af-ac20-47ba101969b0 req-1c7aba89-d7dd-4d10-8561-29cc2b3dd8af tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] No DVR routers for this DVR port 201106f8-ad57-43ba-8183-8f7ecbe69722 on host hv-neutron-8168 {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 05:20:44.563820 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-fe4facd7-d9a1-41af-ac20-47ba101969b0 req-1c7aba89-d7dd-4d10-8561-29cc2b3dd8af tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:44.563820 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fe4facd7-d9a1-41af-ac20-47ba101969b0 req-1c7aba89-d7dd-4d10-8561-29cc2b3dd8af tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.26 "DELETE /v2.0/ports/201106f8-ad57-43ba-8183-8f7ecbe69722 HTTP/1.1" status: 204 len: 173 time: 0.4625938 Nov 09 05:20:44.563820 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '95295fb2-238e-4b98-b4c7-082b0868082d', 'name': 'network-vif-deleted', 'tag': '201106f8-ad57-43ba-8183-8f7ecbe69722'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:20:44.563820 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a9ed6ac1-965f-46fd-87e0-3aa63fdaad35" -d '{"events": [{"server_uuid": "95295fb2-238e-4b98-b4c7-082b0868082d", "name": "network-vif-deleted", "tag": "201106f8-ad57-43ba-8183-8f7ecbe69722"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:20:44.589469 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 05:20:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f487db77-5236-4173-ae3d-a6e462a3e26b x-openstack-request-id: req-f487db77-5236-4173-ae3d-a6e462a3e26b {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:20:44.589781 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "95295fb2-238e-4b98-b4c7-082b0868082d", "name": "network-vif-deleted", "tag": "201106f8-ad57-43ba-8183-8f7ecbe69722", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:20:44.590057 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-f487db77-5236-4173-ae3d-a6e462a3e26b {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:20:44.590533 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '95295fb2-238e-4b98-b4c7-082b0868082d', 'name': 'network-vif-deleted', 'tag': '201106f8-ad57-43ba-8183-8f7ecbe69722', 'status': 'completed', 'code': 200} Nov 09 05:20:45.084311 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-824573b4-0892-4cb3-add2-cbd8144df62f req-f56fb613-6997-40b4-87ca-53ef73653b86 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 210 time: 0.0288126 Nov 09 05:20:45.337105 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:46.181588 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-9d55aa42-f995-4793-aca5-a4feb2d162b7 req-3b8b16f1-7730-446d-9770-98a6aedfa7fd tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 210 time: 0.0275221 Nov 09 05:20:46.691588 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:47.016214 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:47.049276 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 201106f8-ad57-43ba-8183-8f7ecbe69722 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 05:20:47.070296 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] No Port match for: 201106f8-ad57-43ba-8183-8f7ecbe69722 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 05:20:47.070672 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 201106f8-ad57-43ba-8183-8f7ecbe69722 not bound to the agent host hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 05:20:47.273954 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-96aa7ace-e936-40f0-ae07-13056a911a39 req-b7b919be-888d-447e-adc4-2c38f2a8e063 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 210 time: 0.0269570 Nov 09 05:20:48.365102 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4c6798f1-8215-4a93-b145-47f116678f23 req-0740b5d7-9793-4726-8107-7e729ed9bae4 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 210 time: 0.0260994 Nov 09 05:20:49.484917 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-a4740a29-51df-41bd-8b95-e86a483b2a38 req-f45c387a-10c9-488e-afc6-a41199192328 tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "GET /v2.0/ports?device_id=95295fb2-238e-4b98-b4c7-082b0868082d HTTP/1.1" status: 200 len: 210 time: 0.0311592 Nov 09 05:20:50.538713 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 38634) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:20:50.598038 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-304b5611-f6d2-486a-91cc-2761b7cb5dcb tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:50.624708 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-304b5611-f6d2-486a-91cc-2761b7cb5dcb tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:50.805820 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-304b5611-f6d2-486a-91cc-2761b7cb5dcb tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:50.808528 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-304b5611-f6d2-486a-91cc-2761b7cb5dcb tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:50.809700 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-304b5611-f6d2-486a-91cc-2761b7cb5dcb tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] 10.222.0.24 "DELETE /v2.0/security-groups/a91c2c29-9e77-40ac-b633-1eb86d1c611c HTTP/1.1" status: 204 len: 168 time: 0.2700086 Nov 09 05:20:50.820071 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-304b5611-f6d2-486a-91cc-2761b7cb5dcb tempest-TestShelveInstance-1588083208 tempest-TestShelveInstance-1588083208-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=a91c2c29-9e77-40ac-b633-1eb86d1c611c,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:20:50.921711 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 38638) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:20:51.408626 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7aec2440-3af2-4b9f-a2e7-62d2579e47de admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:51.663465 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-7aec2440-3af2-4b9f-a2e7-62d2579e47de admin admin] Deleting port 165314fc-453c-4fef-bf42-9efd260d1493 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:20:51.664157 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7aec2440-3af2-4b9f-a2e7-62d2579e47de admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:51.741180 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-7aec2440-3af2-4b9f-a2e7-62d2579e47de admin admin] For port 165314fc-453c-4fef-bf42-9efd260d1493, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=165314fc-453c-4fef-bf42-9efd260d1493,segment=NetworkSegment(0a75612c-c02a-4294-901e-f7bbf1a2b310),segment_id=0a75612c-c02a-4294-901e-f7bbf1a2b310)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:20:51.741532 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7aec2440-3af2-4b9f-a2e7-62d2579e47de admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:51.754980 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-7aec2440-3af2-4b9f-a2e7-62d2579e47de admin admin] Calling delete_port for 165314fc-453c-4fef-bf42-9efd260d1493 owned by network:router_interface {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:20:52.011526 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7aec2440-3af2-4b9f-a2e7-62d2579e47de admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:52.041640 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7aec2440-3af2-4b9f-a2e7-62d2579e47de admin admin] Pushing event deleted for resources: {'Port': ['ID=165314fc-453c-4fef-bf42-9efd260d1493,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:20:52.212048 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7aec2440-3af2-4b9f-a2e7-62d2579e47de admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:52.428562 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7aec2440-3af2-4b9f-a2e7-62d2579e47de admin admin] Router 4119e421-6cb1-4924-9967-18e73a4eeae3 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 05:20:52.541643 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7aec2440-3af2-4b9f-a2e7-62d2579e47de admin admin] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 05:20:52.546584 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-7aec2440-3af2-4b9f-a2e7-62d2579e47de admin admin] 10.222.0.24 "PUT /v2.0/routers/4119e421-6cb1-4924-9967-18e73a4eeae3/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6237929 Nov 09 05:20:52.549168 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 38642) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:20:52.553051 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cd6babe1-aca3-472f-a82a-ff43b1f1b77e None None] Sync routers for ids ['4119e421-6cb1-4924-9967-18e73a4eeae3'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 05:20:52.563808 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cd6babe1-aca3-472f-a82a-ff43b1f1b77e None None] Routers {'4119e421-6cb1-4924-9967-18e73a4eeae3'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:20:52.564417 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-cd6babe1-aca3-472f-a82a-ff43b1f1b77e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:20:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['4119e421-6cb1-4924-9967-18e73a4eeae3'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:20:52.655366 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7fce1dd5-94eb-4386-842a-bdf9933d4cdf admin admin] Publish callbacks [] for router, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:52.767282 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-cd6babe1-aca3-472f-a82a-ff43b1f1b77e None None] Set router 4119e421-6cb1-4924-9967-18e73a4eeae3 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:20:52.777079 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7fce1dd5-94eb-4386-842a-bdf9933d4cdf admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:52.906209 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-7fce1dd5-94eb-4386-842a-bdf9933d4cdf admin admin] Deleting port 5204f9e0-7d71-4dee-997d-b68078c7a10f {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:20:52.906882 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7fce1dd5-94eb-4386-842a-bdf9933d4cdf admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:52.949372 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-cd6babe1-aca3-472f-a82a-ff43b1f1b77e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'name': 'tempest-TestShelveInstance-1961526497-router', 'tenant_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.251'}], 'enable_snat': True}, 'gw_port_id': '5204f9e0-7d71-4dee-997d-b68078c7a10f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:10:41Z', 'updated_at': '2021-11-09T05:20:51Z', 'revision_number': 5, 'project_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'gw_port': {'id': '5204f9e0-7d71-4dee-997d-b68078c7a10f', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:88:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1808, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.251', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:10:42Z', 'updated_at': '2021-11-09T05:10:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:20:52.982107 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cd6babe1-aca3-472f-a82a-ff43b1f1b77e None None] Checking router: 4119e421-6cb1-4924-9967-18e73a4eeae3 for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 05:20:52.990592 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cd6babe1-aca3-472f-a82a-ff43b1f1b77e None None] Routers {'4119e421-6cb1-4924-9967-18e73a4eeae3'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:20:52.991445 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-cd6babe1-aca3-472f-a82a-ff43b1f1b77e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:20:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['4119e421-6cb1-4924-9967-18e73a4eeae3'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:20:52.992657 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-7fce1dd5-94eb-4386-842a-bdf9933d4cdf admin admin] For port 5204f9e0-7d71-4dee-997d-b68078c7a10f, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=5204f9e0-7d71-4dee-997d-b68078c7a10f,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:20:52.992947 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7fce1dd5-94eb-4386-842a-bdf9933d4cdf admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:53.007997 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-7fce1dd5-94eb-4386-842a-bdf9933d4cdf admin admin] Calling delete_port for 5204f9e0-7d71-4dee-997d-b68078c7a10f owned by network:router_gateway {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:20:53.078130 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-cd6babe1-aca3-472f-a82a-ff43b1f1b77e None None] Set router 4119e421-6cb1-4924-9967-18e73a4eeae3 gateway port host: None {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:20:53.129838 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-cd6babe1-aca3-472f-a82a-ff43b1f1b77e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'name': 'tempest-TestShelveInstance-1961526497-router', 'tenant_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:10:41Z', 'updated_at': '2021-11-09T05:20:52Z', 'revision_number': 6, 'project_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'gw_port_host': None}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:20:53.160464 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cd6babe1-aca3-472f-a82a-ff43b1f1b77e None None] The sync data for ids ['4119e421-6cb1-4924-9967-18e73a4eeae3'] in dv-neutron-816802-2-hyperv is: [{'id': '4119e421-6cb1-4924-9967-18e73a4eeae3', 'name': 'tempest-TestShelveInstance-1961526497-router', 'tenant_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:10:41Z', 'updated_at': '2021-11-09T05:20:52Z', 'revision_number': 6, 'project_id': 'ebd13c4f757b48ab9d14fcf5b3a5325a', 'gw_port_host': None}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 05:20:53.238559 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7fce1dd5-94eb-4386-842a-bdf9933d4cdf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:53.269274 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fce1dd5-94eb-4386-842a-bdf9933d4cdf admin admin] Pushing event deleted for resources: {'Port': ['ID=5204f9e0-7d71-4dee-997d-b68078c7a10f,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:20:53.329798 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7fce1dd5-94eb-4386-842a-bdf9933d4cdf admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-466373'] for router_gateway, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:53.418869 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7fce1dd5-94eb-4386-842a-bdf9933d4cdf admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:53.420936 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7fce1dd5-94eb-4386-842a-bdf9933d4cdf admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:53.520128 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7fce1dd5-94eb-4386-842a-bdf9933d4cdf admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:53.520707 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7fce1dd5-94eb-4386-842a-bdf9933d4cdf admin admin] Fanout notify agent at l3_agent the message router_deleted on router 4119e421-6cb1-4924-9967-18e73a4eeae3 {{(pid=102162) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 05:20:53.525197 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-7fce1dd5-94eb-4386-842a-bdf9933d4cdf admin admin] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:53.526467 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-7fce1dd5-94eb-4386-842a-bdf9933d4cdf admin admin] 10.222.0.24 "DELETE /v2.0/routers/4119e421-6cb1-4924-9967-18e73a4eeae3 HTTP/1.1" status: 204 len: 168 time: 0.9763789 Nov 09 05:20:53.528956 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 38646) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:20:53.584104 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-4260c9f6-f6ea-41c5-a1bd-5cc7eb612c4c admin admin] Deleting subnet abf74659-fa86-43c8-a52c-7b696adbf35a {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 05:20:53.587574 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4260c9f6-f6ea-41c5-a1bd-5cc7eb612c4c admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:53.623673 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4260c9f6-f6ea-41c5-a1bd-5cc7eb612c4c admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:53.698691 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4260c9f6-f6ea-41c5-a1bd-5cc7eb612c4c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:53.834891 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4260c9f6-f6ea-41c5-a1bd-5cc7eb612c4c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:53.867011 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4260c9f6-f6ea-41c5-a1bd-5cc7eb612c4c admin admin] Pushing event deleted for resources: {'Subnet': ['ID=abf74659-fa86-43c8-a52c-7b696adbf35a,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:20:53.870320 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-4260c9f6-f6ea-41c5-a1bd-5cc7eb612c4c admin admin] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:53.873576 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-4260c9f6-f6ea-41c5-a1bd-5cc7eb612c4c admin admin] 10.222.0.24 "DELETE /v2.0/subnets/abf74659-fa86-43c8-a52c-7b696adbf35a HTTP/1.1" status: 204 len: 168 time: 0.3436859 Nov 09 05:20:53.875999 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 38648) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:20:53.876297 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-99bfb744-8cce-4d18-9ebc-c95f379220f7 None None] Network 41e1a505-f3a3-418f-9229-3880f4333c14 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 05:20:53.950259 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-34b9a358-0c5a-4158-96bf-219afd57e34b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:54.009749 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-34b9a358-0c5a-4158-96bf-219afd57e34b admin admin] Deleting port 438646fd-0794-4cd0-aa9b-87b89a08dc7c {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:20:54.010085 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-34b9a358-0c5a-4158-96bf-219afd57e34b admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:54.070241 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b98a5b5d-5d97-4ada-80b8-22f2f71d2def None None] DHCP port deletion for 41e1a505-f3a3-418f-9229-3880f4333c14 request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 05:20:54.077551 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-34b9a358-0c5a-4158-96bf-219afd57e34b admin admin] For port 438646fd-0794-4cd0-aa9b-87b89a08dc7c, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=438646fd-0794-4cd0-aa9b-87b89a08dc7c,segment=NetworkSegment(0a75612c-c02a-4294-901e-f7bbf1a2b310),segment_id=0a75612c-c02a-4294-901e-f7bbf1a2b310)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:20:54.077903 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-34b9a358-0c5a-4158-96bf-219afd57e34b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:54.090609 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-34b9a358-0c5a-4158-96bf-219afd57e34b admin admin] Calling delete_port for 438646fd-0794-4cd0-aa9b-87b89a08dc7c owned by network:dhcp {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:20:54.119371 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-b98a5b5d-5d97-4ada-80b8-22f2f71d2def None None] Deleting port 438646fd-0794-4cd0-aa9b-87b89a08dc7c {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:20:54.119813 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b98a5b5d-5d97-4ada-80b8-22f2f71d2def None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:54.188660 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-b98a5b5d-5d97-4ada-80b8-22f2f71d2def None None] For port 438646fd-0794-4cd0-aa9b-87b89a08dc7c, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=438646fd-0794-4cd0-aa9b-87b89a08dc7c,segment=NetworkSegment(0a75612c-c02a-4294-901e-f7bbf1a2b310),segment_id=0a75612c-c02a-4294-901e-f7bbf1a2b310)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:20:54.188987 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b98a5b5d-5d97-4ada-80b8-22f2f71d2def None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:54.202551 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-b98a5b5d-5d97-4ada-80b8-22f2f71d2def None None] Calling delete_port for 438646fd-0794-4cd0-aa9b-87b89a08dc7c owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:20:54.240492 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-34b9a358-0c5a-4158-96bf-219afd57e34b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:54.272778 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34b9a358-0c5a-4158-96bf-219afd57e34b admin admin] Pushing event deleted for resources: {'Port': ['ID=438646fd-0794-4cd0-aa9b-87b89a08dc7c,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:20:54.273051 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-34b9a358-0c5a-4158-96bf-219afd57e34b admin admin] No DVR routers for this DVR port 438646fd-0794-4cd0-aa9b-87b89a08dc7c on host dv-neutron-816802-2-hyperv {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 05:20:54.278089 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b98a5b5d-5d97-4ada-80b8-22f2f71d2def None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:54.308302 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b98a5b5d-5d97-4ada-80b8-22f2f71d2def None None] Pushing event deleted for resources: {'Port': ['ID=438646fd-0794-4cd0-aa9b-87b89a08dc7c,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:20:54.310480 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b98a5b5d-5d97-4ada-80b8-22f2f71d2def None None] No DVR routers for this DVR port 438646fd-0794-4cd0-aa9b-87b89a08dc7c on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 05:20:54.318014 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b98a5b5d-5d97-4ada-80b8-22f2f71d2def None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:20:54.318417 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b98a5b5d-5d97-4ada-80b8-22f2f71d2def None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:20:54.318737 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b98a5b5d-5d97-4ada-80b8-22f2f71d2def None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:20:54.319080 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b98a5b5d-5d97-4ada-80b8-22f2f71d2def None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:20:54.319408 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b98a5b5d-5d97-4ada-80b8-22f2f71d2def None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:20:54.319741 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b98a5b5d-5d97-4ada-80b8-22f2f71d2def None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:20:54.320069 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b98a5b5d-5d97-4ada-80b8-22f2f71d2def None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:20:54.320797 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b98a5b5d-5d97-4ada-80b8-22f2f71d2def None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:20:54.320797 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b98a5b5d-5d97-4ada-80b8-22f2f71d2def None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:20:54.321002 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b98a5b5d-5d97-4ada-80b8-22f2f71d2def None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:20:54.321329 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b98a5b5d-5d97-4ada-80b8-22f2f71d2def None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:20:54.321656 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b98a5b5d-5d97-4ada-80b8-22f2f71d2def None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:20:54.347782 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-34b9a358-0c5a-4158-96bf-219afd57e34b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:54.367524 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-34b9a358-0c5a-4158-96bf-219afd57e34b admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['41e1a505-f3a3-418f-9229-3880f4333c14']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:20:54.376646 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-34b9a358-0c5a-4158-96bf-219afd57e34b admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '0a75612c-c02a-4294-901e-f7bbf1a2b310') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:20:54.377473 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-34b9a358-0c5a-4158-96bf-219afd57e34b admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '0a75612c-c02a-4294-901e-f7bbf1a2b310') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:20:54.386608 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-34b9a358-0c5a-4158-96bf-219afd57e34b admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:54.400305 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-34b9a358-0c5a-4158-96bf-219afd57e34b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:54.406114 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-34b9a358-0c5a-4158-96bf-219afd57e34b admin admin] Releasing vlan 326 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 05:20:54.406528 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-34b9a358-0c5a-4158-96bf-219afd57e34b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:54.408204 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 05:20:54.408204 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 05:20:54.408204 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 05:20:54.408204 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 05:20:54.408204 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 05:20:54.408204 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 05:20:54.408204 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 05:20:54.408204 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 05:20:54.408204 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 05:20:54.408204 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 05:20:54.408204 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 05:20:54.408204 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 05:20:54.408204 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 05:20:54.408204 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 05:20:54.408204 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 05:20:54.408204 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 05:20:54.408204 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 05:20:54.408204 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 05:20:54.408204 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 05:20:54.408204 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 05:20:54.408204 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 05:20:54.408204 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 05:20:54.408204 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 05:20:54.408204 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 05:20:54.408204 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 05:20:54.408204 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 05:20:54.408204 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 05:20:54.408204 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 05:20:54.408204 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 05:20:54.408204 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 05:20:54.408204 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 05:20:54.408204 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 05:20:54.531704 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-34b9a358-0c5a-4158-96bf-219afd57e34b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:54.537089 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-34b9a358-0c5a-4158-96bf-219afd57e34b admin admin] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:54.540249 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-34b9a358-0c5a-4158-96bf-219afd57e34b admin admin] 10.222.0.24 "DELETE /v2.0/networks/41e1a505-f3a3-418f-9229-3880f4333c14 HTTP/1.1" status: 204 len: 168 time: 0.6633515 Nov 09 05:20:54.543369 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 38650) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:20:54.550833 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34b9a358-0c5a-4158-96bf-219afd57e34b admin admin] Pushing event deleted for resources: {'Network': ['ID=41e1a505-f3a3-418f-9229-3880f4333c14,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:20:54.757998 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 438646fd-0794-4cd0-aa9b-87b89a08dc7c no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 05:20:54.778499 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 438646fd-0794-4cd0-aa9b-87b89a08dc7c {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 05:20:54.778837 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 438646fd-0794-4cd0-aa9b-87b89a08dc7c not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 05:20:54.779241 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 5204f9e0-7d71-4dee-997d-b68078c7a10f no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 05:20:54.798184 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 5204f9e0-7d71-4dee-997d-b68078c7a10f {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 05:20:54.798476 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 5204f9e0-7d71-4dee-997d-b68078c7a10f not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 05:20:54.799405 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 165314fc-453c-4fef-bf42-9efd260d1493 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 05:20:54.818890 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 165314fc-453c-4fef-bf42-9efd260d1493 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 05:20:54.819235 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 165314fc-453c-4fef-bf42-9efd260d1493 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 05:20:54.879597 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d81861eb-1913-4fff-8f12-8ec4ee9b5ed3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:55.116113 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-d81861eb-1913-4fff-8f12-8ec4ee9b5ed3 admin admin] Deleting port 98221fb7-a97e-48d8-8c23-9a65ee0ff9bb {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:20:55.116365 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d81861eb-1913-4fff-8f12-8ec4ee9b5ed3 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:55.194126 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-d81861eb-1913-4fff-8f12-8ec4ee9b5ed3 admin admin] For port 98221fb7-a97e-48d8-8c23-9a65ee0ff9bb, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=98221fb7-a97e-48d8-8c23-9a65ee0ff9bb,segment=NetworkSegment(427bac9b-3a53-470d-af69-12c1d54ff678),segment_id=427bac9b-3a53-470d-af69-12c1d54ff678)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:20:55.194511 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d81861eb-1913-4fff-8f12-8ec4ee9b5ed3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:55.206572 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-d81861eb-1913-4fff-8f12-8ec4ee9b5ed3 admin admin] Calling delete_port for 98221fb7-a97e-48d8-8c23-9a65ee0ff9bb owned by network:router_interface {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:20:55.438306 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d81861eb-1913-4fff-8f12-8ec4ee9b5ed3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:55.463824 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d81861eb-1913-4fff-8f12-8ec4ee9b5ed3 admin admin] Pushing event deleted for resources: {'Port': ['ID=98221fb7-a97e-48d8-8c23-9a65ee0ff9bb,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:20:55.475910 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d81861eb-1913-4fff-8f12-8ec4ee9b5ed3 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:20:55.476258 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d81861eb-1913-4fff-8f12-8ec4ee9b5ed3 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:20:55.476600 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d81861eb-1913-4fff-8f12-8ec4ee9b5ed3 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:20:55.476936 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d81861eb-1913-4fff-8f12-8ec4ee9b5ed3 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:20:55.477267 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d81861eb-1913-4fff-8f12-8ec4ee9b5ed3 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:20:55.477596 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d81861eb-1913-4fff-8f12-8ec4ee9b5ed3 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:20:55.477924 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d81861eb-1913-4fff-8f12-8ec4ee9b5ed3 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:20:55.478254 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d81861eb-1913-4fff-8f12-8ec4ee9b5ed3 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:20:55.478604 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d81861eb-1913-4fff-8f12-8ec4ee9b5ed3 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:20:55.478933 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d81861eb-1913-4fff-8f12-8ec4ee9b5ed3 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:20:55.479254 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d81861eb-1913-4fff-8f12-8ec4ee9b5ed3 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:20:55.479571 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d81861eb-1913-4fff-8f12-8ec4ee9b5ed3 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:20:55.635187 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-d81861eb-1913-4fff-8f12-8ec4ee9b5ed3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:55.839481 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d81861eb-1913-4fff-8f12-8ec4ee9b5ed3 admin admin] Router 91dd8d79-6212-4914-b31e-8b09f14ad8bd has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 05:20:55.947801 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d81861eb-1913-4fff-8f12-8ec4ee9b5ed3 admin admin] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 05:20:55.952729 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-d81861eb-1913-4fff-8f12-8ec4ee9b5ed3 admin admin] 10.222.0.24 "PUT /v2.0/routers/91dd8d79-6212-4914-b31e-8b09f14ad8bd/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4082663 Nov 09 05:20:55.955822 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 38652) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:20:55.958329 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a49e3f37-347a-44fb-b047-19c14551c97e None None] Sync routers for ids ['91dd8d79-6212-4914-b31e-8b09f14ad8bd'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 05:20:55.967693 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a49e3f37-347a-44fb-b047-19c14551c97e None None] Routers {'91dd8d79-6212-4914-b31e-8b09f14ad8bd'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:20:55.968307 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-a49e3f37-347a-44fb-b047-19c14551c97e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:20:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['91dd8d79-6212-4914-b31e-8b09f14ad8bd'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:20:56.073827 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-a49e3f37-347a-44fb-b047-19c14551c97e None None] Set router 91dd8d79-6212-4914-b31e-8b09f14ad8bd gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:20:56.262867 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-a49e3f37-347a-44fb-b047-19c14551c97e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '91dd8d79-6212-4914-b31e-8b09f14ad8bd', 'name': 'tempest-TestShelveInstance-1268500813-router', 'tenant_id': 'e2046a90eaa74271a16949e08ce6507e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.224'}], 'enable_snat': True}, 'gw_port_id': '0a66f250-0e46-4c8e-90c9-9004293b7728', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:10:47Z', 'updated_at': '2021-11-09T05:20:55Z', 'revision_number': 5, 'project_id': 'e2046a90eaa74271a16949e08ce6507e', 'gw_port': {'id': '0a66f250-0e46-4c8e-90c9-9004293b7728', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:b5:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '91dd8d79-6212-4914-b31e-8b09f14ad8bd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1820, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:10:47Z', 'updated_at': '2021-11-09T05:10:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:20:56.290049 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a49e3f37-347a-44fb-b047-19c14551c97e None None] Checking router: 91dd8d79-6212-4914-b31e-8b09f14ad8bd for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 05:20:56.299356 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a49e3f37-347a-44fb-b047-19c14551c97e None None] Routers {'91dd8d79-6212-4914-b31e-8b09f14ad8bd'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:20:56.299972 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-a49e3f37-347a-44fb-b047-19c14551c97e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:20:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['91dd8d79-6212-4914-b31e-8b09f14ad8bd'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:20:56.340271 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-75bff680-0c23-45d6-a91f-a0f4a693f14e admin admin] Publish callbacks [] for router, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:56.403654 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-a49e3f37-347a-44fb-b047-19c14551c97e None None] Set router 91dd8d79-6212-4914-b31e-8b09f14ad8bd gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:20:56.441977 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-75bff680-0c23-45d6-a91f-a0f4a693f14e admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:56.539157 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-75bff680-0c23-45d6-a91f-a0f4a693f14e admin admin] Deleting port 0a66f250-0e46-4c8e-90c9-9004293b7728 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:20:56.539511 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-75bff680-0c23-45d6-a91f-a0f4a693f14e admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:56.577378 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-a49e3f37-347a-44fb-b047-19c14551c97e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '91dd8d79-6212-4914-b31e-8b09f14ad8bd', 'name': 'tempest-TestShelveInstance-1268500813-router', 'tenant_id': 'e2046a90eaa74271a16949e08ce6507e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.224'}], 'enable_snat': True}, 'gw_port_id': '0a66f250-0e46-4c8e-90c9-9004293b7728', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:10:47Z', 'updated_at': '2021-11-09T05:20:55Z', 'revision_number': 5, 'project_id': 'e2046a90eaa74271a16949e08ce6507e', 'gw_port': {'id': '0a66f250-0e46-4c8e-90c9-9004293b7728', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:b5:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '91dd8d79-6212-4914-b31e-8b09f14ad8bd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1820, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:10:47Z', 'updated_at': '2021-11-09T05:10:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:20:56.606956 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a49e3f37-347a-44fb-b047-19c14551c97e None None] The sync data for ids ['91dd8d79-6212-4914-b31e-8b09f14ad8bd'] in dv-neutron-816802-2-hyperv is: [{'id': '91dd8d79-6212-4914-b31e-8b09f14ad8bd', 'name': 'tempest-TestShelveInstance-1268500813-router', 'tenant_id': 'e2046a90eaa74271a16949e08ce6507e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.224'}], 'enable_snat': True}, 'gw_port_id': '0a66f250-0e46-4c8e-90c9-9004293b7728', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:10:47Z', 'updated_at': '2021-11-09T05:20:55Z', 'revision_number': 5, 'project_id': 'e2046a90eaa74271a16949e08ce6507e', 'gw_port': {'id': '0a66f250-0e46-4c8e-90c9-9004293b7728', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:b5:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '91dd8d79-6212-4914-b31e-8b09f14ad8bd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1820, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:10:47Z', 'updated_at': '2021-11-09T05:10:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 05:20:56.622523 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-75bff680-0c23-45d6-a91f-a0f4a693f14e admin admin] For port 0a66f250-0e46-4c8e-90c9-9004293b7728, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=0a66f250-0e46-4c8e-90c9-9004293b7728,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:20:56.622880 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-75bff680-0c23-45d6-a91f-a0f4a693f14e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:56.639129 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-75bff680-0c23-45d6-a91f-a0f4a693f14e admin admin] Calling delete_port for 0a66f250-0e46-4c8e-90c9-9004293b7728 owned by network:router_gateway {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:20:56.863542 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-75bff680-0c23-45d6-a91f-a0f4a693f14e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:56.902473 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75bff680-0c23-45d6-a91f-a0f4a693f14e admin admin] Pushing event deleted for resources: {'Port': ['ID=0a66f250-0e46-4c8e-90c9-9004293b7728,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:20:56.972221 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-75bff680-0c23-45d6-a91f-a0f4a693f14e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-466373'] for router_gateway, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:57.077296 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-75bff680-0c23-45d6-a91f-a0f4a693f14e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:57.079565 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-75bff680-0c23-45d6-a91f-a0f4a693f14e admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:57.082580 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 98221fb7-a97e-48d8-8c23-9a65ee0ff9bb no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 05:20:57.108787 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 98221fb7-a97e-48d8-8c23-9a65ee0ff9bb {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 05:20:57.109365 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 98221fb7-a97e-48d8-8c23-9a65ee0ff9bb not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 05:20:57.217670 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-75bff680-0c23-45d6-a91f-a0f4a693f14e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:57.218409 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-75bff680-0c23-45d6-a91f-a0f4a693f14e admin admin] Fanout notify agent at l3_agent the message router_deleted on router 91dd8d79-6212-4914-b31e-8b09f14ad8bd {{(pid=102161) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 05:20:57.223401 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-75bff680-0c23-45d6-a91f-a0f4a693f14e admin admin] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:57.227511 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 38654) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:20:57.231142 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-75bff680-0c23-45d6-a91f-a0f4a693f14e admin admin] 10.222.0.24 "DELETE /v2.0/routers/91dd8d79-6212-4914-b31e-8b09f14ad8bd HTTP/1.1" status: 204 len: 168 time: 1.2742438 Nov 09 05:20:57.288067 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-b8e883f2-6caa-4ee6-b6ce-a5742b9294af admin admin] Deleting subnet abdf4487-51ee-478e-8096-167f92236ef6 {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 05:20:57.291359 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b8e883f2-6caa-4ee6-b6ce-a5742b9294af admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:57.331628 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b8e883f2-6caa-4ee6-b6ce-a5742b9294af admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:57.411723 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b8e883f2-6caa-4ee6-b6ce-a5742b9294af admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:57.526886 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b8e883f2-6caa-4ee6-b6ce-a5742b9294af admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:57.552951 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8e883f2-6caa-4ee6-b6ce-a5742b9294af admin admin] Pushing event deleted for resources: {'Subnet': ['ID=abdf4487-51ee-478e-8096-167f92236ef6,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:20:57.557011 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b8e883f2-6caa-4ee6-b6ce-a5742b9294af admin admin] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:57.565235 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-b8e883f2-6caa-4ee6-b6ce-a5742b9294af admin admin] 10.222.0.24 "DELETE /v2.0/subnets/abdf4487-51ee-478e-8096-167f92236ef6 HTTP/1.1" status: 204 len: 168 time: 0.3319235 Nov 09 05:20:57.565235 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 38656) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:20:57.707762 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-02555cab-efb6-4010-b513-308dd461dbe0 None None] Network af03aad1-f784-4a70-ae82-2bede3b275e0 requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 05:20:57.962209 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4bbc8c95-09f3-438e-8e69-0b7401f0a6db None None] DHCP port deletion for af03aad1-f784-4a70-ae82-2bede3b275e0 request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 05:20:57.974538 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-78ac0ee0-964f-421d-bfbd-377744421003 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:58.009730 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-4bbc8c95-09f3-438e-8e69-0b7401f0a6db None None] Deleting port b318b080-2cb9-40a5-b57c-6a6647fba455 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:20:58.010122 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4bbc8c95-09f3-438e-8e69-0b7401f0a6db None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:58.026494 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-78ac0ee0-964f-421d-bfbd-377744421003 admin admin] Deleting port b318b080-2cb9-40a5-b57c-6a6647fba455 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:20:58.026829 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-78ac0ee0-964f-421d-bfbd-377744421003 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:58.077193 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-4bbc8c95-09f3-438e-8e69-0b7401f0a6db None None] For port b318b080-2cb9-40a5-b57c-6a6647fba455, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=b318b080-2cb9-40a5-b57c-6a6647fba455,segment=NetworkSegment(427bac9b-3a53-470d-af69-12c1d54ff678),segment_id=427bac9b-3a53-470d-af69-12c1d54ff678)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:20:58.077596 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4bbc8c95-09f3-438e-8e69-0b7401f0a6db None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:58.091389 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-4bbc8c95-09f3-438e-8e69-0b7401f0a6db None None] Calling delete_port for b318b080-2cb9-40a5-b57c-6a6647fba455 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:20:58.096723 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-78ac0ee0-964f-421d-bfbd-377744421003 admin admin] For port b318b080-2cb9-40a5-b57c-6a6647fba455, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=b318b080-2cb9-40a5-b57c-6a6647fba455,segment=NetworkSegment(427bac9b-3a53-470d-af69-12c1d54ff678),segment_id=427bac9b-3a53-470d-af69-12c1d54ff678)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:20:58.097098 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-78ac0ee0-964f-421d-bfbd-377744421003 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:58.110643 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-78ac0ee0-964f-421d-bfbd-377744421003 admin admin] Calling delete_port for b318b080-2cb9-40a5-b57c-6a6647fba455 owned by network:dhcp {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:20:58.228890 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4bbc8c95-09f3-438e-8e69-0b7401f0a6db None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:58.234686 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-78ac0ee0-964f-421d-bfbd-377744421003 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:58.254130 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bbc8c95-09f3-438e-8e69-0b7401f0a6db None None] Pushing event deleted for resources: {'Port': ['ID=b318b080-2cb9-40a5-b57c-6a6647fba455,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:20:58.259072 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4bbc8c95-09f3-438e-8e69-0b7401f0a6db None None] No DVR routers for this DVR port b318b080-2cb9-40a5-b57c-6a6647fba455 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 05:20:58.260324 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78ac0ee0-964f-421d-bfbd-377744421003 admin admin] Pushing event deleted for resources: {'Port': ['ID=b318b080-2cb9-40a5-b57c-6a6647fba455,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:20:58.263734 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-78ac0ee0-964f-421d-bfbd-377744421003 admin admin] No DVR routers for this DVR port b318b080-2cb9-40a5-b57c-6a6647fba455 on host dv-neutron-816802-2-hyperv {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 05:20:58.336103 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-78ac0ee0-964f-421d-bfbd-377744421003 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:58.355728 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-78ac0ee0-964f-421d-bfbd-377744421003 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['af03aad1-f784-4a70-ae82-2bede3b275e0']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:20:58.365423 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-78ac0ee0-964f-421d-bfbd-377744421003 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '427bac9b-3a53-470d-af69-12c1d54ff678') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:20:58.365669 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-78ac0ee0-964f-421d-bfbd-377744421003 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '427bac9b-3a53-470d-af69-12c1d54ff678') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:20:58.375064 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-78ac0ee0-964f-421d-bfbd-377744421003 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:58.387978 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-78ac0ee0-964f-421d-bfbd-377744421003 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:58.394178 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-78ac0ee0-964f-421d-bfbd-377744421003 admin admin] Releasing vlan 310 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 05:20:58.394585 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-78ac0ee0-964f-421d-bfbd-377744421003 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:58.396194 dv-neutron-816802-2-hyperv neutron-server[102162]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 05:20:58.396194 dv-neutron-816802-2-hyperv neutron-server[102162]: self.session.flush() Nov 09 05:20:58.396194 dv-neutron-816802-2-hyperv neutron-server[102162]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 05:20:58.396194 dv-neutron-816802-2-hyperv neutron-server[102162]: self.session.flush() Nov 09 05:20:58.396194 dv-neutron-816802-2-hyperv neutron-server[102162]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 05:20:58.396194 dv-neutron-816802-2-hyperv neutron-server[102162]: self.session.flush() Nov 09 05:20:58.396194 dv-neutron-816802-2-hyperv neutron-server[102162]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 09 05:20:58.396194 dv-neutron-816802-2-hyperv neutron-server[102162]: self.session.flush() Nov 09 05:20:58.396194 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 05:20:58.396194 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 05:20:58.396194 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 05:20:58.396194 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 05:20:58.396194 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 05:20:58.396194 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 05:20:58.396194 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 05:20:58.396194 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 05:20:58.396194 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 05:20:58.396194 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 05:20:58.396194 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 05:20:58.396194 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 05:20:58.396194 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 05:20:58.396194 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 05:20:58.396194 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 05:20:58.396194 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 05:20:58.396194 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 05:20:58.396194 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 05:20:58.396194 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 05:20:58.396194 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 05:20:58.396194 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 05:20:58.396194 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 05:20:58.396194 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 05:20:58.396194 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 05:20:58.396194 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 05:20:58.396194 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 05:20:58.396194 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 05:20:58.396194 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 05:20:58.396194 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 05:20:58.396194 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 05:20:58.396194 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 05:20:58.396194 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 05:20:58.501135 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-78ac0ee0-964f-421d-bfbd-377744421003 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:58.507642 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-78ac0ee0-964f-421d-bfbd-377744421003 admin admin] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:58.510835 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-78ac0ee0-964f-421d-bfbd-377744421003 admin admin] 10.222.0.24 "DELETE /v2.0/networks/af03aad1-f784-4a70-ae82-2bede3b275e0 HTTP/1.1" status: 204 len: 168 time: 0.9467509 Nov 09 05:20:58.520712 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78ac0ee0-964f-421d-bfbd-377744421003 admin admin] Pushing event deleted for resources: {'Network': ['ID=af03aad1-f784-4a70-ae82-2bede3b275e0,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:20:58.756195 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device b318b080-2cb9-40a5-b57c-6a6647fba455 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 05:20:58.780005 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: b318b080-2cb9-40a5-b57c-6a6647fba455 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 05:20:58.780349 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device b318b080-2cb9-40a5-b57c-6a6647fba455 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 05:20:58.780767 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 0a66f250-0e46-4c8e-90c9-9004293b7728 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 05:20:58.799323 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 0a66f250-0e46-4c8e-90c9-9004293b7728 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 05:20:58.799667 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 0a66f250-0e46-4c8e-90c9-9004293b7728 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 05:20:58.819073 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 38660) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:20:58.857927 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-9e4ef5e2-238c-4c5b-a1fa-5de027361b58 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=ebd13c4f757b48ab9d14fcf5b3a5325a&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0377128 Nov 09 05:20:58.860447 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 38662) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:20:58.907598 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8b6b188d-b6ef-48f4-9387-105a39738506 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:58.927776 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8b6b188d-b6ef-48f4-9387-105a39738506 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:59.049788 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8b6b188d-b6ef-48f4-9387-105a39738506 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:59.052522 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-8b6b188d-b6ef-48f4-9387-105a39738506 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:59.053658 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-8b6b188d-b6ef-48f4-9387-105a39738506 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/f0574e05-3ad8-44d0-94d2-485f290a43aa HTTP/1.1" status: 204 len: 168 time: 0.1923184 Nov 09 05:20:59.061653 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b6b188d-b6ef-48f4-9387-105a39738506 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f0574e05-3ad8-44d0-94d2-485f290a43aa,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:20:59.715252 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 38668) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:20:59.755399 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-938706b8-64bc-4af6-a01f-572bd6746ebe admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=e2046a90eaa74271a16949e08ce6507e&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0389457 Nov 09 05:20:59.757893 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 38670) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:20:59.804234 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-972e5702-3d18-4554-b921-56fc814fafa2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:59.824806 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-972e5702-3d18-4554-b921-56fc814fafa2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:59.935718 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-972e5702-3d18-4554-b921-56fc814fafa2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:59.938507 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-972e5702-3d18-4554-b921-56fc814fafa2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:20:59.939502 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-972e5702-3d18-4554-b921-56fc814fafa2 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/8bbda0e9-121d-4188-8ec8-e65e6ac9b8d4 HTTP/1.1" status: 204 len: 168 time: 0.1806517 Nov 09 05:20:59.947340 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-972e5702-3d18-4554-b921-56fc814fafa2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8bbda0e9-121d-4188-8ec8-e65e6ac9b8d4,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:21:00.948293 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 38692) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:21:01.041235 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-312bf597-7a4f-4f6c-b42d-c9445f73ccd3 admin admin] Request body: {'network': {'name': 'tempest-TestSnapshotPattern-1474624592-network', 'tenant_id': 'ceedba48d4ab4ffcb707b41a150b986b'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:21:01.123962 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-312bf597-7a4f-4f6c-b42d-c9445f73ccd3 admin admin] Made reservation on behalf of ceedba48d4ab4ffcb707b41a150b986b for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 05:21:01.126315 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-312bf597-7a4f-4f6c-b42d-c9445f73ccd3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:01.134583 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-312bf597-7a4f-4f6c-b42d-c9445f73ccd3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:01.208140 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-312bf597-7a4f-4f6c-b42d-c9445f73ccd3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:01.268803 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-312bf597-7a4f-4f6c-b42d-c9445f73ccd3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:01.294732 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-312bf597-7a4f-4f6c-b42d-c9445f73ccd3 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 349} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 05:21:01.300422 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-312bf597-7a4f-4f6c-b42d-c9445f73ccd3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bb8e3fa7-6478-428c-9310-99ce3e618e63,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:21:01.307470 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-312bf597-7a4f-4f6c-b42d-c9445f73ccd3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:01.307689 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-312bf597-7a4f-4f6c-b42d-c9445f73ccd3 admin admin] Added segment 7f482fc6-4887-4d69-a152-097f906532cc of type vlan for network 8b3ee119-8ca9-4512-a0b7-4947c2eb41ed Nov 09 05:21:01.346266 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-312bf597-7a4f-4f6c-b42d-c9445f73ccd3 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:01.432803 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-312bf597-7a4f-4f6c-b42d-c9445f73ccd3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:01.433776 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-312bf597-7a4f-4f6c-b42d-c9445f73ccd3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:21:01.434352 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-312bf597-7a4f-4f6c-b42d-c9445f73ccd3 admin admin] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:01.492551 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-312bf597-7a4f-4f6c-b42d-c9445f73ccd3 admin admin] Pushing event updated for resources: {'Network': ['ID=8b3ee119-8ca9-4512-a0b7-4947c2eb41ed,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:21:01.502520 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 8b3ee119-8ca9-4512-a0b7-4947c2eb41ed details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 05:21:01.521644 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-312bf597-7a4f-4f6c-b42d-c9445f73ccd3 admin admin] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 0.5722404 Nov 09 05:21:01.525896 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 38696) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:21:01.531296 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-7e82c461-92cb-495e-b17d-104dde350f49 admin admin] Request body: {'subnet': {'network_id': '8b3ee119-8ca9-4512-a0b7-4947c2eb41ed', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestSnapshotPattern-1474624592-subnet', 'tenant_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'ip_version': 4}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:21:01.604379 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7e82c461-92cb-495e-b17d-104dde350f49 admin admin] Made reservation on behalf of ceedba48d4ab4ffcb707b41a150b986b for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 05:21:01.606744 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7e82c461-92cb-495e-b17d-104dde350f49 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:01.829112 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7e82c461-92cb-495e-b17d-104dde350f49 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:01.881691 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e82c461-92cb-495e-b17d-104dde350f49 admin admin] Pushing event updated for resources: {'Subnet': ['ID=85aac8f0-cd4e-40f0-b238-bfb36190a9ad,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:21:01.900957 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7e82c461-92cb-495e-b17d-104dde350f49 admin admin] Checking segment: {'id': '7f482fc6-4887-4d69-a152-097f906532cc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '8b3ee119-8ca9-4512-a0b7-4947c2eb41ed'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 05:21:01.901315 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7e82c461-92cb-495e-b17d-104dde350f49 admin admin] Network hostable DHCP agents. Network: 8b3ee119-8ca9-4512-a0b7-4947c2eb41ed, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 05:21:01.965708 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7e82c461-92cb-495e-b17d-104dde350f49 admin admin] Network 8b3ee119-8ca9-4512-a0b7-4947c2eb41ed is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 05:21:02.045943 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-7e82c461-92cb-495e-b17d-104dde350f49 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 8b3ee119-8ca9-4512-a0b7-4947c2eb41ed) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:21:02.050788 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7e82c461-92cb-495e-b17d-104dde350f49 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:21:02.051379 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7e82c461-92cb-495e-b17d-104dde350f49 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:02.057762 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-18e3e612-8b9c-4229-82d8-c220e9f1fc5f None None] Network 8b3ee119-8ca9-4512-a0b7-4947c2eb41ed requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 05:21:02.117636 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-7e82c461-92cb-495e-b17d-104dde350f49 admin admin] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.5903137 Nov 09 05:21:02.120083 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 38698) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:21:02.124372 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-45c6526e-5542-4109-b380-3f88846b0093 admin admin] Request body: {'router': {'name': 'tempest-TestSnapshotPattern-1474624592-router', 'tenant_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:21:02.197672 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c5884475-bf60-4039-b5e6-e150bb543c4c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-8b3ee119-8ca9-4512-a0b7-4947c2eb41ed', 'network_id': '8b3ee119-8ca9-4512-a0b7-4947c2eb41ed', 'tenant_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'fixed_ips': [{'subnet_id': '85aac8f0-cd4e-40f0-b238-bfb36190a9ad'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 05:21:02.198381 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-45c6526e-5542-4109-b380-3f88846b0093 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:02.198543 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c5884475-bf60-4039-b5e6-e150bb543c4c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:02.199488 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-45c6526e-5542-4109-b380-3f88846b0093 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:02.249386 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-45c6526e-5542-4109-b380-3f88846b0093 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:02.325656 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-c5884475-bf60-4039-b5e6-e150bb543c4c None None] Allocated IP 172.20.0.2 (8b3ee119-8ca9-4512-a0b7-4947c2eb41ed/85aac8f0-cd4e-40f0-b238-bfb36190a9ad/44abee79-6c5a-49a1-87de-99d8924ce05e) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 05:21:02.453943 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-45c6526e-5542-4109-b380-3f88846b0093 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:02.465297 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c5884475-bf60-4039-b5e6-e150bb543c4c None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:02.572057 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c5884475-bf60-4039-b5e6-e150bb543c4c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:02.611348 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c5884475-bf60-4039-b5e6-e150bb543c4c None None] Network 8b3ee119-8ca9-4512-a0b7-4947c2eb41ed is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:21:02.615528 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-c5884475-bf60-4039-b5e6-e150bb543c4c None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:21:02.618083 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c5884475-bf60-4039-b5e6-e150bb543c4c None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 05:21:02.632993 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5884475-bf60-4039-b5e6-e150bb543c4c None None] Pushing event updated for resources: {'Port': ['ID=44abee79-6c5a-49a1-87de-99d8924ce05e,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:21:02.682027 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-c5884475-bf60-4039-b5e6-e150bb543c4c None None] Attempting to bind port 44abee79-6c5a-49a1-87de-99d8924ce05e on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 05:21:02.682414 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-c5884475-bf60-4039-b5e6-e150bb543c4c None None] Attempting to bind port 44abee79-6c5a-49a1-87de-99d8924ce05e by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '7f482fc6-4887-4d69-a152-097f906532cc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '8b3ee119-8ca9-4512-a0b7-4947c2eb41ed'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 05:21:02.682776 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c5884475-bf60-4039-b5e6-e150bb543c4c None None] Attempting to bind port 44abee79-6c5a-49a1-87de-99d8924ce05e on network 8b3ee119-8ca9-4512-a0b7-4947c2eb41ed {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 05:21:02.687551 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c5884475-bf60-4039-b5e6-e150bb543c4c None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 5, 20, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 05:21:02.687922 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c5884475-bf60-4039-b5e6-e150bb543c4c None None] Checking segment: {'id': '7f482fc6-4887-4d69-a152-097f906532cc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '8b3ee119-8ca9-4512-a0b7-4947c2eb41ed'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 05:21:02.688314 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c5884475-bf60-4039-b5e6-e150bb543c4c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:02.688703 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c5884475-bf60-4039-b5e6-e150bb543c4c None None] Bound using segment: {'id': '7f482fc6-4887-4d69-a152-097f906532cc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '8b3ee119-8ca9-4512-a0b7-4947c2eb41ed'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 05:21:02.689732 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-c5884475-bf60-4039-b5e6-e150bb543c4c None None] Bound port: 44abee79-6c5a-49a1-87de-99d8924ce05e, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7f482fc6-4887-4d69-a152-097f906532cc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '8b3ee119-8ca9-4512-a0b7-4947c2eb41ed'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 05:21:02.690111 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c5884475-bf60-4039-b5e6-e150bb543c4c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:02.706376 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-45c6526e-5542-4109-b380-3f88846b0093 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:02.729004 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-45c6526e-5542-4109-b380-3f88846b0093 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:02.750789 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-c5884475-bf60-4039-b5e6-e150bb543c4c None None] For port 44abee79-6c5a-49a1-87de-99d8924ce05e, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 05:21:02.754352 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-c5884475-bf60-4039-b5e6-e150bb543c4c None None] For port 44abee79-6c5a-49a1-87de-99d8924ce05e, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=44abee79-6c5a-49a1-87de-99d8924ce05e,segment=NetworkSegment(7f482fc6-4887-4d69-a152-097f906532cc),segment_id=7f482fc6-4887-4d69-a152-097f906532cc)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 05:21:02.824050 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c5884475-bf60-4039-b5e6-e150bb543c4c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:02.829377 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-45c6526e-5542-4109-b380-3f88846b0093 admin admin] Allocated IP 172.26.0.119 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/89781986-0dc0-4c2f-b390-c38c5e41723e) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 05:21:02.884309 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5884475-bf60-4039-b5e6-e150bb543c4c None None] Pushing event updated for resources: {'Port': ['ID=44abee79-6c5a-49a1-87de-99d8924ce05e,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:21:02.941385 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-45c6526e-5542-4109-b380-3f88846b0093 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:03.045089 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-45c6526e-5542-4109-b380-3f88846b0093 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:03.088360 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-45c6526e-5542-4109-b380-3f88846b0093 admin admin] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:21:03.093433 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-45c6526e-5542-4109-b380-3f88846b0093 admin admin] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:21:03.097174 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-45c6526e-5542-4109-b380-3f88846b0093 admin admin] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 05:21:03.120057 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45c6526e-5542-4109-b380-3f88846b0093 admin admin] Pushing event updated for resources: {'Port': ['ID=89781986-0dc0-4c2f-b390-c38c5e41723e,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:21:03.410458 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-45c6526e-5542-4109-b380-3f88846b0093 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:03.618282 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-45c6526e-5542-4109-b380-3f88846b0093 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:03.791569 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-13f26246-c074-412a-8e9d-4275bd580845 None None] Network 8b3ee119-8ca9-4512-a0b7-4947c2eb41ed requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 05:21:03.821201 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-45c6526e-5542-4109-b380-3f88846b0093 admin admin] Router 3e2008fd-6aec-4b2e-b56a-0934358f106c is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102161) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 05:21:03.870264 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-a5b0e354-78ca-44dd-a498-9dd33b60dd17 None None] Provisioning complete for port 44abee79-6c5a-49a1-87de-99d8924ce05e triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:21:03.870264 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a5b0e354-78ca-44dd-a498-9dd33b60dd17 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:03.942884 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-45c6526e-5542-4109-b380-3f88846b0093 admin admin] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 05:21:03.953450 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b861fd4b-8ecd-4edb-ac60-fee5eed209b5 None None] Sync routers for ids ['3e2008fd-6aec-4b2e-b56a-0934358f106c'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 05:21:03.965691 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b861fd4b-8ecd-4edb-ac60-fee5eed209b5 None None] Routers {'3e2008fd-6aec-4b2e-b56a-0934358f106c'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:21:03.966303 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-b861fd4b-8ecd-4edb-ac60-fee5eed209b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:20:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['3e2008fd-6aec-4b2e-b56a-0934358f106c'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:21:04.012435 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-45c6526e-5542-4109-b380-3f88846b0093 admin admin] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:04.013897 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-45c6526e-5542-4109-b380-3f88846b0093 admin admin] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 922 time: 1.8928530 Nov 09 05:21:04.019041 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 38700) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:21:04.035029 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a5b0e354-78ca-44dd-a498-9dd33b60dd17 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:04.072313 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-a5b0e354-78ca-44dd-a498-9dd33b60dd17 None None] For port 44abee79-6c5a-49a1-87de-99d8924ce05e, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=44abee79-6c5a-49a1-87de-99d8924ce05e,segment=NetworkSegment(7f482fc6-4887-4d69-a152-097f906532cc),segment_id=7f482fc6-4887-4d69-a152-097f906532cc)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:21:04.072910 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-b861fd4b-8ecd-4edb-ac60-fee5eed209b5 None None] Set router 3e2008fd-6aec-4b2e-b56a-0934358f106c gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:21:04.141718 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a5b0e354-78ca-44dd-a498-9dd33b60dd17 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:04.220566 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5b0e354-78ca-44dd-a498-9dd33b60dd17 None None] Pushing event updated for resources: {'Port': ['ID=44abee79-6c5a-49a1-87de-99d8924ce05e,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:21:04.275642 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-b861fd4b-8ecd-4edb-ac60-fee5eed209b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'name': 'tempest-TestSnapshotPattern-1474624592-router', 'tenant_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.119'}], 'enable_snat': True}, 'gw_port_id': '89781986-0dc0-4c2f-b390-c38c5e41723e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:21:02Z', 'updated_at': '2021-11-09T05:21:03Z', 'revision_number': 3, 'project_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'gw_port': {'id': '89781986-0dc0-4c2f-b390-c38c5e41723e', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:b5:3c:d4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1856, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.119', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:21:02Z', 'updated_at': '2021-11-09T05:21:02Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:21:04.304762 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b861fd4b-8ecd-4edb-ac60-fee5eed209b5 None None] Checking router: 3e2008fd-6aec-4b2e-b56a-0934358f106c for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 05:21:04.305106 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b861fd4b-8ecd-4edb-ac60-fee5eed209b5 None None] Updating router 3e2008fd-6aec-4b2e-b56a-0934358f106c port 89781986-0dc0-4c2f-b390-c38c5e41723e binding host dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 05:21:04.329428 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-b861fd4b-8ecd-4edb-ac60-fee5eed209b5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:04.363472 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-68b5fac6-4be6-4e06-a6c0-b47fd28f0f58 None None] Provisioning complete for port 44abee79-6c5a-49a1-87de-99d8924ce05e triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:21:04.363913 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-68b5fac6-4be6-4e06-a6c0-b47fd28f0f58 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:04.467177 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dec605ed-9d17-4c0c-a02e-e79e1c5f620f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:04.589260 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-b861fd4b-8ecd-4edb-ac60-fee5eed209b5 None None] Publish callbacks [] for port, precommit_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:04.651727 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-b861fd4b-8ecd-4edb-ac60-fee5eed209b5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:04.703414 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-b861fd4b-8ecd-4edb-ac60-fee5eed209b5 None None] Attempting to bind port 89781986-0dc0-4c2f-b390-c38c5e41723e on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 05:21:04.703780 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-b861fd4b-8ecd-4edb-ac60-fee5eed209b5 None None] Attempting to bind port 89781986-0dc0-4c2f-b390-c38c5e41723e by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 05:21:04.704145 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b861fd4b-8ecd-4edb-ac60-fee5eed209b5 None None] Attempting to bind port 89781986-0dc0-4c2f-b390-c38c5e41723e on network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 05:21:04.713252 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d640dcc2-5f25-4b2b-a1bd-216a4914e0ea None None] Pushing event updated for resources: {'Port': ['ID=89781986-0dc0-4c2f-b390-c38c5e41723e,revision_number=2']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:21:04.715591 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b861fd4b-8ecd-4edb-ac60-fee5eed209b5 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 5, 20, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 05:21:04.715853 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b861fd4b-8ecd-4edb-ac60-fee5eed209b5 None None] Checking segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102164) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 05:21:04.716248 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-b861fd4b-8ecd-4edb-ac60-fee5eed209b5 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:04.716634 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b861fd4b-8ecd-4edb-ac60-fee5eed209b5 None None] Bound using segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 05:21:04.717102 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-b861fd4b-8ecd-4edb-ac60-fee5eed209b5 None None] Bound port: 89781986-0dc0-4c2f-b390-c38c5e41723e, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 05:21:04.717480 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-b861fd4b-8ecd-4edb-ac60-fee5eed209b5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:04.725254 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d640dcc2-5f25-4b2b-a1bd-216a4914e0ea None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:21:04.725402 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d640dcc2-5f25-4b2b-a1bd-216a4914e0ea None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:21:04.725616 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d640dcc2-5f25-4b2b-a1bd-216a4914e0ea None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:21:04.725949 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d640dcc2-5f25-4b2b-a1bd-216a4914e0ea None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:21:04.726279 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d640dcc2-5f25-4b2b-a1bd-216a4914e0ea None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:21:04.726638 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d640dcc2-5f25-4b2b-a1bd-216a4914e0ea None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:21:04.726963 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d640dcc2-5f25-4b2b-a1bd-216a4914e0ea None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:21:04.727290 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d640dcc2-5f25-4b2b-a1bd-216a4914e0ea None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:21:04.727608 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d640dcc2-5f25-4b2b-a1bd-216a4914e0ea None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:21:04.727925 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d640dcc2-5f25-4b2b-a1bd-216a4914e0ea None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:21:04.728245 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d640dcc2-5f25-4b2b-a1bd-216a4914e0ea None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:21:04.728562 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d640dcc2-5f25-4b2b-a1bd-216a4914e0ea None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102164) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:21:04.787189 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-b861fd4b-8ecd-4edb-ac60-fee5eed209b5 None None] For port 89781986-0dc0-4c2f-b390-c38c5e41723e, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102164) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 05:21:04.790598 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-b861fd4b-8ecd-4edb-ac60-fee5eed209b5 None None] For port 89781986-0dc0-4c2f-b390-c38c5e41723e, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=89781986-0dc0-4c2f-b390-c38c5e41723e,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102164) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 05:21:04.816215 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 44abee79-6c5a-49a1-87de-99d8924ce05e up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:21:04.863377 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 44abee79-6c5a-49a1-87de-99d8924ce05e triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:21:04.863644 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:04.875244 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-b861fd4b-8ecd-4edb-ac60-fee5eed209b5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:04.912116 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-dec605ed-9d17-4c0c-a02e-e79e1c5f620f admin admin] Allocated IP 172.20.0.1 (8b3ee119-8ca9-4512-a0b7-4947c2eb41ed/85aac8f0-cd4e-40f0-b238-bfb36190a9ad/a562afa6-7652-4f76-8b5c-24feacfbb57c) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 05:21:04.944387 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b861fd4b-8ecd-4edb-ac60-fee5eed209b5 None None] Routers {'3e2008fd-6aec-4b2e-b56a-0934358f106c'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:21:04.946300 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-b861fd4b-8ecd-4edb-ac60-fee5eed209b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:20:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['3e2008fd-6aec-4b2e-b56a-0934358f106c'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:21:04.949576 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d640dcc2-5f25-4b2b-a1bd-216a4914e0ea None None] Pushing event updated for resources: {'Port': ['ID=89781986-0dc0-4c2f-b390-c38c5e41723e,revision_number=3']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:21:05.022993 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dec605ed-9d17-4c0c-a02e-e79e1c5f620f admin admin] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:05.053929 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-b861fd4b-8ecd-4edb-ac60-fee5eed209b5 None None] Set router 3e2008fd-6aec-4b2e-b56a-0934358f106c gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:21:05.109288 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dec605ed-9d17-4c0c-a02e-e79e1c5f620f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:05.149577 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dec605ed-9d17-4c0c-a02e-e79e1c5f620f admin admin] Network 8b3ee119-8ca9-4512-a0b7-4947c2eb41ed is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:21:05.154785 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-dec605ed-9d17-4c0c-a02e-e79e1c5f620f admin admin] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:21:05.159051 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dec605ed-9d17-4c0c-a02e-e79e1c5f620f admin admin] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 05:21:05.184214 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dec605ed-9d17-4c0c-a02e-e79e1c5f620f admin admin] Pushing event updated for resources: {'Port': ['ID=a562afa6-7652-4f76-8b5c-24feacfbb57c,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:21:05.207004 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dec605ed-9d17-4c0c-a02e-e79e1c5f620f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:05.333484 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-b861fd4b-8ecd-4edb-ac60-fee5eed209b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'name': 'tempest-TestSnapshotPattern-1474624592-router', 'tenant_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.119'}], 'enable_snat': True}, 'gw_port_id': '89781986-0dc0-4c2f-b390-c38c5e41723e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:21:02Z', 'updated_at': '2021-11-09T05:21:03Z', 'revision_number': 3, 'project_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'gw_port': {'id': '89781986-0dc0-4c2f-b390-c38c5e41723e', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:b5:3c:d4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1856, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.119', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:21:02Z', 'updated_at': '2021-11-09T05:21:04Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:21:05.364779 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b861fd4b-8ecd-4edb-ac60-fee5eed209b5 None None] The sync data for ids ['3e2008fd-6aec-4b2e-b56a-0934358f106c'] in dv-neutron-816802-2-hyperv is: [{'id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'name': 'tempest-TestSnapshotPattern-1474624592-router', 'tenant_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.119'}], 'enable_snat': True}, 'gw_port_id': '89781986-0dc0-4c2f-b390-c38c5e41723e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:21:02Z', 'updated_at': '2021-11-09T05:21:03Z', 'revision_number': 3, 'project_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'gw_port': {'id': '89781986-0dc0-4c2f-b390-c38c5e41723e', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:b5:3c:d4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1856, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.119', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:21:02Z', 'updated_at': '2021-11-09T05:21:04Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 05:21:05.377585 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-b90f61db-bf9b-40fe-a67f-0f51a00d9de6 None None] Provisioning complete for port a562afa6-7652-4f76-8b5c-24feacfbb57c triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:21:05.377585 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b90f61db-bf9b-40fe-a67f-0f51a00d9de6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:05.408617 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-b90f61db-bf9b-40fe-a67f-0f51a00d9de6 None None] Port a562afa6-7652-4f76-8b5c-24feacfbb57c cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 05:21:05.424306 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dec605ed-9d17-4c0c-a02e-e79e1c5f620f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:05.605389 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dec605ed-9d17-4c0c-a02e-e79e1c5f620f admin admin] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:05.667281 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dec605ed-9d17-4c0c-a02e-e79e1c5f620f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:05.739067 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dec605ed-9d17-4c0c-a02e-e79e1c5f620f admin admin] Pushing event updated for resources: {'Port': ['ID=a562afa6-7652-4f76-8b5c-24feacfbb57c,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:21:05.742805 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dec605ed-9d17-4c0c-a02e-e79e1c5f620f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:05.837952 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dec605ed-9d17-4c0c-a02e-e79e1c5f620f admin admin] Network 8b3ee119-8ca9-4512-a0b7-4947c2eb41ed is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:21:05.839416 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-dec605ed-9d17-4c0c-a02e-e79e1c5f620f admin admin] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:21:05.969064 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dec605ed-9d17-4c0c-a02e-e79e1c5f620f admin admin] Router 3e2008fd-6aec-4b2e-b56a-0934358f106c has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 05:21:06.086978 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dec605ed-9d17-4c0c-a02e-e79e1c5f620f admin admin] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 05:21:06.099315 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-dec605ed-9d17-4c0c-a02e-e79e1c5f620f admin admin] 10.222.0.24 "PUT /v2.0/routers/3e2008fd-6aec-4b2e-b56a-0934358f106c/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.0717309 Nov 09 05:21:06.137987 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-edbaa878-299e-4d7f-8ff1-3e66787da34e None None] Provisioning complete for port a562afa6-7652-4f76-8b5c-24feacfbb57c triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:21:06.138540 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-edbaa878-299e-4d7f-8ff1-3e66787da34e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:06.177407 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-edbaa878-299e-4d7f-8ff1-3e66787da34e None None] Port a562afa6-7652-4f76-8b5c-24feacfbb57c cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 05:21:06.790054 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 89781986-0dc0-4c2f-b390-c38c5e41723e up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:21:06.825229 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 38716) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:21:06.831007 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-cd15c89c-5fc5-43ea-8f08-dffc125ddc80 admin admin] Request body: {'network': {'name': 'tempest-TestSnapshotPattern-906856928-network', 'tenant_id': 'dfd9fcae13714ba6890b7200ad6fcd05'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:21:06.844738 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 89781986-0dc0-4c2f-b390-c38c5e41723e triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:21:06.845208 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:06.924215 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-da1a2986-72b1-42f1-81ec-4a936014ea6b None None] Sync routers for ids ['3e2008fd-6aec-4b2e-b56a-0934358f106c'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 05:21:06.932738 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:06.942947 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cd15c89c-5fc5-43ea-8f08-dffc125ddc80 admin admin] Made reservation on behalf of dfd9fcae13714ba6890b7200ad6fcd05 for: {'network': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 05:21:06.946336 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cd15c89c-5fc5-43ea-8f08-dffc125ddc80 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for network, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:06.950664 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-da1a2986-72b1-42f1-81ec-4a936014ea6b None None] Routers {'3e2008fd-6aec-4b2e-b56a-0934358f106c'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:21:06.952964 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-da1a2986-72b1-42f1-81ec-4a936014ea6b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:20:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['3e2008fd-6aec-4b2e-b56a-0934358f106c'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:21:06.956997 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cd15c89c-5fc5-43ea-8f08-dffc125ddc80 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:06.992451 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 89781986-0dc0-4c2f-b390-c38c5e41723e, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=89781986-0dc0-4c2f-b390-c38c5e41723e,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:21:07.030084 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cd15c89c-5fc5-43ea-8f08-dffc125ddc80 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:07.060656 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:07.067770 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-da1a2986-72b1-42f1-81ec-4a936014ea6b None None] Set router 3e2008fd-6aec-4b2e-b56a-0934358f106c gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:21:07.114407 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cd15c89c-5fc5-43ea-8f08-dffc125ddc80 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:07.136155 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-cd15c89c-5fc5-43ea-8f08-dffc125ddc80 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 312} {{(pid=102161) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 09 05:21:07.152119 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd15c89c-5fc5-43ea-8f08-dffc125ddc80 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f5a81250-6fa5-4cdf-b2c6-7ba33941c580,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:21:07.156460 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cd15c89c-5fc5-43ea-8f08-dffc125ddc80 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:07.156809 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.segments_db [None req-cd15c89c-5fc5-43ea-8f08-dffc125ddc80 admin admin] Added segment a0230152-da2c-465a-8813-0aca466a0111 of type vlan for network 42d49c70-f883-4a2a-a399-48a4cfc7efee Nov 09 05:21:07.188798 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=89781986-0dc0-4c2f-b390-c38c5e41723e,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:21:07.201416 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cd15c89c-5fc5-43ea-8f08-dffc125ddc80 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8756746775534'] for network, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:07.297291 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cd15c89c-5fc5-43ea-8f08-dffc125ddc80 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183'] for network, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:07.298444 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cd15c89c-5fc5-43ea-8f08-dffc125ddc80 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:21:07.298969 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-cd15c89c-5fc5-43ea-8f08-dffc125ddc80 admin admin] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:07.301267 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-da1a2986-72b1-42f1-81ec-4a936014ea6b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'name': 'tempest-TestSnapshotPattern-1474624592-router', 'tenant_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.119'}], 'enable_snat': True}, 'gw_port_id': '89781986-0dc0-4c2f-b390-c38c5e41723e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:21:02Z', 'updated_at': '2021-11-09T05:21:05Z', 'revision_number': 4, 'project_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'gw_port': {'id': '89781986-0dc0-4c2f-b390-c38c5e41723e', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:b5:3c:d4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1856, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.119', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:21:02Z', 'updated_at': '2021-11-09T05:21:04Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'a562afa6-7652-4f76-8b5c-24feacfbb57c', 'name': '', 'network_id': '8b3ee119-8ca9-4512-a0b7-4947c2eb41ed', 'tenant_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'mac_address': 'fa:16:3e:61:c7:f8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1857, 'fixed_ips': [{'subnet_id': '85aac8f0-cd4e-40f0-b238-bfb36190a9ad', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:21:04Z', 'updated_at': '2021-11-09T05:21:05Z', 'revision_number': 2, 'project_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'subnets': [{'id': '85aac8f0-cd4e-40f0-b238-bfb36190a9ad', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:21:07.358866 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd15c89c-5fc5-43ea-8f08-dffc125ddc80 admin admin] Pushing event updated for resources: {'Network': ['ID=42d49c70-f883-4a2a-a399-48a4cfc7efee,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:21:07.397420 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-cd15c89c-5fc5-43ea-8f08-dffc125ddc80 admin admin] 10.222.0.24 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.5709600 Nov 09 05:21:07.400301 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 38718) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:21:07.405424 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-59b5e189-31a7-46ee-8f83-a1751d75eed5 admin admin] Request body: {'subnet': {'network_id': '42d49c70-f883-4a2a-a399-48a4cfc7efee', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestSnapshotPattern-906856928-subnet', 'tenant_id': 'dfd9fcae13714ba6890b7200ad6fcd05', 'ip_version': 4}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:21:07.475705 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Network 42d49c70-f883-4a2a-a399-48a4cfc7efee details requested by agent ovs-agent-dv-neutron-816802-2-hyperv with host dv-neutron-816802-2-hyperv {{(pid=102163) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 09 05:21:07.477931 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-da1a2986-72b1-42f1-81ec-4a936014ea6b None None] Checking router: 3e2008fd-6aec-4b2e-b56a-0934358f106c for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 05:21:07.478275 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-da1a2986-72b1-42f1-81ec-4a936014ea6b None None] Updating router 3e2008fd-6aec-4b2e-b56a-0934358f106c port a562afa6-7652-4f76-8b5c-24feacfbb57c binding host dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 05:21:07.503544 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-59b5e189-31a7-46ee-8f83-a1751d75eed5 admin admin] Made reservation on behalf of dfd9fcae13714ba6890b7200ad6fcd05 for: {'subnet': 1} {{(pid=102161) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 05:21:07.506082 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-59b5e189-31a7-46ee-8f83-a1751d75eed5 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5785465'] for subnet, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:07.544357 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-da1a2986-72b1-42f1-81ec-4a936014ea6b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:07.754763 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-59b5e189-31a7-46ee-8f83-a1751d75eed5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6995432', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5785219'] for subnet, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:07.812113 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59b5e189-31a7-46ee-8f83-a1751d75eed5 admin admin] Pushing event updated for resources: {'Subnet': ['ID=ab0ba536-f04d-40cc-ab2c-cccc21052c2c,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:21:07.822963 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59b5e189-31a7-46ee-8f83-a1751d75eed5 admin admin] Checking segment: {'id': 'a0230152-da2c-465a-8813-0aca466a0111', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 312, 'network_id': '42d49c70-f883-4a2a-a399-48a4cfc7efee'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102161) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 05:21:07.823319 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-59b5e189-31a7-46ee-8f83-a1751d75eed5 admin admin] Network hostable DHCP agents. Network: 42d49c70-f883-4a2a-a399-48a4cfc7efee, hostable agents: ['cb24b282-9b2c-4486-bad1-b98e0db75839'], hosted agents: [] {{(pid=102161) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 09 05:21:07.826637 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-da1a2986-72b1-42f1-81ec-4a936014ea6b None None] Publish callbacks [] for port, precommit_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:07.915115 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-da1a2986-72b1-42f1-81ec-4a936014ea6b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:07.937719 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-59b5e189-31a7-46ee-8f83-a1751d75eed5 admin admin] Network 42d49c70-f883-4a2a-a399-48a4cfc7efee is scheduled to be hosted by DHCP agent cb24b282-9b2c-4486-bad1-b98e0db75839 with binding_index 1 {{(pid=102161) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 09 05:21:07.964742 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c25d0954-2b0b-49b0-90f7-7219cc1e69ac None None] Pushing event updated for resources: {'Port': ['ID=a562afa6-7652-4f76-8b5c-24feacfbb57c,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:21:08.017391 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-da1a2986-72b1-42f1-81ec-4a936014ea6b None None] Attempting to bind port a562afa6-7652-4f76-8b5c-24feacfbb57c on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 05:21:08.017762 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-da1a2986-72b1-42f1-81ec-4a936014ea6b None None] Attempting to bind port a562afa6-7652-4f76-8b5c-24feacfbb57c by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': '7f482fc6-4887-4d69-a152-097f906532cc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '8b3ee119-8ca9-4512-a0b7-4947c2eb41ed'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 05:21:08.018126 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-da1a2986-72b1-42f1-81ec-4a936014ea6b None None] Attempting to bind port a562afa6-7652-4f76-8b5c-24feacfbb57c on network 8b3ee119-8ca9-4512-a0b7-4947c2eb41ed {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 05:21:08.023682 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-da1a2986-72b1-42f1-81ec-4a936014ea6b None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 5, 20, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 05:21:08.024055 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-da1a2986-72b1-42f1-81ec-4a936014ea6b None None] Checking segment: {'id': '7f482fc6-4887-4d69-a152-097f906532cc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '8b3ee119-8ca9-4512-a0b7-4947c2eb41ed'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 05:21:08.024451 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-da1a2986-72b1-42f1-81ec-4a936014ea6b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:08.024837 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-da1a2986-72b1-42f1-81ec-4a936014ea6b None None] Bound using segment: {'id': '7f482fc6-4887-4d69-a152-097f906532cc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '8b3ee119-8ca9-4512-a0b7-4947c2eb41ed'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 05:21:08.025298 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-da1a2986-72b1-42f1-81ec-4a936014ea6b None None] Bound port: a562afa6-7652-4f76-8b5c-24feacfbb57c, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7f482fc6-4887-4d69-a152-097f906532cc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '8b3ee119-8ca9-4512-a0b7-4947c2eb41ed'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 05:21:08.025674 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-da1a2986-72b1-42f1-81ec-4a936014ea6b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:08.027472 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-59b5e189-31a7-46ee-8f83-a1751d75eed5 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816802-2-hyperv, 42d49c70-f883-4a2a-a399-48a4cfc7efee) {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:21:08.034131 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-59b5e189-31a7-46ee-8f83-a1751d75eed5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:21:08.037761 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-59b5e189-31a7-46ee-8f83-a1751d75eed5 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:08.060126 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-adb64920-bb97-4ada-8413-65ab2e59ddf8 None None] Network 42d49c70-f883-4a2a-a399-48a4cfc7efee requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 05:21:08.121254 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-59b5e189-31a7-46ee-8f83-a1751d75eed5 admin admin] 10.222.0.24 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.7198770 Nov 09 05:21:08.123776 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 38720) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:21:08.128256 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-f89fbae7-6e33-4ba9-839a-75e3cafc03f4 admin admin] Request body: {'router': {'name': 'tempest-TestSnapshotPattern-906856928-router', 'tenant_id': 'dfd9fcae13714ba6890b7200ad6fcd05', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:21:08.143037 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-da1a2986-72b1-42f1-81ec-4a936014ea6b None None] For port a562afa6-7652-4f76-8b5c-24feacfbb57c, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 05:21:08.147124 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-da1a2986-72b1-42f1-81ec-4a936014ea6b None None] For port a562afa6-7652-4f76-8b5c-24feacfbb57c, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=a562afa6-7652-4f76-8b5c-24feacfbb57c,segment=NetworkSegment(7f482fc6-4887-4d69-a152-097f906532cc),segment_id=7f482fc6-4887-4d69-a152-097f906532cc)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 05:21:08.221896 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f89fbae7-6e33-4ba9-839a-75e3cafc03f4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-464141', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30537'] for router, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:08.223067 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f89fbae7-6e33-4ba9-839a-75e3cafc03f4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-464313', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-466228', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-509071', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30530'] for router, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:08.230562 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-1e34dca1-62df-4a72-b4b6-2c24e05a5aad None None] Provisioning complete for port a562afa6-7652-4f76-8b5c-24feacfbb57c triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:21:08.231110 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1e34dca1-62df-4a72-b4b6-2c24e05a5aad None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:08.233855 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-da1a2986-72b1-42f1-81ec-4a936014ea6b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:08.254345 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b91e1109-5d51-4e35-a191-94c326eae54a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp72272a6d-a70c-519e-8140-f46bbcc3e62b-42d49c70-f883-4a2a-a399-48a4cfc7efee', 'network_id': '42d49c70-f883-4a2a-a399-48a4cfc7efee', 'tenant_id': 'dfd9fcae13714ba6890b7200ad6fcd05', 'fixed_ips': [{'subnet_id': 'ab0ba536-f04d-40cc-ab2c-cccc21052c2c'}]}} from dv-neutron-816802-2-hyperv. {{(pid=102163) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 09 05:21:08.255181 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b91e1109-5d51-4e35-a191-94c326eae54a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:08.281862 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f89fbae7-6e33-4ba9-839a-75e3cafc03f4 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:08.392765 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c25d0954-2b0b-49b0-90f7-7219cc1e69ac None None] Pushing event updated for resources: {'Port': ['ID=a562afa6-7652-4f76-8b5c-24feacfbb57c,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:21:08.402016 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-da1a2986-72b1-42f1-81ec-4a936014ea6b None None] Routers {'3e2008fd-6aec-4b2e-b56a-0934358f106c'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:21:08.402588 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-da1a2986-72b1-42f1-81ec-4a936014ea6b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:20:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['3e2008fd-6aec-4b2e-b56a-0934358f106c'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:21:08.483822 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f89fbae7-6e33-4ba9-839a-75e3cafc03f4 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:08.557104 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1e34dca1-62df-4a72-b4b6-2c24e05a5aad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:08.577992 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.db_base_plugin_common [None req-b91e1109-5d51-4e35-a191-94c326eae54a None None] Allocated IP 172.20.0.2 (42d49c70-f883-4a2a-a399-48a4cfc7efee/ab0ba536-f04d-40cc-ab2c-cccc21052c2c/9a2f7a79-d1b4-4f1d-81ef-5447d7909fa9) {{(pid=102163) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 05:21:08.624931 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-da1a2986-72b1-42f1-81ec-4a936014ea6b None None] Set router 3e2008fd-6aec-4b2e-b56a-0934358f106c gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:21:08.663310 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-1e34dca1-62df-4a72-b4b6-2c24e05a5aad None None] For port a562afa6-7652-4f76-8b5c-24feacfbb57c, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=a562afa6-7652-4f76-8b5c-24feacfbb57c,segment=NetworkSegment(7f482fc6-4887-4d69-a152-097f906532cc),segment_id=7f482fc6-4887-4d69-a152-097f906532cc)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:21:08.750284 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f89fbae7-6e33-4ba9-839a-75e3cafc03f4 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:08.759537 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1e34dca1-62df-4a72-b4b6-2c24e05a5aad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:08.770722 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f89fbae7-6e33-4ba9-839a-75e3cafc03f4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:08.822546 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 89781986-0dc0-4c2f-b390-c38c5e41723e up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:21:08.880067 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-f89fbae7-6e33-4ba9-839a-75e3cafc03f4 admin admin] Allocated IP 172.26.0.250 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/3071901a-ccad-4330-bda7-47a2ecb73a37) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 05:21:08.973699 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e34dca1-62df-4a72-b4b6-2c24e05a5aad None None] Pushing event updated for resources: {'Port': ['ID=a562afa6-7652-4f76-8b5c-24feacfbb57c,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:21:08.984280 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b91e1109-5d51-4e35-a191-94c326eae54a None None] Publish callbacks [] for port, precommit_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:08.989996 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f89fbae7-6e33-4ba9-839a-75e3cafc03f4 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:08.990505 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-af1245f6-1e15-4204-b20c-604e89aa1920 None None] Provisioning complete for port a562afa6-7652-4f76-8b5c-24feacfbb57c triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:21:08.990505 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-af1245f6-1e15-4204-b20c-604e89aa1920 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:09.045113 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 89781986-0dc0-4c2f-b390-c38c5e41723e triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:21:09.045477 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:09.093365 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b91e1109-5d51-4e35-a191-94c326eae54a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684'] for port, after_create {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:09.115240 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f89fbae7-6e33-4ba9-839a-75e3cafc03f4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:09.154313 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f89fbae7-6e33-4ba9-839a-75e3cafc03f4 admin admin] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:21:09.157414 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-f89fbae7-6e33-4ba9-839a-75e3cafc03f4 admin admin] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:21:09.163464 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f89fbae7-6e33-4ba9-839a-75e3cafc03f4 admin admin] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 05:21:09.188805 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f89fbae7-6e33-4ba9-839a-75e3cafc03f4 admin admin] Pushing event updated for resources: {'Port': ['ID=3071901a-ccad-4330-bda7-47a2ecb73a37,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:21:09.318937 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b91e1109-5d51-4e35-a191-94c326eae54a None None] Network 42d49c70-f883-4a2a-a399-48a4cfc7efee is already hosted by enough agents. {{(pid=102163) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:21:09.331082 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.scheduler.base_scheduler [None req-b91e1109-5d51-4e35-a191-94c326eae54a None None] Resources bound (agent type, host, resource id): {{(pid=102163) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:21:09.335547 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b91e1109-5d51-4e35-a191-94c326eae54a None None] Received port after_create {{(pid=102163) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 05:21:09.338795 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b91e1109-5d51-4e35-a191-94c326eae54a None None] Pushing event updated for resources: {'Port': ['ID=9a2f7a79-d1b4-4f1d-81ef-5447d7909fa9,revision_number=1']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:21:09.343097 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-da1a2986-72b1-42f1-81ec-4a936014ea6b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'name': 'tempest-TestSnapshotPattern-1474624592-router', 'tenant_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.119'}], 'enable_snat': True}, 'gw_port_id': '89781986-0dc0-4c2f-b390-c38c5e41723e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:21:02Z', 'updated_at': '2021-11-09T05:21:05Z', 'revision_number': 4, 'project_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'gw_port': {'id': '89781986-0dc0-4c2f-b390-c38c5e41723e', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:b5:3c:d4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1856, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.119', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:21:02Z', 'updated_at': '2021-11-09T05:21:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'a562afa6-7652-4f76-8b5c-24feacfbb57c', 'name': '', 'network_id': '8b3ee119-8ca9-4512-a0b7-4947c2eb41ed', 'tenant_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'mac_address': 'fa:16:3e:61:c7:f8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1857, 'fixed_ips': [{'subnet_id': '85aac8f0-cd4e-40f0-b238-bfb36190a9ad', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:21:04Z', 'updated_at': '2021-11-09T05:21:08Z', 'revision_number': 4, 'project_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'subnets': [{'id': '85aac8f0-cd4e-40f0-b238-bfb36190a9ad', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:21:09.404718 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-da1a2986-72b1-42f1-81ec-4a936014ea6b None None] The sync data for ids ['3e2008fd-6aec-4b2e-b56a-0934358f106c'] in dv-neutron-816802-2-hyperv is: [{'id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'name': 'tempest-TestSnapshotPattern-1474624592-router', 'tenant_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.119'}], 'enable_snat': True}, 'gw_port_id': '89781986-0dc0-4c2f-b390-c38c5e41723e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:21:02Z', 'updated_at': '2021-11-09T05:21:05Z', 'revision_number': 4, 'project_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'gw_port': {'id': '89781986-0dc0-4c2f-b390-c38c5e41723e', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:b5:3c:d4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1856, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.119', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:21:02Z', 'updated_at': '2021-11-09T05:21:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'a562afa6-7652-4f76-8b5c-24feacfbb57c', 'name': '', 'network_id': '8b3ee119-8ca9-4512-a0b7-4947c2eb41ed', 'tenant_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'mac_address': 'fa:16:3e:61:c7:f8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1857, 'fixed_ips': [{'subnet_id': '85aac8f0-cd4e-40f0-b238-bfb36190a9ad', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:21:04Z', 'updated_at': '2021-11-09T05:21:08Z', 'revision_number': 4, 'project_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'subnets': [{'id': '85aac8f0-cd4e-40f0-b238-bfb36190a9ad', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 05:21:09.460226 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-b91e1109-5d51-4e35-a191-94c326eae54a None None] Attempting to bind port 9a2f7a79-d1b4-4f1d-81ef-5447d7909fa9 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 05:21:09.460226 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-b91e1109-5d51-4e35-a191-94c326eae54a None None] Attempting to bind port 9a2f7a79-d1b4-4f1d-81ef-5447d7909fa9 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'a0230152-da2c-465a-8813-0aca466a0111', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 312, 'network_id': '42d49c70-f883-4a2a-a399-48a4cfc7efee'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 05:21:09.460226 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b91e1109-5d51-4e35-a191-94c326eae54a None None] Attempting to bind port 9a2f7a79-d1b4-4f1d-81ef-5447d7909fa9 on network 42d49c70-f883-4a2a-a399-48a4cfc7efee {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 05:21:09.464557 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b91e1109-5d51-4e35-a191-94c326eae54a None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 5, 20, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 05:21:09.465057 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b91e1109-5d51-4e35-a191-94c326eae54a None None] Checking segment: {'id': 'a0230152-da2c-465a-8813-0aca466a0111', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 312, 'network_id': '42d49c70-f883-4a2a-a399-48a4cfc7efee'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 05:21:09.465553 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b91e1109-5d51-4e35-a191-94c326eae54a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:09.466000 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b91e1109-5d51-4e35-a191-94c326eae54a None None] Bound using segment: {'id': 'a0230152-da2c-465a-8813-0aca466a0111', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 312, 'network_id': '42d49c70-f883-4a2a-a399-48a4cfc7efee'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 05:21:09.466563 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-b91e1109-5d51-4e35-a191-94c326eae54a None None] Bound port: 9a2f7a79-d1b4-4f1d-81ef-5447d7909fa9, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a0230152-da2c-465a-8813-0aca466a0111', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 312, 'network_id': '42d49c70-f883-4a2a-a399-48a4cfc7efee'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 05:21:09.466941 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b91e1109-5d51-4e35-a191-94c326eae54a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:09.542469 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f89fbae7-6e33-4ba9-839a-75e3cafc03f4 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:09.554484 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-b91e1109-5d51-4e35-a191-94c326eae54a None None] For port 9a2f7a79-d1b4-4f1d-81ef-5447d7909fa9, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 05:21:09.557724 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-b91e1109-5d51-4e35-a191-94c326eae54a None None] For port 9a2f7a79-d1b4-4f1d-81ef-5447d7909fa9, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=9a2f7a79-d1b4-4f1d-81ef-5447d7909fa9,segment=NetworkSegment(a0230152-da2c-465a-8813-0aca466a0111),segment_id=a0230152-da2c-465a-8813-0aca466a0111)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 05:21:09.652636 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b91e1109-5d51-4e35-a191-94c326eae54a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:09.717352 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b91e1109-5d51-4e35-a191-94c326eae54a None None] Pushing event updated for resources: {'Port': ['ID=9a2f7a79-d1b4-4f1d-81ef-5447d7909fa9,revision_number=2']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:21:09.761646 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f89fbae7-6e33-4ba9-839a-75e3cafc03f4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-464310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-466401'] for router, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:10.012154 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f89fbae7-6e33-4ba9-839a-75e3cafc03f4 admin admin] Router 82f0930c-c769-4ad1-aced-bf5daba02c47 is scheduled to L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b with binding_index 1 {{(pid=102161) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 09 05:21:10.123894 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f89fbae7-6e33-4ba9-839a-75e3cafc03f4 admin admin] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 05:21:10.133723 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ffed4c02-d8be-428d-9908-48cc1cc72129 None None] Sync routers for ids ['82f0930c-c769-4ad1-aced-bf5daba02c47'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 05:21:10.144881 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ffed4c02-d8be-428d-9908-48cc1cc72129 None None] Routers {'82f0930c-c769-4ad1-aced-bf5daba02c47'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:21:10.150083 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-ffed4c02-d8be-428d-9908-48cc1cc72129 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:20:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['82f0930c-c769-4ad1-aced-bf5daba02c47'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:21:10.234820 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f89fbae7-6e33-4ba9-839a-75e3cafc03f4 admin admin] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:10.236354 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-f89fbae7-6e33-4ba9-839a-75e3cafc03f4 admin admin] 10.222.0.24 "POST /v2.0/routers HTTP/1.1" status: 201 len: 921 time: 2.1112068 Nov 09 05:21:10.239006 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 38722) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:21:10.254789 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-ffed4c02-d8be-428d-9908-48cc1cc72129 None None] Set router 82f0930c-c769-4ad1-aced-bf5daba02c47 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:21:10.450191 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-ffed4c02-d8be-428d-9908-48cc1cc72129 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '82f0930c-c769-4ad1-aced-bf5daba02c47', 'name': 'tempest-TestSnapshotPattern-906856928-router', 'tenant_id': 'dfd9fcae13714ba6890b7200ad6fcd05', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.250'}], 'enable_snat': True}, 'gw_port_id': '3071901a-ccad-4330-bda7-47a2ecb73a37', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:21:08Z', 'updated_at': '2021-11-09T05:21:09Z', 'revision_number': 3, 'project_id': 'dfd9fcae13714ba6890b7200ad6fcd05', 'gw_port': {'id': '3071901a-ccad-4330-bda7-47a2ecb73a37', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:43:8d:d1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '82f0930c-c769-4ad1-aced-bf5daba02c47', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1868, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.250', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:21:08Z', 'updated_at': '2021-11-09T05:21:08Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:21:10.489314 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ffed4c02-d8be-428d-9908-48cc1cc72129 None None] Checking router: 82f0930c-c769-4ad1-aced-bf5daba02c47 for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 05:21:10.489805 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ffed4c02-d8be-428d-9908-48cc1cc72129 None None] Updating router 82f0930c-c769-4ad1-aced-bf5daba02c47 port 3071901a-ccad-4330-bda7-47a2ecb73a37 binding host dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 05:21:10.518818 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-ffed4c02-d8be-428d-9908-48cc1cc72129 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:10.719608 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-828da5a1-a170-4b77-928b-2193ff13eb96 None None] Network 42d49c70-f883-4a2a-a399-48a4cfc7efee requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 05:21:10.805111 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-ffed4c02-d8be-428d-9908-48cc1cc72129 None None] Publish callbacks [] for port, precommit_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:10.852584 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device a562afa6-7652-4f76-8b5c-24feacfbb57c up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:21:10.878637 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-ffed4c02-d8be-428d-9908-48cc1cc72129 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:10.908861 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-a373747d-5963-48fa-a081-79573dfd0d98 None None] Provisioning complete for port 9a2f7a79-d1b4-4f1d-81ef-5447d7909fa9 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:21:10.909148 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a373747d-5963-48fa-a081-79573dfd0d98 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:10.938917 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-ffed4c02-d8be-428d-9908-48cc1cc72129 None None] Attempting to bind port 3071901a-ccad-4330-bda7-47a2ecb73a37 on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 05:21:10.939608 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-ffed4c02-d8be-428d-9908-48cc1cc72129 None None] Attempting to bind port 3071901a-ccad-4330-bda7-47a2ecb73a37 by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 05:21:10.940321 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ffed4c02-d8be-428d-9908-48cc1cc72129 None None] Attempting to bind port 3071901a-ccad-4330-bda7-47a2ecb73a37 on network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 05:21:10.949825 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ffed4c02-d8be-428d-9908-48cc1cc72129 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 5, 20, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 05:21:10.950644 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ffed4c02-d8be-428d-9908-48cc1cc72129 None None] Checking segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102164) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 05:21:10.951106 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-ffed4c02-d8be-428d-9908-48cc1cc72129 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:10.951501 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ffed4c02-d8be-428d-9908-48cc1cc72129 None None] Bound using segment: {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'} {{(pid=102164) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 05:21:10.952141 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.managers [None req-ffed4c02-d8be-428d-9908-48cc1cc72129 None None] Bound port: 3071901a-ccad-4330-bda7-47a2ecb73a37, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b32354f7-483b-42dd-a7b6-93b8f64d6739', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5'}}] {{(pid=102164) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 05:21:10.952346 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-ffed4c02-d8be-428d-9908-48cc1cc72129 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:10.983883 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port a562afa6-7652-4f76-8b5c-24feacfbb57c triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:21:10.984249 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:10.995013 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18bf57aa-8bd7-43aa-95be-e3673eccce27 None None] Pushing event updated for resources: {'Port': ['ID=3071901a-ccad-4330-bda7-47a2ecb73a37,revision_number=2']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:21:11.012621 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-ffed4c02-d8be-428d-9908-48cc1cc72129 None None] For port 3071901a-ccad-4330-bda7-47a2ecb73a37, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102164) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 05:21:11.023180 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dbb078d3-ca8b-4051-b3cd-61f6e59b42df admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:11.024486 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.plugins.ml2.db [None req-ffed4c02-d8be-428d-9908-48cc1cc72129 None None] For port 3071901a-ccad-4330-bda7-47a2ecb73a37, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=3071901a-ccad-4330-bda7-47a2ecb73a37,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102164) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 05:21:11.069771 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a373747d-5963-48fa-a081-79573dfd0d98 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:11.109601 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron_lib.callbacks.manager [None req-ffed4c02-d8be-428d-9908-48cc1cc72129 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102164) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:11.141298 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-a373747d-5963-48fa-a081-79573dfd0d98 None None] For port 9a2f7a79-d1b4-4f1d-81ef-5447d7909fa9, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=9a2f7a79-d1b4-4f1d-81ef-5447d7909fa9,segment=NetworkSegment(a0230152-da2c-465a-8813-0aca466a0111),segment_id=a0230152-da2c-465a-8813-0aca466a0111)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:21:11.144678 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 9a2f7a79-d1b4-4f1d-81ef-5447d7909fa9 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:21:11.182408 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ffed4c02-d8be-428d-9908-48cc1cc72129 None None] Routers {'82f0930c-c769-4ad1-aced-bf5daba02c47'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:21:11.182408 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-ffed4c02-d8be-428d-9908-48cc1cc72129 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:20:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['82f0930c-c769-4ad1-aced-bf5daba02c47'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:21:11.202552 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a373747d-5963-48fa-a081-79573dfd0d98 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:11.204379 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 9a2f7a79-d1b4-4f1d-81ef-5447d7909fa9 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:21:11.205596 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:11.215469 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-dbb078d3-ca8b-4051-b3cd-61f6e59b42df admin admin] Allocated IP 172.20.0.1 (42d49c70-f883-4a2a-a399-48a4cfc7efee/ab0ba536-f04d-40cc-ab2c-cccc21052c2c/69db06ff-6e0c-420f-acd4-e6223477866d) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 05:21:11.256533 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18bf57aa-8bd7-43aa-95be-e3673eccce27 None None] Pushing event updated for resources: {'Port': ['ID=3071901a-ccad-4330-bda7-47a2ecb73a37,revision_number=3']} {{(pid=102164) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:21:11.301557 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a373747d-5963-48fa-a081-79573dfd0d98 None None] Pushing event updated for resources: {'Port': ['ID=9a2f7a79-d1b4-4f1d-81ef-5447d7909fa9,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:21:11.325792 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-ffed4c02-d8be-428d-9908-48cc1cc72129 None None] Set router 82f0930c-c769-4ad1-aced-bf5daba02c47 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:21:11.353949 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dbb078d3-ca8b-4051-b3cd-61f6e59b42df admin admin] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:11.365933 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-66361cd3-b834-476d-a36b-3c83b9be6082 None None] Provisioning complete for port 9a2f7a79-d1b4-4f1d-81ef-5447d7909fa9 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:21:11.365933 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-66361cd3-b834-476d-a36b-3c83b9be6082 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:11.407233 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d3a6d2cc-bc85-4fda-b5fa-df70963f73a2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:11.448059 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dbb078d3-ca8b-4051-b3cd-61f6e59b42df admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:11.489259 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dbb078d3-ca8b-4051-b3cd-61f6e59b42df admin admin] Network 42d49c70-f883-4a2a-a399-48a4cfc7efee is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:21:11.493988 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-dbb078d3-ca8b-4051-b3cd-61f6e59b42df admin admin] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:21:11.497733 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dbb078d3-ca8b-4051-b3cd-61f6e59b42df admin admin] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 05:21:11.508752 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-ffed4c02-d8be-428d-9908-48cc1cc72129 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '82f0930c-c769-4ad1-aced-bf5daba02c47', 'name': 'tempest-TestSnapshotPattern-906856928-router', 'tenant_id': 'dfd9fcae13714ba6890b7200ad6fcd05', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.250'}], 'enable_snat': True}, 'gw_port_id': '3071901a-ccad-4330-bda7-47a2ecb73a37', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:21:08Z', 'updated_at': '2021-11-09T05:21:09Z', 'revision_number': 3, 'project_id': 'dfd9fcae13714ba6890b7200ad6fcd05', 'gw_port': {'id': '3071901a-ccad-4330-bda7-47a2ecb73a37', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:43:8d:d1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '82f0930c-c769-4ad1-aced-bf5daba02c47', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1868, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.250', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:21:08Z', 'updated_at': '2021-11-09T05:21:11Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:21:11.521408 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbb078d3-ca8b-4051-b3cd-61f6e59b42df admin admin] Pushing event updated for resources: {'Port': ['ID=69db06ff-6e0c-420f-acd4-e6223477866d,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:21:11.536990 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ffed4c02-d8be-428d-9908-48cc1cc72129 None None] The sync data for ids ['82f0930c-c769-4ad1-aced-bf5daba02c47'] in dv-neutron-816802-2-hyperv is: [{'id': '82f0930c-c769-4ad1-aced-bf5daba02c47', 'name': 'tempest-TestSnapshotPattern-906856928-router', 'tenant_id': 'dfd9fcae13714ba6890b7200ad6fcd05', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.250'}], 'enable_snat': True}, 'gw_port_id': '3071901a-ccad-4330-bda7-47a2ecb73a37', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:21:08Z', 'updated_at': '2021-11-09T05:21:09Z', 'revision_number': 3, 'project_id': 'dfd9fcae13714ba6890b7200ad6fcd05', 'gw_port': {'id': '3071901a-ccad-4330-bda7-47a2ecb73a37', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:43:8d:d1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '82f0930c-c769-4ad1-aced-bf5daba02c47', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1868, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.250', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:21:08Z', 'updated_at': '2021-11-09T05:21:11Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 05:21:11.549332 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dbb078d3-ca8b-4051-b3cd-61f6e59b42df admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-465972'] for router_interface, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:11.768604 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-38dacd21-bd25-4ee4-9d2c-35d164d189ed None None] Provisioning complete for port 69db06ff-6e0c-420f-acd4-e6223477866d triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:21:11.769110 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-38dacd21-bd25-4ee4-9d2c-35d164d189ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:11.789481 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dbb078d3-ca8b-4051-b3cd-61f6e59b42df admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:11.812637 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-38dacd21-bd25-4ee4-9d2c-35d164d189ed None None] Port 69db06ff-6e0c-420f-acd4-e6223477866d cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 05:21:11.975816 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dbb078d3-ca8b-4051-b3cd-61f6e59b42df admin admin] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:12.029216 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dbb078d3-ca8b-4051-b3cd-61f6e59b42df admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:12.097523 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbb078d3-ca8b-4051-b3cd-61f6e59b42df admin admin] Pushing event updated for resources: {'Port': ['ID=69db06ff-6e0c-420f-acd4-e6223477866d,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:21:12.099917 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-dbb078d3-ca8b-4051-b3cd-61f6e59b42df admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1588005', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-466080'] for router_interface, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:12.197969 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dbb078d3-ca8b-4051-b3cd-61f6e59b42df admin admin] Network 42d49c70-f883-4a2a-a399-48a4cfc7efee is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:21:12.199457 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-dbb078d3-ca8b-4051-b3cd-61f6e59b42df admin admin] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:21:12.337633 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dbb078d3-ca8b-4051-b3cd-61f6e59b42df admin admin] Router 82f0930c-c769-4ad1-aced-bf5daba02c47 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 05:21:12.437538 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-3ea44a1c-73cf-4f8c-b91f-c64df0b1b984 None None] Provisioning complete for port 69db06ff-6e0c-420f-acd4-e6223477866d triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:21:12.437922 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3ea44a1c-73cf-4f8c-b91f-c64df0b1b984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:12.448960 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dbb078d3-ca8b-4051-b3cd-61f6e59b42df admin admin] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 05:21:12.453927 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-dbb078d3-ca8b-4051-b3cd-61f6e59b42df admin admin] 10.222.0.24 "PUT /v2.0/routers/82f0930c-c769-4ad1-aced-bf5daba02c47/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.2137332 Nov 09 05:21:12.475165 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-3ea44a1c-73cf-4f8c-b91f-c64df0b1b984 None None] Port 69db06ff-6e0c-420f-acd4-e6223477866d cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 05:21:12.766870 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:12.851286 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 3071901a-ccad-4330-bda7-47a2ecb73a37 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:21:12.901165 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 3071901a-ccad-4330-bda7-47a2ecb73a37 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:21:12.901603 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:12.979624 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:13.000028 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] For port 3071901a-ccad-4330-bda7-47a2ecb73a37, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=3071901a-ccad-4330-bda7-47a2ecb73a37,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:21:13.013359 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 38734) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:21:13.018876 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-28bfde76-fdbd-4613-a21f-e11d704bb419 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1373868547', 'description': 'tempest-secgroup-smoke-1373868547 description', 'project_id': 'ceedba48d4ab4ffcb707b41a150b986b'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:21:13.072927 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:13.073718 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 9a2f7a79-d1b4-4f1d-81ef-5447d7909fa9 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:21:13.112666 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-28bfde76-fdbd-4613-a21f-e11d704bb419 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks [] for security_group, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:13.151965 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Pushing event updated for resources: {'Port': ['ID=3071901a-ccad-4330-bda7-47a2ecb73a37,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:21:13.159310 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-92eef451-b592-4228-85dc-739496d54be4 None None] Sync routers for ids ['82f0930c-c769-4ad1-aced-bf5daba02c47'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 05:21:13.174385 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-92eef451-b592-4228-85dc-739496d54be4 None None] Routers {'82f0930c-c769-4ad1-aced-bf5daba02c47'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:21:13.175001 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-92eef451-b592-4228-85dc-739496d54be4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:20:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['82f0930c-c769-4ad1-aced-bf5daba02c47'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:21:13.176744 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 9a2f7a79-d1b4-4f1d-81ef-5447d7909fa9 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:21:13.177113 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:13.184959 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-28bfde76-fdbd-4613-a21f-e11d704bb419 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks [] for security_group, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:13.261031 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-28bfde76-fdbd-4613-a21f-e11d704bb419 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:13.290033 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28bfde76-fdbd-4613-a21f-e11d704bb419 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Pushing event updated for resources: {'SecurityGroup': ['ID=11ff3dd7-fb6d-4cff-8806-7229476345b0,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:21:13.334321 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-92eef451-b592-4228-85dc-739496d54be4 None None] Set router 82f0930c-c769-4ad1-aced-bf5daba02c47 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:21:13.356498 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-28bfde76-fdbd-4613-a21f-e11d704bb419 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:13.357795 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-28bfde76-fdbd-4613-a21f-e11d704bb419 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.3434079 Nov 09 05:21:13.360690 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 38736) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:21:13.370510 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-b01e4d4e-b326-4864-96e3-c2419e8f1f0e tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Request body: {'security_group_rule': {'security_group_id': '11ff3dd7-fb6d-4cff-8806-7229476345b0', 'project_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:21:13.444975 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b01e4d4e-b326-4864-96e3-c2419e8f1f0e tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:13.499881 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b01e4d4e-b326-4864-96e3-c2419e8f1f0e tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:13.539134 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-92eef451-b592-4228-85dc-739496d54be4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '82f0930c-c769-4ad1-aced-bf5daba02c47', 'name': 'tempest-TestSnapshotPattern-906856928-router', 'tenant_id': 'dfd9fcae13714ba6890b7200ad6fcd05', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.250'}], 'enable_snat': True}, 'gw_port_id': '3071901a-ccad-4330-bda7-47a2ecb73a37', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:21:08Z', 'updated_at': '2021-11-09T05:21:11Z', 'revision_number': 4, 'project_id': 'dfd9fcae13714ba6890b7200ad6fcd05', 'gw_port': {'id': '3071901a-ccad-4330-bda7-47a2ecb73a37', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:43:8d:d1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '82f0930c-c769-4ad1-aced-bf5daba02c47', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1868, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.250', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:21:08Z', 'updated_at': '2021-11-09T05:21:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '69db06ff-6e0c-420f-acd4-e6223477866d', 'name': '', 'network_id': '42d49c70-f883-4a2a-a399-48a4cfc7efee', 'tenant_id': 'dfd9fcae13714ba6890b7200ad6fcd05', 'mac_address': 'fa:16:3e:1d:58:f5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '82f0930c-c769-4ad1-aced-bf5daba02c47', 'device_owner': 'network:router_interface', 'standard_attr_id': 1869, 'fixed_ips': [{'subnet_id': 'ab0ba536-f04d-40cc-ab2c-cccc21052c2c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:21:11Z', 'updated_at': '2021-11-09T05:21:11Z', 'revision_number': 2, 'project_id': 'dfd9fcae13714ba6890b7200ad6fcd05', 'subnets': [{'id': 'ab0ba536-f04d-40cc-ab2c-cccc21052c2c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:21:13.564946 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-92eef451-b592-4228-85dc-739496d54be4 None None] Checking router: 82f0930c-c769-4ad1-aced-bf5daba02c47 for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 05:21:13.565301 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-92eef451-b592-4228-85dc-739496d54be4 None None] Updating router 82f0930c-c769-4ad1-aced-bf5daba02c47 port 69db06ff-6e0c-420f-acd4-e6223477866d binding host dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 09 05:21:13.571652 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b01e4d4e-b326-4864-96e3-c2419e8f1f0e tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:13.590506 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b01e4d4e-b326-4864-96e3-c2419e8f1f0e tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f97ac2b1-77a0-43c2-8872-6a8b044cb114,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:21:13.591096 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-92eef451-b592-4228-85dc-739496d54be4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:13.660016 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b01e4d4e-b326-4864-96e3-c2419e8f1f0e tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:13.661261 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-b01e4d4e-b326-4864-96e3-c2419e8f1f0e tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2990398 Nov 09 05:21:13.664055 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 38738) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:21:13.668535 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-bad1bf8b-8dda-4084-8e80-03bae692ca98 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Request body: {'security_group_rule': {'security_group_id': '11ff3dd7-fb6d-4cff-8806-7229476345b0', 'project_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:21:13.759869 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bad1bf8b-8dda-4084-8e80-03bae692ca98 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:13.807593 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-b64acbd5-cb59-4645-a9f9-11b3a9709030 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:13.822522 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bad1bf8b-8dda-4084-8e80-03bae692ca98 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:13.862958 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-92eef451-b592-4228-85dc-739496d54be4 None None] Publish callbacks [] for port, precommit_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:13.892018 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bad1bf8b-8dda-4084-8e80-03bae692ca98 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:13.910284 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bad1bf8b-8dda-4084-8e80-03bae692ca98 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5fbcafda-5e6e-4163-83ad-c6d8b8024353,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:21:13.913269 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-92eef451-b592-4228-85dc-739496d54be4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:13.959634 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57461940-bfed-4db5-b38c-0668699af533 None None] Pushing event updated for resources: {'Port': ['ID=69db06ff-6e0c-420f-acd4-e6223477866d,revision_number=3']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:21:13.963464 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bad1bf8b-8dda-4084-8e80-03bae692ca98 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:13.963603 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-bad1bf8b-8dda-4084-8e80-03bae692ca98 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.2985797 Nov 09 05:21:13.966519 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 38740) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:21:13.970991 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-0dbdc760-ef1a-4cad-b268-7a412770e94a tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Request body: {'security_group_rule': {'security_group_id': '11ff3dd7-fb6d-4cff-8806-7229476345b0', 'project_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:21:14.024960 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-92eef451-b592-4228-85dc-739496d54be4 None None] Attempting to bind port 69db06ff-6e0c-420f-acd4-e6223477866d on host dv-neutron-816802-2-hyperv for vnic_type normal with profile {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 05:21:14.025316 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-92eef451-b592-4228-85dc-739496d54be4 None None] Attempting to bind port 69db06ff-6e0c-420f-acd4-e6223477866d by drivers openvswitch,hyperv on host dv-neutron-816802-2-hyperv at level 0 using segments [{'id': 'a0230152-da2c-465a-8813-0aca466a0111', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 312, 'network_id': '42d49c70-f883-4a2a-a399-48a4cfc7efee'}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 05:21:14.025699 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-92eef451-b592-4228-85dc-739496d54be4 None None] Attempting to bind port 69db06ff-6e0c-420f-acd4-e6223477866d on network 42d49c70-f883-4a2a-a399-48a4cfc7efee {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 05:21:14.030693 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-92eef451-b592-4228-85dc-739496d54be4 None None] Checking agent: {'id': '8139c5bf-3240-449b-a0ac-835184af43d6', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816802-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 20, 17), 'started_at': datetime.datetime(2021, 11, 9, 4, 20, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 5, 20, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816802-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 05:21:14.031057 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-92eef451-b592-4228-85dc-739496d54be4 None None] Checking segment: {'id': 'a0230152-da2c-465a-8813-0aca466a0111', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 312, 'network_id': '42d49c70-f883-4a2a-a399-48a4cfc7efee'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102163) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 05:21:14.031440 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-92eef451-b592-4228-85dc-739496d54be4 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:14.031820 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-92eef451-b592-4228-85dc-739496d54be4 None None] Bound using segment: {'id': 'a0230152-da2c-465a-8813-0aca466a0111', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 312, 'network_id': '42d49c70-f883-4a2a-a399-48a4cfc7efee'} {{(pid=102163) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 05:21:14.032274 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.managers [None req-92eef451-b592-4228-85dc-739496d54be4 None None] Bound port: 69db06ff-6e0c-420f-acd4-e6223477866d, host: dv-neutron-816802-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a0230152-da2c-465a-8813-0aca466a0111', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 312, 'network_id': '42d49c70-f883-4a2a-a399-48a4cfc7efee'}}] {{(pid=102163) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 05:21:14.032644 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-92eef451-b592-4228-85dc-739496d54be4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:14.074558 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0dbdc760-ef1a-4cad-b268-7a412770e94a tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:14.105502 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-92eef451-b592-4228-85dc-739496d54be4 None None] For port 69db06ff-6e0c-420f-acd4-e6223477866d, host dv-neutron-816802-2-hyperv, cleared binding levels {{(pid=102163) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 05:21:14.108730 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-92eef451-b592-4228-85dc-739496d54be4 None None] For port 69db06ff-6e0c-420f-acd4-e6223477866d, host dv-neutron-816802-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=69db06ff-6e0c-420f-acd4-e6223477866d,segment=NetworkSegment(a0230152-da2c-465a-8813-0aca466a0111),segment_id=a0230152-da2c-465a-8813-0aca466a0111)] {{(pid=102163) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 05:21:14.139424 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0dbdc760-ef1a-4cad-b268-7a412770e94a tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:14.197051 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-92eef451-b592-4228-85dc-739496d54be4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:14.221798 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0dbdc760-ef1a-4cad-b268-7a412770e94a tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:14.240551 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0dbdc760-ef1a-4cad-b268-7a412770e94a tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8432a748-be3e-4fc4-b8e0-8b59bd2a5ef1,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:21:14.254116 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-5dda4181-f995-41f3-b018-79a2700be629 None None] Provisioning complete for port 69db06ff-6e0c-420f-acd4-e6223477866d triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:21:14.254693 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5dda4181-f995-41f3-b018-79a2700be629 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:14.287728 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57461940-bfed-4db5-b38c-0668699af533 None None] Pushing event updated for resources: {'Port': ['ID=69db06ff-6e0c-420f-acd4-e6223477866d,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:21:14.300197 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-92eef451-b592-4228-85dc-739496d54be4 None None] Routers {'82f0930c-c769-4ad1-aced-bf5daba02c47'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:21:14.300197 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-92eef451-b592-4228-85dc-739496d54be4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:21:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['82f0930c-c769-4ad1-aced-bf5daba02c47'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:21:14.320901 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-0dbdc760-ef1a-4cad-b268-7a412770e94a tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:14.323180 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-0dbdc760-ef1a-4cad-b268-7a412770e94a tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3546598 Nov 09 05:21:14.324943 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 38742) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:21:14.332302 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-628198d3-e924-4648-922a-0c9189f453d1 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Request body: {'security_group_rule': {'security_group_id': '11ff3dd7-fb6d-4cff-8806-7229476345b0', 'project_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:21:14.420956 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-628198d3-e924-4648-922a-0c9189f453d1 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:14.493713 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-628198d3-e924-4648-922a-0c9189f453d1 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:14.564624 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-628198d3-e924-4648-922a-0c9189f453d1 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:14.582049 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-628198d3-e924-4648-922a-0c9189f453d1 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4d8a0c47-1c6e-4d0d-bff3-206bf4cadb6e,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:21:14.586126 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-92eef451-b592-4228-85dc-739496d54be4 None None] Set router 82f0930c-c769-4ad1-aced-bf5daba02c47 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:21:14.587796 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5dda4181-f995-41f3-b018-79a2700be629 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:14.651823 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-628198d3-e924-4648-922a-0c9189f453d1 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:14.653059 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-628198d3-e924-4648-922a-0c9189f453d1 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3270526 Nov 09 05:21:14.655890 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 38744) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:21:14.660873 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [None req-a98ea9a2-787d-4a00-8be4-8697b80feeec tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Request body: {'security_group_rule': {'security_group_id': '11ff3dd7-fb6d-4cff-8806-7229476345b0', 'project_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:21:14.689102 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-5dda4181-f995-41f3-b018-79a2700be629 None None] For port 69db06ff-6e0c-420f-acd4-e6223477866d, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=69db06ff-6e0c-420f-acd4-e6223477866d,segment=NetworkSegment(a0230152-da2c-465a-8813-0aca466a0111),segment_id=a0230152-da2c-465a-8813-0aca466a0111)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:21:14.764251 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.db.securitygroups_db [None req-a98ea9a2-787d-4a00-8be4-8697b80feeec tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Project ceedba48d4ab4ffcb707b41a150b986b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 09 05:21:14.770691 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a98ea9a2-787d-4a00-8be4-8697b80feeec tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:14.776655 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5dda4181-f995-41f3-b018-79a2700be629 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:14.806495 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 3071901a-ccad-4330-bda7-47a2ecb73a37 up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:21:14.838944 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a98ea9a2-787d-4a00-8be4-8697b80feeec tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:14.869432 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5dda4181-f995-41f3-b018-79a2700be629 None None] Pushing event updated for resources: {'Port': ['ID=69db06ff-6e0c-420f-acd4-e6223477866d,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:21:14.900258 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-92eef451-b592-4228-85dc-739496d54be4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '82f0930c-c769-4ad1-aced-bf5daba02c47', 'name': 'tempest-TestSnapshotPattern-906856928-router', 'tenant_id': 'dfd9fcae13714ba6890b7200ad6fcd05', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.250'}], 'enable_snat': True}, 'gw_port_id': '3071901a-ccad-4330-bda7-47a2ecb73a37', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:21:08Z', 'updated_at': '2021-11-09T05:21:11Z', 'revision_number': 4, 'project_id': 'dfd9fcae13714ba6890b7200ad6fcd05', 'gw_port': {'id': '3071901a-ccad-4330-bda7-47a2ecb73a37', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:43:8d:d1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '82f0930c-c769-4ad1-aced-bf5daba02c47', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1868, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.250', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:21:08Z', 'updated_at': '2021-11-09T05:21:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '69db06ff-6e0c-420f-acd4-e6223477866d', 'name': '', 'network_id': '42d49c70-f883-4a2a-a399-48a4cfc7efee', 'tenant_id': 'dfd9fcae13714ba6890b7200ad6fcd05', 'mac_address': 'fa:16:3e:1d:58:f5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '82f0930c-c769-4ad1-aced-bf5daba02c47', 'device_owner': 'network:router_interface', 'standard_attr_id': 1869, 'fixed_ips': [{'subnet_id': 'ab0ba536-f04d-40cc-ab2c-cccc21052c2c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:21:11Z', 'updated_at': '2021-11-09T05:21:14Z', 'revision_number': 4, 'project_id': 'dfd9fcae13714ba6890b7200ad6fcd05', 'subnets': [{'id': 'ab0ba536-f04d-40cc-ab2c-cccc21052c2c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:21:14.926783 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a98ea9a2-787d-4a00-8be4-8697b80feeec tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:14.929830 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 3071901a-ccad-4330-bda7-47a2ecb73a37 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:21:14.930198 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:14.931770 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-92eef451-b592-4228-85dc-739496d54be4 None None] The sync data for ids ['82f0930c-c769-4ad1-aced-bf5daba02c47'] in dv-neutron-816802-2-hyperv is: [{'id': '82f0930c-c769-4ad1-aced-bf5daba02c47', 'name': 'tempest-TestSnapshotPattern-906856928-router', 'tenant_id': 'dfd9fcae13714ba6890b7200ad6fcd05', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.250'}], 'enable_snat': True}, 'gw_port_id': '3071901a-ccad-4330-bda7-47a2ecb73a37', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:21:08Z', 'updated_at': '2021-11-09T05:21:11Z', 'revision_number': 4, 'project_id': 'dfd9fcae13714ba6890b7200ad6fcd05', 'gw_port': {'id': '3071901a-ccad-4330-bda7-47a2ecb73a37', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:43:8d:d1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '82f0930c-c769-4ad1-aced-bf5daba02c47', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1868, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.250', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:21:08Z', 'updated_at': '2021-11-09T05:21:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': '69db06ff-6e0c-420f-acd4-e6223477866d', 'name': '', 'network_id': '42d49c70-f883-4a2a-a399-48a4cfc7efee', 'tenant_id': 'dfd9fcae13714ba6890b7200ad6fcd05', 'mac_address': 'fa:16:3e:1d:58:f5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '82f0930c-c769-4ad1-aced-bf5daba02c47', 'device_owner': 'network:router_interface', 'standard_attr_id': 1869, 'fixed_ips': [{'subnet_id': 'ab0ba536-f04d-40cc-ab2c-cccc21052c2c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:21:11Z', 'updated_at': '2021-11-09T05:21:14Z', 'revision_number': 4, 'project_id': 'dfd9fcae13714ba6890b7200ad6fcd05', 'subnets': [{'id': 'ab0ba536-f04d-40cc-ab2c-cccc21052c2c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 05:21:14.948612 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a98ea9a2-787d-4a00-8be4-8697b80feeec tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e0a49b9e-4486-4fa2-9493-c96bec2b350a,revision_number=0']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:21:14.953599 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-5965c1dd-8509-4038-87ac-f011cdc9b621 None None] Provisioning complete for port 69db06ff-6e0c-420f-acd4-e6223477866d triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:21:14.954482 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5965c1dd-8509-4038-87ac-f011cdc9b621 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:15.012441 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-a98ea9a2-787d-4a00-8be4-8697b80feeec tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:15.016558 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-a98ea9a2-787d-4a00-8be4-8697b80feeec tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.3568377 Nov 09 05:21:15.020806 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 38746) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:21:15.022552 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-1a947f5f-bb90-4740-b258-31231a1deef6 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Request body: {'security_group_rule': {'security_group_id': '11ff3dd7-fb6d-4cff-8806-7229476345b0', 'project_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:21:15.119121 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.securitygroups_db [None req-1a947f5f-bb90-4740-b258-31231a1deef6 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Project ceedba48d4ab4ffcb707b41a150b986b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 09 05:21:15.124456 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1a947f5f-bb90-4740-b258-31231a1deef6 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:15.186174 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1a947f5f-bb90-4740-b258-31231a1deef6 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:15.257895 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1a947f5f-bb90-4740-b258-31231a1deef6 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509256'] for security_group_rule, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:15.278789 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a947f5f-bb90-4740-b258-31231a1deef6 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b6f0a3de-7e35-41b3-9a59-2d15960ccc95,revision_number=0']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:21:15.349144 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:15.362437 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1a947f5f-bb90-4740-b258-31231a1deef6 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:15.363565 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1a947f5f-bb90-4740-b258-31231a1deef6 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.3448069 Nov 09 05:21:15.518294 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-8e04e5e5-d23c-41e1-9d15-bd8857979f03 req-86c554f8-bdb0-4dc0-a4d6-086a3f783e87 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1373868547&fields=id&tenant_id=ceedba48d4ab4ffcb707b41a150b986b HTTP/1.1" status: 200 len: 267 time: 0.0441258 Nov 09 05:21:15.629987 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e04e5e5-d23c-41e1-9d15-bd8857979f03 req-69c4d6fc-2b6f-4d89-8b5c-d672ca4f60ad tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:21:15.631405 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-8e04e5e5-d23c-41e1-9d15-bd8857979f03 req-69c4d6fc-2b6f-4d89-8b5c-d672ca4f60ad tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/networks?id=8b3ee119-8ca9-4512-a0b7-4947c2eb41ed HTTP/1.1" status: 200 len: 810 time: 0.1065481 Nov 09 05:21:15.646885 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-8e04e5e5-d23c-41e1-9d15-bd8857979f03 req-96866fbf-53d9-4fd0-99f1-461243e92d83 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/quotas/ceedba48d4ab4ffcb707b41a150b986b HTTP/1.1" status: 200 len: 375 time: 0.0097730 Nov 09 05:21:15.705451 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-8e04e5e5-d23c-41e1-9d15-bd8857979f03 req-cb04c756-62b5-4916-a503-614457b55dc5 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/ports?tenant_id=ceedba48d4ab4ffcb707b41a150b986b&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0528970 Nov 09 05:21:15.886837 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-8e04e5e5-d23c-41e1-9d15-bd8857979f03 req-358ed2d9-5562-4e70-8e0f-a93760fc40e1 service neutron] 10.222.0.24 "GET /v2.0/networks/8b3ee119-8ca9-4512-a0b7-4947c2eb41ed?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1699686 Nov 09 05:21:15.974155 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-8e04e5e5-d23c-41e1-9d15-bd8857979f03 req-c77926b0-05f1-4ea3-8607-0dfe5c7a562e service neutron] 10.222.0.24 "GET /v2.0/networks/8b3ee119-8ca9-4512-a0b7-4947c2eb41ed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0809708 Nov 09 05:21:16.273697 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-60ec6048-9f92-41bb-96bf-8111f83f046a req-b8cce96f-9f05-40fc-b7df-8e73f2dd4c02 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/ports?device_id=02ab6126-30d5-46d6-89a4-2640d594b5a9 HTTP/1.1" status: 200 len: 210 time: 0.0325034 Nov 09 05:21:16.703255 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:16.798836 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 69db06ff-6e0c-420f-acd4-e6223477866d up at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:21:16.851855 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Provisioning complete for port 69db06ff-6e0c-420f-acd4-e6223477866d triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:21:16.855249 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:17.038455 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:17.350182 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-3f369687-92a1-4c07-bf8e-0e06dc998259 req-1850d1b6-dbd4-42fe-88a4-601cbe37bb34 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/ports?device_id=02ab6126-30d5-46d6-89a4-2640d594b5a9 HTTP/1.1" status: 200 len: 210 time: 0.0258050 Nov 09 05:21:18.469365 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a2753de9-87cf-4b69-8b17-12a638b80bb7 req-e04d1d0f-9734-43ec-83fa-62fd07595da5 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/ports?device_id=02ab6126-30d5-46d6-89a4-2640d594b5a9 HTTP/1.1" status: 200 len: 210 time: 0.0314381 Nov 09 05:21:18.505164 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e04e5e5-d23c-41e1-9d15-bd8857979f03 req-82737116-4ac7-43ae-885f-caa3aad4e19c tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:21:18.506613 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8e04e5e5-d23c-41e1-9d15-bd8857979f03 req-82737116-4ac7-43ae-885f-caa3aad4e19c tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.26 "GET /v2.0/networks?id=8b3ee119-8ca9-4512-a0b7-4947c2eb41ed HTTP/1.1" status: 200 len: 810 time: 0.1269643 Nov 09 05:21:18.573481 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8e04e5e5-d23c-41e1-9d15-bd8857979f03 req-76b813f6-ed54-4e98-bb1f-68696d4ce63a tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.26 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=ceedba48d4ab4ffcb707b41a150b986b HTTP/1.1" status: 200 len: 380 time: 0.0567124 Nov 09 05:21:18.584788 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-8e04e5e5-d23c-41e1-9d15-bd8857979f03 req-1c4122b4-b882-4284-bcc6-de6652866002 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Request body: {'port': {'device_id': '02ab6126-30d5-46d6-89a4-2640d594b5a9', 'network_id': '8b3ee119-8ca9-4512-a0b7-4947c2eb41ed', 'admin_state_up': True, 'tenant_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'security_groups': ['11ff3dd7-fb6d-4cff-8806-7229476345b0']}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:21:18.781124 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8e04e5e5-d23c-41e1-9d15-bd8857979f03 req-1c4122b4-b882-4284-bcc6-de6652866002 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Made reservation on behalf of ceedba48d4ab4ffcb707b41a150b986b for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 05:21:18.784753 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-8e04e5e5-d23c-41e1-9d15-bd8857979f03 req-1c4122b4-b882-4284-bcc6-de6652866002 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:18.911448 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [req-8e04e5e5-d23c-41e1-9d15-bd8857979f03 req-1c4122b4-b882-4284-bcc6-de6652866002 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Allocated IP 172.20.0.8 (8b3ee119-8ca9-4512-a0b7-4947c2eb41ed/85aac8f0-cd4e-40f0-b238-bfb36190a9ad/498a9507-2cc1-41a9-8335-d8a8ea35a9dc) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 05:21:19.050578 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-8e04e5e5-d23c-41e1-9d15-bd8857979f03 req-1c4122b4-b882-4284-bcc6-de6652866002 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:19.149704 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-8e04e5e5-d23c-41e1-9d15-bd8857979f03 req-1c4122b4-b882-4284-bcc6-de6652866002 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:19.196383 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8e04e5e5-d23c-41e1-9d15-bd8857979f03 req-1c4122b4-b882-4284-bcc6-de6652866002 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Network 8b3ee119-8ca9-4512-a0b7-4947c2eb41ed is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:21:19.199501 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [req-8e04e5e5-d23c-41e1-9d15-bd8857979f03 req-1c4122b4-b882-4284-bcc6-de6652866002 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:21:19.203794 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-8e04e5e5-d23c-41e1-9d15-bd8857979f03 req-1c4122b4-b882-4284-bcc6-de6652866002 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 05:21:19.207770 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c4122b4-b882-4284-bcc6-de6652866002 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Pushing event updated for resources: {'Port': ['ID=498a9507-2cc1-41a9-8335-d8a8ea35a9dc,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:21:19.254189 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e04e5e5-d23c-41e1-9d15-bd8857979f03 req-1c4122b4-b882-4284-bcc6-de6652866002 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:21:19.254820 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-8e04e5e5-d23c-41e1-9d15-bd8857979f03 req-1c4122b4-b882-4284-bcc6-de6652866002 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:19.334536 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8e04e5e5-d23c-41e1-9d15-bd8857979f03 req-1c4122b4-b882-4284-bcc6-de6652866002 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.26 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7532265 Nov 09 05:21:19.348322 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-8e04e5e5-d23c-41e1-9d15-bd8857979f03 req-69ccef40-136b-4e94-b297-68cd47efec04 service neutron] Request body: {'port': {'device_id': '02ab6126-30d5-46d6-89a4-2640d594b5a9', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:21:19.405419 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-8e04e5e5-d23c-41e1-9d15-bd8857979f03 req-69ccef40-136b-4e94-b297-68cd47efec04 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:19.461841 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 05:21:19.474235 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-99b791d0-4662-403a-bc8d-7d694c634e99 None None] Provisioning complete for port 498a9507-2cc1-41a9-8335-d8a8ea35a9dc triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:21:19.474235 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-99b791d0-4662-403a-bc8d-7d694c634e99 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:19.508158 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-99b791d0-4662-403a-bc8d-7d694c634e99 None None] Port 498a9507-2cc1-41a9-8335-d8a8ea35a9dc cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 05:21:19.590770 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f92ec718-76ce-44eb-ae25-1faab5f77490 req-061d7724-7af7-440d-8464-ebb01c90aacc tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:21:19.592125 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f92ec718-76ce-44eb-ae25-1faab5f77490 req-061d7724-7af7-440d-8464-ebb01c90aacc tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/ports?device_id=02ab6126-30d5-46d6-89a4-2640d594b5a9 HTTP/1.1" status: 200 len: 931 time: 0.0531487 Nov 09 05:21:19.645262 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f92ec718-76ce-44eb-ae25-1faab5f77490 req-6a41b043-b76c-4a18-88ba-a19a52af1642 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/security-groups?id=11ff3dd7-fb6d-4cff-8806-7229476345b0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0463183 Nov 09 05:21:19.671509 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [req-8e04e5e5-d23c-41e1-9d15-bd8857979f03 req-69ccef40-136b-4e94-b297-68cd47efec04 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 498a9507-2cc1-41a9-8335-d8a8ea35a9dc {{(pid=102162) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 05:21:19.678911 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-8e04e5e5-d23c-41e1-9d15-bd8857979f03 req-69ccef40-136b-4e94-b297-68cd47efec04 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:19.690437 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.provisioning_blocks [req-8e04e5e5-d23c-41e1-9d15-bd8857979f03 req-69ccef40-136b-4e94-b297-68cd47efec04 service neutron] Transition to ACTIVE for port object 498a9507-2cc1-41a9-8335-d8a8ea35a9dc will not be triggered until provisioned by entity L2. {{(pid=102162) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 09 05:21:19.763822 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-8e04e5e5-d23c-41e1-9d15-bd8857979f03 req-69ccef40-136b-4e94-b297-68cd47efec04 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:19.836010 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69ccef40-136b-4e94-b297-68cd47efec04 service neutron] Pushing event updated for resources: {'Port': ['ID=498a9507-2cc1-41a9-8335-d8a8ea35a9dc,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:21:19.886717 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-8e04e5e5-d23c-41e1-9d15-bd8857979f03 req-69ccef40-136b-4e94-b297-68cd47efec04 service neutron] Attempting to bind port 498a9507-2cc1-41a9-8335-d8a8ea35a9dc on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 05:21:19.887062 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-8e04e5e5-d23c-41e1-9d15-bd8857979f03 req-69ccef40-136b-4e94-b297-68cd47efec04 service neutron] Attempting to bind port 498a9507-2cc1-41a9-8335-d8a8ea35a9dc by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '7f482fc6-4887-4d69-a152-097f906532cc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '8b3ee119-8ca9-4512-a0b7-4947c2eb41ed'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 05:21:19.887415 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8e04e5e5-d23c-41e1-9d15-bd8857979f03 req-69ccef40-136b-4e94-b297-68cd47efec04 service neutron] Attempting to bind port 498a9507-2cc1-41a9-8335-d8a8ea35a9dc on network 8b3ee119-8ca9-4512-a0b7-4947c2eb41ed {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 05:21:19.894956 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8e04e5e5-d23c-41e1-9d15-bd8857979f03 req-69ccef40-136b-4e94-b297-68cd47efec04 service neutron] Port 498a9507-2cc1-41a9-8335-d8a8ea35a9dc on network 8b3ee119-8ca9-4512-a0b7-4947c2eb41ed not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 05:21:19.895279 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8e04e5e5-d23c-41e1-9d15-bd8857979f03 req-69ccef40-136b-4e94-b297-68cd47efec04 service neutron] Attempting to bind port 498a9507-2cc1-41a9-8335-d8a8ea35a9dc on network 8b3ee119-8ca9-4512-a0b7-4947c2eb41ed {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 05:21:19.900477 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8e04e5e5-d23c-41e1-9d15-bd8857979f03 req-69ccef40-136b-4e94-b297-68cd47efec04 service neutron] Checking agent: {'id': '7d36b884-4ad2-4878-9464-bf647030b544', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'started_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 5, 21, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 05:21:19.900813 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8e04e5e5-d23c-41e1-9d15-bd8857979f03 req-69ccef40-136b-4e94-b297-68cd47efec04 service neutron] Checking segment: {'id': '7f482fc6-4887-4d69-a152-097f906532cc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '8b3ee119-8ca9-4512-a0b7-4947c2eb41ed'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 05:21:19.901198 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8e04e5e5-d23c-41e1-9d15-bd8857979f03 req-69ccef40-136b-4e94-b297-68cd47efec04 service neutron] Bound using segment: {'id': '7f482fc6-4887-4d69-a152-097f906532cc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '8b3ee119-8ca9-4512-a0b7-4947c2eb41ed'} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 05:21:19.901631 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-8e04e5e5-d23c-41e1-9d15-bd8857979f03 req-69ccef40-136b-4e94-b297-68cd47efec04 service neutron] Bound port: 498a9507-2cc1-41a9-8335-d8a8ea35a9dc, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '7f482fc6-4887-4d69-a152-097f906532cc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '8b3ee119-8ca9-4512-a0b7-4947c2eb41ed'}}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 05:21:19.901984 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-8e04e5e5-d23c-41e1-9d15-bd8857979f03 req-69ccef40-136b-4e94-b297-68cd47efec04 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:19.969439 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-8e04e5e5-d23c-41e1-9d15-bd8857979f03 req-69ccef40-136b-4e94-b297-68cd47efec04 service neutron] For port 498a9507-2cc1-41a9-8335-d8a8ea35a9dc, host hv-neutron-8168, cleared binding levels {{(pid=102162) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 05:21:19.972620 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-8e04e5e5-d23c-41e1-9d15-bd8857979f03 req-69ccef40-136b-4e94-b297-68cd47efec04 service neutron] For port 498a9507-2cc1-41a9-8335-d8a8ea35a9dc, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=498a9507-2cc1-41a9-8335-d8a8ea35a9dc,segment=NetworkSegment(7f482fc6-4887-4d69-a152-097f906532cc),segment_id=7f482fc6-4887-4d69-a152-097f906532cc)] {{(pid=102162) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 05:21:20.058295 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-8e04e5e5-d23c-41e1-9d15-bd8857979f03 req-69ccef40-136b-4e94-b297-68cd47efec04 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:20.091118 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e04e5e5-d23c-41e1-9d15-bd8857979f03 req-69ccef40-136b-4e94-b297-68cd47efec04 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:21:20.091654 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-8e04e5e5-d23c-41e1-9d15-bd8857979f03 req-69ccef40-136b-4e94-b297-68cd47efec04 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:20.093134 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8e04e5e5-d23c-41e1-9d15-bd8857979f03 req-69ccef40-136b-4e94-b297-68cd47efec04 service neutron] 10.222.0.26 "PUT /v2.0/ports/498a9507-2cc1-41a9-8335-d8a8ea35a9dc HTTP/1.1" status: 200 len: 1093 time: 0.7498853 Nov 09 05:21:20.093558 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '02ab6126-30d5-46d6-89a4-2640d594b5a9', 'tag': '498a9507-2cc1-41a9-8335-d8a8ea35a9dc'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:21:20.095950 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-753357a3-9a67-4086-ac9d-fbe4ebb2bec4" -d '{"events": [{"name": "network-changed", "server_uuid": "02ab6126-30d5-46d6-89a4-2640d594b5a9", "tag": "498a9507-2cc1-41a9-8335-d8a8ea35a9dc"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:21:20.128919 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69ccef40-136b-4e94-b297-68cd47efec04 service neutron] Pushing event updated for resources: {'Port': ['ID=498a9507-2cc1-41a9-8335-d8a8ea35a9dc,revision_number=3']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:21:20.202990 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 05:21:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5fbe0599-75ec-491e-ac86-ebf29c6ed8a3 x-openstack-request-id: req-5fbe0599-75ec-491e-ac86-ebf29c6ed8a3 {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:21:20.203282 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "02ab6126-30d5-46d6-89a4-2640d594b5a9", "tag": "498a9507-2cc1-41a9-8335-d8a8ea35a9dc", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:21:20.209845 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-5fbe0599-75ec-491e-ac86-ebf29c6ed8a3 {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:21:20.209845 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '02ab6126-30d5-46d6-89a4-2640d594b5a9', 'tag': '498a9507-2cc1-41a9-8335-d8a8ea35a9dc', 'status': 'completed', 'code': 200} Nov 09 05:21:20.274330 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-753357a3-9a67-4086-ac9d-fbe4ebb2bec4 req-310a5843-f30a-42cc-a779-b3e4b3dd1d4e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:21:20.275860 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-753357a3-9a67-4086-ac9d-fbe4ebb2bec4 req-310a5843-f30a-42cc-a779-b3e4b3dd1d4e service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=ceedba48d4ab4ffcb707b41a150b986b&device_id=02ab6126-30d5-46d6-89a4-2640d594b5a9 HTTP/1.1" status: 200 len: 1096 time: 0.0481596 Nov 09 05:21:20.373618 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-753357a3-9a67-4086-ac9d-fbe4ebb2bec4 req-cb1186b9-870a-42b0-af7b-1d9bf4c88162 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:21:20.375055 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-753357a3-9a67-4086-ac9d-fbe4ebb2bec4 req-cb1186b9-870a-42b0-af7b-1d9bf4c88162 service neutron] 10.222.0.26 "GET /v2.0/networks?tenant_id=ceedba48d4ab4ffcb707b41a150b986b&shared=False HTTP/1.1" status: 200 len: 911 time: 0.0900126 Nov 09 05:21:20.469949 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-753357a3-9a67-4086-ac9d-fbe4ebb2bec4 req-aba18454-4c91-492d-b760-9392ff6b0fab service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:21:20.471457 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-753357a3-9a67-4086-ac9d-fbe4ebb2bec4 req-aba18454-4c91-492d-b760-9392ff6b0fab service neutron] 10.222.0.26 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0895934 Nov 09 05:21:20.545319 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e04e5e5-d23c-41e1-9d15-bd8857979f03 req-39472506-354f-4a7f-a141-31cc9e828d2d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:21:20.546905 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8e04e5e5-d23c-41e1-9d15-bd8857979f03 req-39472506-354f-4a7f-a141-31cc9e828d2d service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=ceedba48d4ab4ffcb707b41a150b986b&device_id=02ab6126-30d5-46d6-89a4-2640d594b5a9 HTTP/1.1" status: 200 len: 1096 time: 0.0401781 Nov 09 05:21:20.588705 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8e04e5e5-d23c-41e1-9d15-bd8857979f03 req-290c1a4b-50f7-4a0a-989c-7db6421abc41 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=498a9507-2cc1-41a9-8335-d8a8ea35a9dc HTTP/1.1" status: 200 len: 217 time: 0.0338786 Nov 09 05:21:20.648869 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e04e5e5-d23c-41e1-9d15-bd8857979f03 req-f0a28010-79cd-409f-990c-3ff64d97bd87 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:21:20.650178 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8e04e5e5-d23c-41e1-9d15-bd8857979f03 req-f0a28010-79cd-409f-990c-3ff64d97bd87 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=85aac8f0-cd4e-40f0-b238-bfb36190a9ad HTTP/1.1" status: 200 len: 849 time: 0.0462613 Nov 09 05:21:20.695836 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e04e5e5-d23c-41e1-9d15-bd8857979f03 req-dd1c4d86-3d03-4081-81ae-6c7f39ec1881 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:21:20.697332 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8e04e5e5-d23c-41e1-9d15-bd8857979f03 req-dd1c4d86-3d03-4081-81ae-6c7f39ec1881 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=8b3ee119-8ca9-4512-a0b7-4947c2eb41ed&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0399327 Nov 09 05:21:20.766822 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23826cd3-08e9-4292-a31c-5b25b9b3350f req-51120037-fc61-4381-a70c-a1be7e2fbb18 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:21:20.768957 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-23826cd3-08e9-4292-a31c-5b25b9b3350f req-51120037-fc61-4381-a70c-a1be7e2fbb18 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/ports?device_id=02ab6126-30d5-46d6-89a4-2640d594b5a9 HTTP/1.1" status: 200 len: 943 time: 0.0508986 Nov 09 05:21:20.788548 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8e04e5e5-d23c-41e1-9d15-bd8857979f03 req-fa816192-9869-4458-963c-f36819b7275f service neutron] 10.222.0.26 "GET /v2.0/networks/8b3ee119-8ca9-4512-a0b7-4947c2eb41ed?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0827961 Nov 09 05:21:20.816936 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-23826cd3-08e9-4292-a31c-5b25b9b3350f req-1d0eca29-d4a5-4b48-83c1-31a0e888d7d8 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/security-groups?id=11ff3dd7-fb6d-4cff-8806-7229476345b0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419884 Nov 09 05:21:20.882071 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8e04e5e5-d23c-41e1-9d15-bd8857979f03 req-adee5137-3ba0-4e7e-abd1-f78770079017 service neutron] 10.222.0.26 "GET /v2.0/networks/8b3ee119-8ca9-4512-a0b7-4947c2eb41ed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0859239 Nov 09 05:21:21.934337 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c48a8c6d-0ec3-4143-a38b-995b25748e98 req-937db84a-4373-42ec-a9de-c97dd710f124 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:21:21.935821 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c48a8c6d-0ec3-4143-a38b-995b25748e98 req-937db84a-4373-42ec-a9de-c97dd710f124 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/ports?device_id=02ab6126-30d5-46d6-89a4-2640d594b5a9 HTTP/1.1" status: 200 len: 943 time: 0.0481465 Nov 09 05:21:21.984790 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-c48a8c6d-0ec3-4143-a38b-995b25748e98 req-fd28ae73-c71f-4172-80aa-1a1e224df578 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/security-groups?id=11ff3dd7-fb6d-4cff-8806-7229476345b0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424042 Nov 09 05:21:23.097678 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5da58ff-6a5f-4fd8-9eb4-b443553d173d req-aac72961-e145-4f42-a7b9-e974357a2eda tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:21:23.099150 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c5da58ff-6a5f-4fd8-9eb4-b443553d173d req-aac72961-e145-4f42-a7b9-e974357a2eda tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/ports?device_id=02ab6126-30d5-46d6-89a4-2640d594b5a9 HTTP/1.1" status: 200 len: 943 time: 0.0474546 Nov 09 05:21:23.152266 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c5da58ff-6a5f-4fd8-9eb4-b443553d173d req-83516ad3-c942-45b8-9b7b-9dc38f3471a1 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/security-groups?id=11ff3dd7-fb6d-4cff-8806-7229476345b0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0471244 Nov 09 05:21:23.252280 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 498a9507-2cc1-41a9-8335-d8a8ea35a9dc details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=102163) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 09 05:21:23.348160 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 498a9507-2cc1-41a9-8335-d8a8ea35a9dc, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=498a9507-2cc1-41a9-8335-d8a8ea35a9dc,segment=NetworkSegment(7f482fc6-4887-4d69-a152-097f906532cc),segment_id=7f482fc6-4887-4d69-a152-097f906532cc)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:21:23.359349 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Returning: {'device': '498a9507-2cc1-41a9-8335-d8a8ea35a9dc', 'network_id': '8b3ee119-8ca9-4512-a0b7-4947c2eb41ed', 'port_id': '498a9507-2cc1-41a9-8335-d8a8ea35a9dc', 'mac_address': 'fa:16:3e:e7:09:4d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 349, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '85aac8f0-cd4e-40f0-b238-bfb36190a9ad', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102163) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 09 05:21:23.395723 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:23.407799 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 498a9507-2cc1-41a9-8335-d8a8ea35a9dc {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 05:21:23.426051 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 498a9507-2cc1-41a9-8335-d8a8ea35a9dc, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=498a9507-2cc1-41a9-8335-d8a8ea35a9dc,segment=NetworkSegment(7f482fc6-4887-4d69-a152-097f906532cc),segment_id=7f482fc6-4887-4d69-a152-097f906532cc)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:21:23.531829 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:23.577352 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=498a9507-2cc1-41a9-8335-d8a8ea35a9dc,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:21:23.770786 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['498a9507-2cc1-41a9-8335-d8a8ea35a9dc'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 05:21:24.268056 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b5ddc62-7b24-45c3-8043-2176601a3670 req-c9113ced-604d-4db1-a96a-360d3070d535 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:21:24.269515 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7b5ddc62-7b24-45c3-8043-2176601a3670 req-c9113ced-604d-4db1-a96a-360d3070d535 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/ports?device_id=02ab6126-30d5-46d6-89a4-2640d594b5a9 HTTP/1.1" status: 200 len: 944 time: 0.0528319 Nov 09 05:21:24.319273 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7b5ddc62-7b24-45c3-8043-2176601a3670 req-b0b6b054-b4dd-4671-ad37-8d5c9dd547b1 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/security-groups?id=11ff3dd7-fb6d-4cff-8806-7229476345b0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0438530 Nov 09 05:21:25.267620 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 498a9507-2cc1-41a9-8335-d8a8ea35a9dc up at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:21:25.383254 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning for port 498a9507-2cc1-41a9-8335-d8a8ea35a9dc completed by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 09 05:21:25.387215 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning complete for port 498a9507-2cc1-41a9-8335-d8a8ea35a9dc triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:21:25.393047 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:25.432745 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-985bf9d4-d735-406b-88ca-9306f9c509e6 req-97a12b83-28bb-46da-aac8-e945a30cc731 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:21:25.434341 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-985bf9d4-d735-406b-88ca-9306f9c509e6 req-97a12b83-28bb-46da-aac8-e945a30cc731 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/ports?device_id=02ab6126-30d5-46d6-89a4-2640d594b5a9 HTTP/1.1" status: 200 len: 944 time: 0.0491605 Nov 09 05:21:25.463202 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:25.484234 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-985bf9d4-d735-406b-88ca-9306f9c509e6 req-f1f38b9f-4e53-4934-ab3c-a3d39c195bf8 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/security-groups?id=11ff3dd7-fb6d-4cff-8806-7229476345b0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439713 Nov 09 05:21:25.485821 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '02ab6126-30d5-46d6-89a4-2640d594b5a9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '498a9507-2cc1-41a9-8335-d8a8ea35a9dc'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:21:25.488133 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cce35537-bd62-4e31-a070-21cbcd7ebcdf" -d '{"events": [{"server_uuid": "02ab6126-30d5-46d6-89a4-2640d594b5a9", "name": "network-vif-plugged", "status": "completed", "tag": "498a9507-2cc1-41a9-8335-d8a8ea35a9dc"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:21:25.501489 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 498a9507-2cc1-41a9-8335-d8a8ea35a9dc, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=498a9507-2cc1-41a9-8335-d8a8ea35a9dc,segment=NetworkSegment(7f482fc6-4887-4d69-a152-097f906532cc),segment_id=7f482fc6-4887-4d69-a152-097f906532cc)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:21:25.578064 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 05:21:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-eab340d3-53a2-41f5-b35a-803ae8318f0f x-openstack-request-id: req-eab340d3-53a2-41f5-b35a-803ae8318f0f {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:21:25.578371 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "02ab6126-30d5-46d6-89a4-2640d594b5a9", "name": "network-vif-plugged", "status": "completed", "tag": "498a9507-2cc1-41a9-8335-d8a8ea35a9dc", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:21:25.578647 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-eab340d3-53a2-41f5-b35a-803ae8318f0f {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:21:25.579295 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '02ab6126-30d5-46d6-89a4-2640d594b5a9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '498a9507-2cc1-41a9-8335-d8a8ea35a9dc', 'code': 200} Nov 09 05:21:25.584112 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:25.635671 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=498a9507-2cc1-41a9-8335-d8a8ea35a9dc,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:21:25.816946 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4348ee0c-4f87-498a-9393-87cb78f438d5 req-3a65e77f-e7b2-412b-8a90-018322754237 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:21:25.818307 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4348ee0c-4f87-498a-9393-87cb78f438d5 req-3a65e77f-e7b2-412b-8a90-018322754237 service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=02ab6126-30d5-46d6-89a4-2640d594b5a9 HTTP/1.1" status: 200 len: 1098 time: 0.0392718 Nov 09 05:21:25.863384 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-4348ee0c-4f87-498a-9393-87cb78f438d5 req-6cc16717-0e71-4007-914a-ddf8ce76be2d service neutron] 10.222.0.26 "GET /v2.0/security-groups?id=11ff3dd7-fb6d-4cff-8806-7229476345b0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0383794 Nov 09 05:21:26.598406 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f08c3c8-76b1-4162-8774-4eb42fa5ccc5 req-8d731834-e17c-4d3c-ad20-8ef0e2417754 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:21:26.599885 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-5f08c3c8-76b1-4162-8774-4eb42fa5ccc5 req-8d731834-e17c-4d3c-ad20-8ef0e2417754 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/ports?device_id=02ab6126-30d5-46d6-89a4-2640d594b5a9 HTTP/1.1" status: 200 len: 945 time: 0.0481882 Nov 09 05:21:26.648308 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-5f08c3c8-76b1-4162-8774-4eb42fa5ccc5 req-72be04ee-8ee0-48dc-8f65-e6da54fe35c8 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/security-groups?id=11ff3dd7-fb6d-4cff-8806-7229476345b0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424592 Nov 09 05:21:27.767559 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41f1387a-5f86-47d4-8766-31fd2d389722 req-26089e04-3f05-4a75-a6d9-5d8939f6c26c tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:21:27.769040 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-41f1387a-5f86-47d4-8766-31fd2d389722 req-26089e04-3f05-4a75-a6d9-5d8939f6c26c tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/ports?device_id=02ab6126-30d5-46d6-89a4-2640d594b5a9 HTTP/1.1" status: 200 len: 945 time: 0.0523107 Nov 09 05:21:27.818551 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-41f1387a-5f86-47d4-8766-31fd2d389722 req-8afdaf1f-587c-4a3a-98dc-b7fc71817dcb tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/security-groups?id=11ff3dd7-fb6d-4cff-8806-7229476345b0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435083 Nov 09 05:21:27.937495 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8be89cd7-3646-4360-b723-97220552bfe5 req-108e1ebf-55d3-4164-9979-f2d2d23360c0 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:21:27.939417 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-8be89cd7-3646-4360-b723-97220552bfe5 req-108e1ebf-55d3-4164-9979-f2d2d23360c0 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/ports?device_id=02ab6126-30d5-46d6-89a4-2640d594b5a9 HTTP/1.1" status: 200 len: 945 time: 0.0522656 Nov 09 05:21:27.987401 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-8be89cd7-3646-4360-b723-97220552bfe5 req-a339efab-c7e3-474f-ae44-de6e02c25b6e tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/security-groups?id=11ff3dd7-fb6d-4cff-8806-7229476345b0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420866 Nov 09 05:21:28.008837 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 38824) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:21:28.088403 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f889ca46-852d-4c19-9839-36169ff419be tempest-TestSnapshotPattern-458119647 tempest-TestSnapshotPattern-458119647-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:21:28.089893 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-f889ca46-852d-4c19-9839-36169ff419be tempest-TestSnapshotPattern-458119647 tempest-TestSnapshotPattern-458119647-project-admin] 10.222.0.24 "GET /v2.0/ports?device_id=02ab6126-30d5-46d6-89a4-2640d594b5a9 HTTP/1.1" status: 200 len: 1093 time: 0.0800459 Nov 09 05:21:28.092757 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 38828) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:21:28.097467 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-81233a2f-9243-4970-a3a4-5a527ad2f2f9 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Request body: {'floatingip': {'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'port_id': '498a9507-2cc1-41a9-8335-d8a8ea35a9dc', 'tenant_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'fixed_ip_address': '172.20.0.8'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:21:28.227609 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-81233a2f-9243-4970-a3a4-5a527ad2f2f9 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks [] for floatingip, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:28.323452 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-81233a2f-9243-4970-a3a4-5a527ad2f2f9 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:28.420614 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-81233a2f-9243-4970-a3a4-5a527ad2f2f9 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Allocated IP 172.26.0.15 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/ab607fc8-143a-4715-9a6b-2281cc8587d3) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 05:21:28.520517 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-81233a2f-9243-4970-a3a4-5a527ad2f2f9 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:28.606299 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-81233a2f-9243-4970-a3a4-5a527ad2f2f9 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:28.647126 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-81233a2f-9243-4970-a3a4-5a527ad2f2f9 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:21:28.649995 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-81233a2f-9243-4970-a3a4-5a527ad2f2f9 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:21:28.654203 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-81233a2f-9243-4970-a3a4-5a527ad2f2f9 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 05:21:28.657169 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81233a2f-9243-4970-a3a4-5a527ad2f2f9 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Pushing event updated for resources: {'Port': ['ID=ab607fc8-143a-4715-9a6b-2281cc8587d3,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:21:29.000787 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-81233a2f-9243-4970-a3a4-5a527ad2f2f9 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:29.127686 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-81233a2f-9243-4970-a3a4-5a527ad2f2f9 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:29.274482 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-81233a2f-9243-4970-a3a4-5a527ad2f2f9 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:29.352685 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-81233a2f-9243-4970-a3a4-5a527ad2f2f9 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:29.419532 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81233a2f-9243-4970-a3a4-5a527ad2f2f9 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Pushing event updated for resources: {'Port': ['ID=ab607fc8-143a-4715-9a6b-2281cc8587d3,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:21:29.432771 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-81233a2f-9243-4970-a3a4-5a527ad2f2f9 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:29.529681 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.l3_db [None req-81233a2f-9243-4970-a3a4-5a527ad2f2f9 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Floating IP 78f00222-fc32-4d7a-bbda-ac50245d8691 associated. External IP: 172.26.0.15, port: 498a9507-2cc1-41a9-8335-d8a8ea35a9dc. Nov 09 05:21:30.008932 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-81233a2f-9243-4970-a3a4-5a527ad2f2f9 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Router 3e2008fd-6aec-4b2e-b56a-0934358f106c has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 05:21:30.112973 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-81233a2f-9243-4970-a3a4-5a527ad2f2f9 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 05:21:30.122779 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a08ac38-4e6a-4661-b3e9-316f31ac364f None None] Sync routers for ids ['3e2008fd-6aec-4b2e-b56a-0934358f106c'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 05:21:30.132856 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a08ac38-4e6a-4661-b3e9-316f31ac364f None None] Routers {'3e2008fd-6aec-4b2e-b56a-0934358f106c'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:21:30.133452 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-4a08ac38-4e6a-4661-b3e9-316f31ac364f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:21:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['3e2008fd-6aec-4b2e-b56a-0934358f106c'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:21:30.202507 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-81233a2f-9243-4970-a3a4-5a527ad2f2f9 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:30.231071 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-81233a2f-9243-4970-a3a4-5a527ad2f2f9 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 2.1373148 Nov 09 05:21:30.232766 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '02ab6126-30d5-46d6-89a4-2640d594b5a9', 'tag': '498a9507-2cc1-41a9-8335-d8a8ea35a9dc'}] {{(pid=102161) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:21:30.234348 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}99dfdda0def497b4372884ef2eb87f06b1e425c8eba5ceda5f64bbab037a07d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-22465d10-eccf-488a-8c27-593b41700eb3" -d '{"events": [{"name": "network-changed", "server_uuid": "02ab6126-30d5-46d6-89a4-2640d594b5a9", "tag": "498a9507-2cc1-41a9-8335-d8a8ea35a9dc"}]}' {{(pid=102161) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:21:30.236709 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-4a08ac38-4e6a-4661-b3e9-316f31ac364f None None] Set router 3e2008fd-6aec-4b2e-b56a-0934358f106c gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:21:30.333991 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 05:21:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f83de078-14d5-4f76-ac84-1608786d76be x-openstack-request-id: req-f83de078-14d5-4f76-ac84-1608786d76be {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:21:30.334407 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "02ab6126-30d5-46d6-89a4-2640d594b5a9", "tag": "498a9507-2cc1-41a9-8335-d8a8ea35a9dc", "status": "completed", "code": 200}]} {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:21:30.334669 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-f83de078-14d5-4f76-ac84-1608786d76be {{(pid=102161) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:21:30.335290 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '02ab6126-30d5-46d6-89a4-2640d594b5a9', 'tag': '498a9507-2cc1-41a9-8335-d8a8ea35a9dc', 'status': 'completed', 'code': 200} Nov 09 05:21:30.396606 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22465d10-eccf-488a-8c27-593b41700eb3 req-addae7f0-480c-4932-8045-25e31dd2c5ab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:21:30.398105 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-22465d10-eccf-488a-8c27-593b41700eb3 req-addae7f0-480c-4932-8045-25e31dd2c5ab service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=ceedba48d4ab4ffcb707b41a150b986b&device_id=02ab6126-30d5-46d6-89a4-2640d594b5a9 HTTP/1.1" status: 200 len: 1098 time: 0.0419838 Nov 09 05:21:30.490630 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22465d10-eccf-488a-8c27-593b41700eb3 req-8f92aad0-cd8d-4632-aebc-ab8d9ad34a4c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:21:30.492033 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-22465d10-eccf-488a-8c27-593b41700eb3 req-8f92aad0-cd8d-4632-aebc-ab8d9ad34a4c service neutron] 10.222.0.26 "GET /v2.0/networks?id=8b3ee119-8ca9-4512-a0b7-4947c2eb41ed HTTP/1.1" status: 200 len: 911 time: 0.0873678 Nov 09 05:21:30.556858 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-4a08ac38-4e6a-4661-b3e9-316f31ac364f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'name': 'tempest-TestSnapshotPattern-1474624592-router', 'tenant_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.119'}], 'enable_snat': True}, 'gw_port_id': '89781986-0dc0-4c2f-b390-c38c5e41723e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:21:02Z', 'updated_at': '2021-11-09T05:21:05Z', 'revision_number': 4, 'project_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'gw_port': {'id': '89781986-0dc0-4c2f-b390-c38c5e41723e', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:b5:3c:d4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1856, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.119', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:21:02Z', 'updated_at': '2021-11-09T05:21:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '78f00222-fc32-4d7a-bbda-ac50245d8691', 'tenant_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'floating_ip_address': '172.26.0.15', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'port_id': '498a9507-2cc1-41a9-8335-d8a8ea35a9dc', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 1881, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8b3ee119-8ca9-4512-a0b7-4947c2eb41ed', 'mac_address': 'fa:16:3e:e7:09:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '02ab6126-30d5-46d6-89a4-2640d594b5a9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T05:21:28Z', 'updated_at': '2021-11-09T05:21:28Z', 'revision_number': 0, 'project_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a562afa6-7652-4f76-8b5c-24feacfbb57c', 'name': '', 'network_id': '8b3ee119-8ca9-4512-a0b7-4947c2eb41ed', 'tenant_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'mac_address': 'fa:16:3e:61:c7:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1857, 'fixed_ips': [{'subnet_id': '85aac8f0-cd4e-40f0-b238-bfb36190a9ad', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:21:04Z', 'updated_at': '2021-11-09T05:21:08Z', 'revision_number': 5, 'project_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'subnets': [{'id': '85aac8f0-cd4e-40f0-b238-bfb36190a9ad', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:21:30.558518 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-22465d10-eccf-488a-8c27-593b41700eb3 req-7fdf7051-733d-4e81-b46c-e8e78b7e9485 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=498a9507-2cc1-41a9-8335-d8a8ea35a9dc HTTP/1.1" status: 200 len: 998 time: 0.0582232 Nov 09 05:21:30.582510 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a08ac38-4e6a-4661-b3e9-316f31ac364f None None] Checking router: 3e2008fd-6aec-4b2e-b56a-0934358f106c for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 05:21:30.590480 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a08ac38-4e6a-4661-b3e9-316f31ac364f None None] Routers {'3e2008fd-6aec-4b2e-b56a-0934358f106c'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:21:30.591097 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-4a08ac38-4e6a-4661-b3e9-316f31ac364f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:21:14Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['3e2008fd-6aec-4b2e-b56a-0934358f106c'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:21:30.607036 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22465d10-eccf-488a-8c27-593b41700eb3 req-fe3a0b3f-2880-423f-9a90-dcf910a2417a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:21:30.608474 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-22465d10-eccf-488a-8c27-593b41700eb3 req-fe3a0b3f-2880-423f-9a90-dcf910a2417a service neutron] 10.222.0.26 "GET /v2.0/subnets?id=85aac8f0-cd4e-40f0-b238-bfb36190a9ad HTTP/1.1" status: 200 len: 849 time: 0.0425794 Nov 09 05:21:30.656074 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22465d10-eccf-488a-8c27-593b41700eb3 req-01e66adb-307d-43f6-96a6-7cd50942474f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:21:30.658073 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-22465d10-eccf-488a-8c27-593b41700eb3 req-01e66adb-307d-43f6-96a6-7cd50942474f service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=8b3ee119-8ca9-4512-a0b7-4947c2eb41ed&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0420871 Nov 09 05:21:30.696416 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-4a08ac38-4e6a-4661-b3e9-316f31ac364f None None] Set router 3e2008fd-6aec-4b2e-b56a-0934358f106c gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:21:30.754276 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-22465d10-eccf-488a-8c27-593b41700eb3 req-03d98705-8e9b-4e19-82fa-9e220bee85ac service neutron] 10.222.0.26 "GET /v2.0/networks/8b3ee119-8ca9-4512-a0b7-4947c2eb41ed?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0890439 Nov 09 05:21:30.846779 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-22465d10-eccf-488a-8c27-593b41700eb3 req-2f1aae26-cb7e-487d-8004-5e71266b9b74 service neutron] 10.222.0.26 "GET /v2.0/networks/8b3ee119-8ca9-4512-a0b7-4947c2eb41ed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0856802 Nov 09 05:21:30.927127 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-4a08ac38-4e6a-4661-b3e9-316f31ac364f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'name': 'tempest-TestSnapshotPattern-1474624592-router', 'tenant_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.119'}], 'enable_snat': True}, 'gw_port_id': '89781986-0dc0-4c2f-b390-c38c5e41723e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:21:02Z', 'updated_at': '2021-11-09T05:21:05Z', 'revision_number': 4, 'project_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'gw_port': {'id': '89781986-0dc0-4c2f-b390-c38c5e41723e', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:b5:3c:d4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1856, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.119', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:21:02Z', 'updated_at': '2021-11-09T05:21:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '78f00222-fc32-4d7a-bbda-ac50245d8691', 'tenant_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'floating_ip_address': '172.26.0.15', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'port_id': '498a9507-2cc1-41a9-8335-d8a8ea35a9dc', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 1881, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8b3ee119-8ca9-4512-a0b7-4947c2eb41ed', 'mac_address': 'fa:16:3e:e7:09:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '02ab6126-30d5-46d6-89a4-2640d594b5a9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T05:21:28Z', 'updated_at': '2021-11-09T05:21:28Z', 'revision_number': 0, 'project_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a562afa6-7652-4f76-8b5c-24feacfbb57c', 'name': '', 'network_id': '8b3ee119-8ca9-4512-a0b7-4947c2eb41ed', 'tenant_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'mac_address': 'fa:16:3e:61:c7:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1857, 'fixed_ips': [{'subnet_id': '85aac8f0-cd4e-40f0-b238-bfb36190a9ad', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:21:04Z', 'updated_at': '2021-11-09T05:21:08Z', 'revision_number': 5, 'project_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'subnets': [{'id': '85aac8f0-cd4e-40f0-b238-bfb36190a9ad', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:21:30.952304 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a08ac38-4e6a-4661-b3e9-316f31ac364f None None] The sync data for ids ['3e2008fd-6aec-4b2e-b56a-0934358f106c'] in dv-neutron-816802-2-hyperv is: [{'id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'name': 'tempest-TestSnapshotPattern-1474624592-router', 'tenant_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.119'}], 'enable_snat': True}, 'gw_port_id': '89781986-0dc0-4c2f-b390-c38c5e41723e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:21:02Z', 'updated_at': '2021-11-09T05:21:05Z', 'revision_number': 4, 'project_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'gw_port': {'id': '89781986-0dc0-4c2f-b390-c38c5e41723e', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:b5:3c:d4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1856, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.119', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:21:02Z', 'updated_at': '2021-11-09T05:21:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '78f00222-fc32-4d7a-bbda-ac50245d8691', 'tenant_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'floating_ip_address': '172.26.0.15', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'port_id': '498a9507-2cc1-41a9-8335-d8a8ea35a9dc', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 1881, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8b3ee119-8ca9-4512-a0b7-4947c2eb41ed', 'mac_address': 'fa:16:3e:e7:09:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '02ab6126-30d5-46d6-89a4-2640d594b5a9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T05:21:28Z', 'updated_at': '2021-11-09T05:21:28Z', 'revision_number': 0, 'project_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a562afa6-7652-4f76-8b5c-24feacfbb57c', 'name': '', 'network_id': '8b3ee119-8ca9-4512-a0b7-4947c2eb41ed', 'tenant_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'mac_address': 'fa:16:3e:61:c7:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1857, 'fixed_ips': [{'subnet_id': '85aac8f0-cd4e-40f0-b238-bfb36190a9ad', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:21:04Z', 'updated_at': '2021-11-09T05:21:08Z', 'revision_number': 5, 'project_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'subnets': [{'id': '85aac8f0-cd4e-40f0-b238-bfb36190a9ad', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 05:21:31.135852 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f8cbeede-e255-4231-a1ba-c3acc52c2a02 None None] New status for floating IP 78f00222-fc32-4d7a-bbda-ac50245d8691: ACTIVE {{(pid=102163) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 05:21:36.323948 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3e47a381-c156-47fd-8f21-81bb1ff3a7ce req-643f5831-8b89-4b57-aa6e-8e07041709ef service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=02ab6126-30d5-46d6-89a4-2640d594b5a9&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0404804 Nov 09 05:21:36.404269 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e47a381-c156-47fd-8f21-81bb1ff3a7ce req-c7295a5e-0fe5-4f58-a1f4-e4becacf5535 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:21:36.405725 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3e47a381-c156-47fd-8f21-81bb1ff3a7ce req-c7295a5e-0fe5-4f58-a1f4-e4becacf5535 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=ceedba48d4ab4ffcb707b41a150b986b&device_id=02ab6126-30d5-46d6-89a4-2640d594b5a9 HTTP/1.1" status: 200 len: 1098 time: 0.0393932 Nov 09 05:21:36.509407 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e47a381-c156-47fd-8f21-81bb1ff3a7ce req-be052434-f487-46dc-b8c9-863c7d22eaf8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:21:36.510861 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3e47a381-c156-47fd-8f21-81bb1ff3a7ce req-be052434-f487-46dc-b8c9-863c7d22eaf8 service neutron] 10.222.0.26 "GET /v2.0/networks?id=8b3ee119-8ca9-4512-a0b7-4947c2eb41ed HTTP/1.1" status: 200 len: 911 time: 0.0858200 Nov 09 05:21:36.574901 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3e47a381-c156-47fd-8f21-81bb1ff3a7ce req-f2b35b0a-2615-4610-aa4c-a6c1187ed876 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=498a9507-2cc1-41a9-8335-d8a8ea35a9dc HTTP/1.1" status: 200 len: 1000 time: 0.0563850 Nov 09 05:21:36.635895 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e47a381-c156-47fd-8f21-81bb1ff3a7ce req-2377eb4f-3c3b-45c4-a2a5-ec3c466108d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:21:36.637301 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3e47a381-c156-47fd-8f21-81bb1ff3a7ce req-2377eb4f-3c3b-45c4-a2a5-ec3c466108d4 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=85aac8f0-cd4e-40f0-b238-bfb36190a9ad HTTP/1.1" status: 200 len: 849 time: 0.0464330 Nov 09 05:21:36.683525 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e47a381-c156-47fd-8f21-81bb1ff3a7ce req-d9d095de-0c3d-4c94-9915-c3c6cca659e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:21:36.684976 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3e47a381-c156-47fd-8f21-81bb1ff3a7ce req-d9d095de-0c3d-4c94-9915-c3c6cca659e4 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=8b3ee119-8ca9-4512-a0b7-4947c2eb41ed&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0394883 Nov 09 05:21:36.775094 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3e47a381-c156-47fd-8f21-81bb1ff3a7ce req-0b54f6e8-09ae-432b-9bcb-b48bc15d8d16 service neutron] 10.222.0.26 "GET /v2.0/networks/8b3ee119-8ca9-4512-a0b7-4947c2eb41ed?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0818415 Nov 09 05:21:36.865911 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3e47a381-c156-47fd-8f21-81bb1ff3a7ce req-c5bebb7e-9719-47fd-8937-c4e649a591dd service neutron] 10.222.0.26 "GET /v2.0/networks/8b3ee119-8ca9-4512-a0b7-4947c2eb41ed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0838156 Nov 09 05:21:41.371669 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-250ebf85-08dd-48d5-a9aa-78f37b5b7d6e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:42.788902 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:43.743526 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-9093e14a-7fce-4d4c-98bb-2bbfb973e2bf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:45.312678 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:46.747232 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:47.004590 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:21:56.461246 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 05:22:11.388916 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c70c803f-ff4c-4042-895a-f05af5043fc1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:22:12.742033 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:22:13.713151 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e4f804e8-3f0b-43c5-8236-0a7e334ff004 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:22:15.324841 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:22:16.696205 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:22:17.000735 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:22:33.459008 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 05:22:37.314817 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e4a40a75-b024-4167-9da6-b239fa54764a req-d134e93e-ba77-4a23-a2b7-0082176d3172 service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=02ab6126-30d5-46d6-89a4-2640d594b5a9&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0396783 Nov 09 05:22:37.394860 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4a40a75-b024-4167-9da6-b239fa54764a req-31c9014d-d186-41aa-a12e-63b5f27d4d7c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:22:37.396334 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e4a40a75-b024-4167-9da6-b239fa54764a req-31c9014d-d186-41aa-a12e-63b5f27d4d7c service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=ceedba48d4ab4ffcb707b41a150b986b&device_id=02ab6126-30d5-46d6-89a4-2640d594b5a9 HTTP/1.1" status: 200 len: 1098 time: 0.0404963 Nov 09 05:22:37.501294 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4a40a75-b024-4167-9da6-b239fa54764a req-8877f781-8cb1-4e74-974b-cdbc93dcf5ed service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:22:37.502808 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e4a40a75-b024-4167-9da6-b239fa54764a req-8877f781-8cb1-4e74-974b-cdbc93dcf5ed service neutron] 10.222.0.26 "GET /v2.0/networks?id=8b3ee119-8ca9-4512-a0b7-4947c2eb41ed HTTP/1.1" status: 200 len: 911 time: 0.0869961 Nov 09 05:22:37.571022 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e4a40a75-b024-4167-9da6-b239fa54764a req-48f33066-dff2-47ce-9c0f-55a127d54e96 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=498a9507-2cc1-41a9-8335-d8a8ea35a9dc HTTP/1.1" status: 200 len: 1000 time: 0.0615444 Nov 09 05:22:37.623663 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4a40a75-b024-4167-9da6-b239fa54764a req-c6e94c23-f659-469a-83ca-e3c563c2892c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:22:37.625077 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e4a40a75-b024-4167-9da6-b239fa54764a req-c6e94c23-f659-469a-83ca-e3c563c2892c service neutron] 10.222.0.26 "GET /v2.0/subnets?id=85aac8f0-cd4e-40f0-b238-bfb36190a9ad HTTP/1.1" status: 200 len: 849 time: 0.0466163 Nov 09 05:22:37.669757 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4a40a75-b024-4167-9da6-b239fa54764a req-9290cdc3-2185-4118-b195-e0c980f55bdf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:22:37.671220 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e4a40a75-b024-4167-9da6-b239fa54764a req-9290cdc3-2185-4118-b195-e0c980f55bdf service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=8b3ee119-8ca9-4512-a0b7-4947c2eb41ed&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0388322 Nov 09 05:22:37.758494 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e4a40a75-b024-4167-9da6-b239fa54764a req-40daab98-b0ff-430f-9749-ccc0a6a801a9 service neutron] 10.222.0.26 "GET /v2.0/networks/8b3ee119-8ca9-4512-a0b7-4947c2eb41ed?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0795376 Nov 09 05:22:37.850672 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e4a40a75-b024-4167-9da6-b239fa54764a req-bbd96d4a-0417-473c-93bf-ef1153c5aa4a service neutron] 10.222.0.26 "GET /v2.0/networks/8b3ee119-8ca9-4512-a0b7-4947c2eb41ed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0855491 Nov 09 05:22:41.377768 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-490a897c-ea9d-4f81-8acb-41a4bd2e4fe7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:22:42.761479 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:22:43.709511 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-af1e4123-2eb0-4f75-89f0-420fe487a467 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:22:45.342737 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:22:46.718976 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:22:46.989009 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:23:10.457965 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 05:23:11.360673 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d34e948c-d83b-4738-adfa-55b438d28921 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:23:12.720670 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:23:13.708981 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0c6426fc-a711-4d8f-80fc-235d4365950f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:23:15.315235 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:23:16.709571 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:23:16.982851 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:23:27.904956 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 498a9507-2cc1-41a9-8335-d8a8ea35a9dc details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=102163) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 09 05:23:27.999886 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 498a9507-2cc1-41a9-8335-d8a8ea35a9dc, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=498a9507-2cc1-41a9-8335-d8a8ea35a9dc,segment=NetworkSegment(7f482fc6-4887-4d69-a152-097f906532cc),segment_id=7f482fc6-4887-4d69-a152-097f906532cc)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:23:28.010800 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Returning: {'device': '498a9507-2cc1-41a9-8335-d8a8ea35a9dc', 'network_id': '8b3ee119-8ca9-4512-a0b7-4947c2eb41ed', 'port_id': '498a9507-2cc1-41a9-8335-d8a8ea35a9dc', 'mac_address': 'fa:16:3e:e7:09:4d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 349, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '85aac8f0-cd4e-40f0-b238-bfb36190a9ad', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102163) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 09 05:23:28.047235 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:23:28.059364 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 498a9507-2cc1-41a9-8335-d8a8ea35a9dc {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 05:23:28.078388 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 498a9507-2cc1-41a9-8335-d8a8ea35a9dc, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=498a9507-2cc1-41a9-8335-d8a8ea35a9dc,segment=NetworkSegment(7f482fc6-4887-4d69-a152-097f906532cc),segment_id=7f482fc6-4887-4d69-a152-097f906532cc)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:23:28.149557 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:23:28.198116 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=498a9507-2cc1-41a9-8335-d8a8ea35a9dc,revision_number=6']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:23:28.205690 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:23:28.206037 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:23:28.206400 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:23:28.206737 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:23:28.207064 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:23:28.207397 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:23:28.207724 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:23:28.208049 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:23:28.208378 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:23:28.208698 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:23:28.209016 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:23:28.209335 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:23:28.222158 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['498a9507-2cc1-41a9-8335-d8a8ea35a9dc'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 05:23:29.923745 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 498a9507-2cc1-41a9-8335-d8a8ea35a9dc up at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:23:29.974824 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning complete for port 498a9507-2cc1-41a9-8335-d8a8ea35a9dc triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:23:29.975191 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:23:30.049881 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:23:30.072627 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '02ab6126-30d5-46d6-89a4-2640d594b5a9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '498a9507-2cc1-41a9-8335-d8a8ea35a9dc'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:23:30.074713 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fd8b8710-1713-4319-adb9-2e56aef98292" -d '{"events": [{"server_uuid": "02ab6126-30d5-46d6-89a4-2640d594b5a9", "name": "network-vif-plugged", "status": "completed", "tag": "498a9507-2cc1-41a9-8335-d8a8ea35a9dc"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:23:30.087331 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 498a9507-2cc1-41a9-8335-d8a8ea35a9dc, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=498a9507-2cc1-41a9-8335-d8a8ea35a9dc,segment=NetworkSegment(7f482fc6-4887-4d69-a152-097f906532cc),segment_id=7f482fc6-4887-4d69-a152-097f906532cc)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:23:30.115776 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 05:23:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7602584d-de3e-414c-9394-420262db2ab8 x-openstack-request-id: req-7602584d-de3e-414c-9394-420262db2ab8 {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:23:30.116488 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "02ab6126-30d5-46d6-89a4-2640d594b5a9", "name": "network-vif-plugged", "status": "completed", "tag": "498a9507-2cc1-41a9-8335-d8a8ea35a9dc", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:23:30.116741 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-7602584d-de3e-414c-9394-420262db2ab8 {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:23:30.117131 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '02ab6126-30d5-46d6-89a4-2640d594b5a9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '498a9507-2cc1-41a9-8335-d8a8ea35a9dc', 'code': 200} Nov 09 05:23:30.144109 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:23:30.192583 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=498a9507-2cc1-41a9-8335-d8a8ea35a9dc,revision_number=7']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:23:37.371912 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76458e8b-a90b-40c0-8255-b91248c23fc5 req-3fcd3e3e-a590-4043-88ca-1454a96140d6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:23:37.373371 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-76458e8b-a90b-40c0-8255-b91248c23fc5 req-3fcd3e3e-a590-4043-88ca-1454a96140d6 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=ceedba48d4ab4ffcb707b41a150b986b&device_id=02ab6126-30d5-46d6-89a4-2640d594b5a9 HTTP/1.1" status: 200 len: 1098 time: 0.0463245 Nov 09 05:23:37.510370 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76458e8b-a90b-40c0-8255-b91248c23fc5 req-7dd63215-1139-446d-a3ab-f9610aa4483b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:23:37.511891 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-76458e8b-a90b-40c0-8255-b91248c23fc5 req-7dd63215-1139-446d-a3ab-f9610aa4483b service neutron] 10.222.0.26 "GET /v2.0/networks?id=8b3ee119-8ca9-4512-a0b7-4947c2eb41ed HTTP/1.1" status: 200 len: 911 time: 0.1180277 Nov 09 05:23:37.593360 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-76458e8b-a90b-40c0-8255-b91248c23fc5 req-834f3867-80e4-481b-9b7a-f0f3ff852a63 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=498a9507-2cc1-41a9-8335-d8a8ea35a9dc HTTP/1.1" status: 200 len: 1000 time: 0.0734472 Nov 09 05:23:37.660676 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76458e8b-a90b-40c0-8255-b91248c23fc5 req-87be7994-cdb0-4446-a312-6be28df2a8d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:23:37.662078 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-76458e8b-a90b-40c0-8255-b91248c23fc5 req-87be7994-cdb0-4446-a312-6be28df2a8d2 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=85aac8f0-cd4e-40f0-b238-bfb36190a9ad HTTP/1.1" status: 200 len: 849 time: 0.0604341 Nov 09 05:23:37.710457 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76458e8b-a90b-40c0-8255-b91248c23fc5 req-d705ef1b-f4a0-4325-8cd1-1d1cd8c1b64c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:23:37.712122 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-76458e8b-a90b-40c0-8255-b91248c23fc5 req-d705ef1b-f4a0-4325-8cd1-1d1cd8c1b64c service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=8b3ee119-8ca9-4512-a0b7-4947c2eb41ed&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0429292 Nov 09 05:23:37.822223 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-76458e8b-a90b-40c0-8255-b91248c23fc5 req-baf70bab-1ada-4ea3-aefc-6106c7d790f8 service neutron] 10.222.0.26 "GET /v2.0/networks/8b3ee119-8ca9-4512-a0b7-4947c2eb41ed?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0980504 Nov 09 05:23:37.938594 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-76458e8b-a90b-40c0-8255-b91248c23fc5 req-5b75f3be-7385-4e18-9ffd-7b7c3c5cd4bd service neutron] 10.222.0.26 "GET /v2.0/networks/8b3ee119-8ca9-4512-a0b7-4947c2eb41ed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1077149 Nov 09 05:23:41.399610 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-459b1408-78ec-441a-a170-a5699972dd5d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:23:41.603602 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-a3ab6efd-ff7d-4a3f-8ecf-98705a6edead req-29d43517-9f9a-4216-a5d0-446183c0aeff tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1373868547&fields=id&tenant_id=ceedba48d4ab4ffcb707b41a150b986b HTTP/1.1" status: 200 len: 267 time: 0.0432351 Nov 09 05:23:41.710764 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3ab6efd-ff7d-4a3f-8ecf-98705a6edead req-586f0ac1-ab88-4cd7-a526-b496c7f30277 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:23:41.712203 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-a3ab6efd-ff7d-4a3f-8ecf-98705a6edead req-586f0ac1-ab88-4cd7-a526-b496c7f30277 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/networks?id=8b3ee119-8ca9-4512-a0b7-4947c2eb41ed HTTP/1.1" status: 200 len: 810 time: 0.1015463 Nov 09 05:23:41.727302 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-a3ab6efd-ff7d-4a3f-8ecf-98705a6edead req-6da4fb52-04aa-4f18-af9d-a912dca49945 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/quotas/ceedba48d4ab4ffcb707b41a150b986b HTTP/1.1" status: 200 len: 375 time: 0.0088291 Nov 09 05:23:41.781589 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-a3ab6efd-ff7d-4a3f-8ecf-98705a6edead req-d635975c-2cc0-4839-aa5e-252f9bc8bc9a tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/ports?tenant_id=ceedba48d4ab4ffcb707b41a150b986b&fields=id HTTP/1.1" status: 200 len: 394 time: 0.0493422 Nov 09 05:23:41.874884 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-a3ab6efd-ff7d-4a3f-8ecf-98705a6edead req-635b3274-3225-4332-b3dd-5465108c1678 service neutron] 10.222.0.24 "GET /v2.0/networks/8b3ee119-8ca9-4512-a0b7-4947c2eb41ed?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0819969 Nov 09 05:23:41.974565 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-a3ab6efd-ff7d-4a3f-8ecf-98705a6edead req-e5cac027-ff20-4716-8e15-f800b644c252 service neutron] 10.222.0.24 "GET /v2.0/networks/8b3ee119-8ca9-4512-a0b7-4947c2eb41ed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0889359 Nov 09 05:23:42.250554 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-58612f9d-6c19-4027-9980-738eb2d676a5 req-c501b7a5-2f81-4947-9aa3-b56e8d2fd05b tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/ports?device_id=2f429d46-4883-4417-9acb-d66f9f90ba78 HTTP/1.1" status: 200 len: 210 time: 0.0286179 Nov 09 05:23:42.754929 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:23:43.339900 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-22dbf1b1-bf3c-4e55-8659-4deca64d8bf3 req-2ad70807-1185-4557-889d-962d0a14aa69 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/ports?device_id=2f429d46-4883-4417-9acb-d66f9f90ba78 HTTP/1.1" status: 200 len: 210 time: 0.0259125 Nov 09 05:23:43.703858 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a6fe1328-4844-4757-895a-630962f63c6a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:23:43.986091 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 498a9507-2cc1-41a9-8335-d8a8ea35a9dc no longer exists at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 05:23:44.210587 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:23:44.231568 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '02ab6126-30d5-46d6-89a4-2640d594b5a9', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '498a9507-2cc1-41a9-8335-d8a8ea35a9dc'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:23:44.233798 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-abe7b328-265c-4714-aeab-eb088c081f8a" -d '{"events": [{"server_uuid": "02ab6126-30d5-46d6-89a4-2640d594b5a9", "name": "network-vif-unplugged", "status": "completed", "tag": "498a9507-2cc1-41a9-8335-d8a8ea35a9dc"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:23:44.246065 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 498a9507-2cc1-41a9-8335-d8a8ea35a9dc, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=498a9507-2cc1-41a9-8335-d8a8ea35a9dc,segment=NetworkSegment(7f482fc6-4887-4d69-a152-097f906532cc),segment_id=7f482fc6-4887-4d69-a152-097f906532cc)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:23:44.284096 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 09 Nov 2021 05:23:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b8641a63-6b90-4373-ab5f-4352311153e2 x-openstack-request-id: req-b8641a63-6b90-4373-ab5f-4352311153e2 {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:23:44.284451 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "02ab6126-30d5-46d6-89a4-2640d594b5a9", "name": "network-vif-unplugged", "status": "completed", "tag": "498a9507-2cc1-41a9-8335-d8a8ea35a9dc", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:23:44.284679 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-b8641a63-6b90-4373-ab5f-4352311153e2 {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:23:44.285069 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '02ab6126-30d5-46d6-89a4-2640d594b5a9', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '498a9507-2cc1-41a9-8335-d8a8ea35a9dc', 'code': 200} Nov 09 05:23:44.314496 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:23:44.360342 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=498a9507-2cc1-41a9-8335-d8a8ea35a9dc,revision_number=8']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:23:44.414856 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f505e337-00d7-4aa7-a9c5-8292149a6bec req-441a122a-72d2-4c16-a177-bec2b917e16c tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/ports?device_id=2f429d46-4883-4417-9acb-d66f9f90ba78 HTTP/1.1" status: 200 len: 210 time: 0.0261216 Nov 09 05:23:45.337877 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:23:45.510787 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-71007623-3ee9-43a3-b3b2-58f6048a1f76 req-3f1a3585-d85c-47e0-b753-6c18a709585a tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/ports?device_id=2f429d46-4883-4417-9acb-d66f9f90ba78 HTTP/1.1" status: 200 len: 210 time: 0.0262830 Nov 09 05:23:46.297114 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3ab6efd-ff7d-4a3f-8ecf-98705a6edead req-5bdc0f22-dc35-48cc-9b4e-54bef21bd5b5 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:23:46.298588 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a3ab6efd-ff7d-4a3f-8ecf-98705a6edead req-5bdc0f22-dc35-48cc-9b4e-54bef21bd5b5 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.26 "GET /v2.0/networks?id=8b3ee119-8ca9-4512-a0b7-4947c2eb41ed HTTP/1.1" status: 200 len: 810 time: 0.1046677 Nov 09 05:23:46.368455 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a3ab6efd-ff7d-4a3f-8ecf-98705a6edead req-a88bdf01-9871-4e47-a6da-012a6d5da8b9 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.26 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=ceedba48d4ab4ffcb707b41a150b986b HTTP/1.1" status: 200 len: 380 time: 0.0536177 Nov 09 05:23:46.377912 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-a3ab6efd-ff7d-4a3f-8ecf-98705a6edead req-d988ff4a-c820-47d3-b2c4-5665bd5ff573 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Request body: {'port': {'device_id': '2f429d46-4883-4417-9acb-d66f9f90ba78', 'network_id': '8b3ee119-8ca9-4512-a0b7-4947c2eb41ed', 'admin_state_up': True, 'tenant_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'security_groups': ['11ff3dd7-fb6d-4cff-8806-7229476345b0']}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:23:46.604607 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-29a213d2-e9b3-47a3-938f-7cecd97f8905 req-9bec4b81-7504-403f-8c7e-5ea899e3ccb5 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/ports?device_id=2f429d46-4883-4417-9acb-d66f9f90ba78 HTTP/1.1" status: 200 len: 210 time: 0.0268939 Nov 09 05:23:46.612315 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a3ab6efd-ff7d-4a3f-8ecf-98705a6edead req-d988ff4a-c820-47d3-b2c4-5665bd5ff573 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Made reservation on behalf of ceedba48d4ab4ffcb707b41a150b986b for: {'port': 1} {{(pid=102162) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 09 05:23:46.616627 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-a3ab6efd-ff7d-4a3f-8ecf-98705a6edead req-d988ff4a-c820-47d3-b2c4-5665bd5ff573 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:23:46.703932 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:23:46.742772 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_common [req-a3ab6efd-ff7d-4a3f-8ecf-98705a6edead req-d988ff4a-c820-47d3-b2c4-5665bd5ff573 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Allocated IP 172.20.0.3 (8b3ee119-8ca9-4512-a0b7-4947c2eb41ed/85aac8f0-cd4e-40f0-b238-bfb36190a9ad/4b9ff12f-b81f-43c9-886a-615f9e5be058) {{(pid=102162) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 05:23:46.883596 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-a3ab6efd-ff7d-4a3f-8ecf-98705a6edead req-d988ff4a-c820-47d3-b2c4-5665bd5ff573 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks [] for port, precommit_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:23:47.003177 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-a3ab6efd-ff7d-4a3f-8ecf-98705a6edead req-d988ff4a-c820-47d3-b2c4-5665bd5ff573 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_create {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:23:47.024977 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:23:47.094748 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a3ab6efd-ff7d-4a3f-8ecf-98705a6edead req-d988ff4a-c820-47d3-b2c4-5665bd5ff573 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Network 8b3ee119-8ca9-4512-a0b7-4947c2eb41ed is already hosted by enough agents. {{(pid=102162) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:23:47.098254 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.base_scheduler [req-a3ab6efd-ff7d-4a3f-8ecf-98705a6edead req-d988ff4a-c820-47d3-b2c4-5665bd5ff573 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Resources bound (agent type, host, resource id): {{(pid=102162) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:23:47.101278 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-a3ab6efd-ff7d-4a3f-8ecf-98705a6edead req-d988ff4a-c820-47d3-b2c4-5665bd5ff573 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Received port after_create {{(pid=102162) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 05:23:47.176970 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d988ff4a-c820-47d3-b2c4-5665bd5ff573 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Pushing event updated for resources: {'Port': ['ID=4b9ff12f-b81f-43c9-886a-615f9e5be058,revision_number=1']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:23:47.204483 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d988ff4a-c820-47d3-b2c4-5665bd5ff573 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:23:47.207981 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d988ff4a-c820-47d3-b2c4-5665bd5ff573 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:23:47.208522 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d988ff4a-c820-47d3-b2c4-5665bd5ff573 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:23:47.208934 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d988ff4a-c820-47d3-b2c4-5665bd5ff573 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:23:47.209343 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d988ff4a-c820-47d3-b2c4-5665bd5ff573 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:23:47.209774 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d988ff4a-c820-47d3-b2c4-5665bd5ff573 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:23:47.210598 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d988ff4a-c820-47d3-b2c4-5665bd5ff573 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:23:47.210951 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d988ff4a-c820-47d3-b2c4-5665bd5ff573 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:23:47.211294 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d988ff4a-c820-47d3-b2c4-5665bd5ff573 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:23:47.211625 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d988ff4a-c820-47d3-b2c4-5665bd5ff573 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:23:47.212301 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d988ff4a-c820-47d3-b2c4-5665bd5ff573 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:23:47.212635 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d988ff4a-c820-47d3-b2c4-5665bd5ff573 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:23:47.226344 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3ab6efd-ff7d-4a3f-8ecf-98705a6edead req-d988ff4a-c820-47d3-b2c4-5665bd5ff573 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:23:47.226988 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-a3ab6efd-ff7d-4a3f-8ecf-98705a6edead req-d988ff4a-c820-47d3-b2c4-5665bd5ff573 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:23:47.318396 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a3ab6efd-ff7d-4a3f-8ecf-98705a6edead req-d988ff4a-c820-47d3-b2c4-5665bd5ff573 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.26 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.9439304 Nov 09 05:23:47.461915 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 05:23:47.476936 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-fa55b1e7-b739-43be-bd8b-3846dd8180ca None None] Provisioning complete for port 4b9ff12f-b81f-43c9-886a-615f9e5be058 triggered by entity DHCP. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:23:47.477307 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-fa55b1e7-b739-43be-bd8b-3846dd8180ca None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:23:47.517121 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-fa55b1e7-b739-43be-bd8b-3846dd8180ca None None] Port 4b9ff12f-b81f-43c9-886a-615f9e5be058 cannot update to ACTIVE because it is not bound. {{(pid=102163) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 09 05:23:47.723934 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04b95890-b458-4c07-b266-574d5334d8db req-562bf782-444b-46f7-b31e-1bb07398a9de tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:23:47.725553 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-04b95890-b458-4c07-b266-574d5334d8db req-562bf782-444b-46f7-b31e-1bb07398a9de tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/ports?device_id=2f429d46-4883-4417-9acb-d66f9f90ba78 HTTP/1.1" status: 200 len: 931 time: 0.0551982 Nov 09 05:23:47.780681 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-04b95890-b458-4c07-b266-574d5334d8db req-d43ee20d-4d15-4c3d-90dd-95eb102ff651 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/security-groups?id=11ff3dd7-fb6d-4cff-8806-7229476345b0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0477719 Nov 09 05:23:48.907869 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33ef0557-0fba-4a6d-b2c3-b5fd3155d6fe req-ed785c9e-3719-4b18-822b-036f09311198 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:23:48.909566 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-33ef0557-0fba-4a6d-b2c3-b5fd3155d6fe req-ed785c9e-3719-4b18-822b-036f09311198 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/ports?device_id=2f429d46-4883-4417-9acb-d66f9f90ba78 HTTP/1.1" status: 200 len: 931 time: 0.0572171 Nov 09 05:23:48.960478 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-33ef0557-0fba-4a6d-b2c3-b5fd3155d6fe req-741a62c9-f692-4644-b1c3-7f7d93ac7c2e tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/security-groups?id=11ff3dd7-fb6d-4cff-8806-7229476345b0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0446703 Nov 09 05:23:50.082079 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e153d94-8301-405e-87e5-330f115451cf req-10d4fdb0-8e91-4e30-b28f-6939cd4db7e9 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:23:50.083612 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7e153d94-8301-405e-87e5-330f115451cf req-10d4fdb0-8e91-4e30-b28f-6939cd4db7e9 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/ports?device_id=2f429d46-4883-4417-9acb-d66f9f90ba78 HTTP/1.1" status: 200 len: 931 time: 0.0525773 Nov 09 05:23:50.132772 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-7e153d94-8301-405e-87e5-330f115451cf req-df88b59d-9d7e-4d74-87ec-eeb6da28061c tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/security-groups?id=11ff3dd7-fb6d-4cff-8806-7229476345b0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432034 Nov 09 05:23:51.259090 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-378b4cc4-9e88-4e7a-bf1b-6302945e0825 req-9f8e2fe6-15f1-4aaf-b595-0a52b02c59b3 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:23:51.260945 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-378b4cc4-9e88-4e7a-bf1b-6302945e0825 req-9f8e2fe6-15f1-4aaf-b595-0a52b02c59b3 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/ports?device_id=2f429d46-4883-4417-9acb-d66f9f90ba78 HTTP/1.1" status: 200 len: 931 time: 0.0550690 Nov 09 05:23:51.312174 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-378b4cc4-9e88-4e7a-bf1b-6302945e0825 req-3f288846-f638-4cb1-b5f8-42610d35dc4a tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/security-groups?id=11ff3dd7-fb6d-4cff-8806-7229476345b0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0448511 Nov 09 05:23:52.438993 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01df6f32-01a4-4c85-bcd2-9928573efb7a req-fe2a6584-8b7d-40d8-9040-540561874193 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:23:52.440645 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-01df6f32-01a4-4c85-bcd2-9928573efb7a req-fe2a6584-8b7d-40d8-9040-540561874193 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/ports?device_id=2f429d46-4883-4417-9acb-d66f9f90ba78 HTTP/1.1" status: 200 len: 931 time: 0.0534520 Nov 09 05:23:52.492772 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-01df6f32-01a4-4c85-bcd2-9928573efb7a req-af1b07ce-e49f-44dc-bbd6-953c2af74378 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/security-groups?id=11ff3dd7-fb6d-4cff-8806-7229476345b0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430074 Nov 09 05:23:53.614103 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c46c04de-cdd9-40f8-9511-0f30eded6506 req-431eb8e7-3f44-4863-9758-f55f3060b0a3 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:23:53.615600 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c46c04de-cdd9-40f8-9511-0f30eded6506 req-431eb8e7-3f44-4863-9758-f55f3060b0a3 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/ports?device_id=2f429d46-4883-4417-9acb-d66f9f90ba78 HTTP/1.1" status: 200 len: 931 time: 0.0506291 Nov 09 05:23:53.672743 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-c46c04de-cdd9-40f8-9511-0f30eded6506 req-05d582f5-53c0-4dd4-97f7-a08f9c490d76 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/security-groups?id=11ff3dd7-fb6d-4cff-8806-7229476345b0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0504735 Nov 09 05:23:54.789769 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fec23caa-5acf-49bb-89e9-bb048b12bc9c req-80ce1526-db8e-4365-b774-697aeb320774 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:23:54.791311 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fec23caa-5acf-49bb-89e9-bb048b12bc9c req-80ce1526-db8e-4365-b774-697aeb320774 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/ports?device_id=2f429d46-4883-4417-9acb-d66f9f90ba78 HTTP/1.1" status: 200 len: 931 time: 0.0489891 Nov 09 05:23:54.850858 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fec23caa-5acf-49bb-89e9-bb048b12bc9c req-d5fd9485-a3c0-44ed-9dd0-fcbe7f779ae2 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/security-groups?id=11ff3dd7-fb6d-4cff-8806-7229476345b0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433724 Nov 09 05:23:55.984992 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-767a576c-3a48-47f1-a359-40c28f16c7a6 req-7c47df72-bc2a-47a5-816e-ef87d2fca68c tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:23:55.986516 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-767a576c-3a48-47f1-a359-40c28f16c7a6 req-7c47df72-bc2a-47a5-816e-ef87d2fca68c tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/ports?device_id=2f429d46-4883-4417-9acb-d66f9f90ba78 HTTP/1.1" status: 200 len: 931 time: 0.0510557 Nov 09 05:23:56.036949 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-767a576c-3a48-47f1-a359-40c28f16c7a6 req-ab03af99-f540-41ba-bba3-81bfe7c5e5d5 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/security-groups?id=11ff3dd7-fb6d-4cff-8806-7229476345b0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0446093 Nov 09 05:23:57.161585 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d823dc4-f55f-4f32-8016-346acfe7e94c req-994f05df-dbd0-43e4-b4ab-ae81849bd19b tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:23:57.163315 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6d823dc4-f55f-4f32-8016-346acfe7e94c req-994f05df-dbd0-43e4-b4ab-ae81849bd19b tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/ports?device_id=2f429d46-4883-4417-9acb-d66f9f90ba78 HTTP/1.1" status: 200 len: 931 time: 0.0586476 Nov 09 05:23:57.215445 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6d823dc4-f55f-4f32-8016-346acfe7e94c req-e9308e66-1bb4-47f5-acb2-0a87911cc81b tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/security-groups?id=11ff3dd7-fb6d-4cff-8806-7229476345b0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0460918 Nov 09 05:23:57.735079 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.v2.base [req-a3ab6efd-ff7d-4a3f-8ecf-98705a6edead req-1eec6561-f512-439a-8494-6bfb7030d80d service neutron] Request body: {'port': {'device_id': '2f429d46-4883-4417-9acb-d66f9f90ba78', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=102162) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:23:57.788026 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-a3ab6efd-ff7d-4a3f-8ecf-98705a6edead req-1eec6561-f512-439a-8494-6bfb7030d80d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:23:58.060752 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [req-a3ab6efd-ff7d-4a3f-8ecf-98705a6edead req-1eec6561-f512-439a-8494-6bfb7030d80d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4b9ff12f-b81f-43c9-886a-615f9e5be058 {{(pid=102162) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 05:23:58.068954 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-a3ab6efd-ff7d-4a3f-8ecf-98705a6edead req-1eec6561-f512-439a-8494-6bfb7030d80d service neutron] Publish callbacks [] for port, precommit_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:23:58.081639 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.provisioning_blocks [req-a3ab6efd-ff7d-4a3f-8ecf-98705a6edead req-1eec6561-f512-439a-8494-6bfb7030d80d service neutron] Transition to ACTIVE for port object 4b9ff12f-b81f-43c9-886a-615f9e5be058 will not be triggered until provisioned by entity L2. {{(pid=102162) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 09 05:23:58.155084 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-a3ab6efd-ff7d-4a3f-8ecf-98705a6edead req-1eec6561-f512-439a-8494-6bfb7030d80d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:23:58.206447 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eec6561-f512-439a-8494-6bfb7030d80d service neutron] Pushing event updated for resources: {'Port': ['ID=4b9ff12f-b81f-43c9-886a-615f9e5be058,revision_number=2']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:23:58.280499 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-a3ab6efd-ff7d-4a3f-8ecf-98705a6edead req-1eec6561-f512-439a-8494-6bfb7030d80d service neutron] Attempting to bind port 4b9ff12f-b81f-43c9-886a-615f9e5be058 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 09 05:23:58.280834 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-a3ab6efd-ff7d-4a3f-8ecf-98705a6edead req-1eec6561-f512-439a-8494-6bfb7030d80d service neutron] Attempting to bind port 4b9ff12f-b81f-43c9-886a-615f9e5be058 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '7f482fc6-4887-4d69-a152-097f906532cc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '8b3ee119-8ca9-4512-a0b7-4947c2eb41ed'}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 09 05:23:58.281359 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a3ab6efd-ff7d-4a3f-8ecf-98705a6edead req-1eec6561-f512-439a-8494-6bfb7030d80d service neutron] Attempting to bind port 4b9ff12f-b81f-43c9-886a-615f9e5be058 on network 8b3ee119-8ca9-4512-a0b7-4947c2eb41ed {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 05:23:58.286177 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a3ab6efd-ff7d-4a3f-8ecf-98705a6edead req-1eec6561-f512-439a-8494-6bfb7030d80d service neutron] Port 4b9ff12f-b81f-43c9-886a-615f9e5be058 on network 8b3ee119-8ca9-4512-a0b7-4947c2eb41ed not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 09 05:23:58.286548 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a3ab6efd-ff7d-4a3f-8ecf-98705a6edead req-1eec6561-f512-439a-8494-6bfb7030d80d service neutron] Attempting to bind port 4b9ff12f-b81f-43c9-886a-615f9e5be058 on network 8b3ee119-8ca9-4512-a0b7-4947c2eb41ed {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 09 05:23:58.291808 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a3ab6efd-ff7d-4a3f-8ecf-98705a6edead req-1eec6561-f512-439a-8494-6bfb7030d80d service neutron] Checking agent: {'id': '7d36b884-4ad2-4878-9464-bf647030b544', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'started_at': datetime.datetime(2021, 11, 9, 4, 26, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 9, 5, 23, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 09 05:23:58.292141 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a3ab6efd-ff7d-4a3f-8ecf-98705a6edead req-1eec6561-f512-439a-8494-6bfb7030d80d service neutron] Checking segment: {'id': '7f482fc6-4887-4d69-a152-097f906532cc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '8b3ee119-8ca9-4512-a0b7-4947c2eb41ed'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102162) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 09 05:23:58.292514 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a3ab6efd-ff7d-4a3f-8ecf-98705a6edead req-1eec6561-f512-439a-8494-6bfb7030d80d service neutron] Bound using segment: {'id': '7f482fc6-4887-4d69-a152-097f906532cc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '8b3ee119-8ca9-4512-a0b7-4947c2eb41ed'} {{(pid=102162) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 09 05:23:58.292930 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.managers [req-a3ab6efd-ff7d-4a3f-8ecf-98705a6edead req-1eec6561-f512-439a-8494-6bfb7030d80d service neutron] Bound port: 4b9ff12f-b81f-43c9-886a-615f9e5be058, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '7f482fc6-4887-4d69-a152-097f906532cc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '8b3ee119-8ca9-4512-a0b7-4947c2eb41ed'}}] {{(pid=102162) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 09 05:23:58.293287 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-a3ab6efd-ff7d-4a3f-8ecf-98705a6edead req-1eec6561-f512-439a-8494-6bfb7030d80d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:23:58.346935 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f016591d-9a1c-4d9a-87d7-dd81885478ab req-a7852b26-6cd9-40b5-80bc-39f7f241329b tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:23:58.348566 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f016591d-9a1c-4d9a-87d7-dd81885478ab req-a7852b26-6cd9-40b5-80bc-39f7f241329b tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/ports?device_id=2f429d46-4883-4417-9acb-d66f9f90ba78 HTTP/1.1" status: 200 len: 943 time: 0.0564947 Nov 09 05:23:58.366887 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-a3ab6efd-ff7d-4a3f-8ecf-98705a6edead req-1eec6561-f512-439a-8494-6bfb7030d80d service neutron] For port 4b9ff12f-b81f-43c9-886a-615f9e5be058, host hv-neutron-8168, cleared binding levels {{(pid=102162) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 09 05:23:58.371604 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-a3ab6efd-ff7d-4a3f-8ecf-98705a6edead req-1eec6561-f512-439a-8494-6bfb7030d80d service neutron] For port 4b9ff12f-b81f-43c9-886a-615f9e5be058, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=4b9ff12f-b81f-43c9-886a-615f9e5be058,segment=NetworkSegment(7f482fc6-4887-4d69-a152-097f906532cc),segment_id=7f482fc6-4887-4d69-a152-097f906532cc)] {{(pid=102162) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 09 05:23:58.405564 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-f016591d-9a1c-4d9a-87d7-dd81885478ab req-9f8436dc-3861-4c00-ab86-01c43eb68487 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/security-groups?id=11ff3dd7-fb6d-4cff-8806-7229476345b0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0443676 Nov 09 05:23:58.464438 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-a3ab6efd-ff7d-4a3f-8ecf-98705a6edead req-1eec6561-f512-439a-8494-6bfb7030d80d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5729950'] for port, after_update {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:23:58.497674 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3ab6efd-ff7d-4a3f-8ecf-98705a6edead req-1eec6561-f512-439a-8494-6bfb7030d80d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:23:58.498349 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-a3ab6efd-ff7d-4a3f-8ecf-98705a6edead req-1eec6561-f512-439a-8494-6bfb7030d80d service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:23:58.500193 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a3ab6efd-ff7d-4a3f-8ecf-98705a6edead req-1eec6561-f512-439a-8494-6bfb7030d80d service neutron] 10.222.0.26 "PUT /v2.0/ports/4b9ff12f-b81f-43c9-886a-615f9e5be058 HTTP/1.1" status: 200 len: 1093 time: 0.7694547 Nov 09 05:23:58.500622 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2f429d46-4883-4417-9acb-d66f9f90ba78', 'tag': '4b9ff12f-b81f-43c9-886a-615f9e5be058'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:23:58.502975 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-05f6871c-048a-4787-b78f-bef48b7c67cb" -d '{"events": [{"name": "network-changed", "server_uuid": "2f429d46-4883-4417-9acb-d66f9f90ba78", "tag": "4b9ff12f-b81f-43c9-886a-615f9e5be058"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:23:58.527799 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eec6561-f512-439a-8494-6bfb7030d80d service neutron] Pushing event updated for resources: {'Port': ['ID=4b9ff12f-b81f-43c9-886a-615f9e5be058,revision_number=3']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:23:58.551411 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 05:23:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ee935b3e-7348-4be6-b125-6feffc51200f x-openstack-request-id: req-ee935b3e-7348-4be6-b125-6feffc51200f {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:23:58.551411 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2f429d46-4883-4417-9acb-d66f9f90ba78", "tag": "4b9ff12f-b81f-43c9-886a-615f9e5be058", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:23:58.551411 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-ee935b3e-7348-4be6-b125-6feffc51200f {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:23:58.551411 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2f429d46-4883-4417-9acb-d66f9f90ba78', 'tag': '4b9ff12f-b81f-43c9-886a-615f9e5be058', 'status': 'completed', 'code': 200} Nov 09 05:23:58.615637 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05f6871c-048a-4787-b78f-bef48b7c67cb req-28106023-5dd9-41a4-8b27-628273081c89 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:23:58.617076 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-05f6871c-048a-4787-b78f-bef48b7c67cb req-28106023-5dd9-41a4-8b27-628273081c89 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=ceedba48d4ab4ffcb707b41a150b986b&device_id=2f429d46-4883-4417-9acb-d66f9f90ba78 HTTP/1.1" status: 200 len: 1096 time: 0.0425651 Nov 09 05:23:59.014616 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05f6871c-048a-4787-b78f-bef48b7c67cb req-01932044-fdf4-40a2-98dc-1bf0ad19326a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:23:59.016077 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-05f6871c-048a-4787-b78f-bef48b7c67cb req-01932044-fdf4-40a2-98dc-1bf0ad19326a service neutron] 10.222.0.26 "GET /v2.0/networks?tenant_id=ceedba48d4ab4ffcb707b41a150b986b&shared=False HTTP/1.1" status: 200 len: 911 time: 0.3906581 Nov 09 05:23:59.107118 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05f6871c-048a-4787-b78f-bef48b7c67cb req-81b15b4c-e9a0-4dce-94c9-dbcb594467cb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:23:59.109142 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-05f6871c-048a-4787-b78f-bef48b7c67cb req-81b15b4c-e9a0-4dce-94c9-dbcb594467cb service neutron] 10.222.0.26 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0849664 Nov 09 05:23:59.187265 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3ab6efd-ff7d-4a3f-8ecf-98705a6edead req-c17d1535-834a-4897-b243-f6495afda99c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:23:59.188630 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a3ab6efd-ff7d-4a3f-8ecf-98705a6edead req-c17d1535-834a-4897-b243-f6495afda99c service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=ceedba48d4ab4ffcb707b41a150b986b&device_id=2f429d46-4883-4417-9acb-d66f9f90ba78 HTTP/1.1" status: 200 len: 1096 time: 0.0438325 Nov 09 05:23:59.229812 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a3ab6efd-ff7d-4a3f-8ecf-98705a6edead req-75ec175b-5802-4bdc-a977-256d86bab0d9 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=4b9ff12f-b81f-43c9-886a-615f9e5be058 HTTP/1.1" status: 200 len: 217 time: 0.0333858 Nov 09 05:23:59.277811 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3ab6efd-ff7d-4a3f-8ecf-98705a6edead req-2308f609-d643-4940-b1d2-9bc3395d3d13 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:23:59.279262 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a3ab6efd-ff7d-4a3f-8ecf-98705a6edead req-2308f609-d643-4940-b1d2-9bc3395d3d13 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=85aac8f0-cd4e-40f0-b238-bfb36190a9ad HTTP/1.1" status: 200 len: 849 time: 0.0423138 Nov 09 05:23:59.325925 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3ab6efd-ff7d-4a3f-8ecf-98705a6edead req-0f23d07d-bae4-48c0-a8f3-06135e94051b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:23:59.327893 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a3ab6efd-ff7d-4a3f-8ecf-98705a6edead req-0f23d07d-bae4-48c0-a8f3-06135e94051b service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=8b3ee119-8ca9-4512-a0b7-4947c2eb41ed&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0410492 Nov 09 05:23:59.414549 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a3ab6efd-ff7d-4a3f-8ecf-98705a6edead req-f9f7c4a4-4e94-4981-8007-ee7928cd7615 service neutron] 10.222.0.26 "GET /v2.0/networks/8b3ee119-8ca9-4512-a0b7-4947c2eb41ed?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0791714 Nov 09 05:23:59.505078 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-a3ab6efd-ff7d-4a3f-8ecf-98705a6edead req-b4743bb6-8db8-4d8c-968d-9d0ed24cbde5 service neutron] 10.222.0.26 "GET /v2.0/networks/8b3ee119-8ca9-4512-a0b7-4947c2eb41ed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0839474 Nov 09 05:23:59.528385 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fd6ca6c-97b0-48ae-882e-7e7cd80d7513 req-9790f285-5495-49b0-8dd5-e9f19aa6be14 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:23:59.529890 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-2fd6ca6c-97b0-48ae-882e-7e7cd80d7513 req-9790f285-5495-49b0-8dd5-e9f19aa6be14 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/ports?device_id=2f429d46-4883-4417-9acb-d66f9f90ba78 HTTP/1.1" status: 200 len: 943 time: 0.0575945 Nov 09 05:23:59.578888 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-2fd6ca6c-97b0-48ae-882e-7e7cd80d7513 req-baf0d78e-26bd-446d-ab18-c487dd2af4a6 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/security-groups?id=11ff3dd7-fb6d-4cff-8806-7229476345b0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423541 Nov 09 05:24:00.692665 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-802dddc6-8f4f-49a8-8cfc-c79bac7ef0f7 req-177a5ad8-777d-4ad5-b7d4-512459acd987 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:24:00.694097 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-802dddc6-8f4f-49a8-8cfc-c79bac7ef0f7 req-177a5ad8-777d-4ad5-b7d4-512459acd987 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/ports?device_id=2f429d46-4883-4417-9acb-d66f9f90ba78 HTTP/1.1" status: 200 len: 943 time: 0.0468709 Nov 09 05:24:00.741577 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-802dddc6-8f4f-49a8-8cfc-c79bac7ef0f7 req-70967e76-cfd5-4612-a391-d9a92a3ec4bb tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/security-groups?id=11ff3dd7-fb6d-4cff-8806-7229476345b0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416136 Nov 09 05:24:01.855285 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02bf4013-100e-4164-8e8f-9f19e6a37a01 req-cd4f32e8-9d15-437e-b853-fe2e1f46b041 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:24:01.856734 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-02bf4013-100e-4164-8e8f-9f19e6a37a01 req-cd4f32e8-9d15-437e-b853-fe2e1f46b041 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/ports?device_id=2f429d46-4883-4417-9acb-d66f9f90ba78 HTTP/1.1" status: 200 len: 943 time: 0.0485721 Nov 09 05:24:01.905716 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-02bf4013-100e-4164-8e8f-9f19e6a37a01 req-8e276668-bb7d-460d-b45a-1bfb629b2b20 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/security-groups?id=11ff3dd7-fb6d-4cff-8806-7229476345b0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432355 Nov 09 05:24:02.006010 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 4b9ff12f-b81f-43c9-886a-615f9e5be058 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=102163) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 09 05:24:02.097721 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 4b9ff12f-b81f-43c9-886a-615f9e5be058, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=4b9ff12f-b81f-43c9-886a-615f9e5be058,segment=NetworkSegment(7f482fc6-4887-4d69-a152-097f906532cc),segment_id=7f482fc6-4887-4d69-a152-097f906532cc)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:24:02.108547 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Returning: {'device': '4b9ff12f-b81f-43c9-886a-615f9e5be058', 'network_id': '8b3ee119-8ca9-4512-a0b7-4947c2eb41ed', 'port_id': '4b9ff12f-b81f-43c9-886a-615f9e5be058', 'mac_address': 'fa:16:3e:6f:44:d3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 349, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '85aac8f0-cd4e-40f0-b238-bfb36190a9ad', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102163) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 09 05:24:02.148869 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:24:02.161148 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4b9ff12f-b81f-43c9-886a-615f9e5be058 {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 05:24:02.179070 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 4b9ff12f-b81f-43c9-886a-615f9e5be058, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=4b9ff12f-b81f-43c9-886a-615f9e5be058,segment=NetworkSegment(7f482fc6-4887-4d69-a152-097f906532cc),segment_id=7f482fc6-4887-4d69-a152-097f906532cc)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:24:02.239663 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:24:02.284137 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=4b9ff12f-b81f-43c9-886a-615f9e5be058,revision_number=4']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:24:02.485838 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['4b9ff12f-b81f-43c9-886a-615f9e5be058'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 05:24:03.028732 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76f07383-41fd-4f61-812e-3853f3d1fe79 req-3b835f9f-f8bb-455d-b2b2-aa8028b5bd6e tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:24:03.030300 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-76f07383-41fd-4f61-812e-3853f3d1fe79 req-3b835f9f-f8bb-455d-b2b2-aa8028b5bd6e tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/ports?device_id=2f429d46-4883-4417-9acb-d66f9f90ba78 HTTP/1.1" status: 200 len: 944 time: 0.0504174 Nov 09 05:24:03.081819 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-76f07383-41fd-4f61-812e-3853f3d1fe79 req-08238edf-777e-4f45-a057-51a8e719febc tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/security-groups?id=11ff3dd7-fb6d-4cff-8806-7229476345b0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0451925 Nov 09 05:24:04.012741 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 4b9ff12f-b81f-43c9-886a-615f9e5be058 up at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:24:04.142812 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning for port 4b9ff12f-b81f-43c9-886a-615f9e5be058 completed by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 09 05:24:04.142812 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning complete for port 4b9ff12f-b81f-43c9-886a-615f9e5be058 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:24:04.142812 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:24:04.200999 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70e9fa05-048c-4d9a-87c2-ac0287d6ea85 req-0dc92608-d653-4fb0-b4e5-c73eb350da06 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:24:04.202514 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-70e9fa05-048c-4d9a-87c2-ac0287d6ea85 req-0dc92608-d653-4fb0-b4e5-c73eb350da06 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/ports?device_id=2f429d46-4883-4417-9acb-d66f9f90ba78 HTTP/1.1" status: 200 len: 944 time: 0.0529137 Nov 09 05:24:04.221471 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:24:04.243933 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2f429d46-4883-4417-9acb-d66f9f90ba78', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4b9ff12f-b81f-43c9-886a-615f9e5be058'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:24:04.251808 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-77197891-5e89-438b-bee8-719edddcf1f3" -d '{"events": [{"server_uuid": "2f429d46-4883-4417-9acb-d66f9f90ba78", "name": "network-vif-plugged", "status": "completed", "tag": "4b9ff12f-b81f-43c9-886a-615f9e5be058"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:24:04.252183 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-70e9fa05-048c-4d9a-87c2-ac0287d6ea85 req-2733b36a-5e0f-4600-9938-7400bc20e392 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/security-groups?id=11ff3dd7-fb6d-4cff-8806-7229476345b0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434768 Nov 09 05:24:04.258908 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 4b9ff12f-b81f-43c9-886a-615f9e5be058, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=4b9ff12f-b81f-43c9-886a-615f9e5be058,segment=NetworkSegment(7f482fc6-4887-4d69-a152-097f906532cc),segment_id=7f482fc6-4887-4d69-a152-097f906532cc)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:24:04.284634 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 05:24:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-49827443-08ab-4966-827d-e7d521d99270 x-openstack-request-id: req-49827443-08ab-4966-827d-e7d521d99270 {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:24:04.284634 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2f429d46-4883-4417-9acb-d66f9f90ba78", "name": "network-vif-plugged", "status": "completed", "tag": "4b9ff12f-b81f-43c9-886a-615f9e5be058", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:24:04.284634 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-49827443-08ab-4966-827d-e7d521d99270 {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:24:04.284634 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2f429d46-4883-4417-9acb-d66f9f90ba78', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4b9ff12f-b81f-43c9-886a-615f9e5be058', 'code': 200} Nov 09 05:24:04.340404 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:24:04.391198 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=4b9ff12f-b81f-43c9-886a-615f9e5be058,revision_number=5']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:24:04.609699 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24312e7e-7623-476a-b609-d1f35b3dc829 req-856db50a-e6b4-45e1-b200-359894be4e2c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:24:04.611248 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-24312e7e-7623-476a-b609-d1f35b3dc829 req-856db50a-e6b4-45e1-b200-359894be4e2c service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=2f429d46-4883-4417-9acb-d66f9f90ba78 HTTP/1.1" status: 200 len: 1098 time: 0.0391579 Nov 09 05:24:04.656183 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-24312e7e-7623-476a-b609-d1f35b3dc829 req-8fd2ba59-b82f-4339-829e-c5db7314dcd3 service neutron] 10.222.0.26 "GET /v2.0/security-groups?id=11ff3dd7-fb6d-4cff-8806-7229476345b0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0382304 Nov 09 05:24:05.366657 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58255ed6-3ea7-4ed3-a454-84c6d5dec562 req-fa264f3f-636b-4980-8a02-8d5be4df71c4 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:24:05.368123 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-58255ed6-3ea7-4ed3-a454-84c6d5dec562 req-fa264f3f-636b-4980-8a02-8d5be4df71c4 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/ports?device_id=2f429d46-4883-4417-9acb-d66f9f90ba78 HTTP/1.1" status: 200 len: 945 time: 0.0483842 Nov 09 05:24:05.424533 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-58255ed6-3ea7-4ed3-a454-84c6d5dec562 req-efc9f4c5-3a3a-4662-bc98-b4561d86f222 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/security-groups?id=11ff3dd7-fb6d-4cff-8806-7229476345b0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0505853 Nov 09 05:24:06.539427 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c42b7d6-fb33-4ab2-a30d-b623a69bc55f req-11644e99-230a-4a40-b239-d524eba524ab tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:24:06.540875 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2c42b7d6-fb33-4ab2-a30d-b623a69bc55f req-11644e99-230a-4a40-b239-d524eba524ab tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/ports?device_id=2f429d46-4883-4417-9acb-d66f9f90ba78 HTTP/1.1" status: 200 len: 945 time: 0.0487642 Nov 09 05:24:06.588840 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-2c42b7d6-fb33-4ab2-a30d-b623a69bc55f req-bc0162a9-2ad3-4972-9d4d-836feb8c09fd tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/security-groups?id=11ff3dd7-fb6d-4cff-8806-7229476345b0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421057 Nov 09 05:24:06.701003 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4479e17e-579b-4be4-991b-7166d294dd8d req-e12b9536-cc1a-4383-b484-8219288679d8 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:24:06.703228 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-4479e17e-579b-4be4-991b-7166d294dd8d req-e12b9536-cc1a-4383-b484-8219288679d8 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/ports?device_id=2f429d46-4883-4417-9acb-d66f9f90ba78 HTTP/1.1" status: 200 len: 945 time: 0.0479238 Nov 09 05:24:06.755001 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-4479e17e-579b-4be4-991b-7166d294dd8d req-77f879b4-194b-4c97-8536-2f0f7c08de67 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/security-groups?id=11ff3dd7-fb6d-4cff-8806-7229476345b0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0460250 Nov 09 05:24:06.775564 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 39136) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:24:06.814073 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4c36f66b-aac6-4fc0-b40a-c73ed4a7412a tempest-TestSnapshotPattern-458119647 tempest-TestSnapshotPattern-458119647-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:24:06.815578 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-4c36f66b-aac6-4fc0-b40a-c73ed4a7412a tempest-TestSnapshotPattern-458119647 tempest-TestSnapshotPattern-458119647-project-admin] 10.222.0.24 "GET /v2.0/ports?device_id=2f429d46-4883-4417-9acb-d66f9f90ba78 HTTP/1.1" status: 200 len: 1093 time: 0.0390797 Nov 09 05:24:06.818255 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 39138) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:24:06.822420 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.v2.base [None req-9c713e9c-64d6-4d36-bddc-e3746143b465 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Request body: {'floatingip': {'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'port_id': '4b9ff12f-b81f-43c9-886a-615f9e5be058', 'tenant_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'fixed_ip_address': '172.20.0.3'}} {{(pid=102161) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 09 05:24:06.904140 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9c713e9c-64d6-4d36-bddc-e3746143b465 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks [] for floatingip, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:24:06.995518 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9c713e9c-64d6-4d36-bddc-e3746143b465 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:24:07.099538 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_common [None req-9c713e9c-64d6-4d36-bddc-e3746143b465 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Allocated IP 172.26.0.129 (2b6725f5-ebfe-485a-8f42-ccb5a241ddb5/e932d5b0-df1b-4711-8b71-813e648a5e78/bcd38e54-2b40-4c25-8a33-18e1f20a1c95) {{(pid=102161) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 09 05:24:07.197548 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9c713e9c-64d6-4d36-bddc-e3746143b465 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks [] for port, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:24:07.275741 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9c713e9c-64d6-4d36-bddc-e3746143b465 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8756746785684', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:24:07.311300 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9c713e9c-64d6-4d36-bddc-e3746143b465 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Network 2b6725f5-ebfe-485a-8f42-ccb5a241ddb5 is already hosted by enough agents. {{(pid=102161) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 09 05:24:07.313956 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.base_scheduler [None req-9c713e9c-64d6-4d36-bddc-e3746143b465 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Resources bound (agent type, host, resource id): {{(pid=102161) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 09 05:24:07.319381 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9c713e9c-64d6-4d36-bddc-e3746143b465 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Received port after_create {{(pid=102161) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 09 05:24:07.342276 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c713e9c-64d6-4d36-bddc-e3746143b465 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Pushing event updated for resources: {'Port': ['ID=bcd38e54-2b40-4c25-8a33-18e1f20a1c95,revision_number=1']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:24:07.353965 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c713e9c-64d6-4d36-bddc-e3746143b465 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:24:07.354316 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c713e9c-64d6-4d36-bddc-e3746143b465 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:24:07.354675 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c713e9c-64d6-4d36-bddc-e3746143b465 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:24:07.355001 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c713e9c-64d6-4d36-bddc-e3746143b465 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:24:07.355324 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c713e9c-64d6-4d36-bddc-e3746143b465 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:24:07.355649 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c713e9c-64d6-4d36-bddc-e3746143b465 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:24:07.356021 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c713e9c-64d6-4d36-bddc-e3746143b465 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:24:07.356289 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c713e9c-64d6-4d36-bddc-e3746143b465 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:24:07.356608 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c713e9c-64d6-4d36-bddc-e3746143b465 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:24:07.356921 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c713e9c-64d6-4d36-bddc-e3746143b465 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:24:07.357233 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c713e9c-64d6-4d36-bddc-e3746143b465 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:24:07.357667 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c713e9c-64d6-4d36-bddc-e3746143b465 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:24:07.692011 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9c713e9c-64d6-4d36-bddc-e3746143b465 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:24:07.804673 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9c713e9c-64d6-4d36-bddc-e3746143b465 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:24:07.959679 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9c713e9c-64d6-4d36-bddc-e3746143b465 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks [] for port, precommit_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:24:08.029557 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9c713e9c-64d6-4d36-bddc-e3746143b465 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6995299'] for port, after_update {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:24:08.091988 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c713e9c-64d6-4d36-bddc-e3746143b465 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Pushing event updated for resources: {'Port': ['ID=bcd38e54-2b40-4c25-8a33-18e1f20a1c95,revision_number=2']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:24:08.105844 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9c713e9c-64d6-4d36-bddc-e3746143b465 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-466319'] for floatingip, after_create {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:24:08.204517 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.l3_db [None req-9c713e9c-64d6-4d36-bddc-e3746143b465 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Floating IP 982a898e-0e47-4394-8d47-e87b423517c9 associated. External IP: 172.26.0.129, port: 4b9ff12f-b81f-43c9-886a-615f9e5be058. Nov 09 05:24:08.407904 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9c713e9c-64d6-4d36-bddc-e3746143b465 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Router 3e2008fd-6aec-4b2e-b56a-0934358f106c has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 05:24:08.511327 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9c713e9c-64d6-4d36-bddc-e3746143b465 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 05:24:08.521073 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c963a051-c49b-4c68-9406-8f1e82ae5db7 None None] Sync routers for ids ['3e2008fd-6aec-4b2e-b56a-0934358f106c'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 05:24:08.529960 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c963a051-c49b-4c68-9406-8f1e82ae5db7 None None] Routers {'3e2008fd-6aec-4b2e-b56a-0934358f106c'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:24:08.530605 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-c963a051-c49b-4c68-9406-8f1e82ae5db7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:23:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['3e2008fd-6aec-4b2e-b56a-0934358f106c'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:24:08.563481 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-9c713e9c-64d6-4d36-bddc-e3746143b465 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:24:08.596205 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-9c713e9c-64d6-4d36-bddc-e3746143b465 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.7767432 Nov 09 05:24:08.596731 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2f429d46-4883-4417-9acb-d66f9f90ba78', 'tag': '4b9ff12f-b81f-43c9-886a-615f9e5be058'}] {{(pid=102161) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:24:08.599063 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}99dfdda0def497b4372884ef2eb87f06b1e425c8eba5ceda5f64bbab037a07d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8f355a51-8a32-4424-b671-9e28f7c3061f" -d '{"events": [{"name": "network-changed", "server_uuid": "2f429d46-4883-4417-9acb-d66f9f90ba78", "tag": "4b9ff12f-b81f-43c9-886a-615f9e5be058"}]}' {{(pid=102161) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:24:08.634841 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 05:24:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0bc74d57-f653-440b-a73a-0f1eb64f2fb1 x-openstack-request-id: req-0bc74d57-f653-440b-a73a-0f1eb64f2fb1 {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:24:08.635132 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2f429d46-4883-4417-9acb-d66f9f90ba78", "tag": "4b9ff12f-b81f-43c9-886a-615f9e5be058", "status": "completed", "code": 200}]} {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:24:08.635392 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-0bc74d57-f653-440b-a73a-0f1eb64f2fb1 {{(pid=102161) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:24:08.635809 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2f429d46-4883-4417-9acb-d66f9f90ba78', 'tag': '4b9ff12f-b81f-43c9-886a-615f9e5be058', 'status': 'completed', 'code': 200} Nov 09 05:24:08.650911 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-c963a051-c49b-4c68-9406-8f1e82ae5db7 None None] Set router 3e2008fd-6aec-4b2e-b56a-0934358f106c gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:24:08.700195 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f355a51-8a32-4424-b671-9e28f7c3061f req-84b47dd5-62cf-40a4-8234-fde10893d5aa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:24:08.701555 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8f355a51-8a32-4424-b671-9e28f7c3061f req-84b47dd5-62cf-40a4-8234-fde10893d5aa service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=ceedba48d4ab4ffcb707b41a150b986b&device_id=2f429d46-4883-4417-9acb-d66f9f90ba78 HTTP/1.1" status: 200 len: 1098 time: 0.0430179 Nov 09 05:24:08.791582 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f355a51-8a32-4424-b671-9e28f7c3061f req-bf5af75a-456c-4222-b121-ddcb3810afde service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:24:08.793076 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8f355a51-8a32-4424-b671-9e28f7c3061f req-bf5af75a-456c-4222-b121-ddcb3810afde service neutron] 10.222.0.26 "GET /v2.0/networks?id=8b3ee119-8ca9-4512-a0b7-4947c2eb41ed HTTP/1.1" status: 200 len: 911 time: 0.0845907 Nov 09 05:24:08.864805 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8f355a51-8a32-4424-b671-9e28f7c3061f req-a6b87331-4634-4c83-8901-1d32816a3d2a service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=4b9ff12f-b81f-43c9-886a-615f9e5be058 HTTP/1.1" status: 200 len: 999 time: 0.0633447 Nov 09 05:24:08.913716 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f355a51-8a32-4424-b671-9e28f7c3061f req-a05b35ea-bef7-4218-96a3-c5d8375b8efc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:24:08.915190 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8f355a51-8a32-4424-b671-9e28f7c3061f req-a05b35ea-bef7-4218-96a3-c5d8375b8efc service neutron] 10.222.0.26 "GET /v2.0/subnets?id=85aac8f0-cd4e-40f0-b238-bfb36190a9ad HTTP/1.1" status: 200 len: 849 time: 0.0440431 Nov 09 05:24:08.961932 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-c963a051-c49b-4c68-9406-8f1e82ae5db7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'name': 'tempest-TestSnapshotPattern-1474624592-router', 'tenant_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.119'}], 'enable_snat': True}, 'gw_port_id': '89781986-0dc0-4c2f-b390-c38c5e41723e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:21:02Z', 'updated_at': '2021-11-09T05:21:05Z', 'revision_number': 4, 'project_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'gw_port': {'id': '89781986-0dc0-4c2f-b390-c38c5e41723e', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:b5:3c:d4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1856, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.119', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:21:02Z', 'updated_at': '2021-11-09T05:21:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '78f00222-fc32-4d7a-bbda-ac50245d8691', 'tenant_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'floating_ip_address': '172.26.0.15', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'port_id': '498a9507-2cc1-41a9-8335-d8a8ea35a9dc', 'fixed_ip_address': '172.20.0.8', 'status': 'ACTIVE', 'standard_attr_id': 1881, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8b3ee119-8ca9-4512-a0b7-4947c2eb41ed', 'mac_address': 'fa:16:3e:e7:09:4d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '02ab6126-30d5-46d6-89a4-2640d594b5a9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T05:21:28Z', 'updated_at': '2021-11-09T05:21:31Z', 'revision_number': 1, 'project_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'fixed_ip_address_scope': None}, {'id': '982a898e-0e47-4394-8d47-e87b423517c9', 'tenant_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'floating_ip_address': '172.26.0.129', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'port_id': '4b9ff12f-b81f-43c9-886a-615f9e5be058', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 1884, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8b3ee119-8ca9-4512-a0b7-4947c2eb41ed', 'mac_address': 'fa:16:3e:6f:44:d3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f429d46-4883-4417-9acb-d66f9f90ba78', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T05:24:07Z', 'updated_at': '2021-11-09T05:24:07Z', 'revision_number': 0, 'project_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a562afa6-7652-4f76-8b5c-24feacfbb57c', 'name': '', 'network_id': '8b3ee119-8ca9-4512-a0b7-4947c2eb41ed', 'tenant_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'mac_address': 'fa:16:3e:61:c7:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1857, 'fixed_ips': [{'subnet_id': '85aac8f0-cd4e-40f0-b238-bfb36190a9ad', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:21:04Z', 'updated_at': '2021-11-09T05:21:08Z', 'revision_number': 5, 'project_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'subnets': [{'id': '85aac8f0-cd4e-40f0-b238-bfb36190a9ad', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:24:08.962627 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f355a51-8a32-4424-b671-9e28f7c3061f req-2541a668-ec8e-45ce-a014-53f020568c16 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:24:08.964125 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8f355a51-8a32-4424-b671-9e28f7c3061f req-2541a668-ec8e-45ce-a014-53f020568c16 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=8b3ee119-8ca9-4512-a0b7-4947c2eb41ed&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0414569 Nov 09 05:24:08.990992 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c963a051-c49b-4c68-9406-8f1e82ae5db7 None None] Checking router: 3e2008fd-6aec-4b2e-b56a-0934358f106c for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 05:24:08.999047 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c963a051-c49b-4c68-9406-8f1e82ae5db7 None None] Routers {'3e2008fd-6aec-4b2e-b56a-0934358f106c'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:24:08.999795 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-c963a051-c49b-4c68-9406-8f1e82ae5db7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:23:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['3e2008fd-6aec-4b2e-b56a-0934358f106c'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:24:09.058288 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8f355a51-8a32-4424-b671-9e28f7c3061f req-c419453c-0a72-405d-9501-80d7ed8901d5 service neutron] 10.222.0.26 "GET /v2.0/networks/8b3ee119-8ca9-4512-a0b7-4947c2eb41ed?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0865643 Nov 09 05:24:09.101983 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-c963a051-c49b-4c68-9406-8f1e82ae5db7 None None] Set router 3e2008fd-6aec-4b2e-b56a-0934358f106c gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:24:09.147992 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-8f355a51-8a32-4424-b671-9e28f7c3061f req-db7f14a5-041c-4ce3-80bd-fde70aadcdca service neutron] 10.222.0.26 "GET /v2.0/networks/8b3ee119-8ca9-4512-a0b7-4947c2eb41ed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0827248 Nov 09 05:24:09.320092 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-c963a051-c49b-4c68-9406-8f1e82ae5db7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'name': 'tempest-TestSnapshotPattern-1474624592-router', 'tenant_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.119'}], 'enable_snat': True}, 'gw_port_id': '89781986-0dc0-4c2f-b390-c38c5e41723e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:21:02Z', 'updated_at': '2021-11-09T05:21:05Z', 'revision_number': 4, 'project_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'gw_port': {'id': '89781986-0dc0-4c2f-b390-c38c5e41723e', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:b5:3c:d4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1856, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.119', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:21:02Z', 'updated_at': '2021-11-09T05:21:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '78f00222-fc32-4d7a-bbda-ac50245d8691', 'tenant_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'floating_ip_address': '172.26.0.15', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'port_id': '498a9507-2cc1-41a9-8335-d8a8ea35a9dc', 'fixed_ip_address': '172.20.0.8', 'status': 'ACTIVE', 'standard_attr_id': 1881, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8b3ee119-8ca9-4512-a0b7-4947c2eb41ed', 'mac_address': 'fa:16:3e:e7:09:4d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '02ab6126-30d5-46d6-89a4-2640d594b5a9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T05:21:28Z', 'updated_at': '2021-11-09T05:21:31Z', 'revision_number': 1, 'project_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'fixed_ip_address_scope': None}, {'id': '982a898e-0e47-4394-8d47-e87b423517c9', 'tenant_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'floating_ip_address': '172.26.0.129', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'port_id': '4b9ff12f-b81f-43c9-886a-615f9e5be058', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 1884, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8b3ee119-8ca9-4512-a0b7-4947c2eb41ed', 'mac_address': 'fa:16:3e:6f:44:d3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f429d46-4883-4417-9acb-d66f9f90ba78', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T05:24:07Z', 'updated_at': '2021-11-09T05:24:07Z', 'revision_number': 0, 'project_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a562afa6-7652-4f76-8b5c-24feacfbb57c', 'name': '', 'network_id': '8b3ee119-8ca9-4512-a0b7-4947c2eb41ed', 'tenant_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'mac_address': 'fa:16:3e:61:c7:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1857, 'fixed_ips': [{'subnet_id': '85aac8f0-cd4e-40f0-b238-bfb36190a9ad', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:21:04Z', 'updated_at': '2021-11-09T05:21:08Z', 'revision_number': 5, 'project_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'subnets': [{'id': '85aac8f0-cd4e-40f0-b238-bfb36190a9ad', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:24:09.346012 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c963a051-c49b-4c68-9406-8f1e82ae5db7 None None] The sync data for ids ['3e2008fd-6aec-4b2e-b56a-0934358f106c'] in dv-neutron-816802-2-hyperv is: [{'id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'name': 'tempest-TestSnapshotPattern-1474624592-router', 'tenant_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.119'}], 'enable_snat': True}, 'gw_port_id': '89781986-0dc0-4c2f-b390-c38c5e41723e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:21:02Z', 'updated_at': '2021-11-09T05:21:05Z', 'revision_number': 4, 'project_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'gw_port': {'id': '89781986-0dc0-4c2f-b390-c38c5e41723e', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:b5:3c:d4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1856, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.119', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:21:02Z', 'updated_at': '2021-11-09T05:21:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '78f00222-fc32-4d7a-bbda-ac50245d8691', 'tenant_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'floating_ip_address': '172.26.0.15', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'port_id': '498a9507-2cc1-41a9-8335-d8a8ea35a9dc', 'fixed_ip_address': '172.20.0.8', 'status': 'ACTIVE', 'standard_attr_id': 1881, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8b3ee119-8ca9-4512-a0b7-4947c2eb41ed', 'mac_address': 'fa:16:3e:e7:09:4d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '02ab6126-30d5-46d6-89a4-2640d594b5a9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T05:21:28Z', 'updated_at': '2021-11-09T05:21:31Z', 'revision_number': 1, 'project_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'fixed_ip_address_scope': None}, {'id': '982a898e-0e47-4394-8d47-e87b423517c9', 'tenant_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'floating_ip_address': '172.26.0.129', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'port_id': '4b9ff12f-b81f-43c9-886a-615f9e5be058', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 1884, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8b3ee119-8ca9-4512-a0b7-4947c2eb41ed', 'mac_address': 'fa:16:3e:6f:44:d3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f429d46-4883-4417-9acb-d66f9f90ba78', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T05:24:07Z', 'updated_at': '2021-11-09T05:24:07Z', 'revision_number': 0, 'project_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a562afa6-7652-4f76-8b5c-24feacfbb57c', 'name': '', 'network_id': '8b3ee119-8ca9-4512-a0b7-4947c2eb41ed', 'tenant_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'mac_address': 'fa:16:3e:61:c7:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1857, 'fixed_ips': [{'subnet_id': '85aac8f0-cd4e-40f0-b238-bfb36190a9ad', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:21:04Z', 'updated_at': '2021-11-09T05:21:08Z', 'revision_number': 5, 'project_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'subnets': [{'id': '85aac8f0-cd4e-40f0-b238-bfb36190a9ad', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 05:24:09.530870 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ad33c4d3-8560-41ae-9f9d-93a224648e7a None None] New status for floating IP 982a898e-0e47-4394-8d47-e87b423517c9: ACTIVE {{(pid=102163) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 05:24:11.418269 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-aaaeef42-4723-4e7d-9a32-e04a96ad9854 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:24:12.738076 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:24:13.720748 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-df38379d-dde5-47d3-85a9-49ed73ba29ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:24:15.343511 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:24:16.709441 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:24:17.029244 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:24:24.461318 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 05:24:38.376204 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d93c2c27-502a-48bf-8bb3-30592cf50ba6 req-f57a163f-1e78-4255-b3f5-2ae30c945082 service neutron] 10.222.0.26 "GET /v2.0/ports?device_id=02ab6126-30d5-46d6-89a4-2640d594b5a9&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1081188 Nov 09 05:24:38.458863 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d93c2c27-502a-48bf-8bb3-30592cf50ba6 req-d531ddb4-d54a-4b50-9512-9134d6a42ea0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:24:38.461119 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d93c2c27-502a-48bf-8bb3-30592cf50ba6 req-d531ddb4-d54a-4b50-9512-9134d6a42ea0 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=ceedba48d4ab4ffcb707b41a150b986b&device_id=02ab6126-30d5-46d6-89a4-2640d594b5a9 HTTP/1.1" status: 200 len: 1096 time: 0.0411546 Nov 09 05:24:38.563428 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d93c2c27-502a-48bf-8bb3-30592cf50ba6 req-07c45489-acc0-432b-97f4-186d7ab0aac3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:24:38.564780 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d93c2c27-502a-48bf-8bb3-30592cf50ba6 req-07c45489-acc0-432b-97f4-186d7ab0aac3 service neutron] 10.222.0.26 "GET /v2.0/networks?id=8b3ee119-8ca9-4512-a0b7-4947c2eb41ed HTTP/1.1" status: 200 len: 911 time: 0.0834944 Nov 09 05:24:38.633220 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d93c2c27-502a-48bf-8bb3-30592cf50ba6 req-993034ed-73db-462d-93d6-704538e5ca5f service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=498a9507-2cc1-41a9-8335-d8a8ea35a9dc HTTP/1.1" status: 200 len: 998 time: 0.0607703 Nov 09 05:24:38.682220 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d93c2c27-502a-48bf-8bb3-30592cf50ba6 req-de7f1048-c1ee-43d3-9d5e-d4075274c6c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:24:38.683655 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d93c2c27-502a-48bf-8bb3-30592cf50ba6 req-de7f1048-c1ee-43d3-9d5e-d4075274c6c1 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=85aac8f0-cd4e-40f0-b238-bfb36190a9ad HTTP/1.1" status: 200 len: 849 time: 0.0433600 Nov 09 05:24:38.727826 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d93c2c27-502a-48bf-8bb3-30592cf50ba6 req-1eee2392-f74c-4efa-8046-ce86e1d5b6d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:24:38.729402 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d93c2c27-502a-48bf-8bb3-30592cf50ba6 req-1eee2392-f74c-4efa-8046-ce86e1d5b6d1 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=8b3ee119-8ca9-4512-a0b7-4947c2eb41ed&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0384929 Nov 09 05:24:38.822600 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d93c2c27-502a-48bf-8bb3-30592cf50ba6 req-627f0834-1b1c-4470-94ac-b2a7383febf2 service neutron] 10.222.0.26 "GET /v2.0/networks/8b3ee119-8ca9-4512-a0b7-4947c2eb41ed?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0841269 Nov 09 05:24:38.911089 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d93c2c27-502a-48bf-8bb3-30592cf50ba6 req-5376b790-6f12-4014-9814-5307216ce33a service neutron] 10.222.0.26 "GET /v2.0/networks/8b3ee119-8ca9-4512-a0b7-4947c2eb41ed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0814416 Nov 09 05:24:41.371996 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-8929a9b5-e633-4d7e-ba82-116be70423cf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:24:42.754546 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:24:43.709158 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-453f8cde-1a97-45a9-ac91-39013062ebd2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:24:45.315486 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:24:46.720863 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:24:47.000924 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:01.460710 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 05:25:11.382867 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c1ea5d2a-12fc-427f-b1c8-12102eb0db89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:12.795241 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:13.709752 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7971a21e-0e85-4d25-9d63-5bb10adb4c58 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:15.303928 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:16.737727 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:17.006582 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:34.488124 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 4b9ff12f-b81f-43c9-886a-615f9e5be058 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=102163) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 09 05:25:34.592393 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 4b9ff12f-b81f-43c9-886a-615f9e5be058, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=4b9ff12f-b81f-43c9-886a-615f9e5be058,segment=NetworkSegment(7f482fc6-4887-4d69-a152-097f906532cc),segment_id=7f482fc6-4887-4d69-a152-097f906532cc)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:25:34.609391 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Returning: {'device': '4b9ff12f-b81f-43c9-886a-615f9e5be058', 'network_id': '8b3ee119-8ca9-4512-a0b7-4947c2eb41ed', 'port_id': '4b9ff12f-b81f-43c9-886a-615f9e5be058', 'mac_address': 'fa:16:3e:6f:44:d3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 349, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '85aac8f0-cd4e-40f0-b238-bfb36190a9ad', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102163) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 09 05:25:34.647678 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:34.662213 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 4b9ff12f-b81f-43c9-886a-615f9e5be058 {{(pid=102163) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 09 05:25:34.683359 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 4b9ff12f-b81f-43c9-886a-615f9e5be058, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=4b9ff12f-b81f-43c9-886a-615f9e5be058,segment=NetworkSegment(7f482fc6-4887-4d69-a152-097f906532cc),segment_id=7f482fc6-4887-4d69-a152-097f906532cc)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:25:34.830061 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:34.908060 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=4b9ff12f-b81f-43c9-886a-615f9e5be058,revision_number=6']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:25:34.917503 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] get_ports_and_sgs() called for port_ids ['4b9ff12f-b81f-43c9-886a-615f9e5be058'] {{(pid=102163) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 09 05:25:34.942400 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:25:34.965589 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:25:34.965589 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:25:34.965589 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:25:34.965589 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:25:34.965589 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:25:34.965589 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:25:34.965589 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:25:34.965589 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:25:34.965589 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:25:34.965589 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:25:34.965589 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102163) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:25:36.505228 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 4b9ff12f-b81f-43c9-886a-615f9e5be058 up at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 09 05:25:36.568349 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.provisioning_blocks [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Provisioning complete for port 4b9ff12f-b81f-43c9-886a-615f9e5be058 triggered by entity L2. {{(pid=102163) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 09 05:25:36.568983 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1536464'] for port, provisioning_complete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:36.658979 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:36.687642 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2f429d46-4883-4417-9acb-d66f9f90ba78', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4b9ff12f-b81f-43c9-886a-615f9e5be058'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:25:36.690327 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4a89e112-3451-4e98-a206-d65dd35423b6" -d '{"events": [{"server_uuid": "2f429d46-4883-4417-9acb-d66f9f90ba78", "name": "network-vif-plugged", "status": "completed", "tag": "4b9ff12f-b81f-43c9-886a-615f9e5be058"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:25:36.704934 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 4b9ff12f-b81f-43c9-886a-615f9e5be058, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=4b9ff12f-b81f-43c9-886a-615f9e5be058,segment=NetworkSegment(7f482fc6-4887-4d69-a152-097f906532cc),segment_id=7f482fc6-4887-4d69-a152-097f906532cc)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:25:36.734245 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 05:25:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b0ad4c08-a454-42ec-80fe-882a85f9c464 x-openstack-request-id: req-b0ad4c08-a454-42ec-80fe-882a85f9c464 {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:25:36.734543 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2f429d46-4883-4417-9acb-d66f9f90ba78", "name": "network-vif-plugged", "status": "completed", "tag": "4b9ff12f-b81f-43c9-886a-615f9e5be058", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:25:36.734663 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-b0ad4c08-a454-42ec-80fe-882a85f9c464 {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:25:36.735000 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2f429d46-4883-4417-9acb-d66f9f90ba78', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4b9ff12f-b81f-43c9-886a-615f9e5be058', 'code': 200} Nov 09 05:25:36.779006 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:36.831334 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=4b9ff12f-b81f-43c9-886a-615f9e5be058,revision_number=7']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:25:38.461097 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 05:25:39.383711 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc0938d2-0fb9-4e7e-9440-d1f6bea54730 req-36eded0c-e1d0-41e6-8df3-c09e7eafc484 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:25:39.385248 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fc0938d2-0fb9-4e7e-9440-d1f6bea54730 req-36eded0c-e1d0-41e6-8df3-c09e7eafc484 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=ceedba48d4ab4ffcb707b41a150b986b&device_id=2f429d46-4883-4417-9acb-d66f9f90ba78 HTTP/1.1" status: 200 len: 1098 time: 0.0522044 Nov 09 05:25:39.507113 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc0938d2-0fb9-4e7e-9440-d1f6bea54730 req-490a1114-423c-43a5-b4c6-abb25b9c607c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:25:39.508606 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fc0938d2-0fb9-4e7e-9440-d1f6bea54730 req-490a1114-423c-43a5-b4c6-abb25b9c607c service neutron] 10.222.0.26 "GET /v2.0/networks?id=8b3ee119-8ca9-4512-a0b7-4947c2eb41ed HTTP/1.1" status: 200 len: 911 time: 0.0994461 Nov 09 05:25:39.592628 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fc0938d2-0fb9-4e7e-9440-d1f6bea54730 req-71000053-5349-4e67-98b3-25ac62157f29 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=4b9ff12f-b81f-43c9-886a-615f9e5be058 HTTP/1.1" status: 200 len: 1001 time: 0.0750883 Nov 09 05:25:39.653013 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc0938d2-0fb9-4e7e-9440-d1f6bea54730 req-06634352-5e0a-4f09-b3cf-4586aa8bd60f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:25:39.653013 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fc0938d2-0fb9-4e7e-9440-d1f6bea54730 req-06634352-5e0a-4f09-b3cf-4586aa8bd60f service neutron] 10.222.0.26 "GET /v2.0/subnets?id=85aac8f0-cd4e-40f0-b238-bfb36190a9ad HTTP/1.1" status: 200 len: 849 time: 0.0518105 Nov 09 05:25:39.703320 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc0938d2-0fb9-4e7e-9440-d1f6bea54730 req-74ac2e01-762b-424d-b886-356e6b355b17 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:25:39.704871 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fc0938d2-0fb9-4e7e-9440-d1f6bea54730 req-74ac2e01-762b-424d-b886-356e6b355b17 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=8b3ee119-8ca9-4512-a0b7-4947c2eb41ed&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0441749 Nov 09 05:25:39.802661 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fc0938d2-0fb9-4e7e-9440-d1f6bea54730 req-ba975d03-edcf-4037-85bc-2ce94cea6c2e service neutron] 10.222.0.26 "GET /v2.0/networks/8b3ee119-8ca9-4512-a0b7-4947c2eb41ed?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0892036 Nov 09 05:25:39.894222 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fc0938d2-0fb9-4e7e-9440-d1f6bea54730 req-320dfeb6-be44-4df0-b8cf-b517f751cc2b service neutron] 10.222.0.26 "GET /v2.0/networks/8b3ee119-8ca9-4512-a0b7-4947c2eb41ed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0844796 Nov 09 05:25:41.372458 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3bbe5e40-a876-4b54-8005-233788e68b60 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:42.760920 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:43.721163 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5c647b3e-5b4e-4589-b3a2-1c663fe36e56 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:45.343235 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:45.805799 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 39346) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:25:45.961291 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-2705d00f-0ef5-4381-ae23-86213410bb35 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Deleting port bcd38e54-2b40-4c25-8a33-18e1f20a1c95 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:25:45.961631 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2705d00f-0ef5-4381-ae23-86213410bb35 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:46.033742 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2705d00f-0ef5-4381-ae23-86213410bb35 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:46.033991 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2705d00f-0ef5-4381-ae23-86213410bb35 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:46.045369 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-2705d00f-0ef5-4381-ae23-86213410bb35 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Calling delete_port for bcd38e54-2b40-4c25-8a33-18e1f20a1c95 owned by network:floatingip {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:25:46.252737 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2705d00f-0ef5-4381-ae23-86213410bb35 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:46.287626 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2705d00f-0ef5-4381-ae23-86213410bb35 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Pushing event deleted for resources: {'Port': ['ID=bcd38e54-2b40-4c25-8a33-18e1f20a1c95,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:25:46.309623 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2705d00f-0ef5-4381-ae23-86213410bb35 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:25:46.309971 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2705d00f-0ef5-4381-ae23-86213410bb35 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:25:46.310304 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2705d00f-0ef5-4381-ae23-86213410bb35 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:25:46.310656 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2705d00f-0ef5-4381-ae23-86213410bb35 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:25:46.310981 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2705d00f-0ef5-4381-ae23-86213410bb35 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:25:46.311311 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2705d00f-0ef5-4381-ae23-86213410bb35 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:25:46.311631 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2705d00f-0ef5-4381-ae23-86213410bb35 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:25:46.311952 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2705d00f-0ef5-4381-ae23-86213410bb35 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:25:46.312391 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2705d00f-0ef5-4381-ae23-86213410bb35 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:25:46.312709 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2705d00f-0ef5-4381-ae23-86213410bb35 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:25:46.313189 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2705d00f-0ef5-4381-ae23-86213410bb35 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:25:46.313508 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2705d00f-0ef5-4381-ae23-86213410bb35 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102161) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:25:46.355099 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2705d00f-0ef5-4381-ae23-86213410bb35 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks [] for floatingip, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:46.355427 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.l3_db [None req-2705d00f-0ef5-4381-ae23-86213410bb35 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Floating IP 982a898e-0e47-4394-8d47-e87b423517c9 disassociated (deleted). External IP: 172.26.0.129, port: 4b9ff12f-b81f-43c9-886a-615f9e5be058. Nov 09 05:25:46.556506 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2705d00f-0ef5-4381-ae23-86213410bb35 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Router 3e2008fd-6aec-4b2e-b56a-0934358f106c has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 05:25:46.722079 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:46.938648 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2705d00f-0ef5-4381-ae23-86213410bb35 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 05:25:46.943484 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-2705d00f-0ef5-4381-ae23-86213410bb35 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:46.949517 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aa63ed56-6c61-4bf0-be1d-30ab03d85c25 None None] Sync routers for ids ['3e2008fd-6aec-4b2e-b56a-0934358f106c'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 05:25:46.959876 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aa63ed56-6c61-4bf0-be1d-30ab03d85c25 None None] Routers {'3e2008fd-6aec-4b2e-b56a-0934358f106c'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:25:46.961256 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-aa63ed56-6c61-4bf0-be1d-30ab03d85c25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:25:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['3e2008fd-6aec-4b2e-b56a-0934358f106c'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:25:46.970692 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-2705d00f-0ef5-4381-ae23-86213410bb35 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "DELETE /v2.0/floatingips/982a898e-0e47-4394-8d47-e87b423517c9 HTTP/1.1" status: 204 len: 168 time: 1.1637580 Nov 09 05:25:46.971515 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2f429d46-4883-4417-9acb-d66f9f90ba78', 'tag': '4b9ff12f-b81f-43c9-886a-615f9e5be058'}] {{(pid=102161) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:25:46.974341 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}99dfdda0def497b4372884ef2eb87f06b1e425c8eba5ceda5f64bbab037a07d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-df8bb3a3-6e32-4d80-9417-e29ad8d55ad2" -d '{"events": [{"name": "network-changed", "server_uuid": "2f429d46-4883-4417-9acb-d66f9f90ba78", "tag": "4b9ff12f-b81f-43c9-886a-615f9e5be058"}]}' {{(pid=102161) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:25:47.006780 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:47.025303 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 05:25:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5da433c8-551d-4f62-bf4f-d64198d28e64 x-openstack-request-id: req-5da433c8-551d-4f62-bf4f-d64198d28e64 {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:25:47.025303 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2f429d46-4883-4417-9acb-d66f9f90ba78", "tag": "4b9ff12f-b81f-43c9-886a-615f9e5be058", "status": "completed", "code": 200}]} {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:25:47.025303 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-5da433c8-551d-4f62-bf4f-d64198d28e64 {{(pid=102161) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:25:47.025303 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2f429d46-4883-4417-9acb-d66f9f90ba78', 'tag': '4b9ff12f-b81f-43c9-886a-615f9e5be058', 'status': 'completed', 'code': 200} Nov 09 05:25:47.077655 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-aa63ed56-6c61-4bf0-be1d-30ab03d85c25 None None] Set router 3e2008fd-6aec-4b2e-b56a-0934358f106c gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:25:47.092474 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df8bb3a3-6e32-4d80-9417-e29ad8d55ad2 req-6355a220-5708-4536-939d-335641149980 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:25:47.094135 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-df8bb3a3-6e32-4d80-9417-e29ad8d55ad2 req-6355a220-5708-4536-939d-335641149980 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=ceedba48d4ab4ffcb707b41a150b986b&device_id=2f429d46-4883-4417-9acb-d66f9f90ba78 HTTP/1.1" status: 200 len: 1098 time: 0.0470500 Nov 09 05:25:47.187090 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df8bb3a3-6e32-4d80-9417-e29ad8d55ad2 req-029405ac-d459-4313-b8f1-b07da3174e62 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:25:47.188492 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-df8bb3a3-6e32-4d80-9417-e29ad8d55ad2 req-029405ac-d459-4313-b8f1-b07da3174e62 service neutron] 10.222.0.26 "GET /v2.0/networks?id=8b3ee119-8ca9-4512-a0b7-4947c2eb41ed HTTP/1.1" status: 200 len: 911 time: 0.0874481 Nov 09 05:25:47.233605 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-df8bb3a3-6e32-4d80-9417-e29ad8d55ad2 req-40a17075-a031-4a6b-b238-164e03926ea4 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=4b9ff12f-b81f-43c9-886a-615f9e5be058 HTTP/1.1" status: 200 len: 217 time: 0.0383749 Nov 09 05:25:47.284208 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df8bb3a3-6e32-4d80-9417-e29ad8d55ad2 req-7a2be750-a593-4a50-ba22-e47dc74d0b34 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:25:47.285788 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-df8bb3a3-6e32-4d80-9417-e29ad8d55ad2 req-7a2be750-a593-4a50-ba22-e47dc74d0b34 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=85aac8f0-cd4e-40f0-b238-bfb36190a9ad HTTP/1.1" status: 200 len: 849 time: 0.0459270 Nov 09 05:25:47.306025 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-aa63ed56-6c61-4bf0-be1d-30ab03d85c25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'name': 'tempest-TestSnapshotPattern-1474624592-router', 'tenant_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.119'}], 'enable_snat': True}, 'gw_port_id': '89781986-0dc0-4c2f-b390-c38c5e41723e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:21:02Z', 'updated_at': '2021-11-09T05:21:05Z', 'revision_number': 4, 'project_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'gw_port': {'id': '89781986-0dc0-4c2f-b390-c38c5e41723e', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:b5:3c:d4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1856, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.119', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:21:02Z', 'updated_at': '2021-11-09T05:21:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '78f00222-fc32-4d7a-bbda-ac50245d8691', 'tenant_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'floating_ip_address': '172.26.0.15', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'port_id': '498a9507-2cc1-41a9-8335-d8a8ea35a9dc', 'fixed_ip_address': '172.20.0.8', 'status': 'ACTIVE', 'standard_attr_id': 1881, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8b3ee119-8ca9-4512-a0b7-4947c2eb41ed', 'mac_address': 'fa:16:3e:e7:09:4d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '02ab6126-30d5-46d6-89a4-2640d594b5a9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T05:21:28Z', 'updated_at': '2021-11-09T05:21:31Z', 'revision_number': 1, 'project_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a562afa6-7652-4f76-8b5c-24feacfbb57c', 'name': '', 'network_id': '8b3ee119-8ca9-4512-a0b7-4947c2eb41ed', 'tenant_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'mac_address': 'fa:16:3e:61:c7:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1857, 'fixed_ips': [{'subnet_id': '85aac8f0-cd4e-40f0-b238-bfb36190a9ad', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:21:04Z', 'updated_at': '2021-11-09T05:21:08Z', 'revision_number': 5, 'project_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'subnets': [{'id': '85aac8f0-cd4e-40f0-b238-bfb36190a9ad', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:25:47.331974 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df8bb3a3-6e32-4d80-9417-e29ad8d55ad2 req-dce14d89-4d29-4752-84ab-be0ec7aaacf1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:25:47.332233 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aa63ed56-6c61-4bf0-be1d-30ab03d85c25 None None] Checking router: 3e2008fd-6aec-4b2e-b56a-0934358f106c for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 05:25:47.334073 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-df8bb3a3-6e32-4d80-9417-e29ad8d55ad2 req-dce14d89-4d29-4752-84ab-be0ec7aaacf1 service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=8b3ee119-8ca9-4512-a0b7-4947c2eb41ed&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0411081 Nov 09 05:25:47.341279 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aa63ed56-6c61-4bf0-be1d-30ab03d85c25 None None] Routers {'3e2008fd-6aec-4b2e-b56a-0934358f106c'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:25:47.341874 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-aa63ed56-6c61-4bf0-be1d-30ab03d85c25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:25:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['3e2008fd-6aec-4b2e-b56a-0934358f106c'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:25:47.440891 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-df8bb3a3-6e32-4d80-9417-e29ad8d55ad2 req-1c9f52bd-cf04-43bb-b15d-8d3687d3c622 service neutron] 10.222.0.26 "GET /v2.0/networks/8b3ee119-8ca9-4512-a0b7-4947c2eb41ed?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0978458 Nov 09 05:25:47.452279 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-aa63ed56-6c61-4bf0-be1d-30ab03d85c25 None None] Set router 3e2008fd-6aec-4b2e-b56a-0934358f106c gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:25:47.565026 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-df8bb3a3-6e32-4d80-9417-e29ad8d55ad2 req-b2026624-c6d4-45b1-941d-b9f90d1b2d87 service neutron] 10.222.0.26 "GET /v2.0/networks/8b3ee119-8ca9-4512-a0b7-4947c2eb41ed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1167896 Nov 09 05:25:47.574830 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa78fa11-d682-4c1b-82ed-385aa20ecb38 req-2bd2fc4c-4096-443a-a3ed-3ee421b8606e tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:25:47.579880 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fa78fa11-d682-4c1b-82ed-385aa20ecb38 req-2bd2fc4c-4096-443a-a3ed-3ee421b8606e tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/ports?device_id=2f429d46-4883-4417-9acb-d66f9f90ba78 HTTP/1.1" status: 200 len: 945 time: 0.1745529 Nov 09 05:25:47.632247 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-fa78fa11-d682-4c1b-82ed-385aa20ecb38 req-08d19991-b6e5-4af8-b82a-ff568ce54c77 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/security-groups?id=11ff3dd7-fb6d-4cff-8806-7229476345b0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0501473 Nov 09 05:25:47.762920 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-aa63ed56-6c61-4bf0-be1d-30ab03d85c25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'name': 'tempest-TestSnapshotPattern-1474624592-router', 'tenant_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.119'}], 'enable_snat': True}, 'gw_port_id': '89781986-0dc0-4c2f-b390-c38c5e41723e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:21:02Z', 'updated_at': '2021-11-09T05:21:05Z', 'revision_number': 4, 'project_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'gw_port': {'id': '89781986-0dc0-4c2f-b390-c38c5e41723e', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:b5:3c:d4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1856, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.119', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:21:02Z', 'updated_at': '2021-11-09T05:21:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '78f00222-fc32-4d7a-bbda-ac50245d8691', 'tenant_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'floating_ip_address': '172.26.0.15', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'port_id': '498a9507-2cc1-41a9-8335-d8a8ea35a9dc', 'fixed_ip_address': '172.20.0.8', 'status': 'ACTIVE', 'standard_attr_id': 1881, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8b3ee119-8ca9-4512-a0b7-4947c2eb41ed', 'mac_address': 'fa:16:3e:e7:09:4d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '02ab6126-30d5-46d6-89a4-2640d594b5a9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T05:21:28Z', 'updated_at': '2021-11-09T05:21:31Z', 'revision_number': 1, 'project_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a562afa6-7652-4f76-8b5c-24feacfbb57c', 'name': '', 'network_id': '8b3ee119-8ca9-4512-a0b7-4947c2eb41ed', 'tenant_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'mac_address': 'fa:16:3e:61:c7:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1857, 'fixed_ips': [{'subnet_id': '85aac8f0-cd4e-40f0-b238-bfb36190a9ad', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:21:04Z', 'updated_at': '2021-11-09T05:21:08Z', 'revision_number': 5, 'project_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'subnets': [{'id': '85aac8f0-cd4e-40f0-b238-bfb36190a9ad', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:25:47.791263 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aa63ed56-6c61-4bf0-be1d-30ab03d85c25 None None] The sync data for ids ['3e2008fd-6aec-4b2e-b56a-0934358f106c'] in dv-neutron-816802-2-hyperv is: [{'id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'name': 'tempest-TestSnapshotPattern-1474624592-router', 'tenant_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.119'}], 'enable_snat': True}, 'gw_port_id': '89781986-0dc0-4c2f-b390-c38c5e41723e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:21:02Z', 'updated_at': '2021-11-09T05:21:05Z', 'revision_number': 4, 'project_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'gw_port': {'id': '89781986-0dc0-4c2f-b390-c38c5e41723e', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:b5:3c:d4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1856, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.119', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:21:02Z', 'updated_at': '2021-11-09T05:21:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_floatingips': [{'id': '78f00222-fc32-4d7a-bbda-ac50245d8691', 'tenant_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'floating_ip_address': '172.26.0.15', 'floating_network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'router_id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'port_id': '498a9507-2cc1-41a9-8335-d8a8ea35a9dc', 'fixed_ip_address': '172.20.0.8', 'status': 'ACTIVE', 'standard_attr_id': 1881, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8b3ee119-8ca9-4512-a0b7-4947c2eb41ed', 'mac_address': 'fa:16:3e:e7:09:4d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '02ab6126-30d5-46d6-89a4-2640d594b5a9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-09T05:21:28Z', 'updated_at': '2021-11-09T05:21:31Z', 'revision_number': 1, 'project_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a562afa6-7652-4f76-8b5c-24feacfbb57c', 'name': '', 'network_id': '8b3ee119-8ca9-4512-a0b7-4947c2eb41ed', 'tenant_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'mac_address': 'fa:16:3e:61:c7:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1857, 'fixed_ips': [{'subnet_id': '85aac8f0-cd4e-40f0-b238-bfb36190a9ad', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:21:04Z', 'updated_at': '2021-11-09T05:21:08Z', 'revision_number': 5, 'project_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'subnets': [{'id': '85aac8f0-cd4e-40f0-b238-bfb36190a9ad', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 05:25:48.020844 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6548419e-82b9-4f5d-9b3e-230626f2e8de None None] New status for floating IP 982a898e-0e47-4394-8d47-e87b423517c9: DOWN {{(pid=102163) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 05:25:48.514805 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 4b9ff12f-b81f-43c9-886a-615f9e5be058 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 05:25:48.590735 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-598808'] for port, before_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:48.611854 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2f429d46-4883-4417-9acb-d66f9f90ba78', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '4b9ff12f-b81f-43c9-886a-615f9e5be058'}] {{(pid=102163) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:25:48.614045 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8c820a47ce791f029e4ab78d75743093dac365431608b1f90e62ae1ff12bdff5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-47b52bf4-4aa6-4ddd-8043-68fbcc230a82" -d '{"events": [{"server_uuid": "2f429d46-4883-4417-9acb-d66f9f90ba78", "name": "network-vif-unplugged", "status": "completed", "tag": "4b9ff12f-b81f-43c9-886a-615f9e5be058"}]}' {{(pid=102163) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:25:48.626481 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] For port 4b9ff12f-b81f-43c9-886a-615f9e5be058, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=4b9ff12f-b81f-43c9-886a-615f9e5be058,segment=NetworkSegment(7f482fc6-4887-4d69-a152-097f906532cc),segment_id=7f482fc6-4887-4d69-a152-097f906532cc)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:25:48.649876 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 09 Nov 2021 05:25:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e3e67d2f-b839-49d5-a149-7ca612f8413e x-openstack-request-id: req-e3e67d2f-b839-49d5-a149-7ca612f8413e {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:25:48.650166 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2f429d46-4883-4417-9acb-d66f9f90ba78", "name": "network-vif-unplugged", "status": "completed", "tag": "4b9ff12f-b81f-43c9-886a-615f9e5be058", "code": 200}]} {{(pid=102163) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:25:48.650445 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-e3e67d2f-b839-49d5-a149-7ca612f8413e {{(pid=102163) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:25:48.650864 dv-neutron-816802-2-hyperv neutron-server[102163]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2f429d46-4883-4417-9acb-d66f9f90ba78', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '4b9ff12f-b81f-43c9-886a-615f9e5be058', 'code': 200} Nov 09 05:25:48.698266 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8756747267220', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8756746785702', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8756746785720'] for port, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:48.749743 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e76fcfa2-3b25-43a8-9db9-c71f99052ebd req-fb38f74f-1855-4397-9ce1-a0261e3f446c tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:25:48.750399 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Pushing event updated for resources: {'Port': ['ID=4b9ff12f-b81f-43c9-886a-615f9e5be058,revision_number=8']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:25:48.751242 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e76fcfa2-3b25-43a8-9db9-c71f99052ebd req-fb38f74f-1855-4397-9ce1-a0261e3f446c tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/ports?device_id=2f429d46-4883-4417-9acb-d66f9f90ba78 HTTP/1.1" status: 200 len: 943 time: 0.0507803 Nov 09 05:25:48.801294 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-e76fcfa2-3b25-43a8-9db9-c71f99052ebd req-0dee41d4-3486-4af6-b7aa-eecc71c78673 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/security-groups?id=11ff3dd7-fb6d-4cff-8806-7229476345b0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430989 Nov 09 05:25:48.918214 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d98dc99-612f-447b-aa88-c199071a16cb req-f9f93e62-cb37-48a4-9efc-3ad6da47f4aa tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:25:48.919676 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3d98dc99-612f-447b-aa88-c199071a16cb req-f9f93e62-cb37-48a4-9efc-3ad6da47f4aa tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.26 "GET /v2.0/ports?device_id=2f429d46-4883-4417-9acb-d66f9f90ba78 HTTP/1.1" status: 200 len: 943 time: 0.0490329 Nov 09 05:25:49.012297 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-3d98dc99-612f-447b-aa88-c199071a16cb req-e8d9f5b2-6a73-4836-9cc9-764e1d431619 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Deleting port 4b9ff12f-b81f-43c9-886a-615f9e5be058 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:25:49.012653 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-3d98dc99-612f-447b-aa88-c199071a16cb req-e8d9f5b2-6a73-4836-9cc9-764e1d431619 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:49.099040 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-3d98dc99-612f-447b-aa88-c199071a16cb req-e8d9f5b2-6a73-4836-9cc9-764e1d431619 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] For port 4b9ff12f-b81f-43c9-886a-615f9e5be058, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=4b9ff12f-b81f-43c9-886a-615f9e5be058,segment=NetworkSegment(7f482fc6-4887-4d69-a152-097f906532cc),segment_id=7f482fc6-4887-4d69-a152-097f906532cc)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:25:49.099307 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-3d98dc99-612f-447b-aa88-c199071a16cb req-e8d9f5b2-6a73-4836-9cc9-764e1d431619 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:49.111735 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-3d98dc99-612f-447b-aa88-c199071a16cb req-e8d9f5b2-6a73-4836-9cc9-764e1d431619 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Calling delete_port for 4b9ff12f-b81f-43c9-886a-615f9e5be058 owned by compute:nova {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:25:49.292793 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-3d98dc99-612f-447b-aa88-c199071a16cb req-e8d9f5b2-6a73-4836-9cc9-764e1d431619 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:49.321494 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8d9f5b2-6a73-4836-9cc9-764e1d431619 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Pushing event deleted for resources: {'Port': ['ID=4b9ff12f-b81f-43c9-886a-615f9e5be058,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:25:49.333170 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8d9f5b2-6a73-4836-9cc9-764e1d431619 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:25:49.333520 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8d9f5b2-6a73-4836-9cc9-764e1d431619 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:25:49.333864 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8d9f5b2-6a73-4836-9cc9-764e1d431619 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:25:49.334200 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8d9f5b2-6a73-4836-9cc9-764e1d431619 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:25:49.334555 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8d9f5b2-6a73-4836-9cc9-764e1d431619 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:25:49.334888 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8d9f5b2-6a73-4836-9cc9-764e1d431619 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:25:49.335214 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8d9f5b2-6a73-4836-9cc9-764e1d431619 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:25:49.335537 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8d9f5b2-6a73-4836-9cc9-764e1d431619 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:25:49.335862 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8d9f5b2-6a73-4836-9cc9-764e1d431619 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:25:49.336181 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8d9f5b2-6a73-4836-9cc9-764e1d431619 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:25:49.336503 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8d9f5b2-6a73-4836-9cc9-764e1d431619 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:25:49.336820 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8d9f5b2-6a73-4836-9cc9-764e1d431619 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816802-2-hyperv {{(pid=102162) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 09 05:25:49.374836 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-3d98dc99-612f-447b-aa88-c199071a16cb req-e8d9f5b2-6a73-4836-9cc9-764e1d431619 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] No DVR routers for this DVR port 4b9ff12f-b81f-43c9-886a-615f9e5be058 on host hv-neutron-8168 {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 05:25:49.377329 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-3d98dc99-612f-447b-aa88-c199071a16cb req-e8d9f5b2-6a73-4836-9cc9-764e1d431619 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:49.380724 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-3d98dc99-612f-447b-aa88-c199071a16cb req-e8d9f5b2-6a73-4836-9cc9-764e1d431619 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.26 "DELETE /v2.0/ports/4b9ff12f-b81f-43c9-886a-615f9e5be058 HTTP/1.1" status: 204 len: 173 time: 0.4548328 Nov 09 05:25:49.381161 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2f429d46-4883-4417-9acb-d66f9f90ba78', 'name': 'network-vif-deleted', 'tag': '4b9ff12f-b81f-43c9-886a-615f9e5be058'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:25:49.383481 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e0cee686-7d80-4533-8f02-fd1c1fb48c39" -d '{"events": [{"server_uuid": "2f429d46-4883-4417-9acb-d66f9f90ba78", "name": "network-vif-deleted", "tag": "4b9ff12f-b81f-43c9-886a-615f9e5be058"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:25:49.419263 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 05:25:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-070fb3e0-6223-4699-bf01-9eb434bc0a72 x-openstack-request-id: req-070fb3e0-6223-4699-bf01-9eb434bc0a72 {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:25:49.419556 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2f429d46-4883-4417-9acb-d66f9f90ba78", "name": "network-vif-deleted", "tag": "4b9ff12f-b81f-43c9-886a-615f9e5be058", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:25:49.419829 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-070fb3e0-6223-4699-bf01-9eb434bc0a72 {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:25:49.420202 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2f429d46-4883-4417-9acb-d66f9f90ba78', 'name': 'network-vif-deleted', 'tag': '4b9ff12f-b81f-43c9-886a-615f9e5be058', 'status': 'completed', 'code': 200} Nov 09 05:25:49.920674 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-d66cd032-7495-4d65-b5a7-7dbf4d6093b2 req-9855a3d9-fe94-4c51-8115-8db3a5e8257a tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/ports?device_id=2f429d46-4883-4417-9acb-d66f9f90ba78 HTTP/1.1" status: 200 len: 210 time: 0.0261099 Nov 09 05:25:52.247350 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 39412) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:25:52.400684 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-b8b27fdb-04ba-4f7f-afa2-918dc7ef7387 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Deleting port ab607fc8-143a-4715-9a6b-2281cc8587d3 {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:25:52.401016 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b8b27fdb-04ba-4f7f-afa2-918dc7ef7387 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:52.477148 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b8b27fdb-04ba-4f7f-afa2-918dc7ef7387 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:52.477477 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b8b27fdb-04ba-4f7f-afa2-918dc7ef7387 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:52.488906 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-b8b27fdb-04ba-4f7f-afa2-918dc7ef7387 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Calling delete_port for ab607fc8-143a-4715-9a6b-2281cc8587d3 owned by network:floatingip {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:25:52.549143 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 4b9ff12f-b81f-43c9-886a-615f9e5be058 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 05:25:52.572046 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] No Port match for: 4b9ff12f-b81f-43c9-886a-615f9e5be058 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 05:25:52.572387 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 4b9ff12f-b81f-43c9-886a-615f9e5be058 not bound to the agent host hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 05:25:52.687159 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b8b27fdb-04ba-4f7f-afa2-918dc7ef7387 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:52.713899 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8b27fdb-04ba-4f7f-afa2-918dc7ef7387 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Pushing event deleted for resources: {'Port': ['ID=ab607fc8-143a-4715-9a6b-2281cc8587d3,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:25:52.774696 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b8b27fdb-04ba-4f7f-afa2-918dc7ef7387 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks [] for floatingip, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:52.775023 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.db.l3_db [None req-b8b27fdb-04ba-4f7f-afa2-918dc7ef7387 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Floating IP 78f00222-fc32-4d7a-bbda-ac50245d8691 disassociated (deleted). External IP: 172.26.0.15, port: 498a9507-2cc1-41a9-8335-d8a8ea35a9dc. Nov 09 05:25:52.978452 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b8b27fdb-04ba-4f7f-afa2-918dc7ef7387 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Router 3e2008fd-6aec-4b2e-b56a-0934358f106c has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 05:25:53.085463 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b8b27fdb-04ba-4f7f-afa2-918dc7ef7387 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 05:25:53.090132 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-b8b27fdb-04ba-4f7f-afa2-918dc7ef7387 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for floatingip, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:53.094612 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1cdebf67-5c37-4213-96bb-392c80d1ff9c None None] Sync routers for ids ['3e2008fd-6aec-4b2e-b56a-0934358f106c'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 05:25:53.104354 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1cdebf67-5c37-4213-96bb-392c80d1ff9c None None] Routers {'3e2008fd-6aec-4b2e-b56a-0934358f106c'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:25:53.104949 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-1cdebf67-5c37-4213-96bb-392c80d1ff9c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:25:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['3e2008fd-6aec-4b2e-b56a-0934358f106c'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:25:53.118923 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-b8b27fdb-04ba-4f7f-afa2-918dc7ef7387 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "DELETE /v2.0/floatingips/78f00222-fc32-4d7a-bbda-ac50245d8691 HTTP/1.1" status: 204 len: 168 time: 0.8681836 Nov 09 05:25:53.118923 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '02ab6126-30d5-46d6-89a4-2640d594b5a9', 'tag': '498a9507-2cc1-41a9-8335-d8a8ea35a9dc'}] {{(pid=102161) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:25:53.119387 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}99dfdda0def497b4372884ef2eb87f06b1e425c8eba5ceda5f64bbab037a07d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6a7bc5dd-e80e-4a8f-864f-ce1a0ac1b8a5" -d '{"events": [{"name": "network-changed", "server_uuid": "02ab6126-30d5-46d6-89a4-2640d594b5a9", "tag": "498a9507-2cc1-41a9-8335-d8a8ea35a9dc"}]}' {{(pid=102161) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:25:53.161480 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 09 Nov 2021 05:25:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e5198382-4901-4d25-b1f8-f684bb9566e9 x-openstack-request-id: req-e5198382-4901-4d25-b1f8-f684bb9566e9 {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:25:53.161866 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "02ab6126-30d5-46d6-89a4-2640d594b5a9", "tag": "498a9507-2cc1-41a9-8335-d8a8ea35a9dc", "status": "completed", "code": 200}]} {{(pid=102161) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:25:53.162323 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-e5198382-4901-4d25-b1f8-f684bb9566e9 {{(pid=102161) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:25:53.162852 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '02ab6126-30d5-46d6-89a4-2640d594b5a9', 'tag': '498a9507-2cc1-41a9-8335-d8a8ea35a9dc', 'status': 'completed', 'code': 200} Nov 09 05:25:53.216882 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-1cdebf67-5c37-4213-96bb-392c80d1ff9c None None] Set router 3e2008fd-6aec-4b2e-b56a-0934358f106c gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:25:53.232089 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a7bc5dd-e80e-4a8f-864f-ce1a0ac1b8a5 req-7bf38dc7-b91c-42d1-a32e-cffc97e17e71 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:25:53.233536 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6a7bc5dd-e80e-4a8f-864f-ce1a0ac1b8a5 req-7bf38dc7-b91c-42d1-a32e-cffc97e17e71 service neutron] 10.222.0.26 "GET /v2.0/ports?tenant_id=ceedba48d4ab4ffcb707b41a150b986b&device_id=02ab6126-30d5-46d6-89a4-2640d594b5a9 HTTP/1.1" status: 200 len: 1096 time: 0.0497174 Nov 09 05:25:53.330734 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a7bc5dd-e80e-4a8f-864f-ce1a0ac1b8a5 req-685d35c7-6959-4c3e-a08d-fd6aa197883e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:25:53.332198 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6a7bc5dd-e80e-4a8f-864f-ce1a0ac1b8a5 req-685d35c7-6959-4c3e-a08d-fd6aa197883e service neutron] 10.222.0.26 "GET /v2.0/networks?id=8b3ee119-8ca9-4512-a0b7-4947c2eb41ed HTTP/1.1" status: 200 len: 911 time: 0.0884614 Nov 09 05:25:53.377029 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6a7bc5dd-e80e-4a8f-864f-ce1a0ac1b8a5 req-608569cc-67e4-4d7c-b115-d4d720e36b72 service neutron] 10.222.0.26 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=498a9507-2cc1-41a9-8335-d8a8ea35a9dc HTTP/1.1" status: 200 len: 217 time: 0.0373428 Nov 09 05:25:53.414118 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-1cdebf67-5c37-4213-96bb-392c80d1ff9c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'name': 'tempest-TestSnapshotPattern-1474624592-router', 'tenant_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.119'}], 'enable_snat': True}, 'gw_port_id': '89781986-0dc0-4c2f-b390-c38c5e41723e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:21:02Z', 'updated_at': '2021-11-09T05:21:05Z', 'revision_number': 4, 'project_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'gw_port': {'id': '89781986-0dc0-4c2f-b390-c38c5e41723e', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:b5:3c:d4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1856, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.119', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:21:02Z', 'updated_at': '2021-11-09T05:21:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'a562afa6-7652-4f76-8b5c-24feacfbb57c', 'name': '', 'network_id': '8b3ee119-8ca9-4512-a0b7-4947c2eb41ed', 'tenant_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'mac_address': 'fa:16:3e:61:c7:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1857, 'fixed_ips': [{'subnet_id': '85aac8f0-cd4e-40f0-b238-bfb36190a9ad', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:21:04Z', 'updated_at': '2021-11-09T05:21:08Z', 'revision_number': 5, 'project_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'subnets': [{'id': '85aac8f0-cd4e-40f0-b238-bfb36190a9ad', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:25:53.427983 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a7bc5dd-e80e-4a8f-864f-ce1a0ac1b8a5 req-cf62ac48-41e0-4f4b-8bd1-cbcbec63b270 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:25:53.429574 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6a7bc5dd-e80e-4a8f-864f-ce1a0ac1b8a5 req-cf62ac48-41e0-4f4b-8bd1-cbcbec63b270 service neutron] 10.222.0.26 "GET /v2.0/subnets?id=85aac8f0-cd4e-40f0-b238-bfb36190a9ad HTTP/1.1" status: 200 len: 849 time: 0.0457509 Nov 09 05:25:53.445021 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1cdebf67-5c37-4213-96bb-392c80d1ff9c None None] Checking router: 3e2008fd-6aec-4b2e-b56a-0934358f106c for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 05:25:53.453409 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1cdebf67-5c37-4213-96bb-392c80d1ff9c None None] Routers {'3e2008fd-6aec-4b2e-b56a-0934358f106c'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:25:53.454007 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-1cdebf67-5c37-4213-96bb-392c80d1ff9c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:25:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['3e2008fd-6aec-4b2e-b56a-0934358f106c'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:25:53.488729 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a7bc5dd-e80e-4a8f-864f-ce1a0ac1b8a5 req-789b131a-2906-436f-a41c-3f27ed07f0da service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:25:53.488729 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6a7bc5dd-e80e-4a8f-864f-ce1a0ac1b8a5 req-789b131a-2906-436f-a41c-3f27ed07f0da service neutron] 10.222.0.26 "GET /v2.0/ports?network_id=8b3ee119-8ca9-4512-a0b7-4947c2eb41ed&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0495431 Nov 09 05:25:53.567712 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-1cdebf67-5c37-4213-96bb-392c80d1ff9c None None] Set router 3e2008fd-6aec-4b2e-b56a-0934358f106c gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:25:53.573967 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb657b7c-5f9e-4332-9b3b-493647fa1924 req-14991dc6-7cc1-4e1a-812b-c7e7b278aac1 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102161) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:25:53.576167 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-cb657b7c-5f9e-4332-9b3b-493647fa1924 req-14991dc6-7cc1-4e1a-812b-c7e7b278aac1 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/ports?device_id=02ab6126-30d5-46d6-89a4-2640d594b5a9 HTTP/1.1" status: 200 len: 943 time: 0.1062040 Nov 09 05:25:53.583766 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6a7bc5dd-e80e-4a8f-864f-ce1a0ac1b8a5 req-2e60aedc-25b2-4dbc-8e80-6be3017518e3 service neutron] 10.222.0.26 "GET /v2.0/networks/8b3ee119-8ca9-4512-a0b7-4947c2eb41ed?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0884140 Nov 09 05:25:53.628091 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [req-cb657b7c-5f9e-4332-9b3b-493647fa1924 req-79e82d6c-9471-4133-a6dd-b640092fb1c4 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/security-groups?id=11ff3dd7-fb6d-4cff-8806-7229476345b0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439255 Nov 09 05:25:53.683024 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6a7bc5dd-e80e-4a8f-864f-ce1a0ac1b8a5 req-51eecccd-534b-4981-9701-7c40dec09be6 service neutron] 10.222.0.26 "GET /v2.0/networks/8b3ee119-8ca9-4512-a0b7-4947c2eb41ed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0913267 Nov 09 05:25:53.764497 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-1cdebf67-5c37-4213-96bb-392c80d1ff9c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'name': 'tempest-TestSnapshotPattern-1474624592-router', 'tenant_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.119'}], 'enable_snat': True}, 'gw_port_id': '89781986-0dc0-4c2f-b390-c38c5e41723e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:21:02Z', 'updated_at': '2021-11-09T05:21:05Z', 'revision_number': 4, 'project_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'gw_port': {'id': '89781986-0dc0-4c2f-b390-c38c5e41723e', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:b5:3c:d4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1856, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.119', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:21:02Z', 'updated_at': '2021-11-09T05:21:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'a562afa6-7652-4f76-8b5c-24feacfbb57c', 'name': '', 'network_id': '8b3ee119-8ca9-4512-a0b7-4947c2eb41ed', 'tenant_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'mac_address': 'fa:16:3e:61:c7:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1857, 'fixed_ips': [{'subnet_id': '85aac8f0-cd4e-40f0-b238-bfb36190a9ad', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:21:04Z', 'updated_at': '2021-11-09T05:21:08Z', 'revision_number': 5, 'project_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'subnets': [{'id': '85aac8f0-cd4e-40f0-b238-bfb36190a9ad', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:25:53.795508 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1cdebf67-5c37-4213-96bb-392c80d1ff9c None None] The sync data for ids ['3e2008fd-6aec-4b2e-b56a-0934358f106c'] in dv-neutron-816802-2-hyperv is: [{'id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'name': 'tempest-TestSnapshotPattern-1474624592-router', 'tenant_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.119'}], 'enable_snat': True}, 'gw_port_id': '89781986-0dc0-4c2f-b390-c38c5e41723e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:21:02Z', 'updated_at': '2021-11-09T05:21:05Z', 'revision_number': 4, 'project_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'gw_port': {'id': '89781986-0dc0-4c2f-b390-c38c5e41723e', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:b5:3c:d4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1856, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.119', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:21:02Z', 'updated_at': '2021-11-09T05:21:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv', '_interfaces': [{'id': 'a562afa6-7652-4f76-8b5c-24feacfbb57c', 'name': '', 'network_id': '8b3ee119-8ca9-4512-a0b7-4947c2eb41ed', 'tenant_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'mac_address': 'fa:16:3e:61:c7:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1857, 'fixed_ips': [{'subnet_id': '85aac8f0-cd4e-40f0-b238-bfb36190a9ad', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:21:04Z', 'updated_at': '2021-11-09T05:21:08Z', 'revision_number': 5, 'project_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'subnets': [{'id': '85aac8f0-cd4e-40f0-b238-bfb36190a9ad', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 05:25:54.000532 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bc84361c-6954-4b4d-b1b4-98bcbc955b57 None None] New status for floating IP 78f00222-fc32-4d7a-bbda-ac50245d8691: DOWN {{(pid=102163) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 09 05:25:54.743641 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b0a4cdb-3234-4c0c-b7fc-c0ceab56e5e1 req-79a17bc4-5f91-41e5-a805-7dff09982b14 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:25:54.745119 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6b0a4cdb-3234-4c0c-b7fc-c0ceab56e5e1 req-79a17bc4-5f91-41e5-a805-7dff09982b14 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/ports?device_id=02ab6126-30d5-46d6-89a4-2640d594b5a9 HTTP/1.1" status: 200 len: 943 time: 0.0486317 Nov 09 05:25:54.794019 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-6b0a4cdb-3234-4c0c-b7fc-c0ceab56e5e1 req-d475b5da-1619-4fd7-91d1-8e81a54e6b85 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/security-groups?id=11ff3dd7-fb6d-4cff-8806-7229476345b0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429406 Nov 09 05:25:55.028428 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e528d5c-616a-4c8c-a536-c550ca0f7359 req-f2d26d8a-ebb4-4f74-b983-f0800ae20c2b tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102162) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 09 05:25:55.029951 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5e528d5c-616a-4c8c-a536-c550ca0f7359 req-f2d26d8a-ebb4-4f74-b983-f0800ae20c2b tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.26 "GET /v2.0/ports?device_id=02ab6126-30d5-46d6-89a4-2640d594b5a9 HTTP/1.1" status: 200 len: 943 time: 0.0475240 Nov 09 05:25:55.121169 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-5e528d5c-616a-4c8c-a536-c550ca0f7359 req-91032249-daa3-4310-8cb3-efad1c89a01d tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Deleting port 498a9507-2cc1-41a9-8335-d8a8ea35a9dc {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:25:55.121495 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-5e528d5c-616a-4c8c-a536-c550ca0f7359 req-91032249-daa3-4310-8cb3-efad1c89a01d tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:55.206461 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [req-5e528d5c-616a-4c8c-a536-c550ca0f7359 req-91032249-daa3-4310-8cb3-efad1c89a01d tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] For port 498a9507-2cc1-41a9-8335-d8a8ea35a9dc, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=498a9507-2cc1-41a9-8335-d8a8ea35a9dc,segment=NetworkSegment(7f482fc6-4887-4d69-a152-097f906532cc),segment_id=7f482fc6-4887-4d69-a152-097f906532cc)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:25:55.206814 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-5e528d5c-616a-4c8c-a536-c550ca0f7359 req-91032249-daa3-4310-8cb3-efad1c89a01d tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:55.218945 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [req-5e528d5c-616a-4c8c-a536-c550ca0f7359 req-91032249-daa3-4310-8cb3-efad1c89a01d tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Calling delete_port for 498a9507-2cc1-41a9-8335-d8a8ea35a9dc owned by compute:nova {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:25:55.412474 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-5e528d5c-616a-4c8c-a536-c550ca0f7359 req-91032249-daa3-4310-8cb3-efad1c89a01d tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:55.437614 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91032249-daa3-4310-8cb3-efad1c89a01d tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Pushing event deleted for resources: {'Port': ['ID=498a9507-2cc1-41a9-8335-d8a8ea35a9dc,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:25:55.484683 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [req-5e528d5c-616a-4c8c-a536-c550ca0f7359 req-91032249-daa3-4310-8cb3-efad1c89a01d tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] No DVR routers for this DVR port 498a9507-2cc1-41a9-8335-d8a8ea35a9dc on host hv-neutron-8168 {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 05:25:55.488984 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [req-5e528d5c-616a-4c8c-a536-c550ca0f7359 req-91032249-daa3-4310-8cb3-efad1c89a01d tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1983533'] for port, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:55.490688 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-5e528d5c-616a-4c8c-a536-c550ca0f7359 req-91032249-daa3-4310-8cb3-efad1c89a01d tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.26 "DELETE /v2.0/ports/498a9507-2cc1-41a9-8335-d8a8ea35a9dc HTTP/1.1" status: 204 len: 173 time: 0.4548950 Nov 09 05:25:55.491140 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '02ab6126-30d5-46d6-89a4-2640d594b5a9', 'name': 'network-vif-deleted', 'tag': '498a9507-2cc1-41a9-8335-d8a8ea35a9dc'}] {{(pid=102162) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 09 05:25:55.493357 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.24/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}02508515116eaa5be16ac337b2b6e6f6a806433239e8b391a2ff29efb5143525" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9335c117-f04c-4252-b089-2173ea3d120b" -d '{"events": [{"server_uuid": "02ab6126-30d5-46d6-89a4-2640d594b5a9", "name": "network-vif-deleted", "tag": "498a9507-2cc1-41a9-8335-d8a8ea35a9dc"}]}' {{(pid=102162) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 09 05:25:55.529252 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 09 Nov 2021 05:25:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2c0f4deb-e9c1-42f3-8ae5-d6c6775e7468 x-openstack-request-id: req-2c0f4deb-e9c1-42f3-8ae5-d6c6775e7468 {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 09 05:25:55.529539 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "02ab6126-30d5-46d6-89a4-2640d594b5a9", "name": "network-vif-deleted", "tag": "498a9507-2cc1-41a9-8335-d8a8ea35a9dc", "status": "completed", "code": 200}]} {{(pid=102162) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 09 05:25:55.529791 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.24/compute/v2.1/os-server-external-events used request id req-2c0f4deb-e9c1-42f3-8ae5-d6c6775e7468 {{(pid=102162) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 09 05:25:55.530191 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '02ab6126-30d5-46d6-89a4-2640d594b5a9', 'name': 'network-vif-deleted', 'tag': '498a9507-2cc1-41a9-8335-d8a8ea35a9dc', 'status': 'completed', 'code': 200} Nov 09 05:25:55.905233 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [req-60f6f112-2834-42ff-9684-aa3fea66c894 req-299655ad-2058-46bf-b934-9ee3a6bcb900 tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "GET /v2.0/ports?device_id=02ab6126-30d5-46d6-89a4-2640d594b5a9 HTTP/1.1" status: 200 len: 210 time: 0.0286067 Nov 09 05:25:56.961149 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 39430) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:25:57.016302 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7cb362e0-d110-4e7f-b86c-5768baf023af tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks [] for security_group, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:57.047773 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7cb362e0-d110-4e7f-b86c-5768baf023af tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:57.178393 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7cb362e0-d110-4e7f-b86c-5768baf023af tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:57.180980 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-7cb362e0-d110-4e7f-b86c-5768baf023af tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Publish callbacks [] for security_group, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:57.182156 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-7cb362e0-d110-4e7f-b86c-5768baf023af tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] 10.222.0.24 "DELETE /v2.0/security-groups/11ff3dd7-fb6d-4cff-8806-7229476345b0 HTTP/1.1" status: 204 len: 168 time: 0.2200549 Nov 09 05:25:57.191749 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cb362e0-d110-4e7f-b86c-5768baf023af tempest-TestSnapshotPattern-2016321499 tempest-TestSnapshotPattern-2016321499-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=11ff3dd7-fb6d-4cff-8806-7229476345b0,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:25:57.281067 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 39434) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:25:57.625641 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-38044796-cb80-45e5-9b70-d40feec2117a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:57.877212 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-38044796-cb80-45e5-9b70-d40feec2117a admin admin] Deleting port a562afa6-7652-4f76-8b5c-24feacfbb57c {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:25:57.877644 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-38044796-cb80-45e5-9b70-d40feec2117a admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:57.962664 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-38044796-cb80-45e5-9b70-d40feec2117a admin admin] For port a562afa6-7652-4f76-8b5c-24feacfbb57c, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=a562afa6-7652-4f76-8b5c-24feacfbb57c,segment=NetworkSegment(7f482fc6-4887-4d69-a152-097f906532cc),segment_id=7f482fc6-4887-4d69-a152-097f906532cc)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:25:57.963355 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-38044796-cb80-45e5-9b70-d40feec2117a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:57.975461 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-38044796-cb80-45e5-9b70-d40feec2117a admin admin] Calling delete_port for a562afa6-7652-4f76-8b5c-24feacfbb57c owned by network:router_interface {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:25:58.189008 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-38044796-cb80-45e5-9b70-d40feec2117a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:58.214416 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38044796-cb80-45e5-9b70-d40feec2117a admin admin] Pushing event deleted for resources: {'Port': ['ID=a562afa6-7652-4f76-8b5c-24feacfbb57c,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:25:58.379565 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-38044796-cb80-45e5-9b70-d40feec2117a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:58.586117 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-38044796-cb80-45e5-9b70-d40feec2117a admin admin] Router 3e2008fd-6aec-4b2e-b56a-0934358f106c has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102161) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 05:25:58.595965 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 498a9507-2cc1-41a9-8335-d8a8ea35a9dc no longer exists at agent hyperv_hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 05:25:58.616481 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] No Port match for: 498a9507-2cc1-41a9-8335-d8a8ea35a9dc {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 05:25:58.616828 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Device 498a9507-2cc1-41a9-8335-d8a8ea35a9dc not bound to the agent host hv-neutron-8168 {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 05:25:58.690898 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-38044796-cb80-45e5-9b70-d40feec2117a admin admin] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102161) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 05:25:58.695913 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-38044796-cb80-45e5-9b70-d40feec2117a admin admin] 10.222.0.24 "PUT /v2.0/routers/3e2008fd-6aec-4b2e-b56a-0934358f106c/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4135571 Nov 09 05:25:58.698460 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 39436) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:25:58.699346 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4947c925-86bd-44c0-9678-8259e6ed6da1 None None] Sync routers for ids ['3e2008fd-6aec-4b2e-b56a-0934358f106c'] in dv-neutron-816802-2-hyperv {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 05:25:58.708972 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4947c925-86bd-44c0-9678-8259e6ed6da1 None None] Routers {'3e2008fd-6aec-4b2e-b56a-0934358f106c'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:25:58.709569 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-4947c925-86bd-44c0-9678-8259e6ed6da1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:25:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['3e2008fd-6aec-4b2e-b56a-0934358f106c'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:25:58.805566 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f5dde178-c070-41b9-aed8-77997e2918bd admin admin] Publish callbacks [] for router, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:58.813367 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-4947c925-86bd-44c0-9678-8259e6ed6da1 None None] Set router 3e2008fd-6aec-4b2e-b56a-0934358f106c gateway port host: dv-neutron-816802-2-hyperv {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:25:58.927362 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f5dde178-c070-41b9-aed8-77997e2918bd admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:58.996518 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-4947c925-86bd-44c0-9678-8259e6ed6da1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'name': 'tempest-TestSnapshotPattern-1474624592-router', 'tenant_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.119'}], 'enable_snat': True}, 'gw_port_id': '89781986-0dc0-4c2f-b390-c38c5e41723e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:21:02Z', 'updated_at': '2021-11-09T05:25:58Z', 'revision_number': 5, 'project_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'gw_port': {'id': '89781986-0dc0-4c2f-b390-c38c5e41723e', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:b5:3c:d4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1856, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.119', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:21:02Z', 'updated_at': '2021-11-09T05:21:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:25:59.022165 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4947c925-86bd-44c0-9678-8259e6ed6da1 None None] Checking router: 3e2008fd-6aec-4b2e-b56a-0934358f106c for host: dv-neutron-816802-2-hyperv {{(pid=102164) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 05:25:59.030517 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4947c925-86bd-44c0-9678-8259e6ed6da1 None None] Routers {'3e2008fd-6aec-4b2e-b56a-0934358f106c'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102164) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:25:59.031108 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-4947c925-86bd-44c0-9678-8259e6ed6da1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:25:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['3e2008fd-6aec-4b2e-b56a-0934358f106c'], 'active': True} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:25:59.044709 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-f5dde178-c070-41b9-aed8-77997e2918bd admin admin] Deleting port 89781986-0dc0-4c2f-b390-c38c5e41723e {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:25:59.045225 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f5dde178-c070-41b9-aed8-77997e2918bd admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:59.116142 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_dvr_db [None req-4947c925-86bd-44c0-9678-8259e6ed6da1 None None] Set router 3e2008fd-6aec-4b2e-b56a-0934358f106c gateway port host: None {{(pid=102164) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:25:59.125556 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-f5dde178-c070-41b9-aed8-77997e2918bd admin admin] For port 89781986-0dc0-4c2f-b390-c38c5e41723e, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=89781986-0dc0-4c2f-b390-c38c5e41723e,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:25:59.125906 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f5dde178-c070-41b9-aed8-77997e2918bd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:59.138071 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-f5dde178-c070-41b9-aed8-77997e2918bd admin admin] Calling delete_port for 89781986-0dc0-4c2f-b390-c38c5e41723e owned by network:router_gateway {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:25:59.261587 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.l3_hamode_db [None req-4947c925-86bd-44c0-9678-8259e6ed6da1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'name': 'tempest-TestSnapshotPattern-1474624592-router', 'tenant_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:21:02Z', 'updated_at': '2021-11-09T05:25:58Z', 'revision_number': 6, 'project_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'gw_port_host': None}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102164) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:25:59.287886 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4947c925-86bd-44c0-9678-8259e6ed6da1 None None] The sync data for ids ['3e2008fd-6aec-4b2e-b56a-0934358f106c'] in dv-neutron-816802-2-hyperv is: [{'id': '3e2008fd-6aec-4b2e-b56a-0934358f106c', 'name': 'tempest-TestSnapshotPattern-1474624592-router', 'tenant_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:21:02Z', 'updated_at': '2021-11-09T05:25:58Z', 'revision_number': 6, 'project_id': 'ceedba48d4ab4ffcb707b41a150b986b', 'gw_port_host': None}] {{(pid=102164) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 05:25:59.361237 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f5dde178-c070-41b9-aed8-77997e2918bd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:59.386926 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5dde178-c070-41b9-aed8-77997e2918bd admin admin] Pushing event deleted for resources: {'Port': ['ID=89781986-0dc0-4c2f-b390-c38c5e41723e,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:25:59.444508 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f5dde178-c070-41b9-aed8-77997e2918bd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-466373'] for router_gateway, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:59.530629 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f5dde178-c070-41b9-aed8-77997e2918bd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:59.533400 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f5dde178-c070-41b9-aed8-77997e2918bd admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:59.629913 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f5dde178-c070-41b9-aed8-77997e2918bd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:59.630522 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f5dde178-c070-41b9-aed8-77997e2918bd admin admin] Fanout notify agent at l3_agent the message router_deleted on router 3e2008fd-6aec-4b2e-b56a-0934358f106c {{(pid=102161) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 05:25:59.638828 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-f5dde178-c070-41b9-aed8-77997e2918bd admin admin] Publish callbacks [] for router, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:59.638828 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-f5dde178-c070-41b9-aed8-77997e2918bd admin admin] 10.222.0.24 "DELETE /v2.0/routers/3e2008fd-6aec-4b2e-b56a-0934358f106c HTTP/1.1" status: 204 len: 168 time: 0.9366767 Nov 09 05:25:59.638828 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 39438) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:25:59.685511 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.db_base_plugin_v2 [None req-1bf428bc-7c68-41e8-b033-4b2f883e99c9 admin admin] Deleting subnet 85aac8f0-cd4e-40f0-b238-bfb36190a9ad {{(pid=102161) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 05:25:59.688772 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1bf428bc-7c68-41e8-b033-4b2f883e99c9 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:25:59.727380 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1bf428bc-7c68-41e8-b033-4b2f883e99c9 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7110504'] for subnet, precommit_delete_associations {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:00.089852 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1bf428bc-7c68-41e8-b033-4b2f883e99c9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:00.224960 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1bf428bc-7c68-41e8-b033-4b2f883e99c9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6995369', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5785240'] for subnet, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:00.250559 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bf428bc-7c68-41e8-b033-4b2f883e99c9 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=85aac8f0-cd4e-40f0-b238-bfb36190a9ad,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:26:00.254162 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-1bf428bc-7c68-41e8-b033-4b2f883e99c9 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:00.257341 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-1bf428bc-7c68-41e8-b033-4b2f883e99c9 admin admin] 10.222.0.24 "DELETE /v2.0/subnets/85aac8f0-cd4e-40f0-b238-bfb36190a9ad HTTP/1.1" status: 204 len: 168 time: 0.6175370 Nov 09 05:26:00.259795 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.wsgi [-] (102161) accepted ('10.222.0.24', 39440) {{(pid=102161) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:26:00.262330 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e9964745-990d-4d3d-982c-7dcd32edea12 None None] Network 8b3ee119-8ca9-4512-a0b7-4947c2eb41ed requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 05:26:00.434062 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bf46523b-df11-4c8d-8a85-c7e6dd31d52b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:00.465065 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0a6e84fb-125c-45aa-93a4-4f218dc1bbfd None None] DHCP port deletion for 8b3ee119-8ca9-4512-a0b7-4947c2eb41ed request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 05:26:00.485288 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-bf46523b-df11-4c8d-8a85-c7e6dd31d52b admin admin] Deleting port 44abee79-6c5a-49a1-87de-99d8924ce05e {{(pid=102161) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:26:00.485638 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bf46523b-df11-4c8d-8a85-c7e6dd31d52b admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:00.509719 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-0a6e84fb-125c-45aa-93a4-4f218dc1bbfd None None] Deleting port 44abee79-6c5a-49a1-87de-99d8924ce05e {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:26:00.510009 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0a6e84fb-125c-45aa-93a4-4f218dc1bbfd None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:00.551531 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.db [None req-bf46523b-df11-4c8d-8a85-c7e6dd31d52b admin admin] For port 44abee79-6c5a-49a1-87de-99d8924ce05e, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=44abee79-6c5a-49a1-87de-99d8924ce05e,segment=NetworkSegment(7f482fc6-4887-4d69-a152-097f906532cc),segment_id=7f482fc6-4887-4d69-a152-097f906532cc)] {{(pid=102161) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:26:00.551810 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bf46523b-df11-4c8d-8a85-c7e6dd31d52b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:00.564516 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.plugin [None req-bf46523b-df11-4c8d-8a85-c7e6dd31d52b admin admin] Calling delete_port for 44abee79-6c5a-49a1-87de-99d8924ce05e owned by network:dhcp {{(pid=102161) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:26:00.573226 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-0a6e84fb-125c-45aa-93a4-4f218dc1bbfd None None] For port 44abee79-6c5a-49a1-87de-99d8924ce05e, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=44abee79-6c5a-49a1-87de-99d8924ce05e,segment=NetworkSegment(7f482fc6-4887-4d69-a152-097f906532cc),segment_id=7f482fc6-4887-4d69-a152-097f906532cc)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:26:00.573622 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0a6e84fb-125c-45aa-93a4-4f218dc1bbfd None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:00.586710 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-0a6e84fb-125c-45aa-93a4-4f218dc1bbfd None None] Calling delete_port for 44abee79-6c5a-49a1-87de-99d8924ce05e owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:26:00.703689 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bf46523b-df11-4c8d-8a85-c7e6dd31d52b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6995324'] for port, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:00.710495 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0a6e84fb-125c-45aa-93a4-4f218dc1bbfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:00.730053 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf46523b-df11-4c8d-8a85-c7e6dd31d52b admin admin] Pushing event deleted for resources: {'Port': ['ID=44abee79-6c5a-49a1-87de-99d8924ce05e,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:26:00.731864 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bf46523b-df11-4c8d-8a85-c7e6dd31d52b admin admin] No DVR routers for this DVR port 44abee79-6c5a-49a1-87de-99d8924ce05e on host dv-neutron-816802-2-hyperv {{(pid=102161) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 05:26:00.736254 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a6e84fb-125c-45aa-93a4-4f218dc1bbfd None None] Pushing event deleted for resources: {'Port': ['ID=44abee79-6c5a-49a1-87de-99d8924ce05e,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:26:00.738085 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0a6e84fb-125c-45aa-93a4-4f218dc1bbfd None None] No DVR routers for this DVR port 44abee79-6c5a-49a1-87de-99d8924ce05e on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 05:26:00.806978 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bf46523b-df11-4c8d-8a85-c7e6dd31d52b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:00.827173 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-bf46523b-df11-4c8d-8a85-c7e6dd31d52b admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8b3ee119-8ca9-4512-a0b7-4947c2eb41ed']}} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:26:00.836975 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-bf46523b-df11-4c8d-8a85-c7e6dd31d52b admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '7f482fc6-4887-4d69-a152-097f906532cc') {'for_net_delete': True} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:26:00.837269 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.services.segments.db [None req-bf46523b-df11-4c8d-8a85-c7e6dd31d52b admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '7f482fc6-4887-4d69-a152-097f906532cc') {} {{(pid=102161) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:26:00.846285 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bf46523b-df11-4c8d-8a85-c7e6dd31d52b admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7110513'] for segment, before_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:00.859027 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bf46523b-df11-4c8d-8a85-c7e6dd31d52b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:00.864776 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-bf46523b-df11-4c8d-8a85-c7e6dd31d52b admin admin] Releasing vlan 349 on physical network physnet1 to pool {{(pid=102161) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 05:26:00.865152 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bf46523b-df11-4c8d-8a85-c7e6dd31d52b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6995279'] for segment, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:00.866776 dv-neutron-816802-2-hyperv neutron-server[102161]: Traceback (most recent call last): Nov 09 05:26:00.866776 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 05:26:00.866776 dv-neutron-816802-2-hyperv neutron-server[102161]: timer() Nov 09 05:26:00.866776 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 05:26:00.866776 dv-neutron-816802-2-hyperv neutron-server[102161]: cb(*args, **kw) Nov 09 05:26:00.866776 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 05:26:00.866776 dv-neutron-816802-2-hyperv neutron-server[102161]: return func(*args, **kwargs) Nov 09 05:26:00.866776 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 05:26:00.866776 dv-neutron-816802-2-hyperv neutron-server[102161]: self._notify() Nov 09 05:26:00.866776 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 05:26:00.866776 dv-neutron-816802-2-hyperv neutron-server[102161]: self.callback(batched_events) Nov 09 05:26:00.866776 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 05:26:00.866776 dv-neutron-816802-2-hyperv neutron-server[102161]: event.method(event) Nov 09 05:26:00.866776 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 05:26:00.866776 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 05:26:00.866776 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 05:26:00.866776 dv-neutron-816802-2-hyperv neutron-server[102161]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 05:26:00.866776 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 05:26:00.866776 dv-neutron-816802-2-hyperv neutron-server[102161]: return f(self, *a, **k) Nov 09 05:26:00.866776 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 05:26:00.866776 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._get(url).json() Nov 09 05:26:00.866776 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 05:26:00.866776 dv-neutron-816802-2-hyperv neutron-server[102161]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 05:26:00.866776 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 05:26:00.866776 dv-neutron-816802-2-hyperv neutron-server[102161]: return self.request(url, 'GET', **kwargs) Nov 09 05:26:00.866776 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 05:26:00.866776 dv-neutron-816802-2-hyperv neutron-server[102161]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 05:26:00.866776 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 05:26:00.866776 dv-neutron-816802-2-hyperv neutron-server[102161]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 05:26:00.866776 dv-neutron-816802-2-hyperv neutron-server[102161]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 05:26:00.866776 dv-neutron-816802-2-hyperv neutron-server[102161]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 05:26:00.866776 dv-neutron-816802-2-hyperv neutron-server[102161]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 05:26:00.943304 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device a562afa6-7652-4f76-8b5c-24feacfbb57c no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 05:26:00.965966 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: a562afa6-7652-4f76-8b5c-24feacfbb57c {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 05:26:00.966309 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device a562afa6-7652-4f76-8b5c-24feacfbb57c not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 05:26:00.967428 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 44abee79-6c5a-49a1-87de-99d8924ce05e no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 05:26:00.978479 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bf46523b-df11-4c8d-8a85-c7e6dd31d52b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:00.983301 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron_lib.callbacks.manager [None req-bf46523b-df11-4c8d-8a85-c7e6dd31d52b admin admin] Publish callbacks [] for network, before_response {{(pid=102161) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:00.985395 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 44abee79-6c5a-49a1-87de-99d8924ce05e {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 05:26:00.985572 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 44abee79-6c5a-49a1-87de-99d8924ce05e not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 05:26:00.985984 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 89781986-0dc0-4c2f-b390-c38c5e41723e no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 05:26:00.987240 dv-neutron-816802-2-hyperv neutron-server[102161]: INFO neutron.wsgi [None req-bf46523b-df11-4c8d-8a85-c7e6dd31d52b admin admin] 10.222.0.24 "DELETE /v2.0/networks/8b3ee119-8ca9-4512-a0b7-4947c2eb41ed HTTP/1.1" status: 204 len: 168 time: 0.7260818 Nov 09 05:26:00.990865 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 39444) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:26:01.000368 dv-neutron-816802-2-hyperv neutron-server[102161]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf46523b-df11-4c8d-8a85-c7e6dd31d52b admin admin] Pushing event deleted for resources: {'Network': ['ID=8b3ee119-8ca9-4512-a0b7-4947c2eb41ed,revision_number=None']} {{(pid=102161) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:26:01.007299 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 89781986-0dc0-4c2f-b390-c38c5e41723e {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 05:26:01.007728 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 89781986-0dc0-4c2f-b390-c38c5e41723e not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 05:26:01.327765 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c4162c94-9a37-4df2-bcf0-e18e7cb7254a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-466063'] for router_interface, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:01.560570 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-c4162c94-9a37-4df2-bcf0-e18e7cb7254a admin admin] Deleting port 69db06ff-6e0c-420f-acd4-e6223477866d {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:26:01.560902 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c4162c94-9a37-4df2-bcf0-e18e7cb7254a admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:01.638732 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-c4162c94-9a37-4df2-bcf0-e18e7cb7254a admin admin] For port 69db06ff-6e0c-420f-acd4-e6223477866d, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=69db06ff-6e0c-420f-acd4-e6223477866d,segment=NetworkSegment(a0230152-da2c-465a-8813-0aca466a0111),segment_id=a0230152-da2c-465a-8813-0aca466a0111)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:26:01.639014 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c4162c94-9a37-4df2-bcf0-e18e7cb7254a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:01.651856 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-c4162c94-9a37-4df2-bcf0-e18e7cb7254a admin admin] Calling delete_port for 69db06ff-6e0c-420f-acd4-e6223477866d owned by network:router_interface {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:26:01.858319 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c4162c94-9a37-4df2-bcf0-e18e7cb7254a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:01.882661 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4162c94-9a37-4df2-bcf0-e18e7cb7254a admin admin] Pushing event deleted for resources: {'Port': ['ID=69db06ff-6e0c-420f-acd4-e6223477866d,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:26:02.047309 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c4162c94-9a37-4df2-bcf0-e18e7cb7254a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1588012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-465215'] for router_interface, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:02.546824 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c4162c94-9a37-4df2-bcf0-e18e7cb7254a admin admin] Router 82f0930c-c769-4ad1-aced-bf5daba02c47 has already been hosted by L3 agent ea291deb-d47b-4467-a9a1-d3a1ddaaa20b {{(pid=102162) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 09 05:26:02.647323 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c4162c94-9a37-4df2-bcf0-e18e7cb7254a admin admin] Notify agent at l3_agent.dv-neutron-816802-2-hyperv the message routers_updated {{(pid=102162) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 09 05:26:02.652484 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-c4162c94-9a37-4df2-bcf0-e18e7cb7254a admin admin] 10.222.0.24 "PUT /v2.0/routers/82f0930c-c769-4ad1-aced-bf5daba02c47/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6604450 Nov 09 05:26:02.655080 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 39446) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:26:02.656589 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2483adfb-f139-4665-853d-2fd8e0c0222d None None] Sync routers for ids ['82f0930c-c769-4ad1-aced-bf5daba02c47'] in dv-neutron-816802-2-hyperv {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 09 05:26:02.666635 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2483adfb-f139-4665-853d-2fd8e0c0222d None None] Routers {'82f0930c-c769-4ad1-aced-bf5daba02c47'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:26:02.667244 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-2483adfb-f139-4665-853d-2fd8e0c0222d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:25:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['82f0930c-c769-4ad1-aced-bf5daba02c47'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:26:02.758443 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-61e194d0-949e-448f-a426-21b78294a955 admin admin] Publish callbacks [] for router, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:02.864272 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-61e194d0-949e-448f-a426-21b78294a955 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:02.917978 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-2483adfb-f139-4665-853d-2fd8e0c0222d None None] Set router 82f0930c-c769-4ad1-aced-bf5daba02c47 gateway port host: dv-neutron-816802-2-hyperv {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:26:02.963641 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-61e194d0-949e-448f-a426-21b78294a955 admin admin] Deleting port 3071901a-ccad-4330-bda7-47a2ecb73a37 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:26:02.963970 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-61e194d0-949e-448f-a426-21b78294a955 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:03.044165 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-61e194d0-949e-448f-a426-21b78294a955 admin admin] For port 3071901a-ccad-4330-bda7-47a2ecb73a37, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=3071901a-ccad-4330-bda7-47a2ecb73a37,segment=NetworkSegment(b32354f7-483b-42dd-a7b6-93b8f64d6739),segment_id=b32354f7-483b-42dd-a7b6-93b8f64d6739)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:26:03.044519 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-61e194d0-949e-448f-a426-21b78294a955 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:03.056910 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-61e194d0-949e-448f-a426-21b78294a955 admin admin] Calling delete_port for 3071901a-ccad-4330-bda7-47a2ecb73a37 owned by network:router_gateway {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:26:03.096060 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-2483adfb-f139-4665-853d-2fd8e0c0222d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '82f0930c-c769-4ad1-aced-bf5daba02c47', 'name': 'tempest-TestSnapshotPattern-906856928-router', 'tenant_id': 'dfd9fcae13714ba6890b7200ad6fcd05', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'external_fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.250'}], 'enable_snat': True}, 'gw_port_id': '3071901a-ccad-4330-bda7-47a2ecb73a37', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:21:08Z', 'updated_at': '2021-11-09T05:26:01Z', 'revision_number': 5, 'project_id': 'dfd9fcae13714ba6890b7200ad6fcd05', 'gw_port': {'id': '3071901a-ccad-4330-bda7-47a2ecb73a37', 'name': '', 'network_id': '2b6725f5-ebfe-485a-8f42-ccb5a241ddb5', 'tenant_id': '', 'mac_address': 'fa:16:3e:43:8d:d1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '82f0930c-c769-4ad1-aced-bf5daba02c47', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1868, 'fixed_ips': [{'subnet_id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'ip_address': '172.26.0.250', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816802-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-09T05:21:08Z', 'updated_at': '2021-11-09T05:21:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e932d5b0-df1b-4711-8b71-813e648a5e78', 'cidr': '172.26.0.0/24', 'gateway_ip': '172.26.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816802-2-hyperv'}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:26:03.125260 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2483adfb-f139-4665-853d-2fd8e0c0222d None None] Checking router: 82f0930c-c769-4ad1-aced-bf5daba02c47 for host: dv-neutron-816802-2-hyperv {{(pid=102163) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 09 05:26:03.133981 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2483adfb-f139-4665-853d-2fd8e0c0222d None None] Routers {'82f0930c-c769-4ad1-aced-bf5daba02c47'} bound to L3 agent in host dv-neutron-816802-2-hyperv {{(pid=102163) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 09 05:26:03.134628 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-2483adfb-f139-4665-853d-2fd8e0c0222d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816802-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-09T04:20:14Z,description=,heartbeat_timestamp=2021-11-09T05:25:44Z,host='dv-neutron-816802-2-hyperv',id=ea291deb-d47b-4467-a9a1-d3a1ddaaa20b,load=0,resource_versions=,resources_synced=,started_at=2021-11-09T04:20:14Z,topic='l3_agent')) {'router_ids': ['82f0930c-c769-4ad1-aced-bf5daba02c47'], 'active': True} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:26:03.229154 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvr_db [None req-2483adfb-f139-4665-853d-2fd8e0c0222d None None] Set router 82f0930c-c769-4ad1-aced-bf5daba02c47 gateway port host: None {{(pid=102163) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 09 05:26:03.283699 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_hamode_db [None req-2483adfb-f139-4665-853d-2fd8e0c0222d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '82f0930c-c769-4ad1-aced-bf5daba02c47', 'name': 'tempest-TestSnapshotPattern-906856928-router', 'tenant_id': 'dfd9fcae13714ba6890b7200ad6fcd05', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:21:08Z', 'updated_at': '2021-11-09T05:26:02Z', 'revision_number': 6, 'project_id': 'dfd9fcae13714ba6890b7200ad6fcd05', 'gw_port_host': None}], 'dv-neutron-816802-2-hyperv', False) {} {{(pid=102163) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:26:03.286742 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-61e194d0-949e-448f-a426-21b78294a955 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:03.314493 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2483adfb-f139-4665-853d-2fd8e0c0222d None None] The sync data for ids ['82f0930c-c769-4ad1-aced-bf5daba02c47'] in dv-neutron-816802-2-hyperv is: [{'id': '82f0930c-c769-4ad1-aced-bf5daba02c47', 'name': 'tempest-TestSnapshotPattern-906856928-router', 'tenant_id': 'dfd9fcae13714ba6890b7200ad6fcd05', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-09T05:21:08Z', 'updated_at': '2021-11-09T05:26:02Z', 'revision_number': 6, 'project_id': 'dfd9fcae13714ba6890b7200ad6fcd05', 'gw_port_host': None}] {{(pid=102163) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 09 05:26:03.314889 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61e194d0-949e-448f-a426-21b78294a955 admin admin] Pushing event deleted for resources: {'Port': ['ID=3071901a-ccad-4330-bda7-47a2ecb73a37,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:26:03.373542 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-61e194d0-949e-448f-a426-21b78294a955 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-466373'] for router_gateway, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:03.464774 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-61e194d0-949e-448f-a426-21b78294a955 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-465511', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30555'] for router, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:03.466794 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-61e194d0-949e-448f-a426-21b78294a955 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:03.549516 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-61e194d0-949e-448f-a426-21b78294a955 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-465532'] for router, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:03.550042 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-61e194d0-949e-448f-a426-21b78294a955 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 82f0930c-c769-4ad1-aced-bf5daba02c47 {{(pid=102162) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 09 05:26:03.555718 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-61e194d0-949e-448f-a426-21b78294a955 admin admin] Publish callbacks [] for router, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:03.560768 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-61e194d0-949e-448f-a426-21b78294a955 admin admin] 10.222.0.24 "DELETE /v2.0/routers/82f0930c-c769-4ad1-aced-bf5daba02c47 HTTP/1.1" status: 204 len: 168 time: 0.9008644 Nov 09 05:26:03.560768 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 39448) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:26:03.603553 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.db_base_plugin_v2 [None req-3e68f3e7-9b0f-49c5-970e-7b47d8347fc5 admin admin] Deleting subnet ab0ba536-f04d-40cc-ab2c-cccc21052c2c {{(pid=102162) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 09 05:26:03.606525 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3e68f3e7-9b0f-49c5-970e-7b47d8347fc5 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:03.639822 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3e68f3e7-9b0f-49c5-970e-7b47d8347fc5 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5375415'] for subnet, precommit_delete_associations {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:03.721840 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3e68f3e7-9b0f-49c5-970e-7b47d8347fc5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1539362'] for subnet, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:03.829902 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3e68f3e7-9b0f-49c5-970e-7b47d8347fc5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1539371', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2011904', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5729876', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5794761'] for subnet, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:03.856272 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e68f3e7-9b0f-49c5-970e-7b47d8347fc5 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=ab0ba536-f04d-40cc-ab2c-cccc21052c2c,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:26:03.858193 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-3e68f3e7-9b0f-49c5-970e-7b47d8347fc5 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:03.861737 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-3e68f3e7-9b0f-49c5-970e-7b47d8347fc5 admin admin] 10.222.0.24 "DELETE /v2.0/subnets/ab0ba536-f04d-40cc-ab2c-cccc21052c2c HTTP/1.1" status: 204 len: 168 time: 0.3014171 Nov 09 05:26:03.862763 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-abf558c7-7cb2-47cc-9eea-9324a7a6255d None None] Network 42d49c70-f883-4a2a-a399-48a4cfc7efee requested from dv-neutron-816802-2-hyperv {{(pid=102163) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 09 05:26:03.864864 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 39450) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:26:03.937099 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b565e36a-b4bd-4ed1-aec9-2443ab327be3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1497543'] for network, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:03.988572 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-b565e36a-b4bd-4ed1-aec9-2443ab327be3 admin admin] Deleting port 9a2f7a79-d1b4-4f1d-81ef-5447d7909fa9 {{(pid=102162) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:26:03.988981 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b565e36a-b4bd-4ed1-aec9-2443ab327be3 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:04.052892 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.db [None req-b565e36a-b4bd-4ed1-aec9-2443ab327be3 admin admin] For port 9a2f7a79-d1b4-4f1d-81ef-5447d7909fa9, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=9a2f7a79-d1b4-4f1d-81ef-5447d7909fa9,segment=NetworkSegment(a0230152-da2c-465a-8813-0aca466a0111),segment_id=a0230152-da2c-465a-8813-0aca466a0111)] {{(pid=102162) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:26:04.053249 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b565e36a-b4bd-4ed1-aec9-2443ab327be3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:04.062149 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0dcc6eca-0543-41a4-b8c6-286371b9b9dd None None] DHCP port deletion for 42d49c70-f883-4a2a-a399-48a4cfc7efee request from dv-neutron-816802-2-hyperv {{(pid=102163) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 09 05:26:04.072451 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.plugin [None req-b565e36a-b4bd-4ed1-aec9-2443ab327be3 admin admin] Calling delete_port for 9a2f7a79-d1b4-4f1d-81ef-5447d7909fa9 owned by network:dhcp {{(pid=102162) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:26:04.111462 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-0dcc6eca-0543-41a4-b8c6-286371b9b9dd None None] Deleting port 9a2f7a79-d1b4-4f1d-81ef-5447d7909fa9 {{(pid=102163) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 09 05:26:04.111834 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0dcc6eca-0543-41a4-b8c6-286371b9b9dd None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8756747261112'] for port, before_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:04.175089 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.db [None req-0dcc6eca-0543-41a4-b8c6-286371b9b9dd None None] For port 9a2f7a79-d1b4-4f1d-81ef-5447d7909fa9, host dv-neutron-816802-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816802-2-hyperv',level=0,port_id=9a2f7a79-d1b4-4f1d-81ef-5447d7909fa9,segment=NetworkSegment(a0230152-da2c-465a-8813-0aca466a0111),segment_id=a0230152-da2c-465a-8813-0aca466a0111)] {{(pid=102163) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 09 05:26:04.175490 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0dcc6eca-0543-41a4-b8c6-286371b9b9dd None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-472617'] for port, precommit_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:04.192364 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-0dcc6eca-0543-41a4-b8c6-286371b9b9dd None None] Calling delete_port for 9a2f7a79-d1b4-4f1d-81ef-5447d7909fa9 owned by network:dhcp {{(pid=102163) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 09 05:26:04.224884 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b565e36a-b4bd-4ed1-aec9-2443ab327be3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5729921'] for port, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:04.250965 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b565e36a-b4bd-4ed1-aec9-2443ab327be3 admin admin] Pushing event deleted for resources: {'Port': ['ID=9a2f7a79-d1b4-4f1d-81ef-5447d7909fa9,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:26:04.254353 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b565e36a-b4bd-4ed1-aec9-2443ab327be3 admin admin] No DVR routers for this DVR port 9a2f7a79-d1b4-4f1d-81ef-5447d7909fa9 on host dv-neutron-816802-2-hyperv {{(pid=102162) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 05:26:04.276257 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-0dcc6eca-0543-41a4-b8c6-286371b9b9dd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-598938', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-184976', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8756747267202', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8756746785693'] for port, after_delete {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:04.303392 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0dcc6eca-0543-41a4-b8c6-286371b9b9dd None None] Pushing event deleted for resources: {'Port': ['ID=9a2f7a79-d1b4-4f1d-81ef-5447d7909fa9,revision_number=None']} {{(pid=102163) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:26:04.308406 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0dcc6eca-0543-41a4-b8c6-286371b9b9dd None None] No DVR routers for this DVR port 9a2f7a79-d1b4-4f1d-81ef-5447d7909fa9 on host dv-neutron-816802-2-hyperv {{(pid=102163) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 09 05:26:04.347353 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b565e36a-b4bd-4ed1-aec9-2443ab327be3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1538135', 'neutron.services.segments.db._delete_segments_for_network-8756747342897'] for network, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:04.368991 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-b565e36a-b4bd-4ed1-aec9-2443ab327be3 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['42d49c70-f883-4a2a-a399-48a4cfc7efee']}} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:26:04.378129 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-b565e36a-b4bd-4ed1-aec9-2443ab327be3 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a0230152-da2c-465a-8813-0aca466a0111') {'for_net_delete': True} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:26:04.378449 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.services.segments.db [None req-b565e36a-b4bd-4ed1-aec9-2443ab327be3 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a0230152-da2c-465a-8813-0aca466a0111') {} {{(pid=102162) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 09 05:26:04.388283 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b565e36a-b4bd-4ed1-aec9-2443ab327be3 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8756747347002', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5375406'] for segment, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:04.401979 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b565e36a-b4bd-4ed1-aec9-2443ab327be3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139'] for segment, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:04.408000 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b565e36a-b4bd-4ed1-aec9-2443ab327be3 admin admin] Releasing vlan 312 on physical network physnet1 to pool {{(pid=102162) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 09 05:26:04.408384 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b565e36a-b4bd-4ed1-aec9-2443ab327be3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1543139', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5729970'] for segment, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:04.410048 dv-neutron-816802-2-hyperv neutron-server[102162]: Traceback (most recent call last): Nov 09 05:26:04.410048 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 05:26:04.410048 dv-neutron-816802-2-hyperv neutron-server[102162]: timer() Nov 09 05:26:04.410048 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 05:26:04.410048 dv-neutron-816802-2-hyperv neutron-server[102162]: cb(*args, **kw) Nov 09 05:26:04.410048 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 09 05:26:04.410048 dv-neutron-816802-2-hyperv neutron-server[102162]: return func(*args, **kwargs) Nov 09 05:26:04.410048 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 09 05:26:04.410048 dv-neutron-816802-2-hyperv neutron-server[102162]: self._notify() Nov 09 05:26:04.410048 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 09 05:26:04.410048 dv-neutron-816802-2-hyperv neutron-server[102162]: self.callback(batched_events) Nov 09 05:26:04.410048 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 09 05:26:04.410048 dv-neutron-816802-2-hyperv neutron-server[102162]: event.method(event) Nov 09 05:26:04.410048 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 09 05:26:04.410048 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 09 05:26:04.410048 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 09 05:26:04.410048 dv-neutron-816802-2-hyperv neutron-server[102162]: aggregate_uuid = self.p_client.list_aggregates( Nov 09 05:26:04.410048 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 09 05:26:04.410048 dv-neutron-816802-2-hyperv neutron-server[102162]: return f(self, *a, **k) Nov 09 05:26:04.410048 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 09 05:26:04.410048 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._get(url).json() Nov 09 05:26:04.410048 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 09 05:26:04.410048 dv-neutron-816802-2-hyperv neutron-server[102162]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 09 05:26:04.410048 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 09 05:26:04.410048 dv-neutron-816802-2-hyperv neutron-server[102162]: return self.request(url, 'GET', **kwargs) Nov 09 05:26:04.410048 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 09 05:26:04.410048 dv-neutron-816802-2-hyperv neutron-server[102162]: base_url = self.get_endpoint(auth, allow=allow, Nov 09 05:26:04.410048 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 09 05:26:04.410048 dv-neutron-816802-2-hyperv neutron-server[102162]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 09 05:26:04.410048 dv-neutron-816802-2-hyperv neutron-server[102162]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 09 05:26:04.410048 dv-neutron-816802-2-hyperv neutron-server[102162]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 09 05:26:04.410048 dv-neutron-816802-2-hyperv neutron-server[102162]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 09 05:26:04.510064 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b565e36a-b4bd-4ed1-aec9-2443ab327be3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1539236', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-486711', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1588183', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-466361'] for network, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:04.521678 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-b565e36a-b4bd-4ed1-aec9-2443ab327be3 admin admin] Publish callbacks [] for network, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:04.521678 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-b565e36a-b4bd-4ed1-aec9-2443ab327be3 admin admin] 10.222.0.24 "DELETE /v2.0/networks/42d49c70-f883-4a2a-a399-48a4cfc7efee HTTP/1.1" status: 204 len: 168 time: 0.6552024 Nov 09 05:26:04.534273 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b565e36a-b4bd-4ed1-aec9-2443ab327be3 admin admin] Pushing event deleted for resources: {'Network': ['ID=42d49c70-f883-4a2a-a399-48a4cfc7efee,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:26:04.839106 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 39454) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:26:04.900786 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-b4b8bd25-a222-49d3-adbe-2d0ba747d318 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=ceedba48d4ab4ffcb707b41a150b986b&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0602946 Nov 09 05:26:04.903290 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 39456) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:26:04.927119 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 69db06ff-6e0c-420f-acd4-e6223477866d no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 05:26:04.947868 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 69db06ff-6e0c-420f-acd4-e6223477866d {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 05:26:04.948213 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 69db06ff-6e0c-420f-acd4-e6223477866d not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 05:26:04.948627 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 3071901a-ccad-4330-bda7-47a2ecb73a37 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 05:26:04.965302 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c2d00d0a-b2ca-4620-88b8-ba472e08a7df admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:04.969746 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 3071901a-ccad-4330-bda7-47a2ecb73a37 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 05:26:04.970088 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 3071901a-ccad-4330-bda7-47a2ecb73a37 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 05:26:04.970533 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 9a2f7a79-d1b4-4f1d-81ef-5447d7909fa9 no longer exists at agent ovs-agent-dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 09 05:26:04.989963 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.plugin [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] No Port match for: 9a2f7a79-d1b4-4f1d-81ef-5447d7909fa9 {{(pid=102163) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 09 05:26:04.990303 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron.plugins.ml2.rpc [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Device 9a2f7a79-d1b4-4f1d-81ef-5447d7909fa9 not bound to the agent host dv-neutron-816802-2-hyperv {{(pid=102163) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 09 05:26:04.995119 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c2d00d0a-b2ca-4620-88b8-ba472e08a7df admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:05.109514 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c2d00d0a-b2ca-4620-88b8-ba472e08a7df admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:05.112045 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-c2d00d0a-b2ca-4620-88b8-ba472e08a7df admin admin] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:05.113190 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-c2d00d0a-b2ca-4620-88b8-ba472e08a7df admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/bb8e3fa7-6478-428c-9310-99ce3e618e63 HTTP/1.1" status: 204 len: 168 time: 0.2089655 Nov 09 05:26:05.121701 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2d00d0a-b2ca-4620-88b8-ba472e08a7df admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bb8e3fa7-6478-428c-9310-99ce3e618e63,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:26:05.680593 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 39462) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:26:05.720029 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-d424fe82-268c-4563-9620-646f10e34512 admin admin] 10.222.0.24 "GET /v2.0/security-groups?tenant_id=dfd9fcae13714ba6890b7200ad6fcd05&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0381987 Nov 09 05:26:05.722347 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.wsgi [-] (102162) accepted ('10.222.0.24', 39464) {{(pid=102162) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 09 05:26:05.773940 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-74dc1d61-e97f-41d1-98ed-9683abc14338 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:05.794755 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-74dc1d61-e97f-41d1-98ed-9683abc14338 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:05.915598 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-74dc1d61-e97f-41d1-98ed-9683abc14338 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-509343'] for security_group, after_delete {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:05.918116 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron_lib.callbacks.manager [None req-74dc1d61-e97f-41d1-98ed-9683abc14338 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102162) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:05.919333 dv-neutron-816802-2-hyperv neutron-server[102162]: INFO neutron.wsgi [None req-74dc1d61-e97f-41d1-98ed-9683abc14338 admin admin] 10.222.0.24 "DELETE /v2.0/security-groups/f5a81250-6fa5-4cdf-b2c6-7ba33941c580 HTTP/1.1" status: 204 len: 168 time: 0.1954310 Nov 09 05:26:05.927537 dv-neutron-816802-2-hyperv neutron-server[102162]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74dc1d61-e97f-41d1-98ed-9683abc14338 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f5a81250-6fa5-4cdf-b2c6-7ba33941c580,revision_number=None']} {{(pid=102162) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 09 05:26:11.406849 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-1bf4473f-45d3-487b-bec4-e873d22b42e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:12.749927 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:13.749144 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-3683e890-5799-4ecf-8b30-95ffa2ef5470 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:15.331934 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:15.459556 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 05:26:16.743778 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:17.001127 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:41.377728 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-fb83a951-ecb4-4544-9143-c73897b83f00 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:42.755587 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:43.709306 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-dcf8a749-bbc1-402d-b000-3f26e9f70d81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:45.337463 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:46.721474 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:47.029213 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:26:52.458566 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 05:27:11.417968 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4d64d8df-3fe6-44d9-a7c8-7e4680b45ac0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:27:12.765983 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:27:13.686300 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-952b821a-05ea-472f-b2d1-9b5396a06c50 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:27:15.338020 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:27:16.732173 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:27:17.006553 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:27:29.458519 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 05:27:41.388881 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-d47d3d23-0862-4d9c-a29c-bc603ca9545b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:27:42.795426 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:27:43.703219 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-cbd0c351-4f1f-4462-a797-347924b1a686 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:27:45.360695 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:27:46.732250 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:27:47.000515 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:28:06.457250 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 05:28:11.382943 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4bc5c522-eac0-4b2a-9bcb-27b9e6163ff5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:28:12.789440 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:28:13.714586 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-de362753-8da9-4c24-947e-d96e1e57500f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:28:15.332093 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:28:16.737936 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:28:17.041313 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:28:41.417621 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-62a021da-bf2c-49dd-bde9-f2d8521347ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:28:42.817357 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:28:43.455467 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 05:28:43.714807 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-4da4e9d1-77e0-40b7-b0fc-2f63f6cd480f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:28:45.355482 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:28:46.725942 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:28:47.005929 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:29:11.394331 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-005b749f-3281-40f2-b5f5-02dfc7b3431e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:29:12.852022 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:29:13.703011 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-5cbc7a64-5a17-4780-8c70-a5c32ed70f89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:29:15.365705 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:29:16.748903 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:29:17.000723 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:29:20.453970 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 05:29:41.445610 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-19044648-3b03-4504-8180-cd2f542e2185 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:29:42.812121 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:29:43.697754 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ab584922-dfbe-47a4-93f4-ec080deff170 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:29:45.372240 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:29:46.726182 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:29:47.023492 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:29:57.454433 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 05:30:11.400439 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-c428f15f-9204-4e95-b52c-929e5fb2f9e9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:30:12.835043 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:30:13.720093 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-7edafa85-fb7f-416b-8b61-e3282abdfcb4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:30:15.354529 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:30:16.748846 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:30:17.023713 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:30:34.453124 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 05:30:41.433796 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a39366c2-7045-48be-a8e7-203639673566 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:30:42.844830 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:30:43.720412 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-decff7ef-0c59-4ede-89df-df6986fee0a6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:30:45.372239 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:30:46.772159 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:30:47.017927 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:31:11.411937 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-6f11d097-794b-4b50-83f0-580d21340633 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:31:11.452102 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 09 05:31:12.835514 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:31:13.715393 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-a53b1648-b6f8-458c-9035-e30e2a0a5daa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:31:15.400881 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:31:16.754587 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:31:17.023326 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:31:41.395479 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-eefcfb1a-f640-467e-b871-ae10ec77a1f0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:31:42.857979 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-361ced7d-ac60-4c28-92d8-615c79e84e05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:31:43.726368 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-29731f0f-2dfb-4cf8-85cd-ae85e9ba0e4b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:31:45.387649 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-ee45e005-39ef-4f87-97a1-e9d348695d43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:31:46.798883 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-56a771ad-8d56-4cd0-900b-bb035db3d09f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:31:47.038970 dv-neutron-816802-2-hyperv neutron-server[102163]: DEBUG neutron_lib.callbacks.manager [None req-e89ddf11-60f4-4f01-ac9c-4b032f69f600 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8756747342879', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1536353'] for agent, after_update {{(pid=102163) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 09 05:31:48.450524 dv-neutron-816802-2-hyperv neutron-server[102164]: DEBUG neutron.db.agents_db [None req-c278c599-0a88-442c-a0fc-7e1faaadd58f None None] Agent healthcheck: found 6 active agents {{(pid=102164) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}}